-- Logs begin at Mon 2022-08-29 14:51:06 UTC, end at Mon 2022-08-29 17:24:24 UTC. -- Aug 29 15:21:27.312581 n-d-836830-13 systemd[1]: Starting Devstack devstack@keystone.service... Aug 29 15:21:27.320274 n-d-836830-13 devstack@keystone.service[82131]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 29 15:21:27.322291 n-d-836830-13 devstack@keystone.service[82131]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 15:21:27 2022] *** Aug 29 15:21:27.322291 n-d-836830-13 devstack@keystone.service[82131]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 15:21:27.322291 n-d-836830-13 devstack@keystone.service[82131]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 15:21:27.322291 n-d-836830-13 devstack@keystone.service[82131]: nodename: n-d-836830-13 Aug 29 15:21:27.322291 n-d-836830-13 devstack@keystone.service[82131]: machine: x86_64 Aug 29 15:21:27.322291 n-d-836830-13 devstack@keystone.service[82131]: clock source: unix Aug 29 15:21:27.322291 n-d-836830-13 devstack@keystone.service[82131]: pcre jit disabled Aug 29 15:21:27.322291 n-d-836830-13 devstack@keystone.service[82131]: detected number of CPU cores: 4 Aug 29 15:21:27.322291 n-d-836830-13 devstack@keystone.service[82131]: current working directory: / Aug 29 15:21:27.322291 n-d-836830-13 devstack@keystone.service[82131]: detected binary path: /usr/bin/uwsgi-core Aug 29 15:21:27.323393 n-d-836830-13 devstack@keystone.service[82131]: your processes number limit is 47680 Aug 29 15:21:27.323393 n-d-836830-13 devstack@keystone.service[82131]: your memory page size is 4096 bytes Aug 29 15:21:27.323393 n-d-836830-13 devstack@keystone.service[82131]: detected max file descriptor number: 2048 Aug 29 15:21:27.323393 n-d-836830-13 devstack@keystone.service[82131]: lock engine: pthread robust mutexes Aug 29 15:21:27.323393 n-d-836830-13 devstack@keystone.service[82131]: thunder lock: enabled Aug 29 15:21:27.323393 n-d-836830-13 devstack@keystone.service[82131]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 29 15:21:27.323393 n-d-836830-13 devstack@keystone.service[82131]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 15:21:27.365031 n-d-836830-13 devstack@keystone.service[82131]: Python main interpreter initialized at 0x564c718719c0 Aug 29 15:21:27.365031 n-d-836830-13 devstack@keystone.service[82131]: python threads support enabled Aug 29 15:21:27.365031 n-d-836830-13 devstack@keystone.service[82131]: your server socket listen backlog is limited to 100 connections Aug 29 15:21:27.365031 n-d-836830-13 devstack@keystone.service[82131]: your mercy for graceful operations on workers is 90 seconds Aug 29 15:21:27.365402 n-d-836830-13 devstack@keystone.service[82131]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 15:21:27.365504 n-d-836830-13 devstack@keystone.service[82131]: *** Operational MODE: preforking *** Aug 29 15:21:27.365804 n-d-836830-13 devstack@keystone.service[82131]: *** uWSGI is running in multiple interpreter mode *** Aug 29 15:21:27.365804 n-d-836830-13 devstack@keystone.service[82131]: spawned uWSGI master process (pid: 82131) Aug 29 15:21:27.366021 n-d-836830-13 systemd[1]: Started Devstack devstack@keystone.service. Aug 29 15:21:27.366732 n-d-836830-13 devstack@keystone.service[82131]: spawned uWSGI worker 1 (pid: 82148, cores: 1) Aug 29 15:21:27.369420 n-d-836830-13 devstack@keystone.service[82131]: spawned uWSGI worker 2 (pid: 82149, cores: 1) Aug 29 15:21:27.369420 n-d-836830-13 devstack@keystone.service[82131]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 15:21:31.709222 n-d-836830-13 devstack@keystone.service[82148]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 15:21:31.709222 n-d-836830-13 devstack@keystone.service[82148]: from cryptography.utils import int_from_bytes Aug 29 15:21:31.709986 n-d-836830-13 devstack@keystone.service[82148]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 15:21:31.709986 n-d-836830-13 devstack@keystone.service[82148]: from cryptography.utils import int_from_bytes Aug 29 15:21:31.714150 n-d-836830-13 devstack@keystone.service[82149]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 15:21:31.714150 n-d-836830-13 devstack@keystone.service[82149]: from cryptography.utils import int_from_bytes Aug 29 15:21:31.714714 n-d-836830-13 devstack@keystone.service[82149]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 15:21:31.714714 n-d-836830-13 devstack@keystone.service[82149]: from cryptography.utils import int_from_bytes Aug 29 15:21:31.760861 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 15:21:31.761059 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 15:21:31.761229 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] command line args: [] {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 15:21:31.761503 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 15:21:31.761683 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ================================================================================ {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 15:21:31.761940 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] admin_token = **** {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.762188 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] config_dir = [] {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.762382 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.762565 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] config_source = [] {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.762751 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] debug = True {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.762955 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.763484 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.763569 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] insecure_debug = False {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.763637 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 15:21:31.763780 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.763861 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 15:21:31.763984 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] command line args: [] {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 15:21:31.764060 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.764250 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 15:21:31.764335 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] list_limit = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.764439 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ================================================================================ {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 15:21:31.764513 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] log_config_append = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.764604 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.764675 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] admin_token = **** {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.764784 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] log_dir = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.764890 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] config_dir = [] {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.764967 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] log_file = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.765094 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.765173 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.765369 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] config_source = [] {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.765463 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.765555 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] debug = True {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.765650 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.765846 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.765997 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.766092 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.766171 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.766243 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] insecure_debug = False {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.766317 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.766388 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.766456 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.766594 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.766685 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.766824 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] list_limit = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.766915 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.766988 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] log_config_append = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.767179 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.767265 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.767342 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] log_dir = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.767413 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.767504 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] log_file = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.767609 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.767736 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.767837 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.767982 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.768086 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] notification_format = cadf {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.768231 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.768339 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.768482 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.768655 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.768790 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.83/identity {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.768869 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.768992 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] publish_errors = False {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.769096 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.769214 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.769360 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.769455 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.769594 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.769697 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.769827 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.769911 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.770057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.770145 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.770286 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.770369 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] standard_threads = False {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.770607 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] strict_password_check = False {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.770708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.770780 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] notification_format = cadf {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.770849 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.770912 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] use_eventlog = False {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.771041 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.771170 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] use_journal = False {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.771336 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] use_json = False {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.771464 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] use_stderr = False {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.771619 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.83/identity {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.771697 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] use_syslog = False {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.771799 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] publish_errors = False {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.771879 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] watch_log_file = False {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.771958 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.772082 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.772229 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.772328 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.772412 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.772592 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.772675 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.772833 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.772973 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.773093 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] standard_threads = False {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.773167 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.773280 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] strict_password_check = False {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.773365 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.773516 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.773593 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.773690 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] use_eventlog = False {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.773766 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.773863 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] use_journal = False {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.774011 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.774108 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] use_json = False {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.774182 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] use_stderr = False {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.774285 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.774364 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] use_syslog = False {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.774502 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.774603 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] watch_log_file = False {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:21:31.774737 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.774814 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.775611 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.775708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.775819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.776070 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.776154 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.776320 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.776494 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.776582 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.776755 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.776840 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.777043 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.777118 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.777290 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.777403 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.777511 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.777668 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.777742 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.777811 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.777991 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.778067 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.778247 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.778358 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.778480 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.778558 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.778717 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.778799 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.778935 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.779064 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.779266 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.779354 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.779424 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.779493 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.779672 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.779763 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.779922 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.779998 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.780156 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.780238 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.780390 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.780467 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.780638 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.780713 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.780888 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.780969 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.781127 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.781209 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.781380 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.781455 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.781614 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.781688 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.781853 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.781931 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.782094 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.782216 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.782318 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.782393 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.782550 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.782626 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.782780 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.782860 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.783014 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.783145 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.783303 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.783377 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.783492 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.783567 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.783732 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.783806 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.783971 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.784054 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.784201 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.784275 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.784434 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.784509 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.784662 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.784737 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.784894 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.784969 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.785131 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.785206 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.785356 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.785432 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.785585 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.785666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.785814 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.785889 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.786043 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.786120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.786276 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.786351 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.786509 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.786583 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.786733 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.786808 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.786963 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.787073 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.787237 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.787346 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.787473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.787567 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.787704 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.787780 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.787949 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.788024 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.788180 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.788257 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.788410 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.788488 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.788642 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.788717 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.788872 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.788949 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.789137 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.789228 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.789392 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.789476 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.789616 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.789699 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.789862 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.789938 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.790093 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.790170 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.790328 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.790415 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.790623 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] cache.enabled = True {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.790706 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.790976 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.791172 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.791309 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.791465 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.791640 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.791757 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.791862 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.791958 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.792052 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.792155 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.792251 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.792347 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.792440 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.792590 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.792667 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.792831 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.792915 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.793071 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.793146 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.793307 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.793394 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.793541 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.793659 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.793775 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.793902 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.794026 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.794102 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] cache.enabled = True {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.794266 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.794344 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.794510 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.794589 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.794748 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.794828 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.795039 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.795120 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.795236 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.795348 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.795468 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.795585 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.795675 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.795836 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.795950 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.796056 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.796189 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.796263 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.796387 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.796502 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.796621 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.796763 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.796849 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.797003 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.797081 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.797249 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.797342 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.797486 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.797563 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.797724 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.797801 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.797971 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.798091 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.798206 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.798282 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] auth.external = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.798456 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] auth.mapped = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.798581 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.798710 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.798830 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.798963 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.799119 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.799197 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.799267 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] auth.password = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.799345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.799417 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] auth.token = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.799561 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.799639 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.799786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.799871 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] catalog.caching = True {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.800013 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.800090 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.800245 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.800326 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.800490 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.800573 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.800725 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.800851 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.800985 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.801124 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.801249 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.801374 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] credential.caching = True {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.801504 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.801637 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] credential.driver = sql {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.801771 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] auth.external = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.801898 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.802023 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] auth.mapped = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.802152 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.802302 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.802424 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.802508 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.802581 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.802652 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.802720 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] auth.password = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.802890 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.802971 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] auth.token = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.803171 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.803251 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.803407 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] catalog.caching = True {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.803491 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.803663 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.803747 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.803948 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.804035 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.804200 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.804277 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.804442 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.804517 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.804682 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.804759 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.804944 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.805020 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] credential.caching = True {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.805183 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] federation.caching = True {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.805261 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] credential.driver = sql {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.805421 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.805499 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.805663 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.805739 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] federation.driver = sql {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.805910 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.805987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.806677 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.806820 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.806931 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.807011 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.807201 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.807509 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.807613 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.807688 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.807758 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.807946 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.808025 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.808212 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.808307 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.808502 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.808635 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.808738 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] identity.caching = True {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.808816 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.808992 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.809083 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.809230 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.809310 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.809485 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.809563 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.809979 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] federation.caching = True {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.810142 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.810218 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.810288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] identity.driver = sql {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.810447 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] federation.driver = sql {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.810526 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.810693 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.810779 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.810922 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.811004 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.811194 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.811273 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.811431 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.811509 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.811666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.811744 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.811901 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.811983 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.812144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.812221 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.812375 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.812452 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.812620 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.812696 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.812852 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] identity.caching = True {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.812931 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.813097 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.813174 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.813341 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.813418 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.813574 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.813652 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.813805 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.813882 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.814042 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.814118 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] identity.driver = sql {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.814266 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.814344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.814504 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.814618 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.814750 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.814832 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.814993 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.815097 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.815248 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.815335 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.815476 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.815566 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.815741 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.815831 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.815945 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.816025 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.816188 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.816267 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.816433 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.816521 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.816688 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.816767 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.816941 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.817020 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.817178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.817258 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.817417 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.817497 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.817651 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ldap.password = **** {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.817730 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.817892 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.817972 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.818131 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.818279 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.818377 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.818512 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.818599 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.818749 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.818835 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.818990 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.819091 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.819255 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.819346 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.819505 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.819584 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.819737 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.819812 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.819986 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.820083 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.820232 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.820311 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.820465 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.820543 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.820704 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.820790 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.820943 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.821021 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.821168 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.821245 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ldap.user = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.821407 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.821493 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.821666 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ldap.password = **** {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.821743 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.822531 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.822764 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.822863 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.823071 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.823156 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.823328 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.823446 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.823566 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.823690 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.823800 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.823928 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.824122 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.824213 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.824339 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.824427 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.824635 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.824721 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.824864 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.824943 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.825115 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.825205 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.825361 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.825440 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.825598 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.825694 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.825830 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.825918 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.826062 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.826141 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.826291 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ldap.user = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.826369 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.826527 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.826613 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.826766 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.826843 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.826997 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.827095 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.827260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.827359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.827499 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.827579 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.827739 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.827816 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.827976 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.828063 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.828204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.828282 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.828459 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] policy.driver = sql {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.828535 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.828694 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.828783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.828940 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.829021 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.829166 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.829285 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.829403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] receipt.caching = True {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.829570 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.829652 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.829724 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.829938 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.830016 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.830182 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.830268 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.830425 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.830541 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.830653 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.830737 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.830897 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.830993 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] resource.caching = True {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.831157 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.831238 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.831396 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.831506 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] resource.driver = sql {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.831628 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.831720 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.831861 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.831939 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.832104 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.832183 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.832350 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] revoke.caching = True {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.832482 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.832587 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.832663 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.832827 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.832903 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] policy.driver = sql {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.833071 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] role.cache_time = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.833156 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.833310 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] role.caching = True {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.833386 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.833557 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.833639 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] role.driver = sql {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.833790 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] role.list_limit = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.833945 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] receipt.caching = True {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.834043 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.834120 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.834296 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.834374 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.834549 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.834634 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.834800 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.834878 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.835060 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.835156 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.835303 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] resource.caching = True {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.835395 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.835551 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.835630 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.835803 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.835881 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] resource.driver = sql {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.836042 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.836121 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.836292 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.836371 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.836543 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.836621 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.836794 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.836873 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] revoke.caching = True {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.837044 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.837122 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.837348 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.837474 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.837714 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.837792 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] role.cache_time = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.837967 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.838163 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] role.caching = True {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.838241 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.838440 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] role.driver = sql {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.838527 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.838676 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] role.list_limit = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.838754 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.838928 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.839006 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.839204 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.839333 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.839463 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.839543 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.839706 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.839784 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.839941 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.840033 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.840177 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.840255 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.840411 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.840524 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.840665 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.840844 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.840934 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.841007 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.841164 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.841244 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.841404 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.841492 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.841646 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.841724 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.841999 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] token.cache_time = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.842089 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.842163 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] token.caching = True {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.842325 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.842406 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.842566 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.842646 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] token.provider = fernet {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.842864 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.842962 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.843089 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.843171 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.843342 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.843419 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.843584 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.843675 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.843831 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.843910 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.844081 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.844183 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.844329 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.844418 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] trust.driver = sql {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.844565 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.844643 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.844793 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.844869 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.845025 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.845110 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.845292 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.845381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.845505 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.845584 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.845754 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.845844 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.845999 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.846085 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.846268 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.846346 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.846531 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] database.connection = **** {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.846609 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.846772 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] token.cache_time = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.846863 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.847035 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.847116 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] token.caching = True {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.847278 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.847355 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.847521 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.847610 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] token.provider = fernet {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.847759 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.847837 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.847998 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.848075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.848235 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.848320 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.848474 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.848551 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.848719 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.848797 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.848957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.849043 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.849202 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.849280 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] trust.driver = sql {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.849440 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.849524 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.849672 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.849756 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.849908 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.849985 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.850151 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.850227 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.850400 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.850489 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.850623 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.850701 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.850859 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.850944 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.851047 n-d-836830-13 devstack@keystone.service[82148]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 15:21:31.851195 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.851456 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] database.connection = **** {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.851699 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.851946 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.852207 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.852466 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.852700 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.852985 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.853371 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.853761 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.854013 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.854255 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.854501 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.854740 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.854991 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.855255 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.855499 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.855818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.856072 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.856311 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:21:31.856478 n-d-836830-13 devstack@keystone.service[82149]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 15:21:31.881211 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=82148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:31.881444 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=82148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:31.881671 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=82148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:31.882875 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=82149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:31.883131 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=82149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:31.883359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=82149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:31.891339 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=82148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:31.892549 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=82149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:31.920116 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=82148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:31.920353 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=82148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:31.921672 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=82149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:31.921901 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=82149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:31.975315 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=82148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:31.975489 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=82149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:32.025955 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=82149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:32.026180 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=82149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:32.027515 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=82148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:32.027752 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=82148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:32.182431 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:32.182663 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=82148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:32.182869 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=82148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:32.183117 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=82148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:32.183340 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=82148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:32.183558 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=82148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:32.188152 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:32.188385 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=82149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:32.188610 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=82149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:32.188823 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=82149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:32.189039 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=82149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:32.189253 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=82149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:32.206777 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:32.206893 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:32.207007 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=82149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:32.207108 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=82148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:32.207254 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=82149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:32.207353 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=82148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:32.207478 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=82149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:32.207562 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=82148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:32.207698 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=82149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:32.207780 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=82148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:32.207915 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=82149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:32.207998 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=82148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:32.208130 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:32.208212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:32.219310 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=82148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:32.219759 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=82149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:32.232821 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:32.232983 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=82148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:32.233219 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=82148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:32.233436 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:32.233537 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=82148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:32.233656 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=82148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:32.233725 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=82149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:32.233879 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=82148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:32.233961 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=82149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:32.234094 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:32.234172 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=82149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:32.234304 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=82149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:32.234515 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=82149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:32.234727 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:21:32.251713 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.251925 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 15:21:32.252193 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.252275 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.252401 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 15:21:32.252482 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 15:21:32.252723 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.252813 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.252922 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 15:21:32.253001 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.253195 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.253283 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.253487 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.253703 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.253965 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.254225 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.263227 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.263510 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.263783 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.264070 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.264160 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.264359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.264631 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.264917 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.271068 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=82148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:21:32.271833 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=82149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:21:32.273976 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=82148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:21:32.274268 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.274558 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.274834 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=82149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:21:32.274916 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.275199 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.275320 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.275471 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.275751 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.275839 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.276033 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.276199 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.276312 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.276531 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.276611 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.276852 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.276931 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.277190 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.277561 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.277950 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.278234 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.278513 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.300165 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.301632 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=82148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:21:32.301923 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.302230 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.303716 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=82149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:21:32.304062 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.307272 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=82148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:21:32.307576 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.307865 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.310071 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=82149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:21:32.310353 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.310634 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.314649 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=82148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:21:32.314947 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.316926 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=82149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:21:32.317209 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.318936 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=82148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:21:32.319256 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.319555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.319853 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.320135 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.321256 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=82149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:21:32.321546 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.321948 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.322259 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.322425 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.322558 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.322708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.322865 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.322987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.323284 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.323555 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.338686 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.338965 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.341169 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.341441 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.342855 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=82148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:21:32.345282 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=82149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:21:32.345998 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.346312 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.348485 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.348779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.350679 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=82148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:21:32.353525 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=82149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:21:32.354434 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=82148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:21:32.357105 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=82149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:21:32.357569 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.357878 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.358172 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.358462 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.358747 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.359162 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.360683 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.361047 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.361335 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.361629 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.361918 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.362261 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.375543 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=82148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:21:32.375836 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.376108 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.376374 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.379267 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=82149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:21:32.379555 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.379825 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.380086 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.383159 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.384846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.386398 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.386679 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.387141 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.388660 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.389356 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=82148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:21:32.389643 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.389930 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.390187 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.390277 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.390461 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.390540 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.393081 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=82149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:21:32.393372 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.393766 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.394049 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.394339 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.401852 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=82148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:21:32.402136 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.402421 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.402705 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.402998 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.403313 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.403609 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.406780 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=82149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:21:32.407272 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.407651 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.407937 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.408303 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.408590 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.408920 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.419613 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=82148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:21:32.422643 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=82148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:21:32.425430 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=82149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:21:32.425536 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.426986 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.428348 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=82149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:21:32.428496 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=82148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:21:32.428780 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.429067 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.431868 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.433453 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.435475 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=82149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:21:32.435761 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.436049 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.436540 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.438026 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=82148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:21:32.440947 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.441254 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.441547 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.441830 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.442423 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.443906 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=82149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:21:32.447103 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.447566 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.447853 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.448135 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.449846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=82148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:21:32.450139 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.450428 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.456057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=82149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:21:32.456350 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.456630 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.457360 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=82148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:21:32.457646 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.457945 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.458229 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.458509 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.458787 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.459107 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.459401 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.459678 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.459960 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.460237 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.460504 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.460775 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.461056 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=82148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.463833 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=82149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:21:32.464113 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.464395 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.464672 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.464976 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.465315 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.465606 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.465884 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.466164 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.466498 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.466772 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.467065 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.467433 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.467709 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=82149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:21:32.496465 n-d-836830-13 devstack@keystone.service[82148]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564c718719c0 pid: 82148 (default app) Aug 29 15:21:32.500087 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9652e0eb-da3d-4ee5-8ef3-b1157da5da4b None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:32.500381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9652e0eb-da3d-4ee5-8ef3-b1157da5da4b None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:32.500657 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9652e0eb-da3d-4ee5-8ef3-b1157da5da4b None None] PATH_INFO: `/v3` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:32.503915 n-d-836830-13 devstack@keystone.service[82149]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564c718719c0 pid: 82149 (default app) Aug 29 15:21:32.504855 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1/1] 10.222.0.83 () {50 vars in 791 bytes} [Mon Aug 29 15:21:32 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:21:39.125220 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3a4c9-b557-4abf-8273-947ef18eabce None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:39.125721 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3a4c9-b557-4abf-8273-947ef18eabce None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:39.125721 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3a4c9-b557-4abf-8273-947ef18eabce None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:39.129990 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1/2] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:21:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:21:39.135302 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25784e2b-4dfe-4b42-a1f8-fb446c641249 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:39.135841 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25784e2b-4dfe-4b42-a1f8-fb446c641249 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:39.135841 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25784e2b-4dfe-4b42-a1f8-fb446c641249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:39.207191 n-d-836830-13 devstack@keystone.service[82148]: INFO dbcounter [None req-25784e2b-4dfe-4b42-a1f8-fb446c641249 None None] Registered counter for database keystone Aug 29 15:21:39.225981 n-d-836830-13 devstack@keystone.service[82148]: DEBUG oslo_db.sqlalchemy.engines [None req-25784e2b-4dfe-4b42-a1f8-fb446c641249 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 15:21:39.232938 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writer thread running {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 15:21:39.411982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG passlib.handlers.bcrypt [None req-25784e2b-4dfe-4b42-a1f8-fb446c641249 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=82148) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 29 15:21:39.412274 n-d-836830-13 devstack@keystone.service[82148]: DEBUG passlib.handlers.bcrypt [None req-25784e2b-4dfe-4b42-a1f8-fb446c641249 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=82148) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 29 15:21:39.470496 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-25784e2b-4dfe-4b42-a1f8-fb446c641249 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:21:39.472133 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-25784e2b-4dfe-4b42-a1f8-fb446c641249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:21:39.600482 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2/3] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:21:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 29 15:21:40.090607 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3a4c9-b557-4abf-8273-947ef18eabce None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:21:40.160271 n-d-836830-13 devstack@keystone.service[82149]: INFO dbcounter [None req-9ee3a4c9-b557-4abf-8273-947ef18eabce None None] Registered counter for database keystone Aug 29 15:21:40.182038 n-d-836830-13 devstack@keystone.service[82149]: DEBUG oslo_db.sqlalchemy.engines [None req-9ee3a4c9-b557-4abf-8273-947ef18eabce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82149) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 15:21:40.191290 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writer thread running {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 15:21:40.312632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3a4c9-b557-4abf-8273-947ef18eabce None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:21:40.316945 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2139d18b-ef96-41a7-bdcc-877e3af3fed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:21:40.317575 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139d18b-ef96-41a7-bdcc-877e3af3fed8 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:40.317855 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139d18b-ef96-41a7-bdcc-877e3af3fed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:40.318127 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139d18b-ef96-41a7-bdcc-877e3af3fed8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:40.326419 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2139d18b-ef96-41a7-bdcc-877e3af3fed8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:21:40.379078 n-d-836830-13 devstack@keystone.service[82149]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2139d18b-ef96-41a7-bdcc-877e3af3fed8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 29 15:21:40.379368 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2139d18b-ef96-41a7-bdcc-877e3af3fed8 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:21:40.389609 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2/4] 10.222.0.83 () {58 vars in 1324 bytes} [Mon Aug 29 15:21:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:21:40.395602 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25784e2b-4dfe-4b42-a1f8-fb446c641249 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:21:40.410636 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25784e2b-4dfe-4b42-a1f8-fb446c641249 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:21:40.415462 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d768e-671f-42fe-b0ea-a4efbcaa428f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:21:40.416554 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d768e-671f-42fe-b0ea-a4efbcaa428f admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:40.416835 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d768e-671f-42fe-b0ea-a4efbcaa428f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:40.417109 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d768e-671f-42fe-b0ea-a4efbcaa428f admin admin] PATH_INFO: `/v3/projects/2be1d9508c364610be9aca20e58e1d6a` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:40.418682 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d768e-671f-42fe-b0ea-a4efbcaa428f admin admin] RBAC: Authorizing `identity:get_project(project_id=2be1d9508c364610be9aca20e58e1d6a)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:21:40.473092 n-d-836830-13 devstack@keystone.service[82148]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ca3d768e-671f-42fe-b0ea-a4efbcaa428f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 29 15:21:40.473442 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d768e-671f-42fe-b0ea-a4efbcaa428f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:21:40.478242 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3/5] 10.222.0.83 () {56 vars in 1207 bytes} [Mon Aug 29 15:21:40 2022] GET /identity/v3/projects/2be1d9508c364610be9aca20e58e1d6a => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:21:42.372545 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc87790-97a3-43f2-9726-55fda6e86f39 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:42.373149 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc87790-97a3-43f2-9726-55fda6e86f39 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:42.373149 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc87790-97a3-43f2-9726-55fda6e86f39 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:42.377193 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3/6] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:21:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:21:42.382766 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15399b01-f8d7-4f1e-a337-2594417cc2a6 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:42.383239 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15399b01-f8d7-4f1e-a337-2594417cc2a6 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:42.383239 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15399b01-f8d7-4f1e-a337-2594417cc2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:42.403477 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-15399b01-f8d7-4f1e-a337-2594417cc2a6 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:21:42.404992 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-15399b01-f8d7-4f1e-a337-2594417cc2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:21:42.412890 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4/7] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:21:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 29 15:21:42.678879 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc87790-97a3-43f2-9726-55fda6e86f39 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:21:42.692187 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc87790-97a3-43f2-9726-55fda6e86f39 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:21:42.696805 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8eeb3-e927-4e7b-900a-6a397c3a5abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:21:42.697421 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8eeb3-e927-4e7b-900a-6a397c3a5abc admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:42.697702 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8eeb3-e927-4e7b-900a-6a397c3a5abc admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:42.697976 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8eeb3-e927-4e7b-900a-6a397c3a5abc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:42.707193 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba8eeb3-e927-4e7b-900a-6a397c3a5abc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:21:42.709004 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba8eeb3-e927-4e7b-900a-6a397c3a5abc admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:21:42.718114 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4/8] 10.222.0.83 () {58 vars in 1324 bytes} [Mon Aug 29 15:21:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:21:42.723739 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15399b01-f8d7-4f1e-a337-2594417cc2a6 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:21:42.733646 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15399b01-f8d7-4f1e-a337-2594417cc2a6 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:21:42.738032 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc8a39d-5125-48ed-b013-65b30a123fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:21:42.738658 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8a39d-5125-48ed-b013-65b30a123fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:42.738942 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8a39d-5125-48ed-b013-65b30a123fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:42.739253 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8a39d-5125-48ed-b013-65b30a123fb9 admin admin] PATH_INFO: `/v3/users/6db5f614a81044e59454d15b8c60cf8f` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:42.740758 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc8a39d-5125-48ed-b013-65b30a123fb9 admin admin] RBAC: Authorizing `identity:get_user(user_id=6db5f614a81044e59454d15b8c60cf8f)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:21:42.743486 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc8a39d-5125-48ed-b013-65b30a123fb9 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:21:42.745057 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 5/9] 10.222.0.83 () {56 vars in 1198 bytes} [Mon Aug 29 15:21:42 2022] GET /identity/v3/users/6db5f614a81044e59454d15b8c60cf8f => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:21:44.715767 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed09f1-d7b9-46ff-96dd-417f8aa76f74 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:44.716286 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed09f1-d7b9-46ff-96dd-417f8aa76f74 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:44.716286 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed09f1-d7b9-46ff-96dd-417f8aa76f74 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:44.717634 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 5/10] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:21:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:21:44.722805 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e699247-33fa-412f-8211-80720202847d None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:44.723231 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e699247-33fa-412f-8211-80720202847d None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:44.723387 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e699247-33fa-412f-8211-80720202847d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:44.743434 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-7e699247-33fa-412f-8211-80720202847d None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:21:44.744607 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7e699247-33fa-412f-8211-80720202847d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:21:44.756671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2171a-0479-48d6-8c66-09f047ec5ea7 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:44.757125 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2171a-0479-48d6-8c66-09f047ec5ea7 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:44.757579 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2171a-0479-48d6-8c66-09f047ec5ea7 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:44.759092 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 6/11] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:21:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:21:44.764222 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2fdceb-156f-426d-8610-e83af63db4d6 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:44.764498 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2fdceb-156f-426d-8610-e83af63db4d6 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:44.764772 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2fdceb-156f-426d-8610-e83af63db4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:44.808653 n-d-836830-13 devstack@keystone.service[82149]: DEBUG passlib.handlers.bcrypt [None req-3b2fdceb-156f-426d-8610-e83af63db4d6 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=82149) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 29 15:21:44.809045 n-d-836830-13 devstack@keystone.service[82149]: DEBUG passlib.handlers.bcrypt [None req-3b2fdceb-156f-426d-8610-e83af63db4d6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=82149) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 29 15:21:44.825870 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 6/12] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:21:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:21:44.859568 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-3b2fdceb-156f-426d-8610-e83af63db4d6 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:21:44.861164 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3b2fdceb-156f-426d-8610-e83af63db4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:21:44.962573 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 7/13] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:21:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 15:21:45.094678 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e699247-33fa-412f-8211-80720202847d None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:21:45.120962 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:21:45.208311 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e699247-33fa-412f-8211-80720202847d None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:21:45.241923 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2fdceb-156f-426d-8610-e83af63db4d6 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:21:45.242921 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7c01c-59ab-4a90-8b9d-14658048a1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:21:45.243597 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7c01c-59ab-4a90-8b9d-14658048a1c5 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:45.243877 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7c01c-59ab-4a90-8b9d-14658048a1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:45.244153 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7c01c-59ab-4a90-8b9d-14658048a1c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:45.255536 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b7c01c-59ab-4a90-8b9d-14658048a1c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:21:45.265320 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-d7b7c01c-59ab-4a90-8b9d-14658048a1c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:21:45.265320 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:21:45.265320 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:21:45.265320 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:21:45.265320 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:21:45.265320 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:21:45.265320 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:21:45.265320 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:21:45.265320 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:21:45.265320 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:21:45.265320 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:21:45.265320 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:21:45.265320 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:21:45.265320 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:21:45.265320 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:21:45.265320 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:21:45.266445 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:21:45.266445 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:21:45.266445 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:21:45.266445 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:21:45.266445 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:21:45.266445 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:21:45.266445 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:21:45.266445 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:21:45.266445 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:21:45.266445 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:21:45.266445 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:21:45.266445 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:21:45.266445 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:21:45.266445 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:21:45.266445 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:21:45.266445 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:21:45.267507 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:21:45.267507 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:21:45.267507 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:21:45.267507 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:21:45.267507 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:21:45.267507 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:21:45.267507 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:21:45.267507 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:21:45.267507 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:21:45.267507 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:21:45.267507 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:21:45.267507 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:21:45.267507 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 7/14] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 15:21:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:21:45.272973 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7c01c-59ab-4a90-8b9d-14658048a1c5 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:21:45.348200 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2fdceb-156f-426d-8610-e83af63db4d6 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:21:45.350533 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:21:45.355832 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:21:45.375984 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7c01c-59ab-4a90-8b9d-14658048a1c5 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:21:45.388502 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c7748-cf67-4d00-8923-e344af468b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:21:45.389440 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c7748-cf67-4d00-8923-e344af468b5f None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:45.389788 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c7748-cf67-4d00-8923-e344af468b5f None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:45.390142 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c7748-cf67-4d00-8923-e344af468b5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:45.410356 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5decf791-b86d-4abc-8a7a-0694e9fc0e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:21:45.410992 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5decf791-b86d-4abc-8a7a-0694e9fc0e89 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:45.411296 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5decf791-b86d-4abc-8a7a-0694e9fc0e89 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:45.411566 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5decf791-b86d-4abc-8a7a-0694e9fc0e89 None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:45.412248 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5decf791-b86d-4abc-8a7a-0694e9fc0e89 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:21:45.412553 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5decf791-b86d-4abc-8a7a-0694e9fc0e89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:21:45.414108 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5decf791-b86d-4abc-8a7a-0694e9fc0e89 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:21:45.425920 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 8/15] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:21:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:21:45.433298 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5decf791-b86d-4abc-8a7a-0694e9fc0e89 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:21:45.467411 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6c7748-cf67-4d00-8923-e344af468b5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:21:45.468951 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6c7748-cf67-4d00-8923-e344af468b5f None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:21:45.548684 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5decf791-b86d-4abc-8a7a-0694e9fc0e89 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:21:45.567471 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 8/16] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:21:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 15:21:45.573785 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c7748-cf67-4d00-8923-e344af468b5f None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:21:45.576496 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:21:45.584188 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f923413c-7c41-4e81-be1d-4cf26d9dd91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:21:45.584966 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923413c-7c41-4e81-be1d-4cf26d9dd91f None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:45.585245 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923413c-7c41-4e81-be1d-4cf26d9dd91f None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:45.585525 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923413c-7c41-4e81-be1d-4cf26d9dd91f None admin] PATH_INFO: `/v3/users/6db5f614a81044e59454d15b8c60cf8f` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:45.586685 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f923413c-7c41-4e81-be1d-4cf26d9dd91f None admin] RBAC: Authorizing `identity:get_user(user_id=6db5f614a81044e59454d15b8c60cf8f)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:21:45.588184 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f923413c-7c41-4e81-be1d-4cf26d9dd91f None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:21:45.589761 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 9/17] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 15:21:45 2022] GET /identity/v3/users/6db5f614a81044e59454d15b8c60cf8f => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:21:45.595234 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f923413c-7c41-4e81-be1d-4cf26d9dd91f None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:21:45.610233 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:21:45.675319 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c7748-cf67-4d00-8923-e344af468b5f None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:21:45.695860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f923413c-7c41-4e81-be1d-4cf26d9dd91f None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:21:45.713360 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4df340-eadd-4a97-a0f6-8c9eb4b759ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:21:45.714224 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4df340-eadd-4a97-a0f6-8c9eb4b759ff None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:45.714505 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4df340-eadd-4a97-a0f6-8c9eb4b759ff None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:45.714779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4df340-eadd-4a97-a0f6-8c9eb4b759ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:45.731567 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af986578-3f29-4be3-b3a8-2be8c8863408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:21:45.732204 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af986578-3f29-4be3-b3a8-2be8c8863408 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:45.732484 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af986578-3f29-4be3-b3a8-2be8c8863408 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:45.732759 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af986578-3f29-4be3-b3a8-2be8c8863408 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:45.733676 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4df340-eadd-4a97-a0f6-8c9eb4b759ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:21:45.734038 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af986578-3f29-4be3-b3a8-2be8c8863408 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:21:45.735237 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4df340-eadd-4a97-a0f6-8c9eb4b759ff None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:21:45.735346 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af986578-3f29-4be3-b3a8-2be8c8863408 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:21:45.737063 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 10/18] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:21:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:21:45.743440 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af986578-3f29-4be3-b3a8-2be8c8863408 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:21:45.756903 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-ca4df340-eadd-4a97-a0f6-8c9eb4b759ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:21:45.756903 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:21:45.756903 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:21:45.756903 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:21:45.756903 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:21:45.756903 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:21:45.756903 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:21:45.756903 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:21:45.756903 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:21:45.756903 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:21:45.756903 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:21:45.756903 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:21:45.756903 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:21:45.756903 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:21:45.756903 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:21:45.756903 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:21:45.757871 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:21:45.757871 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:21:45.757871 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:21:45.757871 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:21:45.757871 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:21:45.757871 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:21:45.757871 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:21:45.757871 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:21:45.757871 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:21:45.757871 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:21:45.757871 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:21:45.757871 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:21:45.757871 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:21:45.757871 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:21:45.757871 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:21:45.757871 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:21:45.757871 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:21:45.758697 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:21:45.758697 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:21:45.758697 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:21:45.758697 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 9/19] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:21:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:21:45.763892 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4df340-eadd-4a97-a0f6-8c9eb4b759ff None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:21:45.824084 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:21:45.830160 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:21:45.851625 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af986578-3f29-4be3-b3a8-2be8c8863408 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:21:45.873134 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4df340-eadd-4a97-a0f6-8c9eb4b759ff None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:21:45.885910 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1133209-da0e-41ec-9fad-9906c7cbb550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:21:45.886519 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1133209-da0e-41ec-9fad-9906c7cbb550 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:45.886799 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1133209-da0e-41ec-9fad-9906c7cbb550 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:45.887105 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1133209-da0e-41ec-9fad-9906c7cbb550 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:45.887826 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1133209-da0e-41ec-9fad-9906c7cbb550 None admin] RBAC: Adding query filter params (role.id=4bb2bbb7bb544610877949fc933504d2, scope.domain.id=default, user.id=6db5f614a81044e59454d15b8c60cf8f) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:21:45.888131 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1133209-da0e-41ec-9fad-9906c7cbb550 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:21:45.889571 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1133209-da0e-41ec-9fad-9906c7cbb550 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:21:45.896048 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 11/20] 10.222.0.83 () {56 vars in 1322 bytes} [Mon Aug 29 15:21:45 2022] GET /identity/v3/role_assignments?user.id=6db5f614a81044e59454d15b8c60cf8f&scope.domain.id=default&role.id=4bb2bbb7bb544610877949fc933504d2 => generated 233 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:21:45.906999 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7176904-7777-4508-9dae-3951a4bc2e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:21:45.907664 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7176904-7777-4508-9dae-3951a4bc2e78 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:45.907944 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7176904-7777-4508-9dae-3951a4bc2e78 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:45.908225 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7176904-7777-4508-9dae-3951a4bc2e78 None admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:45.908893 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7176904-7777-4508-9dae-3951a4bc2e78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:21:45.909199 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7176904-7777-4508-9dae-3951a4bc2e78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:21:45.910650 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7176904-7777-4508-9dae-3951a4bc2e78 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:21:45.931694 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 10/21] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:21:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:21:48.065561 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf5914-40cd-451c-a127-055cd2b4e2e7 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:48.066561 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf5914-40cd-451c-a127-055cd2b4e2e7 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:48.067086 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf5914-40cd-451c-a127-055cd2b4e2e7 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:48.069579 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 12/22] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:21:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:21:48.075576 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a743e5-49a7-408f-b821-e5c59ed583fe None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:48.076449 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a743e5-49a7-408f-b821-e5c59ed583fe None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:48.076915 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a743e5-49a7-408f-b821-e5c59ed583fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:48.104872 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-06a743e5-49a7-408f-b821-e5c59ed583fe None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:21:48.106421 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-06a743e5-49a7-408f-b821-e5c59ed583fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:21:48.201908 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 11/23] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:21:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:21:48.352928 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b61d3-d80f-439c-9399-5cde8366830c None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:48.353519 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b61d3-d80f-439c-9399-5cde8366830c None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:48.354018 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b61d3-d80f-439c-9399-5cde8366830c None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:48.355577 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 13/24] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:21:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:21:48.372601 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a25f7-99e3-4565-b07c-f18d0c5d12f4 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:48.372888 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a25f7-99e3-4565-b07c-f18d0c5d12f4 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:48.373480 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a25f7-99e3-4565-b07c-f18d0c5d12f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:48.400058 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-e90a25f7-99e3-4565-b07c-f18d0c5d12f4 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:21:48.401638 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e90a25f7-99e3-4565-b07c-f18d0c5d12f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:21:48.455565 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:21:48.485768 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 12/25] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:21:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:21:48.593048 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb9cd2-b734-4d44-85ed-0ba59c0a083b None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:48.593361 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb9cd2-b734-4d44-85ed-0ba59c0a083b None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:48.593602 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb9cd2-b734-4d44-85ed-0ba59c0a083b None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:48.595096 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 14/26] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:21:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:21:48.601156 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f2f1d-f7e3-4570-926d-344f243d4902 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:48.601455 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f2f1d-f7e3-4570-926d-344f243d4902 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:48.601734 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f2f1d-f7e3-4570-926d-344f243d4902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:48.623589 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b47fd1-5c35-4646-b017-553ee445ace2 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:48.623846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b47fd1-5c35-4646-b017-553ee445ace2 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:48.624057 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b47fd1-5c35-4646-b017-553ee445ace2 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:48.625388 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 15/27] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:21:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:21:48.630833 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-6d9f2f1d-f7e3-4570-926d-344f243d4902 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:21:48.632773 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6d9f2f1d-f7e3-4570-926d-344f243d4902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:21:48.647551 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a05292-1356-4bd1-82cc-fb3e50fbf05d None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:48.647918 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a05292-1356-4bd1-82cc-fb3e50fbf05d None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:48.648105 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a05292-1356-4bd1-82cc-fb3e50fbf05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:48.674984 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-e1a05292-1356-4bd1-82cc-fb3e50fbf05d None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:21:48.676289 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e1a05292-1356-4bd1-82cc-fb3e50fbf05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:21:48.785494 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 13/28] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:21:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:21:48.790345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f2f1d-f7e3-4570-926d-344f243d4902 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:21:48.827179 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 16/29] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:21:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 29 15:21:48.833559 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a05292-1356-4bd1-82cc-fb3e50fbf05d None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:21:48.918366 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f2f1d-f7e3-4570-926d-344f243d4902 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:21:48.926766 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:21:48.960966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9400ca0-630d-412b-b7df-5ee3c5a35839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:21:48.961953 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9400ca0-630d-412b-b7df-5ee3c5a35839 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:48.962451 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9400ca0-630d-412b-b7df-5ee3c5a35839 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:48.962920 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9400ca0-630d-412b-b7df-5ee3c5a35839 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:48.977960 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9400ca0-630d-412b-b7df-5ee3c5a35839 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:21:48.985907 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-d9400ca0-630d-412b-b7df-5ee3c5a35839 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:21:48.985907 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:21:48.985907 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:21:48.985907 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:21:48.985907 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:21:48.985907 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:21:48.985907 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:21:48.985907 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:21:48.985907 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:21:48.985907 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:21:48.985907 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:21:48.985907 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:21:48.985907 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:21:48.985907 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:21:48.985907 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:21:48.985907 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:21:48.988325 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:21:48.988325 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:21:48.988325 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:21:48.988325 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:21:48.988325 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:21:48.988325 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:21:48.988325 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:21:48.988325 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:21:48.988325 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:21:48.988325 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:21:48.988325 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:21:48.988325 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:21:48.988325 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:21:48.988325 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:21:48.988325 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:21:48.988325 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:21:48.989098 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:21:48.989098 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:21:48.989098 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:21:48.989098 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:21:48.989098 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:21:48.989098 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:21:48.989098 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:21:48.989098 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:21:48.989098 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:21:48.989098 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:21:48.989098 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:21:48.989098 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:21:48.989098 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 14/30] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 15:21:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:21:48.994461 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9400ca0-630d-412b-b7df-5ee3c5a35839 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:21:49.027396 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:21:49.063348 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a05292-1356-4bd1-82cc-fb3e50fbf05d None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:21:49.155816 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cdce82-5c2b-466e-b7a5-bee4ee3ac1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:21:49.156558 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cdce82-5c2b-466e-b7a5-bee4ee3ac1ab None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:49.156778 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cdce82-5c2b-466e-b7a5-bee4ee3ac1ab None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:49.157058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cdce82-5c2b-466e-b7a5-bee4ee3ac1ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:49.169711 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cdce82-5c2b-466e-b7a5-bee4ee3ac1ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:21:49.171199 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cdce82-5c2b-466e-b7a5-bee4ee3ac1ab None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:21:49.181120 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9400ca0-630d-412b-b7df-5ee3c5a35839 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:21:49.192602 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-a9cdce82-5c2b-466e-b7a5-bee4ee3ac1ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:21:49.192602 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:21:49.192602 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:21:49.192602 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:21:49.192602 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:21:49.192602 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:21:49.192602 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:21:49.192602 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:21:49.192602 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:21:49.192602 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:21:49.192602 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:21:49.192602 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:21:49.192602 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:21:49.192602 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:21:49.192602 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:21:49.192602 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:21:49.193602 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:21:49.193602 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:21:49.193602 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:21:49.193602 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:21:49.193602 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:21:49.193602 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:21:49.193602 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:21:49.193602 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:21:49.193602 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:21:49.193602 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:21:49.193602 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:21:49.193602 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:21:49.193602 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:21:49.193602 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:21:49.193602 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:21:49.193602 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:21:49.193602 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:21:49.194517 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:21:49.194517 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:21:49.194517 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:21:49.194517 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 17/31] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:21:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:21:49.202230 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cdce82-5c2b-466e-b7a5-bee4ee3ac1ab None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:21:49.234736 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab382a9a-ede1-4c55-aa8e-a2dde1af462b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:21:49.235408 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab382a9a-ede1-4c55-aa8e-a2dde1af462b None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:49.235690 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab382a9a-ede1-4c55-aa8e-a2dde1af462b None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:49.235965 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab382a9a-ede1-4c55-aa8e-a2dde1af462b None admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:49.236655 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab382a9a-ede1-4c55-aa8e-a2dde1af462b None admin] RBAC: Adding query filter params (name=admin) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:21:49.236962 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab382a9a-ede1-4c55-aa8e-a2dde1af462b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:21:49.238392 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab382a9a-ede1-4c55-aa8e-a2dde1af462b None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:21:49.267901 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 15/32] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:21:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:21:49.268706 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab382a9a-ede1-4c55-aa8e-a2dde1af462b None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:21:49.312325 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:21:49.361583 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cdce82-5c2b-466e-b7a5-bee4ee3ac1ab None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:21:49.391196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab382a9a-ede1-4c55-aa8e-a2dde1af462b None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:21:49.391409 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:21:49.402040 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b2e710-05a0-46f2-9f65-664da17ce7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:21:49.402662 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2e710-05a0-46f2-9f65-664da17ce7de None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:49.402982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2e710-05a0-46f2-9f65-664da17ce7de None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:49.403287 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2e710-05a0-46f2-9f65-664da17ce7de None admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:49.404124 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b2e710-05a0-46f2-9f65-664da17ce7de None admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:21:49.404337 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b2e710-05a0-46f2-9f65-664da17ce7de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:21:49.405922 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b2e710-05a0-46f2-9f65-664da17ce7de None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:21:49.425629 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 18/33] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:21:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:21:49.426603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b2e710-05a0-46f2-9f65-664da17ce7de None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:21:49.431182 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f1893-fa9a-4e58-8328-71a6cd28de36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:21:49.432370 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f1893-fa9a-4e58-8328-71a6cd28de36 None admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:49.432842 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f1893-fa9a-4e58-8328-71a6cd28de36 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:49.433304 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f1893-fa9a-4e58-8328-71a6cd28de36 None admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:49.434180 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1f1893-fa9a-4e58-8328-71a6cd28de36 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:21:49.435815 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1f1893-fa9a-4e58-8328-71a6cd28de36 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:21:49.543059 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b2e710-05a0-46f2-9f65-664da17ce7de None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:21:49.565350 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 16/34] 10.222.0.83 () {60 vars in 1131 bytes} [Mon Aug 29 15:21:49 2022] POST /identity/v3/roles => generated 219 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:21:49.566699 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f1893-fa9a-4e58-8328-71a6cd28de36 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:21:49.581992 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c4210-97af-42d3-8b1a-d49d9e5c0cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:21:49.582668 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c4210-97af-42d3-8b1a-d49d9e5c0cde None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:49.583044 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c4210-97af-42d3-8b1a-d49d9e5c0cde None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:49.583301 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c4210-97af-42d3-8b1a-d49d9e5c0cde None admin] PATH_INFO: `/v3/users/6db5f614a81044e59454d15b8c60cf8f` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:49.584596 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4c4210-97af-42d3-8b1a-d49d9e5c0cde None admin] RBAC: Authorizing `identity:get_user(user_id=6db5f614a81044e59454d15b8c60cf8f)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:21:49.586182 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4c4210-97af-42d3-8b1a-d49d9e5c0cde None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:21:49.588189 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 19/35] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 15:21:49 2022] GET /identity/v3/users/6db5f614a81044e59454d15b8c60cf8f => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:21:49.588822 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c4210-97af-42d3-8b1a-d49d9e5c0cde None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:21:49.658463 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:21:49.675073 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:21:49.691800 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f1893-fa9a-4e58-8328-71a6cd28de36 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:21:49.722025 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c4210-97af-42d3-8b1a-d49d9e5c0cde None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:21:49.737412 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10cbe4a-6e7d-4d07-805e-0db58b4bef48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:21:49.738202 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10cbe4a-6e7d-4d07-805e-0db58b4bef48 None admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:49.738585 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10cbe4a-6e7d-4d07-805e-0db58b4bef48 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:49.739120 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10cbe4a-6e7d-4d07-805e-0db58b4bef48 None admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:49.740054 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10cbe4a-6e7d-4d07-805e-0db58b4bef48 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:21:49.742614 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10cbe4a-6e7d-4d07-805e-0db58b4bef48 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:21:49.762063 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 17/36] 10.222.0.83 () {60 vars in 1131 bytes} [Mon Aug 29 15:21:49 2022] POST /identity/v3/roles => generated 225 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:21:49.762904 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10cbe4a-6e7d-4d07-805e-0db58b4bef48 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:21:49.770204 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c4c33-02c3-4418-9334-8015e3e40a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:21:49.770907 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c4c33-02c3-4418-9334-8015e3e40a37 None admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:49.771918 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c4c33-02c3-4418-9334-8015e3e40a37 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:49.772258 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c4c33-02c3-4418-9334-8015e3e40a37 None admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:49.772938 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246c4c33-02c3-4418-9334-8015e3e40a37 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:21:49.774683 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246c4c33-02c3-4418-9334-8015e3e40a37 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:21:49.908895 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10cbe4a-6e7d-4d07-805e-0db58b4bef48 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:21:49.951950 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6221b1-50ee-4ceb-a6d5-5adc23b5ba23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:21:49.952912 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6221b1-50ee-4ceb-a6d5-5adc23b5ba23 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:49.953389 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6221b1-50ee-4ceb-a6d5-5adc23b5ba23 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:49.953991 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6221b1-50ee-4ceb-a6d5-5adc23b5ba23 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:49.955719 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6221b1-50ee-4ceb-a6d5-5adc23b5ba23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:21:49.957376 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6221b1-50ee-4ceb-a6d5-5adc23b5ba23 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:21:49.960048 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 18/37] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:21:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:21:49.961488 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59087037-e0c6-45d9-9a5f-19e22d872ca3 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:49.961777 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59087037-e0c6-45d9-9a5f-19e22d872ca3 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:49.962139 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59087037-e0c6-45d9-9a5f-19e22d872ca3 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:49.963745 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 19/38] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:21:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:21:49.967059 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 20/39] 10.222.0.83 () {60 vars in 1141 bytes} [Mon Aug 29 15:21:49 2022] POST /identity/v3/projects => generated 301 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:21:49.968627 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53554b-37f7-4797-925f-1df75e93bbbc None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:49.969066 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53554b-37f7-4797-925f-1df75e93bbbc None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:49.969507 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53554b-37f7-4797-925f-1df75e93bbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:49.973281 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c4c33-02c3-4418-9334-8015e3e40a37 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:21:49.993720 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-bf53554b-37f7-4797-925f-1df75e93bbbc None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:21:49.995823 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-bf53554b-37f7-4797-925f-1df75e93bbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:21:50.009656 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:21:50.092058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c4c33-02c3-4418-9334-8015e3e40a37 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:21:50.096388 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 20/40] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:21:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 15:21:50.106540 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:21:50.141234 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eea8b4-a391-4b64-a344-70086c4fef9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:21:50.142096 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eea8b4-a391-4b64-a344-70086c4fef9c None admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:50.142448 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eea8b4-a391-4b64-a344-70086c4fef9c None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:50.142801 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eea8b4-a391-4b64-a344-70086c4fef9c None admin] PATH_INFO: `/v3/domains/default/users/6db5f614a81044e59454d15b8c60cf8f/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:50.145139 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eea8b4-a391-4b64-a344-70086c4fef9c None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=6db5f614a81044e59454d15b8c60cf8f, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:21:50.147261 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eea8b4-a391-4b64-a344-70086c4fef9c None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:21:50.165386 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 21/41] 10.222.0.83 () {58 vars in 1361 bytes} [Mon Aug 29 15:21:49 2022] PUT /identity/v3/domains/default/users/6db5f614a81044e59454d15b8c60cf8f/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:21:50.202228 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9f6b2-23ab-4512-ba67-9000cab2a597 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:50.203172 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9f6b2-23ab-4512-ba67-9000cab2a597 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:50.203660 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9f6b2-23ab-4512-ba67-9000cab2a597 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:50.205671 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 21/42] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:21:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:21:50.212055 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407138f3-4d78-40a3-afce-60c0f7c9c8a9 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:50.212369 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407138f3-4d78-40a3-afce-60c0f7c9c8a9 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:50.212620 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407138f3-4d78-40a3-afce-60c0f7c9c8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:50.235271 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-407138f3-4d78-40a3-afce-60c0f7c9c8a9 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:21:50.236892 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-407138f3-4d78-40a3-afce-60c0f7c9c8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:21:50.323169 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 22/43] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:21:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:21:50.385560 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9f6b2-23ab-4512-ba67-9000cab2a597 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:21:50.492922 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9f6b2-23ab-4512-ba67-9000cab2a597 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:21:50.527329 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef158af2-d7e1-47c8-8ecc-a39360295dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:21:50.527954 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef158af2-d7e1-47c8-8ecc-a39360295dfb None admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:50.528236 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef158af2-d7e1-47c8-8ecc-a39360295dfb None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:50.528512 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef158af2-d7e1-47c8-8ecc-a39360295dfb None admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:50.529194 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef158af2-d7e1-47c8-8ecc-a39360295dfb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:21:50.530582 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef158af2-d7e1-47c8-8ecc-a39360295dfb None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:21:50.547070 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 22/44] 10.222.0.83 () {60 vars in 1131 bytes} [Mon Aug 29 15:21:50 2022] POST /identity/v3/roles => generated 223 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:21:50.593319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407138f3-4d78-40a3-afce-60c0f7c9c8a9 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:21:50.806038 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:21:50.813351 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407138f3-4d78-40a3-afce-60c0f7c9c8a9 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:21:50.851307 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b7aca-e456-4250-9a3f-dbdaf54892ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:21:50.851955 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b7aca-e456-4250-9a3f-dbdaf54892ec None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:50.852241 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b7aca-e456-4250-9a3f-dbdaf54892ec None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:50.852518 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b7aca-e456-4250-9a3f-dbdaf54892ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:50.853650 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b7aca-e456-4250-9a3f-dbdaf54892ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:21:50.855161 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b7aca-e456-4250-9a3f-dbdaf54892ec None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:21:50.856746 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 23/45] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:21:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:21:50.862239 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef158af2-d7e1-47c8-8ecc-a39360295dfb None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:21:50.871105 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:21:50.966979 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef158af2-d7e1-47c8-8ecc-a39360295dfb None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:21:51.000194 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e9610-bb24-402b-9190-d26428571df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:21:51.000808 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e9610-bb24-402b-9190-d26428571df7 None admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:51.001089 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e9610-bb24-402b-9190-d26428571df7 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:51.001364 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e9610-bb24-402b-9190-d26428571df7 None admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:51.002023 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540e9610-bb24-402b-9190-d26428571df7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:21:51.003512 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540e9610-bb24-402b-9190-d26428571df7 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:21:51.032379 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 23/46] 10.222.0.83 () {60 vars in 1141 bytes} [Mon Aug 29 15:21:50 2022] POST /identity/v3/projects => generated 312 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:21:52.124064 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae3953-91fe-45e0-a357-836cabdfca0d None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:52.124558 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae3953-91fe-45e0-a357-836cabdfca0d None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:52.124558 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae3953-91fe-45e0-a357-836cabdfca0d None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:52.125864 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 24/47] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:21:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:21:52.131719 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7f25e-e775-4bf3-815c-0bd50aa3cfc5 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:52.132129 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7f25e-e775-4bf3-815c-0bd50aa3cfc5 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:52.132271 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7f25e-e775-4bf3-815c-0bd50aa3cfc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:52.150097 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-eba7f25e-e775-4bf3-815c-0bd50aa3cfc5 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:21:52.151298 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-eba7f25e-e775-4bf3-815c-0bd50aa3cfc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:21:52.205054 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:21:52.219491 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 24/48] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:21:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:21:52.487280 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae3953-91fe-45e0-a357-836cabdfca0d None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:21:52.613814 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae3953-91fe-45e0-a357-836cabdfca0d None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:21:52.651335 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc5b5d-0128-4371-9292-5e4f5e81e8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:21:52.651963 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc5b5d-0128-4371-9292-5e4f5e81e8a0 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:52.652242 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc5b5d-0128-4371-9292-5e4f5e81e8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:52.652516 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc5b5d-0128-4371-9292-5e4f5e81e8a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:52.664243 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc5b5d-0128-4371-9292-5e4f5e81e8a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:21:52.669049 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-e8dc5b5d-0128-4371-9292-5e4f5e81e8a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:21:52.669049 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:21:52.669049 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:21:52.669049 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:21:52.669049 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:21:52.669049 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:21:52.669049 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:21:52.669049 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:21:52.669049 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:21:52.669049 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:21:52.669049 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:21:52.669049 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:21:52.669049 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:21:52.669049 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:21:52.669049 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:21:52.669049 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:21:52.669945 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:21:52.669945 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:21:52.669945 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:21:52.669945 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:21:52.669945 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:21:52.669945 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:21:52.669945 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:21:52.669945 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:21:52.669945 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:21:52.669945 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:21:52.669945 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:21:52.669945 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:21:52.669945 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:21:52.669945 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:21:52.669945 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:21:52.669945 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:21:52.670684 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:21:52.670684 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:21:52.670684 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:21:52.670684 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:21:52.670684 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:21:52.670684 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:21:52.670684 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:21:52.670684 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:21:52.670684 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:21:52.670684 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:21:52.670684 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:21:52.670684 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:21:52.670684 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 25/49] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 15:21:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:21:52.675921 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7f25e-e775-4bf3-815c-0bd50aa3cfc5 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:21:52.780143 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7f25e-e775-4bf3-815c-0bd50aa3cfc5 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:21:52.931133 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c20d7-1dcf-4913-af3d-9b70720aa994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:21:52.931750 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c20d7-1dcf-4913-af3d-9b70720aa994 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:52.932028 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c20d7-1dcf-4913-af3d-9b70720aa994 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:52.932299 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c20d7-1dcf-4913-af3d-9b70720aa994 None admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:52.932966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c20d7-1dcf-4913-af3d-9b70720aa994 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:21:52.933267 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c20d7-1dcf-4913-af3d-9b70720aa994 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:21:52.934643 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c20d7-1dcf-4913-af3d-9b70720aa994 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:21:52.943064 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 25/50] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:21:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:21:52.949763 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc5b5d-0128-4371-9292-5e4f5e81e8a0 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:21:52.969675 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbd9cf-b707-4aa0-847b-9cd6836eaaa5 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:52.969958 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbd9cf-b707-4aa0-847b-9cd6836eaaa5 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:52.970234 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbd9cf-b707-4aa0-847b-9cd6836eaaa5 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:52.971615 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 26/51] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:21:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:21:52.976719 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:21:52.977503 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63417508-fe53-465a-9928-adb944d455e6 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:52.977783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63417508-fe53-465a-9928-adb944d455e6 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:52.978116 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63417508-fe53-465a-9928-adb944d455e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:52.996415 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-63417508-fe53-465a-9928-adb944d455e6 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:21:52.997615 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-63417508-fe53-465a-9928-adb944d455e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:21:53.044395 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:21:53.058834 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc5b5d-0128-4371-9292-5e4f5e81e8a0 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:21:53.065979 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 27/52] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:21:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 15:21:53.093818 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd96b9e-e817-4473-b2e0-6bfa24670a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:21:53.094457 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd96b9e-e817-4473-b2e0-6bfa24670a27 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:53.094742 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd96b9e-e817-4473-b2e0-6bfa24670a27 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:53.095041 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd96b9e-e817-4473-b2e0-6bfa24670a27 None admin] PATH_INFO: `/v3/users/6db5f614a81044e59454d15b8c60cf8f` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:53.096203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd96b9e-e817-4473-b2e0-6bfa24670a27 None admin] RBAC: Authorizing `identity:get_user(user_id=6db5f614a81044e59454d15b8c60cf8f)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:21:53.097671 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd96b9e-e817-4473-b2e0-6bfa24670a27 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:21:53.100152 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 26/53] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 15:21:52 2022] GET /identity/v3/users/6db5f614a81044e59454d15b8c60cf8f => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:21:53.105732 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63417508-fe53-465a-9928-adb944d455e6 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:21:53.205045 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63417508-fe53-465a-9928-adb944d455e6 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:21:53.237993 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccaf1c9-c7f6-440c-a8ca-9a05b9e8c029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:21:53.238623 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccaf1c9-c7f6-440c-a8ca-9a05b9e8c029 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:53.238903 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccaf1c9-c7f6-440c-a8ca-9a05b9e8c029 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:53.239824 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccaf1c9-c7f6-440c-a8ca-9a05b9e8c029 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:53.240957 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccaf1c9-c7f6-440c-a8ca-9a05b9e8c029 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:21:53.242399 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccaf1c9-c7f6-440c-a8ca-9a05b9e8c029 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:21:53.244023 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 28/54] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:21:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:21:53.249762 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd96b9e-e817-4473-b2e0-6bfa24670a27 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:21:53.341261 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:21:53.341428 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccaf1c9-c7f6-440c-a8ca-9a05b9e8c029 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:21:53.350026 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd96b9e-e817-4473-b2e0-6bfa24670a27 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:21:53.383655 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e642aa5-c14e-40fb-ac5d-5b584c507a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:21:53.384262 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e642aa5-c14e-40fb-ac5d-5b584c507a7b None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:53.384546 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e642aa5-c14e-40fb-ac5d-5b584c507a7b None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:53.384819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e642aa5-c14e-40fb-ac5d-5b584c507a7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:53.385545 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e642aa5-c14e-40fb-ac5d-5b584c507a7b None admin] RBAC: Adding query filter params (role.id=4bb2bbb7bb544610877949fc933504d2, scope.domain.id=default, user.id=6db5f614a81044e59454d15b8c60cf8f) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:21:53.385856 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e642aa5-c14e-40fb-ac5d-5b584c507a7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:21:53.387342 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e642aa5-c14e-40fb-ac5d-5b584c507a7b None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:21:53.390208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:21:53.393218 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 27/55] 10.222.0.83 () {56 vars in 1322 bytes} [Mon Aug 29 15:21:53 2022] GET /identity/v3/role_assignments?user.id=6db5f614a81044e59454d15b8c60cf8f&scope.domain.id=default&role.id=4bb2bbb7bb544610877949fc933504d2 => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:21:53.448601 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccaf1c9-c7f6-440c-a8ca-9a05b9e8c029 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:21:53.485335 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301c654-7fde-45c5-bea5-249df7c22b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:21:53.485991 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301c654-7fde-45c5-bea5-249df7c22b0f None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:53.486305 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301c654-7fde-45c5-bea5-249df7c22b0f None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:53.486639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301c654-7fde-45c5-bea5-249df7c22b0f None admin] PATH_INFO: `/v3/domains/default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:53.487810 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a301c654-7fde-45c5-bea5-249df7c22b0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:21:53.489917 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a301c654-7fde-45c5-bea5-249df7c22b0f None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:21:53.491987 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 29/56] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:21:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:21:53.497773 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e642aa5-c14e-40fb-ac5d-5b584c507a7b None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:21:53.604516 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e642aa5-c14e-40fb-ac5d-5b584c507a7b None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:21:53.636789 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f836b3-59da-41e6-aff1-b459e9c3893f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:21:53.637387 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f836b3-59da-41e6-aff1-b459e9c3893f None admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:53.637666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f836b3-59da-41e6-aff1-b459e9c3893f None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:53.637935 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f836b3-59da-41e6-aff1-b459e9c3893f None admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:53.638579 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f836b3-59da-41e6-aff1-b459e9c3893f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:21:53.640060 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f836b3-59da-41e6-aff1-b459e9c3893f None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:21:53.667718 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 28/57] 10.222.0.83 () {60 vars in 1140 bytes} [Mon Aug 29 15:21:53 2022] POST /identity/v3/projects => generated 298 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:21:55.567928 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51832e-6ca1-4ffc-87d0-f7584c187740 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:55.568598 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51832e-6ca1-4ffc-87d0-f7584c187740 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:55.568598 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51832e-6ca1-4ffc-87d0-f7584c187740 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:55.569806 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 30/58] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:21:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:21:55.574980 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc298a3-ced0-4e17-b734-65a389a9dc80 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:55.575414 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc298a3-ced0-4e17-b734-65a389a9dc80 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:55.575553 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc298a3-ced0-4e17-b734-65a389a9dc80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:55.593286 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-6dc298a3-ced0-4e17-b734-65a389a9dc80 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:21:55.594475 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6dc298a3-ced0-4e17-b734-65a389a9dc80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:21:55.596418 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:21:55.667285 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 29/59] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:21:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:21:55.942439 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51832e-6ca1-4ffc-87d0-f7584c187740 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:21:56.047840 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51832e-6ca1-4ffc-87d0-f7584c187740 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:21:56.064121 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:21:56.081782 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d2ad1-27c4-45b8-8cbd-d1c740290b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:21:56.083163 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d2ad1-27c4-45b8-8cbd-d1c740290b21 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:56.083531 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d2ad1-27c4-45b8-8cbd-d1c740290b21 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:56.083803 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d2ad1-27c4-45b8-8cbd-d1c740290b21 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:56.084897 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d2ad1-27c4-45b8-8cbd-d1c740290b21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:21:56.086330 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d2ad1-27c4-45b8-8cbd-d1c740290b21 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:21:56.087907 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 31/60] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:21:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:21:56.093457 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc298a3-ced0-4e17-b734-65a389a9dc80 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:21:56.191343 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc298a3-ced0-4e17-b734-65a389a9dc80 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:21:56.225523 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1528f76-4867-4e0d-a3c7-b28802be139f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:21:56.226087 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1528f76-4867-4e0d-a3c7-b28802be139f None admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:56.226375 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1528f76-4867-4e0d-a3c7-b28802be139f None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:56.226650 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1528f76-4867-4e0d-a3c7-b28802be139f None admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:56.227345 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1528f76-4867-4e0d-a3c7-b28802be139f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:21:56.228796 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1528f76-4867-4e0d-a3c7-b28802be139f None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:21:56.243204 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:21:56.257913 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 30/61] 10.222.0.83 () {60 vars in 1132 bytes} [Mon Aug 29 15:21:56 2022] POST /identity/v3/users => generated 275 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:21:59.304123 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2215e-a1dc-40fc-88a8-f440d254b31a None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:59.305242 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2215e-a1dc-40fc-88a8-f440d254b31a None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:59.305661 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2215e-a1dc-40fc-88a8-f440d254b31a None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:59.307160 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 32/62] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:21:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:21:59.312734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd23c8-9906-4b58-abab-7b1947ff9241 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:59.313150 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd23c8-9906-4b58-abab-7b1947ff9241 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:59.313480 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd23c8-9906-4b58-abab-7b1947ff9241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:59.344041 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-64dd23c8-9906-4b58-abab-7b1947ff9241 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:21:59.345247 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-64dd23c8-9906-4b58-abab-7b1947ff9241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:21:59.435867 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 31/63] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:21:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:21:59.595785 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef6081-a349-4247-96b5-670fc05225e7 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:59.596378 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef6081-a349-4247-96b5-670fc05225e7 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:59.596866 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef6081-a349-4247-96b5-670fc05225e7 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:59.599086 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 33/64] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:21:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:21:59.604434 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b79b6-cd13-407d-ac21-4e3487c03cc1 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:59.604729 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b79b6-cd13-407d-ac21-4e3487c03cc1 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:59.605075 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b79b6-cd13-407d-ac21-4e3487c03cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:59.626726 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-d85b79b6-cd13-407d-ac21-4e3487c03cc1 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:21:59.628313 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d85b79b6-cd13-407d-ac21-4e3487c03cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:21:59.717324 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 32/65] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:21:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:21:59.803151 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef6081-a349-4247-96b5-670fc05225e7 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:21:59.827395 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5e793-337c-43b8-bcc4-4a81ffa38d38 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:59.828165 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5e793-337c-43b8-bcc4-4a81ffa38d38 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:59.828746 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5e793-337c-43b8-bcc4-4a81ffa38d38 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:59.830457 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 33/66] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:21:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:21:59.836513 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99148947-3b98-4fab-a3b2-a2a31447c401 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:59.837083 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99148947-3b98-4fab-a3b2-a2a31447c401 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:59.837579 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99148947-3b98-4fab-a3b2-a2a31447c401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:59.868472 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-99148947-3b98-4fab-a3b2-a2a31447c401 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:21:59.872035 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-99148947-3b98-4fab-a3b2-a2a31447c401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:21:59.963820 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:21:59.975225 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef6081-a349-4247-96b5-670fc05225e7 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:21:59.984773 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 34/67] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:21:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:21:59.986487 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f303223-d5b1-4bc9-8c82-76a63507a64e None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:59.986774 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f303223-d5b1-4bc9-8c82-76a63507a64e None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:59.986960 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f303223-d5b1-4bc9-8c82-76a63507a64e None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:59.989146 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 35/68] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:21:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:21:59.994238 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234ac24-aa43-4c0e-88ad-2e4beb87077c None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:59.994525 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234ac24-aa43-4c0e-88ad-2e4beb87077c None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:59.994801 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234ac24-aa43-4c0e-88ad-2e4beb87077c None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:21:59.999961 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 36/69] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:21:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:21:59.999961 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed517189-2553-45ae-8414-6759e0b09d4d None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:21:59.999961 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed517189-2553-45ae-8414-6759e0b09d4d None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:21:59.999961 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed517189-2553-45ae-8414-6759e0b09d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:00.022445 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-ed517189-2553-45ae-8414-6759e0b09d4d None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:00.024372 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ed517189-2553-45ae-8414-6759e0b09d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:00.029787 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af6d66f-d766-4d33-bb6f-eca703e06b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:00.030681 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6d66f-d766-4d33-bb6f-eca703e06b11 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:00.031163 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6d66f-d766-4d33-bb6f-eca703e06b11 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:00.031667 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6d66f-d766-4d33-bb6f-eca703e06b11 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:00.047239 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af6d66f-d766-4d33-bb6f-eca703e06b11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:00.055185 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-5af6d66f-d766-4d33-bb6f-eca703e06b11 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:22:00.055185 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:00.055185 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:00.055185 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:00.055185 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:00.055185 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:00.055185 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:00.055185 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:00.055185 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:00.055185 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:00.055185 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:00.055185 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:00.055185 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:00.055185 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:00.055185 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:00.055185 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:00.056126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:00.056126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:00.056126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:00.056126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:00.056126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:00.056126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:00.056126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:00.056126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:00.056126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:00.056126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:00.056126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:00.056126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:00.056126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:00.056126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:00.056126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:00.056126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:00.056882 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:00.056882 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:00.056882 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:00.056882 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:00.056882 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:00.056882 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:00.056882 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:00.056882 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:00.056882 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:00.056882 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:00.056882 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:22:00.056882 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:22:00.056882 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 34/70] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:21:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:22:00.059226 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eeb6a8-1117-4167-8384-2c68344aada1 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:00.059226 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eeb6a8-1117-4167-8384-2c68344aada1 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:00.059226 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eeb6a8-1117-4167-8384-2c68344aada1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:00.084826 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-81eeb6a8-1117-4167-8384-2c68344aada1 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:00.086065 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-81eeb6a8-1117-4167-8384-2c68344aada1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:00.123144 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 37/71] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:21:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:22:00.123144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed517189-2553-45ae-8414-6759e0b09d4d None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:00.149729 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:00.180674 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 35/72] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:22:00.181636 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eeb6a8-1117-4167-8384-2c68344aada1 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:00.263569 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed517189-2553-45ae-8414-6759e0b09d4d None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:00.283380 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:00.302860 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eeb6a8-1117-4167-8384-2c68344aada1 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:00.305797 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d9f078-f7a3-4fd5-8066-2088523f0d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:00.306675 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9f078-f7a3-4fd5-8066-2088523f0d15 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:00.307194 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9f078-f7a3-4fd5-8066-2088523f0d15 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:00.307691 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9f078-f7a3-4fd5-8066-2088523f0d15 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:00.319116 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d9f078-f7a3-4fd5-8066-2088523f0d15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:00.324793 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-c3d9f078-f7a3-4fd5-8066-2088523f0d15 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:22:00.324793 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:00.324793 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:00.324793 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:00.324793 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:00.324793 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:00.324793 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:00.324793 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:00.324793 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:00.324793 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:00.324793 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:00.324793 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:00.324793 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:00.324793 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:00.324793 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:00.324793 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:00.325636 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:00.325636 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:00.325636 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:00.325636 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:00.325636 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:00.325636 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:00.325636 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:00.325636 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:00.325636 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:00.325636 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:00.325636 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:00.325636 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:00.325636 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:00.325636 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:00.325636 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:00.325636 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:00.326389 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:00.326389 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:00.326389 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:00.326389 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:00.326389 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:00.326389 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:00.326389 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:00.326389 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:00.326389 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:00.326389 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:00.326389 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:22:00.326389 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:22:00.328898 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 38/73] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 15:22:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:22:00.329891 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d9f078-f7a3-4fd5-8066-2088523f0d15 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:00.345096 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a01ee9-9fac-49b2-9405-fe1b526dca3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:00.345748 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a01ee9-9fac-49b2-9405-fe1b526dca3d None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:00.346014 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a01ee9-9fac-49b2-9405-fe1b526dca3d None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:00.346293 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a01ee9-9fac-49b2-9405-fe1b526dca3d None admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:00.346965 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a01ee9-9fac-49b2-9405-fe1b526dca3d None admin] RBAC: Adding query filter params (name=member) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:00.347376 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a01ee9-9fac-49b2-9405-fe1b526dca3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:00.350136 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a01ee9-9fac-49b2-9405-fe1b526dca3d None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:00.361892 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 36/74] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 15:22:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:00.362705 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a01ee9-9fac-49b2-9405-fe1b526dca3d None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:00.420800 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:00.453664 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d9f078-f7a3-4fd5-8066-2088523f0d15 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:00.493686 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46080060-aaec-463e-bd73-b9ce8f157f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:00.494330 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46080060-aaec-463e-bd73-b9ce8f157f63 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:00.494428 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a01ee9-9fac-49b2-9405-fe1b526dca3d None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:00.494609 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46080060-aaec-463e-bd73-b9ce8f157f63 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:00.494900 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46080060-aaec-463e-bd73-b9ce8f157f63 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:00.506978 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46080060-aaec-463e-bd73-b9ce8f157f63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:00.511962 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-46080060-aaec-463e-bd73-b9ce8f157f63 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 15:22:00.511962 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:00.511962 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:00.511962 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:00.511962 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:00.511962 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:00.511962 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:00.511962 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:00.511962 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:00.511962 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:00.511962 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:00.511962 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:00.511962 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:00.511962 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:00.511962 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:00.511962 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:00.512798 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:00.512798 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:00.512798 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:00.512798 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:00.512798 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:00.512798 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:00.512798 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:00.512798 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:00.512798 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:00.512798 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:00.512798 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:00.512798 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:00.512798 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:00.512798 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:00.512798 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:00.512798 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:00.513773 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:00.513773 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:00.513773 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:00.513773 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:00.513773 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:00.513773 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:00.513773 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:00.513773 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:00.513773 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:00.513773 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:00.513773 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 15:22:00.513773 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:22:00.513773 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 39/75] 10.222.0.83 () {56 vars in 1114 bytes} [Mon Aug 29 15:22:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:22:00.516410 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46080060-aaec-463e-bd73-b9ce8f157f63 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:00.530695 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48468324-5c17-43c6-9a2f-8fa987ff0afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:00.531334 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48468324-5c17-43c6-9a2f-8fa987ff0afb None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:00.531614 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48468324-5c17-43c6-9a2f-8fa987ff0afb None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:00.531885 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48468324-5c17-43c6-9a2f-8fa987ff0afb None admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:00.532546 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48468324-5c17-43c6-9a2f-8fa987ff0afb None admin] RBAC: Adding query filter params (name=admin) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:00.532846 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48468324-5c17-43c6-9a2f-8fa987ff0afb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:00.534215 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48468324-5c17-43c6-9a2f-8fa987ff0afb None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:00.543388 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 37/76] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:22:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:00.544527 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48468324-5c17-43c6-9a2f-8fa987ff0afb None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:00.556699 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:00.624993 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46080060-aaec-463e-bd73-b9ce8f157f63 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:00.640340 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:00.645377 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48468324-5c17-43c6-9a2f-8fa987ff0afb None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:00.659420 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b5309a-0b88-4933-b587-6411ae64829b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:00.660328 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5309a-0b88-4933-b587-6411ae64829b None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:00.660616 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5309a-0b88-4933-b587-6411ae64829b None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:00.661244 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5309a-0b88-4933-b587-6411ae64829b None admin] PATH_INFO: `/v3/users/618f35cfd2d04e50a8c22d7b8993a5fe` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:00.674052 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b5309a-0b88-4933-b587-6411ae64829b None admin] RBAC: Authorizing `identity:get_user(user_id=618f35cfd2d04e50a8c22d7b8993a5fe)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:00.675620 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b5309a-0b88-4933-b587-6411ae64829b None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:00.677267 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 40/77] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 15:22:00 2022] GET /identity/v3/users/618f35cfd2d04e50a8c22d7b8993a5fe => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:00.678038 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b5309a-0b88-4933-b587-6411ae64829b None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:00.685242 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e025d-bd3a-4b06-9428-72e871e6f589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:00.685892 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e025d-bd3a-4b06-9428-72e871e6f589 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:00.686175 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e025d-bd3a-4b06-9428-72e871e6f589 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:00.686457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e025d-bd3a-4b06-9428-72e871e6f589 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:00.687624 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e025d-bd3a-4b06-9428-72e871e6f589 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:00.689096 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e025d-bd3a-4b06-9428-72e871e6f589 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:00.690670 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 38/78] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:22:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:00.692341 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e025d-bd3a-4b06-9428-72e871e6f589 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:00.777265 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:00.787640 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b5309a-0b88-4933-b587-6411ae64829b None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:00.794685 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e025d-bd3a-4b06-9428-72e871e6f589 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:00.826846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227f235-40d1-4cde-bdcb-79f8330d9a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:00.827520 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227f235-40d1-4cde-bdcb-79f8330d9a7f None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:00.827804 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227f235-40d1-4cde-bdcb-79f8330d9a7f None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:00.828084 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227f235-40d1-4cde-bdcb-79f8330d9a7f None admin] PATH_INFO: `/v3/roles/member` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:00.832147 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8022bb5-1911-418c-8189-10c0ee7ba6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:00.832761 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8022bb5-1911-418c-8189-10c0ee7ba6e2 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:00.833043 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8022bb5-1911-418c-8189-10c0ee7ba6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:00.833319 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8022bb5-1911-418c-8189-10c0ee7ba6e2 None admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:00.833986 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8022bb5-1911-418c-8189-10c0ee7ba6e2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:00.834289 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8022bb5-1911-418c-8189-10c0ee7ba6e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:00.835711 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8022bb5-1911-418c-8189-10c0ee7ba6e2 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:00.838746 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e227f235-40d1-4cde-bdcb-79f8330d9a7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:00.843628 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 39/79] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:22:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:00.848935 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-e227f235-40d1-4cde-bdcb-79f8330d9a7f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:22:00.848935 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:00.848935 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:00.848935 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:00.848935 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:00.848935 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:00.848935 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:00.848935 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:00.848935 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:00.848935 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:00.848935 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:00.848935 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:00.848935 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:00.848935 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:00.848935 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:00.848935 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:00.849895 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:00.849895 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:00.849895 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:00.849895 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:00.849895 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:00.849895 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:00.849895 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:00.849895 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:00.849895 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:00.849895 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:00.849895 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:00.849895 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:00.849895 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:00.849895 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:00.849895 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:00.849895 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:00.850663 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:00.850663 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:00.850663 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:00.850663 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:00.850663 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:00.850663 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:00.850663 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:00.850663 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:00.850663 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:00.850663 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:00.850663 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:22:00.850663 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:22:00.851290 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8022bb5-1911-418c-8189-10c0ee7ba6e2 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:00.851363 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 41/80] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:22:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:22:00.851363 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227f235-40d1-4cde-bdcb-79f8330d9a7f None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:00.876320 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:00.949686 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8022bb5-1911-418c-8189-10c0ee7ba6e2 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:00.955542 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227f235-40d1-4cde-bdcb-79f8330d9a7f None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:00.982478 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd3fb4-1958-4ad0-b52e-3774f3b360d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:00.983252 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd3fb4-1958-4ad0-b52e-3774f3b360d6 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:00.983527 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd3fb4-1958-4ad0-b52e-3774f3b360d6 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:00.983797 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd3fb4-1958-4ad0-b52e-3774f3b360d6 None admin] PATH_INFO: `/v3/users/6db5f614a81044e59454d15b8c60cf8f` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:00.985144 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd3fb4-1958-4ad0-b52e-3774f3b360d6 None admin] RBAC: Authorizing `identity:get_user(user_id=6db5f614a81044e59454d15b8c60cf8f)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:00.986595 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd3fb4-1958-4ad0-b52e-3774f3b360d6 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:00.988396 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 40/81] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 15:22:00 2022] GET /identity/v3/users/6db5f614a81044e59454d15b8c60cf8f => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:00.989174 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd3fb4-1958-4ad0-b52e-3774f3b360d6 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:00.990074 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575c597-14c1-4062-8eda-287dfaa9d3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:00.990697 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575c597-14c1-4062-8eda-287dfaa9d3f7 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:00.990978 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575c597-14c1-4062-8eda-287dfaa9d3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:00.991793 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575c597-14c1-4062-8eda-287dfaa9d3f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:01.014525 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:01.061128 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0575c597-14c1-4062-8eda-287dfaa9d3f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:01.062657 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0575c597-14c1-4062-8eda-287dfaa9d3f7 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:01.084713 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:01.091469 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd3fb4-1958-4ad0-b52e-3774f3b360d6 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:01.125697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c6e70-cd17-43bb-b633-1d786ccb1931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:01.126308 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c6e70-cd17-43bb-b633-1d786ccb1931 None admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:01.126593 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c6e70-cd17-43bb-b633-1d786ccb1931 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:01.126868 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c6e70-cd17-43bb-b633-1d786ccb1931 None admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:01.127571 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c6e70-cd17-43bb-b633-1d786ccb1931 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:01.131559 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c6e70-cd17-43bb-b633-1d786ccb1931 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:01.164805 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 42/82] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:22:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:22:01.165392 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 41/83] 10.222.0.83 () {60 vars in 1132 bytes} [Mon Aug 29 15:22:00 2022] POST /identity/v3/users => generated 289 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:22:01.166248 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c6e70-cd17-43bb-b633-1d786ccb1931 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:01.166525 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575c597-14c1-4062-8eda-287dfaa9d3f7 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:01.238527 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:01.294388 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575c597-14c1-4062-8eda-287dfaa9d3f7 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:01.307516 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c6e70-cd17-43bb-b633-1d786ccb1931 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:01.336808 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08766f2-97de-4909-80a9-717b435d7aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:01.337613 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08766f2-97de-4909-80a9-717b435d7aa8 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:01.337896 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08766f2-97de-4909-80a9-717b435d7aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:01.338169 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08766f2-97de-4909-80a9-717b435d7aa8 None admin] PATH_INFO: `/v3/users/618f35cfd2d04e50a8c22d7b8993a5fe` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:01.339371 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08766f2-97de-4909-80a9-717b435d7aa8 None admin] RBAC: Authorizing `identity:get_user(user_id=618f35cfd2d04e50a8c22d7b8993a5fe)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:01.340824 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08766f2-97de-4909-80a9-717b435d7aa8 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:01.343702 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 43/84] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 15:22:01 2022] GET /identity/v3/users/618f35cfd2d04e50a8c22d7b8993a5fe => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:01.343702 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08766f2-97de-4909-80a9-717b435d7aa8 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:01.353249 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab5f8a-ca2b-489d-a881-f60a3f978f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:01.353878 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab5f8a-ca2b-489d-a881-f60a3f978f10 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:01.354454 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab5f8a-ca2b-489d-a881-f60a3f978f10 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:01.354454 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab5f8a-ca2b-489d-a881-f60a3f978f10 None admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:01.355145 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffab5f8a-ca2b-489d-a881-f60a3f978f10 None admin] RBAC: Adding query filter params (name=member) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:01.355457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffab5f8a-ca2b-489d-a881-f60a3f978f10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:01.357101 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffab5f8a-ca2b-489d-a881-f60a3f978f10 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:01.365937 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 42/85] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 15:22:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:01.371071 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab5f8a-ca2b-489d-a881-f60a3f978f10 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:01.384747 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:01.482907 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08766f2-97de-4909-80a9-717b435d7aa8 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:01.495621 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab5f8a-ca2b-489d-a881-f60a3f978f10 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:01.508695 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:01.525886 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e873feb5-d55c-4b1f-956d-362bf161a06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:01.526802 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873feb5-d55c-4b1f-956d-362bf161a06f None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:01.527108 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873feb5-d55c-4b1f-956d-362bf161a06f None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:01.527975 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873feb5-d55c-4b1f-956d-362bf161a06f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:01.547486 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df06414e-8dee-4957-a859-e03ce3209be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:01.548719 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06414e-8dee-4957-a859-e03ce3209be7 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:01.549144 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06414e-8dee-4957-a859-e03ce3209be7 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:01.549798 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06414e-8dee-4957-a859-e03ce3209be7 None admin] PATH_INFO: `/v3/projects/81f3af84c83d43499bc734eb2261802e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:01.552335 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df06414e-8dee-4957-a859-e03ce3209be7 None admin] RBAC: Authorizing `identity:get_project(project_id=81f3af84c83d43499bc734eb2261802e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:01.554879 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df06414e-8dee-4957-a859-e03ce3209be7 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:01.557102 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 43/86] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:22:01 2022] GET /identity/v3/projects/81f3af84c83d43499bc734eb2261802e => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:01.558706 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df06414e-8dee-4957-a859-e03ce3209be7 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:01.607213 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e873feb5-d55c-4b1f-956d-362bf161a06f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:01.608869 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e873feb5-d55c-4b1f-956d-362bf161a06f None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:01.660590 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:01.683166 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df06414e-8dee-4957-a859-e03ce3209be7 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:01.719547 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65224524-dfcb-4648-bbe9-17fa2512b016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:01.720328 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65224524-dfcb-4648-bbe9-17fa2512b016 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:01.720743 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65224524-dfcb-4648-bbe9-17fa2512b016 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:01.721116 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65224524-dfcb-4648-bbe9-17fa2512b016 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:01.750894 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 44/87] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:22:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:22:01.756073 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e873feb5-d55c-4b1f-956d-362bf161a06f None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:01.785826 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:01.810150 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65224524-dfcb-4648-bbe9-17fa2512b016 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:01.811994 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65224524-dfcb-4648-bbe9-17fa2512b016 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:01.883678 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e873feb5-d55c-4b1f-956d-362bf161a06f None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:01.902710 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:01.925966 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 44/88] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:22:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:22:01.926627 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65224524-dfcb-4648-bbe9-17fa2512b016 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:01.928234 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4fd9d7-8ce2-4216-bcde-c49c4b54be28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:01.928879 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4fd9d7-8ce2-4216-bcde-c49c4b54be28 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:01.929399 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4fd9d7-8ce2-4216-bcde-c49c4b54be28 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:01.929675 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4fd9d7-8ce2-4216-bcde-c49c4b54be28 None admin] PATH_INFO: `/v3/users/618f35cfd2d04e50a8c22d7b8993a5fe` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:01.931097 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4fd9d7-8ce2-4216-bcde-c49c4b54be28 None admin] RBAC: Authorizing `identity:get_user(user_id=618f35cfd2d04e50a8c22d7b8993a5fe)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:01.932577 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4fd9d7-8ce2-4216-bcde-c49c4b54be28 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:01.934781 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 45/89] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 15:22:01 2022] GET /identity/v3/users/618f35cfd2d04e50a8c22d7b8993a5fe => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:01.934892 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4fd9d7-8ce2-4216-bcde-c49c4b54be28 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:02.032186 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:02.045735 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4fd9d7-8ce2-4216-bcde-c49c4b54be28 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:02.048851 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65224524-dfcb-4648-bbe9-17fa2512b016 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:02.080951 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067e52c-5d72-4ac2-bf7d-857d4adeda6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:02.082212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067e52c-5d72-4ac2-bf7d-857d4adeda6f None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:02.082493 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067e52c-5d72-4ac2-bf7d-857d4adeda6f None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:02.082765 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067e52c-5d72-4ac2-bf7d-857d4adeda6f None admin] PATH_INFO: `/v3/projects/81f3af84c83d43499bc734eb2261802e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:02.083944 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3067e52c-5d72-4ac2-bf7d-857d4adeda6f None admin] RBAC: Authorizing `identity:get_project(project_id=81f3af84c83d43499bc734eb2261802e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:02.085401 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3067e52c-5d72-4ac2-bf7d-857d4adeda6f None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:02.087106 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 46/90] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:22:01 2022] GET /identity/v3/projects/81f3af84c83d43499bc734eb2261802e => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:02.087830 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067e52c-5d72-4ac2-bf7d-857d4adeda6f None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:02.090433 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff7abd-5c2e-4d8c-a025-6f2b94942311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:02.091409 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff7abd-5c2e-4d8c-a025-6f2b94942311 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:02.091885 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff7abd-5c2e-4d8c-a025-6f2b94942311 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:02.092343 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff7abd-5c2e-4d8c-a025-6f2b94942311 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:02.093255 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff7abd-5c2e-4d8c-a025-6f2b94942311 None admin] RBAC: Adding query filter params (role.id=e85047210af34e2d87f8162c8bd2005e, scope.project.id=81f3af84c83d43499bc734eb2261802e, user.id=618f35cfd2d04e50a8c22d7b8993a5fe) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:02.093763 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff7abd-5c2e-4d8c-a025-6f2b94942311 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:02.095483 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff7abd-5c2e-4d8c-a025-6f2b94942311 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:02.105872 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 45/91] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 15:22:01 2022] GET /identity/v3/role_assignments?user.id=618f35cfd2d04e50a8c22d7b8993a5fe&scope.project.id=81f3af84c83d43499bc734eb2261802e&role.id=e85047210af34e2d87f8162c8bd2005e => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:02.107126 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff7abd-5c2e-4d8c-a025-6f2b94942311 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:02.163414 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:02.200187 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067e52c-5d72-4ac2-bf7d-857d4adeda6f None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:02.230136 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff7abd-5c2e-4d8c-a025-6f2b94942311 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:02.241966 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698c065-9f41-4a0e-9c19-69fccc661f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:02.242617 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698c065-9f41-4a0e-9c19-69fccc661f60 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:02.242898 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698c065-9f41-4a0e-9c19-69fccc661f60 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:02.243534 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698c065-9f41-4a0e-9c19-69fccc661f60 None admin] PATH_INFO: `/v3/projects/81f3af84c83d43499bc734eb2261802e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:02.244454 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b698c065-9f41-4a0e-9c19-69fccc661f60 None admin] RBAC: Authorizing `identity:get_project(project_id=81f3af84c83d43499bc734eb2261802e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:02.246148 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b698c065-9f41-4a0e-9c19-69fccc661f60 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:02.247996 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 47/92] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:22:02 2022] GET /identity/v3/projects/81f3af84c83d43499bc734eb2261802e => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:02.248702 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698c065-9f41-4a0e-9c19-69fccc661f60 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:02.277831 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ba3ec-abe9-4fed-83d8-33fecf42eb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:02.278849 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ba3ec-abe9-4fed-83d8-33fecf42eb1b None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:02.279446 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ba3ec-abe9-4fed-83d8-33fecf42eb1b None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:02.279918 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ba3ec-abe9-4fed-83d8-33fecf42eb1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:02.280456 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:02.366536 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ba3ec-abe9-4fed-83d8-33fecf42eb1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:02.368820 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ba3ec-abe9-4fed-83d8-33fecf42eb1b None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:02.391251 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698c065-9f41-4a0e-9c19-69fccc661f60 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:02.420368 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:02.431213 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66fdac-1d79-4d62-9ad5-b57e1cfb4bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:02.431833 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66fdac-1d79-4d62-9ad5-b57e1cfb4bf8 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:02.432113 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66fdac-1d79-4d62-9ad5-b57e1cfb4bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:02.432586 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66fdac-1d79-4d62-9ad5-b57e1cfb4bf8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:02.433266 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e66fdac-1d79-4d62-9ad5-b57e1cfb4bf8 None admin] RBAC: Adding query filter params (role.id=4bb2bbb7bb544610877949fc933504d2, scope.project.id=81f3af84c83d43499bc734eb2261802e, user.id=6db5f614a81044e59454d15b8c60cf8f) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:02.433597 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e66fdac-1d79-4d62-9ad5-b57e1cfb4bf8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:02.435197 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e66fdac-1d79-4d62-9ad5-b57e1cfb4bf8 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:02.444088 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 48/93] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 15:22:02 2022] GET /identity/v3/role_assignments?user.id=6db5f614a81044e59454d15b8c60cf8f&scope.project.id=81f3af84c83d43499bc734eb2261802e&role.id=4bb2bbb7bb544610877949fc933504d2 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:02.444088 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66fdac-1d79-4d62-9ad5-b57e1cfb4bf8 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:02.530573 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 46/94] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:22:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:22:02.553890 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ba3ec-abe9-4fed-83d8-33fecf42eb1b None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:02.647796 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:02.679501 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66fdac-1d79-4d62-9ad5-b57e1cfb4bf8 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:02.721623 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ba3ec-abe9-4fed-83d8-33fecf42eb1b None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:02.724794 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757faf0-7a74-4b9e-8986-d08ea1d88417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:02.725416 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757faf0-7a74-4b9e-8986-d08ea1d88417 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:02.725700 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757faf0-7a74-4b9e-8986-d08ea1d88417 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:02.725979 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757faf0-7a74-4b9e-8986-d08ea1d88417 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:02.726725 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5757faf0-7a74-4b9e-8986-d08ea1d88417 None admin] RBAC: Adding query filter params (role.id=3e8f6ab382f64437b245115f5a28f535, scope.project.id=81f3af84c83d43499bc734eb2261802e, user.id=618f35cfd2d04e50a8c22d7b8993a5fe) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:02.727058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5757faf0-7a74-4b9e-8986-d08ea1d88417 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:02.728539 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5757faf0-7a74-4b9e-8986-d08ea1d88417 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:02.742661 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 49/95] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 15:22:02 2022] GET /identity/v3/role_assignments?user.id=618f35cfd2d04e50a8c22d7b8993a5fe&scope.project.id=81f3af84c83d43499bc734eb2261802e&role.id=3e8f6ab382f64437b245115f5a28f535 => generated 259 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:02.794554 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13ef8b-bfc3-482d-9ed7-ed7cd629000f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:02.795318 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13ef8b-bfc3-482d-9ed7-ed7cd629000f None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:02.795609 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13ef8b-bfc3-482d-9ed7-ed7cd629000f None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:02.795884 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13ef8b-bfc3-482d-9ed7-ed7cd629000f None admin] PATH_INFO: `/v3/projects/15b426bd7a14464db64108758c77e848` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:02.800844 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b13ef8b-bfc3-482d-9ed7-ed7cd629000f None admin] RBAC: Authorizing `identity:get_project(project_id=15b426bd7a14464db64108758c77e848)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:02.802374 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b13ef8b-bfc3-482d-9ed7-ed7cd629000f None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:02.804448 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 47/96] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:22:02 2022] GET /identity/v3/projects/15b426bd7a14464db64108758c77e848 => generated 312 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:02.810715 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757faf0-7a74-4b9e-8986-d08ea1d88417 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:02.968886 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757faf0-7a74-4b9e-8986-d08ea1d88417 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:03.019898 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247bf5f7-4907-41c8-9ee6-46443dc6ae21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:03.020572 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247bf5f7-4907-41c8-9ee6-46443dc6ae21 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:03.020861 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247bf5f7-4907-41c8-9ee6-46443dc6ae21 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:03.021140 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247bf5f7-4907-41c8-9ee6-46443dc6ae21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:03.021889 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247bf5f7-4907-41c8-9ee6-46443dc6ae21 None admin] RBAC: Adding query filter params (role.id=e85047210af34e2d87f8162c8bd2005e, scope.project.id=15b426bd7a14464db64108758c77e848, user.id=618f35cfd2d04e50a8c22d7b8993a5fe) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:03.022203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247bf5f7-4907-41c8-9ee6-46443dc6ae21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:03.023769 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247bf5f7-4907-41c8-9ee6-46443dc6ae21 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:03.036214 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 50/97] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 15:22:02 2022] GET /identity/v3/role_assignments?user.id=618f35cfd2d04e50a8c22d7b8993a5fe&scope.project.id=15b426bd7a14464db64108758c77e848&role.id=e85047210af34e2d87f8162c8bd2005e => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:03.549062 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d40b53-6c61-4b4d-8524-ec3c9e6e9557 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:03.549574 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d40b53-6c61-4b4d-8524-ec3c9e6e9557 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:03.550208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d40b53-6c61-4b4d-8524-ec3c9e6e9557 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:03.551640 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 48/98] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:03.557390 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19fdb5-28e3-458c-8d92-09ccfe1af562 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:03.557811 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19fdb5-28e3-458c-8d92-09ccfe1af562 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:03.557981 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19fdb5-28e3-458c-8d92-09ccfe1af562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:03.583781 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-7c19fdb5-28e3-458c-8d92-09ccfe1af562 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:03.584987 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7c19fdb5-28e3-458c-8d92-09ccfe1af562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:03.602542 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:03.670314 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 51/99] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:22:04.215041 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d40b53-6c61-4b4d-8524-ec3c9e6e9557 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:04.232749 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:04.252199 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d81e6-3c28-4f6e-a581-b2d24b4c04c2 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:04.252880 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d81e6-3c28-4f6e-a581-b2d24b4c04c2 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:04.253363 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d81e6-3c28-4f6e-a581-b2d24b4c04c2 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:04.254914 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 52/100] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:04.260187 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c643ce-6b38-4b4b-a942-90ed3f33f666 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:04.260762 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c643ce-6b38-4b4b-a942-90ed3f33f666 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:04.261237 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c643ce-6b38-4b4b-a942-90ed3f33f666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:04.304314 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-c0c643ce-6b38-4b4b-a942-90ed3f33f666 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:04.305879 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c0c643ce-6b38-4b4b-a942-90ed3f33f666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:04.380265 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d40b53-6c61-4b4d-8524-ec3c9e6e9557 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:04.445843 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25219dad-52be-4a6b-b60a-34a725cb7b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:04.446642 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25219dad-52be-4a6b-b60a-34a725cb7b34 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:04.446924 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25219dad-52be-4a6b-b60a-34a725cb7b34 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:04.447223 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25219dad-52be-4a6b-b60a-34a725cb7b34 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:04.453293 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 53/101] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 15:22:04.472078 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25219dad-52be-4a6b-b60a-34a725cb7b34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:04.476909 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-25219dad-52be-4a6b-b60a-34a725cb7b34 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 15:22:04.476909 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:04.476909 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:04.476909 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:04.476909 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:04.476909 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:04.476909 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:04.476909 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:04.476909 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:04.476909 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:04.476909 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:04.476909 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:04.476909 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:04.476909 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:04.476909 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:04.476909 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:04.477757 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:04.477757 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:04.477757 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:04.477757 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:04.477757 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:04.477757 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:04.477757 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:04.477757 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:04.477757 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:04.477757 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:04.477757 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:04.477757 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:04.477757 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:04.477757 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:04.477757 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:04.477757 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:04.478525 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:04.478525 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:04.478525 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:04.478525 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:04.478525 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:04.478525 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:04.478525 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:04.478525 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:04.478525 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:04.478525 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:04.478525 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 15:22:04.478525 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:22:04.478525 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 49/102] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:22:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:22:04.485393 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c643ce-6b38-4b4b-a942-90ed3f33f666 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:04.601191 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:04.629293 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c643ce-6b38-4b4b-a942-90ed3f33f666 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:04.685637 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188f9d0e-2dbc-48be-947a-d63e165f42a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:04.686263 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f9d0e-2dbc-48be-947a-d63e165f42a0 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:04.686550 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f9d0e-2dbc-48be-947a-d63e165f42a0 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:04.686830 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f9d0e-2dbc-48be-947a-d63e165f42a0 None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:04.687542 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188f9d0e-2dbc-48be-947a-d63e165f42a0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:04.687851 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188f9d0e-2dbc-48be-947a-d63e165f42a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:04.689252 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188f9d0e-2dbc-48be-947a-d63e165f42a0 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:04.705185 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 54/103] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 15:22:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:04.711545 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25219dad-52be-4a6b-b60a-34a725cb7b34 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:04.736848 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98c76a-8229-43d3-bbcd-ab916048a5ac None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:04.737657 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98c76a-8229-43d3-bbcd-ab916048a5ac None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:04.737934 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98c76a-8229-43d3-bbcd-ab916048a5ac None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:04.739336 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 55/104] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:22:04.744436 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90b32a-f25a-4d41-b1fa-c0180a481346 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:04.744962 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90b32a-f25a-4d41-b1fa-c0180a481346 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:04.745479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90b32a-f25a-4d41-b1fa-c0180a481346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:04.780011 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-7e90b32a-f25a-4d41-b1fa-c0180a481346 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:04.781573 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7e90b32a-f25a-4d41-b1fa-c0180a481346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:04.864709 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:04.919845 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25219dad-52be-4a6b-b60a-34a725cb7b34 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:04.929674 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 56/105] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 15:22:04.958507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e90b32a-f25a-4d41-b1fa-c0180a481346 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:04.985063 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b26e7-eb07-4177-a9d2-57128e49c80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:04.985705 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b26e7-eb07-4177-a9d2-57128e49c80e None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:04.985983 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b26e7-eb07-4177-a9d2-57128e49c80e None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:04.986257 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b26e7-eb07-4177-a9d2-57128e49c80e None admin] PATH_INFO: `/v3/users/b7d81fc7f9984b35b62e7769af29a92e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:05.008213 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73b26e7-eb07-4177-a9d2-57128e49c80e None admin] RBAC: Authorizing `identity:get_user(user_id=b7d81fc7f9984b35b62e7769af29a92e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:05.009667 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73b26e7-eb07-4177-a9d2-57128e49c80e None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:05.011609 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 50/106] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 15:22:04 2022] GET /identity/v3/users/b7d81fc7f9984b35b62e7769af29a92e => generated 289 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:05.017173 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b26e7-eb07-4177-a9d2-57128e49c80e None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:05.083705 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:05.146549 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e90b32a-f25a-4d41-b1fa-c0180a481346 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:05.206371 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b26e7-eb07-4177-a9d2-57128e49c80e None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:05.224312 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855acb7-947d-4142-a14f-634289240b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:05.226818 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855acb7-947d-4142-a14f-634289240b33 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:05.227264 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855acb7-947d-4142-a14f-634289240b33 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:05.227673 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855acb7-947d-4142-a14f-634289240b33 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:05.229136 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3855acb7-947d-4142-a14f-634289240b33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:05.231804 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3855acb7-947d-4142-a14f-634289240b33 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:05.234565 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 57/107] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:22:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:22:05.242211 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855acb7-947d-4142-a14f-634289240b33 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:05.280088 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:05.295812 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cb37ed-7e9e-48bf-96b7-d90369e66dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:05.296705 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb37ed-7e9e-48bf-96b7-d90369e66dd8 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:05.297239 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb37ed-7e9e-48bf-96b7-d90369e66dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:05.297655 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb37ed-7e9e-48bf-96b7-d90369e66dd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:05.392132 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cb37ed-7e9e-48bf-96b7-d90369e66dd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:05.396269 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cb37ed-7e9e-48bf-96b7-d90369e66dd8 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:05.424090 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855acb7-947d-4142-a14f-634289240b33 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:05.482534 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b30e3f-4464-46a4-8e8b-3e62c437cf07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:05.483446 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b30e3f-4464-46a4-8e8b-3e62c437cf07 None admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:05.483868 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b30e3f-4464-46a4-8e8b-3e62c437cf07 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:05.484307 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b30e3f-4464-46a4-8e8b-3e62c437cf07 None admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:05.485102 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b30e3f-4464-46a4-8e8b-3e62c437cf07 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:05.486882 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b30e3f-4464-46a4-8e8b-3e62c437cf07 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:05.493785 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:05.520581 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 58/108] 10.222.0.83 () {60 vars in 1141 bytes} [Mon Aug 29 15:22:05 2022] POST /identity/v3/projects => generated 302 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:22:05.521780 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b30e3f-4464-46a4-8e8b-3e62c437cf07 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:05.568140 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 51/109] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:22:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 15:22:05.570098 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b83c17-a124-4c11-900f-9a6d005e9ad2 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:05.570098 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b83c17-a124-4c11-900f-9a6d005e9ad2 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:05.570270 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b83c17-a124-4c11-900f-9a6d005e9ad2 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:05.571675 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 52/110] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:05.573886 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b83c17-a124-4c11-900f-9a6d005e9ad2 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:05.617839 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:05.670003 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b30e3f-4464-46a4-8e8b-3e62c437cf07 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:05.748453 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4d4c5-ec67-4c1e-8bf7-0e44b0044c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:05.749394 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4d4c5-ec67-4c1e-8bf7-0e44b0044c7c None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:05.749841 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4d4c5-ec67-4c1e-8bf7-0e44b0044c7c None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:05.750259 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4d4c5-ec67-4c1e-8bf7-0e44b0044c7c None admin] PATH_INFO: `/v3/roles/member` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:05.758163 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b83c17-a124-4c11-900f-9a6d005e9ad2 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:05.765688 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4d4c5-ec67-4c1e-8bf7-0e44b0044c7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:05.772865 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-7fe4d4c5-ec67-4c1e-8bf7-0e44b0044c7c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:22:05.772865 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:05.772865 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:05.772865 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:05.772865 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:05.772865 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:05.772865 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:05.772865 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:05.772865 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:05.772865 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:05.772865 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:05.772865 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:05.772865 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:05.772865 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:05.772865 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:05.772865 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:05.773750 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:05.773750 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:05.773750 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:05.773750 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:05.773750 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:05.773750 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:05.773750 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:05.773750 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:05.773750 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:05.773750 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:05.773750 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:05.773750 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:05.773750 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:05.773750 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:05.773750 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:05.773750 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:05.774493 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:05.774493 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:05.774493 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:05.774493 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:05.774493 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:05.774493 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:05.774493 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:05.774493 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:05.774493 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:05.774493 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:05.774493 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:22:05.774493 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:22:05.776945 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 59/111] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:22:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:22:05.778272 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129b202-3ce8-41fb-9fc3-3b7a3f07dada None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:05.783078 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129b202-3ce8-41fb-9fc3-3b7a3f07dada None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:05.783078 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129b202-3ce8-41fb-9fc3-3b7a3f07dada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:05.798919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d48fc-c435-4885-8306-d946e6d2cffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:05.800377 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d48fc-c435-4885-8306-d946e6d2cffb None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:05.800662 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d48fc-c435-4885-8306-d946e6d2cffb None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:05.801001 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d48fc-c435-4885-8306-d946e6d2cffb None admin] PATH_INFO: `/v3/projects/81f3af84c83d43499bc734eb2261802e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:05.801884 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-9129b202-3ce8-41fb-9fc3-3b7a3f07dada None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:05.802130 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359d48fc-c435-4885-8306-d946e6d2cffb None admin] RBAC: Authorizing `identity:get_project(project_id=81f3af84c83d43499bc734eb2261802e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:05.803115 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9129b202-3ce8-41fb-9fc3-3b7a3f07dada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:05.803886 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359d48fc-c435-4885-8306-d946e6d2cffb None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:05.805951 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 53/112] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:22:05 2022] GET /identity/v3/projects/81f3af84c83d43499bc734eb2261802e => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:05.808838 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc2020-82ed-4474-b5c7-d7c65b0ba55c None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:05.809202 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc2020-82ed-4474-b5c7-d7c65b0ba55c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:05.809488 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc2020-82ed-4474-b5c7-d7c65b0ba55c None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:05.811038 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 54/113] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:05.811779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc2020-82ed-4474-b5c7-d7c65b0ba55c None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:05.862621 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:05.889550 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 60/114] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:22:05.891052 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae291632-943d-4d90-b4c7-b7efe169a8ab None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:05.891348 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae291632-943d-4d90-b4c7-b7efe169a8ab None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:05.891621 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae291632-943d-4d90-b4c7-b7efe169a8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:05.911366 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-ae291632-943d-4d90-b4c7-b7efe169a8ab None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:05.912643 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ae291632-943d-4d90-b4c7-b7efe169a8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:05.935006 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:05.942231 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc2020-82ed-4474-b5c7-d7c65b0ba55c None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:05.990848 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 61/115] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:22:05.991923 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae291632-943d-4d90-b4c7-b7efe169a8ab None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:06.023047 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a798a7a2-900b-4d85-b60b-3679b8052dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:06.024111 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798a7a2-900b-4d85-b60b-3679b8052dc2 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:06.024631 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798a7a2-900b-4d85-b60b-3679b8052dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:06.025097 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798a7a2-900b-4d85-b60b-3679b8052dc2 None admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:06.025957 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a798a7a2-900b-4d85-b60b-3679b8052dc2 None admin] RBAC: Adding query filter params (name=member) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:06.026451 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a798a7a2-900b-4d85-b60b-3679b8052dc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:06.028296 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a798a7a2-900b-4d85-b60b-3679b8052dc2 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:06.052592 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 55/116] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 15:22:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:06.061144 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a798a7a2-900b-4d85-b60b-3679b8052dc2 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:06.193820 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae291632-943d-4d90-b4c7-b7efe169a8ab None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:06.210565 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:06.217356 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a798a7a2-900b-4d85-b60b-3679b8052dc2 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:06.250846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decfdc48-60ad-4452-ac12-7ea40d927415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:06.252059 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfdc48-60ad-4452-ac12-7ea40d927415 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:06.252763 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfdc48-60ad-4452-ac12-7ea40d927415 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:06.253969 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfdc48-60ad-4452-ac12-7ea40d927415 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:06.253969 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decfdc48-60ad-4452-ac12-7ea40d927415 None admin] RBAC: Adding query filter params (role.id=7c797c10240d4c399d804718c977d567, scope.project.id=81f3af84c83d43499bc734eb2261802e, user.id=b7d81fc7f9984b35b62e7769af29a92e) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:06.254502 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decfdc48-60ad-4452-ac12-7ea40d927415 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:06.256312 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decfdc48-60ad-4452-ac12-7ea40d927415 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:06.260773 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f154f4-c571-42ae-b9e0-e1f2c33c05eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:06.261637 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f154f4-c571-42ae-b9e0-e1f2c33c05eb None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:06.262122 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f154f4-c571-42ae-b9e0-e1f2c33c05eb None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:06.262541 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f154f4-c571-42ae-b9e0-e1f2c33c05eb None admin] PATH_INFO: `/v3/users/618f35cfd2d04e50a8c22d7b8993a5fe` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:06.263465 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 62/117] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 15:22:05 2022] GET /identity/v3/role_assignments?user.id=b7d81fc7f9984b35b62e7769af29a92e&scope.project.id=81f3af84c83d43499bc734eb2261802e&role.id=7c797c10240d4c399d804718c977d567 => generated 259 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:06.264239 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f154f4-c571-42ae-b9e0-e1f2c33c05eb None admin] RBAC: Authorizing `identity:get_user(user_id=618f35cfd2d04e50a8c22d7b8993a5fe)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:06.264771 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a473fb0-1ed4-4212-b6c5-43b816ff6c8e None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:06.265150 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a473fb0-1ed4-4212-b6c5-43b816ff6c8e None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:06.265524 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a473fb0-1ed4-4212-b6c5-43b816ff6c8e None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:06.266361 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f154f4-c571-42ae-b9e0-e1f2c33c05eb None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:06.266963 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 63/118] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:06.267808 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a473fb0-1ed4-4212-b6c5-43b816ff6c8e None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:06.269373 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 56/119] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 15:22:06 2022] GET /identity/v3/users/618f35cfd2d04e50a8c22d7b8993a5fe => generated 275 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:06.274801 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f154f4-c571-42ae-b9e0-e1f2c33c05eb None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:06.344745 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:06.439183 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f154f4-c571-42ae-b9e0-e1f2c33c05eb None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:06.443758 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a473fb0-1ed4-4212-b6c5-43b816ff6c8e None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:06.475688 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f051858-a4be-4fd8-9417-bf6b3d3197f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:06.476254 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f051858-a4be-4fd8-9417-bf6b3d3197f7 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:06.476532 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f051858-a4be-4fd8-9417-bf6b3d3197f7 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:06.476880 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f051858-a4be-4fd8-9417-bf6b3d3197f7 None admin] PATH_INFO: `/v3/projects/81f3af84c83d43499bc734eb2261802e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:06.477932 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f051858-a4be-4fd8-9417-bf6b3d3197f7 None admin] RBAC: Authorizing `identity:get_project(project_id=81f3af84c83d43499bc734eb2261802e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:06.479408 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f051858-a4be-4fd8-9417-bf6b3d3197f7 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:06.481374 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 57/120] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:22:06 2022] GET /identity/v3/projects/81f3af84c83d43499bc734eb2261802e => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:22:06.482549 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f418c70-9520-45e3-9d36-7a1999ccc7cd None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:06.482842 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f418c70-9520-45e3-9d36-7a1999ccc7cd None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:06.483136 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f418c70-9520-45e3-9d36-7a1999ccc7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:06.485426 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15230f-349f-40ad-857b-c29eb84083ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:06.486285 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15230f-349f-40ad-857b-c29eb84083ba None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:06.487281 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15230f-349f-40ad-857b-c29eb84083ba None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:06.488097 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15230f-349f-40ad-857b-c29eb84083ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:06.501128 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15230f-349f-40ad-857b-c29eb84083ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:06.502663 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-2f418c70-9520-45e3-9d36-7a1999ccc7cd None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:06.503911 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2f418c70-9520-45e3-9d36-7a1999ccc7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:06.507379 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-4f15230f-349f-40ad-857b-c29eb84083ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:22:06.507379 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:06.507379 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:06.507379 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:06.507379 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:06.507379 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:06.507379 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:06.507379 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:06.507379 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:06.507379 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:06.507379 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:06.507379 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:06.507379 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:06.507379 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:06.507379 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:06.507379 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:06.508439 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:06.508439 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:06.508439 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:06.508439 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:06.508439 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:06.508439 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:06.508439 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:06.508439 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:06.508439 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:06.508439 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:06.508439 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:06.508439 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:06.508439 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:06.508439 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:06.508439 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:06.508439 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:06.509354 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:06.509354 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:06.509354 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:06.509354 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:06.509354 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:06.509354 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:06.509354 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:06.509354 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:06.509354 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:06.509354 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:06.509354 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:22:06.509354 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:22:06.511273 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 64/121] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 15:22:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:22:06.516683 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15230f-349f-40ad-857b-c29eb84083ba None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:06.550881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:06.578411 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 58/122] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:22:06.579205 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f418c70-9520-45e3-9d36-7a1999ccc7cd None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:06.625740 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15230f-349f-40ad-857b-c29eb84083ba None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:06.660029 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:06.662645 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862067fd-01d1-4367-8407-ad755b5e6e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:06.663577 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862067fd-01d1-4367-8407-ad755b5e6e72 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:06.664064 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862067fd-01d1-4367-8407-ad755b5e6e72 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:06.664529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862067fd-01d1-4367-8407-ad755b5e6e72 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:06.677031 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862067fd-01d1-4367-8407-ad755b5e6e72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:06.683395 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-862067fd-01d1-4367-8407-ad755b5e6e72 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:22:06.683395 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:06.683395 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:06.683395 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:06.683395 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:06.683395 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:06.683395 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:06.683395 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:06.683395 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:06.683395 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:06.683395 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:06.683395 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:06.683395 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:06.683395 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:06.683395 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:06.683395 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:06.684259 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:06.684259 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:06.684259 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:06.684259 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:06.684259 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:06.684259 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:06.684259 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:06.684259 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:06.684259 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:06.684259 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:06.684259 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:06.684259 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:06.684259 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:06.684259 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:06.684259 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:06.684259 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:06.685105 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:06.685105 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:06.685105 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:06.685105 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:06.685105 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:06.685105 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:06.685105 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:06.685105 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:06.685105 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:06.685105 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:06.685105 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:22:06.685105 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:22:06.687640 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f418c70-9520-45e3-9d36-7a1999ccc7cd None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:06.687835 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 65/123] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:22:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:22:06.693484 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862067fd-01d1-4367-8407-ad755b5e6e72 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:06.753297 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06301565-d54e-4666-b44a-23d657e7803d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:06.754101 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06301565-d54e-4666-b44a-23d657e7803d None admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:06.754349 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06301565-d54e-4666-b44a-23d657e7803d None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:06.754630 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06301565-d54e-4666-b44a-23d657e7803d None admin] PATH_INFO: `/v3/projects/81f3af84c83d43499bc734eb2261802e/users/618f35cfd2d04e50a8c22d7b8993a5fe/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:06.762492 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06301565-d54e-4666-b44a-23d657e7803d None admin] RBAC: Authorizing `identity:create_grant(project_id=81f3af84c83d43499bc734eb2261802e, user_id=618f35cfd2d04e50a8c22d7b8993a5fe, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:06.764142 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06301565-d54e-4666-b44a-23d657e7803d None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:06.794256 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 59/124] 10.222.0.83 () {58 vars in 1439 bytes} [Mon Aug 29 15:22:06 2022] PUT /identity/v3/projects/81f3af84c83d43499bc734eb2261802e/users/618f35cfd2d04e50a8c22d7b8993a5fe/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:22:06.795050 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06301565-d54e-4666-b44a-23d657e7803d None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:06.811479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:06.822445 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862067fd-01d1-4367-8407-ad755b5e6e72 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:06.895414 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d34db-186e-4528-b44a-b0339e19cab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:06.896410 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d34db-186e-4528-b44a-b0339e19cab7 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:06.896894 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d34db-186e-4528-b44a-b0339e19cab7 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:06.897365 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d34db-186e-4528-b44a-b0339e19cab7 None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:06.898245 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d34db-186e-4528-b44a-b0339e19cab7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:06.898776 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d34db-186e-4528-b44a-b0339e19cab7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:06.901498 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d34db-186e-4528-b44a-b0339e19cab7 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:06.915779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:06.922501 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 66/125] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:22:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:06.932118 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d34db-186e-4528-b44a-b0339e19cab7 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:06.947556 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06301565-d54e-4666-b44a-23d657e7803d None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:07.022571 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4befe0c-6fe2-4823-aa88-d5dd76ff5bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:07.023150 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4befe0c-6fe2-4823-aa88-d5dd76ff5bc0 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:07.023435 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4befe0c-6fe2-4823-aa88-d5dd76ff5bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:07.023710 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4befe0c-6fe2-4823-aa88-d5dd76ff5bc0 None admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:07.024389 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4befe0c-6fe2-4823-aa88-d5dd76ff5bc0 None admin] RBAC: Adding query filter params (name=member) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:07.024693 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4befe0c-6fe2-4823-aa88-d5dd76ff5bc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:07.026091 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4befe0c-6fe2-4823-aa88-d5dd76ff5bc0 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:07.043873 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 60/126] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 15:22:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:07.044740 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4befe0c-6fe2-4823-aa88-d5dd76ff5bc0 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:07.105818 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d34db-186e-4528-b44a-b0339e19cab7 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:07.164359 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf98693-467d-4a3f-9964-ce29c1ac69aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:07.165021 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf98693-467d-4a3f-9964-ce29c1ac69aa None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:07.165304 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf98693-467d-4a3f-9964-ce29c1ac69aa None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:07.165580 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf98693-467d-4a3f-9964-ce29c1ac69aa None admin] PATH_INFO: `/v3/users/6db5f614a81044e59454d15b8c60cf8f` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:07.166787 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf98693-467d-4a3f-9964-ce29c1ac69aa None admin] RBAC: Authorizing `identity:get_user(user_id=6db5f614a81044e59454d15b8c60cf8f)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:07.168354 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf98693-467d-4a3f-9964-ce29c1ac69aa None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:07.169708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4befe0c-6fe2-4823-aa88-d5dd76ff5bc0 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:07.169981 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 67/127] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 15:22:06 2022] GET /identity/v3/users/6db5f614a81044e59454d15b8c60cf8f => generated 247 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:07.170750 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf98693-467d-4a3f-9964-ce29c1ac69aa None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:07.206070 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:07.226181 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441c546-3c91-492a-afd9-1f8bfae0bf9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:07.226826 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441c546-3c91-492a-afd9-1f8bfae0bf9f None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:07.227670 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441c546-3c91-492a-afd9-1f8bfae0bf9f None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:07.227952 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441c546-3c91-492a-afd9-1f8bfae0bf9f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:07.249308 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3441c546-3c91-492a-afd9-1f8bfae0bf9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:07.258040 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-3441c546-3c91-492a-afd9-1f8bfae0bf9f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 15:22:07.258040 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:07.258040 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:07.258040 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:07.258040 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:07.258040 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:07.258040 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:07.258040 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:07.258040 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:07.258040 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:07.258040 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:07.258040 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:07.258040 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:07.258040 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:07.258040 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:07.258040 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:07.258922 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:07.258922 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:07.258922 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:07.258922 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:07.258922 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:07.258922 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:07.258922 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:07.258922 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:07.258922 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:07.258922 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:07.258922 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:07.258922 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:07.258922 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:07.258922 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:07.258922 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:07.258922 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:07.259728 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:07.259728 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:07.259728 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:07.259728 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:07.259728 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:07.259728 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:07.259728 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:07.259728 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:07.259728 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:07.259728 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:07.259728 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 15:22:07.259728 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:22:07.269125 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 61/128] 10.222.0.83 () {56 vars in 1114 bytes} [Mon Aug 29 15:22:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:22:07.270156 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441c546-3c91-492a-afd9-1f8bfae0bf9f None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:07.291107 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:07.337556 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf98693-467d-4a3f-9964-ce29c1ac69aa None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:07.379456 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d46cbd-3acc-4921-aa9e-803f64066732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:07.380108 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d46cbd-3acc-4921-aa9e-803f64066732 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:07.381796 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d46cbd-3acc-4921-aa9e-803f64066732 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:07.382076 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d46cbd-3acc-4921-aa9e-803f64066732 None admin] PATH_INFO: `/v3/users/618f35cfd2d04e50a8c22d7b8993a5fe` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:07.384549 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d46cbd-3acc-4921-aa9e-803f64066732 None admin] RBAC: Authorizing `identity:get_user(user_id=618f35cfd2d04e50a8c22d7b8993a5fe)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:07.388067 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d46cbd-3acc-4921-aa9e-803f64066732 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:07.393223 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 68/129] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 15:22:07 2022] GET /identity/v3/users/618f35cfd2d04e50a8c22d7b8993a5fe => generated 275 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:07.395399 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d46cbd-3acc-4921-aa9e-803f64066732 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:07.462656 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441c546-3c91-492a-afd9-1f8bfae0bf9f None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:07.538076 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e9402-dcf5-4dde-bb35-35af20372c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:07.538724 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e9402-dcf5-4dde-bb35-35af20372c73 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:07.539007 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e9402-dcf5-4dde-bb35-35af20372c73 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:07.539545 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e9402-dcf5-4dde-bb35-35af20372c73 None admin] PATH_INFO: `/v3/projects/81f3af84c83d43499bc734eb2261802e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:07.541744 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113e9402-dcf5-4dde-bb35-35af20372c73 None admin] RBAC: Authorizing `identity:get_project(project_id=81f3af84c83d43499bc734eb2261802e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:07.543418 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113e9402-dcf5-4dde-bb35-35af20372c73 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:07.544937 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:07.550168 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 62/130] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:22:07 2022] GET /identity/v3/projects/81f3af84c83d43499bc734eb2261802e => generated 298 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:07.550987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e9402-dcf5-4dde-bb35-35af20372c73 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:07.561011 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d46cbd-3acc-4921-aa9e-803f64066732 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:07.606593 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db75fddd-855a-42a5-8411-3c80881ad5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:07.607263 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75fddd-855a-42a5-8411-3c80881ad5e7 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:07.607547 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75fddd-855a-42a5-8411-3c80881ad5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:07.607823 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75fddd-855a-42a5-8411-3c80881ad5e7 None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:07.608611 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db75fddd-855a-42a5-8411-3c80881ad5e7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:07.608921 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db75fddd-855a-42a5-8411-3c80881ad5e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:07.610419 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db75fddd-855a-42a5-8411-3c80881ad5e7 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:07.624515 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 69/131] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:22:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:07.625397 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db75fddd-855a-42a5-8411-3c80881ad5e7 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:07.677478 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:07.726099 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e9402-dcf5-4dde-bb35-35af20372c73 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:07.754054 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db75fddd-855a-42a5-8411-3c80881ad5e7 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:07.792066 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85f809-7375-41c3-8558-698222573a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:07.793735 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85f809-7375-41c3-8558-698222573a35 None admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:07.794789 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85f809-7375-41c3-8558-698222573a35 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:07.795393 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85f809-7375-41c3-8558-698222573a35 None admin] PATH_INFO: `/v3/projects/81f3af84c83d43499bc734eb2261802e/users/6db5f614a81044e59454d15b8c60cf8f/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:07.799822 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b85f809-7375-41c3-8558-698222573a35 None admin] RBAC: Authorizing `identity:create_grant(project_id=81f3af84c83d43499bc734eb2261802e, user_id=6db5f614a81044e59454d15b8c60cf8f, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:07.802090 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b85f809-7375-41c3-8558-698222573a35 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:07.814350 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb601f83-ade7-4385-b6cd-c839c53c77d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:07.816530 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb601f83-ade7-4385-b6cd-c839c53c77d4 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:07.817578 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb601f83-ade7-4385-b6cd-c839c53c77d4 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:07.818994 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb601f83-ade7-4385-b6cd-c839c53c77d4 None admin] PATH_INFO: `/v3/projects/15b426bd7a14464db64108758c77e848` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:07.821796 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb601f83-ade7-4385-b6cd-c839c53c77d4 None admin] RBAC: Authorizing `identity:get_project(project_id=15b426bd7a14464db64108758c77e848)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:07.823605 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb601f83-ade7-4385-b6cd-c839c53c77d4 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:07.826085 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 70/132] 10.222.0.83 () {58 vars in 1439 bytes} [Mon Aug 29 15:22:07 2022] PUT /identity/v3/projects/81f3af84c83d43499bc734eb2261802e/users/6db5f614a81044e59454d15b8c60cf8f/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:22:07.828043 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 63/133] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:22:07 2022] GET /identity/v3/projects/15b426bd7a14464db64108758c77e848 => generated 312 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:07.829105 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85f809-7375-41c3-8558-698222573a35 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:07.834672 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb601f83-ade7-4385-b6cd-c839c53c77d4 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:07.858512 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:08.011074 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85f809-7375-41c3-8558-698222573a35 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:08.050439 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41497c77-d271-40b5-b715-6a71b9eba4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:08.051439 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41497c77-d271-40b5-b715-6a71b9eba4f8 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:08.051902 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41497c77-d271-40b5-b715-6a71b9eba4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:08.052355 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41497c77-d271-40b5-b715-6a71b9eba4f8 None admin] PATH_INFO: `/v3/users/618f35cfd2d04e50a8c22d7b8993a5fe` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:08.052903 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb601f83-ade7-4385-b6cd-c839c53c77d4 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:08.054186 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41497c77-d271-40b5-b715-6a71b9eba4f8 None admin] RBAC: Authorizing `identity:get_user(user_id=618f35cfd2d04e50a8c22d7b8993a5fe)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:08.057298 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41497c77-d271-40b5-b715-6a71b9eba4f8 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:08.059305 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 71/134] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 15:22:07 2022] GET /identity/v3/users/618f35cfd2d04e50a8c22d7b8993a5fe => generated 275 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:08.060882 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31595ca3-4250-4158-8341-fab26b908a76 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:08.061366 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31595ca3-4250-4158-8341-fab26b908a76 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:08.062450 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31595ca3-4250-4158-8341-fab26b908a76 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:08.064157 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 72/135] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:08.065773 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31595ca3-4250-4158-8341-fab26b908a76 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:08.136996 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d1be99-afc7-47c6-8027-75b92dfd1ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:08.137850 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1be99-afc7-47c6-8027-75b92dfd1ba7 None admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:08.138175 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1be99-afc7-47c6-8027-75b92dfd1ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:08.138457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1be99-afc7-47c6-8027-75b92dfd1ba7 None admin] PATH_INFO: `/v3/projects/15b426bd7a14464db64108758c77e848/users/618f35cfd2d04e50a8c22d7b8993a5fe/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:08.141472 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d1be99-afc7-47c6-8027-75b92dfd1ba7 None admin] RBAC: Authorizing `identity:create_grant(project_id=15b426bd7a14464db64108758c77e848, user_id=618f35cfd2d04e50a8c22d7b8993a5fe, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:08.143829 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d1be99-afc7-47c6-8027-75b92dfd1ba7 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:08.167495 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 64/136] 10.222.0.83 () {58 vars in 1439 bytes} [Mon Aug 29 15:22:07 2022] PUT /identity/v3/projects/15b426bd7a14464db64108758c77e848/users/618f35cfd2d04e50a8c22d7b8993a5fe/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:22:08.168915 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b21b87-4fb3-460a-9abd-8c3434d35d80 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:08.169241 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b21b87-4fb3-460a-9abd-8c3434d35d80 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:08.169535 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b21b87-4fb3-460a-9abd-8c3434d35d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:08.188190 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:08.199210 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:08.213991 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-81b21b87-4fb3-460a-9abd-8c3434d35d80 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:08.215442 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-81b21b87-4fb3-460a-9abd-8c3434d35d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:08.240879 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31595ca3-4250-4158-8341-fab26b908a76 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:08.349248 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 65/137] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:22:08.355131 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3d976-bb52-4faf-b9fe-cfb254af6f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:08.355131 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3d976-bb52-4faf-b9fe-cfb254af6f6f None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:08.355131 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3d976-bb52-4faf-b9fe-cfb254af6f6f None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:08.355131 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3d976-bb52-4faf-b9fe-cfb254af6f6f None admin] PATH_INFO: `/v3/projects/81f3af84c83d43499bc734eb2261802e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:08.356035 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3d976-bb52-4faf-b9fe-cfb254af6f6f None admin] RBAC: Authorizing `identity:get_project(project_id=81f3af84c83d43499bc734eb2261802e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:08.357510 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3d976-bb52-4faf-b9fe-cfb254af6f6f None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:08.359445 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 73/138] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:22:08 2022] GET /identity/v3/projects/81f3af84c83d43499bc734eb2261802e => generated 298 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:08.367233 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b21b87-4fb3-460a-9abd-8c3434d35d80 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:08.479918 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b21b87-4fb3-460a-9abd-8c3434d35d80 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:08.518355 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b958ae-8fd2-4bc4-8609-753c9a6ab951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:08.519433 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b958ae-8fd2-4bc4-8609-753c9a6ab951 None admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:08.519933 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b958ae-8fd2-4bc4-8609-753c9a6ab951 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:08.520404 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b958ae-8fd2-4bc4-8609-753c9a6ab951 None admin] PATH_INFO: `/v3/projects/81f3af84c83d43499bc734eb2261802e/users/618f35cfd2d04e50a8c22d7b8993a5fe/roles/3e8f6ab382f64437b245115f5a28f535` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:08.522783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b958ae-8fd2-4bc4-8609-753c9a6ab951 None admin] RBAC: Authorizing `identity:create_grant(project_id=81f3af84c83d43499bc734eb2261802e, user_id=618f35cfd2d04e50a8c22d7b8993a5fe, role_id=3e8f6ab382f64437b245115f5a28f535)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:08.524481 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b958ae-8fd2-4bc4-8609-753c9a6ab951 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:08.527776 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:08.542204 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 66/139] 10.222.0.83 () {58 vars in 1439 bytes} [Mon Aug 29 15:22:08 2022] PUT /identity/v3/projects/81f3af84c83d43499bc734eb2261802e/users/618f35cfd2d04e50a8c22d7b8993a5fe/roles/3e8f6ab382f64437b245115f5a28f535 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:22:08.802526 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeab722-516c-467c-af32-c1b2edec7b7a None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:08.803315 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeab722-516c-467c-af32-c1b2edec7b7a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:08.803386 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeab722-516c-467c-af32-c1b2edec7b7a None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:08.804799 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 74/140] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:08.810378 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620db9e-b321-4f86-b8ca-d42512e722b8 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:08.810906 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620db9e-b321-4f86-b8ca-d42512e722b8 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:08.811432 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620db9e-b321-4f86-b8ca-d42512e722b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:08.831644 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-0620db9e-b321-4f86-b8ca-d42512e722b8 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:08.833764 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0620db9e-b321-4f86-b8ca-d42512e722b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:08.915415 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 67/141] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:22:08.933066 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeab722-516c-467c-af32-c1b2edec7b7a None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:09.092871 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeab722-516c-467c-af32-c1b2edec7b7a None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:09.141105 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47183ab3-6f6d-4497-a2c6-1157635fd58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:09.141749 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47183ab3-6f6d-4497-a2c6-1157635fd58a None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:09.142024 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47183ab3-6f6d-4497-a2c6-1157635fd58a None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:09.143011 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47183ab3-6f6d-4497-a2c6-1157635fd58a None admin] PATH_INFO: `/v3/domains/default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:09.144199 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47183ab3-6f6d-4497-a2c6-1157635fd58a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:09.145640 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47183ab3-6f6d-4497-a2c6-1157635fd58a None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:09.147569 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 75/142] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:22:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:09.153504 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0620db9e-b321-4f86-b8ca-d42512e722b8 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:09.315924 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0620db9e-b321-4f86-b8ca-d42512e722b8 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:09.345749 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47183ab3-6f6d-4497-a2c6-1157635fd58a None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:09.351961 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:09.363202 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff558a4-35a5-4b29-8d49-fbfda393b45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:09.363835 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff558a4-35a5-4b29-8d49-fbfda393b45a None admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:09.364119 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff558a4-35a5-4b29-8d49-fbfda393b45a None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:09.364397 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff558a4-35a5-4b29-8d49-fbfda393b45a None admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:09.365576 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff558a4-35a5-4b29-8d49-fbfda393b45a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:09.367154 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff558a4-35a5-4b29-8d49-fbfda393b45a None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:09.397660 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 68/143] 10.222.0.83 () {60 vars in 1132 bytes} [Mon Aug 29 15:22:09 2022] POST /identity/v3/users => generated 283 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:22:09.400237 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:09.522113 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12ff14-c2e2-4f1f-9a42-5a31158d7ffb None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:09.522787 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12ff14-c2e2-4f1f-9a42-5a31158d7ffb None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:09.523311 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12ff14-c2e2-4f1f-9a42-5a31158d7ffb None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:09.525847 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 69/144] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:22:09.532230 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c163f1-6d97-4e78-8833-ba8d03721a79 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:09.532836 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c163f1-6d97-4e78-8833-ba8d03721a79 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:09.533334 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c163f1-6d97-4e78-8833-ba8d03721a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:09.548310 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47183ab3-6f6d-4497-a2c6-1157635fd58a None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:09.554646 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-49c163f1-6d97-4e78-8833-ba8d03721a79 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:09.556187 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-49c163f1-6d97-4e78-8833-ba8d03721a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:09.600126 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00461fe7-05de-4964-b05f-143e1aed376c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:09.600698 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00461fe7-05de-4964-b05f-143e1aed376c None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:09.600979 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00461fe7-05de-4964-b05f-143e1aed376c None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:09.601329 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00461fe7-05de-4964-b05f-143e1aed376c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:09.619346 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00461fe7-05de-4964-b05f-143e1aed376c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:09.630867 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-00461fe7-05de-4964-b05f-143e1aed376c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 15:22:09.630867 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:09.630867 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:09.630867 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:09.630867 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:09.630867 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:09.630867 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:09.630867 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:09.630867 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:09.630867 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:09.630867 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:09.630867 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:09.630867 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:09.630867 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:09.630867 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:09.630867 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:09.631834 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:09.631834 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:09.631834 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:09.631834 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:09.631834 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:09.631834 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:09.631834 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:09.631834 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:09.631834 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:09.631834 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:09.631834 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:09.631834 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:09.631834 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:09.631834 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:09.631834 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:09.631834 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:09.632617 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:09.632617 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:09.632617 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:09.632617 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:09.632617 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:09.632617 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:09.632617 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:09.632617 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:09.632617 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:09.632617 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:09.632617 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 15:22:09.632617 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:22:09.632617 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 76/145] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:22:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:22:09.640345 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00461fe7-05de-4964-b05f-143e1aed376c None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:09.641868 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 70/146] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 15:22:09.780477 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00461fe7-05de-4964-b05f-143e1aed376c None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:09.783485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:09.818718 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c042a6-d462-4d45-adcb-11b21a602c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:09.819365 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c042a6-d462-4d45-adcb-11b21a602c3a None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:09.819690 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c042a6-d462-4d45-adcb-11b21a602c3a None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:09.819968 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c042a6-d462-4d45-adcb-11b21a602c3a None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:09.820691 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c042a6-d462-4d45-adcb-11b21a602c3a None admin] RBAC: Adding query filter params (name=reader) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:09.821004 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c042a6-d462-4d45-adcb-11b21a602c3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:09.822398 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c042a6-d462-4d45-adcb-11b21a602c3a None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:09.831467 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 77/147] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 15:22:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:22:09.837121 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c163f1-6d97-4e78-8833-ba8d03721a79 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:09.970108 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c163f1-6d97-4e78-8833-ba8d03721a79 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:09.984919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:10.011229 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40183ab6-beca-46a0-8265-2828f8f40d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:10.012161 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40183ab6-beca-46a0-8265-2828f8f40d5c None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:10.012447 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40183ab6-beca-46a0-8265-2828f8f40d5c None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:10.012720 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40183ab6-beca-46a0-8265-2828f8f40d5c None admin] PATH_INFO: `/v3/users/b7d81fc7f9984b35b62e7769af29a92e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:10.013861 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40183ab6-beca-46a0-8265-2828f8f40d5c None admin] RBAC: Authorizing `identity:get_user(user_id=b7d81fc7f9984b35b62e7769af29a92e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:10.015394 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40183ab6-beca-46a0-8265-2828f8f40d5c None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:10.017019 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 71/148] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 15:22:09 2022] GET /identity/v3/users/b7d81fc7f9984b35b62e7769af29a92e => generated 289 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:10.023341 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c042a6-d462-4d45-adcb-11b21a602c3a None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:10.163431 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c042a6-d462-4d45-adcb-11b21a602c3a None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:10.192792 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40183ab6-beca-46a0-8265-2828f8f40d5c None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:10.205998 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b98e1a-99a9-455b-a94b-955ec3cc0b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:10.207107 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b98e1a-99a9-455b-a94b-955ec3cc0b7f None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:10.207605 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b98e1a-99a9-455b-a94b-955ec3cc0b7f None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:10.208088 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b98e1a-99a9-455b-a94b-955ec3cc0b7f None admin] PATH_INFO: `/v3/projects/81f3af84c83d43499bc734eb2261802e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:10.209560 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b98e1a-99a9-455b-a94b-955ec3cc0b7f None admin] RBAC: Authorizing `identity:get_project(project_id=81f3af84c83d43499bc734eb2261802e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:10.211401 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b98e1a-99a9-455b-a94b-955ec3cc0b7f None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:10.213361 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 78/149] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:22:10 2022] GET /identity/v3/projects/81f3af84c83d43499bc734eb2261802e => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:10.219006 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b98e1a-99a9-455b-a94b-955ec3cc0b7f None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:10.241030 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:10.391336 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40183ab6-beca-46a0-8265-2828f8f40d5c None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:10.411819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b98e1a-99a9-455b-a94b-955ec3cc0b7f None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:10.464130 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67b94e-3d93-40aa-9743-2778233f852e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:10.465122 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67b94e-3d93-40aa-9743-2778233f852e None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:10.465627 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67b94e-3d93-40aa-9743-2778233f852e None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:10.466087 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67b94e-3d93-40aa-9743-2778233f852e None admin] PATH_INFO: `/v3/roles/member` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:10.477692 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689948b7-b004-4cc9-9be9-ba36bd6a0a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:10.479615 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689948b7-b004-4cc9-9be9-ba36bd6a0a5b None admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:10.480297 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689948b7-b004-4cc9-9be9-ba36bd6a0a5b None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:10.481370 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689948b7-b004-4cc9-9be9-ba36bd6a0a5b None admin] PATH_INFO: `/v3/projects/81f3af84c83d43499bc734eb2261802e/users/b7d81fc7f9984b35b62e7769af29a92e/roles/7c797c10240d4c399d804718c977d567` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:10.486354 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689948b7-b004-4cc9-9be9-ba36bd6a0a5b None admin] RBAC: Authorizing `identity:create_grant(project_id=81f3af84c83d43499bc734eb2261802e, user_id=b7d81fc7f9984b35b62e7769af29a92e, role_id=7c797c10240d4c399d804718c977d567)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:10.487249 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b67b94e-3d93-40aa-9743-2778233f852e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:10.490477 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689948b7-b004-4cc9-9be9-ba36bd6a0a5b None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:10.497098 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-1b67b94e-3d93-40aa-9743-2778233f852e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:22:10.497098 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:10.497098 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:10.497098 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:10.497098 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:10.497098 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:10.497098 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:10.497098 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:10.497098 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:10.497098 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:10.497098 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:10.497098 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:10.497098 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:10.497098 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:10.497098 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:10.497098 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:10.497920 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:10.497920 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:10.497920 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:10.497920 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:10.497920 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:10.497920 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:10.497920 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:10.497920 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:10.497920 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:10.497920 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:10.497920 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:10.497920 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:10.497920 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:10.497920 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:10.497920 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:10.497920 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:10.498673 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:10.498673 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:10.498673 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:10.498673 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:10.498673 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:10.498673 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:10.498673 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:10.498673 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:10.498673 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:10.498673 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:10.498673 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:22:10.498673 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:22:10.502659 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 72/150] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:22:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:22:10.509814 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67b94e-3d93-40aa-9743-2778233f852e None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:10.525046 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 79/151] 10.222.0.83 () {58 vars in 1439 bytes} [Mon Aug 29 15:22:10 2022] PUT /identity/v3/projects/81f3af84c83d43499bc734eb2261802e/users/b7d81fc7f9984b35b62e7769af29a92e/roles/7c797c10240d4c399d804718c977d567 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:22:10.561673 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:10.627982 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67b94e-3d93-40aa-9743-2778233f852e None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:10.665776 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5beddd-d0f8-4af2-95bf-69dd0583a073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:10.666444 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5beddd-d0f8-4af2-95bf-69dd0583a073 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:10.666720 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5beddd-d0f8-4af2-95bf-69dd0583a073 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:10.666988 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5beddd-d0f8-4af2-95bf-69dd0583a073 None admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:10.667687 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5beddd-d0f8-4af2-95bf-69dd0583a073 None admin] RBAC: Adding query filter params (name=member) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:10.667988 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5beddd-d0f8-4af2-95bf-69dd0583a073 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:10.669387 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5beddd-d0f8-4af2-95bf-69dd0583a073 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:10.679918 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 73/152] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 15:22:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:22:10.685746 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689948b7-b004-4cc9-9be9-ba36bd6a0a5b None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:10.779628 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:10.798460 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035e17b-d1ec-4ad8-9bdc-3c8cf4be6628 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:10.798897 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035e17b-d1ec-4ad8-9bdc-3c8cf4be6628 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:10.799226 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035e17b-d1ec-4ad8-9bdc-3c8cf4be6628 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:10.800805 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 74/153] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:10.806127 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71064dc-8d0a-4e39-ba94-9faf0099fb13 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:10.806405 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71064dc-8d0a-4e39-ba94-9faf0099fb13 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:10.806678 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71064dc-8d0a-4e39-ba94-9faf0099fb13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:10.835389 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689948b7-b004-4cc9-9be9-ba36bd6a0a5b None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:10.840091 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a71064dc-8d0a-4e39-ba94-9faf0099fb13 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:10.841293 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a71064dc-8d0a-4e39-ba94-9faf0099fb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:10.887463 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc0f16-68a6-4518-9916-b2c1f66745a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:10.888555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc0f16-68a6-4518-9916-b2c1f66745a3 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:10.889027 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc0f16-68a6-4518-9916-b2c1f66745a3 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:10.889494 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc0f16-68a6-4518-9916-b2c1f66745a3 None admin] PATH_INFO: `/v3/users/618f35cfd2d04e50a8c22d7b8993a5fe` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:10.893461 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc0f16-68a6-4518-9916-b2c1f66745a3 None admin] RBAC: Authorizing `identity:get_user(user_id=618f35cfd2d04e50a8c22d7b8993a5fe)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:10.895333 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc0f16-68a6-4518-9916-b2c1f66745a3 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:10.897744 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 80/154] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 15:22:10 2022] GET /identity/v3/users/618f35cfd2d04e50a8c22d7b8993a5fe => generated 275 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:10.914168 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc0f16-68a6-4518-9916-b2c1f66745a3 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:10.971539 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 75/155] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 15:22:11.055907 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc0f16-68a6-4518-9916-b2c1f66745a3 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:11.092465 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6e2cd0-32bf-4c31-917d-01ad9d8a3c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:11.093508 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e2cd0-32bf-4c31-917d-01ad9d8a3c23 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:11.093989 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e2cd0-32bf-4c31-917d-01ad9d8a3c23 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:11.094447 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e2cd0-32bf-4c31-917d-01ad9d8a3c23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:11.097705 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:11.171059 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6e2cd0-32bf-4c31-917d-01ad9d8a3c23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:11.172579 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6e2cd0-32bf-4c31-917d-01ad9d8a3c23 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:11.287493 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 81/156] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:22:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 15:22:11.293212 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71064dc-8d0a-4e39-ba94-9faf0099fb13 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:11.336666 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:11.419292 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71064dc-8d0a-4e39-ba94-9faf0099fb13 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:11.458950 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d363203-39de-4e6e-944f-c9b2dd99a506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:11.459866 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d363203-39de-4e6e-944f-c9b2dd99a506 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:11.460291 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d363203-39de-4e6e-944f-c9b2dd99a506 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:11.460703 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d363203-39de-4e6e-944f-c9b2dd99a506 None admin] PATH_INFO: `/v3/projects/81f3af84c83d43499bc734eb2261802e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:11.462042 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d363203-39de-4e6e-944f-c9b2dd99a506 None admin] RBAC: Authorizing `identity:get_project(project_id=81f3af84c83d43499bc734eb2261802e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:11.463655 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d363203-39de-4e6e-944f-c9b2dd99a506 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:11.465463 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 76/157] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:22:11 2022] GET /identity/v3/projects/81f3af84c83d43499bc734eb2261802e => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:11.472614 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6e2cd0-32bf-4c31-917d-01ad9d8a3c23 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:11.513332 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:11.586458 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6e2cd0-32bf-4c31-917d-01ad9d8a3c23 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:11.622378 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e11cd3-df71-4894-a80a-b46846cad331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:11.622906 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e11cd3-df71-4894-a80a-b46846cad331 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:11.623217 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e11cd3-df71-4894-a80a-b46846cad331 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:11.623491 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e11cd3-df71-4894-a80a-b46846cad331 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:11.624283 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e11cd3-df71-4894-a80a-b46846cad331 None admin] RBAC: Adding query filter params (role.id=e85047210af34e2d87f8162c8bd2005e, scope.project.id=81f3af84c83d43499bc734eb2261802e, user.id=618f35cfd2d04e50a8c22d7b8993a5fe) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:11.624598 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e11cd3-df71-4894-a80a-b46846cad331 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:11.626108 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e11cd3-df71-4894-a80a-b46846cad331 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:11.632769 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 82/158] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 15:22:11 2022] GET /identity/v3/role_assignments?user.id=618f35cfd2d04e50a8c22d7b8993a5fe&scope.project.id=81f3af84c83d43499bc734eb2261802e&role.id=e85047210af34e2d87f8162c8bd2005e => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:11.636184 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6bb4a-463d-4679-8e7c-35cc5e5ccd96 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:11.636468 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6bb4a-463d-4679-8e7c-35cc5e5ccd96 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:11.636740 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6bb4a-463d-4679-8e7c-35cc5e5ccd96 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:11.638211 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 77/159] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:11.648569 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e11cd3-df71-4894-a80a-b46846cad331 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:11.660607 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95083a6e-eb63-441b-8f89-f0fe65b7f298 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:11.660927 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95083a6e-eb63-441b-8f89-f0fe65b7f298 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:11.661148 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95083a6e-eb63-441b-8f89-f0fe65b7f298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:11.695837 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-95083a6e-eb63-441b-8f89-f0fe65b7f298 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:11.697130 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-95083a6e-eb63-441b-8f89-f0fe65b7f298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:11.793473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e11cd3-df71-4894-a80a-b46846cad331 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:11.803266 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:11.845485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5553f0f-ed74-4f54-98a3-ea42e7e32b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:11.846133 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5553f0f-ed74-4f54-98a3-ea42e7e32b84 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:11.846532 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5553f0f-ed74-4f54-98a3-ea42e7e32b84 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:11.846808 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5553f0f-ed74-4f54-98a3-ea42e7e32b84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:11.860353 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5553f0f-ed74-4f54-98a3-ea42e7e32b84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:11.867066 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-f5553f0f-ed74-4f54-98a3-ea42e7e32b84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:22:11.867066 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:11.867066 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:11.867066 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:11.867066 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:11.867066 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:11.867066 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:11.867066 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:11.867066 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:11.867066 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:11.867066 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:11.867066 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:11.867066 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:11.867066 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:11.867066 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:11.867066 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:11.868069 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:11.868069 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:11.868069 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:11.868069 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:11.868069 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:11.868069 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:11.868069 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:11.868069 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:11.868069 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:11.868069 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:11.868069 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:11.868069 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:11.868069 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:11.868069 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:11.868069 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:11.868069 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:11.868859 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:11.868859 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:11.868859 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:11.868859 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:11.868859 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:11.868859 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:11.868859 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:11.868859 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:11.868859 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:11.868859 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:11.868859 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:22:11.868859 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:22:11.868859 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 83/160] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 15:22:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:22:11.869524 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1de07-2e3d-466f-9150-f1cf0d78d22c None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:11.870085 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1de07-2e3d-466f-9150-f1cf0d78d22c None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:11.870085 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1de07-2e3d-466f-9150-f1cf0d78d22c None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:11.875796 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 84/161] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:11.876698 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1de07-2e3d-466f-9150-f1cf0d78d22c None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:11.890330 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 78/162] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 29 15:22:11.892430 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25358470-36dd-4fbb-8b99-3f198887c722 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:11.893000 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25358470-36dd-4fbb-8b99-3f198887c722 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:11.893325 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25358470-36dd-4fbb-8b99-3f198887c722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:11.923968 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-25358470-36dd-4fbb-8b99-3f198887c722 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:11.925390 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-25358470-36dd-4fbb-8b99-3f198887c722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:11.961702 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:12.045874 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 79/163] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:22:12.059718 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1de07-2e3d-466f-9150-f1cf0d78d22c None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:12.101370 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b337e-6946-4ab6-93ca-18820418a5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:12.101990 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b337e-6946-4ab6-93ca-18820418a5e8 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:12.102266 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b337e-6946-4ab6-93ca-18820418a5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:12.102536 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b337e-6946-4ab6-93ca-18820418a5e8 None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:12.103251 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b337e-6946-4ab6-93ca-18820418a5e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:12.103559 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b337e-6946-4ab6-93ca-18820418a5e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:12.104989 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b337e-6946-4ab6-93ca-18820418a5e8 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:12.119214 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 85/164] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:22:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:12.124827 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25358470-36dd-4fbb-8b99-3f198887c722 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:12.249748 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25358470-36dd-4fbb-8b99-3f198887c722 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:12.289277 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346fb8af-9751-444d-a6cf-1c8a31082060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:12.290289 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fb8af-9751-444d-a6cf-1c8a31082060 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:12.290779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fb8af-9751-444d-a6cf-1c8a31082060 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:12.291271 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fb8af-9751-444d-a6cf-1c8a31082060 None admin] PATH_INFO: `/v3/users/6db5f614a81044e59454d15b8c60cf8f` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:12.292588 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346fb8af-9751-444d-a6cf-1c8a31082060 None admin] RBAC: Authorizing `identity:get_user(user_id=6db5f614a81044e59454d15b8c60cf8f)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:12.294248 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346fb8af-9751-444d-a6cf-1c8a31082060 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:12.296437 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 80/165] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 15:22:12 2022] GET /identity/v3/users/6db5f614a81044e59454d15b8c60cf8f => generated 247 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:12.303351 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b337e-6946-4ab6-93ca-18820418a5e8 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:12.336756 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:12.436726 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b337e-6946-4ab6-93ca-18820418a5e8 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:12.451538 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346fb8af-9751-444d-a6cf-1c8a31082060 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:12.485177 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f92584-92b2-4382-93c8-5c6c0a2cf5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:12.485997 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f92584-92b2-4382-93c8-5c6c0a2cf5cf None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:12.486276 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f92584-92b2-4382-93c8-5c6c0a2cf5cf None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:12.487507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f92584-92b2-4382-93c8-5c6c0a2cf5cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:12.506661 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:12.627481 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346fb8af-9751-444d-a6cf-1c8a31082060 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:12.630545 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f92584-92b2-4382-93c8-5c6c0a2cf5cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:12.632053 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f92584-92b2-4382-93c8-5c6c0a2cf5cf None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:12.663398 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:12.688294 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ee592-1fa4-490a-93c6-fdca26d067e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:12.689230 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ee592-1fa4-490a-93c6-fdca26d067e1 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:12.689603 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ee592-1fa4-490a-93c6-fdca26d067e1 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:12.689902 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ee592-1fa4-490a-93c6-fdca26d067e1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:12.704953 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ee592-1fa4-490a-93c6-fdca26d067e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:12.710141 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-488ee592-1fa4-490a-93c6-fdca26d067e1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:22:12.710141 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:12.710141 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:12.710141 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:12.710141 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:12.710141 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:12.710141 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:12.710141 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:12.710141 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:12.710141 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:12.710141 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:12.710141 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:12.710141 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:12.710141 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:12.710141 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:12.710141 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:12.711011 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:12.711011 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:12.711011 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:12.711011 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:12.711011 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:12.711011 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:12.711011 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:12.711011 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:12.711011 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:12.711011 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:12.711011 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:12.711011 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:12.711011 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:12.711011 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:12.711011 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:12.711011 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:12.712067 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:12.712067 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:12.712067 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:12.712067 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:12.712067 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:12.712067 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:12.712067 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:12.712067 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:12.712067 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:12.712067 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:12.712067 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:22:12.712067 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:22:12.712067 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 81/166] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:22:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:22:12.712067 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ee592-1fa4-490a-93c6-fdca26d067e1 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:12.753772 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 86/167] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:22:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:22:12.754459 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f92584-92b2-4382-93c8-5c6c0a2cf5cf None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:12.854848 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f92584-92b2-4382-93c8-5c6c0a2cf5cf None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:12.863462 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ee592-1fa4-490a-93c6-fdca26d067e1 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:12.866553 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:12.882526 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:12.920120 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b049d-40ea-4769-9085-8920462c4f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:12.920810 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b049d-40ea-4769-9085-8920462c4f88 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:12.921041 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b049d-40ea-4769-9085-8920462c4f88 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:12.921306 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b049d-40ea-4769-9085-8920462c4f88 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:12.931735 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d9a5aa-8de7-430b-9b39-04e1f34e5142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:12.932360 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9a5aa-8de7-430b-9b39-04e1f34e5142 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:12.932636 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9a5aa-8de7-430b-9b39-04e1f34e5142 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:12.932905 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9a5aa-8de7-430b-9b39-04e1f34e5142 None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:12.933587 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d9a5aa-8de7-430b-9b39-04e1f34e5142 None admin] RBAC: Adding query filter params (name=member) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:12.933886 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d9a5aa-8de7-430b-9b39-04e1f34e5142 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:12.935359 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d9a5aa-8de7-430b-9b39-04e1f34e5142 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:12.940489 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1b049d-40ea-4769-9085-8920462c4f88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:12.945668 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-cf1b049d-40ea-4769-9085-8920462c4f88 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 15:22:12.945668 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:12.945668 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:12.945668 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:12.945668 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:12.945668 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:12.945668 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:12.945668 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:12.945668 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:12.945668 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:12.945668 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:12.945668 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:12.945668 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:12.945668 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:12.945668 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:12.945668 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:12.946531 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:12.946531 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:12.946531 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:12.946531 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:12.946531 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:12.946531 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:12.946531 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:12.946531 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:12.946531 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:12.946531 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:12.946531 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:12.946531 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:12.946531 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:12.946531 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:12.946531 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:12.946531 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:12.947427 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:12.947427 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:12.947427 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:12.947427 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:12.947427 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:12.947427 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:12.947427 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:12.947427 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:12.947427 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:12.947427 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:12.947427 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 15:22:12.947427 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:22:12.947427 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 82/168] 10.222.0.83 () {56 vars in 1114 bytes} [Mon Aug 29 15:22:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:22:12.948073 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b049d-40ea-4769-9085-8920462c4f88 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:12.953554 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 87/169] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 15:22:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:12.954827 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d9a5aa-8de7-430b-9b39-04e1f34e5142 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:13.114379 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b049d-40ea-4769-9085-8920462c4f88 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:13.151240 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddcaea9-11eb-42cc-ae88-8daf1cdac80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:13.151980 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcaea9-11eb-42cc-ae88-8daf1cdac80b None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:13.152263 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcaea9-11eb-42cc-ae88-8daf1cdac80b None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:13.152532 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcaea9-11eb-42cc-ae88-8daf1cdac80b None admin] PATH_INFO: `/v3/projects/81f3af84c83d43499bc734eb2261802e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:13.154788 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d9a5aa-8de7-430b-9b39-04e1f34e5142 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:13.158377 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddcaea9-11eb-42cc-ae88-8daf1cdac80b None admin] RBAC: Authorizing `identity:get_project(project_id=81f3af84c83d43499bc734eb2261802e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:13.159930 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddcaea9-11eb-42cc-ae88-8daf1cdac80b None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:13.161828 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 83/170] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:22:12 2022] GET /identity/v3/projects/81f3af84c83d43499bc734eb2261802e => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:13.166219 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddcaea9-11eb-42cc-ae88-8daf1cdac80b None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:13.210916 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:13.239899 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3992e7-e254-4322-b33a-686f64386bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:13.240542 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3992e7-e254-4322-b33a-686f64386bfa None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:13.240822 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3992e7-e254-4322-b33a-686f64386bfa None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:13.241098 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3992e7-e254-4322-b33a-686f64386bfa None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:13.241797 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3992e7-e254-4322-b33a-686f64386bfa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:13.242104 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3992e7-e254-4322-b33a-686f64386bfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:13.243570 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3992e7-e254-4322-b33a-686f64386bfa None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:13.265372 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 88/171] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:22:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:13.266251 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3992e7-e254-4322-b33a-686f64386bfa None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:13.356030 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddcaea9-11eb-42cc-ae88-8daf1cdac80b None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:13.365123 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:13.447660 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b40c2-e679-4615-ba49-beb57111077f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:13.448785 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b40c2-e679-4615-ba49-beb57111077f None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:13.449345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b40c2-e679-4615-ba49-beb57111077f None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:13.449819 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b40c2-e679-4615-ba49-beb57111077f None admin] PATH_INFO: `/v3/users/618f35cfd2d04e50a8c22d7b8993a5fe` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:13.451695 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101b40c2-e679-4615-ba49-beb57111077f None admin] RBAC: Authorizing `identity:get_user(user_id=618f35cfd2d04e50a8c22d7b8993a5fe)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:13.453344 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101b40c2-e679-4615-ba49-beb57111077f None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:13.456137 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 84/172] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 15:22:13 2022] GET /identity/v3/users/618f35cfd2d04e50a8c22d7b8993a5fe => generated 275 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:13.457230 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b40c2-e679-4615-ba49-beb57111077f None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:13.501436 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3992e7-e254-4322-b33a-686f64386bfa None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:13.582866 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e73b7-2f94-4a8a-94c4-be38a5cd48b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:13.583527 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e73b7-2f94-4a8a-94c4-be38a5cd48b0 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:13.583809 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e73b7-2f94-4a8a-94c4-be38a5cd48b0 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:13.584083 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e73b7-2f94-4a8a-94c4-be38a5cd48b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:13.587058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e73b7-2f94-4a8a-94c4-be38a5cd48b0 None admin] RBAC: Adding query filter params (role.id=4bb2bbb7bb544610877949fc933504d2, scope.project.id=81f3af84c83d43499bc734eb2261802e, user.id=6db5f614a81044e59454d15b8c60cf8f) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:13.587058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e73b7-2f94-4a8a-94c4-be38a5cd48b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:13.587058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e73b7-2f94-4a8a-94c4-be38a5cd48b0 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:13.605440 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 89/173] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 15:22:13 2022] GET /identity/v3/role_assignments?user.id=6db5f614a81044e59454d15b8c60cf8f&scope.project.id=81f3af84c83d43499bc734eb2261802e&role.id=4bb2bbb7bb544610877949fc933504d2 => generated 608 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:13.606162 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e73b7-2f94-4a8a-94c4-be38a5cd48b0 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:13.643446 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:13.698006 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b40c2-e679-4615-ba49-beb57111077f None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:13.767453 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e73b7-2f94-4a8a-94c4-be38a5cd48b0 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:13.779139 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:13.811278 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d44fd-caaf-490c-a4de-ac91633481a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:13.811918 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d44fd-caaf-490c-a4de-ac91633481a5 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:13.812198 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d44fd-caaf-490c-a4de-ac91633481a5 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:13.812474 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d44fd-caaf-490c-a4de-ac91633481a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:13.815735 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b933a-8d55-4a0e-99f7-976105aabe10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:13.816386 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b933a-8d55-4a0e-99f7-976105aabe10 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:13.816662 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b933a-8d55-4a0e-99f7-976105aabe10 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:13.816932 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b933a-8d55-4a0e-99f7-976105aabe10 None admin] PATH_INFO: `/v3/users/618f35cfd2d04e50a8c22d7b8993a5fe` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:13.818107 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b933a-8d55-4a0e-99f7-976105aabe10 None admin] RBAC: Authorizing `identity:get_user(user_id=618f35cfd2d04e50a8c22d7b8993a5fe)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:13.819610 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b933a-8d55-4a0e-99f7-976105aabe10 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:13.821528 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 85/174] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 15:22:13 2022] GET /identity/v3/users/618f35cfd2d04e50a8c22d7b8993a5fe => generated 275 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:13.826965 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b933a-8d55-4a0e-99f7-976105aabe10 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:13.926129 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d44fd-caaf-490c-a4de-ac91633481a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:13.928592 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d44fd-caaf-490c-a4de-ac91633481a5 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:14.069003 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 90/175] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:22:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:22:14.073446 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b933a-8d55-4a0e-99f7-976105aabe10 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:14.074944 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d44fd-caaf-490c-a4de-ac91633481a5 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:14.094984 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:14.126265 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d3b1f6-40ee-47db-b0b5-adbcbc9694b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:14.127343 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3b1f6-40ee-47db-b0b5-adbcbc9694b0 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:14.127824 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3b1f6-40ee-47db-b0b5-adbcbc9694b0 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:14.128293 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3b1f6-40ee-47db-b0b5-adbcbc9694b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:14.152386 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:14.204485 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d3b1f6-40ee-47db-b0b5-adbcbc9694b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:14.206405 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d3b1f6-40ee-47db-b0b5-adbcbc9694b0 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:14.262583 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d44fd-caaf-490c-a4de-ac91633481a5 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:14.313163 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f477cd0c-6670-4c4e-b208-a8cc3a87d527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:14.314584 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477cd0c-6670-4c4e-b208-a8cc3a87d527 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:14.315602 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477cd0c-6670-4c4e-b208-a8cc3a87d527 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:14.316114 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477cd0c-6670-4c4e-b208-a8cc3a87d527 None admin] PATH_INFO: `/v3/projects/15b426bd7a14464db64108758c77e848` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:14.318156 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f477cd0c-6670-4c4e-b208-a8cc3a87d527 None admin] RBAC: Authorizing `identity:get_project(project_id=15b426bd7a14464db64108758c77e848)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:14.320555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f477cd0c-6670-4c4e-b208-a8cc3a87d527 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:14.323445 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 91/176] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:22:14 2022] GET /identity/v3/projects/15b426bd7a14464db64108758c77e848 => generated 312 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:14.324867 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdfab80-9097-4f10-b446-f1c4c0fa90d2 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:14.325351 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdfab80-9097-4f10-b446-f1c4c0fa90d2 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:14.325807 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdfab80-9097-4f10-b446-f1c4c0fa90d2 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:14.326436 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 86/177] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:22:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 15:22:14.331070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36868bea-6d53-484e-bdea-8c56159b6d13 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:14.331070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36868bea-6d53-484e-bdea-8c56159b6d13 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:14.331070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36868bea-6d53-484e-bdea-8c56159b6d13 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:14.331070 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 87/178] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:14.331070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36868bea-6d53-484e-bdea-8c56159b6d13 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:14.332348 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 92/179] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:14.334471 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdfab80-9097-4f10-b446-f1c4c0fa90d2 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:14.398286 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:14.436070 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:14.452798 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36868bea-6d53-484e-bdea-8c56159b6d13 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:14.463048 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdfab80-9097-4f10-b446-f1c4c0fa90d2 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:14.491949 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5a956-631c-438f-9647-c3900b43fc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:14.492677 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5a956-631c-438f-9647-c3900b43fc50 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:14.492955 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5a956-631c-438f-9647-c3900b43fc50 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:14.493224 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5a956-631c-438f-9647-c3900b43fc50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:14.494012 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5a956-631c-438f-9647-c3900b43fc50 None admin] RBAC: Adding query filter params (role.id=e85047210af34e2d87f8162c8bd2005e, scope.project.id=15b426bd7a14464db64108758c77e848, user.id=618f35cfd2d04e50a8c22d7b8993a5fe) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:14.494429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5a956-631c-438f-9647-c3900b43fc50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:14.495904 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5a956-631c-438f-9647-c3900b43fc50 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:14.497465 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f8b7cc-651b-4dd5-8d45-abda5596c4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:14.498101 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8b7cc-651b-4dd5-8d45-abda5596c4f0 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:14.498381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8b7cc-651b-4dd5-8d45-abda5596c4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:14.498655 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8b7cc-651b-4dd5-8d45-abda5596c4f0 None admin] PATH_INFO: `/v3/projects/81f3af84c83d43499bc734eb2261802e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:14.499845 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f8b7cc-651b-4dd5-8d45-abda5596c4f0 None admin] RBAC: Authorizing `identity:get_project(project_id=81f3af84c83d43499bc734eb2261802e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:14.501913 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f8b7cc-651b-4dd5-8d45-abda5596c4f0 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:14.503255 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 88/180] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 15:22:14 2022] GET /identity/v3/role_assignments?user.id=618f35cfd2d04e50a8c22d7b8993a5fe&scope.project.id=15b426bd7a14464db64108758c77e848&role.id=e85047210af34e2d87f8162c8bd2005e => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:14.503825 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 93/181] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:22:14 2022] GET /identity/v3/projects/81f3af84c83d43499bc734eb2261802e => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:22:14.504512 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ef631-aa6b-485c-acf4-445579cf6194 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:14.504861 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ef631-aa6b-485c-acf4-445579cf6194 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:14.505139 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ef631-aa6b-485c-acf4-445579cf6194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:14.515342 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e283aca-978a-4534-af60-8811cf953f68 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:14.515342 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e283aca-978a-4534-af60-8811cf953f68 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:14.515342 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e283aca-978a-4534-af60-8811cf953f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:14.529243 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-7a6ef631-aa6b-485c-acf4-445579cf6194 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:14.530530 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7a6ef631-aa6b-485c-acf4-445579cf6194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:14.534873 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-5e283aca-978a-4534-af60-8811cf953f68 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:14.537708 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5e283aca-978a-4534-af60-8811cf953f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:14.618248 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 89/182] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:22:14.619707 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf872e6-685e-4285-906c-30abe5490875 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:14.619993 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf872e6-685e-4285-906c-30abe5490875 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:14.620264 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf872e6-685e-4285-906c-30abe5490875 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:14.626143 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 90/183] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:14.627567 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf872e6-685e-4285-906c-30abe5490875 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:14.630687 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 94/184] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:22:14.633335 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd737c-c563-4410-9f48-913ffaeb54f5 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:14.633865 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd737c-c563-4410-9f48-913ffaeb54f5 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:14.634338 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd737c-c563-4410-9f48-913ffaeb54f5 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:14.635957 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 95/185] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:14.638170 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f756596-bbe9-499e-a54d-cb85553cc37b None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:14.638691 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f756596-bbe9-499e-a54d-cb85553cc37b None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:14.639610 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f756596-bbe9-499e-a54d-cb85553cc37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:14.661312 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-9f756596-bbe9-499e-a54d-cb85553cc37b None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:14.662835 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9f756596-bbe9-499e-a54d-cb85553cc37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:14.739527 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:14.754842 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 96/186] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:22:14.756539 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca7f4d-cfe7-4b16-8001-fb88bfe7cf5e None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:14.757027 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca7f4d-cfe7-4b16-8001-fb88bfe7cf5e None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:14.757568 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca7f4d-cfe7-4b16-8001-fb88bfe7cf5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:14.779394 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:14.798669 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-5eca7f4d-cfe7-4b16-8001-fb88bfe7cf5e None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:14.802638 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5eca7f4d-cfe7-4b16-8001-fb88bfe7cf5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:14.810807 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf872e6-685e-4285-906c-30abe5490875 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:14.889400 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1c72b-01db-417c-81b6-3bef04f82758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:14.890033 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1c72b-01db-417c-81b6-3bef04f82758 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:14.890358 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1c72b-01db-417c-81b6-3bef04f82758 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:14.890670 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1c72b-01db-417c-81b6-3bef04f82758 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:14.892591 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d1c72b-01db-417c-81b6-3bef04f82758 None admin] RBAC: Adding query filter params (role.id=3e8f6ab382f64437b245115f5a28f535, scope.project.id=81f3af84c83d43499bc734eb2261802e, user.id=618f35cfd2d04e50a8c22d7b8993a5fe) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:14.893018 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d1c72b-01db-417c-81b6-3bef04f82758 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:14.897134 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 97/187] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:22:14.899276 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d1c72b-01db-417c-81b6-3bef04f82758 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:14.911165 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 91/188] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 15:22:14 2022] GET /identity/v3/role_assignments?user.id=618f35cfd2d04e50a8c22d7b8993a5fe&scope.project.id=81f3af84c83d43499bc734eb2261802e&role.id=3e8f6ab382f64437b245115f5a28f535 => generated 608 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:15.012023 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca7f4d-cfe7-4b16-8001-fb88bfe7cf5e None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:15.101963 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1c72b-01db-417c-81b6-3bef04f82758 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:15.161867 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca7f4d-cfe7-4b16-8001-fb88bfe7cf5e None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:15.208250 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43192a93-5beb-48ba-ad4a-891c74919b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:15.209235 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43192a93-5beb-48ba-ad4a-891c74919b3b None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:15.209531 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43192a93-5beb-48ba-ad4a-891c74919b3b None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:15.210090 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43192a93-5beb-48ba-ad4a-891c74919b3b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:15.213023 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:15.225849 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43192a93-5beb-48ba-ad4a-891c74919b3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:15.231238 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-43192a93-5beb-48ba-ad4a-891c74919b3b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 15:22:15.231238 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:15.231238 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:15.231238 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:15.231238 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:15.231238 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:15.231238 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:15.231238 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:15.231238 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:15.231238 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:15.231238 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:15.231238 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:15.231238 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:15.231238 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:15.231238 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:15.231238 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:15.232274 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:15.232274 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:15.232274 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:15.232274 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:15.232274 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:15.232274 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:15.232274 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:15.232274 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:15.232274 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:15.232274 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:15.232274 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:15.232274 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:15.232274 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:15.232274 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:15.232274 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:15.232274 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:15.233093 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:15.233093 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:15.233093 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:15.233093 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:15.233093 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:15.233093 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:15.233093 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:15.233093 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:15.233093 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:15.233093 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:15.233093 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 15:22:15.233093 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:22:15.236417 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 98/189] 10.222.0.83 () {56 vars in 1114 bytes} [Mon Aug 29 15:22:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:22:15.238021 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43192a93-5beb-48ba-ad4a-891c74919b3b None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:15.290610 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1c72b-01db-417c-81b6-3bef04f82758 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:15.309778 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:15.349318 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f268a-8ebf-4188-beeb-236dbb4fa593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:15.349955 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f268a-8ebf-4188-beeb-236dbb4fa593 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:15.350231 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f268a-8ebf-4188-beeb-236dbb4fa593 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:15.350503 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f268a-8ebf-4188-beeb-236dbb4fa593 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:15.361816 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f268a-8ebf-4188-beeb-236dbb4fa593 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:15.367255 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-cd8f268a-8ebf-4188-beeb-236dbb4fa593 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:22:15.367255 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:15.367255 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:15.367255 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:15.367255 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:15.367255 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:15.367255 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:15.367255 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:15.367255 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:15.367255 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:15.367255 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:15.367255 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:15.367255 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:15.367255 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:15.367255 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:15.367255 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:15.368276 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:15.368276 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:15.368276 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:15.368276 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:15.368276 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:15.368276 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:15.368276 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:15.368276 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:15.368276 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:15.368276 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:15.368276 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:15.368276 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:15.368276 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:15.368276 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:15.368276 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:15.368276 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:15.370258 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:15.370258 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:15.370258 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:15.370258 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:15.370258 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:15.370258 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:15.370258 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:15.370258 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:15.370258 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:15.370258 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:15.370258 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:22:15.370258 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:22:15.370258 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 92/190] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 15:22:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:22:15.370258 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f268a-8ebf-4188-beeb-236dbb4fa593 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:15.385101 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43192a93-5beb-48ba-ad4a-891c74919b3b None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:15.421143 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0dfeb6-f271-4852-aedd-b8c69edf99b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:15.421885 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0dfeb6-f271-4852-aedd-b8c69edf99b8 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:15.422845 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0dfeb6-f271-4852-aedd-b8c69edf99b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:15.423149 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0dfeb6-f271-4852-aedd-b8c69edf99b8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:15.433924 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0dfeb6-f271-4852-aedd-b8c69edf99b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:15.439699 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-aa0dfeb6-f271-4852-aedd-b8c69edf99b8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 15:22:15.439699 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:15.439699 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:15.439699 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:15.439699 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:15.439699 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:15.439699 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:15.439699 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:15.439699 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:15.439699 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:15.439699 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:15.439699 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:15.439699 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:15.439699 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:15.439699 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:15.439699 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:15.441290 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:15.441290 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:15.441290 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:15.441290 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:15.441290 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:15.441290 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:15.441290 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:15.441290 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:15.441290 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:15.441290 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:15.441290 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:15.441290 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:15.441290 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:15.441290 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:15.441290 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:15.441290 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:15.442083 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:15.442083 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:15.442083 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:15.442083 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:15.442083 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:15.442083 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:15.442083 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:15.442083 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:15.442083 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:15.442083 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:15.442083 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 15:22:15.442083 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:22:15.442083 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 99/191] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:22:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:22:15.442083 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0dfeb6-f271-4852-aedd-b8c69edf99b8 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:15.489182 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f268a-8ebf-4188-beeb-236dbb4fa593 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:15.505677 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:15.530504 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b96f3d-05d4-4942-a01e-94eb65a47af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:15.531155 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b96f3d-05d4-4942-a01e-94eb65a47af1 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:15.532255 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b96f3d-05d4-4942-a01e-94eb65a47af1 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:15.532255 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b96f3d-05d4-4942-a01e-94eb65a47af1 None admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:15.532897 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b96f3d-05d4-4942-a01e-94eb65a47af1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:15.533199 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b96f3d-05d4-4942-a01e-94eb65a47af1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:15.534584 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b96f3d-05d4-4942-a01e-94eb65a47af1 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:15.542941 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 93/192] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:22:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:15.543703 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b96f3d-05d4-4942-a01e-94eb65a47af1 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:15.565156 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0dfeb6-f271-4852-aedd-b8c69edf99b8 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:15.578344 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:15.600434 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10c5eb-b76e-421f-8551-640041594805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:15.601073 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10c5eb-b76e-421f-8551-640041594805 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:15.601348 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10c5eb-b76e-421f-8551-640041594805 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:15.601614 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10c5eb-b76e-421f-8551-640041594805 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:15.602750 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af10c5eb-b76e-421f-8551-640041594805 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:15.604228 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af10c5eb-b76e-421f-8551-640041594805 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:15.605815 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 100/193] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:22:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:15.606565 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10c5eb-b76e-421f-8551-640041594805 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:15.659374 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b96f3d-05d4-4942-a01e-94eb65a47af1 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:15.698147 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8357ae78-c5b3-4756-b5f7-6ceb9c3ace3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:15.698774 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8357ae78-c5b3-4756-b5f7-6ceb9c3ace3b None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:15.699070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8357ae78-c5b3-4756-b5f7-6ceb9c3ace3b None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:15.699381 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8357ae78-c5b3-4756-b5f7-6ceb9c3ace3b None admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:15.700083 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8357ae78-c5b3-4756-b5f7-6ceb9c3ace3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:15.700395 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8357ae78-c5b3-4756-b5f7-6ceb9c3ace3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:15.701970 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8357ae78-c5b3-4756-b5f7-6ceb9c3ace3b None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:15.711784 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 94/194] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:22:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:15.716396 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8357ae78-c5b3-4756-b5f7-6ceb9c3ace3b None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:15.724432 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10c5eb-b76e-421f-8551-640041594805 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:15.749565 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:15.762782 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128452a1-f79d-4228-b5af-7eb9a168f463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:15.763436 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128452a1-f79d-4228-b5af-7eb9a168f463 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:15.763718 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128452a1-f79d-4228-b5af-7eb9a168f463 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:15.763989 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128452a1-f79d-4228-b5af-7eb9a168f463 None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:15.764707 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128452a1-f79d-4228-b5af-7eb9a168f463 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:15.765013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128452a1-f79d-4228-b5af-7eb9a168f463 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:15.767003 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128452a1-f79d-4228-b5af-7eb9a168f463 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:15.775837 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 101/195] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 15:22:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:15.776626 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128452a1-f79d-4228-b5af-7eb9a168f463 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:15.818326 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:15.825817 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8357ae78-c5b3-4756-b5f7-6ceb9c3ace3b None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:15.861759 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a65390-d625-49da-920c-bc0fc42a684b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:15.862387 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a65390-d625-49da-920c-bc0fc42a684b None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:15.862661 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a65390-d625-49da-920c-bc0fc42a684b None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:15.862925 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a65390-d625-49da-920c-bc0fc42a684b None admin] PATH_INFO: `/v3/users/0c7fc1aaa8c94016866dda1d8db730ac` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:15.876703 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a65390-d625-49da-920c-bc0fc42a684b None admin] RBAC: Authorizing `identity:get_user(user_id=0c7fc1aaa8c94016866dda1d8db730ac)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:15.878182 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a65390-d625-49da-920c-bc0fc42a684b None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:15.879872 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 95/196] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 15:22:15 2022] GET /identity/v3/users/0c7fc1aaa8c94016866dda1d8db730ac => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:15.884630 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a65390-d625-49da-920c-bc0fc42a684b None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:15.884722 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128452a1-f79d-4228-b5af-7eb9a168f463 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:15.919679 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54efe6-de7e-4960-a09e-a501de7e89e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:15.920289 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54efe6-de7e-4960-a09e-a501de7e89e7 None admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:15.920568 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54efe6-de7e-4960-a09e-a501de7e89e7 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:15.921249 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54efe6-de7e-4960-a09e-a501de7e89e7 None admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:15.921907 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a54efe6-de7e-4960-a09e-a501de7e89e7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:15.923423 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a54efe6-de7e-4960-a09e-a501de7e89e7 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:15.947068 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 102/197] 10.222.0.83 () {60 vars in 1132 bytes} [Mon Aug 29 15:22:15 2022] POST /identity/v3/users => generated 297 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:22:15.947068 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54efe6-de7e-4960-a09e-a501de7e89e7 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:15.996220 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:16.000917 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a65390-d625-49da-920c-bc0fc42a684b None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:16.041640 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a78e86-1626-4a72-b969-2838d44eb5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:16.042433 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a78e86-1626-4a72-b969-2838d44eb5f8 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:16.042708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a78e86-1626-4a72-b969-2838d44eb5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:16.042977 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a78e86-1626-4a72-b969-2838d44eb5f8 None admin] PATH_INFO: `/v3/users/0c7fc1aaa8c94016866dda1d8db730ac` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:16.044237 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a78e86-1626-4a72-b969-2838d44eb5f8 None admin] RBAC: Authorizing `identity:get_user(user_id=0c7fc1aaa8c94016866dda1d8db730ac)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:16.045975 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a78e86-1626-4a72-b969-2838d44eb5f8 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:16.053021 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 96/198] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 15:22:15 2022] GET /identity/v3/users/0c7fc1aaa8c94016866dda1d8db730ac => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:16.053021 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a78e86-1626-4a72-b969-2838d44eb5f8 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:16.068089 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54efe6-de7e-4960-a09e-a501de7e89e7 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:16.073472 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:16.109055 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa541ee-75bf-42af-afef-0a5f141234ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:16.110031 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa541ee-75bf-42af-afef-0a5f141234ba None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:16.110305 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa541ee-75bf-42af-afef-0a5f141234ba None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:16.111143 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa541ee-75bf-42af-afef-0a5f141234ba None admin] PATH_INFO: `/v3/users/b7d81fc7f9984b35b62e7769af29a92e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:16.111766 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa541ee-75bf-42af-afef-0a5f141234ba None admin] RBAC: Authorizing `identity:get_user(user_id=b7d81fc7f9984b35b62e7769af29a92e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:16.113257 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa541ee-75bf-42af-afef-0a5f141234ba None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:16.114949 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 103/199] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 15:22:15 2022] GET /identity/v3/users/b7d81fc7f9984b35b62e7769af29a92e => generated 289 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:16.116157 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa541ee-75bf-42af-afef-0a5f141234ba None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:16.169628 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a78e86-1626-4a72-b969-2838d44eb5f8 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:16.220352 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b592b9-0640-4421-9f06-4cedf373ff67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:16.221199 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b592b9-0640-4421-9f06-4cedf373ff67 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:16.221509 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b592b9-0640-4421-9f06-4cedf373ff67 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:16.221715 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b592b9-0640-4421-9f06-4cedf373ff67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:16.251434 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa541ee-75bf-42af-afef-0a5f141234ba None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:16.261293 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:16.300159 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb48f08f-2b00-4971-a7c5-1129f518f50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:16.300843 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48f08f-2b00-4971-a7c5-1129f518f50c None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:16.301125 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48f08f-2b00-4971-a7c5-1129f518f50c None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:16.301396 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48f08f-2b00-4971-a7c5-1129f518f50c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:16.319158 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b592b9-0640-4421-9f06-4cedf373ff67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:16.321140 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b592b9-0640-4421-9f06-4cedf373ff67 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:16.351442 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:16.390817 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb48f08f-2b00-4971-a7c5-1129f518f50c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:16.392764 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb48f08f-2b00-4971-a7c5-1129f518f50c None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:16.456639 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 97/200] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:22:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:22:16.457545 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b592b9-0640-4421-9f06-4cedf373ff67 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:16.517293 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 104/201] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:22:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:22:16.518239 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb48f08f-2b00-4971-a7c5-1129f518f50c None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:16.529330 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:16.593213 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b592b9-0640-4421-9f06-4cedf373ff67 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:16.622462 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:16.635427 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb48f08f-2b00-4971-a7c5-1129f518f50c None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:16.642284 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3a2a9-efd9-4d93-89a7-a8efa7d9ed69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:16.643169 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3a2a9-efd9-4d93-89a7-a8efa7d9ed69 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:16.644177 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3a2a9-efd9-4d93-89a7-a8efa7d9ed69 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:16.644654 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3a2a9-efd9-4d93-89a7-a8efa7d9ed69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:16.674280 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac2c32-58e6-4812-bc68-a95a261e2fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:16.675499 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac2c32-58e6-4812-bc68-a95a261e2fa1 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:16.676036 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac2c32-58e6-4812-bc68-a95a261e2fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:16.676833 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac2c32-58e6-4812-bc68-a95a261e2fa1 None admin] PATH_INFO: `/v3/projects/7ebc74909fbc49f2b7065ea3550fee57` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:16.678458 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ac2c32-58e6-4812-bc68-a95a261e2fa1 None admin] RBAC: Authorizing `identity:get_project(project_id=7ebc74909fbc49f2b7065ea3550fee57)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:16.680024 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ac2c32-58e6-4812-bc68-a95a261e2fa1 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:16.681764 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 105/202] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:22:16 2022] GET /identity/v3/projects/7ebc74909fbc49f2b7065ea3550fee57 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:16.682606 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac2c32-58e6-4812-bc68-a95a261e2fa1 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:16.740655 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a3a2a9-efd9-4d93-89a7-a8efa7d9ed69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:16.742753 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a3a2a9-efd9-4d93-89a7-a8efa7d9ed69 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:16.775548 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:16.808398 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac2c32-58e6-4812-bc68-a95a261e2fa1 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:16.847947 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87fa7b1-4c08-42f9-a70f-57513b05abf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:16.848620 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87fa7b1-4c08-42f9-a70f-57513b05abf4 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:16.848892 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87fa7b1-4c08-42f9-a70f-57513b05abf4 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:16.849159 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87fa7b1-4c08-42f9-a70f-57513b05abf4 None admin] PATH_INFO: `/v3/projects/7ebc74909fbc49f2b7065ea3550fee57` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:16.851082 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87fa7b1-4c08-42f9-a70f-57513b05abf4 None admin] RBAC: Authorizing `identity:get_project(project_id=7ebc74909fbc49f2b7065ea3550fee57)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:16.853962 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87fa7b1-4c08-42f9-a70f-57513b05abf4 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:16.857761 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 106/203] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:22:16 2022] GET /identity/v3/projects/7ebc74909fbc49f2b7065ea3550fee57 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:16.859302 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87fa7b1-4c08-42f9-a70f-57513b05abf4 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:16.878303 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 98/204] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:22:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:22:16.879808 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3a2a9-efd9-4d93-89a7-a8efa7d9ed69 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:16.905835 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:16.993133 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3a2a9-efd9-4d93-89a7-a8efa7d9ed69 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:16.995093 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87fa7b1-4c08-42f9-a70f-57513b05abf4 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:17.034630 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ea04e-77d1-4dc9-a02c-02baf3f787db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:17.035277 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ea04e-77d1-4dc9-a02c-02baf3f787db None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:17.035553 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ea04e-77d1-4dc9-a02c-02baf3f787db None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:17.035820 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ea04e-77d1-4dc9-a02c-02baf3f787db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:17.036551 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ea04e-77d1-4dc9-a02c-02baf3f787db None admin] RBAC: Adding query filter params (role.id=4bb2bbb7bb544610877949fc933504d2, scope.project.id=7ebc74909fbc49f2b7065ea3550fee57, user.id=0c7fc1aaa8c94016866dda1d8db730ac) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:17.036856 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ea04e-77d1-4dc9-a02c-02baf3f787db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:17.038322 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ea04e-77d1-4dc9-a02c-02baf3f787db None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:17.039452 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd34f69-96b9-4df7-ab1f-122c8583949a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:17.040384 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd34f69-96b9-4df7-ab1f-122c8583949a None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:17.040847 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd34f69-96b9-4df7-ab1f-122c8583949a None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:17.041385 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd34f69-96b9-4df7-ab1f-122c8583949a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:17.042311 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd34f69-96b9-4df7-ab1f-122c8583949a None admin] RBAC: Adding query filter params (role.id=3e8f6ab382f64437b245115f5a28f535, scope.project.id=7ebc74909fbc49f2b7065ea3550fee57, user.id=0c7fc1aaa8c94016866dda1d8db730ac) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:17.042805 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd34f69-96b9-4df7-ab1f-122c8583949a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:17.044263 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 99/205] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 15:22:16 2022] GET /identity/v3/role_assignments?user.id=0c7fc1aaa8c94016866dda1d8db730ac&scope.project.id=7ebc74909fbc49f2b7065ea3550fee57&role.id=4bb2bbb7bb544610877949fc933504d2 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:17.044762 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd34f69-96b9-4df7-ab1f-122c8583949a None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:17.045048 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ea04e-77d1-4dc9-a02c-02baf3f787db None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:17.053871 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 107/206] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 15:22:16 2022] GET /identity/v3/role_assignments?user.id=0c7fc1aaa8c94016866dda1d8db730ac&scope.project.id=7ebc74909fbc49f2b7065ea3550fee57&role.id=3e8f6ab382f64437b245115f5a28f535 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:17.156081 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:17.172340 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ea04e-77d1-4dc9-a02c-02baf3f787db None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:17.214827 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7b5fd-76bf-4b03-b9bc-f96338d8ed75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:17.215523 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7b5fd-76bf-4b03-b9bc-f96338d8ed75 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:17.215801 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7b5fd-76bf-4b03-b9bc-f96338d8ed75 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:17.216073 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7b5fd-76bf-4b03-b9bc-f96338d8ed75 None admin] PATH_INFO: `/v3/projects/81f3af84c83d43499bc734eb2261802e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:17.217269 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b7b5fd-76bf-4b03-b9bc-f96338d8ed75 None admin] RBAC: Authorizing `identity:get_project(project_id=81f3af84c83d43499bc734eb2261802e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:17.218810 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b7b5fd-76bf-4b03-b9bc-f96338d8ed75 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:17.220566 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 100/207] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:22:17 2022] GET /identity/v3/projects/81f3af84c83d43499bc734eb2261802e => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:17.226748 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd34f69-96b9-4df7-ab1f-122c8583949a None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:17.245883 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:17.369278 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd34f69-96b9-4df7-ab1f-122c8583949a None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:17.413940 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed668744-ed21-4053-9702-c4312b836b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:17.414473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed668744-ed21-4053-9702-c4312b836b2f None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:17.414751 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed668744-ed21-4053-9702-c4312b836b2f None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:17.415040 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed668744-ed21-4053-9702-c4312b836b2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:17.415837 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed668744-ed21-4053-9702-c4312b836b2f None admin] RBAC: Adding query filter params (role.id=7c797c10240d4c399d804718c977d567, scope.project.id=81f3af84c83d43499bc734eb2261802e, user.id=b7d81fc7f9984b35b62e7769af29a92e) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:17.416150 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed668744-ed21-4053-9702-c4312b836b2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:17.417608 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed668744-ed21-4053-9702-c4312b836b2f None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:17.424047 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 108/208] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 15:22:17 2022] GET /identity/v3/role_assignments?user.id=b7d81fc7f9984b35b62e7769af29a92e&scope.project.id=81f3af84c83d43499bc734eb2261802e&role.id=7c797c10240d4c399d804718c977d567 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:18.225580 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61117a9-4b6c-4431-9afd-95a63d786f51 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:18.226169 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61117a9-4b6c-4431-9afd-95a63d786f51 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:18.226169 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61117a9-4b6c-4431-9afd-95a63d786f51 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:18.227910 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 101/209] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:18.233724 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43980cc7-8fc5-4b01-b4bf-7c3f8fa83c15 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:18.234781 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43980cc7-8fc5-4b01-b4bf-7c3f8fa83c15 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:18.236401 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43980cc7-8fc5-4b01-b4bf-7c3f8fa83c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:18.255565 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-43980cc7-8fc5-4b01-b4bf-7c3f8fa83c15 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:18.256770 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-43980cc7-8fc5-4b01-b4bf-7c3f8fa83c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:18.282804 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2356eef-a562-4445-8e9b-0a1a2fd125a4 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:18.283135 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2356eef-a562-4445-8e9b-0a1a2fd125a4 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:18.283390 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2356eef-a562-4445-8e9b-0a1a2fd125a4 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:18.284865 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 102/210] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:22:18.291891 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8be80a-7d33-4044-9e21-616aea7ecc97 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:18.292410 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8be80a-7d33-4044-9e21-616aea7ecc97 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:18.292885 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8be80a-7d33-4044-9e21-616aea7ecc97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:18.312959 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-cb8be80a-7d33-4044-9e21-616aea7ecc97 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:18.314472 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-cb8be80a-7d33-4044-9e21-616aea7ecc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:18.334750 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 109/211] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:22:18.383789 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 103/212] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 15:22:18.611593 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43980cc7-8fc5-4b01-b4bf-7c3f8fa83c15 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:18.613998 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:18.659077 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8be80a-7d33-4044-9e21-616aea7ecc97 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:18.727857 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43980cc7-8fc5-4b01-b4bf-7c3f8fa83c15 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:18.744380 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:18.764631 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8be80a-7d33-4044-9e21-616aea7ecc97 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:18.769878 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6fffc6-fae1-4d99-b78e-1637ab8b47ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:18.770773 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fffc6-fae1-4d99-b78e-1637ab8b47ba None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:18.771238 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fffc6-fae1-4d99-b78e-1637ab8b47ba None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:18.771651 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fffc6-fae1-4d99-b78e-1637ab8b47ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:18.784206 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6fffc6-fae1-4d99-b78e-1637ab8b47ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:18.789647 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-1b6fffc6-fae1-4d99-b78e-1637ab8b47ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:22:18.789647 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:18.789647 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:18.789647 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:18.789647 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:18.789647 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:18.789647 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:18.789647 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:18.789647 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:18.789647 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:18.789647 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:18.789647 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:18.789647 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:18.789647 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:18.789647 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:18.789647 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:18.790710 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:18.790710 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:18.790710 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:18.790710 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:18.790710 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:18.790710 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:18.790710 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:18.790710 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:18.790710 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:18.790710 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:18.790710 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:18.790710 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:18.790710 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:18.790710 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:18.790710 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:18.790710 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:18.791684 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:18.791684 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:18.791684 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:18.791684 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:18.791684 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:18.791684 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:18.791684 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:18.791684 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:18.791684 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:18.791684 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:18.791684 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:22:18.791684 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:22:18.793555 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 110/213] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:22:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:22:18.799424 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6fffc6-fae1-4d99-b78e-1637ab8b47ba None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:18.802167 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed2327-ff1b-421a-a210-77bfd11a0e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:18.802808 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed2327-ff1b-421a-a210-77bfd11a0e00 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:18.803113 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed2327-ff1b-421a-a210-77bfd11a0e00 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:18.803385 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed2327-ff1b-421a-a210-77bfd11a0e00 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:18.804496 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fed2327-ff1b-421a-a210-77bfd11a0e00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:18.805944 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fed2327-ff1b-421a-a210-77bfd11a0e00 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:18.812704 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 104/214] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:22:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:18.813978 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed2327-ff1b-421a-a210-77bfd11a0e00 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:18.872612 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:18.916962 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed2327-ff1b-421a-a210-77bfd11a0e00 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:18.919171 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6fffc6-fae1-4d99-b78e-1637ab8b47ba None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:18.953137 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9513c6-130c-47fe-81a5-a9d202493cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:18.954188 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9513c6-130c-47fe-81a5-a9d202493cf4 None admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:18.954646 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9513c6-130c-47fe-81a5-a9d202493cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:18.955105 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9513c6-130c-47fe-81a5-a9d202493cf4 None admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:18.955770 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9513c6-130c-47fe-81a5-a9d202493cf4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:18.957225 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9513c6-130c-47fe-81a5-a9d202493cf4 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:18.959982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca762e5-79c9-4f18-b728-045c7fc6c546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:18.960807 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca762e5-79c9-4f18-b728-045c7fc6c546 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:18.961262 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca762e5-79c9-4f18-b728-045c7fc6c546 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:18.961706 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca762e5-79c9-4f18-b728-045c7fc6c546 None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:18.962548 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca762e5-79c9-4f18-b728-045c7fc6c546 None admin] RBAC: Adding query filter params (name=member) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:18.963068 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca762e5-79c9-4f18-b728-045c7fc6c546 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:18.964625 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca762e5-79c9-4f18-b728-045c7fc6c546 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:18.977278 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 111/215] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 15:22:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:18.983138 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca762e5-79c9-4f18-b728-045c7fc6c546 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:18.987178 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 105/216] 10.222.0.83 () {60 vars in 1132 bytes} [Mon Aug 29 15:22:18 2022] POST /identity/v3/users => generated 297 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:22:19.087915 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901749c0-df59-4726-9b6b-e992aacac062 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:19.088207 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901749c0-df59-4726-9b6b-e992aacac062 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:19.088468 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901749c0-df59-4726-9b6b-e992aacac062 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:19.090205 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 106/217] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:19.097075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833b1e9-6f34-4050-890c-1833e089afc9 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:19.097075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833b1e9-6f34-4050-890c-1833e089afc9 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:19.097354 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833b1e9-6f34-4050-890c-1833e089afc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:19.111371 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca762e5-79c9-4f18-b728-045c7fc6c546 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:19.112206 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:19.118242 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a833b1e9-6f34-4050-890c-1833e089afc9 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:19.119614 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a833b1e9-6f34-4050-890c-1833e089afc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:19.143500 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:19.154733 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6aa54e-d4c7-4139-aec5-9e95c38a181f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:19.155417 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6aa54e-d4c7-4139-aec5-9e95c38a181f None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:19.155865 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6aa54e-d4c7-4139-aec5-9e95c38a181f None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:19.156252 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6aa54e-d4c7-4139-aec5-9e95c38a181f None admin] PATH_INFO: `/v3/users/ad3b6ce094574cbdbddbfe2d8fb63368` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:19.174288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6aa54e-d4c7-4139-aec5-9e95c38a181f None admin] RBAC: Authorizing `identity:get_user(user_id=ad3b6ce094574cbdbddbfe2d8fb63368)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:19.175819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6aa54e-d4c7-4139-aec5-9e95c38a181f None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:19.177807 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 112/218] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 15:22:18 2022] GET /identity/v3/users/ad3b6ce094574cbdbddbfe2d8fb63368 => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:22:19.184693 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6aa54e-d4c7-4139-aec5-9e95c38a181f None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:19.213207 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 107/219] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 15:22:19.299505 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6aa54e-d4c7-4139-aec5-9e95c38a181f None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:19.317217 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377ba6f-28a9-43be-b0ff-b3e1ee603ba1 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:19.317706 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377ba6f-28a9-43be-b0ff-b3e1ee603ba1 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:19.317779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377ba6f-28a9-43be-b0ff-b3e1ee603ba1 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:19.320519 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 108/220] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:22:19.324179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd832f8-3f86-4f3b-8598-a11ce78af507 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:19.324711 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd832f8-3f86-4f3b-8598-a11ce78af507 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:19.325143 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd832f8-3f86-4f3b-8598-a11ce78af507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:19.337284 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e6486-bbe5-4585-8f81-d5db24e7ad59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:19.337907 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e6486-bbe5-4585-8f81-d5db24e7ad59 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:19.338184 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e6486-bbe5-4585-8f81-d5db24e7ad59 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:19.338455 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e6486-bbe5-4585-8f81-d5db24e7ad59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:19.354536 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-0bd832f8-3f86-4f3b-8598-a11ce78af507 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:19.355756 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0bd832f8-3f86-4f3b-8598-a11ce78af507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:19.404051 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:19.421024 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41e6486-bbe5-4585-8f81-d5db24e7ad59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:19.422924 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41e6486-bbe5-4585-8f81-d5db24e7ad59 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:19.430065 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 109/221] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:22:19.494093 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd832f8-3f86-4f3b-8598-a11ce78af507 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:19.563548 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 113/222] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:22:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:22:19.576872 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e6486-bbe5-4585-8f81-d5db24e7ad59 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:19.609853 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:19.677092 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd832f8-3f86-4f3b-8598-a11ce78af507 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:19.725719 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:19.737091 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64395012-3a57-4054-9f43-1844718d2863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:19.737744 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64395012-3a57-4054-9f43-1844718d2863 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:19.738030 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64395012-3a57-4054-9f43-1844718d2863 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:19.738293 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64395012-3a57-4054-9f43-1844718d2863 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:19.746850 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e6486-bbe5-4585-8f81-d5db24e7ad59 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:19.752919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64395012-3a57-4054-9f43-1844718d2863 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:19.757875 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-64395012-3a57-4054-9f43-1844718d2863 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:22:19.757875 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:19.757875 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:19.757875 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:19.757875 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:19.757875 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:19.757875 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:19.757875 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:19.757875 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:19.757875 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:19.757875 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:19.757875 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:19.757875 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:19.757875 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:19.757875 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:19.757875 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:19.758772 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:19.758772 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:19.758772 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:19.758772 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:19.758772 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:19.758772 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:19.758772 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:19.758772 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:19.758772 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:19.758772 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:19.758772 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:19.758772 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:19.758772 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:19.758772 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:19.758772 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:19.758772 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:19.759741 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:19.759741 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:19.759741 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:19.759741 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:19.759741 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:19.759741 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:19.759741 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:19.759741 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:19.759741 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:19.759741 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:19.759741 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:22:19.759741 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:22:19.763359 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 110/223] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 15:22:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:22:19.764184 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64395012-3a57-4054-9f43-1844718d2863 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:19.786816 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12662f62-2d78-4643-9c40-100b8205c719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:19.787500 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12662f62-2d78-4643-9c40-100b8205c719 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:19.787779 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12662f62-2d78-4643-9c40-100b8205c719 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:19.788053 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12662f62-2d78-4643-9c40-100b8205c719 None admin] PATH_INFO: `/v3/projects/7ebc74909fbc49f2b7065ea3550fee57` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:19.789323 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12662f62-2d78-4643-9c40-100b8205c719 None admin] RBAC: Authorizing `identity:get_project(project_id=7ebc74909fbc49f2b7065ea3550fee57)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:19.790787 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12662f62-2d78-4643-9c40-100b8205c719 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:19.792730 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 114/224] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:22:19 2022] GET /identity/v3/projects/7ebc74909fbc49f2b7065ea3550fee57 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:19.793491 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12662f62-2d78-4643-9c40-100b8205c719 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:19.876144 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64395012-3a57-4054-9f43-1844718d2863 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:19.903439 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12662f62-2d78-4643-9c40-100b8205c719 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:19.907587 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:19.915292 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0af69b-b284-4a8b-8301-20a32f617254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:19.916126 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0af69b-b284-4a8b-8301-20a32f617254 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:19.916497 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0af69b-b284-4a8b-8301-20a32f617254 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:19.916833 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0af69b-b284-4a8b-8301-20a32f617254 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:19.930072 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0af69b-b284-4a8b-8301-20a32f617254 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:19.935350 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-6f0af69b-b284-4a8b-8301-20a32f617254 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 15:22:19.935350 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:19.935350 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:19.935350 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:19.935350 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:19.935350 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:19.935350 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:19.935350 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:19.935350 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:19.935350 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:19.935350 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:19.935350 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:19.935350 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:19.935350 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:19.935350 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:19.935350 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:19.937320 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:19.937320 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:19.937320 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:19.937320 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:19.937320 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:19.937320 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:19.937320 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:19.937320 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:19.937320 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:19.937320 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:19.937320 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:19.937320 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:19.937320 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:19.937320 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:19.937320 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:19.937320 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:19.938701 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:19.938701 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:19.938701 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:19.938701 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:19.938701 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:19.938701 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:19.938701 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:19.938701 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:19.938701 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:19.938701 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:19.938701 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 15:22:19.938701 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:22:19.942828 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 111/225] 10.222.0.83 () {56 vars in 1114 bytes} [Mon Aug 29 15:22:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:22:19.943888 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0af69b-b284-4a8b-8301-20a32f617254 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:19.944372 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b9096d-78a8-441f-8676-fb94362b2fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:19.945138 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9096d-78a8-441f-8676-fb94362b2fea None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:19.945414 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9096d-78a8-441f-8676-fb94362b2fea None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:19.945731 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9096d-78a8-441f-8676-fb94362b2fea None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:19.946418 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b9096d-78a8-441f-8676-fb94362b2fea None admin] RBAC: Adding query filter params (name=admin) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:19.946720 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b9096d-78a8-441f-8676-fb94362b2fea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:19.948156 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b9096d-78a8-441f-8676-fb94362b2fea None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:19.958036 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 115/226] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:22:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:19.958774 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b9096d-78a8-441f-8676-fb94362b2fea None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:19.975346 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:20.061511 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0af69b-b284-4a8b-8301-20a32f617254 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:20.070086 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b9096d-78a8-441f-8676-fb94362b2fea None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:20.099609 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175796c-7603-4930-b459-8aaf6143cb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:20.100540 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175796c-7603-4930-b459-8aaf6143cb40 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:20.101079 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175796c-7603-4930-b459-8aaf6143cb40 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:20.101522 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175796c-7603-4930-b459-8aaf6143cb40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:20.102465 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1175796c-7603-4930-b459-8aaf6143cb40 None admin] RBAC: Adding query filter params (role.id=e85047210af34e2d87f8162c8bd2005e, scope.project.id=7ebc74909fbc49f2b7065ea3550fee57, user.id=ad3b6ce094574cbdbddbfe2d8fb63368) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:20.102953 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1175796c-7603-4930-b459-8aaf6143cb40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:20.104689 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1175796c-7603-4930-b459-8aaf6143cb40 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:20.106609 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098df6fa-48ab-4c5d-a863-5f757ce427d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:20.107263 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098df6fa-48ab-4c5d-a863-5f757ce427d6 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:20.107545 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098df6fa-48ab-4c5d-a863-5f757ce427d6 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:20.107826 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098df6fa-48ab-4c5d-a863-5f757ce427d6 None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:20.109299 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098df6fa-48ab-4c5d-a863-5f757ce427d6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:20.109659 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098df6fa-48ab-4c5d-a863-5f757ce427d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:20.111067 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098df6fa-48ab-4c5d-a863-5f757ce427d6 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:20.112700 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 112/227] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 15:22:19 2022] GET /identity/v3/role_assignments?user.id=ad3b6ce094574cbdbddbfe2d8fb63368&scope.project.id=7ebc74909fbc49f2b7065ea3550fee57&role.id=e85047210af34e2d87f8162c8bd2005e => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:20.113837 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175796c-7603-4930-b459-8aaf6143cb40 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:20.120476 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 116/228] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:22:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:20.129863 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098df6fa-48ab-4c5d-a863-5f757ce427d6 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:20.184358 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:20.239664 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175796c-7603-4930-b459-8aaf6143cb40 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:20.255346 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:20.288726 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098df6fa-48ab-4c5d-a863-5f757ce427d6 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:20.310607 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf369e4c-cfcf-4ebe-8ab4-059ea3bbf9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:20.310607 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf369e4c-cfcf-4ebe-8ab4-059ea3bbf9cf None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:20.310607 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf369e4c-cfcf-4ebe-8ab4-059ea3bbf9cf None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:20.310607 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf369e4c-cfcf-4ebe-8ab4-059ea3bbf9cf None admin] PATH_INFO: `/v3/users/0c7fc1aaa8c94016866dda1d8db730ac` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:20.311429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf369e4c-cfcf-4ebe-8ab4-059ea3bbf9cf None admin] RBAC: Authorizing `identity:get_user(user_id=0c7fc1aaa8c94016866dda1d8db730ac)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:20.314098 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf369e4c-cfcf-4ebe-8ab4-059ea3bbf9cf None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:20.315454 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 113/229] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 15:22:20 2022] GET /identity/v3/users/0c7fc1aaa8c94016866dda1d8db730ac => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:20.320888 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf369e4c-cfcf-4ebe-8ab4-059ea3bbf9cf None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:20.339236 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540eb1f9-1654-4ca9-a73e-e7db63ad12e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:20.340558 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540eb1f9-1654-4ca9-a73e-e7db63ad12e2 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:20.340983 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540eb1f9-1654-4ca9-a73e-e7db63ad12e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:20.341430 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540eb1f9-1654-4ca9-a73e-e7db63ad12e2 None admin] PATH_INFO: `/v3/users/0c7fc1aaa8c94016866dda1d8db730ac` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:20.343000 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540eb1f9-1654-4ca9-a73e-e7db63ad12e2 None admin] RBAC: Authorizing `identity:get_user(user_id=0c7fc1aaa8c94016866dda1d8db730ac)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:20.345317 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540eb1f9-1654-4ca9-a73e-e7db63ad12e2 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:20.347289 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 117/230] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 15:22:20 2022] GET /identity/v3/users/0c7fc1aaa8c94016866dda1d8db730ac => generated 283 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:20.354084 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540eb1f9-1654-4ca9-a73e-e7db63ad12e2 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:20.487995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf369e4c-cfcf-4ebe-8ab4-059ea3bbf9cf None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:20.518451 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:20.548955 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540eb1f9-1654-4ca9-a73e-e7db63ad12e2 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:20.554494 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ea72f8-3d52-441f-b804-163bef9fdbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:20.556037 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea72f8-3d52-441f-b804-163bef9fdbcb None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:20.558003 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea72f8-3d52-441f-b804-163bef9fdbcb None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:20.558463 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea72f8-3d52-441f-b804-163bef9fdbcb None admin] PATH_INFO: `/v3/projects/7ebc74909fbc49f2b7065ea3550fee57` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:20.564309 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ea72f8-3d52-441f-b804-163bef9fdbcb None admin] RBAC: Authorizing `identity:get_project(project_id=7ebc74909fbc49f2b7065ea3550fee57)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:20.566109 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ea72f8-3d52-441f-b804-163bef9fdbcb None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:20.569160 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 114/231] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:22:20 2022] GET /identity/v3/projects/7ebc74909fbc49f2b7065ea3550fee57 => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:22:20.574799 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ea72f8-3d52-441f-b804-163bef9fdbcb None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:20.623301 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd03e4-dc59-497e-8d83-756442115dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:20.623956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd03e4-dc59-497e-8d83-756442115dca None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:20.624776 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd03e4-dc59-497e-8d83-756442115dca None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:20.625048 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd03e4-dc59-497e-8d83-756442115dca None admin] PATH_INFO: `/v3/projects/7ebc74909fbc49f2b7065ea3550fee57` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:20.626498 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fd03e4-dc59-497e-8d83-756442115dca None admin] RBAC: Authorizing `identity:get_project(project_id=7ebc74909fbc49f2b7065ea3550fee57)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:20.632146 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fd03e4-dc59-497e-8d83-756442115dca None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:20.634384 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 118/232] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:22:20 2022] GET /identity/v3/projects/7ebc74909fbc49f2b7065ea3550fee57 => generated 302 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:22:20.640120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd03e4-dc59-497e-8d83-756442115dca None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:20.664106 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:20.760173 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ea72f8-3d52-441f-b804-163bef9fdbcb None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:20.785921 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd03e4-dc59-497e-8d83-756442115dca None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:20.821403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673bce93-e6e1-43f7-bb38-3a22b43fa02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:20.822064 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673bce93-e6e1-43f7-bb38-3a22b43fa02b None admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:20.822344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673bce93-e6e1-43f7-bb38-3a22b43fa02b None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:20.822619 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673bce93-e6e1-43f7-bb38-3a22b43fa02b None admin] PATH_INFO: `/v3/projects/7ebc74909fbc49f2b7065ea3550fee57/users/0c7fc1aaa8c94016866dda1d8db730ac/roles/3e8f6ab382f64437b245115f5a28f535` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:20.824871 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673bce93-e6e1-43f7-bb38-3a22b43fa02b None admin] RBAC: Authorizing `identity:create_grant(project_id=7ebc74909fbc49f2b7065ea3550fee57, user_id=0c7fc1aaa8c94016866dda1d8db730ac, role_id=3e8f6ab382f64437b245115f5a28f535)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:20.826335 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673bce93-e6e1-43f7-bb38-3a22b43fa02b None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:20.827293 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552036e3-adcf-4ff9-b8d0-2fb9f61f98d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:20.828945 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552036e3-adcf-4ff9-b8d0-2fb9f61f98d0 None admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:20.829668 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552036e3-adcf-4ff9-b8d0-2fb9f61f98d0 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:20.830243 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552036e3-adcf-4ff9-b8d0-2fb9f61f98d0 None admin] PATH_INFO: `/v3/projects/7ebc74909fbc49f2b7065ea3550fee57/users/0c7fc1aaa8c94016866dda1d8db730ac/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:20.833106 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552036e3-adcf-4ff9-b8d0-2fb9f61f98d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ebc74909fbc49f2b7065ea3550fee57, user_id=0c7fc1aaa8c94016866dda1d8db730ac, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:20.834825 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552036e3-adcf-4ff9-b8d0-2fb9f61f98d0 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:20.851903 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 115/233] 10.222.0.83 () {58 vars in 1439 bytes} [Mon Aug 29 15:22:20 2022] PUT /identity/v3/projects/7ebc74909fbc49f2b7065ea3550fee57/users/0c7fc1aaa8c94016866dda1d8db730ac/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:22:20.858344 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 119/234] 10.222.0.83 () {58 vars in 1439 bytes} [Mon Aug 29 15:22:20 2022] PUT /identity/v3/projects/7ebc74909fbc49f2b7065ea3550fee57/users/0c7fc1aaa8c94016866dda1d8db730ac/roles/3e8f6ab382f64437b245115f5a28f535 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:22:21.306890 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0619cf3-6a9a-43d2-b2fa-6d2b65aa573b None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:21.307331 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0619cf3-6a9a-43d2-b2fa-6d2b65aa573b None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:21.307510 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0619cf3-6a9a-43d2-b2fa-6d2b65aa573b None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:21.309076 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 116/235] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:21.314713 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fcb64b-8619-4eeb-94b8-f5bfc92cfb19 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:21.314999 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fcb64b-8619-4eeb-94b8-f5bfc92cfb19 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:21.315310 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fcb64b-8619-4eeb-94b8-f5bfc92cfb19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:21.343871 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-11fcb64b-8619-4eeb-94b8-f5bfc92cfb19 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:21.345083 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-11fcb64b-8619-4eeb-94b8-f5bfc92cfb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:21.435829 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:21.448311 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 120/236] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:22:21.582395 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01079b0-bcf1-425c-a059-42e7839e2af0 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:21.582902 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01079b0-bcf1-425c-a059-42e7839e2af0 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:21.582902 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01079b0-bcf1-425c-a059-42e7839e2af0 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:21.584532 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 117/237] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:21.589811 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f3fb7-5e63-45a9-9276-b2d4dbf0a432 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:21.590105 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f3fb7-5e63-45a9-9276-b2d4dbf0a432 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:21.590380 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f3fb7-5e63-45a9-9276-b2d4dbf0a432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:21.620315 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-383f3fb7-5e63-45a9-9276-b2d4dbf0a432 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:21.621570 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-383f3fb7-5e63-45a9-9276-b2d4dbf0a432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:21.710729 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 121/238] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:22:21.761809 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01079b0-bcf1-425c-a059-42e7839e2af0 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:21.834320 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:21.913639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01079b0-bcf1-425c-a059-42e7839e2af0 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:21.961572 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e19e6-6809-4dd5-a6b8-9092b655986d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:21.962213 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e19e6-6809-4dd5-a6b8-9092b655986d None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:21.962491 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e19e6-6809-4dd5-a6b8-9092b655986d None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:21.962762 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e19e6-6809-4dd5-a6b8-9092b655986d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:21.977304 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e19e6-6809-4dd5-a6b8-9092b655986d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:21.982883 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-516e19e6-6809-4dd5-a6b8-9092b655986d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 15:22:21.982883 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:21.982883 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:21.982883 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:21.982883 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:21.982883 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:21.982883 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:21.982883 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:21.982883 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:21.982883 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:21.982883 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:21.982883 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:21.982883 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:21.982883 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:21.982883 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:21.982883 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:21.984695 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:21.984695 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:21.984695 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:21.984695 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:21.984695 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:21.984695 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:21.984695 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:21.984695 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:21.984695 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:21.984695 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:21.984695 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:21.984695 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:21.984695 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:21.984695 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:21.984695 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:21.984695 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:21.985487 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:21.985487 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:21.985487 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:21.985487 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:21.985487 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:21.985487 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:21.985487 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:21.985487 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:21.985487 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:21.985487 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:21.985487 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 15:22:21.985487 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:22:21.987633 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 118/239] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:22:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:22:21.996144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f3fb7-5e63-45a9-9276-b2d4dbf0a432 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:22.143439 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f3fb7-5e63-45a9-9276-b2d4dbf0a432 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:22.180322 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:22.187001 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df76eb-a8b8-4db7-945b-ac929805cb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:22.187692 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df76eb-a8b8-4db7-945b-ac929805cb51 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:22.187967 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df76eb-a8b8-4db7-945b-ac929805cb51 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:22.188236 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df76eb-a8b8-4db7-945b-ac929805cb51 None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:22.188905 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df76eb-a8b8-4db7-945b-ac929805cb51 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:22.189207 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df76eb-a8b8-4db7-945b-ac929805cb51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:22.190591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df76eb-a8b8-4db7-945b-ac929805cb51 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:22.203173 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 122/240] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 15:22:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:22.209196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e19e6-6809-4dd5-a6b8-9092b655986d None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:22.225894 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df76eb-a8b8-4db7-945b-ac929805cb51 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:22.353452 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df76eb-a8b8-4db7-945b-ac929805cb51 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:22.421354 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e19e6-6809-4dd5-a6b8-9092b655986d None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:22.430502 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef75d6-82b1-48a3-a96c-51b6fb4d3727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:22.431176 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef75d6-82b1-48a3-a96c-51b6fb4d3727 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:22.431457 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef75d6-82b1-48a3-a96c-51b6fb4d3727 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:22.431727 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef75d6-82b1-48a3-a96c-51b6fb4d3727 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:22.435356 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:22.435569 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ef75d6-82b1-48a3-a96c-51b6fb4d3727 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:22.437632 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ef75d6-82b1-48a3-a96c-51b6fb4d3727 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:22.442307 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 123/241] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:22:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:22:22.449735 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef75d6-82b1-48a3-a96c-51b6fb4d3727 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:22.496880 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89924db6-1d3a-4cbb-ac1d-fa6f70a38c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:22.497517 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89924db6-1d3a-4cbb-ac1d-fa6f70a38c1b None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:22.497794 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89924db6-1d3a-4cbb-ac1d-fa6f70a38c1b None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:22.498063 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89924db6-1d3a-4cbb-ac1d-fa6f70a38c1b None admin] PATH_INFO: `/v3/users/04672a5a3b604967a657c4f41466ae27` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:22.526329 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89924db6-1d3a-4cbb-ac1d-fa6f70a38c1b None admin] RBAC: Authorizing `identity:get_user(user_id=04672a5a3b604967a657c4f41466ae27)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:22.527826 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89924db6-1d3a-4cbb-ac1d-fa6f70a38c1b None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:22.531769 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 119/242] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 15:22:22 2022] GET /identity/v3/users/04672a5a3b604967a657c4f41466ae27 => generated 297 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:22.535203 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba934d-60bf-4177-9039-0c6891325164 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:22.535486 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba934d-60bf-4177-9039-0c6891325164 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:22.535749 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba934d-60bf-4177-9039-0c6891325164 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:22.537247 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 120/243] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:22.537936 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba934d-60bf-4177-9039-0c6891325164 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:22.555840 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:22.602222 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef75d6-82b1-48a3-a96c-51b6fb4d3727 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:22.646635 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba934d-60bf-4177-9039-0c6891325164 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:22.647208 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2595e5-6fd8-4202-ae99-6a5783990e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:22.647441 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2595e5-6fd8-4202-ae99-6a5783990e2f None admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:22.647707 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2595e5-6fd8-4202-ae99-6a5783990e2f None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:22.647981 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2595e5-6fd8-4202-ae99-6a5783990e2f None admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:22.648806 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2595e5-6fd8-4202-ae99-6a5783990e2f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:22.651108 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2595e5-6fd8-4202-ae99-6a5783990e2f None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:22.679413 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 124/244] 10.222.0.83 () {60 vars in 1132 bytes} [Mon Aug 29 15:22:22 2022] POST /identity/v3/users => generated 293 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:22:22.684149 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959eaa3-4094-4b91-8205-3b89f6f52151 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:22.684437 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959eaa3-4094-4b91-8205-3b89f6f52151 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:22.684984 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959eaa3-4094-4b91-8205-3b89f6f52151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:22.699277 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4410ec-102c-432d-9937-0a1051b7a82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:22.702966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4410ec-102c-432d-9937-0a1051b7a82e None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:22.702966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4410ec-102c-432d-9937-0a1051b7a82e None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:22.702966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4410ec-102c-432d-9937-0a1051b7a82e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:22.726892 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-1959eaa3-4094-4b91-8205-3b89f6f52151 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:22.728167 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1959eaa3-4094-4b91-8205-3b89f6f52151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:22.768490 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:22.842191 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4410ec-102c-432d-9937-0a1051b7a82e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:22.846144 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4410ec-102c-432d-9937-0a1051b7a82e None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:22.880558 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 125/245] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:22:22.974267 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 121/246] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:22:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:22:22.979872 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959eaa3-4094-4b91-8205-3b89f6f52151 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:23.038267 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:23.103881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959eaa3-4094-4b91-8205-3b89f6f52151 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:23.145868 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9595d-b8d3-4bd5-9b61-35942d1dc7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:23.146895 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9595d-b8d3-4bd5-9b61-35942d1dc7c5 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:23.147374 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9595d-b8d3-4bd5-9b61-35942d1dc7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:23.147843 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9595d-b8d3-4bd5-9b61-35942d1dc7c5 None admin] PATH_INFO: `/v3/projects/7ebc74909fbc49f2b7065ea3550fee57` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:23.149185 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9595d-b8d3-4bd5-9b61-35942d1dc7c5 None admin] RBAC: Authorizing `identity:get_project(project_id=7ebc74909fbc49f2b7065ea3550fee57)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:23.150823 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9595d-b8d3-4bd5-9b61-35942d1dc7c5 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:23.152707 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 126/247] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:22:22 2022] GET /identity/v3/projects/7ebc74909fbc49f2b7065ea3550fee57 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:23.158770 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4410ec-102c-432d-9937-0a1051b7a82e None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:23.175996 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9595d-b8d3-4bd5-9b61-35942d1dc7c5 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:23.237991 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:23.285200 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4410ec-102c-432d-9937-0a1051b7a82e None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:23.316160 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9595d-b8d3-4bd5-9b61-35942d1dc7c5 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:23.325934 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ccac7f-3293-410c-a878-3763b8baa56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:23.326540 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ccac7f-3293-410c-a878-3763b8baa56f None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:23.326857 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ccac7f-3293-410c-a878-3763b8baa56f None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:23.327152 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ccac7f-3293-410c-a878-3763b8baa56f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:23.327893 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ccac7f-3293-410c-a878-3763b8baa56f None admin] RBAC: Adding query filter params (role.id=7c797c10240d4c399d804718c977d567, scope.project.id=7ebc74909fbc49f2b7065ea3550fee57, user.id=04672a5a3b604967a657c4f41466ae27) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:23.328193 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ccac7f-3293-410c-a878-3763b8baa56f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:23.329939 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ccac7f-3293-410c-a878-3763b8baa56f None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:23.336003 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 122/248] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 15:22:23 2022] GET /identity/v3/role_assignments?user.id=04672a5a3b604967a657c4f41466ae27&scope.project.id=7ebc74909fbc49f2b7065ea3550fee57&role.id=7c797c10240d4c399d804718c977d567 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:23.337305 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b530c-b0b9-449c-8f74-57eee09b5c12 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:23.337546 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b530c-b0b9-449c-8f74-57eee09b5c12 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:23.337816 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b530c-b0b9-449c-8f74-57eee09b5c12 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:23.339092 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 123/249] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:23.345180 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61024e5e-df7c-4347-81bf-ca32924c58db None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:23.345486 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61024e5e-df7c-4347-81bf-ca32924c58db None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:23.345722 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61024e5e-df7c-4347-81bf-ca32924c58db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:23.365422 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae1789-8af1-4700-b6b9-4a9dc50fbbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:23.367246 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae1789-8af1-4700-b6b9-4a9dc50fbbae None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:23.367735 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae1789-8af1-4700-b6b9-4a9dc50fbbae None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:23.368201 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae1789-8af1-4700-b6b9-4a9dc50fbbae None admin] PATH_INFO: `/v3/roles/member` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:23.370899 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-61024e5e-df7c-4347-81bf-ca32924c58db None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:23.372567 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-61024e5e-df7c-4347-81bf-ca32924c58db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:23.375862 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:23.389505 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae1789-8af1-4700-b6b9-4a9dc50fbbae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:23.396876 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-efae1789-8af1-4700-b6b9-4a9dc50fbbae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:22:23.396876 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:23.396876 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:23.396876 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:23.396876 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:23.396876 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:23.396876 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:23.396876 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:23.396876 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:23.396876 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:23.396876 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:23.396876 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:23.396876 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:23.396876 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:23.396876 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:23.396876 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:23.397809 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:23.397809 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:23.397809 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:23.397809 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:23.397809 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:23.397809 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:23.397809 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:23.397809 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:23.397809 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:23.397809 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:23.397809 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:23.397809 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:23.397809 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:23.397809 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:23.397809 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:23.397809 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:23.398570 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:23.398570 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:23.398570 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:23.398570 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:23.398570 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:23.398570 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:23.398570 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:23.398570 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:23.398570 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:23.398570 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:23.398570 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:22:23.398570 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:22:23.402380 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 127/250] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:22:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:22:23.409481 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae1789-8af1-4700-b6b9-4a9dc50fbbae None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:23.473234 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 124/251] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 15:22:23.476961 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0423347-e954-4af4-ae7f-f6b3f4c18446 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:23.476961 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0423347-e954-4af4-ae7f-f6b3f4c18446 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:23.476961 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0423347-e954-4af4-ae7f-f6b3f4c18446 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:23.477555 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 125/252] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:23.483571 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5158ca6-ae75-42ca-ab8d-b95dc2258ee0 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:23.483862 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5158ca6-ae75-42ca-ab8d-b95dc2258ee0 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:23.484121 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5158ca6-ae75-42ca-ab8d-b95dc2258ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:23.506160 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a5158ca6-ae75-42ca-ab8d-b95dc2258ee0 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:23.508851 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a5158ca6-ae75-42ca-ab8d-b95dc2258ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:23.546872 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae1789-8af1-4700-b6b9-4a9dc50fbbae None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:23.588473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b62b7-715d-465a-a23d-8c6027019f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:23.589344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b62b7-715d-465a-a23d-8c6027019f6d None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:23.589779 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b62b7-715d-465a-a23d-8c6027019f6d None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:23.590189 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b62b7-715d-465a-a23d-8c6027019f6d None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:23.591014 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0b62b7-715d-465a-a23d-8c6027019f6d None admin] RBAC: Adding query filter params (name=member) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:23.591473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0b62b7-715d-465a-a23d-8c6027019f6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:23.593750 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0b62b7-715d-465a-a23d-8c6027019f6d None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:23.605957 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 128/253] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 15:22:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:23.614438 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b62b7-715d-465a-a23d-8c6027019f6d None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:23.621199 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:23.649228 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 126/254] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:22:23.707505 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:23.776842 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b62b7-715d-465a-a23d-8c6027019f6d None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:23.826141 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff1f143-e0be-4b95-9638-22845b18f08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:23.826895 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1f143-e0be-4b95-9638-22845b18f08a None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:23.827204 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1f143-e0be-4b95-9638-22845b18f08a None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:23.827471 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1f143-e0be-4b95-9638-22845b18f08a None admin] PATH_INFO: `/v3/users/ad3b6ce094574cbdbddbfe2d8fb63368` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:23.829216 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff1f143-e0be-4b95-9638-22845b18f08a None admin] RBAC: Authorizing `identity:get_user(user_id=ad3b6ce094574cbdbddbfe2d8fb63368)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:23.830858 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff1f143-e0be-4b95-9638-22845b18f08a None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:23.832960 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 129/255] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 15:22:23 2022] GET /identity/v3/users/ad3b6ce094574cbdbddbfe2d8fb63368 => generated 297 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:22:23.838619 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5158ca6-ae75-42ca-ab8d-b95dc2258ee0 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:24.031373 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5158ca6-ae75-42ca-ab8d-b95dc2258ee0 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:24.085204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07136ce-55b2-4535-a27f-c4ff24146512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:24.085864 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07136ce-55b2-4535-a27f-c4ff24146512 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:24.086202 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07136ce-55b2-4535-a27f-c4ff24146512 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:24.086484 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07136ce-55b2-4535-a27f-c4ff24146512 None admin] PATH_INFO: `/v3/projects/7ebc74909fbc49f2b7065ea3550fee57` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:24.087704 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07136ce-55b2-4535-a27f-c4ff24146512 None admin] RBAC: Authorizing `identity:get_project(project_id=7ebc74909fbc49f2b7065ea3550fee57)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:24.089181 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07136ce-55b2-4535-a27f-c4ff24146512 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:24.091042 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 127/256] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:22:23 2022] GET /identity/v3/projects/7ebc74909fbc49f2b7065ea3550fee57 => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:24.097147 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff1f143-e0be-4b95-9638-22845b18f08a None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:24.135278 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07136ce-55b2-4535-a27f-c4ff24146512 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:24.249703 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:24.291203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff1f143-e0be-4b95-9638-22845b18f08a None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:24.300832 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:24.346791 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9bdf2b-d989-4192-9bff-782af22680b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:24.347639 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9bdf2b-d989-4192-9bff-782af22680b7 None admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:24.347919 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9bdf2b-d989-4192-9bff-782af22680b7 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:24.348192 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9bdf2b-d989-4192-9bff-782af22680b7 None admin] PATH_INFO: `/v3/projects/7ebc74909fbc49f2b7065ea3550fee57/users/ad3b6ce094574cbdbddbfe2d8fb63368/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:24.351132 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9bdf2b-d989-4192-9bff-782af22680b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ebc74909fbc49f2b7065ea3550fee57, user_id=ad3b6ce094574cbdbddbfe2d8fb63368, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:24.352603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9bdf2b-d989-4192-9bff-782af22680b7 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:24.360006 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07136ce-55b2-4535-a27f-c4ff24146512 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:24.382340 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 130/257] 10.222.0.83 () {58 vars in 1439 bytes} [Mon Aug 29 15:22:24 2022] PUT /identity/v3/projects/7ebc74909fbc49f2b7065ea3550fee57/users/ad3b6ce094574cbdbddbfe2d8fb63368/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:22:24.383250 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9bdf2b-d989-4192-9bff-782af22680b7 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:24.431541 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed6378-6e88-4fcb-a49a-8a985ae230c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:24.431541 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed6378-6e88-4fcb-a49a-8a985ae230c9 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:24.431541 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed6378-6e88-4fcb-a49a-8a985ae230c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:24.431541 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed6378-6e88-4fcb-a49a-8a985ae230c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:24.439472 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eed6378-6e88-4fcb-a49a-8a985ae230c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:24.444771 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-6eed6378-6e88-4fcb-a49a-8a985ae230c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:22:24.444771 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:24.444771 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:24.444771 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:24.444771 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:24.444771 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:24.444771 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:24.444771 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:24.444771 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:24.444771 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:24.444771 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:24.444771 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:24.444771 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:24.444771 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:24.444771 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:24.444771 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:24.445709 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:24.445709 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:24.445709 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:24.445709 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:24.445709 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:24.445709 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:24.445709 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:24.445709 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:24.445709 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:24.445709 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:24.445709 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:24.445709 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:24.445709 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:24.445709 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:24.445709 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:24.445709 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:24.446522 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:24.446522 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:24.446522 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:24.446522 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:24.446522 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:24.446522 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:24.446522 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:24.446522 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:24.446522 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:24.446522 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:24.446522 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:22:24.446522 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:22:24.446522 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 128/258] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 15:22:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:22:24.453429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed6378-6e88-4fcb-a49a-8a985ae230c9 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:24.527995 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9bdf2b-d989-4192-9bff-782af22680b7 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:24.584078 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b855143-11f8-4e51-bac3-fd343eb6346d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:24.585093 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b855143-11f8-4e51-bac3-fd343eb6346d None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:24.585567 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b855143-11f8-4e51-bac3-fd343eb6346d None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:24.586035 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b855143-11f8-4e51-bac3-fd343eb6346d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:24.599560 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b855143-11f8-4e51-bac3-fd343eb6346d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:24.605443 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-6b855143-11f8-4e51-bac3-fd343eb6346d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 15:22:24.605443 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:24.605443 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:24.605443 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:24.605443 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:24.605443 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:24.605443 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:24.605443 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:24.605443 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:24.605443 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:24.605443 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:24.605443 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:24.605443 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:24.605443 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:24.605443 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:24.605443 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:24.606349 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:24.606349 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:24.606349 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:24.606349 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:24.606349 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:24.606349 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:24.606349 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:24.606349 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:24.606349 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:24.606349 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:24.606349 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:24.606349 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:24.606349 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:24.606349 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:24.606349 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:24.606349 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:24.607156 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:24.607156 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:24.607156 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:24.607156 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:24.607156 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:24.607156 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:24.607156 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:24.607156 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:24.607156 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:24.607156 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:24.607156 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 15:22:24.607156 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:22:24.609183 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 131/259] 10.222.0.83 () {56 vars in 1114 bytes} [Mon Aug 29 15:22:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:22:24.616144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b855143-11f8-4e51-bac3-fd343eb6346d None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:24.651956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:24.674566 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed6378-6e88-4fcb-a49a-8a985ae230c9 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:24.737157 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:24.791734 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e89dd31-ee75-494a-8fd8-422505f471ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:24.792371 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89dd31-ee75-494a-8fd8-422505f471ec None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:24.792649 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89dd31-ee75-494a-8fd8-422505f471ec None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:24.792919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89dd31-ee75-494a-8fd8-422505f471ec None admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:24.793606 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e89dd31-ee75-494a-8fd8-422505f471ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:24.793906 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e89dd31-ee75-494a-8fd8-422505f471ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:24.800173 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e89dd31-ee75-494a-8fd8-422505f471ec None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:24.810797 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b855143-11f8-4e51-bac3-fd343eb6346d None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:24.813647 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 129/260] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:22:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:24.819073 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e89dd31-ee75-494a-8fd8-422505f471ec None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:24.900497 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06f036-7492-442c-8049-94086523b476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:24.901057 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06f036-7492-442c-8049-94086523b476 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:24.901340 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06f036-7492-442c-8049-94086523b476 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:24.901618 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06f036-7492-442c-8049-94086523b476 None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:24.902304 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06f036-7492-442c-8049-94086523b476 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:24.902612 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06f036-7492-442c-8049-94086523b476 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:24.905547 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06f036-7492-442c-8049-94086523b476 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:24.929113 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 132/261] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:22:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:24.936104 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06f036-7492-442c-8049-94086523b476 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:25.000275 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e89dd31-ee75-494a-8fd8-422505f471ec None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:25.042515 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6788f-1fe8-43ad-b291-28a64d79406a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:25.043190 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6788f-1fe8-43ad-b291-28a64d79406a None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:25.043467 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6788f-1fe8-43ad-b291-28a64d79406a None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:25.043734 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6788f-1fe8-43ad-b291-28a64d79406a None admin] PATH_INFO: `/v3/users/0c7fc1aaa8c94016866dda1d8db730ac` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:25.044861 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd6788f-1fe8-43ad-b291-28a64d79406a None admin] RBAC: Authorizing `identity:get_user(user_id=0c7fc1aaa8c94016866dda1d8db730ac)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:25.047186 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd6788f-1fe8-43ad-b291-28a64d79406a None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:25.053732 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 130/262] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 15:22:24 2022] GET /identity/v3/users/0c7fc1aaa8c94016866dda1d8db730ac => generated 283 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:22:25.060291 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6788f-1fe8-43ad-b291-28a64d79406a None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:25.093487 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:25.111530 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06f036-7492-442c-8049-94086523b476 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:25.139431 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:25.160631 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f1ba46-a221-4658-b94b-e16f93084cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:25.161199 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1ba46-a221-4658-b94b-e16f93084cb5 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:25.161478 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1ba46-a221-4658-b94b-e16f93084cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:25.161749 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1ba46-a221-4658-b94b-e16f93084cb5 None admin] PATH_INFO: `/v3/users/0c7fc1aaa8c94016866dda1d8db730ac` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:25.162903 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f1ba46-a221-4658-b94b-e16f93084cb5 None admin] RBAC: Authorizing `identity:get_user(user_id=0c7fc1aaa8c94016866dda1d8db730ac)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:25.164397 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f1ba46-a221-4658-b94b-e16f93084cb5 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:25.166310 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 133/263] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 15:22:24 2022] GET /identity/v3/users/0c7fc1aaa8c94016866dda1d8db730ac => generated 283 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:25.172414 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f1ba46-a221-4658-b94b-e16f93084cb5 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:25.191578 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6788f-1fe8-43ad-b291-28a64d79406a None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:25.242658 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30575cf5-77e1-4b92-8c6d-bb269951c91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:25.244040 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30575cf5-77e1-4b92-8c6d-bb269951c91d None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:25.244315 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30575cf5-77e1-4b92-8c6d-bb269951c91d None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:25.244582 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30575cf5-77e1-4b92-8c6d-bb269951c91d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:25.367623 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f1ba46-a221-4658-b94b-e16f93084cb5 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:25.368101 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30575cf5-77e1-4b92-8c6d-bb269951c91d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:25.369565 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30575cf5-77e1-4b92-8c6d-bb269951c91d None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:25.426862 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c354dcf5-c60e-471a-ae7d-d4d8955eaba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:25.427509 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354dcf5-c60e-471a-ae7d-d4d8955eaba5 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:25.427706 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354dcf5-c60e-471a-ae7d-d4d8955eaba5 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:25.427978 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354dcf5-c60e-471a-ae7d-d4d8955eaba5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:25.468640 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:25.487063 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:25.548177 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c354dcf5-c60e-471a-ae7d-d4d8955eaba5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:25.555057 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c354dcf5-c60e-471a-ae7d-d4d8955eaba5 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:25.637474 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 131/264] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:22:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 15:22:25.643980 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30575cf5-77e1-4b92-8c6d-bb269951c91d None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:25.797977 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30575cf5-77e1-4b92-8c6d-bb269951c91d None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:25.798959 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 134/265] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:22:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 15:22:25.805206 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c354dcf5-c60e-471a-ae7d-d4d8955eaba5 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:25.835756 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70dfe51-1cb4-4a40-befb-f3d9b692aae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:25.836484 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70dfe51-1cb4-4a40-befb-f3d9b692aae4 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:25.836835 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70dfe51-1cb4-4a40-befb-f3d9b692aae4 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:25.837178 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70dfe51-1cb4-4a40-befb-f3d9b692aae4 None admin] PATH_INFO: `/v3/projects/7ebc74909fbc49f2b7065ea3550fee57` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:25.838398 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70dfe51-1cb4-4a40-befb-f3d9b692aae4 None admin] RBAC: Authorizing `identity:get_project(project_id=7ebc74909fbc49f2b7065ea3550fee57)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:25.839965 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70dfe51-1cb4-4a40-befb-f3d9b692aae4 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:25.842422 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 132/266] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:22:25 2022] GET /identity/v3/projects/7ebc74909fbc49f2b7065ea3550fee57 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:25.852960 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70dfe51-1cb4-4a40-befb-f3d9b692aae4 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:25.869808 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:25.892205 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:25.940527 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c354dcf5-c60e-471a-ae7d-d4d8955eaba5 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:25.964340 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70dfe51-1cb4-4a40-befb-f3d9b692aae4 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:26.003667 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95877c86-352c-4a8c-9f28-2ee77ca0eeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:26.004285 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95877c86-352c-4a8c-9f28-2ee77ca0eeb6 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:26.004566 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95877c86-352c-4a8c-9f28-2ee77ca0eeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:26.004838 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95877c86-352c-4a8c-9f28-2ee77ca0eeb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:26.005572 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95877c86-352c-4a8c-9f28-2ee77ca0eeb6 None admin] RBAC: Adding query filter params (role.id=4bb2bbb7bb544610877949fc933504d2, scope.project.id=7ebc74909fbc49f2b7065ea3550fee57, user.id=0c7fc1aaa8c94016866dda1d8db730ac) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:26.005879 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95877c86-352c-4a8c-9f28-2ee77ca0eeb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:26.006947 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc52a5-614b-43fa-a2f7-735e9bf6f279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:26.007368 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95877c86-352c-4a8c-9f28-2ee77ca0eeb6 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:26.008045 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc52a5-614b-43fa-a2f7-735e9bf6f279 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:26.008513 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc52a5-614b-43fa-a2f7-735e9bf6f279 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:26.008971 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc52a5-614b-43fa-a2f7-735e9bf6f279 None admin] PATH_INFO: `/v3/projects/7ebc74909fbc49f2b7065ea3550fee57` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:26.014403 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 133/267] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 15:22:25 2022] GET /identity/v3/role_assignments?user.id=0c7fc1aaa8c94016866dda1d8db730ac&scope.project.id=7ebc74909fbc49f2b7065ea3550fee57&role.id=4bb2bbb7bb544610877949fc933504d2 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:22:26.015489 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc52a5-614b-43fa-a2f7-735e9bf6f279 None admin] RBAC: Authorizing `identity:get_project(project_id=7ebc74909fbc49f2b7065ea3550fee57)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:26.015634 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f0c21-cd53-4c45-a218-bc6e70602e14 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:26.015810 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f0c21-cd53-4c45-a218-bc6e70602e14 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:26.016078 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f0c21-cd53-4c45-a218-bc6e70602e14 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:26.017337 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 134/268] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:26.017910 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc52a5-614b-43fa-a2f7-735e9bf6f279 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:26.023072 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 135/269] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:22:25 2022] GET /identity/v3/projects/7ebc74909fbc49f2b7065ea3550fee57 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:22:26.036652 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc52a5-614b-43fa-a2f7-735e9bf6f279 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:26.037045 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1a306-8da8-4e88-9c34-fe0c1cffb6e0 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:26.037412 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1a306-8da8-4e88-9c34-fe0c1cffb6e0 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:26.037757 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1a306-8da8-4e88-9c34-fe0c1cffb6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:26.068672 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-54a1a306-8da8-4e88-9c34-fe0c1cffb6e0 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:26.070070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-54a1a306-8da8-4e88-9c34-fe0c1cffb6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:26.200035 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 135/270] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:22:26.201820 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b957d-cf27-4087-a217-281d4b6b67e3 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:26.202105 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b957d-cf27-4087-a217-281d4b6b67e3 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:26.202379 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b957d-cf27-4087-a217-281d4b6b67e3 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:26.203730 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 136/271] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:26.209934 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1f686-a1bc-4477-888d-37c3547c2378 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:26.210222 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1f686-a1bc-4477-888d-37c3547c2378 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:26.210499 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1f686-a1bc-4477-888d-37c3547c2378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:26.220356 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc52a5-614b-43fa-a2f7-735e9bf6f279 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:26.250042 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:26.255139 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-b5c1f686-a1bc-4477-888d-37c3547c2378 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:26.256363 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b5c1f686-a1bc-4477-888d-37c3547c2378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:26.258854 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:26.265673 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248fd517-c4d8-4f9c-8eb4-cca661e47e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:26.266290 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fd517-c4d8-4f9c-8eb4-cca661e47e12 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:26.266568 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fd517-c4d8-4f9c-8eb4-cca661e47e12 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:26.266839 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fd517-c4d8-4f9c-8eb4-cca661e47e12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:26.268118 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248fd517-c4d8-4f9c-8eb4-cca661e47e12 None admin] RBAC: Adding query filter params (role.id=3e8f6ab382f64437b245115f5a28f535, scope.project.id=7ebc74909fbc49f2b7065ea3550fee57, user.id=0c7fc1aaa8c94016866dda1d8db730ac) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:26.268432 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248fd517-c4d8-4f9c-8eb4-cca661e47e12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:26.269956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248fd517-c4d8-4f9c-8eb4-cca661e47e12 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:26.281092 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 136/272] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 15:22:26 2022] GET /identity/v3/role_assignments?user.id=0c7fc1aaa8c94016866dda1d8db730ac&scope.project.id=7ebc74909fbc49f2b7065ea3550fee57&role.id=3e8f6ab382f64437b245115f5a28f535 => generated 608 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:22:26.372636 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 137/273] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:22:26.472985 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca0738-c08a-4ad1-903f-7d86d2a5e053 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:26.473456 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca0738-c08a-4ad1-903f-7d86d2a5e053 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:26.473456 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca0738-c08a-4ad1-903f-7d86d2a5e053 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:26.475079 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 137/274] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:26.480434 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d010d-c27e-499b-a456-ea0d9c3d1bcf None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:26.480727 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d010d-c27e-499b-a456-ea0d9c3d1bcf None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:26.481005 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d010d-c27e-499b-a456-ea0d9c3d1bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:26.505190 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-dd0d010d-c27e-499b-a456-ea0d9c3d1bcf None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:26.506373 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-dd0d010d-c27e-499b-a456-ea0d9c3d1bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:26.581749 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca0738-c08a-4ad1-903f-7d86d2a5e053 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:26.583350 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 138/275] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:22:26.724544 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca0738-c08a-4ad1-903f-7d86d2a5e053 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:26.728365 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d010d-c27e-499b-a456-ea0d9c3d1bcf None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:26.768716 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92357ea5-53f6-4c8d-9fa5-fbeb31f9690d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:26.769371 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92357ea5-53f6-4c8d-9fa5-fbeb31f9690d None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:26.769647 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92357ea5-53f6-4c8d-9fa5-fbeb31f9690d None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:26.769917 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92357ea5-53f6-4c8d-9fa5-fbeb31f9690d None admin] PATH_INFO: `/v3/roles/member` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:26.781552 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92357ea5-53f6-4c8d-9fa5-fbeb31f9690d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:26.787310 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-92357ea5-53f6-4c8d-9fa5-fbeb31f9690d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:22:26.787310 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:26.787310 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:26.787310 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:26.787310 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:26.787310 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:26.787310 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:26.787310 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:26.787310 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:26.787310 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:26.787310 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:26.787310 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:26.787310 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:26.787310 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:26.787310 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:26.787310 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:26.788173 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:26.788173 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:26.788173 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:26.788173 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:26.788173 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:26.788173 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:26.788173 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:26.788173 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:26.788173 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:26.788173 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:26.788173 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:26.788173 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:26.788173 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:26.788173 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:26.788173 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:26.788173 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:26.788968 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:26.788968 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:26.788968 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:26.788968 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:26.788968 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:26.788968 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:26.788968 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:26.788968 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:26.788968 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:26.788968 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:26.788968 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:22:26.788968 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:22:26.788968 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 138/276] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:22:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:22:26.796065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92357ea5-53f6-4c8d-9fa5-fbeb31f9690d None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:26.814134 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:26.850904 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:26.860668 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d010d-c27e-499b-a456-ea0d9c3d1bcf None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:26.899620 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded4d0f-2b3a-40c3-881d-82ef091bcb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:26.900256 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded4d0f-2b3a-40c3-881d-82ef091bcb1e None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:26.900535 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded4d0f-2b3a-40c3-881d-82ef091bcb1e None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:26.900798 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded4d0f-2b3a-40c3-881d-82ef091bcb1e None admin] PATH_INFO: `/v3/domains/default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:26.901876 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ded4d0f-2b3a-40c3-881d-82ef091bcb1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:26.903557 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ded4d0f-2b3a-40c3-881d-82ef091bcb1e None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:26.906225 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 139/277] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:22:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:22:26.906935 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded4d0f-2b3a-40c3-881d-82ef091bcb1e None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:26.916919 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92357ea5-53f6-4c8d-9fa5-fbeb31f9690d None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:26.958119 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120f27a-06ae-47d9-90fe-9373638ced8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:26.958736 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120f27a-06ae-47d9-90fe-9373638ced8b None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:26.959040 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120f27a-06ae-47d9-90fe-9373638ced8b None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:26.959322 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120f27a-06ae-47d9-90fe-9373638ced8b None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:26.959997 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d120f27a-06ae-47d9-90fe-9373638ced8b None admin] RBAC: Adding query filter params (name=member) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:26.960305 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d120f27a-06ae-47d9-90fe-9373638ced8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:26.961712 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d120f27a-06ae-47d9-90fe-9373638ced8b None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:26.970887 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 139/278] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 15:22:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:22:26.971737 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120f27a-06ae-47d9-90fe-9373638ced8b None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:27.024868 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded4d0f-2b3a-40c3-881d-82ef091bcb1e None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:27.061923 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d867f9b8-5f76-4251-be1a-536fdd52bb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:27.062560 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867f9b8-5f76-4251-be1a-536fdd52bb64 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:27.062837 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867f9b8-5f76-4251-be1a-536fdd52bb64 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:27.063132 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867f9b8-5f76-4251-be1a-536fdd52bb64 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:27.066034 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:27.076712 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d867f9b8-5f76-4251-be1a-536fdd52bb64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:27.077647 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120f27a-06ae-47d9-90fe-9373638ced8b None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:27.081968 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-d867f9b8-5f76-4251-be1a-536fdd52bb64 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 15:22:27.081968 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:27.081968 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:27.081968 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:27.081968 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:27.081968 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:27.081968 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:27.081968 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:27.081968 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:27.081968 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:27.081968 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:27.081968 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:27.081968 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:27.081968 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:27.081968 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:27.081968 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:27.082860 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:27.082860 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:27.082860 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:27.082860 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:27.082860 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:27.082860 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:27.082860 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:27.082860 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:27.082860 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:27.082860 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:27.082860 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:27.082860 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:27.082860 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:27.082860 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:27.082860 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:27.082860 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:27.088448 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:27.088448 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:27.088448 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:27.088448 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:27.088448 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:27.088448 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:27.088448 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:27.088448 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:27.088448 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:27.088448 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:27.088448 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 15:22:27.088448 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:22:27.088448 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 140/279] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:22:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:22:27.088448 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d867f9b8-5f76-4251-be1a-536fdd52bb64 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:27.090416 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:27.116636 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd9737-1cdd-4714-8083-02ec0ed3ac2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:27.117240 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd9737-1cdd-4714-8083-02ec0ed3ac2e None admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:27.117522 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd9737-1cdd-4714-8083-02ec0ed3ac2e None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:27.117793 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd9737-1cdd-4714-8083-02ec0ed3ac2e None admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:27.118439 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd9737-1cdd-4714-8083-02ec0ed3ac2e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:27.119906 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd9737-1cdd-4714-8083-02ec0ed3ac2e None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:27.143299 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 140/280] 10.222.0.83 () {60 vars in 1132 bytes} [Mon Aug 29 15:22:26 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:22:27.144255 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd9737-1cdd-4714-8083-02ec0ed3ac2e None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:27.225768 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d867f9b8-5f76-4251-be1a-536fdd52bb64 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:27.258749 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd9737-1cdd-4714-8083-02ec0ed3ac2e None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:27.269907 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b60b27-49a2-49c5-bb9f-5d9c61c04f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:27.271107 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b60b27-49a2-49c5-bb9f-5d9c61c04f09 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:27.271590 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b60b27-49a2-49c5-bb9f-5d9c61c04f09 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:27.272118 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b60b27-49a2-49c5-bb9f-5d9c61c04f09 None admin] PATH_INFO: `/v3/users/36d9608338894a51b8441b0c53dfd09f` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:27.290290 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b60b27-49a2-49c5-bb9f-5d9c61c04f09 None admin] RBAC: Authorizing `identity:get_user(user_id=36d9608338894a51b8441b0c53dfd09f)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:27.292243 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b60b27-49a2-49c5-bb9f-5d9c61c04f09 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:27.294373 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 141/281] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 15:22:27 2022] GET /identity/v3/users/36d9608338894a51b8441b0c53dfd09f => generated 293 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:27.298311 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5016345-e0ce-4b5a-aaba-424c437f5f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:27.298927 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5016345-e0ce-4b5a-aaba-424c437f5f9a None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:27.299234 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5016345-e0ce-4b5a-aaba-424c437f5f9a None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:27.299755 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5016345-e0ce-4b5a-aaba-424c437f5f9a None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:27.300431 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5016345-e0ce-4b5a-aaba-424c437f5f9a None admin] RBAC: Adding query filter params (name=reader) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:27.300729 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5016345-e0ce-4b5a-aaba-424c437f5f9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:27.301682 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b60b27-49a2-49c5-bb9f-5d9c61c04f09 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:27.302091 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5016345-e0ce-4b5a-aaba-424c437f5f9a None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:27.311816 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 141/282] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 15:22:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:27.317240 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d526d-f1d4-4b3d-ae78-4450bcbaccfb None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:27.317528 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d526d-f1d4-4b3d-ae78-4450bcbaccfb None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:27.317798 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d526d-f1d4-4b3d-ae78-4450bcbaccfb None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:27.319240 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 142/283] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:22:27.321324 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d526d-f1d4-4b3d-ae78-4450bcbaccfb None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:27.354524 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:27.371335 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:27.425426 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b60b27-49a2-49c5-bb9f-5d9c61c04f09 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:27.458398 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d526d-f1d4-4b3d-ae78-4450bcbaccfb None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:27.478625 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a68c1e-35bc-4b42-a3de-4943c96d9755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:27.478625 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a68c1e-35bc-4b42-a3de-4943c96d9755 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:27.478885 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a68c1e-35bc-4b42-a3de-4943c96d9755 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:27.479221 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a68c1e-35bc-4b42-a3de-4943c96d9755 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:27.480043 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a68c1e-35bc-4b42-a3de-4943c96d9755 None admin] RBAC: Adding query filter params (role.id=e85047210af34e2d87f8162c8bd2005e, user.id=36d9608338894a51b8441b0c53dfd09f, scope.system=all) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:27.480266 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a68c1e-35bc-4b42-a3de-4943c96d9755 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:27.481721 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a68c1e-35bc-4b42-a3de-4943c96d9755 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:27.488031 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 142/284] 10.222.0.83 () {56 vars in 1308 bytes} [Mon Aug 29 15:22:27 2022] GET /identity/v3/role_assignments?user.id=36d9608338894a51b8441b0c53dfd09f&scope.system=all&role.id=e85047210af34e2d87f8162c8bd2005e => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:27.489322 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13934d18-5958-4037-bce2-f2167215446d None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:27.489957 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13934d18-5958-4037-bce2-f2167215446d None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:27.489957 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13934d18-5958-4037-bce2-f2167215446d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:27.513002 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-13934d18-5958-4037-bce2-f2167215446d None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:27.514822 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-13934d18-5958-4037-bce2-f2167215446d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:27.516140 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27cb475-8037-4ea6-9181-dc489afa04a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:27.517853 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27cb475-8037-4ea6-9181-dc489afa04a5 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:27.519505 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27cb475-8037-4ea6-9181-dc489afa04a5 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:27.520001 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27cb475-8037-4ea6-9181-dc489afa04a5 None admin] PATH_INFO: `/v3/users/04672a5a3b604967a657c4f41466ae27` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:27.521597 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27cb475-8037-4ea6-9181-dc489afa04a5 None admin] RBAC: Authorizing `identity:get_user(user_id=04672a5a3b604967a657c4f41466ae27)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:27.524679 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27cb475-8037-4ea6-9181-dc489afa04a5 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:27.527403 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 143/285] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 15:22:27 2022] GET /identity/v3/users/04672a5a3b604967a657c4f41466ae27 => generated 297 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:22:27.533599 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27cb475-8037-4ea6-9181-dc489afa04a5 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:27.614073 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 143/286] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:22:27.674129 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:27.688054 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27cb475-8037-4ea6-9181-dc489afa04a5 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:27.736653 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2043c6-4240-4930-9276-55ba457c78b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:27.737293 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2043c6-4240-4930-9276-55ba457c78b5 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:27.737571 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2043c6-4240-4930-9276-55ba457c78b5 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:27.737843 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2043c6-4240-4930-9276-55ba457c78b5 None admin] PATH_INFO: `/v3/projects/7ebc74909fbc49f2b7065ea3550fee57` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:27.738978 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2043c6-4240-4930-9276-55ba457c78b5 None admin] RBAC: Authorizing `identity:get_project(project_id=7ebc74909fbc49f2b7065ea3550fee57)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:27.742126 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2043c6-4240-4930-9276-55ba457c78b5 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:27.742126 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 144/287] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:22:27 2022] GET /identity/v3/projects/7ebc74909fbc49f2b7065ea3550fee57 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:22:27.749525 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13934d18-5958-4037-bce2-f2167215446d None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:27.817537 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:27.881187 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13934d18-5958-4037-bce2-f2167215446d None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:27.921204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2555680-66f0-400c-90f3-53bcd16425aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:27.921885 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2555680-66f0-400c-90f3-53bcd16425aa None admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:27.922159 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2555680-66f0-400c-90f3-53bcd16425aa None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:27.922425 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2555680-66f0-400c-90f3-53bcd16425aa None admin] PATH_INFO: `/v3/projects/7ebc74909fbc49f2b7065ea3550fee57/users/04672a5a3b604967a657c4f41466ae27/roles/7c797c10240d4c399d804718c977d567` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:27.924694 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2555680-66f0-400c-90f3-53bcd16425aa None admin] RBAC: Authorizing `identity:create_grant(project_id=7ebc74909fbc49f2b7065ea3550fee57, user_id=04672a5a3b604967a657c4f41466ae27, role_id=7c797c10240d4c399d804718c977d567)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:27.926149 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2555680-66f0-400c-90f3-53bcd16425aa None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:27.942581 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 144/288] 10.222.0.83 () {58 vars in 1439 bytes} [Mon Aug 29 15:22:27 2022] PUT /identity/v3/projects/7ebc74909fbc49f2b7065ea3550fee57/users/04672a5a3b604967a657c4f41466ae27/roles/7c797c10240d4c399d804718c977d567 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:22:27.992570 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2043c6-4240-4930-9276-55ba457c78b5 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:28.125969 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2043c6-4240-4930-9276-55ba457c78b5 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:28.166548 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e3dca-8668-4ea3-92ac-04fe9257ecfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:28.167149 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e3dca-8668-4ea3-92ac-04fe9257ecfe None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:28.167434 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e3dca-8668-4ea3-92ac-04fe9257ecfe None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:28.167707 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e3dca-8668-4ea3-92ac-04fe9257ecfe None admin] PATH_INFO: `/v3/roles/member` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:28.179530 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e3dca-8668-4ea3-92ac-04fe9257ecfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:28.185030 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-db1e3dca-8668-4ea3-92ac-04fe9257ecfe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:22:28.185030 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:28.185030 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:28.185030 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:28.185030 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:28.185030 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:28.185030 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:28.185030 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:28.185030 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:28.185030 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:28.185030 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:28.185030 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:28.185030 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:28.185030 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:28.185030 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:28.185030 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:28.185864 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:28.185864 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:28.185864 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:28.185864 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:28.185864 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:28.185864 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:28.185864 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:28.185864 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:28.185864 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:28.185864 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:28.185864 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:28.185864 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:28.185864 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:28.185864 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:28.185864 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:28.185864 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:28.186645 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:28.186645 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:28.186645 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:28.186645 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:28.186645 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:28.186645 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:28.186645 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:28.186645 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:28.186645 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:28.186645 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:28.186645 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:22:28.186645 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:22:28.186645 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 145/289] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:22:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:22:28.192131 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2555680-66f0-400c-90f3-53bcd16425aa None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:28.328929 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2555680-66f0-400c-90f3-53bcd16425aa None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:28.339080 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:28.374132 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb69878-c4ee-47c2-a3f8-d4dcdaefa743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:28.375127 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb69878-c4ee-47c2-a3f8-d4dcdaefa743 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:28.375597 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb69878-c4ee-47c2-a3f8-d4dcdaefa743 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:28.376054 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb69878-c4ee-47c2-a3f8-d4dcdaefa743 None admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:28.377007 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb69878-c4ee-47c2-a3f8-d4dcdaefa743 None admin] RBAC: Adding query filter params (name=member) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:28.377504 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb69878-c4ee-47c2-a3f8-d4dcdaefa743 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:28.379095 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb69878-c4ee-47c2-a3f8-d4dcdaefa743 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:28.392548 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 145/290] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 15:22:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:22:28.398540 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e3dca-8668-4ea3-92ac-04fe9257ecfe None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:28.441099 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:28.525909 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e3dca-8668-4ea3-92ac-04fe9257ecfe None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:28.562200 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ff008-08d8-4a32-b20f-bd04e46d7171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:28.562947 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ff008-08d8-4a32-b20f-bd04e46d7171 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:28.563261 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ff008-08d8-4a32-b20f-bd04e46d7171 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:28.563533 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ff008-08d8-4a32-b20f-bd04e46d7171 None admin] PATH_INFO: `/v3/users/ad3b6ce094574cbdbddbfe2d8fb63368` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:28.564736 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0ff008-08d8-4a32-b20f-bd04e46d7171 None admin] RBAC: Authorizing `identity:get_user(user_id=ad3b6ce094574cbdbddbfe2d8fb63368)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:28.566197 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0ff008-08d8-4a32-b20f-bd04e46d7171 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:28.568149 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 146/291] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 15:22:28 2022] GET /identity/v3/users/ad3b6ce094574cbdbddbfe2d8fb63368 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:28.576045 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb69878-c4ee-47c2-a3f8-d4dcdaefa743 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:28.707044 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb69878-c4ee-47c2-a3f8-d4dcdaefa743 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:28.748861 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a998556-c0ab-475d-836b-caf57dfd237d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:28.749500 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a998556-c0ab-475d-836b-caf57dfd237d None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:28.749778 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a998556-c0ab-475d-836b-caf57dfd237d None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:28.750047 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a998556-c0ab-475d-836b-caf57dfd237d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:28.801563 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:28.840625 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a998556-c0ab-475d-836b-caf57dfd237d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:28.842648 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a998556-c0ab-475d-836b-caf57dfd237d None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:28.972873 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 146/292] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:22:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:22:28.978646 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ff008-08d8-4a32-b20f-bd04e46d7171 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:29.086454 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:29.103235 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ff008-08d8-4a32-b20f-bd04e46d7171 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:29.155050 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a08c3b-6be0-45ed-a33c-fd009e687269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:29.155691 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a08c3b-6be0-45ed-a33c-fd009e687269 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:29.155968 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a08c3b-6be0-45ed-a33c-fd009e687269 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:29.156237 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a08c3b-6be0-45ed-a33c-fd009e687269 None admin] PATH_INFO: `/v3/projects/7ebc74909fbc49f2b7065ea3550fee57` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:29.159702 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a08c3b-6be0-45ed-a33c-fd009e687269 None admin] RBAC: Authorizing `identity:get_project(project_id=7ebc74909fbc49f2b7065ea3550fee57)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:29.161162 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a08c3b-6be0-45ed-a33c-fd009e687269 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:29.163309 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 147/293] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:22:28 2022] GET /identity/v3/projects/7ebc74909fbc49f2b7065ea3550fee57 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:29.172139 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a998556-c0ab-475d-836b-caf57dfd237d None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:29.270728 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:29.309299 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a998556-c0ab-475d-836b-caf57dfd237d None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:29.353277 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c9a97-5f4d-42e5-8c5b-b519f456fe49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:29.354269 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c9a97-5f4d-42e5-8c5b-b519f456fe49 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:29.354736 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c9a97-5f4d-42e5-8c5b-b519f456fe49 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:29.355245 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c9a97-5f4d-42e5-8c5b-b519f456fe49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:29.356185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4c9a97-5f4d-42e5-8c5b-b519f456fe49 None admin] RBAC: Adding query filter params (role.id=e85047210af34e2d87f8162c8bd2005e, scope.project.id=7ebc74909fbc49f2b7065ea3550fee57, user.id=ad3b6ce094574cbdbddbfe2d8fb63368) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:29.356748 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4c9a97-5f4d-42e5-8c5b-b519f456fe49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:29.358671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4c9a97-5f4d-42e5-8c5b-b519f456fe49 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:29.365940 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 147/294] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 15:22:29 2022] GET /identity/v3/role_assignments?user.id=ad3b6ce094574cbdbddbfe2d8fb63368&scope.project.id=7ebc74909fbc49f2b7065ea3550fee57&role.id=e85047210af34e2d87f8162c8bd2005e => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:29.621473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9504e6-b67b-4727-9eeb-563457f89fb6 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:29.621965 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9504e6-b67b-4727-9eeb-563457f89fb6 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:29.621965 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9504e6-b67b-4727-9eeb-563457f89fb6 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:29.623647 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 148/295] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:29.628786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b0433-f88b-414c-8c42-f41e0976f748 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:29.629311 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b0433-f88b-414c-8c42-f41e0976f748 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:29.629970 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b0433-f88b-414c-8c42-f41e0976f748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:29.651301 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-5e9b0433-f88b-414c-8c42-f41e0976f748 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:29.652805 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5e9b0433-f88b-414c-8c42-f41e0976f748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:29.742287 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 148/296] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:22:29.817595 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92059a0e-3ce1-4141-855d-0b8bcb6c1f15 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:29.817946 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92059a0e-3ce1-4141-855d-0b8bcb6c1f15 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:29.818230 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92059a0e-3ce1-4141-855d-0b8bcb6c1f15 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:29.819920 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 149/297] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:29.824991 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb42917-06d1-4a98-8ae6-937d2c19ced5 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:29.825321 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb42917-06d1-4a98-8ae6-937d2c19ced5 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:29.825632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb42917-06d1-4a98-8ae6-937d2c19ced5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:29.847400 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-4eb42917-06d1-4a98-8ae6-937d2c19ced5 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:29.848597 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4eb42917-06d1-4a98-8ae6-937d2c19ced5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:29.917767 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:29.932194 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 149/298] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:22:30.009413 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a5e97-6cfd-4858-9e82-becbf08e8740 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:30.009699 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a5e97-6cfd-4858-9e82-becbf08e8740 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:30.009980 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a5e97-6cfd-4858-9e82-becbf08e8740 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:30.011646 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 150/299] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:30.017554 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070a8ae-f317-434b-895b-fce2c0d3596d None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:30.017844 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070a8ae-f317-434b-895b-fce2c0d3596d None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:30.018120 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070a8ae-f317-434b-895b-fce2c0d3596d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:30.037556 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-e070a8ae-f317-434b-895b-fce2c0d3596d None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:30.038345 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a5e97-6cfd-4858-9e82-becbf08e8740 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:30.038763 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e070a8ae-f317-434b-895b-fce2c0d3596d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:30.117611 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 150/300] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:22:30.159611 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a5e97-6cfd-4858-9e82-becbf08e8740 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:30.194745 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe404bb0-6587-4b9b-9c13-a06680c0f0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:30.195408 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe404bb0-6587-4b9b-9c13-a06680c0f0bc None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:30.195681 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe404bb0-6587-4b9b-9c13-a06680c0f0bc None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:30.195952 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe404bb0-6587-4b9b-9c13-a06680c0f0bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:30.197057 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe404bb0-6587-4b9b-9c13-a06680c0f0bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:30.198557 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe404bb0-6587-4b9b-9c13-a06680c0f0bc None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:30.200833 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 151/301] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:22:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:22:30.206803 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070a8ae-f317-434b-895b-fce2c0d3596d None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:30.226400 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe404bb0-6587-4b9b-9c13-a06680c0f0bc None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:30.256860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:30.339186 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070a8ae-f317-434b-895b-fce2c0d3596d None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:30.354161 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe404bb0-6587-4b9b-9c13-a06680c0f0bc None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:30.373263 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:30.386900 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d7fab-6e94-4f12-a275-08c50e4fd609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:30.388537 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d7fab-6e94-4f12-a275-08c50e4fd609 None admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:30.389024 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d7fab-6e94-4f12-a275-08c50e4fd609 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:30.389437 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d7fab-6e94-4f12-a275-08c50e4fd609 None admin] PATH_INFO: `/v3/groups` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:30.390283 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d7fab-6e94-4f12-a275-08c50e4fd609 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:30.391539 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a334cea-8346-40e6-a31b-0e545b9a0705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:30.392094 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d7fab-6e94-4f12-a275-08c50e4fd609 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:30.392317 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a334cea-8346-40e6-a31b-0e545b9a0705 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:30.392666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a334cea-8346-40e6-a31b-0e545b9a0705 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:30.393007 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a334cea-8346-40e6-a31b-0e545b9a0705 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:30.404468 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a334cea-8346-40e6-a31b-0e545b9a0705 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:30.409658 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 151/302] 10.222.0.83 () {60 vars in 1134 bytes} [Mon Aug 29 15:22:30 2022] POST /identity/v3/groups => generated 229 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:22:30.410039 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-4a334cea-8346-40e6-a31b-0e545b9a0705 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 15:22:30.410039 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:30.410039 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:30.410039 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:30.410039 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:30.410039 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:30.410039 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:30.410039 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:30.410039 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:30.410039 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:30.410039 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:30.410039 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:30.410039 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:30.410039 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:30.410039 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:30.410039 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:30.411209 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:30.411209 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:30.411209 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:30.411209 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:30.411209 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:30.411209 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:30.411209 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:30.411209 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:30.411209 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:30.411209 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:30.411209 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:30.411209 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:30.411209 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:30.411209 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:30.411209 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:30.411209 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:30.412420 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:30.412420 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:30.412420 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:30.412420 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:30.412420 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:30.412420 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:30.412420 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:30.412420 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:30.412420 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:30.412420 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:30.412420 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 15:22:30.412420 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:22:30.413154 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d7fab-6e94-4f12-a275-08c50e4fd609 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:30.413236 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 152/303] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:22:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:22:30.421213 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a334cea-8346-40e6-a31b-0e545b9a0705 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:30.526732 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d7fab-6e94-4f12-a275-08c50e4fd609 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:30.534874 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:30.552787 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a334cea-8346-40e6-a31b-0e545b9a0705 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:30.566697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e287f-0b2c-4d80-837a-21b7067f5d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:30.567597 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e287f-0b2c-4d80-837a-21b7067f5d5d None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:30.567727 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e287f-0b2c-4d80-837a-21b7067f5d5d None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:30.568386 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e287f-0b2c-4d80-837a-21b7067f5d5d None admin] PATH_INFO: `/v3/roles/member` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:30.580242 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4e287f-0b2c-4d80-837a-21b7067f5d5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:30.585582 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-be4e287f-0b2c-4d80-837a-21b7067f5d5d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:22:30.585582 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:30.585582 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:30.585582 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:30.585582 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:30.585582 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:30.585582 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:30.585582 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:30.585582 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:30.585582 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:30.585582 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:30.585582 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:30.585582 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:30.585582 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:30.585582 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:30.585582 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:30.586655 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:30.586655 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:30.586655 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:30.586655 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:30.586655 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:30.586655 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:30.586655 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:30.586655 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:30.586655 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:30.586655 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:30.586655 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:30.586655 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:30.586655 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:30.586655 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:30.586655 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:30.586655 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:30.587757 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:30.587757 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:30.587757 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:30.587757 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:30.587757 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:30.587757 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:30.587757 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:30.587757 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:30.587757 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:30.587757 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:30.587757 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:22:30.587757 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:22:30.587757 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 152/304] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:22:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:22:30.588660 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91a30e-9c52-4b78-b675-ecef272d76d2 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:30.588660 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91a30e-9c52-4b78-b675-ecef272d76d2 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:30.588660 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91a30e-9c52-4b78-b675-ecef272d76d2 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:30.589745 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 153/305] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:30.594613 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91a30e-9c52-4b78-b675-ecef272d76d2 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:30.599343 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f70b8-d220-4457-950d-f0ab2f24cd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:30.600060 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f70b8-d220-4457-950d-f0ab2f24cd57 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:30.600393 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f70b8-d220-4457-950d-f0ab2f24cd57 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:30.600728 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f70b8-d220-4457-950d-f0ab2f24cd57 None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:30.601460 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f70b8-d220-4457-950d-f0ab2f24cd57 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:30.601835 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f70b8-d220-4457-950d-f0ab2f24cd57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:30.603319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f70b8-d220-4457-950d-f0ab2f24cd57 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:30.614210 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 153/306] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 15:22:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:30.615650 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ab688-abb8-4822-88a1-080c9d5393d6 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:30.615934 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ab688-abb8-4822-88a1-080c9d5393d6 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:30.616202 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ab688-abb8-4822-88a1-080c9d5393d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:30.634835 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-278ab688-abb8-4822-88a1-080c9d5393d6 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:30.636086 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-278ab688-abb8-4822-88a1-080c9d5393d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:30.652956 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:30.710708 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 154/307] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:22:30.711490 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ab688-abb8-4822-88a1-080c9d5393d6 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:30.726258 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91a30e-9c52-4b78-b675-ecef272d76d2 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:30.761606 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc441f-bfb4-4071-8fa2-17c129680104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:30.762382 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc441f-bfb4-4071-8fa2-17c129680104 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:30.763539 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc441f-bfb4-4071-8fa2-17c129680104 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:30.763659 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc441f-bfb4-4071-8fa2-17c129680104 None admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:30.764543 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fc441f-bfb4-4071-8fa2-17c129680104 None admin] RBAC: Adding query filter params (name=member) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:30.764949 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fc441f-bfb4-4071-8fa2-17c129680104 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:30.766435 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fc441f-bfb4-4071-8fa2-17c129680104 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:30.780310 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 154/308] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 15:22:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:22:30.784924 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc441f-bfb4-4071-8fa2-17c129680104 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:30.814007 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:30.840285 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ab688-abb8-4822-88a1-080c9d5393d6 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:30.885226 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5350621-bde2-439c-bb2e-a6f9d361f09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:30.886139 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5350621-bde2-439c-bb2e-a6f9d361f09b None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:30.886561 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5350621-bde2-439c-bb2e-a6f9d361f09b None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:30.886975 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5350621-bde2-439c-bb2e-a6f9d361f09b None admin] PATH_INFO: `/v3/users/190be9cd7dd1496db45a0cfc87732066` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:30.903561 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5350621-bde2-439c-bb2e-a6f9d361f09b None admin] RBAC: Authorizing `identity:get_user(user_id=190be9cd7dd1496db45a0cfc87732066)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:30.905209 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5350621-bde2-439c-bb2e-a6f9d361f09b None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:30.907128 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 155/309] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 15:22:30 2022] GET /identity/v3/users/190be9cd7dd1496db45a0cfc87732066 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:30.913002 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5350621-bde2-439c-bb2e-a6f9d361f09b None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:30.916096 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc441f-bfb4-4071-8fa2-17c129680104 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:30.963414 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:30.974765 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e40cf9-91d1-4d73-9a01-f68b547892c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:30.976060 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e40cf9-91d1-4d73-9a01-f68b547892c1 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:30.976508 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e40cf9-91d1-4d73-9a01-f68b547892c1 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:30.976945 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e40cf9-91d1-4d73-9a01-f68b547892c1 None admin] PATH_INFO: `/v3/users/36d9608338894a51b8441b0c53dfd09f` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:30.979016 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e40cf9-91d1-4d73-9a01-f68b547892c1 None admin] RBAC: Authorizing `identity:get_user(user_id=36d9608338894a51b8441b0c53dfd09f)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:30.980635 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e40cf9-91d1-4d73-9a01-f68b547892c1 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:30.983235 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 155/310] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 15:22:30 2022] GET /identity/v3/users/36d9608338894a51b8441b0c53dfd09f => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:22:30.983981 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e40cf9-91d1-4d73-9a01-f68b547892c1 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:31.028178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5350621-bde2-439c-bb2e-a6f9d361f09b None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:31.067282 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a5826-e0cd-458c-b79d-cbb6d0005051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:31.067813 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a5826-e0cd-458c-b79d-cbb6d0005051 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:31.068093 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a5826-e0cd-458c-b79d-cbb6d0005051 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:31.068761 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a5826-e0cd-458c-b79d-cbb6d0005051 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:31.069517 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a5826-e0cd-458c-b79d-cbb6d0005051 None admin] RBAC: Adding query filter params (role.id=7c797c10240d4c399d804718c977d567, user.id=190be9cd7dd1496db45a0cfc87732066, scope.system=all) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:31.069826 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a5826-e0cd-458c-b79d-cbb6d0005051 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:31.071685 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a5826-e0cd-458c-b79d-cbb6d0005051 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:31.075114 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:31.086343 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 156/311] 10.222.0.83 () {56 vars in 1308 bytes} [Mon Aug 29 15:22:30 2022] GET /identity/v3/role_assignments?user.id=190be9cd7dd1496db45a0cfc87732066&scope.system=all&role.id=7c797c10240d4c399d804718c977d567 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:22:31.086343 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a5826-e0cd-458c-b79d-cbb6d0005051 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:31.102272 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e40cf9-91d1-4d73-9a01-f68b547892c1 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:31.146704 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41545b-c1f2-4b1f-8248-31c1b1d8d00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:31.147379 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41545b-c1f2-4b1f-8248-31c1b1d8d00c None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:31.147650 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41545b-c1f2-4b1f-8248-31c1b1d8d00c None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:31.147915 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41545b-c1f2-4b1f-8248-31c1b1d8d00c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:31.164922 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d41545b-c1f2-4b1f-8248-31c1b1d8d00c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:31.173201 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-1d41545b-c1f2-4b1f-8248-31c1b1d8d00c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 15:22:31.173201 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:31.173201 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:31.173201 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:31.173201 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:31.173201 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:31.173201 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:31.173201 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:31.173201 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:31.173201 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:31.173201 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:31.173201 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:31.173201 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:31.173201 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:31.173201 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:31.173201 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:31.174441 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:31.174441 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:31.174441 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:31.174441 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:31.174441 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:31.174441 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:31.174441 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:31.174441 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:31.174441 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:31.174441 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:31.174441 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:31.174441 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:31.174441 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:31.174441 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:31.174441 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:31.174441 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:31.175246 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:31.175246 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:31.175246 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:31.175246 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:31.175246 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:31.175246 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:31.175246 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:31.175246 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:31.175246 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:31.175246 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:31.175246 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 15:22:31.175246 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:22:31.176781 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 156/312] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:22:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:22:31.182451 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41545b-c1f2-4b1f-8248-31c1b1d8d00c None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:31.220953 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:31.247978 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a5826-e0cd-458c-b79d-cbb6d0005051 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:31.292990 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d65f3-288e-4b79-88cd-1af6e6cacc98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:31.293701 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d65f3-288e-4b79-88cd-1af6e6cacc98 None admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:31.294566 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d65f3-288e-4b79-88cd-1af6e6cacc98 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:31.294844 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d65f3-288e-4b79-88cd-1af6e6cacc98 None admin] PATH_INFO: `/v3/system/users/36d9608338894a51b8441b0c53dfd09f/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:31.297061 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d65f3-288e-4b79-88cd-1af6e6cacc98 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=36d9608338894a51b8441b0c53dfd09f, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:31.299229 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d65f3-288e-4b79-88cd-1af6e6cacc98 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:31.307619 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41545b-c1f2-4b1f-8248-31c1b1d8d00c None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:31.320148 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 157/313] 10.222.0.83 () {58 vars in 1334 bytes} [Mon Aug 29 15:22:31 2022] PUT /identity/v3/system/users/36d9608338894a51b8441b0c53dfd09f/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:22:31.361692 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d29d2-4076-413a-9497-81ef4a6cf217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:31.362443 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d29d2-4076-413a-9497-81ef4a6cf217 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:31.362777 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d29d2-4076-413a-9497-81ef4a6cf217 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:31.363291 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d29d2-4076-413a-9497-81ef4a6cf217 None admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:31.364069 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d29d2-4076-413a-9497-81ef4a6cf217 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:31.364229 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d29d2-4076-413a-9497-81ef4a6cf217 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:31.365711 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d29d2-4076-413a-9497-81ef4a6cf217 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:31.377681 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 157/314] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 15:22:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:22:31.383357 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d65f3-288e-4b79-88cd-1af6e6cacc98 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:31.467474 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:31.508502 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d65f3-288e-4b79-88cd-1af6e6cacc98 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:31.549653 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d90a39-4a4d-40ec-a6c3-43b52592a3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:31.550957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d90a39-4a4d-40ec-a6c3-43b52592a3c6 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:31.551517 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d90a39-4a4d-40ec-a6c3-43b52592a3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:31.552000 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d90a39-4a4d-40ec-a6c3-43b52592a3c6 None admin] PATH_INFO: `/v3/users/04672a5a3b604967a657c4f41466ae27` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:31.553473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d90a39-4a4d-40ec-a6c3-43b52592a3c6 None admin] RBAC: Authorizing `identity:get_user(user_id=04672a5a3b604967a657c4f41466ae27)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:31.555412 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d90a39-4a4d-40ec-a6c3-43b52592a3c6 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:31.557993 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 158/315] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 15:22:31 2022] GET /identity/v3/users/04672a5a3b604967a657c4f41466ae27 => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:22:31.564311 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d29d2-4076-413a-9497-81ef4a6cf217 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:31.673360 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:31.679641 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d29d2-4076-413a-9497-81ef4a6cf217 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:31.715600 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abd6dc-7eb7-4f26-b88f-0afa312defe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:31.716713 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abd6dc-7eb7-4f26-b88f-0afa312defe4 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:31.716991 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abd6dc-7eb7-4f26-b88f-0afa312defe4 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:31.717261 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abd6dc-7eb7-4f26-b88f-0afa312defe4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:31.787312 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4abd6dc-7eb7-4f26-b88f-0afa312defe4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:31.788779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4abd6dc-7eb7-4f26-b88f-0afa312defe4 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:31.888686 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:31.896852 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 158/316] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:22:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:22:31.902397 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d90a39-4a4d-40ec-a6c3-43b52592a3c6 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:32.015985 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d90a39-4a4d-40ec-a6c3-43b52592a3c6 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:32.048151 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:32.054687 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c85867-16bf-46cf-b01e-2d975073bc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:32.055838 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c85867-16bf-46cf-b01e-2d975073bc2f None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:32.056284 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c85867-16bf-46cf-b01e-2d975073bc2f None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:32.056716 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c85867-16bf-46cf-b01e-2d975073bc2f None admin] PATH_INFO: `/v3/projects/7ebc74909fbc49f2b7065ea3550fee57` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:32.058048 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c85867-16bf-46cf-b01e-2d975073bc2f None admin] RBAC: Authorizing `identity:get_project(project_id=7ebc74909fbc49f2b7065ea3550fee57)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:32.060474 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c85867-16bf-46cf-b01e-2d975073bc2f None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:32.062753 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 159/317] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:22:31 2022] GET /identity/v3/projects/7ebc74909fbc49f2b7065ea3550fee57 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:32.068515 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abd6dc-7eb7-4f26-b88f-0afa312defe4 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:32.186763 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abd6dc-7eb7-4f26-b88f-0afa312defe4 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:32.226310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f3027-77e7-4dc8-8df8-316fce2adef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:32.227227 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f3027-77e7-4dc8-8df8-316fce2adef1 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:32.227703 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f3027-77e7-4dc8-8df8-316fce2adef1 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:32.228135 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f3027-77e7-4dc8-8df8-316fce2adef1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:32.229006 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f3027-77e7-4dc8-8df8-316fce2adef1 None admin] RBAC: Adding query filter params (role.id=7c797c10240d4c399d804718c977d567, scope.project.id=7ebc74909fbc49f2b7065ea3550fee57, user.id=04672a5a3b604967a657c4f41466ae27) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:32.229457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f3027-77e7-4dc8-8df8-316fce2adef1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:32.231148 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f3027-77e7-4dc8-8df8-316fce2adef1 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:32.238379 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 159/318] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 15:22:32 2022] GET /identity/v3/role_assignments?user.id=04672a5a3b604967a657c4f41466ae27&scope.project.id=7ebc74909fbc49f2b7065ea3550fee57&role.id=7c797c10240d4c399d804718c977d567 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:32.422077 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d815b-3b7d-48da-8ac0-11673e47d6ba None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:32.422279 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d815b-3b7d-48da-8ac0-11673e47d6ba None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:32.422558 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d815b-3b7d-48da-8ac0-11673e47d6ba None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:32.424499 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 160/319] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:32.429905 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35be14-87ff-46bc-a213-e88bc7491e53 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:32.430197 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35be14-87ff-46bc-a213-e88bc7491e53 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:32.430480 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35be14-87ff-46bc-a213-e88bc7491e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:32.451208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-4b35be14-87ff-46bc-a213-e88bc7491e53 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:32.452289 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4b35be14-87ff-46bc-a213-e88bc7491e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:32.514281 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:32.526793 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 160/320] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:22:32.800569 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d815b-3b7d-48da-8ac0-11673e47d6ba None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:32.909879 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d815b-3b7d-48da-8ac0-11673e47d6ba None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:32.946588 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff87e9-dc25-4228-9372-7e78bfd5812a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:32.947268 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff87e9-dc25-4228-9372-7e78bfd5812a None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:32.947549 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff87e9-dc25-4228-9372-7e78bfd5812a None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:32.947823 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff87e9-dc25-4228-9372-7e78bfd5812a None admin] PATH_INFO: `/v3/domains/default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:32.948925 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff87e9-dc25-4228-9372-7e78bfd5812a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:32.951271 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff87e9-dc25-4228-9372-7e78bfd5812a None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:32.953306 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 161/321] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:22:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:32.958879 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35be14-87ff-46bc-a213-e88bc7491e53 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:33.061792 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05a3f9-48f1-4216-952a-fcad9c331d00 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:33.062121 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05a3f9-48f1-4216-952a-fcad9c331d00 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:33.062344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05a3f9-48f1-4216-952a-fcad9c331d00 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:33.063724 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 162/322] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:22:33.068812 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570a4e7-8ab6-4410-85e5-4eaea89b5025 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:33.069092 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570a4e7-8ab6-4410-85e5-4eaea89b5025 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:33.069362 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570a4e7-8ab6-4410-85e5-4eaea89b5025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:33.077405 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35be14-87ff-46bc-a213-e88bc7491e53 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:33.087399 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-9570a4e7-8ab6-4410-85e5-4eaea89b5025 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:33.088584 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9570a4e7-8ab6-4410-85e5-4eaea89b5025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:33.114971 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2826801b-69ef-4f89-a290-23662ecf4079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:33.116013 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826801b-69ef-4f89-a290-23662ecf4079 None admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:33.116591 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826801b-69ef-4f89-a290-23662ecf4079 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:33.116863 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826801b-69ef-4f89-a290-23662ecf4079 None admin] PATH_INFO: `/v3/groups` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:33.117512 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2826801b-69ef-4f89-a290-23662ecf4079 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:33.119089 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2826801b-69ef-4f89-a290-23662ecf4079 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:33.135565 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 161/323] 10.222.0.83 () {60 vars in 1134 bytes} [Mon Aug 29 15:22:32 2022] POST /identity/v3/groups => generated 226 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:22:33.164393 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:33.175086 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 163/324] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 15:22:33.444614 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3f595-46d4-44a0-8578-96a5adb77d96 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:33.444972 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3f595-46d4-44a0-8578-96a5adb77d96 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:33.445147 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3f595-46d4-44a0-8578-96a5adb77d96 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:33.446613 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 162/325] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:33.447235 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570a4e7-8ab6-4410-85e5-4eaea89b5025 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:33.451891 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bb7bf-61a7-49ba-98be-fcfaf507b25f None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:33.452223 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bb7bf-61a7-49ba-98be-fcfaf507b25f None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:33.452500 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bb7bf-61a7-49ba-98be-fcfaf507b25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:33.472000 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-f79bb7bf-61a7-49ba-98be-fcfaf507b25f None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:33.473824 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f79bb7bf-61a7-49ba-98be-fcfaf507b25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:33.537068 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:33.567784 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 163/326] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 15:22:33.574349 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570a4e7-8ab6-4410-85e5-4eaea89b5025 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:33.611292 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0942d75-7afb-49e0-987f-a84699167cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:33.612073 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0942d75-7afb-49e0-987f-a84699167cd8 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:33.612445 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0942d75-7afb-49e0-987f-a84699167cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:33.612806 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0942d75-7afb-49e0-987f-a84699167cd8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:33.625352 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0942d75-7afb-49e0-987f-a84699167cd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:33.630509 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-b0942d75-7afb-49e0-987f-a84699167cd8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 15:22:33.630509 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:33.630509 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:33.630509 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:33.630509 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:33.630509 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:33.630509 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:33.630509 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:33.630509 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:33.630509 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:33.630509 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:33.630509 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:33.630509 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:33.630509 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:33.630509 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:33.630509 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:33.631421 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:33.631421 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:33.631421 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:33.631421 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:33.631421 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:33.631421 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:33.631421 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:33.631421 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:33.631421 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:33.631421 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:33.631421 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:33.631421 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:33.631421 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:33.631421 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:33.631421 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:33.631421 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:33.632200 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:33.632200 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:33.632200 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:33.632200 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:33.632200 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:33.632200 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:33.632200 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:33.632200 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:33.632200 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:33.632200 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:33.632200 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 15:22:33.632200 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:22:33.632200 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 164/327] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:22:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:22:33.639342 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bb7bf-61a7-49ba-98be-fcfaf507b25f None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:33.781888 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bb7bf-61a7-49ba-98be-fcfaf507b25f None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:33.820424 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f7c1f2-b9ea-4cb8-aec0-22c20789b6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:33.821261 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7c1f2-b9ea-4cb8-aec0-22c20789b6d7 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:33.821695 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7c1f2-b9ea-4cb8-aec0-22c20789b6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:33.822104 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7c1f2-b9ea-4cb8-aec0-22c20789b6d7 None admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:33.822891 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f7c1f2-b9ea-4cb8-aec0-22c20789b6d7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:33.823343 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f7c1f2-b9ea-4cb8-aec0-22c20789b6d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:33.827062 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f7c1f2-b9ea-4cb8-aec0-22c20789b6d7 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:33.836266 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 164/328] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 15:22:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:33.842472 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0942d75-7afb-49e0-987f-a84699167cd8 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:33.906516 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f7c1f2-b9ea-4cb8-aec0-22c20789b6d7 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:33.917178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:33.962810 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0942d75-7afb-49e0-987f-a84699167cd8 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:33.967395 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:34.007970 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df2a49-9840-43bc-9fd3-350528843741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:34.009887 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df2a49-9840-43bc-9fd3-350528843741 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:34.010372 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df2a49-9840-43bc-9fd3-350528843741 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:34.010841 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df2a49-9840-43bc-9fd3-350528843741 None admin] PATH_INFO: `/v3/users/190be9cd7dd1496db45a0cfc87732066` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:34.012768 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19df2a49-9840-43bc-9fd3-350528843741 None admin] RBAC: Authorizing `identity:get_user(user_id=190be9cd7dd1496db45a0cfc87732066)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:34.014471 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19df2a49-9840-43bc-9fd3-350528843741 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:34.017192 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 165/329] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 15:22:33 2022] GET /identity/v3/users/190be9cd7dd1496db45a0cfc87732066 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:22:34.023274 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df2a49-9840-43bc-9fd3-350528843741 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:34.047474 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f7c1f2-b9ea-4cb8-aec0-22c20789b6d7 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:34.094330 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a43cb-c2f5-4957-9fc2-b7577c07c8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:34.094958 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a43cb-c2f5-4957-9fc2-b7577c07c8d8 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:34.095259 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a43cb-c2f5-4957-9fc2-b7577c07c8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:34.095527 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a43cb-c2f5-4957-9fc2-b7577c07c8d8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:34.111685 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6a43cb-c2f5-4957-9fc2-b7577c07c8d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:34.118975 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-1c6a43cb-c2f5-4957-9fc2-b7577c07c8d8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:22:34.118975 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:34.118975 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:34.118975 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:34.118975 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:34.118975 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:34.118975 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:34.118975 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:34.118975 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:34.118975 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:34.118975 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:34.118975 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:34.118975 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:34.118975 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:34.118975 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:34.118975 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:34.119874 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:34.119874 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:34.119874 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:34.119874 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:34.119874 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:34.119874 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:34.119874 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:34.119874 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:34.119874 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:34.119874 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:34.119874 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:34.119874 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:34.119874 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:34.119874 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:34.119874 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:34.119874 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:34.120681 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:34.120681 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:34.120681 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:34.120681 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:34.120681 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:34.120681 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:34.120681 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:34.120681 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:34.120681 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:34.120681 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:34.120681 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:22:34.120681 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:22:34.123812 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 165/330] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:22:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:22:34.129498 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a43cb-c2f5-4957-9fc2-b7577c07c8d8 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:34.161768 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df2a49-9840-43bc-9fd3-350528843741 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:34.192249 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:34.203529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab8fd4d-a604-49ac-b3fa-d51de12e1a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:34.204605 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8fd4d-a604-49ac-b3fa-d51de12e1a37 None admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:34.205081 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8fd4d-a604-49ac-b3fa-d51de12e1a37 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:34.205548 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8fd4d-a604-49ac-b3fa-d51de12e1a37 None admin] PATH_INFO: `/v3/system/users/190be9cd7dd1496db45a0cfc87732066/roles/7c797c10240d4c399d804718c977d567` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:34.208147 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab8fd4d-a604-49ac-b3fa-d51de12e1a37 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=190be9cd7dd1496db45a0cfc87732066, role_id=7c797c10240d4c399d804718c977d567)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:34.209837 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab8fd4d-a604-49ac-b3fa-d51de12e1a37 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:34.223550 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 166/331] 10.222.0.83 () {58 vars in 1334 bytes} [Mon Aug 29 15:22:34 2022] PUT /identity/v3/system/users/190be9cd7dd1496db45a0cfc87732066/roles/7c797c10240d4c399d804718c977d567 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:22:34.242928 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a43cb-c2f5-4957-9fc2-b7577c07c8d8 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:34.244623 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:34.286309 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dcd42f-a95d-4cbf-b0bb-06b23877212a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:34.286924 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dcd42f-a95d-4cbf-b0bb-06b23877212a None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:34.287240 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dcd42f-a95d-4cbf-b0bb-06b23877212a None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:34.287511 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dcd42f-a95d-4cbf-b0bb-06b23877212a None admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:34.288189 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dcd42f-a95d-4cbf-b0bb-06b23877212a None admin] RBAC: Adding query filter params (name=member) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:34.288489 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dcd42f-a95d-4cbf-b0bb-06b23877212a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:34.289883 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dcd42f-a95d-4cbf-b0bb-06b23877212a None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:34.301417 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 166/332] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 15:22:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:34.307151 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab8fd4d-a604-49ac-b3fa-d51de12e1a37 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:34.445477 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab8fd4d-a604-49ac-b3fa-d51de12e1a37 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:34.492142 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b57d57-3477-41f2-8cc3-0b576f269e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:34.492780 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b57d57-3477-41f2-8cc3-0b576f269e92 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:34.493060 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b57d57-3477-41f2-8cc3-0b576f269e92 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:34.493333 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b57d57-3477-41f2-8cc3-0b576f269e92 None admin] PATH_INFO: `/v3/users/36d9608338894a51b8441b0c53dfd09f` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:34.494580 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b57d57-3477-41f2-8cc3-0b576f269e92 None admin] RBAC: Authorizing `identity:get_user(user_id=36d9608338894a51b8441b0c53dfd09f)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:34.496750 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b57d57-3477-41f2-8cc3-0b576f269e92 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:34.498987 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 167/333] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 15:22:34 2022] GET /identity/v3/users/36d9608338894a51b8441b0c53dfd09f => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:34.504978 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dcd42f-a95d-4cbf-b0bb-06b23877212a None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:34.629694 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dcd42f-a95d-4cbf-b0bb-06b23877212a None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:34.670270 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae81ea32-f697-4bc5-bedb-072997c58282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:34.670887 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81ea32-f697-4bc5-bedb-072997c58282 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:34.671223 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81ea32-f697-4bc5-bedb-072997c58282 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:34.671498 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81ea32-f697-4bc5-bedb-072997c58282 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:34.672229 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae81ea32-f697-4bc5-bedb-072997c58282 None admin] RBAC: Adding query filter params (role.id=e85047210af34e2d87f8162c8bd2005e, user.id=36d9608338894a51b8441b0c53dfd09f, scope.system=all) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:34.672537 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae81ea32-f697-4bc5-bedb-072997c58282 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:34.674334 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae81ea32-f697-4bc5-bedb-072997c58282 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:34.694637 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 167/334] 10.222.0.83 () {56 vars in 1308 bytes} [Mon Aug 29 15:22:34 2022] GET /identity/v3/role_assignments?user.id=36d9608338894a51b8441b0c53dfd09f&scope.system=all&role.id=e85047210af34e2d87f8162c8bd2005e => generated 510 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:35.717396 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17057a-e11e-4bc5-a754-5fc01534585f None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:35.717885 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17057a-e11e-4bc5-a754-5fc01534585f None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:35.718060 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17057a-e11e-4bc5-a754-5fc01534585f None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:35.719642 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 168/335] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:35.737148 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031271a-59b2-4cb0-9b4b-8453f132c26f None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:35.738057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031271a-59b2-4cb0-9b4b-8453f132c26f None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:35.738519 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031271a-59b2-4cb0-9b4b-8453f132c26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:35.768060 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-d031271a-59b2-4cb0-9b4b-8453f132c26f None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:35.769627 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d031271a-59b2-4cb0-9b4b-8453f132c26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:35.788747 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:35.853574 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 168/336] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:22:36.051687 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456c798-90b6-4625-b5bd-5721559a51c7 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:36.052020 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456c798-90b6-4625-b5bd-5721559a51c7 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:36.052212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456c798-90b6-4625-b5bd-5721559a51c7 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:36.053772 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 169/337] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:36.059347 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ce7ba-7ee6-48f3-9754-81bd2b7804be None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:36.059977 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ce7ba-7ee6-48f3-9754-81bd2b7804be None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:36.060446 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ce7ba-7ee6-48f3-9754-81bd2b7804be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:36.087566 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a50ce7ba-7ee6-48f3-9754-81bd2b7804be None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:36.089151 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a50ce7ba-7ee6-48f3-9754-81bd2b7804be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:36.164807 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f456c798-90b6-4625-b5bd-5721559a51c7 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:36.180023 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 169/338] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:22:36.258486 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:36.321069 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f456c798-90b6-4625-b5bd-5721559a51c7 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:36.364350 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028f605-37ed-483b-8d63-ac7774136751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:36.364993 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028f605-37ed-483b-8d63-ac7774136751 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:36.365271 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028f605-37ed-483b-8d63-ac7774136751 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:36.365547 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028f605-37ed-483b-8d63-ac7774136751 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:36.380736 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4028f605-37ed-483b-8d63-ac7774136751 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:36.385632 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-4028f605-37ed-483b-8d63-ac7774136751 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:22:36.385632 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:36.385632 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:36.385632 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:36.385632 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:36.385632 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:36.385632 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:36.385632 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:36.385632 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:36.385632 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:36.385632 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:36.385632 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:36.385632 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:36.385632 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:36.385632 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:36.385632 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:36.386704 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:36.386704 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:36.386704 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:36.386704 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:36.386704 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:36.386704 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:36.386704 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:36.386704 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:36.386704 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:36.386704 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:36.386704 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:36.386704 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:36.386704 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:36.386704 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:36.386704 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:36.386704 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:36.387897 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:36.387897 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:36.387897 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:36.387897 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:36.387897 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:36.387897 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:36.387897 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:36.387897 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:36.387897 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:36.387897 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:36.387897 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:22:36.387897 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:22:36.387897 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 170/339] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:22:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:22:36.393018 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ce7ba-7ee6-48f3-9754-81bd2b7804be None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:36.488833 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:36.511537 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ce7ba-7ee6-48f3-9754-81bd2b7804be None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:36.563425 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b54a0c-9dae-48e2-8288-e3eb12d275de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:36.564053 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b54a0c-9dae-48e2-8288-e3eb12d275de None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:36.564326 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b54a0c-9dae-48e2-8288-e3eb12d275de None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:36.564592 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b54a0c-9dae-48e2-8288-e3eb12d275de None admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:36.565258 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b54a0c-9dae-48e2-8288-e3eb12d275de None admin] RBAC: Adding query filter params (name=member) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:36.565556 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b54a0c-9dae-48e2-8288-e3eb12d275de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:36.566937 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b54a0c-9dae-48e2-8288-e3eb12d275de None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:36.576231 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 170/340] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 15:22:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:36.581728 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028f605-37ed-483b-8d63-ac7774136751 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:36.688046 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028f605-37ed-483b-8d63-ac7774136751 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:36.711045 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:36.733056 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f0e8c7-3e91-4f62-a531-b1f4ddca5f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:36.733663 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0e8c7-3e91-4f62-a531-b1f4ddca5f67 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:36.733985 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0e8c7-3e91-4f62-a531-b1f4ddca5f67 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:36.734326 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0e8c7-3e91-4f62-a531-b1f4ddca5f67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:36.822692 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f0e8c7-3e91-4f62-a531-b1f4ddca5f67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:36.824728 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f0e8c7-3e91-4f62-a531-b1f4ddca5f67 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:36.850991 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634e532-2bde-4786-98d7-f24f762ea4ab None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:36.851502 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634e532-2bde-4786-98d7-f24f762ea4ab None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:36.851502 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634e532-2bde-4786-98d7-f24f762ea4ab None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:36.853107 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 171/341] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:36.858003 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634e532-2bde-4786-98d7-f24f762ea4ab None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:36.960490 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 171/342] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:22:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:22:36.962101 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895586a-665a-4cb1-9304-d0bdc3ac6b2a None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:36.962387 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895586a-665a-4cb1-9304-d0bdc3ac6b2a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:36.962661 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895586a-665a-4cb1-9304-d0bdc3ac6b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:36.990062 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-a895586a-665a-4cb1-9304-d0bdc3ac6b2a None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:36.991299 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a895586a-665a-4cb1-9304-d0bdc3ac6b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:37.008799 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:37.072211 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 172/343] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:22:37.073179 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895586a-665a-4cb1-9304-d0bdc3ac6b2a None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:37.080614 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634e532-2bde-4786-98d7-f24f762ea4ab None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:37.193286 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895586a-665a-4cb1-9304-d0bdc3ac6b2a None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:37.200319 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba1216-0b84-45bb-8756-5dd213d17951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:37.200989 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba1216-0b84-45bb-8756-5dd213d17951 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:37.201263 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba1216-0b84-45bb-8756-5dd213d17951 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:37.201531 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba1216-0b84-45bb-8756-5dd213d17951 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:37.231959 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ba1216-0b84-45bb-8756-5dd213d17951 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:37.232265 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4268168-d850-4bc9-a413-01d34270e4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:37.232833 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4268168-d850-4bc9-a413-01d34270e4ff None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:37.233116 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4268168-d850-4bc9-a413-01d34270e4ff None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:37.233390 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4268168-d850-4bc9-a413-01d34270e4ff None admin] PATH_INFO: `/v3/projects/81f3af84c83d43499bc734eb2261802e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:37.234524 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4268168-d850-4bc9-a413-01d34270e4ff None admin] RBAC: Authorizing `identity:get_project(project_id=81f3af84c83d43499bc734eb2261802e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:37.236023 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4268168-d850-4bc9-a413-01d34270e4ff None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:37.237268 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-e8ba1216-0b84-45bb-8756-5dd213d17951 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 15:22:37.237268 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:37.237268 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:37.237268 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:37.237268 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:37.237268 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:37.237268 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:37.237268 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:37.237268 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:37.237268 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:37.237268 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:37.237268 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:37.237268 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:37.237268 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:37.237268 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:37.237268 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:37.238114 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:37.238114 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:37.238114 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:37.238114 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:37.238114 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:37.238114 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:37.238114 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:37.238114 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:37.238114 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:37.238114 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:37.238114 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:37.238114 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:37.238114 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:37.238114 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:37.238114 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:37.238114 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:37.238914 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:37.238914 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:37.238914 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:37.238914 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:37.238914 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:37.238914 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:37.238914 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:37.238914 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:37.238914 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:37.238914 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:37.238914 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 15:22:37.238914 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:22:37.239592 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 173/344] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:22:37 2022] GET /identity/v3/projects/81f3af84c83d43499bc734eb2261802e => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:37.239659 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 172/345] 10.222.0.83 () {56 vars in 1114 bytes} [Mon Aug 29 15:22:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:22:37.243969 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4268168-d850-4bc9-a413-01d34270e4ff None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:37.255928 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba1216-0b84-45bb-8756-5dd213d17951 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:37.267350 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:37.268258 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:37.363373 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4268168-d850-4bc9-a413-01d34270e4ff None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:37.401005 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282ca19-f16d-4a35-aa9d-06d966b5fa14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:37.402693 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282ca19-f16d-4a35-aa9d-06d966b5fa14 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:37.403116 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282ca19-f16d-4a35-aa9d-06d966b5fa14 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:37.403698 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282ca19-f16d-4a35-aa9d-06d966b5fa14 None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:37.404554 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282ca19-f16d-4a35-aa9d-06d966b5fa14 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:37.405044 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282ca19-f16d-4a35-aa9d-06d966b5fa14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:37.406743 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282ca19-f16d-4a35-aa9d-06d966b5fa14 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:37.416720 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 174/346] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:22:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:22:37.423754 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282ca19-f16d-4a35-aa9d-06d966b5fa14 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:37.521440 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:37.535039 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282ca19-f16d-4a35-aa9d-06d966b5fa14 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:37.577037 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd98e6-3b78-42ac-9a14-d010a387ec37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:37.578103 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd98e6-3b78-42ac-9a14-d010a387ec37 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:37.578485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd98e6-3b78-42ac-9a14-d010a387ec37 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:37.578822 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd98e6-3b78-42ac-9a14-d010a387ec37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:37.601162 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba1216-0b84-45bb-8756-5dd213d17951 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:37.655674 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fd98e6-3b78-42ac-9a14-d010a387ec37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:37.657168 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fd98e6-3b78-42ac-9a14-d010a387ec37 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:37.712831 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f932e-21c6-47d6-a91d-fe3c0c23832d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:37.713481 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f932e-21c6-47d6-a91d-fe3c0c23832d None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:37.713759 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f932e-21c6-47d6-a91d-fe3c0c23832d None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:37.714032 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f932e-21c6-47d6-a91d-fe3c0c23832d None admin] PATH_INFO: `/v3/groups/acffb9866dd94f5bab98e82e6a4e03ac` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:37.721458 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f932e-21c6-47d6-a91d-fe3c0c23832d None admin] RBAC: Authorizing `identity:get_group(group_id=acffb9866dd94f5bab98e82e6a4e03ac)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:37.722996 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f932e-21c6-47d6-a91d-fe3c0c23832d None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:37.725453 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 173/347] 10.222.0.83 () {56 vars in 1180 bytes} [Mon Aug 29 15:22:37 2022] GET /identity/v3/groups/acffb9866dd94f5bab98e82e6a4e03ac => generated 226 bytes in 470 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:37.726417 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f932e-21c6-47d6-a91d-fe3c0c23832d None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:37.762111 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:37.793385 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 175/348] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:22:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 15:22:37.794276 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845d84b-5075-489e-93c5-666024efc84a None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:37.794557 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845d84b-5075-489e-93c5-666024efc84a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:37.794880 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845d84b-5075-489e-93c5-666024efc84a None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:37.796384 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 176/349] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:37.797151 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845d84b-5075-489e-93c5-666024efc84a None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:37.831326 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:37.878007 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f932e-21c6-47d6-a91d-fe3c0c23832d None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:37.925864 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5919d3-0127-444e-bd86-b0eb805ae232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:37.926512 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5919d3-0127-444e-bd86-b0eb805ae232 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:37.926764 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5919d3-0127-444e-bd86-b0eb805ae232 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:37.927072 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5919d3-0127-444e-bd86-b0eb805ae232 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:37.929310 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845d84b-5075-489e-93c5-666024efc84a None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:37.938887 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5919d3-0127-444e-bd86-b0eb805ae232 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:37.945302 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-5e5919d3-0127-444e-bd86-b0eb805ae232 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:22:37.945302 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:37.945302 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:37.945302 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:37.945302 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:37.945302 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:37.945302 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:37.945302 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:37.945302 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:37.945302 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:37.945302 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:37.945302 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:37.945302 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:37.945302 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:37.945302 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:37.945302 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:37.950819 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:37.950819 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:37.950819 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:37.950819 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:37.950819 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:37.950819 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:37.950819 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:37.950819 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:37.950819 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:37.950819 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:37.950819 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:37.950819 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:37.950819 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:37.950819 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:37.950819 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:37.950819 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:37.951689 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:37.951689 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:37.951689 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:37.951689 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:37.951689 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:37.951689 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:37.951689 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:37.951689 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:37.951689 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:37.951689 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:37.951689 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:22:37.951689 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:22:37.951689 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 174/350] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:22:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:22:37.951689 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102e196-4508-447a-a6b3-bbf82e443591 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:37.952394 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102e196-4508-447a-a6b3-bbf82e443591 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:37.952394 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102e196-4508-447a-a6b3-bbf82e443591 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:37.952394 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 175/351] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:37.952394 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102e196-4508-447a-a6b3-bbf82e443591 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:37.980983 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00955f42-064b-4f6e-ae5b-a193ebcc8e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:37.981960 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00955f42-064b-4f6e-ae5b-a193ebcc8e87 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:37.982468 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00955f42-064b-4f6e-ae5b-a193ebcc8e87 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:37.982963 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00955f42-064b-4f6e-ae5b-a193ebcc8e87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:37.983967 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00955f42-064b-4f6e-ae5b-a193ebcc8e87 None admin] RBAC: Adding query filter params (group.id=acffb9866dd94f5bab98e82e6a4e03ac, role.id=e85047210af34e2d87f8162c8bd2005e, scope.project.id=81f3af84c83d43499bc734eb2261802e) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:37.984414 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00955f42-064b-4f6e-ae5b-a193ebcc8e87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:37.986258 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00955f42-064b-4f6e-ae5b-a193ebcc8e87 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:37.995071 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 177/352] 10.222.0.83 () {56 vars in 1376 bytes} [Mon Aug 29 15:22:37 2022] GET /identity/v3/role_assignments?group.id=acffb9866dd94f5bab98e82e6a4e03ac&scope.project.id=81f3af84c83d43499bc734eb2261802e&role.id=e85047210af34e2d87f8162c8bd2005e => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:37.995239 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888aea5c-6e8b-4fcd-a802-47167dfd5d38 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:37.996079 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888aea5c-6e8b-4fcd-a802-47167dfd5d38 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:37.996656 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888aea5c-6e8b-4fcd-a802-47167dfd5d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:38.017569 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-888aea5c-6e8b-4fcd-a802-47167dfd5d38 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:38.018891 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-888aea5c-6e8b-4fcd-a802-47167dfd5d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:38.067441 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:38.109409 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102e196-4508-447a-a6b3-bbf82e443591 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:38.111000 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 178/353] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:22:38.112142 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888aea5c-6e8b-4fcd-a802-47167dfd5d38 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:38.182197 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:38.194399 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f78b52-4c57-4b93-8710-12167fca4dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:38.195396 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f78b52-4c57-4b93-8710-12167fca4dde None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:38.195920 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f78b52-4c57-4b93-8710-12167fca4dde None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:38.196380 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f78b52-4c57-4b93-8710-12167fca4dde None admin] PATH_INFO: `/v3/projects/81f3af84c83d43499bc734eb2261802e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:38.198486 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f78b52-4c57-4b93-8710-12167fca4dde None admin] RBAC: Authorizing `identity:get_project(project_id=81f3af84c83d43499bc734eb2261802e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:38.200802 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f78b52-4c57-4b93-8710-12167fca4dde None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:38.202991 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 176/354] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:22:37 2022] GET /identity/v3/projects/81f3af84c83d43499bc734eb2261802e => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:38.208598 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439d4d7-562f-45e5-a24e-b8274039811d None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:38.208707 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439d4d7-562f-45e5-a24e-b8274039811d None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:38.208988 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439d4d7-562f-45e5-a24e-b8274039811d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:38.227257 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-c439d4d7-562f-45e5-a24e-b8274039811d None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:38.228500 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c439d4d7-562f-45e5-a24e-b8274039811d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:38.238938 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888aea5c-6e8b-4fcd-a802-47167dfd5d38 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:38.285189 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6c82f-59d2-4e86-a005-e9970bea0b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:38.285796 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6c82f-59d2-4e86-a005-e9970bea0b32 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:38.286076 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6c82f-59d2-4e86-a005-e9970bea0b32 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:38.286348 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6c82f-59d2-4e86-a005-e9970bea0b32 None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:38.287039 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e6c82f-59d2-4e86-a005-e9970bea0b32 None admin] RBAC: Adding query filter params (name=member) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:38.287347 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e6c82f-59d2-4e86-a005-e9970bea0b32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:38.288812 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e6c82f-59d2-4e86-a005-e9970bea0b32 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:38.303191 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 179/355] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 15:22:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:38.304299 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d46719-562b-4a35-985d-5124aa38dc2e None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:38.304648 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d46719-562b-4a35-985d-5124aa38dc2e None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:38.304867 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d46719-562b-4a35-985d-5124aa38dc2e None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:38.306067 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 180/356] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:38.306756 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d46719-562b-4a35-985d-5124aa38dc2e None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:38.320479 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 177/357] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:22:38.321689 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c439d4d7-562f-45e5-a24e-b8274039811d None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:38.349779 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:38.453460 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c439d4d7-562f-45e5-a24e-b8274039811d None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:38.468881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d46719-562b-4a35-985d-5124aa38dc2e None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:38.484877 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:38.496264 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546b5cd-c8f8-43d5-961f-b461fc4d392a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:38.496961 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546b5cd-c8f8-43d5-961f-b461fc4d392a None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:38.497264 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546b5cd-c8f8-43d5-961f-b461fc4d392a None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:38.497577 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546b5cd-c8f8-43d5-961f-b461fc4d392a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:38.529749 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec651ae-822c-4c46-9d4f-62627a4ec311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:38.530396 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec651ae-822c-4c46-9d4f-62627a4ec311 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:38.530676 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec651ae-822c-4c46-9d4f-62627a4ec311 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:38.530950 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec651ae-822c-4c46-9d4f-62627a4ec311 None admin] PATH_INFO: `/v3/groups/acffb9866dd94f5bab98e82e6a4e03ac` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:38.536516 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec651ae-822c-4c46-9d4f-62627a4ec311 None admin] RBAC: Authorizing `identity:get_group(group_id=acffb9866dd94f5bab98e82e6a4e03ac)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:38.536516 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec651ae-822c-4c46-9d4f-62627a4ec311 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:38.536516 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 181/358] 10.222.0.83 () {56 vars in 1180 bytes} [Mon Aug 29 15:22:38 2022] GET /identity/v3/groups/acffb9866dd94f5bab98e82e6a4e03ac => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:38.536516 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b60af-237c-49a0-b102-29592cb8b6eb None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:38.536860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b60af-237c-49a0-b102-29592cb8b6eb None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:38.537103 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b60af-237c-49a0-b102-29592cb8b6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:38.560133 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-b02b60af-237c-49a0-b102-29592cb8b6eb None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:38.561339 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b02b60af-237c-49a0-b102-29592cb8b6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:38.591710 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2546b5cd-c8f8-43d5-961f-b461fc4d392a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:38.593403 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2546b5cd-c8f8-43d5-961f-b461fc4d392a None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:38.638490 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 182/359] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:22:38.639206 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b60af-237c-49a0-b102-29592cb8b6eb None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:38.676444 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:38.743716 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 178/360] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:22:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:22:38.751124 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546b5cd-c8f8-43d5-961f-b461fc4d392a None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:38.772564 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b60af-237c-49a0-b102-29592cb8b6eb None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:38.792305 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:38.827995 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb89d2-7254-4e19-a635-2aff9c6651e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:38.829303 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb89d2-7254-4e19-a635-2aff9c6651e0 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:38.829788 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb89d2-7254-4e19-a635-2aff9c6651e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:38.830576 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb89d2-7254-4e19-a635-2aff9c6651e0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:38.845316 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbb89d2-7254-4e19-a635-2aff9c6651e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:38.852813 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-dbbb89d2-7254-4e19-a635-2aff9c6651e0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 15:22:38.852813 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:38.852813 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:38.852813 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:38.852813 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:38.852813 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:38.852813 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:38.852813 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:38.852813 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:38.852813 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:38.852813 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:38.852813 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:38.852813 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:38.852813 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:38.852813 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:38.852813 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:38.853684 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:38.853684 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:38.853684 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:38.853684 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:38.853684 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:38.853684 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:38.853684 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:38.853684 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:38.853684 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:38.853684 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:38.853684 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:38.853684 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:38.853684 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:38.853684 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:38.853684 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:38.853684 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:38.854479 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:38.854479 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:38.854479 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:38.854479 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:38.854479 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:38.854479 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:38.854479 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:38.854479 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:38.854479 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:38.854479 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:38.854479 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 15:22:38.854479 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:22:38.856573 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 183/361] 10.222.0.83 () {56 vars in 1114 bytes} [Mon Aug 29 15:22:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:22:38.861955 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb89d2-7254-4e19-a635-2aff9c6651e0 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:38.890135 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546b5cd-c8f8-43d5-961f-b461fc4d392a None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:38.928165 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82af56d-6091-41fc-a91e-de6d0f149078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:38.928781 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82af56d-6091-41fc-a91e-de6d0f149078 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:38.929092 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82af56d-6091-41fc-a91e-de6d0f149078 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:38.929381 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82af56d-6091-41fc-a91e-de6d0f149078 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:38.930157 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82af56d-6091-41fc-a91e-de6d0f149078 None admin] RBAC: Adding query filter params (group.id=acffb9866dd94f5bab98e82e6a4e03ac, role.id=3e8f6ab382f64437b245115f5a28f535, scope.project.id=81f3af84c83d43499bc734eb2261802e) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:38.930574 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82af56d-6091-41fc-a91e-de6d0f149078 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:38.931960 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82af56d-6091-41fc-a91e-de6d0f149078 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:38.938556 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 179/362] 10.222.0.83 () {56 vars in 1376 bytes} [Mon Aug 29 15:22:38 2022] GET /identity/v3/role_assignments?group.id=acffb9866dd94f5bab98e82e6a4e03ac&scope.project.id=81f3af84c83d43499bc734eb2261802e&role.id=3e8f6ab382f64437b245115f5a28f535 => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:38.939428 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82af56d-6091-41fc-a91e-de6d0f149078 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:38.974095 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:38.987874 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb89d2-7254-4e19-a635-2aff9c6651e0 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:39.034371 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531979f5-5b6b-443f-b90d-250c3b64c4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:39.035322 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531979f5-5b6b-443f-b90d-250c3b64c4de None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:39.035772 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531979f5-5b6b-443f-b90d-250c3b64c4de None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:39.036189 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531979f5-5b6b-443f-b90d-250c3b64c4de None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:39.051936 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531979f5-5b6b-443f-b90d-250c3b64c4de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:39.059455 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-531979f5-5b6b-443f-b90d-250c3b64c4de None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 15:22:39.059455 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:39.059455 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:39.059455 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:39.059455 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:39.059455 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:39.059455 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:39.059455 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:39.059455 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:39.059455 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:39.059455 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:39.059455 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:39.059455 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:39.059455 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:39.059455 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:39.059455 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:39.060413 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:39.060413 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:39.060413 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:39.060413 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:39.060413 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:39.060413 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:39.060413 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:39.060413 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:39.060413 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:39.060413 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:39.060413 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:39.060413 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:39.060413 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:39.060413 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:39.060413 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:39.060413 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:39.061223 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:39.061223 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:39.061223 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:39.061223 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:39.061223 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:39.061223 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:39.061223 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:39.061223 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:39.061223 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:39.061223 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:39.061223 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 15:22:39.061223 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:22:39.063670 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 184/363] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:22:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:22:39.063670 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531979f5-5b6b-443f-b90d-250c3b64c4de None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:39.071104 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:39.088741 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82af56d-6091-41fc-a91e-de6d0f149078 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:39.139083 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ced758-1c7e-4832-b7ee-002b0a2a84a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:39.139648 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ced758-1c7e-4832-b7ee-002b0a2a84a3 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:39.139930 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ced758-1c7e-4832-b7ee-002b0a2a84a3 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:39.140205 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ced758-1c7e-4832-b7ee-002b0a2a84a3 None admin] PATH_INFO: `/v3/projects/7ebc74909fbc49f2b7065ea3550fee57` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:39.141357 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ced758-1c7e-4832-b7ee-002b0a2a84a3 None admin] RBAC: Authorizing `identity:get_project(project_id=7ebc74909fbc49f2b7065ea3550fee57)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:39.142908 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ced758-1c7e-4832-b7ee-002b0a2a84a3 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:39.144718 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 180/364] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:22:38 2022] GET /identity/v3/projects/7ebc74909fbc49f2b7065ea3550fee57 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:39.150995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ced758-1c7e-4832-b7ee-002b0a2a84a3 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:39.219694 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531979f5-5b6b-443f-b90d-250c3b64c4de None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:39.267489 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23a1e7-62e0-4b8d-b854-78037f255a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:39.268506 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23a1e7-62e0-4b8d-b854-78037f255a5b None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:39.268994 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23a1e7-62e0-4b8d-b854-78037f255a5b None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:39.269463 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23a1e7-62e0-4b8d-b854-78037f255a5b None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:39.270944 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b23a1e7-62e0-4b8d-b854-78037f255a5b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:39.271488 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b23a1e7-62e0-4b8d-b854-78037f255a5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:39.273670 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b23a1e7-62e0-4b8d-b854-78037f255a5b None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:39.285159 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ced758-1c7e-4832-b7ee-002b0a2a84a3 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:39.287041 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 185/365] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:22:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:39.289197 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23a1e7-62e0-4b8d-b854-78037f255a5b None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:39.311531 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:39.333172 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a3cb8-8dce-4c29-8e9f-62d78d631af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:39.333172 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a3cb8-8dce-4c29-8e9f-62d78d631af9 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:39.333172 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a3cb8-8dce-4c29-8e9f-62d78d631af9 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:39.333172 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a3cb8-8dce-4c29-8e9f-62d78d631af9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:39.346100 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a3cb8-8dce-4c29-8e9f-62d78d631af9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:39.351894 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-194a3cb8-8dce-4c29-8e9f-62d78d631af9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:22:39.351894 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:39.351894 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:39.351894 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:39.351894 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:39.351894 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:39.351894 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:39.351894 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:39.351894 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:39.351894 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:39.351894 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:39.351894 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:39.351894 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:39.351894 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:39.351894 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:39.351894 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:39.352766 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:39.352766 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:39.352766 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:39.352766 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:39.352766 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:39.352766 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:39.352766 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:39.352766 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:39.352766 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:39.352766 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:39.352766 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:39.352766 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:39.352766 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:39.352766 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:39.352766 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:39.352766 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:39.353550 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:39.353550 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:39.353550 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:39.353550 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:39.353550 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:39.353550 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:39.353550 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:39.353550 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:39.353550 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:39.353550 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:39.353550 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:22:39.353550 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:22:39.353550 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 181/366] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 15:22:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:22:39.354193 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a3cb8-8dce-4c29-8e9f-62d78d631af9 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:39.380364 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:39.432318 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23a1e7-62e0-4b8d-b854-78037f255a5b None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:39.475550 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a590c86-8088-4b97-a6f4-ac5359188527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:39.476195 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a590c86-8088-4b97-a6f4-ac5359188527 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:39.476472 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a590c86-8088-4b97-a6f4-ac5359188527 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:39.476745 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a590c86-8088-4b97-a6f4-ac5359188527 None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:39.477514 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a590c86-8088-4b97-a6f4-ac5359188527 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:39.477821 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a590c86-8088-4b97-a6f4-ac5359188527 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:39.479348 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a590c86-8088-4b97-a6f4-ac5359188527 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:39.491298 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 186/367] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 15:22:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:39.492672 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a590c86-8088-4b97-a6f4-ac5359188527 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:39.505222 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a3cb8-8dce-4c29-8e9f-62d78d631af9 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:39.546292 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a2bd5-44ad-4af8-aff3-61ce7751b1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:39.548211 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a2bd5-44ad-4af8-aff3-61ce7751b1f7 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:39.548497 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a2bd5-44ad-4af8-aff3-61ce7751b1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:39.548794 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a2bd5-44ad-4af8-aff3-61ce7751b1f7 None admin] PATH_INFO: `/v3/groups/acffb9866dd94f5bab98e82e6a4e03ac` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:39.549922 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a2bd5-44ad-4af8-aff3-61ce7751b1f7 None admin] RBAC: Authorizing `identity:get_group(group_id=acffb9866dd94f5bab98e82e6a4e03ac)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:39.551413 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a2bd5-44ad-4af8-aff3-61ce7751b1f7 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:39.552985 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 182/368] 10.222.0.83 () {56 vars in 1180 bytes} [Mon Aug 29 15:22:39 2022] GET /identity/v3/groups/acffb9866dd94f5bab98e82e6a4e03ac => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:39.553730 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a2bd5-44ad-4af8-aff3-61ce7751b1f7 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:39.618114 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:39.651462 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a590c86-8088-4b97-a6f4-ac5359188527 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:39.663531 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:39.686343 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a2bd5-44ad-4af8-aff3-61ce7751b1f7 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:39.694291 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e8e8d-027d-4e1b-9a81-6226b03a4548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:39.694907 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e8e8d-027d-4e1b-9a81-6226b03a4548 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:39.695229 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e8e8d-027d-4e1b-9a81-6226b03a4548 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:39.695486 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e8e8d-027d-4e1b-9a81-6226b03a4548 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:39.732814 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef913f30-0a18-4270-b336-d0c016a4f4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:39.733436 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef913f30-0a18-4270-b336-d0c016a4f4a0 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:39.733966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef913f30-0a18-4270-b336-d0c016a4f4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:39.734241 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef913f30-0a18-4270-b336-d0c016a4f4a0 None admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:39.736113 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef913f30-0a18-4270-b336-d0c016a4f4a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:39.736428 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef913f30-0a18-4270-b336-d0c016a4f4a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:39.738635 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef913f30-0a18-4270-b336-d0c016a4f4a0 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:39.753846 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 183/369] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:22:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:39.754711 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef913f30-0a18-4270-b336-d0c016a4f4a0 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:39.799579 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e8e8d-027d-4e1b-9a81-6226b03a4548 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:39.801056 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e8e8d-027d-4e1b-9a81-6226b03a4548 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:39.874967 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef913f30-0a18-4270-b336-d0c016a4f4a0 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:39.889777 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:39.919624 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 187/370] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:22:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:22:39.920850 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e8e8d-027d-4e1b-9a81-6226b03a4548 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:39.922026 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d92cad6-0daa-45a1-b973-2fcd2ea98505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:39.922926 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92cad6-0daa-45a1-b973-2fcd2ea98505 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:39.923245 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92cad6-0daa-45a1-b973-2fcd2ea98505 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:39.923518 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92cad6-0daa-45a1-b973-2fcd2ea98505 None admin] PATH_INFO: `/v3/users/190be9cd7dd1496db45a0cfc87732066` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:39.924915 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d92cad6-0daa-45a1-b973-2fcd2ea98505 None admin] RBAC: Authorizing `identity:get_user(user_id=190be9cd7dd1496db45a0cfc87732066)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:39.926605 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d92cad6-0daa-45a1-b973-2fcd2ea98505 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:39.928255 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 184/371] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 15:22:39 2022] GET /identity/v3/users/190be9cd7dd1496db45a0cfc87732066 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:39.932369 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d92cad6-0daa-45a1-b973-2fcd2ea98505 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:39.955321 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:40.035810 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e8e8d-027d-4e1b-9a81-6226b03a4548 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:40.052654 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d92cad6-0daa-45a1-b973-2fcd2ea98505 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:40.074232 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9971c-6751-4b42-bef3-4aab63841272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:40.075418 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9971c-6751-4b42-bef3-4aab63841272 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:40.075910 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9971c-6751-4b42-bef3-4aab63841272 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:40.076375 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9971c-6751-4b42-bef3-4aab63841272 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:40.077272 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb9971c-6751-4b42-bef3-4aab63841272 None admin] RBAC: Adding query filter params (group.id=acffb9866dd94f5bab98e82e6a4e03ac, role.id=e85047210af34e2d87f8162c8bd2005e, scope.project.id=7ebc74909fbc49f2b7065ea3550fee57) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:40.077734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb9971c-6751-4b42-bef3-4aab63841272 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:40.079467 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb9971c-6751-4b42-bef3-4aab63841272 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:40.086174 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 188/372] 10.222.0.83 () {56 vars in 1376 bytes} [Mon Aug 29 15:22:39 2022] GET /identity/v3/role_assignments?group.id=acffb9866dd94f5bab98e82e6a4e03ac&scope.project.id=7ebc74909fbc49f2b7065ea3550fee57&role.id=e85047210af34e2d87f8162c8bd2005e => generated 260 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:40.087217 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9971c-6751-4b42-bef3-4aab63841272 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:40.091445 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb0fdb-248d-4dc3-b3ae-ca8338cff3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:40.092086 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb0fdb-248d-4dc3-b3ae-ca8338cff3ec None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:40.092383 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb0fdb-248d-4dc3-b3ae-ca8338cff3ec None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:40.093491 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb0fdb-248d-4dc3-b3ae-ca8338cff3ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:40.139282 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:40.175523 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cb0fdb-248d-4dc3-b3ae-ca8338cff3ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:40.176346 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cb0fdb-248d-4dc3-b3ae-ca8338cff3ec None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:40.196771 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:40.213496 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9971c-6751-4b42-bef3-4aab63841272 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:40.258556 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e981e3-496f-4518-87d9-cfa0091f046d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:40.259498 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e981e3-496f-4518-87d9-cfa0091f046d None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:40.259943 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e981e3-496f-4518-87d9-cfa0091f046d None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:40.260358 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e981e3-496f-4518-87d9-cfa0091f046d None admin] PATH_INFO: `/v3/projects/7ebc74909fbc49f2b7065ea3550fee57` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:40.262557 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e981e3-496f-4518-87d9-cfa0091f046d None admin] RBAC: Authorizing `identity:get_project(project_id=7ebc74909fbc49f2b7065ea3550fee57)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:40.264255 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e981e3-496f-4518-87d9-cfa0091f046d None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:40.266203 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 189/373] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:22:40 2022] GET /identity/v3/projects/7ebc74909fbc49f2b7065ea3550fee57 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:40.267264 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e981e3-496f-4518-87d9-cfa0091f046d None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:40.301565 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 185/374] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:22:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:22:40.301565 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb0fdb-248d-4dc3-b3ae-ca8338cff3ec None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:40.394242 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e981e3-496f-4518-87d9-cfa0091f046d None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:40.404923 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:40.416981 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb0fdb-248d-4dc3-b3ae-ca8338cff3ec None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:40.435402 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b6178-c33f-4084-87da-5df92d897189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:40.436022 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b6178-c33f-4084-87da-5df92d897189 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:40.436355 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b6178-c33f-4084-87da-5df92d897189 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:40.436915 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:40.437031 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b6178-c33f-4084-87da-5df92d897189 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:40.438218 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b6178-c33f-4084-87da-5df92d897189 None admin] RBAC: Adding query filter params (role.id=7c797c10240d4c399d804718c977d567, user.id=190be9cd7dd1496db45a0cfc87732066, scope.system=all) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:40.438717 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b6178-c33f-4084-87da-5df92d897189 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:40.440553 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b6178-c33f-4084-87da-5df92d897189 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:40.460331 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 190/375] 10.222.0.83 () {56 vars in 1308 bytes} [Mon Aug 29 15:22:40 2022] GET /identity/v3/role_assignments?user.id=190be9cd7dd1496db45a0cfc87732066&scope.system=all&role.id=7c797c10240d4c399d804718c977d567 => generated 510 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:40.464928 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b6178-c33f-4084-87da-5df92d897189 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:40.469990 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce2457-cc50-46d7-a2d8-1a471fd35916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:40.470829 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce2457-cc50-46d7-a2d8-1a471fd35916 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:40.475425 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce2457-cc50-46d7-a2d8-1a471fd35916 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:40.475922 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce2457-cc50-46d7-a2d8-1a471fd35916 None admin] PATH_INFO: `/v3/groups/acffb9866dd94f5bab98e82e6a4e03ac` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:40.478166 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ce2457-cc50-46d7-a2d8-1a471fd35916 None admin] RBAC: Authorizing `identity:get_group(group_id=acffb9866dd94f5bab98e82e6a4e03ac)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:40.480356 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ce2457-cc50-46d7-a2d8-1a471fd35916 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:40.489519 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 186/376] 10.222.0.83 () {56 vars in 1180 bytes} [Mon Aug 29 15:22:40 2022] GET /identity/v3/groups/acffb9866dd94f5bab98e82e6a4e03ac => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:40.490740 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce2457-cc50-46d7-a2d8-1a471fd35916 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:40.610628 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce2457-cc50-46d7-a2d8-1a471fd35916 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:40.651452 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa01dde-9195-407e-8d49-e534b8779817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:40.652422 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa01dde-9195-407e-8d49-e534b8779817 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:40.652842 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa01dde-9195-407e-8d49-e534b8779817 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:40.653251 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa01dde-9195-407e-8d49-e534b8779817 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:40.654150 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa01dde-9195-407e-8d49-e534b8779817 None admin] RBAC: Adding query filter params (group.id=acffb9866dd94f5bab98e82e6a4e03ac, role.id=3e8f6ab382f64437b245115f5a28f535, scope.project.id=7ebc74909fbc49f2b7065ea3550fee57) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:40.654614 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa01dde-9195-407e-8d49-e534b8779817 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:40.656315 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa01dde-9195-407e-8d49-e534b8779817 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:40.662733 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 187/377] 10.222.0.83 () {56 vars in 1376 bytes} [Mon Aug 29 15:22:40 2022] GET /identity/v3/role_assignments?group.id=acffb9866dd94f5bab98e82e6a4e03ac&scope.project.id=7ebc74909fbc49f2b7065ea3550fee57&role.id=3e8f6ab382f64437b245115f5a28f535 => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:40.664454 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135f33a-73bd-4225-b19b-34e6f83670b3 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:40.664933 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135f33a-73bd-4225-b19b-34e6f83670b3 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:40.665415 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135f33a-73bd-4225-b19b-34e6f83670b3 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:40.667608 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 188/378] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:40.674756 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c75efe-7972-4be2-8388-b04c239f50dc None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:40.675399 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c75efe-7972-4be2-8388-b04c239f50dc None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:40.675870 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c75efe-7972-4be2-8388-b04c239f50dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:40.710332 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b6178-c33f-4084-87da-5df92d897189 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:40.716457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-d1c75efe-7972-4be2-8388-b04c239f50dc None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:40.721697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d1c75efe-7972-4be2-8388-b04c239f50dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:40.784093 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:40.785323 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8456118d-f7f5-410a-a19e-dd62b1abf0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:40.785957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456118d-f7f5-410a-a19e-dd62b1abf0bb None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:40.786233 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456118d-f7f5-410a-a19e-dd62b1abf0bb None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:40.786501 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456118d-f7f5-410a-a19e-dd62b1abf0bb None admin] PATH_INFO: `/v3/projects/2be1d9508c364610be9aca20e58e1d6a` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:40.792533 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8456118d-f7f5-410a-a19e-dd62b1abf0bb None admin] RBAC: Authorizing `identity:get_project(project_id=2be1d9508c364610be9aca20e58e1d6a)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:40.794136 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8456118d-f7f5-410a-a19e-dd62b1abf0bb None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:40.796232 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 191/379] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:22:40 2022] GET /identity/v3/projects/2be1d9508c364610be9aca20e58e1d6a => generated 344 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:40.802381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8456118d-f7f5-410a-a19e-dd62b1abf0bb None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:40.811531 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 189/380] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 15:22:40.876565 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:40.969875 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8456118d-f7f5-410a-a19e-dd62b1abf0bb None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:41.008730 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba091f-475b-4969-a53c-3acbec8ab9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:41.009599 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba091f-475b-4969-a53c-3acbec8ab9a4 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:41.010019 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba091f-475b-4969-a53c-3acbec8ab9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:41.010459 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba091f-475b-4969-a53c-3acbec8ab9a4 None admin] PATH_INFO: `/v3/groups/ccbf4526c7874a938f1f0565364b7f3f` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:41.018188 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba091f-475b-4969-a53c-3acbec8ab9a4 None admin] RBAC: Authorizing `identity:get_group(group_id=ccbf4526c7874a938f1f0565364b7f3f)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:41.019941 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba091f-475b-4969-a53c-3acbec8ab9a4 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:41.022035 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 192/381] 10.222.0.83 () {56 vars in 1180 bytes} [Mon Aug 29 15:22:40 2022] GET /identity/v3/groups/ccbf4526c7874a938f1f0565364b7f3f => generated 229 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:22:41.028786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c75efe-7972-4be2-8388-b04c239f50dc None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:41.165068 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c75efe-7972-4be2-8388-b04c239f50dc None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:41.176450 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba091f-475b-4969-a53c-3acbec8ab9a4 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:41.229319 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495bfe00-af4e-4e98-9652-2e9cf7968215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:41.230281 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495bfe00-af4e-4e98-9652-2e9cf7968215 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:41.230583 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495bfe00-af4e-4e98-9652-2e9cf7968215 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:41.230861 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495bfe00-af4e-4e98-9652-2e9cf7968215 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:41.231639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495bfe00-af4e-4e98-9652-2e9cf7968215 None admin] RBAC: Adding query filter params (group.id=ccbf4526c7874a938f1f0565364b7f3f, role.id=4bb2bbb7bb544610877949fc933504d2, scope.project.id=2be1d9508c364610be9aca20e58e1d6a) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:41.231951 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495bfe00-af4e-4e98-9652-2e9cf7968215 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:41.233426 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495bfe00-af4e-4e98-9652-2e9cf7968215 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:41.243478 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 190/382] 10.222.0.83 () {56 vars in 1376 bytes} [Mon Aug 29 15:22:41 2022] GET /identity/v3/role_assignments?group.id=ccbf4526c7874a938f1f0565364b7f3f&scope.project.id=2be1d9508c364610be9aca20e58e1d6a&role.id=4bb2bbb7bb544610877949fc933504d2 => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:41.334971 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:41.339801 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba091f-475b-4969-a53c-3acbec8ab9a4 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:41.387998 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07253017-5036-41a5-884e-dbfc97927973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:41.388904 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07253017-5036-41a5-884e-dbfc97927973 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:41.389333 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07253017-5036-41a5-884e-dbfc97927973 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:41.389752 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07253017-5036-41a5-884e-dbfc97927973 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:41.402854 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07253017-5036-41a5-884e-dbfc97927973 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:41.408668 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-07253017-5036-41a5-884e-dbfc97927973 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:22:41.408668 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:41.408668 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:41.408668 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:41.408668 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:41.408668 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:41.408668 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:41.408668 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:41.408668 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:41.408668 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:41.408668 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:41.408668 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:41.408668 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:41.408668 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:41.408668 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:41.408668 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:41.409747 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:41.409747 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:41.409747 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:41.409747 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:41.409747 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:41.409747 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:41.409747 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:41.409747 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:41.409747 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:41.409747 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:41.409747 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:41.409747 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:41.409747 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:41.409747 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:41.409747 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:41.409747 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:41.410671 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:41.410671 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:41.410671 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:41.410671 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:41.410671 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:41.410671 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:41.410671 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:41.410671 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:41.410671 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:41.410671 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:41.410671 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:22:41.410671 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:22:41.413073 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 193/383] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:22:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:22:41.420167 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495bfe00-af4e-4e98-9652-2e9cf7968215 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:41.458773 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba63a6-91d0-46eb-bcba-50d7d65e847c None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:41.459301 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba63a6-91d0-46eb-bcba-50d7d65e847c None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:41.459719 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba63a6-91d0-46eb-bcba-50d7d65e847c None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:41.461540 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 194/384] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:41.469321 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e112f-1e07-49f9-a2ef-0cb3018866ee None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:41.470426 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e112f-1e07-49f9-a2ef-0cb3018866ee None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:41.471043 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e112f-1e07-49f9-a2ef-0cb3018866ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:41.497633 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-e43e112f-1e07-49f9-a2ef-0cb3018866ee None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:41.499169 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:41.500313 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e43e112f-1e07-49f9-a2ef-0cb3018866ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:41.622193 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495bfe00-af4e-4e98-9652-2e9cf7968215 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:41.627576 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 195/385] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 15:22:41.663333 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d694d3-fad4-493d-b71a-fce15b830e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:41.664326 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d694d3-fad4-493d-b71a-fce15b830e66 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:41.664786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d694d3-fad4-493d-b71a-fce15b830e66 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:41.665227 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d694d3-fad4-493d-b71a-fce15b830e66 None admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:41.666059 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d694d3-fad4-493d-b71a-fce15b830e66 None admin] RBAC: Adding query filter params (name=member) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:41.667107 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d694d3-fad4-493d-b71a-fce15b830e66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:41.668893 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d694d3-fad4-493d-b71a-fce15b830e66 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:41.678415 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 191/386] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 15:22:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:41.684291 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e112f-1e07-49f9-a2ef-0cb3018866ee None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:41.785102 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:41.800553 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e112f-1e07-49f9-a2ef-0cb3018866ee None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:41.840957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bbd6e8-bc35-4668-a1ac-2ef343414282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:41.842345 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bbd6e8-bc35-4668-a1ac-2ef343414282 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:41.842782 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bbd6e8-bc35-4668-a1ac-2ef343414282 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:41.843268 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bbd6e8-bc35-4668-a1ac-2ef343414282 None admin] PATH_INFO: `/v3/groups/acffb9866dd94f5bab98e82e6a4e03ac` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:41.844631 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bbd6e8-bc35-4668-a1ac-2ef343414282 None admin] RBAC: Authorizing `identity:get_group(group_id=acffb9866dd94f5bab98e82e6a4e03ac)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:41.846324 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bbd6e8-bc35-4668-a1ac-2ef343414282 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:41.848672 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 196/387] 10.222.0.83 () {56 vars in 1180 bytes} [Mon Aug 29 15:22:41 2022] GET /identity/v3/groups/acffb9866dd94f5bab98e82e6a4e03ac => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:41.856344 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d694d3-fad4-493d-b71a-fce15b830e66 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:41.970149 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d694d3-fad4-493d-b71a-fce15b830e66 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:41.973400 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:42.006680 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcce26d-6139-400c-b6e9-89f3a04a7424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:42.007691 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcce26d-6139-400c-b6e9-89f3a04a7424 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:42.008136 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcce26d-6139-400c-b6e9-89f3a04a7424 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:42.008572 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcce26d-6139-400c-b6e9-89f3a04a7424 None admin] PATH_INFO: `/v3/projects/81f3af84c83d43499bc734eb2261802e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:42.009918 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcce26d-6139-400c-b6e9-89f3a04a7424 None admin] RBAC: Authorizing `identity:get_project(project_id=81f3af84c83d43499bc734eb2261802e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:42.012471 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcce26d-6139-400c-b6e9-89f3a04a7424 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:42.014647 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 192/388] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:22:41 2022] GET /identity/v3/projects/81f3af84c83d43499bc734eb2261802e => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:42.020056 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bbd6e8-bc35-4668-a1ac-2ef343414282 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:42.067724 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcce26d-6139-400c-b6e9-89f3a04a7424 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:42.151738 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bbd6e8-bc35-4668-a1ac-2ef343414282 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:42.198631 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208e6e0-3505-44ec-b3df-cd34a633dae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:42.200346 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208e6e0-3505-44ec-b3df-cd34a633dae5 None admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:42.201171 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208e6e0-3505-44ec-b3df-cd34a633dae5 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:42.201821 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208e6e0-3505-44ec-b3df-cd34a633dae5 None admin] PATH_INFO: `/v3/projects/81f3af84c83d43499bc734eb2261802e/groups/acffb9866dd94f5bab98e82e6a4e03ac/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:42.204247 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e208e6e0-3505-44ec-b3df-cd34a633dae5 None admin] RBAC: Authorizing `identity:create_grant(project_id=81f3af84c83d43499bc734eb2261802e, group_id=acffb9866dd94f5bab98e82e6a4e03ac, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:42.206927 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e208e6e0-3505-44ec-b3df-cd34a633dae5 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:42.223173 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 197/389] 10.222.0.83 () {58 vars in 1442 bytes} [Mon Aug 29 15:22:42 2022] PUT /identity/v3/projects/81f3af84c83d43499bc734eb2261802e/groups/acffb9866dd94f5bab98e82e6a4e03ac/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:22:42.299833 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcce26d-6139-400c-b6e9-89f3a04a7424 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:42.357492 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41351df-6290-4617-a71a-f2a8954e7201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:42.358047 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41351df-6290-4617-a71a-f2a8954e7201 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:42.358331 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41351df-6290-4617-a71a-f2a8954e7201 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:42.358604 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41351df-6290-4617-a71a-f2a8954e7201 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:42.375178 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41351df-6290-4617-a71a-f2a8954e7201 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:42.380051 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-c41351df-6290-4617-a71a-f2a8954e7201 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 15:22:42.380051 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:42.380051 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:42.380051 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:42.380051 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:42.380051 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:42.380051 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:42.380051 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:42.380051 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:42.380051 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:42.380051 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:42.380051 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:42.380051 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:42.380051 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:42.380051 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:42.380051 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:42.380958 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:42.380958 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:42.380958 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:42.380958 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:42.380958 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:42.380958 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:42.380958 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:42.380958 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:42.380958 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:42.380958 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:42.380958 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:42.380958 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:42.380958 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:42.380958 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:42.380958 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:42.380958 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:42.381765 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:42.381765 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:42.381765 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:42.381765 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:42.381765 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:42.381765 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:42.381765 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:42.381765 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:42.381765 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:42.381765 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:42.381765 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 15:22:42.381765 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:22:42.381765 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 193/390] 10.222.0.83 () {56 vars in 1114 bytes} [Mon Aug 29 15:22:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:22:42.388653 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208e6e0-3505-44ec-b3df-cd34a633dae5 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:42.429061 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:42.535069 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208e6e0-3505-44ec-b3df-cd34a633dae5 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:42.577338 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a33db-26a7-4ae4-8364-f51ac5ea8f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:42.578335 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a33db-26a7-4ae4-8364-f51ac5ea8f87 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:42.578810 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a33db-26a7-4ae4-8364-f51ac5ea8f87 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:42.579312 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a33db-26a7-4ae4-8364-f51ac5ea8f87 None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:42.580186 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a33db-26a7-4ae4-8364-f51ac5ea8f87 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:42.580684 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a33db-26a7-4ae4-8364-f51ac5ea8f87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:42.582320 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a33db-26a7-4ae4-8364-f51ac5ea8f87 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:42.593836 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 198/391] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:22:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:42.599784 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41351df-6290-4617-a71a-f2a8954e7201 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:42.642433 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:42.756532 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41351df-6290-4617-a71a-f2a8954e7201 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:42.799785 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2241e-c544-483c-869e-20542103e4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:42.800476 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2241e-c544-483c-869e-20542103e4be None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:42.800757 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2241e-c544-483c-869e-20542103e4be None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:42.801025 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2241e-c544-483c-869e-20542103e4be None admin] PATH_INFO: `/v3/groups/acffb9866dd94f5bab98e82e6a4e03ac` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:42.807914 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab2241e-c544-483c-869e-20542103e4be None admin] RBAC: Authorizing `identity:get_group(group_id=acffb9866dd94f5bab98e82e6a4e03ac)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:42.809372 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab2241e-c544-483c-869e-20542103e4be None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:42.811409 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 194/392] 10.222.0.83 () {56 vars in 1180 bytes} [Mon Aug 29 15:22:42 2022] GET /identity/v3/groups/acffb9866dd94f5bab98e82e6a4e03ac => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:42.817359 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a33db-26a7-4ae4-8364-f51ac5ea8f87 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:42.939917 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:42.970899 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a33db-26a7-4ae4-8364-f51ac5ea8f87 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:43.021260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453f4b2-141a-4e53-b23c-ad93519bca48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:43.022009 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453f4b2-141a-4e53-b23c-ad93519bca48 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:43.022188 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453f4b2-141a-4e53-b23c-ad93519bca48 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:43.022463 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453f4b2-141a-4e53-b23c-ad93519bca48 None admin] PATH_INFO: `/v3/projects/81f3af84c83d43499bc734eb2261802e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:43.027788 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0453f4b2-141a-4e53-b23c-ad93519bca48 None admin] RBAC: Authorizing `identity:get_project(project_id=81f3af84c83d43499bc734eb2261802e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:43.029280 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0453f4b2-141a-4e53-b23c-ad93519bca48 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:43.031193 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 199/393] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:22:42 2022] GET /identity/v3/projects/81f3af84c83d43499bc734eb2261802e => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:43.036784 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2241e-c544-483c-869e-20542103e4be None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:43.096046 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b288c-5474-45c6-a737-10311c90d3b2 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:43.096383 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b288c-5474-45c6-a737-10311c90d3b2 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:43.096603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b288c-5474-45c6-a737-10311c90d3b2 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:43.098242 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 200/394] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:22:43.103453 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0add5-d83e-4391-88ae-971dc7c3b899 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:43.103796 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0add5-d83e-4391-88ae-971dc7c3b899 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:43.104079 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0add5-d83e-4391-88ae-971dc7c3b899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:43.137416 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-41f0add5-d83e-4391-88ae-971dc7c3b899 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:43.139982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-41f0add5-d83e-4391-88ae-971dc7c3b899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:43.213332 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:43.218576 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2241e-c544-483c-869e-20542103e4be None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:43.276968 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9930e5c8-fbe9-481f-be6e-ae78e6d0502f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:43.278328 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930e5c8-fbe9-481f-be6e-ae78e6d0502f None admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:43.279533 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 201/395] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 15:22:43.279993 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930e5c8-fbe9-481f-be6e-ae78e6d0502f None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:43.280446 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930e5c8-fbe9-481f-be6e-ae78e6d0502f None admin] PATH_INFO: `/v3/projects/81f3af84c83d43499bc734eb2261802e/groups/acffb9866dd94f5bab98e82e6a4e03ac/roles/3e8f6ab382f64437b245115f5a28f535` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:43.283051 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9930e5c8-fbe9-481f-be6e-ae78e6d0502f None admin] RBAC: Authorizing `identity:create_grant(project_id=81f3af84c83d43499bc734eb2261802e, group_id=acffb9866dd94f5bab98e82e6a4e03ac, role_id=3e8f6ab382f64437b245115f5a28f535)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:43.284712 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9930e5c8-fbe9-481f-be6e-ae78e6d0502f None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:43.300059 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 195/396] 10.222.0.83 () {58 vars in 1442 bytes} [Mon Aug 29 15:22:43 2022] PUT /identity/v3/projects/81f3af84c83d43499bc734eb2261802e/groups/acffb9866dd94f5bab98e82e6a4e03ac/roles/3e8f6ab382f64437b245115f5a28f535 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:22:43.456980 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c6beb-e240-4b32-b8d9-c27265786cde None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:43.457691 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c6beb-e240-4b32-b8d9-c27265786cde None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:43.458212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c6beb-e240-4b32-b8d9-c27265786cde None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:43.459820 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 202/397] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:43.467671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248bc56e-296d-41d3-b2f1-e5e33e4316a0 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:43.468218 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248bc56e-296d-41d3-b2f1-e5e33e4316a0 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:43.468716 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248bc56e-296d-41d3-b2f1-e5e33e4316a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:43.489922 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-248bc56e-296d-41d3-b2f1-e5e33e4316a0 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:43.491477 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-248bc56e-296d-41d3-b2f1-e5e33e4316a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:43.571614 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 196/398] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:22:43.731685 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946d14d-3bf1-42f1-a0f5-282fd5abc4d7 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:43.731978 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946d14d-3bf1-42f1-a0f5-282fd5abc4d7 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:43.732145 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946d14d-3bf1-42f1-a0f5-282fd5abc4d7 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:43.733793 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 203/399] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:43.742071 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9e9e6-bf51-439f-82a3-228f13f94d82 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:43.742071 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9e9e6-bf51-439f-82a3-228f13f94d82 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:43.742071 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9e9e6-bf51-439f-82a3-228f13f94d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:43.758071 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946d14d-3bf1-42f1-a0f5-282fd5abc4d7 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:43.771645 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-abe9e9e6-bf51-439f-82a3-228f13f94d82 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:43.772838 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-abe9e9e6-bf51-439f-82a3-228f13f94d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:43.898083 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 197/400] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:22:43.904509 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:43.937366 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946d14d-3bf1-42f1-a0f5-282fd5abc4d7 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:43.945041 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe9e9e6-bf51-439f-82a3-228f13f94d82 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:43.985532 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:43.995827 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff5d3b-d4e1-44d9-98a4-d8c256861afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:43.996482 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff5d3b-d4e1-44d9-98a4-d8c256861afb None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:43.996753 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff5d3b-d4e1-44d9-98a4-d8c256861afb None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:43.997020 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff5d3b-d4e1-44d9-98a4-d8c256861afb None admin] PATH_INFO: `/v3/roles/member` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:44.010301 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ff5d3b-d4e1-44d9-98a4-d8c256861afb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:44.015560 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-10ff5d3b-d4e1-44d9-98a4-d8c256861afb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:22:44.015560 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:44.015560 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:44.015560 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:44.015560 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:44.015560 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:44.015560 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:44.015560 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:44.015560 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:44.015560 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:44.015560 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:44.015560 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:44.015560 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:44.015560 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:44.015560 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:44.015560 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:44.016421 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:44.016421 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:44.016421 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:44.016421 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:44.016421 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:44.016421 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:44.016421 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:44.016421 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:44.016421 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:44.016421 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:44.016421 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:44.016421 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:44.016421 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:44.016421 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:44.016421 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:44.016421 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:44.017228 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:44.017228 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:44.017228 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:44.017228 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:44.017228 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:44.017228 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:44.017228 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:44.017228 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:44.017228 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:44.017228 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:44.017228 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:22:44.017228 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:22:44.017228 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 204/401] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:22:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:22:44.022813 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff5d3b-d4e1-44d9-98a4-d8c256861afb None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:44.117765 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe9e9e6-bf51-439f-82a3-228f13f94d82 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:44.174139 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff5d3b-d4e1-44d9-98a4-d8c256861afb None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:44.183910 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2b8f5-07ab-4871-96f2-296ca052326d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:44.184561 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2b8f5-07ab-4871-96f2-296ca052326d None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:44.184838 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2b8f5-07ab-4871-96f2-296ca052326d None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:44.185104 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2b8f5-07ab-4871-96f2-296ca052326d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:44.202814 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2b8f5-07ab-4871-96f2-296ca052326d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:44.207702 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-b2f2b8f5-07ab-4871-96f2-296ca052326d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 15:22:44.207702 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:44.207702 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:44.207702 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:44.207702 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:44.207702 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:44.207702 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:44.207702 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:44.207702 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:44.207702 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:44.207702 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:44.207702 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:44.207702 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:44.207702 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:44.207702 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:44.207702 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:44.208575 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:44.208575 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:44.208575 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:44.208575 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:44.208575 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:44.208575 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:44.208575 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:44.208575 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:44.208575 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:44.208575 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:44.208575 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:44.208575 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:44.208575 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:44.208575 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:44.208575 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:44.208575 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:44.209368 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:44.209368 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:44.209368 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:44.209368 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:44.209368 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:44.209368 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:44.209368 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:44.209368 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:44.209368 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:44.209368 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:44.209368 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 15:22:44.209368 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:22:44.209368 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 198/402] 10.222.0.83 () {56 vars in 1114 bytes} [Mon Aug 29 15:22:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:22:44.214866 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2b8f5-07ab-4871-96f2-296ca052326d None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:44.246529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a30724-eebe-4d9d-88a5-093a4f960ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:44.247096 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a30724-eebe-4d9d-88a5-093a4f960ce5 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:44.247374 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a30724-eebe-4d9d-88a5-093a4f960ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:44.247641 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a30724-eebe-4d9d-88a5-093a4f960ce5 None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:44.248317 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a30724-eebe-4d9d-88a5-093a4f960ce5 None admin] RBAC: Adding query filter params (name=member) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:44.248619 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a30724-eebe-4d9d-88a5-093a4f960ce5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:44.250015 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a30724-eebe-4d9d-88a5-093a4f960ce5 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:44.255633 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:44.268721 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 205/403] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 15:22:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:44.275165 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a30724-eebe-4d9d-88a5-093a4f960ce5 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:44.346775 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:44.373518 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2b8f5-07ab-4871-96f2-296ca052326d None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:44.398212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a30724-eebe-4d9d-88a5-093a4f960ce5 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:44.420506 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11ac97-f6f6-4b1d-ab7f-b6b151329168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:44.422050 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11ac97-f6f6-4b1d-ab7f-b6b151329168 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:44.422428 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11ac97-f6f6-4b1d-ab7f-b6b151329168 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:44.422971 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11ac97-f6f6-4b1d-ab7f-b6b151329168 None admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:44.423906 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11ac97-f6f6-4b1d-ab7f-b6b151329168 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:44.424310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11ac97-f6f6-4b1d-ab7f-b6b151329168 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:44.426827 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11ac97-f6f6-4b1d-ab7f-b6b151329168 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:44.438131 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 199/404] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:22:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:22:44.439117 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11ac97-f6f6-4b1d-ab7f-b6b151329168 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:44.440315 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b182131-9c94-4eb9-9a8e-b11988618985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:44.441116 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b182131-9c94-4eb9-9a8e-b11988618985 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:44.441542 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b182131-9c94-4eb9-9a8e-b11988618985 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:44.442138 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b182131-9c94-4eb9-9a8e-b11988618985 None admin] PATH_INFO: `/v3/groups/acffb9866dd94f5bab98e82e6a4e03ac` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:44.443511 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b182131-9c94-4eb9-9a8e-b11988618985 None admin] RBAC: Authorizing `identity:get_group(group_id=acffb9866dd94f5bab98e82e6a4e03ac)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:44.444950 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b182131-9c94-4eb9-9a8e-b11988618985 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:44.446533 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 206/405] 10.222.0.83 () {56 vars in 1180 bytes} [Mon Aug 29 15:22:44 2022] GET /identity/v3/groups/acffb9866dd94f5bab98e82e6a4e03ac => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:22:44.447443 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b182131-9c94-4eb9-9a8e-b11988618985 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:44.516302 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:44.555366 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b182131-9c94-4eb9-9a8e-b11988618985 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:44.581373 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11ac97-f6f6-4b1d-ab7f-b6b151329168 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:44.596296 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ce08d-3874-455c-92ad-67f738876b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:44.597302 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ce08d-3874-455c-92ad-67f738876b68 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:44.597912 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ce08d-3874-455c-92ad-67f738876b68 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:44.598388 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ce08d-3874-455c-92ad-67f738876b68 None admin] PATH_INFO: `/v3/groups/acffb9866dd94f5bab98e82e6a4e03ac` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:44.599834 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4ce08d-3874-455c-92ad-67f738876b68 None admin] RBAC: Authorizing `identity:get_group(group_id=acffb9866dd94f5bab98e82e6a4e03ac)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:44.601630 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4ce08d-3874-455c-92ad-67f738876b68 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:44.605270 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 207/406] 10.222.0.83 () {56 vars in 1180 bytes} [Mon Aug 29 15:22:44 2022] GET /identity/v3/groups/acffb9866dd94f5bab98e82e6a4e03ac => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:44.606477 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ce08d-3874-455c-92ad-67f738876b68 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:44.622961 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82fefae-b2db-4948-b329-ad96fe0ace95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:44.623628 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fefae-b2db-4948-b329-ad96fe0ace95 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:44.623903 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fefae-b2db-4948-b329-ad96fe0ace95 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:44.624170 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fefae-b2db-4948-b329-ad96fe0ace95 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:44.639484 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82fefae-b2db-4948-b329-ad96fe0ace95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:44.644754 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-d82fefae-b2db-4948-b329-ad96fe0ace95 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:22:44.644754 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:44.644754 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:44.644754 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:44.644754 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:44.644754 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:44.644754 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:44.644754 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:44.644754 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:44.644754 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:44.644754 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:44.644754 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:44.644754 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:44.644754 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:44.644754 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:44.644754 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:44.645624 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:44.645624 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:44.645624 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:44.645624 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:44.645624 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:44.645624 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:44.645624 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:44.645624 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:44.645624 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:44.645624 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:44.645624 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:44.645624 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:44.645624 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:44.645624 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:44.645624 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:44.645624 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:44.646419 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:44.646419 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:44.646419 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:44.646419 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:44.646419 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:44.646419 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:44.646419 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:44.646419 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:44.646419 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:44.646419 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:44.646419 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:22:44.646419 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:22:44.646419 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 200/407] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 15:22:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:22:44.647120 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82fefae-b2db-4948-b329-ad96fe0ace95 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:44.649584 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:44.748276 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ce08d-3874-455c-92ad-67f738876b68 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:44.781416 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82fefae-b2db-4948-b329-ad96fe0ace95 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:44.784498 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c078b32-2f45-4899-84f8-41068406f536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:44.785130 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c078b32-2f45-4899-84f8-41068406f536 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:44.785406 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c078b32-2f45-4899-84f8-41068406f536 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:44.785675 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c078b32-2f45-4899-84f8-41068406f536 None admin] PATH_INFO: `/v3/projects/7ebc74909fbc49f2b7065ea3550fee57` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:44.786797 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c078b32-2f45-4899-84f8-41068406f536 None admin] RBAC: Authorizing `identity:get_project(project_id=7ebc74909fbc49f2b7065ea3550fee57)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:44.788260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c078b32-2f45-4899-84f8-41068406f536 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:44.789948 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 208/408] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:22:44 2022] GET /identity/v3/projects/7ebc74909fbc49f2b7065ea3550fee57 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:44.791938 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c078b32-2f45-4899-84f8-41068406f536 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:44.796796 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:44.819866 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407c133-d817-4702-afb2-c3b04272d92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:44.820505 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407c133-d817-4702-afb2-c3b04272d92e None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:44.820799 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407c133-d817-4702-afb2-c3b04272d92e None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:44.821058 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407c133-d817-4702-afb2-c3b04272d92e None admin] PATH_INFO: `/v3/projects/7ebc74909fbc49f2b7065ea3550fee57` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:44.822818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4407c133-d817-4702-afb2-c3b04272d92e None admin] RBAC: Authorizing `identity:get_project(project_id=7ebc74909fbc49f2b7065ea3550fee57)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:44.824485 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4407c133-d817-4702-afb2-c3b04272d92e None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:44.831057 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 201/409] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:22:44 2022] GET /identity/v3/projects/7ebc74909fbc49f2b7065ea3550fee57 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:44.831057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b80b4-90a2-4ac2-929f-19cc0dcbff79 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:44.831057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b80b4-90a2-4ac2-929f-19cc0dcbff79 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:44.831057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b80b4-90a2-4ac2-929f-19cc0dcbff79 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:44.831057 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 202/410] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:44.831057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b80b4-90a2-4ac2-929f-19cc0dcbff79 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:44.907981 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:44.911248 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c078b32-2f45-4899-84f8-41068406f536 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:44.943981 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b80b4-90a2-4ac2-929f-19cc0dcbff79 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:44.945973 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a738bb-3c63-41a7-bc13-7ed08f32488f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:44.946582 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a738bb-3c63-41a7-bc13-7ed08f32488f None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:44.946856 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a738bb-3c63-41a7-bc13-7ed08f32488f None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:44.947737 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a738bb-3c63-41a7-bc13-7ed08f32488f None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:44.948576 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a738bb-3c63-41a7-bc13-7ed08f32488f None admin] RBAC: Adding query filter params (name=admin) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:44.948881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a738bb-3c63-41a7-bc13-7ed08f32488f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:44.950536 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a738bb-3c63-41a7-bc13-7ed08f32488f None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:44.958943 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 209/411] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:22:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:44.959733 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a738bb-3c63-41a7-bc13-7ed08f32488f None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:44.996979 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea8e5f-dcd0-49f9-9b29-d4c95c14f1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:44.998016 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea8e5f-dcd0-49f9-9b29-d4c95c14f1e4 None admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:44.998478 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea8e5f-dcd0-49f9-9b29-d4c95c14f1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:44.998935 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea8e5f-dcd0-49f9-9b29-d4c95c14f1e4 None admin] PATH_INFO: `/v3/projects/7ebc74909fbc49f2b7065ea3550fee57/groups/acffb9866dd94f5bab98e82e6a4e03ac/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:45.001971 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ea8e5f-dcd0-49f9-9b29-d4c95c14f1e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ebc74909fbc49f2b7065ea3550fee57, group_id=acffb9866dd94f5bab98e82e6a4e03ac, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:45.004413 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ea8e5f-dcd0-49f9-9b29-d4c95c14f1e4 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:45.023084 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 203/412] 10.222.0.83 () {58 vars in 1442 bytes} [Mon Aug 29 15:22:44 2022] PUT /identity/v3/projects/7ebc74909fbc49f2b7065ea3550fee57/groups/acffb9866dd94f5bab98e82e6a4e03ac/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:22:45.030116 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915f00a-aeba-4e20-95a3-b0f7df98a416 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:45.030116 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915f00a-aeba-4e20-95a3-b0f7df98a416 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:45.030116 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915f00a-aeba-4e20-95a3-b0f7df98a416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:45.061045 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-3915f00a-aeba-4e20-95a3-b0f7df98a416 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:45.062478 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:45.064341 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3915f00a-aeba-4e20-95a3-b0f7df98a416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:45.110309 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a738bb-3c63-41a7-bc13-7ed08f32488f None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:45.167550 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2038d3-6aed-4849-8716-3303da41b0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:45.168805 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2038d3-6aed-4849-8716-3303da41b0f2 None admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:45.169076 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 204/413] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:22:45.169940 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3915f00a-aeba-4e20-95a3-b0f7df98a416 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:45.175223 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2038d3-6aed-4849-8716-3303da41b0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:45.175686 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2038d3-6aed-4849-8716-3303da41b0f2 None admin] PATH_INFO: `/v3/projects/7ebc74909fbc49f2b7065ea3550fee57/groups/acffb9866dd94f5bab98e82e6a4e03ac/roles/3e8f6ab382f64437b245115f5a28f535` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:45.182505 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2038d3-6aed-4849-8716-3303da41b0f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ebc74909fbc49f2b7065ea3550fee57, group_id=acffb9866dd94f5bab98e82e6a4e03ac, role_id=3e8f6ab382f64437b245115f5a28f535)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:45.185213 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2038d3-6aed-4849-8716-3303da41b0f2 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:45.224749 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 210/414] 10.222.0.83 () {58 vars in 1442 bytes} [Mon Aug 29 15:22:44 2022] PUT /identity/v3/projects/7ebc74909fbc49f2b7065ea3550fee57/groups/acffb9866dd94f5bab98e82e6a4e03ac/roles/3e8f6ab382f64437b245115f5a28f535 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:22:45.234849 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:45.279920 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3915f00a-aeba-4e20-95a3-b0f7df98a416 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:45.317941 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f3f94-fee4-439e-9bf0-5c5172cd1edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:45.318526 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f3f94-fee4-439e-9bf0-5c5172cd1edd None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:45.318803 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f3f94-fee4-439e-9bf0-5c5172cd1edd None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:45.319141 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f3f94-fee4-439e-9bf0-5c5172cd1edd None admin] PATH_INFO: `/v3/groups/ccbf4526c7874a938f1f0565364b7f3f` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:45.320307 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f3f94-fee4-439e-9bf0-5c5172cd1edd None admin] RBAC: Authorizing `identity:get_group(group_id=ccbf4526c7874a938f1f0565364b7f3f)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:45.321907 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f3f94-fee4-439e-9bf0-5c5172cd1edd None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:45.324122 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 205/415] 10.222.0.83 () {56 vars in 1180 bytes} [Mon Aug 29 15:22:45 2022] GET /identity/v3/groups/ccbf4526c7874a938f1f0565364b7f3f => generated 229 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:45.330473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2038d3-6aed-4849-8716-3303da41b0f2 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:45.525531 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2038d3-6aed-4849-8716-3303da41b0f2 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:45.567280 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:45.592152 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4891de-3088-44d6-9594-038e5c8d6a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:45.592984 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4891de-3088-44d6-9594-038e5c8d6a75 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:45.593450 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4891de-3088-44d6-9594-038e5c8d6a75 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:45.593927 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4891de-3088-44d6-9594-038e5c8d6a75 None admin] PATH_INFO: `/v3/projects/2be1d9508c364610be9aca20e58e1d6a` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:45.595993 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4891de-3088-44d6-9594-038e5c8d6a75 None admin] RBAC: Authorizing `identity:get_project(project_id=2be1d9508c364610be9aca20e58e1d6a)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:45.598509 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4891de-3088-44d6-9594-038e5c8d6a75 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:45.601855 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 211/416] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:22:45 2022] GET /identity/v3/projects/2be1d9508c364610be9aca20e58e1d6a => generated 344 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:45.607949 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f3f94-fee4-439e-9bf0-5c5172cd1edd None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:45.738227 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f3f94-fee4-439e-9bf0-5c5172cd1edd None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:45.784213 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:45.788766 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4891de-3088-44d6-9594-038e5c8d6a75 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:45.796593 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005cff53-2b41-4095-a980-4d630504af20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:45.798207 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005cff53-2b41-4095-a980-4d630504af20 None admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:45.798511 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005cff53-2b41-4095-a980-4d630504af20 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:45.798752 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005cff53-2b41-4095-a980-4d630504af20 None admin] PATH_INFO: `/v3/projects/2be1d9508c364610be9aca20e58e1d6a/groups/ccbf4526c7874a938f1f0565364b7f3f/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:45.800703 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005cff53-2b41-4095-a980-4d630504af20 None admin] RBAC: Authorizing `identity:create_grant(project_id=2be1d9508c364610be9aca20e58e1d6a, group_id=ccbf4526c7874a938f1f0565364b7f3f, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:45.802186 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005cff53-2b41-4095-a980-4d630504af20 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:45.816233 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 206/417] 10.222.0.83 () {58 vars in 1442 bytes} [Mon Aug 29 15:22:45 2022] PUT /identity/v3/projects/2be1d9508c364610be9aca20e58e1d6a/groups/ccbf4526c7874a938f1f0565364b7f3f/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:22:45.867807 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16baf835-b247-4cf2-a705-438b5fa7861f None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:45.868030 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16baf835-b247-4cf2-a705-438b5fa7861f None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:45.868410 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16baf835-b247-4cf2-a705-438b5fa7861f None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:45.870051 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 207/418] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:45.880728 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6c4a7-79d1-47f7-a857-aa4d5b85d396 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:45.881170 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6c4a7-79d1-47f7-a857-aa4d5b85d396 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:45.881540 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6c4a7-79d1-47f7-a857-aa4d5b85d396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:45.903769 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-03b6c4a7-79d1-47f7-a857-aa4d5b85d396 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:45.905329 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-03b6c4a7-79d1-47f7-a857-aa4d5b85d396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:45.986242 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4891de-3088-44d6-9594-038e5c8d6a75 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:45.987448 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 208/419] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 15:22:46.058550 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b07d29-f455-41f1-b55e-6eea45a4b10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:46.059640 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b07d29-f455-41f1-b55e-6eea45a4b10a None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:46.060118 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b07d29-f455-41f1-b55e-6eea45a4b10a None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:46.060594 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b07d29-f455-41f1-b55e-6eea45a4b10a None admin] PATH_INFO: `/v3/roles/member` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:46.096546 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b07d29-f455-41f1-b55e-6eea45a4b10a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:46.108653 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-d5b07d29-f455-41f1-b55e-6eea45a4b10a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:22:46.108653 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:46.108653 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:46.108653 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:46.108653 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:46.108653 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:46.108653 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:46.108653 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:46.108653 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:46.108653 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:46.108653 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:46.108653 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:46.108653 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:46.108653 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:46.108653 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:46.108653 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:46.110459 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:46.110459 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:46.110459 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:46.110459 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:46.110459 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:46.110459 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:46.110459 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:46.110459 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:46.110459 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:46.110459 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:46.110459 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:46.110459 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:46.110459 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:46.110459 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:46.110459 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:46.110459 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:46.112699 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:46.112699 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:46.112699 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:46.112699 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:46.112699 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:46.112699 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:46.112699 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:46.112699 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:46.112699 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:46.112699 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:46.112699 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:22:46.112699 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:22:46.112699 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 212/420] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:22:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:22:46.120429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b6c4a7-79d1-47f7-a857-aa4d5b85d396 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:46.231190 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b6c4a7-79d1-47f7-a857-aa4d5b85d396 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:46.256152 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:46.279745 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd63b3-b3e0-419c-a985-aeda113013ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:46.280412 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd63b3-b3e0-419c-a985-aeda113013ce None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:46.280687 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd63b3-b3e0-419c-a985-aeda113013ce None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:46.280949 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd63b3-b3e0-419c-a985-aeda113013ce None admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:46.281628 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bd63b3-b3e0-419c-a985-aeda113013ce None admin] RBAC: Adding query filter params (name=member) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:46.281911 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bd63b3-b3e0-419c-a985-aeda113013ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:46.283322 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bd63b3-b3e0-419c-a985-aeda113013ce None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:46.293107 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 209/421] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 15:22:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:22:46.298797 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b07d29-f455-41f1-b55e-6eea45a4b10a None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:46.371595 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:46.378304 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd63b3-b3e0-419c-a985-aeda113013ce None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:46.427506 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b07d29-f455-41f1-b55e-6eea45a4b10a None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:46.480579 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c856a-9183-4306-a1a1-1340f3fb3466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:46.481195 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c856a-9183-4306-a1a1-1340f3fb3466 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:46.481473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c856a-9183-4306-a1a1-1340f3fb3466 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:46.481746 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c856a-9183-4306-a1a1-1340f3fb3466 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:46.574999 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd63b3-b3e0-419c-a985-aeda113013ce None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:46.617469 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727c856a-9183-4306-a1a1-1340f3fb3466 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:46.619128 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727c856a-9183-4306-a1a1-1340f3fb3466 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:46.622307 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc70064-a8f6-4f5a-a013-665d61ffadbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:46.622889 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc70064-a8f6-4f5a-a013-665d61ffadbe None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:46.623199 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc70064-a8f6-4f5a-a013-665d61ffadbe None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:46.623471 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc70064-a8f6-4f5a-a013-665d61ffadbe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:46.637016 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc70064-a8f6-4f5a-a013-665d61ffadbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:46.640795 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-ccc70064-a8f6-4f5a-a013-665d61ffadbe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 15:22:46.640795 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:46.640795 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:46.640795 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:46.640795 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:46.640795 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:46.640795 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:46.640795 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:46.640795 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:46.640795 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:46.640795 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:46.640795 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:46.640795 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:46.640795 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:46.640795 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:46.640795 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:46.641690 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:46.641690 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:46.641690 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:46.641690 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:46.641690 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:46.641690 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:46.641690 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:46.641690 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:46.641690 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:46.641690 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:46.641690 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:46.641690 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:46.641690 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:46.641690 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:46.641690 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:46.641690 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:46.647069 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:46.647069 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:46.647069 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:46.647069 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:46.647069 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:46.647069 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:46.647069 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:46.647069 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:46.647069 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:46.647069 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:46.647069 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 15:22:46.647069 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:22:46.647069 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 210/422] 10.222.0.83 () {56 vars in 1114 bytes} [Mon Aug 29 15:22:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:22:46.658762 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc70064-a8f6-4f5a-a013-665d61ffadbe None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:46.691624 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:46.744529 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 213/423] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:22:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:22:46.750653 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:46.756177 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c856a-9183-4306-a1a1-1340f3fb3466 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:46.829143 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc70064-a8f6-4f5a-a013-665d61ffadbe None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:46.865835 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a98ca-fafa-4fb8-b7ed-4b60a6e71f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:46.866707 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a98ca-fafa-4fb8-b7ed-4b60a6e71f24 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:46.867156 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a98ca-fafa-4fb8-b7ed-4b60a6e71f24 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:46.867603 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a98ca-fafa-4fb8-b7ed-4b60a6e71f24 None admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:46.868944 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a98ca-fafa-4fb8-b7ed-4b60a6e71f24 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:46.869451 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a98ca-fafa-4fb8-b7ed-4b60a6e71f24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:46.871122 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a98ca-fafa-4fb8-b7ed-4b60a6e71f24 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:46.880579 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 211/424] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:22:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:22:46.888448 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a98ca-fafa-4fb8-b7ed-4b60a6e71f24 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:46.976852 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c856a-9183-4306-a1a1-1340f3fb3466 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:47.048669 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dca1c6-0a73-4fc8-9963-615aee5e6d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:47.049322 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dca1c6-0a73-4fc8-9963-615aee5e6d2d None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:47.049591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dca1c6-0a73-4fc8-9963-615aee5e6d2d None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:47.049866 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dca1c6-0a73-4fc8-9963-615aee5e6d2d None admin] PATH_INFO: `/v3/projects/81f3af84c83d43499bc734eb2261802e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:47.052975 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dca1c6-0a73-4fc8-9963-615aee5e6d2d None admin] RBAC: Authorizing `identity:get_project(project_id=81f3af84c83d43499bc734eb2261802e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:47.054449 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dca1c6-0a73-4fc8-9963-615aee5e6d2d None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:47.056836 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 214/425] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:22:46 2022] GET /identity/v3/projects/81f3af84c83d43499bc734eb2261802e => generated 298 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:47.064237 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a98ca-fafa-4fb8-b7ed-4b60a6e71f24 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:47.064747 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dca1c6-0a73-4fc8-9963-615aee5e6d2d None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:47.066344 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:47.104177 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a02c9c6-484b-48e2-8ba4-3be945c81e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:47.105063 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02c9c6-484b-48e2-8ba4-3be945c81e3f None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:47.105483 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02c9c6-484b-48e2-8ba4-3be945c81e3f None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:47.105890 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02c9c6-484b-48e2-8ba4-3be945c81e3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:47.106813 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:47.179619 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a02c9c6-484b-48e2-8ba4-3be945c81e3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:47.181924 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a02c9c6-484b-48e2-8ba4-3be945c81e3f None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:47.284657 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dca1c6-0a73-4fc8-9963-615aee5e6d2d None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:47.301017 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 212/426] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:22:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 15:22:47.312038 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a02c9c6-484b-48e2-8ba4-3be945c81e3f None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:47.315283 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:47.333120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae027d-e85a-4fba-b118-22d294cbd91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:47.333789 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae027d-e85a-4fba-b118-22d294cbd91c None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:47.334073 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae027d-e85a-4fba-b118-22d294cbd91c None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:47.334398 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae027d-e85a-4fba-b118-22d294cbd91c None admin] PATH_INFO: `/v3/groups/acffb9866dd94f5bab98e82e6a4e03ac` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:47.335621 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae027d-e85a-4fba-b118-22d294cbd91c None admin] RBAC: Authorizing `identity:get_group(group_id=acffb9866dd94f5bab98e82e6a4e03ac)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:47.337160 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae027d-e85a-4fba-b118-22d294cbd91c None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:47.343133 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 215/427] 10.222.0.83 () {56 vars in 1180 bytes} [Mon Aug 29 15:22:47 2022] GET /identity/v3/groups/acffb9866dd94f5bab98e82e6a4e03ac => generated 226 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:22:47.345455 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae027d-e85a-4fba-b118-22d294cbd91c None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:47.450743 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:47.473923 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae027d-e85a-4fba-b118-22d294cbd91c None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:47.511457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a02c9c6-484b-48e2-8ba4-3be945c81e3f None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:47.532517 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98385eae-6e7d-4cea-81a2-5a42ed26a215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:47.533622 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98385eae-6e7d-4cea-81a2-5a42ed26a215 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:47.534426 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98385eae-6e7d-4cea-81a2-5a42ed26a215 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:47.534866 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98385eae-6e7d-4cea-81a2-5a42ed26a215 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:47.535769 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98385eae-6e7d-4cea-81a2-5a42ed26a215 None admin] RBAC: Adding query filter params (group.id=acffb9866dd94f5bab98e82e6a4e03ac, role.id=e85047210af34e2d87f8162c8bd2005e, scope.project.id=81f3af84c83d43499bc734eb2261802e) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:47.536224 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98385eae-6e7d-4cea-81a2-5a42ed26a215 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:47.538621 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98385eae-6e7d-4cea-81a2-5a42ed26a215 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:47.548191 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 216/428] 10.222.0.83 () {56 vars in 1376 bytes} [Mon Aug 29 15:22:47 2022] GET /identity/v3/role_assignments?group.id=acffb9866dd94f5bab98e82e6a4e03ac&scope.project.id=81f3af84c83d43499bc734eb2261802e&role.id=e85047210af34e2d87f8162c8bd2005e => generated 611 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:22:47.549698 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62962d86-351c-441b-a1c7-0024fff11e15 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:47.550129 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62962d86-351c-441b-a1c7-0024fff11e15 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:47.550546 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62962d86-351c-441b-a1c7-0024fff11e15 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:47.552499 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 217/429] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:47.559403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4a815-7d12-4b47-8128-b06f656c19f7 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:47.559956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4a815-7d12-4b47-8128-b06f656c19f7 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:47.560373 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4a815-7d12-4b47-8128-b06f656c19f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:47.566358 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0888bb9b-583f-4166-99c1-4320b1eab65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:47.567111 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888bb9b-583f-4166-99c1-4320b1eab65c None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:47.567396 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888bb9b-583f-4166-99c1-4320b1eab65c None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:47.567691 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888bb9b-583f-4166-99c1-4320b1eab65c None admin] PATH_INFO: `/v3/projects/81f3af84c83d43499bc734eb2261802e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:47.572044 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0888bb9b-583f-4166-99c1-4320b1eab65c None admin] RBAC: Authorizing `identity:get_project(project_id=81f3af84c83d43499bc734eb2261802e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:47.576883 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0888bb9b-583f-4166-99c1-4320b1eab65c None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:47.578952 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 213/430] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:22:47 2022] GET /identity/v3/projects/81f3af84c83d43499bc734eb2261802e => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:47.585755 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0888bb9b-583f-4166-99c1-4320b1eab65c None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:47.599178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-96c4a815-7d12-4b47-8128-b06f656c19f7 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:47.600703 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-96c4a815-7d12-4b47-8128-b06f656c19f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:47.736628 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:47.745806 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 218/431] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:22:47.785934 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0888bb9b-583f-4166-99c1-4320b1eab65c None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:47.831753 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb989c-1ae2-48b1-9e22-3246c67e31af None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:47.831940 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a4295-1cae-4741-abd7-3d9ef6052bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:47.832418 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a4295-1cae-4741-abd7-3d9ef6052bd5 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:47.832697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a4295-1cae-4741-abd7-3d9ef6052bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:47.832977 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb989c-1ae2-48b1-9e22-3246c67e31af None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:47.833085 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a4295-1cae-4741-abd7-3d9ef6052bd5 None admin] PATH_INFO: `/v3/groups/acffb9866dd94f5bab98e82e6a4e03ac` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:47.833537 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb989c-1ae2-48b1-9e22-3246c67e31af None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:47.834149 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a4295-1cae-4741-abd7-3d9ef6052bd5 None admin] RBAC: Authorizing `identity:get_group(group_id=acffb9866dd94f5bab98e82e6a4e03ac)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:47.835570 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 219/432] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:22:47.835673 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a4295-1cae-4741-abd7-3d9ef6052bd5 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:47.838051 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 214/433] 10.222.0.83 () {56 vars in 1180 bytes} [Mon Aug 29 15:22:47 2022] GET /identity/v3/groups/acffb9866dd94f5bab98e82e6a4e03ac => generated 226 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:22:47.841694 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd54965-b8bf-4c48-a136-a36644e60384 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:47.842044 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd54965-b8bf-4c48-a136-a36644e60384 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:47.842395 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd54965-b8bf-4c48-a136-a36644e60384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:47.845954 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb989c-1ae2-48b1-9e22-3246c67e31af None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:47.865127 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-ffd54965-b8bf-4c48-a136-a36644e60384 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:47.867217 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ffd54965-b8bf-4c48-a136-a36644e60384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:47.962903 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 215/434] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 15:22:47.982187 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:48.004499 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb989c-1ae2-48b1-9e22-3246c67e31af None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:48.044110 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5145d9-c9d0-4b7a-b238-0f5ccd1e4961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:48.044714 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5145d9-c9d0-4b7a-b238-0f5ccd1e4961 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:48.044993 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5145d9-c9d0-4b7a-b238-0f5ccd1e4961 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:48.045257 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5145d9-c9d0-4b7a-b238-0f5ccd1e4961 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:48.046253 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5145d9-c9d0-4b7a-b238-0f5ccd1e4961 None admin] RBAC: Adding query filter params (group.id=acffb9866dd94f5bab98e82e6a4e03ac, role.id=3e8f6ab382f64437b245115f5a28f535, scope.project.id=81f3af84c83d43499bc734eb2261802e) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:48.046615 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5145d9-c9d0-4b7a-b238-0f5ccd1e4961 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:48.048136 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5145d9-c9d0-4b7a-b238-0f5ccd1e4961 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:48.054671 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 220/435] 10.222.0.83 () {56 vars in 1376 bytes} [Mon Aug 29 15:22:47 2022] GET /identity/v3/role_assignments?group.id=acffb9866dd94f5bab98e82e6a4e03ac&scope.project.id=81f3af84c83d43499bc734eb2261802e&role.id=3e8f6ab382f64437b245115f5a28f535 => generated 611 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:48.074914 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd54965-b8bf-4c48-a136-a36644e60384 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:48.156678 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:48.195307 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd54965-b8bf-4c48-a136-a36644e60384 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:48.241931 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5d6ed-8b62-459b-8162-ad6cf11484f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:48.242923 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5d6ed-8b62-459b-8162-ad6cf11484f8 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:48.243662 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5d6ed-8b62-459b-8162-ad6cf11484f8 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:48.244192 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5d6ed-8b62-459b-8162-ad6cf11484f8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:48.256339 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c5d6ed-8b62-459b-8162-ad6cf11484f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:48.258651 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5145d9-c9d0-4b7a-b238-0f5ccd1e4961 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:48.263446 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-d8c5d6ed-8b62-459b-8162-ad6cf11484f8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 15:22:48.263446 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:48.263446 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:48.263446 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:48.263446 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:48.263446 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:48.263446 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:48.263446 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:48.263446 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:48.263446 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:48.263446 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:48.263446 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:48.263446 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:48.263446 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:48.263446 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:48.263446 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:48.264378 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:48.264378 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:48.264378 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:48.264378 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:48.264378 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:48.264378 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:48.264378 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:48.264378 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:48.264378 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:48.264378 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:48.264378 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:48.264378 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:48.264378 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:48.264378 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:48.264378 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:48.264378 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:48.265188 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:48.265188 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:48.265188 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:48.265188 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:48.265188 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:48.265188 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:48.265188 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:48.265188 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:48.265188 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:48.265188 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:48.265188 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 15:22:48.265188 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:22:48.267895 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 216/436] 10.222.0.83 () {56 vars in 1114 bytes} [Mon Aug 29 15:22:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:22:48.274068 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5d6ed-8b62-459b-8162-ad6cf11484f8 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:48.391009 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5145d9-c9d0-4b7a-b238-0f5ccd1e4961 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:48.420223 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5d6ed-8b62-459b-8162-ad6cf11484f8 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:48.435360 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce1854-56e9-4f1b-bb16-44c04c6202cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:48.435990 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce1854-56e9-4f1b-bb16-44c04c6202cb None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:48.436275 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce1854-56e9-4f1b-bb16-44c04c6202cb None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:48.436545 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce1854-56e9-4f1b-bb16-44c04c6202cb None admin] PATH_INFO: `/v3/roles/member` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:48.454293 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce1854-56e9-4f1b-bb16-44c04c6202cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:48.455159 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:48.461416 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-16ce1854-56e9-4f1b-bb16-44c04c6202cb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:22:48.461416 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:48.461416 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:48.461416 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:48.461416 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:48.461416 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:48.461416 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:48.461416 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:48.461416 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:48.461416 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:48.461416 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:48.461416 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:48.461416 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:48.461416 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:48.461416 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:48.461416 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:48.464462 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:48.464462 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:48.464462 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:48.464462 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:48.464462 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:48.464462 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:48.464462 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:48.464462 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:48.464462 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:48.464462 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:48.464462 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:48.464462 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:48.464462 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:48.464462 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:48.464462 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:48.464462 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:48.465240 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:48.465240 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:48.465240 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:48.465240 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:48.465240 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:48.465240 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:48.465240 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:48.465240 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:48.465240 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:48.465240 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:48.465240 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:22:48.465240 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:22:48.465832 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc8548-ae82-4eae-bc61-c234675b1173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:48.465832 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc8548-ae82-4eae-bc61-c234675b1173 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:48.465832 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc8548-ae82-4eae-bc61-c234675b1173 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:48.465832 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc8548-ae82-4eae-bc61-c234675b1173 None admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:48.469121 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc8548-ae82-4eae-bc61-c234675b1173 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:48.469121 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc8548-ae82-4eae-bc61-c234675b1173 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:48.469121 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc8548-ae82-4eae-bc61-c234675b1173 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:48.471976 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 221/437] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:22:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:22:48.478325 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 217/438] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:22:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:48.481003 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce1854-56e9-4f1b-bb16-44c04c6202cb None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:48.484340 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc8548-ae82-4eae-bc61-c234675b1173 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:48.490894 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:48.608170 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc8548-ae82-4eae-bc61-c234675b1173 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:48.611716 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce1854-56e9-4f1b-bb16-44c04c6202cb None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:48.647986 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c087f5-a385-4006-a104-417d1243d92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:48.648593 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c087f5-a385-4006-a104-417d1243d92f None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:48.648865 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c087f5-a385-4006-a104-417d1243d92f None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:48.649132 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c087f5-a385-4006-a104-417d1243d92f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:48.651202 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e8a449-13e2-4238-b899-5acdf8a7bbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:48.651854 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8a449-13e2-4238-b899-5acdf8a7bbce None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:48.652157 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8a449-13e2-4238-b899-5acdf8a7bbce None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:48.652456 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8a449-13e2-4238-b899-5acdf8a7bbce None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:48.653145 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e8a449-13e2-4238-b899-5acdf8a7bbce None admin] RBAC: Adding query filter params (name=member) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:48.653471 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e8a449-13e2-4238-b899-5acdf8a7bbce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:48.654944 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e8a449-13e2-4238-b899-5acdf8a7bbce None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:48.663491 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 222/439] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 15:22:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:48.664698 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af06a56-2207-43b1-b4ac-1ab2669cde81 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:48.665104 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af06a56-2207-43b1-b4ac-1ab2669cde81 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:48.665958 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af06a56-2207-43b1-b4ac-1ab2669cde81 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:48.667577 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 223/440] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:48.669599 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af06a56-2207-43b1-b4ac-1ab2669cde81 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:48.715486 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:48.725759 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c087f5-a385-4006-a104-417d1243d92f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:48.727247 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c087f5-a385-4006-a104-417d1243d92f None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:48.744377 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:48.780560 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af06a56-2207-43b1-b4ac-1ab2669cde81 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:48.817065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22d240-2f85-4e56-93a1-5bc838481619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:48.817719 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22d240-2f85-4e56-93a1-5bc838481619 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:48.818000 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22d240-2f85-4e56-93a1-5bc838481619 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:48.818272 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22d240-2f85-4e56-93a1-5bc838481619 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:48.835939 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 218/441] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:22:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 15:22:48.838041 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400524ea-809a-431c-8f2e-943469fe0547 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:48.838366 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400524ea-809a-431c-8f2e-943469fe0547 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:48.838637 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400524ea-809a-431c-8f2e-943469fe0547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:48.855748 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-400524ea-809a-431c-8f2e-943469fe0547 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:48.856907 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-400524ea-809a-431c-8f2e-943469fe0547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:48.892907 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22d240-2f85-4e56-93a1-5bc838481619 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:48.894419 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22d240-2f85-4e56-93a1-5bc838481619 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:48.925157 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 219/442] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:22:48.926243 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400524ea-809a-431c-8f2e-943469fe0547 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:48.949515 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:48.974582 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:49.012468 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 224/443] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:22:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 15:22:49.018242 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22d240-2f85-4e56-93a1-5bc838481619 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:49.041815 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400524ea-809a-431c-8f2e-943469fe0547 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:49.081604 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01508d-19e3-4a70-a78b-39c153b70b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:49.082246 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01508d-19e3-4a70-a78b-39c153b70b26 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:49.082525 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01508d-19e3-4a70-a78b-39c153b70b26 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:49.082794 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01508d-19e3-4a70-a78b-39c153b70b26 None admin] PATH_INFO: `/v3/projects/7ebc74909fbc49f2b7065ea3550fee57` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:49.083953 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01508d-19e3-4a70-a78b-39c153b70b26 None admin] RBAC: Authorizing `identity:get_project(project_id=7ebc74909fbc49f2b7065ea3550fee57)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:49.085388 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01508d-19e3-4a70-a78b-39c153b70b26 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:49.087633 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 220/444] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:22:48 2022] GET /identity/v3/projects/7ebc74909fbc49f2b7065ea3550fee57 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:49.093063 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01508d-19e3-4a70-a78b-39c153b70b26 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:49.127371 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22d240-2f85-4e56-93a1-5bc838481619 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:49.163461 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd91cbe3-2440-439d-8685-46ea7f16db6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:49.163991 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91cbe3-2440-439d-8685-46ea7f16db6a None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:49.164270 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91cbe3-2440-439d-8685-46ea7f16db6a None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:49.164544 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91cbe3-2440-439d-8685-46ea7f16db6a None admin] PATH_INFO: `/v3/projects/7ebc74909fbc49f2b7065ea3550fee57` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:49.165829 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd91cbe3-2440-439d-8685-46ea7f16db6a None admin] RBAC: Authorizing `identity:get_project(project_id=7ebc74909fbc49f2b7065ea3550fee57)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:49.167439 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd91cbe3-2440-439d-8685-46ea7f16db6a None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:49.169277 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 225/445] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:22:49 2022] GET /identity/v3/projects/7ebc74909fbc49f2b7065ea3550fee57 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:22:49.174814 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd91cbe3-2440-439d-8685-46ea7f16db6a None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:49.187070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:49.203423 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01508d-19e3-4a70-a78b-39c153b70b26 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:49.213564 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:49.242778 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483010a-1e42-4541-bf2b-bbdcce81408b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:49.244161 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483010a-1e42-4541-bf2b-bbdcce81408b None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:49.244614 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483010a-1e42-4541-bf2b-bbdcce81408b None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:49.244899 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483010a-1e42-4541-bf2b-bbdcce81408b None admin] PATH_INFO: `/v3/groups/acffb9866dd94f5bab98e82e6a4e03ac` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:49.246094 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c483010a-1e42-4541-bf2b-bbdcce81408b None admin] RBAC: Authorizing `identity:get_group(group_id=acffb9866dd94f5bab98e82e6a4e03ac)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:49.247726 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c483010a-1e42-4541-bf2b-bbdcce81408b None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:49.249367 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 221/446] 10.222.0.83 () {56 vars in 1180 bytes} [Mon Aug 29 15:22:49 2022] GET /identity/v3/groups/acffb9866dd94f5bab98e82e6a4e03ac => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:22:49.250212 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483010a-1e42-4541-bf2b-bbdcce81408b None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:49.285875 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd91cbe3-2440-439d-8685-46ea7f16db6a None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:49.319960 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d379f2-afd2-4c44-8140-d0d7255061f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:49.320575 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d379f2-afd2-4c44-8140-d0d7255061f8 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:49.320849 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d379f2-afd2-4c44-8140-d0d7255061f8 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:49.321178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d379f2-afd2-4c44-8140-d0d7255061f8 None admin] PATH_INFO: `/v3/groups/acffb9866dd94f5bab98e82e6a4e03ac` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:49.322971 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d379f2-afd2-4c44-8140-d0d7255061f8 None admin] RBAC: Authorizing `identity:get_group(group_id=acffb9866dd94f5bab98e82e6a4e03ac)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:49.324446 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d379f2-afd2-4c44-8140-d0d7255061f8 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:49.326659 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 226/447] 10.222.0.83 () {56 vars in 1180 bytes} [Mon Aug 29 15:22:49 2022] GET /identity/v3/groups/acffb9866dd94f5bab98e82e6a4e03ac => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:22:49.326921 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d379f2-afd2-4c44-8140-d0d7255061f8 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:49.356294 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483010a-1e42-4541-bf2b-bbdcce81408b None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:49.391615 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe7cbb7-4299-4e94-bcdc-1fc2fd5d5d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:49.392235 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe7cbb7-4299-4e94-bcdc-1fc2fd5d5d21 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:49.392506 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe7cbb7-4299-4e94-bcdc-1fc2fd5d5d21 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:49.392769 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe7cbb7-4299-4e94-bcdc-1fc2fd5d5d21 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:49.402857 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe7cbb7-4299-4e94-bcdc-1fc2fd5d5d21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:49.407912 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-abe7cbb7-4299-4e94-bcdc-1fc2fd5d5d21 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:22:49.407912 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:49.407912 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:49.407912 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:49.407912 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:49.407912 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:49.407912 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:49.407912 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:49.407912 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:49.407912 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:49.407912 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:49.407912 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:49.407912 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:49.407912 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:49.407912 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:49.407912 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:49.408974 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:49.408974 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:49.408974 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:49.408974 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:49.408974 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:49.408974 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:49.408974 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:49.408974 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:49.408974 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:49.408974 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:49.408974 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:49.408974 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:49.408974 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:49.408974 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:49.408974 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:49.408974 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:49.409970 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:49.409970 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:49.409970 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:49.409970 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:49.409970 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:49.409970 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:49.409970 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:49.409970 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:49.409970 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:49.409970 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:49.409970 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:22:49.409970 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:22:49.409970 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 222/448] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 15:22:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:22:49.410748 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe7cbb7-4299-4e94-bcdc-1fc2fd5d5d21 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:49.428381 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:49.436332 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d379f2-afd2-4c44-8140-d0d7255061f8 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:49.438701 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:49.472141 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1694b-4e30-4c10-8294-af2c86c643c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:49.472747 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1694b-4e30-4c10-8294-af2c86c643c9 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:49.473021 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1694b-4e30-4c10-8294-af2c86c643c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:49.473290 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1694b-4e30-4c10-8294-af2c86c643c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:49.474018 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1694b-4e30-4c10-8294-af2c86c643c9 None admin] RBAC: Adding query filter params (group.id=acffb9866dd94f5bab98e82e6a4e03ac, role.id=3e8f6ab382f64437b245115f5a28f535, scope.project.id=7ebc74909fbc49f2b7065ea3550fee57) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:49.474332 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1694b-4e30-4c10-8294-af2c86c643c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:49.475807 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1694b-4e30-4c10-8294-af2c86c643c9 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:49.482565 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 227/449] 10.222.0.83 () {56 vars in 1376 bytes} [Mon Aug 29 15:22:49 2022] GET /identity/v3/role_assignments?group.id=acffb9866dd94f5bab98e82e6a4e03ac&scope.project.id=7ebc74909fbc49f2b7065ea3550fee57&role.id=3e8f6ab382f64437b245115f5a28f535 => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:49.483385 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1694b-4e30-4c10-8294-af2c86c643c9 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:49.525854 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe7cbb7-4299-4e94-bcdc-1fc2fd5d5d21 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:49.570348 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903229a7-4dcb-43cb-80d6-ebdfdc340a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:49.570995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903229a7-4dcb-43cb-80d6-ebdfdc340a25 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:49.571521 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903229a7-4dcb-43cb-80d6-ebdfdc340a25 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:49.571878 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903229a7-4dcb-43cb-80d6-ebdfdc340a25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:49.572628 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903229a7-4dcb-43cb-80d6-ebdfdc340a25 None admin] RBAC: Adding query filter params (group.id=acffb9866dd94f5bab98e82e6a4e03ac, role.id=e85047210af34e2d87f8162c8bd2005e, scope.project.id=7ebc74909fbc49f2b7065ea3550fee57) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:49.572936 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903229a7-4dcb-43cb-80d6-ebdfdc340a25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:49.574633 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903229a7-4dcb-43cb-80d6-ebdfdc340a25 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:49.581469 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 223/450] 10.222.0.83 () {56 vars in 1376 bytes} [Mon Aug 29 15:22:49 2022] GET /identity/v3/role_assignments?group.id=acffb9866dd94f5bab98e82e6a4e03ac&scope.project.id=7ebc74909fbc49f2b7065ea3550fee57&role.id=e85047210af34e2d87f8162c8bd2005e => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:49.621878 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1694b-4e30-4c10-8294-af2c86c643c9 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:49.671012 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c481d27-574a-4204-ae98-9f391fae01dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:49.671892 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c481d27-574a-4204-ae98-9f391fae01dc None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:49.672215 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c481d27-574a-4204-ae98-9f391fae01dc None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:49.672518 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c481d27-574a-4204-ae98-9f391fae01dc None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:49.673396 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c481d27-574a-4204-ae98-9f391fae01dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:49.673793 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c481d27-574a-4204-ae98-9f391fae01dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:49.675426 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c481d27-574a-4204-ae98-9f391fae01dc None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:49.686192 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 228/451] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:22:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:49.692410 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903229a7-4dcb-43cb-80d6-ebdfdc340a25 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:49.783141 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:49.803564 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903229a7-4dcb-43cb-80d6-ebdfdc340a25 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:49.838594 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7911b7-4664-4a81-8a8e-e91deb4de764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:49.839306 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7911b7-4664-4a81-8a8e-e91deb4de764 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:49.839582 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7911b7-4664-4a81-8a8e-e91deb4de764 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:49.839847 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7911b7-4664-4a81-8a8e-e91deb4de764 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:49.910340 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7911b7-4664-4a81-8a8e-e91deb4de764 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:49.911820 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7911b7-4664-4a81-8a8e-e91deb4de764 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:49.995328 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:50.016413 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 224/452] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:22:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:22:50.022321 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c481d27-574a-4204-ae98-9f391fae01dc None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:50.054636 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:50.126379 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c481d27-574a-4204-ae98-9f391fae01dc None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:50.158662 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9801a3f-9783-4136-af49-655f3733842b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:50.159306 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9801a3f-9783-4136-af49-655f3733842b None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:50.159586 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9801a3f-9783-4136-af49-655f3733842b None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:50.159860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9801a3f-9783-4136-af49-655f3733842b None admin] PATH_INFO: `/v3/projects/2be1d9508c364610be9aca20e58e1d6a` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:50.160977 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9801a3f-9783-4136-af49-655f3733842b None admin] RBAC: Authorizing `identity:get_project(project_id=2be1d9508c364610be9aca20e58e1d6a)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:50.162410 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9801a3f-9783-4136-af49-655f3733842b None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:50.164067 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 229/453] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:22:50 2022] GET /identity/v3/projects/2be1d9508c364610be9aca20e58e1d6a => generated 344 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:22:50.170578 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7911b7-4664-4a81-8a8e-e91deb4de764 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:50.268326 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7911b7-4664-4a81-8a8e-e91deb4de764 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:50.302021 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da3ec9-9892-4a0a-9a07-c5e341c09a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:50.302641 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da3ec9-9892-4a0a-9a07-c5e341c09a2e None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:50.302918 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da3ec9-9892-4a0a-9a07-c5e341c09a2e None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:50.303238 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da3ec9-9892-4a0a-9a07-c5e341c09a2e None admin] PATH_INFO: `/v3/groups/ccbf4526c7874a938f1f0565364b7f3f` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:50.304331 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da3ec9-9892-4a0a-9a07-c5e341c09a2e None admin] RBAC: Authorizing `identity:get_group(group_id=ccbf4526c7874a938f1f0565364b7f3f)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:50.305862 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da3ec9-9892-4a0a-9a07-c5e341c09a2e None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:50.307461 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 225/454] 10.222.0.83 () {56 vars in 1180 bytes} [Mon Aug 29 15:22:50 2022] GET /identity/v3/groups/ccbf4526c7874a938f1f0565364b7f3f => generated 229 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:50.313463 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9801a3f-9783-4136-af49-655f3733842b None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:50.409267 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:50.413338 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9801a3f-9783-4136-af49-655f3733842b None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:50.445357 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec1d42-a221-480c-be96-78cddd6ecf4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:50.446555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec1d42-a221-480c-be96-78cddd6ecf4e None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:50.446831 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec1d42-a221-480c-be96-78cddd6ecf4e None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:50.447139 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec1d42-a221-480c-be96-78cddd6ecf4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:50.447854 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afec1d42-a221-480c-be96-78cddd6ecf4e None admin] RBAC: Adding query filter params (group.id=ccbf4526c7874a938f1f0565364b7f3f, role.id=4bb2bbb7bb544610877949fc933504d2, scope.project.id=2be1d9508c364610be9aca20e58e1d6a) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:50.448156 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afec1d42-a221-480c-be96-78cddd6ecf4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:50.449583 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afec1d42-a221-480c-be96-78cddd6ecf4e None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:50.455153 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 230/455] 10.222.0.83 () {56 vars in 1376 bytes} [Mon Aug 29 15:22:50 2022] GET /identity/v3/role_assignments?group.id=ccbf4526c7874a938f1f0565364b7f3f&scope.project.id=2be1d9508c364610be9aca20e58e1d6a&role.id=4bb2bbb7bb544610877949fc933504d2 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:52.731535 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aae2ba-640c-43a2-9ef9-b03e96d16d2c None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:52.732517 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aae2ba-640c-43a2-9ef9-b03e96d16d2c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:52.733024 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aae2ba-640c-43a2-9ef9-b03e96d16d2c None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:52.734842 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 226/456] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:52.740020 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337b504-070f-4640-af11-8e08a06a0c29 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:52.740872 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337b504-070f-4640-af11-8e08a06a0c29 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:52.741349 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337b504-070f-4640-af11-8e08a06a0c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:52.766857 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-3337b504-070f-4640-af11-8e08a06a0c29 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:52.768432 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3337b504-070f-4640-af11-8e08a06a0c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:52.870297 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 231/457] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:22:53.002147 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff0b17-5515-469d-a86e-161a976b1e9e None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:53.002751 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff0b17-5515-469d-a86e-161a976b1e9e None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:53.003342 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff0b17-5515-469d-a86e-161a976b1e9e None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:53.004883 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 227/458] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:53.010592 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ebdbc-1f6a-4e23-94af-2adb878899b0 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:53.011136 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ebdbc-1f6a-4e23-94af-2adb878899b0 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:53.011596 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ebdbc-1f6a-4e23-94af-2adb878899b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:53.041604 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-ba4ebdbc-1f6a-4e23-94af-2adb878899b0 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:53.043150 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ba4ebdbc-1f6a-4e23-94af-2adb878899b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:53.150678 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 232/459] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:22:53.170320 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba0d27-ed32-4ba3-b6b0-32eb74ed3305 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:53.170933 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba0d27-ed32-4ba3-b6b0-32eb74ed3305 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:53.171433 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba0d27-ed32-4ba3-b6b0-32eb74ed3305 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:53.173226 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 228/460] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:53.178658 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e033d85-07ab-47ae-8513-82af3ddaa56f None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:53.179157 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e033d85-07ab-47ae-8513-82af3ddaa56f None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:53.180332 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e033d85-07ab-47ae-8513-82af3ddaa56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:53.208017 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-8e033d85-07ab-47ae-8513-82af3ddaa56f None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:53.209573 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8e033d85-07ab-47ae-8513-82af3ddaa56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:53.215052 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dba0d27-ed32-4ba3-b6b0-32eb74ed3305 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:53.228904 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:53.309946 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:53.318642 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 233/461] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:22:53.373622 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dba0d27-ed32-4ba3-b6b0-32eb74ed3305 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:53.417956 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9122af5-5b6b-44f5-bea9-1dba43610885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:53.418681 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9122af5-5b6b-44f5-bea9-1dba43610885 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:53.418982 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9122af5-5b6b-44f5-bea9-1dba43610885 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:53.419281 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9122af5-5b6b-44f5-bea9-1dba43610885 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:53.434682 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9122af5-5b6b-44f5-bea9-1dba43610885 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:53.436336 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9122af5-5b6b-44f5-bea9-1dba43610885 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:53.455237 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-a9122af5-5b6b-44f5-bea9-1dba43610885 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:22:53.455237 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:53.455237 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:53.455237 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:53.455237 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:53.455237 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:53.455237 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:53.455237 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:53.455237 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:53.455237 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:53.455237 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:53.455237 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:53.455237 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:22:53.455237 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:22:53.455237 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:22:53.455237 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:22:53.456126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:53.456126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:53.456126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:53.456126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:53.456126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:53.456126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:53.456126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:53.456126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:53.456126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:53.456126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:53.456126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:53.456126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:53.456126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:53.456126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:53.456126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:53.456126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:53.456126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:22:53.456983 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:22:53.456983 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:22:53.456983 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:22:53.456983 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 229/462] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:22:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:22:53.463081 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e033d85-07ab-47ae-8513-82af3ddaa56f None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:53.533775 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9122af5-5b6b-44f5-bea9-1dba43610885 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:53.632519 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e033d85-07ab-47ae-8513-82af3ddaa56f None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:53.673456 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:53.677253 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9122af5-5b6b-44f5-bea9-1dba43610885 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:53.681629 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e287613-9f75-44e8-a86b-95d55ca9bb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:53.682248 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e287613-9f75-44e8-a86b-95d55ca9bb63 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:53.682521 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e287613-9f75-44e8-a86b-95d55ca9bb63 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:53.682790 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e287613-9f75-44e8-a86b-95d55ca9bb63 None admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:53.683537 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e287613-9f75-44e8-a86b-95d55ca9bb63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:53.683902 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e287613-9f75-44e8-a86b-95d55ca9bb63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:53.685302 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e287613-9f75-44e8-a86b-95d55ca9bb63 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:53.704846 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 234/463] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:22:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:53.704846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e287613-9f75-44e8-a86b-95d55ca9bb63 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:53.721106 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:53.734826 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102b77f-e391-41a1-91d2-219c6c2b6fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:53.736148 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102b77f-e391-41a1-91d2-219c6c2b6fe3 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:53.736617 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102b77f-e391-41a1-91d2-219c6c2b6fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:53.737073 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102b77f-e391-41a1-91d2-219c6c2b6fe3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:53.754529 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102b77f-e391-41a1-91d2-219c6c2b6fe3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:53.756371 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102b77f-e391-41a1-91d2-219c6c2b6fe3 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:53.771926 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-1102b77f-e391-41a1-91d2-219c6c2b6fe3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:22:53.771926 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:53.771926 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:53.771926 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:53.771926 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:53.771926 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:53.771926 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:53.771926 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:53.771926 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:53.771926 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:53.771926 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:53.771926 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:53.771926 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:22:53.771926 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:22:53.771926 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:22:53.771926 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:22:53.772839 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:53.772839 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:53.772839 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:53.772839 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:53.772839 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:53.772839 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:53.772839 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:53.772839 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:53.772839 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:53.772839 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:53.772839 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:53.772839 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:53.772839 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:53.772839 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:53.772839 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:53.772839 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:53.772839 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:22:53.774040 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:22:53.774040 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:22:53.774040 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:22:53.776447 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 230/464] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:22:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:22:53.777461 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102b77f-e391-41a1-91d2-219c6c2b6fe3 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:53.819310 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e287613-9f75-44e8-a86b-95d55ca9bb63 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:53.858740 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e455d90-0ed1-43af-80c3-acbfcf12112a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:53.859454 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e455d90-0ed1-43af-80c3-acbfcf12112a None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:53.859728 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e455d90-0ed1-43af-80c3-acbfcf12112a None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:53.860052 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e455d90-0ed1-43af-80c3-acbfcf12112a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:53.873546 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e455d90-0ed1-43af-80c3-acbfcf12112a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:53.875467 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e455d90-0ed1-43af-80c3-acbfcf12112a None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:53.885152 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102b77f-e391-41a1-91d2-219c6c2b6fe3 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:53.891805 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-5e455d90-0ed1-43af-80c3-acbfcf12112a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:22:53.891805 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:53.891805 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:53.891805 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:53.891805 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:53.891805 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:53.891805 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:53.891805 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:53.891805 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:53.891805 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:53.891805 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:53.891805 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:53.891805 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:22:53.891805 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:22:53.891805 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:22:53.891805 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:22:53.892700 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:53.892700 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:53.892700 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:53.892700 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:53.892700 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:53.892700 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:53.892700 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:53.892700 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:53.892700 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:53.892700 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:53.892700 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:53.892700 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:53.892700 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:53.892700 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:53.892700 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:53.892700 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:53.892700 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:22:53.893536 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:22:53.893536 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:22:53.893536 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:22:53.897784 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 235/465] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:22:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:22:53.898839 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e455d90-0ed1-43af-80c3-acbfcf12112a None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:53.923684 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c466be-300b-4a12-85e0-fdc1e02b8364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:53.924657 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c466be-300b-4a12-85e0-fdc1e02b8364 None admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:53.925122 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c466be-300b-4a12-85e0-fdc1e02b8364 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:53.925597 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c466be-300b-4a12-85e0-fdc1e02b8364 None admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:53.926430 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c466be-300b-4a12-85e0-fdc1e02b8364 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:53.928076 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c466be-300b-4a12-85e0-fdc1e02b8364 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:53.959174 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 231/466] 10.222.0.83 () {60 vars in 1132 bytes} [Mon Aug 29 15:22:53 2022] POST /identity/v3/users => generated 246 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:22:53.960556 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c466be-300b-4a12-85e0-fdc1e02b8364 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:53.971453 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:53.982893 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:54.062957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e455d90-0ed1-43af-80c3-acbfcf12112a None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:54.123685 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8498ddd1-f769-4bcf-b824-5a8bdccb58a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:54.125156 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498ddd1-f769-4bcf-b824-5a8bdccb58a4 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:54.125581 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498ddd1-f769-4bcf-b824-5a8bdccb58a4 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:54.126017 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498ddd1-f769-4bcf-b824-5a8bdccb58a4 None admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:54.127229 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8498ddd1-f769-4bcf-b824-5a8bdccb58a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:54.127678 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8498ddd1-f769-4bcf-b824-5a8bdccb58a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:54.129898 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8498ddd1-f769-4bcf-b824-5a8bdccb58a4 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:54.146041 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 236/467] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:22:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:54.147252 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052d376-506a-499f-b883-7817ee1da2b1 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:54.147536 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052d376-506a-499f-b883-7817ee1da2b1 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:54.147804 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052d376-506a-499f-b883-7817ee1da2b1 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:54.150098 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 237/468] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:54.156480 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052d376-506a-499f-b883-7817ee1da2b1 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:54.161919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c466be-300b-4a12-85e0-fdc1e02b8364 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:54.205135 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324e27b-6bca-41aa-9d80-fdf6a43f2d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:54.205749 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324e27b-6bca-41aa-9d80-fdf6a43f2d5e None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:54.206030 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324e27b-6bca-41aa-9d80-fdf6a43f2d5e None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:54.206297 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324e27b-6bca-41aa-9d80-fdf6a43f2d5e None admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:54.206948 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5324e27b-6bca-41aa-9d80-fdf6a43f2d5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:54.207281 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5324e27b-6bca-41aa-9d80-fdf6a43f2d5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:54.208680 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5324e27b-6bca-41aa-9d80-fdf6a43f2d5e None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:54.223161 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 232/469] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:22:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:54.224418 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ce6e5-8a45-4205-8eea-790815759f87 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:54.224701 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ce6e5-8a45-4205-8eea-790815759f87 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:54.224979 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ce6e5-8a45-4205-8eea-790815759f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:54.246204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-3b5ce6e5-8a45-4205-8eea-790815759f87 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:54.247538 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3b5ce6e5-8a45-4205-8eea-790815759f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:54.287150 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052d376-506a-499f-b883-7817ee1da2b1 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:54.315237 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:54.315814 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:54.331049 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 233/470] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:22:54.331049 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522c160-16dd-41e1-b1b3-300d36e95d4e None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:54.331049 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522c160-16dd-41e1-b1b3-300d36e95d4e None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:54.331049 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522c160-16dd-41e1-b1b3-300d36e95d4e None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:54.331049 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 234/471] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:54.331049 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522c160-16dd-41e1-b1b3-300d36e95d4e None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:54.338114 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdaefa6-e1a7-49a7-a28e-1ec9236cf8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:54.338774 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdaefa6-e1a7-49a7-a28e-1ec9236cf8c6 None admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:54.339103 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdaefa6-e1a7-49a7-a28e-1ec9236cf8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:54.339400 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdaefa6-e1a7-49a7-a28e-1ec9236cf8c6 None admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:54.340102 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdaefa6-e1a7-49a7-a28e-1ec9236cf8c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:54.342263 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdaefa6-e1a7-49a7-a28e-1ec9236cf8c6 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:54.373139 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 238/472] 10.222.0.83 () {60 vars in 1132 bytes} [Mon Aug 29 15:22:54 2022] POST /identity/v3/users => generated 248 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:22:54.374611 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be810f-1314-4c91-a594-affbf90684ac None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:54.374907 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be810f-1314-4c91-a594-affbf90684ac None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:54.375287 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be810f-1314-4c91-a594-affbf90684ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:54.395044 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-33be810f-1314-4c91-a594-affbf90684ac None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:54.396340 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-33be810f-1314-4c91-a594-affbf90684ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:54.476816 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522c160-16dd-41e1-b1b3-300d36e95d4e None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:54.477169 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 239/473] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:22:54.536010 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d230a8-ea4e-439e-a88b-8de34ce1754d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:54.536707 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d230a8-ea4e-439e-a88b-8de34ce1754d None admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:54.536990 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d230a8-ea4e-439e-a88b-8de34ce1754d None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:54.537261 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d230a8-ea4e-439e-a88b-8de34ce1754d None admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:54.537924 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d230a8-ea4e-439e-a88b-8de34ce1754d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:54.540354 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d230a8-ea4e-439e-a88b-8de34ce1754d None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:54.573896 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 235/474] 10.222.0.83 () {60 vars in 1132 bytes} [Mon Aug 29 15:22:54 2022] POST /identity/v3/users => generated 248 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:22:54.611968 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be810f-1314-4c91-a594-affbf90684ac None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:54.734734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be810f-1314-4c91-a594-affbf90684ac None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:54.753667 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:54.783304 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b7668-bd22-44d3-86d9-84c7ddd386d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:54.783952 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b7668-bd22-44d3-86d9-84c7ddd386d0 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:54.784231 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b7668-bd22-44d3-86d9-84c7ddd386d0 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:54.784500 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b7668-bd22-44d3-86d9-84c7ddd386d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:54.797908 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b7668-bd22-44d3-86d9-84c7ddd386d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:54.799713 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b7668-bd22-44d3-86d9-84c7ddd386d0 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:54.816326 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-595b7668-bd22-44d3-86d9-84c7ddd386d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:22:54.816326 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:54.816326 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:54.816326 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:54.816326 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:54.816326 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:54.816326 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:54.816326 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:54.816326 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:54.816326 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:54.816326 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:54.816326 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:54.816326 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:22:54.816326 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:22:54.816326 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:22:54.816326 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:22:54.817244 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:54.817244 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:54.817244 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:54.817244 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:54.817244 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:54.817244 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:54.817244 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:54.817244 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:54.817244 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:54.817244 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:54.817244 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:54.817244 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:54.817244 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:54.817244 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:54.817244 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:54.817244 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:54.817244 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:22:54.818060 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:22:54.818060 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:22:54.818060 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:22:54.818060 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 240/475] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:22:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:22:54.823932 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d230a8-ea4e-439e-a88b-8de34ce1754d None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:54.837109 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b7668-bd22-44d3-86d9-84c7ddd386d0 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:54.904130 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:54.965078 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d230a8-ea4e-439e-a88b-8de34ce1754d None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:54.967586 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b7668-bd22-44d3-86d9-84c7ddd386d0 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:55.013862 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3afc535-8f5f-4336-9cc6-3c2c302fb00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:55.014666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afc535-8f5f-4336-9cc6-3c2c302fb00c None admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:55.014975 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afc535-8f5f-4336-9cc6-3c2c302fb00c None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:55.015338 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afc535-8f5f-4336-9cc6-3c2c302fb00c None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:55.016060 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3afc535-8f5f-4336-9cc6-3c2c302fb00c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:55.017793 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3afc535-8f5f-4336-9cc6-3c2c302fb00c None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:55.018038 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b1cb4-0a1b-4f37-afbf-d0f82bfb40e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:55.018803 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b1cb4-0a1b-4f37-afbf-d0f82bfb40e9 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:55.019260 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b1cb4-0a1b-4f37-afbf-d0f82bfb40e9 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:55.019686 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b1cb4-0a1b-4f37-afbf-d0f82bfb40e9 None admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:55.020472 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70b1cb4-0a1b-4f37-afbf-d0f82bfb40e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:55.020913 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70b1cb4-0a1b-4f37-afbf-d0f82bfb40e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:55.022702 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70b1cb4-0a1b-4f37-afbf-d0f82bfb40e9 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:55.028118 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.sql.core [None req-e3afc535-8f5f-4336-9cc6-3c2c302fb00c None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 15:22:55.028118 n-d-836830-13 devstack@keystone.service[82148]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 29 15:22:55.028118 n-d-836830-13 devstack@keystone.service[82148]: [parameters: {'id': '2edbfa2702a74ce0bc751f871a0cdd39', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 29 15:22:55.028118 n-d-836830-13 devstack@keystone.service[82148]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82148) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 15:22:55.039316 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 236/476] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:22:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:55.045834 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b1cb4-0a1b-4f37-afbf-d0f82bfb40e9 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:55.046325 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-e3afc535-8f5f-4336-9cc6-3c2c302fb00c None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 29 15:22:55.046325 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:55.046325 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 15:22:55.046325 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 15:22:55.046325 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 15:22:55.046325 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 15:22:55.046325 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 15:22:55.046325 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 15:22:55.046325 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 15:22:55.046325 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application conn.query(q) Aug 29 15:22:55.046325 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 15:22:55.046325 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 15:22:55.046325 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 15:22:55.046325 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application result.read() Aug 29 15:22:55.046325 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 15:22:55.047510 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 15:22:55.047510 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 15:22:55.047510 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 15:22:55.047510 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 15:22:55.047510 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 15:22:55.047510 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 15:22:55.047510 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 15:22:55.047510 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 15:22:55.047510 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:22:55.047510 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 15:22:55.047510 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:22:55.047510 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:55.047510 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 15:22:55.047510 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 15:22:55.047510 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 29 15:22:55.047510 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return ref.to_dict() Aug 29 15:22:55.047510 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 15:22:55.047510 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application next(self.gen) Aug 29 15:22:55.048644 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 15:22:55.048644 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application yield resource Aug 29 15:22:55.048644 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 15:22:55.048644 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application next(self.gen) Aug 29 15:22:55.048644 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 15:22:55.048644 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 15:22:55.048644 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:22:55.048644 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 15:22:55.048644 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:22:55.048644 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise self.value Aug 29 15:22:55.048644 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 15:22:55.048644 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 15:22:55.048644 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 15:22:55.048644 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application session.commit() Aug 29 15:22:55.048644 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 15:22:55.048644 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 15:22:55.048644 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 15:22:55.049712 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 15:22:55.049712 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 15:22:55.049712 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self.session.flush() Aug 29 15:22:55.049712 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 15:22:55.049712 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 15:22:55.049712 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 15:22:55.049712 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 15:22:55.049712 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 15:22:55.049712 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application compat.raise_( Aug 29 15:22:55.049712 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 15:22:55.049712 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception Aug 29 15:22:55.049712 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 15:22:55.049712 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 15:22:55.049712 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 15:22:55.049712 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 15:22:55.049712 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 15:22:55.049712 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 15:22:55.050773 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 15:22:55.050773 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 15:22:55.050773 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 29 15:22:55.050773 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 29 15:22:55.050773 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 15:22:55.050773 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 15:22:55.050773 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 15:22:55.050773 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 15:22:55.050773 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 15:22:55.050773 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 15:22:55.050773 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 15:22:55.050773 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 15:22:55.050773 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 15:22:55.050773 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 15:22:55.050773 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 15:22:55.050773 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception Aug 29 15:22:55.051782 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 15:22:55.051782 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 15:22:55.051782 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 15:22:55.051782 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 15:22:55.051782 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 15:22:55.051782 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 15:22:55.051782 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 15:22:55.051782 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application conn.query(q) Aug 29 15:22:55.051782 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 15:22:55.051782 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 15:22:55.051782 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 15:22:55.051782 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application result.read() Aug 29 15:22:55.051782 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 15:22:55.051782 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 15:22:55.051782 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 15:22:55.051782 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 15:22:55.052582 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 15:22:55.052582 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 15:22:55.052582 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 15:22:55.052582 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 15:22:55.052582 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 15:22:55.052582 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 29 15:22:55.052582 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [parameters: {'id': '2edbfa2702a74ce0bc751f871a0cdd39', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 29 15:22:55.052582 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 15:22:55.052582 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:22:55.052582 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:22:55.052582 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:22:55.052582 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:55.052582 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:55.052582 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:55.052582 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:55.052582 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:55.053362 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:55.053362 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:55.053362 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:55.053362 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:55.053362 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:55.053362 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:55.053362 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 29 15:22:55.053362 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 29 15:22:55.053362 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:55.053362 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:55.053362 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 29 15:22:55.053362 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 29 15:22:55.053362 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 15:22:55.053362 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 15:22:55.053362 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 29 15:22:55.053362 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:22:55.054813 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 241/477] 10.222.0.83 () {60 vars in 1131 bytes} [Mon Aug 29 15:22:54 2022] POST /identity/v3/roles => generated 144 bytes in 211 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:22:55.057010 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3afc535-8f5f-4336-9cc6-3c2c302fb00c None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:55.104743 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:55.229751 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b1cb4-0a1b-4f37-afbf-d0f82bfb40e9 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:55.237035 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3afc535-8f5f-4336-9cc6-3c2c302fb00c None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:55.256172 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:55.278490 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a86dd-ee23-41b5-ab9e-58236d739842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:55.279174 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a86dd-ee23-41b5-ab9e-58236d739842 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:55.279521 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a86dd-ee23-41b5-ab9e-58236d739842 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:55.279802 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a86dd-ee23-41b5-ab9e-58236d739842 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:55.296880 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a86dd-ee23-41b5-ab9e-58236d739842 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:55.305264 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe541ea0-e619-44d3-b4f9-3c02518b9592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:55.305872 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe541ea0-e619-44d3-b4f9-3c02518b9592 None admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:55.306154 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe541ea0-e619-44d3-b4f9-3c02518b9592 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:55.306427 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe541ea0-e619-44d3-b4f9-3c02518b9592 None admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:55.307115 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe541ea0-e619-44d3-b4f9-3c02518b9592 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:55.308635 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe541ea0-e619-44d3-b4f9-3c02518b9592 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:55.310618 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-8d6a86dd-ee23-41b5-ab9e-58236d739842 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 15:22:55.310618 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:55.310618 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:55.310618 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:55.310618 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:55.310618 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:55.310618 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:55.310618 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:55.310618 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:55.310618 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:55.310618 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:55.310618 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:55.310618 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:55.310618 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:55.310618 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:55.310618 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:55.311512 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:55.311512 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:55.311512 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:55.311512 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:55.311512 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:55.311512 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:55.311512 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:55.311512 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:55.311512 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:55.311512 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:55.311512 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:55.311512 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:55.311512 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:55.311512 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:55.311512 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:55.311512 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:55.312277 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:55.312277 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:55.312277 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:55.312277 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:55.312277 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:55.312277 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:55.312277 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:55.312277 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:55.312277 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:55.312277 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:55.312277 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 15:22:55.312277 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:22:55.312277 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 242/478] 10.222.0.83 () {56 vars in 1114 bytes} [Mon Aug 29 15:22:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:22:55.318736 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a86dd-ee23-41b5-ab9e-58236d739842 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:55.349942 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 237/479] 10.222.0.83 () {60 vars in 1132 bytes} [Mon Aug 29 15:22:55 2022] POST /identity/v3/users => generated 249 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:22:55.440202 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:55.457246 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a86dd-ee23-41b5-ab9e-58236d739842 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:55.494850 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a363e-d67a-423d-965d-aa94d6e21179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:55.495456 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a363e-d67a-423d-965d-aa94d6e21179 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:55.495742 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a363e-d67a-423d-965d-aa94d6e21179 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:55.495991 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a363e-d67a-423d-965d-aa94d6e21179 None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:55.496655 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a363e-d67a-423d-965d-aa94d6e21179 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:55.496949 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a363e-d67a-423d-965d-aa94d6e21179 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:55.498327 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a363e-d67a-423d-965d-aa94d6e21179 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:55.507686 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 243/480] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:22:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:56.411564 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4f428-823b-4394-aea8-6411640baac4 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:56.412575 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4f428-823b-4394-aea8-6411640baac4 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:56.413064 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4f428-823b-4394-aea8-6411640baac4 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:56.414958 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 238/481] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:56.420350 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd0cfe-7a3b-49c6-ae2f-c3f6b6217a0e None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:56.421221 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd0cfe-7a3b-49c6-ae2f-c3f6b6217a0e None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:56.421695 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd0cfe-7a3b-49c6-ae2f-c3f6b6217a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:56.443372 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-c5dd0cfe-7a3b-49c6-ae2f-c3f6b6217a0e None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:56.445463 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c5dd0cfe-7a3b-49c6-ae2f-c3f6b6217a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:56.540244 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 244/482] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:22:56.964070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa4f428-823b-4394-aea8-6411640baac4 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:57.019169 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4400de-3fb6-4205-8b4e-5c51e480ffef None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:57.019813 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4400de-3fb6-4205-8b4e-5c51e480ffef None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:57.020368 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4400de-3fb6-4205-8b4e-5c51e480ffef None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:57.022437 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 245/483] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:57.028561 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880fd95-2640-4374-af20-d2b8f89d122b None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:57.028859 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880fd95-2640-4374-af20-d2b8f89d122b None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:57.029130 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880fd95-2640-4374-af20-d2b8f89d122b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:57.064092 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-0880fd95-2640-4374-af20-d2b8f89d122b None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:57.065315 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0880fd95-2640-4374-af20-d2b8f89d122b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:57.080867 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa4f428-823b-4394-aea8-6411640baac4 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:57.148383 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f9b7f-5952-481d-b91d-ee703cfaf291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:57.149066 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f9b7f-5952-481d-b91d-ee703cfaf291 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:57.149341 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f9b7f-5952-481d-b91d-ee703cfaf291 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:57.149612 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f9b7f-5952-481d-b91d-ee703cfaf291 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:57.174497 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f9b7f-5952-481d-b91d-ee703cfaf291 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:57.179802 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-561f9b7f-5952-481d-b91d-ee703cfaf291 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:22:57.179802 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:57.179802 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:57.179802 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:57.179802 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:57.179802 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:57.179802 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:57.179802 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:57.179802 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:57.179802 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:57.179802 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:57.179802 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:57.179802 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:57.179802 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:57.179802 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:57.179802 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:57.180774 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:57.180774 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:57.180774 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:57.180774 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:57.180774 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:57.180774 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:57.180774 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:57.180774 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:57.180774 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:57.180774 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:57.180774 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:57.180774 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:57.180774 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:57.180774 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:57.180774 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:57.180774 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:57.181567 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:57.181567 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:57.181567 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:57.181567 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:57.181567 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:57.181567 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:57.181567 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:57.181567 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:57.181567 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:57.181567 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:57.181567 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:22:57.181567 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:22:57.181567 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 239/484] 10.222.0.83 () {56 vars in 1102 bytes} [Mon Aug 29 15:22:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:22:57.192689 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f9b7f-5952-481d-b91d-ee703cfaf291 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:57.198357 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 246/485] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:22:57.239741 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb83b2-dc64-45eb-8fc8-32d20ecf3bb4 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:57.240229 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb83b2-dc64-45eb-8fc8-32d20ecf3bb4 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:57.240663 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb83b2-dc64-45eb-8fc8-32d20ecf3bb4 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:57.242174 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 247/486] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:22:57.247459 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4b4ca-8b0f-4e4f-86af-f33d1531facc None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:57.248009 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4b4ca-8b0f-4e4f-86af-f33d1531facc None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:57.248480 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4b4ca-8b0f-4e4f-86af-f33d1531facc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:57.264342 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:57.281111 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-5af4b4ca-8b0f-4e4f-86af-f33d1531facc None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:57.283487 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5af4b4ca-8b0f-4e4f-86af-f33d1531facc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:57.291009 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:57.360370 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f9b7f-5952-481d-b91d-ee703cfaf291 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:57.399464 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91084e7e-55cb-4b6a-862b-2d4fde820d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:57.400101 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91084e7e-55cb-4b6a-862b-2d4fde820d68 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:57.400424 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91084e7e-55cb-4b6a-862b-2d4fde820d68 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:57.400704 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91084e7e-55cb-4b6a-862b-2d4fde820d68 None admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:57.401374 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91084e7e-55cb-4b6a-862b-2d4fde820d68 None admin] RBAC: Adding query filter params (name=service) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:57.401677 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91084e7e-55cb-4b6a-862b-2d4fde820d68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:57.403098 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91084e7e-55cb-4b6a-862b-2d4fde820d68 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:57.413030 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 240/487] 10.222.0.83 () {56 vars in 1103 bytes} [Mon Aug 29 15:22:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:57.422850 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91084e7e-55cb-4b6a-862b-2d4fde820d68 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:57.435168 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 248/488] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 29 15:22:57.485297 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4b4ca-8b0f-4e4f-86af-f33d1531facc None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:57.591577 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4b4ca-8b0f-4e4f-86af-f33d1531facc None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:57.629165 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea8571-cf8e-42c1-9483-79507236b369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:57.630160 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea8571-cf8e-42c1-9483-79507236b369 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:57.630632 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea8571-cf8e-42c1-9483-79507236b369 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:57.631154 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea8571-cf8e-42c1-9483-79507236b369 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:57.631257 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:57.643648 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ea8571-cf8e-42c1-9483-79507236b369 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:57.649445 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-33ea8571-cf8e-42c1-9483-79507236b369 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:22:57.649445 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:57.649445 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:57.649445 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:57.649445 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:57.649445 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:57.649445 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:57.649445 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:57.649445 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:57.649445 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:57.649445 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:57.649445 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:57.649445 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:57.649445 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:57.649445 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:57.649445 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:57.650324 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:57.650324 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:57.650324 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:57.650324 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:57.650324 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:57.650324 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:57.650324 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:57.650324 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:57.650324 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:57.650324 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:57.650324 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:57.650324 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:57.650324 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:57.650324 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:57.650324 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:57.650324 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:57.651151 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:57.651151 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:57.651151 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:57.651151 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:57.651151 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:57.651151 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:57.651151 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:57.651151 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:57.651151 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:57.651151 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:57.651151 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:22:57.651151 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:22:57.653717 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 249/489] 10.222.0.83 () {56 vars in 1102 bytes} [Mon Aug 29 15:22:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:22:57.654627 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:57.659315 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea8571-cf8e-42c1-9483-79507236b369 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:57.669188 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91084e7e-55cb-4b6a-862b-2d4fde820d68 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:57.738828 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca4883-a788-4032-a497-809a70848192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:57.739498 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca4883-a788-4032-a497-809a70848192 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:57.742520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca4883-a788-4032-a497-809a70848192 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:57.742520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca4883-a788-4032-a497-809a70848192 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:57.759421 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ca4883-a788-4032-a497-809a70848192 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:57.760881 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ca4883-a788-4032-a497-809a70848192 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:57.785832 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-e9ca4883-a788-4032-a497-809a70848192 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:22:57.785832 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:57.785832 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:57.785832 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:57.785832 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:57.785832 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:57.785832 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:57.785832 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:57.785832 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:57.785832 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:57.785832 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:57.785832 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:57.785832 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:22:57.785832 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:22:57.785832 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:22:57.785832 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:22:57.786774 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:57.786774 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:57.786774 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:57.786774 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:57.786774 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:57.786774 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:57.786774 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:57.786774 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:57.786774 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:57.786774 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:57.786774 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:57.786774 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:57.786774 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:57.786774 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:57.786774 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:57.786774 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:57.786774 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:22:57.788122 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:22:57.788122 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:22:57.788122 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:22:57.788122 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 241/490] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:22:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:22:57.788122 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca4883-a788-4032-a497-809a70848192 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:57.815932 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea8571-cf8e-42c1-9483-79507236b369 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:57.860770 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4ec75-7151-4863-a288-58afd8b7b998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:57.861815 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4ec75-7151-4863-a288-58afd8b7b998 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:57.862310 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4ec75-7151-4863-a288-58afd8b7b998 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:57.862781 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4ec75-7151-4863-a288-58afd8b7b998 None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:57.863855 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4ec75-7151-4863-a288-58afd8b7b998 None admin] RBAC: Adding query filter params (name=service) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:57.864452 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4ec75-7151-4863-a288-58afd8b7b998 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:57.866303 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4ec75-7151-4863-a288-58afd8b7b998 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:57.876779 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 250/491] 10.222.0.83 () {56 vars in 1103 bytes} [Mon Aug 29 15:22:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:22:57.877912 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4ec75-7151-4863-a288-58afd8b7b998 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:57.908274 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca4883-a788-4032-a497-809a70848192 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:57.944860 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ade367-b531-45f1-b354-6b3e90fd1e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:57.945497 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ade367-b531-45f1-b354-6b3e90fd1e9b None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:57.945777 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ade367-b531-45f1-b354-6b3e90fd1e9b None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:57.946048 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ade367-b531-45f1-b354-6b3e90fd1e9b None admin] PATH_INFO: `/v3/roles/service` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:57.947722 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:57.957317 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ade367-b531-45f1-b354-6b3e90fd1e9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:57.963108 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-73ade367-b531-45f1-b354-6b3e90fd1e9b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:22:57.963108 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:57.963108 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:57.963108 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:57.963108 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:57.963108 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:57.963108 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:57.963108 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:57.963108 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:57.963108 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:57.963108 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:57.963108 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:57.963108 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:57.963108 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:57.963108 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:57.963108 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:57.964050 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:57.964050 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:57.964050 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:57.964050 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:57.964050 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:57.964050 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:57.964050 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:57.964050 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:57.964050 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:57.964050 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:57.964050 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:57.964050 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:57.964050 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:57.964050 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:57.964050 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:57.964050 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:57.964854 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:57.964854 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:57.964854 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:57.964854 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:57.964854 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:57.964854 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:57.964854 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:57.964854 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:57.964854 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:57.964854 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:57.964854 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:22:57.964854 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:22:57.964854 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 242/492] 10.222.0.83 () {56 vars in 1102 bytes} [Mon Aug 29 15:22:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:22:57.965497 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ade367-b531-45f1-b354-6b3e90fd1e9b None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:57.970806 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:58.009687 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4ec75-7151-4863-a288-58afd8b7b998 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:58.044889 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01a88a-9c87-4839-a589-1e90a8110be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:58.045527 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01a88a-9c87-4839-a589-1e90a8110be1 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:58.045807 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01a88a-9c87-4839-a589-1e90a8110be1 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:58.046082 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01a88a-9c87-4839-a589-1e90a8110be1 None admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:58.046769 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01a88a-9c87-4839-a589-1e90a8110be1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:58.047106 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01a88a-9c87-4839-a589-1e90a8110be1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:58.048503 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01a88a-9c87-4839-a589-1e90a8110be1 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:58.061522 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 251/493] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:22:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:58.062334 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01a88a-9c87-4839-a589-1e90a8110be1 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:58.077120 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ade367-b531-45f1-b354-6b3e90fd1e9b None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:58.112036 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028ba0e-05bf-41f2-ac3c-56db8bbe39cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:58.112593 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028ba0e-05bf-41f2-ac3c-56db8bbe39cc None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:58.112872 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028ba0e-05bf-41f2-ac3c-56db8bbe39cc None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:58.113144 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028ba0e-05bf-41f2-ac3c-56db8bbe39cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:58.123874 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1028ba0e-05bf-41f2-ac3c-56db8bbe39cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:58.125646 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1028ba0e-05bf-41f2-ac3c-56db8bbe39cc None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:58.139826 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-1028ba0e-05bf-41f2-ac3c-56db8bbe39cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:22:58.139826 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:58.139826 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:58.139826 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:58.139826 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:58.139826 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:58.139826 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:58.139826 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:58.139826 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:58.139826 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:58.139826 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:58.139826 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:58.139826 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:22:58.139826 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:22:58.139826 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:22:58.139826 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:22:58.140753 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:58.140753 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:58.140753 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:58.140753 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:58.140753 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:58.140753 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:58.140753 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:58.140753 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:58.140753 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:58.140753 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:58.140753 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:58.140753 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:58.140753 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:58.140753 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:58.140753 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:58.140753 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:58.140753 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:22:58.141581 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:22:58.141581 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:22:58.141581 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:22:58.141581 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 243/494] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:22:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:22:58.146760 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09052fbc-96b8-4bd8-84cd-a47ffe921ebc None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:58.146760 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09052fbc-96b8-4bd8-84cd-a47ffe921ebc None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:58.146760 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09052fbc-96b8-4bd8-84cd-a47ffe921ebc None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:58.146760 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 244/495] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:58.146760 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cc8f2-91df-44bf-b159-6198a00f0d28 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:58.146760 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cc8f2-91df-44bf-b159-6198a00f0d28 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:58.147218 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cc8f2-91df-44bf-b159-6198a00f0d28 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:58.147218 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 245/496] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:22:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:22:58.148433 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0cc8f2-91df-44bf-b159-6198a00f0d28 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:58.168365 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01a88a-9c87-4839-a589-1e90a8110be1 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:58.190392 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:58.205500 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a554cf8-4e66-4b5a-968b-a1b050f4a7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:58.206105 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a554cf8-4e66-4b5a-968b-a1b050f4a7eb None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:58.206382 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a554cf8-4e66-4b5a-968b-a1b050f4a7eb None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:58.206652 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a554cf8-4e66-4b5a-968b-a1b050f4a7eb None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:58.207351 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a554cf8-4e66-4b5a-968b-a1b050f4a7eb None admin] RBAC: Adding query filter params (name=service) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:58.207654 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a554cf8-4e66-4b5a-968b-a1b050f4a7eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:58.207794 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:58.209043 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a554cf8-4e66-4b5a-968b-a1b050f4a7eb None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:58.216915 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 252/497] 10.222.0.83 () {56 vars in 1103 bytes} [Mon Aug 29 15:22:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:58.218062 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b2923-5cd6-47d9-a671-7d1e2a4d021c None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:58.218346 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b2923-5cd6-47d9-a671-7d1e2a4d021c None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:58.218617 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b2923-5cd6-47d9-a671-7d1e2a4d021c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:58.236011 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-179b2923-5cd6-47d9-a671-7d1e2a4d021c None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:58.237201 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-179b2923-5cd6-47d9-a671-7d1e2a4d021c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:58.258235 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0cc8f2-91df-44bf-b159-6198a00f0d28 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:58.293132 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c957ba60-ee5e-4227-860f-de714ed0e496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:58.294020 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957ba60-ee5e-4227-860f-de714ed0e496 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:58.294293 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957ba60-ee5e-4227-860f-de714ed0e496 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:58.294561 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957ba60-ee5e-4227-860f-de714ed0e496 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:58.301865 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c957ba60-ee5e-4227-860f-de714ed0e496 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:58.302636 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 253/498] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:22:58.304015 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b2923-5cd6-47d9-a671-7d1e2a4d021c None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:58.311821 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c957ba60-ee5e-4227-860f-de714ed0e496 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:58.325563 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-c957ba60-ee5e-4227-860f-de714ed0e496 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 15:22:58.325563 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:58.325563 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:58.325563 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:58.325563 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:58.325563 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:58.325563 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:58.325563 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:58.325563 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:58.325563 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:58.325563 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:58.325563 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:58.325563 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:22:58.325563 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:22:58.325563 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:22:58.325563 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:22:58.326499 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:58.326499 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:58.326499 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:22:58.326499 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:22:58.326499 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:22:58.326499 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:22:58.326499 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:58.326499 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:58.326499 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:58.326499 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:58.326499 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:58.326499 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:58.326499 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:58.326499 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:58.326499 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:58.326499 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:58.326499 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:58.326499 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:58.327457 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:58.327457 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:58.327457 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:22:58.327457 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:22:58.327457 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:22:58.327457 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:22:58.327457 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:22:58.327457 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:22:58.327457 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 15:22:58.327457 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:22:58.327457 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 246/499] 10.222.0.83 () {56 vars in 1093 bytes} [Mon Aug 29 15:22:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:22:58.328023 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bccdf46-8fa5-4af2-8518-e72293fe5bf7 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:58.328429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bccdf46-8fa5-4af2-8518-e72293fe5bf7 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:58.328429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bccdf46-8fa5-4af2-8518-e72293fe5bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:58.346706 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-6bccdf46-8fa5-4af2-8518-e72293fe5bf7 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:22:58.347930 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6bccdf46-8fa5-4af2-8518-e72293fe5bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:22:58.419580 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 247/500] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:22:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:22:58.422363 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b2923-5cd6-47d9-a671-7d1e2a4d021c None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:58.431918 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bccdf46-8fa5-4af2-8518-e72293fe5bf7 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:58.437512 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:58.463936 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449bc8d-a305-4524-91fd-c48f56c455e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:58.464779 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449bc8d-a305-4524-91fd-c48f56c455e4 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:58.464889 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449bc8d-a305-4524-91fd-c48f56c455e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:58.465184 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449bc8d-a305-4524-91fd-c48f56c455e4 None admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:58.465859 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5449bc8d-a305-4524-91fd-c48f56c455e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:58.466171 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5449bc8d-a305-4524-91fd-c48f56c455e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:58.467619 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5449bc8d-a305-4524-91fd-c48f56c455e4 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:58.483093 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 254/501] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:22:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:58.483093 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449bc8d-a305-4524-91fd-c48f56c455e4 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:58.505985 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:58.578593 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bccdf46-8fa5-4af2-8518-e72293fe5bf7 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:58.603966 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449bc8d-a305-4524-91fd-c48f56c455e4 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:58.614352 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823fc120-7080-4a39-9d0d-75fe95611a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:58.614985 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823fc120-7080-4a39-9d0d-75fe95611a73 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:58.615292 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823fc120-7080-4a39-9d0d-75fe95611a73 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:58.615560 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823fc120-7080-4a39-9d0d-75fe95611a73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:58.626919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823fc120-7080-4a39-9d0d-75fe95611a73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:58.628407 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823fc120-7080-4a39-9d0d-75fe95611a73 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:58.643722 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-823fc120-7080-4a39-9d0d-75fe95611a73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:22:58.643722 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:58.643722 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:58.643722 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:58.643722 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:58.643722 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:58.643722 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:58.643722 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:58.643722 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:58.643722 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:58.643722 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:58.643722 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:58.643722 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:22:58.643722 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:22:58.643722 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:22:58.643722 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:22:58.644665 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:58.644665 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:58.644665 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:58.644665 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:58.644665 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:58.644665 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:58.644665 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:58.644665 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:58.644665 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:58.644665 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:58.644665 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:58.644665 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:58.644665 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:58.644665 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:58.644665 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:58.644665 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:58.644665 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:22:58.651009 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:22:58.651009 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:22:58.651009 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:22:58.651201 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b774709-1359-451b-a5cb-97ff09afac7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:58.651201 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b774709-1359-451b-a5cb-97ff09afac7c None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:58.651201 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b774709-1359-451b-a5cb-97ff09afac7c None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:58.651412 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 248/502] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:22:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:22:58.651480 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b774709-1359-451b-a5cb-97ff09afac7c None admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:58.651552 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823fc120-7080-4a39-9d0d-75fe95611a73 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:58.651617 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b774709-1359-451b-a5cb-97ff09afac7c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:58.651617 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b774709-1359-451b-a5cb-97ff09afac7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:58.651617 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b774709-1359-451b-a5cb-97ff09afac7c None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:58.687204 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 255/503] 10.222.0.83 () {56 vars in 1133 bytes} [Mon Aug 29 15:22:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:58.688223 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b774709-1359-451b-a5cb-97ff09afac7c None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:58.719623 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:58.756058 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:58.760041 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823fc120-7080-4a39-9d0d-75fe95611a73 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:58.791081 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b774709-1359-451b-a5cb-97ff09afac7c None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:58.795196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee14d3d-c7a2-4d30-a96c-366bd8bb4f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:58.795818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee14d3d-c7a2-4d30-a96c-366bd8bb4f99 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:58.796088 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee14d3d-c7a2-4d30-a96c-366bd8bb4f99 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:58.796350 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee14d3d-c7a2-4d30-a96c-366bd8bb4f99 None admin] PATH_INFO: `/v3/users/glance` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:58.804373 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee14d3d-c7a2-4d30-a96c-366bd8bb4f99 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:58.805932 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee14d3d-c7a2-4d30-a96c-366bd8bb4f99 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:58.817187 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-fee14d3d-c7a2-4d30-a96c-366bd8bb4f99 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 15:22:58.817187 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:58.817187 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:58.817187 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:58.817187 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:58.817187 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:58.817187 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:58.817187 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:58.817187 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:58.817187 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:58.817187 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:58.817187 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:58.817187 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:22:58.817187 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:22:58.817187 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:22:58.817187 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:22:58.818259 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:58.818259 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:58.818259 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:22:58.818259 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:22:58.818259 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:22:58.818259 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:22:58.818259 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:58.818259 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:58.818259 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:58.818259 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:58.818259 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:58.818259 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:58.818259 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:58.818259 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:58.818259 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:58.818259 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:58.818259 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:58.818259 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:58.819753 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:58.819753 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:58.819753 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:22:58.819753 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:22:58.819753 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:22:58.819753 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:22:58.819753 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:22:58.819753 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:22:58.819753 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 15:22:58.819753 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:22:58.819753 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 249/504] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:22:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:22:58.819753 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee14d3d-c7a2-4d30-a96c-366bd8bb4f99 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:58.830545 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f2a9e-e500-4c05-8b48-be754203f62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:58.831209 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f2a9e-e500-4c05-8b48-be754203f62f None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:58.831489 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f2a9e-e500-4c05-8b48-be754203f62f None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:58.831758 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f2a9e-e500-4c05-8b48-be754203f62f None admin] PATH_INFO: `/v3/roles/service` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:58.842978 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915f2a9e-e500-4c05-8b48-be754203f62f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:22:58.847832 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-915f2a9e-e500-4c05-8b48-be754203f62f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:22:58.847832 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:58.847832 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:58.847832 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:58.847832 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:58.847832 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:58.847832 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:58.847832 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:58.847832 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:58.847832 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:58.847832 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:58.847832 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:58.847832 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:22:58.847832 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:22:58.847832 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:22:58.847832 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:22:58.848802 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:22:58.848802 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:22:58.848802 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:22:58.848802 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:22:58.848802 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:58.848802 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:58.848802 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:58.848802 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:58.848802 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:58.848802 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:58.848802 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:58.848802 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:58.848802 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:58.848802 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:58.848802 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:58.848802 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:58.849570 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:58.849570 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:58.849570 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:58.849570 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:58.849570 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:22:58.849570 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:22:58.849570 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:22:58.849570 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:22:58.849570 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:22:58.849570 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:22:58.849570 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:22:58.849570 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:22:58.849570 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 256/505] 10.222.0.83 () {56 vars in 1102 bytes} [Mon Aug 29 15:22:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:22:58.850282 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f2a9e-e500-4c05-8b48-be754203f62f None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:58.922801 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee14d3d-c7a2-4d30-a96c-366bd8bb4f99 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:58.942920 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:58.952992 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f2a9e-e500-4c05-8b48-be754203f62f None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:58.956359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b2528-e0de-4db1-9058-80a47ef30d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:58.956963 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b2528-e0de-4db1-9058-80a47ef30d8a None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:58.957236 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b2528-e0de-4db1-9058-80a47ef30d8a None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:58.957502 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b2528-e0de-4db1-9058-80a47ef30d8a None admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:58.958133 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751b2528-e0de-4db1-9058-80a47ef30d8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:58.958429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751b2528-e0de-4db1-9058-80a47ef30d8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:58.960523 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751b2528-e0de-4db1-9058-80a47ef30d8a None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:58.972100 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 250/506] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:22:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:58.972900 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b2528-e0de-4db1-9058-80a47ef30d8a None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:58.988309 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe98ad-2b9c-4337-b129-2a4346454c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:58.989002 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe98ad-2b9c-4337-b129-2a4346454c21 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:58.989297 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe98ad-2b9c-4337-b129-2a4346454c21 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:58.989638 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe98ad-2b9c-4337-b129-2a4346454c21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:58.995486 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:59.000544 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe98ad-2b9c-4337-b129-2a4346454c21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:59.002012 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe98ad-2b9c-4337-b129-2a4346454c21 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:59.016299 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-7fbe98ad-2b9c-4337-b129-2a4346454c21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:22:59.016299 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:59.016299 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:59.016299 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:59.016299 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:59.016299 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:59.016299 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:59.016299 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:59.016299 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:59.016299 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:59.016299 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:59.016299 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:59.016299 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:22:59.016299 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:22:59.016299 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:22:59.016299 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:22:59.017182 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:59.017182 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:59.017182 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:59.017182 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:59.017182 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:59.017182 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:59.017182 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:59.017182 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:59.017182 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:59.017182 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:59.017182 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:59.017182 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:59.017182 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:59.017182 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:59.017182 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:59.017182 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:59.017182 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:22:59.018003 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:22:59.018003 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:22:59.018003 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:22:59.018003 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 257/507] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:22:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:22:59.018210 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe98ad-2b9c-4337-b129-2a4346454c21 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:59.079171 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b2528-e0de-4db1-9058-80a47ef30d8a None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:59.114818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe1fd9-ecc5-4f5c-89c1-72764cd8fc0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:59.115544 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe1fd9-ecc5-4f5c-89c1-72764cd8fc0f None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:59.116367 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe1fd9-ecc5-4f5c-89c1-72764cd8fc0f None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:59.116639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe1fd9-ecc5-4f5c-89c1-72764cd8fc0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:59.118399 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe98ad-2b9c-4337-b129-2a4346454c21 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:59.153800 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b78c4-2503-4389-aac1-0947806f4287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:59.154395 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b78c4-2503-4389-aac1-0947806f4287 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:59.154673 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b78c4-2503-4389-aac1-0947806f4287 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:59.154947 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b78c4-2503-4389-aac1-0947806f4287 None admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:59.155706 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b78c4-2503-4389-aac1-0947806f4287 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:59.156010 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b78c4-2503-4389-aac1-0947806f4287 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:59.157443 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b78c4-2503-4389-aac1-0947806f4287 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:59.172788 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:59.176927 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 258/508] 10.222.0.83 () {56 vars in 1137 bytes} [Mon Aug 29 15:22:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:59.177975 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b78c4-2503-4389-aac1-0947806f4287 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:59.185372 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abe1fd9-ecc5-4f5c-89c1-72764cd8fc0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:59.186816 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abe1fd9-ecc5-4f5c-89c1-72764cd8fc0f None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:59.205169 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:59.278578 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b78c4-2503-4389-aac1-0947806f4287 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:59.286906 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 251/509] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:22:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:22:59.288303 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe1fd9-ecc5-4f5c-89c1-72764cd8fc0f None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:59.313585 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c6017-7e7c-4cbe-9f55-8e06b08127ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:59.314184 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c6017-7e7c-4cbe-9f55-8e06b08127ca None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:59.314460 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c6017-7e7c-4cbe-9f55-8e06b08127ca None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:59.314727 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c6017-7e7c-4cbe-9f55-8e06b08127ca None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:59.315412 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c6017-7e7c-4cbe-9f55-8e06b08127ca None admin] RBAC: Adding query filter params (name=service) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:59.315713 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c6017-7e7c-4cbe-9f55-8e06b08127ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:59.317096 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c6017-7e7c-4cbe-9f55-8e06b08127ca None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:59.325581 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 259/510] 10.222.0.83 () {56 vars in 1103 bytes} [Mon Aug 29 15:22:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:59.325581 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c6017-7e7c-4cbe-9f55-8e06b08127ca None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:59.387415 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:59.394624 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe1fd9-ecc5-4f5c-89c1-72764cd8fc0f None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:59.412303 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:59.427965 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c6017-7e7c-4cbe-9f55-8e06b08127ca None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:59.430953 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569caea9-1815-4690-b615-b8ac95ab38a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:59.431620 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569caea9-1815-4690-b615-b8ac95ab38a9 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:59.431894 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569caea9-1815-4690-b615-b8ac95ab38a9 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:59.432158 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569caea9-1815-4690-b615-b8ac95ab38a9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:59.439140 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569caea9-1815-4690-b615-b8ac95ab38a9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:59.440607 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569caea9-1815-4690-b615-b8ac95ab38a9 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:59.452667 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-569caea9-1815-4690-b615-b8ac95ab38a9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 15:22:59.452667 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:59.452667 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:59.452667 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:59.452667 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:59.452667 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:59.452667 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:59.452667 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:59.452667 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:59.452667 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:59.452667 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:59.452667 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:59.452667 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:22:59.452667 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:22:59.452667 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:22:59.452667 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:22:59.453737 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:59.453737 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:59.453737 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:22:59.453737 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:22:59.453737 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:22:59.453737 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:22:59.453737 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:59.453737 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:59.453737 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:59.453737 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:59.453737 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:59.453737 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:59.453737 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:59.453737 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:59.453737 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:59.453737 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:59.453737 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:59.453737 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:59.454614 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:59.454614 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:59.454614 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:22:59.454614 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:22:59.454614 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:22:59.454614 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:22:59.454614 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:22:59.454614 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:22:59.454614 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 15:22:59.454614 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:22:59.454614 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 252/511] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:22:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:22:59.454614 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569caea9-1815-4690-b615-b8ac95ab38a9 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:59.467179 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e984eca-36df-4532-a3d0-ae71b92c25b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:59.467755 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e984eca-36df-4532-a3d0-ae71b92c25b9 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:59.468099 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e984eca-36df-4532-a3d0-ae71b92c25b9 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:59.468378 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e984eca-36df-4532-a3d0-ae71b92c25b9 None admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:59.469030 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e984eca-36df-4532-a3d0-ae71b92c25b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:59.469339 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e984eca-36df-4532-a3d0-ae71b92c25b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:59.470757 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e984eca-36df-4532-a3d0-ae71b92c25b9 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:59.482991 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 260/512] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:22:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:59.483896 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e984eca-36df-4532-a3d0-ae71b92c25b9 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:59.558303 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569caea9-1815-4690-b615-b8ac95ab38a9 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:59.583673 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e984eca-36df-4532-a3d0-ae71b92c25b9 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:59.591704 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce617ef-fd62-49bf-914a-71be233794ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:59.592303 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce617ef-fd62-49bf-914a-71be233794ca None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:59.592578 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce617ef-fd62-49bf-914a-71be233794ca None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:59.592843 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce617ef-fd62-49bf-914a-71be233794ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:59.606726 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:59.620540 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b31aa05-481c-434c-bb09-c218611269eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:59.621199 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b31aa05-481c-434c-bb09-c218611269eb None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:59.621483 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b31aa05-481c-434c-bb09-c218611269eb None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:59.621755 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b31aa05-481c-434c-bb09-c218611269eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:59.631689 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b31aa05-481c-434c-bb09-c218611269eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:59.633221 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b31aa05-481c-434c-bb09-c218611269eb None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:59.639499 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:59.648547 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-4b31aa05-481c-434c-bb09-c218611269eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:22:59.648547 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:59.648547 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:59.648547 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:59.648547 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:59.648547 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:59.648547 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:59.648547 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:59.648547 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:59.648547 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:59.648547 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:59.648547 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:59.648547 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:22:59.648547 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:22:59.648547 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:22:59.648547 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:22:59.649483 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:59.649483 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:59.649483 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:59.649483 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:59.649483 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:59.649483 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:59.649483 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:59.649483 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:59.649483 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:59.649483 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:59.649483 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:59.649483 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:59.649483 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:59.649483 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:59.649483 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:59.649483 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:59.649483 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:22:59.650303 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:22:59.650303 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:22:59.650303 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:22:59.650303 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 261/513] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:22:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:22:59.650518 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b31aa05-481c-434c-bb09-c218611269eb None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:59.664674 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce617ef-fd62-49bf-914a-71be233794ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:59.666098 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce617ef-fd62-49bf-914a-71be233794ca None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:59.765752 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b31aa05-481c-434c-bb09-c218611269eb None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:59.769355 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 253/514] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:22:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:22:59.770237 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce617ef-fd62-49bf-914a-71be233794ca None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:59.800252 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d248a-2639-42f3-a10f-86166a98c32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:59.800878 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d248a-2639-42f3-a10f-86166a98c32d None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:59.801156 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d248a-2639-42f3-a10f-86166a98c32d None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:59.801428 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d248a-2639-42f3-a10f-86166a98c32d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:59.812015 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d248a-2639-42f3-a10f-86166a98c32d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:59.813471 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d248a-2639-42f3-a10f-86166a98c32d None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:59.827705 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-560d248a-2639-42f3-a10f-86166a98c32d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:22:59.827705 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:22:59.827705 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:22:59.827705 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:22:59.827705 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:22:59.827705 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:22:59.827705 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:22:59.827705 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:22:59.827705 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:22:59.827705 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:22:59.827705 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:22:59.827705 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:22:59.827705 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:22:59.827705 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:22:59.827705 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:22:59.827705 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:22:59.828804 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:22:59.828804 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:22:59.828804 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:22:59.828804 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:22:59.828804 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:22:59.828804 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:22:59.828804 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:22:59.828804 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:22:59.828804 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:22:59.828804 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:22:59.828804 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:22:59.828804 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:22:59.828804 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:22:59.828804 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:22:59.828804 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:22:59.828804 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:22:59.828804 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:22:59.829656 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:22:59.829656 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:22:59.829656 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:22:59.829656 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 262/515] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:22:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:22:59.830040 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d248a-2639-42f3-a10f-86166a98c32d None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:59.851195 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:59.858425 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:22:59.873099 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce617ef-fd62-49bf-914a-71be233794ca None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:59.906636 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668d6c5-b297-4afa-b847-f0d1f568c6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:59.907263 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668d6c5-b297-4afa-b847-f0d1f568c6ca None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:59.907536 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668d6c5-b297-4afa-b847-f0d1f568c6ca None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:59.907789 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668d6c5-b297-4afa-b847-f0d1f568c6ca None admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:59.908506 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a668d6c5-b297-4afa-b847-f0d1f568c6ca None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:22:59.908801 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a668d6c5-b297-4afa-b847-f0d1f568c6ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:59.910215 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a668d6c5-b297-4afa-b847-f0d1f568c6ca None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:59.931293 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d248a-2639-42f3-a10f-86166a98c32d None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:22:59.947138 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 254/516] 10.222.0.83 () {56 vars in 1137 bytes} [Mon Aug 29 15:22:59 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:22:59.947797 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668d6c5-b297-4afa-b847-f0d1f568c6ca None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:22:59.965365 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca023537-cc2e-4ee9-9290-0c21d78f21ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:22:59.965971 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca023537-cc2e-4ee9-9290-0c21d78f21ad None admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:22:59.966255 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca023537-cc2e-4ee9-9290-0c21d78f21ad None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:22:59.966528 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca023537-cc2e-4ee9-9290-0c21d78f21ad None admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:22:59.967209 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca023537-cc2e-4ee9-9290-0c21d78f21ad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:22:59.968650 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca023537-cc2e-4ee9-9290-0c21d78f21ad None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:22:59.991397 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 263/517] 10.222.0.83 () {60 vars in 1132 bytes} [Mon Aug 29 15:22:59 2022] POST /identity/v3/users => generated 247 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:22:59.992682 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca023537-cc2e-4ee9-9290-0c21d78f21ad None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:00.071279 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668d6c5-b297-4afa-b847-f0d1f568c6ca None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:00.090466 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:00.112090 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b00de5-06f0-4748-9905-d5593f8a8474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:00.112730 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b00de5-06f0-4748-9905-d5593f8a8474 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:00.113005 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b00de5-06f0-4748-9905-d5593f8a8474 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:00.113274 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b00de5-06f0-4748-9905-d5593f8a8474 None admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:00.113931 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b00de5-06f0-4748-9905-d5593f8a8474 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:00.114229 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b00de5-06f0-4748-9905-d5593f8a8474 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:00.115805 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b00de5-06f0-4748-9905-d5593f8a8474 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:00.117260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca023537-cc2e-4ee9-9290-0c21d78f21ad None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:00.119107 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:00.131091 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 255/518] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:22:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:00.131091 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b00de5-06f0-4748-9905-d5593f8a8474 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:00.158905 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f2e456-947a-4569-90cc-1ee37cc6e9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:00.159612 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2e456-947a-4569-90cc-1ee37cc6e9f2 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:00.159894 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2e456-947a-4569-90cc-1ee37cc6e9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:00.160172 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2e456-947a-4569-90cc-1ee37cc6e9f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:00.172819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f2e456-947a-4569-90cc-1ee37cc6e9f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:00.174536 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f2e456-947a-4569-90cc-1ee37cc6e9f2 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:00.194961 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-f8f2e456-947a-4569-90cc-1ee37cc6e9f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:00.194961 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:00.194961 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:00.194961 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:00.194961 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:00.194961 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:00.194961 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:00.194961 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:00.194961 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:00.194961 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:00.194961 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:00.194961 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:00.194961 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:23:00.194961 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:23:00.194961 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:23:00.194961 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:23:00.196142 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:00.196142 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:00.196142 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:00.196142 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:00.196142 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:00.196142 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:00.196142 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:00.196142 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:00.196142 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:00.196142 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:00.196142 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:00.196142 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:00.196142 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:00.196142 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:00.196142 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:00.196142 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:00.196142 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:23:00.197106 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:23:00.197106 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:00.197106 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:00.197106 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 264/519] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:22:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:00.197106 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f2e456-947a-4569-90cc-1ee37cc6e9f2 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:00.255393 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b00de5-06f0-4748-9905-d5593f8a8474 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:00.293603 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd53c05-a247-45a6-a721-201bd24d2b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:00.294450 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd53c05-a247-45a6-a721-201bd24d2b80 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:00.294733 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd53c05-a247-45a6-a721-201bd24d2b80 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:00.295127 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd53c05-a247-45a6-a721-201bd24d2b80 None admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:00.295966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd53c05-a247-45a6-a721-201bd24d2b80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:00.296381 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd53c05-a247-45a6-a721-201bd24d2b80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:00.297882 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd53c05-a247-45a6-a721-201bd24d2b80 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:00.310892 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f2e456-947a-4569-90cc-1ee37cc6e9f2 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:00.316513 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 256/520] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:23:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:00.316513 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd53c05-a247-45a6-a721-201bd24d2b80 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:00.356171 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae79620-6f01-4fa0-9a83-216d36293fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:00.356791 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae79620-6f01-4fa0-9a83-216d36293fd1 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:00.357137 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae79620-6f01-4fa0-9a83-216d36293fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:00.357476 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae79620-6f01-4fa0-9a83-216d36293fd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:00.360240 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:00.385874 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:00.434480 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae79620-6f01-4fa0-9a83-216d36293fd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:00.435076 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd53c05-a247-45a6-a721-201bd24d2b80 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:00.436289 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae79620-6f01-4fa0-9a83-216d36293fd1 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:00.471299 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17b038-8deb-42af-afc5-9ddb3f20e75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:00.471931 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17b038-8deb-42af-afc5-9ddb3f20e75d None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:00.472204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17b038-8deb-42af-afc5-9ddb3f20e75d None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:00.472469 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17b038-8deb-42af-afc5-9ddb3f20e75d None admin] PATH_INFO: `/v3/projects/service` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:00.482769 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb17b038-8deb-42af-afc5-9ddb3f20e75d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:00.485120 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb17b038-8deb-42af-afc5-9ddb3f20e75d None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:00.499193 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-fb17b038-8deb-42af-afc5-9ddb3f20e75d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:00.499193 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:00.499193 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:00.499193 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:00.499193 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:00.499193 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:00.499193 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:00.499193 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:00.499193 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:00.499193 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:00.499193 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:00.499193 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:00.499193 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:23:00.499193 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:23:00.499193 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:23:00.500095 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:23:00.500095 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:00.500095 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:00.500095 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:00.500095 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:00.500095 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:00.500095 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:00.500095 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:00.500095 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:00.500095 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:00.500095 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:00.500095 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:00.500095 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:00.500095 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:00.500095 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:00.500095 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:00.500095 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:00.500921 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:23:00.500921 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:23:00.500921 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:23:00.500921 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:23:00.500921 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:23:00.500921 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:23:00.500921 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:00.500921 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:00.500921 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 257/521] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:23:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:00.501377 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17b038-8deb-42af-afc5-9ddb3f20e75d None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:00.548234 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 265/522] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:23:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:23:00.550004 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae79620-6f01-4fa0-9a83-216d36293fd1 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:00.584120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:00.615912 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17b038-8deb-42af-afc5-9ddb3f20e75d None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:00.632177 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:00.653024 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e539a65-c3f5-4647-b339-3929f5d66bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:00.653626 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e539a65-c3f5-4647-b339-3929f5d66bb8 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:00.653901 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e539a65-c3f5-4647-b339-3929f5d66bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:00.654197 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e539a65-c3f5-4647-b339-3929f5d66bb8 None admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:00.654794 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e539a65-c3f5-4647-b339-3929f5d66bb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:00.655119 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e539a65-c3f5-4647-b339-3929f5d66bb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:00.656483 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e539a65-c3f5-4647-b339-3929f5d66bb8 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:00.657363 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae79620-6f01-4fa0-9a83-216d36293fd1 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:00.673341 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 258/523] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:23:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:00.673341 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e539a65-c3f5-4647-b339-3929f5d66bb8 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:00.706249 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7220dd7-8a2d-4cdc-992d-d728119320da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:00.706891 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7220dd7-8a2d-4cdc-992d-d728119320da None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:00.707194 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7220dd7-8a2d-4cdc-992d-d728119320da None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:00.707466 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7220dd7-8a2d-4cdc-992d-d728119320da None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:00.715196 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7220dd7-8a2d-4cdc-992d-d728119320da None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:00.716655 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7220dd7-8a2d-4cdc-992d-d728119320da None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:00.730474 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-c7220dd7-8a2d-4cdc-992d-d728119320da None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 15:23:00.730474 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:00.730474 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:00.730474 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:00.730474 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:00.730474 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:00.730474 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:00.730474 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:00.730474 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:00.730474 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:00.730474 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:00.730474 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:00.730474 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:23:00.730474 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:23:00.730474 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:23:00.730474 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:23:00.731409 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:00.731409 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:00.731409 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:23:00.731409 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:23:00.731409 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:23:00.731409 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:23:00.731409 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:00.731409 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:00.731409 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:00.731409 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:00.731409 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:00.731409 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:00.731409 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:00.731409 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:00.731409 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:00.731409 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:00.731409 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:00.731409 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:00.732288 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:00.732288 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:00.732288 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:23:00.732288 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:23:00.732288 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:23:00.732288 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:23:00.732288 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:23:00.732288 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:23:00.732288 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 15:23:00.732288 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:00.736407 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 266/524] 10.222.0.83 () {56 vars in 1102 bytes} [Mon Aug 29 15:23:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:00.737012 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7220dd7-8a2d-4cdc-992d-d728119320da None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:00.785596 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e539a65-c3f5-4647-b339-3929f5d66bb8 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:00.823145 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a443588b-7a09-4d82-ba44-093eb5bf5130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:00.823765 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443588b-7a09-4d82-ba44-093eb5bf5130 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:00.824039 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443588b-7a09-4d82-ba44-093eb5bf5130 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:00.824311 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443588b-7a09-4d82-ba44-093eb5bf5130 None admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:00.824999 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a443588b-7a09-4d82-ba44-093eb5bf5130 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:00.825305 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a443588b-7a09-4d82-ba44-093eb5bf5130 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:00.826780 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a443588b-7a09-4d82-ba44-093eb5bf5130 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:00.845073 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:00.851280 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 259/525] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 15:23:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:00.851280 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a443588b-7a09-4d82-ba44-093eb5bf5130 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:00.858754 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7220dd7-8a2d-4cdc-992d-d728119320da None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:00.892317 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:00.897206 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f1c5b-853f-4753-998f-3bfef11a7412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:00.897849 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f1c5b-853f-4753-998f-3bfef11a7412 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:00.898129 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f1c5b-853f-4753-998f-3bfef11a7412 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:00.898408 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f1c5b-853f-4753-998f-3bfef11a7412 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:00.909317 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382f1c5b-853f-4753-998f-3bfef11a7412 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:00.910804 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382f1c5b-853f-4753-998f-3bfef11a7412 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:00.926919 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-382f1c5b-853f-4753-998f-3bfef11a7412 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:00.926919 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:00.926919 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:00.926919 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:00.926919 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:00.926919 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:00.926919 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:00.926919 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:00.926919 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:00.926919 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:00.926919 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:00.926919 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:00.926919 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:23:00.926919 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:23:00.926919 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:23:00.926919 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:23:00.928241 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:00.928241 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:00.928241 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:00.928241 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:00.928241 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:00.928241 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:00.928241 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:00.928241 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:00.928241 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:00.928241 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:00.928241 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:00.928241 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:00.928241 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:00.928241 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:00.928241 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:00.928241 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:00.928241 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:23:00.929078 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:23:00.929078 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:00.929078 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:00.929078 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 267/526] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:00.929296 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f1c5b-853f-4753-998f-3bfef11a7412 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:00.972043 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a443588b-7a09-4d82-ba44-093eb5bf5130 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:01.009213 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b4097-8d84-410b-98be-3052b2e5efc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:01.009929 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b4097-8d84-410b-98be-3052b2e5efc9 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:01.010205 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b4097-8d84-410b-98be-3052b2e5efc9 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:01.010472 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b4097-8d84-410b-98be-3052b2e5efc9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:01.017663 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725b4097-8d84-410b-98be-3052b2e5efc9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:01.019761 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725b4097-8d84-410b-98be-3052b2e5efc9 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:01.039283 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-725b4097-8d84-410b-98be-3052b2e5efc9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:01.039283 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:01.039283 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:01.039283 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:01.039283 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:01.039283 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:01.039283 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:01.039283 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:01.039283 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:01.039283 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:01.039283 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:01.039283 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:01.039283 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:23:01.039283 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:23:01.039283 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:23:01.040271 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:23:01.040271 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:01.040271 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:01.040271 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:01.040271 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:01.040271 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:01.040271 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:01.040271 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:01.040271 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:01.040271 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:01.040271 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:01.040271 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:01.040271 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:01.040271 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:01.040271 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:01.040271 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:01.040271 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:01.041092 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:23:01.041092 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:23:01.041092 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:23:01.041092 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:23:01.041092 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:23:01.041092 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:23:01.041092 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:01.041092 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:01.041494 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f1c5b-853f-4753-998f-3bfef11a7412 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:01.041574 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 260/527] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:23:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:01.041574 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b4097-8d84-410b-98be-3052b2e5efc9 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:01.084807 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee4343-6a45-4c8a-b052-63af343010c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:01.085418 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee4343-6a45-4c8a-b052-63af343010c2 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:01.085697 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee4343-6a45-4c8a-b052-63af343010c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:01.085967 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee4343-6a45-4c8a-b052-63af343010c2 None admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:01.086696 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfee4343-6a45-4c8a-b052-63af343010c2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:01.087001 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfee4343-6a45-4c8a-b052-63af343010c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:01.088490 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfee4343-6a45-4c8a-b052-63af343010c2 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:01.109457 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 268/528] 10.222.0.83 () {56 vars in 1139 bytes} [Mon Aug 29 15:23:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:01.110562 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee4343-6a45-4c8a-b052-63af343010c2 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:01.119281 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:01.154997 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:01.162973 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b4097-8d84-410b-98be-3052b2e5efc9 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:01.201773 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1980122-501b-4131-9ab0-01cd89c30b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:01.202373 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1980122-501b-4131-9ab0-01cd89c30b92 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:01.202645 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1980122-501b-4131-9ab0-01cd89c30b92 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:01.202920 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1980122-501b-4131-9ab0-01cd89c30b92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:01.203669 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1980122-501b-4131-9ab0-01cd89c30b92 None admin] RBAC: Adding query filter params (role.id=19a8fa4068774a289594739614bb8ad4, scope.project.id=44655977b0814a728f0fa73d442a7ee9, user.id=253947a5ef294d2bb828761873251bd1) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:01.203969 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1980122-501b-4131-9ab0-01cd89c30b92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:01.205409 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1980122-501b-4131-9ab0-01cd89c30b92 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:01.212192 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 261/529] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 15:23:01 2022] GET /identity/v3/role_assignments?user.id=253947a5ef294d2bb828761873251bd1&scope.project.id=44655977b0814a728f0fa73d442a7ee9&role.id=19a8fa4068774a289594739614bb8ad4 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:01.212967 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1980122-501b-4131-9ab0-01cd89c30b92 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:01.246426 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee4343-6a45-4c8a-b052-63af343010c2 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:01.286362 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2fe656-c32b-4b69-a410-bc77670022ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:01.286805 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fe656-c32b-4b69-a410-bc77670022ee None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:01.287268 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fe656-c32b-4b69-a410-bc77670022ee None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:01.288261 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fe656-c32b-4b69-a410-bc77670022ee None admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:01.289383 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2fe656-c32b-4b69-a410-bc77670022ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:01.289688 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2fe656-c32b-4b69-a410-bc77670022ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:01.291155 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2fe656-c32b-4b69-a410-bc77670022ee None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:01.309707 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 269/530] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:23:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:01.310692 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2fe656-c32b-4b69-a410-bc77670022ee None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:01.378484 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1980122-501b-4131-9ab0-01cd89c30b92 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:01.387366 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:01.420288 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015c62e-fd01-4f5e-9e84-c4e30b97bc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:01.421308 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015c62e-fd01-4f5e-9e84-c4e30b97bc29 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:01.421765 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015c62e-fd01-4f5e-9e84-c4e30b97bc29 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:01.422226 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015c62e-fd01-4f5e-9e84-c4e30b97bc29 None admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:01.423231 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c015c62e-fd01-4f5e-9e84-c4e30b97bc29 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:01.423540 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c015c62e-fd01-4f5e-9e84-c4e30b97bc29 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:01.425011 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c015c62e-fd01-4f5e-9e84-c4e30b97bc29 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:01.434924 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2fe656-c32b-4b69-a410-bc77670022ee None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:01.445733 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 262/531] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 15:23:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:01.445733 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015c62e-fd01-4f5e-9e84-c4e30b97bc29 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:01.466429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:01.482393 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed0d27e-92fe-4313-a5b3-46862fd5c1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:01.483362 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed0d27e-92fe-4313-a5b3-46862fd5c1a5 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:01.483809 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed0d27e-92fe-4313-a5b3-46862fd5c1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:01.484244 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed0d27e-92fe-4313-a5b3-46862fd5c1a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:01.555147 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015c62e-fd01-4f5e-9e84-c4e30b97bc29 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:01.561009 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed0d27e-92fe-4313-a5b3-46862fd5c1a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:01.563043 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed0d27e-92fe-4313-a5b3-46862fd5c1a5 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:01.594673 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f12dc3-0aaa-4fa4-8df0-78c23eb578a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:01.595442 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f12dc3-0aaa-4fa4-8df0-78c23eb578a2 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:01.595792 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f12dc3-0aaa-4fa4-8df0-78c23eb578a2 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:01.596134 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f12dc3-0aaa-4fa4-8df0-78c23eb578a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:01.603956 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f12dc3-0aaa-4fa4-8df0-78c23eb578a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:01.605507 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f12dc3-0aaa-4fa4-8df0-78c23eb578a2 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:01.618722 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-90f12dc3-0aaa-4fa4-8df0-78c23eb578a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:01.618722 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:01.618722 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:01.618722 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:01.618722 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:01.618722 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:01.618722 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:01.618722 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:01.618722 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:01.618722 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:01.618722 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:01.618722 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:01.618722 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:23:01.618722 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:23:01.618722 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:23:01.619634 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:23:01.619634 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:01.619634 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:01.619634 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:01.619634 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:01.619634 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:01.619634 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:01.619634 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:01.619634 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:01.619634 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:01.619634 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:01.619634 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:01.619634 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:01.619634 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:01.619634 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:01.619634 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:01.619634 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:01.620449 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:23:01.620449 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:23:01.620449 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:23:01.620449 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:23:01.620449 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:23:01.620449 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:23:01.620449 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:01.620449 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:01.623271 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 263/532] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:23:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:01.624113 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f12dc3-0aaa-4fa4-8df0-78c23eb578a2 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:01.636217 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:01.679662 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 270/533] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:23:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:23:01.680902 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed0d27e-92fe-4313-a5b3-46862fd5c1a5 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:01.728319 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:01.754870 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f12dc3-0aaa-4fa4-8df0-78c23eb578a2 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:01.794465 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70443a17-a75e-4b63-a103-02372db2fabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:01.795099 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70443a17-a75e-4b63-a103-02372db2fabe None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:01.795381 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70443a17-a75e-4b63-a103-02372db2fabe None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:01.795653 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70443a17-a75e-4b63-a103-02372db2fabe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:01.796379 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70443a17-a75e-4b63-a103-02372db2fabe None admin] RBAC: Adding query filter params (role.id=19a8fa4068774a289594739614bb8ad4, scope.project.id=44655977b0814a728f0fa73d442a7ee9, user.id=e6b0f9835ed549cab91d684326be83fa) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:01.796686 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70443a17-a75e-4b63-a103-02372db2fabe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:01.797581 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed0d27e-92fe-4313-a5b3-46862fd5c1a5 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:01.798148 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70443a17-a75e-4b63-a103-02372db2fabe None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:01.804117 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 264/534] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 15:23:01 2022] GET /identity/v3/role_assignments?user.id=e6b0f9835ed549cab91d684326be83fa&scope.project.id=44655977b0814a728f0fa73d442a7ee9&role.id=19a8fa4068774a289594739614bb8ad4 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:01.804919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70443a17-a75e-4b63-a103-02372db2fabe None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:01.873383 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839353d-8064-446c-b875-a1556f4f8570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:01.874545 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839353d-8064-446c-b875-a1556f4f8570 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:01.875121 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839353d-8064-446c-b875-a1556f4f8570 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:01.875593 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839353d-8064-446c-b875-a1556f4f8570 None admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:01.876510 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5839353d-8064-446c-b875-a1556f4f8570 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:01.877038 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5839353d-8064-446c-b875-a1556f4f8570 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:01.878724 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5839353d-8064-446c-b875-a1556f4f8570 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:01.917952 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 271/535] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 15:23:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:01.923450 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839353d-8064-446c-b875-a1556f4f8570 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:01.939177 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70443a17-a75e-4b63-a103-02372db2fabe None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:01.970633 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:01.974123 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d6432-ca7a-4209-b56c-5197317fba02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:01.975381 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d6432-ca7a-4209-b56c-5197317fba02 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:01.975659 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d6432-ca7a-4209-b56c-5197317fba02 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:01.975931 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d6432-ca7a-4209-b56c-5197317fba02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:01.987978 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d6432-ca7a-4209-b56c-5197317fba02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:01.989655 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d6432-ca7a-4209-b56c-5197317fba02 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:01.997605 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:02.006519 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-321d6432-ca7a-4209-b56c-5197317fba02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:02.006519 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:02.006519 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:02.006519 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:02.006519 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:02.006519 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:02.006519 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:02.006519 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:02.006519 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:02.006519 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:02.006519 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:02.006519 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:02.006519 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:23:02.006519 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:23:02.006519 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:23:02.006519 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:23:02.007452 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:02.007452 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:02.007452 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:02.007452 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:02.007452 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:02.007452 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:02.007452 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:02.007452 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:02.007452 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:02.007452 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:02.007452 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:02.007452 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:02.007452 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:02.007452 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:02.007452 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:02.007452 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:02.007452 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:23:02.008575 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:23:02.008575 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:02.008575 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:02.008575 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 265/536] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:02.013610 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d6432-ca7a-4209-b56c-5197317fba02 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:02.136817 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839353d-8064-446c-b875-a1556f4f8570 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:02.142173 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d6432-ca7a-4209-b56c-5197317fba02 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:02.183302 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1844930-8d34-40b0-881d-c7f80c06556c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:02.184292 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1844930-8d34-40b0-881d-c7f80c06556c None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:02.184671 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2539b039-f722-4f51-8431-3dce1db2be42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:02.184942 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1844930-8d34-40b0-881d-c7f80c06556c None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:02.185378 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1844930-8d34-40b0-881d-c7f80c06556c None admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:02.185477 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539b039-f722-4f51-8431-3dce1db2be42 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:02.185737 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539b039-f722-4f51-8431-3dce1db2be42 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:02.186080 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539b039-f722-4f51-8431-3dce1db2be42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:02.186686 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1844930-8d34-40b0-881d-c7f80c06556c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:02.186972 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2539b039-f722-4f51-8431-3dce1db2be42 None admin] RBAC: Adding query filter params (role.id=19a8fa4068774a289594739614bb8ad4, scope.project.id=44655977b0814a728f0fa73d442a7ee9, user.id=fd42634b2795427cba6614c53491ded2) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:02.187348 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1844930-8d34-40b0-881d-c7f80c06556c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:02.187540 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2539b039-f722-4f51-8431-3dce1db2be42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:02.188910 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2539b039-f722-4f51-8431-3dce1db2be42 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:02.189341 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1844930-8d34-40b0-881d-c7f80c06556c None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:02.196852 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 272/537] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 15:23:01 2022] GET /identity/v3/role_assignments?user.id=fd42634b2795427cba6614c53491ded2&scope.project.id=44655977b0814a728f0fa73d442a7ee9&role.id=19a8fa4068774a289594739614bb8ad4 => generated 259 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:23:02.204508 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e337f-0b7f-41c4-8cfe-d7f091c69de9 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:02.206890 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e337f-0b7f-41c4-8cfe-d7f091c69de9 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:02.207794 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e337f-0b7f-41c4-8cfe-d7f091c69de9 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:02.216624 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 273/538] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:02 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:23:02.218339 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 266/539] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:23:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:23:02.220007 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223471b-9089-483c-b572-d6bfb0b44ae1 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:02.220497 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223471b-9089-483c-b572-d6bfb0b44ae1 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:02.220950 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223471b-9089-483c-b572-d6bfb0b44ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:02.225322 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1844930-8d34-40b0-881d-c7f80c06556c None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:02.257986 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-5223471b-9089-483c-b572-d6bfb0b44ae1 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:02.259784 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5223471b-9089-483c-b572-d6bfb0b44ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:02.336354 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:02.367052 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 274/540] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:23:02.402483 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1844930-8d34-40b0-881d-c7f80c06556c None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:02.439181 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c51e3a3-574c-4522-b217-5a283fa13f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:02.439976 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51e3a3-574c-4522-b217-5a283fa13f93 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:02.440196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51e3a3-574c-4522-b217-5a283fa13f93 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:02.440468 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51e3a3-574c-4522-b217-5a283fa13f93 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:02.448090 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c51e3a3-574c-4522-b217-5a283fa13f93 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:02.449629 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c51e3a3-574c-4522-b217-5a283fa13f93 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:02.461538 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-1c51e3a3-574c-4522-b217-5a283fa13f93 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:02.461538 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:02.461538 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:02.461538 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:02.461538 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:02.461538 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:02.461538 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:02.461538 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:02.461538 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:02.461538 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:02.461538 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:02.461538 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:02.461538 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:23:02.461538 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:23:02.461538 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:23:02.462381 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:23:02.462381 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:02.462381 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:02.462381 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:02.462381 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:02.462381 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:02.462381 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:02.462381 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:02.462381 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:02.462381 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:02.462381 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:02.462381 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:02.462381 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:02.462381 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:02.462381 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:02.462381 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:02.462381 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:02.463227 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:23:02.463227 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:23:02.463227 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:23:02.463227 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:23:02.463227 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:23:02.463227 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:23:02.463227 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:02.463227 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:02.463227 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 267/541] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:23:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:02.468245 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223471b-9089-483c-b572-d6bfb0b44ae1 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:02.488198 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:02.589058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223471b-9089-483c-b572-d6bfb0b44ae1 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:02.625592 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4119e0-93fa-427e-ab25-3c16475f0d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:02.626197 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4119e0-93fa-427e-ab25-3c16475f0d33 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:02.626471 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4119e0-93fa-427e-ab25-3c16475f0d33 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:02.626799 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4119e0-93fa-427e-ab25-3c16475f0d33 None admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:02.627674 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4119e0-93fa-427e-ab25-3c16475f0d33 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:02.628027 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4119e0-93fa-427e-ab25-3c16475f0d33 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:02.629603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4119e0-93fa-427e-ab25-3c16475f0d33 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:02.642752 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 275/542] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 15:23:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:23:02.648433 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c51e3a3-574c-4522-b217-5a283fa13f93 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:02.712385 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4119e0-93fa-427e-ab25-3c16475f0d33 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:02.815738 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:02.841985 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4119e0-93fa-427e-ab25-3c16475f0d33 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:02.869684 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c51e3a3-574c-4522-b217-5a283fa13f93 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:02.882346 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c564fc17-e5de-44bb-9267-99a98aeeaa10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:02.883238 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564fc17-e5de-44bb-9267-99a98aeeaa10 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:02.883742 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564fc17-e5de-44bb-9267-99a98aeeaa10 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:02.884152 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564fc17-e5de-44bb-9267-99a98aeeaa10 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:02.896766 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c564fc17-e5de-44bb-9267-99a98aeeaa10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:23:02.902498 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-c564fc17-e5de-44bb-9267-99a98aeeaa10 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:23:02.902498 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:02.902498 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:02.902498 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:02.902498 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:02.902498 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:02.902498 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:02.902498 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:02.902498 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:02.902498 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:02.902498 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:02.902498 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:02.902498 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:23:02.902498 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:23:02.902498 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:23:02.902498 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:23:02.903413 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:23:02.903413 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:23:02.903413 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:23:02.903413 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:23:02.903413 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:02.903413 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:02.903413 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:02.903413 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:02.903413 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:02.903413 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:02.903413 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:02.903413 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:02.903413 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:02.903413 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:02.903413 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:02.903413 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:02.904213 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:02.904213 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:02.904213 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:02.904213 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:02.904213 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:23:02.904213 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:23:02.904213 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:23:02.904213 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:23:02.904213 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:23:02.904213 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:23:02.904213 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:23:02.904213 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:02.906201 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 276/543] 10.222.0.83 () {56 vars in 1102 bytes} [Mon Aug 29 15:23:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:23:02.916018 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c564fc17-e5de-44bb-9267-99a98aeeaa10 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:02.921568 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:02.995850 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be8029-7fce-45fd-9ca2-4099fbfc4234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:02.996389 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be8029-7fce-45fd-9ca2-4099fbfc4234 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:02.996670 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be8029-7fce-45fd-9ca2-4099fbfc4234 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:02.996943 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be8029-7fce-45fd-9ca2-4099fbfc4234 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:02.997686 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be8029-7fce-45fd-9ca2-4099fbfc4234 None admin] RBAC: Adding query filter params (role.id=19a8fa4068774a289594739614bb8ad4, scope.project.id=44655977b0814a728f0fa73d442a7ee9, user.id=9a84bb38f6454574897120223b8fc140) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:02.997994 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be8029-7fce-45fd-9ca2-4099fbfc4234 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:02.999928 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be8029-7fce-45fd-9ca2-4099fbfc4234 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:03.021020 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 268/544] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 15:23:02 2022] GET /identity/v3/role_assignments?user.id=9a84bb38f6454574897120223b8fc140&scope.project.id=44655977b0814a728f0fa73d442a7ee9&role.id=19a8fa4068774a289594739614bb8ad4 => generated 259 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:03.038605 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c564fc17-e5de-44bb-9267-99a98aeeaa10 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:03.128261 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac5f77-9e2c-4139-b10f-def9b14cb649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:03.129085 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac5f77-9e2c-4139-b10f-def9b14cb649 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:03.129363 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac5f77-9e2c-4139-b10f-def9b14cb649 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:03.129634 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac5f77-9e2c-4139-b10f-def9b14cb649 None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:03.130543 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac5f77-9e2c-4139-b10f-def9b14cb649 None admin] RBAC: Adding query filter params (name=service) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:03.131537 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac5f77-9e2c-4139-b10f-def9b14cb649 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:03.133623 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac5f77-9e2c-4139-b10f-def9b14cb649 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:03.143465 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:03.151343 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 277/545] 10.222.0.83 () {56 vars in 1103 bytes} [Mon Aug 29 15:23:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:03.160188 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be8029-7fce-45fd-9ca2-4099fbfc4234 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:03.263043 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a93a3b-aa92-48b7-9975-8aa66b4e1b05 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:03.263229 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a93a3b-aa92-48b7-9975-8aa66b4e1b05 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:03.263501 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a93a3b-aa92-48b7-9975-8aa66b4e1b05 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:03.265092 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 278/546] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:23:03.284453 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8cb82-1e71-477c-9648-288b77c3de87 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:03.284756 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8cb82-1e71-477c-9648-288b77c3de87 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:03.285001 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8cb82-1e71-477c-9648-288b77c3de87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:03.312073 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be8029-7fce-45fd-9ca2-4099fbfc4234 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:03.323458 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-fdf8cb82-1e71-477c-9648-288b77c3de87 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:03.324651 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-fdf8cb82-1e71-477c-9648-288b77c3de87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:03.349377 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863d56f-b9f7-4bcb-b8d0-9932e86238bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:03.350098 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863d56f-b9f7-4bcb-b8d0-9932e86238bc None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:03.350386 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863d56f-b9f7-4bcb-b8d0-9932e86238bc None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:03.350664 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863d56f-b9f7-4bcb-b8d0-9932e86238bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:03.362633 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d863d56f-b9f7-4bcb-b8d0-9932e86238bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:03.364136 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d863d56f-b9f7-4bcb-b8d0-9932e86238bc None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:03.379393 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-d863d56f-b9f7-4bcb-b8d0-9932e86238bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:03.379393 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:03.379393 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:03.379393 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:03.379393 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:03.379393 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:03.379393 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:03.379393 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:03.379393 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:03.379393 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:03.379393 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:03.379393 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:03.379393 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:23:03.379393 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:23:03.379393 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:23:03.379393 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:23:03.380303 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:03.380303 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:03.380303 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:03.380303 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:03.380303 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:03.380303 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:03.380303 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:03.380303 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:03.380303 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:03.380303 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:03.380303 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:03.380303 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:03.380303 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:03.380303 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:03.380303 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:03.380303 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:03.380303 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:23:03.382439 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:23:03.382439 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:03.382439 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:03.382439 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 269/547] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:03.387012 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863d56f-b9f7-4bcb-b8d0-9932e86238bc None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:03.420001 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:03.496627 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863d56f-b9f7-4bcb-b8d0-9932e86238bc None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:03.534246 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a48c7d-7b99-4654-99ac-5d5164b38233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:03.534781 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a48c7d-7b99-4654-99ac-5d5164b38233 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:03.535090 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a48c7d-7b99-4654-99ac-5d5164b38233 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:03.535382 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a48c7d-7b99-4654-99ac-5d5164b38233 None admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:03.536031 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a48c7d-7b99-4654-99ac-5d5164b38233 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:03.536342 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a48c7d-7b99-4654-99ac-5d5164b38233 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:03.538196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a48c7d-7b99-4654-99ac-5d5164b38233 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:03.551416 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 270/548] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:23:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:03.558124 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a48c7d-7b99-4654-99ac-5d5164b38233 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:03.589576 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 279/549] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:23:03.664364 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:03.674026 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a48c7d-7b99-4654-99ac-5d5164b38233 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:03.717265 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9496461-db7e-4e9f-b05e-276d5b748fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:03.717897 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9496461-db7e-4e9f-b05e-276d5b748fe1 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:03.718174 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9496461-db7e-4e9f-b05e-276d5b748fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:03.718443 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9496461-db7e-4e9f-b05e-276d5b748fe1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:03.726687 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9496461-db7e-4e9f-b05e-276d5b748fe1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:03.728204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9496461-db7e-4e9f-b05e-276d5b748fe1 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:03.744164 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-e9496461-db7e-4e9f-b05e-276d5b748fe1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 15:23:03.744164 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:03.744164 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:03.744164 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:03.744164 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:03.744164 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:03.744164 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:03.744164 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:03.744164 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:03.744164 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:03.744164 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:03.744164 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:03.744164 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:23:03.744164 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:23:03.744164 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:23:03.744164 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:23:03.745568 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:03.745568 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:03.745568 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:23:03.745568 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:23:03.745568 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:23:03.745568 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:23:03.745568 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:03.745568 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:03.745568 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:03.745568 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:03.745568 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:03.745568 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:03.745568 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:03.745568 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:03.745568 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:03.745568 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:03.745568 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:03.745568 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:03.747243 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:03.747243 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:03.747243 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:23:03.747243 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:23:03.747243 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:23:03.747243 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:23:03.747243 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:23:03.747243 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:23:03.747243 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 15:23:03.747243 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:03.747243 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 271/550] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 15:23:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:23:03.759048 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf8cb82-1e71-477c-9648-288b77c3de87 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:03.859964 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf8cb82-1e71-477c-9648-288b77c3de87 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:03.895375 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af5282d-b892-400d-9b74-52f628e0a9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:03.896368 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:03.896881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5282d-b892-400d-9b74-52f628e0a9a9 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:03.897179 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5282d-b892-400d-9b74-52f628e0a9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:03.897512 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5282d-b892-400d-9b74-52f628e0a9a9 None admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:03.898457 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af5282d-b892-400d-9b74-52f628e0a9a9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:03.898798 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af5282d-b892-400d-9b74-52f628e0a9a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:03.900442 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af5282d-b892-400d-9b74-52f628e0a9a9 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:03.920510 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 280/551] 10.222.0.83 () {56 vars in 1135 bytes} [Mon Aug 29 15:23:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:03.926144 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9496461-db7e-4e9f-b05e-276d5b748fe1 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:04.033564 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9496461-db7e-4e9f-b05e-276d5b748fe1 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:04.066600 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af5282d-b892-400d-9b74-52f628e0a9a9 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:04.079768 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe7727-d88d-4261-8cc3-8cf79eaf42f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:04.080383 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe7727-d88d-4261-8cc3-8cf79eaf42f2 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:04.080655 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe7727-d88d-4261-8cc3-8cf79eaf42f2 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:04.080923 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe7727-d88d-4261-8cc3-8cf79eaf42f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:04.107458 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:04.165578 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fe7727-d88d-4261-8cc3-8cf79eaf42f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:04.167984 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fe7727-d88d-4261-8cc3-8cf79eaf42f2 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:04.192935 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af5282d-b892-400d-9b74-52f628e0a9a9 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:04.239975 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9329ce-9f05-4beb-8b5d-7f00d161eeae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:04.241014 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9329ce-9f05-4beb-8b5d-7f00d161eeae None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:04.241440 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9329ce-9f05-4beb-8b5d-7f00d161eeae None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:04.242124 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9329ce-9f05-4beb-8b5d-7f00d161eeae None admin] PATH_INFO: `/v3/roles/service` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:04.256156 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9329ce-9f05-4beb-8b5d-7f00d161eeae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:23:04.262264 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-2d9329ce-9f05-4beb-8b5d-7f00d161eeae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:23:04.262264 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:04.262264 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:04.262264 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:04.262264 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:04.262264 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:04.262264 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:04.262264 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:04.262264 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:04.262264 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:04.262264 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:04.262264 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:04.262264 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:23:04.262264 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:23:04.262264 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:23:04.262264 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:23:04.263508 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:23:04.263508 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:23:04.263508 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:23:04.263508 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:23:04.263508 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:04.263508 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:04.263508 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:04.263508 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:04.263508 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:04.263508 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:04.263508 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:04.263508 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:04.263508 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:04.263508 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:04.263508 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:04.263508 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:04.264493 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:04.264493 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:04.264493 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:04.264493 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:04.264493 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:23:04.264493 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:23:04.264493 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:23:04.264493 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:23:04.264493 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:23:04.264493 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:23:04.264493 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:23:04.264493 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:04.267306 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 281/552] 10.222.0.83 () {56 vars in 1102 bytes} [Mon Aug 29 15:23:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:23:04.269095 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cfbe2-d493-4fab-8142-e00119812008 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:04.269843 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cfbe2-d493-4fab-8142-e00119812008 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:04.270404 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cfbe2-d493-4fab-8142-e00119812008 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:04.272846 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 282/553] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:23:04.277047 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73cfbe2-d493-4fab-8142-e00119812008 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:04.303046 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 272/554] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:23:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:23:04.304686 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3390e1-508f-4925-82dc-000c3be88140 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:04.305089 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3390e1-508f-4925-82dc-000c3be88140 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:04.305368 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3390e1-508f-4925-82dc-000c3be88140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:04.326195 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-bc3390e1-508f-4925-82dc-000c3be88140 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:04.327523 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-bc3390e1-508f-4925-82dc-000c3be88140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:04.335077 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:04.390971 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:04.391792 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73cfbe2-d493-4fab-8142-e00119812008 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:04.415086 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 273/555] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:23:04.415784 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3390e1-508f-4925-82dc-000c3be88140 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:04.446665 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb3514-efea-4999-8774-d13d56cb82bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:04.447407 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb3514-efea-4999-8774-d13d56cb82bd None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:04.447750 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb3514-efea-4999-8774-d13d56cb82bd None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:04.448088 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb3514-efea-4999-8774-d13d56cb82bd None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:04.448836 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb3514-efea-4999-8774-d13d56cb82bd None admin] RBAC: Adding query filter params (name=service) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:04.449145 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb3514-efea-4999-8774-d13d56cb82bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:04.450535 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb3514-efea-4999-8774-d13d56cb82bd None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:04.467796 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 283/556] 10.222.0.83 () {56 vars in 1103 bytes} [Mon Aug 29 15:23:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:04.479902 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb3514-efea-4999-8774-d13d56cb82bd None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:04.554190 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3390e1-508f-4925-82dc-000c3be88140 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:04.590497 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8274d98-8072-495a-9a9e-965b24f0fdce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:04.591215 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8274d98-8072-495a-9a9e-965b24f0fdce None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:04.591518 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8274d98-8072-495a-9a9e-965b24f0fdce None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:04.591785 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8274d98-8072-495a-9a9e-965b24f0fdce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:04.603356 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8274d98-8072-495a-9a9e-965b24f0fdce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:04.604913 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8274d98-8072-495a-9a9e-965b24f0fdce None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:04.620830 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-b8274d98-8072-495a-9a9e-965b24f0fdce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:04.620830 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:04.620830 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:04.620830 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:04.620830 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:04.620830 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:04.620830 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:04.620830 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:04.620830 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:04.620830 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:04.620830 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:04.620830 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:04.620830 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:23:04.620830 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:23:04.620830 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:23:04.620830 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:23:04.621762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:04.621762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:04.621762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:04.621762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:04.621762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:04.621762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:04.621762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:04.621762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:04.621762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:04.621762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:04.621762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:04.621762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:04.621762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:04.621762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:04.621762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:04.621762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:04.621762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:23:04.622959 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:23:04.622959 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:04.622959 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:04.622959 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 274/557] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:04.629385 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8274d98-8072-495a-9a9e-965b24f0fdce None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:04.702354 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:04.705145 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb3514-efea-4999-8774-d13d56cb82bd None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:04.727445 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:04.758725 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a7771c-eb8d-43e4-aef0-5ee63566050b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:04.760008 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7771c-eb8d-43e4-aef0-5ee63566050b None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:04.760773 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7771c-eb8d-43e4-aef0-5ee63566050b None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:04.761270 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7771c-eb8d-43e4-aef0-5ee63566050b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:04.775974 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a7771c-eb8d-43e4-aef0-5ee63566050b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:04.778421 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a7771c-eb8d-43e4-aef0-5ee63566050b None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:04.797144 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8274d98-8072-495a-9a9e-965b24f0fdce None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:04.801402 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-62a7771c-eb8d-43e4-aef0-5ee63566050b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:04.801402 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:04.801402 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:04.801402 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:04.801402 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:04.801402 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:04.801402 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:04.801402 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:04.801402 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:04.801402 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:04.801402 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:04.801402 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:04.801402 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:23:04.801402 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:23:04.801402 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:23:04.801402 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:23:04.803939 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:04.803939 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:04.803939 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:04.803939 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:04.803939 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:04.803939 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:04.803939 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:04.803939 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:04.803939 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:04.803939 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:04.803939 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:04.803939 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:04.803939 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:04.803939 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:04.803939 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:04.803939 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:04.803939 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:23:04.804832 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:23:04.804832 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:04.804832 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:04.809939 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 284/558] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:04.811833 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94755add-39d2-447d-b4bd-c309cb312c29 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:04.812177 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94755add-39d2-447d-b4bd-c309cb312c29 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:04.812571 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94755add-39d2-447d-b4bd-c309cb312c29 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:04.818695 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 285/559] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:23:04.818695 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94755add-39d2-447d-b4bd-c309cb312c29 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:04.839834 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be897fc-6375-4a17-8367-0b5f98d7fcaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:04.840575 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be897fc-6375-4a17-8367-0b5f98d7fcaf None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:04.840876 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be897fc-6375-4a17-8367-0b5f98d7fcaf None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:04.841311 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be897fc-6375-4a17-8367-0b5f98d7fcaf None admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:04.841842 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be897fc-6375-4a17-8367-0b5f98d7fcaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:04.842166 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be897fc-6375-4a17-8367-0b5f98d7fcaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:04.843637 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be897fc-6375-4a17-8367-0b5f98d7fcaf None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:04.857000 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 275/560] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:23:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:04.857748 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be897fc-6375-4a17-8367-0b5f98d7fcaf None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:04.948276 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94755add-39d2-447d-b4bd-c309cb312c29 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:04.972152 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:04.981351 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be897fc-6375-4a17-8367-0b5f98d7fcaf None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:04.986446 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826da9dd-6cef-4f8a-bf62-7e2d89abb1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:04.987221 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826da9dd-6cef-4f8a-bf62-7e2d89abb1fc None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:04.987569 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826da9dd-6cef-4f8a-bf62-7e2d89abb1fc None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:04.987920 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826da9dd-6cef-4f8a-bf62-7e2d89abb1fc None admin] PATH_INFO: `/v3/roles/service` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:05.002595 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826da9dd-6cef-4f8a-bf62-7e2d89abb1fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:23:05.009541 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-826da9dd-6cef-4f8a-bf62-7e2d89abb1fc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:23:05.009541 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:05.009541 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:05.009541 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:05.009541 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:05.009541 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:05.009541 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:05.009541 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:05.009541 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:05.009541 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:05.009541 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:05.009541 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:05.009541 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:23:05.009541 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:23:05.009541 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:23:05.009541 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:23:05.010678 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:23:05.010678 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:23:05.010678 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:23:05.010678 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:23:05.010678 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:05.010678 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:05.010678 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:05.010678 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:05.010678 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:05.010678 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:05.010678 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:05.010678 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:05.010678 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:05.010678 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:05.010678 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:05.010678 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:05.011586 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:05.011586 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:05.011586 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:05.011586 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:05.011586 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:23:05.011586 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:23:05.011586 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:23:05.011586 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:23:05.011586 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:23:05.011586 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:23:05.011586 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:23:05.011586 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:05.011586 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 286/561] 10.222.0.83 () {56 vars in 1102 bytes} [Mon Aug 29 15:23:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:05.012730 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50605e1d-353d-4e6a-a072-6e0f023eaa8f None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:05.012730 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50605e1d-353d-4e6a-a072-6e0f023eaa8f None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:05.012907 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50605e1d-353d-4e6a-a072-6e0f023eaa8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:05.027179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d57ce0-4477-4cd0-83da-1a4b34785d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:05.027793 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d57ce0-4477-4cd0-83da-1a4b34785d08 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:05.028072 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d57ce0-4477-4cd0-83da-1a4b34785d08 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:05.028368 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d57ce0-4477-4cd0-83da-1a4b34785d08 None admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:05.029025 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d57ce0-4477-4cd0-83da-1a4b34785d08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:05.029371 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d57ce0-4477-4cd0-83da-1a4b34785d08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:05.030835 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d57ce0-4477-4cd0-83da-1a4b34785d08 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:05.032944 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-50605e1d-353d-4e6a-a072-6e0f023eaa8f None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:05.034555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-50605e1d-353d-4e6a-a072-6e0f023eaa8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:05.047972 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 276/562] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:23:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:05.047972 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d57ce0-4477-4cd0-83da-1a4b34785d08 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:05.055459 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:05.115959 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 287/563] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:23:05.116925 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50605e1d-353d-4e6a-a072-6e0f023eaa8f None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:05.162169 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d57ce0-4477-4cd0-83da-1a4b34785d08 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:05.208265 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5938be51-58f0-430c-b7e7-694777e2abd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:05.209019 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938be51-58f0-430c-b7e7-694777e2abd2 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:05.209276 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938be51-58f0-430c-b7e7-694777e2abd2 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:05.209619 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938be51-58f0-430c-b7e7-694777e2abd2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:05.220081 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5938be51-58f0-430c-b7e7-694777e2abd2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:05.221554 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5938be51-58f0-430c-b7e7-694777e2abd2 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:05.242132 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-5938be51-58f0-430c-b7e7-694777e2abd2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:05.242132 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:05.242132 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:05.242132 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:05.242132 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:05.242132 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:05.242132 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:05.242132 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:05.242132 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:05.242132 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:05.242132 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:05.242132 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:05.242132 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:23:05.242132 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:23:05.242132 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:23:05.243469 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:23:05.243469 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:05.243469 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:05.243469 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:05.243469 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:05.243469 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:05.243469 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:05.243469 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:05.243469 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:05.243469 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:05.243469 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:05.243469 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:05.243469 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:05.243469 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:05.243469 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:05.243469 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:05.243469 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:05.244355 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:23:05.244355 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:23:05.244355 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:23:05.244355 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:23:05.244355 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:23:05.244355 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:23:05.244355 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:05.244355 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:05.244355 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 277/564] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:23:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:05.244857 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5938be51-58f0-430c-b7e7-694777e2abd2 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:05.261533 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50605e1d-353d-4e6a-a072-6e0f023eaa8f None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:05.263678 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:05.303682 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e55ac9-8ff4-4baf-8a6f-e7198a2b0100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:05.304623 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e55ac9-8ff4-4baf-8a6f-e7198a2b0100 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:05.304941 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e55ac9-8ff4-4baf-8a6f-e7198a2b0100 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:05.305219 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e55ac9-8ff4-4baf-8a6f-e7198a2b0100 None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:05.305993 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e55ac9-8ff4-4baf-8a6f-e7198a2b0100 None admin] RBAC: Adding query filter params (name=service) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:05.306320 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e55ac9-8ff4-4baf-8a6f-e7198a2b0100 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:05.308115 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e55ac9-8ff4-4baf-8a6f-e7198a2b0100 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:05.316967 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 288/565] 10.222.0.83 () {56 vars in 1103 bytes} [Mon Aug 29 15:23:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:05.317897 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e55ac9-8ff4-4baf-8a6f-e7198a2b0100 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:05.335430 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:05.359774 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5938be51-58f0-430c-b7e7-694777e2abd2 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:05.398772 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e431e9c-bd37-4b9a-ac4a-bcea5e3114f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:05.399562 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e431e9c-bd37-4b9a-ac4a-bcea5e3114f4 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:05.399922 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e431e9c-bd37-4b9a-ac4a-bcea5e3114f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:05.400270 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e431e9c-bd37-4b9a-ac4a-bcea5e3114f4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:05.409487 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e431e9c-bd37-4b9a-ac4a-bcea5e3114f4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:05.411112 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e431e9c-bd37-4b9a-ac4a-bcea5e3114f4 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:05.424621 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-3e431e9c-bd37-4b9a-ac4a-bcea5e3114f4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 15:23:05.424621 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:05.424621 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:05.424621 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:05.424621 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:05.424621 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:05.424621 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:05.424621 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:05.424621 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:05.424621 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:05.424621 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:05.424621 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:05.424621 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:23:05.424621 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:23:05.424621 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:23:05.424621 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:23:05.425839 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:05.425839 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:05.425839 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:23:05.425839 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:23:05.425839 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:23:05.425839 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:23:05.425839 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:05.425839 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:05.425839 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:05.425839 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:05.425839 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:05.425839 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:05.425839 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:05.425839 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:05.425839 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:05.425839 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:05.425839 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:05.425839 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:05.427804 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:05.427804 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:05.427804 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:23:05.427804 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:23:05.427804 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:23:05.427804 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:23:05.427804 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:23:05.427804 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:23:05.427804 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 15:23:05.427804 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:05.427804 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 278/566] 10.222.0.83 () {56 vars in 1093 bytes} [Mon Aug 29 15:23:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:05.427804 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902bc49-55fa-4fb1-802c-e790673ca0fb None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:05.428819 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902bc49-55fa-4fb1-802c-e790673ca0fb None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:05.428819 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902bc49-55fa-4fb1-802c-e790673ca0fb None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:05.429815 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 279/567] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:23:05.430541 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902bc49-55fa-4fb1-802c-e790673ca0fb None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:05.438819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e55ac9-8ff4-4baf-8a6f-e7198a2b0100 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:05.472598 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1272f7-f69b-45c7-90bd-3dcc42ddb0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:05.473234 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1272f7-f69b-45c7-90bd-3dcc42ddb0bd None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:05.473615 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1272f7-f69b-45c7-90bd-3dcc42ddb0bd None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:05.474604 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1272f7-f69b-45c7-90bd-3dcc42ddb0bd None admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:05.475431 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1272f7-f69b-45c7-90bd-3dcc42ddb0bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:05.475766 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1272f7-f69b-45c7-90bd-3dcc42ddb0bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:05.477411 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1272f7-f69b-45c7-90bd-3dcc42ddb0bd None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:05.490354 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 289/568] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 15:23:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:05.491479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1272f7-f69b-45c7-90bd-3dcc42ddb0bd None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:05.515372 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:05.541986 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902bc49-55fa-4fb1-802c-e790673ca0fb None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:05.565630 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:05.578338 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14278dc-256d-4a33-9d1e-78946348cb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:05.579054 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14278dc-256d-4a33-9d1e-78946348cb07 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:05.579367 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14278dc-256d-4a33-9d1e-78946348cb07 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:05.579640 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14278dc-256d-4a33-9d1e-78946348cb07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:05.591560 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14278dc-256d-4a33-9d1e-78946348cb07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:05.592028 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1272f7-f69b-45c7-90bd-3dcc42ddb0bd None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:05.593041 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14278dc-256d-4a33-9d1e-78946348cb07 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:05.608483 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-a14278dc-256d-4a33-9d1e-78946348cb07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:05.608483 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:05.608483 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:05.608483 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:05.608483 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:05.608483 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:05.608483 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:05.608483 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:05.608483 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:05.608483 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:05.608483 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:05.608483 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:05.608483 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:23:05.608483 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:23:05.608483 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:23:05.608483 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:23:05.609475 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:05.609475 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:05.609475 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:05.609475 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:05.609475 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:05.609475 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:05.609475 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:05.609475 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:05.609475 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:05.609475 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:05.609475 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:05.609475 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:05.609475 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:05.609475 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:05.609475 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:05.609475 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:05.609475 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:23:05.610366 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:23:05.610366 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:05.610366 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:05.610366 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 280/569] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:05.610921 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c35ff7-3858-42b0-b4e4-e7d72ac1b45c None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:05.611246 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c35ff7-3858-42b0-b4e4-e7d72ac1b45c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:05.611485 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c35ff7-3858-42b0-b4e4-e7d72ac1b45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:05.628485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac78d8-7fc3-4423-989a-3b6eaafb4cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:05.629034 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-18c35ff7-3858-42b0-b4e4-e7d72ac1b45c None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:05.629160 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac78d8-7fc3-4423-989a-3b6eaafb4cd1 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:05.629373 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac78d8-7fc3-4423-989a-3b6eaafb4cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:05.629644 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac78d8-7fc3-4423-989a-3b6eaafb4cd1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:05.630336 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-18c35ff7-3858-42b0-b4e4-e7d72ac1b45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:05.640497 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bac78d8-7fc3-4423-989a-3b6eaafb4cd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:23:05.645372 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-4bac78d8-7fc3-4423-989a-3b6eaafb4cd1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:23:05.645372 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:05.645372 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:05.645372 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:05.645372 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:05.645372 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:05.645372 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:05.645372 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:05.645372 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:05.645372 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:05.645372 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:05.645372 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:05.645372 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:23:05.645372 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:23:05.645372 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:23:05.645372 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:23:05.647215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:23:05.647215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:23:05.647215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:23:05.647215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:23:05.647215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:05.647215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:05.647215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:05.647215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:05.647215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:05.647215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:05.647215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:05.647215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:05.647215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:05.647215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:05.647215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:05.647215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:05.648739 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:05.648739 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:05.648739 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:05.648739 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:05.648739 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:23:05.648739 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:23:05.648739 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:23:05.648739 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:23:05.648739 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:23:05.648739 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:23:05.648739 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:23:05.648739 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:05.648739 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 290/570] 10.222.0.83 () {56 vars in 1102 bytes} [Mon Aug 29 15:23:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:05.648739 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac78d8-7fc3-4423-989a-3b6eaafb4cd1 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:05.702978 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 281/571] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:23:05.703786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c35ff7-3858-42b0-b4e4-e7d72ac1b45c None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:05.752652 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac78d8-7fc3-4423-989a-3b6eaafb4cd1 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:05.780233 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:05.796653 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ae057-999c-4b03-8089-a4deffcd4940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:05.797269 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ae057-999c-4b03-8089-a4deffcd4940 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:05.797550 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ae057-999c-4b03-8089-a4deffcd4940 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:05.797887 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ae057-999c-4b03-8089-a4deffcd4940 None admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:05.798726 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6ae057-999c-4b03-8089-a4deffcd4940 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:05.799065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6ae057-999c-4b03-8089-a4deffcd4940 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:05.800682 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6ae057-999c-4b03-8089-a4deffcd4940 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:05.804851 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:05.826657 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 291/572] 10.222.0.83 () {56 vars in 1133 bytes} [Mon Aug 29 15:23:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:05.826657 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ae057-999c-4b03-8089-a4deffcd4940 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:05.831500 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c35ff7-3858-42b0-b4e4-e7d72ac1b45c None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:05.869318 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c21b0-069c-4053-ac24-9751942738c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:05.870163 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c21b0-069c-4053-ac24-9751942738c3 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:05.870401 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c21b0-069c-4053-ac24-9751942738c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:05.870737 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c21b0-069c-4053-ac24-9751942738c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:05.871740 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c21b0-069c-4053-ac24-9751942738c3 None admin] RBAC: Adding query filter params (role.id=19a8fa4068774a289594739614bb8ad4, scope.project.id=44655977b0814a728f0fa73d442a7ee9, user.id=b0f8e95d393f499baf44830f9fb7e583) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:05.871849 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c21b0-069c-4053-ac24-9751942738c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:05.873287 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c21b0-069c-4053-ac24-9751942738c3 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:05.879105 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 282/573] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 15:23:05 2022] GET /identity/v3/role_assignments?user.id=b0f8e95d393f499baf44830f9fb7e583&scope.project.id=44655977b0814a728f0fa73d442a7ee9&role.id=19a8fa4068774a289594739614bb8ad4 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:05.879995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c21b0-069c-4053-ac24-9751942738c3 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:05.965614 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ae057-999c-4b03-8089-a4deffcd4940 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:06.007845 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a17a6e-87d2-4a5b-bf81-389d61bcdf34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:06.008853 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a17a6e-87d2-4a5b-bf81-389d61bcdf34 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:06.009328 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a17a6e-87d2-4a5b-bf81-389d61bcdf34 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:06.009604 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a17a6e-87d2-4a5b-bf81-389d61bcdf34 None admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:06.010270 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a17a6e-87d2-4a5b-bf81-389d61bcdf34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:06.010585 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a17a6e-87d2-4a5b-bf81-389d61bcdf34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:06.012095 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a17a6e-87d2-4a5b-bf81-389d61bcdf34 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:06.012425 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c21b0-069c-4053-ac24-9751942738c3 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:06.025784 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 292/574] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:23:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:06.026656 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a17a6e-87d2-4a5b-bf81-389d61bcdf34 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:06.042870 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:06.060619 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218fef3-0e51-4128-91d7-b7511dd2b645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:06.061323 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218fef3-0e51-4128-91d7-b7511dd2b645 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:06.061604 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218fef3-0e51-4128-91d7-b7511dd2b645 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:06.061874 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218fef3-0e51-4128-91d7-b7511dd2b645 None admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:06.062538 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1218fef3-0e51-4128-91d7-b7511dd2b645 None admin] RBAC: Adding query filter params (name=service) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:06.062835 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1218fef3-0e51-4128-91d7-b7511dd2b645 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:06.064283 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1218fef3-0e51-4128-91d7-b7511dd2b645 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:06.078004 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 283/575] 10.222.0.83 () {56 vars in 1103 bytes} [Mon Aug 29 15:23:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:06.078004 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218fef3-0e51-4128-91d7-b7511dd2b645 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:06.094725 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:06.145477 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a17a6e-87d2-4a5b-bf81-389d61bcdf34 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:06.181897 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218fef3-0e51-4128-91d7-b7511dd2b645 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:06.187265 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01d6a7-b96b-44ce-aa50-b94a225a7c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:06.188115 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01d6a7-b96b-44ce-aa50-b94a225a7c1d None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:06.188571 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01d6a7-b96b-44ce-aa50-b94a225a7c1d None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:06.189053 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01d6a7-b96b-44ce-aa50-b94a225a7c1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:06.201133 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af01d6a7-b96b-44ce-aa50-b94a225a7c1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:06.202619 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af01d6a7-b96b-44ce-aa50-b94a225a7c1d None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:06.217764 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-af01d6a7-b96b-44ce-aa50-b94a225a7c1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:06.217764 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:06.217764 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:06.217764 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:06.217764 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:06.217764 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:06.217764 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:06.217764 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:06.217764 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:06.217764 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:06.217764 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:06.217764 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:06.217764 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:23:06.217764 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:23:06.217764 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:23:06.217764 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:23:06.218757 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:06.218757 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:06.218757 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:06.218757 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:06.218757 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:06.218757 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:06.218757 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:06.218757 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:06.218757 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:06.218757 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:06.218757 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:06.218757 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:06.218757 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:06.218757 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:06.218757 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:06.218757 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:06.218757 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:23:06.219703 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:23:06.219703 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:06.219703 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:06.219703 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 293/576] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:06.219703 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01d6a7-b96b-44ce-aa50-b94a225a7c1d None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:06.224045 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edddff9-0d79-452a-8488-f7f43c360df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:06.224700 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edddff9-0d79-452a-8488-f7f43c360df1 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:06.224977 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edddff9-0d79-452a-8488-f7f43c360df1 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:06.225240 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edddff9-0d79-452a-8488-f7f43c360df1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:06.236570 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edddff9-0d79-452a-8488-f7f43c360df1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:23:06.242176 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-1edddff9-0d79-452a-8488-f7f43c360df1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:23:06.242176 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:06.242176 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:06.242176 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:06.242176 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:06.242176 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:06.242176 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:06.242176 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:06.242176 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:06.242176 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:06.242176 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:06.242176 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:06.242176 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:23:06.242176 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:23:06.242176 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:23:06.242176 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:23:06.243139 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:23:06.243139 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:23:06.243139 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:23:06.243139 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:23:06.243139 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:06.243139 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:06.243139 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:06.243139 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:06.243139 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:06.243139 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:06.243139 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:06.243139 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:06.243139 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:06.243139 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:06.243139 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:06.243139 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:06.243957 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:06.243957 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:06.243957 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:06.243957 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:06.243957 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:23:06.243957 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:23:06.243957 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:23:06.243957 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:23:06.243957 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:23:06.243957 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:23:06.243957 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:23:06.243957 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:06.243957 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 284/577] 10.222.0.83 () {56 vars in 1102 bytes} [Mon Aug 29 15:23:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:06.245076 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edddff9-0d79-452a-8488-f7f43c360df1 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:06.297495 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:06.340995 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01d6a7-b96b-44ce-aa50-b94a225a7c1d None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:06.344260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:06.361843 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edddff9-0d79-452a-8488-f7f43c360df1 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:06.379252 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f11492-28ae-4f6d-b29e-470f402e4f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:06.380709 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f11492-28ae-4f6d-b29e-470f402e4f77 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:06.380989 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f11492-28ae-4f6d-b29e-470f402e4f77 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:06.381263 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f11492-28ae-4f6d-b29e-470f402e4f77 None admin] PATH_INFO: `/v3/users/glance` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:06.391008 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f11492-28ae-4f6d-b29e-470f402e4f77 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:06.392826 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f11492-28ae-4f6d-b29e-470f402e4f77 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:06.401793 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a8a15-1a54-4d3f-bf33-a821f3194409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:06.402429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a8a15-1a54-4d3f-bf33-a821f3194409 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:06.402735 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a8a15-1a54-4d3f-bf33-a821f3194409 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:06.403225 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a8a15-1a54-4d3f-bf33-a821f3194409 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:06.405297 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-83f11492-28ae-4f6d-b29e-470f402e4f77 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 15:23:06.405297 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:06.405297 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:06.405297 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:06.405297 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:06.405297 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:06.405297 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:06.405297 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:06.405297 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:06.405297 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:06.405297 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:06.405297 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:06.405297 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:23:06.405297 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:23:06.405297 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:23:06.405297 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:23:06.406207 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:06.406207 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:06.406207 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:23:06.406207 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:23:06.406207 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:23:06.406207 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:23:06.406207 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:06.406207 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:06.406207 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:06.406207 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:06.406207 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:06.406207 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:06.406207 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:06.406207 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:06.406207 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:06.406207 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:06.406207 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:06.406207 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:06.407580 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:06.407580 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:06.407580 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:23:06.407580 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:23:06.407580 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:23:06.407580 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:23:06.407580 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:23:06.407580 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:23:06.407580 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 15:23:06.407580 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:06.411870 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 294/578] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:23:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:06.412907 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f11492-28ae-4f6d-b29e-470f402e4f77 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:06.418903 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a8a15-1a54-4d3f-bf33-a821f3194409 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:06.420786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a8a15-1a54-4d3f-bf33-a821f3194409 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:06.448374 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-4b1a8a15-1a54-4d3f-bf33-a821f3194409 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:06.448374 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:06.448374 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:06.448374 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:06.448374 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:06.448374 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:06.448374 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:06.448374 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:06.448374 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:06.448374 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:06.448374 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:06.448374 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:06.448374 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:23:06.448374 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:23:06.448374 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:23:06.448374 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:23:06.449360 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:06.449360 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:06.449360 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:06.449360 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:06.449360 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:06.449360 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:06.449360 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:06.449360 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:06.449360 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:06.449360 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:06.449360 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:06.449360 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:06.449360 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:06.449360 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:06.449360 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:06.449360 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:06.449360 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:23:06.450235 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:23:06.450235 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:06.450235 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:06.451165 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 285/579] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:06.452077 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a8a15-1a54-4d3f-bf33-a821f3194409 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:06.527737 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f11492-28ae-4f6d-b29e-470f402e4f77 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:06.565470 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:06.572252 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e7840-7d73-4732-9f59-3ce24c50ea99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:06.573019 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e7840-7d73-4732-9f59-3ce24c50ea99 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:06.573485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e7840-7d73-4732-9f59-3ce24c50ea99 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:06.573760 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a8a15-1a54-4d3f-bf33-a821f3194409 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:06.574012 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e7840-7d73-4732-9f59-3ce24c50ea99 None admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:06.574770 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e7840-7d73-4732-9f59-3ce24c50ea99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:06.575381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e7840-7d73-4732-9f59-3ce24c50ea99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:06.577508 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e7840-7d73-4732-9f59-3ce24c50ea99 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:06.594982 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 295/580] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:23:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:06.594982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e7840-7d73-4732-9f59-3ce24c50ea99 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:06.614575 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b015e9-51f6-4200-89ac-b4742410ed67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:06.615215 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b015e9-51f6-4200-89ac-b4742410ed67 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:06.615488 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b015e9-51f6-4200-89ac-b4742410ed67 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:06.615758 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b015e9-51f6-4200-89ac-b4742410ed67 None admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:06.616737 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b015e9-51f6-4200-89ac-b4742410ed67 None admin] RBAC: Adding query filter params (name=service) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:06.617264 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b015e9-51f6-4200-89ac-b4742410ed67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:06.618404 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:06.619260 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b015e9-51f6-4200-89ac-b4742410ed67 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:06.632704 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 286/581] 10.222.0.83 () {56 vars in 1103 bytes} [Mon Aug 29 15:23:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:06.632704 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b015e9-51f6-4200-89ac-b4742410ed67 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:06.706863 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e7840-7d73-4732-9f59-3ce24c50ea99 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:06.737956 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b015e9-51f6-4200-89ac-b4742410ed67 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:06.751990 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90e95d-7deb-494a-949f-3cfed75b0594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:06.752596 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90e95d-7deb-494a-949f-3cfed75b0594 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:06.752872 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90e95d-7deb-494a-949f-3cfed75b0594 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:06.753445 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90e95d-7deb-494a-949f-3cfed75b0594 None admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:06.753843 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90e95d-7deb-494a-949f-3cfed75b0594 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:06.754143 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90e95d-7deb-494a-949f-3cfed75b0594 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:06.756381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90e95d-7deb-494a-949f-3cfed75b0594 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:06.774699 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 296/582] 10.222.0.83 () {56 vars in 1137 bytes} [Mon Aug 29 15:23:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:06.775573 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90e95d-7deb-494a-949f-3cfed75b0594 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:06.786587 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41260e81-58e2-466b-bbc6-0835b91c40ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:06.787822 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41260e81-58e2-466b-bbc6-0835b91c40ed None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:06.788510 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41260e81-58e2-466b-bbc6-0835b91c40ed None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:06.789312 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41260e81-58e2-466b-bbc6-0835b91c40ed None admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:06.790107 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41260e81-58e2-466b-bbc6-0835b91c40ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:06.790559 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41260e81-58e2-466b-bbc6-0835b91c40ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:06.792528 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41260e81-58e2-466b-bbc6-0835b91c40ed None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:06.805627 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 287/583] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:23:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:06.806767 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41260e81-58e2-466b-bbc6-0835b91c40ed None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:06.827601 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:06.868842 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:06.891633 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90e95d-7deb-494a-949f-3cfed75b0594 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:06.920299 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41260e81-58e2-466b-bbc6-0835b91c40ed None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:06.932246 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a3c5c-ba0f-4eac-9886-97443167b97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:06.933141 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a3c5c-ba0f-4eac-9886-97443167b97e None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:06.933141 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a3c5c-ba0f-4eac-9886-97443167b97e None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:06.933426 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a3c5c-ba0f-4eac-9886-97443167b97e None admin] PATH_INFO: `/v3/projects/service` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:06.940925 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1a3c5c-ba0f-4eac-9886-97443167b97e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:06.942376 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1a3c5c-ba0f-4eac-9886-97443167b97e None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:06.954240 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-fe1a3c5c-ba0f-4eac-9886-97443167b97e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:06.954240 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:06.954240 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:06.954240 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:06.954240 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:06.954240 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:06.954240 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:06.954240 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:06.954240 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:06.954240 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:06.954240 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:06.954240 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:06.954240 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:23:06.954240 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:23:06.954240 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:23:06.955183 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:23:06.955183 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:06.955183 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:06.955183 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:06.955183 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:06.955183 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:06.955183 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:06.955183 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:06.955183 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:06.955183 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:06.955183 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:06.955183 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:06.955183 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:06.955183 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:06.955183 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:06.955183 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:06.955183 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:06.956097 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:23:06.956097 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:23:06.956097 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:23:06.956097 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:23:06.956097 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:23:06.956097 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:23:06.956097 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:06.956097 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:06.956097 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 297/584] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:23:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:06.956575 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a3c5c-ba0f-4eac-9886-97443167b97e None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:06.963123 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f81e91-b282-4b04-b3ce-d9c3900aa27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:06.963768 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f81e91-b282-4b04-b3ce-d9c3900aa27c None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:06.964041 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f81e91-b282-4b04-b3ce-d9c3900aa27c None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:06.964309 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f81e91-b282-4b04-b3ce-d9c3900aa27c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:06.976200 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f81e91-b282-4b04-b3ce-d9c3900aa27c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:06.977858 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f81e91-b282-4b04-b3ce-d9c3900aa27c None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:06.996090 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-56f81e91-b282-4b04-b3ce-d9c3900aa27c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:06.996090 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:06.996090 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:06.996090 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:06.996090 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:06.996090 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:06.996090 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:06.996090 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:06.996090 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:06.996090 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:06.996090 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:06.996090 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:06.996090 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:23:06.996090 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:23:06.996090 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:23:06.996090 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:23:06.997353 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:06.997353 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:06.997353 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:06.997353 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:06.997353 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:06.997353 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:06.997353 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:06.997353 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:06.997353 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:06.997353 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:06.997353 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:06.997353 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:06.997353 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:06.997353 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:06.997353 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:06.997353 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:06.997353 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:23:06.998437 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:23:06.998437 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:06.998437 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:07.001797 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 288/585] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:07.002566 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f81e91-b282-4b04-b3ce-d9c3900aa27c None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:07.070609 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a3c5c-ba0f-4eac-9886-97443167b97e None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:07.072205 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:07.109849 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f81e91-b282-4b04-b3ce-d9c3900aa27c None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:07.111252 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732254bb-71b6-4839-b770-dadc017b754f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:07.111882 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732254bb-71b6-4839-b770-dadc017b754f None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:07.112160 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732254bb-71b6-4839-b770-dadc017b754f None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:07.113058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732254bb-71b6-4839-b770-dadc017b754f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:07.123366 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732254bb-71b6-4839-b770-dadc017b754f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:07.124823 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732254bb-71b6-4839-b770-dadc017b754f None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:07.126818 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:07.141159 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-732254bb-71b6-4839-b770-dadc017b754f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:07.141159 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:07.141159 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:07.141159 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:07.141159 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:07.141159 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:07.141159 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:07.141159 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:07.141159 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:07.141159 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:07.141159 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:07.141159 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:07.141159 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:23:07.141159 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:23:07.141159 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:23:07.141159 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:23:07.142117 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:07.142117 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:07.142117 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:07.142117 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:07.142117 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:07.142117 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:07.142117 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:07.142117 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:07.142117 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:07.142117 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:07.142117 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:07.142117 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:07.142117 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:07.142117 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:07.142117 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:07.142117 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:07.142117 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:23:07.143015 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:23:07.143015 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:07.143015 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:07.143015 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 298/586] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:07.143015 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732254bb-71b6-4839-b770-dadc017b754f None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:07.151628 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4970b4f-2200-4898-945c-145991c6eba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:07.152270 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4970b4f-2200-4898-945c-145991c6eba2 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:07.152547 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4970b4f-2200-4898-945c-145991c6eba2 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:07.152817 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4970b4f-2200-4898-945c-145991c6eba2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:07.161734 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4970b4f-2200-4898-945c-145991c6eba2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:07.163221 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4970b4f-2200-4898-945c-145991c6eba2 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:07.174654 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-e4970b4f-2200-4898-945c-145991c6eba2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 15:23:07.174654 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:07.174654 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:07.174654 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:07.174654 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:07.174654 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:07.174654 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:07.174654 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:07.174654 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:07.174654 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:07.174654 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:07.174654 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:07.174654 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:23:07.174654 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:23:07.174654 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:23:07.174654 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:23:07.175626 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:07.175626 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:07.175626 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:23:07.175626 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:23:07.175626 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:23:07.175626 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:23:07.175626 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:07.175626 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:07.175626 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:07.175626 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:07.175626 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:07.175626 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:07.175626 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:07.175626 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:07.175626 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:07.175626 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:07.175626 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:07.175626 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:07.176620 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:07.176620 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:07.176620 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:23:07.176620 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:23:07.176620 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:23:07.176620 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:23:07.176620 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:23:07.176620 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:23:07.176620 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 15:23:07.176620 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:07.176620 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 289/587] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:23:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:07.176620 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4970b4f-2200-4898-945c-145991c6eba2 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:07.260321 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732254bb-71b6-4839-b770-dadc017b754f None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:07.286665 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4970b4f-2200-4898-945c-145991c6eba2 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:07.297715 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c257c37-84aa-48cb-b6e1-5dbc3b5298ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:07.298326 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c257c37-84aa-48cb-b6e1-5dbc3b5298ac None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:07.298605 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c257c37-84aa-48cb-b6e1-5dbc3b5298ac None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:07.298872 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c257c37-84aa-48cb-b6e1-5dbc3b5298ac None admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:07.299592 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c257c37-84aa-48cb-b6e1-5dbc3b5298ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:07.300001 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c257c37-84aa-48cb-b6e1-5dbc3b5298ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:07.302097 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c257c37-84aa-48cb-b6e1-5dbc3b5298ac None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:07.314470 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:07.316142 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 299/588] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 15:23:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:07.316764 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c257c37-84aa-48cb-b6e1-5dbc3b5298ac None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:07.328310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b822b-8b14-48d0-98f1-30c6fdc83725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:07.328915 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b822b-8b14-48d0-98f1-30c6fdc83725 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:07.329190 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b822b-8b14-48d0-98f1-30c6fdc83725 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:07.329464 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b822b-8b14-48d0-98f1-30c6fdc83725 None admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:07.330102 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b822b-8b14-48d0-98f1-30c6fdc83725 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:07.330401 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b822b-8b14-48d0-98f1-30c6fdc83725 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:07.332106 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b822b-8b14-48d0-98f1-30c6fdc83725 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:07.344709 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 290/589] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:23:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:07.345519 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b822b-8b14-48d0-98f1-30c6fdc83725 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:07.378590 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:07.427268 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c257c37-84aa-48cb-b6e1-5dbc3b5298ac None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:07.454899 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b822b-8b14-48d0-98f1-30c6fdc83725 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:07.463540 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027330b3-350c-4db9-a6e1-fd6d4dd32c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:07.464382 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027330b3-350c-4db9-a6e1-fd6d4dd32c4b None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:07.464814 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027330b3-350c-4db9-a6e1-fd6d4dd32c4b None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:07.465087 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027330b3-350c-4db9-a6e1-fd6d4dd32c4b None admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:07.465735 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027330b3-350c-4db9-a6e1-fd6d4dd32c4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:07.466036 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027330b3-350c-4db9-a6e1-fd6d4dd32c4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:07.467444 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027330b3-350c-4db9-a6e1-fd6d4dd32c4b None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:07.479432 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 300/590] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:23:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:07.480230 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027330b3-350c-4db9-a6e1-fd6d4dd32c4b None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:07.496439 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44904318-3319-4919-91af-baba47caedef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:07.497050 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44904318-3319-4919-91af-baba47caedef None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:07.497324 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44904318-3319-4919-91af-baba47caedef None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:07.497592 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44904318-3319-4919-91af-baba47caedef None admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:07.498326 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44904318-3319-4919-91af-baba47caedef None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:07.498632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44904318-3319-4919-91af-baba47caedef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:07.500109 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44904318-3319-4919-91af-baba47caedef None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:07.518490 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 291/591] 10.222.0.83 () {56 vars in 1137 bytes} [Mon Aug 29 15:23:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:07.519603 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44904318-3319-4919-91af-baba47caedef None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:07.568674 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:07.598171 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027330b3-350c-4db9-a6e1-fd6d4dd32c4b None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:07.613620 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:07.625122 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44904318-3319-4919-91af-baba47caedef None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:07.636684 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a970e2a-b278-4a71-a7be-6de9182b96fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:07.637280 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a970e2a-b278-4a71-a7be-6de9182b96fb None admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:07.637565 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a970e2a-b278-4a71-a7be-6de9182b96fb None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:07.637850 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a970e2a-b278-4a71-a7be-6de9182b96fb None admin] PATH_INFO: `/v3/projects/44655977b0814a728f0fa73d442a7ee9/users/253947a5ef294d2bb828761873251bd1/roles/19a8fa4068774a289594739614bb8ad4` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:07.652799 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a970e2a-b278-4a71-a7be-6de9182b96fb None admin] RBAC: Authorizing `identity:create_grant(project_id=44655977b0814a728f0fa73d442a7ee9, user_id=253947a5ef294d2bb828761873251bd1, role_id=19a8fa4068774a289594739614bb8ad4)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:07.654242 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a970e2a-b278-4a71-a7be-6de9182b96fb None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:07.665165 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118cddf0-b71c-46b8-9ee3-b202334068db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:07.665752 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118cddf0-b71c-46b8-9ee3-b202334068db None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:07.666026 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118cddf0-b71c-46b8-9ee3-b202334068db None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:07.666298 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118cddf0-b71c-46b8-9ee3-b202334068db None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:07.674921 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 301/592] 10.222.0.83 () {58 vars in 1439 bytes} [Mon Aug 29 15:23:07 2022] PUT /identity/v3/projects/44655977b0814a728f0fa73d442a7ee9/users/253947a5ef294d2bb828761873251bd1/roles/19a8fa4068774a289594739614bb8ad4 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:23:07.674921 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a970e2a-b278-4a71-a7be-6de9182b96fb None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:07.677448 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118cddf0-b71c-46b8-9ee3-b202334068db None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:07.677574 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118cddf0-b71c-46b8-9ee3-b202334068db None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:07.690402 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-118cddf0-b71c-46b8-9ee3-b202334068db None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 15:23:07.690402 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:07.690402 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:07.690402 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:07.690402 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:07.690402 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:07.690402 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:07.690402 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:07.690402 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:07.690402 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:07.690402 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:07.690402 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:07.690402 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:23:07.690402 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:23:07.690402 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:23:07.690402 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:23:07.691438 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:07.691438 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:07.691438 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:23:07.691438 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:23:07.691438 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:23:07.691438 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:23:07.691438 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:07.691438 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:07.691438 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:07.691438 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:07.691438 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:07.691438 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:07.691438 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:07.691438 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:07.691438 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:07.691438 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:07.691438 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:07.691438 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:07.692438 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:07.692438 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:07.692438 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:23:07.692438 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:23:07.692438 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:23:07.692438 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:23:07.692438 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:23:07.692438 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:23:07.692438 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 15:23:07.692438 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:07.692438 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 292/593] 10.222.0.83 () {56 vars in 1102 bytes} [Mon Aug 29 15:23:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:07.692438 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118cddf0-b71c-46b8-9ee3-b202334068db None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:07.819466 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118cddf0-b71c-46b8-9ee3-b202334068db None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:07.825479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a970e2a-b278-4a71-a7be-6de9182b96fb None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:07.827771 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:07.862691 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a146f7-df67-4ded-a852-4ce79eaa0702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:07.863370 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a146f7-df67-4ded-a852-4ce79eaa0702 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:07.863801 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a146f7-df67-4ded-a852-4ce79eaa0702 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:07.864538 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a146f7-df67-4ded-a852-4ce79eaa0702 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:07.872040 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae9e34-a091-41c9-b146-66bd19d6ae91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:07.872778 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae9e34-a091-41c9-b146-66bd19d6ae91 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:07.873052 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae9e34-a091-41c9-b146-66bd19d6ae91 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:07.873318 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae9e34-a091-41c9-b146-66bd19d6ae91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:07.876606 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a146f7-df67-4ded-a852-4ce79eaa0702 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:07.878062 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a146f7-df67-4ded-a852-4ce79eaa0702 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:07.881552 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae9e34-a091-41c9-b146-66bd19d6ae91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:07.882996 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae9e34-a091-41c9-b146-66bd19d6ae91 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:07.893812 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-e7a146f7-df67-4ded-a852-4ce79eaa0702 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:07.893812 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:07.893812 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:07.893812 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:07.893812 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:07.893812 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:07.893812 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:07.893812 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:07.893812 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:07.893812 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:07.893812 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:07.893812 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:07.893812 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:23:07.893812 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:23:07.893812 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:23:07.893812 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:23:07.894744 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:07.894744 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:07.894744 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:07.894744 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:07.894744 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:07.894744 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:07.894744 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:07.894744 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:07.894744 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:07.894744 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:07.894744 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:07.894744 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:07.894744 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:07.894744 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:07.894744 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:07.894744 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:07.894744 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:23:07.896055 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:23:07.896055 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:07.896055 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:07.896227 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-fbae9e34-a091-41c9-b146-66bd19d6ae91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:07.896227 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:07.896227 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:07.896227 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:07.896227 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:07.896227 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:07.896227 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:07.896227 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:07.896227 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:07.896227 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:07.896227 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:07.896227 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:07.896227 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:23:07.896227 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:23:07.896227 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:23:07.897080 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:23:07.897080 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:07.897080 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:07.897080 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:07.897080 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:07.897080 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:07.897080 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:07.897080 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:07.897080 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:07.897080 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:07.897080 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:07.897080 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:07.897080 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:07.897080 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:07.897080 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:07.897080 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:07.897080 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:07.897988 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:23:07.897988 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:23:07.897988 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:23:07.897988 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:23:07.897988 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:23:07.897988 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:23:07.897988 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:07.897988 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:07.898454 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 293/594] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:07.898525 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 302/595] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:23:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:07.898592 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a146f7-df67-4ded-a852-4ce79eaa0702 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:07.898672 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c9cc7-0d75-4956-899c-5db1aef3db72 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:07.898672 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c9cc7-0d75-4956-899c-5db1aef3db72 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:07.898672 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c9cc7-0d75-4956-899c-5db1aef3db72 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:07.903051 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 303/596] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:23:07.903911 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10c9cc7-0d75-4956-899c-5db1aef3db72 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:07.931288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:08.014477 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a146f7-df67-4ded-a852-4ce79eaa0702 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:08.017839 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10c9cc7-0d75-4956-899c-5db1aef3db72 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:08.054089 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e92874-5466-49b8-bb9b-4c8fce6dce5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:08.054703 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e92874-5466-49b8-bb9b-4c8fce6dce5c None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:08.054983 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e92874-5466-49b8-bb9b-4c8fce6dce5c None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:08.055300 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e92874-5466-49b8-bb9b-4c8fce6dce5c None admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:08.056149 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e92874-5466-49b8-bb9b-4c8fce6dce5c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:08.056456 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e92874-5466-49b8-bb9b-4c8fce6dce5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:08.057884 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e92874-5466-49b8-bb9b-4c8fce6dce5c None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:08.057995 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58478a66-06e6-46f5-8dea-fdec73006e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:08.058494 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58478a66-06e6-46f5-8dea-fdec73006e6f None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:08.058773 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58478a66-06e6-46f5-8dea-fdec73006e6f None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:08.059063 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58478a66-06e6-46f5-8dea-fdec73006e6f None admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:08.059715 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58478a66-06e6-46f5-8dea-fdec73006e6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:08.060021 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58478a66-06e6-46f5-8dea-fdec73006e6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:08.061379 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58478a66-06e6-46f5-8dea-fdec73006e6f None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:08.079062 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 304/597] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:23:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:08.079062 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58478a66-06e6-46f5-8dea-fdec73006e6f None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:08.082936 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 294/598] 10.222.0.83 () {56 vars in 1139 bytes} [Mon Aug 29 15:23:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:08.084358 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7228ddb-8c42-4c4a-97ce-8ce5b375d2d4 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:08.084751 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7228ddb-8c42-4c4a-97ce-8ce5b375d2d4 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:08.085180 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7228ddb-8c42-4c4a-97ce-8ce5b375d2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:08.105953 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-b7228ddb-8c42-4c4a-97ce-8ce5b375d2d4 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:08.107298 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b7228ddb-8c42-4c4a-97ce-8ce5b375d2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:08.119650 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:08.169013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:08.187103 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 295/599] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:23:08.187103 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7228ddb-8c42-4c4a-97ce-8ce5b375d2d4 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:08.193897 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58478a66-06e6-46f5-8dea-fdec73006e6f None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:08.233786 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc275bd2-61e5-4050-bee7-4b2c40ca3ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:08.234930 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc275bd2-61e5-4050-bee7-4b2c40ca3ffe None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:08.236331 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc275bd2-61e5-4050-bee7-4b2c40ca3ffe None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:08.236782 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc275bd2-61e5-4050-bee7-4b2c40ca3ffe None admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:08.237630 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc275bd2-61e5-4050-bee7-4b2c40ca3ffe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:08.238087 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc275bd2-61e5-4050-bee7-4b2c40ca3ffe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:08.240415 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc275bd2-61e5-4050-bee7-4b2c40ca3ffe None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:08.257255 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 305/600] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 15:23:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:08.258314 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc275bd2-61e5-4050-bee7-4b2c40ca3ffe None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:08.322603 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7228ddb-8c42-4c4a-97ce-8ce5b375d2d4 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:08.359753 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654468d8-4560-4ee2-85e2-316f294841e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:08.360696 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654468d8-4560-4ee2-85e2-316f294841e0 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:08.361121 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654468d8-4560-4ee2-85e2-316f294841e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:08.361686 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654468d8-4560-4ee2-85e2-316f294841e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:08.369864 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654468d8-4560-4ee2-85e2-316f294841e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:08.371632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654468d8-4560-4ee2-85e2-316f294841e0 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:08.383375 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc275bd2-61e5-4050-bee7-4b2c40ca3ffe None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:08.384028 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-654468d8-4560-4ee2-85e2-316f294841e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:08.384028 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:08.384028 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:08.384028 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:08.384028 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:08.384028 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:08.384028 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:08.384028 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:08.384028 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:08.384028 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:08.384028 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:08.384028 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:08.384028 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:23:08.384028 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:23:08.384028 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:23:08.385062 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:23:08.385062 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:08.385062 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:08.385062 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:08.385062 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:08.385062 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:08.385062 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:08.385062 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:08.385062 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:08.385062 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:08.385062 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:08.385062 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:08.385062 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:08.385062 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:08.385062 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:08.385062 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:08.385062 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:08.386157 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:23:08.386157 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:23:08.386157 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:23:08.386157 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:23:08.386157 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:23:08.386157 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:23:08.386157 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:08.386157 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:08.392661 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 296/601] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:23:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:08.393625 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654468d8-4560-4ee2-85e2-316f294841e0 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:08.402839 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:08.422825 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20920bf8-965a-41d9-a514-279057cb9e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:08.423777 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20920bf8-965a-41d9-a514-279057cb9e9e None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:08.424218 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20920bf8-965a-41d9-a514-279057cb9e9e None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:08.424680 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20920bf8-965a-41d9-a514-279057cb9e9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:08.437210 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20920bf8-965a-41d9-a514-279057cb9e9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:08.439098 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20920bf8-965a-41d9-a514-279057cb9e9e None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:08.442059 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:08.456546 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-20920bf8-965a-41d9-a514-279057cb9e9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:08.456546 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:08.456546 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:08.456546 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:08.456546 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:08.456546 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:08.456546 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:08.456546 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:08.456546 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:08.456546 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:08.456546 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:08.456546 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:08.456546 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:23:08.456546 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:23:08.456546 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:23:08.456546 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:23:08.457841 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:08.457841 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:08.457841 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:08.457841 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:08.457841 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:08.457841 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:08.457841 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:08.457841 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:08.457841 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:08.457841 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:08.457841 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:08.457841 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:08.457841 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:08.457841 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:08.457841 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:08.457841 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:08.457841 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:23:08.458771 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:23:08.458771 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:08.458771 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:08.458771 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 306/602] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:08.458993 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20920bf8-965a-41d9-a514-279057cb9e9e None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:08.507812 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654468d8-4560-4ee2-85e2-316f294841e0 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:08.543690 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299442bb-9729-4637-b31b-7808831f59be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:08.544439 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299442bb-9729-4637-b31b-7808831f59be None admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:08.544718 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299442bb-9729-4637-b31b-7808831f59be None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:08.544995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299442bb-9729-4637-b31b-7808831f59be None admin] PATH_INFO: `/v3/projects/44655977b0814a728f0fa73d442a7ee9/users/e6b0f9835ed549cab91d684326be83fa/roles/19a8fa4068774a289594739614bb8ad4` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:08.561230 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299442bb-9729-4637-b31b-7808831f59be None admin] RBAC: Authorizing `identity:create_grant(project_id=44655977b0814a728f0fa73d442a7ee9, user_id=e6b0f9835ed549cab91d684326be83fa, role_id=19a8fa4068774a289594739614bb8ad4)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:08.562670 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299442bb-9729-4637-b31b-7808831f59be None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:08.563584 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20920bf8-965a-41d9-a514-279057cb9e9e None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:08.587056 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 297/603] 10.222.0.83 () {58 vars in 1439 bytes} [Mon Aug 29 15:23:08 2022] PUT /identity/v3/projects/44655977b0814a728f0fa73d442a7ee9/users/e6b0f9835ed549cab91d684326be83fa/roles/19a8fa4068774a289594739614bb8ad4 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:23:08.587056 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299442bb-9729-4637-b31b-7808831f59be None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:08.603287 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9497b-f126-469f-a986-45bb1a49737e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:08.603911 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9497b-f126-469f-a986-45bb1a49737e None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:08.604191 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9497b-f126-469f-a986-45bb1a49737e None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:08.604465 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9497b-f126-469f-a986-45bb1a49737e None admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:08.605237 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad9497b-f126-469f-a986-45bb1a49737e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:08.605546 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad9497b-f126-469f-a986-45bb1a49737e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:08.607115 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad9497b-f126-469f-a986-45bb1a49737e None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:08.621904 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 307/604] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 15:23:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:08.622693 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9497b-f126-469f-a986-45bb1a49737e None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:08.667551 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:08.702605 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:08.733708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299442bb-9729-4637-b31b-7808831f59be None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:08.768540 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9497b-f126-469f-a986-45bb1a49737e None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:08.781116 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc142747-62b8-4cc5-ba92-147fee8ca262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:08.781726 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc142747-62b8-4cc5-ba92-147fee8ca262 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:08.782003 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc142747-62b8-4cc5-ba92-147fee8ca262 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:08.782269 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc142747-62b8-4cc5-ba92-147fee8ca262 None admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:08.782912 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc142747-62b8-4cc5-ba92-147fee8ca262 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:08.783259 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc142747-62b8-4cc5-ba92-147fee8ca262 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:08.784621 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc142747-62b8-4cc5-ba92-147fee8ca262 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:08.799838 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 298/605] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:23:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:08.800660 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc142747-62b8-4cc5-ba92-147fee8ca262 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:08.815923 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c979c8aa-4a81-4c1d-a3c3-5cdf429e1954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:08.816817 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979c8aa-4a81-4c1d-a3c3-5cdf429e1954 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:08.816951 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979c8aa-4a81-4c1d-a3c3-5cdf429e1954 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:08.817174 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979c8aa-4a81-4c1d-a3c3-5cdf429e1954 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:08.829627 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c979c8aa-4a81-4c1d-a3c3-5cdf429e1954 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:23:08.835490 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-c979c8aa-4a81-4c1d-a3c3-5cdf429e1954 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:23:08.835490 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:08.835490 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:08.835490 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:08.835490 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:08.835490 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:08.835490 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:08.835490 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:08.835490 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:08.835490 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:08.835490 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:08.835490 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:08.835490 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:23:08.835490 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:23:08.835490 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:23:08.835490 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:23:08.836426 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:23:08.836426 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:23:08.836426 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:23:08.836426 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:23:08.836426 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:08.836426 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:08.836426 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:08.836426 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:08.836426 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:08.836426 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:08.836426 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:08.836426 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:08.836426 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:08.836426 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:08.836426 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:08.836426 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:08.837288 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:08.837288 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:08.837288 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:08.837288 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:08.837288 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:23:08.837288 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:23:08.837288 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:23:08.837288 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:23:08.837288 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:23:08.837288 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:23:08.837288 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:23:08.837288 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:08.837288 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 308/606] 10.222.0.83 () {56 vars in 1102 bytes} [Mon Aug 29 15:23:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:08.837988 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c979c8aa-4a81-4c1d-a3c3-5cdf429e1954 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:08.931433 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc142747-62b8-4cc5-ba92-147fee8ca262 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:08.950274 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:08.967868 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c979c8aa-4a81-4c1d-a3c3-5cdf429e1954 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:08.971517 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666b9b1-854d-434a-94d6-9a54a92f0806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:08.971680 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666b9b1-854d-434a-94d6-9a54a92f0806 None admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:08.972033 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666b9b1-854d-434a-94d6-9a54a92f0806 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:08.972372 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666b9b1-854d-434a-94d6-9a54a92f0806 None admin] PATH_INFO: `/v3/projects/44655977b0814a728f0fa73d442a7ee9/users/fd42634b2795427cba6614c53491ded2/roles/19a8fa4068774a289594739614bb8ad4` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:08.987436 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:08.992106 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f666b9b1-854d-434a-94d6-9a54a92f0806 None admin] RBAC: Authorizing `identity:create_grant(project_id=44655977b0814a728f0fa73d442a7ee9, user_id=fd42634b2795427cba6614c53491ded2, role_id=19a8fa4068774a289594739614bb8ad4)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:08.993739 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f666b9b1-854d-434a-94d6-9a54a92f0806 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:09.012162 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab455e-f5ad-40ff-8fae-61456deca2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:09.013072 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab455e-f5ad-40ff-8fae-61456deca2a4 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:09.013500 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab455e-f5ad-40ff-8fae-61456deca2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:09.013918 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab455e-f5ad-40ff-8fae-61456deca2a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:09.016334 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 299/607] 10.222.0.83 () {58 vars in 1439 bytes} [Mon Aug 29 15:23:08 2022] PUT /identity/v3/projects/44655977b0814a728f0fa73d442a7ee9/users/fd42634b2795427cba6614c53491ded2/roles/19a8fa4068774a289594739614bb8ad4 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:23:09.017181 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666b9b1-854d-434a-94d6-9a54a92f0806 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:09.023167 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ab455e-f5ad-40ff-8fae-61456deca2a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:09.024862 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ab455e-f5ad-40ff-8fae-61456deca2a4 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:09.039502 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-29ab455e-f5ad-40ff-8fae-61456deca2a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:09.039502 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:09.039502 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:09.039502 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:09.039502 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:09.039502 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:09.039502 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:09.039502 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:09.039502 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:09.039502 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:09.039502 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:09.039502 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:09.039502 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:23:09.039502 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:23:09.039502 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:23:09.040668 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:23:09.040668 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:09.040668 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:09.040668 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:09.040668 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:09.040668 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:09.040668 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:09.040668 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:09.040668 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:09.040668 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:09.040668 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:09.040668 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:09.040668 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:09.040668 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:09.040668 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:09.040668 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:09.040668 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:09.042019 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:23:09.042019 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:23:09.042019 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:23:09.042019 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:23:09.042019 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:23:09.042019 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:23:09.042019 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:09.042019 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:09.048856 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 309/608] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:23:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:09.050572 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab455e-f5ad-40ff-8fae-61456deca2a4 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:09.169731 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab455e-f5ad-40ff-8fae-61456deca2a4 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:09.209982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af03b79-f5c6-42da-81c9-963bddaab292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:09.211528 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af03b79-f5c6-42da-81c9-963bddaab292 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:09.211953 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af03b79-f5c6-42da-81c9-963bddaab292 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:09.212499 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af03b79-f5c6-42da-81c9-963bddaab292 None admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:09.213358 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af03b79-f5c6-42da-81c9-963bddaab292 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:09.213822 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af03b79-f5c6-42da-81c9-963bddaab292 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:09.215606 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af03b79-f5c6-42da-81c9-963bddaab292 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:09.233014 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 310/609] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 15:23:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:23:09.236853 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af03b79-f5c6-42da-81c9-963bddaab292 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:09.267301 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666b9b1-854d-434a-94d6-9a54a92f0806 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:09.274858 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:09.310902 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6b0ba-5c28-4c41-a68a-5f009cb01faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:09.311894 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6b0ba-5c28-4c41-a68a-5f009cb01faf None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:09.312349 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6b0ba-5c28-4c41-a68a-5f009cb01faf None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:09.312764 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6b0ba-5c28-4c41-a68a-5f009cb01faf None admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:09.313577 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6b0ba-5c28-4c41-a68a-5f009cb01faf None admin] RBAC: Adding query filter params (name=service) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:09.314022 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6b0ba-5c28-4c41-a68a-5f009cb01faf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:09.315782 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6b0ba-5c28-4c41-a68a-5f009cb01faf None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:09.325111 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 300/610] 10.222.0.83 () {56 vars in 1103 bytes} [Mon Aug 29 15:23:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:09.332046 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6b0ba-5c28-4c41-a68a-5f009cb01faf None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:09.359073 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af03b79-f5c6-42da-81c9-963bddaab292 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:09.372691 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:09.406958 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baaaad0-0211-49d4-8d7d-e5bc9533ecef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:09.407656 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baaaad0-0211-49d4-8d7d-e5bc9533ecef None admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:09.407937 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baaaad0-0211-49d4-8d7d-e5bc9533ecef None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:09.408213 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baaaad0-0211-49d4-8d7d-e5bc9533ecef None admin] PATH_INFO: `/v3/projects/44655977b0814a728f0fa73d442a7ee9/users/9a84bb38f6454574897120223b8fc140/roles/19a8fa4068774a289594739614bb8ad4` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:09.432633 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baaaad0-0211-49d4-8d7d-e5bc9533ecef None admin] RBAC: Authorizing `identity:create_grant(project_id=44655977b0814a728f0fa73d442a7ee9, user_id=9a84bb38f6454574897120223b8fc140, role_id=19a8fa4068774a289594739614bb8ad4)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:09.434096 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baaaad0-0211-49d4-8d7d-e5bc9533ecef None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:09.455232 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 311/611] 10.222.0.83 () {58 vars in 1439 bytes} [Mon Aug 29 15:23:09 2022] PUT /identity/v3/projects/44655977b0814a728f0fa73d442a7ee9/users/9a84bb38f6454574897120223b8fc140/roles/19a8fa4068774a289594739614bb8ad4 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:23:09.471645 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6b0ba-5c28-4c41-a68a-5f009cb01faf None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:09.512888 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307bc7c2-abe1-4dbd-bd1d-3f588a9c6acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:09.513788 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bc7c2-abe1-4dbd-bd1d-3f588a9c6acf None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:09.514215 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bc7c2-abe1-4dbd-bd1d-3f588a9c6acf None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:09.514653 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bc7c2-abe1-4dbd-bd1d-3f588a9c6acf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:09.528720 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307bc7c2-abe1-4dbd-bd1d-3f588a9c6acf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:09.530553 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307bc7c2-abe1-4dbd-bd1d-3f588a9c6acf None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:09.548232 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-307bc7c2-abe1-4dbd-bd1d-3f588a9c6acf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:09.548232 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:09.548232 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:09.548232 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:09.548232 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:09.548232 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:09.548232 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:09.548232 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:09.548232 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:09.548232 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:09.548232 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:09.548232 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:09.548232 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:23:09.548232 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:23:09.548232 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:23:09.548232 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:23:09.549440 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:09.549440 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:09.549440 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:09.549440 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:09.549440 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:09.549440 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:09.549440 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:09.549440 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:09.549440 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:09.549440 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:09.549440 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:09.549440 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:09.549440 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:09.549440 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:09.549440 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:09.549440 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:09.549440 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:23:09.550533 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:23:09.550533 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:09.550533 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:09.552415 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 301/612] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:09.558172 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baaaad0-0211-49d4-8d7d-e5bc9533ecef None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:09.684439 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:09.711669 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baaaad0-0211-49d4-8d7d-e5bc9533ecef None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:09.758674 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984b94e-481e-47f8-a384-29e8f2b63f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:09.759594 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984b94e-481e-47f8-a384-29e8f2b63f89 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:09.760020 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984b94e-481e-47f8-a384-29e8f2b63f89 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:09.760437 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984b94e-481e-47f8-a384-29e8f2b63f89 None admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:09.761261 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1984b94e-481e-47f8-a384-29e8f2b63f89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:09.761724 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1984b94e-481e-47f8-a384-29e8f2b63f89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:09.763391 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1984b94e-481e-47f8-a384-29e8f2b63f89 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:09.780501 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 312/613] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:23:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:09.784095 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307bc7c2-abe1-4dbd-bd1d-3f588a9c6acf None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:09.886943 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38481b9-55fe-4944-bfb6-7737a17db01e None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:09.887633 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38481b9-55fe-4944-bfb6-7737a17db01e None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:09.888336 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38481b9-55fe-4944-bfb6-7737a17db01e None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:09.891240 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:09.892645 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 313/614] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:23:09.901747 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6310c2-92b9-4fd1-bbb1-a1bced8827f1 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:09.902527 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6310c2-92b9-4fd1-bbb1-a1bced8827f1 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:09.903306 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6310c2-92b9-4fd1-bbb1-a1bced8827f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:09.941284 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307bc7c2-abe1-4dbd-bd1d-3f588a9c6acf None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:09.949984 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-3f6310c2-92b9-4fd1-bbb1-a1bced8827f1 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:09.955116 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3f6310c2-92b9-4fd1-bbb1-a1bced8827f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:10.049301 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537dbcf-ec66-4705-964e-fbfe60d4ceec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:10.050230 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537dbcf-ec66-4705-964e-fbfe60d4ceec None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:10.050713 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537dbcf-ec66-4705-964e-fbfe60d4ceec None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:10.051811 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537dbcf-ec66-4705-964e-fbfe60d4ceec None admin] PATH_INFO: `/v3/users/swift` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:10.084371 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a537dbcf-ec66-4705-964e-fbfe60d4ceec None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:10.087182 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a537dbcf-ec66-4705-964e-fbfe60d4ceec None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:10.108311 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-a537dbcf-ec66-4705-964e-fbfe60d4ceec None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 15:23:10.108311 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:10.108311 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:10.108311 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:10.108311 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:10.108311 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:10.108311 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:10.108311 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:10.108311 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:10.108311 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:10.108311 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:10.108311 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:10.108311 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:23:10.108311 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:23:10.108311 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:23:10.108311 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:23:10.110148 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:10.110148 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:10.110148 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:23:10.110148 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:23:10.110148 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:23:10.110148 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:23:10.110148 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:10.110148 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:10.110148 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:10.110148 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:10.110148 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:10.110148 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:10.110148 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:10.110148 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:10.110148 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:10.110148 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:10.110148 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:10.110148 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:10.111224 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:10.111224 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:10.111224 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:23:10.111224 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:23:10.111224 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:23:10.111224 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:23:10.111224 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:23:10.111224 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:23:10.111224 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 15:23:10.111224 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:10.111224 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 302/615] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 15:23:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:10.120212 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537dbcf-ec66-4705-964e-fbfe60d4ceec None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:10.134719 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 314/616] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 15:23:10.363401 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537dbcf-ec66-4705-964e-fbfe60d4ceec None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:10.442711 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40307e31-7d01-4123-a14c-8399b5a2bfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:10.443741 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40307e31-7d01-4123-a14c-8399b5a2bfbc None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:10.444216 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40307e31-7d01-4123-a14c-8399b5a2bfbc None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:10.444687 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40307e31-7d01-4123-a14c-8399b5a2bfbc None admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:10.445974 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40307e31-7d01-4123-a14c-8399b5a2bfbc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:10.446515 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40307e31-7d01-4123-a14c-8399b5a2bfbc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:10.449133 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40307e31-7d01-4123-a14c-8399b5a2bfbc None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:10.475617 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:10.490430 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 303/617] 10.222.0.83 () {56 vars in 1135 bytes} [Mon Aug 29 15:23:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:10.496754 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6310c2-92b9-4fd1-bbb1-a1bced8827f1 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:10.650984 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40307e31-7d01-4123-a14c-8399b5a2bfbc None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:10.661966 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:10.695490 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6310c2-92b9-4fd1-bbb1-a1bced8827f1 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:10.778525 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff552af-cbf1-4356-a408-30d8cbf2f7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:10.779449 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff552af-cbf1-4356-a408-30d8cbf2f7b1 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:10.779732 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff552af-cbf1-4356-a408-30d8cbf2f7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:10.780006 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff552af-cbf1-4356-a408-30d8cbf2f7b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:10.798309 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff552af-cbf1-4356-a408-30d8cbf2f7b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:10.799809 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff552af-cbf1-4356-a408-30d8cbf2f7b1 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:10.828940 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-0ff552af-cbf1-4356-a408-30d8cbf2f7b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:10.828940 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:10.828940 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:10.828940 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:10.828940 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:10.828940 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:10.828940 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:10.828940 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:10.828940 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:10.828940 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:10.828940 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:10.828940 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:10.828940 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:23:10.828940 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:23:10.828940 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:23:10.828940 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:23:10.830589 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:10.830589 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:10.830589 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:10.830589 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:10.830589 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:10.830589 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:10.830589 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:10.830589 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:10.830589 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:10.830589 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:10.830589 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:10.830589 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:10.830589 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:10.830589 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:10.830589 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:10.830589 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:10.830589 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:23:10.832793 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:23:10.832793 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:10.832793 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:10.832793 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 315/618] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:10.838244 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff552af-cbf1-4356-a408-30d8cbf2f7b1 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:10.890482 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40307e31-7d01-4123-a14c-8399b5a2bfbc None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:10.954811 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff552af-cbf1-4356-a408-30d8cbf2f7b1 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:10.961209 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449f38b-3962-4ea1-8051-82b3a49a5f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:10.962752 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449f38b-3962-4ea1-8051-82b3a49a5f92 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:10.963583 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449f38b-3962-4ea1-8051-82b3a49a5f92 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:10.964356 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449f38b-3962-4ea1-8051-82b3a49a5f92 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:10.984929 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5449f38b-3962-4ea1-8051-82b3a49a5f92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:23:10.986065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:10.996044 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd531c18-3639-481c-ae43-ab7c5d4eb2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:10.996825 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd531c18-3639-481c-ae43-ab7c5d4eb2ba None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:10.997200 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd531c18-3639-481c-ae43-ab7c5d4eb2ba None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:10.997519 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd531c18-3639-481c-ae43-ab7c5d4eb2ba None admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:10.997921 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-5449f38b-3962-4ea1-8051-82b3a49a5f92 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:23:10.997921 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:10.997921 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:10.997921 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:10.997921 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:10.997921 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:10.997921 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:10.997921 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:10.997921 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:10.997921 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:10.997921 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:10.997921 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:10.997921 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:23:10.997921 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:23:10.997921 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:23:10.997921 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:23:10.999676 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:23:10.999676 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:23:10.999676 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:23:10.999676 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:23:10.999676 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:10.999676 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:10.999676 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:10.999676 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:10.999676 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:10.999676 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:10.999676 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:10.999676 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:10.999676 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:10.999676 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:10.999676 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:10.999676 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:11.001340 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:11.001340 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:11.001340 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:11.001340 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:11.001340 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:23:11.001340 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:23:11.001340 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:23:11.001340 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:23:11.001340 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:23:11.001340 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:23:11.001340 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:23:11.001340 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:11.002571 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd531c18-3639-481c-ae43-ab7c5d4eb2ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:11.002571 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd531c18-3639-481c-ae43-ab7c5d4eb2ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:11.002571 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd531c18-3639-481c-ae43-ab7c5d4eb2ba None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:11.002907 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 304/619] 10.222.0.83 () {56 vars in 1102 bytes} [Mon Aug 29 15:23:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:11.005591 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb68370-0899-4675-b0fc-34e54132e9b3 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:11.005871 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb68370-0899-4675-b0fc-34e54132e9b3 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:11.006168 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb68370-0899-4675-b0fc-34e54132e9b3 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:11.013266 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 305/620] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:23:11.013266 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb68370-0899-4675-b0fc-34e54132e9b3 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:11.020346 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 316/621] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:23:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:11.020346 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0086cb-23a9-4832-8c59-adad7939e3bb None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:11.020346 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0086cb-23a9-4832-8c59-adad7939e3bb None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:11.020346 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0086cb-23a9-4832-8c59-adad7939e3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:11.046102 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-9b0086cb-23a9-4832-8c59-adad7939e3bb None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:11.047638 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9b0086cb-23a9-4832-8c59-adad7939e3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:11.086349 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:11.135688 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb68370-0899-4675-b0fc-34e54132e9b3 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:11.143044 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 317/622] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:23:11.143044 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0086cb-23a9-4832-8c59-adad7939e3bb None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:11.205861 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1421f602-f4fa-4a8e-8d90-cc5cf55299b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:11.206937 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421f602-f4fa-4a8e-8d90-cc5cf55299b3 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:11.207466 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421f602-f4fa-4a8e-8d90-cc5cf55299b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:11.208039 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421f602-f4fa-4a8e-8d90-cc5cf55299b3 None admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:11.209010 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1421f602-f4fa-4a8e-8d90-cc5cf55299b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:11.209767 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1421f602-f4fa-4a8e-8d90-cc5cf55299b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:11.219047 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1421f602-f4fa-4a8e-8d90-cc5cf55299b3 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:11.232803 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 306/623] 10.222.0.83 () {56 vars in 1103 bytes} [Mon Aug 29 15:23:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:11.239760 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1421f602-f4fa-4a8e-8d90-cc5cf55299b3 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:11.255631 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0086cb-23a9-4832-8c59-adad7939e3bb None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:11.278003 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:11.299746 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237185d-28f0-4e25-899a-24dd75206f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:11.300380 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237185d-28f0-4e25-899a-24dd75206f9a None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:11.301271 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237185d-28f0-4e25-899a-24dd75206f9a None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:11.301635 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237185d-28f0-4e25-899a-24dd75206f9a None admin] PATH_INFO: `/v3/projects/service` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:11.309460 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f237185d-28f0-4e25-899a-24dd75206f9a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:11.310899 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f237185d-28f0-4e25-899a-24dd75206f9a None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:11.325347 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-f237185d-28f0-4e25-899a-24dd75206f9a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:11.325347 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:11.325347 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:11.325347 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:11.325347 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:11.325347 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:11.325347 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:11.325347 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:11.325347 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:11.325347 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:11.325347 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:11.325347 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:11.325347 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:23:11.325347 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:23:11.325347 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:23:11.326310 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:23:11.326310 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:11.326310 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:11.326310 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:11.326310 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:11.326310 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:11.326310 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:11.326310 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:11.326310 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:11.326310 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:11.326310 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:11.326310 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:11.326310 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:11.326310 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:11.326310 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:11.326310 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:11.326310 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:11.328341 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:23:11.328341 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:23:11.328341 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:23:11.328341 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:23:11.328341 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:23:11.328341 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:23:11.328341 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:11.328341 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:11.328341 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 318/624] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:23:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:11.332860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237185d-28f0-4e25-899a-24dd75206f9a None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:11.440056 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1421f602-f4fa-4a8e-8d90-cc5cf55299b3 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:11.484336 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:11.508304 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237185d-28f0-4e25-899a-24dd75206f9a None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:11.515101 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6b4a2-636f-4787-a6ba-2d26bb664281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:11.516058 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6b4a2-636f-4787-a6ba-2d26bb664281 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:11.516615 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6b4a2-636f-4787-a6ba-2d26bb664281 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:11.517620 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6b4a2-636f-4787-a6ba-2d26bb664281 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:11.538822 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf6b4a2-636f-4787-a6ba-2d26bb664281 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:11.541600 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf6b4a2-636f-4787-a6ba-2d26bb664281 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:11.572191 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-8bf6b4a2-636f-4787-a6ba-2d26bb664281 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:11.572191 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:11.572191 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:11.572191 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:11.572191 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:11.572191 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:11.572191 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:11.572191 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:11.572191 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:11.572191 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:11.572191 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:11.572191 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:11.572191 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:23:11.572191 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:23:11.572191 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:23:11.572191 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:23:11.573237 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:11.573237 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:11.573237 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:11.573237 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:11.573237 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:11.573237 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:11.573237 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:11.573237 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:11.573237 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:11.573237 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:11.573237 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:11.573237 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:11.573237 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:11.573237 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:11.573237 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:11.573237 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:11.573237 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:23:11.574118 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:23:11.574118 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:11.574118 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:11.580736 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00909e94-bff3-45d2-b928-74da9ae480e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:11.580736 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00909e94-bff3-45d2-b928-74da9ae480e7 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:11.580736 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00909e94-bff3-45d2-b928-74da9ae480e7 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:11.580736 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00909e94-bff3-45d2-b928-74da9ae480e7 None admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:11.581079 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00909e94-bff3-45d2-b928-74da9ae480e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:11.581079 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00909e94-bff3-45d2-b928-74da9ae480e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:11.581079 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00909e94-bff3-45d2-b928-74da9ae480e7 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:11.581434 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 307/625] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:23:11.583869 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6b4a2-636f-4787-a6ba-2d26bb664281 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:11.599181 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 319/626] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 15:23:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:23:11.600331 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00909e94-bff3-45d2-b928-74da9ae480e7 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:11.655921 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:11.724027 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6b4a2-636f-4787-a6ba-2d26bb664281 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:11.737300 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00909e94-bff3-45d2-b928-74da9ae480e7 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:11.767320 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d7e95-0f49-459a-a4ed-708fa4260288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:11.767995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d7e95-0f49-459a-a4ed-708fa4260288 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:11.768285 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d7e95-0f49-459a-a4ed-708fa4260288 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:11.768565 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d7e95-0f49-459a-a4ed-708fa4260288 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:11.782158 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6b3ca-2dae-49df-97b2-0f28b12caaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:11.783158 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6b3ca-2dae-49df-97b2-0f28b12caaa4 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:11.783270 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d7e95-0f49-459a-a4ed-708fa4260288 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:23:11.783773 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6b3ca-2dae-49df-97b2-0f28b12caaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:11.784292 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6b3ca-2dae-49df-97b2-0f28b12caaa4 None admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:11.785936 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed6b3ca-2dae-49df-97b2-0f28b12caaa4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:11.786518 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed6b3ca-2dae-49df-97b2-0f28b12caaa4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:11.788283 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed6b3ca-2dae-49df-97b2-0f28b12caaa4 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:11.789278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-d09d7e95-0f49-459a-a4ed-708fa4260288 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:23:11.789278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:11.789278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:11.789278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:11.789278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:11.789278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:11.789278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:11.789278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:11.789278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:11.789278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:11.789278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:11.789278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:11.789278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:23:11.789278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:23:11.789278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:23:11.789278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:23:11.790198 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:23:11.790198 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:23:11.790198 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:23:11.790198 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:23:11.790198 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:11.790198 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:11.790198 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:11.790198 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:11.790198 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:11.790198 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:11.790198 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:11.790198 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:11.790198 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:11.790198 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:11.790198 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:11.790198 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:11.791414 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:11.791414 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:11.791414 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:11.791414 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:11.791414 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:23:11.791414 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:23:11.791414 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:23:11.791414 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:23:11.791414 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:23:11.791414 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:23:11.791414 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:23:11.791414 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:11.795650 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 308/627] 10.222.0.83 () {56 vars in 1102 bytes} [Mon Aug 29 15:23:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:11.796480 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d7e95-0f49-459a-a4ed-708fa4260288 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:11.807844 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 320/628] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:11.809068 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6b3ca-2dae-49df-97b2-0f28b12caaa4 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:11.844525 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:11.930406 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:11.935702 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d7e95-0f49-459a-a4ed-708fa4260288 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:11.936422 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6b3ca-2dae-49df-97b2-0f28b12caaa4 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:11.973882 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb25620e-1fb3-4642-b52a-b396c2639a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:11.974551 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25620e-1fb3-4642-b52a-b396c2639a91 None admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:11.974831 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25620e-1fb3-4642-b52a-b396c2639a91 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:11.975149 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25620e-1fb3-4642-b52a-b396c2639a91 None admin] PATH_INFO: `/v3/projects/44655977b0814a728f0fa73d442a7ee9/users/b0f8e95d393f499baf44830f9fb7e583/roles/19a8fa4068774a289594739614bb8ad4` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:11.975380 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bdef97-a314-4445-98e5-9c06400d5d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:11.976572 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bdef97-a314-4445-98e5-9c06400d5d5f None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:11.977063 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bdef97-a314-4445-98e5-9c06400d5d5f None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:11.977545 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bdef97-a314-4445-98e5-9c06400d5d5f None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:11.978416 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bdef97-a314-4445-98e5-9c06400d5d5f None admin] RBAC: Adding query filter params (name=service) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:11.978920 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bdef97-a314-4445-98e5-9c06400d5d5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:11.980575 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bdef97-a314-4445-98e5-9c06400d5d5f None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:11.990887 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 321/629] 10.222.0.83 () {56 vars in 1103 bytes} [Mon Aug 29 15:23:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:11.992467 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bdef97-a314-4445-98e5-9c06400d5d5f None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:11.996591 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb25620e-1fb3-4642-b52a-b396c2639a91 None admin] RBAC: Authorizing `identity:create_grant(project_id=44655977b0814a728f0fa73d442a7ee9, user_id=b0f8e95d393f499baf44830f9fb7e583, role_id=19a8fa4068774a289594739614bb8ad4)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:11.999173 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb25620e-1fb3-4642-b52a-b396c2639a91 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:12.019945 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 309/630] 10.222.0.83 () {58 vars in 1439 bytes} [Mon Aug 29 15:23:11 2022] PUT /identity/v3/projects/44655977b0814a728f0fa73d442a7ee9/users/b0f8e95d393f499baf44830f9fb7e583/roles/19a8fa4068774a289594739614bb8ad4 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:23:12.021841 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb25620e-1fb3-4642-b52a-b396c2639a91 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:12.181073 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bdef97-a314-4445-98e5-9c06400d5d5f None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:12.198712 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:12.219319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b076574-c445-491f-aa18-d15ce52b0ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:12.220392 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b076574-c445-491f-aa18-d15ce52b0ee2 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:12.220959 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b076574-c445-491f-aa18-d15ce52b0ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:12.221447 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b076574-c445-491f-aa18-d15ce52b0ee2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:12.230133 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b076574-c445-491f-aa18-d15ce52b0ee2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:12.232060 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b076574-c445-491f-aa18-d15ce52b0ee2 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:12.235462 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb25620e-1fb3-4642-b52a-b396c2639a91 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:12.244727 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-7b076574-c445-491f-aa18-d15ce52b0ee2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 15:23:12.244727 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:12.244727 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:12.244727 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:12.244727 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:12.244727 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:12.244727 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:12.244727 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:12.244727 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:12.244727 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:12.244727 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:12.244727 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:12.244727 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:23:12.244727 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:23:12.244727 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:23:12.244727 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:23:12.245691 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:12.245691 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:12.245691 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:23:12.245691 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:23:12.245691 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:23:12.245691 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:23:12.245691 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:12.245691 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:12.245691 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:12.245691 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:12.245691 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:12.245691 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:12.245691 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:12.245691 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:12.245691 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:12.245691 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:12.245691 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:12.245691 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:12.246615 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:12.246615 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:12.246615 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:23:12.246615 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:23:12.246615 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:23:12.246615 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:23:12.246615 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:23:12.246615 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:23:12.246615 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 15:23:12.246615 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:12.248891 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 322/631] 10.222.0.83 () {56 vars in 1093 bytes} [Mon Aug 29 15:23:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:12.265725 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b076574-c445-491f-aa18-d15ce52b0ee2 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:12.301482 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:12.302814 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d1839-3dd5-411c-a930-add54a7b35c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:12.304048 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d1839-3dd5-411c-a930-add54a7b35c9 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:12.304502 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d1839-3dd5-411c-a930-add54a7b35c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:12.304918 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d1839-3dd5-411c-a930-add54a7b35c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:12.321824 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d1839-3dd5-411c-a930-add54a7b35c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:12.324049 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d1839-3dd5-411c-a930-add54a7b35c9 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:12.346278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-d92d1839-3dd5-411c-a930-add54a7b35c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:12.346278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:12.346278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:12.346278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:12.346278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:12.346278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:12.346278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:12.346278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:12.346278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:12.346278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:12.346278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:12.346278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:12.346278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:23:12.346278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:23:12.346278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:23:12.346278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:23:12.347551 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:12.347551 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:12.347551 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:12.347551 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:12.347551 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:12.347551 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:12.347551 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:12.347551 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:12.347551 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:12.347551 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:12.347551 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:12.347551 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:12.347551 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:12.347551 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:12.347551 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:12.347551 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:12.347551 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:23:12.348754 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:23:12.348754 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:12.348754 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:12.353635 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 310/632] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:12.359069 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d1839-3dd5-411c-a930-add54a7b35c9 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:12.397551 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b076574-c445-491f-aa18-d15ce52b0ee2 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:12.447394 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3643bbe8-5343-4fd8-bf4f-da9de73a63cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:12.448011 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643bbe8-5343-4fd8-bf4f-da9de73a63cd None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:12.448459 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643bbe8-5343-4fd8-bf4f-da9de73a63cd None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:12.448846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643bbe8-5343-4fd8-bf4f-da9de73a63cd None admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:12.449604 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3643bbe8-5343-4fd8-bf4f-da9de73a63cd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:12.449912 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3643bbe8-5343-4fd8-bf4f-da9de73a63cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:12.452674 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3643bbe8-5343-4fd8-bf4f-da9de73a63cd None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:12.482127 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 323/633] 10.222.0.83 () {56 vars in 1133 bytes} [Mon Aug 29 15:23:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:12.482127 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b65815-639d-4959-af00-15022288a6af None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:12.482127 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b65815-639d-4959-af00-15022288a6af None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:12.482127 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b65815-639d-4959-af00-15022288a6af None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:12.482127 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 324/634] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:23:12.483850 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b65815-639d-4959-af00-15022288a6af None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:12.497564 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d1839-3dd5-411c-a930-add54a7b35c9 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:12.548313 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a593b-3a18-4675-aec2-12ee16756a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:12.548972 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a593b-3a18-4675-aec2-12ee16756a84 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:12.549465 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a593b-3a18-4675-aec2-12ee16756a84 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:12.549740 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a593b-3a18-4675-aec2-12ee16756a84 None admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:12.550852 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a593b-3a18-4675-aec2-12ee16756a84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:12.551186 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a593b-3a18-4675-aec2-12ee16756a84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:12.552666 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a593b-3a18-4675-aec2-12ee16756a84 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:12.555143 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:12.572840 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 311/635] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:23:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:12.574442 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd379b-52b9-45bf-9c1a-1fc9fcbac68c None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:12.574932 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd379b-52b9-45bf-9c1a-1fc9fcbac68c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:12.575442 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd379b-52b9-45bf-9c1a-1fc9fcbac68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:12.581413 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:12.594458 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-e0cd379b-52b9-45bf-9c1a-1fc9fcbac68c None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:12.595683 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e0cd379b-52b9-45bf-9c1a-1fc9fcbac68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:12.609074 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b65815-639d-4959-af00-15022288a6af None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:12.649391 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d838a-f985-4108-8afa-e8e99229b4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:12.650008 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d838a-f985-4108-8afa-e8e99229b4ed None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:12.650292 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d838a-f985-4108-8afa-e8e99229b4ed None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:12.650560 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d838a-f985-4108-8afa-e8e99229b4ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:12.668279 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 312/636] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:23:12.669569 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df17dd5-cc06-4898-b8aa-aa4cb1e2a232 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:12.669856 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df17dd5-cc06-4898-b8aa-aa4cb1e2a232 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:12.670130 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df17dd5-cc06-4898-b8aa-aa4cb1e2a232 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:12.675155 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 313/637] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:23:12.675155 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df17dd5-cc06-4898-b8aa-aa4cb1e2a232 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:12.761379 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d838a-f985-4108-8afa-e8e99229b4ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:12.763915 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d838a-f985-4108-8afa-e8e99229b4ed None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:12.802941 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df17dd5-cc06-4898-b8aa-aa4cb1e2a232 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:12.838817 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:12.853132 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976018b5-478b-47f8-9597-f36d5d08e142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:12.853769 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976018b5-478b-47f8-9597-f36d5d08e142 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:12.854046 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976018b5-478b-47f8-9597-f36d5d08e142 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:12.854364 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976018b5-478b-47f8-9597-f36d5d08e142 None admin] PATH_INFO: `/v3/users/glance` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:12.859124 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:12.864318 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976018b5-478b-47f8-9597-f36d5d08e142 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:12.867428 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976018b5-478b-47f8-9597-f36d5d08e142 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:12.881214 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-976018b5-478b-47f8-9597-f36d5d08e142 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 15:23:12.881214 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:12.881214 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:12.881214 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:12.881214 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:12.881214 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:12.881214 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:12.881214 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:12.881214 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:12.881214 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:12.881214 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:12.881214 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:12.881214 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:23:12.881214 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:23:12.881214 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:23:12.881214 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:23:12.882452 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:12.882452 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:12.882452 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:23:12.882452 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:23:12.882452 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:23:12.882452 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:23:12.882452 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:12.882452 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:12.882452 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:12.882452 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:12.882452 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:12.882452 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:12.882452 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:12.882452 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:12.882452 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:12.882452 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:12.882452 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:12.882452 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:12.883700 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:12.883700 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:12.883700 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:23:12.883700 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:23:12.883700 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:23:12.883700 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:23:12.883700 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:23:12.883700 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:23:12.883700 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 15:23:12.883700 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:12.885241 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 314/638] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:23:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:12.886505 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e9e84-e83c-474c-b1f8-e47e9cc47645 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:12.886879 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e9e84-e83c-474c-b1f8-e47e9cc47645 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:12.887281 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e9e84-e83c-474c-b1f8-e47e9cc47645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:12.896415 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 325/639] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:23:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:23:12.897543 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d838a-f985-4108-8afa-e8e99229b4ed None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:12.911687 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-216e9e84-e83c-474c-b1f8-e47e9cc47645 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:12.913090 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-216e9e84-e83c-474c-b1f8-e47e9cc47645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:12.997818 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 315/640] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:23:12.998683 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e9e84-e83c-474c-b1f8-e47e9cc47645 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:13.028311 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d838a-f985-4108-8afa-e8e99229b4ed None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:13.072724 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a927e-9b8d-4663-826c-b45ec3470322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:13.073492 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a927e-9b8d-4663-826c-b45ec3470322 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:13.073895 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a927e-9b8d-4663-826c-b45ec3470322 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:13.074474 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a927e-9b8d-4663-826c-b45ec3470322 None admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:13.075706 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a927e-9b8d-4663-826c-b45ec3470322 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:13.076120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a927e-9b8d-4663-826c-b45ec3470322 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:13.077939 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a927e-9b8d-4663-826c-b45ec3470322 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:13.106649 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 326/641] 10.222.0.83 () {56 vars in 1137 bytes} [Mon Aug 29 15:23:12 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:13.107967 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a927e-9b8d-4663-826c-b45ec3470322 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:13.120279 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e9e84-e83c-474c-b1f8-e47e9cc47645 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:13.135162 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:13.154896 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:13.162455 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc913f0-6afa-413a-8b17-3fdd5ea051df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:13.163494 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc913f0-6afa-413a-8b17-3fdd5ea051df None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:13.164039 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc913f0-6afa-413a-8b17-3fdd5ea051df None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:13.164521 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc913f0-6afa-413a-8b17-3fdd5ea051df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:13.176318 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc913f0-6afa-413a-8b17-3fdd5ea051df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:13.178783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc913f0-6afa-413a-8b17-3fdd5ea051df None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:13.195287 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-1cc913f0-6afa-413a-8b17-3fdd5ea051df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:13.195287 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:13.195287 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:13.195287 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:13.195287 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:13.195287 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:13.195287 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:13.195287 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:13.195287 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:13.195287 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:13.195287 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:13.195287 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:13.195287 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:23:13.195287 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:23:13.195287 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:23:13.195287 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:23:13.196327 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:13.196327 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:13.196327 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:13.196327 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:13.196327 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:13.196327 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:13.196327 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:13.196327 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:13.196327 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:13.196327 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:13.196327 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:13.196327 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:13.196327 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:13.196327 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:13.196327 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:13.196327 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:13.196327 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:23:13.197243 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:23:13.197243 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:13.197243 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:13.199933 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 316/642] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:13.201561 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc913f0-6afa-413a-8b17-3fdd5ea051df None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:13.241729 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a927e-9b8d-4663-826c-b45ec3470322 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:13.286273 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbccccdd-a850-49ba-b25f-12c91aabde08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:13.286827 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbccccdd-a850-49ba-b25f-12c91aabde08 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:13.287594 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbccccdd-a850-49ba-b25f-12c91aabde08 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:13.287870 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbccccdd-a850-49ba-b25f-12c91aabde08 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:13.303971 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbccccdd-a850-49ba-b25f-12c91aabde08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:23:13.311417 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-fbccccdd-a850-49ba-b25f-12c91aabde08 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:23:13.311417 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:13.311417 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:13.311417 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:13.311417 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:13.311417 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:13.311417 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:13.311417 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:13.311417 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:13.311417 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:13.311417 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:13.311417 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:13.311417 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:23:13.311417 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:23:13.311417 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:23:13.311417 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:23:13.312473 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:23:13.312473 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:23:13.312473 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:23:13.312473 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:23:13.312473 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:13.312473 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:13.312473 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:13.312473 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:13.312473 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:13.312473 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:13.312473 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:13.312473 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:13.312473 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:13.312473 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:13.312473 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:13.312473 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:13.313327 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:13.313327 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:13.313327 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:13.313327 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:13.313327 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:23:13.313327 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:23:13.313327 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:23:13.313327 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:23:13.313327 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:23:13.313327 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:23:13.313327 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:23:13.313327 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:13.313327 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 327/643] 10.222.0.83 () {56 vars in 1102 bytes} [Mon Aug 29 15:23:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:13.314049 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbccccdd-a850-49ba-b25f-12c91aabde08 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:13.322992 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc913f0-6afa-413a-8b17-3fdd5ea051df None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:13.360183 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff591e8e-4ef8-48b9-aae9-83147872fd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:13.360797 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff591e8e-4ef8-48b9-aae9-83147872fd8d None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:13.361076 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff591e8e-4ef8-48b9-aae9-83147872fd8d None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:13.361345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff591e8e-4ef8-48b9-aae9-83147872fd8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:13.400207 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:13.423184 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:13.430379 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbccccdd-a850-49ba-b25f-12c91aabde08 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:13.436697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff591e8e-4ef8-48b9-aae9-83147872fd8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:13.438174 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff591e8e-4ef8-48b9-aae9-83147872fd8d None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:13.472529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ef0d0-5906-4d23-a397-48375a1f3d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:13.473295 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ef0d0-5906-4d23-a397-48375a1f3d69 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:13.473485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ef0d0-5906-4d23-a397-48375a1f3d69 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:13.473762 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ef0d0-5906-4d23-a397-48375a1f3d69 None admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:13.474407 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ef0d0-5906-4d23-a397-48375a1f3d69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:13.474706 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ef0d0-5906-4d23-a397-48375a1f3d69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:13.476132 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ef0d0-5906-4d23-a397-48375a1f3d69 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:13.492906 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 328/644] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:23:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:13.492906 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ef0d0-5906-4d23-a397-48375a1f3d69 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:13.548375 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 317/645] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:23:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:23:13.549047 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff591e8e-4ef8-48b9-aae9-83147872fd8d None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:13.602936 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ef0d0-5906-4d23-a397-48375a1f3d69 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:13.618217 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:13.642671 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35793018-43dd-453e-ada8-9f58973d0191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:13.643418 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35793018-43dd-453e-ada8-9f58973d0191 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:13.643774 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35793018-43dd-453e-ada8-9f58973d0191 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:13.644635 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35793018-43dd-453e-ada8-9f58973d0191 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:13.656150 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35793018-43dd-453e-ada8-9f58973d0191 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:23:13.657273 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff591e8e-4ef8-48b9-aae9-83147872fd8d None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:13.661769 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-35793018-43dd-453e-ada8-9f58973d0191 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:23:13.661769 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:13.661769 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:13.661769 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:13.661769 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:13.661769 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:13.661769 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:13.661769 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:13.661769 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:13.661769 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:13.661769 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:13.661769 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:13.661769 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:23:13.661769 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:23:13.661769 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:23:13.661769 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:23:13.662873 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:23:13.662873 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:23:13.662873 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:23:13.662873 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:23:13.662873 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:13.662873 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:13.662873 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:13.662873 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:13.662873 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:13.662873 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:13.662873 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:13.662873 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:13.662873 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:13.662873 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:13.662873 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:13.662873 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:13.664331 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:13.664331 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:13.664331 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:13.664331 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:13.664331 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:23:13.664331 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:23:13.664331 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:23:13.664331 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:23:13.664331 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:23:13.664331 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:23:13.664331 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:23:13.664331 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:13.668008 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 329/646] 10.222.0.83 () {56 vars in 1102 bytes} [Mon Aug 29 15:23:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:13.668677 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35793018-43dd-453e-ada8-9f58973d0191 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:13.687088 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:13.695623 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a33c6-70ce-4355-b24f-9833cfe65148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:13.696356 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a33c6-70ce-4355-b24f-9833cfe65148 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:13.696730 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a33c6-70ce-4355-b24f-9833cfe65148 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:13.697345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a33c6-70ce-4355-b24f-9833cfe65148 None admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:13.700511 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a33c6-70ce-4355-b24f-9833cfe65148 None admin] RBAC: Adding query filter params (name=service) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:13.700511 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a33c6-70ce-4355-b24f-9833cfe65148 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:13.700511 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a33c6-70ce-4355-b24f-9833cfe65148 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:13.709701 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 318/647] 10.222.0.83 () {56 vars in 1103 bytes} [Mon Aug 29 15:23:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:13.710325 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a33c6-70ce-4355-b24f-9833cfe65148 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:13.787809 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35793018-43dd-453e-ada8-9f58973d0191 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:13.823937 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9497d-932c-4e05-9ce2-adae85b31b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:13.824489 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9497d-932c-4e05-9ce2-adae85b31b07 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:13.824768 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9497d-932c-4e05-9ce2-adae85b31b07 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:13.825042 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9497d-932c-4e05-9ce2-adae85b31b07 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:13.828522 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a33c6-70ce-4355-b24f-9833cfe65148 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:13.833122 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9497d-932c-4e05-9ce2-adae85b31b07 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:13.834582 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9497d-932c-4e05-9ce2-adae85b31b07 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:13.847079 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-25f9497d-932c-4e05-9ce2-adae85b31b07 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:13.847079 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:13.847079 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:13.847079 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:13.847079 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:13.847079 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:13.847079 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:13.847079 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:13.847079 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:13.847079 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:13.847079 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:13.847079 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:13.847079 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:23:13.847079 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:23:13.847079 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:23:13.848188 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:23:13.848188 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:13.848188 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:13.848188 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:13.848188 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:13.848188 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:13.848188 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:13.848188 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:13.848188 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:13.848188 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:13.848188 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:13.848188 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:13.848188 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:13.848188 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:13.848188 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:13.848188 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:13.848188 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:13.849409 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:23:13.849409 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:23:13.849409 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:23:13.849409 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:23:13.849409 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:23:13.849409 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:23:13.849409 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:13.849409 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:13.849409 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 330/648] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:23:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:13.849409 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9497d-932c-4e05-9ce2-adae85b31b07 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:13.862002 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:13.871593 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23878690-de9a-4403-8735-f3d5e62f740a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:13.872367 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23878690-de9a-4403-8735-f3d5e62f740a None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:13.872743 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23878690-de9a-4403-8735-f3d5e62f740a None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:13.873252 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23878690-de9a-4403-8735-f3d5e62f740a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:13.886049 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23878690-de9a-4403-8735-f3d5e62f740a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:13.888096 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23878690-de9a-4403-8735-f3d5e62f740a None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:13.904022 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-23878690-de9a-4403-8735-f3d5e62f740a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:13.904022 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:13.904022 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:13.904022 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:13.904022 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:13.904022 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:13.904022 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:13.904022 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:13.904022 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:13.904022 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:13.904022 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:13.904022 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:13.904022 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:23:13.904022 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:23:13.904022 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:23:13.904022 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:23:13.905192 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:13.905192 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:13.905192 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:13.905192 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:13.905192 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:13.905192 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:13.905192 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:13.905192 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:13.905192 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:13.905192 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:13.905192 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:13.905192 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:13.905192 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:13.905192 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:13.905192 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:13.905192 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:13.905192 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:23:13.906263 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:23:13.906263 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:13.906263 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:13.907699 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 319/649] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:13.908630 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23878690-de9a-4403-8735-f3d5e62f740a None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:13.947174 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:13.973633 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9497d-932c-4e05-9ce2-adae85b31b07 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:14.011140 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf65f31-a384-4fe5-b962-43953977926d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:14.011872 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf65f31-a384-4fe5-b962-43953977926d None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:14.012151 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf65f31-a384-4fe5-b962-43953977926d None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:14.012421 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf65f31-a384-4fe5-b962-43953977926d None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:14.013089 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf65f31-a384-4fe5-b962-43953977926d None admin] RBAC: Adding query filter params (name=service) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:14.013375 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23878690-de9a-4403-8735-f3d5e62f740a None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:14.013845 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf65f31-a384-4fe5-b962-43953977926d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:14.014918 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf65f31-a384-4fe5-b962-43953977926d None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:14.028399 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 331/650] 10.222.0.83 () {56 vars in 1103 bytes} [Mon Aug 29 15:23:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:14.028399 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf65f31-a384-4fe5-b962-43953977926d None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:14.055419 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae933a8-7e40-4932-bd5e-515220d74c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:14.056148 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae933a8-7e40-4932-bd5e-515220d74c6a None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:14.056497 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae933a8-7e40-4932-bd5e-515220d74c6a None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:14.056837 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae933a8-7e40-4932-bd5e-515220d74c6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:14.068247 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae933a8-7e40-4932-bd5e-515220d74c6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:14.069658 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae933a8-7e40-4932-bd5e-515220d74c6a None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:14.085655 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-fae933a8-7e40-4932-bd5e-515220d74c6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:14.085655 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:14.085655 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:14.085655 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:14.085655 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:14.085655 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:14.085655 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:14.085655 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:14.085655 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:14.085655 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:14.085655 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:14.085655 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:14.085655 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:23:14.085655 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:23:14.085655 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:23:14.085655 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:23:14.086774 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:14.086774 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:14.086774 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:14.086774 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:14.086774 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:14.086774 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:14.086774 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:14.086774 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:14.086774 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:14.086774 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:14.086774 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:14.086774 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:14.086774 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:14.086774 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:14.086774 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:14.086774 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:14.086774 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:23:14.087690 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:23:14.087690 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:14.087690 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:14.087690 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 320/651] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:14.087942 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae933a8-7e40-4932-bd5e-515220d74c6a None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:14.124258 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:14.154017 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf65f31-a384-4fe5-b962-43953977926d None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:14.193383 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa365b-fb51-4adf-bb88-4144d532749c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:14.194503 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa365b-fb51-4adf-bb88-4144d532749c None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:14.194892 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa365b-fb51-4adf-bb88-4144d532749c None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:14.195474 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa365b-fb51-4adf-bb88-4144d532749c None admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:14.196574 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa365b-fb51-4adf-bb88-4144d532749c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:14.197104 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa365b-fb51-4adf-bb88-4144d532749c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:14.199771 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa365b-fb51-4adf-bb88-4144d532749c None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:14.205264 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae933a8-7e40-4932-bd5e-515220d74c6a None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:14.211998 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:14.218813 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 332/652] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 15:23:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:14.223856 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa365b-fb51-4adf-bb88-4144d532749c None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:14.248222 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9a9af-2c92-40b0-b80c-dd87a03f3f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:14.248831 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9a9af-2c92-40b0-b80c-dd87a03f3f7f None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:14.249108 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9a9af-2c92-40b0-b80c-dd87a03f3f7f None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:14.249378 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9a9af-2c92-40b0-b80c-dd87a03f3f7f None admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:14.250032 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc9a9af-2c92-40b0-b80c-dd87a03f3f7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:14.250316 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc9a9af-2c92-40b0-b80c-dd87a03f3f7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:14.251714 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc9a9af-2c92-40b0-b80c-dd87a03f3f7f None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:14.264111 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 321/653] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:23:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:14.264996 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9a9af-2c92-40b0-b80c-dd87a03f3f7f None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:14.326320 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa365b-fb51-4adf-bb88-4144d532749c None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:14.355767 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:14.360064 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eac58f-f5a2-4e31-949b-f01a748bbf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:14.360692 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eac58f-f5a2-4e31-949b-f01a748bbf90 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:14.360976 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eac58f-f5a2-4e31-949b-f01a748bbf90 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:14.361245 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eac58f-f5a2-4e31-949b-f01a748bbf90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:14.365553 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9a9af-2c92-40b0-b80c-dd87a03f3f7f None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:14.371390 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eac58f-f5a2-4e31-949b-f01a748bbf90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:14.372837 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eac58f-f5a2-4e31-949b-f01a748bbf90 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:14.387983 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-a6eac58f-f5a2-4e31-949b-f01a748bbf90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:14.387983 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:14.387983 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:14.387983 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:14.387983 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:14.387983 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:14.387983 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:14.387983 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:14.387983 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:14.387983 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:14.387983 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:14.387983 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:14.387983 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:23:14.387983 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:23:14.387983 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:23:14.387983 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:23:14.389111 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:14.389111 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:14.389111 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:14.389111 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:14.389111 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:14.389111 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:14.389111 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:14.389111 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:14.389111 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:14.389111 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:14.389111 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:14.389111 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:14.389111 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:14.389111 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:14.389111 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:14.389111 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:14.389111 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:23:14.389994 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:23:14.389994 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:14.389994 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:14.389994 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 333/654] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:14.390233 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eac58f-f5a2-4e31-949b-f01a748bbf90 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:14.404639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af27622-fcd7-4aae-bc01-6e29f1f00b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:14.405284 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af27622-fcd7-4aae-bc01-6e29f1f00b03 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:14.405566 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af27622-fcd7-4aae-bc01-6e29f1f00b03 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:14.405835 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af27622-fcd7-4aae-bc01-6e29f1f00b03 None admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:14.406499 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af27622-fcd7-4aae-bc01-6e29f1f00b03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:14.406802 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af27622-fcd7-4aae-bc01-6e29f1f00b03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:14.408242 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af27622-fcd7-4aae-bc01-6e29f1f00b03 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:14.420144 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 322/655] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:23:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:14.421413 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ef6f5-304c-4dc1-89dc-072d65727418 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:14.421710 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ef6f5-304c-4dc1-89dc-072d65727418 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:14.421981 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ef6f5-304c-4dc1-89dc-072d65727418 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:14.423218 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 323/656] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:23:14.423912 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ef6f5-304c-4dc1-89dc-072d65727418 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:14.442548 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:14.494243 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eac58f-f5a2-4e31-949b-f01a748bbf90 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:14.527964 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a896a-487e-4307-8003-6a5adf1ab350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:14.528559 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a896a-487e-4307-8003-6a5adf1ab350 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:14.528833 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a896a-487e-4307-8003-6a5adf1ab350 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:14.529102 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a896a-487e-4307-8003-6a5adf1ab350 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:14.529821 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574a896a-487e-4307-8003-6a5adf1ab350 None admin] RBAC: Adding query filter params (role.id=19a8fa4068774a289594739614bb8ad4, scope.project.id=44655977b0814a728f0fa73d442a7ee9, user.id=253947a5ef294d2bb828761873251bd1) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:14.529941 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ef6f5-304c-4dc1-89dc-072d65727418 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:14.530123 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574a896a-487e-4307-8003-6a5adf1ab350 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:14.531586 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574a896a-487e-4307-8003-6a5adf1ab350 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:14.545663 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 334/657] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 15:23:14 2022] GET /identity/v3/role_assignments?user.id=253947a5ef294d2bb828761873251bd1&scope.project.id=44655977b0814a728f0fa73d442a7ee9&role.id=19a8fa4068774a289594739614bb8ad4 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:14.545663 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a896a-487e-4307-8003-6a5adf1ab350 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:14.571599 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3207c0-9670-4d46-a10f-61e3230580c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:14.572320 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3207c0-9670-4d46-a10f-61e3230580c4 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:14.572782 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3207c0-9670-4d46-a10f-61e3230580c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:14.573083 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3207c0-9670-4d46-a10f-61e3230580c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:14.583923 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3207c0-9670-4d46-a10f-61e3230580c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:14.586447 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3207c0-9670-4d46-a10f-61e3230580c4 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:14.603580 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-cd3207c0-9670-4d46-a10f-61e3230580c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:14.603580 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:14.603580 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:14.603580 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:14.603580 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:14.603580 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:14.603580 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:14.603580 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:14.603580 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:14.603580 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:14.603580 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:14.603580 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:14.603580 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:23:14.603580 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:23:14.603580 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:23:14.604731 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:23:14.604731 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:14.604731 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:14.604731 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:14.604731 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:14.604731 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:14.604731 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:14.604731 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:14.604731 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:14.604731 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:14.604731 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:14.604731 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:14.604731 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:14.604731 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:14.604731 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:14.604731 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:14.604731 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:14.605889 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:23:14.605889 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:23:14.605889 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:23:14.605889 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:23:14.605889 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:23:14.605889 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:23:14.605889 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:14.605889 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:14.606623 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 324/658] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:23:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:14.607691 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3207c0-9670-4d46-a10f-61e3230580c4 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:14.624945 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:14.670888 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a896a-487e-4307-8003-6a5adf1ab350 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:14.686309 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:14.716165 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e421d-8dc0-41cf-b0e2-9b621fc80475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:14.717192 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e421d-8dc0-41cf-b0e2-9b621fc80475 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:14.717815 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e421d-8dc0-41cf-b0e2-9b621fc80475 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:14.718015 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e421d-8dc0-41cf-b0e2-9b621fc80475 None admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:14.719062 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647e421d-8dc0-41cf-b0e2-9b621fc80475 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:14.719176 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647e421d-8dc0-41cf-b0e2-9b621fc80475 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:14.721040 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647e421d-8dc0-41cf-b0e2-9b621fc80475 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:14.726487 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3207c0-9670-4d46-a10f-61e3230580c4 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:14.735096 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 335/659] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:23:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:14.736579 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d16193-ad98-4168-86c6-8054b78a030e None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:14.736867 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d16193-ad98-4168-86c6-8054b78a030e None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:14.737141 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d16193-ad98-4168-86c6-8054b78a030e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:14.758065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-e1d16193-ad98-4168-86c6-8054b78a030e None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:14.759337 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e1d16193-ad98-4168-86c6-8054b78a030e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:14.771582 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045596c8-5fbc-4b89-b05a-11aa60a27a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:14.772319 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045596c8-5fbc-4b89-b05a-11aa60a27a9c None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:14.772660 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045596c8-5fbc-4b89-b05a-11aa60a27a9c None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:14.773053 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045596c8-5fbc-4b89-b05a-11aa60a27a9c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:14.780883 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045596c8-5fbc-4b89-b05a-11aa60a27a9c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:14.782337 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045596c8-5fbc-4b89-b05a-11aa60a27a9c None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:14.795226 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-045596c8-5fbc-4b89-b05a-11aa60a27a9c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 15:23:14.795226 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:14.795226 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:14.795226 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:14.795226 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:14.795226 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:14.795226 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:14.795226 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:14.795226 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:14.795226 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:14.795226 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:14.795226 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:14.795226 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:23:14.795226 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:23:14.795226 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:23:14.795226 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:23:14.796190 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:14.796190 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:14.796190 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:23:14.796190 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:23:14.796190 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:23:14.796190 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:23:14.796190 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:14.796190 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:14.796190 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:14.796190 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:14.796190 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:14.796190 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:14.796190 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:14.796190 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:14.796190 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:14.796190 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:14.796190 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:14.796190 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:14.797146 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:14.797146 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:14.797146 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:23:14.797146 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:23:14.797146 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:23:14.797146 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:23:14.797146 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:23:14.797146 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:23:14.797146 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 15:23:14.797146 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:14.797146 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 325/660] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:23:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:14.797146 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045596c8-5fbc-4b89-b05a-11aa60a27a9c None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:14.840343 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 336/661] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:23:14.841581 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d16193-ad98-4168-86c6-8054b78a030e None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:14.875772 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:14.909242 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045596c8-5fbc-4b89-b05a-11aa60a27a9c None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:14.948680 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57178a74-5ddb-4214-8a5a-7dde5093e727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:14.949292 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57178a74-5ddb-4214-8a5a-7dde5093e727 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:14.949632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57178a74-5ddb-4214-8a5a-7dde5093e727 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:14.949908 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57178a74-5ddb-4214-8a5a-7dde5093e727 None admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:14.950604 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57178a74-5ddb-4214-8a5a-7dde5093e727 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:14.950910 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57178a74-5ddb-4214-8a5a-7dde5093e727 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:14.952387 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57178a74-5ddb-4214-8a5a-7dde5093e727 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:14.965443 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 326/662] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 15:23:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:14.966344 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57178a74-5ddb-4214-8a5a-7dde5093e727 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:14.980576 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d16193-ad98-4168-86c6-8054b78a030e None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:14.984214 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:15.035586 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee161df6-5395-4211-bd27-a95256d69c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:15.037327 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee161df6-5395-4211-bd27-a95256d69c4e None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:15.037818 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee161df6-5395-4211-bd27-a95256d69c4e None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:15.038299 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee161df6-5395-4211-bd27-a95256d69c4e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:15.052596 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee161df6-5395-4211-bd27-a95256d69c4e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:15.054072 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee161df6-5395-4211-bd27-a95256d69c4e None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:15.066780 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-ee161df6-5395-4211-bd27-a95256d69c4e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 15:23:15.066780 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:15.066780 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:15.066780 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:15.066780 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:15.066780 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:15.066780 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:15.066780 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:15.066780 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:15.066780 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:15.066780 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:15.066780 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:15.066780 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:23:15.066780 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:23:15.066780 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:23:15.066780 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:23:15.067848 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:15.067848 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:15.067848 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:23:15.067848 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:23:15.067848 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:23:15.067848 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:23:15.067848 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:15.067848 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:15.067848 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:15.067848 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:15.067848 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:15.067848 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:15.067848 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:15.067848 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:15.067848 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:15.067848 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:15.067848 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:15.067848 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:15.068784 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:15.068784 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:15.068784 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:23:15.068784 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:23:15.068784 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:23:15.068784 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:23:15.068784 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:23:15.068784 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:23:15.068784 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 15:23:15.068784 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:15.072745 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 337/663] 10.222.0.83 () {56 vars in 1102 bytes} [Mon Aug 29 15:23:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:15.073689 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee161df6-5395-4211-bd27-a95256d69c4e None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:15.080433 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57178a74-5ddb-4214-8a5a-7dde5093e727 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:15.113453 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:15.119215 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c832a9f-16c5-4777-a17b-b0901ab619fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:15.119587 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c832a9f-16c5-4777-a17b-b0901ab619fc None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:15.119868 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c832a9f-16c5-4777-a17b-b0901ab619fc None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:15.120163 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c832a9f-16c5-4777-a17b-b0901ab619fc None admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:15.121013 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c832a9f-16c5-4777-a17b-b0901ab619fc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:15.121798 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c832a9f-16c5-4777-a17b-b0901ab619fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:15.123680 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c832a9f-16c5-4777-a17b-b0901ab619fc None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:15.147682 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 327/664] 10.222.0.83 () {56 vars in 1137 bytes} [Mon Aug 29 15:23:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:15.147682 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c832a9f-16c5-4777-a17b-b0901ab619fc None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:15.190640 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee161df6-5395-4211-bd27-a95256d69c4e None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:15.228119 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21853f73-fb3e-41a5-abbe-52bc8e35eafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:15.229020 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21853f73-fb3e-41a5-abbe-52bc8e35eafb None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:15.229301 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21853f73-fb3e-41a5-abbe-52bc8e35eafb None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:15.229575 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21853f73-fb3e-41a5-abbe-52bc8e35eafb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:15.230479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21853f73-fb3e-41a5-abbe-52bc8e35eafb None admin] RBAC: Adding query filter params (role.id=19a8fa4068774a289594739614bb8ad4, scope.project.id=44655977b0814a728f0fa73d442a7ee9, user.id=e6b0f9835ed549cab91d684326be83fa) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:15.231198 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21853f73-fb3e-41a5-abbe-52bc8e35eafb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:15.232680 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21853f73-fb3e-41a5-abbe-52bc8e35eafb None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:15.240325 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 338/665] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 15:23:15 2022] GET /identity/v3/role_assignments?user.id=e6b0f9835ed549cab91d684326be83fa&scope.project.id=44655977b0814a728f0fa73d442a7ee9&role.id=19a8fa4068774a289594739614bb8ad4 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:15.248387 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21853f73-fb3e-41a5-abbe-52bc8e35eafb None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:15.252075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c832a9f-16c5-4777-a17b-b0901ab619fc None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:15.294006 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d191209-abee-4550-a42e-43d88f62baba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:15.294626 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:15.294739 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d191209-abee-4550-a42e-43d88f62baba None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:15.295002 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d191209-abee-4550-a42e-43d88f62baba None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:15.295319 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d191209-abee-4550-a42e-43d88f62baba None admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:15.296077 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d191209-abee-4550-a42e-43d88f62baba None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:15.296388 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d191209-abee-4550-a42e-43d88f62baba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:15.298098 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d191209-abee-4550-a42e-43d88f62baba None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:15.319302 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 328/666] 10.222.0.83 () {56 vars in 1139 bytes} [Mon Aug 29 15:23:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:15.320289 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d191209-abee-4550-a42e-43d88f62baba None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:15.402215 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21853f73-fb3e-41a5-abbe-52bc8e35eafb None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:15.409485 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:15.455258 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb4a2f-d4ec-44cf-b63b-77ffea5285d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:15.455258 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb4a2f-d4ec-44cf-b63b-77ffea5285d5 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:15.455617 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb4a2f-d4ec-44cf-b63b-77ffea5285d5 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:15.457082 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb4a2f-d4ec-44cf-b63b-77ffea5285d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:15.516915 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d191209-abee-4550-a42e-43d88f62baba None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:15.555719 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facb4a2f-d4ec-44cf-b63b-77ffea5285d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:15.557514 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facb4a2f-d4ec-44cf-b63b-77ffea5285d5 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:15.562139 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3c7c8-b0f5-4de0-9db0-dcd29e79c2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:15.562809 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3c7c8-b0f5-4de0-9db0-dcd29e79c2e0 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:15.563670 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3c7c8-b0f5-4de0-9db0-dcd29e79c2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:15.563670 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3c7c8-b0f5-4de0-9db0-dcd29e79c2e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:15.578492 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3c7c8-b0f5-4de0-9db0-dcd29e79c2e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:23:15.586289 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-05b3c7c8-b0f5-4de0-9db0-dcd29e79c2e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:23:15.586289 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:15.586289 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:15.586289 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:15.586289 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:15.586289 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:15.586289 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:15.586289 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:15.586289 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:15.586289 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:15.586289 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:15.586289 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:15.586289 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:23:15.586289 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:23:15.586289 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:23:15.586289 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:23:15.587320 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:23:15.587320 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:23:15.587320 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:23:15.587320 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:23:15.587320 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:15.587320 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:15.587320 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:15.587320 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:15.587320 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:15.587320 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:15.587320 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:15.587320 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:15.587320 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:15.587320 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:15.587320 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:15.587320 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:15.588193 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:15.588193 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:15.588193 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:15.588193 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:15.588193 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:23:15.588193 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:23:15.588193 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:23:15.588193 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:23:15.588193 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:23:15.588193 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:23:15.588193 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:23:15.588193 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:15.588193 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 329/667] 10.222.0.83 () {56 vars in 1102 bytes} [Mon Aug 29 15:23:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:15.588193 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3c7c8-b0f5-4de0-9db0-dcd29e79c2e0 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:15.615408 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:15.704403 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 339/668] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:23:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:23:15.705752 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb4a2f-d4ec-44cf-b63b-77ffea5285d5 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:15.800814 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3c7c8-b0f5-4de0-9db0-dcd29e79c2e0 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:15.825537 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb4a2f-d4ec-44cf-b63b-77ffea5285d5 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:15.833016 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:15.864544 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:15.874556 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a743ca-2f1a-4c6d-aeaa-b112c69c7ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:15.875741 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a743ca-2f1a-4c6d-aeaa-b112c69c7ea6 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:15.876036 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a743ca-2f1a-4c6d-aeaa-b112c69c7ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:15.876308 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a743ca-2f1a-4c6d-aeaa-b112c69c7ea6 None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:15.877119 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a743ca-2f1a-4c6d-aeaa-b112c69c7ea6 None admin] RBAC: Adding query filter params (name=service) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:15.877469 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a743ca-2f1a-4c6d-aeaa-b112c69c7ea6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:15.879582 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a743ca-2f1a-4c6d-aeaa-b112c69c7ea6 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:15.895723 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 340/669] 10.222.0.83 () {56 vars in 1103 bytes} [Mon Aug 29 15:23:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:15.896907 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a743ca-2f1a-4c6d-aeaa-b112c69c7ea6 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:15.906371 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7011df4d-34de-4c97-afea-ad9aa4c3ba5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:15.910330 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011df4d-34de-4c97-afea-ad9aa4c3ba5b None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:15.912231 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011df4d-34de-4c97-afea-ad9aa4c3ba5b None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:15.913575 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011df4d-34de-4c97-afea-ad9aa4c3ba5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:16.002393 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7011df4d-34de-4c97-afea-ad9aa4c3ba5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:16.004384 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7011df4d-34de-4c97-afea-ad9aa4c3ba5b None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:16.030925 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a743ca-2f1a-4c6d-aeaa-b112c69c7ea6 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:16.072811 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780b3ca-6af5-4a34-9b5c-89a2edbba9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:16.074407 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780b3ca-6af5-4a34-9b5c-89a2edbba9ea None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:16.075169 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780b3ca-6af5-4a34-9b5c-89a2edbba9ea None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:16.075854 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780b3ca-6af5-4a34-9b5c-89a2edbba9ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:16.090753 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b780b3ca-6af5-4a34-9b5c-89a2edbba9ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:16.092506 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b780b3ca-6af5-4a34-9b5c-89a2edbba9ea None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:16.111465 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-b780b3ca-6af5-4a34-9b5c-89a2edbba9ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:16.111465 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:16.111465 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:16.111465 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:16.111465 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:16.111465 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:16.111465 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:16.111465 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:16.111465 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:16.111465 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:16.111465 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:16.111465 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:16.111465 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:23:16.111465 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:23:16.111465 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:23:16.111465 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:23:16.112516 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:16.112516 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:16.112516 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:16.112516 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:16.112516 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:16.112516 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:16.112516 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:16.112516 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:16.112516 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:16.112516 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:16.112516 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:16.112516 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:16.112516 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:16.112516 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:16.112516 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:16.112516 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:16.112516 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:23:16.113547 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:23:16.113547 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:16.113547 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:16.115623 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 341/670] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:16.116641 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780b3ca-6af5-4a34-9b5c-89a2edbba9ea None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:16.135131 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 330/671] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:23:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:23:16.136627 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7011df4d-34de-4c97-afea-ad9aa4c3ba5b None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:16.148117 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:16.177540 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:16.242162 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780b3ca-6af5-4a34-9b5c-89a2edbba9ea None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:16.244456 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7011df4d-34de-4c97-afea-ad9aa4c3ba5b None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:16.279957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29058bb-3e01-4fa1-aba0-870929e5d855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:16.280953 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29058bb-3e01-4fa1-aba0-870929e5d855 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:16.281214 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2aa7f1-958e-4344-89eb-39e38fef1f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:16.281674 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29058bb-3e01-4fa1-aba0-870929e5d855 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:16.281861 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2aa7f1-958e-4344-89eb-39e38fef1f82 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:16.282096 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2aa7f1-958e-4344-89eb-39e38fef1f82 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:16.282362 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2aa7f1-958e-4344-89eb-39e38fef1f82 None admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:16.282716 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29058bb-3e01-4fa1-aba0-870929e5d855 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:16.283010 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2aa7f1-958e-4344-89eb-39e38fef1f82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:16.283353 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2aa7f1-958e-4344-89eb-39e38fef1f82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:16.285266 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2aa7f1-958e-4344-89eb-39e38fef1f82 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:16.296069 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29058bb-3e01-4fa1-aba0-870929e5d855 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:16.302781 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 331/672] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:23:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:16.302926 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29058bb-3e01-4fa1-aba0-870929e5d855 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:16.303050 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2aa7f1-958e-4344-89eb-39e38fef1f82 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:16.320583 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-c29058bb-3e01-4fa1-aba0-870929e5d855 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:16.320583 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:16.320583 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:16.320583 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:16.320583 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:16.320583 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:16.320583 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:16.320583 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:16.320583 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:16.320583 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:16.320583 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:16.320583 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:16.320583 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:23:16.320583 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:23:16.320583 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:23:16.320583 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:23:16.321677 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:16.321677 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:16.321677 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:16.321677 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:16.321677 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:16.321677 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:16.321677 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:16.321677 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:16.321677 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:16.321677 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:16.321677 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:16.321677 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:16.321677 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:16.321677 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:16.321677 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:16.321677 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:16.321677 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:23:16.322581 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:23:16.322581 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:16.322581 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:16.329322 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 342/673] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:16.330508 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29058bb-3e01-4fa1-aba0-870929e5d855 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:16.370816 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:16.408039 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2aa7f1-958e-4344-89eb-39e38fef1f82 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:16.437876 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:16.447431 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99705da9-5506-4e78-8d0e-3bc6d7313bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:16.448070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99705da9-5506-4e78-8d0e-3bc6d7313bac None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:16.448347 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99705da9-5506-4e78-8d0e-3bc6d7313bac None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:16.448623 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99705da9-5506-4e78-8d0e-3bc6d7313bac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:16.449705 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29058bb-3e01-4fa1-aba0-870929e5d855 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:16.461217 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99705da9-5506-4e78-8d0e-3bc6d7313bac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:16.462906 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99705da9-5506-4e78-8d0e-3bc6d7313bac None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:16.478943 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-99705da9-5506-4e78-8d0e-3bc6d7313bac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:16.478943 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:16.478943 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:16.478943 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:16.478943 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:16.478943 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:16.478943 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:16.478943 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:16.478943 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:16.478943 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:16.478943 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:16.478943 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:16.478943 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:23:16.478943 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:23:16.478943 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:23:16.478943 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:23:16.480076 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:16.480076 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:16.480076 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:16.480076 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:16.480076 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:16.480076 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:16.480076 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:16.480076 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:16.480076 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:16.480076 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:16.480076 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:16.480076 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:16.480076 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:16.480076 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:16.480076 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:16.480076 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:16.480076 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:23:16.480959 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:23:16.480959 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:16.480959 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:16.484861 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 332/674] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:16.485881 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99705da9-5506-4e78-8d0e-3bc6d7313bac None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:16.494514 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0b8bc-de0e-4e72-9395-4d31bd09b9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:16.495537 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0b8bc-de0e-4e72-9395-4d31bd09b9ab None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:16.496180 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0b8bc-de0e-4e72-9395-4d31bd09b9ab None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:16.496649 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0b8bc-de0e-4e72-9395-4d31bd09b9ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:16.504672 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e0b8bc-de0e-4e72-9395-4d31bd09b9ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:16.506635 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e0b8bc-de0e-4e72-9395-4d31bd09b9ab None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:16.519860 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-61e0b8bc-de0e-4e72-9395-4d31bd09b9ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:16.519860 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:16.519860 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:16.519860 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:16.519860 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:16.519860 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:16.519860 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:16.519860 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:16.519860 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:16.519860 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:16.519860 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:16.519860 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:16.519860 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:23:16.519860 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:23:16.519860 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:23:16.520814 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:23:16.520814 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:16.520814 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:16.520814 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:16.520814 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:16.520814 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:16.520814 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:16.520814 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:16.520814 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:16.520814 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:16.520814 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:16.520814 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:16.520814 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:16.520814 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:16.520814 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:16.520814 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:16.520814 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:16.521709 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:23:16.521709 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:23:16.521709 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:23:16.521709 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:23:16.521709 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:23:16.521709 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:23:16.521709 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:16.521709 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:16.528829 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 343/675] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:23:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:16.529941 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0b8bc-de0e-4e72-9395-4d31bd09b9ab None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:16.599580 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99705da9-5506-4e78-8d0e-3bc6d7313bac None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:16.622407 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:16.636450 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071aa88-8a03-4403-9b41-397c71e09be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:16.637084 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071aa88-8a03-4403-9b41-397c71e09be4 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:16.637358 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071aa88-8a03-4403-9b41-397c71e09be4 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:16.637629 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071aa88-8a03-4403-9b41-397c71e09be4 None admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:16.638266 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8071aa88-8a03-4403-9b41-397c71e09be4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:16.638566 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8071aa88-8a03-4403-9b41-397c71e09be4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:16.639962 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8071aa88-8a03-4403-9b41-397c71e09be4 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:16.644756 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0b8bc-de0e-4e72-9395-4d31bd09b9ab None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:16.656115 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 333/676] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:23:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:16.656115 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071aa88-8a03-4403-9b41-397c71e09be4 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:16.687756 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b25839-75b5-40e6-8d49-4a006e408aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:16.688556 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b25839-75b5-40e6-8d49-4a006e408aca None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:16.688833 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b25839-75b5-40e6-8d49-4a006e408aca None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:16.689096 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b25839-75b5-40e6-8d49-4a006e408aca None admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:16.689738 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b25839-75b5-40e6-8d49-4a006e408aca None admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:16.690077 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b25839-75b5-40e6-8d49-4a006e408aca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:16.691475 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b25839-75b5-40e6-8d49-4a006e408aca None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:16.710114 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 344/677] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:23:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:16.710114 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cece4ce-e453-4ffc-81c1-7f06d257fba4 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:16.710114 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cece4ce-e453-4ffc-81c1-7f06d257fba4 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:16.710114 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cece4ce-e453-4ffc-81c1-7f06d257fba4 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:16.710114 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 345/678] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:23:16.710535 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cece4ce-e453-4ffc-81c1-7f06d257fba4 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:16.733586 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:16.772327 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071aa88-8a03-4403-9b41-397c71e09be4 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:16.814129 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dcde55-3cb1-4deb-95c8-902ec3b6dfd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:16.814777 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dcde55-3cb1-4deb-95c8-902ec3b6dfd5 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:16.815079 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dcde55-3cb1-4deb-95c8-902ec3b6dfd5 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:16.815423 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dcde55-3cb1-4deb-95c8-902ec3b6dfd5 None admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:16.816120 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dcde55-3cb1-4deb-95c8-902ec3b6dfd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:16.816431 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dcde55-3cb1-4deb-95c8-902ec3b6dfd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:16.817896 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dcde55-3cb1-4deb-95c8-902ec3b6dfd5 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:16.825618 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cece4ce-e453-4ffc-81c1-7f06d257fba4 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:16.836473 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 334/679] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 15:23:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:16.836473 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dcde55-3cb1-4deb-95c8-902ec3b6dfd5 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:16.866098 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae2a30-4b87-4116-b3c5-e6ebaca0602b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:16.866645 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae2a30-4b87-4116-b3c5-e6ebaca0602b None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:16.866925 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae2a30-4b87-4116-b3c5-e6ebaca0602b None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:16.867216 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae2a30-4b87-4116-b3c5-e6ebaca0602b None admin] PATH_INFO: `/v3/users/swift` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:16.875750 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae2a30-4b87-4116-b3c5-e6ebaca0602b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:16.877242 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae2a30-4b87-4116-b3c5-e6ebaca0602b None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:16.881202 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:16.890359 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-4eae2a30-4b87-4116-b3c5-e6ebaca0602b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 15:23:16.890359 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:16.890359 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:16.890359 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:16.890359 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:16.890359 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:16.890359 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:16.890359 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:16.890359 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:16.890359 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:16.890359 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:16.890359 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:16.890359 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:23:16.890359 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:23:16.890359 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:23:16.890359 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:23:16.891377 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:16.891377 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:16.891377 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:23:16.891377 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:23:16.891377 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:23:16.891377 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:23:16.891377 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:16.891377 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:16.891377 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:16.891377 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:16.891377 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:16.891377 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:16.891377 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:16.891377 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:16.891377 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:16.891377 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:16.891377 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:16.891377 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:16.892314 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:16.892314 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:16.892314 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:23:16.892314 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:23:16.892314 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:23:16.892314 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:23:16.892314 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:23:16.892314 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:23:16.892314 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 15:23:16.892314 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:16.892314 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 346/680] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 15:23:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:16.893393 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85d671-82bf-4e57-b895-9893ac12bdef None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:16.893393 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85d671-82bf-4e57-b895-9893ac12bdef None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:16.893674 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85d671-82bf-4e57-b895-9893ac12bdef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:16.911821 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-3d85d671-82bf-4e57-b895-9893ac12bdef None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:16.913012 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3d85d671-82bf-4e57-b895-9893ac12bdef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:16.953260 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dcde55-3cb1-4deb-95c8-902ec3b6dfd5 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:16.981588 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 347/681] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:23:16.982388 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85d671-82bf-4e57-b895-9893ac12bdef None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:16.986178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:16.995305 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b6b953-4507-4567-87dc-b9fa88866f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:16.996172 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6b953-4507-4567-87dc-b9fa88866f0b None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:16.996619 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6b953-4507-4567-87dc-b9fa88866f0b None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:16.997453 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6b953-4507-4567-87dc-b9fa88866f0b None admin] PATH_INFO: `/v3/projects/service` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:17.007320 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b6b953-4507-4567-87dc-b9fa88866f0b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:17.008777 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b6b953-4507-4567-87dc-b9fa88866f0b None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:17.024615 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-f8b6b953-4507-4567-87dc-b9fa88866f0b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:17.024615 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:17.024615 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:17.024615 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:17.024615 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:17.024615 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:17.024615 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:17.024615 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:17.024615 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:17.024615 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:17.024615 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:17.024615 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:17.024615 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:23:17.024615 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:23:17.024615 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:23:17.025618 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:23:17.025618 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:17.025618 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:17.025618 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:17.025618 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:17.025618 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:17.025618 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:17.025618 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:17.025618 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:17.025618 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:17.025618 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:17.025618 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:17.025618 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:17.025618 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:17.025618 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:17.025618 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:17.025618 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:17.026509 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:23:17.026509 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:23:17.026509 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:23:17.026509 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:23:17.026509 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:23:17.026509 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:23:17.026509 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:17.026509 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:17.028865 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 335/682] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:23:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:17.030076 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b6b953-4507-4567-87dc-b9fa88866f0b None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:17.104745 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85d671-82bf-4e57-b895-9893ac12bdef None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:17.145327 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d04265-562a-4633-9dab-26aaca94bb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:17.146141 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d04265-562a-4633-9dab-26aaca94bb8e None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:17.146518 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d04265-562a-4633-9dab-26aaca94bb8e None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:17.146885 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d04265-562a-4633-9dab-26aaca94bb8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:17.147841 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d04265-562a-4633-9dab-26aaca94bb8e None admin] RBAC: Adding query filter params (role.id=19a8fa4068774a289594739614bb8ad4, scope.project.id=44655977b0814a728f0fa73d442a7ee9, user.id=fd42634b2795427cba6614c53491ded2) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:17.148252 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d04265-562a-4633-9dab-26aaca94bb8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:17.149836 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d04265-562a-4633-9dab-26aaca94bb8e None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:17.160684 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 348/683] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 15:23:16 2022] GET /identity/v3/role_assignments?user.id=fd42634b2795427cba6614c53491ded2&scope.project.id=44655977b0814a728f0fa73d442a7ee9&role.id=19a8fa4068774a289594739614bb8ad4 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:17.160684 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d04265-562a-4633-9dab-26aaca94bb8e None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:17.176139 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:17.180372 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b6b953-4507-4567-87dc-b9fa88866f0b None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:17.247424 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:17.267898 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c157c91-9566-42a0-b2bf-1e72178b245e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:17.269196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c157c91-9566-42a0-b2bf-1e72178b245e None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:17.269696 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c157c91-9566-42a0-b2bf-1e72178b245e None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:17.270168 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c157c91-9566-42a0-b2bf-1e72178b245e None admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:17.270938 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c157c91-9566-42a0-b2bf-1e72178b245e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:17.271276 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c157c91-9566-42a0-b2bf-1e72178b245e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:17.272829 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c157c91-9566-42a0-b2bf-1e72178b245e None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:17.284967 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d04265-562a-4633-9dab-26aaca94bb8e None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:17.303552 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 336/684] 10.222.0.83 () {56 vars in 1135 bytes} [Mon Aug 29 15:23:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:17.304906 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c157c91-9566-42a0-b2bf-1e72178b245e None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:17.328426 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7616a4-9a15-47c0-b9b5-47c45bcc637f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:17.329065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7616a4-9a15-47c0-b9b5-47c45bcc637f None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:17.329344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7616a4-9a15-47c0-b9b5-47c45bcc637f None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:17.329618 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7616a4-9a15-47c0-b9b5-47c45bcc637f None admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:17.330338 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7616a4-9a15-47c0-b9b5-47c45bcc637f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:17.330686 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7616a4-9a15-47c0-b9b5-47c45bcc637f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:17.332726 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7616a4-9a15-47c0-b9b5-47c45bcc637f None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:17.353028 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 349/685] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 15:23:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:17.353028 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7616a4-9a15-47c0-b9b5-47c45bcc637f None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:17.453174 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c157c91-9566-42a0-b2bf-1e72178b245e None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:17.493872 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7616a4-9a15-47c0-b9b5-47c45bcc637f None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:17.498699 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e7be2-63bd-478d-af3d-92ee01fa417d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:17.499365 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e7be2-63bd-478d-af3d-92ee01fa417d None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:17.499640 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e7be2-63bd-478d-af3d-92ee01fa417d None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:17.499904 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e7be2-63bd-478d-af3d-92ee01fa417d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:17.511389 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14e7be2-63bd-478d-af3d-92ee01fa417d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:23:17.516207 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-f14e7be2-63bd-478d-af3d-92ee01fa417d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:23:17.516207 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:17.516207 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:17.516207 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:17.516207 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:17.516207 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:17.516207 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:17.516207 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:17.516207 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:17.516207 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:17.516207 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:17.516207 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:17.516207 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:23:17.516207 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:23:17.516207 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:23:17.516207 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:23:17.517191 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:23:17.517191 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:23:17.517191 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:23:17.517191 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:23:17.517191 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:17.517191 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:17.517191 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:17.517191 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:17.517191 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:17.517191 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:17.517191 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:17.517191 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:17.517191 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:17.517191 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:17.517191 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:17.517191 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:17.518609 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:17.518609 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:17.518609 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:17.518609 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:17.518609 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:23:17.518609 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:23:17.518609 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:23:17.518609 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:23:17.518609 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:23:17.518609 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:23:17.518609 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:23:17.518609 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:17.522897 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 337/686] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 15:23:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:17.524617 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e7be2-63bd-478d-af3d-92ee01fa417d None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:17.528342 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:17.538089 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f709a-855b-4e95-beb9-9e5e74642b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:17.538705 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f709a-855b-4e95-beb9-9e5e74642b9e None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:17.538976 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f709a-855b-4e95-beb9-9e5e74642b9e None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:17.539273 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f709a-855b-4e95-beb9-9e5e74642b9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:17.550278 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:17.625325 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f709a-855b-4e95-beb9-9e5e74642b9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:17.626812 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f709a-855b-4e95-beb9-9e5e74642b9e None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:17.647945 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e7be2-63bd-478d-af3d-92ee01fa417d None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:17.697022 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ca3f8-ac8d-4645-9d7e-60433d077cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:17.697640 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ca3f8-ac8d-4645-9d7e-60433d077cf1 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:17.699093 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ca3f8-ac8d-4645-9d7e-60433d077cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:17.699093 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ca3f8-ac8d-4645-9d7e-60433d077cf1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:17.699093 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ca3f8-ac8d-4645-9d7e-60433d077cf1 None admin] RBAC: Adding query filter params (role.id=19a8fa4068774a289594739614bb8ad4, scope.project.id=44655977b0814a728f0fa73d442a7ee9, user.id=9a84bb38f6454574897120223b8fc140) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:17.699378 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ca3f8-ac8d-4645-9d7e-60433d077cf1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:17.700700 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ca3f8-ac8d-4645-9d7e-60433d077cf1 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:17.708619 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 338/687] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 15:23:17 2022] GET /identity/v3/role_assignments?user.id=9a84bb38f6454574897120223b8fc140&scope.project.id=44655977b0814a728f0fa73d442a7ee9&role.id=19a8fa4068774a289594739614bb8ad4 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:17.710199 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c12337-c940-4778-91da-3187c4a85b70 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:17.710625 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c12337-c940-4778-91da-3187c4a85b70 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:17.711359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c12337-c940-4778-91da-3187c4a85b70 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:17.712337 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 339/688] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:23:17.715955 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c12337-c940-4778-91da-3187c4a85b70 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:17.786028 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 350/689] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:23:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:23:17.787882 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f7b4f-fa87-43ac-b2c2-8f6f64dd98d1 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:17.788363 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f7b4f-fa87-43ac-b2c2-8f6f64dd98d1 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:17.788993 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f7b4f-fa87-43ac-b2c2-8f6f64dd98d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:17.810902 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-646f7b4f-fa87-43ac-b2c2-8f6f64dd98d1 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:17.813225 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-646f7b4f-fa87-43ac-b2c2-8f6f64dd98d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:17.843841 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:17.852905 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:17.876389 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c12337-c940-4778-91da-3187c4a85b70 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:17.910653 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 351/690] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:23:17.912963 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f7b4f-fa87-43ac-b2c2-8f6f64dd98d1 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:17.923565 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97531bed-ead9-4f81-b406-1ec0b612dfa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:17.924865 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97531bed-ead9-4f81-b406-1ec0b612dfa2 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:17.925257 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97531bed-ead9-4f81-b406-1ec0b612dfa2 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:17.925634 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97531bed-ead9-4f81-b406-1ec0b612dfa2 None admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:17.926419 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97531bed-ead9-4f81-b406-1ec0b612dfa2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:17.926828 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97531bed-ead9-4f81-b406-1ec0b612dfa2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:17.929039 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97531bed-ead9-4f81-b406-1ec0b612dfa2 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:17.942380 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 340/691] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:23:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:17.949105 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97531bed-ead9-4f81-b406-1ec0b612dfa2 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:18.039780 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f7b4f-fa87-43ac-b2c2-8f6f64dd98d1 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:18.080203 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97531bed-ead9-4f81-b406-1ec0b612dfa2 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:18.080716 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee7d0c-af79-40b9-818a-e793f6c7f496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:18.081853 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee7d0c-af79-40b9-818a-e793f6c7f496 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:18.082271 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee7d0c-af79-40b9-818a-e793f6c7f496 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:18.082679 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee7d0c-af79-40b9-818a-e793f6c7f496 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:18.094206 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee7d0c-af79-40b9-818a-e793f6c7f496 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:18.095890 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee7d0c-af79-40b9-818a-e793f6c7f496 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:18.113215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-7bee7d0c-af79-40b9-818a-e793f6c7f496 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:18.113215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:18.113215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:18.113215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:18.113215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:18.113215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:18.113215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:18.113215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:18.113215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:18.113215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:18.113215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:18.113215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:18.113215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:23:18.113215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:23:18.113215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:23:18.113215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:23:18.114884 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:18.114884 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:18.114884 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:18.114884 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:18.114884 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:18.114884 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:18.114884 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:18.114884 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:18.114884 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:18.114884 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:18.114884 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:18.114884 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:18.114884 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:18.114884 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:18.114884 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:18.114884 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:18.114884 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:23:18.115790 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:23:18.115790 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:18.115790 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:18.117911 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 352/692] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:18.123225 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbcfdcf-784a-4db3-aa18-fe7a9d94dc47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:18.123782 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee7d0c-af79-40b9-818a-e793f6c7f496 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:18.123891 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcfdcf-784a-4db3-aa18-fe7a9d94dc47 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:18.124127 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcfdcf-784a-4db3-aa18-fe7a9d94dc47 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:18.124406 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcfdcf-784a-4db3-aa18-fe7a9d94dc47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:18.138767 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbcfdcf-784a-4db3-aa18-fe7a9d94dc47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:18.140929 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:18.141939 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbcfdcf-784a-4db3-aa18-fe7a9d94dc47 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:18.148192 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:18.164920 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-3cbcfdcf-784a-4db3-aa18-fe7a9d94dc47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:18.164920 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:18.164920 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:18.164920 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:18.164920 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:18.164920 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:18.164920 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:18.164920 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:18.164920 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:18.164920 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:18.164920 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:18.164920 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:18.164920 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:23:18.164920 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:23:18.164920 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:23:18.164920 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:23:18.166239 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:18.166239 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:18.166239 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:18.166239 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:18.166239 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:18.166239 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:18.166239 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:18.166239 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:18.166239 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:18.166239 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:18.166239 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:18.166239 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:18.166239 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:18.166239 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:18.166239 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:18.166239 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:18.166239 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:23:18.167169 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:23:18.167169 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:18.167169 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:18.169461 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 341/693] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:18.181171 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbcfdcf-784a-4db3-aa18-fe7a9d94dc47 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:18.261257 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee7d0c-af79-40b9-818a-e793f6c7f496 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:18.301435 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0a316-0c3c-4452-9dfa-1b3f47f75b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:18.302406 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0a316-0c3c-4452-9dfa-1b3f47f75b68 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:18.302877 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0a316-0c3c-4452-9dfa-1b3f47f75b68 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:18.303422 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0a316-0c3c-4452-9dfa-1b3f47f75b68 None admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:18.304263 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0a316-0c3c-4452-9dfa-1b3f47f75b68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:18.304672 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbcfdcf-784a-4db3-aa18-fe7a9d94dc47 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:18.305024 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0a316-0c3c-4452-9dfa-1b3f47f75b68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:18.306579 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0a316-0c3c-4452-9dfa-1b3f47f75b68 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:18.320713 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 353/694] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:23:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:23:18.326475 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0a316-0c3c-4452-9dfa-1b3f47f75b68 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:18.347506 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef0b08-ff54-48af-8657-76a5611edcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:18.348249 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef0b08-ff54-48af-8657-76a5611edcbb None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:18.348533 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef0b08-ff54-48af-8657-76a5611edcbb None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:18.348805 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef0b08-ff54-48af-8657-76a5611edcbb None admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:18.349459 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cef0b08-ff54-48af-8657-76a5611edcbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:18.349764 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cef0b08-ff54-48af-8657-76a5611edcbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:18.351187 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cef0b08-ff54-48af-8657-76a5611edcbb None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:18.372470 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 342/695] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:23:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:18.372470 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef0b08-ff54-48af-8657-76a5611edcbb None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:18.412452 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:18.443373 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:18.456551 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0a316-0c3c-4452-9dfa-1b3f47f75b68 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:18.495218 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef0b08-ff54-48af-8657-76a5611edcbb None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:18.503655 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ed5f6-4e92-4bae-8b66-3e2e60614d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:18.504866 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ed5f6-4e92-4bae-8b66-3e2e60614d60 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:18.505162 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ed5f6-4e92-4bae-8b66-3e2e60614d60 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:18.505439 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ed5f6-4e92-4bae-8b66-3e2e60614d60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:18.519690 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666ed5f6-4e92-4bae-8b66-3e2e60614d60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:18.521568 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666ed5f6-4e92-4bae-8b66-3e2e60614d60 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:18.538122 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4324fe60-da7f-49d1-a22d-b3ef129d2218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:18.538763 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324fe60-da7f-49d1-a22d-b3ef129d2218 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:18.539061 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324fe60-da7f-49d1-a22d-b3ef129d2218 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:18.539343 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324fe60-da7f-49d1-a22d-b3ef129d2218 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:18.541890 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-666ed5f6-4e92-4bae-8b66-3e2e60614d60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:18.541890 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:18.541890 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:18.541890 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:18.541890 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:18.541890 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:18.541890 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:18.541890 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:18.541890 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:18.541890 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:18.541890 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:18.541890 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:18.541890 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:23:18.541890 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:23:18.541890 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:23:18.541890 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:23:18.543007 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:18.543007 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:18.543007 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:18.543007 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:18.543007 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:18.543007 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:18.543007 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:18.543007 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:18.543007 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:18.543007 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:18.543007 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:18.543007 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:18.543007 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:18.543007 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:18.543007 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:18.543007 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:18.543007 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:23:18.544117 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:23:18.544117 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:18.544117 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:18.550850 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4324fe60-da7f-49d1-a22d-b3ef129d2218 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:18.550850 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4324fe60-da7f-49d1-a22d-b3ef129d2218 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:18.551670 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 354/696] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:18.552702 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ed5f6-4e92-4bae-8b66-3e2e60614d60 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:18.565040 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-4324fe60-da7f-49d1-a22d-b3ef129d2218 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:18.565040 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:18.565040 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:18.565040 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:18.565040 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:18.565040 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:18.565040 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:18.565040 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:18.565040 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:18.565040 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:18.565040 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:18.565040 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:18.565040 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:23:18.565040 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:23:18.565040 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:23:18.566078 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:23:18.566078 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:18.566078 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:18.566078 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:18.566078 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:18.566078 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:18.566078 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:18.566078 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:18.566078 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:18.566078 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:18.566078 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:18.566078 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:18.566078 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:18.566078 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:18.566078 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:18.566078 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:18.566078 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:18.567595 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:23:18.567595 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:23:18.567595 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:23:18.567595 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:23:18.567595 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:23:18.567595 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:23:18.567595 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:18.567595 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:18.567595 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 343/697] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:23:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:18.567595 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4324fe60-da7f-49d1-a22d-b3ef129d2218 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:18.668221 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ed5f6-4e92-4bae-8b66-3e2e60614d60 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:18.695542 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:18.710955 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4324fe60-da7f-49d1-a22d-b3ef129d2218 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:18.722613 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e163fb-21a0-46cf-bfc8-45882c1f0423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:18.727190 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e163fb-21a0-46cf-bfc8-45882c1f0423 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:18.727713 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e163fb-21a0-46cf-bfc8-45882c1f0423 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:18.728199 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e163fb-21a0-46cf-bfc8-45882c1f0423 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:18.730494 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:18.742359 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e163fb-21a0-46cf-bfc8-45882c1f0423 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:18.746160 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e163fb-21a0-46cf-bfc8-45882c1f0423 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:18.750604 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d453a8a-cb9d-48f8-a2fb-16b2a08944ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:18.756683 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d453a8a-cb9d-48f8-a2fb-16b2a08944ce None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:18.756683 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d453a8a-cb9d-48f8-a2fb-16b2a08944ce None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:18.756683 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d453a8a-cb9d-48f8-a2fb-16b2a08944ce None admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:18.756683 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d453a8a-cb9d-48f8-a2fb-16b2a08944ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:18.756683 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d453a8a-cb9d-48f8-a2fb-16b2a08944ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:18.756683 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d453a8a-cb9d-48f8-a2fb-16b2a08944ce None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:18.765836 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-e1e163fb-21a0-46cf-bfc8-45882c1f0423 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 15:23:18.765836 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:18.765836 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:18.765836 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:18.765836 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:18.765836 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:18.765836 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:18.765836 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:18.765836 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:18.765836 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:18.765836 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:18.765836 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:18.765836 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:23:18.765836 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:23:18.765836 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:23:18.765836 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:23:18.767011 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:18.767011 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:18.767011 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:23:18.767011 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:23:18.767011 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:23:18.767011 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:23:18.767011 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:18.767011 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:18.767011 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:18.767011 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:18.767011 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:18.767011 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:18.767011 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:18.767011 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:18.767011 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:18.767011 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:18.767011 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:18.767011 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:18.768696 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:18.768696 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:18.768696 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:23:18.768696 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:23:18.768696 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:23:18.768696 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:23:18.768696 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:23:18.768696 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:23:18.768696 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 15:23:18.768696 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:18.769266 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 344/698] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:23:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:18.769266 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d453a8a-cb9d-48f8-a2fb-16b2a08944ce None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:18.771142 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 355/699] 10.222.0.83 () {56 vars in 1093 bytes} [Mon Aug 29 15:23:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:18.773974 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e163fb-21a0-46cf-bfc8-45882c1f0423 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:18.892799 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e163fb-21a0-46cf-bfc8-45882c1f0423 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:18.897462 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d453a8a-cb9d-48f8-a2fb-16b2a08944ce None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:18.934785 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f0a01-c912-407e-8177-dc0a857e9b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:18.935458 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f0a01-c912-407e-8177-dc0a857e9b5a None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:18.935726 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f0a01-c912-407e-8177-dc0a857e9b5a None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:18.936129 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f0a01-c912-407e-8177-dc0a857e9b5a None admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:18.936812 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f0a01-c912-407e-8177-dc0a857e9b5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:18.937111 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f0a01-c912-407e-8177-dc0a857e9b5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:18.938314 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0fa23-d80b-4c09-a7f8-2844fd2d57d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:18.938535 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f0a01-c912-407e-8177-dc0a857e9b5a None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:18.939258 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0fa23-d80b-4c09-a7f8-2844fd2d57d3 None admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:18.940340 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0fa23-d80b-4c09-a7f8-2844fd2d57d3 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:18.941012 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0fa23-d80b-4c09-a7f8-2844fd2d57d3 None admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:18.942350 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f0fa23-d80b-4c09-a7f8-2844fd2d57d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:18.944019 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f0fa23-d80b-4c09-a7f8-2844fd2d57d3 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:18.951954 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 345/700] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 15:23:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:18.952787 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f0a01-c912-407e-8177-dc0a857e9b5a None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:18.973126 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 356/701] 10.222.0.83 () {60 vars in 1132 bytes} [Mon Aug 29 15:23:18 2022] POST /identity/v3/users => generated 254 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:23:18.974510 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0fa23-d80b-4c09-a7f8-2844fd2d57d3 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:19.000772 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:19.064400 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:19.159189 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f0a01-c912-407e-8177-dc0a857e9b5a None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:19.190672 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0fa23-d80b-4c09-a7f8-2844fd2d57d3 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:19.221254 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4765ff8-c96b-4126-b5be-581f64c02d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:19.222737 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4765ff8-c96b-4126-b5be-581f64c02d0c None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:19.223496 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4765ff8-c96b-4126-b5be-581f64c02d0c None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:19.223783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4765ff8-c96b-4126-b5be-581f64c02d0c None admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:19.225584 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4765ff8-c96b-4126-b5be-581f64c02d0c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:19.225710 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4765ff8-c96b-4126-b5be-581f64c02d0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:19.227173 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4765ff8-c96b-4126-b5be-581f64c02d0c None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:19.243884 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824ada2-70bd-47e0-85e3-780bcb183c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:19.245594 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824ada2-70bd-47e0-85e3-780bcb183c6c None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:19.246284 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824ada2-70bd-47e0-85e3-780bcb183c6c None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:19.247205 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824ada2-70bd-47e0-85e3-780bcb183c6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:19.248175 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824ada2-70bd-47e0-85e3-780bcb183c6c None admin] RBAC: Adding query filter params (role.id=19a8fa4068774a289594739614bb8ad4, scope.project.id=44655977b0814a728f0fa73d442a7ee9, user.id=b0f8e95d393f499baf44830f9fb7e583) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:19.248712 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824ada2-70bd-47e0-85e3-780bcb183c6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:19.249202 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 346/702] 10.222.0.83 () {56 vars in 1133 bytes} [Mon Aug 29 15:23:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:19.250581 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824ada2-70bd-47e0-85e3-780bcb183c6c None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:19.255177 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4765ff8-c96b-4126-b5be-581f64c02d0c None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:19.258386 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 357/703] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 15:23:18 2022] GET /identity/v3/role_assignments?user.id=b0f8e95d393f499baf44830f9fb7e583&scope.project.id=44655977b0814a728f0fa73d442a7ee9&role.id=19a8fa4068774a289594739614bb8ad4 => generated 608 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:19.371219 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:19.377083 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce88a3-716f-4035-9a5a-87bf9a64913c None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:19.377554 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce88a3-716f-4035-9a5a-87bf9a64913c None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:19.377927 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce88a3-716f-4035-9a5a-87bf9a64913c None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:19.379815 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 358/704] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:23:19.380747 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4765ff8-c96b-4126-b5be-581f64c02d0c None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:19.385555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400ea87-b391-496e-8eb0-551005c362b8 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:19.385947 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400ea87-b391-496e-8eb0-551005c362b8 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:19.386323 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400ea87-b391-496e-8eb0-551005c362b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:19.406304 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-9400ea87-b391-496e-8eb0-551005c362b8 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:19.407695 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9400ea87-b391-496e-8eb0-551005c362b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:19.423259 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a76989-7268-4e89-876c-8ec68964a96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:19.425018 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a76989-7268-4e89-876c-8ec68964a96b None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:19.425568 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a76989-7268-4e89-876c-8ec68964a96b None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:19.426055 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a76989-7268-4e89-876c-8ec68964a96b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:19.486442 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 359/705] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 15:23:19.507119 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a76989-7268-4e89-876c-8ec68964a96b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:19.508949 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a76989-7268-4e89-876c-8ec68964a96b None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:19.610407 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:19.619628 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 347/706] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:23:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:23:19.627226 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400ea87-b391-496e-8eb0-551005c362b8 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:19.663181 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:19.749063 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400ea87-b391-496e-8eb0-551005c362b8 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:19.788336 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d808443-ec52-4fd1-8d01-85b61b8f6c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:19.788975 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d808443-ec52-4fd1-8d01-85b61b8f6c58 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:19.789246 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d808443-ec52-4fd1-8d01-85b61b8f6c58 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:19.789511 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d808443-ec52-4fd1-8d01-85b61b8f6c58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:19.800865 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d808443-ec52-4fd1-8d01-85b61b8f6c58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:19.802719 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d808443-ec52-4fd1-8d01-85b61b8f6c58 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:19.803542 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a76989-7268-4e89-876c-8ec68964a96b None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:19.820811 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-4d808443-ec52-4fd1-8d01-85b61b8f6c58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:19.820811 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:19.820811 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:19.820811 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:19.820811 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:19.820811 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:19.820811 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:19.820811 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:19.820811 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:19.820811 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:19.820811 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:19.820811 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:19.820811 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:23:19.820811 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:23:19.820811 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:23:19.820811 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:23:19.821828 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:19.821828 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:19.821828 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:19.821828 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:19.821828 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:19.821828 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:19.821828 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:19.821828 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:19.821828 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:19.821828 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:19.821828 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:19.821828 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:19.821828 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:19.821828 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:19.821828 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:19.821828 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:19.821828 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:23:19.822726 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:23:19.822726 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:19.822726 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:19.822726 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 360/707] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:19.827794 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d808443-ec52-4fd1-8d01-85b61b8f6c58 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:19.923886 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a76989-7268-4e89-876c-8ec68964a96b None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:19.949916 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:19.972066 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13815c0-dcd8-4b03-ac2a-c3187bd5d217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:19.974398 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13815c0-dcd8-4b03-ac2a-c3187bd5d217 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:19.974897 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13815c0-dcd8-4b03-ac2a-c3187bd5d217 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:19.975430 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13815c0-dcd8-4b03-ac2a-c3187bd5d217 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:19.976788 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13815c0-dcd8-4b03-ac2a-c3187bd5d217 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:19.978806 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13815c0-dcd8-4b03-ac2a-c3187bd5d217 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:19.988245 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d808443-ec52-4fd1-8d01-85b61b8f6c58 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:20.002590 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-f13815c0-dcd8-4b03-ac2a-c3187bd5d217 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 15:23:20.002590 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:20.002590 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:23:20.002590 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:23:20.002590 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:23:20.002590 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:23:20.002590 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:23:20.002590 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:23:20.002590 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 15:23:20.002590 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:20.002590 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:23:20.002590 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:20.002590 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:20.002590 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:20.002590 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:20.002590 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:20.002590 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:20.003840 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:20.003840 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:20.003840 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:20.003840 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:20.003840 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:20.003840 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:20.003840 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:23:20.003840 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:23:20.003840 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:23:20.003840 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:23:20.003840 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:20.003840 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:20.003840 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:20.003840 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:20.003840 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:20.003840 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:20.004866 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:20.004866 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:20.004866 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:20.004866 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:20.004866 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:20.004866 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:20.004866 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:20.004866 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:20.004866 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:20.004866 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:20.004866 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:23:20.004866 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:23:20.004866 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 15:23:20.004866 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:20.016249 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 348/708] 10.222.0.83 () {56 vars in 1129 bytes} [Mon Aug 29 15:23:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:20.020224 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13815c0-dcd8-4b03-ac2a-c3187bd5d217 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:20.065668 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8c861-0490-4f4c-a375-34d13bbad9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:20.066764 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8c861-0490-4f4c-a375-34d13bbad9a1 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:20.067302 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8c861-0490-4f4c-a375-34d13bbad9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:20.067831 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8c861-0490-4f4c-a375-34d13bbad9a1 None admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:20.068692 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8c861-0490-4f4c-a375-34d13bbad9a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:20.069200 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8c861-0490-4f4c-a375-34d13bbad9a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:20.071813 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8c861-0490-4f4c-a375-34d13bbad9a1 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:20.093516 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 361/709] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:23:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:23:20.104897 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8c861-0490-4f4c-a375-34d13bbad9a1 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:20.123999 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:20.172156 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13815c0-dcd8-4b03-ac2a-c3187bd5d217 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:20.212944 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da11df-26d1-43af-a745-cf4ddc981b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:20.213807 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da11df-26d1-43af-a745-cf4ddc981b3c None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:20.214096 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da11df-26d1-43af-a745-cf4ddc981b3c None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:20.214370 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da11df-26d1-43af-a745-cf4ddc981b3c None admin] PATH_INFO: `/v3/services` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:20.215558 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da11df-26d1-43af-a745-cf4ddc981b3c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:20.215867 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da11df-26d1-43af-a745-cf4ddc981b3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:20.217859 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da11df-26d1-43af-a745-cf4ddc981b3c None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:20.225058 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 349/710] 10.222.0.83 () {56 vars in 1124 bytes} [Mon Aug 29 15:23:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:20.225641 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8c861-0490-4f4c-a375-34d13bbad9a1 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:20.226652 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840e67f-c2b3-4425-bfa4-65e295755e6a None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:20.227010 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840e67f-c2b3-4425-bfa4-65e295755e6a None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:20.227407 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840e67f-c2b3-4425-bfa4-65e295755e6a None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:20.231105 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 350/711] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:23:20.232087 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840e67f-c2b3-4425-bfa4-65e295755e6a None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:20.272603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d07771-3575-4829-8f21-b0f52e099aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:20.273765 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d07771-3575-4829-8f21-b0f52e099aa4 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:20.274264 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d07771-3575-4829-8f21-b0f52e099aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:20.274743 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d07771-3575-4829-8f21-b0f52e099aa4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:20.282151 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d07771-3575-4829-8f21-b0f52e099aa4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:20.283833 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d07771-3575-4829-8f21-b0f52e099aa4 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:20.297351 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-37d07771-3575-4829-8f21-b0f52e099aa4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:20.297351 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:20.297351 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:20.297351 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:20.297351 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:20.297351 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:20.297351 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:20.297351 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:20.297351 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:20.297351 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:20.297351 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:20.297351 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:20.297351 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:23:20.297351 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:23:20.297351 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:23:20.298476 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:23:20.298476 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:20.298476 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:20.298476 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:20.298476 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:20.298476 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:20.298476 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:20.298476 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:20.298476 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:20.298476 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:20.298476 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:20.298476 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:20.298476 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:20.298476 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:20.298476 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:20.298476 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:20.298476 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:20.299526 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:23:20.299526 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:23:20.299526 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:23:20.299526 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:23:20.299526 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:23:20.299526 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:23:20.299526 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:20.299526 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:20.306883 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 362/712] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:23:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:20.308485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b65ce-f8ec-4334-885f-d34b68e0bb91 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:20.308946 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b65ce-f8ec-4334-885f-d34b68e0bb91 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:20.309392 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b65ce-f8ec-4334-885f-d34b68e0bb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:20.318846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:20.330945 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-fa8b65ce-f8ec-4334-885f-d34b68e0bb91 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:20.332830 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-fa8b65ce-f8ec-4334-885f-d34b68e0bb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:20.372012 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840e67f-c2b3-4425-bfa4-65e295755e6a None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:20.400434 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:20.413490 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 363/713] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:23:20.413490 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b65ce-f8ec-4334-885f-d34b68e0bb91 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:20.429368 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ec471d-70a9-430f-b633-00355a1703f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:20.430043 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec471d-70a9-430f-b633-00355a1703f4 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:20.430326 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec471d-70a9-430f-b633-00355a1703f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:20.430598 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec471d-70a9-430f-b633-00355a1703f4 None admin] PATH_INFO: `/v3/services` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:20.433165 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ec471d-70a9-430f-b633-00355a1703f4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:20.433475 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ec471d-70a9-430f-b633-00355a1703f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:20.434888 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ec471d-70a9-430f-b633-00355a1703f4 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:20.456306 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 351/714] 10.222.0.83 () {56 vars in 1124 bytes} [Mon Aug 29 15:23:20 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:20.582966 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b65ce-f8ec-4334-885f-d34b68e0bb91 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:20.640230 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6dd20a-b2bc-4dbd-b8c5-81585c51456b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:20.640848 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6dd20a-b2bc-4dbd-b8c5-81585c51456b None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:20.641124 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6dd20a-b2bc-4dbd-b8c5-81585c51456b None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:20.641394 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6dd20a-b2bc-4dbd-b8c5-81585c51456b None admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:20.642102 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6dd20a-b2bc-4dbd-b8c5-81585c51456b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:20.642406 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6dd20a-b2bc-4dbd-b8c5-81585c51456b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:20.643886 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6dd20a-b2bc-4dbd-b8c5-81585c51456b None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:20.646794 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:20.664053 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 364/715] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 15:23:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:20.669829 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ec471d-70a9-430f-b633-00355a1703f4 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:20.798283 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ec471d-70a9-430f-b633-00355a1703f4 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:20.818627 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6dd20a-b2bc-4dbd-b8c5-81585c51456b None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:20.841162 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b425c-3d03-420c-93b7-00e9a332124d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:20.841862 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b425c-3d03-420c-93b7-00e9a332124d None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:20.842237 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b425c-3d03-420c-93b7-00e9a332124d None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:20.842604 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b425c-3d03-420c-93b7-00e9a332124d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:20.843484 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173b425c-3d03-420c-93b7-00e9a332124d None admin] RBAC: Adding query filter params (role.id=4bb2bbb7bb544610877949fc933504d2, scope.project.id=44655977b0814a728f0fa73d442a7ee9, user.id=253947a5ef294d2bb828761873251bd1) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:20.843885 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173b425c-3d03-420c-93b7-00e9a332124d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:20.845950 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173b425c-3d03-420c-93b7-00e9a332124d None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:20.854320 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 352/716] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 15:23:20 2022] GET /identity/v3/role_assignments?user.id=253947a5ef294d2bb828761873251bd1&scope.project.id=44655977b0814a728f0fa73d442a7ee9&role.id=4bb2bbb7bb544610877949fc933504d2 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:20.981428 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6dd20a-b2bc-4dbd-b8c5-81585c51456b None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:21.019360 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01821153-0588-4226-a26f-3a5556451be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:21.019999 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01821153-0588-4226-a26f-3a5556451be0 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:21.020271 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01821153-0588-4226-a26f-3a5556451be0 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:21.020539 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01821153-0588-4226-a26f-3a5556451be0 None admin] PATH_INFO: `/v3/services/network` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:21.021341 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01821153-0588-4226-a26f-3a5556451be0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:21.022722 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01821153-0588-4226-a26f-3a5556451be0 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:21.034534 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-01821153-0588-4226-a26f-3a5556451be0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 15:23:21.034534 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:21.034534 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:23:21.034534 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:23:21.034534 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:23:21.034534 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:23:21.034534 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:23:21.034534 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:23:21.034534 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 15:23:21.034534 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:21.034534 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:23:21.034534 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:21.034534 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:21.034534 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:21.034534 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:21.034534 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:21.034534 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:21.035855 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:21.035855 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:21.035855 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:21.035855 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:21.035855 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:21.035855 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:21.035855 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:23:21.035855 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:23:21.035855 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:23:21.035855 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:23:21.035855 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:21.035855 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:21.035855 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:21.035855 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:21.035855 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:21.035855 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:21.036803 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:21.036803 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:21.036803 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:21.036803 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:21.036803 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:21.036803 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:21.036803 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:21.036803 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:21.036803 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:21.036803 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:21.036803 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:23:21.036803 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:23:21.036803 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 15:23:21.036803 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:21.040545 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 365/717] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:23:20 2022] GET /identity/v3/services/network => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:21.041922 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b425c-3d03-420c-93b7-00e9a332124d None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:21.095496 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:21.147839 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b425c-3d03-420c-93b7-00e9a332124d None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:21.185146 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8b7aa-54ff-47dd-9a38-4b4ebb2b582b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:21.185755 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8b7aa-54ff-47dd-9a38-4b4ebb2b582b None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:21.186030 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8b7aa-54ff-47dd-9a38-4b4ebb2b582b None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:21.186295 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8b7aa-54ff-47dd-9a38-4b4ebb2b582b None admin] PATH_INFO: `/v3/services` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:21.186918 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c8b7aa-54ff-47dd-9a38-4b4ebb2b582b None admin] RBAC: Adding query filter params (name=network) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:21.187236 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c8b7aa-54ff-47dd-9a38-4b4ebb2b582b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:21.188603 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c8b7aa-54ff-47dd-9a38-4b4ebb2b582b None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:21.198658 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 353/718] 10.222.0.83 () {56 vars in 1112 bytes} [Mon Aug 29 15:23:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:21.200143 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01821153-0588-4226-a26f-3a5556451be0 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:21.275447 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:21.311633 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01821153-0588-4226-a26f-3a5556451be0 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:21.346998 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d43989-2259-41a1-81c9-73bf9eff5722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:21.347597 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d43989-2259-41a1-81c9-73bf9eff5722 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:21.347872 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d43989-2259-41a1-81c9-73bf9eff5722 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:21.348192 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d43989-2259-41a1-81c9-73bf9eff5722 None admin] PATH_INFO: `/v3/services` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:21.348819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d43989-2259-41a1-81c9-73bf9eff5722 None admin] RBAC: Adding query filter params (type=network) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:21.349117 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d43989-2259-41a1-81c9-73bf9eff5722 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:21.351403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d43989-2259-41a1-81c9-73bf9eff5722 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:21.361275 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 366/719] 10.222.0.83 () {56 vars in 1112 bytes} [Mon Aug 29 15:23:21 2022] GET /identity/v3/services?type=network => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:21.651717 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d081efc-6699-4331-b721-26eec280a93b None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:21.652208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d081efc-6699-4331-b721-26eec280a93b None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:21.652208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d081efc-6699-4331-b721-26eec280a93b None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:21.653838 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 354/720] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:23:21.658749 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143f606-04ca-4ffe-9a4b-97ddfc955610 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:21.659061 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143f606-04ca-4ffe-9a4b-97ddfc955610 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:21.659333 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143f606-04ca-4ffe-9a4b-97ddfc955610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:21.678060 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-5143f606-04ca-4ffe-9a4b-97ddfc955610 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:21.679285 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5143f606-04ca-4ffe-9a4b-97ddfc955610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:21.759367 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 367/721] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:23:22.031170 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d081efc-6699-4331-b721-26eec280a93b None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:22.161802 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d081efc-6699-4331-b721-26eec280a93b None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:22.177893 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:22.201284 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f111571-ca1d-435a-8701-c849d01bfb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:22.202156 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f111571-ca1d-435a-8701-c849d01bfb36 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:22.202583 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f111571-ca1d-435a-8701-c849d01bfb36 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:22.203003 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f111571-ca1d-435a-8701-c849d01bfb36 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:22.207530 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b2de7-9136-40a5-9d97-6079e5a3048b None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:22.207915 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b2de7-9136-40a5-9d97-6079e5a3048b None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:22.208293 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b2de7-9136-40a5-9d97-6079e5a3048b None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:22.209814 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 368/722] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:23:22.216371 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f111571-ca1d-435a-8701-c849d01bfb36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:23:22.220743 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88ebf5-d3ec-4f96-aadf-4590fcf65deb None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:22.221125 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88ebf5-d3ec-4f96-aadf-4590fcf65deb None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:22.221495 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88ebf5-d3ec-4f96-aadf-4590fcf65deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:22.222712 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-7f111571-ca1d-435a-8701-c849d01bfb36 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:23:22.222712 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:22.222712 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:22.222712 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:22.222712 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:22.222712 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:22.222712 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:22.222712 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:22.222712 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:22.222712 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:22.222712 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:22.222712 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:22.222712 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:23:22.222712 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:23:22.222712 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:23:22.222712 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:23:22.223930 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:23:22.223930 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:23:22.223930 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:23:22.223930 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:23:22.223930 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:22.223930 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:22.223930 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:22.223930 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:22.223930 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:22.223930 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:22.223930 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:22.223930 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:22.223930 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:22.223930 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:22.223930 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:22.223930 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:22.224953 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:22.224953 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:22.224953 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:22.224953 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:22.224953 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:23:22.224953 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:23:22.224953 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:23:22.224953 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:23:22.224953 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:23:22.224953 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:23:22.224953 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:23:22.224953 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:22.227183 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 355/723] 10.222.0.83 () {56 vars in 1102 bytes} [Mon Aug 29 15:23:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:22.233101 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f111571-ca1d-435a-8701-c849d01bfb36 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:22.261120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-df88ebf5-d3ec-4f96-aadf-4590fcf65deb None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:22.265123 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-df88ebf5-d3ec-4f96-aadf-4590fcf65deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:22.347158 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:22.389877 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f111571-ca1d-435a-8701-c849d01bfb36 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:22.400623 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 369/724] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 15:23:22.427438 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c100ee-6cc4-4960-b40b-b9a62de93fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:22.428400 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c100ee-6cc4-4960-b40b-b9a62de93fca None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:22.428883 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c100ee-6cc4-4960-b40b-b9a62de93fca None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:22.429377 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c100ee-6cc4-4960-b40b-b9a62de93fca None admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:22.430259 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c100ee-6cc4-4960-b40b-b9a62de93fca None admin] RBAC: Adding query filter params (name=service) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:22.430789 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c100ee-6cc4-4960-b40b-b9a62de93fca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:22.433643 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c100ee-6cc4-4960-b40b-b9a62de93fca None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:22.443045 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 356/725] 10.222.0.83 () {56 vars in 1103 bytes} [Mon Aug 29 15:23:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:22.455100 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df88ebf5-d3ec-4f96-aadf-4590fcf65deb None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:22.629660 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df88ebf5-d3ec-4f96-aadf-4590fcf65deb None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:22.676215 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e12d837-8f84-4c07-9c9a-71260d99531b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:22.676857 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12d837-8f84-4c07-9c9a-71260d99531b None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:22.677139 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12d837-8f84-4c07-9c9a-71260d99531b None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:22.677400 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12d837-8f84-4c07-9c9a-71260d99531b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:22.696984 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e12d837-8f84-4c07-9c9a-71260d99531b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:22.699154 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e12d837-8f84-4c07-9c9a-71260d99531b None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:22.722924 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-1e12d837-8f84-4c07-9c9a-71260d99531b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:22.722924 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:22.722924 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:22.722924 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:22.722924 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:22.722924 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:22.722924 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:22.722924 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:22.722924 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:22.722924 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:22.722924 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:22.722924 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:22.722924 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:23:22.722924 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:23:22.722924 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:23:22.722924 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:23:22.723909 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:22.723909 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:22.723909 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:22.723909 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:22.723909 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:22.723909 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:22.723909 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:22.723909 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:22.723909 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:22.723909 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:22.723909 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:22.723909 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:22.723909 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:22.723909 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:22.723909 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:22.723909 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:22.723909 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:23:22.724789 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:23:22.724789 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:22.724789 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:22.724789 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 370/726] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:22.730751 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c100ee-6cc4-4960-b40b-b9a62de93fca None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:22.734201 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e12d837-8f84-4c07-9c9a-71260d99531b None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:22.801376 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:22.812813 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:22.873057 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e12d837-8f84-4c07-9c9a-71260d99531b None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:22.910593 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eaad8d-8eba-4396-ada7-7dde583be6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:22.911182 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eaad8d-8eba-4396-ada7-7dde583be6f0 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:22.911459 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eaad8d-8eba-4396-ada7-7dde583be6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:22.911726 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eaad8d-8eba-4396-ada7-7dde583be6f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:22.923186 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eaad8d-8eba-4396-ada7-7dde583be6f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:23:22.928196 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-e6eaad8d-8eba-4396-ada7-7dde583be6f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:23:22.928196 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:22.928196 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:22.928196 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:22.928196 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:22.928196 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:22.928196 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:22.928196 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:22.928196 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:22.928196 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:22.928196 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:22.928196 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:22.928196 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:23:22.928196 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:23:22.928196 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:23:22.928196 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:23:22.929109 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:23:22.929109 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:23:22.929109 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:23:22.929109 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:23:22.929109 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:22.929109 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:22.929109 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:22.929109 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:22.929109 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:22.929109 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:22.929109 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:22.929109 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:22.929109 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:22.929109 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:22.929109 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:22.929109 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:22.929948 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:22.929948 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:22.929948 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:22.929948 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:22.929948 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:23:22.929948 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:23:22.929948 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:23:22.929948 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:23:22.929948 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:23:22.929948 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:23:22.929948 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:23:22.929948 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:22.934308 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 371/727] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 15:23:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:23:22.935632 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eaad8d-8eba-4396-ada7-7dde583be6f0 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:22.954735 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c100ee-6cc4-4960-b40b-b9a62de93fca None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:23.035328 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33a48a-b048-4634-866f-4db514d530c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:23.036050 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33a48a-b048-4634-866f-4db514d530c3 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:23.036335 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33a48a-b048-4634-866f-4db514d530c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:23.036610 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33a48a-b048-4634-866f-4db514d530c3 None admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:23.037260 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c33a48a-b048-4634-866f-4db514d530c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:23.037564 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c33a48a-b048-4634-866f-4db514d530c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:23.037972 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:23.043778 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c33a48a-b048-4634-866f-4db514d530c3 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:23.044714 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eaad8d-8eba-4396-ada7-7dde583be6f0 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:23.077527 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 357/728] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:23:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:23.082886 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c386b1-8e62-4f8c-86bf-79f8b128e159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:23.083560 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c386b1-8e62-4f8c-86bf-79f8b128e159 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:23.083832 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c386b1-8e62-4f8c-86bf-79f8b128e159 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:23.084012 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33a48a-b048-4634-866f-4db514d530c3 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:23.084131 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c386b1-8e62-4f8c-86bf-79f8b128e159 None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:23.084747 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c386b1-8e62-4f8c-86bf-79f8b128e159 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:23.085146 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c386b1-8e62-4f8c-86bf-79f8b128e159 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:23.086635 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c386b1-8e62-4f8c-86bf-79f8b128e159 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:23.101160 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 372/729] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:23:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:23:23.102397 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c386b1-8e62-4f8c-86bf-79f8b128e159 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:23.201996 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:23.209839 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33a48a-b048-4634-866f-4db514d530c3 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:23.220078 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c386b1-8e62-4f8c-86bf-79f8b128e159 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:23.248474 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc54d0-de46-43ba-b4b2-71e7c367add5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:23.249112 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc54d0-de46-43ba-b4b2-71e7c367add5 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:23.249385 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc54d0-de46-43ba-b4b2-71e7c367add5 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:23.249853 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc54d0-de46-43ba-b4b2-71e7c367add5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:23.257411 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbc54d0-de46-43ba-b4b2-71e7c367add5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:23.257820 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b118b-2e93-43ea-87f7-9136edf5af44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:23.258460 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b118b-2e93-43ea-87f7-9136edf5af44 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:23.258738 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b118b-2e93-43ea-87f7-9136edf5af44 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:23.258901 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbc54d0-de46-43ba-b4b2-71e7c367add5 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:23.259011 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b118b-2e93-43ea-87f7-9136edf5af44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:23.271880 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b118b-2e93-43ea-87f7-9136edf5af44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:23.272801 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-ddbc54d0-de46-43ba-b4b2-71e7c367add5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 15:23:23.272801 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:23.272801 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:23.272801 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:23.272801 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:23.272801 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:23.272801 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:23.272801 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:23.272801 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:23.272801 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:23.272801 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:23.272801 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:23.272801 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:23:23.272801 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:23:23.272801 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:23:23.272801 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:23:23.273707 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:23.273707 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:23.273707 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:23:23.273707 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:23:23.273707 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:23:23.273707 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:23:23.273707 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:23.273707 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:23.273707 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:23.273707 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:23.273707 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:23.273707 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:23.273707 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:23.273707 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:23.273707 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:23.273707 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:23.273707 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:23.273707 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:23.275114 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:23.275114 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:23.275114 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:23:23.275114 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:23:23.275114 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:23:23.275114 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:23:23.275114 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:23:23.275114 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:23:23.275114 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 15:23:23.275114 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:23.283648 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b118b-2e93-43ea-87f7-9136edf5af44 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:23.283869 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 358/730] 10.222.0.83 () {56 vars in 1117 bytes} [Mon Aug 29 15:23:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:23.283869 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c2bd8-5616-4b34-bc3c-acfe2b544c2f None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:23.283869 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c2bd8-5616-4b34-bc3c-acfe2b544c2f None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:23.283869 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c2bd8-5616-4b34-bc3c-acfe2b544c2f None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:23.283869 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 359/731] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:23:23.283869 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59999538-87e3-4464-bc00-8602c5abe92a None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:23.283869 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59999538-87e3-4464-bc00-8602c5abe92a None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:23.284613 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59999538-87e3-4464-bc00-8602c5abe92a None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:23.284613 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 360/732] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:23:23.284613 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59999538-87e3-4464-bc00-8602c5abe92a None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:23.302193 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-696b118b-2e93-43ea-87f7-9136edf5af44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:23.302193 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:23.302193 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:23.302193 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:23.302193 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:23.302193 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:23.302193 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:23.302193 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:23.302193 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:23.302193 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:23.302193 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:23.302193 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:23.302193 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:23:23.302193 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:23:23.302193 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:23:23.302193 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:23:23.303414 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:23.303414 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:23.303414 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:23.303414 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:23.303414 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:23.303414 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:23.303414 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:23.303414 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:23.303414 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:23.303414 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:23.303414 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:23.303414 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:23.303414 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:23.303414 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:23.303414 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:23.303414 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:23.303414 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:23:23.304446 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:23:23.304446 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:23.304446 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:23.304446 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 373/733] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:23.311594 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da8439-95b6-4177-ac78-5b61bdef3f1c None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:23.311896 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da8439-95b6-4177-ac78-5b61bdef3f1c None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:23.312182 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da8439-95b6-4177-ac78-5b61bdef3f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:23.331141 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-33da8439-95b6-4177-ac78-5b61bdef3f1c None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:23.332349 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-33da8439-95b6-4177-ac78-5b61bdef3f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:23.334366 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:23.407314 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59999538-87e3-4464-bc00-8602c5abe92a None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:23.409071 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 374/734] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:23:23.410670 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b8449-47f0-4682-9163-82d2fd5e6d51 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:23.410956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b8449-47f0-4682-9163-82d2fd5e6d51 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:23.411292 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b8449-47f0-4682-9163-82d2fd5e6d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:23.446941 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-860b8449-47f0-4682-9163-82d2fd5e6d51 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:23.448520 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-860b8449-47f0-4682-9163-82d2fd5e6d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:23.450745 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f04f9f-92f3-4c54-9be3-5033fa730ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:23.451462 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f04f9f-92f3-4c54-9be3-5033fa730ff4 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:23.451738 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f04f9f-92f3-4c54-9be3-5033fa730ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:23.452059 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f04f9f-92f3-4c54-9be3-5033fa730ff4 None admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:23.453383 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f04f9f-92f3-4c54-9be3-5033fa730ff4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:23.453686 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f04f9f-92f3-4c54-9be3-5033fa730ff4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:23.455156 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f04f9f-92f3-4c54-9be3-5033fa730ff4 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:23.480064 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 361/735] 10.222.0.83 () {56 vars in 1149 bytes} [Mon Aug 29 15:23:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:23.480973 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f04f9f-92f3-4c54-9be3-5033fa730ff4 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:23.503723 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:23.549125 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 375/736] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:23:23.549973 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b8449-47f0-4682-9163-82d2fd5e6d51 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:23.608608 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f04f9f-92f3-4c54-9be3-5033fa730ff4 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:23.635100 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:23.648481 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ff818-4459-49c3-964f-acce56de2002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:23.649447 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ff818-4459-49c3-964f-acce56de2002 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:23.649927 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ff818-4459-49c3-964f-acce56de2002 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:23.650432 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ff818-4459-49c3-964f-acce56de2002 None admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:23.651330 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ff818-4459-49c3-964f-acce56de2002 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:23.651859 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ff818-4459-49c3-964f-acce56de2002 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:23.653483 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ff818-4459-49c3-964f-acce56de2002 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:23.666760 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 362/737] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:23:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:23.673307 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ff818-4459-49c3-964f-acce56de2002 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:23.682920 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b8449-47f0-4682-9163-82d2fd5e6d51 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:23.728178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1c2ab-978e-4f4e-aab0-dae314ccba95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:23.728703 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1c2ab-978e-4f4e-aab0-dae314ccba95 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:23.729072 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1c2ab-978e-4f4e-aab0-dae314ccba95 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:23.729438 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1c2ab-978e-4f4e-aab0-dae314ccba95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:23.781382 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:23.816310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ff818-4459-49c3-964f-acce56de2002 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:23.825596 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf1c2ab-978e-4f4e-aab0-dae314ccba95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:23.828365 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf1c2ab-978e-4f4e-aab0-dae314ccba95 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:23.869257 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f2cd0-c023-4f8e-9fa0-a0dc5fa10993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:23.869900 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f2cd0-c023-4f8e-9fa0-a0dc5fa10993 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:23.870183 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f2cd0-c023-4f8e-9fa0-a0dc5fa10993 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:23.871226 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f2cd0-c023-4f8e-9fa0-a0dc5fa10993 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:23.882856 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f2cd0-c023-4f8e-9fa0-a0dc5fa10993 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:23.884376 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f2cd0-c023-4f8e-9fa0-a0dc5fa10993 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:23.897974 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-f55f2cd0-c023-4f8e-9fa0-a0dc5fa10993 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 15:23:23.897974 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:23.897974 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:23.897974 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:23.897974 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:23.897974 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:23.897974 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:23.897974 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:23.897974 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:23.897974 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:23.897974 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:23.897974 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:23.897974 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:23:23.897974 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:23:23.897974 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:23:23.897974 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:23:23.898994 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:23.898994 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:23.898994 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:23:23.898994 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:23:23.898994 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:23:23.898994 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:23:23.898994 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:23.898994 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:23.898994 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:23.898994 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:23.898994 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:23.898994 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:23.898994 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:23.898994 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:23.898994 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:23.898994 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:23.898994 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:23.898994 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:23.899969 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:23.899969 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:23.899969 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:23:23.899969 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:23:23.899969 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:23:23.899969 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:23:23.899969 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:23:23.899969 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:23:23.899969 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 15:23:23.899969 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:23.899969 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 363/738] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 15:23:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:23:23.901230 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38c89d-7737-4f8c-8928-9788d2abb6a8 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:23.901230 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38c89d-7737-4f8c-8928-9788d2abb6a8 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:23.901230 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38c89d-7737-4f8c-8928-9788d2abb6a8 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:23.902804 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 364/739] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:23:23.903474 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38c89d-7737-4f8c-8928-9788d2abb6a8 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:23.927405 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:23.967574 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 376/740] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:23:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:23:23.969532 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1c2ab-978e-4f4e-aab0-dae314ccba95 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:24.023227 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38c89d-7737-4f8c-8928-9788d2abb6a8 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:24.060661 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e315d42-26ea-43fd-9733-59bca8de0808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:24.061338 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e315d42-26ea-43fd-9733-59bca8de0808 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:24.061611 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e315d42-26ea-43fd-9733-59bca8de0808 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:24.061881 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e315d42-26ea-43fd-9733-59bca8de0808 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:24.063984 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:24.074876 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e315d42-26ea-43fd-9733-59bca8de0808 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:23:24.080905 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-6e315d42-26ea-43fd-9733-59bca8de0808 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:23:24.080905 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:24.080905 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:24.080905 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:24.080905 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:24.080905 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:24.080905 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:24.080905 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:24.080905 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:24.080905 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:24.080905 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:24.080905 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:24.080905 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:23:24.080905 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:23:24.080905 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:23:24.080905 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:23:24.081941 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:23:24.081941 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:23:24.081941 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:23:24.081941 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:23:24.081941 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:24.081941 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:24.081941 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:24.081941 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:24.081941 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:24.081941 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:24.081941 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:24.081941 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:24.081941 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:24.081941 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:24.081941 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:24.081941 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:24.082869 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:24.082869 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:24.082869 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:24.082869 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:24.082869 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:23:24.082869 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:23:24.082869 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:23:24.082869 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:23:24.082869 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:23:24.082869 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:23:24.082869 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:23:24.082869 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:24.087186 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 365/741] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 15:23:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:24.087960 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1c2ab-978e-4f4e-aab0-dae314ccba95 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:24.088452 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3d33b-8dfe-4c0a-956a-9e66168a99b3 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:24.088759 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3d33b-8dfe-4c0a-956a-9e66168a99b3 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:24.089056 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3d33b-8dfe-4c0a-956a-9e66168a99b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:24.108523 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-1de3d33b-8dfe-4c0a-956a-9e66168a99b3 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:24.109757 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1de3d33b-8dfe-4c0a-956a-9e66168a99b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:24.126629 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defff7b7-576f-4d73-832f-edf685707093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:24.127611 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defff7b7-576f-4d73-832f-edf685707093 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:24.127892 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defff7b7-576f-4d73-832f-edf685707093 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:24.128177 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defff7b7-576f-4d73-832f-edf685707093 None admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:24.128922 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defff7b7-576f-4d73-832f-edf685707093 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:24.129235 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defff7b7-576f-4d73-832f-edf685707093 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:24.130682 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defff7b7-576f-4d73-832f-edf685707093 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:24.149058 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 377/742] 10.222.0.83 () {56 vars in 1135 bytes} [Mon Aug 29 15:23:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:24.149985 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defff7b7-576f-4d73-832f-edf685707093 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:24.179484 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:24.185931 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 366/743] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:23:24.187112 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3d33b-8dfe-4c0a-956a-9e66168a99b3 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:24.269101 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defff7b7-576f-4d73-832f-edf685707093 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:24.294119 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3d33b-8dfe-4c0a-956a-9e66168a99b3 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:24.314510 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45caa3e-f56a-420e-a7be-9c05095bb531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:24.315184 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45caa3e-f56a-420e-a7be-9c05095bb531 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:24.315485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45caa3e-f56a-420e-a7be-9c05095bb531 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:24.315781 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45caa3e-f56a-420e-a7be-9c05095bb531 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:24.321161 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:24.327079 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45caa3e-f56a-420e-a7be-9c05095bb531 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:24.329866 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45caa3e-f56a-420e-a7be-9c05095bb531 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:24.336038 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6fcf1-a2ac-4cf2-8ae4-8d99c9d1a634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:24.336781 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6fcf1-a2ac-4cf2-8ae4-8d99c9d1a634 None admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:24.337614 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6fcf1-a2ac-4cf2-8ae4-8d99c9d1a634 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:24.338002 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6fcf1-a2ac-4cf2-8ae4-8d99c9d1a634 None admin] PATH_INFO: `/v3/services` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:24.339212 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb6fcf1-a2ac-4cf2-8ae4-8d99c9d1a634 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:24.341045 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb6fcf1-a2ac-4cf2-8ae4-8d99c9d1a634 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:24.345508 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-a45caa3e-f56a-420e-a7be-9c05095bb531 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:24.345508 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:24.345508 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:24.345508 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:24.345508 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:24.345508 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:24.345508 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:24.345508 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:24.345508 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:24.345508 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:24.345508 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:24.345508 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:24.345508 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:23:24.345508 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:23:24.345508 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:23:24.345508 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:23:24.346686 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:24.346686 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:24.346686 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:24.346686 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:24.346686 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:24.346686 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:24.346686 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:24.346686 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:24.346686 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:24.346686 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:24.346686 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:24.346686 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:24.346686 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:24.346686 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:24.346686 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:24.346686 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:24.346686 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:23:24.347874 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:23:24.347874 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:24.347874 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:24.351440 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 378/744] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:24.352481 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45caa3e-f56a-420e-a7be-9c05095bb531 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:24.364446 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 367/745] 10.222.0.83 () {60 vars in 1141 bytes} [Mon Aug 29 15:23:24 2022] POST /identity/v3/services => generated 251 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:23:24.365520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6fcf1-a2ac-4cf2-8ae4-8d99c9d1a634 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:24.483439 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:24.487292 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45caa3e-f56a-420e-a7be-9c05095bb531 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:24.517691 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6fcf1-a2ac-4cf2-8ae4-8d99c9d1a634 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:24.530906 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970421b4-bd39-4a55-8fc9-e964a1dea881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:24.531475 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970421b4-bd39-4a55-8fc9-e964a1dea881 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:24.531750 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970421b4-bd39-4a55-8fc9-e964a1dea881 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:24.532142 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970421b4-bd39-4a55-8fc9-e964a1dea881 None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:24.532816 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970421b4-bd39-4a55-8fc9-e964a1dea881 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:24.533116 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970421b4-bd39-4a55-8fc9-e964a1dea881 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:24.534570 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970421b4-bd39-4a55-8fc9-e964a1dea881 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:24.545763 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 379/746] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:23:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:24.547307 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970421b4-bd39-4a55-8fc9-e964a1dea881 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:24.558739 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a4680-8725-42ed-a9e2-87a7526a7ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:24.559407 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a4680-8725-42ed-a9e2-87a7526a7ad7 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:24.559689 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a4680-8725-42ed-a9e2-87a7526a7ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:24.559963 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a4680-8725-42ed-a9e2-87a7526a7ad7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:24.616315 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:24.638967 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a4680-8725-42ed-a9e2-87a7526a7ad7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:24.641329 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a4680-8725-42ed-a9e2-87a7526a7ad7 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:24.655615 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970421b4-bd39-4a55-8fc9-e964a1dea881 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:24.691217 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8582c3-fe88-4b92-aa71-0164b7e2391c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:24.691835 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8582c3-fe88-4b92-aa71-0164b7e2391c None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:24.692106 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8582c3-fe88-4b92-aa71-0164b7e2391c None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:24.692377 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8582c3-fe88-4b92-aa71-0164b7e2391c None admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:24.693023 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8582c3-fe88-4b92-aa71-0164b7e2391c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:24.693324 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8582c3-fe88-4b92-aa71-0164b7e2391c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:24.694697 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8582c3-fe88-4b92-aa71-0164b7e2391c None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:24.705278 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:24.711191 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 380/747] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:23:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:24.712544 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8582c3-fe88-4b92-aa71-0164b7e2391c None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:24.763465 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 368/748] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:23:24 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:23:24.763465 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a4680-8725-42ed-a9e2-87a7526a7ad7 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:24.827065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8582c3-fe88-4b92-aa71-0164b7e2391c None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:24.852997 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:24.864807 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa699f-5dad-4710-a5dc-bcee4a38dc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:24.865425 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa699f-5dad-4710-a5dc-bcee4a38dc3a None admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:24.865713 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa699f-5dad-4710-a5dc-bcee4a38dc3a None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:24.865964 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa699f-5dad-4710-a5dc-bcee4a38dc3a None admin] PATH_INFO: `/v3/services` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:24.866618 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fa699f-5dad-4710-a5dc-bcee4a38dc3a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:24.868028 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fa699f-5dad-4710-a5dc-bcee4a38dc3a None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:24.874792 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a4680-8725-42ed-a9e2-87a7526a7ad7 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:24.886120 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 381/749] 10.222.0.83 () {60 vars in 1141 bytes} [Mon Aug 29 15:23:24 2022] POST /identity/v3/services => generated 240 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:23:24.886853 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa699f-5dad-4710-a5dc-bcee4a38dc3a None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:24.941166 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b54e6b-3c2f-454a-97b6-264e7350c586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:24.942396 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b54e6b-3c2f-454a-97b6-264e7350c586 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:24.942825 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b54e6b-3c2f-454a-97b6-264e7350c586 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:24.943332 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b54e6b-3c2f-454a-97b6-264e7350c586 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:24.960792 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b54e6b-3c2f-454a-97b6-264e7350c586 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:24.963259 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b54e6b-3c2f-454a-97b6-264e7350c586 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:24.966220 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:24.983322 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-e7b54e6b-3c2f-454a-97b6-264e7350c586 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:24.983322 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:24.983322 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:24.983322 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:24.983322 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:24.983322 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:24.983322 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:24.983322 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:24.983322 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:24.983322 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:24.983322 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:24.983322 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:24.983322 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:23:24.983322 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:23:24.983322 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:23:24.983322 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:23:24.984523 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:24.984523 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:24.984523 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:24.984523 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:24.984523 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:24.984523 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:24.984523 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:24.984523 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:24.984523 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:24.984523 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:24.984523 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:24.984523 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:24.984523 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:24.984523 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:24.984523 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:24.984523 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:24.984523 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:23:24.985641 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:23:24.985641 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:24.985641 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:24.991314 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 369/750] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:24.992483 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b54e6b-3c2f-454a-97b6-264e7350c586 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:25.031577 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa699f-5dad-4710-a5dc-bcee4a38dc3a None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:25.080822 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e6d2ca-4e28-4ab3-8870-2dfbf9415f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:25.081403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6d2ca-4e28-4ab3-8870-2dfbf9415f6a None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:25.081688 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6d2ca-4e28-4ab3-8870-2dfbf9415f6a None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:25.081963 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6d2ca-4e28-4ab3-8870-2dfbf9415f6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:25.089725 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e6d2ca-4e28-4ab3-8870-2dfbf9415f6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:25.091845 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e6d2ca-4e28-4ab3-8870-2dfbf9415f6a None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:25.103220 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-78e6d2ca-4e28-4ab3-8870-2dfbf9415f6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:25.103220 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:25.103220 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:25.103220 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:25.103220 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:25.103220 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:25.103220 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:25.103220 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:25.103220 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:25.103220 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:25.103220 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:25.103220 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:25.103220 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:23:25.103220 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:23:25.103220 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:23:25.104154 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:23:25.104154 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:25.104154 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:25.104154 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:25.104154 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:25.104154 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:25.104154 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:25.104154 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:25.104154 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:25.104154 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:25.104154 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:25.104154 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:25.104154 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:25.104154 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:25.104154 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:25.104154 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:25.104154 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:25.105054 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:23:25.105054 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:23:25.105054 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:23:25.105054 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:23:25.105054 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:23:25.105054 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:23:25.105054 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:25.105054 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:25.109080 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 382/751] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:23:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:25.109931 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e6d2ca-4e28-4ab3-8870-2dfbf9415f6a None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:25.122926 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b54e6b-3c2f-454a-97b6-264e7350c586 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:25.159488 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:25.167714 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941bba7c-4cbb-4c3e-8d11-37e10ecffa06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:25.168348 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941bba7c-4cbb-4c3e-8d11-37e10ecffa06 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:25.168643 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941bba7c-4cbb-4c3e-8d11-37e10ecffa06 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:25.168916 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941bba7c-4cbb-4c3e-8d11-37e10ecffa06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:25.185907 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941bba7c-4cbb-4c3e-8d11-37e10ecffa06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:25.187413 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941bba7c-4cbb-4c3e-8d11-37e10ecffa06 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:25.202943 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-941bba7c-4cbb-4c3e-8d11-37e10ecffa06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:25.202943 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:25.202943 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:25.202943 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:25.202943 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:25.202943 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:25.202943 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:25.202943 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:25.202943 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:25.202943 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:25.202943 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:25.202943 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:25.202943 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:23:25.202943 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:23:25.202943 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:23:25.202943 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:23:25.203953 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:25.203953 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:25.203953 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:25.203953 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:25.203953 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:25.203953 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:25.203953 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:25.203953 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:25.203953 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:25.203953 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:25.203953 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:25.203953 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:25.203953 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:25.203953 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:25.203953 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:25.203953 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:25.203953 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:23:25.204946 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:23:25.204946 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:25.204946 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:25.204946 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 370/752] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:25.205875 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941bba7c-4cbb-4c3e-8d11-37e10ecffa06 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:25.237330 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e6d2ca-4e28-4ab3-8870-2dfbf9415f6a None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:25.261695 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:25.277770 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea2d343-63ea-4ee8-b472-688fef3616d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:25.278691 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2d343-63ea-4ee8-b472-688fef3616d1 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:25.279104 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2d343-63ea-4ee8-b472-688fef3616d1 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:25.279508 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2d343-63ea-4ee8-b472-688fef3616d1 None admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:25.280857 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea2d343-63ea-4ee8-b472-688fef3616d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:25.281267 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea2d343-63ea-4ee8-b472-688fef3616d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:25.282819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea2d343-63ea-4ee8-b472-688fef3616d1 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:25.300463 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 383/753] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:25.301970 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea2d343-63ea-4ee8-b472-688fef3616d1 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:25.335993 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941bba7c-4cbb-4c3e-8d11-37e10ecffa06 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:25.378258 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee19f25a-c018-4a76-b05c-a372346f8921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:25.379109 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19f25a-c018-4a76-b05c-a372346f8921 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:25.379503 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19f25a-c018-4a76-b05c-a372346f8921 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:25.379880 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19f25a-c018-4a76-b05c-a372346f8921 None admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:25.380680 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee19f25a-c018-4a76-b05c-a372346f8921 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:25.381090 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee19f25a-c018-4a76-b05c-a372346f8921 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:25.382633 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee19f25a-c018-4a76-b05c-a372346f8921 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:25.400852 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 371/754] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 15:23:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:25.401922 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee19f25a-c018-4a76-b05c-a372346f8921 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:25.432701 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea2d343-63ea-4ee8-b472-688fef3616d1 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:25.448665 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:25.480266 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf81f8-7160-4c20-aba4-eaf677768439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:25.481298 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf81f8-7160-4c20-aba4-eaf677768439 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:25.482505 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf81f8-7160-4c20-aba4-eaf677768439 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:25.482948 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf81f8-7160-4c20-aba4-eaf677768439 None admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:25.483770 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf81f8-7160-4c20-aba4-eaf677768439 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:25.484669 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf81f8-7160-4c20-aba4-eaf677768439 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:25.486193 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf81f8-7160-4c20-aba4-eaf677768439 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:25.502877 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 384/755] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:25.504009 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf81f8-7160-4c20-aba4-eaf677768439 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:25.524611 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee19f25a-c018-4a76-b05c-a372346f8921 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:25.557081 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:25.574252 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bba055-9832-4b12-bb79-fd9bb3eeb5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:25.575766 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bba055-9832-4b12-bb79-fd9bb3eeb5e4 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:25.576221 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bba055-9832-4b12-bb79-fd9bb3eeb5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:25.576639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bba055-9832-4b12-bb79-fd9bb3eeb5e4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:25.587576 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bba055-9832-4b12-bb79-fd9bb3eeb5e4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:25.589741 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bba055-9832-4b12-bb79-fd9bb3eeb5e4 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:25.606959 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-11bba055-9832-4b12-bb79-fd9bb3eeb5e4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 15:23:25.606959 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:25.606959 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:25.606959 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:25.606959 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:25.606959 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:25.606959 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:25.606959 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:25.606959 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:25.606959 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:25.606959 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:25.606959 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:25.606959 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:23:25.606959 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:23:25.606959 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:23:25.606959 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:23:25.608439 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:25.608439 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:25.608439 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:23:25.608439 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:23:25.608439 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:23:25.608439 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:23:25.608439 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:25.608439 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:25.608439 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:25.608439 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:25.608439 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:25.608439 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:25.608439 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:25.608439 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:25.608439 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:25.608439 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:25.608439 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:25.608439 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:25.609686 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:25.609686 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:25.609686 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:23:25.609686 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:23:25.609686 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:23:25.609686 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:23:25.609686 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:23:25.609686 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:23:25.609686 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 15:23:25.609686 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:25.611959 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 372/756] 10.222.0.83 () {56 vars in 1093 bytes} [Mon Aug 29 15:23:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:25.613479 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bba055-9832-4b12-bb79-fd9bb3eeb5e4 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:25.631748 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf81f8-7160-4c20-aba4-eaf677768439 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:25.676056 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8860f9ab-1d57-4096-8761-40b90083a311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:25.677090 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860f9ab-1d57-4096-8761-40b90083a311 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:25.677850 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860f9ab-1d57-4096-8761-40b90083a311 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:25.678269 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860f9ab-1d57-4096-8761-40b90083a311 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:25.679454 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8860f9ab-1d57-4096-8761-40b90083a311 None admin] RBAC: Adding query filter params (role.id=19a8fa4068774a289594739614bb8ad4, scope.project.id=44655977b0814a728f0fa73d442a7ee9, user.id=712a09e9d2a248309b91424dd05d2b44) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:25.679909 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8860f9ab-1d57-4096-8761-40b90083a311 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:25.682475 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8860f9ab-1d57-4096-8761-40b90083a311 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:25.690091 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 385/757] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 15:23:25 2022] GET /identity/v3/role_assignments?user.id=712a09e9d2a248309b91424dd05d2b44&scope.project.id=44655977b0814a728f0fa73d442a7ee9&role.id=19a8fa4068774a289594739614bb8ad4 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:25.691528 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8860f9ab-1d57-4096-8761-40b90083a311 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:25.731166 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:25.736623 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bba055-9832-4b12-bb79-fd9bb3eeb5e4 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:25.802795 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc53647-f885-4381-98bd-60b9d70f923d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:25.803485 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc53647-f885-4381-98bd-60b9d70f923d None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:25.803764 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc53647-f885-4381-98bd-60b9d70f923d None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:25.804039 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc53647-f885-4381-98bd-60b9d70f923d None admin] PATH_INFO: `/v3/projects/service` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:25.825126 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc53647-f885-4381-98bd-60b9d70f923d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:25.826624 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc53647-f885-4381-98bd-60b9d70f923d None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:25.853533 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-cdc53647-f885-4381-98bd-60b9d70f923d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:25.853533 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:25.853533 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:25.853533 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:25.853533 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:25.853533 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:25.853533 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:25.853533 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:25.853533 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:25.853533 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:25.853533 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:25.853533 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:25.853533 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:23:25.853533 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:23:25.853533 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:23:25.854874 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:23:25.854874 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:25.854874 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:25.854874 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:25.854874 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:25.854874 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:25.854874 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:25.854874 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:25.854874 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:25.854874 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:25.854874 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:25.854874 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:25.854874 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:25.854874 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:25.854874 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:25.854874 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:25.854874 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:25.855778 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:23:25.855778 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:23:25.855778 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:23:25.855778 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:23:25.855778 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:23:25.855778 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:23:25.855778 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:25.855778 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:25.859261 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 373/758] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:23:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:25.874479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8860f9ab-1d57-4096-8761-40b90083a311 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:25.876096 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc53647-f885-4381-98bd-60b9d70f923d None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:25.888205 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:25.929979 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76913ee9-af70-4bf7-9dde-88726cf661a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:25.930631 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76913ee9-af70-4bf7-9dde-88726cf661a0 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:25.930912 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76913ee9-af70-4bf7-9dde-88726cf661a0 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:25.931239 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76913ee9-af70-4bf7-9dde-88726cf661a0 None admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:25.932251 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76913ee9-af70-4bf7-9dde-88726cf661a0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:25.932733 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76913ee9-af70-4bf7-9dde-88726cf661a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:25.934008 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76913ee9-af70-4bf7-9dde-88726cf661a0 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:25.978931 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 386/759] 10.222.0.83 () {56 vars in 1133 bytes} [Mon Aug 29 15:23:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:25.984118 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76913ee9-af70-4bf7-9dde-88726cf661a0 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:25.998693 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc53647-f885-4381-98bd-60b9d70f923d None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:26.038232 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc7870-f537-435b-9ea2-8013f2b38984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:26.039355 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc7870-f537-435b-9ea2-8013f2b38984 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:26.039840 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc7870-f537-435b-9ea2-8013f2b38984 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:26.040383 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc7870-f537-435b-9ea2-8013f2b38984 None admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:26.041285 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc7870-f537-435b-9ea2-8013f2b38984 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:26.041808 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc7870-f537-435b-9ea2-8013f2b38984 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:26.043493 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc7870-f537-435b-9ea2-8013f2b38984 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:26.059089 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 374/760] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 15:23:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:23:26.065537 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc7870-f537-435b-9ea2-8013f2b38984 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:26.110070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:26.227374 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76913ee9-af70-4bf7-9dde-88726cf661a0 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:26.275121 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc7870-f537-435b-9ea2-8013f2b38984 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:26.299761 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94929aee-f3b1-4c46-94fa-c5e1a3aab3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:26.300411 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94929aee-f3b1-4c46-94fa-c5e1a3aab3c5 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:26.300695 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94929aee-f3b1-4c46-94fa-c5e1a3aab3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:26.300975 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94929aee-f3b1-4c46-94fa-c5e1a3aab3c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:26.316057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f52bcb-7f03-48bd-a67d-b4e5495cd67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:26.317578 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f52bcb-7f03-48bd-a67d-b4e5495cd67e None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:26.318063 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f52bcb-7f03-48bd-a67d-b4e5495cd67e None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:26.318534 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f52bcb-7f03-48bd-a67d-b4e5495cd67e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:26.320230 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94929aee-f3b1-4c46-94fa-c5e1a3aab3c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:26.321951 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94929aee-f3b1-4c46-94fa-c5e1a3aab3c5 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:26.322939 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f52bcb-7f03-48bd-a67d-b4e5495cd67e None admin] RBAC: Adding query filter params (role.id=4bb2bbb7bb544610877949fc933504d2, scope.project.id=44655977b0814a728f0fa73d442a7ee9, user.id=b0f8e95d393f499baf44830f9fb7e583) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:26.323662 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f52bcb-7f03-48bd-a67d-b4e5495cd67e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:26.327472 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f52bcb-7f03-48bd-a67d-b4e5495cd67e None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:26.339118 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 375/761] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 15:23:26 2022] GET /identity/v3/role_assignments?user.id=b0f8e95d393f499baf44830f9fb7e583&scope.project.id=44655977b0814a728f0fa73d442a7ee9&role.id=4bb2bbb7bb544610877949fc933504d2 => generated 259 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:26.347746 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-94929aee-f3b1-4c46-94fa-c5e1a3aab3c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:26.347746 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:26.347746 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:26.347746 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:26.347746 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:26.347746 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:26.347746 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:26.347746 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:26.347746 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:26.347746 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:26.347746 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:26.347746 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:26.347746 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:23:26.347746 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:23:26.347746 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:23:26.347746 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:23:26.348816 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:26.348816 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:26.348816 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:26.348816 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:26.348816 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:26.348816 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:26.348816 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:26.348816 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:26.348816 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:26.348816 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:26.348816 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:26.348816 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:26.348816 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:26.348816 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:26.348816 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:26.348816 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:26.348816 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:23:26.349733 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:23:26.349733 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:26.349733 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:26.352225 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 387/762] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:26.362591 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f52bcb-7f03-48bd-a67d-b4e5495cd67e None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:26.472358 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:26.490750 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f52bcb-7f03-48bd-a67d-b4e5495cd67e None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:26.529869 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96266573-abf8-4bb5-a8fe-1cadf928b158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:26.530898 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96266573-abf8-4bb5-a8fe-1cadf928b158 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:26.531454 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96266573-abf8-4bb5-a8fe-1cadf928b158 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:26.531947 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96266573-abf8-4bb5-a8fe-1cadf928b158 None admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:26.532813 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96266573-abf8-4bb5-a8fe-1cadf928b158 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:26.533317 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96266573-abf8-4bb5-a8fe-1cadf928b158 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:26.534921 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96266573-abf8-4bb5-a8fe-1cadf928b158 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:26.549256 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 376/763] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:26.560145 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94929aee-f3b1-4c46-94fa-c5e1a3aab3c5 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:26.579820 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:26.611107 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0b0bb-74a7-4806-a330-14a4b4769749 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:26.611682 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0b0bb-74a7-4806-a330-14a4b4769749 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:26.612210 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0b0bb-74a7-4806-a330-14a4b4769749 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:26.614113 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 377/764] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:23:26.620048 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0add06-160c-476a-a8a8-2a0e85f8b5d3 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:26.620335 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0add06-160c-476a-a8a8-2a0e85f8b5d3 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:26.620612 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0add06-160c-476a-a8a8-2a0e85f8b5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:26.652083 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-dd0add06-160c-476a-a8a8-2a0e85f8b5d3 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:26.653302 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-dd0add06-160c-476a-a8a8-2a0e85f8b5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:26.698076 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94929aee-f3b1-4c46-94fa-c5e1a3aab3c5 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:26.757249 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a4049-27ed-46f5-a5b9-a06dd0d85865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:26.757902 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a4049-27ed-46f5-a5b9-a06dd0d85865 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:26.758202 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a4049-27ed-46f5-a5b9-a06dd0d85865 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:26.758476 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a4049-27ed-46f5-a5b9-a06dd0d85865 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:26.769132 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a4049-27ed-46f5-a5b9-a06dd0d85865 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:26.770608 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a4049-27ed-46f5-a5b9-a06dd0d85865 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:26.787307 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-238a4049-27ed-46f5-a5b9-a06dd0d85865 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:26.787307 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:26.787307 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:26.787307 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:26.787307 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:26.787307 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:26.787307 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:26.787307 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:26.787307 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:26.787307 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:26.787307 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:26.787307 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:26.787307 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:23:26.787307 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:23:26.787307 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:23:26.789202 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:23:26.789202 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:26.789202 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:26.789202 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:26.789202 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:26.789202 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:26.789202 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:26.789202 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:26.789202 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:26.789202 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:26.789202 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:26.789202 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:26.789202 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:26.789202 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:26.789202 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:26.789202 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:26.789202 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:26.790342 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:23:26.790342 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:23:26.790342 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:23:26.790342 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:23:26.790342 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:23:26.790342 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:23:26.790342 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:26.790342 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:26.790342 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 388/765] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:23:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:26.794106 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a4049-27ed-46f5-a5b9-a06dd0d85865 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:26.828682 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 378/766] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 15:23:26.891563 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:26.907978 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a4049-27ed-46f5-a5b9-a06dd0d85865 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:26.949224 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e4dac-8637-4d21-b7ca-5e7a13537dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:26.949844 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e4dac-8637-4d21-b7ca-5e7a13537dc5 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:26.950122 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e4dac-8637-4d21-b7ca-5e7a13537dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:26.950391 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e4dac-8637-4d21-b7ca-5e7a13537dc5 None admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:26.951115 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1e4dac-8637-4d21-b7ca-5e7a13537dc5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:26.951423 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1e4dac-8637-4d21-b7ca-5e7a13537dc5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:26.952867 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1e4dac-8637-4d21-b7ca-5e7a13537dc5 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:26.970649 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 389/767] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 15:23:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:26.980123 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0add06-160c-476a-a8a8-2a0e85f8b5d3 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:27.108448 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:27.137773 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13ed29-dfc3-4709-86e4-1e32a436b19d None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:27.138585 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13ed29-dfc3-4709-86e4-1e32a436b19d None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:27.139514 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13ed29-dfc3-4709-86e4-1e32a436b19d None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:27.141670 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 390/768] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:23:27.148214 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5656e-9514-475f-a42c-f8e1006818e7 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:27.148755 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5656e-9514-475f-a42c-f8e1006818e7 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:27.149232 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5656e-9514-475f-a42c-f8e1006818e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:27.152465 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0add06-160c-476a-a8a8-2a0e85f8b5d3 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:27.170867 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-77b5656e-9514-475f-a42c-f8e1006818e7 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:27.173108 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-77b5656e-9514-475f-a42c-f8e1006818e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:27.203984 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121792a4-07fa-4ceb-ba72-81709e8f0a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:27.205049 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121792a4-07fa-4ceb-ba72-81709e8f0a2b None admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:27.205560 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121792a4-07fa-4ceb-ba72-81709e8f0a2b None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:27.206034 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121792a4-07fa-4ceb-ba72-81709e8f0a2b None admin] PATH_INFO: `/v3/projects/44655977b0814a728f0fa73d442a7ee9/users/253947a5ef294d2bb828761873251bd1/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:27.208359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121792a4-07fa-4ceb-ba72-81709e8f0a2b None admin] RBAC: Authorizing `identity:create_grant(project_id=44655977b0814a728f0fa73d442a7ee9, user_id=253947a5ef294d2bb828761873251bd1, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:27.210681 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121792a4-07fa-4ceb-ba72-81709e8f0a2b None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:27.226091 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 379/769] 10.222.0.83 () {58 vars in 1439 bytes} [Mon Aug 29 15:23:26 2022] PUT /identity/v3/projects/44655977b0814a728f0fa73d442a7ee9/users/253947a5ef294d2bb828761873251bd1/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:23:27.227533 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121792a4-07fa-4ceb-ba72-81709e8f0a2b None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:27.259062 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 391/770] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 15:23:27.396221 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121792a4-07fa-4ceb-ba72-81709e8f0a2b None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:27.437952 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a306f-15d2-47e5-836f-39ceb52d20e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:27.438600 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a306f-15d2-47e5-836f-39ceb52d20e1 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:27.438993 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a306f-15d2-47e5-836f-39ceb52d20e1 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:27.439292 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a306f-15d2-47e5-836f-39ceb52d20e1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:27.439884 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04a306f-15d2-47e5-836f-39ceb52d20e1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:27.441421 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04a306f-15d2-47e5-836f-39ceb52d20e1 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:27.444349 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:27.456111 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-a04a306f-15d2-47e5-836f-39ceb52d20e1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 15:23:27.456111 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:27.456111 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:23:27.456111 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:23:27.456111 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:23:27.456111 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:23:27.456111 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:23:27.456111 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:23:27.456111 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 15:23:27.456111 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:27.456111 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:23:27.456111 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:27.456111 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:27.456111 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:27.456111 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:27.456111 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:27.456111 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:27.457140 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:27.457140 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:27.457140 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:27.457140 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:27.457140 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:27.457140 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:27.457140 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:23:27.457140 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:23:27.457140 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:23:27.457140 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:23:27.457140 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:27.457140 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:27.457140 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:27.457140 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:27.457140 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:27.457140 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:27.458579 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:27.458579 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:27.458579 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:27.458579 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:27.458579 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:27.458579 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:27.458579 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:27.458579 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:27.458579 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:27.458579 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:27.458579 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:23:27.458579 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:23:27.458579 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 15:23:27.458579 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:27.458579 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 380/771] 10.222.0.83 () {56 vars in 1129 bytes} [Mon Aug 29 15:23:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:27.463394 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5656e-9514-475f-a42c-f8e1006818e7 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:27.541370 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:27.595733 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5656e-9514-475f-a42c-f8e1006818e7 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:27.635394 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a306f-15d2-47e5-836f-39ceb52d20e1 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:27.649080 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32418e5-1ad3-464a-9e40-10374b6d4528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:27.649670 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32418e5-1ad3-464a-9e40-10374b6d4528 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:27.650162 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32418e5-1ad3-464a-9e40-10374b6d4528 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:27.650758 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32418e5-1ad3-464a-9e40-10374b6d4528 None admin] PATH_INFO: `/v3/services` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:27.651538 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32418e5-1ad3-464a-9e40-10374b6d4528 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:27.651912 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32418e5-1ad3-464a-9e40-10374b6d4528 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:27.653477 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32418e5-1ad3-464a-9e40-10374b6d4528 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:27.658870 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 392/772] 10.222.0.83 () {56 vars in 1124 bytes} [Mon Aug 29 15:23:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:27.664022 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32418e5-1ad3-464a-9e40-10374b6d4528 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:27.812029 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32418e5-1ad3-464a-9e40-10374b6d4528 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:27.854227 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9094b-d625-4ef5-8119-c1fcbc70d9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:27.854854 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9094b-d625-4ef5-8119-c1fcbc70d9f6 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:27.855192 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9094b-d625-4ef5-8119-c1fcbc70d9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:27.859058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9094b-d625-4ef5-8119-c1fcbc70d9f6 None admin] PATH_INFO: `/v3/services` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:27.859058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff9094b-d625-4ef5-8119-c1fcbc70d9f6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:27.859058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff9094b-d625-4ef5-8119-c1fcbc70d9f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:27.859058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff9094b-d625-4ef5-8119-c1fcbc70d9f6 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:27.864845 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 393/773] 10.222.0.83 () {56 vars in 1124 bytes} [Mon Aug 29 15:23:27 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:27.865323 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:27.872321 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9094b-d625-4ef5-8119-c1fcbc70d9f6 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:27.874889 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a306f-15d2-47e5-836f-39ceb52d20e1 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:27.969601 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e4231-f09b-47a2-89c8-ce7be5e3f5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:27.970242 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e4231-f09b-47a2-89c8-ce7be5e3f5d5 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:27.970518 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e4231-f09b-47a2-89c8-ce7be5e3f5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:27.970791 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e4231-f09b-47a2-89c8-ce7be5e3f5d5 None admin] PATH_INFO: `/v3/services/network` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:27.971400 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e4231-f09b-47a2-89c8-ce7be5e3f5d5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:27.972783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e4231-f09b-47a2-89c8-ce7be5e3f5d5 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:27.993187 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-776e4231-f09b-47a2-89c8-ce7be5e3f5d5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 15:23:27.993187 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:27.993187 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:23:27.993187 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:23:27.993187 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:23:27.993187 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:23:27.993187 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:23:27.993187 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:23:27.993187 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 15:23:27.993187 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:27.993187 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:23:27.993187 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:27.993187 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:27.993187 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:27.993187 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:27.993187 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:27.993187 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:27.995126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:27.995126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:27.995126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:27.995126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:27.995126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:27.995126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:27.995126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:23:27.995126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:23:27.995126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:23:27.995126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:23:27.995126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:27.995126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:27.995126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:27.995126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:27.995126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:27.995126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:27.996278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:27.996278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:27.996278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:27.996278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:27.996278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:27.996278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:27.996278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:27.996278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:27.996278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:27.996278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:27.996278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:23:27.996278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:23:27.996278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 15:23:27.996278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:27.996278 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 381/774] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:23:27 2022] GET /identity/v3/services/network => generated 88 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:28.001982 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e4231-f09b-47a2-89c8-ce7be5e3f5d5 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:28.030743 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9094b-d625-4ef5-8119-c1fcbc70d9f6 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:28.068309 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c545a-0eae-4c26-8f2e-1eec8b9383a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:28.068932 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c545a-0eae-4c26-8f2e-1eec8b9383a9 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:28.069215 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c545a-0eae-4c26-8f2e-1eec8b9383a9 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:28.069484 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c545a-0eae-4c26-8f2e-1eec8b9383a9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:28.070192 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c545a-0eae-4c26-8f2e-1eec8b9383a9 None admin] RBAC: Adding query filter params (interface=public, service_id=3ebb5b269f974860987688659a7c51ad, region_id=RegionOne) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:28.070500 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c545a-0eae-4c26-8f2e-1eec8b9383a9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:28.072886 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c545a-0eae-4c26-8f2e-1eec8b9383a9 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:28.078632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:28.082637 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 394/775] 10.222.0.83 () {56 vars in 1251 bytes} [Mon Aug 29 15:23:27 2022] GET /identity/v3/endpoints?service_id=3ebb5b269f974860987688659a7c51ad&interface=public®ion_id=RegionOne => generated 194 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:28.084339 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8566422-ee6e-4dd7-9ff8-4d1e5ac813b6 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:28.084623 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8566422-ee6e-4dd7-9ff8-4d1e5ac813b6 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:28.084896 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8566422-ee6e-4dd7-9ff8-4d1e5ac813b6 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:28.086354 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 395/776] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:23:28.091887 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8566422-ee6e-4dd7-9ff8-4d1e5ac813b6 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:28.127061 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e4231-f09b-47a2-89c8-ce7be5e3f5d5 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:28.162249 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6271ef-4de0-4f73-b50e-5b56c6460868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:28.162865 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6271ef-4de0-4f73-b50e-5b56c6460868 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:28.163236 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6271ef-4de0-4f73-b50e-5b56c6460868 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:28.163511 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6271ef-4de0-4f73-b50e-5b56c6460868 None admin] PATH_INFO: `/v3/services` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:28.164190 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6271ef-4de0-4f73-b50e-5b56c6460868 None admin] RBAC: Adding query filter params (name=network) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:28.164493 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6271ef-4de0-4f73-b50e-5b56c6460868 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:28.164952 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:28.165907 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6271ef-4de0-4f73-b50e-5b56c6460868 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:28.170917 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 382/777] 10.222.0.83 () {56 vars in 1112 bytes} [Mon Aug 29 15:23:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:28.172153 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd43276-c2e4-4e47-8f8a-95b940708ae7 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:28.172442 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd43276-c2e4-4e47-8f8a-95b940708ae7 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:28.172717 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd43276-c2e4-4e47-8f8a-95b940708ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:28.192886 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-dfd43276-c2e4-4e47-8f8a-95b940708ae7 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:28.194069 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-dfd43276-c2e4-4e47-8f8a-95b940708ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:28.214569 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8566422-ee6e-4dd7-9ff8-4d1e5ac813b6 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:28.254677 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4fe50-2c16-492c-9fa8-dfad6261ee21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:28.255311 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4fe50-2c16-492c-9fa8-dfad6261ee21 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:28.255600 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4fe50-2c16-492c-9fa8-dfad6261ee21 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:28.255871 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4fe50-2c16-492c-9fa8-dfad6261ee21 None admin] PATH_INFO: `/v3/services` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:28.256631 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4fe50-2c16-492c-9fa8-dfad6261ee21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:28.258264 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4fe50-2c16-492c-9fa8-dfad6261ee21 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:28.267130 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 396/778] 10.222.0.83 () {56 vars in 1087 bytes} [Mon Aug 29 15:23:28 2022] GET /identity/v3/services => generated 772 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:28.268006 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4fe50-2c16-492c-9fa8-dfad6261ee21 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:28.272805 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 383/779] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:23:28.415313 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4fe50-2c16-492c-9fa8-dfad6261ee21 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:28.448384 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:28.474767 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24092e5-3299-4719-981c-bf53a33bce41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:28.475496 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24092e5-3299-4719-981c-bf53a33bce41 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:28.475777 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24092e5-3299-4719-981c-bf53a33bce41 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:28.476044 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24092e5-3299-4719-981c-bf53a33bce41 None admin] PATH_INFO: `/v3/services` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:28.476697 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24092e5-3299-4719-981c-bf53a33bce41 None admin] RBAC: Adding query filter params (type=network) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:28.476998 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24092e5-3299-4719-981c-bf53a33bce41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:28.478938 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24092e5-3299-4719-981c-bf53a33bce41 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:28.487698 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 397/780] 10.222.0.83 () {56 vars in 1112 bytes} [Mon Aug 29 15:23:28 2022] GET /identity/v3/services?type=network => generated 350 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:28.493821 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd43276-c2e4-4e47-8f8a-95b940708ae7 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:28.559707 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:28.601919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd43276-c2e4-4e47-8f8a-95b940708ae7 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:28.637796 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4808aea-771e-49d4-a0d7-89c1822e2f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:28.638409 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4808aea-771e-49d4-a0d7-89c1822e2f37 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:28.638687 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4808aea-771e-49d4-a0d7-89c1822e2f37 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:28.638955 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4808aea-771e-49d4-a0d7-89c1822e2f37 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:28.639687 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4808aea-771e-49d4-a0d7-89c1822e2f37 None admin] RBAC: Adding query filter params (interface=public, service_id=bca19eec513849f393c6c8781c726673, region_id=RegionOne) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:28.639992 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4808aea-771e-49d4-a0d7-89c1822e2f37 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:28.641416 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4808aea-771e-49d4-a0d7-89c1822e2f37 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:28.649399 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 384/781] 10.222.0.83 () {56 vars in 1251 bytes} [Mon Aug 29 15:23:28 2022] GET /identity/v3/endpoints?service_id=bca19eec513849f393c6c8781c726673&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:28.654934 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24092e5-3299-4719-981c-bf53a33bce41 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:28.697276 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4808aea-771e-49d4-a0d7-89c1822e2f37 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:28.837617 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4808aea-771e-49d4-a0d7-89c1822e2f37 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:28.864891 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24092e5-3299-4719-981c-bf53a33bce41 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:28.865326 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:28.887491 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c15e32-b572-4e13-9a63-cffc822f4260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:28.888382 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c15e32-b572-4e13-9a63-cffc822f4260 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:28.888685 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c15e32-b572-4e13-9a63-cffc822f4260 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:28.889174 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c15e32-b572-4e13-9a63-cffc822f4260 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:28.908405 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c15e32-b572-4e13-9a63-cffc822f4260 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:23:28.911206 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978740a-5848-49d7-a780-7bfe54c15fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:28.912049 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978740a-5848-49d7-a780-7bfe54c15fb3 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:28.912526 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978740a-5848-49d7-a780-7bfe54c15fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:28.913018 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978740a-5848-49d7-a780-7bfe54c15fb3 None admin] PATH_INFO: `/v3/services` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:28.913835 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978740a-5848-49d7-a780-7bfe54c15fb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:28.914124 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-49c15e32-b572-4e13-9a63-cffc822f4260 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:23:28.914124 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:28.914124 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:28.914124 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:28.914124 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:28.914124 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:28.914124 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:28.914124 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:28.914124 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:28.914124 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:28.914124 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:28.914124 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:28.914124 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:23:28.914124 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:23:28.914124 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:23:28.914124 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:23:28.915005 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:23:28.915005 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:23:28.915005 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:23:28.915005 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:23:28.915005 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:28.915005 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:28.915005 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:28.915005 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:28.915005 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:28.915005 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:28.915005 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:28.915005 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:28.915005 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:28.915005 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:28.915005 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:28.915005 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:28.915882 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:28.915882 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:28.915882 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:28.915882 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:28.915882 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:23:28.915882 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:23:28.915882 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:23:28.915882 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:23:28.915882 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:23:28.915882 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:23:28.915882 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:23:28.915882 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:28.915882 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 385/782] 10.222.0.83 () {56 vars in 1102 bytes} [Mon Aug 29 15:23:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:23:28.918717 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1b885-b407-4d2c-9ee8-f25e01ac03bf None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:28.918717 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1b885-b407-4d2c-9ee8-f25e01ac03bf None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:28.918717 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1b885-b407-4d2c-9ee8-f25e01ac03bf None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:28.920498 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978740a-5848-49d7-a780-7bfe54c15fb3 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:28.924671 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 386/783] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:23:28.925332 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec1b885-b407-4d2c-9ee8-f25e01ac03bf None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:28.929156 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 398/784] 10.222.0.83 () {56 vars in 1087 bytes} [Mon Aug 29 15:23:28 2022] GET /identity/v3/services => generated 772 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:28.930790 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa789a6-b8e6-4943-b5ac-d29fa09bafeb None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:28.935699 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa789a6-b8e6-4943-b5ac-d29fa09bafeb None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:28.935974 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa789a6-b8e6-4943-b5ac-d29fa09bafeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:28.976303 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-0fa789a6-b8e6-4943-b5ac-d29fa09bafeb None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:28.977733 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0fa789a6-b8e6-4943-b5ac-d29fa09bafeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:29.071495 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:29.074593 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 399/785] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:23:29.127738 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec1b885-b407-4d2c-9ee8-f25e01ac03bf None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:29.165105 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6bf72-7256-4687-978b-a9dd387c31e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:29.165707 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6bf72-7256-4687-978b-a9dd387c31e3 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:29.165988 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6bf72-7256-4687-978b-a9dd387c31e3 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:29.166258 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6bf72-7256-4687-978b-a9dd387c31e3 None admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:29.166927 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad6bf72-7256-4687-978b-a9dd387c31e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:29.167261 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad6bf72-7256-4687-978b-a9dd387c31e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:29.169231 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad6bf72-7256-4687-978b-a9dd387c31e3 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:29.178875 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 387/786] 10.222.0.83 () {56 vars in 1103 bytes} [Mon Aug 29 15:23:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:29.184867 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa789a6-b8e6-4943-b5ac-d29fa09bafeb None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:29.294408 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa789a6-b8e6-4943-b5ac-d29fa09bafeb None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:29.331783 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7b19d-f740-4c16-a8c9-7bcc1b33ed8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:29.332721 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7b19d-f740-4c16-a8c9-7bcc1b33ed8c None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:29.333208 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7b19d-f740-4c16-a8c9-7bcc1b33ed8c None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:29.333656 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7b19d-f740-4c16-a8c9-7bcc1b33ed8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:29.346092 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c7b19d-f740-4c16-a8c9-7bcc1b33ed8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:29.347588 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c7b19d-f740-4c16-a8c9-7bcc1b33ed8c None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:29.362916 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-80c7b19d-f740-4c16-a8c9-7bcc1b33ed8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:29.362916 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:29.362916 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:29.362916 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:29.362916 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:29.362916 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:29.362916 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:29.362916 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:29.362916 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:29.362916 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:29.362916 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:29.362916 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:29.362916 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:23:29.362916 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:23:29.362916 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:23:29.362916 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:23:29.363933 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:29.363933 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:29.363933 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:29.363933 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:29.363933 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:29.363933 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:29.363933 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:29.363933 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:29.363933 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:29.363933 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:29.363933 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:29.363933 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:29.363933 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:29.363933 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:29.363933 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:29.363933 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:29.363933 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:23:29.364820 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:23:29.364820 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:29.364820 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:29.364820 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 400/787] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:29.369953 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6bf72-7256-4687-978b-a9dd387c31e3 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:29.418302 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c0685-2aed-4929-9b12-f771af923370 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:29.418548 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c0685-2aed-4929-9b12-f771af923370 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:29.418768 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c0685-2aed-4929-9b12-f771af923370 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:29.420381 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 401/788] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:23:29.428036 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71c759-9083-4edf-90d8-ff1c3a82145b None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:29.428310 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71c759-9083-4edf-90d8-ff1c3a82145b None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:29.428581 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71c759-9083-4edf-90d8-ff1c3a82145b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:29.451239 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:29.451622 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-ef71c759-9083-4edf-90d8-ff1c3a82145b None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:29.453979 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ef71c759-9083-4edf-90d8-ff1c3a82145b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:29.484325 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:29.526020 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6bf72-7256-4687-978b-a9dd387c31e3 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:29.543171 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 402/789] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 15:23:29.544888 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71c759-9083-4edf-90d8-ff1c3a82145b None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:29.567004 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9dcce9-e848-42a7-96a0-5122323c3f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:29.567647 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9dcce9-e848-42a7-96a0-5122323c3f07 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:29.567924 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9dcce9-e848-42a7-96a0-5122323c3f07 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:29.568196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9dcce9-e848-42a7-96a0-5122323c3f07 None admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:29.568995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9dcce9-e848-42a7-96a0-5122323c3f07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:29.569311 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9dcce9-e848-42a7-96a0-5122323c3f07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:29.570805 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9dcce9-e848-42a7-96a0-5122323c3f07 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:29.585917 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 388/790] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:23:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:29.590772 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9dcce9-e848-42a7-96a0-5122323c3f07 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:29.709283 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71c759-9083-4edf-90d8-ff1c3a82145b None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:29.750946 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9dcce9-e848-42a7-96a0-5122323c3f07 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:29.752548 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:29.791825 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417a3ae-3201-4ff0-93c0-8d7a82406cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:29.792459 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417a3ae-3201-4ff0-93c0-8d7a82406cad None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:29.792734 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417a3ae-3201-4ff0-93c0-8d7a82406cad None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:29.793004 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417a3ae-3201-4ff0-93c0-8d7a82406cad None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:29.806795 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45070d7-9016-4e1a-a1ef-ead2ea23d147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:29.807469 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45070d7-9016-4e1a-a1ef-ead2ea23d147 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:29.807744 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45070d7-9016-4e1a-a1ef-ead2ea23d147 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:29.808012 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45070d7-9016-4e1a-a1ef-ead2ea23d147 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:29.809643 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0417a3ae-3201-4ff0-93c0-8d7a82406cad None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:29.811757 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0417a3ae-3201-4ff0-93c0-8d7a82406cad None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:29.824899 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45070d7-9016-4e1a-a1ef-ead2ea23d147 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:23:29.836489 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-b45070d7-9016-4e1a-a1ef-ead2ea23d147 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:23:29.836489 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:29.836489 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:29.836489 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:29.836489 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:29.836489 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:29.836489 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:29.836489 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:29.836489 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:29.836489 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:29.836489 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:29.836489 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:29.836489 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:23:29.836489 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:23:29.836489 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:23:29.836489 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:23:29.837465 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:23:29.837465 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:23:29.837465 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:23:29.837465 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:23:29.837465 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:29.837465 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:29.837465 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:29.837465 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:29.837465 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:29.837465 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:29.837465 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:29.837465 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:29.837465 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:29.837465 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:29.837465 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:29.837465 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:29.838388 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:29.838388 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:29.838388 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:29.838388 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:29.838388 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:23:29.838388 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:23:29.838388 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:23:29.838388 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:23:29.838388 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:23:29.838388 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:23:29.838388 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:23:29.838388 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:29.838388 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 403/791] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 15:23:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:29.838388 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45070d7-9016-4e1a-a1ef-ead2ea23d147 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:29.842021 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-0417a3ae-3201-4ff0-93c0-8d7a82406cad None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 15:23:29.842021 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:29.842021 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:29.842021 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:29.842021 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:29.842021 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:29.842021 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:29.842021 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:29.842021 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:29.842021 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:29.842021 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:29.842021 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:29.842021 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:23:29.842021 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:23:29.842021 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:23:29.842021 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:23:29.843207 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:29.843207 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:29.843207 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:23:29.843207 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:23:29.843207 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:23:29.843207 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:23:29.843207 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:29.843207 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:29.843207 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:29.843207 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:29.843207 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:29.843207 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:29.843207 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:29.843207 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:29.843207 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:29.843207 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:29.843207 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:29.843207 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:29.844377 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:29.844377 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:29.844377 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:23:29.844377 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:23:29.844377 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:23:29.844377 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:23:29.844377 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:23:29.844377 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:23:29.844377 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 15:23:29.844377 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:29.851346 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 389/792] 10.222.0.83 () {56 vars in 1117 bytes} [Mon Aug 29 15:23:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:29.859484 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417a3ae-3201-4ff0-93c0-8d7a82406cad None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:29.883408 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:29.985396 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417a3ae-3201-4ff0-93c0-8d7a82406cad None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:30.019163 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45070d7-9016-4e1a-a1ef-ead2ea23d147 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:30.021333 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b7213-0757-4feb-9dd4-0da78a1517ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:30.022213 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b7213-0757-4feb-9dd4-0da78a1517ad None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:30.022674 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b7213-0757-4feb-9dd4-0da78a1517ad None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:30.023146 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b7213-0757-4feb-9dd4-0da78a1517ad None admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:30.024068 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b7213-0757-4feb-9dd4-0da78a1517ad None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:30.024549 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b7213-0757-4feb-9dd4-0da78a1517ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:30.026161 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b7213-0757-4feb-9dd4-0da78a1517ad None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:30.046701 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 390/793] 10.222.0.83 () {56 vars in 1149 bytes} [Mon Aug 29 15:23:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:30.052347 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b7213-0757-4feb-9dd4-0da78a1517ad None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:30.059674 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cfbcc2-f736-46ea-adc6-ee40c566eb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:30.060411 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfbcc2-f736-46ea-adc6-ee40c566eb8c None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:30.061352 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfbcc2-f736-46ea-adc6-ee40c566eb8c None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:30.061699 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfbcc2-f736-46ea-adc6-ee40c566eb8c None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:30.062445 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cfbcc2-f736-46ea-adc6-ee40c566eb8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:30.062820 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cfbcc2-f736-46ea-adc6-ee40c566eb8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:30.064758 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cfbcc2-f736-46ea-adc6-ee40c566eb8c None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:30.081496 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 404/794] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:23:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:23:30.081496 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cfbcc2-f736-46ea-adc6-ee40c566eb8c None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:30.084569 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:30.171930 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b7213-0757-4feb-9dd4-0da78a1517ad None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:30.182139 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:30.206784 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cfbcc2-f736-46ea-adc6-ee40c566eb8c None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:30.213183 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc5d6f-0db9-445d-a740-49c74c14c597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:30.214050 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc5d6f-0db9-445d-a740-49c74c14c597 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:30.214503 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc5d6f-0db9-445d-a740-49c74c14c597 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:30.215123 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc5d6f-0db9-445d-a740-49c74c14c597 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:30.231371 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bc5d6f-0db9-445d-a740-49c74c14c597 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:23:30.240589 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-e7bc5d6f-0db9-445d-a740-49c74c14c597 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:23:30.240589 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:30.240589 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:30.240589 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:30.240589 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:30.240589 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:30.240589 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:30.240589 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:30.240589 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:30.240589 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:30.240589 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:30.240589 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:30.240589 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:23:30.240589 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:23:30.240589 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:23:30.240589 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:23:30.241750 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:23:30.241750 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:23:30.241750 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:23:30.241750 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:23:30.241750 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:30.241750 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:30.241750 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:30.241750 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:30.241750 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:30.241750 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:30.241750 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:30.241750 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:30.241750 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:30.241750 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:30.241750 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:30.241750 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:30.242769 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:30.242769 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:30.242769 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:30.242769 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:30.242769 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:23:30.242769 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:23:30.242769 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:23:30.242769 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:23:30.242769 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:23:30.242769 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:23:30.242769 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:23:30.242769 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:30.246563 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea60e663-2bf2-44a5-a5b5-6b6575182bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:30.247659 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60e663-2bf2-44a5-a5b5-6b6575182bc5 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:30.247905 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 391/795] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 15:23:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:30.248394 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60e663-2bf2-44a5-a5b5-6b6575182bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:30.249319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60e663-2bf2-44a5-a5b5-6b6575182bc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:30.249969 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc5d6f-0db9-445d-a740-49c74c14c597 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:30.273015 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea60e663-2bf2-44a5-a5b5-6b6575182bc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:30.274785 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea60e663-2bf2-44a5-a5b5-6b6575182bc5 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:30.291117 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-ea60e663-2bf2-44a5-a5b5-6b6575182bc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:30.291117 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:30.291117 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:30.291117 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:30.291117 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:30.291117 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:30.291117 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:30.291117 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:30.291117 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:30.291117 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:30.291117 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:30.291117 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:30.291117 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:23:30.291117 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:23:30.291117 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:23:30.291117 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:23:30.292126 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:30.292126 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:30.292126 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:30.292126 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:30.292126 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:30.292126 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:30.292126 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:30.292126 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:30.292126 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:30.292126 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:30.292126 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:30.292126 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:30.292126 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:30.292126 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:30.292126 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:30.292126 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:30.292126 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:23:30.293000 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:23:30.293000 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:30.293000 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:30.294872 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 405/796] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:30.296223 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea60e663-2bf2-44a5-a5b5-6b6575182bc5 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:30.356740 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:30.380467 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc5d6f-0db9-445d-a740-49c74c14c597 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:30.406193 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea60e663-2bf2-44a5-a5b5-6b6575182bc5 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:30.419080 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef28a3-7abf-4a95-b4fe-c681dea5d606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:30.420078 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef28a3-7abf-4a95-b4fe-c681dea5d606 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:30.421412 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef28a3-7abf-4a95-b4fe-c681dea5d606 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:30.421934 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef28a3-7abf-4a95-b4fe-c681dea5d606 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:30.433201 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fef28a3-7abf-4a95-b4fe-c681dea5d606 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:30.435121 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fef28a3-7abf-4a95-b4fe-c681dea5d606 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:30.442789 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7753db5a-aaee-4fc7-aadc-1067680b33aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:30.443787 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753db5a-aaee-4fc7-aadc-1067680b33aa None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:30.444169 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753db5a-aaee-4fc7-aadc-1067680b33aa None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:30.444543 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753db5a-aaee-4fc7-aadc-1067680b33aa None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:30.445468 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7753db5a-aaee-4fc7-aadc-1067680b33aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:30.445728 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7753db5a-aaee-4fc7-aadc-1067680b33aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:30.447216 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7753db5a-aaee-4fc7-aadc-1067680b33aa None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:30.448695 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:30.454519 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-8fef28a3-7abf-4a95-b4fe-c681dea5d606 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:30.454519 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:30.454519 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:30.454519 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:30.454519 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:30.454519 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:30.454519 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:30.454519 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:30.454519 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:30.454519 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:30.454519 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:30.454519 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:30.454519 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:23:30.454519 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:23:30.454519 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:23:30.454519 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:23:30.455641 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:30.455641 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:30.455641 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:30.455641 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:30.455641 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:30.455641 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:30.455641 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:30.455641 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:30.455641 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:30.455641 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:30.455641 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:30.455641 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:30.455641 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:30.455641 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:30.455641 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:30.455641 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:30.455641 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:23:30.456528 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:23:30.456528 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:30.456528 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:30.462497 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 392/798] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:30.462634 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 406/798] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:23:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:30.462634 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7753db5a-aaee-4fc7-aadc-1067680b33aa None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:30.463876 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef28a3-7abf-4a95-b4fe-c681dea5d606 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:30.565971 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7753db5a-aaee-4fc7-aadc-1067680b33aa None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:30.583398 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef28a3-7abf-4a95-b4fe-c681dea5d606 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:30.602304 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82efa6e-e15d-43d8-adfa-1bcae420fa11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:30.603023 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82efa6e-e15d-43d8-adfa-1bcae420fa11 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:30.603482 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82efa6e-e15d-43d8-adfa-1bcae420fa11 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:30.603814 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82efa6e-e15d-43d8-adfa-1bcae420fa11 None admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:30.604680 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82efa6e-e15d-43d8-adfa-1bcae420fa11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:30.605006 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82efa6e-e15d-43d8-adfa-1bcae420fa11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:30.606516 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82efa6e-e15d-43d8-adfa-1bcae420fa11 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:30.621544 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 407/799] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:23:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:30.622574 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82efa6e-e15d-43d8-adfa-1bcae420fa11 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:30.628516 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:30.635147 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f9975-fb0e-4140-9256-b1cca9107e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:30.636081 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f9975-fb0e-4140-9256-b1cca9107e3c None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:30.636551 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f9975-fb0e-4140-9256-b1cca9107e3c None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:30.637005 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f9975-fb0e-4140-9256-b1cca9107e3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:30.649738 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f9975-fb0e-4140-9256-b1cca9107e3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:30.651703 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f9975-fb0e-4140-9256-b1cca9107e3c None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:30.668047 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-996f9975-fb0e-4140-9256-b1cca9107e3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:30.668047 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:30.668047 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:30.668047 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:30.668047 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:30.668047 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:30.668047 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:30.668047 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:30.668047 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:30.668047 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:30.668047 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:30.668047 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:30.668047 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:23:30.668047 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:23:30.668047 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:23:30.668047 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:23:30.669020 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:30.669020 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:30.669020 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:30.669020 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:30.669020 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:30.669020 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:30.669020 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:30.669020 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:30.669020 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:30.669020 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:30.669020 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:30.669020 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:30.669020 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:30.669020 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:30.669020 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:30.669020 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:30.669020 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:23:30.669893 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:23:30.669893 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:30.669893 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:30.677461 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 393/800] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:30.678696 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f9975-fb0e-4140-9256-b1cca9107e3c None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:30.685659 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:30.737816 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82efa6e-e15d-43d8-adfa-1bcae420fa11 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:30.777560 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd881c6-bd73-4d7b-ad7c-82f080454789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:30.778309 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd881c6-bd73-4d7b-ad7c-82f080454789 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:30.778655 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd881c6-bd73-4d7b-ad7c-82f080454789 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:30.779069 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd881c6-bd73-4d7b-ad7c-82f080454789 None admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:30.779799 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd881c6-bd73-4d7b-ad7c-82f080454789 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:30.780175 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd881c6-bd73-4d7b-ad7c-82f080454789 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:30.782475 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd881c6-bd73-4d7b-ad7c-82f080454789 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:30.800439 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 408/801] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:23:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:30.800439 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd881c6-bd73-4d7b-ad7c-82f080454789 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:30.905969 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd881c6-bd73-4d7b-ad7c-82f080454789 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:30.915383 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f9975-fb0e-4140-9256-b1cca9107e3c None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:30.922939 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:30.943726 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37379092-04c8-4c00-83cb-5f7e8551c4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:30.944596 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37379092-04c8-4c00-83cb-5f7e8551c4c1 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:30.944876 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37379092-04c8-4c00-83cb-5f7e8551c4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:30.945177 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37379092-04c8-4c00-83cb-5f7e8551c4c1 None admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:30.945808 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37379092-04c8-4c00-83cb-5f7e8551c4c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:30.946115 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37379092-04c8-4c00-83cb-5f7e8551c4c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:30.947537 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37379092-04c8-4c00-83cb-5f7e8551c4c1 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:30.954249 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97208729-1c03-4498-89a0-4299f5ec24a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:30.954935 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97208729-1c03-4498-89a0-4299f5ec24a1 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:30.955243 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97208729-1c03-4498-89a0-4299f5ec24a1 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:30.955518 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97208729-1c03-4498-89a0-4299f5ec24a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:30.965081 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 409/802] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:23:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:30.965081 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0dfe1-6587-4a2e-827d-9b75717470f9 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:30.965081 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0dfe1-6587-4a2e-827d-9b75717470f9 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:30.965081 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0dfe1-6587-4a2e-827d-9b75717470f9 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:30.965081 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 410/803] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:23:30.965081 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0dfe1-6587-4a2e-827d-9b75717470f9 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:30.969861 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97208729-1c03-4498-89a0-4299f5ec24a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:30.971520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97208729-1c03-4498-89a0-4299f5ec24a1 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:30.983719 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-97208729-1c03-4498-89a0-4299f5ec24a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:30.983719 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:30.983719 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:30.983719 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:30.983719 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:30.983719 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:30.983719 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:30.983719 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:30.983719 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:30.983719 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:30.983719 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:30.983719 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:30.983719 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:23:30.983719 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:23:30.983719 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:23:30.984743 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:23:30.984743 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:30.984743 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:30.984743 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:30.984743 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:30.984743 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:30.984743 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:30.984743 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:30.984743 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:30.984743 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:30.984743 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:30.984743 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:30.984743 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:30.984743 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:30.984743 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:30.984743 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:30.984743 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:30.985865 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:23:30.985865 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:23:30.985865 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:23:30.985865 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:23:30.985865 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:23:30.985865 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:23:30.985865 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:30.985865 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:30.985865 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 394/804] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:23:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:30.985865 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97208729-1c03-4498-89a0-4299f5ec24a1 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:31.038806 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:31.089316 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0dfe1-6587-4a2e-827d-9b75717470f9 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:31.102771 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97208729-1c03-4498-89a0-4299f5ec24a1 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:31.128529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d09b92-7bd6-4ede-bc0b-6ae72f1bbaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:31.129401 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d09b92-7bd6-4ede-bc0b-6ae72f1bbaa4 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:31.129841 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d09b92-7bd6-4ede-bc0b-6ae72f1bbaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:31.130117 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d09b92-7bd6-4ede-bc0b-6ae72f1bbaa4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:31.137371 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d09b92-7bd6-4ede-bc0b-6ae72f1bbaa4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:31.138815 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d09b92-7bd6-4ede-bc0b-6ae72f1bbaa4 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:31.141717 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d26b00-a459-4a97-8e5d-b5aa0c6b6613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:31.142468 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d26b00-a459-4a97-8e5d-b5aa0c6b6613 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:31.142847 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d26b00-a459-4a97-8e5d-b5aa0c6b6613 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:31.143242 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d26b00-a459-4a97-8e5d-b5aa0c6b6613 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:31.150478 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d26b00-a459-4a97-8e5d-b5aa0c6b6613 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:31.152067 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d26b00-a459-4a97-8e5d-b5aa0c6b6613 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:31.152871 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-99d09b92-7bd6-4ede-bc0b-6ae72f1bbaa4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 15:23:31.152871 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:31.152871 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:31.152871 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:31.152871 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:31.152871 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:31.152871 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:31.152871 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:31.152871 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:31.152871 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:31.152871 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:31.152871 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:31.152871 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:23:31.152871 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:23:31.152871 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:23:31.152871 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:23:31.153974 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:31.153974 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:31.153974 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:23:31.153974 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:23:31.153974 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:23:31.153974 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:23:31.153974 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:31.153974 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:31.153974 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:31.153974 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:31.153974 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:31.153974 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:31.153974 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:31.153974 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:31.153974 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:31.153974 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:31.153974 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:31.153974 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:31.155251 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:31.155251 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:31.155251 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:23:31.155251 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:23:31.155251 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:23:31.155251 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:23:31.155251 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:23:31.155251 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:23:31.155251 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 15:23:31.155251 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:31.159376 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 411/805] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 15:23:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:31.160672 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1df8d9-1b25-403e-9636-35c9ef8d1dcd None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:31.160962 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1df8d9-1b25-403e-9636-35c9ef8d1dcd None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:31.161237 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1df8d9-1b25-403e-9636-35c9ef8d1dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:31.167538 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-65d26b00-a459-4a97-8e5d-b5aa0c6b6613 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 15:23:31.167538 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:31.167538 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:31.167538 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:31.167538 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:31.167538 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:31.167538 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:31.167538 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:31.167538 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:31.167538 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:31.167538 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:31.167538 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:31.167538 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:23:31.167538 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:23:31.167538 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:23:31.167538 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:23:31.168744 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:31.168744 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:31.168744 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:23:31.168744 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:23:31.168744 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:23:31.168744 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:23:31.168744 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:31.168744 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:31.168744 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:31.168744 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:31.168744 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:31.168744 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:31.168744 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:31.168744 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:31.168744 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:31.168744 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:31.168744 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:31.168744 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:31.169753 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:31.169753 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:31.169753 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:23:31.169753 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:23:31.169753 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:23:31.169753 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:23:31.169753 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:23:31.169753 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:23:31.169753 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 15:23:31.169753 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:31.169753 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 395/806] 10.222.0.83 () {56 vars in 1093 bytes} [Mon Aug 29 15:23:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:31.169753 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d26b00-a459-4a97-8e5d-b5aa0c6b6613 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:31.185713 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-2b1df8d9-1b25-403e-9636-35c9ef8d1dcd None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:31.186904 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2b1df8d9-1b25-403e-9636-35c9ef8d1dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:31.218463 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:31.259198 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 412/807] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:23:31.260049 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1df8d9-1b25-403e-9636-35c9ef8d1dcd None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:31.281423 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d26b00-a459-4a97-8e5d-b5aa0c6b6613 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:31.286125 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:31.321067 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c4eb6c-c5ec-42c1-aa2e-68673b5532db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:31.321779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c4eb6c-c5ec-42c1-aa2e-68673b5532db None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:31.322131 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c4eb6c-c5ec-42c1-aa2e-68673b5532db None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:31.322469 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c4eb6c-c5ec-42c1-aa2e-68673b5532db None admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:31.323257 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c4eb6c-c5ec-42c1-aa2e-68673b5532db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:31.323648 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c4eb6c-c5ec-42c1-aa2e-68673b5532db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:31.325129 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c4eb6c-c5ec-42c1-aa2e-68673b5532db None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:31.338011 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 396/808] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 15:23:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:31.338818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c4eb6c-c5ec-42c1-aa2e-68673b5532db None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:31.378335 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1df8d9-1b25-403e-9636-35c9ef8d1dcd None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:31.416491 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f0ec5d-7780-48bc-9ffd-7586ad969cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:31.417113 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0ec5d-7780-48bc-9ffd-7586ad969cdd None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:31.417458 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0ec5d-7780-48bc-9ffd-7586ad969cdd None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:31.417797 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0ec5d-7780-48bc-9ffd-7586ad969cdd None admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:31.418607 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f0ec5d-7780-48bc-9ffd-7586ad969cdd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:31.418977 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f0ec5d-7780-48bc-9ffd-7586ad969cdd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:31.420513 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f0ec5d-7780-48bc-9ffd-7586ad969cdd None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:31.439124 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 413/809] 10.222.0.83 () {56 vars in 1135 bytes} [Mon Aug 29 15:23:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:31.440367 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e3012-4997-4d3d-87ce-da2084cc5ee8 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:31.440649 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e3012-4997-4d3d-87ce-da2084cc5ee8 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:31.440914 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e3012-4997-4d3d-87ce-da2084cc5ee8 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:31.442267 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 414/810] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:23:31.446991 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e3012-4997-4d3d-87ce-da2084cc5ee8 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:31.450045 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c4eb6c-c5ec-42c1-aa2e-68673b5532db None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:31.475472 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:31.488019 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aacaf7-c442-48dd-9a4b-ffecf31607b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:31.488631 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aacaf7-c442-48dd-9a4b-ffecf31607b1 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:31.488909 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aacaf7-c442-48dd-9a4b-ffecf31607b1 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:31.489174 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aacaf7-c442-48dd-9a4b-ffecf31607b1 None admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:31.489895 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aacaf7-c442-48dd-9a4b-ffecf31607b1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:31.490196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aacaf7-c442-48dd-9a4b-ffecf31607b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:31.491649 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aacaf7-c442-48dd-9a4b-ffecf31607b1 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:31.510141 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 397/811] 10.222.0.83 () {56 vars in 1133 bytes} [Mon Aug 29 15:23:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:31.511116 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aacaf7-c442-48dd-9a4b-ffecf31607b1 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:31.538440 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:31.561727 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e3012-4997-4d3d-87ce-da2084cc5ee8 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:31.597202 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e116e45-6652-423a-b54c-5798ef409ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:31.597856 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e116e45-6652-423a-b54c-5798ef409ded None admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:31.598129 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e116e45-6652-423a-b54c-5798ef409ded None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:31.598395 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e116e45-6652-423a-b54c-5798ef409ded None admin] PATH_INFO: `/v3/projects/44655977b0814a728f0fa73d442a7ee9/users/712a09e9d2a248309b91424dd05d2b44/roles/19a8fa4068774a289594739614bb8ad4` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:31.613009 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e116e45-6652-423a-b54c-5798ef409ded None admin] RBAC: Authorizing `identity:create_grant(project_id=44655977b0814a728f0fa73d442a7ee9, user_id=712a09e9d2a248309b91424dd05d2b44, role_id=19a8fa4068774a289594739614bb8ad4)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:31.614356 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aacaf7-c442-48dd-9a4b-ffecf31607b1 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:31.614496 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e116e45-6652-423a-b54c-5798ef409ded None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:31.627365 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 415/812] 10.222.0.83 () {58 vars in 1439 bytes} [Mon Aug 29 15:23:31 2022] PUT /identity/v3/projects/44655977b0814a728f0fa73d442a7ee9/users/712a09e9d2a248309b91424dd05d2b44/roles/19a8fa4068774a289594739614bb8ad4 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:23:31.636020 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1393645-ab12-4e06-b1cf-5cc6cf0af8c0 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:31.636020 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1393645-ab12-4e06-b1cf-5cc6cf0af8c0 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:31.636020 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1393645-ab12-4e06-b1cf-5cc6cf0af8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:31.650553 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f93e3b-4191-4147-8589-9a95aac78ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:31.651250 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f93e3b-4191-4147-8589-9a95aac78ea6 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:31.651521 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f93e3b-4191-4147-8589-9a95aac78ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:31.651794 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f93e3b-4191-4147-8589-9a95aac78ea6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:31.662495 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-f1393645-ab12-4e06-b1cf-5cc6cf0af8c0 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:31.663964 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f93e3b-4191-4147-8589-9a95aac78ea6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:31.664616 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f1393645-ab12-4e06-b1cf-5cc6cf0af8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:31.665441 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f93e3b-4191-4147-8589-9a95aac78ea6 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:31.688019 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-18f93e3b-4191-4147-8589-9a95aac78ea6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:31.688019 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:31.688019 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:31.688019 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:31.688019 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:31.688019 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:31.688019 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:31.688019 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:31.688019 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:31.688019 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:31.688019 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:31.688019 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:31.688019 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:23:31.688019 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:23:31.688019 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:23:31.688019 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:23:31.689696 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:31.689696 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:31.689696 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:31.689696 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:31.689696 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:31.689696 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:31.689696 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:31.689696 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:31.689696 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:31.689696 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:31.689696 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:31.689696 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:31.689696 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:31.689696 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:31.689696 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:31.689696 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:31.689696 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:23:31.690594 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:23:31.690594 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:31.690594 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:31.690594 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 398/813] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:31.691890 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f93e3b-4191-4147-8589-9a95aac78ea6 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:31.763072 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 416/814] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:23:31.763072 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1393645-ab12-4e06-b1cf-5cc6cf0af8c0 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:31.764281 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:31.788132 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:31.818087 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f93e3b-4191-4147-8589-9a95aac78ea6 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:31.855937 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2331654-5a2c-4cd8-b4ab-208c53bce40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:31.856548 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2331654-5a2c-4cd8-b4ab-208c53bce40a None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:31.856818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2331654-5a2c-4cd8-b4ab-208c53bce40a None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:31.857084 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2331654-5a2c-4cd8-b4ab-208c53bce40a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:31.900855 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1393645-ab12-4e06-b1cf-5cc6cf0af8c0 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:31.933259 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2331654-5a2c-4cd8-b4ab-208c53bce40a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:31.935767 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2331654-5a2c-4cd8-b4ab-208c53bce40a None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:31.945038 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cfb5d7-af51-4da9-81c4-b768b6e5611d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:31.945606 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cfb5d7-af51-4da9-81c4-b768b6e5611d None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:31.945880 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cfb5d7-af51-4da9-81c4-b768b6e5611d None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:31.946145 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cfb5d7-af51-4da9-81c4-b768b6e5611d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:31.947100 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cfb5d7-af51-4da9-81c4-b768b6e5611d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:31.948487 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cfb5d7-af51-4da9-81c4-b768b6e5611d None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:31.958351 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-72cfb5d7-af51-4da9-81c4-b768b6e5611d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 15:23:31.958351 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:31.958351 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:23:31.958351 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:23:31.958351 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:23:31.958351 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:23:31.958351 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:23:31.958351 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:23:31.958351 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 15:23:31.958351 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:31.958351 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:23:31.958351 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:31.958351 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:31.958351 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:31.958351 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:31.958351 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:31.958351 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:31.959625 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:31.959625 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:31.959625 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:31.959625 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:31.959625 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:31.959625 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:31.959625 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:23:31.959625 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:23:31.959625 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:23:31.959625 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:23:31.959625 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:31.959625 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:31.959625 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:31.959625 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:31.959625 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:31.959625 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:31.960753 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:31.960753 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:31.960753 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:31.960753 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:31.960753 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:31.960753 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:31.960753 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:31.960753 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:31.960753 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:31.960753 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:31.960753 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:23:31.960753 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:23:31.960753 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 15:23:31.960753 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:31.960753 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 417/815] 10.222.0.83 () {56 vars in 1129 bytes} [Mon Aug 29 15:23:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:31.961797 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cfb5d7-af51-4da9-81c4-b768b6e5611d None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:32.035098 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:32.043201 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:32.073303 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cfb5d7-af51-4da9-81c4-b768b6e5611d None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:32.073897 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 399/816] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:23:31 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 15:23:32.078454 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2331654-5a2c-4cd8-b4ab-208c53bce40a None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:32.115830 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344979ea-d4b6-46bf-8fe7-d2f9eac88666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:32.116549 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344979ea-d4b6-46bf-8fe7-d2f9eac88666 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:32.116895 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344979ea-d4b6-46bf-8fe7-d2f9eac88666 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:32.117232 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344979ea-d4b6-46bf-8fe7-d2f9eac88666 None admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:32.117952 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344979ea-d4b6-46bf-8fe7-d2f9eac88666 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:32.118325 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344979ea-d4b6-46bf-8fe7-d2f9eac88666 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:32.119800 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344979ea-d4b6-46bf-8fe7-d2f9eac88666 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:32.135166 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 418/817] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:23:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:32.135166 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344979ea-d4b6-46bf-8fe7-d2f9eac88666 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:32.192446 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2331654-5a2c-4cd8-b4ab-208c53bce40a None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:32.230823 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98fe234-d213-422d-9b1f-b7ddc5ffbec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:32.231770 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fe234-d213-422d-9b1f-b7ddc5ffbec1 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:32.232373 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fe234-d213-422d-9b1f-b7ddc5ffbec1 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:32.232850 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fe234-d213-422d-9b1f-b7ddc5ffbec1 None admin] PATH_INFO: `/v3/services` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:32.233719 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98fe234-d213-422d-9b1f-b7ddc5ffbec1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:32.234161 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98fe234-d213-422d-9b1f-b7ddc5ffbec1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:32.235918 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98fe234-d213-422d-9b1f-b7ddc5ffbec1 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:32.238875 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344979ea-d4b6-46bf-8fe7-d2f9eac88666 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:32.245394 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 400/818] 10.222.0.83 () {56 vars in 1124 bytes} [Mon Aug 29 15:23:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:32.246434 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98fe234-d213-422d-9b1f-b7ddc5ffbec1 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:32.266873 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:32.276485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59ac05-f0c4-4eaf-b078-8bf6bb2e8bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:32.277122 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59ac05-f0c4-4eaf-b078-8bf6bb2e8bd9 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:32.277399 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59ac05-f0c4-4eaf-b078-8bf6bb2e8bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:32.277677 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59ac05-f0c4-4eaf-b078-8bf6bb2e8bd9 None admin] PATH_INFO: `/v3/services/network` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:32.278261 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc59ac05-f0c4-4eaf-b078-8bf6bb2e8bd9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:32.279682 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc59ac05-f0c4-4eaf-b078-8bf6bb2e8bd9 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:32.289171 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-bc59ac05-f0c4-4eaf-b078-8bf6bb2e8bd9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 15:23:32.289171 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:32.289171 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:23:32.289171 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:23:32.289171 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:23:32.289171 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:23:32.289171 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:23:32.289171 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:23:32.289171 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 15:23:32.289171 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:32.289171 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:23:32.289171 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:32.289171 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:32.289171 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:32.289171 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:32.289171 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:32.289171 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:32.290156 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:32.290156 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:32.290156 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:32.290156 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:32.290156 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:32.290156 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:32.290156 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:23:32.290156 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:23:32.290156 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:23:32.290156 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:23:32.290156 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:32.290156 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:32.290156 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:32.290156 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:32.290156 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:32.290156 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:32.291107 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:32.291107 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:32.291107 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:32.291107 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:32.291107 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:32.291107 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:32.291107 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:32.291107 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:32.291107 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:32.291107 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:32.291107 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:23:32.291107 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:23:32.291107 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 15:23:32.291107 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:32.291107 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 419/819] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:23:32 2022] GET /identity/v3/services/network => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:32.291952 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59ac05-f0c4-4eaf-b078-8bf6bb2e8bd9 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:32.296755 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:32.366121 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98fe234-d213-422d-9b1f-b7ddc5ffbec1 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:32.401041 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59ac05-f0c4-4eaf-b078-8bf6bb2e8bd9 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:32.404324 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1fb4b2-c58b-4972-9e5a-3582ea02592a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:32.404949 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1fb4b2-c58b-4972-9e5a-3582ea02592a None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:32.405227 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1fb4b2-c58b-4972-9e5a-3582ea02592a None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:32.405498 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1fb4b2-c58b-4972-9e5a-3582ea02592a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:32.416874 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1fb4b2-c58b-4972-9e5a-3582ea02592a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:32.418318 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1fb4b2-c58b-4972-9e5a-3582ea02592a None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:32.434300 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-ed1fb4b2-c58b-4972-9e5a-3582ea02592a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:32.434300 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:32.434300 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:32.434300 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:32.434300 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:32.434300 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:32.434300 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:32.434300 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:32.434300 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:32.434300 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:32.434300 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:32.434300 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:32.434300 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:23:32.434300 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:23:32.434300 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:23:32.434300 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:23:32.435312 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:32.435312 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:32.435312 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:32.435312 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:32.435312 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:32.435312 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:32.435312 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:32.435312 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:32.435312 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:32.435312 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:32.435312 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:32.435312 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:32.435312 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:32.435312 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:32.435312 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:32.435312 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:32.435312 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:23:32.436216 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:23:32.436216 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:32.436216 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:32.436216 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 401/820] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:32.436216 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1fb4b2-c58b-4972-9e5a-3582ea02592a None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:32.442284 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822e7567-9019-4354-9c73-fe1eed2af5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:32.442932 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e7567-9019-4354-9c73-fe1eed2af5c9 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:32.443261 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e7567-9019-4354-9c73-fe1eed2af5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:32.443530 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e7567-9019-4354-9c73-fe1eed2af5c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:32.450854 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822e7567-9019-4354-9c73-fe1eed2af5c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:32.452443 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822e7567-9019-4354-9c73-fe1eed2af5c9 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:32.467216 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-822e7567-9019-4354-9c73-fe1eed2af5c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:32.467216 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:32.467216 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:32.467216 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:32.467216 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:32.467216 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:32.467216 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:32.467216 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:32.467216 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:32.467216 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:32.467216 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:32.467216 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:32.467216 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:23:32.467216 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:23:32.467216 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:23:32.468254 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:23:32.468254 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:32.468254 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:32.468254 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:32.468254 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:32.468254 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:32.468254 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:32.468254 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:32.468254 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:32.468254 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:32.468254 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:32.468254 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:32.468254 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:32.468254 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:32.468254 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:32.468254 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:32.468254 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:32.475060 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:23:32.475060 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:23:32.475060 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:23:32.475060 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:23:32.475060 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:23:32.475060 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:23:32.475060 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:32.475060 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:32.475060 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 420/821] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:23:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:32.475060 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822e7567-9019-4354-9c73-fe1eed2af5c9 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:32.534928 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:32.538129 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:32.546619 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1fb4b2-c58b-4972-9e5a-3582ea02592a None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:32.586823 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3a95b-0b68-4cd8-ba14-2cc0f1cb3c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:32.587573 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3a95b-0b68-4cd8-ba14-2cc0f1cb3c3a None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:32.587861 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3a95b-0b68-4cd8-ba14-2cc0f1cb3c3a None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:32.588249 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3a95b-0b68-4cd8-ba14-2cc0f1cb3c3a None admin] PATH_INFO: `/v3/services` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:32.588909 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b3a95b-0b68-4cd8-ba14-2cc0f1cb3c3a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:32.589215 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b3a95b-0b68-4cd8-ba14-2cc0f1cb3c3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:32.590607 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b3a95b-0b68-4cd8-ba14-2cc0f1cb3c3a None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:32.591345 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822e7567-9019-4354-9c73-fe1eed2af5c9 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:32.595830 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 402/822] 10.222.0.83 () {56 vars in 1124 bytes} [Mon Aug 29 15:23:32 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:32.601574 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3a95b-0b68-4cd8-ba14-2cc0f1cb3c3a None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:32.630394 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7a834-916a-42d2-acfe-e1471c4bf1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:32.631214 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7a834-916a-42d2-acfe-e1471c4bf1e4 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:32.631501 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7a834-916a-42d2-acfe-e1471c4bf1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:32.632104 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7a834-916a-42d2-acfe-e1471c4bf1e4 None admin] PATH_INFO: `/v3/services` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:32.632814 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a7a834-916a-42d2-acfe-e1471c4bf1e4 None admin] RBAC: Adding query filter params (name=network) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:32.633057 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a7a834-916a-42d2-acfe-e1471c4bf1e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:32.634432 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a7a834-916a-42d2-acfe-e1471c4bf1e4 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:32.639363 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 421/823] 10.222.0.83 () {56 vars in 1112 bytes} [Mon Aug 29 15:23:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:32.640170 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7a834-916a-42d2-acfe-e1471c4bf1e4 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:32.721156 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3a95b-0b68-4cd8-ba14-2cc0f1cb3c3a None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:32.757643 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7a834-916a-42d2-acfe-e1471c4bf1e4 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:32.762618 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94380282-d591-473b-95b4-0652a90e8553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:32.763263 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94380282-d591-473b-95b4-0652a90e8553 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:32.763543 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94380282-d591-473b-95b4-0652a90e8553 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:32.763812 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94380282-d591-473b-95b4-0652a90e8553 None admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:32.764456 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94380282-d591-473b-95b4-0652a90e8553 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:32.764761 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94380282-d591-473b-95b4-0652a90e8553 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:32.766137 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94380282-d591-473b-95b4-0652a90e8553 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:32.776556 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:32.784140 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 403/824] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:23:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:32.784140 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94380282-d591-473b-95b4-0652a90e8553 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:32.802068 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:32.808322 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3392558-d1f7-4ec2-84ec-8ac8a6a89270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:32.809021 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3392558-d1f7-4ec2-84ec-8ac8a6a89270 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:32.809374 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3392558-d1f7-4ec2-84ec-8ac8a6a89270 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:32.809985 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3392558-d1f7-4ec2-84ec-8ac8a6a89270 None admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:32.810608 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3392558-d1f7-4ec2-84ec-8ac8a6a89270 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:32.811102 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3392558-d1f7-4ec2-84ec-8ac8a6a89270 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:32.813267 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3392558-d1f7-4ec2-84ec-8ac8a6a89270 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:32.833664 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 422/825] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 15:23:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:32.833664 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3392558-d1f7-4ec2-84ec-8ac8a6a89270 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:32.897586 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94380282-d591-473b-95b4-0652a90e8553 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:32.936243 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3392558-d1f7-4ec2-84ec-8ac8a6a89270 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:32.940306 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a3fd6-ecd9-43da-9091-314f25d5418e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:32.940980 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a3fd6-ecd9-43da-9091-314f25d5418e None admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:32.941326 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a3fd6-ecd9-43da-9091-314f25d5418e None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:32.941715 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a3fd6-ecd9-43da-9091-314f25d5418e None admin] PATH_INFO: `/v3/endpoints` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:32.942456 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a3fd6-ecd9-43da-9091-314f25d5418e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:32.944015 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a3fd6-ecd9-43da-9091-314f25d5418e None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:32.969586 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 404/826] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:23:32 2022] POST /identity/v3/endpoints => generated 346 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:23:32.970462 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a3fd6-ecd9-43da-9091-314f25d5418e None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:32.995661 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663793b-069a-4c9a-a914-92ce77fec5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:32.996607 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663793b-069a-4c9a-a914-92ce77fec5b0 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:32.997125 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663793b-069a-4c9a-a914-92ce77fec5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:32.997543 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663793b-069a-4c9a-a914-92ce77fec5b0 None admin] PATH_INFO: `/v3/services` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:32.998471 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b663793b-069a-4c9a-a914-92ce77fec5b0 None admin] RBAC: Adding query filter params (type=network) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:32.998918 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b663793b-069a-4c9a-a914-92ce77fec5b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:33.000900 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b663793b-069a-4c9a-a914-92ce77fec5b0 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:33.008232 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 423/827] 10.222.0.83 () {56 vars in 1112 bytes} [Mon Aug 29 15:23:32 2022] GET /identity/v3/services?type=network => generated 350 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:33.009436 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663793b-069a-4c9a-a914-92ce77fec5b0 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:33.057982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:33.092742 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:33.137137 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a3fd6-ecd9-43da-9091-314f25d5418e None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:33.186393 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9ebfa-50ac-4f23-981e-d0588f343351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:33.187125 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9ebfa-50ac-4f23-981e-d0588f343351 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:33.187429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9ebfa-50ac-4f23-981e-d0588f343351 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:33.187723 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9ebfa-50ac-4f23-981e-d0588f343351 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:33.196374 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab9ebfa-50ac-4f23-981e-d0588f343351 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:33.197916 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab9ebfa-50ac-4f23-981e-d0588f343351 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:33.212083 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-aab9ebfa-50ac-4f23-981e-d0588f343351 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:33.212083 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:33.212083 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:33.212083 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:33.212083 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:33.212083 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:33.212083 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:33.212083 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:33.212083 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:33.212083 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:33.212083 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:33.212083 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:33.212083 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:23:33.212083 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:23:33.212083 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:23:33.212991 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:23:33.212991 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:33.212991 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:33.212991 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:33.212991 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:33.212991 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:33.212991 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:33.212991 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:33.212991 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:33.212991 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:33.212991 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:33.212991 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:33.212991 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:33.212991 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:33.212991 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:33.212991 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:33.212991 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:33.213874 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:23:33.213874 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:23:33.213874 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:23:33.213874 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:23:33.213874 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:23:33.213874 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:23:33.213874 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:33.213874 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:33.213874 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 405/828] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:23:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:33.214346 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9ebfa-50ac-4f23-981e-d0588f343351 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:33.276294 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663793b-069a-4c9a-a914-92ce77fec5b0 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:33.311399 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66850a9-d0e3-4d86-8145-c151f80d58e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:33.311965 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66850a9-d0e3-4d86-8145-c151f80d58e6 None admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:33.312244 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66850a9-d0e3-4d86-8145-c151f80d58e6 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:33.312516 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66850a9-d0e3-4d86-8145-c151f80d58e6 None admin] PATH_INFO: `/v3/projects/44655977b0814a728f0fa73d442a7ee9/users/b0f8e95d393f499baf44830f9fb7e583/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:33.314511 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66850a9-d0e3-4d86-8145-c151f80d58e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=44655977b0814a728f0fa73d442a7ee9, user_id=b0f8e95d393f499baf44830f9fb7e583, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:33.315995 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66850a9-d0e3-4d86-8145-c151f80d58e6 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:33.330399 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 424/829] 10.222.0.83 () {58 vars in 1439 bytes} [Mon Aug 29 15:23:33 2022] PUT /identity/v3/projects/44655977b0814a728f0fa73d442a7ee9/users/b0f8e95d393f499baf44830f9fb7e583/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:23:33.338681 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9ebfa-50ac-4f23-981e-d0588f343351 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:33.339528 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66850a9-d0e3-4d86-8145-c151f80d58e6 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:33.382465 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:33.389477 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f15655-000d-4335-9929-b66a3203a758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:33.390509 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f15655-000d-4335-9929-b66a3203a758 None admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:33.391052 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f15655-000d-4335-9929-b66a3203a758 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:33.391616 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f15655-000d-4335-9929-b66a3203a758 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:33.392633 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f15655-000d-4335-9929-b66a3203a758 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:33.394429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f15655-000d-4335-9929-b66a3203a758 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:33.421638 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 406/830] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:23:33 2022] POST /identity/v3/endpoints => generated 337 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:23:33.505041 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:33.513035 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66850a9-d0e3-4d86-8145-c151f80d58e6 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:33.560850 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea02dae-c597-4a8e-b50a-4df2b51ff91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:33.561544 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea02dae-c597-4a8e-b50a-4df2b51ff91f None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:33.561756 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea02dae-c597-4a8e-b50a-4df2b51ff91f None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:33.562027 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea02dae-c597-4a8e-b50a-4df2b51ff91f None admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:33.562740 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea02dae-c597-4a8e-b50a-4df2b51ff91f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:33.563057 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea02dae-c597-4a8e-b50a-4df2b51ff91f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:33.564525 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea02dae-c597-4a8e-b50a-4df2b51ff91f None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:33.579698 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 425/831] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 15:23:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:33.586896 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f15655-000d-4335-9929-b66a3203a758 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:33.679696 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fcd2f-e9ca-4582-852a-96c1d19cdd35 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:33.680528 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fcd2f-e9ca-4582-852a-96c1d19cdd35 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:33.680815 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fcd2f-e9ca-4582-852a-96c1d19cdd35 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:33.682158 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 426/832] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:23:33.689060 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913556fa-2316-4a08-91f3-856ade948336 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:33.689349 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913556fa-2316-4a08-91f3-856ade948336 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:33.689620 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913556fa-2316-4a08-91f3-856ade948336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:33.711365 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-913556fa-2316-4a08-91f3-856ade948336 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:33.713108 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-913556fa-2316-4a08-91f3-856ade948336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:33.728666 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f15655-000d-4335-9929-b66a3203a758 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:33.776128 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f4890-56a4-4dc8-aed4-edce6f991670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:33.776751 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f4890-56a4-4dc8-aed4-edce6f991670 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:33.777028 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f4890-56a4-4dc8-aed4-edce6f991670 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:33.777298 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f4890-56a4-4dc8-aed4-edce6f991670 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:33.778030 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f4890-56a4-4dc8-aed4-edce6f991670 None admin] RBAC: Adding query filter params (role.id=4bb2bbb7bb544610877949fc933504d2, scope.project.id=44655977b0814a728f0fa73d442a7ee9, user.id=253947a5ef294d2bb828761873251bd1) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:33.778334 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f4890-56a4-4dc8-aed4-edce6f991670 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:33.779847 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f4890-56a4-4dc8-aed4-edce6f991670 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:33.788965 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 407/833] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 15:23:33 2022] GET /identity/v3/role_assignments?user.id=253947a5ef294d2bb828761873251bd1&scope.project.id=44655977b0814a728f0fa73d442a7ee9&role.id=4bb2bbb7bb544610877949fc933504d2 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:33.801182 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 427/834] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:33 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 15:23:34.099178 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f4890-56a4-4dc8-aed4-edce6f991670 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:34.151661 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:34.205062 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f4890-56a4-4dc8-aed4-edce6f991670 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:34.240294 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af545de-6aa8-4b7c-a475-6124d4c29189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:34.240930 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af545de-6aa8-4b7c-a475-6124d4c29189 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:34.241244 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af545de-6aa8-4b7c-a475-6124d4c29189 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:34.241590 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af545de-6aa8-4b7c-a475-6124d4c29189 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:34.252239 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af545de-6aa8-4b7c-a475-6124d4c29189 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:23:34.258120 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-5af545de-6aa8-4b7c-a475-6124d4c29189 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:23:34.258120 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:34.258120 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:34.258120 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:34.258120 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:34.258120 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:34.258120 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:34.258120 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:34.258120 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:34.258120 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:34.258120 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:34.258120 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:34.258120 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:23:34.258120 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:23:34.258120 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:23:34.258120 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:23:34.259159 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:23:34.259159 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:23:34.259159 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:23:34.259159 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:23:34.259159 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:34.259159 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:34.259159 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:34.259159 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:34.259159 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:34.259159 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:34.259159 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:34.259159 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:34.259159 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:34.259159 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:34.259159 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:34.259159 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:34.260368 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:34.260368 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:34.260368 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:34.260368 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:34.260368 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:23:34.260368 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:23:34.260368 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:23:34.260368 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:23:34.260368 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:23:34.260368 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:23:34.260368 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:23:34.260368 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:34.260368 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 408/835] 10.222.0.83 () {56 vars in 1102 bytes} [Mon Aug 29 15:23:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:34.265364 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913556fa-2316-4a08-91f3-856ade948336 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:34.355646 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:34.374204 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913556fa-2316-4a08-91f3-856ade948336 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:34.408714 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c995d04-af8b-4e02-a2f1-95cfcb0071f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:34.409324 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c995d04-af8b-4e02-a2f1-95cfcb0071f2 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:34.409597 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c995d04-af8b-4e02-a2f1-95cfcb0071f2 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:34.409865 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c995d04-af8b-4e02-a2f1-95cfcb0071f2 None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:34.410520 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c995d04-af8b-4e02-a2f1-95cfcb0071f2 None admin] RBAC: Adding query filter params (name=service) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:34.410819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c995d04-af8b-4e02-a2f1-95cfcb0071f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:34.412312 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c995d04-af8b-4e02-a2f1-95cfcb0071f2 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:34.421266 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 428/836] 10.222.0.83 () {56 vars in 1103 bytes} [Mon Aug 29 15:23:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:34.426713 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af545de-6aa8-4b7c-a475-6124d4c29189 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:34.529470 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af545de-6aa8-4b7c-a475-6124d4c29189 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:34.539978 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:34.563993 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a77e8-926d-4d9c-ad4b-25aad745a5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:34.564621 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a77e8-926d-4d9c-ad4b-25aad745a5df None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:34.564896 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a77e8-926d-4d9c-ad4b-25aad745a5df None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:34.565164 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a77e8-926d-4d9c-ad4b-25aad745a5df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:34.575952 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a77e8-926d-4d9c-ad4b-25aad745a5df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:34.577665 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a77e8-926d-4d9c-ad4b-25aad745a5df None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:34.592551 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-260a77e8-926d-4d9c-ad4b-25aad745a5df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:34.592551 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:34.592551 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:34.592551 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:34.592551 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:34.592551 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:34.592551 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:34.592551 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:34.592551 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:34.592551 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:34.592551 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:34.592551 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:34.592551 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:23:34.592551 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:23:34.592551 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:23:34.592551 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:23:34.593528 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:34.593528 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:34.593528 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:34.593528 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:34.593528 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:34.593528 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:34.593528 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:34.593528 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:34.593528 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:34.593528 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:34.593528 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:34.593528 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:34.593528 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:34.593528 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:34.593528 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:34.593528 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:34.593528 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:23:34.595053 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:23:34.595053 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:34.595053 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:34.595053 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 409/837] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:34.599630 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c995d04-af8b-4e02-a2f1-95cfcb0071f2 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:34.728605 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c995d04-af8b-4e02-a2f1-95cfcb0071f2 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:34.763619 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb3cf9-4a23-4e6a-87af-064ff3fa7102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:34.764230 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb3cf9-4a23-4e6a-87af-064ff3fa7102 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:34.764512 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb3cf9-4a23-4e6a-87af-064ff3fa7102 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:34.764786 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb3cf9-4a23-4e6a-87af-064ff3fa7102 None admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:34.765436 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb3cf9-4a23-4e6a-87af-064ff3fa7102 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:34.765742 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb3cf9-4a23-4e6a-87af-064ff3fa7102 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:34.767285 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb3cf9-4a23-4e6a-87af-064ff3fa7102 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:34.779868 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 429/838] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:23:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:34.785320 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a77e8-926d-4d9c-ad4b-25aad745a5df None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:34.891059 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a77e8-926d-4d9c-ad4b-25aad745a5df None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:34.928813 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc232f1-16a9-4f33-9d9d-a8853cbd0fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:34.929482 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc232f1-16a9-4f33-9d9d-a8853cbd0fa8 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:34.929762 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc232f1-16a9-4f33-9d9d-a8853cbd0fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:34.930033 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc232f1-16a9-4f33-9d9d-a8853cbd0fa8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:34.939732 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc232f1-16a9-4f33-9d9d-a8853cbd0fa8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:34.941234 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc232f1-16a9-4f33-9d9d-a8853cbd0fa8 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:34.953338 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-5dc232f1-16a9-4f33-9d9d-a8853cbd0fa8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 15:23:34.953338 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:34.953338 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:34.953338 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:34.953338 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:34.953338 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:34.953338 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:34.953338 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:34.953338 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:34.953338 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:34.953338 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:34.953338 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:34.953338 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:23:34.953338 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:23:34.953338 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:23:34.953338 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:23:34.954347 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:34.954347 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:34.954347 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:23:34.954347 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:23:34.954347 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:23:34.954347 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:23:34.954347 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:34.954347 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:34.954347 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:34.954347 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:34.954347 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:34.954347 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:34.954347 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:34.954347 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:34.954347 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:34.954347 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:34.954347 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:34.954347 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:34.955939 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:34.955939 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:34.955939 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:23:34.955939 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:23:34.955939 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:23:34.955939 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:23:34.955939 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:23:34.955939 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:23:34.955939 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 15:23:34.955939 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:34.955939 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 410/839] 10.222.0.83 () {56 vars in 1117 bytes} [Mon Aug 29 15:23:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:34.960446 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb3cf9-4a23-4e6a-87af-064ff3fa7102 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:34.964515 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:35.080006 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb3cf9-4a23-4e6a-87af-064ff3fa7102 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:35.121289 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f1daf-6ccc-4a53-a34b-99089a41b617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:35.122364 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f1daf-6ccc-4a53-a34b-99089a41b617 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:35.122835 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f1daf-6ccc-4a53-a34b-99089a41b617 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:35.123319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f1daf-6ccc-4a53-a34b-99089a41b617 None admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:35.124260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f1daf-6ccc-4a53-a34b-99089a41b617 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:35.124771 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f1daf-6ccc-4a53-a34b-99089a41b617 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:35.126400 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f1daf-6ccc-4a53-a34b-99089a41b617 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:35.145554 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 430/840] 10.222.0.83 () {56 vars in 1149 bytes} [Mon Aug 29 15:23:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:35.153686 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc232f1-16a9-4f33-9d9d-a8853cbd0fa8 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:35.177559 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:35.216371 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28e419-8cbc-4c29-b6ca-2e82badfeea5 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:35.216561 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28e419-8cbc-4c29-b6ca-2e82badfeea5 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:35.216926 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28e419-8cbc-4c29-b6ca-2e82badfeea5 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:35.218628 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 431/841] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:23:35.223932 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ff9ac-7f5a-4a64-8103-2362d2300266 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:35.224217 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ff9ac-7f5a-4a64-8103-2362d2300266 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:35.224491 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ff9ac-7f5a-4a64-8103-2362d2300266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:35.244957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-0b5ff9ac-7f5a-4a64-8103-2362d2300266 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:35.246275 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0b5ff9ac-7f5a-4a64-8103-2362d2300266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:35.258498 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc232f1-16a9-4f33-9d9d-a8853cbd0fa8 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:35.294300 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0103280-f3bf-4659-b752-6cb2bd8ae280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:35.294910 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0103280-f3bf-4659-b752-6cb2bd8ae280 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:35.295213 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0103280-f3bf-4659-b752-6cb2bd8ae280 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:35.295477 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0103280-f3bf-4659-b752-6cb2bd8ae280 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:35.315186 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:35.338978 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 432/842] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:35 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:23:35.378799 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0103280-f3bf-4659-b752-6cb2bd8ae280 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:35.380452 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0103280-f3bf-4659-b752-6cb2bd8ae280 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:35.407322 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:35.488569 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 411/843] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:23:35 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 15:23:35.495226 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ff9ac-7f5a-4a64-8103-2362d2300266 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:35.603383 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ff9ac-7f5a-4a64-8103-2362d2300266 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:35.627475 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0103280-f3bf-4659-b752-6cb2bd8ae280 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:35.642309 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16e1cf-5a92-4c46-ad3b-5025f0184d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:35.643310 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16e1cf-5a92-4c46-ad3b-5025f0184d1c None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:35.643885 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16e1cf-5a92-4c46-ad3b-5025f0184d1c None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:35.644349 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16e1cf-5a92-4c46-ad3b-5025f0184d1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:35.655872 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16e1cf-5a92-4c46-ad3b-5025f0184d1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:35.657336 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16e1cf-5a92-4c46-ad3b-5025f0184d1c None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:35.673383 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-0a16e1cf-5a92-4c46-ad3b-5025f0184d1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:35.673383 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:35.673383 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:35.673383 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:35.673383 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:35.673383 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:35.673383 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:35.673383 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:35.673383 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:35.673383 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:35.673383 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:35.673383 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:35.673383 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:23:35.673383 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:23:35.673383 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:23:35.673383 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:23:35.674384 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:35.674384 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:35.674384 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:35.674384 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:35.674384 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:35.674384 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:35.674384 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:35.674384 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:35.674384 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:35.674384 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:35.674384 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:35.674384 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:35.674384 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:35.674384 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:35.674384 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:35.674384 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:35.674384 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:23:35.680280 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:23:35.680280 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:35.680280 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:35.680280 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 433/844] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:35.680280 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d5d8c-05ca-434e-aaee-c29a316c45df None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:35.680280 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d5d8c-05ca-434e-aaee-c29a316c45df None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:35.680280 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d5d8c-05ca-434e-aaee-c29a316c45df None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:35.680280 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 434/845] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:23:35.683844 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d5d8c-05ca-434e-aaee-c29a316c45df None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:35.742930 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:35.756374 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0103280-f3bf-4659-b752-6cb2bd8ae280 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:35.779468 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:35.792812 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19335298-6d6b-489d-8ab7-d52fcca4a199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:35.793443 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19335298-6d6b-489d-8ab7-d52fcca4a199 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:35.793720 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19335298-6d6b-489d-8ab7-d52fcca4a199 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:35.793988 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19335298-6d6b-489d-8ab7-d52fcca4a199 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:35.794571 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19335298-6d6b-489d-8ab7-d52fcca4a199 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:35.795974 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19335298-6d6b-489d-8ab7-d52fcca4a199 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:35.800973 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d5d8c-05ca-434e-aaee-c29a316c45df None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:35.805061 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-19335298-6d6b-489d-8ab7-d52fcca4a199 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 15:23:35.805061 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:35.805061 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:23:35.805061 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:23:35.805061 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:23:35.805061 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:23:35.805061 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:23:35.805061 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:23:35.805061 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 15:23:35.805061 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:35.805061 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:23:35.805061 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:35.805061 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:35.805061 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:35.805061 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:35.805061 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:35.805061 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:35.806173 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:35.806173 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:35.806173 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:35.806173 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:35.806173 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:35.806173 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:35.806173 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:23:35.806173 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:23:35.806173 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:23:35.806173 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:23:35.806173 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:35.806173 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:35.806173 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:35.806173 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:35.806173 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:35.806173 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:35.808091 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:35.808091 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:35.808091 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:35.808091 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:35.808091 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:35.808091 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:35.808091 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:35.808091 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:35.808091 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:35.808091 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:35.808091 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:23:35.808091 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:23:35.808091 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 15:23:35.808091 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:35.808091 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 412/846] 10.222.0.83 () {56 vars in 1114 bytes} [Mon Aug 29 15:23:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:23:35.808920 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5cdbe-0d0a-459e-8df0-9bca973ee582 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:35.809147 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5cdbe-0d0a-459e-8df0-9bca973ee582 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:35.809426 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5cdbe-0d0a-459e-8df0-9bca973ee582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:35.827229 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-7de5cdbe-0d0a-459e-8df0-9bca973ee582 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:35.828412 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7de5cdbe-0d0a-459e-8df0-9bca973ee582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:35.839455 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0807f1-b2da-489c-a6a0-d670b6cbc277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:35.840582 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0807f1-b2da-489c-a6a0-d670b6cbc277 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:35.840582 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0807f1-b2da-489c-a6a0-d670b6cbc277 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:35.840582 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0807f1-b2da-489c-a6a0-d670b6cbc277 None admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:35.841255 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0807f1-b2da-489c-a6a0-d670b6cbc277 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:35.841558 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0807f1-b2da-489c-a6a0-d670b6cbc277 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:35.842954 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0807f1-b2da-489c-a6a0-d670b6cbc277 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:35.855868 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 435/847] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:23:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:35.857152 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bdace-af8c-4cf5-89e3-41ccd61589f8 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:35.857438 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bdace-af8c-4cf5-89e3-41ccd61589f8 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:35.857712 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bdace-af8c-4cf5-89e3-41ccd61589f8 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:35.858906 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 436/848] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:23:35.859616 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bdace-af8c-4cf5-89e3-41ccd61589f8 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:35.905136 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 413/849] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:35 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:23:35.905964 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5cdbe-0d0a-459e-8df0-9bca973ee582 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:35.972677 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bdace-af8c-4cf5-89e3-41ccd61589f8 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:35.975009 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:36.014504 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5cdbe-0d0a-459e-8df0-9bca973ee582 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:36.016868 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fde9f4-2a2f-4c25-8576-91a552205295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:36.017586 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fde9f4-2a2f-4c25-8576-91a552205295 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:36.017962 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fde9f4-2a2f-4c25-8576-91a552205295 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:36.018332 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fde9f4-2a2f-4c25-8576-91a552205295 None admin] PATH_INFO: `/v3/services` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:36.019103 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fde9f4-2a2f-4c25-8576-91a552205295 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:36.019510 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fde9f4-2a2f-4c25-8576-91a552205295 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:36.020981 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fde9f4-2a2f-4c25-8576-91a552205295 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:36.030793 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 437/850] 10.222.0.83 () {56 vars in 1114 bytes} [Mon Aug 29 15:23:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:36.030793 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f239ffe-a156-4f3b-973a-856cf9aecf5f None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:36.030793 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f239ffe-a156-4f3b-973a-856cf9aecf5f None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:36.030793 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f239ffe-a156-4f3b-973a-856cf9aecf5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:36.037950 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:36.046896 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-5f239ffe-a156-4f3b-973a-856cf9aecf5f None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:36.048132 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5f239ffe-a156-4f3b-973a-856cf9aecf5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:36.058561 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe8640-04c4-4946-bfa1-6fc63da15259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:36.059211 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe8640-04c4-4946-bfa1-6fc63da15259 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:36.059704 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe8640-04c4-4946-bfa1-6fc63da15259 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:36.059813 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe8640-04c4-4946-bfa1-6fc63da15259 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:36.066656 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe8640-04c4-4946-bfa1-6fc63da15259 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:36.068131 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe8640-04c4-4946-bfa1-6fc63da15259 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:36.080415 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-6afe8640-04c4-4946-bfa1-6fc63da15259 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:36.080415 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:36.080415 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:36.080415 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:36.080415 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:36.080415 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:36.080415 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:36.080415 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:36.080415 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:36.080415 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:36.080415 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:36.080415 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:36.080415 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:23:36.080415 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:23:36.080415 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:23:36.081307 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:23:36.081307 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:36.081307 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:36.081307 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:36.081307 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:36.081307 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:36.081307 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:36.081307 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:36.081307 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:36.081307 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:36.081307 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:36.081307 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:36.081307 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:36.081307 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:36.081307 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:36.081307 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:36.081307 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:36.082236 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:23:36.082236 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:23:36.082236 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:23:36.082236 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:23:36.082236 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:23:36.082236 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:23:36.082236 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:36.082236 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:36.082236 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 414/851] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:23:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:36.082236 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe8640-04c4-4946-bfa1-6fc63da15259 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:36.131103 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 438/852] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:36 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:23:36.131103 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f239ffe-a156-4f3b-973a-856cf9aecf5f None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:36.204782 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe8640-04c4-4946-bfa1-6fc63da15259 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:36.238612 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:36.242954 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f239ffe-a156-4f3b-973a-856cf9aecf5f None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:36.243248 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e22a20-e66a-4a9e-bc5d-dd6d2e67bfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:36.243856 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e22a20-e66a-4a9e-bc5d-dd6d2e67bfa1 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:36.244135 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e22a20-e66a-4a9e-bc5d-dd6d2e67bfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:36.244402 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e22a20-e66a-4a9e-bc5d-dd6d2e67bfa1 None admin] PATH_INFO: `/v3/services` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:36.245045 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e22a20-e66a-4a9e-bc5d-dd6d2e67bfa1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:36.245483 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e22a20-e66a-4a9e-bc5d-dd6d2e67bfa1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:36.246852 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e22a20-e66a-4a9e-bc5d-dd6d2e67bfa1 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:36.263608 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 415/853] 10.222.0.83 () {56 vars in 1114 bytes} [Mon Aug 29 15:23:36 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:36.264233 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e22a20-e66a-4a9e-bc5d-dd6d2e67bfa1 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:36.285830 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad7abe-a6f9-470a-8a97-ef7e42582f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:36.286361 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad7abe-a6f9-470a-8a97-ef7e42582f02 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:36.286643 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad7abe-a6f9-470a-8a97-ef7e42582f02 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:36.286916 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad7abe-a6f9-470a-8a97-ef7e42582f02 None admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:36.287665 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad7abe-a6f9-470a-8a97-ef7e42582f02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:36.287971 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad7abe-a6f9-470a-8a97-ef7e42582f02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:36.289459 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad7abe-a6f9-470a-8a97-ef7e42582f02 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:36.309132 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 439/854] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 15:23:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:36.310162 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad7abe-a6f9-470a-8a97-ef7e42582f02 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:36.337601 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:36.429940 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e22a20-e66a-4a9e-bc5d-dd6d2e67bfa1 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:36.440607 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad7abe-a6f9-470a-8a97-ef7e42582f02 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:36.468394 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f600d4-0b0f-4478-a525-bc699eefd443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:36.469033 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f600d4-0b0f-4478-a525-bc699eefd443 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:36.469313 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f600d4-0b0f-4478-a525-bc699eefd443 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:36.469636 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f600d4-0b0f-4478-a525-bc699eefd443 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:36.480978 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f600d4-0b0f-4478-a525-bc699eefd443 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:23:36.482840 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a360904-2fe5-4caf-a1db-8a28d2db233c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:36.483491 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a360904-2fe5-4caf-a1db-8a28d2db233c None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:36.483771 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a360904-2fe5-4caf-a1db-8a28d2db233c None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:36.484044 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a360904-2fe5-4caf-a1db-8a28d2db233c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:36.484774 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a360904-2fe5-4caf-a1db-8a28d2db233c None admin] RBAC: Adding query filter params (role.id=19a8fa4068774a289594739614bb8ad4, scope.project.id=44655977b0814a728f0fa73d442a7ee9, user.id=712a09e9d2a248309b91424dd05d2b44) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:36.485081 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a360904-2fe5-4caf-a1db-8a28d2db233c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:36.486518 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a360904-2fe5-4caf-a1db-8a28d2db233c None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:36.487107 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-c7f600d4-0b0f-4478-a525-bc699eefd443 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:23:36.487107 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:36.487107 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:36.487107 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:36.487107 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:36.487107 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:36.487107 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:36.487107 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:36.487107 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:36.487107 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:36.487107 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:36.487107 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:36.487107 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:23:36.487107 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:23:36.487107 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:23:36.487107 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:23:36.487986 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:23:36.487986 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:23:36.487986 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:23:36.487986 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:23:36.487986 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:36.487986 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:36.487986 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:36.487986 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:36.487986 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:36.487986 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:36.487986 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:36.487986 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:36.487986 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:36.487986 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:36.487986 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:36.487986 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:36.489253 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:36.489253 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:36.489253 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:36.489253 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:36.489253 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:23:36.489253 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:23:36.489253 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:23:36.489253 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:23:36.489253 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:23:36.489253 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:23:36.489253 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:23:36.489253 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:36.489253 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 416/855] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 15:23:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:36.489253 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f600d4-0b0f-4478-a525-bc699eefd443 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:36.497980 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 440/856] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 15:23:36 2022] GET /identity/v3/role_assignments?user.id=712a09e9d2a248309b91424dd05d2b44&scope.project.id=44655977b0814a728f0fa73d442a7ee9&role.id=19a8fa4068774a289594739614bb8ad4 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:36.498640 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a360904-2fe5-4caf-a1db-8a28d2db233c None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:36.527111 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:36.627122 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:36.632160 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f600d4-0b0f-4478-a525-bc699eefd443 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:36.637597 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a360904-2fe5-4caf-a1db-8a28d2db233c None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:36.680794 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89652d50-5b36-4633-81dd-c969cd0549d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:36.681005 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156ea63-4f87-4461-b482-5e40aa673478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:36.681410 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89652d50-5b36-4633-81dd-c969cd0549d9 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:36.681511 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156ea63-4f87-4461-b482-5e40aa673478 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:36.681685 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89652d50-5b36-4633-81dd-c969cd0549d9 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:36.681777 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156ea63-4f87-4461-b482-5e40aa673478 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:36.682001 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89652d50-5b36-4633-81dd-c969cd0549d9 None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:36.682106 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156ea63-4f87-4461-b482-5e40aa673478 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:36.682585 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6156ea63-4f87-4461-b482-5e40aa673478 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:36.682689 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89652d50-5b36-4633-81dd-c969cd0549d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:36.682963 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89652d50-5b36-4633-81dd-c969cd0549d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:36.684699 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6156ea63-4f87-4461-b482-5e40aa673478 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:36.684940 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89652d50-5b36-4633-81dd-c969cd0549d9 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:36.694651 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 441/857] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:23:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:36.695924 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-6156ea63-4f87-4461-b482-5e40aa673478 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 15:23:36.695924 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:36.695924 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:23:36.695924 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:23:36.695924 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:23:36.695924 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:23:36.695924 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:23:36.695924 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:23:36.695924 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 15:23:36.695924 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:36.695924 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:23:36.695924 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:36.695924 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:36.695924 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:36.695924 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:36.695924 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:36.696800 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:36.696800 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:36.696800 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:36.696800 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:36.696800 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:36.696800 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:36.696800 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:36.696800 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:23:36.696800 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:23:36.696800 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:23:36.696800 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:23:36.696800 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:36.696800 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:36.696800 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:36.696800 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:36.696800 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:36.696800 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:36.697675 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:36.697675 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:36.697675 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:36.697675 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:36.697675 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:36.697675 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:36.697675 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:36.697675 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:36.697675 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:36.697675 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:36.697675 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:23:36.697675 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:23:36.697675 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 15:23:36.697675 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:36.703783 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 417/858] 10.222.0.83 () {56 vars in 1132 bytes} [Mon Aug 29 15:23:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:36.704012 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89652d50-5b36-4633-81dd-c969cd0549d9 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:36.706014 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156ea63-4f87-4461-b482-5e40aa673478 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:36.832513 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:36.847369 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156ea63-4f87-4461-b482-5e40aa673478 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:36.851671 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89652d50-5b36-4633-81dd-c969cd0549d9 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:36.887675 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4f990-2673-4ba5-a44d-32ee1fdb457d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:36.888266 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72648b9c-6cb3-48ff-b738-4ca3d817bd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:36.888391 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4f990-2673-4ba5-a44d-32ee1fdb457d None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:36.888562 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4f990-2673-4ba5-a44d-32ee1fdb457d None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:36.888817 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4f990-2673-4ba5-a44d-32ee1fdb457d None admin] PATH_INFO: `/v3/services` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:36.889516 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a4f990-2673-4ba5-a44d-32ee1fdb457d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:36.889823 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a4f990-2673-4ba5-a44d-32ee1fdb457d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:36.890035 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72648b9c-6cb3-48ff-b738-4ca3d817bd80 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:36.890495 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72648b9c-6cb3-48ff-b738-4ca3d817bd80 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:36.890957 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72648b9c-6cb3-48ff-b738-4ca3d817bd80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:36.891231 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a4f990-2673-4ba5-a44d-32ee1fdb457d None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:36.896692 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 442/859] 10.222.0.83 () {56 vars in 1126 bytes} [Mon Aug 29 15:23:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:36.902145 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4f990-2673-4ba5-a44d-32ee1fdb457d None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:36.903811 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72648b9c-6cb3-48ff-b738-4ca3d817bd80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:36.905485 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72648b9c-6cb3-48ff-b738-4ca3d817bd80 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:36.921809 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-72648b9c-6cb3-48ff-b738-4ca3d817bd80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:36.921809 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:36.921809 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:36.921809 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:36.921809 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:36.921809 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:36.921809 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:36.921809 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:36.921809 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:36.921809 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:36.921809 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:36.921809 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:36.921809 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:23:36.921809 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:23:36.921809 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:23:36.921809 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:23:36.922795 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:36.922795 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:36.922795 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:36.922795 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:36.922795 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:36.922795 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:36.922795 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:36.922795 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:36.922795 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:36.922795 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:36.922795 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:36.922795 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:36.922795 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:36.922795 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:36.922795 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:36.922795 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:36.922795 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:23:36.923745 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:23:36.923745 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:36.923745 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:36.925830 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 418/860] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:23:36.935055 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72648b9c-6cb3-48ff-b738-4ca3d817bd80 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:36.959411 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:37.017384 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4f990-2673-4ba5-a44d-32ee1fdb457d None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:37.055389 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438db4a1-9b2d-447d-9ebf-4d4b82ea9186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:37.056001 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438db4a1-9b2d-447d-9ebf-4d4b82ea9186 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:37.056278 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438db4a1-9b2d-447d-9ebf-4d4b82ea9186 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:37.056551 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438db4a1-9b2d-447d-9ebf-4d4b82ea9186 None admin] PATH_INFO: `/v3/services` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:37.057185 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438db4a1-9b2d-447d-9ebf-4d4b82ea9186 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:37.057487 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438db4a1-9b2d-447d-9ebf-4d4b82ea9186 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:37.058981 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438db4a1-9b2d-447d-9ebf-4d4b82ea9186 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:37.071334 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 443/861] 10.222.0.83 () {56 vars in 1126 bytes} [Mon Aug 29 15:23:36 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:23:37.072138 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72648b9c-6cb3-48ff-b738-4ca3d817bd80 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:37.119655 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e5bd6-3817-464c-b7e2-3ab2d149c9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:37.120287 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e5bd6-3817-464c-b7e2-3ab2d149c9aa None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:37.120560 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e5bd6-3817-464c-b7e2-3ab2d149c9aa None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:37.120827 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e5bd6-3817-464c-b7e2-3ab2d149c9aa None admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:37.121492 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33e5bd6-3817-464c-b7e2-3ab2d149c9aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:37.121792 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33e5bd6-3817-464c-b7e2-3ab2d149c9aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:37.123312 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33e5bd6-3817-464c-b7e2-3ab2d149c9aa None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:37.142461 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 419/862] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:23:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:37.143818 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438db4a1-9b2d-447d-9ebf-4d4b82ea9186 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:37.161252 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:37.252741 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438db4a1-9b2d-447d-9ebf-4d4b82ea9186 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:37.288013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e6c44-590c-4c39-a5cc-6f515ade2d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:37.288640 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e6c44-590c-4c39-a5cc-6f515ade2d5f None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:37.288920 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e6c44-590c-4c39-a5cc-6f515ade2d5f None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:37.289186 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e6c44-590c-4c39-a5cc-6f515ade2d5f None admin] PATH_INFO: `/v3/users/swift` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:37.297815 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11e6c44-590c-4c39-a5cc-6f515ade2d5f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:37.299300 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11e6c44-590c-4c39-a5cc-6f515ade2d5f None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:37.311685 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-f11e6c44-590c-4c39-a5cc-6f515ade2d5f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 15:23:37.311685 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:37.311685 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:37.311685 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:37.311685 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:37.311685 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:37.311685 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:37.311685 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:37.311685 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:37.311685 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:37.311685 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:37.311685 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:37.311685 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:23:37.311685 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:23:37.311685 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:23:37.311685 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:23:37.312663 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:37.312663 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:37.312663 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:23:37.312663 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:23:37.312663 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:23:37.312663 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:23:37.312663 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:37.312663 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:37.312663 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:37.312663 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:37.312663 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:37.312663 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:37.312663 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:37.312663 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:37.312663 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:37.312663 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:37.312663 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:37.312663 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:37.313589 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:37.313589 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:37.313589 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:23:37.313589 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:23:37.313589 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:23:37.313589 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:23:37.313589 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:23:37.313589 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:23:37.313589 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 15:23:37.313589 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:37.317434 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 444/863] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 15:23:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:37.318785 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e5bd6-3817-464c-b7e2-3ab2d149c9aa None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:37.408219 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:37.431746 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e5bd6-3817-464c-b7e2-3ab2d149c9aa None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:37.467589 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e436a-8755-46a4-8496-145859a5bc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:37.468198 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e436a-8755-46a4-8496-145859a5bc04 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:37.468481 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e436a-8755-46a4-8496-145859a5bc04 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:37.468747 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e436a-8755-46a4-8496-145859a5bc04 None admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:37.469469 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3e436a-8755-46a4-8496-145859a5bc04 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:37.469773 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3e436a-8755-46a4-8496-145859a5bc04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:37.471221 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3e436a-8755-46a4-8496-145859a5bc04 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:37.488850 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 420/864] 10.222.0.83 () {56 vars in 1135 bytes} [Mon Aug 29 15:23:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:37.494992 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e6c44-590c-4c39-a5cc-6f515ade2d5f None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:37.569538 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:37.602088 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e6c44-590c-4c39-a5cc-6f515ade2d5f None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:37.637309 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f08538-3974-4ae4-8fca-3bbfa5638d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:37.638339 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f08538-3974-4ae4-8fca-3bbfa5638d47 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:37.639472 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f08538-3974-4ae4-8fca-3bbfa5638d47 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:37.640023 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f08538-3974-4ae4-8fca-3bbfa5638d47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:37.713976 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f08538-3974-4ae4-8fca-3bbfa5638d47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:37.715754 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f08538-3974-4ae4-8fca-3bbfa5638d47 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:37.788073 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:37.826575 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 445/865] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:23:37 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 15:23:37.828051 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e436a-8755-46a4-8496-145859a5bc04 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:37.931951 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e436a-8755-46a4-8496-145859a5bc04 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:37.971318 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b28e8-5cdf-4c9f-8f78-3eb66ef0d33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:37.971872 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b28e8-5cdf-4c9f-8f78-3eb66ef0d33e None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:37.972159 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b28e8-5cdf-4c9f-8f78-3eb66ef0d33e None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:37.972412 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b28e8-5cdf-4c9f-8f78-3eb66ef0d33e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:37.974390 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:37.983503 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b28e8-5cdf-4c9f-8f78-3eb66ef0d33e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:37.984937 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b28e8-5cdf-4c9f-8f78-3eb66ef0d33e None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:38.000089 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-8c7b28e8-5cdf-4c9f-8f78-3eb66ef0d33e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:38.000089 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:38.000089 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:38.000089 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:38.000089 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:38.000089 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:38.000089 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:38.000089 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:38.000089 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:38.000089 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:38.000089 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:38.000089 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:38.000089 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:23:38.000089 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:23:38.000089 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:23:38.000089 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:23:38.001710 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:38.001710 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:38.001710 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:38.001710 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:38.001710 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:38.001710 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:38.001710 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:38.001710 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:38.001710 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:38.001710 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:38.001710 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:38.001710 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:38.001710 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:38.001710 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:38.001710 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:38.001710 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:38.001710 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:23:38.003624 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:23:38.003624 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:38.003624 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:38.003624 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 421/866] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:38.009811 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f08538-3974-4ae4-8fca-3bbfa5638d47 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:38.114429 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f08538-3974-4ae4-8fca-3bbfa5638d47 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:38.153846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9cac0f-785c-4236-9ddd-fca4d2d8322a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:38.154846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9cac0f-785c-4236-9ddd-fca4d2d8322a None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:38.155986 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9cac0f-785c-4236-9ddd-fca4d2d8322a None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:38.156483 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9cac0f-785c-4236-9ddd-fca4d2d8322a None admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:38.157322 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9cac0f-785c-4236-9ddd-fca4d2d8322a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:38.157844 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9cac0f-785c-4236-9ddd-fca4d2d8322a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:38.159436 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9cac0f-785c-4236-9ddd-fca4d2d8322a None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:38.175203 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 446/867] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:23:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:38.177755 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b28e8-5cdf-4c9f-8f78-3eb66ef0d33e None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:38.230908 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd283a-0cba-479a-8a88-3d92c399c527 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:38.231218 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd283a-0cba-479a-8a88-3d92c399c527 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:38.231396 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd283a-0cba-479a-8a88-3d92c399c527 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:38.233088 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 447/868] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:23:38.240195 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa1436-aeb0-48a9-b8ff-05444f8f92ab None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:38.240580 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa1436-aeb0-48a9-b8ff-05444f8f92ab None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:38.241173 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa1436-aeb0-48a9-b8ff-05444f8f92ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:38.267762 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-39aa1436-aeb0-48a9-b8ff-05444f8f92ab None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:38.269080 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-39aa1436-aeb0-48a9-b8ff-05444f8f92ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:38.301140 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b28e8-5cdf-4c9f-8f78-3eb66ef0d33e None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:38.338689 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d8fca-4cf1-4fb5-8d16-1e66cb9acb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:38.339682 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d8fca-4cf1-4fb5-8d16-1e66cb9acb78 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:38.340188 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d8fca-4cf1-4fb5-8d16-1e66cb9acb78 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:38.340636 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d8fca-4cf1-4fb5-8d16-1e66cb9acb78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:38.348280 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d8fca-4cf1-4fb5-8d16-1e66cb9acb78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:38.350077 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d8fca-4cf1-4fb5-8d16-1e66cb9acb78 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:38.351422 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:38.363063 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 448/869] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:38 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 15:23:38.368934 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-e74d8fca-4cf1-4fb5-8d16-1e66cb9acb78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:38.368934 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:38.368934 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:38.368934 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:38.368934 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:38.368934 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:38.368934 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:38.368934 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:38.368934 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:38.368934 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:38.368934 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:38.368934 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:38.368934 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:23:38.368934 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:23:38.368934 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:23:38.369826 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:23:38.369826 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:38.369826 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:38.369826 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:38.369826 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:38.369826 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:38.369826 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:38.369826 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:38.369826 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:38.369826 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:38.369826 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:38.369826 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:38.369826 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:38.369826 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:38.369826 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:38.369826 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:38.369826 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:38.370732 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:23:38.370732 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:23:38.370732 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:23:38.370732 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:23:38.370732 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:23:38.370732 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:23:38.370732 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:38.370732 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:38.375182 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 422/870] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:23:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:23:38.376754 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa1436-aeb0-48a9-b8ff-05444f8f92ab None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:38.485443 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa1436-aeb0-48a9-b8ff-05444f8f92ab None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:38.521627 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138440b-594b-4aae-90bf-2f02ac4d1d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:38.522231 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138440b-594b-4aae-90bf-2f02ac4d1d84 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:38.522505 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138440b-594b-4aae-90bf-2f02ac4d1d84 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:38.522770 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138440b-594b-4aae-90bf-2f02ac4d1d84 None admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:38.523538 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b138440b-594b-4aae-90bf-2f02ac4d1d84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:38.523835 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b138440b-594b-4aae-90bf-2f02ac4d1d84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:38.525303 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b138440b-594b-4aae-90bf-2f02ac4d1d84 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:38.542238 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 449/871] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 15:23:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:23:38.543709 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d8fca-4cf1-4fb5-8d16-1e66cb9acb78 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:38.597797 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:38.639231 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138440b-594b-4aae-90bf-2f02ac4d1d84 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:38.657628 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d8fca-4cf1-4fb5-8d16-1e66cb9acb78 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:38.674136 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:38.697027 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4faf0e-b38b-4ed4-a774-84ae02ff7c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:38.698016 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4faf0e-b38b-4ed4-a774-84ae02ff7c0a None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:38.698528 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4faf0e-b38b-4ed4-a774-84ae02ff7c0a None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:38.699086 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4faf0e-b38b-4ed4-a774-84ae02ff7c0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:38.700111 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4faf0e-b38b-4ed4-a774-84ae02ff7c0a None admin] RBAC: Adding query filter params (role.id=4bb2bbb7bb544610877949fc933504d2, scope.project.id=44655977b0814a728f0fa73d442a7ee9, user.id=b0f8e95d393f499baf44830f9fb7e583) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:38.700644 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4faf0e-b38b-4ed4-a774-84ae02ff7c0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:38.702297 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4faf0e-b38b-4ed4-a774-84ae02ff7c0a None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:38.710201 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 423/872] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 15:23:38 2022] GET /identity/v3/role_assignments?user.id=b0f8e95d393f499baf44830f9fb7e583&scope.project.id=44655977b0814a728f0fa73d442a7ee9&role.id=4bb2bbb7bb544610877949fc933504d2 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:23:38.728157 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a8f09-6d4c-4541-abe8-41422e57f5fd None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:38.728815 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a8f09-6d4c-4541-abe8-41422e57f5fd None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:38.729428 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a8f09-6d4c-4541-abe8-41422e57f5fd None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:38.731553 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 424/873] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:23:38.739172 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc7582-dade-442b-b137-ec9370f47ba2 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:38.739488 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc7582-dade-442b-b137-ec9370f47ba2 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:38.739773 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc7582-dade-442b-b137-ec9370f47ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:38.765339 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-f4bc7582-dade-442b-b137-ec9370f47ba2 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:38.766977 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f4bc7582-dade-442b-b137-ec9370f47ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:38.785918 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138440b-594b-4aae-90bf-2f02ac4d1d84 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:38.840515 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3ff69-f25c-470a-9a7a-3f34471c300a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:38.842166 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3ff69-f25c-470a-9a7a-3f34471c300a None admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:38.842639 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3ff69-f25c-470a-9a7a-3f34471c300a None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:38.843383 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3ff69-f25c-470a-9a7a-3f34471c300a None admin] PATH_INFO: `/v3/services` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:38.845319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3ff69-f25c-470a-9a7a-3f34471c300a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:38.847802 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3ff69-f25c-470a-9a7a-3f34471c300a None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:38.859228 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 425/874] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:38 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:23:38.872522 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 450/875] 10.222.0.83 () {60 vars in 1141 bytes} [Mon Aug 29 15:23:38 2022] POST /identity/v3/services => generated 251 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:23:39.070562 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4ea36-1a60-41c0-a2c1-b5cf3f8b2d7d None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:39.070751 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4ea36-1a60-41c0-a2c1-b5cf3f8b2d7d None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:39.071046 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4ea36-1a60-41c0-a2c1-b5cf3f8b2d7d None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:39.072655 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 426/876] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:23:39.077879 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61338da3-0102-4f7c-abc7-2ba22425a003 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:39.078167 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61338da3-0102-4f7c-abc7-2ba22425a003 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:39.078443 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61338da3-0102-4f7c-abc7-2ba22425a003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:39.098187 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-61338da3-0102-4f7c-abc7-2ba22425a003 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:39.099672 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-61338da3-0102-4f7c-abc7-2ba22425a003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:39.143612 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4ea36-1a60-41c0-a2c1-b5cf3f8b2d7d None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:39.187732 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 451/877] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:39 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:23:39.189649 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:39.256348 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4ea36-1a60-41c0-a2c1-b5cf3f8b2d7d None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:39.292548 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564f09e-3cc4-43d3-af0a-bfe296adb408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:39.293471 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564f09e-3cc4-43d3-af0a-bfe296adb408 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:39.293921 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564f09e-3cc4-43d3-af0a-bfe296adb408 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:39.294392 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564f09e-3cc4-43d3-af0a-bfe296adb408 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:39.306068 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6564f09e-3cc4-43d3-af0a-bfe296adb408 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:23:39.311194 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-6564f09e-3cc4-43d3-af0a-bfe296adb408 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 15:23:39.311194 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:39.311194 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:39.311194 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:39.311194 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:39.311194 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:39.311194 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:39.311194 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:39.311194 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:39.311194 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:39.311194 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:39.311194 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:39.311194 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:23:39.311194 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:23:39.311194 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:23:39.311194 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:23:39.312102 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:23:39.312102 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:23:39.312102 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:23:39.312102 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:23:39.312102 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:39.312102 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:39.312102 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:39.312102 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:39.312102 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:39.312102 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:39.312102 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:39.312102 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:39.312102 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:39.312102 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:39.312102 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:39.312102 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:39.312911 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:39.312911 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:39.312911 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:39.312911 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:39.312911 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:23:39.312911 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:23:39.312911 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:23:39.312911 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:23:39.312911 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:23:39.312911 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:23:39.312911 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 15:23:39.312911 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:39.315808 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 427/878] 10.222.0.83 () {56 vars in 1120 bytes} [Mon Aug 29 15:23:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:23:39.323651 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61338da3-0102-4f7c-abc7-2ba22425a003 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:39.333014 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:39.437227 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61338da3-0102-4f7c-abc7-2ba22425a003 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:39.473797 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e99073-f607-4512-9bd9-f60f2f07535f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:39.474410 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e99073-f607-4512-9bd9-f60f2f07535f None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:39.474686 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e99073-f607-4512-9bd9-f60f2f07535f None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:39.474955 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e99073-f607-4512-9bd9-f60f2f07535f None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:39.475697 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e99073-f607-4512-9bd9-f60f2f07535f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:39.476003 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e99073-f607-4512-9bd9-f60f2f07535f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:39.477369 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e99073-f607-4512-9bd9-f60f2f07535f None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:39.485825 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 452/879] 10.222.0.83 () {56 vars in 1115 bytes} [Mon Aug 29 15:23:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:39.491325 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564f09e-3cc4-43d3-af0a-bfe296adb408 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:39.495316 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e99073-f607-4512-9bd9-f60f2f07535f None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:39.570827 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:39.602106 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:39.606208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564f09e-3cc4-43d3-af0a-bfe296adb408 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:39.607537 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e99073-f607-4512-9bd9-f60f2f07535f None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:39.643407 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a991895-653f-4fd8-ac4b-b9b9381fe1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:39.644228 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a991895-653f-4fd8-ac4b-b9b9381fe1e0 None admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:39.644428 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ffa91f-2dba-4602-8d6d-b23dc0ab49b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:39.644712 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a991895-653f-4fd8-ac4b-b9b9381fe1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:39.645089 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a991895-653f-4fd8-ac4b-b9b9381fe1e0 None admin] PATH_INFO: `/v3/services` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:39.645634 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffa91f-2dba-4602-8d6d-b23dc0ab49b2 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:39.645855 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a991895-653f-4fd8-ac4b-b9b9381fe1e0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:39.646263 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffa91f-2dba-4602-8d6d-b23dc0ab49b2 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:39.646715 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffa91f-2dba-4602-8d6d-b23dc0ab49b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:39.647465 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a991895-653f-4fd8-ac4b-b9b9381fe1e0 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:39.660056 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ffa91f-2dba-4602-8d6d-b23dc0ab49b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:39.661818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ffa91f-2dba-4602-8d6d-b23dc0ab49b2 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:39.671952 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 453/880] 10.222.0.83 () {60 vars in 1141 bytes} [Mon Aug 29 15:23:39 2022] POST /identity/v3/services => generated 269 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:23:39.679684 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-06ffa91f-2dba-4602-8d6d-b23dc0ab49b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:39.679684 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:39.679684 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:39.679684 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:39.679684 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:39.679684 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:39.679684 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:39.679684 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:39.679684 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:39.679684 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:39.679684 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:39.679684 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:39.679684 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:23:39.679684 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:23:39.679684 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:23:39.679684 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:23:39.680710 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:39.680710 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:39.680710 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:39.680710 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:39.680710 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:39.680710 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:39.680710 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:39.680710 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:39.680710 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:39.680710 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:39.680710 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:39.680710 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:39.680710 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:39.680710 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:39.680710 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:39.680710 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:39.680710 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:23:39.681628 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:23:39.681628 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:39.681628 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:39.684056 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 428/881] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:39.691212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a991895-653f-4fd8-ac4b-b9b9381fe1e0 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:39.816249 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a991895-653f-4fd8-ac4b-b9b9381fe1e0 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:39.847542 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:39.852709 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0d32a-1db0-492e-bc8d-38378453fc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:39.853719 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0d32a-1db0-492e-bc8d-38378453fc38 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:39.853999 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0d32a-1db0-492e-bc8d-38378453fc38 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:39.854270 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0d32a-1db0-492e-bc8d-38378453fc38 None admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:39.854937 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0d32a-1db0-492e-bc8d-38378453fc38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:39.855800 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0d32a-1db0-492e-bc8d-38378453fc38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:39.857262 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0d32a-1db0-492e-bc8d-38378453fc38 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:39.870500 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 454/882] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:23:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:39.876145 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ffa91f-2dba-4602-8d6d-b23dc0ab49b2 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:39.990256 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ffa91f-2dba-4602-8d6d-b23dc0ab49b2 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:40.028078 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89806bb6-d7eb-4811-8d61-81d68e7412cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:40.028780 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89806bb6-d7eb-4811-8d61-81d68e7412cb None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:40.029041 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89806bb6-d7eb-4811-8d61-81d68e7412cb None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:40.029310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89806bb6-d7eb-4811-8d61-81d68e7412cb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:40.038457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89806bb6-d7eb-4811-8d61-81d68e7412cb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:40.040500 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89806bb6-d7eb-4811-8d61-81d68e7412cb None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:40.052717 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-89806bb6-d7eb-4811-8d61-81d68e7412cb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 15:23:40.052717 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:40.052717 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:40.052717 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:40.052717 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:40.052717 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:40.052717 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:40.052717 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:40.052717 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:40.052717 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:40.052717 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:40.052717 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:40.052717 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:23:40.052717 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:23:40.052717 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:23:40.052717 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:23:40.053665 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:40.053665 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:40.053665 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:23:40.053665 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:23:40.053665 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:23:40.053665 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:23:40.053665 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:40.053665 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:40.053665 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:40.053665 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:40.053665 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:40.053665 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:40.053665 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:40.053665 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:40.053665 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:40.053665 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:40.053665 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:40.053665 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:40.054576 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:40.054576 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:40.054576 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:23:40.054576 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:23:40.054576 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:23:40.054576 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:23:40.054576 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:23:40.054576 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:23:40.054576 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 15:23:40.054576 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:40.054576 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 429/883] 10.222.0.83 () {56 vars in 1117 bytes} [Mon Aug 29 15:23:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:23:40.061363 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0d32a-1db0-492e-bc8d-38378453fc38 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:40.168341 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0d32a-1db0-492e-bc8d-38378453fc38 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:40.204504 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f883cd8-be87-4e68-84e9-c34c27f912ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:40.205163 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f883cd8-be87-4e68-84e9-c34c27f912ed None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:40.205389 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f883cd8-be87-4e68-84e9-c34c27f912ed None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:40.206337 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f883cd8-be87-4e68-84e9-c34c27f912ed None admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:40.207219 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f883cd8-be87-4e68-84e9-c34c27f912ed None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:40.207646 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f883cd8-be87-4e68-84e9-c34c27f912ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:40.209314 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f883cd8-be87-4e68-84e9-c34c27f912ed None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:40.229022 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 455/884] 10.222.0.83 () {56 vars in 1149 bytes} [Mon Aug 29 15:23:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:40.234754 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89806bb6-d7eb-4811-8d61-81d68e7412cb None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:40.250849 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:40.340724 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89806bb6-d7eb-4811-8d61-81d68e7412cb None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:40.375429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f392b6b1-366b-4c6b-aed2-729a78f1f9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:40.376041 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392b6b1-366b-4c6b-aed2-729a78f1f9bd None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:40.376323 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392b6b1-366b-4c6b-aed2-729a78f1f9bd None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:40.376576 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392b6b1-366b-4c6b-aed2-729a78f1f9bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:40.448156 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f392b6b1-366b-4c6b-aed2-729a78f1f9bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:40.449614 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f392b6b1-366b-4c6b-aed2-729a78f1f9bd None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:40.464571 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:40.554333 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 430/885] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:23:40 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 15:23:40.559952 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f883cd8-be87-4e68-84e9-c34c27f912ed None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:40.607590 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:40.668669 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f883cd8-be87-4e68-84e9-c34c27f912ed None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:40.707616 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bbd387-32ac-4471-aef8-9814a741663f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:40.708291 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbd387-32ac-4471-aef8-9814a741663f None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:40.708571 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbd387-32ac-4471-aef8-9814a741663f None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:40.708844 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbd387-32ac-4471-aef8-9814a741663f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:40.720035 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bbd387-32ac-4471-aef8-9814a741663f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:40.721556 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bbd387-32ac-4471-aef8-9814a741663f None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:40.737237 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-18bbd387-32ac-4471-aef8-9814a741663f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:40.737237 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:40.737237 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:40.737237 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:40.737237 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:40.737237 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:40.737237 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:40.737237 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:40.737237 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:40.737237 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:40.737237 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:40.737237 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:40.737237 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:23:40.737237 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:23:40.737237 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:23:40.737237 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:23:40.739176 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:40.739176 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:40.739176 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:40.739176 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:40.739176 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:40.739176 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:40.739176 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:40.739176 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:40.739176 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:40.739176 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:40.739176 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:40.739176 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:40.739176 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:40.739176 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:40.739176 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:40.739176 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:40.739176 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:23:40.740254 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:23:40.740254 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:40.740254 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:40.740254 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 456/886] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:40.744936 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f392b6b1-366b-4c6b-aed2-729a78f1f9bd None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:40.803528 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52b53e-ec4b-4053-b6f3-04746c45e9f5 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:40.804154 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52b53e-ec4b-4053-b6f3-04746c45e9f5 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:40.804625 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52b53e-ec4b-4053-b6f3-04746c45e9f5 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:40.806394 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 457/887] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:23:40.811659 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0db1b7-ff01-4009-8fe8-7704e8ea173a None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:40.812181 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0db1b7-ff01-4009-8fe8-7704e8ea173a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:40.812674 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0db1b7-ff01-4009-8fe8-7704e8ea173a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:40.832403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-1c0db1b7-ff01-4009-8fe8-7704e8ea173a None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:40.833945 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1c0db1b7-ff01-4009-8fe8-7704e8ea173a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:40.852364 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f392b6b1-366b-4c6b-aed2-729a78f1f9bd None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:40.867370 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:40.889659 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf7d79-9b26-4beb-b95d-68817ba444db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:40.890267 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf7d79-9b26-4beb-b95d-68817ba444db None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:40.890539 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf7d79-9b26-4beb-b95d-68817ba444db None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:40.890803 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf7d79-9b26-4beb-b95d-68817ba444db None admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:40.891481 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf7d79-9b26-4beb-b95d-68817ba444db None admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:40.891779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf7d79-9b26-4beb-b95d-68817ba444db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:40.893141 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf7d79-9b26-4beb-b95d-68817ba444db None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:40.905881 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 431/888] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:23:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:40.907257 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e698a01-708a-4779-a952-7ad490cddf4b None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:40.907503 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e698a01-708a-4779-a952-7ad490cddf4b None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:40.907773 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e698a01-708a-4779-a952-7ad490cddf4b None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:40.909226 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 432/889] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:23:40.912192 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e698a01-708a-4779-a952-7ad490cddf4b None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:40.928487 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 458/890] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:40 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:23:40.930196 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4be0a-fdab-4636-9880-11d5fea27992 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:40.930568 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4be0a-fdab-4636-9880-11d5fea27992 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:40.930909 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4be0a-fdab-4636-9880-11d5fea27992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:40.955171 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-35f4be0a-fdab-4636-9880-11d5fea27992 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:40.956684 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-35f4be0a-fdab-4636-9880-11d5fea27992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:40.980607 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:41.032910 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 459/891] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:40 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:23:41.043772 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e698a01-708a-4779-a952-7ad490cddf4b None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:41.082757 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d336af-48bf-4219-ae5b-f811eb6e2ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:41.083668 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d336af-48bf-4219-ae5b-f811eb6e2ff4 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:41.084137 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d336af-48bf-4219-ae5b-f811eb6e2ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:41.084485 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d336af-48bf-4219-ae5b-f811eb6e2ff4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:41.091906 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d336af-48bf-4219-ae5b-f811eb6e2ff4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:41.093477 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d336af-48bf-4219-ae5b-f811eb6e2ff4 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:41.106220 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-16d336af-48bf-4219-ae5b-f811eb6e2ff4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:41.106220 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:41.106220 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:41.106220 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:41.106220 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:41.106220 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:41.106220 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:41.106220 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:41.106220 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:41.106220 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:41.106220 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:41.106220 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:41.106220 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:23:41.106220 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:23:41.106220 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:23:41.107150 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:23:41.107150 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:41.107150 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:41.107150 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:41.107150 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:41.107150 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:41.107150 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:41.107150 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:41.107150 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:41.107150 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:41.107150 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:41.107150 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:41.107150 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:41.107150 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:41.107150 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:41.107150 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:41.107150 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:41.108040 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:23:41.108040 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:23:41.108040 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:23:41.108040 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:23:41.108040 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:23:41.108040 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:23:41.108040 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:41.108040 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:41.108040 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 433/892] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:23:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:41.114096 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4be0a-fdab-4636-9880-11d5fea27992 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:41.218685 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d336af-48bf-4219-ae5b-f811eb6e2ff4 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:41.230595 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4be0a-fdab-4636-9880-11d5fea27992 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:41.255685 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:41.280512 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83570740-6dcf-4714-92eb-22f0a60f49df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:41.282206 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83570740-6dcf-4714-92eb-22f0a60f49df None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:41.282695 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83570740-6dcf-4714-92eb-22f0a60f49df None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:41.283466 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83570740-6dcf-4714-92eb-22f0a60f49df None admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:41.285099 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83570740-6dcf-4714-92eb-22f0a60f49df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:41.286397 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83570740-6dcf-4714-92eb-22f0a60f49df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:41.288481 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83570740-6dcf-4714-92eb-22f0a60f49df None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:41.305664 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 460/893] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 15:23:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:41.311887 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83570740-6dcf-4714-92eb-22f0a60f49df None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:41.331108 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d336af-48bf-4219-ae5b-f811eb6e2ff4 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:41.336207 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:41.368488 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283cc6b-a920-4430-bae6-98acea2b0aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:41.369119 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283cc6b-a920-4430-bae6-98acea2b0aea None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:41.369387 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283cc6b-a920-4430-bae6-98acea2b0aea None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:41.369656 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283cc6b-a920-4430-bae6-98acea2b0aea None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:41.370233 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f283cc6b-a920-4430-bae6-98acea2b0aea None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:41.371633 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f283cc6b-a920-4430-bae6-98acea2b0aea None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:41.381045 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-f283cc6b-a920-4430-bae6-98acea2b0aea None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 15:23:41.381045 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:41.381045 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:23:41.381045 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:23:41.381045 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:23:41.381045 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:23:41.381045 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:23:41.381045 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:23:41.381045 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 15:23:41.381045 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:41.381045 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:23:41.381045 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:41.381045 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:41.381045 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:41.381045 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:41.381045 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:41.381045 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:41.382083 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:41.382083 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:41.382083 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:41.382083 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:41.382083 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:41.382083 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:41.382083 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:23:41.382083 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:23:41.382083 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:23:41.382083 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:23:41.382083 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:41.382083 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:41.382083 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:41.382083 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:41.382083 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:41.382083 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:41.382935 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:41.382935 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:41.382935 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:41.382935 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:41.382935 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:41.382935 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:41.382935 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:41.382935 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:41.382935 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:41.382935 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:41.382935 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:23:41.382935 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:23:41.382935 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 15:23:41.382935 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:41.382935 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 434/894] 10.222.0.83 () {56 vars in 1126 bytes} [Mon Aug 29 15:23:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:23:41.383773 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283cc6b-a920-4430-bae6-98acea2b0aea None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:41.448046 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83570740-6dcf-4714-92eb-22f0a60f49df None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:41.486177 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9d2d3-1ea4-465f-88c3-de44f84c88c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:41.486558 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:41.486718 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9d2d3-1ea4-465f-88c3-de44f84c88c3 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:41.486959 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9d2d3-1ea4-465f-88c3-de44f84c88c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:41.487250 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9d2d3-1ea4-465f-88c3-de44f84c88c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:41.487969 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d9d2d3-1ea4-465f-88c3-de44f84c88c3 None admin] RBAC: Adding query filter params (role.id=49f4519b105b4692b68e8d28be78fe57, scope.project.id=44655977b0814a728f0fa73d442a7ee9, user.id=712a09e9d2a248309b91424dd05d2b44) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:41.488264 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d9d2d3-1ea4-465f-88c3-de44f84c88c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:41.491190 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d9d2d3-1ea4-465f-88c3-de44f84c88c3 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:41.493877 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283cc6b-a920-4430-bae6-98acea2b0aea None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:41.497190 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 461/895] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 15:23:41 2022] GET /identity/v3/role_assignments?user.id=712a09e9d2a248309b91424dd05d2b44&scope.project.id=44655977b0814a728f0fa73d442a7ee9&role.id=49f4519b105b4692b68e8d28be78fe57 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:23:41.497637 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9d2d3-1ea4-465f-88c3-de44f84c88c3 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:41.549823 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcff82b-8027-4b87-b041-5205b053b95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:41.550872 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcff82b-8027-4b87-b041-5205b053b95f None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:41.551487 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcff82b-8027-4b87-b041-5205b053b95f None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:41.552002 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcff82b-8027-4b87-b041-5205b053b95f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:41.552946 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcff82b-8027-4b87-b041-5205b053b95f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:41.554702 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcff82b-8027-4b87-b041-5205b053b95f None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:41.565763 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-7fcff82b-8027-4b87-b041-5205b053b95f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 15:23:41.565763 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:41.565763 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:23:41.565763 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:23:41.565763 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:23:41.565763 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:23:41.565763 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:23:41.565763 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:23:41.565763 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 15:23:41.565763 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:41.565763 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:23:41.565763 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:41.565763 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:41.565763 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:41.565763 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:41.565763 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:41.565763 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:41.566963 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:41.566963 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:41.566963 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:41.566963 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:41.566963 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:41.566963 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:41.566963 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:23:41.566963 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:23:41.566963 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:23:41.566963 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:23:41.566963 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:41.566963 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:41.566963 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:41.566963 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:41.566963 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:41.566963 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:41.568399 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:41.568399 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:41.568399 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:41.568399 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:41.568399 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:41.568399 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:41.568399 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:41.568399 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:41.568399 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:41.568399 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:41.568399 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:23:41.568399 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:23:41.568399 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 15:23:41.568399 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:41.571797 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 435/896] 10.222.0.83 () {56 vars in 1114 bytes} [Mon Aug 29 15:23:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:41.579475 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcff82b-8027-4b87-b041-5205b053b95f None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:41.598169 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:41.622671 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9d2d3-1ea4-465f-88c3-de44f84c88c3 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:41.666509 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47862f52-0465-4537-863b-b954476353bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:41.667564 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47862f52-0465-4537-863b-b954476353bc None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:41.668054 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47862f52-0465-4537-863b-b954476353bc None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:41.668514 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47862f52-0465-4537-863b-b954476353bc None admin] PATH_INFO: `/v3/services` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:41.669452 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47862f52-0465-4537-863b-b954476353bc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:41.669957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47862f52-0465-4537-863b-b954476353bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:41.671635 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47862f52-0465-4537-863b-b954476353bc None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:41.677877 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 462/897] 10.222.0.83 () {56 vars in 1122 bytes} [Mon Aug 29 15:23:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:41.688189 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47862f52-0465-4537-863b-b954476353bc None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:41.710200 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcff82b-8027-4b87-b041-5205b053b95f None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:41.760723 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7549539-5ead-4464-b83c-764f43d0cec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:41.761338 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7549539-5ead-4464-b83c-764f43d0cec5 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:41.761573 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7549539-5ead-4464-b83c-764f43d0cec5 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:41.761783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7549539-5ead-4464-b83c-764f43d0cec5 None admin] PATH_INFO: `/v3/services` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:41.762572 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7549539-5ead-4464-b83c-764f43d0cec5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:41.762884 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7549539-5ead-4464-b83c-764f43d0cec5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:41.764971 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7549539-5ead-4464-b83c-764f43d0cec5 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:41.770380 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 436/898] 10.222.0.83 () {56 vars in 1114 bytes} [Mon Aug 29 15:23:41 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:41.776131 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7549539-5ead-4464-b83c-764f43d0cec5 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:41.809439 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:41.819353 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47862f52-0465-4537-863b-b954476353bc None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:41.858419 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a790ab-f14e-4234-821e-a6e8610bc813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:41.859900 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a790ab-f14e-4234-821e-a6e8610bc813 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:41.860516 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a790ab-f14e-4234-821e-a6e8610bc813 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:41.861065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a790ab-f14e-4234-821e-a6e8610bc813 None admin] PATH_INFO: `/v3/services` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:41.861908 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a790ab-f14e-4234-821e-a6e8610bc813 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:41.862652 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a790ab-f14e-4234-821e-a6e8610bc813 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:41.866247 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a790ab-f14e-4234-821e-a6e8610bc813 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:41.872338 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 463/899] 10.222.0.83 () {56 vars in 1122 bytes} [Mon Aug 29 15:23:41 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:41.873432 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748400bd-d36c-4e9a-994f-14e601baa8ba None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:41.873806 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748400bd-d36c-4e9a-994f-14e601baa8ba None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:41.873989 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748400bd-d36c-4e9a-994f-14e601baa8ba None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:41.875498 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 464/900] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:23:41.882817 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b1dab-6527-4ea8-95e9-ee475012a2a6 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:41.883210 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b1dab-6527-4ea8-95e9-ee475012a2a6 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:41.883380 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b1dab-6527-4ea8-95e9-ee475012a2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:41.906938 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7549539-5ead-4464-b83c-764f43d0cec5 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:41.908390 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-676b1dab-6527-4ea8-95e9-ee475012a2a6 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:41.909885 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-676b1dab-6527-4ea8-95e9-ee475012a2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:41.914070 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:41.962873 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c2c40a-318e-43ad-85b8-24714780cb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:41.963921 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c2c40a-318e-43ad-85b8-24714780cb21 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:41.964515 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c2c40a-318e-43ad-85b8-24714780cb21 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:41.964998 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c2c40a-318e-43ad-85b8-24714780cb21 None admin] PATH_INFO: `/v3/services` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:41.966105 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c2c40a-318e-43ad-85b8-24714780cb21 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:41.966617 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c2c40a-318e-43ad-85b8-24714780cb21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:41.969036 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c2c40a-318e-43ad-85b8-24714780cb21 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:41.977632 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 437/901] 10.222.0.83 () {56 vars in 1114 bytes} [Mon Aug 29 15:23:41 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:23:41.983096 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c2c40a-318e-43ad-85b8-24714780cb21 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:42.009970 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 465/902] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:41 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 15:23:42.095526 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:42.102434 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c2c40a-318e-43ad-85b8-24714780cb21 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:42.138496 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f2dddd-0e8e-4b61-9d7a-2af9cfc47310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:42.139142 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2dddd-0e8e-4b61-9d7a-2af9cfc47310 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:42.139425 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2dddd-0e8e-4b61-9d7a-2af9cfc47310 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:42.139702 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2dddd-0e8e-4b61-9d7a-2af9cfc47310 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:42.140409 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f2dddd-0e8e-4b61-9d7a-2af9cfc47310 None admin] RBAC: Adding query filter params (interface=public, service_id=1f34084dd3d946148397c09710f357d3, region_id=RegionOne) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:42.140716 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f2dddd-0e8e-4b61-9d7a-2af9cfc47310 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:42.142092 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f2dddd-0e8e-4b61-9d7a-2af9cfc47310 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:42.148353 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 438/903] 10.222.0.83 () {56 vars in 1251 bytes} [Mon Aug 29 15:23:41 2022] GET /identity/v3/endpoints?service_id=1f34084dd3d946148397c09710f357d3&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:42.154860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b1dab-6527-4ea8-95e9-ee475012a2a6 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:42.266677 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b1dab-6527-4ea8-95e9-ee475012a2a6 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:42.304348 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ac802-f79f-4a37-8135-bded17872fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:42.305264 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ac802-f79f-4a37-8135-bded17872fcd None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:42.305727 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ac802-f79f-4a37-8135-bded17872fcd None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:42.306181 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ac802-f79f-4a37-8135-bded17872fcd None admin] PATH_INFO: `/v3/services` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:42.307001 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9ac802-f79f-4a37-8135-bded17872fcd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:42.308641 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9ac802-f79f-4a37-8135-bded17872fcd None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:42.319156 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 466/904] 10.222.0.83 () {56 vars in 1087 bytes} [Mon Aug 29 15:23:42 2022] GET /identity/v3/services => generated 1268 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:23:42.323983 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f2dddd-0e8e-4b61-9d7a-2af9cfc47310 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:42.438339 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f2dddd-0e8e-4b61-9d7a-2af9cfc47310 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:42.480254 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e937d-5eb0-4b71-ba35-a3f223ee3eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:42.480903 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e937d-5eb0-4b71-ba35-a3f223ee3eb4 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:42.481177 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e937d-5eb0-4b71-ba35-a3f223ee3eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:42.481511 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e937d-5eb0-4b71-ba35-a3f223ee3eb4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:42.482110 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9e937d-5eb0-4b71-ba35-a3f223ee3eb4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:42.483514 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9e937d-5eb0-4b71-ba35-a3f223ee3eb4 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:42.494037 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-6b9e937d-5eb0-4b71-ba35-a3f223ee3eb4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 15:23:42.494037 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:42.494037 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:23:42.494037 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:23:42.494037 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:23:42.494037 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:23:42.494037 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:23:42.494037 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:23:42.494037 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 15:23:42.494037 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:42.494037 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:23:42.494037 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:42.494037 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:42.494037 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:42.494037 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:42.494037 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:42.494971 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:42.494971 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:42.494971 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:42.494971 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:42.494971 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:42.494971 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:42.494971 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:42.494971 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:23:42.494971 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:23:42.494971 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:23:42.494971 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:23:42.494971 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:42.494971 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:42.494971 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:42.494971 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:42.494971 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:42.494971 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:42.495885 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:42.495885 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:42.495885 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:42.495885 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:42.495885 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:42.495885 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:42.495885 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:42.495885 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:42.495885 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:42.495885 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:42.495885 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:23:42.495885 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:23:42.495885 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 15:23:42.495885 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:42.499105 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 439/905] 10.222.0.83 () {56 vars in 1132 bytes} [Mon Aug 29 15:23:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:42.501452 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ac802-f79f-4a37-8135-bded17872fcd None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:42.504582 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:42.616742 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ac802-f79f-4a37-8135-bded17872fcd None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:42.653178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8697d-6d24-4fa5-940d-3d7bae03018d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:42.654255 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8697d-6d24-4fa5-940d-3d7bae03018d None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:42.654760 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8697d-6d24-4fa5-940d-3d7bae03018d None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:42.655260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8697d-6d24-4fa5-940d-3d7bae03018d None admin] PATH_INFO: `/v3/services` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:42.656206 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e8697d-6d24-4fa5-940d-3d7bae03018d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:42.656741 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e8697d-6d24-4fa5-940d-3d7bae03018d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:42.658461 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e8697d-6d24-4fa5-940d-3d7bae03018d None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:42.669546 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 467/906] 10.222.0.83 () {56 vars in 1126 bytes} [Mon Aug 29 15:23:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:23:42.671165 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e937d-5eb0-4b71-ba35-a3f223ee3eb4 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:42.695550 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:42.784703 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e937d-5eb0-4b71-ba35-a3f223ee3eb4 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:42.835713 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab92b50-106a-40b9-8403-fd37cb848e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:42.836702 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab92b50-106a-40b9-8403-fd37cb848e7c None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:42.837191 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab92b50-106a-40b9-8403-fd37cb848e7c None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:42.837659 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab92b50-106a-40b9-8403-fd37cb848e7c None admin] PATH_INFO: `/v3/services` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:42.838490 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab92b50-106a-40b9-8403-fd37cb848e7c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:42.839077 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab92b50-106a-40b9-8403-fd37cb848e7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:42.840750 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab92b50-106a-40b9-8403-fd37cb848e7c None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:42.851511 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 440/907] 10.222.0.83 () {56 vars in 1126 bytes} [Mon Aug 29 15:23:42 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:42.854442 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8697d-6d24-4fa5-940d-3d7bae03018d None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:42.924174 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:42.962380 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8697d-6d24-4fa5-940d-3d7bae03018d None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:42.998139 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e57be-f20d-4d4f-899e-65d4adc81df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:42.998798 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e57be-f20d-4d4f-899e-65d4adc81df9 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:42.999102 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e57be-f20d-4d4f-899e-65d4adc81df9 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:42.999372 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e57be-f20d-4d4f-899e-65d4adc81df9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:43.000099 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e57be-f20d-4d4f-899e-65d4adc81df9 None admin] RBAC: Adding query filter params (interface=public, service_id=edc3a17798fa49649b90c18a914c7c7a, region_id=RegionOne) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:43.000402 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e57be-f20d-4d4f-899e-65d4adc81df9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:43.001843 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e57be-f20d-4d4f-899e-65d4adc81df9 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:43.008353 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 468/908] 10.222.0.83 () {56 vars in 1251 bytes} [Mon Aug 29 15:23:42 2022] GET /identity/v3/endpoints?service_id=edc3a17798fa49649b90c18a914c7c7a&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:43.014082 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab92b50-106a-40b9-8403-fd37cb848e7c None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:43.104608 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:43.124783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab92b50-106a-40b9-8403-fd37cb848e7c None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:43.161357 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365f4a4-a73e-42e0-a888-950b3d82df9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:43.161967 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365f4a4-a73e-42e0-a888-950b3d82df9a None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:43.162247 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365f4a4-a73e-42e0-a888-950b3d82df9a None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:43.162537 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365f4a4-a73e-42e0-a888-950b3d82df9a None admin] PATH_INFO: `/v3/services` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:43.163191 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5365f4a4-a73e-42e0-a888-950b3d82df9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:43.164776 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5365f4a4-a73e-42e0-a888-950b3d82df9a None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:43.175175 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 441/909] 10.222.0.83 () {56 vars in 1087 bytes} [Mon Aug 29 15:23:43 2022] GET /identity/v3/services => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:23:43.521079 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8740e1-a96b-428a-8432-9fc25b768416 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:43.521622 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8740e1-a96b-428a-8432-9fc25b768416 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:43.521622 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8740e1-a96b-428a-8432-9fc25b768416 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:43.523239 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 469/910] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:23:43.528842 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83230d43-60a5-4295-bacc-0ada23e7906a None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:43.529183 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83230d43-60a5-4295-bacc-0ada23e7906a None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:43.529425 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83230d43-60a5-4295-bacc-0ada23e7906a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:43.551920 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-83230d43-60a5-4295-bacc-0ada23e7906a None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:43.553597 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-83230d43-60a5-4295-bacc-0ada23e7906a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:43.629909 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 442/911] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:43 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 15:23:43.902295 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8740e1-a96b-428a-8432-9fc25b768416 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:43.918551 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc39bb9-2c91-4c16-b4e9-042727d3c1cc None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:43.919099 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc39bb9-2c91-4c16-b4e9-042727d3c1cc None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:43.919296 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc39bb9-2c91-4c16-b4e9-042727d3c1cc None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:43.921054 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 443/912] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:23:43.926314 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db755f95-bedb-437e-b42f-2a9b5ad2d663 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:43.926671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db755f95-bedb-437e-b42f-2a9b5ad2d663 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:43.927105 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db755f95-bedb-437e-b42f-2a9b5ad2d663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:43.948932 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-db755f95-bedb-437e-b42f-2a9b5ad2d663 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:43.950269 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-db755f95-bedb-437e-b42f-2a9b5ad2d663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:44.020381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8740e1-a96b-428a-8432-9fc25b768416 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:44.035049 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 444/913] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:43 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:23:44.055984 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:44.060939 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2744dd8-b3a8-4773-98eb-a5318646bc83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:44.061587 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2744dd8-b3a8-4773-98eb-a5318646bc83 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:44.061858 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2744dd8-b3a8-4773-98eb-a5318646bc83 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:44.062523 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2744dd8-b3a8-4773-98eb-a5318646bc83 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:44.074604 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2744dd8-b3a8-4773-98eb-a5318646bc83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:23:44.079833 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-c2744dd8-b3a8-4773-98eb-a5318646bc83 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 15:23:44.079833 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:44.079833 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:44.079833 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:44.079833 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:44.079833 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:44.079833 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:44.079833 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:44.079833 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:44.079833 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:44.079833 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:44.079833 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:44.079833 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:23:44.079833 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:23:44.079833 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:23:44.079833 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:23:44.080798 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:23:44.080798 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:23:44.080798 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:23:44.080798 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:23:44.080798 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:44.080798 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:44.080798 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:44.080798 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:44.080798 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:44.080798 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:44.080798 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:44.080798 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:44.080798 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:44.080798 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:44.080798 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:44.080798 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:44.081689 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:44.081689 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:44.081689 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:44.081689 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:44.081689 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:23:44.081689 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:23:44.081689 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:23:44.081689 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:23:44.081689 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:23:44.081689 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:23:44.081689 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 15:23:44.081689 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:44.081689 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 470/914] 10.222.0.83 () {56 vars in 1120 bytes} [Mon Aug 29 15:23:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:23:44.087737 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db755f95-bedb-437e-b42f-2a9b5ad2d663 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:44.092709 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:44.202045 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db755f95-bedb-437e-b42f-2a9b5ad2d663 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:44.239231 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef51361-ca22-429a-aef6-cd98b45bc5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:44.240304 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef51361-ca22-429a-aef6-cd98b45bc5e9 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:44.240798 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef51361-ca22-429a-aef6-cd98b45bc5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:44.241275 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef51361-ca22-429a-aef6-cd98b45bc5e9 None admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:44.242152 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef51361-ca22-429a-aef6-cd98b45bc5e9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:44.242659 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef51361-ca22-429a-aef6-cd98b45bc5e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:44.244858 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef51361-ca22-429a-aef6-cd98b45bc5e9 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:44.254023 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 445/915] 10.222.0.83 () {56 vars in 1115 bytes} [Mon Aug 29 15:23:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:23:44.259983 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2744dd8-b3a8-4773-98eb-a5318646bc83 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:44.342048 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef51361-ca22-429a-aef6-cd98b45bc5e9 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:44.369861 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2744dd8-b3a8-4773-98eb-a5318646bc83 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:44.404913 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6aa22b-6ec9-4938-8c00-9273e2d926ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:44.405591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6aa22b-6ec9-4938-8c00-9273e2d926ad None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:44.405867 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6aa22b-6ec9-4938-8c00-9273e2d926ad None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:44.406153 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6aa22b-6ec9-4938-8c00-9273e2d926ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:44.417825 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6aa22b-6ec9-4938-8c00-9273e2d926ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:44.418233 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:44.419315 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6aa22b-6ec9-4938-8c00-9273e2d926ad None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:44.435353 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-9f6aa22b-6ec9-4938-8c00-9273e2d926ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:44.435353 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:44.435353 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:44.435353 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:44.435353 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:44.435353 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:44.435353 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:44.435353 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:44.435353 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:44.435353 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:44.435353 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:44.435353 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:44.435353 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:23:44.435353 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:23:44.435353 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:23:44.435353 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:23:44.436349 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:44.436349 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:44.436349 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:44.436349 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:44.436349 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:44.436349 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:44.436349 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:44.436349 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:44.436349 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:44.436349 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:44.436349 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:44.436349 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:44.436349 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:44.436349 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:44.436349 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:44.436349 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:44.436349 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:23:44.437252 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:23:44.437252 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:44.437252 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:44.441662 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 471/916] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:44.442221 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6aa22b-6ec9-4938-8c00-9273e2d926ad None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:44.461264 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef51361-ca22-429a-aef6-cd98b45bc5e9 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:44.490272 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:44.499372 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701965a-ef00-40e8-bc06-d5c7f92eb408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:44.500269 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701965a-ef00-40e8-bc06-d5c7f92eb408 None admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:44.500681 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701965a-ef00-40e8-bc06-d5c7f92eb408 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:44.501618 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701965a-ef00-40e8-bc06-d5c7f92eb408 None admin] PATH_INFO: `/v3/services` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:44.503011 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f701965a-ef00-40e8-bc06-d5c7f92eb408 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:44.506152 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f701965a-ef00-40e8-bc06-d5c7f92eb408 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:44.527589 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 446/917] 10.222.0.83 () {60 vars in 1141 bytes} [Mon Aug 29 15:23:44 2022] POST /identity/v3/services => generated 241 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:23:44.528817 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc755b-2091-438c-896a-527017a2dfd8 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:44.529265 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc755b-2091-438c-896a-527017a2dfd8 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:44.529536 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc755b-2091-438c-896a-527017a2dfd8 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:44.530831 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 447/918] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:23:44.536439 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1d268-7db8-44f0-ad50-4429d3000a07 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:44.536910 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1d268-7db8-44f0-ad50-4429d3000a07 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:44.537366 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1d268-7db8-44f0-ad50-4429d3000a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:44.557050 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-e7e1d268-7db8-44f0-ad50-4429d3000a07 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:44.558624 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e7e1d268-7db8-44f0-ad50-4429d3000a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:44.568805 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6aa22b-6ec9-4938-8c00-9273e2d926ad None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:44.618850 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682a112-7d15-4faf-9583-082606c3521b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:44.620317 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682a112-7d15-4faf-9583-082606c3521b None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:44.620773 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682a112-7d15-4faf-9583-082606c3521b None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:44.621201 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682a112-7d15-4faf-9583-082606c3521b None admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:44.622115 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0682a112-7d15-4faf-9583-082606c3521b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:44.622568 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0682a112-7d15-4faf-9583-082606c3521b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:44.624231 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0682a112-7d15-4faf-9583-082606c3521b None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:44.644755 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 472/919] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:23:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:44.646142 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682a112-7d15-4faf-9583-082606c3521b None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:44.647183 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 448/920] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 15:23:44.764501 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:44.768985 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682a112-7d15-4faf-9583-082606c3521b None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:44.805485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb07e7c-5381-44ec-955c-d8979971aac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:44.806650 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb07e7c-5381-44ec-955c-d8979971aac8 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:44.807220 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb07e7c-5381-44ec-955c-d8979971aac8 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:44.807838 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb07e7c-5381-44ec-955c-d8979971aac8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:44.815493 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb07e7c-5381-44ec-955c-d8979971aac8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:44.817259 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb07e7c-5381-44ec-955c-d8979971aac8 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:44.836942 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-7fb07e7c-5381-44ec-955c-d8979971aac8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 15:23:44.836942 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:44.836942 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:44.836942 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:44.836942 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:44.836942 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:44.836942 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:44.836942 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:44.836942 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:44.836942 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:44.836942 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:44.836942 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:44.836942 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:23:44.836942 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:23:44.836942 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:23:44.836942 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:23:44.838534 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:44.838534 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:44.838534 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:23:44.838534 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:23:44.838534 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:23:44.838534 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:23:44.838534 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:44.838534 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:44.838534 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:44.838534 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:44.838534 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:44.838534 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:44.838534 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:44.838534 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:44.838534 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:44.838534 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:44.838534 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:44.838534 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:44.839608 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:44.839608 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:44.839608 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:23:44.839608 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:23:44.839608 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:23:44.839608 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:23:44.839608 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:23:44.839608 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:23:44.839608 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 15:23:44.839608 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:44.842032 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 473/921] 10.222.0.83 () {56 vars in 1117 bytes} [Mon Aug 29 15:23:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:44.848345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1d268-7db8-44f0-ad50-4429d3000a07 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:44.908240 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:44.947275 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb07e7c-5381-44ec-955c-d8979971aac8 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:44.960559 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1d268-7db8-44f0-ad50-4429d3000a07 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:45.001245 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ddef9b-3a3f-4451-9f45-6a43a55cff3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:45.001956 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ddef9b-3a3f-4451-9f45-6a43a55cff3b None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:45.002236 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ddef9b-3a3f-4451-9f45-6a43a55cff3b None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:45.002507 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ddef9b-3a3f-4451-9f45-6a43a55cff3b None admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:45.003269 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ddef9b-3a3f-4451-9f45-6a43a55cff3b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:45.003577 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ddef9b-3a3f-4451-9f45-6a43a55cff3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:45.005191 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ddef9b-3a3f-4451-9f45-6a43a55cff3b None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:45.029911 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 449/922] 10.222.0.83 () {56 vars in 1149 bytes} [Mon Aug 29 15:23:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:45.035449 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ddef9b-3a3f-4451-9f45-6a43a55cff3b None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:45.055265 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb07e7c-5381-44ec-955c-d8979971aac8 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:45.094498 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfdcbfd-4e05-4f97-81f1-fca5e3ee7565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:45.095215 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfdcbfd-4e05-4f97-81f1-fca5e3ee7565 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:45.095504 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfdcbfd-4e05-4f97-81f1-fca5e3ee7565 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:45.096031 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfdcbfd-4e05-4f97-81f1-fca5e3ee7565 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:45.096729 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfdcbfd-4e05-4f97-81f1-fca5e3ee7565 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:45.098119 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfdcbfd-4e05-4f97-81f1-fca5e3ee7565 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:45.108560 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-9dfdcbfd-4e05-4f97-81f1-fca5e3ee7565 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 15:23:45.108560 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:45.108560 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:23:45.108560 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:23:45.108560 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:23:45.108560 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:23:45.108560 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:23:45.108560 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:23:45.108560 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 15:23:45.108560 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:45.108560 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:23:45.108560 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:45.108560 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:45.108560 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:45.108560 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:45.108560 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:45.108560 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:45.111088 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:45.111088 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:45.111088 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:45.111088 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:45.111088 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:45.111088 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:45.111088 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:23:45.111088 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:23:45.111088 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:23:45.111088 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:23:45.111088 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:45.111088 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:45.111088 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:45.111088 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:45.111088 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:45.111088 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:45.113084 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:45.113084 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:45.113084 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:45.113084 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:45.113084 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:45.113084 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:45.113084 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:45.113084 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:45.113084 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:45.113084 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:45.113084 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:23:45.113084 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:23:45.113084 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 15:23:45.113084 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:45.113084 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 474/923] 10.222.0.83 () {56 vars in 1114 bytes} [Mon Aug 29 15:23:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:23:45.116050 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfdcbfd-4e05-4f97-81f1-fca5e3ee7565 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:45.148304 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ddef9b-3a3f-4451-9f45-6a43a55cff3b None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:45.151830 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:45.168008 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:45.195786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e6c93-710d-4627-8b56-4a5e36c79c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:45.196731 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e6c93-710d-4627-8b56-4a5e36c79c22 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:45.197414 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e6c93-710d-4627-8b56-4a5e36c79c22 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:45.197889 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e6c93-710d-4627-8b56-4a5e36c79c22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:45.208751 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e6c93-710d-4627-8b56-4a5e36c79c22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:45.210201 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e6c93-710d-4627-8b56-4a5e36c79c22 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:45.225126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-924e6c93-710d-4627-8b56-4a5e36c79c22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:45.225126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:45.225126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:45.225126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:45.225126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:45.225126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:45.225126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:45.225126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:45.225126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:45.225126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:45.225126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:45.225126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:45.225126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:23:45.225126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:23:45.225126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:23:45.225126 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:23:45.226276 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:45.226276 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:45.226276 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:45.226276 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:45.226276 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:45.226276 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:45.226276 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:45.226276 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:45.226276 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:45.226276 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:45.226276 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:45.226276 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:45.226276 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:45.226276 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:45.226276 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:45.226276 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:45.226276 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:23:45.227406 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:23:45.227406 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:45.227406 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:45.231184 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 450/924] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:23:45.233480 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a3053-2be6-41ec-8a96-5c4d846fce0c None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:45.233968 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a3053-2be6-41ec-8a96-5c4d846fce0c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:45.234510 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a3053-2be6-41ec-8a96-5c4d846fce0c None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:45.235847 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 451/925] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:23:45.236534 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a3053-2be6-41ec-8a96-5c4d846fce0c None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:45.243015 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfdcbfd-4e05-4f97-81f1-fca5e3ee7565 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:45.280906 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4780c7d-d629-4e21-bcde-180017d7f15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:45.281443 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4780c7d-d629-4e21-bcde-180017d7f15f None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:45.281726 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4780c7d-d629-4e21-bcde-180017d7f15f None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:45.281999 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4780c7d-d629-4e21-bcde-180017d7f15f None admin] PATH_INFO: `/v3/services` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:45.282641 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4780c7d-d629-4e21-bcde-180017d7f15f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:45.282944 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4780c7d-d629-4e21-bcde-180017d7f15f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:45.284377 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4780c7d-d629-4e21-bcde-180017d7f15f None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:45.294968 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 475/926] 10.222.0.83 () {56 vars in 1114 bytes} [Mon Aug 29 15:23:45 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:45.296052 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5aa2d-4929-4014-9433-4e9ca6c7e181 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:45.296336 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5aa2d-4929-4014-9433-4e9ca6c7e181 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:45.296603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5aa2d-4929-4014-9433-4e9ca6c7e181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:45.315759 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-edf5aa2d-4929-4014-9433-4e9ca6c7e181 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:45.316940 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-edf5aa2d-4929-4014-9433-4e9ca6c7e181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:45.357301 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a3053-2be6-41ec-8a96-5c4d846fce0c None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:45.388494 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 476/927] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:23:45.389656 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5aa2d-4929-4014-9433-4e9ca6c7e181 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:45.403360 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9878252a-7b8d-4587-8057-c64760898034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:45.404335 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878252a-7b8d-4587-8057-c64760898034 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:45.404861 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878252a-7b8d-4587-8057-c64760898034 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:45.405476 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878252a-7b8d-4587-8057-c64760898034 None admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:45.406349 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9878252a-7b8d-4587-8057-c64760898034 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:45.406872 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9878252a-7b8d-4587-8057-c64760898034 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:45.408757 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9878252a-7b8d-4587-8057-c64760898034 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:45.411172 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:45.424561 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 452/928] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:23:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:45.429609 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9878252a-7b8d-4587-8057-c64760898034 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:45.476105 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:45.510414 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5aa2d-4929-4014-9433-4e9ca6c7e181 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:45.552377 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f78617-190e-4036-a07b-396eca84cfc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:45.552798 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f78617-190e-4036-a07b-396eca84cfc1 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:45.553075 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f78617-190e-4036-a07b-396eca84cfc1 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:45.553341 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f78617-190e-4036-a07b-396eca84cfc1 None admin] PATH_INFO: `/v3/services` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:45.553974 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f78617-190e-4036-a07b-396eca84cfc1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:45.554344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f78617-190e-4036-a07b-396eca84cfc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:45.555690 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f78617-190e-4036-a07b-396eca84cfc1 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:45.565205 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 477/929] 10.222.0.83 () {56 vars in 1114 bytes} [Mon Aug 29 15:23:45 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:45.566325 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f78617-190e-4036-a07b-396eca84cfc1 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:45.583864 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9878252a-7b8d-4587-8057-c64760898034 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:45.622923 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a13b6-d618-4c0b-8635-0630a9095cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:45.623596 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a13b6-d618-4c0b-8635-0630a9095cf3 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:45.623866 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a13b6-d618-4c0b-8635-0630a9095cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:45.624128 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a13b6-d618-4c0b-8635-0630a9095cf3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:45.632566 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8a13b6-d618-4c0b-8635-0630a9095cf3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:45.634456 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8a13b6-d618-4c0b-8635-0630a9095cf3 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:45.648749 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-fb8a13b6-d618-4c0b-8635-0630a9095cf3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:45.648749 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:45.648749 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:45.648749 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:45.648749 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:45.648749 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:45.648749 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:45.648749 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:45.648749 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:45.648749 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:45.648749 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:45.648749 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:45.648749 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:23:45.648749 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:23:45.648749 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:23:45.649714 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:23:45.649714 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:45.649714 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:45.649714 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:45.649714 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:45.649714 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:45.649714 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:45.649714 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:45.649714 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:45.649714 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:45.649714 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:45.649714 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:45.649714 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:45.649714 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:45.649714 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:45.649714 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:45.649714 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:45.650633 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:23:45.650633 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:23:45.650633 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:23:45.650633 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:23:45.650633 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:23:45.650633 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:23:45.650633 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:45.650633 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:45.655572 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 453/930] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:23:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:23:45.656454 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a13b6-d618-4c0b-8635-0630a9095cf3 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:45.679336 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:45.705251 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f78617-190e-4036-a07b-396eca84cfc1 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:45.749633 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75574ee-c684-4e46-8aa4-28e83cc4f7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:45.750643 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75574ee-c684-4e46-8aa4-28e83cc4f7ea None admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:45.751124 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75574ee-c684-4e46-8aa4-28e83cc4f7ea None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:45.751558 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75574ee-c684-4e46-8aa4-28e83cc4f7ea None admin] PATH_INFO: `/v3/endpoints` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:45.752390 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75574ee-c684-4e46-8aa4-28e83cc4f7ea None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:45.753909 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75574ee-c684-4e46-8aa4-28e83cc4f7ea None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:45.754549 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:45.771488 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a13b6-d618-4c0b-8635-0630a9095cf3 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:45.777759 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 478/931] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:23:45 2022] POST /identity/v3/endpoints => generated 346 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:23:45.778584 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75574ee-c684-4e46-8aa4-28e83cc4f7ea None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:45.827519 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7d1a5-8adf-4a0c-bf48-ce4a9e652a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:45.827858 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7d1a5-8adf-4a0c-bf48-ce4a9e652a8f None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:45.828160 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7d1a5-8adf-4a0c-bf48-ce4a9e652a8f None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:45.828435 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7d1a5-8adf-4a0c-bf48-ce4a9e652a8f None admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:45.829129 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7d1a5-8adf-4a0c-bf48-ce4a9e652a8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:45.829439 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7d1a5-8adf-4a0c-bf48-ce4a9e652a8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:45.830978 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7d1a5-8adf-4a0c-bf48-ce4a9e652a8f None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:45.851542 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 454/932] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 15:23:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:45.852545 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7d1a5-8adf-4a0c-bf48-ce4a9e652a8f None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:45.919364 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75574ee-c684-4e46-8aa4-28e83cc4f7ea None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:45.961975 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52efc0-dc5f-4057-b314-ab6496e71c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:45.962620 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52efc0-dc5f-4057-b314-ab6496e71c6a None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:45.962904 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52efc0-dc5f-4057-b314-ab6496e71c6a None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:45.963287 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52efc0-dc5f-4057-b314-ab6496e71c6a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:45.964625 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52efc0-dc5f-4057-b314-ab6496e71c6a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:45.966214 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52efc0-dc5f-4057-b314-ab6496e71c6a None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:45.970351 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:45.981191 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-7d52efc0-dc5f-4057-b314-ab6496e71c6a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 15:23:45.981191 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:45.981191 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:23:45.981191 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:23:45.981191 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:23:45.981191 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:23:45.981191 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:23:45.981191 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:23:45.981191 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 15:23:45.981191 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:45.981191 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:23:45.981191 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:45.981191 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:45.981191 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:45.981191 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:45.981191 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:45.982173 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:45.982173 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:45.982173 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:45.982173 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:45.982173 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:45.982173 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:45.982173 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:45.982173 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:23:45.982173 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:23:45.982173 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:23:45.982173 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:23:45.982173 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:45.982173 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:45.982173 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:45.982173 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:45.982173 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:45.982173 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:45.983094 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:45.983094 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:45.983094 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:45.983094 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:45.983094 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:45.983094 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:45.983094 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:45.983094 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:45.983094 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:45.983094 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:45.983094 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:23:45.983094 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:23:45.983094 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 15:23:45.983094 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:45.983094 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 479/933] 10.222.0.83 () {56 vars in 1132 bytes} [Mon Aug 29 15:23:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:45.989691 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52efc0-dc5f-4057-b314-ab6496e71c6a None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:46.001608 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7d1a5-8adf-4a0c-bf48-ce4a9e652a8f None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:46.054452 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f67742-0f9a-480c-933a-3edd2f917313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:46.055798 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f67742-0f9a-480c-933a-3edd2f917313 None admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:46.056743 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f67742-0f9a-480c-933a-3edd2f917313 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:46.057360 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f67742-0f9a-480c-933a-3edd2f917313 None admin] PATH_INFO: `/v3/projects/44655977b0814a728f0fa73d442a7ee9/users/712a09e9d2a248309b91424dd05d2b44/roles/49f4519b105b4692b68e8d28be78fe57` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:46.060773 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f67742-0f9a-480c-933a-3edd2f917313 None admin] RBAC: Authorizing `identity:create_grant(project_id=44655977b0814a728f0fa73d442a7ee9, user_id=712a09e9d2a248309b91424dd05d2b44, role_id=49f4519b105b4692b68e8d28be78fe57)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:46.062485 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f67742-0f9a-480c-933a-3edd2f917313 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:46.083478 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 455/934] 10.222.0.83 () {58 vars in 1439 bytes} [Mon Aug 29 15:23:45 2022] PUT /identity/v3/projects/44655977b0814a728f0fa73d442a7ee9/users/712a09e9d2a248309b91424dd05d2b44/roles/49f4519b105b4692b68e8d28be78fe57 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:23:46.132517 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52efc0-dc5f-4057-b314-ab6496e71c6a None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:46.174848 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a855ac-0027-4b6f-806d-aff26289724f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:46.175510 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a855ac-0027-4b6f-806d-aff26289724f None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:46.175794 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a855ac-0027-4b6f-806d-aff26289724f None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:46.176191 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a855ac-0027-4b6f-806d-aff26289724f None admin] PATH_INFO: `/v3/services` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:46.176858 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a855ac-0027-4b6f-806d-aff26289724f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:46.177164 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a855ac-0027-4b6f-806d-aff26289724f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:46.178578 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a855ac-0027-4b6f-806d-aff26289724f None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:46.185504 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 480/935] 10.222.0.83 () {56 vars in 1126 bytes} [Mon Aug 29 15:23:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:23:46.192511 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f67742-0f9a-480c-933a-3edd2f917313 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:46.203421 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:46.322906 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f67742-0f9a-480c-933a-3edd2f917313 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:46.361045 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f8c3c-8a57-4b92-a22c-866796c64638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:46.361580 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f8c3c-8a57-4b92-a22c-866796c64638 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:46.361855 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f8c3c-8a57-4b92-a22c-866796c64638 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:46.362121 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f8c3c-8a57-4b92-a22c-866796c64638 None admin] PATH_INFO: `/v3/services` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:46.362757 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f8c3c-8a57-4b92-a22c-866796c64638 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:46.363133 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f8c3c-8a57-4b92-a22c-866796c64638 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:46.364505 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f8c3c-8a57-4b92-a22c-866796c64638 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:46.370090 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 456/936] 10.222.0.83 () {56 vars in 1126 bytes} [Mon Aug 29 15:23:46 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:46.375862 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a855ac-0027-4b6f-806d-aff26289724f None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:46.441545 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:46.482235 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a855ac-0027-4b6f-806d-aff26289724f None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:46.518347 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621eff1b-a16a-424e-91a5-965506a3744e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:46.518967 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621eff1b-a16a-424e-91a5-965506a3744e None admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:46.519282 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621eff1b-a16a-424e-91a5-965506a3744e None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:46.519556 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621eff1b-a16a-424e-91a5-965506a3744e None admin] PATH_INFO: `/v3/endpoints` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:46.520301 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621eff1b-a16a-424e-91a5-965506a3744e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:46.521678 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621eff1b-a16a-424e-91a5-965506a3744e None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:46.545459 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 481/937] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:23:46 2022] POST /identity/v3/endpoints => generated 347 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:23:46.608900 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072db5c0-e826-4d3e-9465-8b556b140ec9 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:46.609553 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072db5c0-e826-4d3e-9465-8b556b140ec9 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:46.610101 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072db5c0-e826-4d3e-9465-8b556b140ec9 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:46.612152 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 457/938] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:23:46.617503 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fd43b-8f0d-4ba4-856f-02053b5c469f None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:46.617797 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fd43b-8f0d-4ba4-856f-02053b5c469f None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:46.618119 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fd43b-8f0d-4ba4-856f-02053b5c469f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:46.638878 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-721fd43b-8f0d-4ba4-856f-02053b5c469f None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:46.640182 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-721fd43b-8f0d-4ba4-856f-02053b5c469f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:46.722360 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 482/939] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:23:46.992394 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072db5c0-e826-4d3e-9465-8b556b140ec9 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:47.067647 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:47.106394 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072db5c0-e826-4d3e-9465-8b556b140ec9 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:47.143961 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af14aa-6b51-4d5a-8c4a-8574fff4df18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:47.144596 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af14aa-6b51-4d5a-8c4a-8574fff4df18 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:47.144873 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af14aa-6b51-4d5a-8c4a-8574fff4df18 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:47.145139 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af14aa-6b51-4d5a-8c4a-8574fff4df18 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:47.145718 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38af14aa-6b51-4d5a-8c4a-8574fff4df18 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:47.147098 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38af14aa-6b51-4d5a-8c4a-8574fff4df18 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:47.156831 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-38af14aa-6b51-4d5a-8c4a-8574fff4df18 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 15:23:47.156831 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:47.156831 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:23:47.156831 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:23:47.156831 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:23:47.156831 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:23:47.156831 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:23:47.156831 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:23:47.156831 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 15:23:47.156831 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:47.156831 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:23:47.156831 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:47.156831 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:47.156831 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:47.156831 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:47.156831 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:47.156831 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:47.157861 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:47.157861 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:47.157861 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:47.157861 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:47.157861 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:47.157861 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:47.157861 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:23:47.157861 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:23:47.157861 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:23:47.157861 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:23:47.157861 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:47.157861 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:47.157861 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:47.157861 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:47.157861 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:47.157861 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:47.158705 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:47.158705 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:47.158705 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:47.158705 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:47.158705 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:47.158705 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:47.158705 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:47.158705 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:47.158705 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:47.158705 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:47.158705 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:23:47.158705 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:23:47.158705 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 15:23:47.158705 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:47.158705 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 458/940] 10.222.0.83 () {56 vars in 1126 bytes} [Mon Aug 29 15:23:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:47.164202 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721fd43b-8f0d-4ba4-856f-02053b5c469f None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:47.211526 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:47.269931 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721fd43b-8f0d-4ba4-856f-02053b5c469f None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:47.305646 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54860a0b-35bd-417c-94df-52d1b758c29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:47.306264 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54860a0b-35bd-417c-94df-52d1b758c29c None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:47.306540 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54860a0b-35bd-417c-94df-52d1b758c29c None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:47.306808 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54860a0b-35bd-417c-94df-52d1b758c29c None admin] PATH_INFO: `/v3/services` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:47.307475 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54860a0b-35bd-417c-94df-52d1b758c29c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:47.307777 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54860a0b-35bd-417c-94df-52d1b758c29c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:47.309152 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54860a0b-35bd-417c-94df-52d1b758c29c None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:47.314374 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 483/941] 10.222.0.83 () {56 vars in 1122 bytes} [Mon Aug 29 15:23:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:47.319802 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af14aa-6b51-4d5a-8c4a-8574fff4df18 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:47.424850 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af14aa-6b51-4d5a-8c4a-8574fff4df18 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:47.454284 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:47.460829 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b430bae0-6bab-4676-8f2f-617e08d5fb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:47.461493 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430bae0-6bab-4676-8f2f-617e08d5fb2b None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:47.461927 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430bae0-6bab-4676-8f2f-617e08d5fb2b None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:47.462415 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430bae0-6bab-4676-8f2f-617e08d5fb2b None admin] PATH_INFO: `/v3/services` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:47.463073 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b430bae0-6bab-4676-8f2f-617e08d5fb2b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:47.463381 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b430bae0-6bab-4676-8f2f-617e08d5fb2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:47.464811 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b430bae0-6bab-4676-8f2f-617e08d5fb2b None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:47.470341 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 459/942] 10.222.0.83 () {56 vars in 1122 bytes} [Mon Aug 29 15:23:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:47.476577 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54860a0b-35bd-417c-94df-52d1b758c29c None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:47.578632 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54860a0b-35bd-417c-94df-52d1b758c29c None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:47.589721 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:47.615896 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90012f1-af19-4175-8ec0-7a3fa332ca2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:47.616872 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90012f1-af19-4175-8ec0-7a3fa332ca2e None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:47.617380 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90012f1-af19-4175-8ec0-7a3fa332ca2e None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:47.617873 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90012f1-af19-4175-8ec0-7a3fa332ca2e None admin] PATH_INFO: `/v3/endpoints` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:47.618793 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90012f1-af19-4175-8ec0-7a3fa332ca2e None admin] RBAC: Adding query filter params (interface=public, service_id=23904f33ca88445faad0204fc3519f5f, region_id=RegionOne) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:47.619337 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90012f1-af19-4175-8ec0-7a3fa332ca2e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:47.620927 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90012f1-af19-4175-8ec0-7a3fa332ca2e None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:47.627444 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 484/943] 10.222.0.83 () {56 vars in 1251 bytes} [Mon Aug 29 15:23:47 2022] GET /identity/v3/endpoints?service_id=23904f33ca88445faad0204fc3519f5f&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:47.636458 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b430bae0-6bab-4676-8f2f-617e08d5fb2b None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:47.740610 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b430bae0-6bab-4676-8f2f-617e08d5fb2b None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:47.777305 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8647172c-d0c2-4fe8-98d3-3e6d79d842aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:47.777921 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647172c-d0c2-4fe8-98d3-3e6d79d842aa None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:47.778193 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647172c-d0c2-4fe8-98d3-3e6d79d842aa None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:47.778457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647172c-d0c2-4fe8-98d3-3e6d79d842aa None admin] PATH_INFO: `/v3/services` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:47.779098 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8647172c-d0c2-4fe8-98d3-3e6d79d842aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:47.780708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8647172c-d0c2-4fe8-98d3-3e6d79d842aa None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:47.788067 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 460/944] 10.222.0.83 () {56 vars in 1087 bytes} [Mon Aug 29 15:23:47 2022] GET /identity/v3/services => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:23:47.963473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d636f6b-6925-4d25-a4c4-1bff9cce9453 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:47.964538 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d636f6b-6925-4d25-a4c4-1bff9cce9453 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:47.965019 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d636f6b-6925-4d25-a4c4-1bff9cce9453 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:47.966815 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 485/945] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:23:47.972867 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be7a47-4b1b-4f57-bd6f-7a3a66fe38ad None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:47.973238 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be7a47-4b1b-4f57-bd6f-7a3a66fe38ad None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:47.973504 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be7a47-4b1b-4f57-bd6f-7a3a66fe38ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:47.993395 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-41be7a47-4b1b-4f57-bd6f-7a3a66fe38ad None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:47.994565 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-41be7a47-4b1b-4f57-bd6f-7a3a66fe38ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:48.054054 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:48.069613 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 461/946] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:23:48.095526 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873de29-7a71-42dc-972a-ee18fe6971cd None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:48.095866 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873de29-7a71-42dc-972a-ee18fe6971cd None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:48.096074 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873de29-7a71-42dc-972a-ee18fe6971cd None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:48.097401 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 486/947] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:23:48.102994 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4577be-344b-42d8-af03-8c145e709e02 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:48.104538 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4577be-344b-42d8-af03-8c145e709e02 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:48.104538 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4577be-344b-42d8-af03-8c145e709e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:48.123604 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-4f4577be-344b-42d8-af03-8c145e709e02 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:48.124891 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4f4577be-344b-42d8-af03-8c145e709e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:48.199143 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 462/948] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 15:23:48.351398 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873de29-7a71-42dc-972a-ee18fe6971cd None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:48.462228 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873de29-7a71-42dc-972a-ee18fe6971cd None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:48.466949 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4577be-344b-42d8-af03-8c145e709e02 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:48.498635 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd07061-31e8-4060-9f03-38248ef67602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:48.499279 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd07061-31e8-4060-9f03-38248ef67602 None admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:48.500077 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd07061-31e8-4060-9f03-38248ef67602 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:48.500354 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd07061-31e8-4060-9f03-38248ef67602 None admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:48.501101 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd07061-31e8-4060-9f03-38248ef67602 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:48.502643 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd07061-31e8-4060-9f03-38248ef67602 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:48.505342 n-d-836830-13 devstack@keystone.service[82148]: WARNING keystone.server.flask.common [None req-1cd07061-31e8-4060-9f03-38248ef67602 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 29 15:23:48.524412 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.sql.core [None req-1cd07061-31e8-4060-9f03-38248ef67602 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 15:23:48.524412 n-d-836830-13 devstack@keystone.service[82148]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 29 15:23:48.524412 n-d-836830-13 devstack@keystone.service[82148]: [parameters: {'id': '6fa0637515b54f6c99cd41321a501aca', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 29 15:23:48.524412 n-d-836830-13 devstack@keystone.service[82148]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82148) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 15:23:48.534995 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-1cd07061-31e8-4060-9f03-38248ef67602 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6fa0637515b54f6c99cd41321a501aca.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6fa0637515b54f6c99cd41321a501aca. Aug 29 15:23:48.534995 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:48.534995 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 15:23:48.534995 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 15:23:48.534995 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 15:23:48.534995 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 15:23:48.534995 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 15:23:48.534995 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 15:23:48.534995 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 15:23:48.534995 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application conn.query(q) Aug 29 15:23:48.534995 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 15:23:48.534995 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 15:23:48.534995 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 15:23:48.535852 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application result.read() Aug 29 15:23:48.535852 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 15:23:48.535852 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 15:23:48.535852 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 15:23:48.535852 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 15:23:48.535852 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 15:23:48.535852 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 15:23:48.535852 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 15:23:48.535852 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 15:23:48.535852 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 15:23:48.535852 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:48.535852 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 15:23:48.535852 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:48.535852 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:48.535852 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 15:23:48.535852 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 15:23:48.535852 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 29 15:23:48.535852 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 29 15:23:48.536808 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 15:23:48.536808 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application next(self.gen) Aug 29 15:23:48.536808 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 15:23:48.536808 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application yield resource Aug 29 15:23:48.536808 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 15:23:48.536808 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application next(self.gen) Aug 29 15:23:48.536808 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 15:23:48.536808 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 15:23:48.536808 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:23:48.536808 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 15:23:48.536808 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:23:48.536808 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise self.value Aug 29 15:23:48.536808 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 15:23:48.536808 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 15:23:48.536808 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 15:23:48.536808 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application session.commit() Aug 29 15:23:48.536808 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 15:23:48.537711 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 15:23:48.537711 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 15:23:48.537711 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 15:23:48.537711 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 15:23:48.537711 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self.session.flush() Aug 29 15:23:48.537711 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 15:23:48.537711 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 15:23:48.537711 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 15:23:48.537711 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 15:23:48.537711 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 15:23:48.537711 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application compat.raise_( Aug 29 15:23:48.537711 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 15:23:48.537711 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception Aug 29 15:23:48.537711 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 15:23:48.537711 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 15:23:48.537711 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 15:23:48.537711 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 15:23:48.538603 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 15:23:48.538603 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 15:23:48.538603 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 15:23:48.538603 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 15:23:48.538603 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 29 15:23:48.538603 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 29 15:23:48.538603 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 15:23:48.538603 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 15:23:48.538603 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 15:23:48.538603 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 15:23:48.538603 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 15:23:48.538603 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 15:23:48.538603 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 15:23:48.538603 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 15:23:48.538603 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 15:23:48.540347 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 15:23:48.540347 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 15:23:48.540347 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception Aug 29 15:23:48.540347 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 15:23:48.540347 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 15:23:48.540347 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 15:23:48.540347 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 15:23:48.540347 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 15:23:48.540347 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 15:23:48.540347 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 15:23:48.540347 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application conn.query(q) Aug 29 15:23:48.540347 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 15:23:48.540347 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 15:23:48.540347 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 15:23:48.540347 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application result.read() Aug 29 15:23:48.540347 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 15:23:48.540347 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 15:23:48.541909 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 15:23:48.541909 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 15:23:48.541909 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 15:23:48.541909 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 15:23:48.541909 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 15:23:48.541909 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 15:23:48.541909 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 15:23:48.541909 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 29 15:23:48.541909 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [parameters: {'id': '6fa0637515b54f6c99cd41321a501aca', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 29 15:23:48.541909 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 15:23:48.541909 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:48.541909 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:23:48.541909 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:48.541909 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:48.541909 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 29 15:23:48.552064 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 29 15:23:48.552064 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 15:23:48.552064 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 15:23:48.552064 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 29 15:23:48.552064 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:48.552064 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:23:48.552064 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:48.552064 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:48.552064 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:48.552064 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:48.552064 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:48.552064 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:48.552064 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:48.552064 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:48.552064 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:48.552064 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:48.552064 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:48.553675 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:48.553675 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 29 15:23:48.553675 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 29 15:23:48.553675 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:48.553675 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:48.553675 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 29 15:23:48.553675 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 29 15:23:48.553675 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6fa0637515b54f6c99cd41321a501aca. Aug 29 15:23:48.553675 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:48.553675 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 487/949] 10.222.0.83 () {60 vars in 1140 bytes} [Mon Aug 29 15:23:48 2022] POST /identity/v3/projects => generated 262 bytes in 186 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:48.553675 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd07061-31e8-4060-9f03-38248ef67602 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:48.581315 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4577be-344b-42d8-af03-8c145e709e02 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:48.600357 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:48.607630 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:48.622265 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22bbe6c-bece-4274-9906-1e9473de1916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:48.623120 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22bbe6c-bece-4274-9906-1e9473de1916 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:48.623719 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22bbe6c-bece-4274-9906-1e9473de1916 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:48.624290 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22bbe6c-bece-4274-9906-1e9473de1916 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:48.636847 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22bbe6c-bece-4274-9906-1e9473de1916 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:23:48.644315 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-b22bbe6c-bece-4274-9906-1e9473de1916 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 15:23:48.644315 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:48.644315 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:48.644315 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:48.644315 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:48.644315 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:48.644315 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:48.644315 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:48.644315 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:48.644315 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:48.644315 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:48.644315 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:48.644315 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:23:48.644315 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:23:48.644315 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:23:48.644315 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:23:48.645504 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:23:48.645504 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:23:48.645504 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:23:48.645504 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:23:48.645504 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:48.645504 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:48.645504 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:48.645504 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:48.645504 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:48.645504 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:48.645504 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:48.645504 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:48.645504 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:48.645504 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:48.645504 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:48.645504 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:48.646491 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:48.646491 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:48.646491 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:48.646491 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:48.646491 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:23:48.646491 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:23:48.646491 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:23:48.646491 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:23:48.646491 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:23:48.646491 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:23:48.646491 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 15:23:48.646491 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:48.654302 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 463/950] 10.222.0.83 () {56 vars in 1120 bytes} [Mon Aug 29 15:23:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:23:48.658296 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22bbe6c-bece-4274-9906-1e9473de1916 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:48.678837 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd07061-31e8-4060-9f03-38248ef67602 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:48.721331 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bcb972-0b8d-4a6f-a99f-29715bd47c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:48.721970 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bcb972-0b8d-4a6f-a99f-29715bd47c75 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:48.722247 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bcb972-0b8d-4a6f-a99f-29715bd47c75 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:48.722518 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bcb972-0b8d-4a6f-a99f-29715bd47c75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:48.729794 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bcb972-0b8d-4a6f-a99f-29715bd47c75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:48.731473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bcb972-0b8d-4a6f-a99f-29715bd47c75 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:48.742973 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-33bcb972-0b8d-4a6f-a99f-29715bd47c75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:48.742973 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:48.742973 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:48.742973 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:48.742973 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:48.742973 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:48.742973 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:48.742973 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:48.742973 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:48.742973 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:48.742973 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:48.742973 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:48.742973 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:23:48.742973 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:23:48.742973 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:23:48.743926 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:23:48.743926 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:48.743926 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:48.743926 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:48.743926 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:48.743926 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:48.743926 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:48.743926 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:48.743926 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:48.743926 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:48.743926 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:48.743926 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:48.743926 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:48.743926 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:48.743926 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:48.743926 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:48.743926 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:48.744824 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:23:48.744824 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:23:48.744824 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:23:48.744824 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:23:48.744824 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:23:48.744824 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:23:48.744824 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:48.744824 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:48.744824 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 488/951] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:23:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:48.746331 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6fbc2-d029-4870-be46-5ba4615d7179 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:48.746331 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6fbc2-d029-4870-be46-5ba4615d7179 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:48.746331 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6fbc2-d029-4870-be46-5ba4615d7179 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:48.751210 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 489/952] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:23:48.751561 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d6fbc2-d029-4870-be46-5ba4615d7179 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:48.799673 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22bbe6c-bece-4274-9906-1e9473de1916 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:48.840935 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f490534-3414-401e-97e9-5ed5e93e3f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:48.841543 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f490534-3414-401e-97e9-5ed5e93e3f6b None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:48.841813 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f490534-3414-401e-97e9-5ed5e93e3f6b None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:48.842275 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f490534-3414-401e-97e9-5ed5e93e3f6b None admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:48.842745 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f490534-3414-401e-97e9-5ed5e93e3f6b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:48.843069 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f490534-3414-401e-97e9-5ed5e93e3f6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:48.845029 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f490534-3414-401e-97e9-5ed5e93e3f6b None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:48.853391 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 464/953] 10.222.0.83 () {56 vars in 1115 bytes} [Mon Aug 29 15:23:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:23:48.854416 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ddff2-d4df-4476-bb75-ee5bc8bd2053 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:48.854699 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ddff2-d4df-4476-bb75-ee5bc8bd2053 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:48.854971 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ddff2-d4df-4476-bb75-ee5bc8bd2053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:48.861184 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:48.873267 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d6fbc2-d029-4870-be46-5ba4615d7179 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:48.873764 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-5b4ddff2-d4df-4476-bb75-ee5bc8bd2053 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:48.875810 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5b4ddff2-d4df-4476-bb75-ee5bc8bd2053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:48.912538 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0309fd-c630-4e96-951f-20385b427c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:48.913154 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0309fd-c630-4e96-951f-20385b427c0f None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:48.913424 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0309fd-c630-4e96-951f-20385b427c0f None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:48.913690 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0309fd-c630-4e96-951f-20385b427c0f None admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:48.914350 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0309fd-c630-4e96-951f-20385b427c0f None admin] RBAC: Adding query filter params (name=service) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:48.914669 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0309fd-c630-4e96-951f-20385b427c0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:48.916125 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0309fd-c630-4e96-951f-20385b427c0f None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:48.916491 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:48.935605 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 490/954] 10.222.0.83 () {56 vars in 1112 bytes} [Mon Aug 29 15:23:48 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:48.936430 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0309fd-c630-4e96-951f-20385b427c0f None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:48.970316 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 465/955] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:23:49.063933 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0309fd-c630-4e96-951f-20385b427c0f None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:49.103677 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287bbf1-bd7b-42b9-b128-d51b65eac764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:49.104322 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287bbf1-bd7b-42b9-b128-d51b65eac764 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:49.104600 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287bbf1-bd7b-42b9-b128-d51b65eac764 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:49.104873 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287bbf1-bd7b-42b9-b128-d51b65eac764 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:49.116932 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5287bbf1-bd7b-42b9-b128-d51b65eac764 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:49.118326 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5287bbf1-bd7b-42b9-b128-d51b65eac764 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:49.135858 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-5287bbf1-bd7b-42b9-b128-d51b65eac764 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:49.135858 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:49.135858 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:49.135858 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:49.135858 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:49.135858 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:49.135858 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:49.135858 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:49.135858 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:49.135858 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:49.135858 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:49.135858 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:49.135858 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:23:49.135858 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:23:49.135858 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:23:49.135858 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:23:49.136959 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:49.136959 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:49.136959 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:49.136959 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:49.136959 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:49.136959 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:49.136959 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:49.136959 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:49.136959 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:49.136959 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:49.136959 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:49.136959 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:49.136959 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:49.136959 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:49.136959 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:49.136959 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:49.136959 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:23:49.137935 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:23:49.137935 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:49.137935 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:49.137935 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 491/956] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:49.143589 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ddff2-d4df-4476-bb75-ee5bc8bd2053 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:49.257880 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ddff2-d4df-4476-bb75-ee5bc8bd2053 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:49.270918 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287bbf1-bd7b-42b9-b128-d51b65eac764 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:49.274232 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:49.298284 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46608d4-921e-49b6-9849-91bf500e85ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:49.298903 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46608d4-921e-49b6-9849-91bf500e85ac None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:49.299215 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46608d4-921e-49b6-9849-91bf500e85ac None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:49.299485 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46608d4-921e-49b6-9849-91bf500e85ac None admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:49.300130 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46608d4-921e-49b6-9849-91bf500e85ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:49.300424 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46608d4-921e-49b6-9849-91bf500e85ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:49.301797 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46608d4-921e-49b6-9849-91bf500e85ac None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:49.319012 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 466/957] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:23:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:49.320466 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46608d4-921e-49b6-9849-91bf500e85ac None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:49.378229 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:49.388058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287bbf1-bd7b-42b9-b128-d51b65eac764 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:49.431010 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910a84f-aee9-4457-9806-6f8661936c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:49.431834 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910a84f-aee9-4457-9806-6f8661936c70 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:49.432206 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910a84f-aee9-4457-9806-6f8661936c70 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:49.432622 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910a84f-aee9-4457-9806-6f8661936c70 None admin] PATH_INFO: `/v3/services/compute` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:49.432919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46608d4-921e-49b6-9849-91bf500e85ac None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:49.433387 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910a84f-aee9-4457-9806-6f8661936c70 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:49.435168 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910a84f-aee9-4457-9806-6f8661936c70 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:49.447447 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-2910a84f-aee9-4457-9806-6f8661936c70 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 15:23:49.447447 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:49.447447 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:23:49.447447 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:23:49.447447 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:23:49.447447 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:23:49.447447 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:23:49.447447 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:23:49.447447 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 15:23:49.447447 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:49.447447 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:23:49.447447 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:49.447447 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:49.447447 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:49.447447 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:49.447447 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:49.447447 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:49.448675 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:49.448675 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:49.448675 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:49.448675 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:49.448675 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:49.448675 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:49.448675 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:23:49.448675 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:23:49.448675 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:23:49.448675 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:23:49.448675 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:49.448675 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:49.448675 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:49.448675 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:49.448675 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:49.448675 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:49.449524 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:49.449524 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:49.449524 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:49.449524 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:49.449524 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:49.449524 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:49.449524 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:49.449524 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:49.449524 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:49.449524 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:49.449524 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:23:49.449524 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:23:49.449524 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 15:23:49.449524 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:49.449524 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 492/958] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:23:49 2022] GET /identity/v3/services/compute => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:49.456896 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910a84f-aee9-4457-9806-6f8661936c70 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:49.477342 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b9f111-e4c6-4a84-aa0d-585604353e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:49.478195 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9f111-e4c6-4a84-aa0d-585604353e54 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:49.478439 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9f111-e4c6-4a84-aa0d-585604353e54 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:49.478707 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9f111-e4c6-4a84-aa0d-585604353e54 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:49.488452 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b9f111-e4c6-4a84-aa0d-585604353e54 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:49.490069 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b9f111-e4c6-4a84-aa0d-585604353e54 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:49.503059 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-58b9f111-e4c6-4a84-aa0d-585604353e54 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 15:23:49.503059 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:49.503059 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:49.503059 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:49.503059 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:49.503059 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:49.503059 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:49.503059 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:49.503059 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:49.503059 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:49.503059 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:49.503059 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:49.503059 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:23:49.503059 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:23:49.503059 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:23:49.503059 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:23:49.504055 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:49.504055 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:49.504055 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:23:49.504055 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:23:49.504055 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:23:49.504055 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:23:49.504055 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:49.504055 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:49.504055 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:49.504055 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:49.504055 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:49.504055 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:49.504055 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:49.504055 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:49.504055 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:49.504055 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:49.504055 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:49.504055 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:49.504982 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:49.504982 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:49.504982 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:23:49.504982 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:23:49.504982 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:23:49.504982 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:23:49.504982 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:23:49.504982 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:23:49.504982 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 15:23:49.504982 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:49.509338 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 467/959] 10.222.0.83 () {56 vars in 1117 bytes} [Mon Aug 29 15:23:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:49.510332 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b9f111-e4c6-4a84-aa0d-585604353e54 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:49.539785 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:49.578003 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910a84f-aee9-4457-9806-6f8661936c70 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:49.612335 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:49.619557 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084a40d-1bd1-4d9d-b8bf-ec596a2e154f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:49.620374 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084a40d-1bd1-4d9d-b8bf-ec596a2e154f None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:49.620656 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084a40d-1bd1-4d9d-b8bf-ec596a2e154f None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:49.620926 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084a40d-1bd1-4d9d-b8bf-ec596a2e154f None admin] PATH_INFO: `/v3/services` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:49.621591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e084a40d-1bd1-4d9d-b8bf-ec596a2e154f None admin] RBAC: Adding query filter params (name=compute) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:49.621849 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e084a40d-1bd1-4d9d-b8bf-ec596a2e154f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:49.623264 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e084a40d-1bd1-4d9d-b8bf-ec596a2e154f None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:49.623894 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b9f111-e4c6-4a84-aa0d-585604353e54 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:49.629379 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 493/960] 10.222.0.83 () {56 vars in 1112 bytes} [Mon Aug 29 15:23:49 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:23:49.634592 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084a40d-1bd1-4d9d-b8bf-ec596a2e154f None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:49.663251 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f20b75-0114-4e07-89ba-f26fc0d7c45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:49.664233 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f20b75-0114-4e07-89ba-f26fc0d7c45f None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:49.664735 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f20b75-0114-4e07-89ba-f26fc0d7c45f None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:49.665295 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f20b75-0114-4e07-89ba-f26fc0d7c45f None admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:49.666274 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f20b75-0114-4e07-89ba-f26fc0d7c45f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:49.666819 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f20b75-0114-4e07-89ba-f26fc0d7c45f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:49.668604 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f20b75-0114-4e07-89ba-f26fc0d7c45f None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:49.693958 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 468/961] 10.222.0.83 () {56 vars in 1149 bytes} [Mon Aug 29 15:23:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:49.695760 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f20b75-0114-4e07-89ba-f26fc0d7c45f None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:49.762334 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084a40d-1bd1-4d9d-b8bf-ec596a2e154f None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:49.793592 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:49.800389 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d345d-6c6c-4d2e-a192-ae4133f9d0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:49.800999 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d345d-6c6c-4d2e-a192-ae4133f9d0b4 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:49.801278 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d345d-6c6c-4d2e-a192-ae4133f9d0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:49.801550 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d345d-6c6c-4d2e-a192-ae4133f9d0b4 None admin] PATH_INFO: `/v3/services` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:49.802182 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d345d-6c6c-4d2e-a192-ae4133f9d0b4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:49.802486 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d345d-6c6c-4d2e-a192-ae4133f9d0b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:49.803884 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d345d-6c6c-4d2e-a192-ae4133f9d0b4 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:49.808400 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 494/962] 10.222.0.83 () {56 vars in 1112 bytes} [Mon Aug 29 15:23:49 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:23:49.809846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fe2b2-301a-4be0-8151-1bb7d1e52995 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:49.810264 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fe2b2-301a-4be0-8151-1bb7d1e52995 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:49.810669 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fe2b2-301a-4be0-8151-1bb7d1e52995 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:49.816531 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 495/963] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:23:49.818134 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e267a51-c81e-4692-84f3-0088f4f5ca29 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:49.818576 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e267a51-c81e-4692-84f3-0088f4f5ca29 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:49.818995 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e267a51-c81e-4692-84f3-0088f4f5ca29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:49.821432 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f20b75-0114-4e07-89ba-f26fc0d7c45f None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:49.847211 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-8e267a51-c81e-4692-84f3-0088f4f5ca29 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:49.849622 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8e267a51-c81e-4692-84f3-0088f4f5ca29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:49.865527 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa9535-3ce5-4211-ba76-e55e9bfc7a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:49.866426 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa9535-3ce5-4211-ba76-e55e9bfc7a55 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:49.866878 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa9535-3ce5-4211-ba76-e55e9bfc7a55 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:49.867381 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa9535-3ce5-4211-ba76-e55e9bfc7a55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:49.888867 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:49.947626 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 496/964] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:23:49.953741 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa9535-3ce5-4211-ba76-e55e9bfc7a55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:49.956434 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa9535-3ce5-4211-ba76-e55e9bfc7a55 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:50.061890 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 469/965] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:23:49 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 15:23:50.068126 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e267a51-c81e-4692-84f3-0088f4f5ca29 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:50.180930 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e267a51-c81e-4692-84f3-0088f4f5ca29 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:50.206080 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:50.217856 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ca4d9-197b-4b49-9e26-66ab74847b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:50.218554 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ca4d9-197b-4b49-9e26-66ab74847b7c None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:50.218833 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ca4d9-197b-4b49-9e26-66ab74847b7c None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:50.219134 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ca4d9-197b-4b49-9e26-66ab74847b7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:50.230765 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ca4d9-197b-4b49-9e26-66ab74847b7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:50.232320 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ca4d9-197b-4b49-9e26-66ab74847b7c None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:50.234763 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa9535-3ce5-4211-ba76-e55e9bfc7a55 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:50.250040 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-cf1ca4d9-197b-4b49-9e26-66ab74847b7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:50.250040 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:50.250040 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:50.250040 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:50.250040 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:50.250040 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:50.250040 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:50.250040 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:50.250040 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:50.250040 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:50.250040 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:50.250040 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:50.250040 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:23:50.250040 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:23:50.250040 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:23:50.250040 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:23:50.251018 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:50.251018 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:50.251018 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:50.251018 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:50.251018 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:50.251018 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:50.251018 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:50.251018 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:50.251018 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:50.251018 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:50.251018 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:50.251018 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:50.251018 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:50.251018 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:50.251018 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:50.251018 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:50.251018 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:23:50.252104 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:23:50.252104 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:23:50.252104 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:50.252104 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 497/966] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:23:50.256773 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ca4d9-197b-4b49-9e26-66ab74847b7c None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:50.297527 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:50.357323 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa9535-3ce5-4211-ba76-e55e9bfc7a55 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:50.394530 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ca4d9-197b-4b49-9e26-66ab74847b7c None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:50.398306 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346624c2-ebec-4c25-b29e-31ff9cb74573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:50.399579 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346624c2-ebec-4c25-b29e-31ff9cb74573 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:50.400287 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346624c2-ebec-4c25-b29e-31ff9cb74573 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:50.400951 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346624c2-ebec-4c25-b29e-31ff9cb74573 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:50.402256 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346624c2-ebec-4c25-b29e-31ff9cb74573 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:50.404630 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346624c2-ebec-4c25-b29e-31ff9cb74573 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:50.415988 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-346624c2-ebec-4c25-b29e-31ff9cb74573 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 15:23:50.415988 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:50.415988 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:23:50.415988 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:23:50.415988 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:23:50.415988 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:23:50.415988 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:23:50.415988 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:23:50.415988 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 15:23:50.415988 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:50.415988 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:23:50.415988 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:50.415988 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:50.415988 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:50.415988 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:50.415988 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:50.415988 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:50.417026 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:50.417026 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:50.417026 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:50.417026 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:50.417026 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:50.417026 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:50.417026 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:23:50.417026 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:23:50.417026 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:23:50.417026 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:23:50.417026 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:50.417026 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:50.417026 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:50.417026 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:50.417026 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:50.417026 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:50.417953 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:50.417953 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:50.417953 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:50.417953 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:50.417953 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:50.417953 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:50.417953 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:50.417953 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:50.417953 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:50.417953 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:50.417953 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:23:50.417953 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:23:50.417953 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 15:23:50.417953 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:50.420878 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 470/967] 10.222.0.83 () {56 vars in 1126 bytes} [Mon Aug 29 15:23:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:23:50.426487 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346624c2-ebec-4c25-b29e-31ff9cb74573 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:50.443070 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c20569-265c-454a-925e-8a84e8560a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:50.443976 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c20569-265c-454a-925e-8a84e8560a9e None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:50.444270 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c20569-265c-454a-925e-8a84e8560a9e None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:50.444544 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c20569-265c-454a-925e-8a84e8560a9e None admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:50.445277 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c20569-265c-454a-925e-8a84e8560a9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:50.446050 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c20569-265c-454a-925e-8a84e8560a9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:50.447839 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c20569-265c-454a-925e-8a84e8560a9e None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:50.469653 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 498/968] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:23:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:23:50.472469 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c20569-265c-454a-925e-8a84e8560a9e None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:50.508102 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:50.551853 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346624c2-ebec-4c25-b29e-31ff9cb74573 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:50.566140 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:50.582305 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c20569-265c-454a-925e-8a84e8560a9e None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:50.590834 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee7591-94b4-42cd-b57e-cfcbd83b0a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:50.591499 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee7591-94b4-42cd-b57e-cfcbd83b0a2c None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:50.591775 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee7591-94b4-42cd-b57e-cfcbd83b0a2c None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:50.592042 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee7591-94b4-42cd-b57e-cfcbd83b0a2c None admin] PATH_INFO: `/v3/services` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:50.592664 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee7591-94b4-42cd-b57e-cfcbd83b0a2c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:50.592961 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee7591-94b4-42cd-b57e-cfcbd83b0a2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:50.594418 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee7591-94b4-42cd-b57e-cfcbd83b0a2c None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:50.605270 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 471/969] 10.222.0.83 () {56 vars in 1122 bytes} [Mon Aug 29 15:23:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:23:50.606138 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee7591-94b4-42cd-b57e-cfcbd83b0a2c None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:50.621982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb6c63-e555-4392-ae53-dcbb249cbeed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:50.622939 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb6c63-e555-4392-ae53-dcbb249cbeed None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:50.623507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb6c63-e555-4392-ae53-dcbb249cbeed None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:50.623989 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb6c63-e555-4392-ae53-dcbb249cbeed None admin] PATH_INFO: `/v3/projects/service` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:50.631737 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fb6c63-e555-4392-ae53-dcbb249cbeed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:50.633511 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fb6c63-e555-4392-ae53-dcbb249cbeed None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:50.646226 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-18fb6c63-e555-4392-ae53-dcbb249cbeed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:50.646226 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:50.646226 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:50.646226 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:50.646226 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:50.646226 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:50.646226 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:50.646226 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:50.646226 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:50.646226 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:50.646226 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:50.646226 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:50.646226 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:23:50.646226 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:23:50.646226 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:23:50.647164 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:23:50.647164 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:50.647164 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:50.647164 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:50.647164 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:50.647164 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:50.647164 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:50.647164 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:50.647164 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:50.647164 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:50.647164 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:50.647164 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:50.647164 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:50.647164 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:50.647164 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:50.647164 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:50.647164 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:50.648078 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:23:50.648078 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:23:50.648078 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:23:50.648078 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:23:50.648078 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:23:50.648078 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:23:50.648078 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:23:50.648078 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:50.654995 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 499/970] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:23:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:50.656504 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb6c63-e555-4392-ae53-dcbb249cbeed None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:50.720235 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee7591-94b4-42cd-b57e-cfcbd83b0a2c None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:50.761083 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d915261e-9f81-4353-8020-3aa1d9788cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:50.761699 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915261e-9f81-4353-8020-3aa1d9788cf4 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:50.761973 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915261e-9f81-4353-8020-3aa1d9788cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:50.762244 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915261e-9f81-4353-8020-3aa1d9788cf4 None admin] PATH_INFO: `/v3/services` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:50.762874 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d915261e-9f81-4353-8020-3aa1d9788cf4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:50.763208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d915261e-9f81-4353-8020-3aa1d9788cf4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:50.764708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d915261e-9f81-4353-8020-3aa1d9788cf4 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:50.775567 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 472/971] 10.222.0.83 () {56 vars in 1122 bytes} [Mon Aug 29 15:23:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:50.776417 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d915261e-9f81-4353-8020-3aa1d9788cf4 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:50.786935 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:50.796486 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb6c63-e555-4392-ae53-dcbb249cbeed None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:50.825929 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:50.838855 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f7340-fdfe-4291-801c-b6e4ad3c324a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:50.839639 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f7340-fdfe-4291-801c-b6e4ad3c324a None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:50.840004 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f7340-fdfe-4291-801c-b6e4ad3c324a None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:50.840372 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f7340-fdfe-4291-801c-b6e4ad3c324a None admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:50.841198 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81f7340-fdfe-4291-801c-b6e4ad3c324a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:50.841555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81f7340-fdfe-4291-801c-b6e4ad3c324a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:50.843197 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81f7340-fdfe-4291-801c-b6e4ad3c324a None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:50.862488 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 500/972] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 15:23:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:23:50.863866 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f7340-fdfe-4291-801c-b6e4ad3c324a None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:50.894513 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d915261e-9f81-4353-8020-3aa1d9788cf4 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:50.932568 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f64bb-c501-46fa-8db0-f8f049541b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:50.933428 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f64bb-c501-46fa-8db0-f8f049541b06 None admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:50.933969 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f64bb-c501-46fa-8db0-f8f049541b06 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:50.934397 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f64bb-c501-46fa-8db0-f8f049541b06 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:50.935353 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f64bb-c501-46fa-8db0-f8f049541b06 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:50.936845 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f64bb-c501-46fa-8db0-f8f049541b06 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:50.972125 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 473/973] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:23:50 2022] POST /identity/v3/endpoints => generated 349 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:23:50.984640 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f7340-fdfe-4291-801c-b6e4ad3c324a None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:51.038311 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b783b-4793-40b6-ba0e-c00446aa0ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:51.039046 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b783b-4793-40b6-ba0e-c00446aa0ee3 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:51.039337 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b783b-4793-40b6-ba0e-c00446aa0ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:51.039600 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b783b-4793-40b6-ba0e-c00446aa0ee3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:51.040377 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b783b-4793-40b6-ba0e-c00446aa0ee3 None admin] RBAC: Adding query filter params (role.id=49f4519b105b4692b68e8d28be78fe57, scope.project.id=44655977b0814a728f0fa73d442a7ee9, user.id=712a09e9d2a248309b91424dd05d2b44) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:51.040686 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b783b-4793-40b6-ba0e-c00446aa0ee3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:51.042122 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b783b-4793-40b6-ba0e-c00446aa0ee3 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:51.053196 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 501/974] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 15:23:50 2022] GET /identity/v3/role_assignments?user.id=712a09e9d2a248309b91424dd05d2b44&scope.project.id=44655977b0814a728f0fa73d442a7ee9&role.id=49f4519b105b4692b68e8d28be78fe57 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:23:51.054755 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63ae84-c2f2-4f82-aac7-b34b883e0819 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:51.055051 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63ae84-c2f2-4f82-aac7-b34b883e0819 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:51.055334 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63ae84-c2f2-4f82-aac7-b34b883e0819 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:51.056953 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 474/975] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:23:51.063093 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cb4db-2695-40c9-8bfc-8d544ebf303c None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:51.063419 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cb4db-2695-40c9-8bfc-8d544ebf303c None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:51.063636 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cb4db-2695-40c9-8bfc-8d544ebf303c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:51.093049 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-ce2cb4db-2695-40c9-8bfc-8d544ebf303c None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:51.095330 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ce2cb4db-2695-40c9-8bfc-8d544ebf303c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:51.116020 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:51.187727 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 502/976] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:23:51.468799 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df63ae84-c2f2-4f82-aac7-b34b883e0819 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:51.573997 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:51.583328 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df63ae84-c2f2-4f82-aac7-b34b883e0819 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:51.622953 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586469a-f5e4-45d5-b0b1-cbbd67632ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:51.623834 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586469a-f5e4-45d5-b0b1-cbbd67632ef1 None admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:51.624257 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586469a-f5e4-45d5-b0b1-cbbd67632ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:51.624671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586469a-f5e4-45d5-b0b1-cbbd67632ef1 None admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:51.625484 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0586469a-f5e4-45d5-b0b1-cbbd67632ef1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:51.627155 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0586469a-f5e4-45d5-b0b1-cbbd67632ef1 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:51.629883 n-d-836830-13 devstack@keystone.service[82149]: WARNING keystone.server.flask.common [None req-0586469a-f5e4-45d5-b0b1-cbbd67632ef1 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 29 15:23:51.642895 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.sql.core [None req-0586469a-f5e4-45d5-b0b1-cbbd67632ef1 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 15:23:51.642895 n-d-836830-13 devstack@keystone.service[82149]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 29 15:23:51.642895 n-d-836830-13 devstack@keystone.service[82149]: [parameters: {'user_id': '7e1e866fe73542529ba5687960af01a3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 29 15:23:51.642895 n-d-836830-13 devstack@keystone.service[82149]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82149) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 15:23:51.660995 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-0586469a-f5e4-45d5-b0b1-cbbd67632ef1 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 29 15:23:51.660995 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:51.660995 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 15:23:51.660995 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 15:23:51.660995 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 15:23:51.660995 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 15:23:51.660995 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 15:23:51.660995 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 15:23:51.660995 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 15:23:51.660995 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application conn.query(q) Aug 29 15:23:51.660995 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 15:23:51.660995 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 15:23:51.660995 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 15:23:51.660995 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application result.read() Aug 29 15:23:51.660995 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 15:23:51.662298 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 15:23:51.662298 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 15:23:51.662298 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 15:23:51.662298 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 15:23:51.662298 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 15:23:51.662298 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 15:23:51.662298 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 15:23:51.662298 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 15:23:51.662298 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:51.662298 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 15:23:51.662298 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:51.662298 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:51.662298 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 15:23:51.662298 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 15:23:51.662298 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 29 15:23:51.662298 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 29 15:23:51.662298 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 15:23:51.662298 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application next(self.gen) Aug 29 15:23:51.663493 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 15:23:51.663493 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application yield resource Aug 29 15:23:51.663493 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 15:23:51.663493 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application next(self.gen) Aug 29 15:23:51.663493 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 15:23:51.663493 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 15:23:51.663493 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:23:51.663493 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 15:23:51.663493 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:23:51.663493 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise self.value Aug 29 15:23:51.663493 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 15:23:51.663493 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 15:23:51.663493 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 15:23:51.663493 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application session.commit() Aug 29 15:23:51.663493 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 15:23:51.663493 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 15:23:51.663493 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 15:23:51.664560 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 15:23:51.664560 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 15:23:51.664560 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self.session.flush() Aug 29 15:23:51.664560 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 15:23:51.664560 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 15:23:51.664560 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 15:23:51.664560 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 15:23:51.664560 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 15:23:51.664560 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application compat.raise_( Aug 29 15:23:51.664560 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 15:23:51.664560 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception Aug 29 15:23:51.664560 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 15:23:51.664560 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 15:23:51.664560 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 15:23:51.664560 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 15:23:51.664560 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 15:23:51.664560 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 15:23:51.665461 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 15:23:51.665461 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 15:23:51.665461 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 29 15:23:51.665461 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 29 15:23:51.665461 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 15:23:51.665461 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 15:23:51.665461 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 15:23:51.665461 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 15:23:51.665461 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 15:23:51.665461 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 15:23:51.665461 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 15:23:51.665461 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 15:23:51.665461 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 15:23:51.665461 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 15:23:51.665461 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 15:23:51.665461 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception Aug 29 15:23:51.666308 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 15:23:51.666308 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 15:23:51.666308 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 15:23:51.666308 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 15:23:51.666308 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 15:23:51.666308 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 15:23:51.666308 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 15:23:51.666308 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application conn.query(q) Aug 29 15:23:51.666308 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 15:23:51.666308 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 15:23:51.666308 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 15:23:51.666308 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application result.read() Aug 29 15:23:51.666308 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 15:23:51.666308 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 15:23:51.666308 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 15:23:51.666308 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 15:23:51.667157 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 15:23:51.667157 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 15:23:51.667157 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 15:23:51.667157 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 15:23:51.667157 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 15:23:51.667157 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 29 15:23:51.667157 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [parameters: {'user_id': '7e1e866fe73542529ba5687960af01a3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 29 15:23:51.667157 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 15:23:51.667157 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:51.667157 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:23:51.667157 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:51.667157 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:51.667157 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:51.667157 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:51.667157 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:51.668022 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:51.668022 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:51.668022 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:51.668022 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:51.668022 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:51.668022 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:51.668022 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:51.668022 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 29 15:23:51.668022 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 29 15:23:51.668022 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:51.668022 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:51.668022 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:23:51.668022 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:23:51.668022 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:23:51.668022 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:23:51.668022 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 29 15:23:51.668022 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 29 15:23:51.668950 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 29 15:23:51.668950 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 29 15:23:51.668950 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 15:23:51.668950 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 15:23:51.668950 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 29 15:23:51.668950 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:51.670993 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 475/977] 10.222.0.83 () {60 vars in 1131 bytes} [Mon Aug 29 15:23:51 2022] POST /identity/v3/users => generated 160 bytes in 203 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:51.679971 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2cb4db-2695-40c9-8bfc-8d544ebf303c None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:51.795584 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2cb4db-2695-40c9-8bfc-8d544ebf303c None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:51.836992 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3184a-f478-46f4-b813-38a801393eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:51.838019 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3184a-f478-46f4-b813-38a801393eff None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:51.838505 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3184a-f478-46f4-b813-38a801393eff None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:51.838976 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3184a-f478-46f4-b813-38a801393eff None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:51.846566 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e3184a-f478-46f4-b813-38a801393eff None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:51.848438 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e3184a-f478-46f4-b813-38a801393eff None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:51.860560 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-b2e3184a-f478-46f4-b813-38a801393eff None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 15:23:51.860560 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:51.860560 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:51.860560 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:51.860560 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:51.860560 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:51.860560 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:51.860560 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:51.860560 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:51.860560 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:51.860560 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:51.860560 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:51.860560 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:23:51.860560 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:23:51.860560 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:23:51.860560 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:23:51.861471 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:51.861471 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:51.861471 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:23:51.861471 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:23:51.861471 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:23:51.861471 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:23:51.861471 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:51.861471 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:51.861471 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:51.861471 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:51.861471 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:51.861471 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:51.861471 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:51.861471 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:51.861471 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:51.861471 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:51.861471 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:51.861471 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:51.862409 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:51.862409 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:51.862409 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:23:51.862409 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:23:51.862409 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:23:51.862409 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:23:51.862409 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:23:51.862409 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:23:51.862409 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 15:23:51.862409 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:51.865580 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 503/978] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:23:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:51.872577 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586469a-f5e4-45d5-b0b1-cbbd67632ef1 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:51.876989 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708a2d8-c74e-40df-acbd-1c21623064c9 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:51.877278 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708a2d8-c74e-40df-acbd-1c21623064c9 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:51.877551 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708a2d8-c74e-40df-acbd-1c21623064c9 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:51.879093 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 504/979] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:23:51.883840 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c498c9b-5926-45ab-b969-54ac96df7af6 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:51.884122 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c498c9b-5926-45ab-b969-54ac96df7af6 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:51.884390 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c498c9b-5926-45ab-b969-54ac96df7af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:51.897588 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:51.903693 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-5c498c9b-5926-45ab-b969-54ac96df7af6 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:51.904888 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5c498c9b-5926-45ab-b969-54ac96df7af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:51.983471 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 505/980] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 15:23:51.999991 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586469a-f5e4-45d5-b0b1-cbbd67632ef1 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:52.037226 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd6788-e222-46f2-9ff8-71ce3114fe24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:52.038246 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd6788-e222-46f2-9ff8-71ce3114fe24 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:52.038736 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd6788-e222-46f2-9ff8-71ce3114fe24 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:52.039275 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd6788-e222-46f2-9ff8-71ce3114fe24 None admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:52.040183 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fd6788-e222-46f2-9ff8-71ce3114fe24 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:52.040677 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fd6788-e222-46f2-9ff8-71ce3114fe24 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:52.042539 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fd6788-e222-46f2-9ff8-71ce3114fe24 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:52.086626 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 476/981] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 15:23:51 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:52.260122 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c498c9b-5926-45ab-b969-54ac96df7af6 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:52.367692 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c498c9b-5926-45ab-b969-54ac96df7af6 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:52.402220 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2e2f1-9367-4ce7-8c47-1cbb5109a379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:52.402827 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2e2f1-9367-4ce7-8c47-1cbb5109a379 None admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:52.403133 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2e2f1-9367-4ce7-8c47-1cbb5109a379 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:52.403408 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2e2f1-9367-4ce7-8c47-1cbb5109a379 None admin] PATH_INFO: `/v3/services` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:52.404051 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf2e2f1-9367-4ce7-8c47-1cbb5109a379 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:52.405418 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf2e2f1-9367-4ce7-8c47-1cbb5109a379 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:52.409550 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:52.422931 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 506/982] 10.222.0.83 () {60 vars in 1141 bytes} [Mon Aug 29 15:23:52 2022] POST /identity/v3/services => generated 242 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:23:53.077448 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18169816-a771-4c87-85aa-7904b3f97b28 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:53.077958 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18169816-a771-4c87-85aa-7904b3f97b28 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:53.077958 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18169816-a771-4c87-85aa-7904b3f97b28 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:53.079429 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 477/983] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:23:53.084557 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5816c45-e1fd-4024-bccc-b420abeffe28 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:53.084859 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5816c45-e1fd-4024-bccc-b420abeffe28 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:53.085116 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5816c45-e1fd-4024-bccc-b420abeffe28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:53.104528 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-b5816c45-e1fd-4024-bccc-b420abeffe28 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:53.105736 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b5816c45-e1fd-4024-bccc-b420abeffe28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:53.108129 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6e2c2-ec8e-4e5c-8e46-f051b90f6e8e None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:53.108396 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6e2c2-ec8e-4e5c-8e46-f051b90f6e8e None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:53.108670 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6e2c2-ec8e-4e5c-8e46-f051b90f6e8e None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:53.110010 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 478/984] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:23:53.115413 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e7f88-e3c6-4751-9116-f38d76c00e89 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:53.117070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e7f88-e3c6-4751-9116-f38d76c00e89 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:53.117070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e7f88-e3c6-4751-9116-f38d76c00e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:53.134674 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-be2e7f88-e3c6-4751-9116-f38d76c00e89 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:53.136211 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-be2e7f88-e3c6-4751-9116-f38d76c00e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:53.147316 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:53.192020 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 507/985] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:53 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:23:53.209183 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 479/986] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:53 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 15:23:53.461482 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5816c45-e1fd-4024-bccc-b420abeffe28 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:53.478943 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e7f88-e3c6-4751-9116-f38d76c00e89 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:53.574675 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5816c45-e1fd-4024-bccc-b420abeffe28 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:53.590064 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e7f88-e3c6-4751-9116-f38d76c00e89 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:53.601417 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:53.614034 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7687d23-9f00-49b3-bce9-bcb1beb2da99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:53.614673 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7687d23-9f00-49b3-bce9-bcb1beb2da99 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:53.614951 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7687d23-9f00-49b3-bce9-bcb1beb2da99 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:53.615781 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7687d23-9f00-49b3-bce9-bcb1beb2da99 None admin] PATH_INFO: `/v3/services/image` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:53.616442 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7687d23-9f00-49b3-bce9-bcb1beb2da99 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:53.617814 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7687d23-9f00-49b3-bce9-bcb1beb2da99 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:53.626865 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-e7687d23-9f00-49b3-bce9-bcb1beb2da99 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 15:23:53.626865 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:53.626865 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:23:53.626865 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:23:53.626865 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:23:53.626865 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:23:53.626865 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:23:53.626865 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:23:53.626865 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 15:23:53.626865 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:53.626865 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:23:53.626865 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:53.626865 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:53.626865 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:53.626865 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:53.626865 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:53.626865 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:53.627860 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:53.627860 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:53.627860 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:53.627860 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:53.627860 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:53.627860 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:53.627860 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:23:53.627860 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:23:53.627860 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:23:53.627860 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:23:53.627860 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:53.627860 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:53.627860 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:53.627860 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:53.627860 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:53.627860 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:53.628718 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:53.628718 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:53.628718 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:53.628718 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:53.628718 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:53.628718 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:53.628718 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:53.628718 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:53.628718 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:53.628718 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:53.628718 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:23:53.628718 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:23:53.628718 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 15:23:53.628718 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:53.628718 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 508/987] 10.222.0.83 () {56 vars in 1105 bytes} [Mon Aug 29 15:23:53 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:53.634515 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7687d23-9f00-49b3-bce9-bcb1beb2da99 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:53.635057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff2622-1b03-40e4-95b6-45d50686acc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:53.635709 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff2622-1b03-40e4-95b6-45d50686acc7 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:53.635983 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff2622-1b03-40e4-95b6-45d50686acc7 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:53.636248 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff2622-1b03-40e4-95b6-45d50686acc7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:53.636832 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ff2622-1b03-40e4-95b6-45d50686acc7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:53.638184 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ff2622-1b03-40e4-95b6-45d50686acc7 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:53.647309 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-48ff2622-1b03-40e4-95b6-45d50686acc7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 15:23:53.647309 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:53.647309 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:23:53.647309 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:23:53.647309 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:23:53.647309 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:23:53.647309 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:23:53.647309 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:23:53.647309 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 15:23:53.647309 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:53.647309 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:23:53.647309 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:53.647309 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:53.647309 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:53.647309 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:53.647309 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:53.647309 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:53.649726 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:53.649726 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:53.649726 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:53.649726 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:53.649726 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:53.649726 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:53.649726 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:23:53.649726 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:23:53.649726 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:23:53.649726 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:23:53.649726 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:53.649726 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:53.649726 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:53.649726 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:53.649726 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:53.649726 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:53.650554 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:53.650554 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:53.650554 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:53.650554 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:53.650554 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:53.650554 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:53.650554 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:53.650554 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:53.650554 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:53.650554 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:53.650554 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:23:53.650554 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:23:53.650554 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 15:23:53.650554 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:53.650554 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 480/988] 10.222.0.83 () {56 vars in 1126 bytes} [Mon Aug 29 15:23:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:23:53.654229 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff2622-1b03-40e4-95b6-45d50686acc7 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:53.667450 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:53.755369 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7687d23-9f00-49b3-bce9-bcb1beb2da99 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:53.768275 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff2622-1b03-40e4-95b6-45d50686acc7 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:53.790323 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1992ec4-6bc0-40b9-a561-e5ff9ee87e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:53.790974 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1992ec4-6bc0-40b9-a561-e5ff9ee87e6e None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:53.791292 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1992ec4-6bc0-40b9-a561-e5ff9ee87e6e None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:53.791569 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1992ec4-6bc0-40b9-a561-e5ff9ee87e6e None admin] PATH_INFO: `/v3/services` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:53.792206 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1992ec4-6bc0-40b9-a561-e5ff9ee87e6e None admin] RBAC: Adding query filter params (name=image) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:53.792522 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1992ec4-6bc0-40b9-a561-e5ff9ee87e6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:53.793891 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1992ec4-6bc0-40b9-a561-e5ff9ee87e6e None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:53.798771 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 509/989] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:53 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:23:53.804947 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1992ec4-6bc0-40b9-a561-e5ff9ee87e6e None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:53.812966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab913f8-8c70-4d3c-9591-bc02e2b06398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:53.813564 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab913f8-8c70-4d3c-9591-bc02e2b06398 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:53.813843 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab913f8-8c70-4d3c-9591-bc02e2b06398 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:53.814539 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab913f8-8c70-4d3c-9591-bc02e2b06398 None admin] PATH_INFO: `/v3/services` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:53.815208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab913f8-8c70-4d3c-9591-bc02e2b06398 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:53.815518 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab913f8-8c70-4d3c-9591-bc02e2b06398 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:53.817257 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab913f8-8c70-4d3c-9591-bc02e2b06398 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:53.827062 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 481/990] 10.222.0.83 () {56 vars in 1122 bytes} [Mon Aug 29 15:23:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:23:53.829320 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab913f8-8c70-4d3c-9591-bc02e2b06398 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:53.863174 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:53.907378 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:53.920719 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1992ec4-6bc0-40b9-a561-e5ff9ee87e6e None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:53.936898 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab913f8-8c70-4d3c-9591-bc02e2b06398 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:53.957808 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92e887-260d-4083-94d8-c368e1cd89a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:53.958424 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92e887-260d-4083-94d8-c368e1cd89a8 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:53.958707 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92e887-260d-4083-94d8-c368e1cd89a8 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:53.958979 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92e887-260d-4083-94d8-c368e1cd89a8 None admin] PATH_INFO: `/v3/services` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:53.959908 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc92e887-260d-4083-94d8-c368e1cd89a8 None admin] RBAC: Adding query filter params (type=image) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:53.960214 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc92e887-260d-4083-94d8-c368e1cd89a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:53.961598 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc92e887-260d-4083-94d8-c368e1cd89a8 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:53.975498 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 510/991] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:53 2022] GET /identity/v3/services?type=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:23:53.982359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20883465-f168-4c5a-9411-c1a1ae081fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:53.983382 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20883465-f168-4c5a-9411-c1a1ae081fa0 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:53.983724 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20883465-f168-4c5a-9411-c1a1ae081fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:53.984061 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20883465-f168-4c5a-9411-c1a1ae081fa0 None admin] PATH_INFO: `/v3/services` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:53.984782 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20883465-f168-4c5a-9411-c1a1ae081fa0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:53.985167 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20883465-f168-4c5a-9411-c1a1ae081fa0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:53.986653 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20883465-f168-4c5a-9411-c1a1ae081fa0 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:53.995439 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 482/992] 10.222.0.83 () {56 vars in 1122 bytes} [Mon Aug 29 15:23:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:23:53.999393 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92e887-260d-4083-94d8-c368e1cd89a8 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:54.111611 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92e887-260d-4083-94d8-c368e1cd89a8 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:54.128676 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:54.150906 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96523bce-08b9-4117-aa9b-f7a44d33a2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:54.153270 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96523bce-08b9-4117-aa9b-f7a44d33a2a4 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:54.153553 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96523bce-08b9-4117-aa9b-f7a44d33a2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:54.153819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96523bce-08b9-4117-aa9b-f7a44d33a2a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:54.154534 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96523bce-08b9-4117-aa9b-f7a44d33a2a4 None admin] RBAC: Adding query filter params (interface=admin, service_id=23904f33ca88445faad0204fc3519f5f, region_id=RegionOne) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:54.154842 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96523bce-08b9-4117-aa9b-f7a44d33a2a4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:54.156238 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96523bce-08b9-4117-aa9b-f7a44d33a2a4 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:54.161664 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 511/993] 10.222.0.83 () {56 vars in 1249 bytes} [Mon Aug 29 15:23:53 2022] GET /identity/v3/endpoints?service_id=23904f33ca88445faad0204fc3519f5f&interface=admin®ion_id=RegionOne => generated 193 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:23:54.168500 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20883465-f168-4c5a-9411-c1a1ae081fa0 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:54.271179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20883465-f168-4c5a-9411-c1a1ae081fa0 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:54.306520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff0673-3f55-494d-8236-aecaa6ef7ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:54.307491 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff0673-3f55-494d-8236-aecaa6ef7ec2 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:54.307947 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff0673-3f55-494d-8236-aecaa6ef7ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:54.308391 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff0673-3f55-494d-8236-aecaa6ef7ec2 None admin] PATH_INFO: `/v3/services` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:54.309227 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff0673-3f55-494d-8236-aecaa6ef7ec2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:54.310788 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff0673-3f55-494d-8236-aecaa6ef7ec2 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:54.317659 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 483/994] 10.222.0.83 () {56 vars in 1087 bytes} [Mon Aug 29 15:23:54 2022] GET /identity/v3/services => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:23:54.378286 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d556a3-67e3-46a5-870a-42c312dbb399 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:54.378537 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d556a3-67e3-46a5-870a-42c312dbb399 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:54.378762 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d556a3-67e3-46a5-870a-42c312dbb399 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:54.380380 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 512/995] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:23:54.386005 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2e2c8-f4f7-481c-8cbc-03ce0a1c85ab None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:54.386312 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2e2c8-f4f7-481c-8cbc-03ce0a1c85ab None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:54.386572 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2e2c8-f4f7-481c-8cbc-03ce0a1c85ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:54.393056 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:54.406792 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-46d2e2c8-f4f7-481c-8cbc-03ce0a1c85ab None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:54.408054 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-46d2e2c8-f4f7-481c-8cbc-03ce0a1c85ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:54.484573 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 484/996] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:54 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:23:54.751160 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d556a3-67e3-46a5-870a-42c312dbb399 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:54.858140 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d556a3-67e3-46a5-870a-42c312dbb399 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:54.892347 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11970da5-82c1-4384-99a8-72b837baf3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:54.893322 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11970da5-82c1-4384-99a8-72b837baf3e7 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:54.893739 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11970da5-82c1-4384-99a8-72b837baf3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:54.894145 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11970da5-82c1-4384-99a8-72b837baf3e7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:54.894884 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11970da5-82c1-4384-99a8-72b837baf3e7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:54.896426 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11970da5-82c1-4384-99a8-72b837baf3e7 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:54.906368 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-11970da5-82c1-4384-99a8-72b837baf3e7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 15:23:54.906368 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:54.906368 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:23:54.906368 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:23:54.906368 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:23:54.906368 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:23:54.906368 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:23:54.906368 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:23:54.906368 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 15:23:54.906368 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:54.906368 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:23:54.906368 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:54.906368 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:54.906368 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:54.906368 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:54.906368 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:54.906368 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:54.907458 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:54.907458 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:54.907458 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:54.907458 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:54.907458 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:54.907458 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:54.907458 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:23:54.907458 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:23:54.907458 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:23:54.907458 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:23:54.907458 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:54.907458 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:54.907458 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:54.907458 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:54.907458 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:54.907458 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:54.908302 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:54.908302 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:54.908302 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:54.908302 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:54.908302 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:54.908302 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:54.908302 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:54.908302 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:54.908302 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:54.908302 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:54.908302 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:23:54.908302 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:23:54.908302 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 15:23:54.908302 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:54.908302 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 513/997] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:23:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:54.915692 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2e2c8-f4f7-481c-8cbc-03ce0a1c85ab None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:55.018375 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2e2c8-f4f7-481c-8cbc-03ce0a1c85ab None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:55.050505 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:55.056776 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a37c6c4-fcc7-45d7-8cb1-154e0ea91f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:55.057169 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37c6c4-fcc7-45d7-8cb1-154e0ea91f1f None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:55.057446 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37c6c4-fcc7-45d7-8cb1-154e0ea91f1f None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:55.057720 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37c6c4-fcc7-45d7-8cb1-154e0ea91f1f None admin] PATH_INFO: `/v3/services` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:55.058348 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a37c6c4-fcc7-45d7-8cb1-154e0ea91f1f None admin] RBAC: Adding query filter params (name=compute) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:55.058650 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a37c6c4-fcc7-45d7-8cb1-154e0ea91f1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:55.060052 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a37c6c4-fcc7-45d7-8cb1-154e0ea91f1f None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:55.069755 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 485/998] 10.222.0.83 () {56 vars in 1112 bytes} [Mon Aug 29 15:23:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:55.071163 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11970da5-82c1-4384-99a8-72b837baf3e7 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:55.120901 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:55.181032 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11970da5-82c1-4384-99a8-72b837baf3e7 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:55.215850 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad8f22-39d3-4190-be3e-05d30cb892c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:55.216453 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad8f22-39d3-4190-be3e-05d30cb892c4 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:55.216727 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad8f22-39d3-4190-be3e-05d30cb892c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:55.217002 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad8f22-39d3-4190-be3e-05d30cb892c4 None admin] PATH_INFO: `/v3/services` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:55.217622 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad8f22-39d3-4190-be3e-05d30cb892c4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:55.217920 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad8f22-39d3-4190-be3e-05d30cb892c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:55.219356 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad8f22-39d3-4190-be3e-05d30cb892c4 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:55.229220 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 514/999] 10.222.0.83 () {56 vars in 1112 bytes} [Mon Aug 29 15:23:55 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:55.230825 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a37c6c4-fcc7-45d7-8cb1-154e0ea91f1f None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:55.334479 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a37c6c4-fcc7-45d7-8cb1-154e0ea91f1f None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:55.370636 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88d317-d215-4111-bb05-e059f8561054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:55.371273 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88d317-d215-4111-bb05-e059f8561054 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:55.371548 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88d317-d215-4111-bb05-e059f8561054 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:55.371813 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88d317-d215-4111-bb05-e059f8561054 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:55.372502 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f88d317-d215-4111-bb05-e059f8561054 None admin] RBAC: Adding query filter params (interface=public, service_id=80b1a84ecd59492f85987d556d43139c, region_id=RegionOne) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:55.372802 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f88d317-d215-4111-bb05-e059f8561054 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:55.374312 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f88d317-d215-4111-bb05-e059f8561054 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:55.379641 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 486/1000] 10.222.0.83 () {56 vars in 1251 bytes} [Mon Aug 29 15:23:55 2022] GET /identity/v3/endpoints?service_id=80b1a84ecd59492f85987d556d43139c&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:55.385117 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad8f22-39d3-4190-be3e-05d30cb892c4 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:55.488862 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad8f22-39d3-4190-be3e-05d30cb892c4 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:55.499013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:55.530049 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e7caf-cfd5-4151-8939-36a01b098ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:55.530637 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e7caf-cfd5-4151-8939-36a01b098ac9 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:55.530916 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e7caf-cfd5-4151-8939-36a01b098ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:55.531212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e7caf-cfd5-4151-8939-36a01b098ac9 None admin] PATH_INFO: `/v3/services` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:55.531810 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e7caf-cfd5-4151-8939-36a01b098ac9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:55.533170 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e7caf-cfd5-4151-8939-36a01b098ac9 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:55.540205 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 515/1001] 10.222.0.83 () {56 vars in 1087 bytes} [Mon Aug 29 15:23:55 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:23:55.925095 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af712f-eecd-4bb7-8f28-1339dc2f10e5 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:55.925379 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af712f-eecd-4bb7-8f28-1339dc2f10e5 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:55.925657 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af712f-eecd-4bb7-8f28-1339dc2f10e5 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:55.927006 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 487/1002] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:23:55.932776 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d1974-3d03-4040-be89-c3e976347667 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:55.933262 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d1974-3d03-4040-be89-c3e976347667 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:55.933351 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d1974-3d03-4040-be89-c3e976347667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:55.952176 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-121d1974-3d03-4040-be89-c3e976347667 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:55.953303 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-121d1974-3d03-4040-be89-c3e976347667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:56.028219 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 516/1003] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:55 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:23:56.272868 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff4ed9-cdaf-4a45-8a53-8f049b4fb426 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:56.273401 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff4ed9-cdaf-4a45-8a53-8f049b4fb426 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:56.273401 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff4ed9-cdaf-4a45-8a53-8f049b4fb426 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:56.275454 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 488/1004] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:23:56.281287 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c227f1-ac0b-4cbf-828d-d459459ff05a None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:56.281669 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c227f1-ac0b-4cbf-828d-d459459ff05a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:56.282011 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c227f1-ac0b-4cbf-828d-d459459ff05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:56.297525 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff4ed9-cdaf-4a45-8a53-8f049b4fb426 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:56.300182 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-86c227f1-ac0b-4cbf-828d-d459459ff05a None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:56.301360 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-86c227f1-ac0b-4cbf-828d-d459459ff05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:56.363964 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:56.374353 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 517/1005] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:56 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:23:56.410186 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff4ed9-cdaf-4a45-8a53-8f049b4fb426 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:56.445789 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06637bef-dfcc-4d0a-b8de-8474b683c2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:56.446394 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06637bef-dfcc-4d0a-b8de-8474b683c2a8 None admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:56.447513 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06637bef-dfcc-4d0a-b8de-8474b683c2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:56.447787 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06637bef-dfcc-4d0a-b8de-8474b683c2a8 None admin] PATH_INFO: `/v3/services` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:56.448441 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06637bef-dfcc-4d0a-b8de-8474b683c2a8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:56.449874 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06637bef-dfcc-4d0a-b8de-8474b683c2a8 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:56.468552 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 489/1006] 10.222.0.83 () {60 vars in 1141 bytes} [Mon Aug 29 15:23:56 2022] POST /identity/v3/services => generated 242 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:23:56.648173 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c227f1-ac0b-4cbf-828d-d459459ff05a None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:56.680423 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:56.760870 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c227f1-ac0b-4cbf-828d-d459459ff05a None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:56.802603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7afb0-383c-4827-93d1-1a10813e833c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:56.803275 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7afb0-383c-4827-93d1-1a10813e833c None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:56.803556 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7afb0-383c-4827-93d1-1a10813e833c None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:56.803826 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7afb0-383c-4827-93d1-1a10813e833c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:56.804410 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f7afb0-383c-4827-93d1-1a10813e833c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:56.805779 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f7afb0-383c-4827-93d1-1a10813e833c None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:56.815502 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-73f7afb0-383c-4827-93d1-1a10813e833c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 15:23:56.815502 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:56.815502 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:23:56.815502 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:23:56.815502 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:23:56.815502 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:23:56.815502 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:23:56.815502 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:23:56.815502 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 15:23:56.815502 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:56.815502 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:23:56.815502 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:56.815502 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:56.815502 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:56.815502 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:56.815502 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:56.815502 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:56.816480 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:56.816480 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:56.816480 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:56.816480 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:56.816480 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:56.816480 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:56.816480 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:23:56.816480 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:23:56.816480 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:23:56.816480 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:23:56.816480 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:56.816480 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:56.816480 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:56.816480 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:56.816480 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:56.816480 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:56.817319 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:56.817319 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:56.817319 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:56.817319 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:56.817319 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:56.817319 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:56.817319 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:56.817319 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:56.817319 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:56.817319 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:56.817319 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:23:56.817319 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:23:56.817319 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 15:23:56.817319 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:56.819116 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 518/1007] 10.222.0.83 () {56 vars in 1126 bytes} [Mon Aug 29 15:23:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:56.823058 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06637bef-dfcc-4d0a-b8de-8474b683c2a8 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:56.927861 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06637bef-dfcc-4d0a-b8de-8474b683c2a8 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:56.949658 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:56.966467 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd6f58-74a7-42a9-947d-fba563a41802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:56.967132 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd6f58-74a7-42a9-947d-fba563a41802 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:56.967408 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd6f58-74a7-42a9-947d-fba563a41802 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:56.967684 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd6f58-74a7-42a9-947d-fba563a41802 None admin] PATH_INFO: `/v3/services` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:56.968305 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd6f58-74a7-42a9-947d-fba563a41802 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:56.968603 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd6f58-74a7-42a9-947d-fba563a41802 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:56.970001 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd6f58-74a7-42a9-947d-fba563a41802 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:56.979262 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 490/1008] 10.222.0.83 () {56 vars in 1122 bytes} [Mon Aug 29 15:23:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:56.981910 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7afb0-383c-4827-93d1-1a10813e833c None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:57.081098 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:57.093086 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7afb0-383c-4827-93d1-1a10813e833c None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:57.130873 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809d7b7-b35b-4c1d-a559-8d763b60f8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:57.131571 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809d7b7-b35b-4c1d-a559-8d763b60f8f0 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:57.131917 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809d7b7-b35b-4c1d-a559-8d763b60f8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:57.132194 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809d7b7-b35b-4c1d-a559-8d763b60f8f0 None admin] PATH_INFO: `/v3/services` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:57.133011 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f809d7b7-b35b-4c1d-a559-8d763b60f8f0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:57.133318 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f809d7b7-b35b-4c1d-a559-8d763b60f8f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:57.134765 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f809d7b7-b35b-4c1d-a559-8d763b60f8f0 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:57.144361 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 519/1009] 10.222.0.83 () {56 vars in 1122 bytes} [Mon Aug 29 15:23:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:57.145920 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd6f58-74a7-42a9-947d-fba563a41802 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:57.254732 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd6f58-74a7-42a9-947d-fba563a41802 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:57.292761 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52cf009-67da-4103-ba9c-228f58cea2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:57.293424 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52cf009-67da-4103-ba9c-228f58cea2d6 None admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:57.293646 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52cf009-67da-4103-ba9c-228f58cea2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:57.293917 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52cf009-67da-4103-ba9c-228f58cea2d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:57.294589 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52cf009-67da-4103-ba9c-228f58cea2d6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:57.296037 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52cf009-67da-4103-ba9c-228f58cea2d6 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:57.313962 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 491/1010] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:23:57 2022] POST /identity/v3/endpoints => generated 325 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:23:57.460842 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293f787-cb90-459d-996e-175e1330a925 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:57.461120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293f787-cb90-459d-996e-175e1330a925 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:57.461391 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293f787-cb90-459d-996e-175e1330a925 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:57.462724 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 520/1011] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:23:57.468304 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ddd244-48b8-41f7-8e64-315331aa62ed None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:57.468585 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ddd244-48b8-41f7-8e64-315331aa62ed None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:57.468860 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ddd244-48b8-41f7-8e64-315331aa62ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:57.488609 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a3ddd244-48b8-41f7-8e64-315331aa62ed None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:57.489805 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a3ddd244-48b8-41f7-8e64-315331aa62ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:57.537729 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:57.574907 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 492/1012] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:57 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:23:57.840702 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9293f787-cb90-459d-996e-175e1330a925 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:57.949539 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9293f787-cb90-459d-996e-175e1330a925 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:57.988454 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba9afb-6007-4af5-b2c9-f7de545d2f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:57.989275 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba9afb-6007-4af5-b2c9-f7de545d2f0c None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:57.989435 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba9afb-6007-4af5-b2c9-f7de545d2f0c None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:57.989589 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba9afb-6007-4af5-b2c9-f7de545d2f0c None admin] PATH_INFO: `/v3/services/compute` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:57.990227 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba9afb-6007-4af5-b2c9-f7de545d2f0c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:57.991664 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba9afb-6007-4af5-b2c9-f7de545d2f0c None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:58.001192 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-8dba9afb-6007-4af5-b2c9-f7de545d2f0c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 15:23:58.001192 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:58.001192 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:23:58.001192 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:23:58.001192 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:23:58.001192 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:23:58.001192 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:23:58.001192 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:23:58.001192 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 15:23:58.001192 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:58.001192 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:23:58.001192 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:58.001192 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:58.001192 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:58.001192 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:58.001192 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:58.001192 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:58.007755 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:58.007755 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:58.007755 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:58.007755 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:58.007755 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:58.007755 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:58.007755 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:23:58.007755 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:23:58.007755 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:23:58.007755 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:23:58.007755 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:58.007755 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:58.007755 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:58.007755 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:58.007755 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:58.007755 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:58.008632 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:58.008632 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:58.008632 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:58.008632 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:58.008632 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:58.008632 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:58.008632 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:58.008632 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:58.008632 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:58.008632 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:58.008632 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:23:58.008632 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:23:58.008632 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 15:23:58.008632 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:23:58.008632 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 521/1013] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:23:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:58.009499 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ddd244-48b8-41f7-8e64-315331aa62ed None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:58.117738 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ddd244-48b8-41f7-8e64-315331aa62ed None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:58.151160 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a985e-0629-4e88-8f08-98b0f04cbc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:58.152447 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a985e-0629-4e88-8f08-98b0f04cbc51 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:58.152822 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a985e-0629-4e88-8f08-98b0f04cbc51 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:58.153187 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a985e-0629-4e88-8f08-98b0f04cbc51 None admin] PATH_INFO: `/v3/services` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:58.153929 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a985e-0629-4e88-8f08-98b0f04cbc51 None admin] RBAC: Adding query filter params (name=compute) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:58.154228 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a985e-0629-4e88-8f08-98b0f04cbc51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:58.155635 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a985e-0629-4e88-8f08-98b0f04cbc51 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:58.165333 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 493/1014] 10.222.0.83 () {56 vars in 1112 bytes} [Mon Aug 29 15:23:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:58.166444 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba9afb-6007-4af5-b2c9-f7de545d2f0c None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:58.188402 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:58.272725 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba9afb-6007-4af5-b2c9-f7de545d2f0c None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:58.307104 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e40686-6e28-4af4-962c-2a3bfda52533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:58.307799 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e40686-6e28-4af4-962c-2a3bfda52533 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:58.308088 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e40686-6e28-4af4-962c-2a3bfda52533 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:58.308365 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e40686-6e28-4af4-962c-2a3bfda52533 None admin] PATH_INFO: `/v3/services` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:58.309046 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e40686-6e28-4af4-962c-2a3bfda52533 None admin] RBAC: Adding query filter params (type=compute) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:58.309353 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e40686-6e28-4af4-962c-2a3bfda52533 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:58.310740 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e40686-6e28-4af4-962c-2a3bfda52533 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:58.320386 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 522/1015] 10.222.0.83 () {56 vars in 1112 bytes} [Mon Aug 29 15:23:58 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:23:58.321495 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a985e-0629-4e88-8f08-98b0f04cbc51 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:58.361052 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:58.428644 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f740eae-c65b-4dd0-8988-6b103591f557 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:58.428845 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f740eae-c65b-4dd0-8988-6b103591f557 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:58.429097 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f740eae-c65b-4dd0-8988-6b103591f557 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:58.430451 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 523/1016] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:23:58.436554 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c12926-d89b-4e7e-a945-b3a3f531f2ac None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:58.436950 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c12926-d89b-4e7e-a945-b3a3f531f2ac None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:58.437234 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c12926-d89b-4e7e-a945-b3a3f531f2ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:58.442585 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a985e-0629-4e88-8f08-98b0f04cbc51 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:58.456872 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-d6c12926-d89b-4e7e-a945-b3a3f531f2ac None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:58.458126 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d6c12926-d89b-4e7e-a945-b3a3f531f2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:58.484068 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0096e7-afef-41a0-a6c9-a31ef876ce40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:58.484686 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0096e7-afef-41a0-a6c9-a31ef876ce40 None admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:58.484964 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0096e7-afef-41a0-a6c9-a31ef876ce40 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:58.485233 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0096e7-afef-41a0-a6c9-a31ef876ce40 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:58.485922 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0096e7-afef-41a0-a6c9-a31ef876ce40 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:58.487317 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0096e7-afef-41a0-a6c9-a31ef876ce40 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:58.510710 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 494/1017] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:23:58 2022] POST /identity/v3/endpoints => generated 334 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:23:58.547132 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 524/1018] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:58 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 15:23:58.817008 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0096e7-afef-41a0-a6c9-a31ef876ce40 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:58.945803 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:58.958915 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0096e7-afef-41a0-a6c9-a31ef876ce40 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:59.003207 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a49e1-232e-4696-8d02-96796a67c344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:59.004383 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a49e1-232e-4696-8d02-96796a67c344 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:59.004961 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a49e1-232e-4696-8d02-96796a67c344 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:59.005414 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a49e1-232e-4696-8d02-96796a67c344 None admin] PATH_INFO: `/v3/services/image` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:59.006156 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489a49e1-232e-4696-8d02-96796a67c344 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:59.007709 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489a49e1-232e-4696-8d02-96796a67c344 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:59.017583 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-489a49e1-232e-4696-8d02-96796a67c344 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 15:23:59.017583 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:59.017583 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:23:59.017583 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:23:59.017583 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:23:59.017583 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:23:59.017583 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:23:59.017583 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:23:59.017583 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 15:23:59.017583 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:59.017583 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:23:59.017583 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:59.017583 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:23:59.017583 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:23:59.017583 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:23:59.017583 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:23:59.017583 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:23:59.018721 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:23:59.018721 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:23:59.018721 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:23:59.018721 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:23:59.018721 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:23:59.018721 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:23:59.018721 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:23:59.018721 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:23:59.018721 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:23:59.018721 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:23:59.018721 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:23:59.018721 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:23:59.018721 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:23:59.018721 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:23:59.018721 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:23:59.018721 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:23:59.019614 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:23:59.019614 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:23:59.019614 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:23:59.019614 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:23:59.019614 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:23:59.019614 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:23:59.019614 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:23:59.019614 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:23:59.019614 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:23:59.019614 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:23:59.019614 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:23:59.019614 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:23:59.019614 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 15:23:59.019614 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:23:59.023095 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 495/1019] 10.222.0.83 () {56 vars in 1105 bytes} [Mon Aug 29 15:23:58 2022] GET /identity/v3/services/image => generated 86 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:23:59.025541 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c12926-d89b-4e7e-a945-b3a3f531f2ac None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:59.036354 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:59.132601 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c12926-d89b-4e7e-a945-b3a3f531f2ac None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:59.167328 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7d035-d9b8-49de-81c1-f607ca52eb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:59.167945 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7d035-d9b8-49de-81c1-f607ca52eb76 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:59.168786 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7d035-d9b8-49de-81c1-f607ca52eb76 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:59.169058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7d035-d9b8-49de-81c1-f607ca52eb76 None admin] PATH_INFO: `/v3/services` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:59.170848 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e7d035-d9b8-49de-81c1-f607ca52eb76 None admin] RBAC: Adding query filter params (name=image) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:59.170848 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e7d035-d9b8-49de-81c1-f607ca52eb76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:59.171556 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e7d035-d9b8-49de-81c1-f607ca52eb76 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:59.181491 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 525/1020] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:59.182669 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a49e1-232e-4696-8d02-96796a67c344 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:59.289998 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a49e1-232e-4696-8d02-96796a67c344 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:59.324359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de940f1-9de2-4a95-a972-e599af301110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:59.325284 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de940f1-9de2-4a95-a972-e599af301110 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:59.325582 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de940f1-9de2-4a95-a972-e599af301110 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:59.325849 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de940f1-9de2-4a95-a972-e599af301110 None admin] PATH_INFO: `/v3/services` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:59.326475 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de940f1-9de2-4a95-a972-e599af301110 None admin] RBAC: Adding query filter params (type=image) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:59.327276 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de940f1-9de2-4a95-a972-e599af301110 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:59.328142 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de940f1-9de2-4a95-a972-e599af301110 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:59.338217 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 496/1021] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:59 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:59.339472 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7d035-d9b8-49de-81c1-f607ca52eb76 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:59.352229 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b318d31-3d1d-44fd-8484-93f492a7db16 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:59.352508 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b318d31-3d1d-44fd-8484-93f492a7db16 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:59.352780 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b318d31-3d1d-44fd-8484-93f492a7db16 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:59.354228 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 497/1022] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:23:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:23:59.359724 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246fb6f-495e-4c47-8e96-9ec9a9ce0437 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:59.360003 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246fb6f-495e-4c47-8e96-9ec9a9ce0437 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:59.360272 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246fb6f-495e-4c47-8e96-9ec9a9ce0437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:59.378308 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-c246fb6f-495e-4c47-8e96-9ec9a9ce0437 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:59.379508 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c246fb6f-495e-4c47-8e96-9ec9a9ce0437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:59.392824 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:59.414039 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:59.448522 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7d035-d9b8-49de-81c1-f607ca52eb76 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:59.450540 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 498/1023] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:23:59 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 15:23:59.485374 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f8903-b9f9-4f0a-845a-a6b15bc7dce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:59.486079 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f8903-b9f9-4f0a-845a-a6b15bc7dce4 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:59.486361 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f8903-b9f9-4f0a-845a-a6b15bc7dce4 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:59.486630 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f8903-b9f9-4f0a-845a-a6b15bc7dce4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:59.487405 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5f8903-b9f9-4f0a-845a-a6b15bc7dce4 None admin] RBAC: Adding query filter params (interface=public, service_id=65fe8b73340b434594aa911a1b5d65ae, region_id=RegionOne) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:23:59.487764 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5f8903-b9f9-4f0a-845a-a6b15bc7dce4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:59.489389 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5f8903-b9f9-4f0a-845a-a6b15bc7dce4 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:59.499061 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 526/1024] 10.222.0.83 () {56 vars in 1251 bytes} [Mon Aug 29 15:23:59 2022] GET /identity/v3/endpoints?service_id=65fe8b73340b434594aa911a1b5d65ae&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:59.501307 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246fb6f-495e-4c47-8e96-9ec9a9ce0437 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:59.608292 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246fb6f-495e-4c47-8e96-9ec9a9ce0437 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:59.644562 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d6378-0c84-4441-abce-e030da0c142e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:59.645173 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d6378-0c84-4441-abce-e030da0c142e None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:59.645448 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d6378-0c84-4441-abce-e030da0c142e None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:59.645717 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d6378-0c84-4441-abce-e030da0c142e None admin] PATH_INFO: `/v3/services` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:59.646321 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d6378-0c84-4441-abce-e030da0c142e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:59.647778 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d6378-0c84-4441-abce-e030da0c142e None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:59.663324 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 499/1025] 10.222.0.83 () {56 vars in 1087 bytes} [Mon Aug 29 15:23:59 2022] GET /identity/v3/services => generated 1957 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:23:59.734921 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f8903-b9f9-4f0a-845a-a6b15bc7dce4 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:59.853987 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f8903-b9f9-4f0a-845a-a6b15bc7dce4 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:59.892274 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff977c0-96fd-408d-acf9-5b77c7807ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:59.892830 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff977c0-96fd-408d-acf9-5b77c7807ed2 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:59.893107 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff977c0-96fd-408d-acf9-5b77c7807ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:59.893380 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff977c0-96fd-408d-acf9-5b77c7807ed2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:59.894514 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff977c0-96fd-408d-acf9-5b77c7807ed2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:59.895989 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff977c0-96fd-408d-acf9-5b77c7807ed2 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:59.899404 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 527/1026] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:23:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:59.903885 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d6378-0c84-4441-abce-e030da0c142e None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:59.925767 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:00.027489 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d6378-0c84-4441-abce-e030da0c142e None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:00.064593 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa15a0-99a2-430c-9a2c-ddbe090f93c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:00.065203 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa15a0-99a2-430c-9a2c-ddbe090f93c3 None admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:00.065481 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa15a0-99a2-430c-9a2c-ddbe090f93c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:00.065752 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa15a0-99a2-430c-9a2c-ddbe090f93c3 None admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:00.066411 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aa15a0-99a2-430c-9a2c-ddbe090f93c3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:00.067888 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aa15a0-99a2-430c-9a2c-ddbe090f93c3 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:00.096125 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 500/1027] 10.222.0.83 () {60 vars in 1141 bytes} [Mon Aug 29 15:23:59 2022] POST /identity/v3/projects => generated 311 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:24:00.598375 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e8fe75-6699-4d32-9846-a2fce07ae8e4 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:00.598933 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e8fe75-6699-4d32-9846-a2fce07ae8e4 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:00.599295 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e8fe75-6699-4d32-9846-a2fce07ae8e4 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:00.600650 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 528/1028] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:24:00.605507 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeeb9b6-a2c8-494c-8136-222475468b21 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:00.605897 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeeb9b6-a2c8-494c-8136-222475468b21 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:00.606061 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeeb9b6-a2c8-494c-8136-222475468b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:00.625577 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-0aeeb9b6-a2c8-494c-8136-222475468b21 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:24:00.626754 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0aeeb9b6-a2c8-494c-8136-222475468b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:24:00.688780 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:00.707174 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 501/1029] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:24:00 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:24:00.969605 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e8fe75-6699-4d32-9846-a2fce07ae8e4 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:00.974508 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:01.079540 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e8fe75-6699-4d32-9846-a2fce07ae8e4 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:01.114021 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc518519-76d2-429d-9bf7-70bce54d8140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:01.114658 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc518519-76d2-429d-9bf7-70bce54d8140 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:01.114936 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc518519-76d2-429d-9bf7-70bce54d8140 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:01.115481 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc518519-76d2-429d-9bf7-70bce54d8140 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:01.126188 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc518519-76d2-429d-9bf7-70bce54d8140 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:24:01.130991 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-dc518519-76d2-429d-9bf7-70bce54d8140 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 15:24:01.130991 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:24:01.130991 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:24:01.130991 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:24:01.130991 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:24:01.130991 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:24:01.130991 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:24:01.130991 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:24:01.130991 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:24:01.130991 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:24:01.130991 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:24:01.130991 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:24:01.130991 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:24:01.130991 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:24:01.130991 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:24:01.130991 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:24:01.132111 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:24:01.132111 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:24:01.132111 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:24:01.132111 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:24:01.132111 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:24:01.132111 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:24:01.132111 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:24:01.132111 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:24:01.132111 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:24:01.132111 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:24:01.132111 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:24:01.132111 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:24:01.132111 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:24:01.132111 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:24:01.132111 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:24:01.132111 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:24:01.132992 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:24:01.132992 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:24:01.132992 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:24:01.132992 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:24:01.132992 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:24:01.132992 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:24:01.132992 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:24:01.132992 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:24:01.132992 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:24:01.132992 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:24:01.132992 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 15:24:01.132992 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:24:01.135189 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 529/1030] 10.222.0.83 () {56 vars in 1120 bytes} [Mon Aug 29 15:24:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:24:01.138127 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeeb9b6-a2c8-494c-8136-222475468b21 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:01.246631 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeeb9b6-a2c8-494c-8136-222475468b21 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:01.282853 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0818f-874b-439f-9f33-eae2729293ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:01.283636 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0818f-874b-439f-9f33-eae2729293ab None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:01.283753 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0818f-874b-439f-9f33-eae2729293ab None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:01.284090 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0818f-874b-439f-9f33-eae2729293ab None admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:01.284695 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0818f-874b-439f-9f33-eae2729293ab None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:24:01.284991 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0818f-874b-439f-9f33-eae2729293ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:01.286383 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0818f-874b-439f-9f33-eae2729293ab None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:01.299663 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 502/1031] 10.222.0.83 () {56 vars in 1115 bytes} [Mon Aug 29 15:24:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:01.301094 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc518519-76d2-429d-9bf7-70bce54d8140 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:01.368272 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:01.410126 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc518519-76d2-429d-9bf7-70bce54d8140 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:01.446284 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2113d47e-ecb5-4f63-bf47-f583ab1c624a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:01.446927 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113d47e-ecb5-4f63-bf47-f583ab1c624a None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:01.447221 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113d47e-ecb5-4f63-bf47-f583ab1c624a None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:01.447553 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113d47e-ecb5-4f63-bf47-f583ab1c624a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:01.458864 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2113d47e-ecb5-4f63-bf47-f583ab1c624a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:01.460363 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2113d47e-ecb5-4f63-bf47-f583ab1c624a None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:01.475752 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-2113d47e-ecb5-4f63-bf47-f583ab1c624a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:24:01.475752 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:24:01.475752 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:24:01.475752 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:24:01.475752 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:24:01.475752 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:24:01.475752 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:24:01.475752 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:24:01.475752 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:24:01.475752 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:24:01.475752 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:24:01.475752 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:24:01.475752 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:24:01.475752 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:24:01.475752 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:24:01.475752 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:24:01.476775 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:24:01.476775 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:24:01.476775 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:24:01.476775 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:24:01.476775 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:24:01.476775 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:24:01.476775 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:24:01.476775 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:24:01.476775 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:24:01.476775 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:24:01.476775 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:24:01.476775 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:24:01.476775 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:24:01.476775 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:24:01.476775 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:24:01.476775 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:24:01.476775 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:24:01.477689 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:24:01.477689 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:24:01.477689 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:24:01.481883 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 530/1032] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:24:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:24:01.482680 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0818f-874b-439f-9f33-eae2729293ab None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:01.542217 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:01.589127 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0818f-874b-439f-9f33-eae2729293ab None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:01.597244 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540ed70-2090-4d36-a155-0e3cce649bb5 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:01.597527 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540ed70-2090-4d36-a155-0e3cce649bb5 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:01.597797 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540ed70-2090-4d36-a155-0e3cce649bb5 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:01.599322 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 531/1033] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:24:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:24:01.603973 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552b021-d252-411a-b84b-01e1e81a3bcc None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:01.604257 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552b021-d252-411a-b84b-01e1e81a3bcc None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:01.604531 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552b021-d252-411a-b84b-01e1e81a3bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:01.624352 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-6552b021-d252-411a-b84b-01e1e81a3bcc None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:24:01.625482 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997fde2-b98c-4670-867a-9bc1da0baf15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:01.626083 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6552b021-d252-411a-b84b-01e1e81a3bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:24:01.626183 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997fde2-b98c-4670-867a-9bc1da0baf15 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:01.626459 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997fde2-b98c-4670-867a-9bc1da0baf15 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:01.626612 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997fde2-b98c-4670-867a-9bc1da0baf15 None admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:01.627269 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c997fde2-b98c-4670-867a-9bc1da0baf15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:24:01.627572 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c997fde2-b98c-4670-867a-9bc1da0baf15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:01.628945 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c997fde2-b98c-4670-867a-9bc1da0baf15 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:01.641362 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 503/1034] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:24:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:01.648490 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997fde2-b98c-4670-867a-9bc1da0baf15 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:01.712191 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 532/1035] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:24:01 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 15:24:01.783546 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997fde2-b98c-4670-867a-9bc1da0baf15 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:01.800956 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:01.819476 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665dc21c-e022-4090-bac8-691af0fdc750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:01.820105 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665dc21c-e022-4090-bac8-691af0fdc750 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:01.820378 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665dc21c-e022-4090-bac8-691af0fdc750 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:01.820643 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665dc21c-e022-4090-bac8-691af0fdc750 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:01.828254 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665dc21c-e022-4090-bac8-691af0fdc750 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:01.829364 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665dc21c-e022-4090-bac8-691af0fdc750 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:01.840905 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-665dc21c-e022-4090-bac8-691af0fdc750 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 15:24:01.840905 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:24:01.840905 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:24:01.840905 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:24:01.840905 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:24:01.840905 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:24:01.840905 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:24:01.840905 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:24:01.840905 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:24:01.840905 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:24:01.840905 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:24:01.840905 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:24:01.840905 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:24:01.840905 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:24:01.840905 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:24:01.840905 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:24:01.841885 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:24:01.841885 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:24:01.841885 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:24:01.841885 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:24:01.841885 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:24:01.841885 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:24:01.841885 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:24:01.841885 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:24:01.841885 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:24:01.841885 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:24:01.841885 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:24:01.841885 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:24:01.841885 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:24:01.841885 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:24:01.841885 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:24:01.841885 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:24:01.841885 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:24:01.841885 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:24:01.847746 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:24:01.847746 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:24:01.847746 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:24:01.847746 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:24:01.847746 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:24:01.847746 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:24:01.847746 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:24:01.847746 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:24:01.847746 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 15:24:01.847746 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:24:01.847746 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 504/1036] 10.222.0.83 () {56 vars in 1093 bytes} [Mon Aug 29 15:24:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:24:01.850944 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552b021-d252-411a-b84b-01e1e81a3bcc None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:01.899982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:01.957074 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552b021-d252-411a-b84b-01e1e81a3bcc None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:01.986209 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665dc21c-e022-4090-bac8-691af0fdc750 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:01.997276 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c561780-1660-4668-9d62-3c28f56252a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:01.997891 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c561780-1660-4668-9d62-3c28f56252a0 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:01.998166 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c561780-1660-4668-9d62-3c28f56252a0 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:01.998908 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c561780-1660-4668-9d62-3c28f56252a0 None admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:02.000589 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c561780-1660-4668-9d62-3c28f56252a0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:24:02.000906 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c561780-1660-4668-9d62-3c28f56252a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:02.002896 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c561780-1660-4668-9d62-3c28f56252a0 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:02.027084 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 533/1037] 10.222.0.83 () {56 vars in 1133 bytes} [Mon Aug 29 15:24:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:02.033764 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c561780-1660-4668-9d62-3c28f56252a0 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:02.106785 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665dc21c-e022-4090-bac8-691af0fdc750 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:02.137375 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c561780-1660-4668-9d62-3c28f56252a0 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:02.140134 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed1e6b-06c3-454a-bc99-cf1299884081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:02.140783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed1e6b-06c3-454a-bc99-cf1299884081 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:02.141056 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed1e6b-06c3-454a-bc99-cf1299884081 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:02.141166 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:02.141337 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed1e6b-06c3-454a-bc99-cf1299884081 None admin] PATH_INFO: `/v3/services/image` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:02.141921 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ed1e6b-06c3-454a-bc99-cf1299884081 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:02.143601 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ed1e6b-06c3-454a-bc99-cf1299884081 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:02.152475 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-58ed1e6b-06c3-454a-bc99-cf1299884081 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 15:24:02.152475 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:24:02.152475 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:24:02.152475 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:24:02.152475 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:24:02.152475 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:24:02.152475 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:24:02.152475 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:24:02.152475 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 15:24:02.152475 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:24:02.152475 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:24:02.152475 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:24:02.152475 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:24:02.152475 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:24:02.152475 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:24:02.152475 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:24:02.152475 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:24:02.153680 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:24:02.153680 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:24:02.153680 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:24:02.153680 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:24:02.153680 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:24:02.153680 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:24:02.153680 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:24:02.153680 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:24:02.153680 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:24:02.153680 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:24:02.153680 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:24:02.153680 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:24:02.153680 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:24:02.153680 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:24:02.153680 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:24:02.153680 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:24:02.154711 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:24:02.154711 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:24:02.154711 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:24:02.154711 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:24:02.154711 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:24:02.154711 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:24:02.154711 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:24:02.154711 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:24:02.154711 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:24:02.154711 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:24:02.154711 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:24:02.154711 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:24:02.154711 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 15:24:02.154711 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:24:02.157491 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 505/1038] 10.222.0.83 () {56 vars in 1105 bytes} [Mon Aug 29 15:24:01 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:24:02.158933 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e5a85-13e4-4d29-a1e8-5a797e35c936 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:02.159273 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e5a85-13e4-4d29-a1e8-5a797e35c936 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:02.159549 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e5a85-13e4-4d29-a1e8-5a797e35c936 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:02.160771 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 506/1039] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:24:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:24:02.163197 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e5a85-13e4-4d29-a1e8-5a797e35c936 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:02.179353 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc5af7-b873-405d-ad9d-1ec026e2163e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:02.179963 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc5af7-b873-405d-ad9d-1ec026e2163e None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:02.180238 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc5af7-b873-405d-ad9d-1ec026e2163e None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:02.180507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc5af7-b873-405d-ad9d-1ec026e2163e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:02.207712 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:02.250474 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adc5af7-b873-405d-ad9d-1ec026e2163e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:02.251963 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adc5af7-b873-405d-ad9d-1ec026e2163e None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:02.269459 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e5a85-13e4-4d29-a1e8-5a797e35c936 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:02.305196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a231118-d6ca-40b7-b946-897132f0674c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:02.305801 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a231118-d6ca-40b7-b946-897132f0674c None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:02.306080 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a231118-d6ca-40b7-b946-897132f0674c None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:02.306349 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a231118-d6ca-40b7-b946-897132f0674c None admin] PATH_INFO: `/v3/services` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:02.307095 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a231118-d6ca-40b7-b946-897132f0674c None admin] RBAC: Adding query filter params (name=image) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:24:02.307304 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a231118-d6ca-40b7-b946-897132f0674c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:02.308670 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a231118-d6ca-40b7-b946-897132f0674c None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:02.314164 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 507/1040] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:24:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:24:02.315184 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1491f2-13e9-47a8-841e-b1fa5183e34f None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:02.315468 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1491f2-13e9-47a8-841e-b1fa5183e34f None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:02.315737 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1491f2-13e9-47a8-841e-b1fa5183e34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:02.334813 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-0d1491f2-13e9-47a8-841e-b1fa5183e34f None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:24:02.336045 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0d1491f2-13e9-47a8-841e-b1fa5183e34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:24:02.354168 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 534/1041] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:24:02 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 15:24:02.355986 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc5af7-b873-405d-ad9d-1ec026e2163e None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:02.359978 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:02.406356 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 508/1042] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:24:02 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:24:02.407300 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1491f2-13e9-47a8-841e-b1fa5183e34f None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:02.442890 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:02.459574 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc5af7-b873-405d-ad9d-1ec026e2163e None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:02.494324 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c184143c-8a6b-4482-94ef-2cd2c95667ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:02.494926 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184143c-8a6b-4482-94ef-2cd2c95667ea None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:02.495381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184143c-8a6b-4482-94ef-2cd2c95667ea None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:02.495653 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184143c-8a6b-4482-94ef-2cd2c95667ea None admin] PATH_INFO: `/v3/services` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:02.496652 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c184143c-8a6b-4482-94ef-2cd2c95667ea None admin] RBAC: Adding query filter params (type=image) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:24:02.496954 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c184143c-8a6b-4482-94ef-2cd2c95667ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:02.498736 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c184143c-8a6b-4482-94ef-2cd2c95667ea None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:02.510148 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 535/1043] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:24:02 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:02.512015 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c184143c-8a6b-4482-94ef-2cd2c95667ea None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:02.514672 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1491f2-13e9-47a8-841e-b1fa5183e34f None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:02.553725 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b223d3bc-361f-47e2-8f15-ed0084226803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:02.554468 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223d3bc-361f-47e2-8f15-ed0084226803 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:02.554818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223d3bc-361f-47e2-8f15-ed0084226803 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:02.555114 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223d3bc-361f-47e2-8f15-ed0084226803 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:02.566026 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b223d3bc-361f-47e2-8f15-ed0084226803 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:02.567497 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b223d3bc-361f-47e2-8f15-ed0084226803 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:02.582529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:02.582780 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-b223d3bc-361f-47e2-8f15-ed0084226803 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:24:02.582780 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:24:02.582780 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:24:02.582780 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:24:02.582780 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:24:02.582780 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:24:02.582780 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:24:02.582780 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:24:02.582780 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:24:02.582780 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:24:02.582780 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:24:02.582780 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:24:02.582780 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:24:02.582780 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:24:02.582780 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:24:02.582780 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:24:02.583762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:24:02.583762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:24:02.583762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:24:02.583762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:24:02.583762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:24:02.583762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:24:02.583762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:24:02.583762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:24:02.583762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:24:02.583762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:24:02.583762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:24:02.583762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:24:02.583762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:24:02.583762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:24:02.583762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:24:02.583762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:24:02.583762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:24:02.585433 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:24:02.585433 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:24:02.585433 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:24:02.585433 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 509/1044] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:24:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:24:02.589603 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b223d3bc-361f-47e2-8f15-ed0084226803 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:02.620979 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c184143c-8a6b-4482-94ef-2cd2c95667ea None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:02.658126 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde87ac4-ee6f-470a-a39a-f6afccc04357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:02.658930 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde87ac4-ee6f-470a-a39a-f6afccc04357 None admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:02.659065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde87ac4-ee6f-470a-a39a-f6afccc04357 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:02.659297 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde87ac4-ee6f-470a-a39a-f6afccc04357 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:02.659971 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde87ac4-ee6f-470a-a39a-f6afccc04357 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:02.661338 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde87ac4-ee6f-470a-a39a-f6afccc04357 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:02.679537 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:02.691544 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 536/1045] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:24:02 2022] POST /identity/v3/endpoints => generated 327 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:24:02.693048 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde87ac4-ee6f-470a-a39a-f6afccc04357 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:02.695878 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b223d3bc-361f-47e2-8f15-ed0084226803 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:02.753087 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f27896-5b93-4dd7-875a-059e1d07ef10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:02.753709 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f27896-5b93-4dd7-875a-059e1d07ef10 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:02.753983 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f27896-5b93-4dd7-875a-059e1d07ef10 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:02.754271 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f27896-5b93-4dd7-875a-059e1d07ef10 None admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:02.754893 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f27896-5b93-4dd7-875a-059e1d07ef10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:24:02.755225 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f27896-5b93-4dd7-875a-059e1d07ef10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:02.756620 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f27896-5b93-4dd7-875a-059e1d07ef10 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:02.774323 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 510/1046] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:24:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:24:02.775899 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f27896-5b93-4dd7-875a-059e1d07ef10 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:02.820028 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde87ac4-ee6f-470a-a39a-f6afccc04357 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:02.848594 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:02.865593 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb362af-d7e3-40db-b723-8691dbc1e060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:02.866243 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb362af-d7e3-40db-b723-8691dbc1e060 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:02.866521 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb362af-d7e3-40db-b723-8691dbc1e060 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:02.866793 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb362af-d7e3-40db-b723-8691dbc1e060 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:02.868685 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb362af-d7e3-40db-b723-8691dbc1e060 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:02.870522 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb362af-d7e3-40db-b723-8691dbc1e060 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:02.872675 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 537/1047] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:24:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:02.879246 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb362af-d7e3-40db-b723-8691dbc1e060 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:02.894598 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f27896-5b93-4dd7-875a-059e1d07ef10 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:02.931823 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8dad2-165c-43ee-b1c6-2de4f37d39b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:02.932459 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8dad2-165c-43ee-b1c6-2de4f37d39b6 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:02.932733 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8dad2-165c-43ee-b1c6-2de4f37d39b6 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:02.933002 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8dad2-165c-43ee-b1c6-2de4f37d39b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:02.941311 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd8dad2-165c-43ee-b1c6-2de4f37d39b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:02.943546 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd8dad2-165c-43ee-b1c6-2de4f37d39b6 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:02.959162 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-4cd8dad2-165c-43ee-b1c6-2de4f37d39b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:24:02.959162 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:24:02.959162 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:24:02.959162 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:24:02.959162 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:24:02.959162 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:24:02.959162 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:24:02.959162 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:24:02.959162 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:24:02.959162 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:24:02.959162 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:24:02.959162 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:24:02.959162 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:24:02.959162 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:24:02.959162 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:24:02.960122 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:24:02.960122 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:24:02.960122 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:24:02.960122 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:24:02.960122 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:24:02.960122 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:24:02.960122 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:24:02.960122 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:24:02.960122 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:24:02.960122 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:24:02.960122 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:24:02.960122 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:24:02.960122 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:24:02.960122 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:24:02.960122 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:24:02.960122 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:24:02.960122 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:24:02.961022 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:24:02.961022 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:24:02.961022 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:24:02.961022 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:24:02.961022 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:24:02.961022 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:24:02.961022 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:24:02.961022 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:24:02.967318 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 511/1048] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:24:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:24:02.968066 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8dad2-165c-43ee-b1c6-2de4f37d39b6 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:02.971903 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:02.997486 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb362af-d7e3-40db-b723-8691dbc1e060 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:03.034403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3dcc39-3bc4-4813-8640-0524241e0c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:03.035011 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3dcc39-3bc4-4813-8640-0524241e0c7e None admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:03.035307 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3dcc39-3bc4-4813-8640-0524241e0c7e None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:03.035581 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3dcc39-3bc4-4813-8640-0524241e0c7e None admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:03.036232 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3dcc39-3bc4-4813-8640-0524241e0c7e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:03.037666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3dcc39-3bc4-4813-8640-0524241e0c7e None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:03.071124 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 538/1049] 10.222.0.83 () {60 vars in 1132 bytes} [Mon Aug 29 15:24:02 2022] POST /identity/v3/users => generated 285 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:24:03.086643 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8dad2-165c-43ee-b1c6-2de4f37d39b6 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:03.124645 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904057c0-dde3-40cf-b0d3-c3014525e533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:03.126956 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904057c0-dde3-40cf-b0d3-c3014525e533 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:03.126956 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904057c0-dde3-40cf-b0d3-c3014525e533 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:03.126956 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904057c0-dde3-40cf-b0d3-c3014525e533 None admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:03.127470 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904057c0-dde3-40cf-b0d3-c3014525e533 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:24:03.131053 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904057c0-dde3-40cf-b0d3-c3014525e533 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:03.131053 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904057c0-dde3-40cf-b0d3-c3014525e533 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:03.143175 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 512/1050] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 15:24:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:03.149881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3dcc39-3bc4-4813-8640-0524241e0c7e None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:03.208021 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:03.267395 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3dcc39-3bc4-4813-8640-0524241e0c7e None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:03.312223 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e4a8fc-b55d-40f8-b935-8d57e9a9d856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:03.312993 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4a8fc-b55d-40f8-b935-8d57e9a9d856 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:03.313272 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4a8fc-b55d-40f8-b935-8d57e9a9d856 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:03.313546 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4a8fc-b55d-40f8-b935-8d57e9a9d856 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:03.314290 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e4a8fc-b55d-40f8-b935-8d57e9a9d856 None admin] RBAC: Adding query filter params (role.id=49f4519b105b4692b68e8d28be78fe57, scope.project.id=44655977b0814a728f0fa73d442a7ee9, user.id=253947a5ef294d2bb828761873251bd1) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:24:03.314600 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e4a8fc-b55d-40f8-b935-8d57e9a9d856 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:03.316110 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e4a8fc-b55d-40f8-b935-8d57e9a9d856 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:03.322935 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 539/1051] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 15:24:03 2022] GET /identity/v3/role_assignments?user.id=253947a5ef294d2bb828761873251bd1&scope.project.id=44655977b0814a728f0fa73d442a7ee9&role.id=49f4519b105b4692b68e8d28be78fe57 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:04.655661 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3004b9-999b-45b6-8ade-b270e6b39c14 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:04.656197 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3004b9-999b-45b6-8ade-b270e6b39c14 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:04.656197 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3004b9-999b-45b6-8ade-b270e6b39c14 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:04.658254 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 513/1052] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:24:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:24:04.664098 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc22f0-9c6f-4ec2-9370-00ded97ed42b None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:04.664587 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc22f0-9c6f-4ec2-9370-00ded97ed42b None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:04.664665 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc22f0-9c6f-4ec2-9370-00ded97ed42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:04.687208 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-5cbc22f0-9c6f-4ec2-9370-00ded97ed42b None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:24:04.688512 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5cbc22f0-9c6f-4ec2-9370-00ded97ed42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:24:04.763682 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 540/1053] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:24:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:24:05.037901 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3004b9-999b-45b6-8ade-b270e6b39c14 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:05.058465 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69209591-0908-4023-9598-6def05060105 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:05.058770 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69209591-0908-4023-9598-6def05060105 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:05.059013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69209591-0908-4023-9598-6def05060105 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:05.060433 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 541/1054] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:24:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:24:05.065198 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36085084-9dd7-4f5a-98d0-582544dd66be None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:05.065486 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36085084-9dd7-4f5a-98d0-582544dd66be None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:05.065764 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36085084-9dd7-4f5a-98d0-582544dd66be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:05.084681 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-36085084-9dd7-4f5a-98d0-582544dd66be None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:24:05.086186 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-36085084-9dd7-4f5a-98d0-582544dd66be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:24:05.109704 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:05.127096 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:05.154610 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3004b9-999b-45b6-8ade-b270e6b39c14 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:05.162100 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 542/1055] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:24:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 15:24:05.190565 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf895b1-a3e9-410f-8dc6-2d454d819d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:05.191299 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf895b1-a3e9-410f-8dc6-2d454d819d75 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:05.191643 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf895b1-a3e9-410f-8dc6-2d454d819d75 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:05.191924 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf895b1-a3e9-410f-8dc6-2d454d819d75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:05.243884 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94413050-02f3-4fb3-9cf2-7033eca2b9c9 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:05.244476 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94413050-02f3-4fb3-9cf2-7033eca2b9c9 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:05.244695 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94413050-02f3-4fb3-9cf2-7033eca2b9c9 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:05.246166 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 543/1056] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:24:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:24:05.250777 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b33b6-83e0-44d6-a1be-8279f9bec037 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:05.251089 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b33b6-83e0-44d6-a1be-8279f9bec037 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:05.251362 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b33b6-83e0-44d6-a1be-8279f9bec037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:05.263270 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf895b1-a3e9-410f-8dc6-2d454d819d75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:05.264720 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf895b1-a3e9-410f-8dc6-2d454d819d75 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:05.269716 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-f79b33b6-83e0-44d6-a1be-8279f9bec037 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:24:05.270893 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f79b33b6-83e0-44d6-a1be-8279f9bec037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:24:05.329416 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:05.343063 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 544/1057] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:24:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 15:24:05.379075 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 514/1058] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:24:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 15:24:05.381924 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b33b6-83e0-44d6-a1be-8279f9bec037 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:05.432732 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf895b1-a3e9-410f-8dc6-2d454d819d75 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:05.492345 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b33b6-83e0-44d6-a1be-8279f9bec037 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:05.493910 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:05.531093 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd045b9-89e0-4621-acf2-87148dfe80b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:05.531859 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd045b9-89e0-4621-acf2-87148dfe80b6 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:05.532147 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd045b9-89e0-4621-acf2-87148dfe80b6 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:05.532425 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd045b9-89e0-4621-acf2-87148dfe80b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:05.543212 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf895b1-a3e9-410f-8dc6-2d454d819d75 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:05.543360 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd045b9-89e0-4621-acf2-87148dfe80b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:05.544737 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd045b9-89e0-4621-acf2-87148dfe80b6 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:05.561298 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-bbd045b9-89e0-4621-acf2-87148dfe80b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:24:05.561298 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:24:05.561298 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:24:05.561298 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:24:05.561298 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:24:05.561298 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:24:05.561298 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:24:05.561298 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:24:05.561298 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:24:05.561298 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:24:05.561298 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:24:05.561298 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:24:05.561298 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:24:05.561298 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:24:05.561298 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:24:05.561298 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:24:05.562291 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:24:05.562291 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:24:05.562291 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:24:05.562291 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:24:05.562291 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:24:05.562291 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:24:05.562291 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:24:05.562291 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:24:05.562291 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:24:05.562291 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:24:05.562291 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:24:05.562291 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:24:05.562291 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:24:05.562291 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:24:05.562291 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:24:05.562291 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:24:05.562291 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:24:05.563256 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:24:05.563256 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:24:05.563256 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:24:05.567355 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 545/1059] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:24:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:24:05.568933 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd045b9-89e0-4621-acf2-87148dfe80b6 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:05.581618 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7367a-6a41-4024-af9f-f5a081908c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:05.582175 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7367a-6a41-4024-af9f-f5a081908c49 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:05.582453 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7367a-6a41-4024-af9f-f5a081908c49 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:05.582720 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7367a-6a41-4024-af9f-f5a081908c49 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:05.593008 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7367a-6a41-4024-af9f-f5a081908c49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:24:05.598301 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-3ce7367a-6a41-4024-af9f-f5a081908c49 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:24:05.598301 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:24:05.598301 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:24:05.598301 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:24:05.598301 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:24:05.598301 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:24:05.598301 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:24:05.598301 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:24:05.598301 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:24:05.598301 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:24:05.598301 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:24:05.598301 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:24:05.598301 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:24:05.598301 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:24:05.598301 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:24:05.598301 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:24:05.604619 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:24:05.604619 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:24:05.604619 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:24:05.604619 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:24:05.604619 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:24:05.604619 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:24:05.604619 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:24:05.604619 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:24:05.604619 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:24:05.604619 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:24:05.604619 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:24:05.604619 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:24:05.604619 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:24:05.604619 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:24:05.604619 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:24:05.604619 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:24:05.605611 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:24:05.605611 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:24:05.605611 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:24:05.605611 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:24:05.605611 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:24:05.605611 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:24:05.605611 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:24:05.605611 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:24:05.605611 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:24:05.605611 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:24:05.605611 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:24:05.605611 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:24:05.605611 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 515/1060] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 15:24:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:24:05.606720 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7367a-6a41-4024-af9f-f5a081908c49 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:05.631794 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:05.679928 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd045b9-89e0-4621-acf2-87148dfe80b6 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:05.711812 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7367a-6a41-4024-af9f-f5a081908c49 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:05.712939 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bbe2e3-9d20-4800-9872-19a26779f594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:05.713546 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbe2e3-9d20-4800-9872-19a26779f594 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:05.713817 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbe2e3-9d20-4800-9872-19a26779f594 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:05.714083 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbe2e3-9d20-4800-9872-19a26779f594 None admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:05.714723 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bbe2e3-9d20-4800-9872-19a26779f594 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:24:05.715020 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bbe2e3-9d20-4800-9872-19a26779f594 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:05.716404 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bbe2e3-9d20-4800-9872-19a26779f594 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:05.728616 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 546/1061] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:24:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:24:05.729417 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bbe2e3-9d20-4800-9872-19a26779f594 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:05.751121 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:05.751704 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f97c5e-53f3-4d57-92ee-e2aaaa93a807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:05.752877 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f97c5e-53f3-4d57-92ee-e2aaaa93a807 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:05.752998 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f97c5e-53f3-4d57-92ee-e2aaaa93a807 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:05.753415 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f97c5e-53f3-4d57-92ee-e2aaaa93a807 None admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:05.754091 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f97c5e-53f3-4d57-92ee-e2aaaa93a807 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:24:05.754417 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f97c5e-53f3-4d57-92ee-e2aaaa93a807 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:05.755856 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f97c5e-53f3-4d57-92ee-e2aaaa93a807 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:05.766016 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 516/1062] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:24:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:05.773262 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f97c5e-53f3-4d57-92ee-e2aaaa93a807 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:05.851362 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bbe2e3-9d20-4800-9872-19a26779f594 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:05.877514 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:05.895001 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03647b44-6236-4e3d-b97d-f329819822e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:05.895793 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03647b44-6236-4e3d-b97d-f329819822e1 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:05.896070 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03647b44-6236-4e3d-b97d-f329819822e1 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:05.896345 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03647b44-6236-4e3d-b97d-f329819822e1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:05.899199 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f97c5e-53f3-4d57-92ee-e2aaaa93a807 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:05.909023 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03647b44-6236-4e3d-b97d-f329819822e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:24:05.913898 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-03647b44-6236-4e3d-b97d-f329819822e1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 15:24:05.913898 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:24:05.913898 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:24:05.913898 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:24:05.913898 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:24:05.913898 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:24:05.913898 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:24:05.913898 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:24:05.913898 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:24:05.913898 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:24:05.913898 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:24:05.913898 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:24:05.913898 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:24:05.913898 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:24:05.913898 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:24:05.913898 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:24:05.914857 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:24:05.914857 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:24:05.914857 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:24:05.914857 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:24:05.914857 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:24:05.914857 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:24:05.914857 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:24:05.914857 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:24:05.914857 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:24:05.914857 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:24:05.914857 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:24:05.914857 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:24:05.914857 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:24:05.914857 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:24:05.914857 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:24:05.914857 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:24:05.915941 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:24:05.915941 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:24:05.915941 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:24:05.915941 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:24:05.915941 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:24:05.915941 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:24:05.915941 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:24:05.915941 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:24:05.915941 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:24:05.915941 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:24:05.915941 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 15:24:05.915941 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:24:05.915941 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 547/1063] 10.222.0.83 () {56 vars in 1120 bytes} [Mon Aug 29 15:24:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:24:05.920962 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03647b44-6236-4e3d-b97d-f329819822e1 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:05.947520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d2428-d7bd-4e7b-b9a9-2faa76b9a3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:05.948315 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d2428-d7bd-4e7b-b9a9-2faa76b9a3a6 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:05.948909 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d2428-d7bd-4e7b-b9a9-2faa76b9a3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:05.949178 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d2428-d7bd-4e7b-b9a9-2faa76b9a3a6 None admin] PATH_INFO: `/v3/users/beb920c00cd340f8bf7bfe5f511c5314` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:05.967282 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d2428-d7bd-4e7b-b9a9-2faa76b9a3a6 None admin] RBAC: Authorizing `identity:get_user(user_id=beb920c00cd340f8bf7bfe5f511c5314)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:05.968729 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d2428-d7bd-4e7b-b9a9-2faa76b9a3a6 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:05.970718 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 517/1064] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 15:24:05 2022] GET /identity/v3/users/beb920c00cd340f8bf7bfe5f511c5314 => generated 285 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:24:05.977238 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d2428-d7bd-4e7b-b9a9-2faa76b9a3a6 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:06.011012 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:06.041836 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03647b44-6236-4e3d-b97d-f329819822e1 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:06.078255 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bbe0ee-23f7-4f0d-8de8-9c1d57dd3a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:06.079005 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bbe0ee-23f7-4f0d-8de8-9c1d57dd3a40 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:06.079399 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bbe0ee-23f7-4f0d-8de8-9c1d57dd3a40 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:06.079783 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bbe0ee-23f7-4f0d-8de8-9c1d57dd3a40 None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:06.080771 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bbe0ee-23f7-4f0d-8de8-9c1d57dd3a40 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:24:06.081248 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bbe0ee-23f7-4f0d-8de8-9c1d57dd3a40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:06.082861 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bbe0ee-23f7-4f0d-8de8-9c1d57dd3a40 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:06.091441 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 548/1065] 10.222.0.83 () {56 vars in 1115 bytes} [Mon Aug 29 15:24:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:24:06.092392 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d2428-d7bd-4e7b-b9a9-2faa76b9a3a6 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:06.097820 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bbe0ee-23f7-4f0d-8de8-9c1d57dd3a40 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:06.128206 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d237d926-1dbe-4498-acf1-409f06a2e0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:06.128741 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237d926-1dbe-4498-acf1-409f06a2e0c5 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:06.129019 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237d926-1dbe-4498-acf1-409f06a2e0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:06.129335 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237d926-1dbe-4498-acf1-409f06a2e0c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:06.141054 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:06.198180 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bbe0ee-23f7-4f0d-8de8-9c1d57dd3a40 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:06.198466 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d237d926-1dbe-4498-acf1-409f06a2e0c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:06.200083 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d237d926-1dbe-4498-acf1-409f06a2e0c5 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:06.230786 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ed0ba-5485-4b65-bfa5-601f0f4946d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:06.231436 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ed0ba-5485-4b65-bfa5-601f0f4946d1 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:06.231711 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ed0ba-5485-4b65-bfa5-601f0f4946d1 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:06.231979 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ed0ba-5485-4b65-bfa5-601f0f4946d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:06.234585 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:06.243899 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ed0ba-5485-4b65-bfa5-601f0f4946d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:06.245603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ed0ba-5485-4b65-bfa5-601f0f4946d1 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:06.263462 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-253ed0ba-5485-4b65-bfa5-601f0f4946d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:24:06.263462 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:24:06.263462 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:24:06.263462 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:24:06.263462 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:24:06.263462 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:24:06.263462 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:24:06.263462 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:24:06.263462 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:24:06.263462 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:24:06.263462 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:24:06.263462 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:24:06.263462 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:24:06.263462 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:24:06.263462 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:24:06.263462 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:24:06.265107 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:24:06.265107 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:24:06.265107 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:24:06.265107 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:24:06.265107 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:24:06.265107 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:24:06.265107 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:24:06.265107 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:24:06.265107 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:24:06.265107 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:24:06.265107 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:24:06.265107 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:24:06.265107 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:24:06.265107 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:24:06.265107 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:24:06.265107 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:24:06.265107 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:24:06.266936 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:24:06.266936 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:24:06.266936 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:24:06.266936 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 549/1066] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:24:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:24:06.271572 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ed0ba-5485-4b65-bfa5-601f0f4946d1 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:06.305179 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 518/1067] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:24:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 15:24:06.311158 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d237d926-1dbe-4498-acf1-409f06a2e0c5 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:06.356422 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:06.398072 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ed0ba-5485-4b65-bfa5-601f0f4946d1 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:06.418696 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d237d926-1dbe-4498-acf1-409f06a2e0c5 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:06.434867 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a20f42-a74e-44cb-b793-86a1f1a8c56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:06.435509 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a20f42-a74e-44cb-b793-86a1f1a8c56c None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:06.435783 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a20f42-a74e-44cb-b793-86a1f1a8c56c None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:06.436050 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a20f42-a74e-44cb-b793-86a1f1a8c56c None admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:06.436693 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a20f42-a74e-44cb-b793-86a1f1a8c56c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:24:06.436992 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a20f42-a74e-44cb-b793-86a1f1a8c56c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:06.438364 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a20f42-a74e-44cb-b793-86a1f1a8c56c None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:06.451314 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 550/1068] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:24:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:24:06.457452 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a20f42-a74e-44cb-b793-86a1f1a8c56c None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:06.459242 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a89038-ea50-4c13-aa5a-71ebf9f7401c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:06.459876 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a89038-ea50-4c13-aa5a-71ebf9f7401c None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:06.460146 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a89038-ea50-4c13-aa5a-71ebf9f7401c None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:06.460411 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a89038-ea50-4c13-aa5a-71ebf9f7401c None admin] PATH_INFO: `/v3/projects/bfeb70b11f044c87a8cfee56c961033e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:06.461510 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a89038-ea50-4c13-aa5a-71ebf9f7401c None admin] RBAC: Authorizing `identity:get_project(project_id=bfeb70b11f044c87a8cfee56c961033e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:06.462943 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a89038-ea50-4c13-aa5a-71ebf9f7401c None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:06.464728 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 519/1069] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:24:06 2022] GET /identity/v3/projects/bfeb70b11f044c87a8cfee56c961033e => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:24:06.470337 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a89038-ea50-4c13-aa5a-71ebf9f7401c None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:06.507194 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:06.558705 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a20f42-a74e-44cb-b793-86a1f1a8c56c None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:06.569503 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a89038-ea50-4c13-aa5a-71ebf9f7401c None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:06.579901 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:06.593658 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c929019-1207-4d6f-9a1a-df21bae99c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:06.594294 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c929019-1207-4d6f-9a1a-df21bae99c07 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:06.594571 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c929019-1207-4d6f-9a1a-df21bae99c07 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:06.594844 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c929019-1207-4d6f-9a1a-df21bae99c07 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:06.602481 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c929019-1207-4d6f-9a1a-df21bae99c07 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:06.603960 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c929019-1207-4d6f-9a1a-df21bae99c07 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:06.604872 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41727593-c7f2-4fea-9481-5b684a59b057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:06.605470 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41727593-c7f2-4fea-9481-5b684a59b057 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:06.605750 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41727593-c7f2-4fea-9481-5b684a59b057 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:06.606015 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41727593-c7f2-4fea-9481-5b684a59b057 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:06.606737 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41727593-c7f2-4fea-9481-5b684a59b057 None admin] RBAC: Adding query filter params (role.id=4bb2bbb7bb544610877949fc933504d2, scope.project.id=bfeb70b11f044c87a8cfee56c961033e, user.id=beb920c00cd340f8bf7bfe5f511c5314) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:24:06.607060 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41727593-c7f2-4fea-9481-5b684a59b057 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:06.608485 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41727593-c7f2-4fea-9481-5b684a59b057 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:06.614296 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 520/1070] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 15:24:06 2022] GET /identity/v3/role_assignments?user.id=beb920c00cd340f8bf7bfe5f511c5314&scope.project.id=bfeb70b11f044c87a8cfee56c961033e&role.id=4bb2bbb7bb544610877949fc933504d2 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:24:06.615829 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-3c929019-1207-4d6f-9a1a-df21bae99c07 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 15:24:06.615829 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:24:06.615829 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:24:06.615829 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:24:06.615829 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:24:06.615829 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:24:06.615829 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:24:06.615829 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:24:06.615829 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:24:06.615829 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:24:06.615829 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:24:06.615829 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:24:06.615829 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:24:06.615829 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:24:06.615829 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:24:06.615829 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:24:06.616923 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:24:06.616923 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:24:06.616923 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:24:06.616923 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:24:06.616923 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:24:06.616923 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:24:06.616923 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:24:06.616923 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:24:06.616923 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:24:06.616923 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:24:06.616923 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:24:06.616923 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:24:06.616923 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:24:06.616923 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:24:06.616923 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:24:06.616923 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:24:06.616923 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:24:06.616923 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:24:06.623273 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:24:06.623273 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:24:06.623273 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:24:06.623273 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:24:06.623273 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:24:06.623273 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:24:06.623273 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:24:06.623273 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:24:06.623273 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 15:24:06.623273 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:24:06.623273 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 551/1071] 10.222.0.83 () {56 vars in 1093 bytes} [Mon Aug 29 15:24:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:24:06.623960 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41727593-c7f2-4fea-9481-5b684a59b057 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:06.735936 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41727593-c7f2-4fea-9481-5b684a59b057 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:06.775628 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0fb12c-ef70-4754-8b2f-01dafe80b458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:06.776233 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fb12c-ef70-4754-8b2f-01dafe80b458 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:06.776505 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fb12c-ef70-4754-8b2f-01dafe80b458 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:06.776772 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fb12c-ef70-4754-8b2f-01dafe80b458 None admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:06.777490 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0fb12c-ef70-4754-8b2f-01dafe80b458 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:24:06.777788 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0fb12c-ef70-4754-8b2f-01dafe80b458 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:06.779220 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0fb12c-ef70-4754-8b2f-01dafe80b458 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:06.796868 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 521/1072] 10.222.0.83 () {56 vars in 1133 bytes} [Mon Aug 29 15:24:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:06.802874 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c929019-1207-4d6f-9a1a-df21bae99c07 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:06.902056 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c929019-1207-4d6f-9a1a-df21bae99c07 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:06.911662 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:06.937476 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c9286-36dd-4592-9161-ec2428b95b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:06.938109 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c9286-36dd-4592-9161-ec2428b95b62 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:06.938386 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c9286-36dd-4592-9161-ec2428b95b62 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:06.938659 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c9286-36dd-4592-9161-ec2428b95b62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:06.949376 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6c9286-36dd-4592-9161-ec2428b95b62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:06.950835 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6c9286-36dd-4592-9161-ec2428b95b62 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:06.964969 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-bb6c9286-36dd-4592-9161-ec2428b95b62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:24:06.964969 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:24:06.964969 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:24:06.964969 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:24:06.964969 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:24:06.964969 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:24:06.964969 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:24:06.964969 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:24:06.964969 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:24:06.964969 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:24:06.964969 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:24:06.964969 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:24:06.964969 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:24:06.964969 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:24:06.964969 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:24:06.964969 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:24:06.965930 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:24:06.965930 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:24:06.965930 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:24:06.965930 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:24:06.965930 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:24:06.965930 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:24:06.965930 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:24:06.965930 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:24:06.965930 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:24:06.965930 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:24:06.965930 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:24:06.965930 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:24:06.965930 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:24:06.965930 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:24:06.965930 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:24:06.965930 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:24:06.965930 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:24:06.966816 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:24:06.966816 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:24:06.966816 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:24:06.966816 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 552/1073] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:24:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:24:06.971863 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0fb12c-ef70-4754-8b2f-01dafe80b458 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:07.005267 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:07.075899 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0fb12c-ef70-4754-8b2f-01dafe80b458 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:07.115412 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2739334-161d-49cb-9408-3191003498a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:07.116021 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2739334-161d-49cb-9408-3191003498a3 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:07.116298 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2739334-161d-49cb-9408-3191003498a3 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:07.116567 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2739334-161d-49cb-9408-3191003498a3 None admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:07.117205 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2739334-161d-49cb-9408-3191003498a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:24:07.117502 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2739334-161d-49cb-9408-3191003498a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:07.118864 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2739334-161d-49cb-9408-3191003498a3 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:07.130758 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 522/1074] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:24:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:07.136368 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c9286-36dd-4592-9161-ec2428b95b62 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:07.235880 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c9286-36dd-4592-9161-ec2428b95b62 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:07.268613 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea687b-404b-489b-856f-88eecd058515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:07.269765 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea687b-404b-489b-856f-88eecd058515 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:07.270042 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea687b-404b-489b-856f-88eecd058515 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:07.270310 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea687b-404b-489b-856f-88eecd058515 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:07.277888 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea687b-404b-489b-856f-88eecd058515 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:07.279357 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea687b-404b-489b-856f-88eecd058515 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:07.291261 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-6aea687b-404b-489b-856f-88eecd058515 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:24:07.291261 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:24:07.291261 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:24:07.291261 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:24:07.291261 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:24:07.291261 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:24:07.291261 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:24:07.291261 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:24:07.291261 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:24:07.291261 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:24:07.291261 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:24:07.291261 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:24:07.291261 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:24:07.291261 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:24:07.291261 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:24:07.292253 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:24:07.292253 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:24:07.292253 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:24:07.292253 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:24:07.292253 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:24:07.292253 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:24:07.292253 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:24:07.292253 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:24:07.292253 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:24:07.292253 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:24:07.292253 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:24:07.292253 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:24:07.292253 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:24:07.292253 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:24:07.292253 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:24:07.292253 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:24:07.292253 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:24:07.293159 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:24:07.293159 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:24:07.293159 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:24:07.293159 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:24:07.293159 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:24:07.293159 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:24:07.293159 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:24:07.293159 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:24:07.293159 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 553/1075] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:24:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:24:07.298130 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2739334-161d-49cb-9408-3191003498a3 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:07.391593 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:07.401567 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2739334-161d-49cb-9408-3191003498a3 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:07.435860 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f943748-d356-469c-9648-2335c8e4fef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:07.436473 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f943748-d356-469c-9648-2335c8e4fef9 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:07.436749 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f943748-d356-469c-9648-2335c8e4fef9 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:07.437020 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f943748-d356-469c-9648-2335c8e4fef9 None admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:07.437705 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f943748-d356-469c-9648-2335c8e4fef9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:24:07.438011 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f943748-d356-469c-9648-2335c8e4fef9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:07.439470 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f943748-d356-469c-9648-2335c8e4fef9 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:07.451543 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 523/1076] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 15:24:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:07.458218 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea687b-404b-489b-856f-88eecd058515 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:07.482027 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:07.558365 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea687b-404b-489b-856f-88eecd058515 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:07.592386 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960758a8-6717-44de-85e4-125d973b888b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:07.593038 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960758a8-6717-44de-85e4-125d973b888b None admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:07.593310 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960758a8-6717-44de-85e4-125d973b888b None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:07.593575 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960758a8-6717-44de-85e4-125d973b888b None admin] PATH_INFO: `/v3/projects/44655977b0814a728f0fa73d442a7ee9/users/253947a5ef294d2bb828761873251bd1/roles/49f4519b105b4692b68e8d28be78fe57` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:07.595674 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960758a8-6717-44de-85e4-125d973b888b None admin] RBAC: Authorizing `identity:create_grant(project_id=44655977b0814a728f0fa73d442a7ee9, user_id=253947a5ef294d2bb828761873251bd1, role_id=49f4519b105b4692b68e8d28be78fe57)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:07.597105 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960758a8-6717-44de-85e4-125d973b888b None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:07.609684 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 554/1077] 10.222.0.83 () {58 vars in 1439 bytes} [Mon Aug 29 15:24:07 2022] PUT /identity/v3/projects/44655977b0814a728f0fa73d442a7ee9/users/253947a5ef294d2bb828761873251bd1/roles/49f4519b105b4692b68e8d28be78fe57 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:24:08.526763 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d16930-94c3-4d86-a973-df57fcbe3eaf None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:08.527330 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d16930-94c3-4d86-a973-df57fcbe3eaf None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:08.527330 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d16930-94c3-4d86-a973-df57fcbe3eaf None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:08.528719 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 524/1078] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:24:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:24:08.534110 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591751eb-41f5-4d04-8e49-98cd0a41bbc9 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:08.534525 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591751eb-41f5-4d04-8e49-98cd0a41bbc9 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:08.534657 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591751eb-41f5-4d04-8e49-98cd0a41bbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:08.553119 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-591751eb-41f5-4d04-8e49-98cd0a41bbc9 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:24:08.554304 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-591751eb-41f5-4d04-8e49-98cd0a41bbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:24:08.620496 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 555/1079] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:24:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 15:24:08.889397 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d16930-94c3-4d86-a973-df57fcbe3eaf None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:08.991269 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d16930-94c3-4d86-a973-df57fcbe3eaf None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:09.026915 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12189ac3-3a35-49b8-a21a-0f3994810d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:09.027568 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12189ac3-3a35-49b8-a21a-0f3994810d1a None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:09.027840 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12189ac3-3a35-49b8-a21a-0f3994810d1a None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:09.028105 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12189ac3-3a35-49b8-a21a-0f3994810d1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:09.038695 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12189ac3-3a35-49b8-a21a-0f3994810d1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:24:09.043440 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-12189ac3-3a35-49b8-a21a-0f3994810d1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:24:09.043440 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:24:09.043440 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:24:09.043440 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:24:09.043440 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:24:09.043440 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:24:09.043440 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:24:09.043440 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:24:09.043440 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:24:09.043440 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:24:09.043440 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:24:09.043440 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:24:09.043440 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:24:09.043440 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:24:09.043440 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:24:09.043440 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:24:09.044364 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:24:09.044364 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:24:09.044364 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:24:09.044364 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:24:09.044364 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:24:09.044364 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:24:09.044364 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:24:09.044364 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:24:09.044364 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:24:09.044364 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:24:09.044364 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:24:09.044364 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:24:09.044364 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:24:09.044364 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:24:09.044364 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:24:09.044364 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:24:09.045346 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:24:09.045346 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:24:09.045346 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:24:09.045346 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:24:09.045346 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:24:09.045346 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:24:09.045346 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:24:09.045346 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:24:09.045346 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:24:09.045346 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:24:09.045346 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:24:09.045346 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:24:09.045346 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 525/1080] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 15:24:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:24:09.050511 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591751eb-41f5-4d04-8e49-98cd0a41bbc9 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:09.062371 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:09.156312 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591751eb-41f5-4d04-8e49-98cd0a41bbc9 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:09.189312 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a4302-9ac2-4f82-8a5a-8f6b95060bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:09.189913 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a4302-9ac2-4f82-8a5a-8f6b95060bff None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:09.190185 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a4302-9ac2-4f82-8a5a-8f6b95060bff None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:09.190451 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a4302-9ac2-4f82-8a5a-8f6b95060bff None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:09.191146 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a4302-9ac2-4f82-8a5a-8f6b95060bff None admin] RBAC: Adding query filter params (name=admin) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:24:09.191450 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a4302-9ac2-4f82-8a5a-8f6b95060bff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:09.193341 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a4302-9ac2-4f82-8a5a-8f6b95060bff None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:09.201816 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 556/1081] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:24:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:09.207713 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12189ac3-3a35-49b8-a21a-0f3994810d1a None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:09.223283 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:09.307667 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12189ac3-3a35-49b8-a21a-0f3994810d1a None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:09.339781 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208d47d-645a-4fa6-8fff-b31864e11260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:09.340404 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208d47d-645a-4fa6-8fff-b31864e11260 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:09.340676 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208d47d-645a-4fa6-8fff-b31864e11260 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:09.340943 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208d47d-645a-4fa6-8fff-b31864e11260 None admin] PATH_INFO: `/v3/users/beb920c00cd340f8bf7bfe5f511c5314` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:09.342037 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2208d47d-645a-4fa6-8fff-b31864e11260 None admin] RBAC: Authorizing `identity:get_user(user_id=beb920c00cd340f8bf7bfe5f511c5314)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:09.343497 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2208d47d-645a-4fa6-8fff-b31864e11260 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:09.345062 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 526/1082] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 15:24:09 2022] GET /identity/v3/users/beb920c00cd340f8bf7bfe5f511c5314 => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:09.351771 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a4302-9ac2-4f82-8a5a-8f6b95060bff None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:09.422146 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:09.457029 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a4302-9ac2-4f82-8a5a-8f6b95060bff None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:09.490959 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0811241-4853-45ad-9104-6edbdd8ecd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:09.491609 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0811241-4853-45ad-9104-6edbdd8ecd6e None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:09.491882 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0811241-4853-45ad-9104-6edbdd8ecd6e None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:09.492149 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0811241-4853-45ad-9104-6edbdd8ecd6e None admin] PATH_INFO: `/v3/projects/bfeb70b11f044c87a8cfee56c961033e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:09.493263 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0811241-4853-45ad-9104-6edbdd8ecd6e None admin] RBAC: Authorizing `identity:get_project(project_id=bfeb70b11f044c87a8cfee56c961033e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:09.494684 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0811241-4853-45ad-9104-6edbdd8ecd6e None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:09.496347 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 557/1083] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:24:09 2022] GET /identity/v3/projects/bfeb70b11f044c87a8cfee56c961033e => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:09.502898 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208d47d-645a-4fa6-8fff-b31864e11260 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:09.516200 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9adca-6a93-4892-93e9-cb82ba302dcf None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:09.516480 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9adca-6a93-4892-93e9-cb82ba302dcf None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:09.516748 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9adca-6a93-4892-93e9-cb82ba302dcf None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:09.518044 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 558/1084] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:24:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:24:09.523737 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71643840-1f59-499f-b1de-8195a2ce1843 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:09.524018 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71643840-1f59-499f-b1de-8195a2ce1843 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:09.524289 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71643840-1f59-499f-b1de-8195a2ce1843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:09.542695 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-71643840-1f59-499f-b1de-8195a2ce1843 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:24:09.544371 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-71643840-1f59-499f-b1de-8195a2ce1843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:24:09.585838 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:09.607062 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208d47d-645a-4fa6-8fff-b31864e11260 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:09.614588 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 559/1085] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:24:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 15:24:09.641379 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5d98c-f2d6-4325-ac61-ea114f0910b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:09.642034 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5d98c-f2d6-4325-ac61-ea114f0910b5 None admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:09.642310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5d98c-f2d6-4325-ac61-ea114f0910b5 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:09.642581 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5d98c-f2d6-4325-ac61-ea114f0910b5 None admin] PATH_INFO: `/v3/projects/bfeb70b11f044c87a8cfee56c961033e/users/beb920c00cd340f8bf7bfe5f511c5314/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:09.644478 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e5d98c-f2d6-4325-ac61-ea114f0910b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=bfeb70b11f044c87a8cfee56c961033e, user_id=beb920c00cd340f8bf7bfe5f511c5314, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:09.645907 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e5d98c-f2d6-4325-ac61-ea114f0910b5 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:09.659672 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 527/1086] 10.222.0.83 () {58 vars in 1439 bytes} [Mon Aug 29 15:24:09 2022] PUT /identity/v3/projects/bfeb70b11f044c87a8cfee56c961033e/users/beb920c00cd340f8bf7bfe5f511c5314/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:24:09.887778 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71643840-1f59-499f-b1de-8195a2ce1843 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:09.956478 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:09.988377 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71643840-1f59-499f-b1de-8195a2ce1843 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:10.024871 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b83aa4-bd49-4b93-bc1e-db4f34a28612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:10.025502 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b83aa4-bd49-4b93-bc1e-db4f34a28612 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:10.025777 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b83aa4-bd49-4b93-bc1e-db4f34a28612 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:10.026045 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b83aa4-bd49-4b93-bc1e-db4f34a28612 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:10.035977 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b83aa4-bd49-4b93-bc1e-db4f34a28612 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:24:10.041402 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-68b83aa4-bd49-4b93-bc1e-db4f34a28612 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 15:24:10.041402 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:24:10.041402 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:24:10.041402 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:24:10.041402 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:24:10.041402 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:24:10.041402 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:24:10.041402 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:24:10.041402 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:24:10.041402 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:24:10.041402 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:24:10.041402 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:24:10.041402 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:24:10.041402 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:24:10.041402 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:24:10.041402 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:24:10.042336 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:24:10.042336 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:24:10.042336 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:24:10.042336 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:24:10.042336 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:24:10.042336 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:24:10.042336 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:24:10.042336 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:24:10.042336 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:24:10.042336 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:24:10.042336 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:24:10.042336 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:24:10.042336 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:24:10.042336 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:24:10.042336 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:24:10.042336 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:24:10.043215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:24:10.043215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:24:10.043215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:24:10.043215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:24:10.043215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:24:10.043215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:24:10.043215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:24:10.043215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:24:10.043215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:24:10.043215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:24:10.043215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 15:24:10.043215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:24:10.043215 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 560/1087] 10.222.0.83 () {56 vars in 1120 bytes} [Mon Aug 29 15:24:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:24:10.048410 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5d98c-f2d6-4325-ac61-ea114f0910b5 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:10.147000 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5d98c-f2d6-4325-ac61-ea114f0910b5 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:10.180136 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf8508-8121-4dea-b16c-e60409179c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:10.180734 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf8508-8121-4dea-b16c-e60409179c6f None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:10.181006 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf8508-8121-4dea-b16c-e60409179c6f None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:10.181269 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf8508-8121-4dea-b16c-e60409179c6f None admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:10.181910 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf8508-8121-4dea-b16c-e60409179c6f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:24:10.182204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf8508-8121-4dea-b16c-e60409179c6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:10.183610 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf8508-8121-4dea-b16c-e60409179c6f None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:10.191387 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 528/1088] 10.222.0.83 () {56 vars in 1115 bytes} [Mon Aug 29 15:24:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:10.197653 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b83aa4-bd49-4b93-bc1e-db4f34a28612 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:10.298116 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b83aa4-bd49-4b93-bc1e-db4f34a28612 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:10.326381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:10.332458 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320dbc22-7a76-45ac-83be-d8cded10a95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:10.333084 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320dbc22-7a76-45ac-83be-d8cded10a95e None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:10.333361 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320dbc22-7a76-45ac-83be-d8cded10a95e None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:10.333631 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320dbc22-7a76-45ac-83be-d8cded10a95e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:10.343919 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320dbc22-7a76-45ac-83be-d8cded10a95e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:10.345368 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320dbc22-7a76-45ac-83be-d8cded10a95e None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:10.359263 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-320dbc22-7a76-45ac-83be-d8cded10a95e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:24:10.359263 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:24:10.359263 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:24:10.359263 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:24:10.359263 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:24:10.359263 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:24:10.359263 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:24:10.359263 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:24:10.359263 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:24:10.359263 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:24:10.359263 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:24:10.359263 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:24:10.359263 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:24:10.359263 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:24:10.359263 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:24:10.359263 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:24:10.360416 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:24:10.360416 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:24:10.360416 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:24:10.360416 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:24:10.360416 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:24:10.360416 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:24:10.360416 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:24:10.360416 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:24:10.360416 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:24:10.360416 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:24:10.360416 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:24:10.360416 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:24:10.360416 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:24:10.360416 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:24:10.360416 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:24:10.360416 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:24:10.360416 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:24:10.361399 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:24:10.361399 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:24:10.361399 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:24:10.361399 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 561/1089] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:24:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:24:10.366798 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf8508-8121-4dea-b16c-e60409179c6f None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:10.369638 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:10.467791 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf8508-8121-4dea-b16c-e60409179c6f None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:10.501009 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5511b0c-f5e2-4f1e-bc6f-92a18a5f7bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:10.501611 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5511b0c-f5e2-4f1e-bc6f-92a18a5f7bdb None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:10.501888 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5511b0c-f5e2-4f1e-bc6f-92a18a5f7bdb None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:10.502154 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5511b0c-f5e2-4f1e-bc6f-92a18a5f7bdb None admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:10.502798 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5511b0c-f5e2-4f1e-bc6f-92a18a5f7bdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:24:10.503121 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5511b0c-f5e2-4f1e-bc6f-92a18a5f7bdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:10.504505 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5511b0c-f5e2-4f1e-bc6f-92a18a5f7bdb None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:10.516714 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 529/1090] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:24:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:24:10.522331 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320dbc22-7a76-45ac-83be-d8cded10a95e None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:10.621508 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320dbc22-7a76-45ac-83be-d8cded10a95e None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:10.654870 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d920dfa-652e-4d47-babd-2f0ee1d68813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:10.655524 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d920dfa-652e-4d47-babd-2f0ee1d68813 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:10.655798 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d920dfa-652e-4d47-babd-2f0ee1d68813 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:10.656063 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d920dfa-652e-4d47-babd-2f0ee1d68813 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:10.663991 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d920dfa-652e-4d47-babd-2f0ee1d68813 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:10.665449 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d920dfa-652e-4d47-babd-2f0ee1d68813 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:10.676438 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-2d920dfa-652e-4d47-babd-2f0ee1d68813 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 15:24:10.676438 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:24:10.676438 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:24:10.676438 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:24:10.676438 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:24:10.676438 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:24:10.676438 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:24:10.676438 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:24:10.676438 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:24:10.676438 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:24:10.676438 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:24:10.676438 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:24:10.676438 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:24:10.676438 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:24:10.676438 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:24:10.676438 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:24:10.677435 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:24:10.677435 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:24:10.677435 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:24:10.677435 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:24:10.677435 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:24:10.677435 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:24:10.677435 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:24:10.677435 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:24:10.677435 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:24:10.677435 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:24:10.677435 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:24:10.677435 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:24:10.677435 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:24:10.677435 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:24:10.677435 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:24:10.677435 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:24:10.677435 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:24:10.677435 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:24:10.679245 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:24:10.679245 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:24:10.679245 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:24:10.679245 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:24:10.679245 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:24:10.679245 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:24:10.679245 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:24:10.679245 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:24:10.679245 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 15:24:10.679245 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:24:10.679245 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 562/1091] 10.222.0.83 () {56 vars in 1093 bytes} [Mon Aug 29 15:24:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:24:10.683810 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5511b0c-f5e2-4f1e-bc6f-92a18a5f7bdb None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:10.752136 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:10.791199 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5511b0c-f5e2-4f1e-bc6f-92a18a5f7bdb None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:10.824262 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f89f2-61e4-4795-a73e-0c298c652272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:10.824864 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f89f2-61e4-4795-a73e-0c298c652272 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:10.825140 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f89f2-61e4-4795-a73e-0c298c652272 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:10.825407 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f89f2-61e4-4795-a73e-0c298c652272 None admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:10.826120 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f89f2-61e4-4795-a73e-0c298c652272 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:24:10.826422 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f89f2-61e4-4795-a73e-0c298c652272 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:10.827871 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f89f2-61e4-4795-a73e-0c298c652272 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:10.845019 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 530/1092] 10.222.0.83 () {56 vars in 1133 bytes} [Mon Aug 29 15:24:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:10.851411 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d920dfa-652e-4d47-babd-2f0ee1d68813 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:10.894208 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:10.950078 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d920dfa-652e-4d47-babd-2f0ee1d68813 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:10.986518 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26c23d-a9a5-4bf6-a81c-4b666dbe1526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:10.987154 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26c23d-a9a5-4bf6-a81c-4b666dbe1526 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:10.987432 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26c23d-a9a5-4bf6-a81c-4b666dbe1526 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:10.987703 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26c23d-a9a5-4bf6-a81c-4b666dbe1526 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:11.054162 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc26c23d-a9a5-4bf6-a81c-4b666dbe1526 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:11.055668 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc26c23d-a9a5-4bf6-a81c-4b666dbe1526 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:11.096286 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:11.154567 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 563/1093] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:24:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 15:24:11.160173 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f89f2-61e4-4795-a73e-0c298c652272 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:11.260748 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f89f2-61e4-4795-a73e-0c298c652272 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:11.280382 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:11.295352 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7f425-1d87-42e0-86c8-278d60c0e3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:11.295985 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7f425-1d87-42e0-86c8-278d60c0e3c2 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:11.296257 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7f425-1d87-42e0-86c8-278d60c0e3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:11.296522 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7f425-1d87-42e0-86c8-278d60c0e3c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:11.307158 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7f425-1d87-42e0-86c8-278d60c0e3c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:11.308612 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7f425-1d87-42e0-86c8-278d60c0e3c2 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:11.322896 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-cbe7f425-1d87-42e0-86c8-278d60c0e3c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:24:11.322896 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:24:11.322896 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:24:11.322896 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:24:11.322896 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:24:11.322896 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:24:11.322896 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:24:11.322896 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:24:11.322896 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:24:11.322896 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:24:11.322896 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:24:11.322896 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:24:11.322896 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:24:11.322896 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:24:11.322896 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:24:11.322896 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:24:11.324062 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:24:11.324062 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:24:11.324062 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:24:11.324062 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:24:11.324062 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:24:11.324062 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:24:11.324062 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:24:11.324062 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:24:11.324062 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:24:11.324062 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:24:11.324062 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:24:11.324062 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:24:11.324062 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:24:11.324062 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:24:11.324062 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:24:11.324062 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:24:11.324062 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:24:11.324954 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:24:11.324954 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:24:11.324954 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:24:11.324954 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 531/1094] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:24:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:24:11.329627 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26c23d-a9a5-4bf6-a81c-4b666dbe1526 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:11.427318 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26c23d-a9a5-4bf6-a81c-4b666dbe1526 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:11.462763 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a67352-946c-4949-a623-da79b02bfe93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:11.463403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a67352-946c-4949-a623-da79b02bfe93 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:11.463682 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a67352-946c-4949-a623-da79b02bfe93 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:11.463953 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a67352-946c-4949-a623-da79b02bfe93 None admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:11.464597 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a67352-946c-4949-a623-da79b02bfe93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:24:11.464894 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a67352-946c-4949-a623-da79b02bfe93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:11.466268 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a67352-946c-4949-a623-da79b02bfe93 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:11.477807 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 564/1095] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:24:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:11.483333 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7f425-1d87-42e0-86c8-278d60c0e3c2 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:11.575201 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8ea0f-cd2f-44a5-af76-01a61de26ae3 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:11.575488 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8ea0f-cd2f-44a5-af76-01a61de26ae3 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:11.575766 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8ea0f-cd2f-44a5-af76-01a61de26ae3 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:11.577101 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 565/1096] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:24:11.581980 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9392e1-832c-4ed5-9f28-f624284a1e82 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:11.582091 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7f425-1d87-42e0-86c8-278d60c0e3c2 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:11.582268 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9392e1-832c-4ed5-9f28-f624284a1e82 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:11.582545 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9392e1-832c-4ed5-9f28-f624284a1e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:11.589010 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:11.602320 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-eb9392e1-832c-4ed5-9f28-f624284a1e82 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:24:11.603548 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-eb9392e1-832c-4ed5-9f28-f624284a1e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:24:11.623041 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40bc44-49cc-4f1a-a7bb-0448c1778c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:11.623751 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40bc44-49cc-4f1a-a7bb-0448c1778c82 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:11.624078 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40bc44-49cc-4f1a-a7bb-0448c1778c82 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:11.624736 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40bc44-49cc-4f1a-a7bb-0448c1778c82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:11.632967 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee40bc44-49cc-4f1a-a7bb-0448c1778c82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:11.635490 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee40bc44-49cc-4f1a-a7bb-0448c1778c82 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:11.648120 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-ee40bc44-49cc-4f1a-a7bb-0448c1778c82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:24:11.648120 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:24:11.648120 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:24:11.648120 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:24:11.648120 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:24:11.648120 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:24:11.648120 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:24:11.648120 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:24:11.648120 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:24:11.648120 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:24:11.648120 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:24:11.648120 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:24:11.648120 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:24:11.648120 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:24:11.648120 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:24:11.649034 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:24:11.649034 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:24:11.649034 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:24:11.649034 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:24:11.649034 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:24:11.649034 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:24:11.649034 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:24:11.649034 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:24:11.649034 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:24:11.649034 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:24:11.649034 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:24:11.649034 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:24:11.649034 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:24:11.649034 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:24:11.649034 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:24:11.649034 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:24:11.649034 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:24:11.649920 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:24:11.649920 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:24:11.649920 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:24:11.649920 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:24:11.649920 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:24:11.649920 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:24:11.649920 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:24:11.649920 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:24:11.651175 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 532/1097] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:24:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:24:11.655052 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40bc44-49cc-4f1a-a7bb-0448c1778c82 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:11.675778 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 566/1098] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:24:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 15:24:11.687353 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:11.758435 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40bc44-49cc-4f1a-a7bb-0448c1778c82 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:11.792594 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5185ff7-1631-4dc4-aba5-4766ee6def51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:11.793204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5185ff7-1631-4dc4-aba5-4766ee6def51 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:11.793482 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5185ff7-1631-4dc4-aba5-4766ee6def51 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:11.793755 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5185ff7-1631-4dc4-aba5-4766ee6def51 None admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:11.794441 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5185ff7-1631-4dc4-aba5-4766ee6def51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:24:11.794750 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5185ff7-1631-4dc4-aba5-4766ee6def51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:11.796218 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5185ff7-1631-4dc4-aba5-4766ee6def51 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:11.808527 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 533/1099] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 15:24:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:24:11.814556 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9392e1-832c-4ed5-9f28-f624284a1e82 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:11.912713 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9392e1-832c-4ed5-9f28-f624284a1e82 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:11.941715 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:11.947608 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2804d7-4088-4cec-996a-c1f0767487c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:11.948213 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2804d7-4088-4cec-996a-c1f0767487c4 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:11.948490 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2804d7-4088-4cec-996a-c1f0767487c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:11.948760 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2804d7-4088-4cec-996a-c1f0767487c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:11.949553 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2804d7-4088-4cec-996a-c1f0767487c4 None admin] RBAC: Adding query filter params (role.id=49f4519b105b4692b68e8d28be78fe57, scope.project.id=44655977b0814a728f0fa73d442a7ee9, user.id=253947a5ef294d2bb828761873251bd1) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:24:11.949864 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2804d7-4088-4cec-996a-c1f0767487c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:11.950171 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5185ff7-1631-4dc4-aba5-4766ee6def51 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:11.951328 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2804d7-4088-4cec-996a-c1f0767487c4 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:11.958181 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 567/1100] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 15:24:11 2022] GET /identity/v3/role_assignments?user.id=253947a5ef294d2bb828761873251bd1&scope.project.id=44655977b0814a728f0fa73d442a7ee9&role.id=49f4519b105b4692b68e8d28be78fe57 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:12.050531 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:12.060427 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5185ff7-1631-4dc4-aba5-4766ee6def51 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:12.098938 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dbcb27-1c22-4a41-81d5-6277baaf60a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:12.099233 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dbcb27-1c22-4a41-81d5-6277baaf60a1 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:12.099589 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dbcb27-1c22-4a41-81d5-6277baaf60a1 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:12.099879 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dbcb27-1c22-4a41-81d5-6277baaf60a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:12.112127 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dbcb27-1c22-4a41-81d5-6277baaf60a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:24:12.116952 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-05dbcb27-1c22-4a41-81d5-6277baaf60a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:24:12.116952 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:24:12.116952 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:24:12.116952 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:24:12.116952 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:24:12.116952 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:24:12.116952 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:24:12.116952 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:24:12.116952 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:24:12.116952 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:24:12.116952 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:24:12.116952 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:24:12.116952 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:24:12.116952 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:24:12.116952 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:24:12.116952 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:24:12.117901 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:24:12.117901 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:24:12.117901 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:24:12.117901 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:24:12.117901 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:24:12.117901 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:24:12.117901 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:24:12.117901 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:24:12.117901 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:24:12.117901 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:24:12.117901 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:24:12.117901 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:24:12.117901 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:24:12.117901 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:24:12.117901 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:24:12.117901 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:24:12.118762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:24:12.118762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:24:12.118762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:24:12.118762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:24:12.118762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:24:12.118762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:24:12.118762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:24:12.118762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:24:12.118762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:24:12.118762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:24:12.118762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:24:12.118762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:24:12.118762 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 534/1101] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 15:24:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:24:12.124971 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2804d7-4088-4cec-996a-c1f0767487c4 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:12.232969 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2804d7-4088-4cec-996a-c1f0767487c4 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:12.267217 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56f216-83bd-4490-9be0-4d22483f689f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:12.267823 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56f216-83bd-4490-9be0-4d22483f689f None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:12.268097 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56f216-83bd-4490-9be0-4d22483f689f None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:12.268368 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56f216-83bd-4490-9be0-4d22483f689f None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:12.269021 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a56f216-83bd-4490-9be0-4d22483f689f None admin] RBAC: Adding query filter params (name=admin) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:24:12.269317 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a56f216-83bd-4490-9be0-4d22483f689f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:12.270677 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a56f216-83bd-4490-9be0-4d22483f689f None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:12.280272 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 568/1102] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:24:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:12.286473 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dbcb27-1c22-4a41-81d5-6277baaf60a1 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:12.393399 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dbcb27-1c22-4a41-81d5-6277baaf60a1 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:12.428176 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5974ac-5fc1-4b19-8621-330593f77352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:12.428804 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5974ac-5fc1-4b19-8621-330593f77352 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:12.429078 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5974ac-5fc1-4b19-8621-330593f77352 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:12.429956 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5974ac-5fc1-4b19-8621-330593f77352 None admin] PATH_INFO: `/v3/users/beb920c00cd340f8bf7bfe5f511c5314` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:12.431516 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5974ac-5fc1-4b19-8621-330593f77352 None admin] RBAC: Authorizing `identity:get_user(user_id=beb920c00cd340f8bf7bfe5f511c5314)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:12.432955 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5974ac-5fc1-4b19-8621-330593f77352 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:12.434562 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 535/1103] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 15:24:12 2022] GET /identity/v3/users/beb920c00cd340f8bf7bfe5f511c5314 => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:12.440723 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56f216-83bd-4490-9be0-4d22483f689f None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:12.503278 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:12.547206 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56f216-83bd-4490-9be0-4d22483f689f None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:12.583045 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed51de81-2c3b-40db-96be-2d8a830019ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:12.583745 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51de81-2c3b-40db-96be-2d8a830019ca None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:12.584029 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51de81-2c3b-40db-96be-2d8a830019ca None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:12.584306 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51de81-2c3b-40db-96be-2d8a830019ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:12.653280 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed51de81-2c3b-40db-96be-2d8a830019ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:12.654751 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed51de81-2c3b-40db-96be-2d8a830019ca None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:12.715904 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:12.765171 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 569/1104] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:24:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 15:24:12.771188 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5974ac-5fc1-4b19-8621-330593f77352 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:12.795055 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:12.874187 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5974ac-5fc1-4b19-8621-330593f77352 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:12.907586 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89255d1d-976a-4ffc-b0fa-d3654cd093bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:12.908207 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89255d1d-976a-4ffc-b0fa-d3654cd093bc None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:12.908483 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89255d1d-976a-4ffc-b0fa-d3654cd093bc None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:12.908752 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89255d1d-976a-4ffc-b0fa-d3654cd093bc None admin] PATH_INFO: `/v3/projects/bfeb70b11f044c87a8cfee56c961033e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:12.909846 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89255d1d-976a-4ffc-b0fa-d3654cd093bc None admin] RBAC: Authorizing `identity:get_project(project_id=bfeb70b11f044c87a8cfee56c961033e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:12.911293 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89255d1d-976a-4ffc-b0fa-d3654cd093bc None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:12.912921 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 536/1105] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:24:12 2022] GET /identity/v3/projects/bfeb70b11f044c87a8cfee56c961033e => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:12.919435 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed51de81-2c3b-40db-96be-2d8a830019ca None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:13.017673 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed51de81-2c3b-40db-96be-2d8a830019ca None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:13.051465 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb4309d-d806-482c-a992-278918a0df04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:13.052067 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4309d-d806-482c-a992-278918a0df04 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:13.052340 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4309d-d806-482c-a992-278918a0df04 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:13.052602 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4309d-d806-482c-a992-278918a0df04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:13.053315 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb4309d-d806-482c-a992-278918a0df04 None admin] RBAC: Adding query filter params (role.id=4bb2bbb7bb544610877949fc933504d2, scope.project.id=bfeb70b11f044c87a8cfee56c961033e, user.id=beb920c00cd340f8bf7bfe5f511c5314) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:24:13.053616 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb4309d-d806-482c-a992-278918a0df04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:13.055268 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb4309d-d806-482c-a992-278918a0df04 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:13.061236 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 570/1106] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 15:24:12 2022] GET /identity/v3/role_assignments?user.id=beb920c00cd340f8bf7bfe5f511c5314&scope.project.id=bfeb70b11f044c87a8cfee56c961033e&role.id=4bb2bbb7bb544610877949fc933504d2 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:14.990666 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf3725-4090-4449-b64e-d6cbb1d709ed None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:14.991242 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf3725-4090-4449-b64e-d6cbb1d709ed None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:14.991242 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf3725-4090-4449-b64e-d6cbb1d709ed None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:14.992527 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 537/1107] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:24:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:24:14.997974 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012cd235-f5ad-405f-8130-a95946d53719 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:14.998408 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012cd235-f5ad-405f-8130-a95946d53719 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:14.998514 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012cd235-f5ad-405f-8130-a95946d53719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:15.017022 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-012cd235-f5ad-405f-8130-a95946d53719 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:24:15.018208 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-012cd235-f5ad-405f-8130-a95946d53719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:24:15.034837 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:15.084500 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 571/1108] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:24:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:24:15.355884 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf3725-4090-4449-b64e-d6cbb1d709ed None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:15.441737 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:15.454279 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf3725-4090-4449-b64e-d6cbb1d709ed None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:15.488798 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bcf508-6b9c-4b6d-b187-78c5b5dc6454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:15.489410 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcf508-6b9c-4b6d-b187-78c5b5dc6454 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:15.489682 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcf508-6b9c-4b6d-b187-78c5b5dc6454 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:15.489946 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcf508-6b9c-4b6d-b187-78c5b5dc6454 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:15.491049 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bcf508-6b9c-4b6d-b187-78c5b5dc6454 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:15.492480 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bcf508-6b9c-4b6d-b187-78c5b5dc6454 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:15.494573 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 538/1109] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:24:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:15.500395 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012cd235-f5ad-405f-8130-a95946d53719 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:15.596729 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012cd235-f5ad-405f-8130-a95946d53719 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:15.630287 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1848e728-b15f-4d8b-88d6-810c1f82aecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:15.630827 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848e728-b15f-4d8b-88d6-810c1f82aecd None admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:15.631133 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848e728-b15f-4d8b-88d6-810c1f82aecd None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:15.631408 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848e728-b15f-4d8b-88d6-810c1f82aecd None admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:15.632053 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1848e728-b15f-4d8b-88d6-810c1f82aecd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:15.633480 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1848e728-b15f-4d8b-88d6-810c1f82aecd None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:15.655047 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 572/1110] 10.222.0.83 () {60 vars in 1132 bytes} [Mon Aug 29 15:24:15 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:24:17.599517 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfefb7d-76ca-4a32-a386-cb2e3bd1685a None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:17.600071 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfefb7d-76ca-4a32-a386-cb2e3bd1685a None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:17.600071 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfefb7d-76ca-4a32-a386-cb2e3bd1685a None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:17.601396 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 539/1111] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:24:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:24:17.607184 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d701c-3424-47dd-a2d7-5b64dbd68e65 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:17.607622 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d701c-3424-47dd-a2d7-5b64dbd68e65 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:17.607724 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d701c-3424-47dd-a2d7-5b64dbd68e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:17.626457 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-f56d701c-3424-47dd-a2d7-5b64dbd68e65 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:24:17.627679 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f56d701c-3424-47dd-a2d7-5b64dbd68e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:24:17.629880 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:17.695955 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 573/1112] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:24:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:24:17.969277 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfefb7d-76ca-4a32-a386-cb2e3bd1685a None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:18.069608 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfefb7d-76ca-4a32-a386-cb2e3bd1685a None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:18.104156 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413281a-1dac-4a78-8a12-49e2c492b33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:18.104773 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413281a-1dac-4a78-8a12-49e2c492b33e None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:18.105078 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413281a-1dac-4a78-8a12-49e2c492b33e None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:18.105381 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413281a-1dac-4a78-8a12-49e2c492b33e None admin] PATH_INFO: `/v3/roles/3e8f6ab382f64437b245115f5a28f535` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:18.106809 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9413281a-1dac-4a78-8a12-49e2c492b33e None admin] RBAC: Authorizing `identity:get_role(role_id=3e8f6ab382f64437b245115f5a28f535)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:18.108208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9413281a-1dac-4a78-8a12-49e2c492b33e None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:18.109534 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 540/1113] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 15:24:17 2022] GET /identity/v3/roles/3e8f6ab382f64437b245115f5a28f535 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:18.115371 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d701c-3424-47dd-a2d7-5b64dbd68e65 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:18.211497 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d701c-3424-47dd-a2d7-5b64dbd68e65 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:18.244583 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a833217-3ba6-49de-9589-4db295fca39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:18.245160 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a833217-3ba6-49de-9589-4db295fca39b None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:18.245436 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a833217-3ba6-49de-9589-4db295fca39b None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:18.245741 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a833217-3ba6-49de-9589-4db295fca39b None admin] PATH_INFO: `/v3/users/b7fa8c76f7b945a2912fb7788a432f8a` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:18.252741 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:18.259219 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a833217-3ba6-49de-9589-4db295fca39b None admin] RBAC: Authorizing `identity:get_user(user_id=b7fa8c76f7b945a2912fb7788a432f8a)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:18.260658 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a833217-3ba6-49de-9589-4db295fca39b None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:18.262782 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 574/1114] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 15:24:18 2022] GET /identity/v3/users/b7fa8c76f7b945a2912fb7788a432f8a => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:18.268584 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413281a-1dac-4a78-8a12-49e2c492b33e None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:18.294016 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:18.365635 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413281a-1dac-4a78-8a12-49e2c492b33e None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:18.398261 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be56f06-f864-4f13-98c8-ba631170ecae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:18.398854 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be56f06-f864-4f13-98c8-ba631170ecae None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:18.399155 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be56f06-f864-4f13-98c8-ba631170ecae None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:18.399422 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be56f06-f864-4f13-98c8-ba631170ecae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:18.464788 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be56f06-f864-4f13-98c8-ba631170ecae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:18.466220 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be56f06-f864-4f13-98c8-ba631170ecae None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:18.489600 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:18.562731 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 541/1115] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:24:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 15:24:18.568575 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a833217-3ba6-49de-9589-4db295fca39b None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:18.669824 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a833217-3ba6-49de-9589-4db295fca39b None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:18.704146 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c60961-8151-4b14-a9d4-35bacececa3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:18.704833 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c60961-8151-4b14-a9d4-35bacececa3c None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:18.705111 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c60961-8151-4b14-a9d4-35bacececa3c None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:18.705381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c60961-8151-4b14-a9d4-35bacececa3c None admin] PATH_INFO: `/v3/projects/bfeb70b11f044c87a8cfee56c961033e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:18.706495 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c60961-8151-4b14-a9d4-35bacececa3c None admin] RBAC: Authorizing `identity:get_project(project_id=bfeb70b11f044c87a8cfee56c961033e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:18.707968 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c60961-8151-4b14-a9d4-35bacececa3c None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:18.709629 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 575/1116] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:24:18 2022] GET /identity/v3/projects/bfeb70b11f044c87a8cfee56c961033e => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:18.715963 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be56f06-f864-4f13-98c8-ba631170ecae None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:18.815649 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be56f06-f864-4f13-98c8-ba631170ecae None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:18.838063 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:18.849228 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b716e-7390-434a-8d4e-6d34053b9ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:18.849830 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b716e-7390-434a-8d4e-6d34053b9ede None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:18.850107 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b716e-7390-434a-8d4e-6d34053b9ede None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:18.850378 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b716e-7390-434a-8d4e-6d34053b9ede None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:18.851135 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b716e-7390-434a-8d4e-6d34053b9ede None admin] RBAC: Adding query filter params (role.id=3e8f6ab382f64437b245115f5a28f535, scope.project.id=bfeb70b11f044c87a8cfee56c961033e, user.id=b7fa8c76f7b945a2912fb7788a432f8a) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:24:18.851446 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b716e-7390-434a-8d4e-6d34053b9ede None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:18.852885 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b716e-7390-434a-8d4e-6d34053b9ede None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:18.859288 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 542/1117] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 15:24:18 2022] GET /identity/v3/role_assignments?user.id=b7fa8c76f7b945a2912fb7788a432f8a&scope.project.id=bfeb70b11f044c87a8cfee56c961033e&role.id=3e8f6ab382f64437b245115f5a28f535 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:20.762593 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa2251-2ead-4750-88b0-cbef4c228e59 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:20.763782 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa2251-2ead-4750-88b0-cbef4c228e59 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:20.763782 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa2251-2ead-4750-88b0-cbef4c228e59 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:20.765053 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 576/1118] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:24:20.770405 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b43be-8234-450e-8f07-8619f3442d96 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:20.770829 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b43be-8234-450e-8f07-8619f3442d96 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:20.770926 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b43be-8234-450e-8f07-8619f3442d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:20.789349 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-6d8b43be-8234-450e-8f07-8619f3442d96 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:24:20.790517 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6d8b43be-8234-450e-8f07-8619f3442d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:24:20.854954 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 543/1119] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:24:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:24:21.124563 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa2251-2ead-4750-88b0-cbef4c228e59 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:21.186035 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:21.222969 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa2251-2ead-4750-88b0-cbef4c228e59 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:21.256381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15619760-5297-46d8-a44f-677e5e28cfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:21.256997 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15619760-5297-46d8-a44f-677e5e28cfd2 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:21.257270 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15619760-5297-46d8-a44f-677e5e28cfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:21.257536 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15619760-5297-46d8-a44f-677e5e28cfd2 None admin] PATH_INFO: `/v3/roles/3e8f6ab382f64437b245115f5a28f535` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:21.258906 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15619760-5297-46d8-a44f-677e5e28cfd2 None admin] RBAC: Authorizing `identity:get_role(role_id=3e8f6ab382f64437b245115f5a28f535)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:21.260300 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15619760-5297-46d8-a44f-677e5e28cfd2 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:21.261609 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 577/1120] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 15:24:21 2022] GET /identity/v3/roles/3e8f6ab382f64437b245115f5a28f535 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:21.267482 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b43be-8234-450e-8f07-8619f3442d96 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:21.363769 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b43be-8234-450e-8f07-8619f3442d96 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:21.381238 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:21.398129 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90d403-f7f2-42d9-99fd-6fbf04e6c199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:21.398750 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90d403-f7f2-42d9-99fd-6fbf04e6c199 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:21.399045 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90d403-f7f2-42d9-99fd-6fbf04e6c199 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:21.399321 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90d403-f7f2-42d9-99fd-6fbf04e6c199 None admin] PATH_INFO: `/v3/users/b7fa8c76f7b945a2912fb7788a432f8a` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:21.400533 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b90d403-f7f2-42d9-99fd-6fbf04e6c199 None admin] RBAC: Authorizing `identity:get_user(user_id=b7fa8c76f7b945a2912fb7788a432f8a)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:21.401956 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b90d403-f7f2-42d9-99fd-6fbf04e6c199 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:21.403561 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 544/1121] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 15:24:21 2022] GET /identity/v3/users/b7fa8c76f7b945a2912fb7788a432f8a => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:21.409428 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15619760-5297-46d8-a44f-677e5e28cfd2 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:21.506286 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15619760-5297-46d8-a44f-677e5e28cfd2 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:21.535401 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:21.540648 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c305cd-20f3-409b-8d3b-14c83cdf2954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:21.541278 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c305cd-20f3-409b-8d3b-14c83cdf2954 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:21.541558 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c305cd-20f3-409b-8d3b-14c83cdf2954 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:21.541833 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c305cd-20f3-409b-8d3b-14c83cdf2954 None admin] PATH_INFO: `/v3/projects/bfeb70b11f044c87a8cfee56c961033e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:21.542954 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c305cd-20f3-409b-8d3b-14c83cdf2954 None admin] RBAC: Authorizing `identity:get_project(project_id=bfeb70b11f044c87a8cfee56c961033e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:21.544437 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c305cd-20f3-409b-8d3b-14c83cdf2954 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:21.546725 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 578/1122] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:24:21 2022] GET /identity/v3/projects/bfeb70b11f044c87a8cfee56c961033e => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:21.552665 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90d403-f7f2-42d9-99fd-6fbf04e6c199 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:21.663552 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90d403-f7f2-42d9-99fd-6fbf04e6c199 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:21.696890 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afd796-94f8-41e2-92d1-45b267407297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:21.697546 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afd796-94f8-41e2-92d1-45b267407297 None admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:21.697822 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afd796-94f8-41e2-92d1-45b267407297 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:21.698094 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afd796-94f8-41e2-92d1-45b267407297 None admin] PATH_INFO: `/v3/projects/bfeb70b11f044c87a8cfee56c961033e/users/b7fa8c76f7b945a2912fb7788a432f8a/roles/3e8f6ab382f64437b245115f5a28f535` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:21.700248 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23afd796-94f8-41e2-92d1-45b267407297 None admin] RBAC: Authorizing `identity:create_grant(project_id=bfeb70b11f044c87a8cfee56c961033e, user_id=b7fa8c76f7b945a2912fb7788a432f8a, role_id=3e8f6ab382f64437b245115f5a28f535)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:21.701722 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23afd796-94f8-41e2-92d1-45b267407297 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:21.714447 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 545/1123] 10.222.0.83 () {58 vars in 1439 bytes} [Mon Aug 29 15:24:21 2022] PUT /identity/v3/projects/bfeb70b11f044c87a8cfee56c961033e/users/b7fa8c76f7b945a2912fb7788a432f8a/roles/3e8f6ab382f64437b245115f5a28f535 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:24:23.620423 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e48133-14e3-4a19-b26e-27290887b234 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:23.621005 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e48133-14e3-4a19-b26e-27290887b234 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:23.621005 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e48133-14e3-4a19-b26e-27290887b234 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:23.622278 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 579/1124] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:24:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:24:23.629467 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c1130-2f42-4065-9b5f-2f8633927b17 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:23.629942 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c1130-2f42-4065-9b5f-2f8633927b17 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:23.630048 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c1130-2f42-4065-9b5f-2f8633927b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:23.648464 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-662c1130-2f42-4065-9b5f-2f8633927b17 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:24:23.649648 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-662c1130-2f42-4065-9b5f-2f8633927b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:24:23.694742 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:23.722100 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 546/1125] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:24:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:24:23.995789 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e48133-14e3-4a19-b26e-27290887b234 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:24.106674 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e48133-14e3-4a19-b26e-27290887b234 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:24.156123 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0152b6-fab5-44be-a36f-0f715d0ec451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:24.156760 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0152b6-fab5-44be-a36f-0f715d0ec451 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:24.157032 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0152b6-fab5-44be-a36f-0f715d0ec451 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:24.157327 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0152b6-fab5-44be-a36f-0f715d0ec451 None admin] PATH_INFO: `/v3/roles/3e8f6ab382f64437b245115f5a28f535` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:24.159390 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0152b6-fab5-44be-a36f-0f715d0ec451 None admin] RBAC: Authorizing `identity:get_role(role_id=3e8f6ab382f64437b245115f5a28f535)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:24.160767 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0152b6-fab5-44be-a36f-0f715d0ec451 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:24.162109 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 580/1126] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 15:24:23 2022] GET /identity/v3/roles/3e8f6ab382f64437b245115f5a28f535 => generated 223 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:24.168365 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c1130-2f42-4065-9b5f-2f8633927b17 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:24.265385 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c1130-2f42-4065-9b5f-2f8633927b17 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:24.299044 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492916f2-4161-486d-aecb-5c8adf245eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:24.299679 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492916f2-4161-486d-aecb-5c8adf245eb7 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:24.299950 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492916f2-4161-486d-aecb-5c8adf245eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:24.300216 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492916f2-4161-486d-aecb-5c8adf245eb7 None admin] PATH_INFO: `/v3/users/b7fa8c76f7b945a2912fb7788a432f8a` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:24.301306 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492916f2-4161-486d-aecb-5c8adf245eb7 None admin] RBAC: Authorizing `identity:get_user(user_id=b7fa8c76f7b945a2912fb7788a432f8a)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:24.302731 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492916f2-4161-486d-aecb-5c8adf245eb7 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:24.304340 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 547/1127] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 15:24:24 2022] GET /identity/v3/users/b7fa8c76f7b945a2912fb7788a432f8a => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:24.310368 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0152b6-fab5-44be-a36f-0f715d0ec451 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:24.375606 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:24.410462 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0152b6-fab5-44be-a36f-0f715d0ec451 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:24.443921 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d6726-58c4-4ef3-957b-92b611768882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:24.444520 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d6726-58c4-4ef3-957b-92b611768882 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:24.444795 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d6726-58c4-4ef3-957b-92b611768882 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:24.445064 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d6726-58c4-4ef3-957b-92b611768882 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:24.510935 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d6726-58c4-4ef3-957b-92b611768882 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:24.512404 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d6726-58c4-4ef3-957b-92b611768882 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:24.574987 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:24.609188 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 581/1128] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:24:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 15:24:24.615164 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492916f2-4161-486d-aecb-5c8adf245eb7 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:24.660384 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:24.712967 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492916f2-4161-486d-aecb-5c8adf245eb7 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:24.746971 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24dbd9-8a9e-4f28-99de-de9cc9021198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:24.747634 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24dbd9-8a9e-4f28-99de-de9cc9021198 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:24.747908 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24dbd9-8a9e-4f28-99de-de9cc9021198 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:24.748179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24dbd9-8a9e-4f28-99de-de9cc9021198 None admin] PATH_INFO: `/v3/projects/bfeb70b11f044c87a8cfee56c961033e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:24.749302 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae24dbd9-8a9e-4f28-99de-de9cc9021198 None admin] RBAC: Authorizing `identity:get_project(project_id=bfeb70b11f044c87a8cfee56c961033e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:24.751068 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae24dbd9-8a9e-4f28-99de-de9cc9021198 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:24.752710 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 548/1129] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:24:24 2022] GET /identity/v3/projects/bfeb70b11f044c87a8cfee56c961033e => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:24.759107 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d6726-58c4-4ef3-957b-92b611768882 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:24.855862 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d6726-58c4-4ef3-957b-92b611768882 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:24.889334 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c433b-d21e-4473-a345-d14b19698254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:24.889930 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c433b-d21e-4473-a345-d14b19698254 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:24.890829 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c433b-d21e-4473-a345-d14b19698254 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:24.891211 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c433b-d21e-4473-a345-d14b19698254 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:24.891938 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c433b-d21e-4473-a345-d14b19698254 None admin] RBAC: Adding query filter params (role.id=3e8f6ab382f64437b245115f5a28f535, scope.project.id=bfeb70b11f044c87a8cfee56c961033e, user.id=b7fa8c76f7b945a2912fb7788a432f8a) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:24:24.892247 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c433b-d21e-4473-a345-d14b19698254 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:24.893680 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c433b-d21e-4473-a345-d14b19698254 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:24.899268 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 582/1130] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 15:24:24 2022] GET /identity/v3/role_assignments?user.id=b7fa8c76f7b945a2912fb7788a432f8a&scope.project.id=bfeb70b11f044c87a8cfee56c961033e&role.id=3e8f6ab382f64437b245115f5a28f535 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:24:26.811210 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08a234-c0e4-462c-ae8b-ada0d0b13996 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:26.811766 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08a234-c0e4-462c-ae8b-ada0d0b13996 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:26.811766 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08a234-c0e4-462c-ae8b-ada0d0b13996 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:26.813587 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 549/1131] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:24:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:24:26.818940 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e14a0-ee42-46f0-a487-cd9827a372e4 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:26.819391 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e14a0-ee42-46f0-a487-cd9827a372e4 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:26.819522 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e14a0-ee42-46f0-a487-cd9827a372e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:26.837791 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-728e14a0-ee42-46f0-a487-cd9827a372e4 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:24:26.838970 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-728e14a0-ee42-46f0-a487-cd9827a372e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:24:26.863909 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:26.905299 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 583/1132] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:24:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 15:24:27.176696 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08a234-c0e4-462c-ae8b-ada0d0b13996 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:27.278254 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08a234-c0e4-462c-ae8b-ada0d0b13996 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:27.293425 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:27.319765 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a032a11-2314-4d84-85a3-0d188e481de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:27.320656 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a032a11-2314-4d84-85a3-0d188e481de1 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:27.321063 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a032a11-2314-4d84-85a3-0d188e481de1 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:27.321447 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a032a11-2314-4d84-85a3-0d188e481de1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:27.322555 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a032a11-2314-4d84-85a3-0d188e481de1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:27.324013 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a032a11-2314-4d84-85a3-0d188e481de1 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:27.325577 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 550/1133] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:24:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:27.331531 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e14a0-ee42-46f0-a487-cd9827a372e4 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:27.428705 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e14a0-ee42-46f0-a487-cd9827a372e4 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:27.461644 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8391db3-6bc6-4f36-a4c3-a61398ab8135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:27.462239 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8391db3-6bc6-4f36-a4c3-a61398ab8135 None admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:27.462516 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8391db3-6bc6-4f36-a4c3-a61398ab8135 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:27.462785 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8391db3-6bc6-4f36-a4c3-a61398ab8135 None admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:27.463462 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8391db3-6bc6-4f36-a4c3-a61398ab8135 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:27.464893 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8391db3-6bc6-4f36-a4c3-a61398ab8135 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:27.492765 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 584/1134] 10.222.0.83 () {60 vars in 1141 bytes} [Mon Aug 29 15:24:27 2022] POST /identity/v3/projects => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:24:29.433038 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2202703-860a-4954-a1ed-27c45b40f1e1 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:29.433607 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2202703-860a-4954-a1ed-27c45b40f1e1 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:29.433607 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2202703-860a-4954-a1ed-27c45b40f1e1 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:29.434910 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 551/1135] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:24:29.440062 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70ff85-c972-4c31-b6b2-f888c461978c None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:29.440461 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70ff85-c972-4c31-b6b2-f888c461978c None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:29.440602 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70ff85-c972-4c31-b6b2-f888c461978c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:29.458911 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-6a70ff85-c972-4c31-b6b2-f888c461978c None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:24:29.460124 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6a70ff85-c972-4c31-b6b2-f888c461978c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:24:29.469062 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:29.526872 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 585/1136] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:24:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:24:29.795623 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2202703-860a-4954-a1ed-27c45b40f1e1 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:29.895006 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2202703-860a-4954-a1ed-27c45b40f1e1 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:29.928050 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c8793d-d4b9-4495-a43a-cb8cb9d40fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:29.928667 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8793d-d4b9-4495-a43a-cb8cb9d40fe9 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:29.928941 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8793d-d4b9-4495-a43a-cb8cb9d40fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:29.929207 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8793d-d4b9-4495-a43a-cb8cb9d40fe9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:29.930294 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c8793d-d4b9-4495-a43a-cb8cb9d40fe9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:29.931748 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c8793d-d4b9-4495-a43a-cb8cb9d40fe9 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:29.933310 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 552/1137] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:24:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:29.939043 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70ff85-c972-4c31-b6b2-f888c461978c None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:30.037469 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70ff85-c972-4c31-b6b2-f888c461978c None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:30.070508 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8709d5-295f-43b0-85d6-7d1a8fda2f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:30.071123 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8709d5-295f-43b0-85d6-7d1a8fda2f07 None admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:30.071401 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8709d5-295f-43b0-85d6-7d1a8fda2f07 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:30.071683 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8709d5-295f-43b0-85d6-7d1a8fda2f07 None admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:30.072307 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8709d5-295f-43b0-85d6-7d1a8fda2f07 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:30.073759 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8709d5-295f-43b0-85d6-7d1a8fda2f07 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:30.090498 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:30.101478 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 586/1138] 10.222.0.83 () {60 vars in 1132 bytes} [Mon Aug 29 15:24:29 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:24:32.043123 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748b9b4-b319-447a-b41e-df8008c1dba7 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:32.043628 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748b9b4-b319-447a-b41e-df8008c1dba7 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:32.043628 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748b9b4-b319-447a-b41e-df8008c1dba7 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:32.044934 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 553/1139] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:24:32.050812 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59686e6f-443d-452f-9f8f-4e4042265388 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:32.051348 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59686e6f-443d-452f-9f8f-4e4042265388 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:32.051508 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59686e6f-443d-452f-9f8f-4e4042265388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:32.069436 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-59686e6f-443d-452f-9f8f-4e4042265388 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:24:32.070607 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-59686e6f-443d-452f-9f8f-4e4042265388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:24:32.137426 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 587/1140] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:24:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:24:32.406151 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c748b9b4-b319-447a-b41e-df8008c1dba7 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:32.456629 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:32.506895 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c748b9b4-b319-447a-b41e-df8008c1dba7 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:32.540591 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c3725-63ca-4da0-8016-b399feab4f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:32.541208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c3725-63ca-4da0-8016-b399feab4f6b None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:32.541482 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c3725-63ca-4da0-8016-b399feab4f6b None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:32.541752 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c3725-63ca-4da0-8016-b399feab4f6b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:32.551551 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c3725-63ca-4da0-8016-b399feab4f6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:24:32.556243 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-942c3725-63ca-4da0-8016-b399feab4f6b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:24:32.556243 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:24:32.556243 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:24:32.556243 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:24:32.556243 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:24:32.556243 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:24:32.556243 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:24:32.556243 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:24:32.556243 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:24:32.556243 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:24:32.556243 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:24:32.556243 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:24:32.556243 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:24:32.556243 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:24:32.556243 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:24:32.556243 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:24:32.557406 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:24:32.557406 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:24:32.557406 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:24:32.557406 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:24:32.557406 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:24:32.557406 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:24:32.557406 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:24:32.557406 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:24:32.557406 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:24:32.557406 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:24:32.557406 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:24:32.557406 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:24:32.557406 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:24:32.557406 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:24:32.557406 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:24:32.557406 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:24:32.558354 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:24:32.558354 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:24:32.558354 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:24:32.558354 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:24:32.558354 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:24:32.558354 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:24:32.558354 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:24:32.558354 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:24:32.558354 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:24:32.558354 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:24:32.558354 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:24:32.558354 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:24:32.558354 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 554/1141] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 15:24:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:24:32.563517 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59686e6f-443d-452f-9f8f-4e4042265388 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:32.659152 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59686e6f-443d-452f-9f8f-4e4042265388 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:32.687167 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:32.693736 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a274d9-b864-463a-a40d-fa1dc6718d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:32.694343 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a274d9-b864-463a-a40d-fa1dc6718d8f None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:32.694634 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a274d9-b864-463a-a40d-fa1dc6718d8f None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:32.694894 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a274d9-b864-463a-a40d-fa1dc6718d8f None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:32.695589 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a274d9-b864-463a-a40d-fa1dc6718d8f None admin] RBAC: Adding query filter params (name=admin) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:24:32.695895 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a274d9-b864-463a-a40d-fa1dc6718d8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:32.697271 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a274d9-b864-463a-a40d-fa1dc6718d8f None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:32.708386 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 588/1142] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:24:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:32.714141 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c3725-63ca-4da0-8016-b399feab4f6b None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:32.813161 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c3725-63ca-4da0-8016-b399feab4f6b None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:32.823293 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:32.848477 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19009d-6eb7-4f7c-b372-7c37a738b65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:32.849101 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19009d-6eb7-4f7c-b372-7c37a738b65d None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:32.849380 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19009d-6eb7-4f7c-b372-7c37a738b65d None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:32.849651 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19009d-6eb7-4f7c-b372-7c37a738b65d None admin] PATH_INFO: `/v3/users/bf3420f7144441ff92c4e7a873e121b3` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:32.862268 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19009d-6eb7-4f7c-b372-7c37a738b65d None admin] RBAC: Authorizing `identity:get_user(user_id=bf3420f7144441ff92c4e7a873e121b3)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:32.864153 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19009d-6eb7-4f7c-b372-7c37a738b65d None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:32.865760 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 555/1143] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 15:24:32 2022] GET /identity/v3/users/bf3420f7144441ff92c4e7a873e121b3 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:32.871691 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a274d9-b864-463a-a40d-fa1dc6718d8f None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:32.969076 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a274d9-b864-463a-a40d-fa1dc6718d8f None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:33.001117 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5cef7a-869c-49ec-a7cf-489e43805d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:33.001713 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5cef7a-869c-49ec-a7cf-489e43805d7b None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:33.001990 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5cef7a-869c-49ec-a7cf-489e43805d7b None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:33.002256 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5cef7a-869c-49ec-a7cf-489e43805d7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:33.063556 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:33.074214 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5cef7a-869c-49ec-a7cf-489e43805d7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:33.075717 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5cef7a-869c-49ec-a7cf-489e43805d7b None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:33.172569 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 589/1144] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:24:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 15:24:33.179404 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19009d-6eb7-4f7c-b372-7c37a738b65d None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:33.276728 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19009d-6eb7-4f7c-b372-7c37a738b65d None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:33.313523 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9d2b5-cd79-4893-82cd-5de10a5dd28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:33.314143 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9d2b5-cd79-4893-82cd-5de10a5dd28f None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:33.314414 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9d2b5-cd79-4893-82cd-5de10a5dd28f None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:33.314680 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9d2b5-cd79-4893-82cd-5de10a5dd28f None admin] PATH_INFO: `/v3/projects/132462c3c51e4beb966ae14f2274036d` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:33.315787 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e9d2b5-cd79-4893-82cd-5de10a5dd28f None admin] RBAC: Authorizing `identity:get_project(project_id=132462c3c51e4beb966ae14f2274036d)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:33.318024 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e9d2b5-cd79-4893-82cd-5de10a5dd28f None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:33.319852 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 556/1145] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:24:33 2022] GET /identity/v3/projects/132462c3c51e4beb966ae14f2274036d => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:33.325986 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5cef7a-869c-49ec-a7cf-489e43805d7b None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:33.416697 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:33.426645 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5cef7a-869c-49ec-a7cf-489e43805d7b None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:33.460292 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab57562-471a-4570-abab-25a88a0af811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:33.460889 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab57562-471a-4570-abab-25a88a0af811 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:33.461168 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab57562-471a-4570-abab-25a88a0af811 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:33.461437 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab57562-471a-4570-abab-25a88a0af811 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:33.462156 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab57562-471a-4570-abab-25a88a0af811 None admin] RBAC: Adding query filter params (role.id=4bb2bbb7bb544610877949fc933504d2, scope.project.id=132462c3c51e4beb966ae14f2274036d, user.id=bf3420f7144441ff92c4e7a873e121b3) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:24:33.462462 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab57562-471a-4570-abab-25a88a0af811 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:33.463928 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab57562-471a-4570-abab-25a88a0af811 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:33.469160 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 590/1146] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 15:24:33 2022] GET /identity/v3/role_assignments?user.id=bf3420f7144441ff92c4e7a873e121b3&scope.project.id=132462c3c51e4beb966ae14f2274036d&role.id=4bb2bbb7bb544610877949fc933504d2 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:35.345452 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076c87b-488a-4636-b6e0-cda07df92f08 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:35.345988 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076c87b-488a-4636-b6e0-cda07df92f08 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:35.345988 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076c87b-488a-4636-b6e0-cda07df92f08 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:35.347371 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 557/1147] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:24:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:24:35.353255 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c948a9-f716-449b-8a8f-9b605b8223c8 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:35.353683 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c948a9-f716-449b-8a8f-9b605b8223c8 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:35.353799 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c948a9-f716-449b-8a8f-9b605b8223c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:35.371679 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-11c948a9-f716-449b-8a8f-9b605b8223c8 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:24:35.372870 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-11c948a9-f716-449b-8a8f-9b605b8223c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:24:35.439964 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 591/1148] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:24:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:24:35.707439 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5076c87b-488a-4636-b6e0-cda07df92f08 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:35.746336 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:35.812556 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5076c87b-488a-4636-b6e0-cda07df92f08 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:35.844880 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeccbe4-cfc7-43e1-b680-dae3e92830d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:35.845502 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeccbe4-cfc7-43e1-b680-dae3e92830d0 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:35.845782 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeccbe4-cfc7-43e1-b680-dae3e92830d0 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:35.846055 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeccbe4-cfc7-43e1-b680-dae3e92830d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:35.856895 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeccbe4-cfc7-43e1-b680-dae3e92830d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:24:35.861745 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-6aeccbe4-cfc7-43e1-b680-dae3e92830d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:24:35.861745 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:24:35.861745 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:24:35.861745 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:24:35.861745 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:24:35.861745 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:24:35.861745 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:24:35.861745 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:24:35.861745 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:24:35.861745 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:24:35.861745 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:24:35.861745 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:24:35.861745 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:24:35.861745 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:24:35.861745 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:24:35.861745 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:24:35.862862 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:24:35.862862 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:24:35.862862 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:24:35.862862 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:24:35.862862 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:24:35.862862 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:24:35.862862 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:24:35.862862 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:24:35.862862 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:24:35.862862 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:24:35.862862 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:24:35.862862 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:24:35.862862 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:24:35.862862 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:24:35.862862 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:24:35.862862 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:24:35.865098 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:24:35.865098 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:24:35.865098 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:24:35.865098 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:24:35.865098 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:24:35.865098 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:24:35.865098 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:24:35.865098 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:24:35.865098 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:24:35.865098 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:24:35.865098 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:24:35.865098 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:24:35.865098 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 558/1149] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 15:24:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:24:35.869624 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c948a9-f716-449b-8a8f-9b605b8223c8 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:35.952517 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:35.968309 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c948a9-f716-449b-8a8f-9b605b8223c8 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:36.002319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefee8b-e77f-44fb-8026-22f24c315109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:36.002914 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefee8b-e77f-44fb-8026-22f24c315109 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:36.003218 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefee8b-e77f-44fb-8026-22f24c315109 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:36.003488 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefee8b-e77f-44fb-8026-22f24c315109 None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:36.004147 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aefee8b-e77f-44fb-8026-22f24c315109 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:24:36.004449 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aefee8b-e77f-44fb-8026-22f24c315109 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:36.006469 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aefee8b-e77f-44fb-8026-22f24c315109 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:36.015329 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 592/1150] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:24:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:36.021197 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeccbe4-cfc7-43e1-b680-dae3e92830d0 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:36.127137 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:36.134070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeccbe4-cfc7-43e1-b680-dae3e92830d0 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:36.167939 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6855e-d88e-4d27-b06f-aa0ee8f9718e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:36.168552 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6855e-d88e-4d27-b06f-aa0ee8f9718e None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:36.168827 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6855e-d88e-4d27-b06f-aa0ee8f9718e None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:36.169093 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6855e-d88e-4d27-b06f-aa0ee8f9718e None admin] PATH_INFO: `/v3/users/bf3420f7144441ff92c4e7a873e121b3` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:36.170191 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6855e-d88e-4d27-b06f-aa0ee8f9718e None admin] RBAC: Authorizing `identity:get_user(user_id=bf3420f7144441ff92c4e7a873e121b3)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:36.171655 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6855e-d88e-4d27-b06f-aa0ee8f9718e None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:36.173223 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 559/1151] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 15:24:36 2022] GET /identity/v3/users/bf3420f7144441ff92c4e7a873e121b3 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:24:36.179300 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefee8b-e77f-44fb-8026-22f24c315109 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:36.278233 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefee8b-e77f-44fb-8026-22f24c315109 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:36.311355 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb60613d-ef52-44f3-ba8f-5f3ec487b654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:36.311974 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60613d-ef52-44f3-ba8f-5f3ec487b654 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:36.312257 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60613d-ef52-44f3-ba8f-5f3ec487b654 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:36.312528 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60613d-ef52-44f3-ba8f-5f3ec487b654 None admin] PATH_INFO: `/v3/projects/132462c3c51e4beb966ae14f2274036d` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:36.313638 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb60613d-ef52-44f3-ba8f-5f3ec487b654 None admin] RBAC: Authorizing `identity:get_project(project_id=132462c3c51e4beb966ae14f2274036d)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:36.315100 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb60613d-ef52-44f3-ba8f-5f3ec487b654 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:36.316732 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 593/1152] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:24:36 2022] GET /identity/v3/projects/132462c3c51e4beb966ae14f2274036d => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:36.322750 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6855e-d88e-4d27-b06f-aa0ee8f9718e None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:36.424897 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6855e-d88e-4d27-b06f-aa0ee8f9718e None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:36.459160 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b12d36-dff5-4da5-9194-1d7ac17e04e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:36.459804 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b12d36-dff5-4da5-9194-1d7ac17e04e7 None admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:36.460080 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b12d36-dff5-4da5-9194-1d7ac17e04e7 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:36.460346 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b12d36-dff5-4da5-9194-1d7ac17e04e7 None admin] PATH_INFO: `/v3/projects/132462c3c51e4beb966ae14f2274036d/users/bf3420f7144441ff92c4e7a873e121b3/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:36.462241 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b12d36-dff5-4da5-9194-1d7ac17e04e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=132462c3c51e4beb966ae14f2274036d, user_id=bf3420f7144441ff92c4e7a873e121b3, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:36.463703 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b12d36-dff5-4da5-9194-1d7ac17e04e7 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:36.477168 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 560/1153] 10.222.0.83 () {58 vars in 1439 bytes} [Mon Aug 29 15:24:36 2022] PUT /identity/v3/projects/132462c3c51e4beb966ae14f2274036d/users/bf3420f7144441ff92c4e7a873e121b3/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:24:38.355261 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f08a3b-2c69-4fb3-8576-4edcc15fa1f4 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:38.355811 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f08a3b-2c69-4fb3-8576-4edcc15fa1f4 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:38.355811 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f08a3b-2c69-4fb3-8576-4edcc15fa1f4 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:38.357165 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 594/1154] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:24:38.362400 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca10cc-7c4a-4e18-a112-b9f2a508641b None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:38.362826 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca10cc-7c4a-4e18-a112-b9f2a508641b None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:38.362939 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca10cc-7c4a-4e18-a112-b9f2a508641b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:38.383239 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-82ca10cc-7c4a-4e18-a112-b9f2a508641b None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:24:38.384453 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-82ca10cc-7c4a-4e18-a112-b9f2a508641b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:24:38.401740 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:38.453305 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 561/1155] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:24:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:24:38.719741 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f08a3b-2c69-4fb3-8576-4edcc15fa1f4 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:38.738685 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:38.821692 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f08a3b-2c69-4fb3-8576-4edcc15fa1f4 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:38.854161 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7015dc38-2ea6-4cf6-8614-402d945c6fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:38.854775 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015dc38-2ea6-4cf6-8614-402d945c6fa7 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:38.855123 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015dc38-2ea6-4cf6-8614-402d945c6fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:38.855395 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015dc38-2ea6-4cf6-8614-402d945c6fa7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:38.866468 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7015dc38-2ea6-4cf6-8614-402d945c6fa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:24:38.871321 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-7015dc38-2ea6-4cf6-8614-402d945c6fa7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:24:38.871321 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:24:38.871321 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:24:38.871321 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:24:38.871321 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:24:38.871321 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:24:38.871321 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:24:38.871321 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:24:38.871321 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:24:38.871321 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:24:38.871321 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:24:38.871321 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:24:38.871321 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:24:38.871321 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:24:38.871321 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:24:38.871321 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:24:38.872295 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:24:38.872295 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:24:38.872295 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:24:38.872295 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:24:38.872295 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:24:38.872295 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:24:38.872295 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:24:38.872295 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:24:38.872295 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:24:38.872295 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:24:38.872295 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:24:38.872295 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:24:38.872295 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:24:38.872295 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:24:38.872295 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:24:38.872295 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:24:38.873289 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:24:38.873289 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:24:38.873289 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:24:38.873289 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:24:38.873289 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:24:38.873289 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:24:38.873289 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:24:38.873289 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:24:38.873289 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:24:38.873289 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:24:38.873289 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:24:38.873289 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:24:38.873289 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 595/1156] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 15:24:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:24:38.878487 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca10cc-7c4a-4e18-a112-b9f2a508641b None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:38.975742 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca10cc-7c4a-4e18-a112-b9f2a508641b None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:39.010104 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff7dac-7c72-413f-a59b-8f10493370a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:39.010712 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff7dac-7c72-413f-a59b-8f10493370a4 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:39.010984 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff7dac-7c72-413f-a59b-8f10493370a4 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:39.011281 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff7dac-7c72-413f-a59b-8f10493370a4 None admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:39.011940 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ff7dac-7c72-413f-a59b-8f10493370a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:24:39.012238 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ff7dac-7c72-413f-a59b-8f10493370a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:39.013611 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ff7dac-7c72-413f-a59b-8f10493370a4 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:39.021950 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 562/1157] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:24:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:39.027864 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7015dc38-2ea6-4cf6-8614-402d945c6fa7 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:39.103421 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:39.126116 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7015dc38-2ea6-4cf6-8614-402d945c6fa7 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:39.159005 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63656422-1622-4879-acd0-9be79f810ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:39.159656 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63656422-1622-4879-acd0-9be79f810ea7 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:39.159931 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63656422-1622-4879-acd0-9be79f810ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:39.160200 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63656422-1622-4879-acd0-9be79f810ea7 None admin] PATH_INFO: `/v3/users/bf3420f7144441ff92c4e7a873e121b3` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:39.161309 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63656422-1622-4879-acd0-9be79f810ea7 None admin] RBAC: Authorizing `identity:get_user(user_id=bf3420f7144441ff92c4e7a873e121b3)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:39.163436 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63656422-1622-4879-acd0-9be79f810ea7 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:39.165028 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 596/1158] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 15:24:39 2022] GET /identity/v3/users/bf3420f7144441ff92c4e7a873e121b3 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:39.170994 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff7dac-7c72-413f-a59b-8f10493370a4 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:39.187172 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:39.270288 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff7dac-7c72-413f-a59b-8f10493370a4 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:39.304041 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7109b97-9704-4d3b-b848-62a9e708db9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:39.304637 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7109b97-9704-4d3b-b848-62a9e708db9b None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:39.304912 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7109b97-9704-4d3b-b848-62a9e708db9b None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:39.305180 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7109b97-9704-4d3b-b848-62a9e708db9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:39.372183 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7109b97-9704-4d3b-b848-62a9e708db9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:39.373697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7109b97-9704-4d3b-b848-62a9e708db9b None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:39.388115 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:39.472576 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 563/1159] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:24:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 15:24:39.478570 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63656422-1622-4879-acd0-9be79f810ea7 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:39.576243 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63656422-1622-4879-acd0-9be79f810ea7 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:39.608846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210dcd34-90dd-48a1-83eb-97b044539c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:39.609463 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210dcd34-90dd-48a1-83eb-97b044539c30 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:39.609741 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210dcd34-90dd-48a1-83eb-97b044539c30 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:39.610022 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210dcd34-90dd-48a1-83eb-97b044539c30 None admin] PATH_INFO: `/v3/projects/132462c3c51e4beb966ae14f2274036d` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:39.611357 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210dcd34-90dd-48a1-83eb-97b044539c30 None admin] RBAC: Authorizing `identity:get_project(project_id=132462c3c51e4beb966ae14f2274036d)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:39.612789 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210dcd34-90dd-48a1-83eb-97b044539c30 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:39.614408 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 597/1160] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:24:39 2022] GET /identity/v3/projects/132462c3c51e4beb966ae14f2274036d => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:39.620580 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7109b97-9704-4d3b-b848-62a9e708db9b None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:39.720181 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7109b97-9704-4d3b-b848-62a9e708db9b None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:39.734013 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:39.754573 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f8648-723c-4530-9de2-cc27a717f2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:39.755209 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f8648-723c-4530-9de2-cc27a717f2a8 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:39.755485 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f8648-723c-4530-9de2-cc27a717f2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:39.755755 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f8648-723c-4530-9de2-cc27a717f2a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:39.757124 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f8648-723c-4530-9de2-cc27a717f2a8 None admin] RBAC: Adding query filter params (role.id=4bb2bbb7bb544610877949fc933504d2, scope.project.id=132462c3c51e4beb966ae14f2274036d, user.id=bf3420f7144441ff92c4e7a873e121b3) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:24:39.757432 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f8648-723c-4530-9de2-cc27a717f2a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:39.758953 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f8648-723c-4530-9de2-cc27a717f2a8 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:39.766813 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 564/1161] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 15:24:39 2022] GET /identity/v3/role_assignments?user.id=bf3420f7144441ff92c4e7a873e121b3&scope.project.id=132462c3c51e4beb966ae14f2274036d&role.id=4bb2bbb7bb544610877949fc933504d2 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:41.683036 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afaae4-35bc-4e7a-b0cb-7cfb9a5f610f None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:41.683599 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afaae4-35bc-4e7a-b0cb-7cfb9a5f610f None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:41.683599 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afaae4-35bc-4e7a-b0cb-7cfb9a5f610f None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:41.684910 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 598/1162] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:24:41.690035 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba4633-8df7-42f3-8116-96b958d9538c None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:41.690436 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba4633-8df7-42f3-8116-96b958d9538c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:41.690561 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba4633-8df7-42f3-8116-96b958d9538c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:41.709121 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-cfba4633-8df7-42f3-8116-96b958d9538c None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:24:41.710926 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-cfba4633-8df7-42f3-8116-96b958d9538c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:24:41.776718 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 565/1163] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:24:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 15:24:42.041281 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47afaae4-35bc-4e7a-b0cb-7cfb9a5f610f None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:42.057191 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:42.145047 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47afaae4-35bc-4e7a-b0cb-7cfb9a5f610f None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:42.177664 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a522d-cbea-432b-9475-f06b8ba5b58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:42.178254 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a522d-cbea-432b-9475-f06b8ba5b58f None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:42.178528 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a522d-cbea-432b-9475-f06b8ba5b58f None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:42.178795 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a522d-cbea-432b-9475-f06b8ba5b58f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:42.244990 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a522d-cbea-432b-9475-f06b8ba5b58f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:42.246433 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a522d-cbea-432b-9475-f06b8ba5b58f None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:42.260141 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:42.342762 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 599/1164] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:24:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 15:24:42.348667 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfba4633-8df7-42f3-8116-96b958d9538c None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:42.445772 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfba4633-8df7-42f3-8116-96b958d9538c None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:42.454547 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:42.480210 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef9962d-e268-46ed-9298-2c301856d224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:42.480828 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9962d-e268-46ed-9298-2c301856d224 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:42.481110 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9962d-e268-46ed-9298-2c301856d224 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:42.481384 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9962d-e268-46ed-9298-2c301856d224 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:42.487849 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef9962d-e268-46ed-9298-2c301856d224 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:42.489284 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef9962d-e268-46ed-9298-2c301856d224 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:42.500955 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-3ef9962d-e268-46ed-9298-2c301856d224 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 29 15:24:42.500955 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:24:42.500955 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 29 15:24:42.500955 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 29 15:24:42.500955 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:24:42.500955 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:24:42.500955 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:24:42.500955 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:24:42.500955 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 29 15:24:42.500955 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:24:42.500955 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:24:42.500955 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:24:42.500955 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:24:42.500955 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:24:42.500955 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:24:42.500955 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:24:42.500955 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:24:42.502141 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:24:42.502141 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:24:42.502141 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:24:42.502141 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:24:42.502141 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:24:42.502141 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:24:42.502141 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:24:42.502141 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:24:42.502141 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:24:42.502141 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:24:42.502141 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:24:42.502141 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:24:42.502141 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:24:42.502141 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:24:42.502141 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:24:42.502141 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:24:42.503229 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:24:42.503229 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:24:42.503229 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:24:42.503229 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:24:42.503229 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:24:42.503229 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:24:42.503229 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:24:42.503229 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:24:42.503229 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:24:42.503229 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:24:42.503229 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 29 15:24:42.503229 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:24:42.503229 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 29 15:24:42.503229 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:24:42.503229 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 566/1165] 10.222.0.83 () {56 vars in 1117 bytes} [Mon Aug 29 15:24:42 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:24:42.508049 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a522d-cbea-432b-9475-f06b8ba5b58f None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:42.605416 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a522d-cbea-432b-9475-f06b8ba5b58f None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:42.618817 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:42.639751 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1dbd68-0907-4a78-9757-aac829a5d8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:42.640353 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1dbd68-0907-4a78-9757-aac829a5d8aa None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:42.640634 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1dbd68-0907-4a78-9757-aac829a5d8aa None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:42.640907 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1dbd68-0907-4a78-9757-aac829a5d8aa None admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:42.641804 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1dbd68-0907-4a78-9757-aac829a5d8aa None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:24:42.642108 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1dbd68-0907-4a78-9757-aac829a5d8aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:42.643535 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1dbd68-0907-4a78-9757-aac829a5d8aa None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:42.650654 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 600/1166] 10.222.0.83 () {56 vars in 1115 bytes} [Mon Aug 29 15:24:42 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:44.568776 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b641e-29bc-4eeb-8f6e-ac9ca8d8d5fe None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:44.569353 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b641e-29bc-4eeb-8f6e-ac9ca8d8d5fe None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:44.569353 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b641e-29bc-4eeb-8f6e-ac9ca8d8d5fe None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:44.571297 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 567/1167] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:24:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:24:44.576591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a2943-6353-45b2-88fb-d260fd6247aa None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:44.576994 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a2943-6353-45b2-88fb-d260fd6247aa None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:44.577132 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a2943-6353-45b2-88fb-d260fd6247aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:44.595304 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-d60a2943-6353-45b2-88fb-d260fd6247aa None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:24:44.596513 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d60a2943-6353-45b2-88fb-d260fd6247aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:24:44.661433 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 601/1168] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:24:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:24:44.933257 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b641e-29bc-4eeb-8f6e-ac9ca8d8d5fe None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:45.036084 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b641e-29bc-4eeb-8f6e-ac9ca8d8d5fe None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:45.069811 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3976242-247d-4eef-bbdf-43ac2703e5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:45.070406 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3976242-247d-4eef-bbdf-43ac2703e5dc None admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:45.070707 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3976242-247d-4eef-bbdf-43ac2703e5dc None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:45.070977 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3976242-247d-4eef-bbdf-43ac2703e5dc None admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:45.071685 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3976242-247d-4eef-bbdf-43ac2703e5dc None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:45.073069 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3976242-247d-4eef-bbdf-43ac2703e5dc None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:45.089721 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 568/1169] 10.222.0.83 () {60 vars in 1138 bytes} [Mon Aug 29 15:24:44 2022] POST /identity/v3/domains => generated 267 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:24:47.022836 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d496f8c-c78f-4d1e-a9a2-4c95d9626a19 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:47.023395 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d496f8c-c78f-4d1e-a9a2-4c95d9626a19 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:47.023395 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d496f8c-c78f-4d1e-a9a2-4c95d9626a19 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:47.024860 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 602/1170] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:24:47.029984 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf5211-b030-43c0-9d03-df455fc66ef7 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:47.030428 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf5211-b030-43c0-9d03-df455fc66ef7 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:47.030533 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf5211-b030-43c0-9d03-df455fc66ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:47.048927 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-77bf5211-b030-43c0-9d03-df455fc66ef7 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:24:47.050088 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-77bf5211-b030-43c0-9d03-df455fc66ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:24:47.072883 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:47.116133 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 569/1171] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:24:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:24:47.381123 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d496f8c-c78f-4d1e-a9a2-4c95d9626a19 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:47.482029 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d496f8c-c78f-4d1e-a9a2-4c95d9626a19 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:47.489103 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:47.516127 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0371da2-00de-4da9-a0d0-35acac04233c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:47.516754 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0371da2-00de-4da9-a0d0-35acac04233c None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:47.517035 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0371da2-00de-4da9-a0d0-35acac04233c None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:47.517312 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0371da2-00de-4da9-a0d0-35acac04233c None admin] PATH_INFO: `/v3/domains/8709476ea78249a2a2ece13afafa92d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:47.528448 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0371da2-00de-4da9-a0d0-35acac04233c None admin] RBAC: Authorizing `identity:get_domain(domain_id=8709476ea78249a2a2ece13afafa92d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:47.529895 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0371da2-00de-4da9-a0d0-35acac04233c None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:47.531537 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 603/1172] 10.222.0.83 () {56 vars in 1183 bytes} [Mon Aug 29 15:24:47 2022] GET /identity/v3/domains/8709476ea78249a2a2ece13afafa92d2 => generated 267 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:47.537351 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf5211-b030-43c0-9d03-df455fc66ef7 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:47.634571 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf5211-b030-43c0-9d03-df455fc66ef7 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:47.668856 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e93412-7041-42c6-9a00-a3af48dc227b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:47.669450 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e93412-7041-42c6-9a00-a3af48dc227b None admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:47.669735 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e93412-7041-42c6-9a00-a3af48dc227b None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:47.670021 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e93412-7041-42c6-9a00-a3af48dc227b None admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:47.670674 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e93412-7041-42c6-9a00-a3af48dc227b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:47.672254 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e93412-7041-42c6-9a00-a3af48dc227b None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:47.699489 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 570/1173] 10.222.0.83 () {60 vars in 1141 bytes} [Mon Aug 29 15:24:47 2022] POST /identity/v3/projects => generated 361 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:24:49.627973 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31434d55-21c5-4f0c-acea-47b31c13d4bf None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:49.628532 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31434d55-21c5-4f0c-acea-47b31c13d4bf None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:49.628532 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31434d55-21c5-4f0c-acea-47b31c13d4bf None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:49.629852 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 604/1174] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:24:49.635361 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49372d3b-a3d1-4bb6-8e6c-f36c77b66f5b None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:49.635757 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49372d3b-a3d1-4bb6-8e6c-f36c77b66f5b None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:49.635898 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49372d3b-a3d1-4bb6-8e6c-f36c77b66f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:49.654326 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-49372d3b-a3d1-4bb6-8e6c-f36c77b66f5b None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:24:49.655517 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-49372d3b-a3d1-4bb6-8e6c-f36c77b66f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:24:49.658187 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:49.723427 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 571/1175] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:24:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:24:49.990793 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31434d55-21c5-4f0c-acea-47b31c13d4bf None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:50.091471 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31434d55-21c5-4f0c-acea-47b31c13d4bf None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:50.123795 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab31266-6b9b-4786-83b2-c4c132f7a376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:50.124414 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab31266-6b9b-4786-83b2-c4c132f7a376 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:50.124692 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab31266-6b9b-4786-83b2-c4c132f7a376 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:50.124962 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab31266-6b9b-4786-83b2-c4c132f7a376 None admin] PATH_INFO: `/v3/domains/8709476ea78249a2a2ece13afafa92d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:50.126068 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab31266-6b9b-4786-83b2-c4c132f7a376 None admin] RBAC: Authorizing `identity:get_domain(domain_id=8709476ea78249a2a2ece13afafa92d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:50.127529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab31266-6b9b-4786-83b2-c4c132f7a376 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:50.129106 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 605/1176] 10.222.0.83 () {56 vars in 1183 bytes} [Mon Aug 29 15:24:49 2022] GET /identity/v3/domains/8709476ea78249a2a2ece13afafa92d2 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:50.135337 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49372d3b-a3d1-4bb6-8e6c-f36c77b66f5b None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:50.231794 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49372d3b-a3d1-4bb6-8e6c-f36c77b66f5b None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:50.264536 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ba457-0e0c-41d2-8ed1-2eccdf084bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:50.265057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ba457-0e0c-41d2-8ed1-2eccdf084bdc None admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:50.265329 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ba457-0e0c-41d2-8ed1-2eccdf084bdc None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:50.265594 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ba457-0e0c-41d2-8ed1-2eccdf084bdc None admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:50.266235 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4ba457-0e0c-41d2-8ed1-2eccdf084bdc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:50.267685 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4ba457-0e0c-41d2-8ed1-2eccdf084bdc None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:50.279400 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:50.290141 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 572/1177] 10.222.0.83 () {60 vars in 1132 bytes} [Mon Aug 29 15:24:50 2022] POST /identity/v3/users => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:24:52.250861 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62db564-f8f1-4bc4-a80f-5afedf714ff9 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:52.251438 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62db564-f8f1-4bc4-a80f-5afedf714ff9 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:52.251438 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62db564-f8f1-4bc4-a80f-5afedf714ff9 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:52.252785 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 606/1178] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:24:52.257760 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198798f4-d303-495b-89a4-46e7b79faaa0 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:52.258128 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198798f4-d303-495b-89a4-46e7b79faaa0 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:52.258297 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198798f4-d303-495b-89a4-46e7b79faaa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:52.276870 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-198798f4-d303-495b-89a4-46e7b79faaa0 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:24:52.278041 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-198798f4-d303-495b-89a4-46e7b79faaa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:24:52.343213 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 573/1179] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:24:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:24:52.611228 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62db564-f8f1-4bc4-a80f-5afedf714ff9 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:52.646133 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:52.711156 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62db564-f8f1-4bc4-a80f-5afedf714ff9 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:52.744337 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f79e22-5691-407f-8eed-e1c57dc3f12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:52.745006 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f79e22-5691-407f-8eed-e1c57dc3f12b None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:52.745280 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f79e22-5691-407f-8eed-e1c57dc3f12b None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:52.745546 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f79e22-5691-407f-8eed-e1c57dc3f12b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:52.755951 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f79e22-5691-407f-8eed-e1c57dc3f12b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:24:52.760811 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-58f79e22-5691-407f-8eed-e1c57dc3f12b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:24:52.760811 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:24:52.760811 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:24:52.760811 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:24:52.760811 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:24:52.760811 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:24:52.760811 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:24:52.760811 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:24:52.760811 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:24:52.760811 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:24:52.760811 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:24:52.760811 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:24:52.760811 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:24:52.760811 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:24:52.760811 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:24:52.760811 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:24:52.761965 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:24:52.761965 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:24:52.761965 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:24:52.761965 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:24:52.761965 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:24:52.761965 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:24:52.761965 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:24:52.761965 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:24:52.761965 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:24:52.761965 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:24:52.761965 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:24:52.761965 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:24:52.761965 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:24:52.761965 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:24:52.761965 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:24:52.761965 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:24:52.763186 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:24:52.763186 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:24:52.763186 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:24:52.763186 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:24:52.763186 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:24:52.763186 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:24:52.763186 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:24:52.763186 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:24:52.763186 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:24:52.763186 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:24:52.763186 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:24:52.763186 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:24:52.763186 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 607/1180] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 15:24:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:24:52.768036 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198798f4-d303-495b-89a4-46e7b79faaa0 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:52.864795 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198798f4-d303-495b-89a4-46e7b79faaa0 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:52.889074 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:52.898245 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ee98d-75ce-4fcc-9e0e-e559a9c553c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:52.898851 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ee98d-75ce-4fcc-9e0e-e559a9c553c5 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:52.899164 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ee98d-75ce-4fcc-9e0e-e559a9c553c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:52.899438 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ee98d-75ce-4fcc-9e0e-e559a9c553c5 None admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:52.900099 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ee98d-75ce-4fcc-9e0e-e559a9c553c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:24:52.900399 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ee98d-75ce-4fcc-9e0e-e559a9c553c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:52.902337 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ee98d-75ce-4fcc-9e0e-e559a9c553c5 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:52.913761 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 574/1181] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:24:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:52.920258 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f79e22-5691-407f-8eed-e1c57dc3f12b None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:53.020815 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:53.032510 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f79e22-5691-407f-8eed-e1c57dc3f12b None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:53.064532 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a731f03-23e9-4809-93c0-d84b12d3fcdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:53.065148 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a731f03-23e9-4809-93c0-d84b12d3fcdd None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:53.065426 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a731f03-23e9-4809-93c0-d84b12d3fcdd None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:53.065696 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a731f03-23e9-4809-93c0-d84b12d3fcdd None admin] PATH_INFO: `/v3/users/8b3471478c24486cba8974e119b9ae16` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:53.078911 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a731f03-23e9-4809-93c0-d84b12d3fcdd None admin] RBAC: Authorizing `identity:get_user(user_id=8b3471478c24486cba8974e119b9ae16)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:53.080381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a731f03-23e9-4809-93c0-d84b12d3fcdd None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:53.081972 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 608/1182] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 15:24:52 2022] GET /identity/v3/users/8b3471478c24486cba8974e119b9ae16 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:53.087967 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ee98d-75ce-4fcc-9e0e-e559a9c553c5 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:53.185181 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ee98d-75ce-4fcc-9e0e-e559a9c553c5 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:53.218760 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469aaf1a-66f3-4bdb-a9f3-afff09e5aebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:53.219392 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469aaf1a-66f3-4bdb-a9f3-afff09e5aebe None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:53.219669 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469aaf1a-66f3-4bdb-a9f3-afff09e5aebe None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:53.219937 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469aaf1a-66f3-4bdb-a9f3-afff09e5aebe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:53.281561 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:53.293697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469aaf1a-66f3-4bdb-a9f3-afff09e5aebe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:53.295165 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469aaf1a-66f3-4bdb-a9f3-afff09e5aebe None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:53.391040 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 575/1183] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:24:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 15:24:53.397180 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a731f03-23e9-4809-93c0-d84b12d3fcdd None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:53.493394 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a731f03-23e9-4809-93c0-d84b12d3fcdd None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:53.527485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff445f0-cdba-481b-a555-5d6354e6d346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:53.528113 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff445f0-cdba-481b-a555-5d6354e6d346 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:53.528389 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff445f0-cdba-481b-a555-5d6354e6d346 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:53.528659 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff445f0-cdba-481b-a555-5d6354e6d346 None admin] PATH_INFO: `/v3/projects/29ede8dbc25e4e10b6a6458af198b5e9` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:53.529832 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff445f0-cdba-481b-a555-5d6354e6d346 None admin] RBAC: Authorizing `identity:get_project(project_id=29ede8dbc25e4e10b6a6458af198b5e9)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:53.531288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff445f0-cdba-481b-a555-5d6354e6d346 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:53.533033 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 609/1184] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:24:53 2022] GET /identity/v3/projects/29ede8dbc25e4e10b6a6458af198b5e9 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:53.539347 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469aaf1a-66f3-4bdb-a9f3-afff09e5aebe None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:53.626604 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:53.639612 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469aaf1a-66f3-4bdb-a9f3-afff09e5aebe None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:53.673173 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04bcea8-592d-4064-b14d-02bad42764bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:53.673765 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04bcea8-592d-4064-b14d-02bad42764bc None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:53.674039 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04bcea8-592d-4064-b14d-02bad42764bc None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:53.674306 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04bcea8-592d-4064-b14d-02bad42764bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:53.675044 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04bcea8-592d-4064-b14d-02bad42764bc None admin] RBAC: Adding query filter params (role.id=4bb2bbb7bb544610877949fc933504d2, scope.project.id=29ede8dbc25e4e10b6a6458af198b5e9, user.id=8b3471478c24486cba8974e119b9ae16) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:24:53.675352 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04bcea8-592d-4064-b14d-02bad42764bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:53.676778 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04bcea8-592d-4064-b14d-02bad42764bc None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:53.681967 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 576/1185] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 15:24:53 2022] GET /identity/v3/role_assignments?user.id=8b3471478c24486cba8974e119b9ae16&scope.project.id=29ede8dbc25e4e10b6a6458af198b5e9&role.id=4bb2bbb7bb544610877949fc933504d2 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:55.551643 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa1af7-3408-4310-b466-93d998b9b0d0 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:55.552173 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa1af7-3408-4310-b466-93d998b9b0d0 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:55.552173 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa1af7-3408-4310-b466-93d998b9b0d0 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:55.553508 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 610/1186] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:24:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:24:55.559418 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85634e5-22b0-40b2-b80b-bd505d717550 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:55.559860 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85634e5-22b0-40b2-b80b-bd505d717550 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:55.559955 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85634e5-22b0-40b2-b80b-bd505d717550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:55.578404 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-f85634e5-22b0-40b2-b80b-bd505d717550 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:24:55.579618 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f85634e5-22b0-40b2-b80b-bd505d717550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:24:55.645503 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 577/1187] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:24:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:24:55.919755 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa1af7-3408-4310-b466-93d998b9b0d0 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:55.941549 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:56.022438 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa1af7-3408-4310-b466-93d998b9b0d0 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:56.056557 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f91e0-1adb-4f08-ba41-46d5120bc450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:56.057184 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f91e0-1adb-4f08-ba41-46d5120bc450 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:56.057461 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f91e0-1adb-4f08-ba41-46d5120bc450 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:56.057731 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f91e0-1adb-4f08-ba41-46d5120bc450 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:56.068547 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38f91e0-1adb-4f08-ba41-46d5120bc450 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:24:56.073435 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-d38f91e0-1adb-4f08-ba41-46d5120bc450 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:24:56.073435 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:24:56.073435 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:24:56.073435 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:24:56.073435 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:24:56.073435 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:24:56.073435 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:24:56.073435 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:24:56.073435 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:24:56.073435 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:24:56.073435 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:24:56.073435 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:24:56.073435 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:24:56.073435 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:24:56.073435 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:24:56.073435 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:24:56.074641 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:24:56.074641 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:24:56.074641 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:24:56.074641 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:24:56.074641 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:24:56.074641 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:24:56.074641 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:24:56.074641 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:24:56.074641 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:24:56.074641 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:24:56.074641 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:24:56.074641 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:24:56.074641 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:24:56.074641 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:24:56.074641 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:24:56.074641 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:24:56.075946 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:24:56.075946 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:24:56.075946 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:24:56.075946 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:24:56.075946 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:24:56.075946 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:24:56.075946 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:24:56.075946 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:24:56.075946 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:24:56.075946 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:24:56.075946 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:24:56.075946 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:24:56.075946 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 611/1188] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 15:24:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:24:56.080965 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85634e5-22b0-40b2-b80b-bd505d717550 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:56.160425 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:56.179418 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85634e5-22b0-40b2-b80b-bd505d717550 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:56.212588 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aabd625-4288-404a-860a-98b482702cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:56.213191 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aabd625-4288-404a-860a-98b482702cfa None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:56.213466 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aabd625-4288-404a-860a-98b482702cfa None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:56.213735 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aabd625-4288-404a-860a-98b482702cfa None admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:56.214383 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aabd625-4288-404a-860a-98b482702cfa None admin] RBAC: Adding query filter params (name=admin) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:24:56.214718 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aabd625-4288-404a-860a-98b482702cfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:56.216120 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aabd625-4288-404a-860a-98b482702cfa None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:56.223954 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 578/1189] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:24:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:56.230938 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f91e0-1adb-4f08-ba41-46d5120bc450 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:56.312697 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:56.331701 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f91e0-1adb-4f08-ba41-46d5120bc450 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:56.366343 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d9d804-f678-493e-bb49-d3822021a008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:56.366977 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9d804-f678-493e-bb49-d3822021a008 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:56.367293 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9d804-f678-493e-bb49-d3822021a008 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:56.367566 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9d804-f678-493e-bb49-d3822021a008 None admin] PATH_INFO: `/v3/users/8b3471478c24486cba8974e119b9ae16` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:56.368715 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d9d804-f678-493e-bb49-d3822021a008 None admin] RBAC: Authorizing `identity:get_user(user_id=8b3471478c24486cba8974e119b9ae16)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:56.370145 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d9d804-f678-493e-bb49-d3822021a008 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:56.371885 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 612/1190] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 15:24:56 2022] GET /identity/v3/users/8b3471478c24486cba8974e119b9ae16 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:56.377724 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aabd625-4288-404a-860a-98b482702cfa None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:56.476919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aabd625-4288-404a-860a-98b482702cfa None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:56.511071 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d487e6-6e76-4169-8efb-dd4b482e9c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:56.511704 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d487e6-6e76-4169-8efb-dd4b482e9c0c None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:56.511983 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d487e6-6e76-4169-8efb-dd4b482e9c0c None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:56.512263 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d487e6-6e76-4169-8efb-dd4b482e9c0c None admin] PATH_INFO: `/v3/projects/29ede8dbc25e4e10b6a6458af198b5e9` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:56.513411 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d487e6-6e76-4169-8efb-dd4b482e9c0c None admin] RBAC: Authorizing `identity:get_project(project_id=29ede8dbc25e4e10b6a6458af198b5e9)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:56.514846 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d487e6-6e76-4169-8efb-dd4b482e9c0c None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:56.516528 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 579/1191] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:24:56 2022] GET /identity/v3/projects/29ede8dbc25e4e10b6a6458af198b5e9 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:56.522790 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d9d804-f678-493e-bb49-d3822021a008 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:56.619876 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d9d804-f678-493e-bb49-d3822021a008 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:56.654334 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089d051-ee0b-456b-8131-a37700ba5d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:56.654982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089d051-ee0b-456b-8131-a37700ba5d48 None admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:56.655288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089d051-ee0b-456b-8131-a37700ba5d48 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:56.655555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089d051-ee0b-456b-8131-a37700ba5d48 None admin] PATH_INFO: `/v3/projects/29ede8dbc25e4e10b6a6458af198b5e9/users/8b3471478c24486cba8974e119b9ae16/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:56.657478 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c089d051-ee0b-456b-8131-a37700ba5d48 None admin] RBAC: Authorizing `identity:create_grant(project_id=29ede8dbc25e4e10b6a6458af198b5e9, user_id=8b3471478c24486cba8974e119b9ae16, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:56.658935 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c089d051-ee0b-456b-8131-a37700ba5d48 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:56.672370 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 613/1192] 10.222.0.83 () {58 vars in 1439 bytes} [Mon Aug 29 15:24:56 2022] PUT /identity/v3/projects/29ede8dbc25e4e10b6a6458af198b5e9/users/8b3471478c24486cba8974e119b9ae16/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:24:58.579097 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d905417-9975-4fb9-8606-f5f6aa92fdeb None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:58.579663 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d905417-9975-4fb9-8606-f5f6aa92fdeb None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:58.579663 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d905417-9975-4fb9-8606-f5f6aa92fdeb None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:58.580976 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 580/1193] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:24:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:24:58.586192 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672036d-1ecc-4115-af62-b7f34ea8b606 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:58.586589 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672036d-1ecc-4115-af62-b7f34ea8b606 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:58.586732 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672036d-1ecc-4115-af62-b7f34ea8b606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:58.604883 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-4672036d-1ecc-4115-af62-b7f34ea8b606 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:24:58.606658 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4672036d-1ecc-4115-af62-b7f34ea8b606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:24:58.608616 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:58.688180 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 614/1194] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:24:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:24:58.964179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d905417-9975-4fb9-8606-f5f6aa92fdeb None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:58.979958 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:59.071195 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d905417-9975-4fb9-8606-f5f6aa92fdeb None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:59.105277 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b3b4a-fb89-474c-a92d-f5a19931a8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:59.105913 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b3b4a-fb89-474c-a92d-f5a19931a8e9 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:59.106331 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b3b4a-fb89-474c-a92d-f5a19931a8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:59.106697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b3b4a-fb89-474c-a92d-f5a19931a8e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:59.116666 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6b3b4a-fb89-474c-a92d-f5a19931a8e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:24:59.121552 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-4c6b3b4a-fb89-474c-a92d-f5a19931a8e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:24:59.121552 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:24:59.121552 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:24:59.121552 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:24:59.121552 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:24:59.121552 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:24:59.121552 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:24:59.121552 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:24:59.121552 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:24:59.121552 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:24:59.121552 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:24:59.121552 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:24:59.121552 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:24:59.121552 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:24:59.121552 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:24:59.121552 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:24:59.122853 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:24:59.122853 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:24:59.122853 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:24:59.122853 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:24:59.122853 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:24:59.122853 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:24:59.122853 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:24:59.122853 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:24:59.122853 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:24:59.122853 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:24:59.122853 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:24:59.122853 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:24:59.122853 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:24:59.122853 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:24:59.122853 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:24:59.122853 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:24:59.123752 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:24:59.123752 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:24:59.123752 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:24:59.123752 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:24:59.123752 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:24:59.123752 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:24:59.123752 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:24:59.123752 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:24:59.123752 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:24:59.123752 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:24:59.123752 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:24:59.123752 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:24:59.123752 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 581/1195] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 15:24:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:24:59.128838 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4672036d-1ecc-4115-af62-b7f34ea8b606 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:59.224268 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4672036d-1ecc-4115-af62-b7f34ea8b606 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:59.256389 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ec7bd-1694-4d67-b0c3-72cc0dd64607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:59.257000 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ec7bd-1694-4d67-b0c3-72cc0dd64607 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:59.257282 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ec7bd-1694-4d67-b0c3-72cc0dd64607 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:59.257555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ec7bd-1694-4d67-b0c3-72cc0dd64607 None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:59.258222 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7ec7bd-1694-4d67-b0c3-72cc0dd64607 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:24:59.258524 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7ec7bd-1694-4d67-b0c3-72cc0dd64607 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:59.259932 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7ec7bd-1694-4d67-b0c3-72cc0dd64607 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:59.265441 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:59.268744 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 615/1196] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:24:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:59.274774 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b3b4a-fb89-474c-a92d-f5a19931a8e9 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:59.347304 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:59.376007 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b3b4a-fb89-474c-a92d-f5a19931a8e9 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:59.409649 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447effd-3bbe-4069-b42d-247f52361f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:59.410261 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447effd-3bbe-4069-b42d-247f52361f2a None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:59.410531 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447effd-3bbe-4069-b42d-247f52361f2a None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:59.410794 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447effd-3bbe-4069-b42d-247f52361f2a None admin] PATH_INFO: `/v3/users/8b3471478c24486cba8974e119b9ae16` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:59.411910 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f447effd-3bbe-4069-b42d-247f52361f2a None admin] RBAC: Authorizing `identity:get_user(user_id=8b3471478c24486cba8974e119b9ae16)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:59.413326 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f447effd-3bbe-4069-b42d-247f52361f2a None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:59.414872 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 582/1197] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 15:24:59 2022] GET /identity/v3/users/8b3471478c24486cba8974e119b9ae16 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:59.420951 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ec7bd-1694-4d67-b0c3-72cc0dd64607 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:59.520312 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ec7bd-1694-4d67-b0c3-72cc0dd64607 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:59.552842 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf5d2c-5f80-4e3e-902a-8796d4a10220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:59.553441 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf5d2c-5f80-4e3e-902a-8796d4a10220 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:59.553719 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf5d2c-5f80-4e3e-902a-8796d4a10220 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:59.553993 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf5d2c-5f80-4e3e-902a-8796d4a10220 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:59.616871 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:59.619103 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebf5d2c-5f80-4e3e-902a-8796d4a10220 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:59.620910 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebf5d2c-5f80-4e3e-902a-8796d4a10220 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:59.719249 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 616/1198] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:24:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 15:24:59.725269 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447effd-3bbe-4069-b42d-247f52361f2a None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:59.822514 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447effd-3bbe-4069-b42d-247f52361f2a None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:59.854972 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45098109-2868-4f5f-a413-d3372df8711a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:59.855619 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45098109-2868-4f5f-a413-d3372df8711a None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:59.855895 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45098109-2868-4f5f-a413-d3372df8711a None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:59.856161 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45098109-2868-4f5f-a413-d3372df8711a None admin] PATH_INFO: `/v3/projects/29ede8dbc25e4e10b6a6458af198b5e9` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:59.857885 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45098109-2868-4f5f-a413-d3372df8711a None admin] RBAC: Authorizing `identity:get_project(project_id=29ede8dbc25e4e10b6a6458af198b5e9)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:59.859351 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45098109-2868-4f5f-a413-d3372df8711a None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:59.860987 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 583/1199] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 15:24:59 2022] GET /identity/v3/projects/29ede8dbc25e4e10b6a6458af198b5e9 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:24:59.867321 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf5d2c-5f80-4e3e-902a-8796d4a10220 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:59.963893 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:59.967262 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf5d2c-5f80-4e3e-902a-8796d4a10220 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:00.002807 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c628e6d2-9800-41ed-9d16-d8752848ae04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:00.003463 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c628e6d2-9800-41ed-9d16-d8752848ae04 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:00.003771 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c628e6d2-9800-41ed-9d16-d8752848ae04 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:00.004072 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c628e6d2-9800-41ed-9d16-d8752848ae04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:00.004822 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c628e6d2-9800-41ed-9d16-d8752848ae04 None admin] RBAC: Adding query filter params (role.id=4bb2bbb7bb544610877949fc933504d2, scope.project.id=29ede8dbc25e4e10b6a6458af198b5e9, user.id=8b3471478c24486cba8974e119b9ae16) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:25:00.005154 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c628e6d2-9800-41ed-9d16-d8752848ae04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:00.006672 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c628e6d2-9800-41ed-9d16-d8752848ae04 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:00.012498 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 617/1200] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 15:24:59 2022] GET /identity/v3/role_assignments?user.id=8b3471478c24486cba8974e119b9ae16&scope.project.id=29ede8dbc25e4e10b6a6458af198b5e9&role.id=4bb2bbb7bb544610877949fc933504d2 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:25:09.851365 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:10.009983 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=18 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:55.709532 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4b4fb-397c-4d37-8f0d-3213a01b8236 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:55.710056 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4b4fb-397c-4d37-8f0d-3213a01b8236 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:55.710056 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4b4fb-397c-4d37-8f0d-3213a01b8236 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:55.711527 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 584/1201] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:25:55.719107 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160a8c7-3de4-460e-820b-183f0d181fa0 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:55.719107 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160a8c7-3de4-460e-820b-183f0d181fa0 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:55.719107 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160a8c7-3de4-460e-820b-183f0d181fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:55.751944 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-3160a8c7-3de4-460e-820b-183f0d181fa0 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:55.753236 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3160a8c7-3de4-460e-820b-183f0d181fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:55.844331 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 618/1202] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:25:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:25:56.135456 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4b4fb-397c-4d37-8f0d-3213a01b8236 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:56.265831 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4b4fb-397c-4d37-8f0d-3213a01b8236 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:56.309186 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845ce86-2e7f-4d51-98d5-3717ba44c99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:56.309831 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845ce86-2e7f-4d51-98d5-3717ba44c99b None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:56.310104 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845ce86-2e7f-4d51-98d5-3717ba44c99b None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:56.310372 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845ce86-2e7f-4d51-98d5-3717ba44c99b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:56.322168 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4845ce86-2e7f-4d51-98d5-3717ba44c99b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:56.323739 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4845ce86-2e7f-4d51-98d5-3717ba44c99b None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:56.342025 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-4845ce86-2e7f-4d51-98d5-3717ba44c99b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:25:56.342025 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:25:56.342025 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:25:56.342025 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:25:56.342025 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:25:56.342025 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:25:56.342025 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:25:56.342025 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:25:56.342025 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:25:56.342025 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:25:56.342025 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:25:56.342025 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:25:56.342025 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:25:56.342025 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:25:56.342025 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:25:56.342025 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:25:56.343175 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:25:56.343175 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:25:56.343175 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:25:56.343175 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:25:56.343175 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:25:56.343175 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:25:56.343175 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:25:56.343175 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:25:56.343175 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:25:56.343175 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:25:56.343175 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:25:56.343175 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:25:56.343175 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:25:56.343175 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:25:56.343175 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:25:56.343175 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:25:56.343175 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:25:56.344239 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:25:56.344239 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:25:56.344239 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:25:56.344239 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 585/1203] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:25:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:25:56.349692 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160a8c7-3de4-460e-820b-183f0d181fa0 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:56.502254 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160a8c7-3de4-460e-820b-183f0d181fa0 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:56.547576 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:56.554952 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40231b-9f73-48a2-8bcf-b3f6333ef411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:56.556250 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40231b-9f73-48a2-8bcf-b3f6333ef411 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:56.556634 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40231b-9f73-48a2-8bcf-b3f6333ef411 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:56.556985 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40231b-9f73-48a2-8bcf-b3f6333ef411 None admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:56.557616 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e40231b-9f73-48a2-8bcf-b3f6333ef411 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:25:56.557917 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e40231b-9f73-48a2-8bcf-b3f6333ef411 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:56.559373 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e40231b-9f73-48a2-8bcf-b3f6333ef411 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:56.572691 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 619/1204] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:25:56.578753 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845ce86-2e7f-4d51-98d5-3717ba44c99b None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:56.652337 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:56.725503 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845ce86-2e7f-4d51-98d5-3717ba44c99b None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:56.766894 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f0ee66-ea3a-44df-9067-b0f6030b6927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:56.767462 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0ee66-ea3a-44df-9067-b0f6030b6927 None admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:56.767741 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0ee66-ea3a-44df-9067-b0f6030b6927 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:56.768005 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0ee66-ea3a-44df-9067-b0f6030b6927 None admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:56.768648 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f0ee66-ea3a-44df-9067-b0f6030b6927 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:56.770073 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f0ee66-ea3a-44df-9067-b0f6030b6927 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:56.795251 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 586/1205] 10.222.0.83 () {60 vars in 1132 bytes} [Mon Aug 29 15:25:56 2022] POST /identity/v3/users => generated 251 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:58.988578 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d8a5b-c8b7-430f-8f08-a9e4d83762f7 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:58.989098 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d8a5b-c8b7-430f-8f08-a9e4d83762f7 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:58.989098 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d8a5b-c8b7-430f-8f08-a9e4d83762f7 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:58.990519 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 620/1206] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:25:58.999072 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31adf36f-ecff-43a3-97b2-2472f137a592 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:58.999072 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31adf36f-ecff-43a3-97b2-2472f137a592 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:58.999072 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31adf36f-ecff-43a3-97b2-2472f137a592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:59.019884 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-31adf36f-ecff-43a3-97b2-2472f137a592 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:59.021606 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-31adf36f-ecff-43a3-97b2-2472f137a592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:59.111433 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 587/1207] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:25:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 15:25:59.407185 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d8a5b-c8b7-430f-8f08-a9e4d83762f7 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:59.533639 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d8a5b-c8b7-430f-8f08-a9e4d83762f7 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:59.584481 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7806171-a7e5-4e96-99ee-fe04db487ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:59.585362 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7806171-a7e5-4e96-99ee-fe04db487ae7 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:59.585780 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7806171-a7e5-4e96-99ee-fe04db487ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:59.586152 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7806171-a7e5-4e96-99ee-fe04db487ae7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:59.601245 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7806171-a7e5-4e96-99ee-fe04db487ae7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:25:59.611317 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-d7806171-a7e5-4e96-99ee-fe04db487ae7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:25:59.611317 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:25:59.611317 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:25:59.611317 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:25:59.611317 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:25:59.611317 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:25:59.611317 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:25:59.611317 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:25:59.611317 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:25:59.611317 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:25:59.611317 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:25:59.611317 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:25:59.611317 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:25:59.611317 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:25:59.611317 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:25:59.611317 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:25:59.612349 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:25:59.612349 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:25:59.612349 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:25:59.612349 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:25:59.612349 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:25:59.612349 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:25:59.612349 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:25:59.612349 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:25:59.612349 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:25:59.612349 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:25:59.612349 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:25:59.612349 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:25:59.612349 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:25:59.612349 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:25:59.612349 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:25:59.612349 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:25:59.613188 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:25:59.613188 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:25:59.613188 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:25:59.613188 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:25:59.613188 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:25:59.613188 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:25:59.613188 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:25:59.613188 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:25:59.613188 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:25:59.613188 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:25:59.613188 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:25:59.613188 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:25:59.622463 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31adf36f-ecff-43a3-97b2-2472f137a592 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:59.632034 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 621/1208] 10.222.0.83 () {56 vars in 1102 bytes} [Mon Aug 29 15:25:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:25:59.669786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:59.761908 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31adf36f-ecff-43a3-97b2-2472f137a592 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:59.803090 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e69c4-a6ec-4b49-9c26-f44b7e4c06c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:59.803729 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e69c4-a6ec-4b49-9c26-f44b7e4c06c8 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:59.804003 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e69c4-a6ec-4b49-9c26-f44b7e4c06c8 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:59.804276 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e69c4-a6ec-4b49-9c26-f44b7e4c06c8 None admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:59.805049 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e69c4-a6ec-4b49-9c26-f44b7e4c06c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:25:59.805393 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e69c4-a6ec-4b49-9c26-f44b7e4c06c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:59.807780 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e69c4-a6ec-4b49-9c26-f44b7e4c06c8 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:59.817894 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 588/1209] 10.222.0.83 () {56 vars in 1103 bytes} [Mon Aug 29 15:25:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:25:59.825260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7806171-a7e5-4e96-99ee-fe04db487ae7 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:59.904145 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:59.972759 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7806171-a7e5-4e96-99ee-fe04db487ae7 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:00.021971 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dadfac0-c7be-4e96-86e9-01aac2b4093c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:00.022713 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadfac0-c7be-4e96-86e9-01aac2b4093c None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:00.031420 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadfac0-c7be-4e96-86e9-01aac2b4093c None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:00.031420 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadfac0-c7be-4e96-86e9-01aac2b4093c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:00.049531 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dadfac0-c7be-4e96-86e9-01aac2b4093c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:00.055697 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dadfac0-c7be-4e96-86e9-01aac2b4093c None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:00.083140 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-9dadfac0-c7be-4e96-86e9-01aac2b4093c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:26:00.083140 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:26:00.083140 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:26:00.083140 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:26:00.083140 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:26:00.083140 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:26:00.083140 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:26:00.083140 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:26:00.083140 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:26:00.083140 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:26:00.083140 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:26:00.083140 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:26:00.083140 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:26:00.083140 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:26:00.083140 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:26:00.083140 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:26:00.085256 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:26:00.085256 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:26:00.085256 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:26:00.085256 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:26:00.085256 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:26:00.085256 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:26:00.085256 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:26:00.085256 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:26:00.085256 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:26:00.085256 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:26:00.085256 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:26:00.085256 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:26:00.085256 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:26:00.085256 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:26:00.085256 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:26:00.085256 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:26:00.085256 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:26:00.086178 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:26:00.086178 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:26:00.086178 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:26:00.086178 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 622/1210] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:25:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:26:00.100372 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e69c4-a6ec-4b49-9c26-f44b7e4c06c8 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:00.224712 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:00.227583 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e69c4-a6ec-4b49-9c26-f44b7e4c06c8 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:00.270924 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf3244-63c8-43fc-95b8-c7b69684d627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:00.271569 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf3244-63c8-43fc-95b8-c7b69684d627 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:00.271844 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf3244-63c8-43fc-95b8-c7b69684d627 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:00.272112 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf3244-63c8-43fc-95b8-c7b69684d627 None admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:00.272754 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf3244-63c8-43fc-95b8-c7b69684d627 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:00.273107 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf3244-63c8-43fc-95b8-c7b69684d627 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:00.274479 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf3244-63c8-43fc-95b8-c7b69684d627 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:00.289937 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 589/1211] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:00.296112 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dadfac0-c7be-4e96-86e9-01aac2b4093c None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:00.414578 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dadfac0-c7be-4e96-86e9-01aac2b4093c None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:00.417478 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:00.459053 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496a44d0-736d-42df-908e-71fd0929b2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:00.459927 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a44d0-736d-42df-908e-71fd0929b2fc None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:00.460196 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a44d0-736d-42df-908e-71fd0929b2fc None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:00.460470 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a44d0-736d-42df-908e-71fd0929b2fc None admin] PATH_INFO: `/v3/users/placement` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:00.477235 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496a44d0-736d-42df-908e-71fd0929b2fc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:00.477694 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496a44d0-736d-42df-908e-71fd0929b2fc None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:00.493320 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-496a44d0-736d-42df-908e-71fd0929b2fc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 15:26:00.493320 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:26:00.493320 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:26:00.493320 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:26:00.493320 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:26:00.493320 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:26:00.493320 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:26:00.493320 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:26:00.493320 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:26:00.493320 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:26:00.493320 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:26:00.493320 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:26:00.493320 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:26:00.493320 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:26:00.493320 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:26:00.493320 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:26:00.496195 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:26:00.496195 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:26:00.496195 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:26:00.496195 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:26:00.496195 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:26:00.496195 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:26:00.496195 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:26:00.496195 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:26:00.496195 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:26:00.496195 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:26:00.496195 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:26:00.496195 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:26:00.496195 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:26:00.496195 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:26:00.496195 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:26:00.496195 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:26:00.496195 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:26:00.496195 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:26:00.498036 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:26:00.498036 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:26:00.498036 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:26:00.498036 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:26:00.498036 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:26:00.498036 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:26:00.498036 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:26:00.498036 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:26:00.498036 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 15:26:00.498036 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:26:00.498036 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 623/1212] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:26:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:26:00.502192 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf3244-63c8-43fc-95b8-c7b69684d627 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:00.648756 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf3244-63c8-43fc-95b8-c7b69684d627 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:00.690080 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cceec4a-9efc-4125-9153-2fccba9f3c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:00.690865 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cceec4a-9efc-4125-9153-2fccba9f3c51 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:00.691351 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cceec4a-9efc-4125-9153-2fccba9f3c51 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:00.691637 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cceec4a-9efc-4125-9153-2fccba9f3c51 None admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:00.692730 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cceec4a-9efc-4125-9153-2fccba9f3c51 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:00.693218 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cceec4a-9efc-4125-9153-2fccba9f3c51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:00.695358 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cceec4a-9efc-4125-9153-2fccba9f3c51 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:00.715950 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 590/1213] 10.222.0.83 () {56 vars in 1143 bytes} [Mon Aug 29 15:26:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:00.721832 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496a44d0-736d-42df-908e-71fd0929b2fc None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:00.859337 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496a44d0-736d-42df-908e-71fd0929b2fc None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:00.899326 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df47b8-a437-4c4f-992b-982c32e0e98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:00.900914 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df47b8-a437-4c4f-992b-982c32e0e98c None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:00.901325 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df47b8-a437-4c4f-992b-982c32e0e98c None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:00.901584 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df47b8-a437-4c4f-992b-982c32e0e98c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:00.937174 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:00.981715 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df47b8-a437-4c4f-992b-982c32e0e98c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:00.983545 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df47b8-a437-4c4f-992b-982c32e0e98c None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:01.101186 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 624/1214] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:26:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 15:26:01.107649 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cceec4a-9efc-4125-9153-2fccba9f3c51 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:01.131354 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:01.241729 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cceec4a-9efc-4125-9153-2fccba9f3c51 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:01.284936 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc60364-323f-4224-b121-328be9fd82eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:01.285585 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc60364-323f-4224-b121-328be9fd82eb None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:01.285905 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc60364-323f-4224-b121-328be9fd82eb None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:01.286163 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc60364-323f-4224-b121-328be9fd82eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:01.299477 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc60364-323f-4224-b121-328be9fd82eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:01.301061 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc60364-323f-4224-b121-328be9fd82eb None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:01.318307 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-dfc60364-323f-4224-b121-328be9fd82eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:26:01.318307 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:26:01.318307 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:26:01.318307 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:26:01.318307 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:26:01.318307 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:26:01.318307 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:26:01.318307 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:26:01.318307 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:26:01.318307 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:26:01.318307 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:26:01.318307 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:26:01.318307 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:26:01.318307 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:26:01.318307 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:26:01.318307 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:26:01.319629 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:26:01.319629 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:26:01.319629 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:26:01.319629 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:26:01.319629 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:26:01.319629 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:26:01.319629 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:26:01.319629 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:26:01.319629 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:26:01.319629 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:26:01.319629 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:26:01.319629 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:26:01.319629 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:26:01.319629 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:26:01.319629 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:26:01.319629 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:26:01.319629 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:26:01.320582 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:26:01.320582 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:26:01.320582 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:26:01.320582 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 591/1215] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:26:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:26:01.330018 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df47b8-a437-4c4f-992b-982c32e0e98c None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:01.403675 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:01.450668 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df47b8-a437-4c4f-992b-982c32e0e98c None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:01.505892 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942b7be-189b-4a58-9196-d07837afdd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:01.506419 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942b7be-189b-4a58-9196-d07837afdd1a None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:01.506678 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942b7be-189b-4a58-9196-d07837afdd1a None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:01.506955 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942b7be-189b-4a58-9196-d07837afdd1a None admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:01.507818 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9942b7be-189b-4a58-9196-d07837afdd1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:01.508127 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9942b7be-189b-4a58-9196-d07837afdd1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:01.510491 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9942b7be-189b-4a58-9196-d07837afdd1a None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:01.529474 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 625/1216] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:01.530829 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc60364-323f-4224-b121-328be9fd82eb None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:01.607760 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:01.643845 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc60364-323f-4224-b121-328be9fd82eb None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:01.680737 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139459e7-523a-4d9c-b6b7-7d9fbba4208a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:01.681323 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139459e7-523a-4d9c-b6b7-7d9fbba4208a None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:01.681606 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139459e7-523a-4d9c-b6b7-7d9fbba4208a None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:01.681877 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139459e7-523a-4d9c-b6b7-7d9fbba4208a None admin] PATH_INFO: `/v3/projects/service` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:01.690480 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139459e7-523a-4d9c-b6b7-7d9fbba4208a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:01.691973 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139459e7-523a-4d9c-b6b7-7d9fbba4208a None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:01.704540 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-139459e7-523a-4d9c-b6b7-7d9fbba4208a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:26:01.704540 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:26:01.704540 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:26:01.704540 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:26:01.704540 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:26:01.704540 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:26:01.704540 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:26:01.704540 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:26:01.704540 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:26:01.704540 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:26:01.704540 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:26:01.704540 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:26:01.704540 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:26:01.704540 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:26:01.704540 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:26:01.710434 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:26:01.710434 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:26:01.710434 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:26:01.710434 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:26:01.710434 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:26:01.710434 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:26:01.710434 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:26:01.710434 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:26:01.710434 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:26:01.710434 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:26:01.710434 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:26:01.710434 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:26:01.710434 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:26:01.710434 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:26:01.710434 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:26:01.710434 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:26:01.710434 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:26:01.711439 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:26:01.711439 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:26:01.711439 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:26:01.711439 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:26:01.711439 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:26:01.711439 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:26:01.711439 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:26:01.711439 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:26:01.711439 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 592/1217] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:26:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:26:01.711967 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942b7be-189b-4a58-9196-d07837afdd1a None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:01.838690 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942b7be-189b-4a58-9196-d07837afdd1a None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:01.866270 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:01.880366 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d512c42-b333-466f-8f33-23658ac640ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:01.881187 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d512c42-b333-466f-8f33-23658ac640ff None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:01.881612 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d512c42-b333-466f-8f33-23658ac640ff None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:01.882058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d512c42-b333-466f-8f33-23658ac640ff None admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:01.882935 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d512c42-b333-466f-8f33-23658ac640ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:01.883495 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d512c42-b333-466f-8f33-23658ac640ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:01.885973 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d512c42-b333-466f-8f33-23658ac640ff None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:01.906147 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 626/1218] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 15:26:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:01.907221 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139459e7-523a-4d9c-b6b7-7d9fbba4208a None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:02.016368 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139459e7-523a-4d9c-b6b7-7d9fbba4208a None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:02.048211 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:02.055539 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf26ba81-e496-4928-a2f3-79b93e72b050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:02.056264 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26ba81-e496-4928-a2f3-79b93e72b050 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:02.057199 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26ba81-e496-4928-a2f3-79b93e72b050 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:02.057573 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26ba81-e496-4928-a2f3-79b93e72b050 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:02.058450 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf26ba81-e496-4928-a2f3-79b93e72b050 None admin] RBAC: Adding query filter params (role.id=19a8fa4068774a289594739614bb8ad4, scope.project.id=44655977b0814a728f0fa73d442a7ee9, user.id=c190fa4a280c41c684130e069bee99eb) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:02.058852 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf26ba81-e496-4928-a2f3-79b93e72b050 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:02.060438 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf26ba81-e496-4928-a2f3-79b93e72b050 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:02.075049 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 593/1219] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 15:26:01 2022] GET /identity/v3/role_assignments?user.id=c190fa4a280c41c684130e069bee99eb&scope.project.id=44655977b0814a728f0fa73d442a7ee9&role.id=19a8fa4068774a289594739614bb8ad4 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:04.061246 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4fd9c-6658-4925-ba5a-4cc5e41a61ea None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:04.061779 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4fd9c-6658-4925-ba5a-4cc5e41a61ea None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:04.061875 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4fd9c-6658-4925-ba5a-4cc5e41a61ea None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:04.063403 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 627/1220] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:26:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:26:04.069377 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e9ec0-eb8b-4766-a96c-cf3ac065f148 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:04.069377 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e9ec0-eb8b-4766-a96c-cf3ac065f148 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:04.069377 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e9ec0-eb8b-4766-a96c-cf3ac065f148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:04.088874 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-5b8e9ec0-eb8b-4766-a96c-cf3ac065f148 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:04.090129 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5b8e9ec0-eb8b-4766-a96c-cf3ac065f148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:04.166297 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 594/1221] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:26:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 15:26:04.431526 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4fd9c-6658-4925-ba5a-4cc5e41a61ea None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:04.550081 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4fd9c-6658-4925-ba5a-4cc5e41a61ea None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:04.592803 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae258205-206a-43cd-906f-437023f74155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:04.593414 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae258205-206a-43cd-906f-437023f74155 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:04.593685 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae258205-206a-43cd-906f-437023f74155 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:04.593951 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae258205-206a-43cd-906f-437023f74155 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:04.605579 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae258205-206a-43cd-906f-437023f74155 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:26:04.610322 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-ae258205-206a-43cd-906f-437023f74155 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:26:04.610322 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:26:04.610322 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:26:04.610322 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:26:04.610322 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:26:04.610322 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:26:04.610322 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:26:04.610322 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:26:04.610322 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:26:04.610322 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:26:04.610322 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:26:04.610322 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:26:04.610322 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:26:04.610322 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:26:04.610322 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:26:04.610322 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:26:04.611534 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:26:04.611534 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:26:04.611534 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:26:04.611534 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:26:04.611534 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:26:04.611534 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:26:04.611534 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:26:04.611534 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:26:04.611534 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:26:04.611534 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:26:04.611534 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:26:04.611534 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:26:04.611534 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:26:04.611534 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:26:04.611534 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:26:04.611534 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:26:04.612454 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:26:04.612454 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:26:04.612454 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:26:04.612454 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:26:04.612454 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:26:04.612454 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:26:04.612454 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:26:04.612454 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:26:04.612454 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:26:04.612454 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:26:04.612454 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:26:04.612454 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:26:04.612454 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 628/1222] 10.222.0.83 () {56 vars in 1102 bytes} [Mon Aug 29 15:26:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:26:04.617723 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e9ec0-eb8b-4766-a96c-cf3ac065f148 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:04.732654 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e9ec0-eb8b-4766-a96c-cf3ac065f148 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:04.758995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:04.773034 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee7b66-f971-4e26-8c66-a9daab9b3a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:04.773743 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee7b66-f971-4e26-8c66-a9daab9b3a7f None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:04.774162 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee7b66-f971-4e26-8c66-a9daab9b3a7f None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:04.774494 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee7b66-f971-4e26-8c66-a9daab9b3a7f None admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:04.775439 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee7b66-f971-4e26-8c66-a9daab9b3a7f None admin] RBAC: Adding query filter params (name=service) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:04.775804 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee7b66-f971-4e26-8c66-a9daab9b3a7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:04.777684 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee7b66-f971-4e26-8c66-a9daab9b3a7f None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:04.788387 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 595/1223] 10.222.0.83 () {56 vars in 1103 bytes} [Mon Aug 29 15:26:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:04.795008 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae258205-206a-43cd-906f-437023f74155 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:04.841756 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:04.909401 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae258205-206a-43cd-906f-437023f74155 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:04.948172 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e4f04-8e5f-456c-be3a-5aa5e4f55b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:04.948969 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e4f04-8e5f-456c-be3a-5aa5e4f55b0e None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:04.949422 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e4f04-8e5f-456c-be3a-5aa5e4f55b0e None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:04.949814 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e4f04-8e5f-456c-be3a-5aa5e4f55b0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:04.962863 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9e4f04-8e5f-456c-be3a-5aa5e4f55b0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:04.965547 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9e4f04-8e5f-456c-be3a-5aa5e4f55b0e None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:04.984482 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-7f9e4f04-8e5f-456c-be3a-5aa5e4f55b0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:26:04.984482 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:26:04.984482 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:26:04.984482 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:26:04.984482 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:26:04.984482 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:26:04.984482 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:26:04.984482 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:26:04.984482 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:26:04.984482 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:26:04.984482 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:26:04.984482 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:26:04.984482 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:26:04.984482 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:26:04.984482 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:26:04.984482 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:26:04.985741 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:26:04.985741 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:26:04.985741 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:26:04.985741 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:26:04.985741 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:26:04.985741 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:26:04.985741 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:26:04.985741 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:26:04.985741 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:26:04.985741 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:26:04.985741 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:26:04.985741 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:26:04.985741 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:26:04.985741 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:26:04.985741 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:26:04.985741 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:26:04.985741 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:26:04.986911 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:26:04.986911 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:26:04.986911 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:26:04.986911 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 629/1224] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:26:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:26:04.992067 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee7b66-f971-4e26-8c66-a9daab9b3a7f None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:05.112722 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee7b66-f971-4e26-8c66-a9daab9b3a7f None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:05.147609 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e3c06-e60c-42f5-8f06-3afc897ff28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:05.148288 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e3c06-e60c-42f5-8f06-3afc897ff28a None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:05.148576 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e3c06-e60c-42f5-8f06-3afc897ff28a None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:05.148858 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e3c06-e60c-42f5-8f06-3afc897ff28a None admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:05.149532 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2e3c06-e60c-42f5-8f06-3afc897ff28a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:05.149947 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2e3c06-e60c-42f5-8f06-3afc897ff28a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:05.151869 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2e3c06-e60c-42f5-8f06-3afc897ff28a None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:05.167697 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 596/1225] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:05.173915 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e4f04-8e5f-456c-be3a-5aa5e4f55b0e None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:05.281857 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:05.289950 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e4f04-8e5f-456c-be3a-5aa5e4f55b0e None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:05.326751 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aff4bb-887a-4b14-8273-03f2f38e0464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:05.327409 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aff4bb-887a-4b14-8273-03f2f38e0464 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:05.327690 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aff4bb-887a-4b14-8273-03f2f38e0464 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:05.327964 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aff4bb-887a-4b14-8273-03f2f38e0464 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:05.336359 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aff4bb-887a-4b14-8273-03f2f38e0464 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:05.337825 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aff4bb-887a-4b14-8273-03f2f38e0464 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:05.349670 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-d6aff4bb-887a-4b14-8273-03f2f38e0464 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 15:26:05.349670 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:26:05.349670 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:26:05.349670 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:26:05.349670 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:26:05.349670 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:26:05.349670 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:26:05.349670 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:26:05.349670 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:26:05.349670 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:26:05.349670 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:26:05.349670 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:26:05.349670 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:26:05.349670 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:26:05.349670 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:26:05.349670 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:26:05.350603 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:26:05.350603 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:26:05.350603 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:26:05.350603 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:26:05.350603 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:26:05.350603 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:26:05.350603 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:26:05.350603 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:26:05.350603 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:26:05.350603 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:26:05.350603 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:26:05.350603 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:26:05.350603 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:26:05.350603 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:26:05.350603 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:26:05.350603 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:26:05.350603 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:26:05.350603 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:26:05.351885 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:26:05.351885 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:26:05.351885 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:26:05.351885 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:26:05.351885 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:26:05.351885 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:26:05.351885 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:26:05.351885 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:26:05.351885 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 15:26:05.351885 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:26:05.351885 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 630/1226] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:26:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:26:05.358705 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e3c06-e60c-42f5-8f06-3afc897ff28a None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:05.425468 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:05.484172 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e3c06-e60c-42f5-8f06-3afc897ff28a None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:05.519661 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850efb6-06d1-4363-a062-503244197f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:05.520276 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850efb6-06d1-4363-a062-503244197f90 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:05.520554 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850efb6-06d1-4363-a062-503244197f90 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:05.520823 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850efb6-06d1-4363-a062-503244197f90 None admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:05.521544 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4850efb6-06d1-4363-a062-503244197f90 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:05.521845 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4850efb6-06d1-4363-a062-503244197f90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:05.523290 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4850efb6-06d1-4363-a062-503244197f90 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:05.541232 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 597/1227] 10.222.0.83 () {56 vars in 1143 bytes} [Mon Aug 29 15:26:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:05.547658 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aff4bb-887a-4b14-8273-03f2f38e0464 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:05.657881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aff4bb-887a-4b14-8273-03f2f38e0464 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:05.696673 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06683b6a-2993-47bf-8586-56d10070b572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:05.697403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06683b6a-2993-47bf-8586-56d10070b572 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:05.697667 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06683b6a-2993-47bf-8586-56d10070b572 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:05.697978 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06683b6a-2993-47bf-8586-56d10070b572 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:05.710960 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06683b6a-2993-47bf-8586-56d10070b572 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:05.712476 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06683b6a-2993-47bf-8586-56d10070b572 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:05.728265 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-06683b6a-2993-47bf-8586-56d10070b572 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:26:05.728265 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:26:05.728265 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:26:05.728265 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:26:05.728265 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:26:05.728265 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:26:05.728265 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:26:05.728265 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:26:05.728265 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:26:05.728265 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:26:05.728265 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:26:05.728265 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:26:05.728265 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:26:05.728265 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:26:05.728265 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:26:05.728265 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:26:05.729566 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:26:05.729566 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:26:05.729566 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:26:05.729566 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:26:05.729566 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:26:05.729566 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:26:05.729566 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:26:05.729566 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:26:05.729566 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:26:05.729566 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:26:05.729566 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:26:05.729566 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:26:05.729566 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:26:05.729566 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:26:05.729566 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:26:05.729566 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:26:05.729566 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:26:05.730539 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:26:05.730539 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:26:05.730539 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:26:05.730539 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 631/1228] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:26:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:26:05.735638 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850efb6-06d1-4363-a062-503244197f90 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:05.851333 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850efb6-06d1-4363-a062-503244197f90 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:05.854776 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:05.894775 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555cb70-5241-49ca-adf3-3c715078d9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:05.895540 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555cb70-5241-49ca-adf3-3c715078d9ac None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:05.895933 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555cb70-5241-49ca-adf3-3c715078d9ac None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:05.896345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555cb70-5241-49ca-adf3-3c715078d9ac None admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:05.897118 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6555cb70-5241-49ca-adf3-3c715078d9ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:05.897558 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6555cb70-5241-49ca-adf3-3c715078d9ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:05.899390 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6555cb70-5241-49ca-adf3-3c715078d9ac None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:05.914226 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 598/1229] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:05.920736 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06683b6a-2993-47bf-8586-56d10070b572 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:05.930406 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:06.039793 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06683b6a-2993-47bf-8586-56d10070b572 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:06.080479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e464173-c677-472f-bf62-c635291d9cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:06.081190 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e464173-c677-472f-bf62-c635291d9cd8 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:06.081522 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e464173-c677-472f-bf62-c635291d9cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:06.081899 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e464173-c677-472f-bf62-c635291d9cd8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:06.089745 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e464173-c677-472f-bf62-c635291d9cd8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:06.091692 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e464173-c677-472f-bf62-c635291d9cd8 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:06.106201 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-2e464173-c677-472f-bf62-c635291d9cd8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:26:06.106201 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:26:06.106201 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:26:06.106201 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:26:06.106201 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:26:06.106201 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:26:06.106201 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:26:06.106201 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:26:06.106201 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:26:06.106201 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:26:06.106201 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:26:06.106201 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:26:06.106201 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:26:06.106201 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:26:06.106201 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:26:06.107348 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:26:06.107348 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:26:06.107348 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:26:06.107348 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:26:06.107348 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:26:06.107348 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:26:06.107348 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:26:06.107348 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:26:06.107348 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:26:06.107348 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:26:06.107348 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:26:06.107348 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:26:06.107348 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:26:06.107348 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:26:06.107348 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:26:06.107348 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:26:06.107348 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:26:06.108255 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:26:06.108255 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:26:06.108255 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:26:06.108255 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:26:06.108255 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:26:06.108255 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:26:06.108255 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:26:06.108255 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:26:06.108255 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 632/1230] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:26:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:26:06.113600 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555cb70-5241-49ca-adf3-3c715078d9ac None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:06.234839 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555cb70-5241-49ca-adf3-3c715078d9ac None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:06.283652 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ade78-8d6f-4abb-bdd5-f99cf19176f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:06.284550 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ade78-8d6f-4abb-bdd5-f99cf19176f5 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:06.284873 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ade78-8d6f-4abb-bdd5-f99cf19176f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:06.285202 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ade78-8d6f-4abb-bdd5-f99cf19176f5 None admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:06.286271 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ade78-8d6f-4abb-bdd5-f99cf19176f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:06.286740 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ade78-8d6f-4abb-bdd5-f99cf19176f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:06.289354 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ade78-8d6f-4abb-bdd5-f99cf19176f5 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:06.309251 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 599/1231] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 15:26:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:26:06.317423 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e464173-c677-472f-bf62-c635291d9cd8 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:06.415916 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:06.465633 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e464173-c677-472f-bf62-c635291d9cd8 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:06.502367 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e026b0-24ce-4871-8863-6825cf812e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:06.503112 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e026b0-24ce-4871-8863-6825cf812e82 None admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:06.503404 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e026b0-24ce-4871-8863-6825cf812e82 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:06.503667 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e026b0-24ce-4871-8863-6825cf812e82 None admin] PATH_INFO: `/v3/projects/44655977b0814a728f0fa73d442a7ee9/users/c190fa4a280c41c684130e069bee99eb/roles/19a8fa4068774a289594739614bb8ad4` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:06.520779 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e026b0-24ce-4871-8863-6825cf812e82 None admin] RBAC: Authorizing `identity:create_grant(project_id=44655977b0814a728f0fa73d442a7ee9, user_id=c190fa4a280c41c684130e069bee99eb, role_id=19a8fa4068774a289594739614bb8ad4)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:06.522291 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e026b0-24ce-4871-8863-6825cf812e82 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:06.538267 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 633/1232] 10.222.0.83 () {58 vars in 1439 bytes} [Mon Aug 29 15:26:06 2022] PUT /identity/v3/projects/44655977b0814a728f0fa73d442a7ee9/users/c190fa4a280c41c684130e069bee99eb/roles/19a8fa4068774a289594739614bb8ad4 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:08.632004 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81934e47-813a-4e70-a402-d4506a8c9fca None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:08.632586 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81934e47-813a-4e70-a402-d4506a8c9fca None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:08.632586 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81934e47-813a-4e70-a402-d4506a8c9fca None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:08.633940 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 600/1233] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:26:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:26:08.640088 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1c172-de91-4da2-a1dd-dce6301a2eec None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:08.640552 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1c172-de91-4da2-a1dd-dce6301a2eec None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:08.640702 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1c172-de91-4da2-a1dd-dce6301a2eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:08.661023 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-27f1c172-de91-4da2-a1dd-dce6301a2eec None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:08.662645 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-27f1c172-de91-4da2-a1dd-dce6301a2eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:08.748693 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 634/1234] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:26:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:26:09.031969 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81934e47-813a-4e70-a402-d4506a8c9fca None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:09.065861 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:09.149196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81934e47-813a-4e70-a402-d4506a8c9fca None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:09.184859 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf9bca-7f47-49a7-9218-dace05f03d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:09.185651 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf9bca-7f47-49a7-9218-dace05f03d64 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:09.185795 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf9bca-7f47-49a7-9218-dace05f03d64 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:09.186034 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf9bca-7f47-49a7-9218-dace05f03d64 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:09.196819 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf9bca-7f47-49a7-9218-dace05f03d64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:26:09.202482 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-0ecf9bca-7f47-49a7-9218-dace05f03d64 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:26:09.202482 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:26:09.202482 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:26:09.202482 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:26:09.202482 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:26:09.202482 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:26:09.202482 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:26:09.202482 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:26:09.202482 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:26:09.202482 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:26:09.202482 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:26:09.202482 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:26:09.202482 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:26:09.202482 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:26:09.202482 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:26:09.202482 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:26:09.203555 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:26:09.203555 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:26:09.203555 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:26:09.203555 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:26:09.203555 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:26:09.203555 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:26:09.203555 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:26:09.203555 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:26:09.203555 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:26:09.203555 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:26:09.203555 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:26:09.203555 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:26:09.203555 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:26:09.203555 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:26:09.203555 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:26:09.203555 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:26:09.204949 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:26:09.204949 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:26:09.204949 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:26:09.204949 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:26:09.204949 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:26:09.204949 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:26:09.204949 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:26:09.204949 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:26:09.204949 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:26:09.204949 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:26:09.204949 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:26:09.204949 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:26:09.204949 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 601/1235] 10.222.0.83 () {56 vars in 1102 bytes} [Mon Aug 29 15:26:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:26:09.209733 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1c172-de91-4da2-a1dd-dce6301a2eec None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:09.257934 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:09.313588 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1c172-de91-4da2-a1dd-dce6301a2eec None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:09.351923 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ccd16f-a2d3-412c-995e-4e329df142f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:09.352592 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccd16f-a2d3-412c-995e-4e329df142f0 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:09.352909 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccd16f-a2d3-412c-995e-4e329df142f0 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:09.353189 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccd16f-a2d3-412c-995e-4e329df142f0 None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:09.353874 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ccd16f-a2d3-412c-995e-4e329df142f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:09.354221 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ccd16f-a2d3-412c-995e-4e329df142f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:09.355781 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ccd16f-a2d3-412c-995e-4e329df142f0 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:09.364979 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 635/1236] 10.222.0.83 () {56 vars in 1103 bytes} [Mon Aug 29 15:26:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:09.371259 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf9bca-7f47-49a7-9218-dace05f03d64 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:09.468622 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:09.485695 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf9bca-7f47-49a7-9218-dace05f03d64 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:09.523400 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b227c6d-fab7-4c83-89a5-414d1686d858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:09.524028 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b227c6d-fab7-4c83-89a5-414d1686d858 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:09.524334 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b227c6d-fab7-4c83-89a5-414d1686d858 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:09.524582 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b227c6d-fab7-4c83-89a5-414d1686d858 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:09.535652 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b227c6d-fab7-4c83-89a5-414d1686d858 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:09.537074 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b227c6d-fab7-4c83-89a5-414d1686d858 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:09.557773 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-0b227c6d-fab7-4c83-89a5-414d1686d858 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:26:09.557773 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:26:09.557773 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:26:09.557773 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:26:09.557773 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:26:09.557773 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:26:09.557773 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:26:09.557773 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:26:09.557773 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:26:09.557773 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:26:09.557773 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:26:09.557773 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:26:09.557773 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:26:09.557773 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:26:09.557773 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:26:09.557773 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:26:09.559201 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:26:09.559201 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:26:09.559201 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:26:09.559201 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:26:09.559201 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:26:09.559201 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:26:09.559201 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:26:09.559201 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:26:09.559201 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:26:09.559201 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:26:09.559201 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:26:09.559201 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:26:09.559201 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:26:09.559201 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:26:09.559201 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:26:09.559201 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:26:09.559201 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:26:09.560261 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:26:09.560261 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:26:09.560261 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:26:09.560261 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 602/1237] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:26:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:26:09.565477 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ccd16f-a2d3-412c-995e-4e329df142f0 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:09.682050 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ccd16f-a2d3-412c-995e-4e329df142f0 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:09.695680 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:09.732831 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca75f3d-503d-490a-8a3b-391f6e4bb5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:09.733521 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca75f3d-503d-490a-8a3b-391f6e4bb5fd None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:09.733796 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca75f3d-503d-490a-8a3b-391f6e4bb5fd None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:09.734064 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca75f3d-503d-490a-8a3b-391f6e4bb5fd None admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:09.734851 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca75f3d-503d-490a-8a3b-391f6e4bb5fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:09.735299 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca75f3d-503d-490a-8a3b-391f6e4bb5fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:09.737010 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca75f3d-503d-490a-8a3b-391f6e4bb5fd None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:09.753442 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 636/1238] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:26:09.759345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b227c6d-fab7-4c83-89a5-414d1686d858 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:09.875372 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b227c6d-fab7-4c83-89a5-414d1686d858 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:09.912564 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eeb00d-bab5-4030-8aa2-20833292538f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:09.913442 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eeb00d-bab5-4030-8aa2-20833292538f None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:09.913774 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eeb00d-bab5-4030-8aa2-20833292538f None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:09.913992 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eeb00d-bab5-4030-8aa2-20833292538f None admin] PATH_INFO: `/v3/users/placement` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:09.916969 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:09.922592 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eeb00d-bab5-4030-8aa2-20833292538f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:09.924198 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eeb00d-bab5-4030-8aa2-20833292538f None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:09.935632 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-d7eeb00d-bab5-4030-8aa2-20833292538f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 15:26:09.935632 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:26:09.935632 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:26:09.935632 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:26:09.935632 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:26:09.935632 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:26:09.935632 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:26:09.935632 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:26:09.935632 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:26:09.935632 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:26:09.935632 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:26:09.935632 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:26:09.935632 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:26:09.935632 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:26:09.935632 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:26:09.935632 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:26:09.936670 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:26:09.936670 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:26:09.936670 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:26:09.936670 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:26:09.936670 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:26:09.936670 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:26:09.936670 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:26:09.936670 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:26:09.936670 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:26:09.936670 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:26:09.936670 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:26:09.936670 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:26:09.936670 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:26:09.936670 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:26:09.936670 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:26:09.936670 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:26:09.936670 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:26:09.936670 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:26:09.942545 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:26:09.942545 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:26:09.942545 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:26:09.942545 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:26:09.942545 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:26:09.942545 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:26:09.942545 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:26:09.942545 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:26:09.942545 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 15:26:09.942545 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:26:09.942545 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 603/1239] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:26:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:26:09.943204 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca75f3d-503d-490a-8a3b-391f6e4bb5fd None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:10.059418 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca75f3d-503d-490a-8a3b-391f6e4bb5fd None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:10.112588 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921e796-8a55-4e61-8ed5-52e64a300648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:10.113353 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921e796-8a55-4e61-8ed5-52e64a300648 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:10.113657 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921e796-8a55-4e61-8ed5-52e64a300648 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:10.113976 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921e796-8a55-4e61-8ed5-52e64a300648 None admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:10.114840 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2921e796-8a55-4e61-8ed5-52e64a300648 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:10.115288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2921e796-8a55-4e61-8ed5-52e64a300648 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:10.116725 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2921e796-8a55-4e61-8ed5-52e64a300648 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:10.139465 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 637/1240] 10.222.0.83 () {56 vars in 1143 bytes} [Mon Aug 29 15:26:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:26:10.144670 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eeb00d-bab5-4030-8aa2-20833292538f None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:10.262449 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eeb00d-bab5-4030-8aa2-20833292538f None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:10.303417 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45931bbf-69f5-40ca-89f3-375b101eefcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:10.304290 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45931bbf-69f5-40ca-89f3-375b101eefcf None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:10.304725 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45931bbf-69f5-40ca-89f3-375b101eefcf None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:10.305401 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45931bbf-69f5-40ca-89f3-375b101eefcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:10.375884 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:10.385479 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45931bbf-69f5-40ca-89f3-375b101eefcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:10.389087 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45931bbf-69f5-40ca-89f3-375b101eefcf None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:10.504605 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 604/1241] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:26:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 15:26:10.510643 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921e796-8a55-4e61-8ed5-52e64a300648 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:10.539953 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:10.622999 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921e796-8a55-4e61-8ed5-52e64a300648 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:10.660274 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955fc50-75fc-4ec4-b1bd-f5b07b686b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:10.660911 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955fc50-75fc-4ec4-b1bd-f5b07b686b4e None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:10.661190 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955fc50-75fc-4ec4-b1bd-f5b07b686b4e None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:10.661466 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955fc50-75fc-4ec4-b1bd-f5b07b686b4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:10.673875 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955fc50-75fc-4ec4-b1bd-f5b07b686b4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:10.675634 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955fc50-75fc-4ec4-b1bd-f5b07b686b4e None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:10.692814 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-1955fc50-75fc-4ec4-b1bd-f5b07b686b4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:26:10.692814 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:26:10.692814 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:26:10.692814 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:26:10.692814 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:26:10.692814 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:26:10.692814 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:26:10.692814 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:26:10.692814 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:26:10.692814 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:26:10.692814 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:26:10.692814 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:26:10.692814 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:26:10.692814 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:26:10.692814 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:26:10.692814 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:26:10.694472 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:26:10.694472 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:26:10.694472 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:26:10.694472 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:26:10.694472 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:26:10.694472 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:26:10.694472 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:26:10.694472 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:26:10.694472 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:26:10.694472 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:26:10.694472 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:26:10.694472 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:26:10.694472 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:26:10.694472 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:26:10.694472 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:26:10.694472 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:26:10.694472 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:26:10.695678 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:26:10.695678 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:26:10.695678 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:26:10.700703 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 638/1242] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:26:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:26:10.700873 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45931bbf-69f5-40ca-89f3-375b101eefcf None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:10.815096 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:10.821325 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45931bbf-69f5-40ca-89f3-375b101eefcf None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:10.858344 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72baa595-bc27-4e8a-8d84-a18fad00e31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:10.858955 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72baa595-bc27-4e8a-8d84-a18fad00e31e None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:10.859254 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72baa595-bc27-4e8a-8d84-a18fad00e31e None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:10.859557 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72baa595-bc27-4e8a-8d84-a18fad00e31e None admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:10.860269 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72baa595-bc27-4e8a-8d84-a18fad00e31e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:10.860659 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72baa595-bc27-4e8a-8d84-a18fad00e31e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:10.862128 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72baa595-bc27-4e8a-8d84-a18fad00e31e None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:10.875610 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 605/1243] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:10.881484 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955fc50-75fc-4ec4-b1bd-f5b07b686b4e None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:10.969118 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:10.994776 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955fc50-75fc-4ec4-b1bd-f5b07b686b4e None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:11.037833 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f0268d-26f0-451b-abc0-543c94ce3fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:11.038742 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0268d-26f0-451b-abc0-543c94ce3fee None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:11.039043 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0268d-26f0-451b-abc0-543c94ce3fee None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:11.039365 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0268d-26f0-451b-abc0-543c94ce3fee None admin] PATH_INFO: `/v3/projects/service` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:11.048681 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f0268d-26f0-451b-abc0-543c94ce3fee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:11.050759 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f0268d-26f0-451b-abc0-543c94ce3fee None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:11.064785 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-50f0268d-26f0-451b-abc0-543c94ce3fee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:26:11.064785 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:26:11.064785 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:26:11.064785 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:26:11.064785 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:26:11.064785 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:26:11.064785 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:26:11.064785 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:26:11.064785 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:26:11.064785 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:26:11.064785 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:26:11.064785 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:26:11.064785 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:26:11.064785 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:26:11.064785 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:26:11.066447 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:26:11.066447 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:26:11.066447 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:26:11.066447 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:26:11.066447 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:26:11.066447 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:26:11.066447 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:26:11.066447 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:26:11.066447 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:26:11.066447 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:26:11.066447 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:26:11.066447 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:26:11.066447 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:26:11.066447 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:26:11.066447 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:26:11.066447 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:26:11.066447 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:26:11.068004 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:26:11.068004 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:26:11.068004 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:26:11.068004 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:26:11.068004 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:26:11.068004 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:26:11.068004 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:26:11.068004 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:26:11.068004 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 639/1244] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:26:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:26:11.072573 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72baa595-bc27-4e8a-8d84-a18fad00e31e None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:11.199960 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72baa595-bc27-4e8a-8d84-a18fad00e31e None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:11.241680 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6736398-3c3d-4a6e-bc15-3e8da67c4c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:11.242302 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6736398-3c3d-4a6e-bc15-3e8da67c4c5a None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:11.242575 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6736398-3c3d-4a6e-bc15-3e8da67c4c5a None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:11.242843 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6736398-3c3d-4a6e-bc15-3e8da67c4c5a None admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:11.243666 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6736398-3c3d-4a6e-bc15-3e8da67c4c5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:11.243923 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6736398-3c3d-4a6e-bc15-3e8da67c4c5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:11.245497 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6736398-3c3d-4a6e-bc15-3e8da67c4c5a None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:11.258612 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 606/1245] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 15:26:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:11.265428 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f0268d-26f0-451b-abc0-543c94ce3fee None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:11.387930 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f0268d-26f0-451b-abc0-543c94ce3fee None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:11.425613 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e495fcea-a08c-4434-a7b0-d11a4d60cbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:11.426222 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495fcea-a08c-4434-a7b0-d11a4d60cbd8 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:11.426501 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495fcea-a08c-4434-a7b0-d11a4d60cbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:11.426774 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495fcea-a08c-4434-a7b0-d11a4d60cbd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:11.427541 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e495fcea-a08c-4434-a7b0-d11a4d60cbd8 None admin] RBAC: Adding query filter params (role.id=19a8fa4068774a289594739614bb8ad4, scope.project.id=44655977b0814a728f0fa73d442a7ee9, user.id=c190fa4a280c41c684130e069bee99eb) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:11.427860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e495fcea-a08c-4434-a7b0-d11a4d60cbd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:11.429292 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e495fcea-a08c-4434-a7b0-d11a4d60cbd8 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:11.435580 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 640/1246] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 15:26:11 2022] GET /identity/v3/role_assignments?user.id=c190fa4a280c41c684130e069bee99eb&scope.project.id=44655977b0814a728f0fa73d442a7ee9&role.id=19a8fa4068774a289594739614bb8ad4 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:13.672699 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb16ee5-a03b-4c44-ad21-e49d232fdb02 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:13.673260 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb16ee5-a03b-4c44-ad21-e49d232fdb02 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:13.673349 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb16ee5-a03b-4c44-ad21-e49d232fdb02 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:13.674842 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 607/1247] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:26:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:26:13.681396 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b238b0c-7de2-4221-90e3-cbf483a1c891 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:13.681950 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b238b0c-7de2-4221-90e3-cbf483a1c891 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:13.682041 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b238b0c-7de2-4221-90e3-cbf483a1c891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:13.690250 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:13.707157 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-3b238b0c-7de2-4221-90e3-cbf483a1c891 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:13.708514 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3b238b0c-7de2-4221-90e3-cbf483a1c891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:13.791835 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 641/1248] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:26:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:26:14.070783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb16ee5-a03b-4c44-ad21-e49d232fdb02 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:14.092407 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:14.189664 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb16ee5-a03b-4c44-ad21-e49d232fdb02 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:14.229671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a3d04-7a55-4833-b7b9-80da976ec30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:14.230586 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a3d04-7a55-4833-b7b9-80da976ec30d None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:14.230875 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a3d04-7a55-4833-b7b9-80da976ec30d None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:14.231178 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a3d04-7a55-4833-b7b9-80da976ec30d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:14.241809 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a3d04-7a55-4833-b7b9-80da976ec30d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:26:14.247635 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-1a5a3d04-7a55-4833-b7b9-80da976ec30d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:26:14.247635 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:26:14.247635 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:26:14.247635 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:26:14.247635 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:26:14.247635 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:26:14.247635 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:26:14.247635 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:26:14.247635 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:26:14.247635 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:26:14.247635 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:26:14.247635 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:26:14.247635 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:26:14.247635 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:26:14.247635 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:26:14.247635 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:26:14.249361 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:26:14.249361 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:26:14.249361 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:26:14.249361 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:26:14.249361 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:26:14.249361 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:26:14.249361 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:26:14.249361 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:26:14.249361 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:26:14.249361 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:26:14.249361 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:26:14.249361 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:26:14.249361 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:26:14.249361 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:26:14.249361 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:26:14.249361 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:26:14.250685 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:26:14.250685 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:26:14.250685 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:26:14.250685 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:26:14.250685 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:26:14.250685 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:26:14.250685 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:26:14.250685 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:26:14.250685 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:26:14.250685 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:26:14.250685 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:26:14.250685 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:26:14.250685 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 608/1249] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 15:26:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:26:14.255415 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b238b0c-7de2-4221-90e3-cbf483a1c891 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:14.373926 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b238b0c-7de2-4221-90e3-cbf483a1c891 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:14.410869 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:14.417205 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd4eccf-7e93-4f3c-b959-7861141453c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:14.418577 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4eccf-7e93-4f3c-b959-7861141453c9 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:14.418872 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4eccf-7e93-4f3c-b959-7861141453c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:14.419179 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4eccf-7e93-4f3c-b959-7861141453c9 None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:14.419906 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd4eccf-7e93-4f3c-b959-7861141453c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:14.420301 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd4eccf-7e93-4f3c-b959-7861141453c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:14.422105 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd4eccf-7e93-4f3c-b959-7861141453c9 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:14.431764 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 642/1250] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:26:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:14.438567 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a3d04-7a55-4833-b7b9-80da976ec30d None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:14.530888 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:14.560792 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a3d04-7a55-4833-b7b9-80da976ec30d None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:14.600192 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bd277-4959-4310-8571-5e64ea398751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:14.600837 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bd277-4959-4310-8571-5e64ea398751 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:14.601115 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bd277-4959-4310-8571-5e64ea398751 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:14.601393 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bd277-4959-4310-8571-5e64ea398751 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:14.614836 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643bd277-4959-4310-8571-5e64ea398751 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:14.616478 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643bd277-4959-4310-8571-5e64ea398751 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:14.635499 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-643bd277-4959-4310-8571-5e64ea398751 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:26:14.635499 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:26:14.635499 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:26:14.635499 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:26:14.635499 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:26:14.635499 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:26:14.635499 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:26:14.635499 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:26:14.635499 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:26:14.635499 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:26:14.635499 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:26:14.635499 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:26:14.635499 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:26:14.635499 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:26:14.635499 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:26:14.635499 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:26:14.636651 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:26:14.636651 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:26:14.636651 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:26:14.636651 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:26:14.636651 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:26:14.636651 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:26:14.636651 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:26:14.636651 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:26:14.636651 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:26:14.636651 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:26:14.636651 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:26:14.636651 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:26:14.636651 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:26:14.636651 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:26:14.636651 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:26:14.636651 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:26:14.636651 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:26:14.637793 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:26:14.637793 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:26:14.637793 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:26:14.643062 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 609/1251] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:26:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:26:14.643493 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd4eccf-7e93-4f3c-b959-7861141453c9 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:14.754254 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd4eccf-7e93-4f3c-b959-7861141453c9 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:14.790380 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db57751-05a7-4c6f-9a8f-186c16174796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:14.790993 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db57751-05a7-4c6f-9a8f-186c16174796 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:14.791349 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db57751-05a7-4c6f-9a8f-186c16174796 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:14.791619 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db57751-05a7-4c6f-9a8f-186c16174796 None admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:14.792265 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db57751-05a7-4c6f-9a8f-186c16174796 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:14.792560 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db57751-05a7-4c6f-9a8f-186c16174796 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:14.793980 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db57751-05a7-4c6f-9a8f-186c16174796 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:14.811069 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 643/1252] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:14.812606 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bd277-4959-4310-8571-5e64ea398751 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:14.929642 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bd277-4959-4310-8571-5e64ea398751 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:14.963054 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:14.975191 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576468d-b45b-43ab-ae49-ce1f328af289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:14.976114 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576468d-b45b-43ab-ae49-ce1f328af289 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:14.976546 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576468d-b45b-43ab-ae49-ce1f328af289 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:14.976971 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576468d-b45b-43ab-ae49-ce1f328af289 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:14.987416 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2576468d-b45b-43ab-ae49-ce1f328af289 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:14.989185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2576468d-b45b-43ab-ae49-ce1f328af289 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:15.002738 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-2576468d-b45b-43ab-ae49-ce1f328af289 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 15:26:15.002738 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:26:15.002738 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:26:15.002738 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:26:15.002738 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:26:15.002738 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:26:15.002738 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:26:15.002738 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:26:15.002738 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:26:15.002738 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:26:15.002738 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:26:15.002738 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:26:15.002738 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:26:15.002738 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:26:15.002738 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:26:15.002738 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:26:15.004675 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:26:15.004675 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:26:15.004675 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:26:15.004675 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:26:15.004675 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:26:15.004675 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:26:15.004675 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:26:15.004675 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:26:15.004675 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:26:15.004675 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:26:15.004675 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:26:15.004675 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:26:15.004675 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:26:15.004675 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:26:15.004675 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:26:15.004675 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:26:15.004675 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:26:15.004675 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:26:15.006453 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:26:15.006453 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:26:15.006453 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:26:15.006453 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:26:15.006453 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:26:15.006453 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:26:15.006453 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:26:15.006453 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:26:15.006453 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 15:26:15.006453 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:26:15.006453 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 610/1253] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:26:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:26:15.010216 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db57751-05a7-4c6f-9a8f-186c16174796 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:15.080945 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:15.136524 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db57751-05a7-4c6f-9a8f-186c16174796 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:15.177644 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e34acfb-39b9-4792-bfe8-6c3b0a835ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:15.178385 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34acfb-39b9-4792-bfe8-6c3b0a835ec5 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:15.178776 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34acfb-39b9-4792-bfe8-6c3b0a835ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:15.179095 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34acfb-39b9-4792-bfe8-6c3b0a835ec5 None admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:15.179915 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e34acfb-39b9-4792-bfe8-6c3b0a835ec5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:15.180179 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e34acfb-39b9-4792-bfe8-6c3b0a835ec5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:15.181874 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e34acfb-39b9-4792-bfe8-6c3b0a835ec5 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:15.210189 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 644/1254] 10.222.0.83 () {56 vars in 1143 bytes} [Mon Aug 29 15:26:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:15.216932 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576468d-b45b-43ab-ae49-ce1f328af289 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:15.331167 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576468d-b45b-43ab-ae49-ce1f328af289 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:15.373875 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ccfb9-6b8f-4d27-bd36-260a8e70e6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:15.374594 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ccfb9-6b8f-4d27-bd36-260a8e70e6c7 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:15.374890 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ccfb9-6b8f-4d27-bd36-260a8e70e6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:15.375306 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ccfb9-6b8f-4d27-bd36-260a8e70e6c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:15.442520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:15.457265 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53ccfb9-6b8f-4d27-bd36-260a8e70e6c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:15.458934 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53ccfb9-6b8f-4d27-bd36-260a8e70e6c7 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:15.579220 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 611/1255] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:26:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 15:26:15.585571 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e34acfb-39b9-4792-bfe8-6c3b0a835ec5 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:15.702359 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e34acfb-39b9-4792-bfe8-6c3b0a835ec5 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:15.717896 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:15.744555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935898a6-19ba-430c-b5bf-3de2aaedccf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:15.745315 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935898a6-19ba-430c-b5bf-3de2aaedccf4 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:15.745632 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935898a6-19ba-430c-b5bf-3de2aaedccf4 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:15.745904 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935898a6-19ba-430c-b5bf-3de2aaedccf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:15.758648 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935898a6-19ba-430c-b5bf-3de2aaedccf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:15.760146 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935898a6-19ba-430c-b5bf-3de2aaedccf4 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:15.776797 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-935898a6-19ba-430c-b5bf-3de2aaedccf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:26:15.776797 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:26:15.776797 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:26:15.776797 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:26:15.776797 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:26:15.776797 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:26:15.776797 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:26:15.776797 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:26:15.776797 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:26:15.776797 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:26:15.776797 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:26:15.776797 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:26:15.776797 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:26:15.776797 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:26:15.776797 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:26:15.776797 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:26:15.777981 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:26:15.777981 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:26:15.777981 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:26:15.777981 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:26:15.777981 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:26:15.777981 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:26:15.777981 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:26:15.777981 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:26:15.777981 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:26:15.777981 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:26:15.777981 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:26:15.777981 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:26:15.777981 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:26:15.777981 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:26:15.777981 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:26:15.777981 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:26:15.777981 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:26:15.779313 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:26:15.779313 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:26:15.779313 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:26:15.779313 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 645/1256] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:26:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:26:15.784748 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ccfb9-6b8f-4d27-bd36-260a8e70e6c7 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:15.881717 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:15.896809 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ccfb9-6b8f-4d27-bd36-260a8e70e6c7 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:15.940250 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcde15b-6cb4-471d-8da9-90f3fc06b742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:15.940876 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcde15b-6cb4-471d-8da9-90f3fc06b742 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:15.941177 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcde15b-6cb4-471d-8da9-90f3fc06b742 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:15.941448 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcde15b-6cb4-471d-8da9-90f3fc06b742 None admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:15.942092 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcde15b-6cb4-471d-8da9-90f3fc06b742 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:15.942397 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcde15b-6cb4-471d-8da9-90f3fc06b742 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:15.943805 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcde15b-6cb4-471d-8da9-90f3fc06b742 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:15.956541 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 612/1257] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:26:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:15.962297 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935898a6-19ba-430c-b5bf-3de2aaedccf4 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:16.101700 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935898a6-19ba-430c-b5bf-3de2aaedccf4 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:16.142990 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763e4d5-9bca-4e0b-90ec-201cb0b1d400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:16.143939 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763e4d5-9bca-4e0b-90ec-201cb0b1d400 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:16.144217 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763e4d5-9bca-4e0b-90ec-201cb0b1d400 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:16.144487 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763e4d5-9bca-4e0b-90ec-201cb0b1d400 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:16.151469 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d763e4d5-9bca-4e0b-90ec-201cb0b1d400 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:16.153202 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d763e4d5-9bca-4e0b-90ec-201cb0b1d400 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:16.165215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-d763e4d5-9bca-4e0b-90ec-201cb0b1d400 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:26:16.165215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:26:16.165215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:26:16.165215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:26:16.165215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:26:16.165215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:26:16.165215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:26:16.165215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:26:16.165215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:26:16.165215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:26:16.165215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:26:16.165215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:26:16.165215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:26:16.165215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:26:16.165215 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:26:16.166321 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:26:16.166321 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:26:16.166321 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:26:16.166321 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:26:16.166321 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:26:16.166321 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:26:16.166321 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:26:16.166321 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:26:16.166321 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:26:16.166321 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:26:16.166321 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:26:16.166321 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:26:16.166321 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:26:16.166321 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:26:16.166321 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:26:16.166321 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:26:16.166321 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:26:16.167325 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:26:16.167325 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:26:16.167325 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:26:16.167325 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:26:16.167325 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:26:16.167325 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:26:16.167325 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:26:16.167325 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:26:16.167325 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 646/1258] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:26:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:26:16.174837 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcde15b-6cb4-471d-8da9-90f3fc06b742 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:16.304228 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcde15b-6cb4-471d-8da9-90f3fc06b742 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:16.351090 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444b30e9-5613-4890-8556-067814c0e3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:16.351700 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b30e9-5613-4890-8556-067814c0e3b6 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:16.351978 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b30e9-5613-4890-8556-067814c0e3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:16.352245 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b30e9-5613-4890-8556-067814c0e3b6 None admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:16.352931 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444b30e9-5613-4890-8556-067814c0e3b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:16.353233 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444b30e9-5613-4890-8556-067814c0e3b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:16.354666 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444b30e9-5613-4890-8556-067814c0e3b6 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:16.367953 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 613/1259] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 15:26:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:26:16.375364 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763e4d5-9bca-4e0b-90ec-201cb0b1d400 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:16.405801 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:16.494654 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763e4d5-9bca-4e0b-90ec-201cb0b1d400 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:16.540494 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c8c7f-d326-4c32-a91a-59d09c7eff0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:16.541147 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c8c7f-d326-4c32-a91a-59d09c7eff0c None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:16.541454 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c8c7f-d326-4c32-a91a-59d09c7eff0c None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:16.541753 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c8c7f-d326-4c32-a91a-59d09c7eff0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:16.550742 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160c8c7f-d326-4c32-a91a-59d09c7eff0c None admin] RBAC: Adding query filter params (role.id=4bb2bbb7bb544610877949fc933504d2, scope.project.id=44655977b0814a728f0fa73d442a7ee9, user.id=c190fa4a280c41c684130e069bee99eb) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:16.550742 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160c8c7f-d326-4c32-a91a-59d09c7eff0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:16.550742 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160c8c7f-d326-4c32-a91a-59d09c7eff0c None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:16.550742 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 647/1260] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 15:26:16 2022] GET /identity/v3/role_assignments?user.id=c190fa4a280c41c684130e069bee99eb&scope.project.id=44655977b0814a728f0fa73d442a7ee9&role.id=4bb2bbb7bb544610877949fc933504d2 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:18.521575 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d2444-1523-403d-b9f3-f9c79f738709 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:18.522163 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d2444-1523-403d-b9f3-f9c79f738709 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:18.522163 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d2444-1523-403d-b9f3-f9c79f738709 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:18.523473 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 614/1261] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:26:18.529179 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c464a4-0c9a-488d-be13-c14ddf8556d8 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:18.529606 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c464a4-0c9a-488d-be13-c14ddf8556d8 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:18.529800 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c464a4-0c9a-488d-be13-c14ddf8556d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:18.548857 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-45c464a4-0c9a-488d-be13-c14ddf8556d8 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:18.550048 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-45c464a4-0c9a-488d-be13-c14ddf8556d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:18.617499 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 648/1262] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:26:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 15:26:18.888281 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d2444-1523-403d-b9f3-f9c79f738709 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:18.898980 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:18.989529 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d2444-1523-403d-b9f3-f9c79f738709 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:19.025746 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521c8b3-47a8-4d5f-bbcf-e2a9a60c0ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:19.026413 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521c8b3-47a8-4d5f-bbcf-e2a9a60c0ecd None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:19.026691 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521c8b3-47a8-4d5f-bbcf-e2a9a60c0ecd None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:19.027000 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521c8b3-47a8-4d5f-bbcf-e2a9a60c0ecd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:19.040219 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d521c8b3-47a8-4d5f-bbcf-e2a9a60c0ecd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:26:19.045929 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-d521c8b3-47a8-4d5f-bbcf-e2a9a60c0ecd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:26:19.045929 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:26:19.045929 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:26:19.045929 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:26:19.045929 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:26:19.045929 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:26:19.045929 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:26:19.045929 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:26:19.045929 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:26:19.045929 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:26:19.045929 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:26:19.045929 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:26:19.045929 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:26:19.045929 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:26:19.045929 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:26:19.045929 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:26:19.047355 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:26:19.047355 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:26:19.047355 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:26:19.047355 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:26:19.047355 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:26:19.047355 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:26:19.047355 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:26:19.047355 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:26:19.047355 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:26:19.047355 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:26:19.047355 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:26:19.047355 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:26:19.047355 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:26:19.047355 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:26:19.047355 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:26:19.047355 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:26:19.048406 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:26:19.048406 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:26:19.048406 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:26:19.048406 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:26:19.048406 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:26:19.048406 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:26:19.048406 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:26:19.048406 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:26:19.048406 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:26:19.048406 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:26:19.048406 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:26:19.048406 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:26:19.048406 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 615/1263] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 15:26:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:26:19.053946 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c464a4-0c9a-488d-be13-c14ddf8556d8 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:19.074925 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:19.159390 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c464a4-0c9a-488d-be13-c14ddf8556d8 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:19.193431 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e7b5e-5771-4c7a-9ca9-5818071fa299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:19.194033 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e7b5e-5771-4c7a-9ca9-5818071fa299 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:19.194311 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e7b5e-5771-4c7a-9ca9-5818071fa299 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:19.194582 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e7b5e-5771-4c7a-9ca9-5818071fa299 None admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:19.195271 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e7b5e-5771-4c7a-9ca9-5818071fa299 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:19.195576 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e7b5e-5771-4c7a-9ca9-5818071fa299 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:19.196946 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e7b5e-5771-4c7a-9ca9-5818071fa299 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:19.204968 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 649/1264] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:26:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:19.210842 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521c8b3-47a8-4d5f-bbcf-e2a9a60c0ecd None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:19.276890 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:19.312092 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521c8b3-47a8-4d5f-bbcf-e2a9a60c0ecd None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:19.346177 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036f75b-f948-408a-a3a7-2ae0b9082fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:19.346797 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036f75b-f948-408a-a3a7-2ae0b9082fce None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:19.347100 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036f75b-f948-408a-a3a7-2ae0b9082fce None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:19.347375 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036f75b-f948-408a-a3a7-2ae0b9082fce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:19.358279 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5036f75b-f948-408a-a3a7-2ae0b9082fce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:19.359761 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5036f75b-f948-408a-a3a7-2ae0b9082fce None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:19.374808 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-5036f75b-f948-408a-a3a7-2ae0b9082fce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:26:19.374808 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:26:19.374808 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:26:19.374808 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:26:19.374808 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:26:19.374808 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:26:19.374808 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:26:19.374808 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:26:19.374808 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:26:19.374808 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:26:19.374808 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:26:19.374808 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:26:19.374808 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:26:19.374808 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:26:19.374808 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:26:19.374808 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:26:19.375992 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:26:19.375992 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:26:19.375992 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:26:19.375992 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:26:19.375992 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:26:19.375992 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:26:19.375992 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:26:19.375992 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:26:19.375992 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:26:19.375992 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:26:19.375992 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:26:19.375992 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:26:19.375992 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:26:19.375992 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:26:19.375992 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:26:19.375992 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:26:19.375992 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:26:19.376915 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:26:19.376915 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:26:19.376915 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:26:19.376915 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 616/1265] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:26:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:26:19.381762 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e7b5e-5771-4c7a-9ca9-5818071fa299 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:19.461964 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:19.481020 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e7b5e-5771-4c7a-9ca9-5818071fa299 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:19.514280 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aeae26-18f0-4433-8170-8b595079fa2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:19.514874 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aeae26-18f0-4433-8170-8b595079fa2d None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:19.515182 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aeae26-18f0-4433-8170-8b595079fa2d None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:19.515454 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aeae26-18f0-4433-8170-8b595079fa2d None admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:19.516095 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aeae26-18f0-4433-8170-8b595079fa2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:19.516396 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aeae26-18f0-4433-8170-8b595079fa2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:19.517762 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aeae26-18f0-4433-8170-8b595079fa2d None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:19.529788 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 650/1266] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:26:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:19.535502 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036f75b-f948-408a-a3a7-2ae0b9082fce None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:19.633323 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036f75b-f948-408a-a3a7-2ae0b9082fce None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:19.653745 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:19.667851 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b7f2c-a31d-478c-ba3d-65dcc7d1e5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:19.668477 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b7f2c-a31d-478c-ba3d-65dcc7d1e5b2 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:19.668802 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b7f2c-a31d-478c-ba3d-65dcc7d1e5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:19.669079 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b7f2c-a31d-478c-ba3d-65dcc7d1e5b2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:19.676344 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b7f2c-a31d-478c-ba3d-65dcc7d1e5b2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:19.677770 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b7f2c-a31d-478c-ba3d-65dcc7d1e5b2 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:19.688818 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-bb3b7f2c-a31d-478c-ba3d-65dcc7d1e5b2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 15:26:19.688818 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:26:19.688818 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:26:19.688818 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:26:19.688818 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:26:19.688818 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:26:19.688818 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:26:19.688818 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:26:19.688818 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:26:19.688818 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:26:19.688818 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:26:19.688818 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:26:19.688818 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:26:19.688818 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:26:19.688818 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:26:19.688818 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:26:19.689948 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:26:19.689948 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:26:19.689948 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:26:19.689948 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:26:19.689948 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:26:19.689948 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:26:19.689948 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:26:19.689948 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:26:19.689948 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:26:19.689948 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:26:19.689948 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:26:19.689948 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:26:19.689948 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:26:19.689948 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:26:19.689948 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:26:19.689948 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:26:19.689948 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:26:19.689948 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:26:19.690895 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:26:19.690895 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:26:19.690895 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:26:19.690895 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:26:19.690895 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:26:19.690895 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:26:19.690895 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:26:19.690895 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:26:19.690895 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 15:26:19.690895 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:26:19.690895 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 617/1267] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:26:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:26:19.695875 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aeae26-18f0-4433-8170-8b595079fa2d None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:19.795167 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aeae26-18f0-4433-8170-8b595079fa2d None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:19.828422 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec567378-ec11-40e8-aa96-b1f764195b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:19.829016 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec567378-ec11-40e8-aa96-b1f764195b6f None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:19.829293 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec567378-ec11-40e8-aa96-b1f764195b6f None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:19.829573 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec567378-ec11-40e8-aa96-b1f764195b6f None admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:19.830275 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec567378-ec11-40e8-aa96-b1f764195b6f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:19.830578 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec567378-ec11-40e8-aa96-b1f764195b6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:19.832062 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec567378-ec11-40e8-aa96-b1f764195b6f None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:19.840581 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:19.849343 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 651/1268] 10.222.0.83 () {56 vars in 1143 bytes} [Mon Aug 29 15:26:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:19.855158 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b7f2c-a31d-478c-ba3d-65dcc7d1e5b2 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:19.954737 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b7f2c-a31d-478c-ba3d-65dcc7d1e5b2 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:19.987906 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001b3a9-78f4-47ea-b685-795fe4861b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:19.988532 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001b3a9-78f4-47ea-b685-795fe4861b1c None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:19.988806 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001b3a9-78f4-47ea-b685-795fe4861b1c None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:19.989074 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001b3a9-78f4-47ea-b685-795fe4861b1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:20.000214 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c001b3a9-78f4-47ea-b685-795fe4861b1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:20.001654 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c001b3a9-78f4-47ea-b685-795fe4861b1c None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:20.016188 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-c001b3a9-78f4-47ea-b685-795fe4861b1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:26:20.016188 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:26:20.016188 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:26:20.016188 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:26:20.016188 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:26:20.016188 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:26:20.016188 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:26:20.016188 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:26:20.016188 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:26:20.016188 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:26:20.016188 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:26:20.016188 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:26:20.016188 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:26:20.016188 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:26:20.016188 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:26:20.016188 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:26:20.017333 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:26:20.017333 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:26:20.017333 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:26:20.017333 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:26:20.017333 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:26:20.017333 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:26:20.017333 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:26:20.017333 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:26:20.017333 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:26:20.017333 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:26:20.017333 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:26:20.017333 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:26:20.017333 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:26:20.017333 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:26:20.017333 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:26:20.017333 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:26:20.017333 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:26:20.018460 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:26:20.018460 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:26:20.018460 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:26:20.023055 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 618/1269] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:26:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:26:20.023798 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec567378-ec11-40e8-aa96-b1f764195b6f None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:20.128748 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec567378-ec11-40e8-aa96-b1f764195b6f None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:20.162580 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bcc556-9099-40f6-8bff-4b6eafc2a2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:20.163216 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bcc556-9099-40f6-8bff-4b6eafc2a2fe None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:20.163495 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bcc556-9099-40f6-8bff-4b6eafc2a2fe None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:20.163767 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bcc556-9099-40f6-8bff-4b6eafc2a2fe None admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:20.164408 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bcc556-9099-40f6-8bff-4b6eafc2a2fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:20.164711 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bcc556-9099-40f6-8bff-4b6eafc2a2fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:20.166435 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bcc556-9099-40f6-8bff-4b6eafc2a2fe None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:20.177486 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 652/1270] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:26:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:20.183244 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001b3a9-78f4-47ea-b685-795fe4861b1c None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:20.215253 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:20.284105 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001b3a9-78f4-47ea-b685-795fe4861b1c None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:20.317578 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd13e6-8428-4b7d-8c17-adcaae40b2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:20.318229 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd13e6-8428-4b7d-8c17-adcaae40b2cb None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:20.318506 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd13e6-8428-4b7d-8c17-adcaae40b2cb None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:20.318774 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd13e6-8428-4b7d-8c17-adcaae40b2cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:20.326294 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd13e6-8428-4b7d-8c17-adcaae40b2cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:20.327771 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd13e6-8428-4b7d-8c17-adcaae40b2cb None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:20.338683 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-7abd13e6-8428-4b7d-8c17-adcaae40b2cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:26:20.338683 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:26:20.338683 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:26:20.338683 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:26:20.338683 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:26:20.338683 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:26:20.338683 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:26:20.338683 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:26:20.338683 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:26:20.338683 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:26:20.338683 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:26:20.338683 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:26:20.338683 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:26:20.338683 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:26:20.338683 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:26:20.339768 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:26:20.339768 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:26:20.339768 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:26:20.339768 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:26:20.339768 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:26:20.339768 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:26:20.339768 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:26:20.339768 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:26:20.339768 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:26:20.339768 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:26:20.339768 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:26:20.339768 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:26:20.339768 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:26:20.339768 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:26:20.339768 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:26:20.339768 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:26:20.339768 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:26:20.340772 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:26:20.340772 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:26:20.340772 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:26:20.340772 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:26:20.340772 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:26:20.340772 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:26:20.340772 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:26:20.340772 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:26:20.340772 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 619/1271] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:26:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:26:20.346991 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bcc556-9099-40f6-8bff-4b6eafc2a2fe None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:20.417172 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:20.461921 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bcc556-9099-40f6-8bff-4b6eafc2a2fe None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:20.498428 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f401ec95-8603-431c-a98e-341f9880cbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:20.499076 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401ec95-8603-431c-a98e-341f9880cbb0 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:20.499343 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401ec95-8603-431c-a98e-341f9880cbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:20.499611 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401ec95-8603-431c-a98e-341f9880cbb0 None admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:20.500311 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f401ec95-8603-431c-a98e-341f9880cbb0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:20.500615 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f401ec95-8603-431c-a98e-341f9880cbb0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:20.502044 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f401ec95-8603-431c-a98e-341f9880cbb0 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:20.514561 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 653/1272] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 15:26:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:20.520661 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd13e6-8428-4b7d-8c17-adcaae40b2cb None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:20.620269 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:20.633051 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd13e6-8428-4b7d-8c17-adcaae40b2cb None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:20.666855 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df57490-505f-44df-89a2-bea732bddeaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:20.667592 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df57490-505f-44df-89a2-bea732bddeaf None admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:20.667824 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df57490-505f-44df-89a2-bea732bddeaf None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:20.668095 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df57490-505f-44df-89a2-bea732bddeaf None admin] PATH_INFO: `/v3/projects/44655977b0814a728f0fa73d442a7ee9/users/c190fa4a280c41c684130e069bee99eb/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:20.670656 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df57490-505f-44df-89a2-bea732bddeaf None admin] RBAC: Authorizing `identity:create_grant(project_id=44655977b0814a728f0fa73d442a7ee9, user_id=c190fa4a280c41c684130e069bee99eb, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:20.672147 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df57490-505f-44df-89a2-bea732bddeaf None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:20.685514 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 620/1273] 10.222.0.83 () {58 vars in 1439 bytes} [Mon Aug 29 15:26:20 2022] PUT /identity/v3/projects/44655977b0814a728f0fa73d442a7ee9/users/c190fa4a280c41c684130e069bee99eb/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:22.584946 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7c660-02ea-4faf-83c2-2e9925c4ca20 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:22.585535 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7c660-02ea-4faf-83c2-2e9925c4ca20 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:22.585535 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7c660-02ea-4faf-83c2-2e9925c4ca20 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:22.586831 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 654/1274] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:26:22.592680 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b53265-5dd5-4f13-8b34-0d204f2b297e None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:22.593108 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b53265-5dd5-4f13-8b34-0d204f2b297e None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:22.593223 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b53265-5dd5-4f13-8b34-0d204f2b297e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:22.612179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-f3b53265-5dd5-4f13-8b34-0d204f2b297e None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:22.613363 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f3b53265-5dd5-4f13-8b34-0d204f2b297e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:22.679784 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 621/1275] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:26:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:26:22.942861 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb7c660-02ea-4faf-83c2-2e9925c4ca20 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:23.044882 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb7c660-02ea-4faf-83c2-2e9925c4ca20 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:23.064264 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:23.083139 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00abb3d4-5f4d-48db-9696-c34c529d6118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:23.083769 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abb3d4-5f4d-48db-9696-c34c529d6118 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:23.084042 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abb3d4-5f4d-48db-9696-c34c529d6118 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:23.084354 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abb3d4-5f4d-48db-9696-c34c529d6118 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:23.095949 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00abb3d4-5f4d-48db-9696-c34c529d6118 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:26:23.100746 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-00abb3d4-5f4d-48db-9696-c34c529d6118 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:26:23.100746 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:26:23.100746 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:26:23.100746 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:26:23.100746 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:26:23.100746 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:26:23.100746 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:26:23.100746 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:26:23.100746 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:26:23.100746 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:26:23.100746 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:26:23.100746 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:26:23.100746 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:26:23.100746 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:26:23.100746 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:26:23.100746 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:26:23.101883 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:26:23.101883 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:26:23.101883 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:26:23.101883 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:26:23.101883 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:26:23.101883 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:26:23.101883 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:26:23.101883 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:26:23.101883 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:26:23.101883 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:26:23.101883 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:26:23.101883 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:26:23.101883 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:26:23.101883 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:26:23.101883 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:26:23.101883 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:26:23.102838 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:26:23.102838 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:26:23.102838 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:26:23.102838 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:26:23.102838 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:26:23.102838 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:26:23.102838 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:26:23.102838 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:26:23.102838 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:26:23.102838 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:26:23.102838 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:26:23.102838 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:26:23.102838 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 655/1276] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 15:26:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:26:23.107901 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b53265-5dd5-4f13-8b34-0d204f2b297e None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:23.188540 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:23.207991 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b53265-5dd5-4f13-8b34-0d204f2b297e None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:23.242195 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307dfe81-8157-4ff7-882b-b06f525467af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:23.242806 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307dfe81-8157-4ff7-882b-b06f525467af None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:23.243115 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307dfe81-8157-4ff7-882b-b06f525467af None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:23.243389 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307dfe81-8157-4ff7-882b-b06f525467af None admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:23.244049 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307dfe81-8157-4ff7-882b-b06f525467af None admin] RBAC: Adding query filter params (name=admin) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:23.244348 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307dfe81-8157-4ff7-882b-b06f525467af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:23.245781 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307dfe81-8157-4ff7-882b-b06f525467af None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:23.254333 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 622/1277] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 15:26:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:23.260102 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00abb3d4-5f4d-48db-9696-c34c529d6118 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:23.360192 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00abb3d4-5f4d-48db-9696-c34c529d6118 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:23.393834 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b3d5ba-6d1d-4077-8d2a-4fc4c363380b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:23.394446 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3d5ba-6d1d-4077-8d2a-4fc4c363380b None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:23.394718 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3d5ba-6d1d-4077-8d2a-4fc4c363380b None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:23.394984 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3d5ba-6d1d-4077-8d2a-4fc4c363380b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:23.405555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b3d5ba-6d1d-4077-8d2a-4fc4c363380b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:23.407139 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b3d5ba-6d1d-4077-8d2a-4fc4c363380b None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:23.421942 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-70b3d5ba-6d1d-4077-8d2a-4fc4c363380b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:26:23.421942 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:26:23.421942 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:26:23.421942 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:26:23.421942 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:26:23.421942 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:26:23.421942 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:26:23.421942 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:26:23.421942 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:26:23.421942 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:26:23.421942 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:26:23.421942 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:26:23.421942 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:26:23.421942 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:26:23.421942 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:26:23.421942 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:26:23.423114 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:26:23.423114 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:26:23.423114 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:26:23.423114 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:26:23.423114 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:26:23.423114 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:26:23.423114 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:26:23.423114 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:26:23.423114 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:26:23.423114 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:26:23.423114 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:26:23.423114 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:26:23.423114 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:26:23.423114 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:26:23.423114 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:26:23.423114 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:26:23.423114 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:26:23.424089 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:26:23.424089 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:26:23.424089 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:26:23.424089 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 656/1278] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:26:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:26:23.429094 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307dfe81-8157-4ff7-882b-b06f525467af None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:23.527234 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307dfe81-8157-4ff7-882b-b06f525467af None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:23.559629 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3dce1-021b-4bd0-a312-bbd99c939d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:23.561166 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3dce1-021b-4bd0-a312-bbd99c939d88 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:23.561302 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3dce1-021b-4bd0-a312-bbd99c939d88 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:23.561573 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3dce1-021b-4bd0-a312-bbd99c939d88 None admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:23.562201 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed3dce1-021b-4bd0-a312-bbd99c939d88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:23.562497 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed3dce1-021b-4bd0-a312-bbd99c939d88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:23.563874 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed3dce1-021b-4bd0-a312-bbd99c939d88 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:23.575201 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 623/1279] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:26:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:23.580897 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b3d5ba-6d1d-4077-8d2a-4fc4c363380b None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:23.612471 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:23.681784 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b3d5ba-6d1d-4077-8d2a-4fc4c363380b None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:23.715349 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3612b3b-61f6-4124-953f-012f20c23a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:23.715974 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3612b3b-61f6-4124-953f-012f20c23a3b None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:23.716799 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3612b3b-61f6-4124-953f-012f20c23a3b None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:23.717273 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3612b3b-61f6-4124-953f-012f20c23a3b None admin] PATH_INFO: `/v3/users/placement` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:23.725086 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3612b3b-61f6-4124-953f-012f20c23a3b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:23.726517 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3612b3b-61f6-4124-953f-012f20c23a3b None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:23.738048 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-a3612b3b-61f6-4124-953f-012f20c23a3b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 15:26:23.738048 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:26:23.738048 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:26:23.738048 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:26:23.738048 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:26:23.738048 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:26:23.738048 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:26:23.738048 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:26:23.738048 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:26:23.738048 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:26:23.738048 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:26:23.738048 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:26:23.738048 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:26:23.738048 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:26:23.738048 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:26:23.738048 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:26:23.739212 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:26:23.739212 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:26:23.739212 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:26:23.739212 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:26:23.739212 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:26:23.739212 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:26:23.739212 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:26:23.739212 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:26:23.739212 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:26:23.739212 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:26:23.739212 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:26:23.739212 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:26:23.739212 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:26:23.739212 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:26:23.739212 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:26:23.739212 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:26:23.739212 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:26:23.739212 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:26:23.740444 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:26:23.740444 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:26:23.740444 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:26:23.740444 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:26:23.740444 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:26:23.740444 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:26:23.740444 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:26:23.740444 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:26:23.740444 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 15:26:23.740444 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:26:23.740444 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 657/1280] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:26:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:26:23.744902 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3dce1-021b-4bd0-a312-bbd99c939d88 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:23.748797 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:23.845682 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3dce1-021b-4bd0-a312-bbd99c939d88 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:23.879379 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff55a9d-1706-4a05-9c7a-778dcaf6fe49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:23.879986 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff55a9d-1706-4a05-9c7a-778dcaf6fe49 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:23.880260 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff55a9d-1706-4a05-9c7a-778dcaf6fe49 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:23.880529 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff55a9d-1706-4a05-9c7a-778dcaf6fe49 None admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:23.881247 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff55a9d-1706-4a05-9c7a-778dcaf6fe49 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:23.881550 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff55a9d-1706-4a05-9c7a-778dcaf6fe49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:23.882972 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff55a9d-1706-4a05-9c7a-778dcaf6fe49 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:23.899810 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 624/1281] 10.222.0.83 () {56 vars in 1143 bytes} [Mon Aug 29 15:26:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:23.906176 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3612b3b-61f6-4124-953f-012f20c23a3b None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:23.995475 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:24.005283 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3612b3b-61f6-4124-953f-012f20c23a3b None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:24.043227 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb66aa-266c-4d25-a9ec-aa5fa41e5ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:24.044119 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb66aa-266c-4d25-a9ec-aa5fa41e5ec6 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:24.045087 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb66aa-266c-4d25-a9ec-aa5fa41e5ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:24.045553 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb66aa-266c-4d25-a9ec-aa5fa41e5ec6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:24.113134 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb66aa-266c-4d25-a9ec-aa5fa41e5ec6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:24.114513 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb66aa-266c-4d25-a9ec-aa5fa41e5ec6 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:24.201838 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:24.212135 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 658/1282] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 15:26:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 15:26:24.218619 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff55a9d-1706-4a05-9c7a-778dcaf6fe49 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:24.277578 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:24.315779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff55a9d-1706-4a05-9c7a-778dcaf6fe49 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:24.352084 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8a0b8-90fa-473f-951a-524259e9d9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:24.352985 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8a0b8-90fa-473f-951a-524259e9d9d9 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:24.353394 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8a0b8-90fa-473f-951a-524259e9d9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:24.353800 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8a0b8-90fa-473f-951a-524259e9d9d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:24.368652 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8a0b8-90fa-473f-951a-524259e9d9d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:24.370849 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8a0b8-90fa-473f-951a-524259e9d9d9 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:24.390982 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-a1e8a0b8-90fa-473f-951a-524259e9d9d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:26:24.390982 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:26:24.390982 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:26:24.390982 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:26:24.390982 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:26:24.390982 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:26:24.390982 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:26:24.390982 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:26:24.390982 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:26:24.390982 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:26:24.390982 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:26:24.390982 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:26:24.390982 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:26:24.390982 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:26:24.390982 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:26:24.390982 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:26:24.392195 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:26:24.392195 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:26:24.392195 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:26:24.392195 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:26:24.392195 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:26:24.392195 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:26:24.392195 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:26:24.392195 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:26:24.392195 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:26:24.392195 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:26:24.392195 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:26:24.392195 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:26:24.392195 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:26:24.392195 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:26:24.392195 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:26:24.392195 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:26:24.392195 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:26:24.393307 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:26:24.393307 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:26:24.393307 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:26:24.393307 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 625/1283] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:26:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:26:24.397919 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb66aa-266c-4d25-a9ec-aa5fa41e5ec6 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:24.496912 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb66aa-266c-4d25-a9ec-aa5fa41e5ec6 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:24.532611 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29088c97-18a2-4056-89dc-4f8948df9236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:24.533215 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29088c97-18a2-4056-89dc-4f8948df9236 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:24.533494 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29088c97-18a2-4056-89dc-4f8948df9236 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:24.533768 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29088c97-18a2-4056-89dc-4f8948df9236 None admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:24.534409 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29088c97-18a2-4056-89dc-4f8948df9236 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:24.534712 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29088c97-18a2-4056-89dc-4f8948df9236 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:24.536115 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29088c97-18a2-4056-89dc-4f8948df9236 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:24.547482 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 659/1284] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 15:26:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:24.553334 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8a0b8-90fa-473f-951a-524259e9d9d9 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:24.654687 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8a0b8-90fa-473f-951a-524259e9d9d9 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:24.668770 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:24.691182 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a535a-9453-4451-8532-7b241bf6c3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:24.691846 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a535a-9453-4451-8532-7b241bf6c3e6 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:24.692126 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a535a-9453-4451-8532-7b241bf6c3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:24.692399 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a535a-9453-4451-8532-7b241bf6c3e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:24.699455 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0a535a-9453-4451-8532-7b241bf6c3e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:24.701660 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0a535a-9453-4451-8532-7b241bf6c3e6 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:24.713812 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-8c0a535a-9453-4451-8532-7b241bf6c3e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:26:24.713812 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:26:24.713812 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:26:24.713812 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:26:24.713812 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:26:24.713812 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:26:24.713812 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:26:24.713812 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:26:24.713812 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:26:24.713812 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:26:24.713812 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:26:24.713812 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:26:24.713812 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:26:24.713812 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:26:24.713812 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:26:24.714881 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:26:24.714881 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:26:24.714881 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:26:24.714881 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:26:24.714881 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:26:24.714881 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:26:24.714881 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:26:24.714881 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:26:24.714881 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 15:26:24.714881 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:26:24.714881 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:26:24.714881 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:26:24.714881 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:26:24.714881 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:26:24.714881 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:26:24.714881 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:26:24.714881 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:26:24.716076 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:26:24.716076 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:26:24.716076 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:26:24.716076 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:26:24.716076 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:26:24.716076 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:26:24.716076 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:26:24.716076 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:26:24.716076 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 626/1285] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 15:26:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:26:24.721434 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29088c97-18a2-4056-89dc-4f8948df9236 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:24.776349 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:24.828459 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29088c97-18a2-4056-89dc-4f8948df9236 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:24.861235 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf2de96-cba6-44d4-9dd0-7eb68cd22252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:24.861833 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2de96-cba6-44d4-9dd0-7eb68cd22252 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:24.862111 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2de96-cba6-44d4-9dd0-7eb68cd22252 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:24.862382 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2de96-cba6-44d4-9dd0-7eb68cd22252 None admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:24.863095 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf2de96-cba6-44d4-9dd0-7eb68cd22252 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:24.863404 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf2de96-cba6-44d4-9dd0-7eb68cd22252 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:24.864831 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf2de96-cba6-44d4-9dd0-7eb68cd22252 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:24.877014 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 660/1286] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 15:26:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:24.883141 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a535a-9453-4451-8532-7b241bf6c3e6 None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:24.982765 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a535a-9453-4451-8532-7b241bf6c3e6 None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:25.027175 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d9e53-0d77-4b6c-85c8-2073d88dfa61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:25.027856 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d9e53-0d77-4b6c-85c8-2073d88dfa61 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:25.028157 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d9e53-0d77-4b6c-85c8-2073d88dfa61 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:25.028424 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d9e53-0d77-4b6c-85c8-2073d88dfa61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:25.030019 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d9e53-0d77-4b6c-85c8-2073d88dfa61 None admin] RBAC: Adding query filter params (role.id=4bb2bbb7bb544610877949fc933504d2, scope.project.id=44655977b0814a728f0fa73d442a7ee9, user.id=c190fa4a280c41c684130e069bee99eb) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:25.030351 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d9e53-0d77-4b6c-85c8-2073d88dfa61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:25.032355 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d9e53-0d77-4b6c-85c8-2073d88dfa61 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:25.039880 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 627/1287] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 15:26:24 2022] GET /identity/v3/role_assignments?user.id=c190fa4a280c41c684130e069bee99eb&scope.project.id=44655977b0814a728f0fa73d442a7ee9&role.id=4bb2bbb7bb544610877949fc933504d2 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:26.994615 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83afd883-5ad1-4725-83c0-2489ad8230a2 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:26.995145 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83afd883-5ad1-4725-83c0-2489ad8230a2 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:26.995145 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83afd883-5ad1-4725-83c0-2489ad8230a2 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:26.996484 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 661/1288] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:26:27.002090 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25cf846-3168-4574-aaeb-3407a0799114 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:27.002498 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25cf846-3168-4574-aaeb-3407a0799114 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:27.002640 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25cf846-3168-4574-aaeb-3407a0799114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:27.021329 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a25cf846-3168-4574-aaeb-3407a0799114 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:27.022567 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a25cf846-3168-4574-aaeb-3407a0799114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:27.055976 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:27.094322 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 628/1289] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:26:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:26:27.365613 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83afd883-5ad1-4725-83c0-2489ad8230a2 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:27.471235 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83afd883-5ad1-4725-83c0-2489ad8230a2 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:27.481699 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:27.505308 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0cb2c1-f3f6-4d43-94c6-9bfcdfe35cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:27.505927 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0cb2c1-f3f6-4d43-94c6-9bfcdfe35cea None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:27.506199 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0cb2c1-f3f6-4d43-94c6-9bfcdfe35cea None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:27.506465 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0cb2c1-f3f6-4d43-94c6-9bfcdfe35cea None admin] PATH_INFO: `/v3/services/placement` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:27.507061 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0cb2c1-f3f6-4d43-94c6-9bfcdfe35cea None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:27.508429 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0cb2c1-f3f6-4d43-94c6-9bfcdfe35cea None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:27.517318 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-4a0cb2c1-f3f6-4d43-94c6-9bfcdfe35cea None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 15:26:27.517318 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:26:27.517318 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:26:27.517318 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:26:27.517318 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:26:27.517318 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:26:27.517318 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:26:27.517318 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:26:27.517318 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 15:26:27.517318 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:26:27.517318 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:26:27.517318 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:26:27.517318 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:26:27.517318 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:26:27.517318 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:26:27.517318 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:26:27.517318 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:26:27.518437 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:26:27.518437 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:26:27.518437 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:26:27.518437 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:26:27.518437 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:26:27.518437 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:26:27.518437 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:26:27.518437 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:26:27.518437 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:26:27.518437 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:26:27.518437 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:26:27.518437 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:26:27.518437 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:26:27.518437 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:26:27.518437 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:26:27.518437 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:26:27.519427 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:26:27.519427 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:26:27.519427 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:26:27.519427 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:26:27.519427 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:26:27.519427 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:26:27.519427 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:26:27.519427 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:26:27.519427 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:26:27.519427 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:26:27.519427 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:26:27.519427 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:26:27.519427 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 15:26:27.519427 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:26:27.519427 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 662/1290] 10.222.0.83 () {56 vars in 1117 bytes} [Mon Aug 29 15:26:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:26:27.524505 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25cf846-3168-4574-aaeb-3407a0799114 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:27.623693 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25cf846-3168-4574-aaeb-3407a0799114 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:27.656568 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c214d5-2655-46fc-a8d6-79d94a5e1d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:27.657165 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c214d5-2655-46fc-a8d6-79d94a5e1d0a None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:27.657442 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c214d5-2655-46fc-a8d6-79d94a5e1d0a None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:27.657710 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c214d5-2655-46fc-a8d6-79d94a5e1d0a None admin] PATH_INFO: `/v3/services` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:27.658330 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c214d5-2655-46fc-a8d6-79d94a5e1d0a None admin] RBAC: Adding query filter params (name=placement) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:27.658630 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c214d5-2655-46fc-a8d6-79d94a5e1d0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:27.660022 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c214d5-2655-46fc-a8d6-79d94a5e1d0a None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:27.664726 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 629/1291] 10.222.0.83 () {56 vars in 1116 bytes} [Mon Aug 29 15:26:27 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:27.672183 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0cb2c1-f3f6-4d43-94c6-9bfcdfe35cea None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:27.771576 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0cb2c1-f3f6-4d43-94c6-9bfcdfe35cea None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:27.805302 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327514ee-4a2a-407f-a748-c53ad03b53c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:27.805915 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327514ee-4a2a-407f-a748-c53ad03b53c8 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:27.806193 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327514ee-4a2a-407f-a748-c53ad03b53c8 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:27.806465 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327514ee-4a2a-407f-a748-c53ad03b53c8 None admin] PATH_INFO: `/v3/services` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:27.807131 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327514ee-4a2a-407f-a748-c53ad03b53c8 None admin] RBAC: Adding query filter params (type=placement) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:27.807437 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327514ee-4a2a-407f-a748-c53ad03b53c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:27.808814 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327514ee-4a2a-407f-a748-c53ad03b53c8 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:27.813344 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 663/1292] 10.222.0.83 () {56 vars in 1116 bytes} [Mon Aug 29 15:26:27 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:29.693968 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3d3d3-c698-40ef-9faa-6d9b6650a5d2 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:29.694506 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3d3d3-c698-40ef-9faa-6d9b6650a5d2 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:29.694506 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3d3d3-c698-40ef-9faa-6d9b6650a5d2 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:29.695895 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 630/1293] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:26:29.701057 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec76eae-b65c-4cb2-9881-5672492064f8 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:29.701591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec76eae-b65c-4cb2-9881-5672492064f8 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:29.701720 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec76eae-b65c-4cb2-9881-5672492064f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:29.720192 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-9ec76eae-b65c-4cb2-9881-5672492064f8 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:29.721380 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9ec76eae-b65c-4cb2-9881-5672492064f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:29.751219 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:29.788671 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 664/1294] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:26:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:26:30.063662 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3d3d3-c698-40ef-9faa-6d9b6650a5d2 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:30.103525 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:30.174328 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3d3d3-c698-40ef-9faa-6d9b6650a5d2 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:30.207996 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a3ca1-e954-4169-8c54-a8965c81a133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:30.208600 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a3ca1-e954-4169-8c54-a8965c81a133 None admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:30.208879 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a3ca1-e954-4169-8c54-a8965c81a133 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:30.209151 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a3ca1-e954-4169-8c54-a8965c81a133 None admin] PATH_INFO: `/v3/services` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:30.209797 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34a3ca1-e954-4169-8c54-a8965c81a133 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:30.211196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34a3ca1-e954-4169-8c54-a8965c81a133 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:30.228371 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 631/1295] 10.222.0.83 () {60 vars in 1141 bytes} [Mon Aug 29 15:26:30 2022] POST /identity/v3/services => generated 246 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:32.150030 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56062dba-7d8c-42dd-99ce-de87038c357c None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:32.150566 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56062dba-7d8c-42dd-99ce-de87038c357c None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:32.150566 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56062dba-7d8c-42dd-99ce-de87038c357c None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:32.151855 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 665/1296] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:26:32.157053 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2bfcf1-b0fd-40bb-8969-301776ed80fc None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:32.157459 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2bfcf1-b0fd-40bb-8969-301776ed80fc None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:32.157587 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2bfcf1-b0fd-40bb-8969-301776ed80fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:32.176331 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-0c2bfcf1-b0fd-40bb-8969-301776ed80fc None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:32.177492 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0c2bfcf1-b0fd-40bb-8969-301776ed80fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:32.250167 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 632/1297] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:26:32 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 15:26:32.521525 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56062dba-7d8c-42dd-99ce-de87038c357c None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:32.622832 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56062dba-7d8c-42dd-99ce-de87038c357c None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:32.656380 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f5792-218e-424d-90d6-e546186dca42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:32.656994 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f5792-218e-424d-90d6-e546186dca42 None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:32.657270 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f5792-218e-424d-90d6-e546186dca42 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:32.657535 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f5792-218e-424d-90d6-e546186dca42 None admin] PATH_INFO: `/v3/services/placement` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:32.658114 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f5792-218e-424d-90d6-e546186dca42 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:32.659518 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f5792-218e-424d-90d6-e546186dca42 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:32.668337 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-a99f5792-218e-424d-90d6-e546186dca42 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 15:26:32.668337 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:26:32.668337 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:26:32.668337 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:26:32.668337 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:26:32.668337 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:26:32.668337 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:26:32.668337 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:26:32.668337 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 15:26:32.668337 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:26:32.668337 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:26:32.668337 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:26:32.668337 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:26:32.668337 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:26:32.668337 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:26:32.668337 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:26:32.668337 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:26:32.669481 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:26:32.669481 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:26:32.669481 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:26:32.669481 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:26:32.669481 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:26:32.669481 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:26:32.669481 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:26:32.669481 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:26:32.669481 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:26:32.669481 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:26:32.669481 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:26:32.669481 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:26:32.669481 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:26:32.669481 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:26:32.669481 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:26:32.669481 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:26:32.670494 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:26:32.670494 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:26:32.670494 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:26:32.670494 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:26:32.670494 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:26:32.670494 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:26:32.670494 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:26:32.670494 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:26:32.670494 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:26:32.670494 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:26:32.670494 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:26:32.670494 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:26:32.670494 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 15:26:32.670494 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:26:32.670494 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 666/1298] 10.222.0.83 () {56 vars in 1117 bytes} [Mon Aug 29 15:26:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:26:32.675979 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2bfcf1-b0fd-40bb-8969-301776ed80fc None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:32.694379 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:32.776298 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2bfcf1-b0fd-40bb-8969-301776ed80fc None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:32.812662 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5cefde-84db-4891-981b-4513e76b9bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:32.813267 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5cefde-84db-4891-981b-4513e76b9bfe None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:32.813541 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5cefde-84db-4891-981b-4513e76b9bfe None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:32.813806 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5cefde-84db-4891-981b-4513e76b9bfe None admin] PATH_INFO: `/v3/services` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:32.814463 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5cefde-84db-4891-981b-4513e76b9bfe None admin] RBAC: Adding query filter params (name=placement) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:32.814761 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5cefde-84db-4891-981b-4513e76b9bfe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:32.816157 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5cefde-84db-4891-981b-4513e76b9bfe None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:32.821143 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 633/1299] 10.222.0.83 () {56 vars in 1116 bytes} [Mon Aug 29 15:26:32 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:32.827336 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f5792-218e-424d-90d6-e546186dca42 None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:32.860601 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:32.928719 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f5792-218e-424d-90d6-e546186dca42 None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:32.960982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86eddc-94fa-4984-9250-758fc8cde92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:32.961580 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86eddc-94fa-4984-9250-758fc8cde92c None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:32.961856 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86eddc-94fa-4984-9250-758fc8cde92c None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:32.962124 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86eddc-94fa-4984-9250-758fc8cde92c None admin] PATH_INFO: `/v3/endpoints` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:32.962870 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86eddc-94fa-4984-9250-758fc8cde92c None admin] RBAC: Adding query filter params (interface=public, service_id=23b6fc8a8a9e467ea48fe7f2b56ea7a0, region_id=RegionOne) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:32.963200 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86eddc-94fa-4984-9250-758fc8cde92c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:32.964571 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86eddc-94fa-4984-9250-758fc8cde92c None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:32.970058 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 667/1300] 10.222.0.83 () {56 vars in 1251 bytes} [Mon Aug 29 15:26:32 2022] GET /identity/v3/endpoints?service_id=23b6fc8a8a9e467ea48fe7f2b56ea7a0&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:32.975790 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5cefde-84db-4891-981b-4513e76b9bfe None admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:33.060350 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:33.085286 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5cefde-84db-4891-981b-4513e76b9bfe None admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:33.122542 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5d92a-f783-41ca-b9cd-9ab4bde023c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:33.123170 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5d92a-f783-41ca-b9cd-9ab4bde023c2 None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:33.123444 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5d92a-f783-41ca-b9cd-9ab4bde023c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:33.123710 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5d92a-f783-41ca-b9cd-9ab4bde023c2 None admin] PATH_INFO: `/v3/services` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:33.124748 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa5d92a-f783-41ca-b9cd-9ab4bde023c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:33.126116 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa5d92a-f783-41ca-b9cd-9ab4bde023c2 None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:33.132851 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 634/1301] 10.222.0.83 () {56 vars in 1087 bytes} [Mon Aug 29 15:26:32 2022] GET /identity/v3/services => generated 2191 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:35.040371 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d12743-5406-46a5-b392-ed03ee4e4ca6 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:35.040897 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d12743-5406-46a5-b392-ed03ee4e4ca6 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:35.040897 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d12743-5406-46a5-b392-ed03ee4e4ca6 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:35.042173 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 668/1302] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:26:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:26:35.047497 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa511f62-0776-4223-8506-0502177557a5 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:35.047928 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa511f62-0776-4223-8506-0502177557a5 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:35.048038 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa511f62-0776-4223-8506-0502177557a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:35.066537 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-aa511f62-0776-4223-8506-0502177557a5 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:35.067886 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-aa511f62-0776-4223-8506-0502177557a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:35.133111 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 635/1303] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:26:35 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:26:35.400333 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d12743-5406-46a5-b392-ed03ee4e4ca6 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:35.494358 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:35.501776 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d12743-5406-46a5-b392-ed03ee4e4ca6 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:35.534365 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0ae19-c43e-4361-bf71-32330deccdcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:35.534980 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0ae19-c43e-4361-bf71-32330deccdcb None admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:35.535288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0ae19-c43e-4361-bf71-32330deccdcb None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:35.535557 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0ae19-c43e-4361-bf71-32330deccdcb None admin] PATH_INFO: `/v3/services/placement` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:35.536134 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae0ae19-c43e-4361-bf71-32330deccdcb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:35.537498 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae0ae19-c43e-4361-bf71-32330deccdcb None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:35.546917 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-5ae0ae19-c43e-4361-bf71-32330deccdcb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 15:26:35.546917 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:26:35.546917 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:26:35.546917 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:26:35.546917 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:26:35.546917 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:26:35.546917 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:26:35.546917 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:26:35.546917 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 15:26:35.546917 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:26:35.546917 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:26:35.546917 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:26:35.546917 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:26:35.546917 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:26:35.546917 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:26:35.546917 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:26:35.546917 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:26:35.548707 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:26:35.548707 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:26:35.548707 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:26:35.548707 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:26:35.548707 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:26:35.548707 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:26:35.548707 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:26:35.548707 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:26:35.548707 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:26:35.548707 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:26:35.548707 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:26:35.548707 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:26:35.548707 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:26:35.548707 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:26:35.548707 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:26:35.548707 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:26:35.550549 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:26:35.550549 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 15:26:35.550549 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:26:35.550549 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:26:35.550549 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:26:35.550549 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:26:35.550549 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:26:35.550549 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:26:35.550549 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:26:35.550549 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:26:35.550549 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:26:35.550549 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:26:35.550549 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 15:26:35.550549 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:26:35.550549 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 669/1304] 10.222.0.83 () {56 vars in 1117 bytes} [Mon Aug 29 15:26:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:26:35.554395 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa511f62-0776-4223-8506-0502177557a5 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:35.631430 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:35.654145 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa511f62-0776-4223-8506-0502177557a5 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:35.687883 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087692f-1c3d-400d-a649-b73cd0bfe90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:35.688483 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087692f-1c3d-400d-a649-b73cd0bfe90e None admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:35.688757 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087692f-1c3d-400d-a649-b73cd0bfe90e None admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:35.689023 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087692f-1c3d-400d-a649-b73cd0bfe90e None admin] PATH_INFO: `/v3/services` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:35.689640 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9087692f-1c3d-400d-a649-b73cd0bfe90e None admin] RBAC: Adding query filter params (name=placement) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:35.689937 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9087692f-1c3d-400d-a649-b73cd0bfe90e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:35.691317 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9087692f-1c3d-400d-a649-b73cd0bfe90e None admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:35.696306 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 636/1305] 10.222.0.83 () {56 vars in 1116 bytes} [Mon Aug 29 15:26:35 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:35.702241 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0ae19-c43e-4361-bf71-32330deccdcb None admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:35.802195 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0ae19-c43e-4361-bf71-32330deccdcb None admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:35.835041 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf981d3-5e2c-460c-b949-c1b2111785d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:35.835650 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf981d3-5e2c-460c-b949-c1b2111785d9 None admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:35.835931 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf981d3-5e2c-460c-b949-c1b2111785d9 None admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:35.836200 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf981d3-5e2c-460c-b949-c1b2111785d9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:35.836868 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf981d3-5e2c-460c-b949-c1b2111785d9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:35.838235 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf981d3-5e2c-460c-b949-c1b2111785d9 None admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:35.857959 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 670/1306] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:26:35 2022] POST /identity/v3/endpoints => generated 331 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:45.693762 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=30 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:45.853643 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:40.797862 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b17fd2-b7f4-4f50-895a-5f2eb52bad7d None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:40.798445 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b17fd2-b7f4-4f50-895a-5f2eb52bad7d None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:40.798445 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b17fd2-b7f4-4f50-895a-5f2eb52bad7d None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:40.799769 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 637/1307] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:27:40.805449 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ff610-56a5-4e04-92ec-afe2aba1d5f5 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:40.806427 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ff610-56a5-4e04-92ec-afe2aba1d5f5 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:40.806528 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ff610-56a5-4e04-92ec-afe2aba1d5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:40.882158 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-2d3ff610-56a5-4e04-92ec-afe2aba1d5f5 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:27:40.883411 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2d3ff610-56a5-4e04-92ec-afe2aba1d5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:41.015410 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 671/1308] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:27:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:27:41.302990 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74d759-42a4-44dd-806c-dee634c04e70 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:41.303622 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74d759-42a4-44dd-806c-dee634c04e70 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:41.304079 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74d759-42a4-44dd-806c-dee634c04e70 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:41.308600 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 638/1309] 10.222.0.83 () {54 vars in 965 bytes} [Mon Aug 29 15:27:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:27:41.314736 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d1ec5-1633-471b-8244-21dcfa2d3aee None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:41.315201 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d1ec5-1633-471b-8244-21dcfa2d3aee None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:41.315545 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d1ec5-1633-471b-8244-21dcfa2d3aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:41.398824 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-1d3d1ec5-1633-471b-8244-21dcfa2d3aee None None] MFA Rules not processed for user `9a84bb38f6454574897120223b8fc140`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:27:41.400683 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1d3d1ec5-1633-471b-8244-21dcfa2d3aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:41.422178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:41.481762 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 672/1310] 10.222.0.83 () {58 vars in 1062 bytes} [Mon Aug 29 15:27:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:27:41.490556 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74d759-42a4-44dd-806c-dee634c04e70 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:41.492312 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-dd74d759-42a4-44dd-806c-dee634c04e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:41.616733 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74d759-42a4-44dd-806c-dee634c04e70 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:41.704730 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b51fdfd-3891-4455-8b20-62aeb0458e5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:41.705129 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b51fdfd-3891-4455-8b20-62aeb0458e5a service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:41.705406 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b51fdfd-3891-4455-8b20-62aeb0458e5a service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:41.705674 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b51fdfd-3891-4455-8b20-62aeb0458e5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:41.707387 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2b51fdfd-3891-4455-8b20-62aeb0458e5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:41.767953 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:41.829374 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b51fdfd-3891-4455-8b20-62aeb0458e5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:41.830981 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b51fdfd-3891-4455-8b20-62aeb0458e5a service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:41.850958 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 639/1311] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:27:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:27:44.086596 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc138b-7023-4b1d-9155-6be46a418ec4 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:44.087262 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc138b-7023-4b1d-9155-6be46a418ec4 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:44.087262 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc138b-7023-4b1d-9155-6be46a418ec4 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:44.088689 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 673/1312] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:27:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:27:44.094305 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d4794-6c72-4e5c-9216-909e4c6b2acd None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:44.094820 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d4794-6c72-4e5c-9216-909e4c6b2acd None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:44.094927 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d4794-6c72-4e5c-9216-909e4c6b2acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:44.193786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-b94d4794-6c72-4e5c-9216-909e4c6b2acd None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:27:44.195013 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b94d4794-6c72-4e5c-9216-909e4c6b2acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:44.312954 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 640/1313] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:27:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:27:44.600760 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc138b-7023-4b1d-9155-6be46a418ec4 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:44.602380 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-49fc138b-7023-4b1d-9155-6be46a418ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:44.711873 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc138b-7023-4b1d-9155-6be46a418ec4 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:44.788804 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:44.792744 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52248997-696b-4e4c-bfd6-decdc23563d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:44.793387 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52248997-696b-4e4c-bfd6-decdc23563d2 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:44.793674 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52248997-696b-4e4c-bfd6-decdc23563d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:44.794160 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52248997-696b-4e4c-bfd6-decdc23563d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:44.796256 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-52248997-696b-4e4c-bfd6-decdc23563d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:44.910030 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52248997-696b-4e4c-bfd6-decdc23563d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:44.911516 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52248997-696b-4e4c-bfd6-decdc23563d2 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:44.931481 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 674/1314] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:27:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:27:47.182930 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602ee4e-6566-403c-a26d-733f422f7d10 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:47.183522 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602ee4e-6566-403c-a26d-733f422f7d10 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:47.183522 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602ee4e-6566-403c-a26d-733f422f7d10 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:47.185008 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 641/1315] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:27:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:27:47.190148 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2edfb1a-1dc8-4729-9648-ef1cd065df10 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:47.190542 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2edfb1a-1dc8-4729-9648-ef1cd065df10 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:47.190690 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2edfb1a-1dc8-4729-9648-ef1cd065df10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:47.257172 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-d2edfb1a-1dc8-4729-9648-ef1cd065df10 None None] MFA Rules not processed for user `618f35cfd2d04e50a8c22d7b8993a5fe`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:27:47.258370 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d2edfb1a-1dc8-4729-9648-ef1cd065df10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:47.309533 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:47.354285 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 675/1316] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:27:47 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:27:47.635665 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602ee4e-6566-403c-a26d-733f422f7d10 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:47.637207 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2602ee4e-6566-403c-a26d-733f422f7d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:47.646903 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:47.745063 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602ee4e-6566-403c-a26d-733f422f7d10 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:47.819610 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898e065-fe8b-4483-97a3-27253f7b166e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:47.820216 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898e065-fe8b-4483-97a3-27253f7b166e service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:47.820493 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898e065-fe8b-4483-97a3-27253f7b166e service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:47.820762 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898e065-fe8b-4483-97a3-27253f7b166e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:47.822359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4898e065-fe8b-4483-97a3-27253f7b166e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:47.883971 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:47.932865 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4898e065-fe8b-4483-97a3-27253f7b166e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:47.934294 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4898e065-fe8b-4483-97a3-27253f7b166e service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:47.952800 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 642/1317] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:27:47 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:27:50.430755 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02d6dd-f27b-413b-b80d-cdb67f360305 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:50.431648 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02d6dd-f27b-413b-b80d-cdb67f360305 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:50.431648 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02d6dd-f27b-413b-b80d-cdb67f360305 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:50.433601 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 676/1318] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:27:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:27:50.438835 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95622ea1-486c-4a5e-93f8-a5a6a7c20f45 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:50.439337 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95622ea1-486c-4a5e-93f8-a5a6a7c20f45 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:50.439477 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95622ea1-486c-4a5e-93f8-a5a6a7c20f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:50.505704 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-95622ea1-486c-4a5e-93f8-a5a6a7c20f45 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:27:50.506908 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-95622ea1-486c-4a5e-93f8-a5a6a7c20f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:50.604771 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 643/1319] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:27:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:27:50.935630 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21311f0-ce8e-4d25-86b8-cfd9d019fed4 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:50.935915 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21311f0-ce8e-4d25-86b8-cfd9d019fed4 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:50.936190 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21311f0-ce8e-4d25-86b8-cfd9d019fed4 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:50.937538 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 677/1320] 10.222.0.83 () {54 vars in 965 bytes} [Mon Aug 29 15:27:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:27:50.943438 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe7a5a-b9b8-4131-92da-2c38d77c7f09 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:50.943721 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe7a5a-b9b8-4131-92da-2c38d77c7f09 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:50.943989 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe7a5a-b9b8-4131-92da-2c38d77c7f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:50.965879 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:51.020341 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-11fe7a5a-b9b8-4131-92da-2c38d77c7f09 None None] MFA Rules not processed for user `9a84bb38f6454574897120223b8fc140`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:27:51.021519 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-11fe7a5a-b9b8-4131-92da-2c38d77c7f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:51.114289 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 644/1321] 10.222.0.83 () {58 vars in 1062 bytes} [Mon Aug 29 15:27:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:27:51.123471 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21311f0-ce8e-4d25-86b8-cfd9d019fed4 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:51.125017 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a21311f0-ce8e-4d25-86b8-cfd9d019fed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:51.227162 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21311f0-ce8e-4d25-86b8-cfd9d019fed4 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:51.300647 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8ffac-15fa-40fa-95ef-35e0dc3807d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:51.301247 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8ffac-15fa-40fa-95ef-35e0dc3807d3 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:51.301515 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8ffac-15fa-40fa-95ef-35e0dc3807d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:51.301776 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8ffac-15fa-40fa-95ef-35e0dc3807d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:51.303428 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-06b8ffac-15fa-40fa-95ef-35e0dc3807d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:51.311152 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:51.411484 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8ffac-15fa-40fa-95ef-35e0dc3807d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:51.412908 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8ffac-15fa-40fa-95ef-35e0dc3807d3 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:51.433054 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 678/1322] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:27:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:27:54.509520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb41ff-6e5a-4b6c-85b4-a623ffdf2bfd None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:54.510103 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb41ff-6e5a-4b6c-85b4-a623ffdf2bfd None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:54.510103 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb41ff-6e5a-4b6c-85b4-a623ffdf2bfd None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:54.511573 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 645/1323] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:27:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:27:54.516993 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfa066-4696-4186-bf27-d90c0a75d1a5 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:54.517411 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfa066-4696-4186-bf27-d90c0a75d1a5 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:54.517547 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfa066-4696-4186-bf27-d90c0a75d1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:54.587898 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-8fcfa066-4696-4186-bf27-d90c0a75d1a5 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:27:54.589321 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8fcfa066-4696-4186-bf27-d90c0a75d1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:54.647307 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:54.689424 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 679/1324] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:27:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:27:54.986356 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb41ff-6e5a-4b6c-85b4-a623ffdf2bfd None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:54.987907 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-17bb41ff-6e5a-4b6c-85b4-a623ffdf2bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:55.093524 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb41ff-6e5a-4b6c-85b4-a623ffdf2bfd None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:55.106834 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:55.169705 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd51ff-c7a7-4742-850f-d0739ab2422e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:55.170228 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd51ff-c7a7-4742-850f-d0739ab2422e service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:55.170511 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd51ff-c7a7-4742-850f-d0739ab2422e service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:55.170782 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd51ff-c7a7-4742-850f-d0739ab2422e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:55.172434 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d7cd51ff-c7a7-4742-850f-d0739ab2422e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:55.283615 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd51ff-c7a7-4742-850f-d0739ab2422e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:55.285063 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd51ff-c7a7-4742-850f-d0739ab2422e service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:55.303662 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 646/1325] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:27:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:27:57.286293 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd91236-1bb4-4ad4-8dff-368de2005c75 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:57.286817 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd91236-1bb4-4ad4-8dff-368de2005c75 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:57.286817 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd91236-1bb4-4ad4-8dff-368de2005c75 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:57.288163 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 680/1326] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:27:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:27:57.294129 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c421d37-fd3e-4bf9-b9c9-4ea4368a9021 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:57.294550 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c421d37-fd3e-4bf9-b9c9-4ea4368a9021 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:57.294849 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c421d37-fd3e-4bf9-b9c9-4ea4368a9021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:57.343845 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:57.363576 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-1c421d37-fd3e-4bf9-b9c9-4ea4368a9021 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:27:57.364810 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1c421d37-fd3e-4bf9-b9c9-4ea4368a9021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:57.461906 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 647/1327] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:27:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:27:57.745210 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd91236-1bb4-4ad4-8dff-368de2005c75 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:57.747485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-bbd91236-1bb4-4ad4-8dff-368de2005c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:57.860956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd91236-1bb4-4ad4-8dff-368de2005c75 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:57.935090 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2287fca-27fa-4b9a-9196-d6a2d0961270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:57.935701 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2287fca-27fa-4b9a-9196-d6a2d0961270 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:57.935974 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2287fca-27fa-4b9a-9196-d6a2d0961270 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:57.936239 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2287fca-27fa-4b9a-9196-d6a2d0961270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:57.937817 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b2287fca-27fa-4b9a-9196-d6a2d0961270 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:57.955371 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:58.050270 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2287fca-27fa-4b9a-9196-d6a2d0961270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:58.051750 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2287fca-27fa-4b9a-9196-d6a2d0961270 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:58.070584 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 681/1328] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:27:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:28:00.076034 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c39c7e-477a-4abd-b1fd-925c384db460 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:00.076591 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c39c7e-477a-4abd-b1fd-925c384db460 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:00.076591 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c39c7e-477a-4abd-b1fd-925c384db460 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:00.077990 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 648/1329] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:28:00.084090 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df2d6f-6500-4c9c-866d-1991e35c6e95 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:00.084666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df2d6f-6500-4c9c-866d-1991e35c6e95 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:00.084666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df2d6f-6500-4c9c-866d-1991e35c6e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:00.162451 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-98df2d6f-6500-4c9c-866d-1991e35c6e95 None None] MFA Rules not processed for user `618f35cfd2d04e50a8c22d7b8993a5fe`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:28:00.163724 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-98df2d6f-6500-4c9c-866d-1991e35c6e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:00.232000 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:00.266175 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 682/1330] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:28:00 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:28:00.549332 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c39c7e-477a-4abd-b1fd-925c384db460 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:00.551139 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e3c39c7e-477a-4abd-b1fd-925c384db460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:00.667095 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c39c7e-477a-4abd-b1fd-925c384db460 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:00.688909 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:00.750982 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37756d27-7735-4015-82a4-004397f31e77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:00.751781 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37756d27-7735-4015-82a4-004397f31e77 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:00.752064 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37756d27-7735-4015-82a4-004397f31e77 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:00.752333 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37756d27-7735-4015-82a4-004397f31e77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:00.753946 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-37756d27-7735-4015-82a4-004397f31e77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:00.873596 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37756d27-7735-4015-82a4-004397f31e77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:00.875072 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37756d27-7735-4015-82a4-004397f31e77 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:00.894482 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 649/1331] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:28:00 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:28:03.033670 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58801eb5-03d8-4270-97ea-8cceaa99983a None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:03.034213 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58801eb5-03d8-4270-97ea-8cceaa99983a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:03.034213 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58801eb5-03d8-4270-97ea-8cceaa99983a None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:03.035609 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 683/1332] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:28:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:28:03.040692 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a1858-06e4-45ad-bf85-6043e79f8486 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:03.041095 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a1858-06e4-45ad-bf85-6043e79f8486 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:03.041238 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a1858-06e4-45ad-bf85-6043e79f8486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:03.105503 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:03.108985 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-0f4a1858-06e4-45ad-bf85-6043e79f8486 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:28:03.110731 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0f4a1858-06e4-45ad-bf85-6043e79f8486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:03.205553 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 650/1333] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:28:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:28:03.489697 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58801eb5-03d8-4270-97ea-8cceaa99983a None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:03.491274 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-58801eb5-03d8-4270-97ea-8cceaa99983a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:03.595168 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58801eb5-03d8-4270-97ea-8cceaa99983a None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:03.666695 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3664ce-36c5-4975-b8f1-57c5493257c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:03.667323 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3664ce-36c5-4975-b8f1-57c5493257c3 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:03.667599 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3664ce-36c5-4975-b8f1-57c5493257c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:03.667868 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3664ce-36c5-4975-b8f1-57c5493257c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:03.670005 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-cc3664ce-36c5-4975-b8f1-57c5493257c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:03.696996 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:03.779348 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3664ce-36c5-4975-b8f1-57c5493257c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:03.780717 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3664ce-36c5-4975-b8f1-57c5493257c3 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:03.798969 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 684/1334] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:28:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:28:05.753844 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20332b47-3de7-427d-a97b-3faafaeb2da5 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:05.754383 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20332b47-3de7-427d-a97b-3faafaeb2da5 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:05.754383 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20332b47-3de7-427d-a97b-3faafaeb2da5 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:05.755816 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 651/1335] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:28:05.761008 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90142a28-dcfd-49d8-9427-46665d18790a None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:05.761439 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90142a28-dcfd-49d8-9427-46665d18790a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:05.761544 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90142a28-dcfd-49d8-9427-46665d18790a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:05.828480 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-90142a28-dcfd-49d8-9427-46665d18790a None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:28:05.829724 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-90142a28-dcfd-49d8-9427-46665d18790a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:05.903235 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:05.926457 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 685/1336] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:28:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:28:06.210558 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20332b47-3de7-427d-a97b-3faafaeb2da5 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:06.212139 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-20332b47-3de7-427d-a97b-3faafaeb2da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:06.315272 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20332b47-3de7-427d-a97b-3faafaeb2da5 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:06.345305 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:06.395554 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b2e96-9048-4e86-9f20-7770f3576921 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:06.396157 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b2e96-9048-4e86-9f20-7770f3576921 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:06.396431 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b2e96-9048-4e86-9f20-7770f3576921 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:06.396699 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b2e96-9048-4e86-9f20-7770f3576921 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:06.398311 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-315b2e96-9048-4e86-9f20-7770f3576921 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:06.506504 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b2e96-9048-4e86-9f20-7770f3576921 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:06.507985 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b2e96-9048-4e86-9f20-7770f3576921 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:06.525471 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 652/1337] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:28:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:28:08.854890 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d025e4-a9a4-4662-b5c3-fbdfbecf1072 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:08.855474 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d025e4-a9a4-4662-b5c3-fbdfbecf1072 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:08.855474 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d025e4-a9a4-4662-b5c3-fbdfbecf1072 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:08.856807 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 686/1338] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:28:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:28:08.862952 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e19461-4dbb-469d-8527-525c9b430179 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:08.863402 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e19461-4dbb-469d-8527-525c9b430179 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:08.863568 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e19461-4dbb-469d-8527-525c9b430179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:08.928625 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-36e19461-4dbb-469d-8527-525c9b430179 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:28:08.929825 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-36e19461-4dbb-469d-8527-525c9b430179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:08.938949 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:09.030024 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 653/1339] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:28:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:28:09.314219 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d025e4-a9a4-4662-b5c3-fbdfbecf1072 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:09.315830 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-51d025e4-a9a4-4662-b5c3-fbdfbecf1072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:09.422717 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d025e4-a9a4-4662-b5c3-fbdfbecf1072 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:09.494578 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4e325-93d8-4f73-b9a4-89925299efda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:09.495202 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4e325-93d8-4f73-b9a4-89925299efda service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:09.495477 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4e325-93d8-4f73-b9a4-89925299efda service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:09.495742 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4e325-93d8-4f73-b9a4-89925299efda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:09.497324 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e0f4e325-93d8-4f73-b9a4-89925299efda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:09.533831 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:09.607038 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f4e325-93d8-4f73-b9a4-89925299efda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:09.608589 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f4e325-93d8-4f73-b9a4-89925299efda service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:09.626360 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 687/1340] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:28:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:28:13.566937 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c5c1e-64da-4c6c-a8f6-dbeaebf70de5 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:13.567499 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c5c1e-64da-4c6c-a8f6-dbeaebf70de5 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:13.567499 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c5c1e-64da-4c6c-a8f6-dbeaebf70de5 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:13.568922 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 654/1341] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:28:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:28:13.574331 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f051adc-5019-43d3-92f2-b44f7920eecf None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:13.574761 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f051adc-5019-43d3-92f2-b44f7920eecf None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:13.574913 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f051adc-5019-43d3-92f2-b44f7920eecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:13.641223 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-1f051adc-5019-43d3-92f2-b44f7920eecf None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:28:13.642436 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1f051adc-5019-43d3-92f2-b44f7920eecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:13.729824 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:13.745010 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 688/1342] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:28:14.031626 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c5c1e-64da-4c6c-a8f6-dbeaebf70de5 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:14.033372 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8c0c5c1e-64da-4c6c-a8f6-dbeaebf70de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:14.145335 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c5c1e-64da-4c6c-a8f6-dbeaebf70de5 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:14.183072 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:14.222403 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33204eed-96c2-4e32-ac19-e6f6950c6e6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:14.223018 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33204eed-96c2-4e32-ac19-e6f6950c6e6e service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:14.223324 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33204eed-96c2-4e32-ac19-e6f6950c6e6e service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:14.223593 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33204eed-96c2-4e32-ac19-e6f6950c6e6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:14.225223 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-33204eed-96c2-4e32-ac19-e6f6950c6e6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:14.337751 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33204eed-96c2-4e32-ac19-e6f6950c6e6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:14.339145 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33204eed-96c2-4e32-ac19-e6f6950c6e6e service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:14.357928 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 655/1343] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:28:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:28:16.884971 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e359c8-3190-4ec9-8593-cc3a0b4e764a None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:16.885494 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e359c8-3190-4ec9-8593-cc3a0b4e764a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:16.885494 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e359c8-3190-4ec9-8593-cc3a0b4e764a None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:16.886813 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 689/1344] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:28:16.893487 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba28bfb-a36c-41f0-a78b-5848ca560d4e None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:16.893994 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba28bfb-a36c-41f0-a78b-5848ca560d4e None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:16.894173 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba28bfb-a36c-41f0-a78b-5848ca560d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:16.969129 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-1ba28bfb-a36c-41f0-a78b-5848ca560d4e None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:28:16.970346 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1ba28bfb-a36c-41f0-a78b-5848ca560d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:16.988883 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:17.079464 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 656/1345] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:28:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:28:17.367488 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e359c8-3190-4ec9-8593-cc3a0b4e764a None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:17.369030 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-03e359c8-3190-4ec9-8593-cc3a0b4e764a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:17.475740 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e359c8-3190-4ec9-8593-cc3a0b4e764a None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:17.550837 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a87ef0-f0d1-4aab-8d8c-f3c731656567 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:17.551476 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a87ef0-f0d1-4aab-8d8c-f3c731656567 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:17.551753 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a87ef0-f0d1-4aab-8d8c-f3c731656567 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:17.552022 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a87ef0-f0d1-4aab-8d8c-f3c731656567 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:17.553671 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a6a87ef0-f0d1-4aab-8d8c-f3c731656567 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:17.605892 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:17.676177 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a87ef0-f0d1-4aab-8d8c-f3c731656567 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:17.677837 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a87ef0-f0d1-4aab-8d8c-f3c731656567 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:17.696924 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 690/1346] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:28:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:28:21.957913 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e7c94-e240-40f8-a414-23aa99561eb2 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:21.958480 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e7c94-e240-40f8-a414-23aa99561eb2 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:21.958480 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e7c94-e240-40f8-a414-23aa99561eb2 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:21.959824 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 657/1347] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:28:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:28:21.965435 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81ee36-acbd-4657-9ae2-f549e0b78090 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:21.965933 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81ee36-acbd-4657-9ae2-f549e0b78090 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:21.966028 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81ee36-acbd-4657-9ae2-f549e0b78090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:22.039676 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-5d81ee36-acbd-4657-9ae2-f549e0b78090 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:28:22.040941 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5d81ee36-acbd-4657-9ae2-f549e0b78090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:22.143493 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:22.147211 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 691/1348] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:28:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:28:22.434702 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967e7c94-e240-40f8-a414-23aa99561eb2 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:22.436264 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-967e7c94-e240-40f8-a414-23aa99561eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:22.543951 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967e7c94-e240-40f8-a414-23aa99561eb2 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:22.593280 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:22.628467 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0499a11-0561-41be-aeec-e7859397f779 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:22.629080 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0499a11-0561-41be-aeec-e7859397f779 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:22.629357 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0499a11-0561-41be-aeec-e7859397f779 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:22.629662 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0499a11-0561-41be-aeec-e7859397f779 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:22.631333 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b0499a11-0561-41be-aeec-e7859397f779 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:22.751540 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0499a11-0561-41be-aeec-e7859397f779 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:22.752987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0499a11-0561-41be-aeec-e7859397f779 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:22.773354 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 658/1349] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:28:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:28:27.828783 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db224c93-c46b-4efb-985e-e8beab2e1cea None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:27.830679 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db224c93-c46b-4efb-985e-e8beab2e1cea None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:27.831174 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db224c93-c46b-4efb-985e-e8beab2e1cea None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:27.834095 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 692/1350] 10.222.0.83 () {54 vars in 921 bytes} [Mon Aug 29 15:28:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:28:27.840701 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e88e15-0a50-4e97-bd67-c9b00a02f633 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:27.841428 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e88e15-0a50-4e97-bd67-c9b00a02f633 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:27.841981 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e88e15-0a50-4e97-bd67-c9b00a02f633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:27.944880 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-b7e88e15-0a50-4e97-bd67-c9b00a02f633 None None] MFA Rules not processed for user `c190fa4a280c41c684130e069bee99eb`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:28:27.946382 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b7e88e15-0a50-4e97-bd67-c9b00a02f633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:27.968555 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:28.137953 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 659/1351] 10.222.0.83 () {58 vars in 1018 bytes} [Mon Aug 29 15:28:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:28:32.503166 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ebda8-a4e6-48ec-b6cc-9011db051e78 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:32.504629 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ebda8-a4e6-48ec-b6cc-9011db051e78 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:32.505101 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ebda8-a4e6-48ec-b6cc-9011db051e78 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:32.506941 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 693/1352] 10.222.0.83 () {54 vars in 921 bytes} [Mon Aug 29 15:28:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:28:32.513154 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50c8f3-aec3-4226-aaf8-5cc32aa6dc8b None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:32.513579 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50c8f3-aec3-4226-aaf8-5cc32aa6dc8b None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:32.513760 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50c8f3-aec3-4226-aaf8-5cc32aa6dc8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:32.601479 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-9a50c8f3-aec3-4226-aaf8-5cc32aa6dc8b None None] MFA Rules not processed for user `c190fa4a280c41c684130e069bee99eb`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:28:32.602718 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9a50c8f3-aec3-4226-aaf8-5cc32aa6dc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:32.698707 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:32.740662 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 660/1353] 10.222.0.83 () {58 vars in 1018 bytes} [Mon Aug 29 15:28:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:28:34.011509 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794af511-9e63-49fd-a176-9a61e13239c0 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:34.012419 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794af511-9e63-49fd-a176-9a61e13239c0 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:34.012765 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794af511-9e63-49fd-a176-9a61e13239c0 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:34.014192 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 694/1354] 10.222.0.83 () {54 vars in 921 bytes} [Mon Aug 29 15:28:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:28:34.019921 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4812d-a259-4895-ba04-12624bfd8d44 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:34.020376 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4812d-a259-4895-ba04-12624bfd8d44 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:34.020495 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4812d-a259-4895-ba04-12624bfd8d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:34.098168 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-b4e4812d-a259-4895-ba04-12624bfd8d44 None None] MFA Rules not processed for user `c190fa4a280c41c684130e069bee99eb`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:28:34.099403 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b4e4812d-a259-4895-ba04-12624bfd8d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:34.205789 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 661/1355] 10.222.0.83 () {58 vars in 1018 bytes} [Mon Aug 29 15:28:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:28:37.664376 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a388d-ab3c-42aa-b189-a915c81f7184 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:37.664924 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a388d-ab3c-42aa-b189-a915c81f7184 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:37.664924 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a388d-ab3c-42aa-b189-a915c81f7184 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:37.666260 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 695/1356] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:28:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:28:37.671357 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0c024-327e-451e-9866-b10107164d6c None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:37.671787 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0c024-327e-451e-9866-b10107164d6c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:37.671909 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0c024-327e-451e-9866-b10107164d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:37.709856 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:37.747810 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-d5e0c024-327e-451e-9866-b10107164d6c None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:28:37.749033 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d5e0c024-327e-451e-9866-b10107164d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:37.880841 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 662/1357] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:28:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:28:38.213542 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82800bf-69a7-417e-870f-1c617026e310 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:38.214064 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82800bf-69a7-417e-870f-1c617026e310 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:38.214321 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82800bf-69a7-417e-870f-1c617026e310 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:38.216028 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 696/1358] 10.222.0.83 () {54 vars in 962 bytes} [Mon Aug 29 15:28:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:28:38.225644 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d94397-21ad-4ec5-a89e-0f046f51eb1e None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:38.225927 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d94397-21ad-4ec5-a89e-0f046f51eb1e None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:38.226198 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d94397-21ad-4ec5-a89e-0f046f51eb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:38.317521 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a6d94397-21ad-4ec5-a89e-0f046f51eb1e None None] MFA Rules not processed for user `253947a5ef294d2bb828761873251bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:28:38.319121 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a6d94397-21ad-4ec5-a89e-0f046f51eb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:38.385314 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:38.470593 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 663/1359] 10.222.0.83 () {58 vars in 1059 bytes} [Mon Aug 29 15:28:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:28:38.477245 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82800bf-69a7-417e-870f-1c617026e310 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:38.478823 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e82800bf-69a7-417e-870f-1c617026e310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:38.637052 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82800bf-69a7-417e-870f-1c617026e310 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:38.719882 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:38.765724 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe664515-ef7d-4eed-81cf-67f9a25b0583 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:38.766234 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe664515-ef7d-4eed-81cf-67f9a25b0583 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:38.766507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe664515-ef7d-4eed-81cf-67f9a25b0583 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:38.766835 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe664515-ef7d-4eed-81cf-67f9a25b0583 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:38.769680 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-fe664515-ef7d-4eed-81cf-67f9a25b0583 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:38.865253 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe664515-ef7d-4eed-81cf-67f9a25b0583 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:38.866853 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe664515-ef7d-4eed-81cf-67f9a25b0583 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:38.887131 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 697/1360] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:28:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:28:41.028239 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f21cdf-dd3f-425c-be74-7b564529722d None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:41.028809 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f21cdf-dd3f-425c-be74-7b564529722d None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:41.028809 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f21cdf-dd3f-425c-be74-7b564529722d None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:41.030312 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 664/1361] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:28:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:28:41.037164 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07609b7e-b70f-4da4-8891-08791c677379 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:41.037946 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07609b7e-b70f-4da4-8891-08791c677379 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:41.038554 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07609b7e-b70f-4da4-8891-08791c677379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:41.115351 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-07609b7e-b70f-4da4-8891-08791c677379 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:28:41.116468 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-07609b7e-b70f-4da4-8891-08791c677379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:41.157078 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:41.226369 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 698/1362] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:28:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:28:41.525307 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f21cdf-dd3f-425c-be74-7b564529722d None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:41.526822 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a7f21cdf-dd3f-425c-be74-7b564529722d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:41.685282 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f21cdf-dd3f-425c-be74-7b564529722d None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:41.695631 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:41.814057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6a3b6-40ff-4d13-acba-c84e1d923168 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:41.814965 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6a3b6-40ff-4d13-acba-c84e1d923168 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:41.815698 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6a3b6-40ff-4d13-acba-c84e1d923168 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:41.816168 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6a3b6-40ff-4d13-acba-c84e1d923168 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:41.818052 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b5c6a3b6-40ff-4d13-acba-c84e1d923168 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:41.923539 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6a3b6-40ff-4d13-acba-c84e1d923168 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:41.926285 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6a3b6-40ff-4d13-acba-c84e1d923168 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:41.947299 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 665/1363] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:28:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:28:44.214950 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba1338-75a4-461f-bed7-c7d033b68c9e None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:44.215494 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba1338-75a4-461f-bed7-c7d033b68c9e None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:44.215595 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba1338-75a4-461f-bed7-c7d033b68c9e None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:44.217070 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 699/1364] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:28:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:28:44.222328 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621091b6-9e08-4a21-8252-a7971cbcad9a None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:44.222985 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621091b6-9e08-4a21-8252-a7971cbcad9a None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:44.223165 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621091b6-9e08-4a21-8252-a7971cbcad9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:44.244992 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:44.313368 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-621091b6-9e08-4a21-8252-a7971cbcad9a None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:28:44.314581 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-621091b6-9e08-4a21-8252-a7971cbcad9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:44.446774 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 666/1365] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:28:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:28:44.747054 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c207c-4f2c-4f25-bcde-16bb7afeb232 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:44.747539 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c207c-4f2c-4f25-bcde-16bb7afeb232 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:44.747820 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c207c-4f2c-4f25-bcde-16bb7afeb232 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:44.751062 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 700/1366] 10.222.0.83 () {54 vars in 962 bytes} [Mon Aug 29 15:28:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:28:44.756082 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f363aa1-bae6-4dd9-bd56-c3acf770094c None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:44.756579 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f363aa1-bae6-4dd9-bd56-c3acf770094c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:44.756951 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f363aa1-bae6-4dd9-bd56-c3acf770094c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:44.877089 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-2f363aa1-bae6-4dd9-bd56-c3acf770094c None None] MFA Rules not processed for user `253947a5ef294d2bb828761873251bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:28:44.878316 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2f363aa1-bae6-4dd9-bd56-c3acf770094c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:44.915011 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:45.002194 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 667/1367] 10.222.0.83 () {58 vars in 1059 bytes} [Mon Aug 29 15:28:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:28:45.010957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c207c-4f2c-4f25-bcde-16bb7afeb232 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:45.012750 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2c5c207c-4f2c-4f25-bcde-16bb7afeb232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:45.196990 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c207c-4f2c-4f25-bcde-16bb7afeb232 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:45.219629 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:45.346359 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d37ef8-266a-4827-bd30-9b6badadfc1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:45.347637 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d37ef8-266a-4827-bd30-9b6badadfc1b service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:45.347637 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d37ef8-266a-4827-bd30-9b6badadfc1b service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:45.348154 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d37ef8-266a-4827-bd30-9b6badadfc1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:45.350050 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-35d37ef8-266a-4827-bd30-9b6badadfc1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:45.449174 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d37ef8-266a-4827-bd30-9b6badadfc1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:45.451137 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d37ef8-266a-4827-bd30-9b6badadfc1b service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:45.471242 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 701/1368] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:28:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:28:47.633880 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54c1f5-d407-463e-b0a3-5e43ddcae62c None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:47.634353 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54c1f5-d407-463e-b0a3-5e43ddcae62c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:47.634674 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54c1f5-d407-463e-b0a3-5e43ddcae62c None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:47.636323 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 668/1369] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:28:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:28:47.643139 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7dd3ea-32a9-4bed-8321-8be06d126117 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:47.643548 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7dd3ea-32a9-4bed-8321-8be06d126117 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:47.643728 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7dd3ea-32a9-4bed-8321-8be06d126117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:47.734757 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:47.797724 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-fa7dd3ea-32a9-4bed-8321-8be06d126117 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:28:47.799485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-fa7dd3ea-32a9-4bed-8321-8be06d126117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:47.932992 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 702/1370] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:28:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:28:48.252874 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c54c1f5-d407-463e-b0a3-5e43ddcae62c None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:48.254917 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2c54c1f5-d407-463e-b0a3-5e43ddcae62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:48.436855 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:48.444461 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c54c1f5-d407-463e-b0a3-5e43ddcae62c None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:48.568580 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d357a83c-5028-4322-8a68-2ac00185ea0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:48.569206 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357a83c-5028-4322-8a68-2ac00185ea0c service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:48.569544 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357a83c-5028-4322-8a68-2ac00185ea0c service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:48.569825 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357a83c-5028-4322-8a68-2ac00185ea0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:48.571522 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d357a83c-5028-4322-8a68-2ac00185ea0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:48.670222 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d357a83c-5028-4322-8a68-2ac00185ea0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:48.671936 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d357a83c-5028-4322-8a68-2ac00185ea0c service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:48.688980 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:48.694650 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 669/1371] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:28:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:28:49.726857 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6c3dc-55e2-4491-9429-626e65862266 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:49.727343 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6c3dc-55e2-4491-9429-626e65862266 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:49.727556 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6c3dc-55e2-4491-9429-626e65862266 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:49.732702 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 703/1372] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:28:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:28:49.734074 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b42ec-9a82-40d7-8f17-7c415bb6a853 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:49.734472 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b42ec-9a82-40d7-8f17-7c415bb6a853 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:49.734717 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b42ec-9a82-40d7-8f17-7c415bb6a853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:49.865000 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-b17b42ec-9a82-40d7-8f17-7c415bb6a853 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:28:49.866831 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b17b42ec-9a82-40d7-8f17-7c415bb6a853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:49.982595 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 670/1373] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:28:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:28:50.557892 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5670227-a34e-4559-b57b-e12195080aa5 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:50.558228 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5670227-a34e-4559-b57b-e12195080aa5 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:50.558455 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5670227-a34e-4559-b57b-e12195080aa5 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:50.560063 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 704/1374] 10.222.0.83 () {54 vars in 964 bytes} [Mon Aug 29 15:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:28:50.565700 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cfc73c-8cc3-4fed-9845-1901a5f74895 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:50.565987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cfc73c-8cc3-4fed-9845-1901a5f74895 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:50.566262 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cfc73c-8cc3-4fed-9845-1901a5f74895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:50.649762 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-b9cfc73c-8cc3-4fed-9845-1901a5f74895 None None] MFA Rules not processed for user `fd42634b2795427cba6614c53491ded2`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:28:50.650982 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b9cfc73c-8cc3-4fed-9845-1901a5f74895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:50.676006 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:50.763799 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 671/1375] 10.222.0.83 () {58 vars in 1061 bytes} [Mon Aug 29 15:28:50 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:28:50.772297 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5670227-a34e-4559-b57b-e12195080aa5 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:50.773832 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f5670227-a34e-4559-b57b-e12195080aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:50.874272 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945c851-64db-430e-89d7-05618f52ed75 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:50.874649 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945c851-64db-430e-89d7-05618f52ed75 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:50.874830 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945c851-64db-430e-89d7-05618f52ed75 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:50.876347 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 672/1376] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:28:50.882046 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1783fe8-bea9-4878-b427-c103eb2f38b6 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:50.882330 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1783fe8-bea9-4878-b427-c103eb2f38b6 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:50.882610 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1783fe8-bea9-4878-b427-c103eb2f38b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:50.905162 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5670227-a34e-4559-b57b-e12195080aa5 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:50.908874 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:50.965314 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a1783fe8-bea9-4878-b427-c103eb2f38b6 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:28:50.966540 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a1783fe8-bea9-4878-b427-c103eb2f38b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:50.991396 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5369f30-f8fb-4fd7-8477-1884ab0f00b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:50.992005 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5369f30-f8fb-4fd7-8477-1884ab0f00b0 service cinder] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:50.992365 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5369f30-f8fb-4fd7-8477-1884ab0f00b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:50.992553 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5369f30-f8fb-4fd7-8477-1884ab0f00b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:50.994148 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f5369f30-f8fb-4fd7-8477-1884ab0f00b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:51.076747 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 673/1377] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:28:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:28:51.119330 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5369f30-f8fb-4fd7-8477-1884ab0f00b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:51.121074 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5369f30-f8fb-4fd7-8477-1884ab0f00b0 service cinder] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:51.140387 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 705/1378] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:28:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:28:51.369702 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1783fe8-bea9-4878-b427-c103eb2f38b6 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:51.370900 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a1783fe8-bea9-4878-b427-c103eb2f38b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:51.401044 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:51.496086 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1783fe8-bea9-4878-b427-c103eb2f38b6 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:51.624962 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d5296c-aa52-474d-bdc1-24b37a3905b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:51.625575 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5296c-aa52-474d-bdc1-24b37a3905b3 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:51.625887 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5296c-aa52-474d-bdc1-24b37a3905b3 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:51.626159 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5296c-aa52-474d-bdc1-24b37a3905b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:51.628104 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-37d5296c-aa52-474d-bdc1-24b37a3905b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:51.660606 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:51.764925 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d5296c-aa52-474d-bdc1-24b37a3905b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:51.767334 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d5296c-aa52-474d-bdc1-24b37a3905b3 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:51.791091 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 674/1379] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:28:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:28:53.870257 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902ff46-33c7-4af4-ad9a-8d5c1080d728 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:53.870759 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902ff46-33c7-4af4-ad9a-8d5c1080d728 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:53.870870 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902ff46-33c7-4af4-ad9a-8d5c1080d728 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:53.872333 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 706/1380] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:28:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:28:53.877483 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc6c0b-39aa-4bb7-a7d4-c881d4c68cbd None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:53.877932 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc6c0b-39aa-4bb7-a7d4-c881d4c68cbd None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:53.878054 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc6c0b-39aa-4bb7-a7d4-c881d4c68cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:53.951522 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-94fc6c0b-39aa-4bb7-a7d4-c881d4c68cbd None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:28:53.952996 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-94fc6c0b-39aa-4bb7-a7d4-c881d4c68cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:54.097276 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:54.101568 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 675/1381] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:28:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:28:54.408140 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902ff46-33c7-4af4-ad9a-8d5c1080d728 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:54.410064 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9902ff46-33c7-4af4-ad9a-8d5c1080d728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:54.478658 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:54.611630 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902ff46-33c7-4af4-ad9a-8d5c1080d728 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:54.738867 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:54.752778 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d3e0d-f08e-4585-9d27-cb200fbb383d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:54.753870 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d3e0d-f08e-4585-9d27-cb200fbb383d service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:54.754212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d3e0d-f08e-4585-9d27-cb200fbb383d service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:54.754550 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d3e0d-f08e-4585-9d27-cb200fbb383d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:54.756571 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9b5d3e0d-f08e-4585-9d27-cb200fbb383d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:54.896652 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d3e0d-f08e-4585-9d27-cb200fbb383d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:54.898664 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d3e0d-f08e-4585-9d27-cb200fbb383d service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:54.920029 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 707/1382] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:28:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:28:57.027151 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497f755-0d27-43a0-b030-1823c3f66202 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:57.028118 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497f755-0d27-43a0-b030-1823c3f66202 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:57.028620 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497f755-0d27-43a0-b030-1823c3f66202 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:57.030510 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 676/1383] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:28:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:28:57.035587 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62385c78-685a-4a9a-93a7-c6bbf4136399 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:57.036037 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62385c78-685a-4a9a-93a7-c6bbf4136399 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:57.036134 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62385c78-685a-4a9a-93a7-c6bbf4136399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:57.117813 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-62385c78-685a-4a9a-93a7-c6bbf4136399 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:28:57.119096 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-62385c78-685a-4a9a-93a7-c6bbf4136399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:57.197781 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:57.238929 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 708/1384] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:28:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:28:57.539740 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497f755-0d27-43a0-b030-1823c3f66202 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:57.541249 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7497f755-0d27-43a0-b030-1823c3f66202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:57.701987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497f755-0d27-43a0-b030-1823c3f66202 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:57.777143 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:57.823131 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29135a4-cf3d-4a4f-aa9c-5d7114e4dbbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:57.823741 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29135a4-cf3d-4a4f-aa9c-5d7114e4dbbf service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:57.824014 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29135a4-cf3d-4a4f-aa9c-5d7114e4dbbf service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:57.824277 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29135a4-cf3d-4a4f-aa9c-5d7114e4dbbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:57.825866 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a29135a4-cf3d-4a4f-aa9c-5d7114e4dbbf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:57.920908 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29135a4-cf3d-4a4f-aa9c-5d7114e4dbbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:57.922520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29135a4-cf3d-4a4f-aa9c-5d7114e4dbbf service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:57.946417 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 677/1385] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:28:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:28:59.910503 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6ffed-88b4-4200-a9f5-462b68a9a813 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:59.911199 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6ffed-88b4-4200-a9f5-462b68a9a813 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:59.911199 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6ffed-88b4-4200-a9f5-462b68a9a813 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:59.912409 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 709/1386] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:28:59.918134 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cce268-11d7-483e-a21b-d890c3fc0b8b None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:59.918600 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cce268-11d7-483e-a21b-d890c3fc0b8b None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:59.918847 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cce268-11d7-483e-a21b-d890c3fc0b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:59.996055 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-06cce268-11d7-483e-a21b-d890c3fc0b8b None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:28:59.997274 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-06cce268-11d7-483e-a21b-d890c3fc0b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:00.032987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:00.098743 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 678/1387] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:28:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:29:00.393259 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6ffed-88b4-4200-a9f5-462b68a9a813 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:29:00.394815 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b3d6ffed-88b4-4200-a9f5-462b68a9a813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:00.549552 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6ffed-88b4-4200-a9f5-462b68a9a813 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:29:00.607160 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:00.672610 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6ee08-29f5-45b8-ad21-2831ffde5773 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:29:00.673144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6ee08-29f5-45b8-ad21-2831ffde5773 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:00.673424 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6ee08-29f5-45b8-ad21-2831ffde5773 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:00.673690 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6ee08-29f5-45b8-ad21-2831ffde5773 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:00.675338 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4eb6ee08-29f5-45b8-ad21-2831ffde5773 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:00.779427 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb6ee08-29f5-45b8-ad21-2831ffde5773 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:29:00.781032 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb6ee08-29f5-45b8-ad21-2831ffde5773 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:29:00.800030 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 710/1388] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:29:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:29:02.760276 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e9638-6b4f-4227-8b93-b49bedd69b5b None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:02.760829 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e9638-6b4f-4227-8b93-b49bedd69b5b None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:02.760829 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e9638-6b4f-4227-8b93-b49bedd69b5b None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:02.762154 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 679/1389] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:29:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:29:02.767352 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3ebee-c888-46f6-bcd6-24af50853f95 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:02.767922 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3ebee-c888-46f6-bcd6-24af50853f95 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:02.767922 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3ebee-c888-46f6-bcd6-24af50853f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:02.844527 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-30d3ebee-c888-46f6-bcd6-24af50853f95 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:29:02.846074 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-30d3ebee-c888-46f6-bcd6-24af50853f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:02.858289 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:02.949567 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 711/1390] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:29:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:29:03.239161 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e9638-6b4f-4227-8b93-b49bedd69b5b None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:29:03.240866 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-439e9638-6b4f-4227-8b93-b49bedd69b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:03.395919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e9638-6b4f-4227-8b93-b49bedd69b5b None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:29:03.413852 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:03.539644 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125791f-244d-468a-84e7-952543949ec0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:29:03.540524 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125791f-244d-468a-84e7-952543949ec0 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:03.541150 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125791f-244d-468a-84e7-952543949ec0 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:03.541709 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125791f-244d-468a-84e7-952543949ec0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:03.543822 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4125791f-244d-468a-84e7-952543949ec0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:03.638508 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4125791f-244d-468a-84e7-952543949ec0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:29:03.640501 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4125791f-244d-468a-84e7-952543949ec0 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:29:03.668789 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 680/1391] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:29:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:29:05.678791 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593eed8-5506-4658-bbd5-d3ec78efedc3 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:05.679555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593eed8-5506-4658-bbd5-d3ec78efedc3 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:05.679673 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593eed8-5506-4658-bbd5-d3ec78efedc3 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:05.680966 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 712/1392] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:29:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:29:05.686261 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ee409-7715-4ed8-9420-b314c3c5f2d0 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:05.686740 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ee409-7715-4ed8-9420-b314c3c5f2d0 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:05.686850 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ee409-7715-4ed8-9420-b314c3c5f2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:05.716838 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:05.758717 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-d28ee409-7715-4ed8-9420-b314c3c5f2d0 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:29:05.759966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d28ee409-7715-4ed8-9420-b314c3c5f2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:05.860732 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 681/1393] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:29:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:29:06.159817 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593eed8-5506-4658-bbd5-d3ec78efedc3 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:29:06.161391 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5593eed8-5506-4658-bbd5-d3ec78efedc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:06.305813 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:06.313483 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593eed8-5506-4658-bbd5-d3ec78efedc3 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:29:06.430709 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa942f1-462a-4265-a6fc-9141e62c7a23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:29:06.431268 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa942f1-462a-4265-a6fc-9141e62c7a23 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:06.431554 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa942f1-462a-4265-a6fc-9141e62c7a23 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:06.431855 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa942f1-462a-4265-a6fc-9141e62c7a23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:06.433503 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4aa942f1-462a-4265-a6fc-9141e62c7a23 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:06.527920 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa942f1-462a-4265-a6fc-9141e62c7a23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:29:06.529844 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa942f1-462a-4265-a6fc-9141e62c7a23 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:29:06.546049 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:06.552030 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 713/1394] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:29:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:29:06.685186 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ddf97-8696-427f-b289-f4958d0685bd None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:06.685425 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ddf97-8696-427f-b289-f4958d0685bd None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:06.685637 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ddf97-8696-427f-b289-f4958d0685bd None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:06.687012 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 682/1395] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:29:06.692862 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba61d7c-9836-4ea4-9be0-06f348521533 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:06.693398 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba61d7c-9836-4ea4-9be0-06f348521533 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:06.693505 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba61d7c-9836-4ea4-9be0-06f348521533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:06.767941 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-9ba61d7c-9836-4ea4-9be0-06f348521533 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:29:06.769197 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9ba61d7c-9836-4ea4-9be0-06f348521533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:06.873774 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 714/1396] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:29:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:29:07.173426 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e815fce-34cd-4a01-8e9f-856c575c68da None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:07.173718 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e815fce-34cd-4a01-8e9f-856c575c68da None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:07.173994 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e815fce-34cd-4a01-8e9f-856c575c68da None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:07.175495 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 683/1397] 10.222.0.83 () {54 vars in 967 bytes} [Mon Aug 29 15:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:29:07.180776 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386452a-5b02-4bd5-b9ca-6dc8ea2954be None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:07.181066 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386452a-5b02-4bd5-b9ca-6dc8ea2954be None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:07.181345 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386452a-5b02-4bd5-b9ca-6dc8ea2954be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:07.262569 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-f386452a-5b02-4bd5-b9ca-6dc8ea2954be None None] MFA Rules not processed for user `e6b0f9835ed549cab91d684326be83fa`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:29:07.263819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f386452a-5b02-4bd5-b9ca-6dc8ea2954be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:07.281412 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:07.340338 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 715/1398] 10.222.0.83 () {58 vars in 1064 bytes} [Mon Aug 29 15:29:07 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:29:07.348118 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e815fce-34cd-4a01-8e9f-856c575c68da None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:29:07.349708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2e815fce-34cd-4a01-8e9f-856c575c68da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:07.456181 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e815fce-34cd-4a01-8e9f-856c575c68da None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:29:07.459085 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:07.532848 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f31c0e-958c-461d-8687-a7349c449956 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6b0f9835ed549cab91d684326be83fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:29:07.533458 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f31c0e-958c-461d-8687-a7349c449956 service glance] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:07.533736 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f31c0e-958c-461d-8687-a7349c449956 service glance] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:07.534005 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f31c0e-958c-461d-8687-a7349c449956 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:07.535631 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e6f31c0e-958c-461d-8687-a7349c449956 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:07.652531 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f31c0e-958c-461d-8687-a7349c449956 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:29:07.654038 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f31c0e-958c-461d-8687-a7349c449956 service glance] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:29:07.673286 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 684/1399] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:29:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:29:08.430036 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9481b-a7ce-4894-a35c-5c9fd9bc8084 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:08.430685 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9481b-a7ce-4894-a35c-5c9fd9bc8084 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:08.430685 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9481b-a7ce-4894-a35c-5c9fd9bc8084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:08.506334 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-c8e9481b-a7ce-4894-a35c-5c9fd9bc8084 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:29:08.508608 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c8e9481b-a7ce-4894-a35c-5c9fd9bc8084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:08.542623 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec464a97-2533-4987-bb34-713f78c9c108 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:08.543185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec464a97-2533-4987-bb34-713f78c9c108 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:08.543185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec464a97-2533-4987-bb34-713f78c9c108 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:08.544541 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 685/1400] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:29:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:29:08.549547 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7079f-5c9d-4c0d-9b2c-83b548bcda5c None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:08.549830 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7079f-5c9d-4c0d-9b2c-83b548bcda5c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:08.550101 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7079f-5c9d-4c0d-9b2c-83b548bcda5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:08.592967 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:08.604753 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 716/1401] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 15:29:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:29:08.620203 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-bac7079f-5c9d-4c0d-9b2c-83b548bcda5c None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:29:08.621445 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-bac7079f-5c9d-4c0d-9b2c-83b548bcda5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:08.650075 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a6919-3803-4d79-b10b-7d1327a0e021 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:08.650474 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a6919-3803-4d79-b10b-7d1327a0e021 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:08.650814 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a6919-3803-4d79-b10b-7d1327a0e021 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:08.652336 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 717/1402] 10.222.0.83 () {54 vars in 943 bytes} [Mon Aug 29 15:29:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:29:08.658770 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0f70e-0b68-4d62-9336-e5d8e0d0674b None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:08.659144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0f70e-0b68-4d62-9336-e5d8e0d0674b None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:08.659362 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0f70e-0b68-4d62-9336-e5d8e0d0674b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:08.701282 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:08.726787 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 686/1403] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:29:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:29:08.739709 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-7fb0f70e-0b68-4d62-9336-e5d8e0d0674b None None] MFA Rules not processed for user `b0f8e95d393f499baf44830f9fb7e583`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:29:08.740928 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7fb0f70e-0b68-4d62-9336-e5d8e0d0674b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:08.851539 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 718/1404] 10.222.0.83 () {58 vars in 1040 bytes} [Mon Aug 29 15:29:08 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:29:08.860953 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7079f-5c9d-4c0d-9b2c-83b548bcda5c None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:29:08.862270 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-bac7079f-5c9d-4c0d-9b2c-83b548bcda5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:08.966610 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7079f-5c9d-4c0d-9b2c-83b548bcda5c None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:29:08.980118 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:09.019731 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0f70e-0b68-4d62-9336-e5d8e0d0674b None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:29:09.020953 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7fb0f70e-0b68-4d62-9336-e5d8e0d0674b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:09.077368 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f24ca1-c979-46ad-826b-908147c23cac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:29:09.077979 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f24ca1-c979-46ad-826b-908147c23cac service swift] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:09.078256 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f24ca1-c979-46ad-826b-908147c23cac service swift] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:09.078528 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f24ca1-c979-46ad-826b-908147c23cac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:09.080199 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-31f24ca1-c979-46ad-826b-908147c23cac service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:09.121973 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:09.125732 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0f70e-0b68-4d62-9336-e5d8e0d0674b None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:29:09.167531 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f24ca1-c979-46ad-826b-908147c23cac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:29:09.169125 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f24ca1-c979-46ad-826b-908147c23cac service swift] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:29:09.177501 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 687/1405] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 15:29:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 15:29:09.251016 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f697a-8584-494b-a0a7-fb777124e831 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:29:09.251659 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f697a-8584-494b-a0a7-fb777124e831 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:09.251941 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f697a-8584-494b-a0a7-fb777124e831 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:09.252212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f697a-8584-494b-a0a7-fb777124e831 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:09.253837 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f77f697a-8584-494b-a0a7-fb777124e831 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:09.363784 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f697a-8584-494b-a0a7-fb777124e831 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:29:09.365924 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f697a-8584-494b-a0a7-fb777124e831 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:29:09.390431 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 719/1406] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:29:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:29:11.424004 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43da8b-348f-4ea6-a987-1bf37665b80e None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:11.424532 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43da8b-348f-4ea6-a987-1bf37665b80e None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:11.424873 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43da8b-348f-4ea6-a987-1bf37665b80e None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:11.426511 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 688/1407] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:29:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:29:11.432716 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a1db8-ced2-4c8a-8b9a-7cd5943dde93 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:11.433194 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a1db8-ced2-4c8a-8b9a-7cd5943dde93 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:11.433290 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a1db8-ced2-4c8a-8b9a-7cd5943dde93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:11.437914 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:11.511214 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-fc8a1db8-ced2-4c8a-8b9a-7cd5943dde93 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:29:11.513139 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-fc8a1db8-ced2-4c8a-8b9a-7cd5943dde93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:11.626854 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 720/1408] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:29:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:29:11.923987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43da8b-348f-4ea6-a987-1bf37665b80e None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:29:11.925494 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4d43da8b-348f-4ea6-a987-1bf37665b80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:11.975316 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:12.089912 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43da8b-348f-4ea6-a987-1bf37665b80e None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:29:12.219771 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7a895-42fd-4d1d-9888-257c8fd3ec6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:29:12.220579 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7a895-42fd-4d1d-9888-257c8fd3ec6e service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:12.220931 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7a895-42fd-4d1d-9888-257c8fd3ec6e service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:12.221266 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7a895-42fd-4d1d-9888-257c8fd3ec6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:12.222960 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e7d7a895-42fd-4d1d-9888-257c8fd3ec6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:12.226116 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:12.323775 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d7a895-42fd-4d1d-9888-257c8fd3ec6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:29:12.325823 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d7a895-42fd-4d1d-9888-257c8fd3ec6e service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:29:12.349126 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 689/1409] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:29:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:29:21.625000 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=64 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:22.346642 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=43 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:32.632405 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbf6b3-27a1-48aa-8d31-836dab4acec1 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:32.632963 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbf6b3-27a1-48aa-8d31-836dab4acec1 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:32.632963 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbf6b3-27a1-48aa-8d31-836dab4acec1 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:32.634450 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 721/1410] 10.222.0.83 () {54 vars in 918 bytes} [Mon Aug 29 15:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:29:32.640530 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7f05e-9d4c-4cec-95e3-0905de43d14f None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:32.641003 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7f05e-9d4c-4cec-95e3-0905de43d14f None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:32.641111 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7f05e-9d4c-4cec-95e3-0905de43d14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:32.716889 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-73d7f05e-9d4c-4cec-95e3-0905de43d14f None None] MFA Rules not processed for user `c190fa4a280c41c684130e069bee99eb`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:29:32.718146 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-73d7f05e-9d4c-4cec-95e3-0905de43d14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:32.827902 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 690/1411] 10.222.0.83 () {58 vars in 1015 bytes} [Mon Aug 29 15:29:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:29:32.842948 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d1f1a-3dd2-47d4-bd3b-899d728adc05 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:32.843266 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d1f1a-3dd2-47d4-bd3b-899d728adc05 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:32.843533 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d1f1a-3dd2-47d4-bd3b-899d728adc05 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:32.844851 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 722/1412] 10.222.0.83 () {54 vars in 918 bytes} [Mon Aug 29 15:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:29:32.849566 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c91e653-26c5-4006-bca4-99d6d98a7a9f None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:32.849882 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c91e653-26c5-4006-bca4-99d6d98a7a9f None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:32.850162 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c91e653-26c5-4006-bca4-99d6d98a7a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:32.923196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:32.926284 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-3c91e653-26c5-4006-bca4-99d6d98a7a9f None None] MFA Rules not processed for user `253947a5ef294d2bb828761873251bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:29:32.928029 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3c91e653-26c5-4006-bca4-99d6d98a7a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:33.044628 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 691/1413] 10.222.0.83 () {58 vars in 1015 bytes} [Mon Aug 29 15:29:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:29:35.461740 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00069c7-4cc2-4403-a97a-5430c0d7161d None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:35.462322 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00069c7-4cc2-4403-a97a-5430c0d7161d None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:35.462322 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00069c7-4cc2-4403-a97a-5430c0d7161d None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:35.463669 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 723/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 15:29:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:29:35.469534 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57919d7-8258-48d6-96e4-b87b857f42d5 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:35.470006 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57919d7-8258-48d6-96e4-b87b857f42d5 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:35.470116 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57919d7-8258-48d6-96e4-b87b857f42d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:35.538963 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-f57919d7-8258-48d6-96e4-b87b857f42d5 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:29:35.540191 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f57919d7-8258-48d6-96e4-b87b857f42d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:35.596016 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:35.639654 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 692/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 15:29:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:29:35.928696 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00069c7-4cc2-4403-a97a-5430c0d7161d None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:29:35.930361 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c00069c7-4cc2-4403-a97a-5430c0d7161d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:36.076796 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00069c7-4cc2-4403-a97a-5430c0d7161d None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:29:36.149785 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:36.190065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104993b5-8945-4c81-b0e7-a852f08df685 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:29:36.190674 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104993b5-8945-4c81-b0e7-a852f08df685 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:36.190956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104993b5-8945-4c81-b0e7-a852f08df685 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:36.191260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104993b5-8945-4c81-b0e7-a852f08df685 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:36.192881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-104993b5-8945-4c81-b0e7-a852f08df685 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:36.283491 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104993b5-8945-4c81-b0e7-a852f08df685 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:29:36.285097 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104993b5-8945-4c81-b0e7-a852f08df685 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:29:36.302893 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 724/1416] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:29:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:29:37.261989 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00494c1e-2359-4317-961e-a7a7bb44d8ff None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:37.262571 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00494c1e-2359-4317-961e-a7a7bb44d8ff None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:37.262571 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00494c1e-2359-4317-961e-a7a7bb44d8ff None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:37.263884 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 693/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 15:29:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:29:37.268979 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990a365-0c46-4104-b024-558ea1edd55f None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:37.269370 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990a365-0c46-4104-b024-558ea1edd55f None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:37.269529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990a365-0c46-4104-b024-558ea1edd55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:37.347981 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-5990a365-0c46-4104-b024-558ea1edd55f None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:29:37.349203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5990a365-0c46-4104-b024-558ea1edd55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:37.376732 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:37.446339 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 725/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 15:29:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:29:37.618874 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00494c1e-2359-4317-961e-a7a7bb44d8ff None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:29:37.620448 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-00494c1e-2359-4317-961e-a7a7bb44d8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:37.768668 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00494c1e-2359-4317-961e-a7a7bb44d8ff None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:29:37.810245 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:37.888945 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56557a32-85d9-4429-808e-5205349ae76c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:29:37.889546 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56557a32-85d9-4429-808e-5205349ae76c service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:37.889820 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56557a32-85d9-4429-808e-5205349ae76c service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:37.890101 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56557a32-85d9-4429-808e-5205349ae76c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:37.891723 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-56557a32-85d9-4429-808e-5205349ae76c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:37.982054 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56557a32-85d9-4429-808e-5205349ae76c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:29:37.983624 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56557a32-85d9-4429-808e-5205349ae76c service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:29:38.001246 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 694/1419] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:29:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:29:38.907536 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e2888-53ba-4e16-9cc3-fb7cb62f5866 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:38.908110 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e2888-53ba-4e16-9cc3-fb7cb62f5866 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:38.908110 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e2888-53ba-4e16-9cc3-fb7cb62f5866 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:38.909439 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 726/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 15:29:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:29:38.914629 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe016a-b305-4fc2-a76d-873283918b3f None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:38.915097 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe016a-b305-4fc2-a76d-873283918b3f None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:38.915220 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe016a-b305-4fc2-a76d-873283918b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:38.970458 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:38.991741 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-7cfe016a-b305-4fc2-a76d-873283918b3f None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:29:38.992936 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7cfe016a-b305-4fc2-a76d-873283918b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:39.089976 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 695/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 15:29:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:29:39.242838 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e2888-53ba-4e16-9cc3-fb7cb62f5866 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:29:39.244404 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-641e2888-53ba-4e16-9cc3-fb7cb62f5866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:39.388737 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e2888-53ba-4e16-9cc3-fb7cb62f5866 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:29:39.400910 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:39.504466 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60deb752-78c1-4c62-b506-421be9c5f889 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:29:39.504980 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60deb752-78c1-4c62-b506-421be9c5f889 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:39.505256 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60deb752-78c1-4c62-b506-421be9c5f889 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:39.505555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60deb752-78c1-4c62-b506-421be9c5f889 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:39.507229 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-60deb752-78c1-4c62-b506-421be9c5f889 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:39.598879 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60deb752-78c1-4c62-b506-421be9c5f889 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:29:39.600532 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60deb752-78c1-4c62-b506-421be9c5f889 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:29:39.618793 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 727/1422] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:29:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:29:40.488535 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480394b-c1a4-4f6a-914f-3d714c2eb021 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:40.489095 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480394b-c1a4-4f6a-914f-3d714c2eb021 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:40.489095 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480394b-c1a4-4f6a-914f-3d714c2eb021 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:40.490432 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 696/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 15:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:29:40.495227 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6778681-22ec-4d63-9748-6dbeed002fd6 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:40.495672 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6778681-22ec-4d63-9748-6dbeed002fd6 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:40.495770 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6778681-22ec-4d63-9748-6dbeed002fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:40.515484 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:40.573509 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-c6778681-22ec-4d63-9748-6dbeed002fd6 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:29:40.575365 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c6778681-22ec-4d63-9748-6dbeed002fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:40.673266 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 728/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 15:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:29:40.824003 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480394b-c1a4-4f6a-914f-3d714c2eb021 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:29:40.825457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5480394b-c1a4-4f6a-914f-3d714c2eb021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:40.936200 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:40.974415 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480394b-c1a4-4f6a-914f-3d714c2eb021 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:29:41.087413 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb66f556-05e0-49d8-b125-b9e1c31f3bca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:29:41.087943 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66f556-05e0-49d8-b125-b9e1c31f3bca service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:41.088224 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66f556-05e0-49d8-b125-b9e1c31f3bca service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:41.088498 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66f556-05e0-49d8-b125-b9e1c31f3bca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:41.090642 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-fb66f556-05e0-49d8-b125-b9e1c31f3bca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:41.165684 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:41.180650 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb66f556-05e0-49d8-b125-b9e1c31f3bca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:29:41.182269 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb66f556-05e0-49d8-b125-b9e1c31f3bca service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:29:41.200086 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 697/1425] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:29:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:29:42.071276 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5fe295-2cfa-4ae6-9bb7-a366fcdb4330 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:42.071807 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5fe295-2cfa-4ae6-9bb7-a366fcdb4330 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:42.071807 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5fe295-2cfa-4ae6-9bb7-a366fcdb4330 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:42.073078 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 729/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 15:29:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:29:42.079172 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2e568-d071-4ed7-83ca-b77c1d0b315a None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:42.079583 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2e568-d071-4ed7-83ca-b77c1d0b315a None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:42.079727 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2e568-d071-4ed7-83ca-b77c1d0b315a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:42.156283 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-03c2e568-d071-4ed7-83ca-b77c1d0b315a None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:29:42.157477 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-03c2e568-d071-4ed7-83ca-b77c1d0b315a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:42.253343 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 698/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 15:29:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:29:42.417460 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5fe295-2cfa-4ae6-9bb7-a366fcdb4330 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:29:42.419532 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-bf5fe295-2cfa-4ae6-9bb7-a366fcdb4330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:42.504235 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:42.566786 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5fe295-2cfa-4ae6-9bb7-a366fcdb4330 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:29:42.682210 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6ad906-f030-486a-8e81-4fec8a9b0cd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:29:42.682819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ad906-f030-486a-8e81-4fec8a9b0cd3 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:42.683137 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ad906-f030-486a-8e81-4fec8a9b0cd3 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:42.683406 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ad906-f030-486a-8e81-4fec8a9b0cd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:42.685673 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4d6ad906-f030-486a-8e81-4fec8a9b0cd3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:42.738963 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:42.780829 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6ad906-f030-486a-8e81-4fec8a9b0cd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:29:42.782423 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6ad906-f030-486a-8e81-4fec8a9b0cd3 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:29:42.801175 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 730/1428] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:29:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:29:43.607556 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87abf6-4298-4daa-b871-49d0a5345942 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:43.608151 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87abf6-4298-4daa-b871-49d0a5345942 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:43.608151 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87abf6-4298-4daa-b871-49d0a5345942 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:43.609433 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 699/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 15:29:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:29:43.614447 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3a696-cbca-4309-9bfc-a3610884255c None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:43.614895 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3a696-cbca-4309-9bfc-a3610884255c None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:43.615010 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3a696-cbca-4309-9bfc-a3610884255c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:43.695161 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-4ab3a696-cbca-4309-9bfc-a3610884255c None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:29:43.696377 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4ab3a696-cbca-4309-9bfc-a3610884255c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:43.797827 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 731/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 15:29:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:29:43.951953 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff87abf6-4298-4daa-b871-49d0a5345942 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:29:43.953479 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ff87abf6-4298-4daa-b871-49d0a5345942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:44.003710 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:44.105319 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff87abf6-4298-4daa-b871-49d0a5345942 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:29:44.217903 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13179053-dbec-43b2-87a9-52f63ab3a33c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:29:44.218419 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13179053-dbec-43b2-87a9-52f63ab3a33c service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:44.218696 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13179053-dbec-43b2-87a9-52f63ab3a33c service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:44.218964 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13179053-dbec-43b2-87a9-52f63ab3a33c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:44.220636 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-13179053-dbec-43b2-87a9-52f63ab3a33c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:44.227634 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:44.311328 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13179053-dbec-43b2-87a9-52f63ab3a33c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:29:44.312929 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13179053-dbec-43b2-87a9-52f63ab3a33c service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:29:44.332088 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 700/1431] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:29:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:29:45.136459 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880635fe-f91f-4eb3-bf28-b474a686553e None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:45.137060 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880635fe-f91f-4eb3-bf28-b474a686553e None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:45.137060 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880635fe-f91f-4eb3-bf28-b474a686553e None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:45.138376 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 732/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 15:29:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:29:45.143426 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417857e9-0945-4656-b086-db00acf638dc None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:45.143864 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417857e9-0945-4656-b086-db00acf638dc None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:45.143987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417857e9-0945-4656-b086-db00acf638dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:45.219387 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-417857e9-0945-4656-b086-db00acf638dc None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:29:45.220587 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-417857e9-0945-4656-b086-db00acf638dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:45.287240 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:45.317550 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 701/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 15:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:29:45.466280 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880635fe-f91f-4eb3-bf28-b474a686553e None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:29:45.467881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-880635fe-f91f-4eb3-bf28-b474a686553e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:45.486011 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:45.614717 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880635fe-f91f-4eb3-bf28-b474a686553e None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:29:45.701232 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:45.728766 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdedc07d-6166-486e-b47b-d3f542617505 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:29:45.729952 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedc07d-6166-486e-b47b-d3f542617505 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:45.730238 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedc07d-6166-486e-b47b-d3f542617505 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:45.730509 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedc07d-6166-486e-b47b-d3f542617505 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:45.732164 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-bdedc07d-6166-486e-b47b-d3f542617505 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:45.822499 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdedc07d-6166-486e-b47b-d3f542617505 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:29:45.825094 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdedc07d-6166-486e-b47b-d3f542617505 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:29:45.843584 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 733/1434] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:29:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:29:46.639857 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216748d-f3eb-4005-a0f0-d7470be91168 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:46.640473 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216748d-f3eb-4005-a0f0-d7470be91168 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:46.640473 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216748d-f3eb-4005-a0f0-d7470be91168 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:46.641797 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 702/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 15:29:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:29:46.646635 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce15071-bd13-4f0f-bda5-9c9af029ac3d None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:46.647064 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce15071-bd13-4f0f-bda5-9c9af029ac3d None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:46.647183 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce15071-bd13-4f0f-bda5-9c9af029ac3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:46.723551 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-cce15071-bd13-4f0f-bda5-9c9af029ac3d None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:29:46.724769 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-cce15071-bd13-4f0f-bda5-9c9af029ac3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:46.770110 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:46.825733 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 734/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 15:29:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:29:46.975883 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216748d-f3eb-4005-a0f0-d7470be91168 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:29:46.977409 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e216748d-f3eb-4005-a0f0-d7470be91168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:47.126052 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216748d-f3eb-4005-a0f0-d7470be91168 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:29:47.180044 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:47.240362 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1820911-56da-4fe3-ad54-1a3f58793305 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:29:47.240973 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1820911-56da-4fe3-ad54-1a3f58793305 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:47.241252 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1820911-56da-4fe3-ad54-1a3f58793305 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:47.241524 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1820911-56da-4fe3-ad54-1a3f58793305 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:47.243153 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a1820911-56da-4fe3-ad54-1a3f58793305 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:47.333007 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1820911-56da-4fe3-ad54-1a3f58793305 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:29:47.334617 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1820911-56da-4fe3-ad54-1a3f58793305 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:29:47.353266 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 703/1437] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:29:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:29:48.160103 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a94f4-021a-41dd-91e2-7dccf61fe22b None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:48.160693 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a94f4-021a-41dd-91e2-7dccf61fe22b None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:48.160693 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a94f4-021a-41dd-91e2-7dccf61fe22b None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:48.161922 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 735/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 15:29:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:29:48.167447 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52835f7e-0dcc-411b-81d0-9919010d33a4 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:48.167865 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52835f7e-0dcc-411b-81d0-9919010d33a4 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:48.167987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52835f7e-0dcc-411b-81d0-9919010d33a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:48.246459 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-52835f7e-0dcc-411b-81d0-9919010d33a4 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:29:48.247695 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-52835f7e-0dcc-411b-81d0-9919010d33a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:48.249707 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:48.349151 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 704/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 15:29:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:29:48.500809 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a94f4-021a-41dd-91e2-7dccf61fe22b None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:29:48.502329 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-001a94f4-021a-41dd-91e2-7dccf61fe22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:48.648781 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a94f4-021a-41dd-91e2-7dccf61fe22b None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:29:48.675482 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:48.764108 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada9e89-affb-4de0-a51c-0c4435d5c437 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:29:48.764636 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada9e89-affb-4de0-a51c-0c4435d5c437 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:48.764913 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada9e89-affb-4de0-a51c-0c4435d5c437 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:48.765185 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada9e89-affb-4de0-a51c-0c4435d5c437 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:48.766791 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-eada9e89-affb-4de0-a51c-0c4435d5c437 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:48.858337 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada9e89-affb-4de0-a51c-0c4435d5c437 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:29:48.859957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada9e89-affb-4de0-a51c-0c4435d5c437 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:29:48.878035 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 736/1440] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:29:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:29:50.703402 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3faf6-bc8d-4d74-9914-71c721cd48de None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:50.703857 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3faf6-bc8d-4d74-9914-71c721cd48de None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:50.703970 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3faf6-bc8d-4d74-9914-71c721cd48de None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:50.705286 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 705/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 15:29:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:29:50.711665 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815d7b6-c2d1-484c-916c-1cd0a62aafef None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:50.712072 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815d7b6-c2d1-484c-916c-1cd0a62aafef None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:50.712213 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815d7b6-c2d1-484c-916c-1cd0a62aafef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:50.753855 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:50.779771 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-4815d7b6-c2d1-484c-916c-1cd0a62aafef None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:29:50.780972 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4815d7b6-c2d1-484c-916c-1cd0a62aafef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:50.877853 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 737/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 15:29:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:29:51.170978 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3faf6-bc8d-4d74-9914-71c721cd48de None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:29:51.172728 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2bf3faf6-bc8d-4d74-9914-71c721cd48de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:51.278032 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3faf6-bc8d-4d74-9914-71c721cd48de None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:29:51.309893 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:51.353129 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b9170-722e-4e79-9f88-281e931b73aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:29:51.353738 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b9170-722e-4e79-9f88-281e931b73aa service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:51.354017 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b9170-722e-4e79-9f88-281e931b73aa service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:51.354283 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b9170-722e-4e79-9f88-281e931b73aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:51.355914 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1a4b9170-722e-4e79-9f88-281e931b73aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:51.466943 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4b9170-722e-4e79-9f88-281e931b73aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:29:51.468477 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4b9170-722e-4e79-9f88-281e931b73aa service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:29:51.486249 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 706/1443] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:29:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:29:53.564827 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b6cd1-93d7-490a-bf9a-e6307f6f7130 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:53.565448 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b6cd1-93d7-490a-bf9a-e6307f6f7130 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:53.565448 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b6cd1-93d7-490a-bf9a-e6307f6f7130 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:53.567060 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 738/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 15:29:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:29:53.572401 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e8019-ba73-4509-9c84-ed553ec0f9e6 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:53.572876 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e8019-ba73-4509-9c84-ed553ec0f9e6 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:53.573016 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e8019-ba73-4509-9c84-ed553ec0f9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:53.638514 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-f49e8019-ba73-4509-9c84-ed553ec0f9e6 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:29:53.639743 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f49e8019-ba73-4509-9c84-ed553ec0f9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:53.653827 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:53.743395 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 707/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 15:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:29:54.031676 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b6cd1-93d7-490a-bf9a-e6307f6f7130 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:29:54.033223 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b50b6cd1-93d7-490a-bf9a-e6307f6f7130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:54.141622 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b6cd1-93d7-490a-bf9a-e6307f6f7130 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:29:54.154988 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:54.216646 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772ba15-f6df-4588-beae-1594626cbf20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:29:54.217254 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772ba15-f6df-4588-beae-1594626cbf20 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:54.217536 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772ba15-f6df-4588-beae-1594626cbf20 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:54.217804 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772ba15-f6df-4588-beae-1594626cbf20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:54.219427 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2772ba15-f6df-4588-beae-1594626cbf20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:54.327308 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2772ba15-f6df-4588-beae-1594626cbf20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:29:54.328692 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2772ba15-f6df-4588-beae-1594626cbf20 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:29:54.347587 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 739/1446] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:29:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:29:56.568455 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb964a-76f7-4d18-870d-3508f1b2cbe5 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:56.568939 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb964a-76f7-4d18-870d-3508f1b2cbe5 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:56.569044 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb964a-76f7-4d18-870d-3508f1b2cbe5 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:56.570360 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 708/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 15:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:29:56.575811 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4a686-8770-4d07-a89f-661e04ef7cc0 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:56.576218 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4a686-8770-4d07-a89f-661e04ef7cc0 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:56.576358 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4a686-8770-4d07-a89f-661e04ef7cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:56.627635 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:56.646061 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-7da4a686-8770-4d07-a89f-661e04ef7cc0 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:29:56.647315 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7da4a686-8770-4d07-a89f-661e04ef7cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:56.745735 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 740/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 15:29:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:29:57.027171 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb964a-76f7-4d18-870d-3508f1b2cbe5 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:29:57.028718 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3ffb964a-76f7-4d18-870d-3508f1b2cbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:57.137379 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb964a-76f7-4d18-870d-3508f1b2cbe5 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:29:57.177555 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:57.212429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac22ca-21ab-4bba-8efd-4c6d0fcce588 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:29:57.213032 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac22ca-21ab-4bba-8efd-4c6d0fcce588 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:57.213306 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac22ca-21ab-4bba-8efd-4c6d0fcce588 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:57.213571 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac22ca-21ab-4bba-8efd-4c6d0fcce588 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:57.215203 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f3ac22ca-21ab-4bba-8efd-4c6d0fcce588 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:57.324728 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ac22ca-21ab-4bba-8efd-4c6d0fcce588 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:29:57.326104 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ac22ca-21ab-4bba-8efd-4c6d0fcce588 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:29:57.345139 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 709/1449] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:29:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:29:59.484416 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43500f5f-1f09-4626-a9a1-5e7140eec26b None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:59.485003 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43500f5f-1f09-4626-a9a1-5e7140eec26b None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:59.485003 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43500f5f-1f09-4626-a9a1-5e7140eec26b None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:59.486287 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 741/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 15:29:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:29:59.491552 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470dfa3-682d-4d1e-ac8b-772f443c2cbd None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:59.492125 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470dfa3-682d-4d1e-ac8b-772f443c2cbd None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:59.492407 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470dfa3-682d-4d1e-ac8b-772f443c2cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:59.567050 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-7470dfa3-682d-4d1e-ac8b-772f443c2cbd None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:29:59.568442 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7470dfa3-682d-4d1e-ac8b-772f443c2cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:59.597635 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:59.676597 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 710/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 15:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:29:59.965176 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43500f5f-1f09-4626-a9a1-5e7140eec26b None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:29:59.967456 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-43500f5f-1f09-4626-a9a1-5e7140eec26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:00.084381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43500f5f-1f09-4626-a9a1-5e7140eec26b None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:30:00.105267 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:00.162948 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75b77c-2b8e-4cbe-8eca-27936ae53f34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:30:00.163590 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75b77c-2b8e-4cbe-8eca-27936ae53f34 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:00.163867 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75b77c-2b8e-4cbe-8eca-27936ae53f34 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:00.164140 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75b77c-2b8e-4cbe-8eca-27936ae53f34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:00.165736 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ec75b77c-2b8e-4cbe-8eca-27936ae53f34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:00.274032 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75b77c-2b8e-4cbe-8eca-27936ae53f34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:30:00.275425 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75b77c-2b8e-4cbe-8eca-27936ae53f34 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:30:00.293366 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 742/1452] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:29:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:30:02.314816 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b22dd-3d7a-4610-b2e8-3687c853b564 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:02.315412 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b22dd-3d7a-4610-b2e8-3687c853b564 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:02.315412 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b22dd-3d7a-4610-b2e8-3687c853b564 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:02.316735 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 711/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 15:30:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:30:02.321849 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e718fac-c62e-42b9-841a-75f679a3742c None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:02.322259 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e718fac-c62e-42b9-841a-75f679a3742c None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:02.322400 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e718fac-c62e-42b9-841a-75f679a3742c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:02.386132 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:02.389072 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-7e718fac-c62e-42b9-841a-75f679a3742c None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:30:02.390901 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7e718fac-c62e-42b9-841a-75f679a3742c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:02.487508 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 743/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 15:30:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:30:02.770361 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b22dd-3d7a-4610-b2e8-3687c853b564 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:30:02.771931 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1a0b22dd-3d7a-4610-b2e8-3687c853b564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:02.876668 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b22dd-3d7a-4610-b2e8-3687c853b564 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:30:02.924579 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:02.950348 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c9252-3e7f-44d2-befa-924a8e9fffc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:30:02.950951 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c9252-3e7f-44d2-befa-924a8e9fffc4 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:02.951261 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c9252-3e7f-44d2-befa-924a8e9fffc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:02.951533 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c9252-3e7f-44d2-befa-924a8e9fffc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:02.953132 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-008c9252-3e7f-44d2-befa-924a8e9fffc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:03.063842 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c9252-3e7f-44d2-befa-924a8e9fffc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:30:03.065293 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c9252-3e7f-44d2-befa-924a8e9fffc4 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:30:03.084278 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 712/1455] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:30:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:30:05.118510 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaca9cb-ff50-430f-83c6-d12bb9bac737 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:05.120255 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaca9cb-ff50-430f-83c6-d12bb9bac737 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:05.120255 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaca9cb-ff50-430f-83c6-d12bb9bac737 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:05.120838 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 744/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 15:30:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:30:05.126482 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f9469-3512-42f7-a3b2-9b58229d5908 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:05.126889 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f9469-3512-42f7-a3b2-9b58229d5908 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:05.127058 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f9469-3512-42f7-a3b2-9b58229d5908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:05.193861 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-4c2f9469-3512-42f7-a3b2-9b58229d5908 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:30:05.195113 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4c2f9469-3512-42f7-a3b2-9b58229d5908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:05.224507 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:05.292392 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 713/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 15:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:30:05.579515 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaca9cb-ff50-430f-83c6-d12bb9bac737 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:30:05.581046 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3eaca9cb-ff50-430f-83c6-d12bb9bac737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:05.687157 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaca9cb-ff50-430f-83c6-d12bb9bac737 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:30:05.716615 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:05.764982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a0bb6-c89e-4090-af1c-436c4a3ea4c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:30:05.765590 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a0bb6-c89e-4090-af1c-436c4a3ea4c3 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:05.765864 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a0bb6-c89e-4090-af1c-436c4a3ea4c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:05.766157 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a0bb6-c89e-4090-af1c-436c4a3ea4c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:05.767800 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-795a0bb6-c89e-4090-af1c-436c4a3ea4c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:05.876322 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795a0bb6-c89e-4090-af1c-436c4a3ea4c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:30:05.877760 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795a0bb6-c89e-4090-af1c-436c4a3ea4c3 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:30:05.895991 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 745/1458] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:30:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:30:07.867444 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfd249-5e42-4cfb-9367-596ca6de0971 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:07.868048 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfd249-5e42-4cfb-9367-596ca6de0971 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:07.868048 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfd249-5e42-4cfb-9367-596ca6de0971 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:07.869326 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 714/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 15:30:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:30:07.874644 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80002ca3-8187-41d1-b639-6444934ade31 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:07.875141 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80002ca3-8187-41d1-b639-6444934ade31 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:07.875250 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80002ca3-8187-41d1-b639-6444934ade31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:07.941655 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-80002ca3-8187-41d1-b639-6444934ade31 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:30:07.942854 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-80002ca3-8187-41d1-b639-6444934ade31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:07.951979 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:08.041321 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 746/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 15:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:30:08.322960 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbfd249-5e42-4cfb-9367-596ca6de0971 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:30:08.324586 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7cbfd249-5e42-4cfb-9367-596ca6de0971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:08.428549 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbfd249-5e42-4cfb-9367-596ca6de0971 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:30:08.484116 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:08.502275 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c156761-fcd1-4c6d-8945-b5c0341f286c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:30:08.502904 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c156761-fcd1-4c6d-8945-b5c0341f286c service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:08.503218 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c156761-fcd1-4c6d-8945-b5c0341f286c service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:08.503487 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c156761-fcd1-4c6d-8945-b5c0341f286c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:08.505068 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4c156761-fcd1-4c6d-8945-b5c0341f286c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:08.615262 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c156761-fcd1-4c6d-8945-b5c0341f286c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:30:08.616700 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c156761-fcd1-4c6d-8945-b5c0341f286c service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:30:08.634502 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 715/1461] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:30:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:30:10.587591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507eb6c-e3aa-4d1b-8068-8802e37b7727 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:10.588070 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507eb6c-e3aa-4d1b-8068-8802e37b7727 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:10.588185 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507eb6c-e3aa-4d1b-8068-8802e37b7727 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:10.589479 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 747/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 15:30:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:30:10.594753 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef2118-3870-4971-89fd-894852bf8f37 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:10.595220 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef2118-3870-4971-89fd-894852bf8f37 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:10.595328 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef2118-3870-4971-89fd-894852bf8f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:10.664339 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-6bef2118-3870-4971-89fd-894852bf8f37 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:30:10.665538 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6bef2118-3870-4971-89fd-894852bf8f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:10.703919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:10.764694 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 716/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 15:30:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:30:11.060261 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2507eb6c-e3aa-4d1b-8068-8802e37b7727 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:30:11.061794 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2507eb6c-e3aa-4d1b-8068-8802e37b7727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:11.166939 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2507eb6c-e3aa-4d1b-8068-8802e37b7727 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:30:11.205153 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:11.241875 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f28211-aa57-4d83-8de8-a034254f1ca6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:30:11.242475 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f28211-aa57-4d83-8de8-a034254f1ca6 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:11.242750 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f28211-aa57-4d83-8de8-a034254f1ca6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:11.243016 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f28211-aa57-4d83-8de8-a034254f1ca6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:11.244636 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-21f28211-aa57-4d83-8de8-a034254f1ca6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:11.378260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f28211-aa57-4d83-8de8-a034254f1ca6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:30:11.379687 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f28211-aa57-4d83-8de8-a034254f1ca6 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:30:11.399547 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 748/1464] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:30:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:30:13.430965 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe824ea3-79b8-4793-9154-a9ab3dbbfa46 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:13.431541 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe824ea3-79b8-4793-9154-a9ab3dbbfa46 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:13.431541 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe824ea3-79b8-4793-9154-a9ab3dbbfa46 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:13.432924 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 717/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 15:30:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:30:13.438380 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd2aba-1b2e-44dc-aa69-9b46a6d466ca None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:13.438797 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd2aba-1b2e-44dc-aa69-9b46a6d466ca None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:13.438929 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd2aba-1b2e-44dc-aa69-9b46a6d466ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:13.505734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-cebd2aba-1b2e-44dc-aa69-9b46a6d466ca None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:30:13.506944 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-cebd2aba-1b2e-44dc-aa69-9b46a6d466ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:13.525127 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:13.604575 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 749/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 15:30:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:30:13.890532 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe824ea3-79b8-4793-9154-a9ab3dbbfa46 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:30:13.892156 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-fe824ea3-79b8-4793-9154-a9ab3dbbfa46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:14.007708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe824ea3-79b8-4793-9154-a9ab3dbbfa46 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:30:14.079152 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:14.087251 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6774f0b4-60e2-42da-b867-3f3fbd4cfcfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:30:14.088082 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774f0b4-60e2-42da-b867-3f3fbd4cfcfc service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:14.088199 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774f0b4-60e2-42da-b867-3f3fbd4cfcfc service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:14.088409 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774f0b4-60e2-42da-b867-3f3fbd4cfcfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:14.090079 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6774f0b4-60e2-42da-b867-3f3fbd4cfcfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:14.209183 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6774f0b4-60e2-42da-b867-3f3fbd4cfcfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:30:14.210625 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6774f0b4-60e2-42da-b867-3f3fbd4cfcfc service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:30:14.229972 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 718/1467] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:30:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:30:16.158920 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a74911-5b66-4214-8eaa-67652c9a2621 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:16.159473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a74911-5b66-4214-8eaa-67652c9a2621 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:16.159473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a74911-5b66-4214-8eaa-67652c9a2621 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:16.160801 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 750/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 15:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:30:16.166216 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4380f-ee5b-474e-bde7-9b14e5946a1f None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:16.166610 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4380f-ee5b-474e-bde7-9b14e5946a1f None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:16.166756 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4380f-ee5b-474e-bde7-9b14e5946a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:16.235459 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-1ba4380f-ee5b-474e-bde7-9b14e5946a1f None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:30:16.236650 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1ba4380f-ee5b-474e-bde7-9b14e5946a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:16.285430 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:16.336525 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 719/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 15:30:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:30:16.623240 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a74911-5b66-4214-8eaa-67652c9a2621 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:30:16.625681 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e4a74911-5b66-4214-8eaa-67652c9a2621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:16.731171 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a74911-5b66-4214-8eaa-67652c9a2621 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:30:16.779345 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:16.807457 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2805903-842f-4c24-87fb-d54f9afe9c2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:30:16.808067 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2805903-842f-4c24-87fb-d54f9afe9c2e service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:16.808341 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2805903-842f-4c24-87fb-d54f9afe9c2e service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:16.808609 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2805903-842f-4c24-87fb-d54f9afe9c2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:16.810201 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b2805903-842f-4c24-87fb-d54f9afe9c2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:16.919837 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2805903-842f-4c24-87fb-d54f9afe9c2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:30:16.921740 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2805903-842f-4c24-87fb-d54f9afe9c2e service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:30:16.940528 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 751/1470] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:30:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:30:26.334748 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=22 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:26.938288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=66 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:36.882248 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae37577-2498-4e2f-ac33-632272f1cd37 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:36.882786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae37577-2498-4e2f-ac33-632272f1cd37 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:36.882786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae37577-2498-4e2f-ac33-632272f1cd37 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:36.884107 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 720/1471] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:30:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:30:36.889336 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260cf017-e196-4da0-bcbb-7aaf2f0717eb None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:36.889785 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260cf017-e196-4da0-bcbb-7aaf2f0717eb None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:36.889902 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260cf017-e196-4da0-bcbb-7aaf2f0717eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:36.962254 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-260cf017-e196-4da0-bcbb-7aaf2f0717eb None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:30:36.963624 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-260cf017-e196-4da0-bcbb-7aaf2f0717eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:37.062642 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 752/1472] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:30:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:30:37.359316 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a0c2e-7ce3-4ada-9764-ab3417e89677 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:37.359597 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a0c2e-7ce3-4ada-9764-ab3417e89677 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:37.359869 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a0c2e-7ce3-4ada-9764-ab3417e89677 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:37.361194 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 721/1473] 10.222.0.83 () {54 vars in 967 bytes} [Mon Aug 29 15:30:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:30:37.366737 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9417deb-b0bd-4b95-bbb5-c1e74b234dd4 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:37.367043 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9417deb-b0bd-4b95-bbb5-c1e74b234dd4 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:37.367334 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9417deb-b0bd-4b95-bbb5-c1e74b234dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:37.446458 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-a9417deb-b0bd-4b95-bbb5-c1e74b234dd4 None None] MFA Rules not processed for user `e6b0f9835ed549cab91d684326be83fa`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:30:37.447703 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a9417deb-b0bd-4b95-bbb5-c1e74b234dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:37.469532 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:37.528987 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 753/1474] 10.222.0.83 () {58 vars in 1064 bytes} [Mon Aug 29 15:30:37 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:30:37.536890 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a0c2e-7ce3-4ada-9764-ab3417e89677 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:30:37.538667 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-111a0c2e-7ce3-4ada-9764-ab3417e89677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:37.641414 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a0c2e-7ce3-4ada-9764-ab3417e89677 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:30:37.715479 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ba1c6-9c63-416c-82d6-bda52a7dff0f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6b0f9835ed549cab91d684326be83fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:30:37.716089 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ba1c6-9c63-416c-82d6-bda52a7dff0f service glance] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:37.716369 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ba1c6-9c63-416c-82d6-bda52a7dff0f service glance] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:37.716641 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ba1c6-9c63-416c-82d6-bda52a7dff0f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:37.718239 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-038ba1c6-9c63-416c-82d6-bda52a7dff0f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:37.773070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:37.832517 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038ba1c6-9c63-416c-82d6-bda52a7dff0f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:30:37.833968 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038ba1c6-9c63-416c-82d6-bda52a7dff0f service glance] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:30:37.853361 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 722/1475] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:30:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:30:39.895579 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251a237-7c85-46f2-aed7-82afff926e89 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:39.896145 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251a237-7c85-46f2-aed7-82afff926e89 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:39.896145 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251a237-7c85-46f2-aed7-82afff926e89 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:39.897464 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 754/1476] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:30:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:30:39.902620 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ec2de-1511-4aec-97ed-fc77a62800c2 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:39.903088 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ec2de-1511-4aec-97ed-fc77a62800c2 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:39.903212 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ec2de-1511-4aec-97ed-fc77a62800c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:39.969119 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-4c6ec2de-1511-4aec-97ed-fc77a62800c2 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:30:39.970247 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4c6ec2de-1511-4aec-97ed-fc77a62800c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:40.072321 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 723/1477] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:30:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:30:40.347640 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d251a237-7c85-46f2-aed7-82afff926e89 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:30:40.349191 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d251a237-7c85-46f2-aed7-82afff926e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:40.478882 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d251a237-7c85-46f2-aed7-82afff926e89 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:30:40.528002 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:40.573912 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fccba3-271b-4c36-a9bc-db111f3904da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:30:40.574526 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fccba3-271b-4c36-a9bc-db111f3904da admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:40.574807 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fccba3-271b-4c36-a9bc-db111f3904da admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:40.575140 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fccba3-271b-4c36-a9bc-db111f3904da admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:40.575822 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fccba3-271b-4c36-a9bc-db111f3904da admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:30:40.577617 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-45fccba3-271b-4c36-a9bc-db111f3904da admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:30:40.577617 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 15:30:40.577617 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 15:30:40.578765 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fccba3-271b-4c36-a9bc-db111f3904da admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:30:40.597892 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 755/1478] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 15:30:40 2022] GET /identity/v3/projects => generated 2553 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:30:42.528618 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977be01-e968-421d-92a4-8a0a025a6222 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:42.529180 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977be01-e968-421d-92a4-8a0a025a6222 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:42.529180 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977be01-e968-421d-92a4-8a0a025a6222 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:42.530519 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 724/1479] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:30:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:30:42.536540 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3cf17-90c1-4597-93a3-b41935c00c19 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:42.536964 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3cf17-90c1-4597-93a3-b41935c00c19 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:42.537094 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3cf17-90c1-4597-93a3-b41935c00c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:42.604154 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-eba3cf17-90c1-4597-93a3-b41935c00c19 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:30:42.605366 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-eba3cf17-90c1-4597-93a3-b41935c00c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:42.705621 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 756/1480] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:30:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:30:42.998881 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977be01-e968-421d-92a4-8a0a025a6222 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:30:43.000640 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9977be01-e968-421d-92a4-8a0a025a6222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:43.010497 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:43.267111 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977be01-e968-421d-92a4-8a0a025a6222 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:30:43.346806 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:43.379367 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4853504-6bc3-4a0d-8c0e-b025053db5cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:30:43.379974 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4853504-6bc3-4a0d-8c0e-b025053db5cd service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:43.380244 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4853504-6bc3-4a0d-8c0e-b025053db5cd service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:43.380507 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4853504-6bc3-4a0d-8c0e-b025053db5cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:43.382111 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e4853504-6bc3-4a0d-8c0e-b025053db5cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:43.471256 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4853504-6bc3-4a0d-8c0e-b025053db5cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:30:43.472831 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4853504-6bc3-4a0d-8c0e-b025053db5cd service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:30:43.491351 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 725/1481] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:30:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:30:45.584087 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9f1ff-d349-45e1-b31c-3b695ebf9a35 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:45.584657 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9f1ff-d349-45e1-b31c-3b695ebf9a35 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:45.584657 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9f1ff-d349-45e1-b31c-3b695ebf9a35 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:45.585983 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 757/1482] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:30:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:30:45.591259 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6ee36-a1b8-413f-a9ea-56c9b8c741ac None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:45.591686 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6ee36-a1b8-413f-a9ea-56c9b8c741ac None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:45.591827 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6ee36-a1b8-413f-a9ea-56c9b8c741ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:45.657393 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-e0d6ee36-a1b8-413f-a9ea-56c9b8c741ac None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:30:45.658863 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e0d6ee36-a1b8-413f-a9ea-56c9b8c741ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:45.705154 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:45.755601 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 726/1483] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:30:46.044536 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9f1ff-d349-45e1-b31c-3b695ebf9a35 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:30:46.046592 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-60c9f1ff-d349-45e1-b31c-3b695ebf9a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:46.071769 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:46.152659 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9f1ff-d349-45e1-b31c-3b695ebf9a35 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:30:46.225453 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d856b17-423d-45ff-8e2e-9d0bf5f1ea47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:30:46.226052 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d856b17-423d-45ff-8e2e-9d0bf5f1ea47 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:46.226324 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d856b17-423d-45ff-8e2e-9d0bf5f1ea47 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:46.226596 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d856b17-423d-45ff-8e2e-9d0bf5f1ea47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:46.228229 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9d856b17-423d-45ff-8e2e-9d0bf5f1ea47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:46.303117 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:46.337504 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d856b17-423d-45ff-8e2e-9d0bf5f1ea47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:30:46.338985 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d856b17-423d-45ff-8e2e-9d0bf5f1ea47 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:30:46.357119 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 758/1484] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:30:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:30:48.296224 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5b481-e4ae-4953-b680-16e55367c5e0 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:48.296836 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5b481-e4ae-4953-b680-16e55367c5e0 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:48.296836 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5b481-e4ae-4953-b680-16e55367c5e0 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:48.298097 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 727/1485] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:30:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:30:48.303566 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d57408-64bc-48e1-9654-3db4eab837b4 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:48.303970 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d57408-64bc-48e1-9654-3db4eab837b4 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:48.304122 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d57408-64bc-48e1-9654-3db4eab837b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:48.371635 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-09d57408-64bc-48e1-9654-3db4eab837b4 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:30:48.372693 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-09d57408-64bc-48e1-9654-3db4eab837b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:48.468384 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 759/1486] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:30:48.754427 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5b481-e4ae-4953-b680-16e55367c5e0 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:30:48.756071 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c2b5b481-e4ae-4953-b680-16e55367c5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:48.861386 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5b481-e4ae-4953-b680-16e55367c5e0 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:30:48.933249 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:48.935245 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c97d63-c01f-4dfd-bc59-b8041198f2ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:30:48.935894 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c97d63-c01f-4dfd-bc59-b8041198f2ad service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:48.936567 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c97d63-c01f-4dfd-bc59-b8041198f2ad service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:48.937033 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c97d63-c01f-4dfd-bc59-b8041198f2ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:48.938859 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-07c97d63-c01f-4dfd-bc59-b8041198f2ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:49.046060 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c97d63-c01f-4dfd-bc59-b8041198f2ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:30:49.047171 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c97d63-c01f-4dfd-bc59-b8041198f2ad service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:30:49.065319 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 728/1487] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:30:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:30:51.125831 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a175a8-b655-4bed-b362-72d4adaa5237 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:51.126375 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a175a8-b655-4bed-b362-72d4adaa5237 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:51.126375 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a175a8-b655-4bed-b362-72d4adaa5237 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:51.127759 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 760/1488] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:30:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:30:51.133131 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f9f9e-01a6-486c-a159-eb575ce4533f None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:51.133544 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f9f9e-01a6-486c-a159-eb575ce4533f None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:51.133674 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f9f9e-01a6-486c-a159-eb575ce4533f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:51.199388 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-6a3f9f9e-01a6-486c-a159-eb575ce4533f None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:30:51.201145 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6a3f9f9e-01a6-486c-a159-eb575ce4533f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:51.255047 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:51.299958 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 729/1489] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:30:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:30:51.594528 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a175a8-b655-4bed-b362-72d4adaa5237 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:30:51.596120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-68a175a8-b655-4bed-b362-72d4adaa5237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:51.633786 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:51.703456 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a175a8-b655-4bed-b362-72d4adaa5237 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:30:51.777175 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153bb34-0678-456f-aa09-4aa3808c1fdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:30:51.777784 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153bb34-0678-456f-aa09-4aa3808c1fdd service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:51.778124 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153bb34-0678-456f-aa09-4aa3808c1fdd service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:51.778502 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153bb34-0678-456f-aa09-4aa3808c1fdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:51.780172 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1153bb34-0678-456f-aa09-4aa3808c1fdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:51.861935 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:51.891683 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1153bb34-0678-456f-aa09-4aa3808c1fdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:30:51.893288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1153bb34-0678-456f-aa09-4aa3808c1fdd service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:30:51.911920 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 761/1490] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:30:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:30:54.037817 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877e660-7b63-4a04-a4f8-e49e89730973 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:54.038380 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877e660-7b63-4a04-a4f8-e49e89730973 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:54.038380 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877e660-7b63-4a04-a4f8-e49e89730973 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:54.039697 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 730/1491] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 15:30:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:30:54.045769 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c121216-6d57-4516-b762-8d2a0c032a91 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:54.046200 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c121216-6d57-4516-b762-8d2a0c032a91 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:54.046305 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c121216-6d57-4516-b762-8d2a0c032a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:54.112947 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-2c121216-6d57-4516-b762-8d2a0c032a91 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:30:54.114200 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2c121216-6d57-4516-b762-8d2a0c032a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:54.212988 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 762/1492] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 15:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:30:54.505486 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a877e660-7b63-4a04-a4f8-e49e89730973 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:30:54.507073 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a877e660-7b63-4a04-a4f8-e49e89730973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:54.622150 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a877e660-7b63-4a04-a4f8-e49e89730973 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:30:54.696815 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e9f66-2a41-4cdb-bf3a-23d65b79ab8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:30:54.697413 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e9f66-2a41-4cdb-bf3a-23d65b79ab8f service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:54.697678 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e9f66-2a41-4cdb-bf3a-23d65b79ab8f service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:54.697944 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e9f66-2a41-4cdb-bf3a-23d65b79ab8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:54.700566 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b33e9f66-2a41-4cdb-bf3a-23d65b79ab8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:54.709876 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:54.810666 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33e9f66-2a41-4cdb-bf3a-23d65b79ab8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:30:54.812080 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33e9f66-2a41-4cdb-bf3a-23d65b79ab8f service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:30:54.829752 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 731/1493] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:30:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:31:04.211734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=82 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:04.827464 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=50 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:08.374846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae219f2-38ed-42bc-b9be-320e255f98f4 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:08.375468 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae219f2-38ed-42bc-b9be-320e255f98f4 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:08.375468 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae219f2-38ed-42bc-b9be-320e255f98f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:08.451226 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-eae219f2-38ed-42bc-b9be-320e255f98f4 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:32:08.452441 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-eae219f2-38ed-42bc-b9be-320e255f98f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:08.548913 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 763/1494] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:32:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:32:08.556676 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a91d25-9ab7-477a-b70b-9135db99ec33 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:08.557189 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a91d25-9ab7-477a-b70b-9135db99ec33 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:08.557302 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a91d25-9ab7-477a-b70b-9135db99ec33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:08.636950 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a7a91d25-9ab7-477a-b70b-9135db99ec33 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:32:08.638713 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a7a91d25-9ab7-477a-b70b-9135db99ec33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:08.740392 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 732/1495] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:32:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:32:08.745308 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae219f2-38ed-42bc-b9be-320e255f98f4 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:08.746619 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-eae219f2-38ed-42bc-b9be-320e255f98f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:08.758218 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae219f2-38ed-42bc-b9be-320e255f98f4 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:08.824446 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:08.859713 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55132ce7-2138-4d6e-8e72-9284901a711a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:08.860318 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55132ce7-2138-4d6e-8e72-9284901a711a admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:08.860592 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55132ce7-2138-4d6e-8e72-9284901a711a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:08.860860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55132ce7-2138-4d6e-8e72-9284901a711a admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:08.861497 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55132ce7-2138-4d6e-8e72-9284901a711a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:32:08.861881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55132ce7-2138-4d6e-8e72-9284901a711a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:08.862892 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-55132ce7-2138-4d6e-8e72-9284901a711a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:32:08.862892 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 15:32:08.862892 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 15:32:08.863809 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55132ce7-2138-4d6e-8e72-9284901a711a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:08.875675 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 764/1496] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:32:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:32:08.883904 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a91d25-9ab7-477a-b70b-9135db99ec33 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:08.893254 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a91d25-9ab7-477a-b70b-9135db99ec33 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:08.954025 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:08.988341 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c4c64-caae-49b3-8d47-f2d1acf9716d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:08.988945 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c4c64-caae-49b3-8d47-f2d1acf9716d admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:08.989219 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c4c64-caae-49b3-8d47-f2d1acf9716d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:08.989487 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c4c64-caae-49b3-8d47-f2d1acf9716d admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:08.990125 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66c4c64-caae-49b3-8d47-f2d1acf9716d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:08.991872 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-c66c4c64-caae-49b3-8d47-f2d1acf9716d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:32:08.991872 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 15:32:08.991872 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 15:32:08.993064 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66c4c64-caae-49b3-8d47-f2d1acf9716d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:09.052368 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 733/1497] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:32:08 2022] POST /identity/v3/projects => generated 377 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:32:09.056781 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55132ce7-2138-4d6e-8e72-9284901a711a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:09.058313 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-55132ce7-2138-4d6e-8e72-9284901a711a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:09.095456 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55132ce7-2138-4d6e-8e72-9284901a711a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:09.194388 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc59ee1-ff67-4e9a-8970-98b478d84b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:09.194999 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc59ee1-ff67-4e9a-8970-98b478d84b89 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:09.195309 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc59ee1-ff67-4e9a-8970-98b478d84b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:09.195589 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc59ee1-ff67-4e9a-8970-98b478d84b89 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:09.196298 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc59ee1-ff67-4e9a-8970-98b478d84b89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:09.197367 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-dbc59ee1-ff67-4e9a-8970-98b478d84b89 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:32:09.197367 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 15:32:09.197367 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 15:32:09.198651 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc59ee1-ff67-4e9a-8970-98b478d84b89 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:09.242513 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 765/1498] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:32:09 2022] POST /identity/v3/users => generated 289 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:32:09.246995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c4c64-caae-49b3-8d47-f2d1acf9716d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:09.248558 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c66c4c64-caae-49b3-8d47-f2d1acf9716d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:09.310761 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c4c64-caae-49b3-8d47-f2d1acf9716d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:09.393166 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:09.405444 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a30987-3cb3-4275-9a5d-36f5fc527d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:09.406050 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a30987-3cb3-4275-9a5d-36f5fc527d94 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:09.406328 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a30987-3cb3-4275-9a5d-36f5fc527d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:09.406594 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a30987-3cb3-4275-9a5d-36f5fc527d94 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:09.407264 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a30987-3cb3-4275-9a5d-36f5fc527d94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:09.408280 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-e4a30987-3cb3-4275-9a5d-36f5fc527d94 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:32:09.408280 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 15:32:09.408280 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 15:32:09.409164 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a30987-3cb3-4275-9a5d-36f5fc527d94 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:09.421694 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 734/1499] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:32:09.425837 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc59ee1-ff67-4e9a-8970-98b478d84b89 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:09.427455 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-dbc59ee1-ff67-4e9a-8970-98b478d84b89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:09.439725 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc59ee1-ff67-4e9a-8970-98b478d84b89 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:09.470100 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:09.546955 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2273b-365c-4ef1-af9e-e2a3577c9fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:09.547587 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2273b-365c-4ef1-af9e-e2a3577c9fdc admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:09.547860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2273b-365c-4ef1-af9e-e2a3577c9fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:09.548127 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2273b-365c-4ef1-af9e-e2a3577c9fdc admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:09.548766 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a2273b-365c-4ef1-af9e-e2a3577c9fdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:09.549768 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-24a2273b-365c-4ef1-af9e-e2a3577c9fdc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:32:09.549768 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 15:32:09.549768 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 15:32:09.550648 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a2273b-365c-4ef1-af9e-e2a3577c9fdc admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:09.562940 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 766/1500] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:32:09.567178 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a30987-3cb3-4275-9a5d-36f5fc527d94 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:09.568761 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e4a30987-3cb3-4275-9a5d-36f5fc527d94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:09.603188 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a30987-3cb3-4275-9a5d-36f5fc527d94 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:09.701751 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf957b-7ca5-41cc-b3e9-7dfa348b82c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:09.702438 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf957b-7ca5-41cc-b3e9-7dfa348b82c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:09.702745 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf957b-7ca5-41cc-b3e9-7dfa348b82c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:09.702956 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf957b-7ca5-41cc-b3e9-7dfa348b82c3 admin admin] PATH_INFO: `/v3/projects/f0aae83747044e74bedbef9b17200991/users/9976e466e00149868e25f56d35f9d252/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:09.724534 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbf957b-7ca5-41cc-b3e9-7dfa348b82c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0aae83747044e74bedbef9b17200991, user_id=9976e466e00149868e25f56d35f9d252, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:09.725582 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-4cbf957b-7ca5-41cc-b3e9-7dfa348b82c3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:32:09.725582 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 15:32:09.725582 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 15:32:09.727552 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbf957b-7ca5-41cc-b3e9-7dfa348b82c3 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:09.756436 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 735/1501] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:32:09 2022] PUT /identity/v3/projects/f0aae83747044e74bedbef9b17200991/users/9976e466e00149868e25f56d35f9d252/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:32:09.769596 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7a136-f40a-4e5f-aa62-30a84714976e None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:09.769890 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7a136-f40a-4e5f-aa62-30a84714976e None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:09.770152 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7a136-f40a-4e5f-aa62-30a84714976e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:09.828896 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-9cf7a136-f40a-4e5f-aa62-30a84714976e None None] MFA Rules not processed for user `9976e466e00149868e25f56d35f9d252`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:32:09.830114 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9cf7a136-f40a-4e5f-aa62-30a84714976e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:09.907894 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 767/1502] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:32:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:32:09.921878 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc39b1-8358-4aff-b89b-fb870367c447 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:09.922172 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc39b1-8358-4aff-b89b-fb870367c447 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:09.922450 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc39b1-8358-4aff-b89b-fb870367c447 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:09.923945 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 736/1503] 10.222.0.83 () {54 vars in 964 bytes} [Mon Aug 29 15:32:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:32:09.928804 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab3b4a-e8cc-4dd5-a5a3-fbc2b918fcd8 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:09.929090 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab3b4a-e8cc-4dd5-a5a3-fbc2b918fcd8 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:09.929367 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab3b4a-e8cc-4dd5-a5a3-fbc2b918fcd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:09.960060 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:10.007569 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-f2ab3b4a-e8cc-4dd5-a5a3-fbc2b918fcd8 None None] MFA Rules not processed for user `fd42634b2795427cba6614c53491ded2`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:32:10.008779 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f2ab3b4a-e8cc-4dd5-a5a3-fbc2b918fcd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:10.091818 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 768/1504] 10.222.0.83 () {58 vars in 1061 bytes} [Mon Aug 29 15:32:09 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:32:10.099393 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc39b1-8358-4aff-b89b-fb870367c447 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:10.100930 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4adc39b1-8358-4aff-b89b-fb870367c447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:10.151784 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:10.206652 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc39b1-8358-4aff-b89b-fb870367c447 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:10.280906 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba27b6-7046-4d70-a255-89fd3ca4694e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:10.281426 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba27b6-7046-4d70-a255-89fd3ca4694e service cinder] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:10.281701 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba27b6-7046-4d70-a255-89fd3ca4694e service cinder] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:10.281993 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba27b6-7046-4d70-a255-89fd3ca4694e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:10.283610 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c8ba27b6-7046-4d70-a255-89fd3ca4694e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:10.382149 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ba27b6-7046-4d70-a255-89fd3ca4694e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:10.383603 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ba27b6-7046-4d70-a255-89fd3ca4694e service cinder] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:10.386999 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:10.402299 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 737/1505] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:32:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:32:10.447314 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5167934-d3e9-4be3-9d67-d152d369342d None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:10.447745 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5167934-d3e9-4be3-9d67-d152d369342d None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:10.447950 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5167934-d3e9-4be3-9d67-d152d369342d None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:10.449212 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 769/1506] 10.222.0.83 () {52 vars in 830 bytes} [Mon Aug 29 15:32:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:32:10.453478 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba27b6-7046-4d70-a255-89fd3ca4694e service cinder] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:10.454677 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c8ba27b6-7046-4d70-a255-89fd3ca4694e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:10.553676 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba27b6-7046-4d70-a255-89fd3ca4694e service cinder] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:10.648095 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7af4de-c5e4-4243-b4d5-ec7aaa6f85ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:10.648734 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7af4de-c5e4-4243-b4d5-ec7aaa6f85ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:10.649041 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7af4de-c5e4-4243-b4d5-ec7aaa6f85ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:10.649335 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7af4de-c5e4-4243-b4d5-ec7aaa6f85ad admin admin] PATH_INFO: `/v3/users/9976e466e00149868e25f56d35f9d252` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:10.661968 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7af4de-c5e4-4243-b4d5-ec7aaa6f85ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=9976e466e00149868e25f56d35f9d252)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:10.662991 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-3c7af4de-c5e4-4243-b4d5-ec7aaa6f85ad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:32:10.662991 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 15:32:10.662991 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 15:32:10.664308 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7af4de-c5e4-4243-b4d5-ec7aaa6f85ad admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:10.674070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:10.731718 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3c7af4de-c5e4-4243-b4d5-ec7aaa6f85ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9976e466e00149868e25f56d35f9d252'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:10.732264 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3c7af4de-c5e4-4243-b4d5-ec7aaa6f85ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9976e466e00149868e25f56d35f9d252'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:10.743264 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3c7af4de-c5e4-4243-b4d5-ec7aaa6f85ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9976e466e00149868e25f56d35f9d252'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:10.756672 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3c7af4de-c5e4-4243-b4d5-ec7aaa6f85ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9976e466e00149868e25f56d35f9d252'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:10.757144 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3c7af4de-c5e4-4243-b4d5-ec7aaa6f85ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9976e466e00149868e25f56d35f9d252'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:10.785748 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 738/1507] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:32:10 2022] DELETE /identity/v3/users/9976e466e00149868e25f56d35f9d252 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:32:10.790852 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00298f-9b1e-473b-8e90-2f3509457de0 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:10.791180 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00298f-9b1e-473b-8e90-2f3509457de0 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:10.791460 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00298f-9b1e-473b-8e90-2f3509457de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:10.853034 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-3e00298f-9b1e-473b-8e90-2f3509457de0 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:32:10.854633 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3e00298f-9b1e-473b-8e90-2f3509457de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:10.929956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:10.943833 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 770/1508] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:32:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:32:10.954416 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7af4de-c5e4-4243-b4d5-ec7aaa6f85ad admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:10.955733 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3c7af4de-c5e4-4243-b4d5-ec7aaa6f85ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:11.056085 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7af4de-c5e4-4243-b4d5-ec7aaa6f85ad admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:11.114667 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:11.136468 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a2147-82f2-4a10-aaf5-4ba984d3950a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:11.137148 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a2147-82f2-4a10-aaf5-4ba984d3950a service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:11.137494 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a2147-82f2-4a10-aaf5-4ba984d3950a service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:11.137795 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a2147-82f2-4a10-aaf5-4ba984d3950a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:11.139455 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8b0a2147-82f2-4a10-aaf5-4ba984d3950a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:11.249459 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a2147-82f2-4a10-aaf5-4ba984d3950a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:11.250901 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a2147-82f2-4a10-aaf5-4ba984d3950a service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:11.270513 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 739/1509] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:32:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:32:11.615348 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00298f-9b1e-473b-8e90-2f3509457de0 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:11.617078 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3e00298f-9b1e-473b-8e90-2f3509457de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:11.630208 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00298f-9b1e-473b-8e90-2f3509457de0 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:11.729270 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed16623-48d5-414b-87f2-8c98d3bdf27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:11.729909 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed16623-48d5-414b-87f2-8c98d3bdf27f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:11.730185 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed16623-48d5-414b-87f2-8c98d3bdf27f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:11.730456 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed16623-48d5-414b-87f2-8c98d3bdf27f admin admin] PATH_INFO: `/v3/projects/f0aae83747044e74bedbef9b17200991` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:11.741051 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed16623-48d5-414b-87f2-8c98d3bdf27f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0aae83747044e74bedbef9b17200991)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:11.742095 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-9ed16623-48d5-414b-87f2-8c98d3bdf27f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:32:11.742095 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 15:32:11.742095 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 15:32:11.743332 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed16623-48d5-414b-87f2-8c98d3bdf27f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:11.801429 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9ed16623-48d5-414b-87f2-8c98d3bdf27f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0aae83747044e74bedbef9b17200991', 'request_id': 'req-9ed16623-48d5-414b-87f2-8c98d3bdf27f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:11.807397 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9ed16623-48d5-414b-87f2-8c98d3bdf27f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0aae83747044e74bedbef9b17200991', 'request_id': 'req-9ed16623-48d5-414b-87f2-8c98d3bdf27f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:11.817432 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9ed16623-48d5-414b-87f2-8c98d3bdf27f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0aae83747044e74bedbef9b17200991', 'request_id': 'req-9ed16623-48d5-414b-87f2-8c98d3bdf27f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:11.849182 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9ed16623-48d5-414b-87f2-8c98d3bdf27f admin admin] The token cache is being invalidate because project f0aae83747044e74bedbef9b17200991 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:32:11.849467 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9ed16623-48d5-414b-87f2-8c98d3bdf27f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:11.849896 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9ed16623-48d5-414b-87f2-8c98d3bdf27f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:11.851322 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 771/1510] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:32:11 2022] DELETE /identity/v3/projects/f0aae83747044e74bedbef9b17200991 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:32:21.268228 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=62 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:21.847121 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:28.096404 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7066a2df-ba30-4b58-bb9f-82f31639c6c2 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:28.096966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7066a2df-ba30-4b58-bb9f-82f31639c6c2 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:28.096966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7066a2df-ba30-4b58-bb9f-82f31639c6c2 None None] PATH_INFO: `/v3` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:28.098154 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 740/1511] 10.222.0.77 () {54 vars in 925 bytes} [Mon Aug 29 15:35:28 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:35:28.104786 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688452c6-7130-45f3-b8d9-e786afc1bdff None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:28.105229 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688452c6-7130-45f3-b8d9-e786afc1bdff None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:28.105346 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688452c6-7130-45f3-b8d9-e786afc1bdff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:28.307366 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-688452c6-7130-45f3-b8d9-e786afc1bdff None None] MFA Rules not processed for user `c190fa4a280c41c684130e069bee99eb`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:35:28.308586 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-688452c6-7130-45f3-b8d9-e786afc1bdff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:28.422323 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 772/1512] 10.222.0.77 () {58 vars in 1015 bytes} [Mon Aug 29 15:35:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:35:32.102038 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe381582-3409-4359-851d-4b79a993a0c6 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:32.102578 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe381582-3409-4359-851d-4b79a993a0c6 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:32.102578 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe381582-3409-4359-851d-4b79a993a0c6 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:32.103877 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 741/1513] 10.222.0.83 () {54 vars in 961 bytes} [Mon Aug 29 15:35:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:35:32.108852 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42b6a4-0a69-44ff-87a3-8f5d73ea901e None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:32.109320 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42b6a4-0a69-44ff-87a3-8f5d73ea901e None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:32.109421 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42b6a4-0a69-44ff-87a3-8f5d73ea901e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:32.129060 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-0a42b6a4-0a69-44ff-87a3-8f5d73ea901e None None] MFA Rules not processed for user `c190fa4a280c41c684130e069bee99eb`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:35:32.130244 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0a42b6a4-0a69-44ff-87a3-8f5d73ea901e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:32.139713 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 773/1514] 10.222.0.83 () {58 vars in 1058 bytes} [Mon Aug 29 15:35:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:35:32.147214 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe381582-3409-4359-851d-4b79a993a0c6 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:32.161494 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe381582-3409-4359-851d-4b79a993a0c6 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:32.167219 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440656d9-a678-4599-8631-dc7b2564308f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:32.167818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440656d9-a678-4599-8631-dc7b2564308f service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:32.168096 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440656d9-a678-4599-8631-dc7b2564308f service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:32.168368 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440656d9-a678-4599-8631-dc7b2564308f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:32.176593 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440656d9-a678-4599-8631-dc7b2564308f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:32.178208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440656d9-a678-4599-8631-dc7b2564308f service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:32.188504 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 742/1515] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:35:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:35:42.123947 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=77 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:42.184498 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=6 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:44.076584 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd3fb5-ee39-4bac-ad90-0e0d80ae5c59 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:44.077129 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd3fb5-ee39-4bac-ad90-0e0d80ae5c59 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:44.077129 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd3fb5-ee39-4bac-ad90-0e0d80ae5c59 None None] PATH_INFO: `/v3` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:44.078556 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 774/1516] 10.222.0.78 () {54 vars in 925 bytes} [Mon Aug 29 15:35:44 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:35:44.085772 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e668c-9a7b-4161-8b84-d7fcd211918d None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:44.086402 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e668c-9a7b-4161-8b84-d7fcd211918d None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:44.086402 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e668c-9a7b-4161-8b84-d7fcd211918d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:44.106301 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-bb3e668c-9a7b-4161-8b84-d7fcd211918d None None] MFA Rules not processed for user `c190fa4a280c41c684130e069bee99eb`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:35:44.107553 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-bb3e668c-9a7b-4161-8b84-d7fcd211918d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:44.116079 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 743/1517] 10.222.0.78 () {58 vars in 1015 bytes} [Mon Aug 29 15:35:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:35:53.037134 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e16f99-a28f-45da-97be-f5563207f705 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:53.037576 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e16f99-a28f-45da-97be-f5563207f705 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:53.037684 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e16f99-a28f-45da-97be-f5563207f705 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:53.040060 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 775/1518] 10.222.0.83 () {54 vars in 961 bytes} [Mon Aug 29 15:35:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:35:53.045128 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b2305-079d-4e1a-b72e-3f6fbc1bf003 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:53.045582 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b2305-079d-4e1a-b72e-3f6fbc1bf003 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:53.045685 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b2305-079d-4e1a-b72e-3f6fbc1bf003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:53.064830 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-7b3b2305-079d-4e1a-b72e-3f6fbc1bf003 None None] MFA Rules not processed for user `c190fa4a280c41c684130e069bee99eb`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:35:53.066005 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7b3b2305-079d-4e1a-b72e-3f6fbc1bf003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:53.074543 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 744/1519] 10.222.0.83 () {58 vars in 1058 bytes} [Mon Aug 29 15:35:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:35:53.082466 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e16f99-a28f-45da-97be-f5563207f705 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:53.096891 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e16f99-a28f-45da-97be-f5563207f705 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:53.103691 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7443379-ec85-4d90-a79a-9b3b977cd677 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:53.104282 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7443379-ec85-4d90-a79a-9b3b977cd677 service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:53.104555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7443379-ec85-4d90-a79a-9b3b977cd677 service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:53.104821 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7443379-ec85-4d90-a79a-9b3b977cd677 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:53.113092 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7443379-ec85-4d90-a79a-9b3b977cd677 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:53.114669 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7443379-ec85-4d90-a79a-9b3b977cd677 service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:53.124540 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 776/1520] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:35:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:36:03.059607 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=6 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:03.120650 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=6 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:10.308918 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca73843-9b42-4f71-b959-da25c0a9665c None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:10.309480 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca73843-9b42-4f71-b959-da25c0a9665c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:10.309480 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca73843-9b42-4f71-b959-da25c0a9665c None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:10.310832 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 745/1521] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 15:36:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:36:10.315962 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016f5c5-e5ef-4b4b-a97c-e59c25061f9d None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:10.316402 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016f5c5-e5ef-4b4b-a97c-e59c25061f9d None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:10.316510 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016f5c5-e5ef-4b4b-a97c-e59c25061f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:10.377029 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-5016f5c5-e5ef-4b4b-a97c-e59c25061f9d None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:36:10.378243 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5016f5c5-e5ef-4b4b-a97c-e59c25061f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:10.455955 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 777/1522] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 15:36:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:36:10.611747 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca73843-9b42-4f71-b959-da25c0a9665c None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:10.613423 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7ca73843-9b42-4f71-b959-da25c0a9665c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:10.718198 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca73843-9b42-4f71-b959-da25c0a9665c None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:10.724060 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440273a-ff8f-42a7-87b7-b74420d9f91b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:10.724668 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440273a-ff8f-42a7-87b7-b74420d9f91b service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:10.724949 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440273a-ff8f-42a7-87b7-b74420d9f91b service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:10.725219 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440273a-ff8f-42a7-87b7-b74420d9f91b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:10.734300 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7440273a-ff8f-42a7-87b7-b74420d9f91b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:10.735926 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7440273a-ff8f-42a7-87b7-b74420d9f91b service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:10.745957 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 746/1523] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:36:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:36:11.588642 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f380b-7fbc-4811-b8ee-3fc5244a8826 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:11.589174 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f380b-7fbc-4811-b8ee-3fc5244a8826 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:11.589174 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f380b-7fbc-4811-b8ee-3fc5244a8826 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:11.590469 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 778/1524] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 15:36:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:36:11.595384 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10b369-863e-4747-8d01-150309ade390 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:11.595840 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10b369-863e-4747-8d01-150309ade390 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:11.595937 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10b369-863e-4747-8d01-150309ade390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:11.616778 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-aa10b369-863e-4747-8d01-150309ade390 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:36:11.617980 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-aa10b369-863e-4747-8d01-150309ade390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:11.625859 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 747/1525] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 15:36:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:36:11.779704 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f380b-7fbc-4811-b8ee-3fc5244a8826 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:11.795101 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f380b-7fbc-4811-b8ee-3fc5244a8826 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:11.800507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a619ebc-4ead-43cc-ba76-6c37f479021b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:11.801106 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a619ebc-4ead-43cc-ba76-6c37f479021b service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:11.801383 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a619ebc-4ead-43cc-ba76-6c37f479021b service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:11.801653 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a619ebc-4ead-43cc-ba76-6c37f479021b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:11.810720 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a619ebc-4ead-43cc-ba76-6c37f479021b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:11.812332 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a619ebc-4ead-43cc-ba76-6c37f479021b service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:11.822253 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 779/1526] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:36:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:36:15.646076 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203c043-87cf-4dcd-b7b9-cb59e919feb8 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:15.646647 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203c043-87cf-4dcd-b7b9-cb59e919feb8 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:15.646647 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203c043-87cf-4dcd-b7b9-cb59e919feb8 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:15.648264 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 748/1527] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 15:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:36:15.653406 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b5f74-c4cb-4a4b-847c-fb36ab57a1d4 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:15.653813 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b5f74-c4cb-4a4b-847c-fb36ab57a1d4 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:15.653951 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b5f74-c4cb-4a4b-847c-fb36ab57a1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:15.674260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-116b5f74-c4cb-4a4b-847c-fb36ab57a1d4 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:36:15.675495 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-116b5f74-c4cb-4a4b-847c-fb36ab57a1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:15.684230 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 780/1528] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 15:36:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:36:15.973675 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203c043-87cf-4dcd-b7b9-cb59e919feb8 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:15.975998 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4203c043-87cf-4dcd-b7b9-cb59e919feb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:16.056166 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203c043-87cf-4dcd-b7b9-cb59e919feb8 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:16.059755 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391f56d-2c9c-4b2a-973d-70f515121f0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:16.060362 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391f56d-2c9c-4b2a-973d-70f515121f0a service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:16.060640 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391f56d-2c9c-4b2a-973d-70f515121f0a service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:16.060909 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391f56d-2c9c-4b2a-973d-70f515121f0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:16.070444 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e391f56d-2c9c-4b2a-973d-70f515121f0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:16.071928 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e391f56d-2c9c-4b2a-973d-70f515121f0a service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:16.082127 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 749/1529] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:36:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:36:17.999571 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e1e49-890a-4d8b-897b-43cbffc967b8 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:18.000141 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e1e49-890a-4d8b-897b-43cbffc967b8 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:18.000141 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e1e49-890a-4d8b-897b-43cbffc967b8 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:18.001458 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 781/1530] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 15:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:36:18.007719 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab2c05-1be4-454c-8b93-fbf152cafc11 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:18.008250 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab2c05-1be4-454c-8b93-fbf152cafc11 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:18.008250 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab2c05-1be4-454c-8b93-fbf152cafc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:18.029771 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-96ab2c05-1be4-454c-8b93-fbf152cafc11 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:36:18.030973 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-96ab2c05-1be4-454c-8b93-fbf152cafc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:18.039416 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 750/1531] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 15:36:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:36:18.342286 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e1e49-890a-4d8b-897b-43cbffc967b8 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:18.353461 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e1e49-890a-4d8b-897b-43cbffc967b8 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:18.356955 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0110db-752d-498a-a353-fdc1fe855c84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:18.357547 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0110db-752d-498a-a353-fdc1fe855c84 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:18.357817 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0110db-752d-498a-a353-fdc1fe855c84 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:18.358083 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0110db-752d-498a-a353-fdc1fe855c84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:18.367127 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0110db-752d-498a-a353-fdc1fe855c84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:18.368561 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0110db-752d-498a-a353-fdc1fe855c84 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:18.378011 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 782/1532] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:36:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:36:28.022565 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=87 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:28.373703 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=65 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:10.055170 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e32cf0-fc9e-41ff-85ff-6d945b6f2fd6 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:10.055862 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e32cf0-fc9e-41ff-85ff-6d945b6f2fd6 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:10.055862 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e32cf0-fc9e-41ff-85ff-6d945b6f2fd6 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:10.057018 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 751/1533] 10.222.0.83 () {54 vars in 921 bytes} [Mon Aug 29 15:37:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:37:10.062545 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b4b08-d1d7-423e-8463-550b63d7fedf None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:10.063044 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b4b08-d1d7-423e-8463-550b63d7fedf None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:10.063136 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b4b08-d1d7-423e-8463-550b63d7fedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:10.088507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-445b4b08-d1d7-423e-8463-550b63d7fedf None None] MFA Rules not processed for user `c190fa4a280c41c684130e069bee99eb`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:10.089883 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-445b4b08-d1d7-423e-8463-550b63d7fedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:10.098957 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 783/1534] 10.222.0.83 () {58 vars in 1018 bytes} [Mon Aug 29 15:37:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:20.079431 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:42.084151 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc19a4d-6e61-4e63-8f58-241cf12d391e None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:42.084724 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc19a4d-6e61-4e63-8f58-241cf12d391e None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:42.084724 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc19a4d-6e61-4e63-8f58-241cf12d391e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:42.110073 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-ccc19a4d-6e61-4e63-8f58-241cf12d391e None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:42.111680 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ccc19a4d-6e61-4e63-8f58-241cf12d391e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:42.122007 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 752/1535] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:42.132522 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958de59-f91d-4314-9d92-d8dfa77d059d None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:42.133070 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958de59-f91d-4314-9d92-d8dfa77d059d None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:42.133070 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958de59-f91d-4314-9d92-d8dfa77d059d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:42.161623 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-2958de59-f91d-4314-9d92-d8dfa77d059d None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:42.163202 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2958de59-f91d-4314-9d92-d8dfa77d059d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:42.177958 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 784/1536] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:42.183288 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc19a4d-6e61-4e63-8f58-241cf12d391e None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:42.196427 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc19a4d-6e61-4e63-8f58-241cf12d391e None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:42.206394 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca127841-ea85-486f-9fd4-b0df5446eb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:42.207397 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca127841-ea85-486f-9fd4-b0df5446eb3b admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:42.207895 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca127841-ea85-486f-9fd4-b0df5446eb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:42.208495 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca127841-ea85-486f-9fd4-b0df5446eb3b admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:42.211860 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca127841-ea85-486f-9fd4-b0df5446eb3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:37:42.212441 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca127841-ea85-486f-9fd4-b0df5446eb3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:42.213806 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-ca127841-ea85-486f-9fd4-b0df5446eb3b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:37:42.213806 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 15:37:42.213806 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 15:37:42.215100 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca127841-ea85-486f-9fd4-b0df5446eb3b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:42.234506 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 753/1537] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:37:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:37:42.243053 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958de59-f91d-4314-9d92-d8dfa77d059d None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:42.257780 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958de59-f91d-4314-9d92-d8dfa77d059d None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:42.269408 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad79aa-9ec8-48b0-b0cb-c096bfadbfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:42.270039 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad79aa-9ec8-48b0-b0cb-c096bfadbfc3 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:42.270313 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad79aa-9ec8-48b0-b0cb-c096bfadbfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:42.270582 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad79aa-9ec8-48b0-b0cb-c096bfadbfc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:42.271281 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad79aa-9ec8-48b0-b0cb-c096bfadbfc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:42.273405 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-efad79aa-9ec8-48b0-b0cb-c096bfadbfc3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:37:42.273405 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 15:37:42.273405 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 15:37:42.274588 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad79aa-9ec8-48b0-b0cb-c096bfadbfc3 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:42.299791 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6ed97-e4ed-45f6-8a3d-728ea8c8a140 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:42.299990 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6ed97-e4ed-45f6-8a3d-728ea8c8a140 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:42.300242 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6ed97-e4ed-45f6-8a3d-728ea8c8a140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:42.342386 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-7ff6ed97-e4ed-45f6-8a3d-728ea8c8a140 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:42.343679 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7ff6ed97-e4ed-45f6-8a3d-728ea8c8a140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:42.345872 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 785/1538] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:37:42 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:42.351937 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad79aa-9ec8-48b0-b0cb-c096bfadbfc3 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:42.457966 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 754/1539] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:37:42.468974 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad79aa-9ec8-48b0-b0cb-c096bfadbfc3 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:42.470049 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872bf4ad-3116-4de4-a787-59f325d40fa8 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:42.470486 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872bf4ad-3116-4de4-a787-59f325d40fa8 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:42.470760 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872bf4ad-3116-4de4-a787-59f325d40fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:42.477542 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0255a-dfcf-4ec9-96ac-c5b2bf30ecb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:42.478179 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0255a-dfcf-4ec9-96ac-c5b2bf30ecb0 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:42.478461 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0255a-dfcf-4ec9-96ac-c5b2bf30ecb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:42.478734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0255a-dfcf-4ec9-96ac-c5b2bf30ecb0 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:42.479420 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0255a-dfcf-4ec9-96ac-c5b2bf30ecb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:42.481410 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0255a-dfcf-4ec9-96ac-c5b2bf30ecb0 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:42.514984 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-872bf4ad-3116-4de4-a787-59f325d40fa8 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:42.516164 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 786/1540] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:37:42 2022] POST /identity/v3/users => generated 292 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:42.516359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-872bf4ad-3116-4de4-a787-59f325d40fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:42.520406 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0255a-dfcf-4ec9-96ac-c5b2bf30ecb0 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:42.536129 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 755/1541] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:42.536864 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0255a-dfcf-4ec9-96ac-c5b2bf30ecb0 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:42.541989 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872bf4ad-3116-4de4-a787-59f325d40fa8 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:42.549277 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e5ae3-a49a-48c5-84aa-80ad03a3875d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:42.549904 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e5ae3-a49a-48c5-84aa-80ad03a3875d admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:42.550240 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e5ae3-a49a-48c5-84aa-80ad03a3875d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:42.550504 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e5ae3-a49a-48c5-84aa-80ad03a3875d admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:42.551176 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9e5ae3-a49a-48c5-84aa-80ad03a3875d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:42.553112 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9e5ae3-a49a-48c5-84aa-80ad03a3875d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:42.561890 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872bf4ad-3116-4de4-a787-59f325d40fa8 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:42.572056 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 787/1542] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:37:42.578448 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fad6f9-7887-4f73-bae7-563598c0c99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:42.579112 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fad6f9-7887-4f73-bae7-563598c0c99e admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:42.579301 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e5ae3-a49a-48c5-84aa-80ad03a3875d admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:42.579403 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fad6f9-7887-4f73-bae7-563598c0c99e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:42.579872 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fad6f9-7887-4f73-bae7-563598c0c99e admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:42.580541 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fad6f9-7887-4f73-bae7-563598c0c99e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:37:42.580849 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fad6f9-7887-4f73-bae7-563598c0c99e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:42.582842 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fad6f9-7887-4f73-bae7-563598c0c99e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:42.595048 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e5ae3-a49a-48c5-84aa-80ad03a3875d admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:42.611903 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffecdce4-1ca3-4bfd-b4d9-14822f970375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:42.612786 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffecdce4-1ca3-4bfd-b4d9-14822f970375 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:42.613136 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffecdce4-1ca3-4bfd-b4d9-14822f970375 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:42.613550 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffecdce4-1ca3-4bfd-b4d9-14822f970375 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:42.614080 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffecdce4-1ca3-4bfd-b4d9-14822f970375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:42.615822 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 756/1543] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:37:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:37:42.615990 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffecdce4-1ca3-4bfd-b4d9-14822f970375 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:42.618114 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7270bbd-3cbf-4b21-b78a-72df583e666e None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:42.618596 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7270bbd-3cbf-4b21-b78a-72df583e666e None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:42.619089 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7270bbd-3cbf-4b21-b78a-72df583e666e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:42.636587 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 788/1544] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:37:42.637590 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffecdce4-1ca3-4bfd-b4d9-14822f970375 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:42.665111 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffecdce4-1ca3-4bfd-b4d9-14822f970375 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:42.677860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab4e1d-50f9-456a-a6b5-a35522b107eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:42.678537 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab4e1d-50f9-456a-a6b5-a35522b107eb admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:42.678817 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab4e1d-50f9-456a-a6b5-a35522b107eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:42.679159 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab4e1d-50f9-456a-a6b5-a35522b107eb admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:42.679769 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ab4e1d-50f9-456a-a6b5-a35522b107eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:42.681889 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ab4e1d-50f9-456a-a6b5-a35522b107eb admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:42.706893 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-d7270bbd-3cbf-4b21-b78a-72df583e666e None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:42.712817 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d7270bbd-3cbf-4b21-b78a-72df583e666e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:42.730718 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 789/1545] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:37:42 2022] POST /identity/v3/projects => generated 403 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:42.731714 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab4e1d-50f9-456a-a6b5-a35522b107eb admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:42.754638 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 757/1546] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:42.760210 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defaf11-01f4-4094-bab8-d1ce725dc4d2 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:42.760689 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defaf11-01f4-4094-bab8-d1ce725dc4d2 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:42.761182 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defaf11-01f4-4094-bab8-d1ce725dc4d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:42.852788 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-8defaf11-01f4-4094-bab8-d1ce725dc4d2 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:42.853920 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8defaf11-01f4-4094-bab8-d1ce725dc4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:42.961737 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab4e1d-50f9-456a-a6b5-a35522b107eb admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:42.973685 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a498aa-916e-43c6-ba1a-7f52e84c6b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:42.974535 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a498aa-916e-43c6-ba1a-7f52e84c6b08 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:42.975854 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a498aa-916e-43c6-ba1a-7f52e84c6b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:42.976274 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a498aa-916e-43c6-ba1a-7f52e84c6b08 admin admin] PATH_INFO: `/v3/projects/09bab46673824d9ba81dc152cc0a3895/users/a726e7ddb8914b72925d217021404000/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:42.986871 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 758/1547] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:42.987808 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8defaf11-01f4-4094-bab8-d1ce725dc4d2 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:43.002519 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8defaf11-01f4-4094-bab8-d1ce725dc4d2 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:43.002943 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:43.008378 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a498aa-916e-43c6-ba1a-7f52e84c6b08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09bab46673824d9ba81dc152cc0a3895, user_id=a726e7ddb8914b72925d217021404000, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:43.010648 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-45a498aa-916e-43c6-ba1a-7f52e84c6b08 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:37:43.010648 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 15:37:43.010648 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 15:37:43.014048 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a498aa-916e-43c6-ba1a-7f52e84c6b08 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:43.014273 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3df2a4-2cc4-4f83-9ae0-0bc6c07e54ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:43.015126 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3df2a4-2cc4-4f83-9ae0-0bc6c07e54ff admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:43.015543 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3df2a4-2cc4-4f83-9ae0-0bc6c07e54ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:43.016141 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3df2a4-2cc4-4f83-9ae0-0bc6c07e54ff admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:43.016992 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3df2a4-2cc4-4f83-9ae0-0bc6c07e54ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:43.018688 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-3f3df2a4-2cc4-4f83-9ae0-0bc6c07e54ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:37:43.018688 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 15:37:43.018688 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 15:37:43.020187 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3df2a4-2cc4-4f83-9ae0-0bc6c07e54ff admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:43.031140 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 790/1548] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:37:42 2022] PUT /identity/v3/projects/09bab46673824d9ba81dc152cc0a3895/users/a726e7ddb8914b72925d217021404000/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:43.032894 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7478292-443c-4572-8dda-48d373b9b123 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:43.033275 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7478292-443c-4572-8dda-48d373b9b123 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:43.033587 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7478292-443c-4572-8dda-48d373b9b123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:43.048769 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 759/1549] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:37:42 2022] POST /identity/v3/users => generated 302 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:43.053429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a139827-0454-45ac-88dc-8c0cba0826b9 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:43.053882 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a139827-0454-45ac-88dc-8c0cba0826b9 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:43.054167 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a139827-0454-45ac-88dc-8c0cba0826b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:43.056038 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-c7478292-443c-4572-8dda-48d373b9b123 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:43.057263 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c7478292-443c-4572-8dda-48d373b9b123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:43.075628 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-2a139827-0454-45ac-88dc-8c0cba0826b9 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:43.076812 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2a139827-0454-45ac-88dc-8c0cba0826b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:43.115685 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:43.130510 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 791/1550] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:43.130510 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053eb95-eff2-46a9-8f3d-dd41a72ec8e6 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:43.130510 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053eb95-eff2-46a9-8f3d-dd41a72ec8e6 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:43.130510 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053eb95-eff2-46a9-8f3d-dd41a72ec8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:43.149341 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-2053eb95-eff2-46a9-8f3d-dd41a72ec8e6 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:43.150605 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2053eb95-eff2-46a9-8f3d-dd41a72ec8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:43.152554 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 760/1551] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:43.153986 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50b50e-db9e-4cc9-b50f-03ad0a0747d4 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:43.154284 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50b50e-db9e-4cc9-b50f-03ad0a0747d4 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:43.154564 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50b50e-db9e-4cc9-b50f-03ad0a0747d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:43.163171 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 792/1552] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:43.165758 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ef1a5-b015-4afc-8357-f7d288570e7c None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:43.166036 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ef1a5-b015-4afc-8357-f7d288570e7c None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:43.166314 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ef1a5-b015-4afc-8357-f7d288570e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:43.176795 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-5e50b50e-db9e-4cc9-b50f-03ad0a0747d4 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:43.178279 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5e50b50e-db9e-4cc9-b50f-03ad0a0747d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:43.186812 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-2e3ef1a5-b015-4afc-8357-f7d288570e7c None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:43.187306 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 761/1553] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:43.188041 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2e3ef1a5-b015-4afc-8357-f7d288570e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:43.188615 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cfc84-c2b0-4c7c-ac8a-83fc158908f1 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:43.188901 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cfc84-c2b0-4c7c-ac8a-83fc158908f1 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:43.189177 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cfc84-c2b0-4c7c-ac8a-83fc158908f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:43.197274 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 793/1554] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:43.198482 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90c5d8-bcdd-4001-a747-296664406f2c None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:43.198757 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90c5d8-bcdd-4001-a747-296664406f2c None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:43.199161 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90c5d8-bcdd-4001-a747-296664406f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:43.210744 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-c69cfc84-c2b0-4c7c-ac8a-83fc158908f1 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:43.212004 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c69cfc84-c2b0-4c7c-ac8a-83fc158908f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:43.220165 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 762/1555] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:43.220993 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69cfc84-c2b0-4c7c-ac8a-83fc158908f1 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:43.230059 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-3c90c5d8-bcdd-4001-a747-296664406f2c None None] MFA Rules not processed for user `a726e7ddb8914b72925d217021404000`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:43.231319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3c90c5d8-bcdd-4001-a747-296664406f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:43.231506 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69cfc84-c2b0-4c7c-ac8a-83fc158908f1 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:43.236184 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956262c-dbb2-461f-ba82-a20fc4c1d7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:43.236794 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956262c-dbb2-461f-ba82-a20fc4c1d7b6 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:43.237076 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956262c-dbb2-461f-ba82-a20fc4c1d7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:43.237350 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956262c-dbb2-461f-ba82-a20fc4c1d7b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:43.237989 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956262c-dbb2-461f-ba82-a20fc4c1d7b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:43.239627 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956262c-dbb2-461f-ba82-a20fc4c1d7b6 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:43.249719 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 763/1556] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:37:43.250644 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956262c-dbb2-461f-ba82-a20fc4c1d7b6 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:43.260519 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956262c-dbb2-461f-ba82-a20fc4c1d7b6 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:43.265442 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53d1c8-33d4-4dd7-9158-acefe6fec389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:43.266116 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53d1c8-33d4-4dd7-9158-acefe6fec389 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:43.266304 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53d1c8-33d4-4dd7-9158-acefe6fec389 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:43.266577 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53d1c8-33d4-4dd7-9158-acefe6fec389 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:43.267243 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf53d1c8-33d4-4dd7-9158-acefe6fec389 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:37:43.267548 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf53d1c8-33d4-4dd7-9158-acefe6fec389 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:43.269126 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf53d1c8-33d4-4dd7-9158-acefe6fec389 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:43.282411 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 764/1557] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:37:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:37:43.283710 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86d8ae-9c8a-4e77-8e78-e381985e997c None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:43.283995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86d8ae-9c8a-4e77-8e78-e381985e997c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:43.284267 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86d8ae-9c8a-4e77-8e78-e381985e997c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:43.304874 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 794/1558] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:43.305241 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cacc5-162b-4278-950c-9ad8bff8376c None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:43.305606 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cacc5-162b-4278-950c-9ad8bff8376c None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:43.305943 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cacc5-162b-4278-950c-9ad8bff8376c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:43.308347 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-ed86d8ae-9c8a-4e77-8e78-e381985e997c None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:43.309592 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ed86d8ae-9c8a-4e77-8e78-e381985e997c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:43.321231 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 765/1559] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:43.321231 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86d8ae-9c8a-4e77-8e78-e381985e997c None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:43.325403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-fb5cacc5-162b-4278-950c-9ad8bff8376c None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:43.326621 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-fb5cacc5-162b-4278-950c-9ad8bff8376c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:43.327974 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86d8ae-9c8a-4e77-8e78-e381985e997c None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:43.332580 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1395d5-f52e-45d4-b511-eaa84a8626bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:43.333171 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1395d5-f52e-45d4-b511-eaa84a8626bb admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:43.333447 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1395d5-f52e-45d4-b511-eaa84a8626bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:43.333717 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1395d5-f52e-45d4-b511-eaa84a8626bb admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:43.338406 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 795/1560] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:43.338570 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1395d5-f52e-45d4-b511-eaa84a8626bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:37:43.338570 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1395d5-f52e-45d4-b511-eaa84a8626bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:43.338715 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fca75-8eac-4f94-814e-24bb5d015e9d None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:43.338715 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fca75-8eac-4f94-814e-24bb5d015e9d None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:43.338715 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fca75-8eac-4f94-814e-24bb5d015e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:43.338890 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1395d5-f52e-45d4-b511-eaa84a8626bb admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:43.350694 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 766/1561] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:37:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:37:43.352031 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2840a6-0c01-4e73-9a5a-0a3e3fe27309 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:43.352475 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2840a6-0c01-4e73-9a5a-0a3e3fe27309 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:43.352749 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2840a6-0c01-4e73-9a5a-0a3e3fe27309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:43.357469 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-625fca75-8eac-4f94-814e-24bb5d015e9d None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:43.358579 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-625fca75-8eac-4f94-814e-24bb5d015e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:43.366833 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 796/1562] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:43.367470 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625fca75-8eac-4f94-814e-24bb5d015e9d None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:43.375775 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-0a2840a6-0c01-4e73-9a5a-0a3e3fe27309 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:43.376643 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625fca75-8eac-4f94-814e-24bb5d015e9d None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:43.376974 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0a2840a6-0c01-4e73-9a5a-0a3e3fe27309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:43.382134 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149722c6-dc39-4748-9927-85542d07ce0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:43.382134 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149722c6-dc39-4748-9927-85542d07ce0c admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:43.382762 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149722c6-dc39-4748-9927-85542d07ce0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:43.382762 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149722c6-dc39-4748-9927-85542d07ce0c admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:43.383216 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149722c6-dc39-4748-9927-85542d07ce0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:43.384811 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149722c6-dc39-4748-9927-85542d07ce0c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:43.385021 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 767/1563] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:43.385785 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2840a6-0c01-4e73-9a5a-0a3e3fe27309 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:43.395144 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 797/1564] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:37:43.395926 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149722c6-dc39-4748-9927-85542d07ce0c admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:43.399468 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2840a6-0c01-4e73-9a5a-0a3e3fe27309 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:43.404923 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a31c6-1cc1-4d2b-9b3a-f9d059aa18e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:43.405531 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a31c6-1cc1-4d2b-9b3a-f9d059aa18e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:43.405811 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a31c6-1cc1-4d2b-9b3a-f9d059aa18e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:43.405909 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149722c6-dc39-4748-9927-85542d07ce0c admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:43.406081 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a31c6-1cc1-4d2b-9b3a-f9d059aa18e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:43.406707 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a31c6-1cc1-4d2b-9b3a-f9d059aa18e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:43.408652 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a31c6-1cc1-4d2b-9b3a-f9d059aa18e7 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:43.410342 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aca9f4-4af6-4ac6-beb4-cb98fce16c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:43.410920 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aca9f4-4af6-4ac6-beb4-cb98fce16c03 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:43.411228 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aca9f4-4af6-4ac6-beb4-cb98fce16c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:43.411496 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aca9f4-4af6-4ac6-beb4-cb98fce16c03 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:43.412110 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aca9f4-4af6-4ac6-beb4-cb98fce16c03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:43.414211 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aca9f4-4af6-4ac6-beb4-cb98fce16c03 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:43.438658 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 768/1565] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:37:43 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:43.439610 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a31c6-1cc1-4d2b-9b3a-f9d059aa18e7 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:43.443476 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 798/1566] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:37:43 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:43.445361 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aca9f4-4af6-4ac6-beb4-cb98fce16c03 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:43.472663 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:43.504707 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a31c6-1cc1-4d2b-9b3a-f9d059aa18e7 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:43.510141 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f75595-5b5a-4d2c-8359-a9e97e94dc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:43.510747 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f75595-5b5a-4d2c-8359-a9e97e94dc0e admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:43.511185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f75595-5b5a-4d2c-8359-a9e97e94dc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:43.511286 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aca9f4-4af6-4ac6-beb4-cb98fce16c03 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:43.511479 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f75595-5b5a-4d2c-8359-a9e97e94dc0e admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:43.512115 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f75595-5b5a-4d2c-8359-a9e97e94dc0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:37:43.512445 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f75595-5b5a-4d2c-8359-a9e97e94dc0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:43.514290 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f75595-5b5a-4d2c-8359-a9e97e94dc0e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:43.516117 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c113ca6-e021-4bb6-9d9a-f71dcce7ac70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:43.516717 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c113ca6-e021-4bb6-9d9a-f71dcce7ac70 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:43.516993 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c113ca6-e021-4bb6-9d9a-f71dcce7ac70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:43.517261 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c113ca6-e021-4bb6-9d9a-f71dcce7ac70 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:43.517909 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c113ca6-e021-4bb6-9d9a-f71dcce7ac70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:37:43.518208 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c113ca6-e021-4bb6-9d9a-f71dcce7ac70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:43.519825 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c113ca6-e021-4bb6-9d9a-f71dcce7ac70 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:43.526896 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 769/1567] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:37:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:37:43.528141 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f75595-5b5a-4d2c-8359-a9e97e94dc0e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:43.536875 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 799/1568] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:37:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:37:43.537867 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f75595-5b5a-4d2c-8359-a9e97e94dc0e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:43.538128 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c113ca6-e021-4bb6-9d9a-f71dcce7ac70 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:43.542717 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0a42d-a399-4945-93e6-1c811a6523c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:43.543363 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0a42d-a399-4945-93e6-1c811a6523c2 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:43.543644 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0a42d-a399-4945-93e6-1c811a6523c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:43.544247 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0a42d-a399-4945-93e6-1c811a6523c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:43.544921 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a0a42d-a399-4945-93e6-1c811a6523c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:43.546841 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a0a42d-a399-4945-93e6-1c811a6523c2 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:43.548160 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c113ca6-e021-4bb6-9d9a-f71dcce7ac70 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:43.552820 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb66ee59-5ee1-431c-bdd4-7a40b86d7ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:43.553444 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66ee59-5ee1-431c-bdd4-7a40b86d7ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:43.553872 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66ee59-5ee1-431c-bdd4-7a40b86d7ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:43.554172 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66ee59-5ee1-431c-bdd4-7a40b86d7ee7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:43.554836 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb66ee59-5ee1-431c-bdd4-7a40b86d7ee7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:37:43.555213 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb66ee59-5ee1-431c-bdd4-7a40b86d7ee7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:43.557203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb66ee59-5ee1-431c-bdd4-7a40b86d7ee7 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:43.569963 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 800/1569] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:37:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:37:43.570810 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb66ee59-5ee1-431c-bdd4-7a40b86d7ee7 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:43.575073 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 770/1570] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:37:43 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:43.575928 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0a42d-a399-4945-93e6-1c811a6523c2 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:43.581818 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb66ee59-5ee1-431c-bdd4-7a40b86d7ee7 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:43.604879 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:43.641536 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd688379-8704-42e9-9a97-81eb4f9d7ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:43.642059 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd688379-8704-42e9-9a97-81eb4f9d7ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:43.642334 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd688379-8704-42e9-9a97-81eb4f9d7ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:43.642454 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0a42d-a399-4945-93e6-1c811a6523c2 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:43.642602 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd688379-8704-42e9-9a97-81eb4f9d7ea1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:43.643275 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd688379-8704-42e9-9a97-81eb4f9d7ea1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:37:43.643572 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd688379-8704-42e9-9a97-81eb4f9d7ea1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:43.645170 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd688379-8704-42e9-9a97-81eb4f9d7ea1 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:43.647339 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deaa9c5-3d16-4ed4-952d-b5ea5396f107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:43.648015 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deaa9c5-3d16-4ed4-952d-b5ea5396f107 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:43.648294 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deaa9c5-3d16-4ed4-952d-b5ea5396f107 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:43.648566 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deaa9c5-3d16-4ed4-952d-b5ea5396f107 admin admin] PATH_INFO: `/v3/projects/40b8719c00e54dca87df81ed4a755e8d/users/ac7202dcf050479d98b4ed87575249a7/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:43.657206 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 801/1571] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:37:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:37:43.658055 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd688379-8704-42e9-9a97-81eb4f9d7ea1 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:43.665811 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deaa9c5-3d16-4ed4-952d-b5ea5396f107 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40b8719c00e54dca87df81ed4a755e8d, user_id=ac7202dcf050479d98b4ed87575249a7, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:43.668382 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd688379-8704-42e9-9a97-81eb4f9d7ea1 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:43.668615 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deaa9c5-3d16-4ed4-952d-b5ea5396f107 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:43.672950 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc35093-c2e0-4a45-b3e4-f8c2dbae4ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:43.673540 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc35093-c2e0-4a45-b3e4-f8c2dbae4ae3 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:43.673918 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc35093-c2e0-4a45-b3e4-f8c2dbae4ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:43.674230 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc35093-c2e0-4a45-b3e4-f8c2dbae4ae3 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:43.675011 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc35093-c2e0-4a45-b3e4-f8c2dbae4ae3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:43.677183 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc35093-c2e0-4a45-b3e4-f8c2dbae4ae3 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:43.683363 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 771/1572] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:37:43 2022] PUT /identity/v3/projects/40b8719c00e54dca87df81ed4a755e8d/users/ac7202dcf050479d98b4ed87575249a7/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:43.684088 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deaa9c5-3d16-4ed4-952d-b5ea5396f107 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:43.700871 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 802/1573] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:37:43 2022] POST /identity/v3/users => generated 292 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:43.701788 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc35093-c2e0-4a45-b3e4-f8c2dbae4ae3 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:43.712226 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc35093-c2e0-4a45-b3e4-f8c2dbae4ae3 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:43.758258 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deaa9c5-3d16-4ed4-952d-b5ea5396f107 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:43.762980 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951bc3e-9bad-4f68-8522-79f15a03aa2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:43.763616 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951bc3e-9bad-4f68-8522-79f15a03aa2a admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:43.764150 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951bc3e-9bad-4f68-8522-79f15a03aa2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:43.764425 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951bc3e-9bad-4f68-8522-79f15a03aa2a admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:43.765122 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d951bc3e-9bad-4f68-8522-79f15a03aa2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:43.767140 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d951bc3e-9bad-4f68-8522-79f15a03aa2a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:43.777560 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e242c-8ad5-4abf-8bf9-35234419f9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:43.778170 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e242c-8ad5-4abf-8bf9-35234419f9a7 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:43.778445 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e242c-8ad5-4abf-8bf9-35234419f9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:43.778712 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e242c-8ad5-4abf-8bf9-35234419f9a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:43.779381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894e242c-8ad5-4abf-8bf9-35234419f9a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:43.781567 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894e242c-8ad5-4abf-8bf9-35234419f9a7 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:43.793459 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 772/1574] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:37:43 2022] POST /identity/v3/users => generated 298 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:43.795966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951bc3e-9bad-4f68-8522-79f15a03aa2a admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:43.807511 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951bc3e-9bad-4f68-8522-79f15a03aa2a admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:43.813487 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 803/1575] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:37:43 2022] POST /identity/v3/projects => generated 371 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:43.813487 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e242c-8ad5-4abf-8bf9-35234419f9a7 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:43.815441 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072a101-44c9-4bf9-a207-2c54b2d0f2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:43.816052 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072a101-44c9-4bf9-a207-2c54b2d0f2bb admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:43.816331 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072a101-44c9-4bf9-a207-2c54b2d0f2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:43.816601 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072a101-44c9-4bf9-a207-2c54b2d0f2bb admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:43.817265 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3072a101-44c9-4bf9-a207-2c54b2d0f2bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:43.817408 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:43.820047 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3072a101-44c9-4bf9-a207-2c54b2d0f2bb admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:43.848171 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 773/1576] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:37:43 2022] POST /identity/v3/projects => generated 397 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:43.849059 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072a101-44c9-4bf9-a207-2c54b2d0f2bb admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:43.877683 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e242c-8ad5-4abf-8bf9-35234419f9a7 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:43.913560 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072a101-44c9-4bf9-a207-2c54b2d0f2bb admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:43.918393 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999049ad-da2f-4f4f-9271-7dc24705d2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:43.919157 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999049ad-da2f-4f4f-9271-7dc24705d2c1 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:43.919437 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999049ad-da2f-4f4f-9271-7dc24705d2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:43.919709 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999049ad-da2f-4f4f-9271-7dc24705d2c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:43.920471 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999049ad-da2f-4f4f-9271-7dc24705d2c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:43.922456 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999049ad-da2f-4f4f-9271-7dc24705d2c1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:43.934841 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1710de-e482-421c-a045-b5f02e188498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:43.935602 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1710de-e482-421c-a045-b5f02e188498 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:43.935782 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1710de-e482-421c-a045-b5f02e188498 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:43.936073 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1710de-e482-421c-a045-b5f02e188498 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:43.936705 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1710de-e482-421c-a045-b5f02e188498 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:43.938669 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1710de-e482-421c-a045-b5f02e188498 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:43.945868 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:43.954612 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 774/1577] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:37:43 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:43.955977 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999049ad-da2f-4f4f-9271-7dc24705d2c1 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:43.966097 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 804/1578] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:37:43 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:43.967455 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246762c-1a67-418a-bde5-5281b21c5692 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:43.967743 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246762c-1a67-418a-bde5-5281b21c5692 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:43.968022 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246762c-1a67-418a-bde5-5281b21c5692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:44.000535 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-e246762c-1a67-418a-bde5-5281b21c5692 None None] MFA Rules not processed for user `ac7202dcf050479d98b4ed87575249a7`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:44.001763 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e246762c-1a67-418a-bde5-5281b21c5692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:44.023580 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999049ad-da2f-4f4f-9271-7dc24705d2c1 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:44.028174 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2693b-d572-48c7-972a-4b047de7bfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:44.028789 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2693b-d572-48c7-972a-4b047de7bfcf admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:44.029066 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2693b-d572-48c7-972a-4b047de7bfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:44.029335 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2693b-d572-48c7-972a-4b047de7bfcf admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:44.029981 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec2693b-d572-48c7-972a-4b047de7bfcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:44.031951 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec2693b-d572-48c7-972a-4b047de7bfcf admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:44.061840 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 775/1579] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:37:43 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:44.062818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2693b-d572-48c7-972a-4b047de7bfcf admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:44.069667 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 805/1580] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:43 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:44.070621 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246762c-1a67-418a-bde5-5281b21c5692 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:44.081052 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246762c-1a67-418a-bde5-5281b21c5692 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:44.111342 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:44.133422 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2693b-d572-48c7-972a-4b047de7bfcf admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:44.138124 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35791bf0-faf6-4a42-89a6-815140100539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:44.138989 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35791bf0-faf6-4a42-89a6-815140100539 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:44.139290 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35791bf0-faf6-4a42-89a6-815140100539 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:44.139556 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35791bf0-faf6-4a42-89a6-815140100539 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:44.140201 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35791bf0-faf6-4a42-89a6-815140100539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:44.141787 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35791bf0-faf6-4a42-89a6-815140100539 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:44.142553 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021e032-3d2e-4488-80f0-6a14badfb35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:44.143229 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021e032-3d2e-4488-80f0-6a14badfb35e admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:44.143502 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021e032-3d2e-4488-80f0-6a14badfb35e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:44.143767 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021e032-3d2e-4488-80f0-6a14badfb35e admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:44.144411 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021e032-3d2e-4488-80f0-6a14badfb35e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:44.145996 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021e032-3d2e-4488-80f0-6a14badfb35e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:44.152030 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 776/1581] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:37:44.155229 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35791bf0-faf6-4a42-89a6-815140100539 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:44.158872 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 806/1582] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:37:44.158872 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021e032-3d2e-4488-80f0-6a14badfb35e admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:44.165604 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35791bf0-faf6-4a42-89a6-815140100539 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:44.166541 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021e032-3d2e-4488-80f0-6a14badfb35e admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:44.170406 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c14d6-8020-44a0-9b75-b377dd7c1280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:44.171008 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c14d6-8020-44a0-9b75-b377dd7c1280 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:44.171147 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbc59b-6396-4ce6-8432-d7400d70183b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:44.171429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c14d6-8020-44a0-9b75-b377dd7c1280 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:44.171696 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbc59b-6396-4ce6-8432-d7400d70183b admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:44.171792 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c14d6-8020-44a0-9b75-b377dd7c1280 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:44.171973 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbc59b-6396-4ce6-8432-d7400d70183b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:44.172241 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbc59b-6396-4ce6-8432-d7400d70183b admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:44.172326 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683c14d6-8020-44a0-9b75-b377dd7c1280 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:44.172860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fbc59b-6396-4ce6-8432-d7400d70183b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:44.174249 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683c14d6-8020-44a0-9b75-b377dd7c1280 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:44.174785 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fbc59b-6396-4ce6-8432-d7400d70183b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:44.197123 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 777/1583] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:37:44 2022] POST /identity/v3/users => generated 286 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:44.197722 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c14d6-8020-44a0-9b75-b377dd7c1280 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:44.199819 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 807/1584] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:37:44 2022] POST /identity/v3/users => generated 299 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:44.200908 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbc59b-6396-4ce6-8432-d7400d70183b admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:44.207472 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c14d6-8020-44a0-9b75-b377dd7c1280 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:44.212274 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbc59b-6396-4ce6-8432-d7400d70183b admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:44.213256 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3da5f8-ca8a-4bd3-bc8b-ac44bcf4f508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:44.213796 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3da5f8-ca8a-4bd3-bc8b-ac44bcf4f508 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:44.214074 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3da5f8-ca8a-4bd3-bc8b-ac44bcf4f508 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:44.214366 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3da5f8-ca8a-4bd3-bc8b-ac44bcf4f508 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:44.214993 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3da5f8-ca8a-4bd3-bc8b-ac44bcf4f508 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:44.216839 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1a34a6-315c-4a96-9f51-0f83f6727b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:44.216967 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3da5f8-ca8a-4bd3-bc8b-ac44bcf4f508 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:44.217435 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a34a6-315c-4a96-9f51-0f83f6727b27 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:44.217710 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a34a6-315c-4a96-9f51-0f83f6727b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:44.217991 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a34a6-315c-4a96-9f51-0f83f6727b27 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:44.218625 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1a34a6-315c-4a96-9f51-0f83f6727b27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:44.220249 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1a34a6-315c-4a96-9f51-0f83f6727b27 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:44.232797 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 808/1585] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:37:44.232797 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1a34a6-315c-4a96-9f51-0f83f6727b27 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:44.245888 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 778/1586] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:37:44 2022] POST /identity/v3/users => generated 292 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:44.246045 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1a34a6-315c-4a96-9f51-0f83f6727b27 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:44.246132 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3da5f8-ca8a-4bd3-bc8b-ac44bcf4f508 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:44.250329 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb95f6-859b-4981-8f0d-47e7a02fd10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:44.250922 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb95f6-859b-4981-8f0d-47e7a02fd10f admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:44.251230 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb95f6-859b-4981-8f0d-47e7a02fd10f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:44.251502 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb95f6-859b-4981-8f0d-47e7a02fd10f admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:44.252124 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eb95f6-859b-4981-8f0d-47e7a02fd10f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:44.254035 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eb95f6-859b-4981-8f0d-47e7a02fd10f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:44.254940 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3da5f8-ca8a-4bd3-bc8b-ac44bcf4f508 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:44.260190 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb92f98-0ca6-4898-86aa-9be57f34a0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:44.260770 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb92f98-0ca6-4898-86aa-9be57f34a0f1 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:44.261051 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb92f98-0ca6-4898-86aa-9be57f34a0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:44.261321 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb92f98-0ca6-4898-86aa-9be57f34a0f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:44.261933 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb92f98-0ca6-4898-86aa-9be57f34a0f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:44.264170 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb92f98-0ca6-4898-86aa-9be57f34a0f1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:44.276785 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 809/1587] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:37:44 2022] POST /identity/v3/users => generated 287 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:44.277554 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb95f6-859b-4981-8f0d-47e7a02fd10f admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:44.288711 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb95f6-859b-4981-8f0d-47e7a02fd10f admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:44.296416 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 779/1588] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:37:44 2022] POST /identity/v3/projects => generated 401 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:44.296563 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4964f-7082-4d11-97af-ffcd112cb7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:44.296696 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb92f98-0ca6-4898-86aa-9be57f34a0f1 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:44.296798 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4964f-7082-4d11-97af-ffcd112cb7b5 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:44.296798 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4964f-7082-4d11-97af-ffcd112cb7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:44.296798 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4964f-7082-4d11-97af-ffcd112cb7b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:44.296798 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad4964f-7082-4d11-97af-ffcd112cb7b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:44.297251 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad4964f-7082-4d11-97af-ffcd112cb7b5 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:44.307530 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 810/1589] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:37:44.308341 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4964f-7082-4d11-97af-ffcd112cb7b5 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:44.317869 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4964f-7082-4d11-97af-ffcd112cb7b5 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:44.323728 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:44.360120 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb92f98-0ca6-4898-86aa-9be57f34a0f1 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:44.366500 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e55ee-bee7-4958-ae90-f480e98c5d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:44.367417 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e55ee-bee7-4958-ae90-f480e98c5d32 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:44.367700 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e55ee-bee7-4958-ae90-f480e98c5d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:44.368015 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e55ee-bee7-4958-ae90-f480e98c5d32 admin admin] PATH_INFO: `/v3/projects/ad02710a3a7e4eb59b295ba888a328a4/users/07cc2434228943d5b28b74e9423429e4/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:44.378082 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d448293c-2dc7-4b2d-882f-d934781aeaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:44.378700 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448293c-2dc7-4b2d-882f-d934781aeaf2 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:44.378972 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448293c-2dc7-4b2d-882f-d934781aeaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:44.379280 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448293c-2dc7-4b2d-882f-d934781aeaf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:44.379936 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d448293c-2dc7-4b2d-882f-d934781aeaf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:44.382244 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d448293c-2dc7-4b2d-882f-d934781aeaf2 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:44.383602 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e55ee-bee7-4958-ae90-f480e98c5d32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad02710a3a7e4eb59b295ba888a328a4, user_id=07cc2434228943d5b28b74e9423429e4, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:44.386368 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e55ee-bee7-4958-ae90-f480e98c5d32 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:44.393500 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 811/1590] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:37:44.394333 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d448293c-2dc7-4b2d-882f-d934781aeaf2 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:44.402035 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 780/1591] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:37:44 2022] PUT /identity/v3/projects/ad02710a3a7e4eb59b295ba888a328a4/users/07cc2434228943d5b28b74e9423429e4/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:44.402839 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e55ee-bee7-4958-ae90-f480e98c5d32 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:44.407099 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d448293c-2dc7-4b2d-882f-d934781aeaf2 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:44.465683 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e55ee-bee7-4958-ae90-f480e98c5d32 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:44.466533 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85a07d-81e2-4e78-90b6-1c80c1d1171d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:44.467298 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85a07d-81e2-4e78-90b6-1c80c1d1171d admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:44.467576 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85a07d-81e2-4e78-90b6-1c80c1d1171d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:44.467956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85a07d-81e2-4e78-90b6-1c80c1d1171d admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:44.468604 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d85a07d-81e2-4e78-90b6-1c80c1d1171d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:44.470257 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d85a07d-81e2-4e78-90b6-1c80c1d1171d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:44.470545 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22258b6c-eb85-4a43-8e35-ec8ff9bb120a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:44.471208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22258b6c-eb85-4a43-8e35-ec8ff9bb120a admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:44.471547 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22258b6c-eb85-4a43-8e35-ec8ff9bb120a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:44.471835 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22258b6c-eb85-4a43-8e35-ec8ff9bb120a admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:44.472654 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22258b6c-eb85-4a43-8e35-ec8ff9bb120a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:44.474257 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22258b6c-eb85-4a43-8e35-ec8ff9bb120a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:44.481208 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 812/1592] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:37:44.482132 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85a07d-81e2-4e78-90b6-1c80c1d1171d admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:44.487160 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:44.490675 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 781/1593] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:37:44.490675 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22258b6c-eb85-4a43-8e35-ec8ff9bb120a admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:44.496197 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85a07d-81e2-4e78-90b6-1c80c1d1171d admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:44.498660 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22258b6c-eb85-4a43-8e35-ec8ff9bb120a admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:44.500786 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd854a-7aa6-4eb6-a485-d76c5c3804ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:44.501385 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd854a-7aa6-4eb6-a485-d76c5c3804ce admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:44.501689 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd854a-7aa6-4eb6-a485-d76c5c3804ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:44.501954 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd854a-7aa6-4eb6-a485-d76c5c3804ce admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:44.502585 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bd854a-7aa6-4eb6-a485-d76c5c3804ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:44.503490 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e972ff-ce29-4d46-83be-d1e7e2c1179d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:44.504084 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e972ff-ce29-4d46-83be-d1e7e2c1179d admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:44.504192 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bd854a-7aa6-4eb6-a485-d76c5c3804ce admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:44.504469 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e972ff-ce29-4d46-83be-d1e7e2c1179d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:44.504744 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e972ff-ce29-4d46-83be-d1e7e2c1179d admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:44.505437 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e972ff-ce29-4d46-83be-d1e7e2c1179d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:44.507754 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e972ff-ce29-4d46-83be-d1e7e2c1179d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:44.516118 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 813/1594] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:37:44.516833 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd854a-7aa6-4eb6-a485-d76c5c3804ce admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:44.522952 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 782/1595] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:37:44.523773 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e972ff-ce29-4d46-83be-d1e7e2c1179d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:44.529687 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd854a-7aa6-4eb6-a485-d76c5c3804ce admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:44.533162 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e972ff-ce29-4d46-83be-d1e7e2c1179d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:44.534550 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8e7c5-160f-48df-95d3-a586846e34b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:44.535197 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8e7c5-160f-48df-95d3-a586846e34b4 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:44.535475 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8e7c5-160f-48df-95d3-a586846e34b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:44.535741 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8e7c5-160f-48df-95d3-a586846e34b4 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:44.536358 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f8e7c5-160f-48df-95d3-a586846e34b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:44.538254 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5035191-d59e-4cee-b018-1de7fbe543f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:44.538643 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f8e7c5-160f-48df-95d3-a586846e34b4 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:44.538931 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5035191-d59e-4cee-b018-1de7fbe543f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:44.539242 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5035191-d59e-4cee-b018-1de7fbe543f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:44.539520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5035191-d59e-4cee-b018-1de7fbe543f5 admin admin] PATH_INFO: `/v3/projects/bb6c0505f505498f94765986baa1aa1c/users/e233d95040244c80a83d0383408c1209/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:44.555443 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5035191-d59e-4cee-b018-1de7fbe543f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb6c0505f505498f94765986baa1aa1c, user_id=e233d95040244c80a83d0383408c1209, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:44.558198 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5035191-d59e-4cee-b018-1de7fbe543f5 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:44.563560 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 814/1596] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:37:44 2022] POST /identity/v3/users => generated 307 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:44.563560 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8e7c5-160f-48df-95d3-a586846e34b4 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:44.572309 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 783/1597] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:37:44 2022] PUT /identity/v3/projects/bb6c0505f505498f94765986baa1aa1c/users/e233d95040244c80a83d0383408c1209/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:44.573171 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5035191-d59e-4cee-b018-1de7fbe543f5 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:44.575670 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8e7c5-160f-48df-95d3-a586846e34b4 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:44.638046 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15618e9f-a5ea-4ab8-ba98-f4edb54a1d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:44.638905 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15618e9f-a5ea-4ab8-ba98-f4edb54a1d59 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:44.639227 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15618e9f-a5ea-4ab8-ba98-f4edb54a1d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:44.639501 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15618e9f-a5ea-4ab8-ba98-f4edb54a1d59 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:44.640155 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15618e9f-a5ea-4ab8-ba98-f4edb54a1d59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:44.641829 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15618e9f-a5ea-4ab8-ba98-f4edb54a1d59 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:44.645384 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5035191-d59e-4cee-b018-1de7fbe543f5 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:44.650687 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7437d0-97d1-4064-8dc1-ef9e0a463d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:44.651327 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7437d0-97d1-4064-8dc1-ef9e0a463d19 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:44.651597 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7437d0-97d1-4064-8dc1-ef9e0a463d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:44.651869 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7437d0-97d1-4064-8dc1-ef9e0a463d19 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:44.656075 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 815/1598] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:37:44.656232 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7437d0-97d1-4064-8dc1-ef9e0a463d19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:44.656329 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15618e9f-a5ea-4ab8-ba98-f4edb54a1d59 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:44.656437 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7437d0-97d1-4064-8dc1-ef9e0a463d19 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:44.665402 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 784/1599] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:37:44.665531 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15618e9f-a5ea-4ab8-ba98-f4edb54a1d59 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:44.666337 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7437d0-97d1-4064-8dc1-ef9e0a463d19 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:44.670539 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57309fa-d99c-43c4-983c-7dfd2fec44bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:44.671180 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57309fa-d99c-43c4-983c-7dfd2fec44bc admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:44.671456 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57309fa-d99c-43c4-983c-7dfd2fec44bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:44.671759 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57309fa-d99c-43c4-983c-7dfd2fec44bc admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:44.672381 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:44.672490 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57309fa-d99c-43c4-983c-7dfd2fec44bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:44.674158 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57309fa-d99c-43c4-983c-7dfd2fec44bc admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:44.676769 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7437d0-97d1-4064-8dc1-ef9e0a463d19 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:44.682856 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217026b-9f8b-4b93-bf26-3d4954bf2b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:44.683547 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217026b-9f8b-4b93-bf26-3d4954bf2b95 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:44.683831 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217026b-9f8b-4b93-bf26-3d4954bf2b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:44.684100 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217026b-9f8b-4b93-bf26-3d4954bf2b95 admin admin] PATH_INFO: `/v3/projects/6ee6ad6ff1354ed8a6885c43d77ae1be/users/5e28d9cf20fd472fa10758ee58fca256/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:44.685788 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 816/1600] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:37:44.687933 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57309fa-d99c-43c4-983c-7dfd2fec44bc admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:44.698034 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57309fa-d99c-43c4-983c-7dfd2fec44bc admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:44.700382 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8217026b-9f8b-4b93-bf26-3d4954bf2b95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ee6ad6ff1354ed8a6885c43d77ae1be, user_id=5e28d9cf20fd472fa10758ee58fca256, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:44.703307 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8217026b-9f8b-4b93-bf26-3d4954bf2b95 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:44.704065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba017554-3277-44ea-ac7c-04b51e40c477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:44.704673 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba017554-3277-44ea-ac7c-04b51e40c477 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:44.704955 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba017554-3277-44ea-ac7c-04b51e40c477 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:44.705327 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba017554-3277-44ea-ac7c-04b51e40c477 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:44.705868 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba017554-3277-44ea-ac7c-04b51e40c477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:44.707517 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba017554-3277-44ea-ac7c-04b51e40c477 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:44.718302 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 785/1601] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:37:44 2022] PUT /identity/v3/projects/6ee6ad6ff1354ed8a6885c43d77ae1be/users/5e28d9cf20fd472fa10758ee58fca256/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:44.722127 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 817/1602] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:37:44.722260 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217026b-9f8b-4b93-bf26-3d4954bf2b95 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:44.722356 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba017554-3277-44ea-ac7c-04b51e40c477 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:44.736416 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba017554-3277-44ea-ac7c-04b51e40c477 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:44.794479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55d755-5637-4d47-b730-87dbcb71a392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:44.795204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217026b-9f8b-4b93-bf26-3d4954bf2b95 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:44.795306 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55d755-5637-4d47-b730-87dbcb71a392 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:44.795497 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55d755-5637-4d47-b730-87dbcb71a392 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:44.795766 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55d755-5637-4d47-b730-87dbcb71a392 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:44.796407 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db55d755-5637-4d47-b730-87dbcb71a392 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:44.798017 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db55d755-5637-4d47-b730-87dbcb71a392 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:44.799848 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d73d4e-33b0-4ec1-ab0f-2a3b7b5f6a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:44.800455 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d73d4e-33b0-4ec1-ab0f-2a3b7b5f6a04 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:44.800728 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d73d4e-33b0-4ec1-ab0f-2a3b7b5f6a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:44.800998 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d73d4e-33b0-4ec1-ab0f-2a3b7b5f6a04 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:44.801636 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d73d4e-33b0-4ec1-ab0f-2a3b7b5f6a04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:44.803286 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d73d4e-33b0-4ec1-ab0f-2a3b7b5f6a04 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:44.808337 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 818/1603] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:37:44.810468 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ed1af-15fe-4965-a8da-87bcea447642 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:44.810898 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ed1af-15fe-4965-a8da-87bcea447642 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:44.811164 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ed1af-15fe-4965-a8da-87bcea447642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:44.816391 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 786/1604] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:37:44.817406 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d73d4e-33b0-4ec1-ab0f-2a3b7b5f6a04 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:44.830715 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d73d4e-33b0-4ec1-ab0f-2a3b7b5f6a04 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:44.836560 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e825559-fd47-4553-97db-531b3dba0c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:44.837220 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e825559-fd47-4553-97db-531b3dba0c36 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:44.837496 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e825559-fd47-4553-97db-531b3dba0c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:44.837766 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e825559-fd47-4553-97db-531b3dba0c36 admin admin] PATH_INFO: `/v3/projects/9ca7759bcbbb40c5b67f6dda70e3ae97/users/e5218d9035444dee8679728c60147682/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:44.843475 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-7b0ed1af-15fe-4965-a8da-87bcea447642 None None] MFA Rules not processed for user `e233d95040244c80a83d0383408c1209`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:44.844788 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7b0ed1af-15fe-4965-a8da-87bcea447642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:44.853460 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e825559-fd47-4553-97db-531b3dba0c36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ca7759bcbbb40c5b67f6dda70e3ae97, user_id=e5218d9035444dee8679728c60147682, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:44.856180 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e825559-fd47-4553-97db-531b3dba0c36 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:44.871727 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 787/1605] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:37:44 2022] PUT /identity/v3/projects/9ca7759bcbbb40c5b67f6dda70e3ae97/users/e5218d9035444dee8679728c60147682/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:44.872556 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e825559-fd47-4553-97db-531b3dba0c36 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:44.894238 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:44.934558 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 819/1606] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:44.934558 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ed1af-15fe-4965-a8da-87bcea447642 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:44.944212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ed1af-15fe-4965-a8da-87bcea447642 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:44.946800 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e825559-fd47-4553-97db-531b3dba0c36 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:44.949019 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8fd2cc-8ac7-44c0-931c-e35fcaf89e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:44.949673 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fd2cc-8ac7-44c0-931c-e35fcaf89e64 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:44.949950 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fd2cc-8ac7-44c0-931c-e35fcaf89e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:44.950225 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fd2cc-8ac7-44c0-931c-e35fcaf89e64 admin admin] PATH_INFO: `/v3/projects/a63b84eca3324578bdefd2847fa23158/users/c90a7444d98e4f45a03053fd032694db/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:44.951916 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e941f36-cc87-42a4-a8a5-d5e7ce6714a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:44.952287 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e941f36-cc87-42a4-a8a5-d5e7ce6714a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:44.952569 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e941f36-cc87-42a4-a8a5-d5e7ce6714a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:44.952840 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e941f36-cc87-42a4-a8a5-d5e7ce6714a3 admin admin] PATH_INFO: `/v3/projects/ad02710a3a7e4eb59b295ba888a328a4/users/07cc2434228943d5b28b74e9423429e4/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:44.954781 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e941f36-cc87-42a4-a8a5-d5e7ce6714a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad02710a3a7e4eb59b295ba888a328a4, user_id=07cc2434228943d5b28b74e9423429e4, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:44.957483 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e941f36-cc87-42a4-a8a5-d5e7ce6714a3 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:44.965315 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8fd2cc-8ac7-44c0-931c-e35fcaf89e64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a63b84eca3324578bdefd2847fa23158, user_id=c90a7444d98e4f45a03053fd032694db, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:44.968062 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8fd2cc-8ac7-44c0-931c-e35fcaf89e64 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:44.968424 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 788/1607] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:37:44 2022] PUT /identity/v3/projects/ad02710a3a7e4eb59b295ba888a328a4/users/07cc2434228943d5b28b74e9423429e4/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:44.969155 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e941f36-cc87-42a4-a8a5-d5e7ce6714a3 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:44.994341 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 820/1608] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:37:44 2022] PUT /identity/v3/projects/a63b84eca3324578bdefd2847fa23158/users/c90a7444d98e4f45a03053fd032694db/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:44.995660 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e04fc7-8bd5-47aa-9be0-6edf25ffa453 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:44.995949 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e04fc7-8bd5-47aa-9be0-6edf25ffa453 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:44.996225 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e04fc7-8bd5-47aa-9be0-6edf25ffa453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:45.027489 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-63e04fc7-8bd5-47aa-9be0-6edf25ffa453 None None] MFA Rules not processed for user `5e28d9cf20fd472fa10758ee58fca256`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:45.028294 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:45.028714 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-63e04fc7-8bd5-47aa-9be0-6edf25ffa453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:45.045792 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e941f36-cc87-42a4-a8a5-d5e7ce6714a3 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:45.097300 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 821/1609] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:45.101527 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e04fc7-8bd5-47aa-9be0-6edf25ffa453 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:45.106083 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5e13d-9230-4520-8be5-12f9a52e7e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:45.106783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5e13d-9230-4520-8be5-12f9a52e7e32 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:45.107079 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5e13d-9230-4520-8be5-12f9a52e7e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:45.107366 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5e13d-9230-4520-8be5-12f9a52e7e32 admin admin] PATH_INFO: `/v3/projects/d8f485f533134df888c3395ef7e662a0/users/fc42d0c4f535430b9a1e94c8400d5521/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:45.122904 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5e13d-9230-4520-8be5-12f9a52e7e32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8f485f533134df888c3395ef7e662a0, user_id=fc42d0c4f535430b9a1e94c8400d5521, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:45.125709 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5e13d-9230-4520-8be5-12f9a52e7e32 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:45.140551 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 789/1610] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:37:44 2022] PUT /identity/v3/projects/d8f485f533134df888c3395ef7e662a0/users/fc42d0c4f535430b9a1e94c8400d5521/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:45.141451 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5e13d-9230-4520-8be5-12f9a52e7e32 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:45.165757 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e04fc7-8bd5-47aa-9be0-6edf25ffa453 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:45.206318 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5e13d-9230-4520-8be5-12f9a52e7e32 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:45.210176 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:45.211590 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c88bd-b9bf-43a2-b85a-c18a0d9e6fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:45.212419 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c88bd-b9bf-43a2-b85a-c18a0d9e6fd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:45.212731 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c88bd-b9bf-43a2-b85a-c18a0d9e6fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:45.213009 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c88bd-b9bf-43a2-b85a-c18a0d9e6fd8 admin admin] PATH_INFO: `/v3/projects/0fd78159a01c4498b21b2c7ed33dc622/users/66185070956b4ede93c2660d7e6a015e/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:45.227281 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b830420-62d1-4022-9afb-1d4d5d3777f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:45.227872 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b830420-62d1-4022-9afb-1d4d5d3777f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:45.228178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b830420-62d1-4022-9afb-1d4d5d3777f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:45.228452 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b830420-62d1-4022-9afb-1d4d5d3777f4 admin admin] PATH_INFO: `/v3/projects/1eb9328a4bc849eaaad28b96916a7c67/users/3715bc7f981c43fc9fa89ae3784d8767/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:45.228880 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126c88bd-b9bf-43a2-b85a-c18a0d9e6fd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fd78159a01c4498b21b2c7ed33dc622, user_id=66185070956b4ede93c2660d7e6a015e, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:45.231599 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126c88bd-b9bf-43a2-b85a-c18a0d9e6fd8 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:45.244278 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b830420-62d1-4022-9afb-1d4d5d3777f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eb9328a4bc849eaaad28b96916a7c67, user_id=3715bc7f981c43fc9fa89ae3784d8767, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:45.245931 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 790/1611] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:37:45 2022] PUT /identity/v3/projects/0fd78159a01c4498b21b2c7ed33dc622/users/66185070956b4ede93c2660d7e6a015e/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:45.246940 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b830420-62d1-4022-9afb-1d4d5d3777f4 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:45.247274 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c39ebe-f2bb-43fb-b032-7ffc876d3842 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:45.247554 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c39ebe-f2bb-43fb-b032-7ffc876d3842 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:45.247823 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c39ebe-f2bb-43fb-b032-7ffc876d3842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:45.269718 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 822/1612] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:37:45 2022] PUT /identity/v3/projects/1eb9328a4bc849eaaad28b96916a7c67/users/3715bc7f981c43fc9fa89ae3784d8767/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:45.272537 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b830420-62d1-4022-9afb-1d4d5d3777f4 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:45.281808 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-b4c39ebe-f2bb-43fb-b032-7ffc876d3842 None None] MFA Rules not processed for user `e5218d9035444dee8679728c60147682`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:45.283191 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b4c39ebe-f2bb-43fb-b032-7ffc876d3842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:45.330874 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:45.333927 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b830420-62d1-4022-9afb-1d4d5d3777f4 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:45.339720 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc95c9c-46d3-4a94-8642-10ba553e9a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:45.340464 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc95c9c-46d3-4a94-8642-10ba553e9a34 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:45.340753 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc95c9c-46d3-4a94-8642-10ba553e9a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:45.341023 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc95c9c-46d3-4a94-8642-10ba553e9a34 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:45.341667 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc95c9c-46d3-4a94-8642-10ba553e9a34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:45.343967 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc95c9c-46d3-4a94-8642-10ba553e9a34 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:45.364368 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 791/1613] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:45.366784 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81ca00-2e7d-4e7f-bef8-4f86fb16c25f None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:45.367303 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81ca00-2e7d-4e7f-bef8-4f86fb16c25f None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:45.367775 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81ca00-2e7d-4e7f-bef8-4f86fb16c25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:45.375307 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 823/1614] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:37:45 2022] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:45.375307 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb41514-268a-414c-8dc8-2baff185fcd9 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:45.375701 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb41514-268a-414c-8dc8-2baff185fcd9 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:45.375701 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb41514-268a-414c-8dc8-2baff185fcd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:45.405771 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-ecb41514-268a-414c-8dc8-2baff185fcd9 None None] MFA Rules not processed for user `c90a7444d98e4f45a03053fd032694db`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:45.407240 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ecb41514-268a-414c-8dc8-2baff185fcd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:45.411417 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-db81ca00-2e7d-4e7f-bef8-4f86fb16c25f None None] MFA Rules not processed for user `07cc2434228943d5b28b74e9423429e4`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:45.413146 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-db81ca00-2e7d-4e7f-bef8-4f86fb16c25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:45.488249 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 824/1615] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:45 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:45.489090 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb41514-268a-414c-8dc8-2baff185fcd9 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:45.496102 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 792/1616] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:45 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:45.497343 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd72e2f-9f25-4286-a942-3da871d3cafc None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:45.497625 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd72e2f-9f25-4286-a942-3da871d3cafc None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:45.497893 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd72e2f-9f25-4286-a942-3da871d3cafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:45.528130 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-1cd72e2f-9f25-4286-a942-3da871d3cafc None None] MFA Rules not processed for user `fc42d0c4f535430b9a1e94c8400d5521`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:45.529311 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1cd72e2f-9f25-4286-a942-3da871d3cafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:45.551740 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:45.569587 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb41514-268a-414c-8dc8-2baff185fcd9 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:45.575428 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c15f9d-643c-4b81-8bfe-308d867065fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:45.576184 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c15f9d-643c-4b81-8bfe-308d867065fc admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:45.576491 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c15f9d-643c-4b81-8bfe-308d867065fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:45.576871 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c15f9d-643c-4b81-8bfe-308d867065fc admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:45.577683 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c15f9d-643c-4b81-8bfe-308d867065fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:45.579663 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c15f9d-643c-4b81-8bfe-308d867065fc admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:45.602121 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 793/1617] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:45.603461 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf96b98-65d5-4022-ba48-d4ff144e9aa0 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:45.603759 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf96b98-65d5-4022-ba48-d4ff144e9aa0 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:45.604081 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf96b98-65d5-4022-ba48-d4ff144e9aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:45.608755 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 825/1618] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:37:45 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:45.609651 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c15f9d-643c-4b81-8bfe-308d867065fc admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:45.633938 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-2bf96b98-65d5-4022-ba48-d4ff144e9aa0 None None] MFA Rules not processed for user `66185070956b4ede93c2660d7e6a015e`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:45.635166 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2bf96b98-65d5-4022-ba48-d4ff144e9aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:45.677225 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c15f9d-643c-4b81-8bfe-308d867065fc admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:45.682104 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ba6961-e998-4851-8a76-a2965ac343b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:45.683047 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba6961-e998-4851-8a76-a2965ac343b0 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:45.683346 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba6961-e998-4851-8a76-a2965ac343b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:45.683614 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba6961-e998-4851-8a76-a2965ac343b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:45.684252 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ba6961-e998-4851-8a76-a2965ac343b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:45.685851 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ba6961-e998-4851-8a76-a2965ac343b0 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:45.694075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:45.696876 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 826/1619] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:37:45.701309 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ba6961-e998-4851-8a76-a2965ac343b0 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:45.707693 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 794/1620] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:45.708722 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf96b98-65d5-4022-ba48-d4ff144e9aa0 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:45.711830 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ba6961-e998-4851-8a76-a2965ac343b0 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:45.716387 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f626a14b-c269-4a2d-bc0d-c35dbf4d4dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:45.716987 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626a14b-c269-4a2d-bc0d-c35dbf4d4dee admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:45.717274 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626a14b-c269-4a2d-bc0d-c35dbf4d4dee admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:45.717545 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626a14b-c269-4a2d-bc0d-c35dbf4d4dee admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:45.718176 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f626a14b-c269-4a2d-bc0d-c35dbf4d4dee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:45.720097 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf96b98-65d5-4022-ba48-d4ff144e9aa0 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:45.720201 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f626a14b-c269-4a2d-bc0d-c35dbf4d4dee admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:45.724623 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7badea-dd42-4264-88b4-c628158ab1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:45.725254 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7badea-dd42-4264-88b4-c628158ab1fc admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:45.725554 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7badea-dd42-4264-88b4-c628158ab1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:45.725804 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7badea-dd42-4264-88b4-c628158ab1fc admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:45.726423 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7badea-dd42-4264-88b4-c628158ab1fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:45.728403 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7badea-dd42-4264-88b4-c628158ab1fc admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:45.749754 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 827/1621] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:37:45 2022] POST /identity/v3/projects => generated 369 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:45.750487 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f626a14b-c269-4a2d-bc0d-c35dbf4d4dee admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:45.761354 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 795/1622] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:37:45 2022] POST /identity/v3/users => generated 297 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:45.762619 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd46ce6-fb0c-4996-a35c-35a3a22064cb None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:45.762999 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd46ce6-fb0c-4996-a35c-35a3a22064cb None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:45.763298 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd46ce6-fb0c-4996-a35c-35a3a22064cb None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:45.765010 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 796/1623] 10.222.0.83 () {54 vars in 962 bytes} [Mon Aug 29 15:37:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:37:45.766018 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd46ce6-fb0c-4996-a35c-35a3a22064cb None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:45.815547 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f626a14b-c269-4a2d-bc0d-c35dbf4d4dee admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:45.820875 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf23f4f-1b93-4ce9-a003-4d4f1685a9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:45.821485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf23f4f-1b93-4ce9-a003-4d4f1685a9e6 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:45.821764 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf23f4f-1b93-4ce9-a003-4d4f1685a9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:45.822032 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf23f4f-1b93-4ce9-a003-4d4f1685a9e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:45.822665 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf23f4f-1b93-4ce9-a003-4d4f1685a9e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:45.824601 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf23f4f-1b93-4ce9-a003-4d4f1685a9e6 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:45.832771 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd46ce6-fb0c-4996-a35c-35a3a22064cb None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:45.838883 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748b46a-66cd-4ac0-b8ca-f888676fddb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:45.839671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748b46a-66cd-4ac0-b8ca-f888676fddb3 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:45.840114 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748b46a-66cd-4ac0-b8ca-f888676fddb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:45.840509 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748b46a-66cd-4ac0-b8ca-f888676fddb3 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:45.841235 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3748b46a-66cd-4ac0-b8ca-f888676fddb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:45.844194 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3748b46a-66cd-4ac0-b8ca-f888676fddb3 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:45.853878 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 828/1624] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:37:45 2022] POST /identity/v3/projects => generated 397 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:45.854981 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf23f4f-1b93-4ce9-a003-4d4f1685a9e6 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:45.870746 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 797/1625] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:37:45 2022] POST /identity/v3/users => generated 298 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:45.871735 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748b46a-66cd-4ac0-b8ca-f888676fddb3 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:45.881908 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748b46a-66cd-4ac0-b8ca-f888676fddb3 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:45.887949 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:45.915099 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf23f4f-1b93-4ce9-a003-4d4f1685a9e6 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:45.918839 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6b0a8-effe-483a-abc8-17bfcc916155 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:45.919469 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6b0a8-effe-483a-abc8-17bfcc916155 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:45.919742 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6b0a8-effe-483a-abc8-17bfcc916155 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:45.920009 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6b0a8-effe-483a-abc8-17bfcc916155 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:45.942520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c25e5c-1c84-4b97-a3b2-0d8b85eb6782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:45.943225 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c25e5c-1c84-4b97-a3b2-0d8b85eb6782 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:45.943503 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c25e5c-1c84-4b97-a3b2-0d8b85eb6782 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:45.944295 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c25e5c-1c84-4b97-a3b2-0d8b85eb6782 admin admin] PATH_INFO: `/v3/projects/1eb9328a4bc849eaaad28b96916a7c67/users/3715bc7f981c43fc9fa89ae3784d8767/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:45.946226 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c25e5c-1c84-4b97-a3b2-0d8b85eb6782 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eb9328a4bc849eaaad28b96916a7c67, user_id=3715bc7f981c43fc9fa89ae3784d8767, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:45.948924 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c25e5c-1c84-4b97-a3b2-0d8b85eb6782 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:45.959688 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 798/1626] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:37:45 2022] PUT /identity/v3/projects/1eb9328a4bc849eaaad28b96916a7c67/users/3715bc7f981c43fc9fa89ae3784d8767/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:45.960607 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c25e5c-1c84-4b97-a3b2-0d8b85eb6782 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:45.987243 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b6b0a8-effe-483a-abc8-17bfcc916155 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:45.988812 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b6b0a8-effe-483a-abc8-17bfcc916155 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:45.998910 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 829/1627] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:37:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:37:45.999840 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6b0a8-effe-483a-abc8-17bfcc916155 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:46.011654 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6b0a8-effe-483a-abc8-17bfcc916155 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:46.033843 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c25e5c-1c84-4b97-a3b2-0d8b85eb6782 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:46.040880 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef8c2c-57e1-4291-b9a2-ee0555b68e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:46.041704 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef8c2c-57e1-4291-b9a2-ee0555b68e8b admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:46.042402 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef8c2c-57e1-4291-b9a2-ee0555b68e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:46.042932 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef8c2c-57e1-4291-b9a2-ee0555b68e8b admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:46.043807 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eef8c2c-57e1-4291-b9a2-ee0555b68e8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:46.045740 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eef8c2c-57e1-4291-b9a2-ee0555b68e8b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:46.050600 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:46.076178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92ab4a0-828b-48af-891a-f6d73ae9a2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:46.076972 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ab4a0-828b-48af-891a-f6d73ae9a2ff admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:46.077366 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ab4a0-828b-48af-891a-f6d73ae9a2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:46.077713 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ab4a0-828b-48af-891a-f6d73ae9a2ff admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:46.078450 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92ab4a0-828b-48af-891a-f6d73ae9a2ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:46.080524 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92ab4a0-828b-48af-891a-f6d73ae9a2ff admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:46.085120 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 799/1628] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:37:45 2022] POST /identity/v3/projects => generated 373 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:46.085120 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef8c2c-57e1-4291-b9a2-ee0555b68e8b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:46.106244 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 830/1629] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:37:45 2022] POST /identity/v3/users => generated 291 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:46.108199 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a087e-5a66-4863-bf05-fd729458aa16 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:46.108679 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a087e-5a66-4863-bf05-fd729458aa16 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:46.109191 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a087e-5a66-4863-bf05-fd729458aa16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:46.154083 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-744a087e-5a66-4863-bf05-fd729458aa16 None None] MFA Rules not processed for user `253947a5ef294d2bb828761873251bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:46.155338 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-744a087e-5a66-4863-bf05-fd729458aa16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:46.157226 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef8c2c-57e1-4291-b9a2-ee0555b68e8b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:46.163283 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a7ff4f-a981-42f8-863d-c5d650922e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:46.164124 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7ff4f-a981-42f8-863d-c5d650922e51 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:46.164554 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7ff4f-a981-42f8-863d-c5d650922e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:46.164969 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7ff4f-a981-42f8-863d-c5d650922e51 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:46.165887 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a7ff4f-a981-42f8-863d-c5d650922e51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:46.167809 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a7ff4f-a981-42f8-863d-c5d650922e51 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:46.180766 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 800/1630] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:37:46.181806 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a7ff4f-a981-42f8-863d-c5d650922e51 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:46.192910 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a7ff4f-a981-42f8-863d-c5d650922e51 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:46.197916 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e5224-ca1e-418c-8315-a34255a727cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:46.199172 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e5224-ca1e-418c-8315-a34255a727cd admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:46.199172 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e5224-ca1e-418c-8315-a34255a727cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:46.199172 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e5224-ca1e-418c-8315-a34255a727cd admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:46.199735 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51e5224-ca1e-418c-8315-a34255a727cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:46.201675 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51e5224-ca1e-418c-8315-a34255a727cd admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:46.210459 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:46.228504 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 801/1631] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:37:46 2022] POST /identity/v3/users => generated 305 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:46.229732 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e5224-ca1e-418c-8315-a34255a727cd admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:46.236457 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 831/1632] 10.222.0.83 () {58 vars in 1059 bytes} [Mon Aug 29 15:37:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:46.238399 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7011e-93cc-475a-aadd-506a4506ae9a None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:46.238690 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7011e-93cc-475a-aadd-506a4506ae9a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:46.238961 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7011e-93cc-475a-aadd-506a4506ae9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:46.243908 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e5224-ca1e-418c-8315-a34255a727cd admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:46.249584 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a04712-571d-4285-b623-1dca4b9b851d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:46.250358 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a04712-571d-4285-b623-1dca4b9b851d admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:46.250807 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a04712-571d-4285-b623-1dca4b9b851d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:46.251180 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a04712-571d-4285-b623-1dca4b9b851d admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:46.251896 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a04712-571d-4285-b623-1dca4b9b851d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:46.253608 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a04712-571d-4285-b623-1dca4b9b851d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:46.267273 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 802/1633] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:37:46.268610 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a04712-571d-4285-b623-1dca4b9b851d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:46.274778 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-11f7011e-93cc-475a-aadd-506a4506ae9a None None] MFA Rules not processed for user `3715bc7f981c43fc9fa89ae3784d8767`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:46.276052 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-11f7011e-93cc-475a-aadd-506a4506ae9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:46.280739 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a04712-571d-4285-b623-1dca4b9b851d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:46.286189 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe2a22-da99-4280-9fc7-ba1d992dd5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:46.286994 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe2a22-da99-4280-9fc7-ba1d992dd5e1 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:46.287511 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe2a22-da99-4280-9fc7-ba1d992dd5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:46.287936 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe2a22-da99-4280-9fc7-ba1d992dd5e1 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:46.288838 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe2a22-da99-4280-9fc7-ba1d992dd5e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:46.291058 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe2a22-da99-4280-9fc7-ba1d992dd5e1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:46.321305 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 803/1634] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:37:46 2022] POST /identity/v3/users => generated 293 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:46.321305 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe2a22-da99-4280-9fc7-ba1d992dd5e1 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:46.335130 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe2a22-da99-4280-9fc7-ba1d992dd5e1 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:46.342173 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9142a0-0fd9-4231-9b68-4aec8c830041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:46.342809 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9142a0-0fd9-4231-9b68-4aec8c830041 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:46.343120 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9142a0-0fd9-4231-9b68-4aec8c830041 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:46.343391 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9142a0-0fd9-4231-9b68-4aec8c830041 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:46.344033 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9142a0-0fd9-4231-9b68-4aec8c830041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:46.345635 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9142a0-0fd9-4231-9b68-4aec8c830041 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:46.355553 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 832/1635] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:46 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:46.356436 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7011e-93cc-475a-aadd-506a4506ae9a None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:46.359744 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 804/1636] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:37:46.360606 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9142a0-0fd9-4231-9b68-4aec8c830041 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:46.367565 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7011e-93cc-475a-aadd-506a4506ae9a None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:46.372575 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39646b-7247-433d-bedd-79ca51a483f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:46.373541 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9142a0-0fd9-4231-9b68-4aec8c830041 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:46.373645 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39646b-7247-433d-bedd-79ca51a483f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:46.373953 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39646b-7247-433d-bedd-79ca51a483f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:46.374290 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39646b-7247-433d-bedd-79ca51a483f0 admin admin] PATH_INFO: `/v3/projects/6c64636bd88f4ac4aec1a8512c3e3107/users/193f305b229e4879ba3da249c3a326f7/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:46.380030 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5b122-cd5b-4141-8e70-5b8fb15c7b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:46.380822 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5b122-cd5b-4141-8e70-5b8fb15c7b6e admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:46.381860 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5b122-cd5b-4141-8e70-5b8fb15c7b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:46.382176 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5b122-cd5b-4141-8e70-5b8fb15c7b6e admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:46.382834 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c5b122-cd5b-4141-8e70-5b8fb15c7b6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:46.384816 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c5b122-cd5b-4141-8e70-5b8fb15c7b6e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:46.394201 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd39646b-7247-433d-bedd-79ca51a483f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c64636bd88f4ac4aec1a8512c3e3107, user_id=193f305b229e4879ba3da249c3a326f7, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:46.397581 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd39646b-7247-433d-bedd-79ca51a483f0 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:46.399426 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 805/1637] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:37:46.400929 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5b122-cd5b-4141-8e70-5b8fb15c7b6e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:46.413647 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 833/1638] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:37:46 2022] PUT /identity/v3/projects/6c64636bd88f4ac4aec1a8512c3e3107/users/193f305b229e4879ba3da249c3a326f7/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:46.414654 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39646b-7247-433d-bedd-79ca51a483f0 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:46.415361 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5b122-cd5b-4141-8e70-5b8fb15c7b6e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:46.477663 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39646b-7247-433d-bedd-79ca51a483f0 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:46.480380 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99876f9-da21-4516-a5bd-e4c1b1637743 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:46.480998 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99876f9-da21-4516-a5bd-e4c1b1637743 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:46.481279 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99876f9-da21-4516-a5bd-e4c1b1637743 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:46.481553 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99876f9-da21-4516-a5bd-e4c1b1637743 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:46.482437 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4f9de-999c-49f3-a215-210736b76a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:46.483120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4f9de-999c-49f3-a215-210736b76a67 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:46.483396 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4f9de-999c-49f3-a215-210736b76a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:46.483663 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4f9de-999c-49f3-a215-210736b76a67 admin admin] PATH_INFO: `/v3/projects/ca0de5a5e0b04a10a89e50800c0a0f28/users/4f5210a00e48424abc9a4f59f7984ad8/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:46.490113 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:46.499145 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4f9de-999c-49f3-a215-210736b76a67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca0de5a5e0b04a10a89e50800c0a0f28, user_id=4f5210a00e48424abc9a4f59f7984ad8, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:46.501867 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4f9de-999c-49f3-a215-210736b76a67 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:46.515088 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 834/1639] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:37:46 2022] PUT /identity/v3/projects/ca0de5a5e0b04a10a89e50800c0a0f28/users/4f5210a00e48424abc9a4f59f7984ad8/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:46.519099 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4f9de-999c-49f3-a215-210736b76a67 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:46.547742 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99876f9-da21-4516-a5bd-e4c1b1637743 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:46.549440 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99876f9-da21-4516-a5bd-e4c1b1637743 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:46.558321 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:46.559584 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 806/1640] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:37:46 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:37:46.560360 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99876f9-da21-4516-a5bd-e4c1b1637743 service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:46.571462 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99876f9-da21-4516-a5bd-e4c1b1637743 service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:46.590423 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4f9de-999c-49f3-a215-210736b76a67 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:46.596364 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fdb886-55c7-4d29-953d-eee356359fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:46.597591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fdb886-55c7-4d29-953d-eee356359fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:46.597877 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fdb886-55c7-4d29-953d-eee356359fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:46.598151 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fdb886-55c7-4d29-953d-eee356359fe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:46.598803 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fdb886-55c7-4d29-953d-eee356359fe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:46.601480 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fdb886-55c7-4d29-953d-eee356359fe3 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:46.611717 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 835/1641] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:37:46.612338 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fdb886-55c7-4d29-953d-eee356359fe3 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:46.622999 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fdb886-55c7-4d29-953d-eee356359fe3 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:46.627720 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb16f3-49b4-495c-82ee-8a85438767f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:46.628360 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb16f3-49b4-495c-82ee-8a85438767f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:46.628643 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb16f3-49b4-495c-82ee-8a85438767f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:46.628910 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb16f3-49b4-495c-82ee-8a85438767f9 admin admin] PATH_INFO: `/v3/projects/59bd6f7ddce4492eab64b95320608fa8/users/7c370274f3684be08cb92412ba00c695/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:46.634593 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d3652-b8d1-41fa-8964-db10d60d4347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:46.636439 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d3652-b8d1-41fa-8964-db10d60d4347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:46.637047 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d3652-b8d1-41fa-8964-db10d60d4347 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:46.637419 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d3652-b8d1-41fa-8964-db10d60d4347 admin admin] PATH_INFO: `/v3/users/fc42d0c4f535430b9a1e94c8400d5521` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:46.638978 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d3652-b8d1-41fa-8964-db10d60d4347 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc42d0c4f535430b9a1e94c8400d5521)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:46.641019 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d3652-b8d1-41fa-8964-db10d60d4347 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:46.648773 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeb16f3-49b4-495c-82ee-8a85438767f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59bd6f7ddce4492eab64b95320608fa8, user_id=7c370274f3684be08cb92412ba00c695, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:46.651523 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeb16f3-49b4-495c-82ee-8a85438767f9 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:46.671054 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 836/1642] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:37:46 2022] PUT /identity/v3/projects/59bd6f7ddce4492eab64b95320608fa8/users/7c370274f3684be08cb92412ba00c695/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:46.676075 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57690e29-78be-4f4a-b964-1b7b2c6fac97 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:46.676457 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57690e29-78be-4f4a-b964-1b7b2c6fac97 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:46.676799 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57690e29-78be-4f4a-b964-1b7b2c6fac97 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:46.679697 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 837/1643] 10.222.0.83 () {54 vars in 962 bytes} [Mon Aug 29 15:37:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:37:46.680219 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57690e29-78be-4f4a-b964-1b7b2c6fac97 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:46.701623 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8c3d3652-b8d1-41fa-8964-db10d60d4347 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc42d0c4f535430b9a1e94c8400d5521'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:46.702389 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8c3d3652-b8d1-41fa-8964-db10d60d4347 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc42d0c4f535430b9a1e94c8400d5521'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:46.712231 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8c3d3652-b8d1-41fa-8964-db10d60d4347 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc42d0c4f535430b9a1e94c8400d5521'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:46.720246 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8c3d3652-b8d1-41fa-8964-db10d60d4347 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc42d0c4f535430b9a1e94c8400d5521'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:46.720982 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8c3d3652-b8d1-41fa-8964-db10d60d4347 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc42d0c4f535430b9a1e94c8400d5521'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:46.747515 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 807/1644] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:37:46 2022] DELETE /identity/v3/users/fc42d0c4f535430b9a1e94c8400d5521 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:46.748868 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d3652-b8d1-41fa-8964-db10d60d4347 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:46.750614 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8c3d3652-b8d1-41fa-8964-db10d60d4347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:46.761703 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57690e29-78be-4f4a-b964-1b7b2c6fac97 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:46.788510 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:46.830832 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d3652-b8d1-41fa-8964-db10d60d4347 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:46.836368 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f205b-123a-416d-ab96-72c0ebb9df00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:46.836984 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f205b-123a-416d-ab96-72c0ebb9df00 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:46.837264 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f205b-123a-416d-ab96-72c0ebb9df00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:46.837538 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f205b-123a-416d-ab96-72c0ebb9df00 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:46.838193 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f205b-123a-416d-ab96-72c0ebb9df00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:46.839833 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f205b-123a-416d-ab96-72c0ebb9df00 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:46.844374 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e2c2e-feb8-48d7-8e09-4782749f405b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:46.845568 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e2c2e-feb8-48d7-8e09-4782749f405b admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:46.845929 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e2c2e-feb8-48d7-8e09-4782749f405b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:46.846265 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e2c2e-feb8-48d7-8e09-4782749f405b admin admin] PATH_INFO: `/v3/projects/23102ab5fb294dd58fbce2d1550b0c64/users/f8045d0542154b06b845a173a438d6e2/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:46.861903 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 808/1645] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:37:46.861903 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f205b-123a-416d-ab96-72c0ebb9df00 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:46.861903 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-519f205b-123a-416d-ab96-72c0ebb9df00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:46.865789 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1e2c2e-feb8-48d7-8e09-4782749f405b admin admin] RBAC: Authorizing `identity:create_grant(project_id=23102ab5fb294dd58fbce2d1550b0c64, user_id=f8045d0542154b06b845a173a438d6e2, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:46.868867 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1e2c2e-feb8-48d7-8e09-4782749f405b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:46.874249 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f205b-123a-416d-ab96-72c0ebb9df00 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:46.879701 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e8c666-03fd-4f90-9924-6d6a65baec99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:46.880736 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8c666-03fd-4f90-9924-6d6a65baec99 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:46.880736 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8c666-03fd-4f90-9924-6d6a65baec99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:46.880999 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8c666-03fd-4f90-9924-6d6a65baec99 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:46.882055 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e8c666-03fd-4f90-9924-6d6a65baec99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:46.886985 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e8c666-03fd-4f90-9924-6d6a65baec99 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:46.887378 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 838/1646] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:37:46 2022] PUT /identity/v3/projects/23102ab5fb294dd58fbce2d1550b0c64/users/f8045d0542154b06b845a173a438d6e2/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:46.888306 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e2c2e-feb8-48d7-8e09-4782749f405b admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:46.890438 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6f1e2c2e-feb8-48d7-8e09-4782749f405b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:46.898257 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 809/1647] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:37:46.902006 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e8c666-03fd-4f90-9924-6d6a65baec99 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:46.903750 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-93e8c666-03fd-4f90-9924-6d6a65baec99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:46.922541 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e8c666-03fd-4f90-9924-6d6a65baec99 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:46.938495 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:46.964255 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e2c2e-feb8-48d7-8e09-4782749f405b admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:46.969127 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a0c874-9eb3-4b45-b274-7a932c1e149b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:46.969798 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0c874-9eb3-4b45-b274-7a932c1e149b admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:46.970077 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0c874-9eb3-4b45-b274-7a932c1e149b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:46.970351 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0c874-9eb3-4b45-b274-7a932c1e149b admin admin] PATH_INFO: `/v3/projects/ee8315fd8e39404c892af3fa6b2c29af/users/26ac52edd08042878cd0d54a6584058f/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:46.986549 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a0c874-9eb3-4b45-b274-7a932c1e149b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee8315fd8e39404c892af3fa6b2c29af, user_id=26ac52edd08042878cd0d54a6584058f, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:46.990100 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a0c874-9eb3-4b45-b274-7a932c1e149b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:46.994387 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082804f8-00ba-402c-9175-51df4e87b801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:46.995014 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082804f8-00ba-402c-9175-51df4e87b801 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:46.995325 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082804f8-00ba-402c-9175-51df4e87b801 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:46.995599 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082804f8-00ba-402c-9175-51df4e87b801 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:46.996246 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082804f8-00ba-402c-9175-51df4e87b801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:46.997894 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082804f8-00ba-402c-9175-51df4e87b801 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:47.009358 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 810/1648] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:37:47.010637 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5386c5-5081-44a2-864d-82984fa9817a None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:47.010925 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5386c5-5081-44a2-864d-82984fa9817a None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:47.011222 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5386c5-5081-44a2-864d-82984fa9817a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:47.018957 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 839/1649] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:37:46 2022] PUT /identity/v3/projects/ee8315fd8e39404c892af3fa6b2c29af/users/26ac52edd08042878cd0d54a6584058f/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:47.018957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c6ad9-6054-4a14-b8c5-fbb58a25635d None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:47.018957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c6ad9-6054-4a14-b8c5-fbb58a25635d None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:47.018957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c6ad9-6054-4a14-b8c5-fbb58a25635d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:47.040030 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-048c6ad9-6054-4a14-b8c5-fbb58a25635d None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:47.041419 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-ad5386c5-5081-44a2-864d-82984fa9817a None None] MFA Rules not processed for user `253947a5ef294d2bb828761873251bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:47.042001 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-048c6ad9-6054-4a14-b8c5-fbb58a25635d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:47.042605 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ad5386c5-5081-44a2-864d-82984fa9817a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:47.114061 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 840/1650] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:47.114932 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c6ad9-6054-4a14-b8c5-fbb58a25635d None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:47.126166 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 811/1651] 10.222.0.83 () {58 vars in 1059 bytes} [Mon Aug 29 15:37:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:47.126326 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c6ad9-6054-4a14-b8c5-fbb58a25635d None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:47.126962 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5386c5-5081-44a2-864d-82984fa9817a None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:47.128346 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ad5386c5-5081-44a2-864d-82984fa9817a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:47.131229 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b82ee1-a700-4248-8732-d01a2f43cbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:47.132655 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b82ee1-a700-4248-8732-d01a2f43cbda admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:47.133141 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b82ee1-a700-4248-8732-d01a2f43cbda admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:47.133428 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b82ee1-a700-4248-8732-d01a2f43cbda admin admin] PATH_INFO: `/v3/projects/6c64636bd88f4ac4aec1a8512c3e3107/users/193f305b229e4879ba3da249c3a326f7/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:47.135455 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b82ee1-a700-4248-8732-d01a2f43cbda admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c64636bd88f4ac4aec1a8512c3e3107, user_id=193f305b229e4879ba3da249c3a326f7, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:47.138190 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b82ee1-a700-4248-8732-d01a2f43cbda admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:47.143512 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5386c5-5081-44a2-864d-82984fa9817a None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:47.149260 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 841/1652] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:37:47 2022] PUT /identity/v3/projects/6c64636bd88f4ac4aec1a8512c3e3107/users/193f305b229e4879ba3da249c3a326f7/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:47.150041 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b82ee1-a700-4248-8732-d01a2f43cbda admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:47.179455 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:47.203818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fbe5e0-504b-4220-8b0b-1158cd9f1eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:47.204466 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fbe5e0-504b-4220-8b0b-1158cd9f1eca admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:47.204732 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fbe5e0-504b-4220-8b0b-1158cd9f1eca admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:47.205000 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fbe5e0-504b-4220-8b0b-1158cd9f1eca admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:47.205631 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fbe5e0-504b-4220-8b0b-1158cd9f1eca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:47.207273 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fbe5e0-504b-4220-8b0b-1158cd9f1eca admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:47.217647 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b82ee1-a700-4248-8732-d01a2f43cbda admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:47.218205 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 812/1653] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:37:47.219616 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fbe5e0-504b-4220-8b0b-1158cd9f1eca admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:47.222931 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4534126c-c901-46b3-802b-91aaa865392d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:47.223633 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534126c-c901-46b3-802b-91aaa865392d admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:47.223903 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534126c-c901-46b3-802b-91aaa865392d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:47.224170 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534126c-c901-46b3-802b-91aaa865392d admin admin] PATH_INFO: `/v3/projects/ca0de5a5e0b04a10a89e50800c0a0f28/users/4f5210a00e48424abc9a4f59f7984ad8/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:47.226313 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4534126c-c901-46b3-802b-91aaa865392d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca0de5a5e0b04a10a89e50800c0a0f28, user_id=4f5210a00e48424abc9a4f59f7984ad8, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:47.229180 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4534126c-c901-46b3-802b-91aaa865392d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:47.230001 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fbe5e0-504b-4220-8b0b-1158cd9f1eca admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:47.235118 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0366a2af-516e-480d-9834-08225f4878b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:47.235770 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366a2af-516e-480d-9834-08225f4878b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:47.236048 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366a2af-516e-480d-9834-08225f4878b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:47.236321 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366a2af-516e-480d-9834-08225f4878b5 admin admin] PATH_INFO: `/v3/projects/59bd6f7ddce4492eab64b95320608fa8/users/7c370274f3684be08cb92412ba00c695/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:47.238242 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0366a2af-516e-480d-9834-08225f4878b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59bd6f7ddce4492eab64b95320608fa8, user_id=7c370274f3684be08cb92412ba00c695, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:47.240005 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 842/1654] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:37:47 2022] PUT /identity/v3/projects/ca0de5a5e0b04a10a89e50800c0a0f28/users/4f5210a00e48424abc9a4f59f7984ad8/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:47.241014 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0366a2af-516e-480d-9834-08225f4878b5 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:47.241191 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4534126c-c901-46b3-802b-91aaa865392d admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:47.258702 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 813/1655] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:37:47 2022] PUT /identity/v3/projects/59bd6f7ddce4492eab64b95320608fa8/users/7c370274f3684be08cb92412ba00c695/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:47.259709 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0366a2af-516e-480d-9834-08225f4878b5 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:47.261460 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0366a2af-516e-480d-9834-08225f4878b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:47.290650 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:47.310604 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4534126c-c901-46b3-802b-91aaa865392d admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:47.323419 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0366a2af-516e-480d-9834-08225f4878b5 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:47.326979 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e334e-dcef-45d9-83af-55543d6c6097 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:47.327619 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e334e-dcef-45d9-83af-55543d6c6097 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:47.327899 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e334e-dcef-45d9-83af-55543d6c6097 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:47.328169 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e334e-dcef-45d9-83af-55543d6c6097 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:47.367696 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a1759-0389-4aa5-8127-789f4a528784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:47.368321 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a1759-0389-4aa5-8127-789f4a528784 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:47.368604 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a1759-0389-4aa5-8127-789f4a528784 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:47.368879 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a1759-0389-4aa5-8127-789f4a528784 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:47.369528 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940a1759-0389-4aa5-8127-789f4a528784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:47.371177 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940a1759-0389-4aa5-8127-789f4a528784 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:47.381954 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 843/1656] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:37:47.383074 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a1759-0389-4aa5-8127-789f4a528784 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:47.396904 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e334e-dcef-45d9-83af-55543d6c6097 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:47.398903 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e334e-dcef-45d9-83af-55543d6c6097 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:47.408546 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 814/1657] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:37:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:37:47.409913 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111d1eb-12b1-4033-b2a3-6760f72656b1 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:47.410201 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111d1eb-12b1-4033-b2a3-6760f72656b1 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:47.410474 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111d1eb-12b1-4033-b2a3-6760f72656b1 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:47.411739 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 815/1658] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 15:37:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:37:47.412876 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd92e26-bdfe-4c5f-ae8f-53833a7c6f64 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:47.413157 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd92e26-bdfe-4c5f-ae8f-53833a7c6f64 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:47.413428 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd92e26-bdfe-4c5f-ae8f-53833a7c6f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:47.451034 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-0bd92e26-bdfe-4c5f-ae8f-53833a7c6f64 None None] MFA Rules not processed for user `193f305b229e4879ba3da249c3a326f7`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:47.452288 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0bd92e26-bdfe-4c5f-ae8f-53833a7c6f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:47.461289 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a1759-0389-4aa5-8127-789f4a528784 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:47.468572 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2f4a9-4985-44c1-9cb2-8d7495749fbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:47.469308 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2f4a9-4985-44c1-9cb2-8d7495749fbd service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:47.469591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2f4a9-4985-44c1-9cb2-8d7495749fbd service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:47.469899 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2f4a9-4985-44c1-9cb2-8d7495749fbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:47.472416 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c4c2f4a9-4985-44c1-9cb2-8d7495749fbd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:47.522750 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:47.534873 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 816/1659] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:47 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:47.535633 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd92e26-bdfe-4c5f-ae8f-53833a7c6f64 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:47.546100 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd92e26-bdfe-4c5f-ae8f-53833a7c6f64 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:47.551148 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff27d1-b5d5-429d-a657-620f0daa28c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:47.551815 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff27d1-b5d5-429d-a657-620f0daa28c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:47.552124 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff27d1-b5d5-429d-a657-620f0daa28c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:47.552399 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff27d1-b5d5-429d-a657-620f0daa28c5 admin admin] PATH_INFO: `/v3/projects/23102ab5fb294dd58fbce2d1550b0c64/users/f8045d0542154b06b845a173a438d6e2/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:47.554955 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff27d1-b5d5-429d-a657-620f0daa28c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23102ab5fb294dd58fbce2d1550b0c64, user_id=f8045d0542154b06b845a173a438d6e2, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:47.557674 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff27d1-b5d5-429d-a657-620f0daa28c5 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:47.558676 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c2f4a9-4985-44c1-9cb2-8d7495749fbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:47.561321 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c2f4a9-4985-44c1-9cb2-8d7495749fbd service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:47.569853 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 817/1660] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:37:47 2022] PUT /identity/v3/projects/23102ab5fb294dd58fbce2d1550b0c64/users/f8045d0542154b06b845a173a438d6e2/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:47.571122 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270474a-e87d-4396-a7be-cddea06ebfe6 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:47.571408 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270474a-e87d-4396-a7be-cddea06ebfe6 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:47.571689 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270474a-e87d-4396-a7be-cddea06ebfe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:47.586097 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 844/1661] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:37:47 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:37:47.605197 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe23993-f05f-4746-906b-4c864354e6d2 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:47.606081 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe23993-f05f-4746-906b-4c864354e6d2 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:47.606910 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe23993-f05f-4746-906b-4c864354e6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:47.626727 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-2270474a-e87d-4396-a7be-cddea06ebfe6 None None] MFA Rules not processed for user `4f5210a00e48424abc9a4f59f7984ad8`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:47.628874 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2270474a-e87d-4396-a7be-cddea06ebfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:47.647201 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-dfe23993-f05f-4746-906b-4c864354e6d2 None None] MFA Rules not processed for user `7c370274f3684be08cb92412ba00c695`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:47.649343 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-dfe23993-f05f-4746-906b-4c864354e6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:47.655784 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:47.730940 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 818/1662] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:47 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:47.732165 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270474a-e87d-4396-a7be-cddea06ebfe6 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:47.764820 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 845/1663] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:47 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:47.766650 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1012e9-b6f2-4888-bef5-16e96b81afac None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:47.767183 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1012e9-b6f2-4888-bef5-16e96b81afac None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:47.767516 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1012e9-b6f2-4888-bef5-16e96b81afac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:47.816010 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-6f1012e9-b6f2-4888-bef5-16e96b81afac None None] MFA Rules not processed for user `c190fa4a280c41c684130e069bee99eb`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:47.817185 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6f1012e9-b6f2-4888-bef5-16e96b81afac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:47.830743 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270474a-e87d-4396-a7be-cddea06ebfe6 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:47.836271 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97999e14-eca6-42b7-a78d-7e43c83b35bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:47.836940 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97999e14-eca6-42b7-a78d-7e43c83b35bf admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:47.837220 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97999e14-eca6-42b7-a78d-7e43c83b35bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:47.837491 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97999e14-eca6-42b7-a78d-7e43c83b35bf admin admin] PATH_INFO: `/v3/projects/ee8315fd8e39404c892af3fa6b2c29af/users/26ac52edd08042878cd0d54a6584058f/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:47.839468 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97999e14-eca6-42b7-a78d-7e43c83b35bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee8315fd8e39404c892af3fa6b2c29af, user_id=26ac52edd08042878cd0d54a6584058f, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:47.842167 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97999e14-eca6-42b7-a78d-7e43c83b35bf admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:47.855733 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 819/1664] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:37:47 2022] PUT /identity/v3/projects/ee8315fd8e39404c892af3fa6b2c29af/users/26ac52edd08042878cd0d54a6584058f/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:47.860628 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21e56b-f63a-42ae-9ae4-807f10ab818b None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:47.861645 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21e56b-f63a-42ae-9ae4-807f10ab818b None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:47.861645 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21e56b-f63a-42ae-9ae4-807f10ab818b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:47.896323 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 846/1665] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 15:37:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:47.897890 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1012e9-b6f2-4888-bef5-16e96b81afac None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:47.899532 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6f1012e9-b6f2-4888-bef5-16e96b81afac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:47.900351 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-dc21e56b-f63a-42ae-9ae4-807f10ab818b None None] MFA Rules not processed for user `f8045d0542154b06b845a173a438d6e2`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:47.903451 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-dc21e56b-f63a-42ae-9ae4-807f10ab818b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:47.913856 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1012e9-b6f2-4888-bef5-16e96b81afac None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:47.955213 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:47.972770 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc780f5a-b8f7-4ca5-bfd1-35a9cae78cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:47.973404 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc780f5a-b8f7-4ca5-bfd1-35a9cae78cf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:47.973682 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc780f5a-b8f7-4ca5-bfd1-35a9cae78cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:47.973953 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc780f5a-b8f7-4ca5-bfd1-35a9cae78cf3 admin admin] PATH_INFO: `/v3/projects/d8f485f533134df888c3395ef7e662a0` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:47.975201 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc780f5a-b8f7-4ca5-bfd1-35a9cae78cf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8f485f533134df888c3395ef7e662a0)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:47.977118 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc780f5a-b8f7-4ca5-bfd1-35a9cae78cf3 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:47.979063 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 820/1666] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:47 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:47.980234 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f4a5b-252a-454e-a44e-56288ce5cd87 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:47.980527 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f4a5b-252a-454e-a44e-56288ce5cd87 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:47.980801 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f4a5b-252a-454e-a44e-56288ce5cd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:48.011925 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-d47f4a5b-252a-454e-a44e-56288ce5cd87 None None] MFA Rules not processed for user `26ac52edd08042878cd0d54a6584058f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:48.013417 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d47f4a5b-252a-454e-a44e-56288ce5cd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:48.024548 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:48.031620 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-dc780f5a-b8f7-4ca5-bfd1-35a9cae78cf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8f485f533134df888c3395ef7e662a0', 'request_id': 'req-dc780f5a-b8f7-4ca5-bfd1-35a9cae78cf3'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:48.039107 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-dc780f5a-b8f7-4ca5-bfd1-35a9cae78cf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8f485f533134df888c3395ef7e662a0', 'request_id': 'req-dc780f5a-b8f7-4ca5-bfd1-35a9cae78cf3'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:48.046277 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-dc780f5a-b8f7-4ca5-bfd1-35a9cae78cf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8f485f533134df888c3395ef7e662a0', 'request_id': 'req-dc780f5a-b8f7-4ca5-bfd1-35a9cae78cf3'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:48.057226 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-dc780f5a-b8f7-4ca5-bfd1-35a9cae78cf3 admin admin] The token cache is being invalidate because project d8f485f533134df888c3395ef7e662a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:37:48.057443 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-dc780f5a-b8f7-4ca5-bfd1-35a9cae78cf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:48.058089 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-dc780f5a-b8f7-4ca5-bfd1-35a9cae78cf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:48.059649 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 847/1667] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:37:47 2022] DELETE /identity/v3/projects/d8f485f533134df888c3395ef7e662a0 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:48.060401 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc780f5a-b8f7-4ca5-bfd1-35a9cae78cf3 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:48.062917 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-dc780f5a-b8f7-4ca5-bfd1-35a9cae78cf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:48.093493 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 821/1668] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:47 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:48.094596 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f4a5b-252a-454e-a44e-56288ce5cd87 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:48.096364 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d47f4a5b-252a-454e-a44e-56288ce5cd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:48.139922 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc780f5a-b8f7-4ca5-bfd1-35a9cae78cf3 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:48.145685 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5dce2a-0582-4499-8f05-3fc60080dd3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:48.146292 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5dce2a-0582-4499-8f05-3fc60080dd3c service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:48.146575 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5dce2a-0582-4499-8f05-3fc60080dd3c service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:48.147582 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5dce2a-0582-4499-8f05-3fc60080dd3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:48.149413 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0c5dce2a-0582-4499-8f05-3fc60080dd3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:48.169556 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f4a5b-252a-454e-a44e-56288ce5cd87 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:48.208051 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5dce2a-0582-4499-8f05-3fc60080dd3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:48.210365 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5dce2a-0582-4499-8f05-3fc60080dd3c service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:48.219567 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 848/1669] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:37:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:37:48.224864 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25189855-ddcc-4b31-b562-b148b52a6d60 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:48.225230 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25189855-ddcc-4b31-b562-b148b52a6d60 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:48.225546 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25189855-ddcc-4b31-b562-b148b52a6d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:48.236193 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf009c7-f0d7-4019-80f5-bb3dbbc3f0b5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:48.236862 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf009c7-f0d7-4019-80f5-bb3dbbc3f0b5 service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:48.237297 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf009c7-f0d7-4019-80f5-bb3dbbc3f0b5 service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:48.237411 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf009c7-f0d7-4019-80f5-bb3dbbc3f0b5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:48.239237 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-dcf009c7-f0d7-4019-80f5-bb3dbbc3f0b5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:48.250220 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-25189855-ddcc-4b31-b562-b148b52a6d60 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:48.250896 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf009c7-f0d7-4019-80f5-bb3dbbc3f0b5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:48.251442 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-25189855-ddcc-4b31-b562-b148b52a6d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:48.252517 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf009c7-f0d7-4019-80f5-bb3dbbc3f0b5 service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:48.262904 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 822/1670] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:37:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:37:48.263948 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf009c7-f0d7-4019-80f5-bb3dbbc3f0b5 service placement] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:48.267405 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-dcf009c7-f0d7-4019-80f5-bb3dbbc3f0b5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:48.275425 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:48.332532 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 849/1671] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:48.339676 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25189855-ddcc-4b31-b562-b148b52a6d60 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:48.341646 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf009c7-f0d7-4019-80f5-bb3dbbc3f0b5 service placement] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:48.346382 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c029a-5268-4fca-bf83-362186483941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:48.347136 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c029a-5268-4fca-bf83-362186483941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:48.347332 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c029a-5268-4fca-bf83-362186483941 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:48.347606 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c029a-5268-4fca-bf83-362186483941 admin admin] PATH_INFO: `/v3/users/e233d95040244c80a83d0383408c1209` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:48.348767 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c029a-5268-4fca-bf83-362186483941 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e233d95040244c80a83d0383408c1209)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:48.351099 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c029a-5268-4fca-bf83-362186483941 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:48.366829 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25189855-ddcc-4b31-b562-b148b52a6d60 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:48.375157 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff032fa2-9035-4f34-8e73-4fac1f1a8375 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:48.375800 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff032fa2-9035-4f34-8e73-4fac1f1a8375 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:48.376141 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff032fa2-9035-4f34-8e73-4fac1f1a8375 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:48.376418 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff032fa2-9035-4f34-8e73-4fac1f1a8375 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:48.379232 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ff032fa2-9035-4f34-8e73-4fac1f1a8375 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:48.399913 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:48.409506 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-262c029a-5268-4fca-bf83-362186483941 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e233d95040244c80a83d0383408c1209'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:48.410215 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-262c029a-5268-4fca-bf83-362186483941 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e233d95040244c80a83d0383408c1209'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:48.417966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-262c029a-5268-4fca-bf83-362186483941 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e233d95040244c80a83d0383408c1209'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:48.425069 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-262c029a-5268-4fca-bf83-362186483941 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e233d95040244c80a83d0383408c1209'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:48.425789 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-262c029a-5268-4fca-bf83-362186483941 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e233d95040244c80a83d0383408c1209'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:48.444791 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 823/1672] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:37:48 2022] DELETE /identity/v3/users/e233d95040244c80a83d0383408c1209 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:48.446144 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587c1eb-8dbf-40e5-aafb-a87efa39befd None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:48.446410 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587c1eb-8dbf-40e5-aafb-a87efa39befd None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:48.446684 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587c1eb-8dbf-40e5-aafb-a87efa39befd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:48.466063 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-5587c1eb-8dbf-40e5-aafb-a87efa39befd None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:48.466339 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff032fa2-9035-4f34-8e73-4fac1f1a8375 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:48.467279 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5587c1eb-8dbf-40e5-aafb-a87efa39befd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:48.468199 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff032fa2-9035-4f34-8e73-4fac1f1a8375 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:48.478119 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 850/1673] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:37:48 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:37:48.479077 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff032fa2-9035-4f34-8e73-4fac1f1a8375 service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:48.480518 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ff032fa2-9035-4f34-8e73-4fac1f1a8375 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:48.495205 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff032fa2-9035-4f34-8e73-4fac1f1a8375 service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:48.532737 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 824/1674] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:48.537463 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281785b-0fd7-41ae-81f0-a37fadbc54ef None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:48.537817 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281785b-0fd7-41ae-81f0-a37fadbc54ef None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:48.538191 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281785b-0fd7-41ae-81f0-a37fadbc54ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:48.560015 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-e281785b-0fd7-41ae-81f0-a37fadbc54ef None None] MFA Rules not processed for user `a726e7ddb8914b72925d217021404000`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:48.560422 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e281785b-0fd7-41ae-81f0-a37fadbc54ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:48.569919 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028117d2-12a7-410c-a29e-66dd4473f73a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:48.570744 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028117d2-12a7-410c-a29e-66dd4473f73a service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:48.571017 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028117d2-12a7-410c-a29e-66dd4473f73a service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:48.571339 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028117d2-12a7-410c-a29e-66dd4473f73a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:48.573114 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-028117d2-12a7-410c-a29e-66dd4473f73a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:48.579988 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:48.618414 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 825/1675] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:48.619690 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d66d1-d291-414d-a255-2cb8dd1f9365 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:48.619971 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d66d1-d291-414d-a255-2cb8dd1f9365 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:48.620274 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d66d1-d291-414d-a255-2cb8dd1f9365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:48.638656 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028117d2-12a7-410c-a29e-66dd4473f73a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:48.639397 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-775d66d1-d291-414d-a255-2cb8dd1f9365 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:48.640530 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028117d2-12a7-410c-a29e-66dd4473f73a service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:48.640626 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-775d66d1-d291-414d-a255-2cb8dd1f9365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:48.649049 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 826/1676] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:48.649826 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d66d1-d291-414d-a255-2cb8dd1f9365 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:48.652149 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 851/1677] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:37:48 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:37:48.652659 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028117d2-12a7-410c-a29e-66dd4473f73a service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:48.654005 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-028117d2-12a7-410c-a29e-66dd4473f73a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:48.659277 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d66d1-d291-414d-a255-2cb8dd1f9365 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:48.665363 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92964496-e8a3-4706-9ebe-bedefc1808a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:48.666043 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92964496-e8a3-4706-9ebe-bedefc1808a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:48.666381 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92964496-e8a3-4706-9ebe-bedefc1808a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:48.666745 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92964496-e8a3-4706-9ebe-bedefc1808a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:48.667432 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92964496-e8a3-4706-9ebe-bedefc1808a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:37:48.667766 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92964496-e8a3-4706-9ebe-bedefc1808a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:48.669457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92964496-e8a3-4706-9ebe-bedefc1808a3 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:48.669919 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028117d2-12a7-410c-a29e-66dd4473f73a service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:48.675832 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379d6ad-dabe-45f1-92bc-812f26cc90dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:48.676529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379d6ad-dabe-45f1-92bc-812f26cc90dd service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:48.676805 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379d6ad-dabe-45f1-92bc-812f26cc90dd service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:48.677079 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379d6ad-dabe-45f1-92bc-812f26cc90dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:48.679613 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1379d6ad-dabe-45f1-92bc-812f26cc90dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:48.686321 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 827/1678] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:37:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:37:48.686321 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92964496-e8a3-4706-9ebe-bedefc1808a3 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:48.688139 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-92964496-e8a3-4706-9ebe-bedefc1808a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:48.726287 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:48.756600 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1379d6ad-dabe-45f1-92bc-812f26cc90dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:48.758195 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1379d6ad-dabe-45f1-92bc-812f26cc90dd service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:48.763323 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92964496-e8a3-4706-9ebe-bedefc1808a3 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:48.767209 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52589b38-e445-44d0-aa5c-7d71f8c7add5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:48.767819 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52589b38-e445-44d0-aa5c-7d71f8c7add5 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:48.768097 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52589b38-e445-44d0-aa5c-7d71f8c7add5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:48.768370 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 852/1679] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:37:48 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:37:48.768502 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52589b38-e445-44d0-aa5c-7d71f8c7add5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:48.769166 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379d6ad-dabe-45f1-92bc-812f26cc90dd service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:48.779532 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52589b38-e445-44d0-aa5c-7d71f8c7add5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:48.781053 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52589b38-e445-44d0-aa5c-7d71f8c7add5 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:48.781520 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379d6ad-dabe-45f1-92bc-812f26cc90dd service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:48.786464 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6662a7-d8f1-4387-8531-ba463be3600e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:48.787174 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6662a7-d8f1-4387-8531-ba463be3600e admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:48.788074 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6662a7-d8f1-4387-8531-ba463be3600e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:48.788355 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6662a7-d8f1-4387-8531-ba463be3600e admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:48.788985 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6662a7-d8f1-4387-8531-ba463be3600e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:48.791050 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6662a7-d8f1-4387-8531-ba463be3600e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:48.793845 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 828/1680] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:37:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:37:48.794941 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52589b38-e445-44d0-aa5c-7d71f8c7add5 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:48.796728 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-52589b38-e445-44d0-aa5c-7d71f8c7add5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:48.821829 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52589b38-e445-44d0-aa5c-7d71f8c7add5 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:48.826275 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 853/1681] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:37:48 2022] POST /identity/v3/projects => generated 401 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:48.827331 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6662a7-d8f1-4387-8531-ba463be3600e admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:48.827768 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c05ec-0c6b-4c51-a61d-4931c3b837f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:48.828384 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c05ec-0c6b-4c51-a61d-4931c3b837f3 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:48.828670 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c05ec-0c6b-4c51-a61d-4931c3b837f3 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:48.828945 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c05ec-0c6b-4c51-a61d-4931c3b837f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:48.830705 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-914c05ec-0c6b-4c51-a61d-4931c3b837f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:48.908153 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c05ec-0c6b-4c51-a61d-4931c3b837f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:48.910083 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c05ec-0c6b-4c51-a61d-4931c3b837f3 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:48.920884 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6662a7-d8f1-4387-8531-ba463be3600e admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:48.921232 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 829/1682] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:37:48 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:37:48.922032 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c05ec-0c6b-4c51-a61d-4931c3b837f3 service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:48.927854 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57208f9f-948a-42af-bc0f-d9db5a6d72a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:48.929225 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57208f9f-948a-42af-bc0f-d9db5a6d72a2 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:48.929662 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57208f9f-948a-42af-bc0f-d9db5a6d72a2 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:48.930062 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57208f9f-948a-42af-bc0f-d9db5a6d72a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:48.932260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-57208f9f-948a-42af-bc0f-d9db5a6d72a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:48.934441 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c05ec-0c6b-4c51-a61d-4931c3b837f3 service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:49.002281 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:49.018572 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771c140-049b-4290-aaf5-10a80c721542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:49.019305 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771c140-049b-4290-aaf5-10a80c721542 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:49.019642 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771c140-049b-4290-aaf5-10a80c721542 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:49.020306 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771c140-049b-4290-aaf5-10a80c721542 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:49.020729 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4771c140-049b-4290-aaf5-10a80c721542 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:49.023508 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4771c140-049b-4290-aaf5-10a80c721542 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:49.025548 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57208f9f-948a-42af-bc0f-d9db5a6d72a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:49.027462 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57208f9f-948a-42af-bc0f-d9db5a6d72a2 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:49.041063 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 854/1683] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:37:48 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:37:49.042310 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57208f9f-948a-42af-bc0f-d9db5a6d72a2 service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:49.047883 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 830/1684] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:37:48 2022] POST /identity/v3/users => generated 301 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:49.051860 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771c140-049b-4290-aaf5-10a80c721542 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:49.054208 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57208f9f-948a-42af-bc0f-d9db5a6d72a2 service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:49.060933 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776db1fa-566d-47b0-8201-ee1871da8fac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:49.061945 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776db1fa-566d-47b0-8201-ee1871da8fac service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:49.062710 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776db1fa-566d-47b0-8201-ee1871da8fac service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:49.062710 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776db1fa-566d-47b0-8201-ee1871da8fac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:49.065162 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-776db1fa-566d-47b0-8201-ee1871da8fac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:49.068868 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771c140-049b-4290-aaf5-10a80c721542 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:49.090651 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660e3d6-036c-44d4-a6b3-98f6814e68c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:49.091307 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660e3d6-036c-44d4-a6b3-98f6814e68c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:49.091578 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660e3d6-036c-44d4-a6b3-98f6814e68c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:49.091852 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660e3d6-036c-44d4-a6b3-98f6814e68c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:49.092655 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8660e3d6-036c-44d4-a6b3-98f6814e68c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:49.094270 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8660e3d6-036c-44d4-a6b3-98f6814e68c9 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:49.106531 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 831/1685] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:37:49.110738 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660e3d6-036c-44d4-a6b3-98f6814e68c9 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:49.125864 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660e3d6-036c-44d4-a6b3-98f6814e68c9 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:49.133968 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035bee71-b8fe-4c1e-a604-03e15e9c757e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:49.134718 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bee71-b8fe-4c1e-a604-03e15e9c757e admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:49.135042 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:49.135489 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bee71-b8fe-4c1e-a604-03e15e9c757e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:49.135765 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bee71-b8fe-4c1e-a604-03e15e9c757e admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:49.136434 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035bee71-b8fe-4c1e-a604-03e15e9c757e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:49.146381 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035bee71-b8fe-4c1e-a604-03e15e9c757e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:49.163628 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776db1fa-566d-47b0-8201-ee1871da8fac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:49.163955 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 832/1686] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:37:49.164868 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035bee71-b8fe-4c1e-a604-03e15e9c757e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:49.165484 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776db1fa-566d-47b0-8201-ee1871da8fac service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:49.171774 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-035bee71-b8fe-4c1e-a604-03e15e9c757e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:49.176121 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 855/1687] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:37:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:37:49.176968 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776db1fa-566d-47b0-8201-ee1871da8fac service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:49.178688 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-776db1fa-566d-47b0-8201-ee1871da8fac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:49.185034 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035bee71-b8fe-4c1e-a604-03e15e9c757e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:49.190039 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203533c-dc68-493f-a39d-e1a51b4dcea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:49.190677 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203533c-dc68-493f-a39d-e1a51b4dcea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:49.190973 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203533c-dc68-493f-a39d-e1a51b4dcea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:49.191275 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203533c-dc68-493f-a39d-e1a51b4dcea8 admin admin] PATH_INFO: `/v3/projects/bb6c0505f505498f94765986baa1aa1c` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:49.192436 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3203533c-dc68-493f-a39d-e1a51b4dcea8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb6c0505f505498f94765986baa1aa1c)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:49.193454 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-3203533c-dc68-493f-a39d-e1a51b4dcea8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:37:49.193454 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 15:37:49.193454 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 15:37:49.193791 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776db1fa-566d-47b0-8201-ee1871da8fac service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:49.194711 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3203533c-dc68-493f-a39d-e1a51b4dcea8 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:49.199035 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ee09a-f629-4c2e-aefa-5287878e5751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:49.199824 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ee09a-f629-4c2e-aefa-5287878e5751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:49.200159 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ee09a-f629-4c2e-aefa-5287878e5751 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:49.200517 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ee09a-f629-4c2e-aefa-5287878e5751 admin admin] PATH_INFO: `/v3/users/e5218d9035444dee8679728c60147682` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:49.201854 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0ee09a-f629-4c2e-aefa-5287878e5751 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5218d9035444dee8679728c60147682)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:49.202945 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-6a0ee09a-f629-4c2e-aefa-5287878e5751 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:37:49.202945 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 15:37:49.202945 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 15:37:49.204267 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0ee09a-f629-4c2e-aefa-5287878e5751 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:49.261020 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3203533c-dc68-493f-a39d-e1a51b4dcea8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb6c0505f505498f94765986baa1aa1c', 'request_id': 'req-3203533c-dc68-493f-a39d-e1a51b4dcea8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:49.268119 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3203533c-dc68-493f-a39d-e1a51b4dcea8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb6c0505f505498f94765986baa1aa1c', 'request_id': 'req-3203533c-dc68-493f-a39d-e1a51b4dcea8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:49.278566 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6a0ee09a-f629-4c2e-aefa-5287878e5751 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5218d9035444dee8679728c60147682'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:49.279323 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6a0ee09a-f629-4c2e-aefa-5287878e5751 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5218d9035444dee8679728c60147682'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:49.283602 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3203533c-dc68-493f-a39d-e1a51b4dcea8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb6c0505f505498f94765986baa1aa1c', 'request_id': 'req-3203533c-dc68-493f-a39d-e1a51b4dcea8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:49.297345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3203533c-dc68-493f-a39d-e1a51b4dcea8 admin admin] The token cache is being invalidate because project bb6c0505f505498f94765986baa1aa1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:37:49.297633 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3203533c-dc68-493f-a39d-e1a51b4dcea8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:49.298397 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3203533c-dc68-493f-a39d-e1a51b4dcea8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:49.299969 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 833/1688] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:37:49 2022] DELETE /identity/v3/projects/bb6c0505f505498f94765986baa1aa1c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:49.303188 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6a0ee09a-f629-4c2e-aefa-5287878e5751 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5218d9035444dee8679728c60147682'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:49.303312 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203533c-dc68-493f-a39d-e1a51b4dcea8 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:49.303312 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3203533c-dc68-493f-a39d-e1a51b4dcea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:49.308177 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6a0ee09a-f629-4c2e-aefa-5287878e5751 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5218d9035444dee8679728c60147682'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:49.318804 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6a0ee09a-f629-4c2e-aefa-5287878e5751 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5218d9035444dee8679728c60147682'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:49.325713 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 856/1689] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:37:49 2022] DELETE /identity/v3/users/e5218d9035444dee8679728c60147682 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:49.326505 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ee09a-f629-4c2e-aefa-5287878e5751 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:49.329626 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6a0ee09a-f629-4c2e-aefa-5287878e5751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:49.378085 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203533c-dc68-493f-a39d-e1a51b4dcea8 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:49.397874 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ee09a-f629-4c2e-aefa-5287878e5751 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:49.402523 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df238c3a-8e99-4ed7-9576-d952c68d5286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:49.403207 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df238c3a-8e99-4ed7-9576-d952c68d5286 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:49.403487 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df238c3a-8e99-4ed7-9576-d952c68d5286 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:49.403763 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df238c3a-8e99-4ed7-9576-d952c68d5286 admin admin] PATH_INFO: `/v3/projects/3ab5abb97d5e40b0a4dea82546dcb92c/users/06856f1488e44bde85de23a5effddbdd/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:49.412223 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:49.419522 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df238c3a-8e99-4ed7-9576-d952c68d5286 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ab5abb97d5e40b0a4dea82546dcb92c, user_id=06856f1488e44bde85de23a5effddbdd, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:49.422501 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df238c3a-8e99-4ed7-9576-d952c68d5286 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:49.437475 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 857/1690] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:37:49 2022] PUT /identity/v3/projects/3ab5abb97d5e40b0a4dea82546dcb92c/users/06856f1488e44bde85de23a5effddbdd/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:49.438859 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8ac65-56eb-4119-bba6-93d19da89dcb None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:49.439182 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8ac65-56eb-4119-bba6-93d19da89dcb None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:49.439453 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8ac65-56eb-4119-bba6-93d19da89dcb None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:49.440680 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 858/1691] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 15:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:37:49.441364 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8ac65-56eb-4119-bba6-93d19da89dcb None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:49.442971 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4dd8ac65-56eb-4119-bba6-93d19da89dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:49.452461 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd5bdf-714c-4386-9ee4-9487b505b5c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:49.453134 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd5bdf-714c-4386-9ee4-9487b505b5c8 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:49.453415 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd5bdf-714c-4386-9ee4-9487b505b5c8 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:49.453688 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd5bdf-714c-4386-9ee4-9487b505b5c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:49.455471 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-63fd5bdf-714c-4386-9ee4-9487b505b5c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:49.484337 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:49.514287 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8ac65-56eb-4119-bba6-93d19da89dcb None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:49.518081 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd5bdf-714c-4386-9ee4-9487b505b5c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:49.518949 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba6886d-4ac8-4b9c-bd03-2ea9e24c65ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:49.519609 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6886d-4ac8-4b9c-bd03-2ea9e24c65ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:49.519726 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd5bdf-714c-4386-9ee4-9487b505b5c8 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:49.519888 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6886d-4ac8-4b9c-bd03-2ea9e24c65ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:49.520175 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6886d-4ac8-4b9c-bd03-2ea9e24c65ef admin admin] PATH_INFO: `/v3/users/193f305b229e4879ba3da249c3a326f7` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:49.521300 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba6886d-4ac8-4b9c-bd03-2ea9e24c65ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=193f305b229e4879ba3da249c3a326f7)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:49.524109 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba6886d-4ac8-4b9c-bd03-2ea9e24c65ef admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:49.529394 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 834/1692] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:37:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:37:49.530424 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4e608-6898-48ea-b44c-61cc15d9db54 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:49.530714 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4e608-6898-48ea-b44c-61cc15d9db54 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:49.530987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4e608-6898-48ea-b44c-61cc15d9db54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:49.552029 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-7ec4e608-6898-48ea-b44c-61cc15d9db54 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:49.554057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7ec4e608-6898-48ea-b44c-61cc15d9db54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:49.563253 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 835/1693] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:49.564661 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568e571-2e42-41ab-a3a0-6c0d0e648509 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:49.565103 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568e571-2e42-41ab-a3a0-6c0d0e648509 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:49.565375 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568e571-2e42-41ab-a3a0-6c0d0e648509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:49.587349 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-d568e571-2e42-41ab-a3a0-6c0d0e648509 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:49.587595 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-eba6886d-4ac8-4b9c-bd03-2ea9e24c65ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '193f305b229e4879ba3da249c3a326f7'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:49.588518 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-eba6886d-4ac8-4b9c-bd03-2ea9e24c65ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '193f305b229e4879ba3da249c3a326f7'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:49.588677 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d568e571-2e42-41ab-a3a0-6c0d0e648509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:49.597691 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 836/1694] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:49.602764 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02792b05-31c2-4933-b02c-f7c62fb7f769 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:49.603074 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02792b05-31c2-4933-b02c-f7c62fb7f769 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:49.603355 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02792b05-31c2-4933-b02c-f7c62fb7f769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:49.611524 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-eba6886d-4ac8-4b9c-bd03-2ea9e24c65ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '193f305b229e4879ba3da249c3a326f7'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:49.621915 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-eba6886d-4ac8-4b9c-bd03-2ea9e24c65ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '193f305b229e4879ba3da249c3a326f7'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:49.624885 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-02792b05-31c2-4933-b02c-f7c62fb7f769 None None] MFA Rules not processed for user `253947a5ef294d2bb828761873251bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:49.626089 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-02792b05-31c2-4933-b02c-f7c62fb7f769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:49.630789 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-eba6886d-4ac8-4b9c-bd03-2ea9e24c65ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '193f305b229e4879ba3da249c3a326f7'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:49.638710 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 859/1695] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:37:49 2022] DELETE /identity/v3/users/193f305b229e4879ba3da249c3a326f7 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:49.640094 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba6886d-4ac8-4b9c-bd03-2ea9e24c65ef admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:49.641470 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-eba6886d-4ac8-4b9c-bd03-2ea9e24c65ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:49.714053 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 837/1696] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 15:37:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:49.715047 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02792b05-31c2-4933-b02c-f7c62fb7f769 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:49.716641 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-02792b05-31c2-4933-b02c-f7c62fb7f769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:49.741298 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba6886d-4ac8-4b9c-bd03-2ea9e24c65ef admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:49.745326 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138f33b-14f5-4e5a-8027-3214fcfd3d03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:49.745970 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138f33b-14f5-4e5a-8027-3214fcfd3d03 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:49.746289 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138f33b-14f5-4e5a-8027-3214fcfd3d03 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:49.746555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138f33b-14f5-4e5a-8027-3214fcfd3d03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:49.748969 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a138f33b-14f5-4e5a-8027-3214fcfd3d03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:49.824197 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02792b05-31c2-4933-b02c-f7c62fb7f769 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:49.826630 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138f33b-14f5-4e5a-8027-3214fcfd3d03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:49.828010 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138f33b-14f5-4e5a-8027-3214fcfd3d03 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:49.828328 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e16a1-df31-440b-b8d2-3001ef89f4d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:49.828952 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e16a1-df31-440b-b8d2-3001ef89f4d2 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:49.829233 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e16a1-df31-440b-b8d2-3001ef89f4d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:49.829516 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e16a1-df31-440b-b8d2-3001ef89f4d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:49.831382 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2b5e16a1-df31-440b-b8d2-3001ef89f4d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:49.842857 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:49.847007 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e16a1-df31-440b-b8d2-3001ef89f4d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:49.848515 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e16a1-df31-440b-b8d2-3001ef89f4d2 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:49.854780 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 860/1697] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:37:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:37:49.855829 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138f33b-14f5-4e5a-8027-3214fcfd3d03 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:49.859993 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 838/1698] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:37:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:37:49.860827 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a138f33b-14f5-4e5a-8027-3214fcfd3d03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:49.874210 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:49.962414 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e16a1-df31-440b-b8d2-3001ef89f4d2 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:49.964991 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2b5e16a1-df31-440b-b8d2-3001ef89f4d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:49.987464 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e16a1-df31-440b-b8d2-3001ef89f4d2 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:50.000167 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca34804-a22f-40c0-a016-dcf553576604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:50.006196 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138f33b-14f5-4e5a-8027-3214fcfd3d03 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:50.008669 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca34804-a22f-40c0-a016-dcf553576604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:50.009132 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca34804-a22f-40c0-a016-dcf553576604 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:50.011047 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca34804-a22f-40c0-a016-dcf553576604 admin admin] PATH_INFO: `/v3/users/66185070956b4ede93c2660d7e6a015e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:50.012034 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f35ed9-9d2a-4637-b05b-b6a5f3473084 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6b0f9835ed549cab91d684326be83fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:50.012818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca34804-a22f-40c0-a016-dcf553576604 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66185070956b4ede93c2660d7e6a015e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:50.012930 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f35ed9-9d2a-4637-b05b-b6a5f3473084 service glance] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:50.013253 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f35ed9-9d2a-4637-b05b-b6a5f3473084 service glance] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:50.017751 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca34804-a22f-40c0-a016-dcf553576604 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:50.018463 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f35ed9-9d2a-4637-b05b-b6a5f3473084 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:50.123311 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-dca34804-a22f-40c0-a016-dcf553576604 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66185070956b4ede93c2660d7e6a015e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:50.124070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-dca34804-a22f-40c0-a016-dcf553576604 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66185070956b4ede93c2660d7e6a015e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:50.137342 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-dca34804-a22f-40c0-a016-dcf553576604 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66185070956b4ede93c2660d7e6a015e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:50.149239 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-dca34804-a22f-40c0-a016-dcf553576604 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66185070956b4ede93c2660d7e6a015e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:50.150190 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-dca34804-a22f-40c0-a016-dcf553576604 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66185070956b4ede93c2660d7e6a015e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:50.155092 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f35ed9-9d2a-4637-b05b-b6a5f3473084 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:50.156584 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f35ed9-9d2a-4637-b05b-b6a5f3473084 service glance] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:50.169439 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 861/1699] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:37:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:37:50.170653 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f35ed9-9d2a-4637-b05b-b6a5f3473084 service glance] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:50.175996 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 839/1700] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:37:49 2022] DELETE /identity/v3/users/66185070956b4ede93c2660d7e6a015e => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:37:50.176140 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-33f35ed9-9d2a-4637-b05b-b6a5f3473084 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:50.176255 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca34804-a22f-40c0-a016-dcf553576604 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:50.176255 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-dca34804-a22f-40c0-a016-dcf553576604 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:50.195151 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f35ed9-9d2a-4637-b05b-b6a5f3473084 service glance] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:50.285942 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca34804-a22f-40c0-a016-dcf553576604 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:50.292955 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757fcca6-6fd7-4480-bc64-560c3f4cd8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:50.293886 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757fcca6-6fd7-4480-bc64-560c3f4cd8b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:50.294174 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757fcca6-6fd7-4480-bc64-560c3f4cd8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:50.294503 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757fcca6-6fd7-4480-bc64-560c3f4cd8b1 admin admin] PATH_INFO: `/v3/users/ac7202dcf050479d98b4ed87575249a7` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:50.295829 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757fcca6-6fd7-4480-bc64-560c3f4cd8b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac7202dcf050479d98b4ed87575249a7)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:50.298095 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757fcca6-6fd7-4480-bc64-560c3f4cd8b1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:50.312561 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f722df3-a7cf-418d-9562-6168f4fdf391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:50.313823 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f722df3-a7cf-418d-9562-6168f4fdf391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:50.314108 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f722df3-a7cf-418d-9562-6168f4fdf391 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:50.314381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f722df3-a7cf-418d-9562-6168f4fdf391 admin admin] PATH_INFO: `/v3/projects/6c64636bd88f4ac4aec1a8512c3e3107` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:50.315630 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f722df3-a7cf-418d-9562-6168f4fdf391 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c64636bd88f4ac4aec1a8512c3e3107)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:50.318412 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f722df3-a7cf-418d-9562-6168f4fdf391 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:50.358957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:50.359995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-757fcca6-6fd7-4480-bc64-560c3f4cd8b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac7202dcf050479d98b4ed87575249a7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:50.360979 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-757fcca6-6fd7-4480-bc64-560c3f4cd8b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac7202dcf050479d98b4ed87575249a7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:50.375712 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-757fcca6-6fd7-4480-bc64-560c3f4cd8b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac7202dcf050479d98b4ed87575249a7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:50.386315 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0f722df3-a7cf-418d-9562-6168f4fdf391 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c64636bd88f4ac4aec1a8512c3e3107', 'request_id': 'req-0f722df3-a7cf-418d-9562-6168f4fdf391'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:50.390866 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-757fcca6-6fd7-4480-bc64-560c3f4cd8b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac7202dcf050479d98b4ed87575249a7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:50.391904 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-757fcca6-6fd7-4480-bc64-560c3f4cd8b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac7202dcf050479d98b4ed87575249a7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:50.394432 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0f722df3-a7cf-418d-9562-6168f4fdf391 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c64636bd88f4ac4aec1a8512c3e3107', 'request_id': 'req-0f722df3-a7cf-418d-9562-6168f4fdf391'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:50.408108 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0f722df3-a7cf-418d-9562-6168f4fdf391 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c64636bd88f4ac4aec1a8512c3e3107', 'request_id': 'req-0f722df3-a7cf-418d-9562-6168f4fdf391'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:50.410228 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:50.425481 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0f722df3-a7cf-418d-9562-6168f4fdf391 admin admin] The token cache is being invalidate because project 6c64636bd88f4ac4aec1a8512c3e3107 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:37:50.425912 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0f722df3-a7cf-418d-9562-6168f4fdf391 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:50.426755 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0f722df3-a7cf-418d-9562-6168f4fdf391 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:50.431681 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 840/1701] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:37:50 2022] DELETE /identity/v3/users/ac7202dcf050479d98b4ed87575249a7 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:50.433141 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a854e-1a02-4aed-b825-73867c12df52 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:50.433426 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a854e-1a02-4aed-b825-73867c12df52 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:50.433699 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a854e-1a02-4aed-b825-73867c12df52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:50.436145 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 862/1702] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:37:50 2022] DELETE /identity/v3/projects/6c64636bd88f4ac4aec1a8512c3e3107 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:50.437144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f722df3-a7cf-418d-9562-6168f4fdf391 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:50.438543 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0f722df3-a7cf-418d-9562-6168f4fdf391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:50.455071 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-f27a854e-1a02-4aed-b825-73867c12df52 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:50.456584 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f27a854e-1a02-4aed-b825-73867c12df52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:50.528706 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 841/1703] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:50.531067 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0bdde-8ee3-446d-b792-38e5db723a1f None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:50.531067 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0bdde-8ee3-446d-b792-38e5db723a1f None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:50.531067 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0bdde-8ee3-446d-b792-38e5db723a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:50.555573 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a1b0bdde-8ee3-446d-b792-38e5db723a1f None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:50.556907 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a1b0bdde-8ee3-446d-b792-38e5db723a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:50.566216 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 842/1704] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:50.566909 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f722df3-a7cf-418d-9562-6168f4fdf391 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:50.567801 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d9aa4-cc7c-416a-806d-c2a7045cf6b7 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:50.568278 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d9aa4-cc7c-416a-806d-c2a7045cf6b7 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:50.568685 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d9aa4-cc7c-416a-806d-c2a7045cf6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:50.574596 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e9b91-e94c-41ce-b977-14faa42e1f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:50.575499 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e9b91-e94c-41ce-b977-14faa42e1f69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:50.576038 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e9b91-e94c-41ce-b977-14faa42e1f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:50.576731 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e9b91-e94c-41ce-b977-14faa42e1f69 admin admin] PATH_INFO: `/v3/projects/9ca7759bcbbb40c5b67f6dda70e3ae97` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:50.580316 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e9b91-e94c-41ce-b977-14faa42e1f69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ca7759bcbbb40c5b67f6dda70e3ae97)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:50.582594 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e9b91-e94c-41ce-b977-14faa42e1f69 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:50.594391 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-cb9d9aa4-cc7c-416a-806d-c2a7045cf6b7 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:50.595791 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-cb9d9aa4-cc7c-416a-806d-c2a7045cf6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:50.604844 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 843/1705] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:50.605590 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d9aa4-cc7c-416a-806d-c2a7045cf6b7 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:50.607047 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-cb9d9aa4-cc7c-416a-806d-c2a7045cf6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:50.640901 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c14e9b91-e94c-41ce-b977-14faa42e1f69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ca7759bcbbb40c5b67f6dda70e3ae97', 'request_id': 'req-c14e9b91-e94c-41ce-b977-14faa42e1f69'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:50.647251 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c14e9b91-e94c-41ce-b977-14faa42e1f69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ca7759bcbbb40c5b67f6dda70e3ae97', 'request_id': 'req-c14e9b91-e94c-41ce-b977-14faa42e1f69'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:50.656479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c14e9b91-e94c-41ce-b977-14faa42e1f69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ca7759bcbbb40c5b67f6dda70e3ae97', 'request_id': 'req-c14e9b91-e94c-41ce-b977-14faa42e1f69'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:50.672080 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c14e9b91-e94c-41ce-b977-14faa42e1f69 admin admin] The token cache is being invalidate because project 9ca7759bcbbb40c5b67f6dda70e3ae97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:37:50.672430 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c14e9b91-e94c-41ce-b977-14faa42e1f69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:50.673132 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c14e9b91-e94c-41ce-b977-14faa42e1f69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:50.674935 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 863/1706] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:37:50 2022] DELETE /identity/v3/projects/9ca7759bcbbb40c5b67f6dda70e3ae97 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:50.677276 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d9aa4-cc7c-416a-806d-c2a7045cf6b7 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:50.679896 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e9b91-e94c-41ce-b977-14faa42e1f69 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:50.681442 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c14e9b91-e94c-41ce-b977-14faa42e1f69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:50.735130 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd0b4a-c4fd-4d6e-bb5e-aaaf8f1487e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:50.735666 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd0b4a-c4fd-4d6e-bb5e-aaaf8f1487e7 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:50.736007 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd0b4a-c4fd-4d6e-bb5e-aaaf8f1487e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:50.736370 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd0b4a-c4fd-4d6e-bb5e-aaaf8f1487e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:50.738607 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4dcd0b4a-c4fd-4d6e-bb5e-aaaf8f1487e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:50.756400 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:50.762073 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e9b91-e94c-41ce-b977-14faa42e1f69 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:50.767921 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4b9a7-a78f-45cf-8191-258bc515b057 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:50.768761 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4b9a7-a78f-45cf-8191-258bc515b057 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:50.769019 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4b9a7-a78f-45cf-8191-258bc515b057 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:50.769289 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4b9a7-a78f-45cf-8191-258bc515b057 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:50.773954 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ffd4b9a7-a78f-45cf-8191-258bc515b057 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:50.795537 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:50.822658 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcd0b4a-c4fd-4d6e-bb5e-aaaf8f1487e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:50.824173 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcd0b4a-c4fd-4d6e-bb5e-aaaf8f1487e7 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:50.835547 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 844/1707] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:37:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:37:50.836839 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2449a6-2f41-47b4-a469-2e55b521daee None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:50.837140 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2449a6-2f41-47b4-a469-2e55b521daee None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:50.837402 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2449a6-2f41-47b4-a469-2e55b521daee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:50.851507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd4b9a7-a78f-45cf-8191-258bc515b057 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:50.853472 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd4b9a7-a78f-45cf-8191-258bc515b057 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:50.859294 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-fd2449a6-2f41-47b4-a469-2e55b521daee None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:50.860526 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-fd2449a6-2f41-47b4-a469-2e55b521daee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:50.866651 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 864/1708] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:37:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:37:50.868245 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4b9a7-a78f-45cf-8191-258bc515b057 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:50.870467 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 845/1709] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:50.871105 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ffd4b9a7-a78f-45cf-8191-258bc515b057 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:50.875260 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2449a6-2f41-47b4-a469-2e55b521daee None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:50.889105 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2449a6-2f41-47b4-a469-2e55b521daee None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:50.895796 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4b9a7-a78f-45cf-8191-258bc515b057 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:50.895976 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984bd29f-3550-4e4d-ab93-4e6b2d2ddeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:50.897039 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bd29f-3550-4e4d-ab93-4e6b2d2ddeb6 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:50.897039 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bd29f-3550-4e4d-ab93-4e6b2d2ddeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:50.898102 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bd29f-3550-4e4d-ab93-4e6b2d2ddeb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:50.898324 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984bd29f-3550-4e4d-ab93-4e6b2d2ddeb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:37:50.898703 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984bd29f-3550-4e4d-ab93-4e6b2d2ddeb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:50.900870 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984bd29f-3550-4e4d-ab93-4e6b2d2ddeb6 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:50.906957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711800b2-41eb-4d54-b95e-d010b2411c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:50.907985 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711800b2-41eb-4d54-b95e-d010b2411c28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:50.908464 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711800b2-41eb-4d54-b95e-d010b2411c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:50.909231 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711800b2-41eb-4d54-b95e-d010b2411c28 admin admin] PATH_INFO: `/v3/users/7c370274f3684be08cb92412ba00c695` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:50.911579 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711800b2-41eb-4d54-b95e-d010b2411c28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c370274f3684be08cb92412ba00c695)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:50.916503 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711800b2-41eb-4d54-b95e-d010b2411c28 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:50.924115 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 846/1710] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:37:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:37:50.925054 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984bd29f-3550-4e4d-ab93-4e6b2d2ddeb6 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:50.948276 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984bd29f-3550-4e4d-ab93-4e6b2d2ddeb6 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:50.957521 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e120941f-39a8-420e-8bc3-28cae466776d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:50.960434 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120941f-39a8-420e-8bc3-28cae466776d admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:50.960964 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120941f-39a8-420e-8bc3-28cae466776d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:50.961301 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120941f-39a8-420e-8bc3-28cae466776d admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:50.962481 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e120941f-39a8-420e-8bc3-28cae466776d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:50.966185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e120941f-39a8-420e-8bc3-28cae466776d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:51.008669 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-711800b2-41eb-4d54-b95e-d010b2411c28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c370274f3684be08cb92412ba00c695'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:51.010048 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-711800b2-41eb-4d54-b95e-d010b2411c28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c370274f3684be08cb92412ba00c695'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:51.019212 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 847/1711] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:37:50 2022] POST /identity/v3/projects => generated 375 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:51.024612 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e120941f-39a8-420e-8bc3-28cae466776d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:51.034706 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-711800b2-41eb-4d54-b95e-d010b2411c28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c370274f3684be08cb92412ba00c695'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:51.045691 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-711800b2-41eb-4d54-b95e-d010b2411c28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c370274f3684be08cb92412ba00c695'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:51.055878 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-711800b2-41eb-4d54-b95e-d010b2411c28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c370274f3684be08cb92412ba00c695'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:51.066457 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 865/1712] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:37:50 2022] DELETE /identity/v3/users/7c370274f3684be08cb92412ba00c695 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:51.145034 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e120941f-39a8-420e-8bc3-28cae466776d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:51.293911 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e064c-da99-4fcd-ad4c-0ad766c8a9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:51.295718 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e064c-da99-4fcd-ad4c-0ad766c8a9a3 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:51.296142 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e064c-da99-4fcd-ad4c-0ad766c8a9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:51.296423 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e064c-da99-4fcd-ad4c-0ad766c8a9a3 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:51.297072 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794e064c-da99-4fcd-ad4c-0ad766c8a9a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:51.299095 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794e064c-da99-4fcd-ad4c-0ad766c8a9a3 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:51.328617 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 848/1713] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:37:51 2022] POST /identity/v3/users => generated 288 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:51.330031 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711800b2-41eb-4d54-b95e-d010b2411c28 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:51.332301 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-711800b2-41eb-4d54-b95e-d010b2411c28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:51.357047 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711800b2-41eb-4d54-b95e-d010b2411c28 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:51.373581 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800b15a-8509-49a1-9478-27130b30ab7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:51.374477 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800b15a-8509-49a1-9478-27130b30ab7f admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:51.375038 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800b15a-8509-49a1-9478-27130b30ab7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:51.375507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800b15a-8509-49a1-9478-27130b30ab7f admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:51.376503 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800b15a-8509-49a1-9478-27130b30ab7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:51.378511 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800b15a-8509-49a1-9478-27130b30ab7f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:51.404090 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 866/1714] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:37:51.405980 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e064c-da99-4fcd-ad4c-0ad766c8a9a3 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:51.431565 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e064c-da99-4fcd-ad4c-0ad766c8a9a3 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:51.439248 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800b15a-8509-49a1-9478-27130b30ab7f admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:51.441083 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1800b15a-8509-49a1-9478-27130b30ab7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:51.447887 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b956278-1f29-4c69-9b20-aadcb20c87fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:51.448533 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b956278-1f29-4c69-9b20-aadcb20c87fd admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:51.452088 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b956278-1f29-4c69-9b20-aadcb20c87fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:51.452205 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b956278-1f29-4c69-9b20-aadcb20c87fd admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:51.452899 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b956278-1f29-4c69-9b20-aadcb20c87fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:51.454879 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b956278-1f29-4c69-9b20-aadcb20c87fd admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:51.475373 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800b15a-8509-49a1-9478-27130b30ab7f admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:51.476132 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 849/1715] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:37:51.480724 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b956278-1f29-4c69-9b20-aadcb20c87fd admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:51.484445 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff0dfb-8b91-4e26-85f3-5d461716cee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:51.485117 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff0dfb-8b91-4e26-85f3-5d461716cee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:51.485620 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff0dfb-8b91-4e26-85f3-5d461716cee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:51.485992 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff0dfb-8b91-4e26-85f3-5d461716cee6 admin admin] PATH_INFO: `/v3/projects/0fd78159a01c4498b21b2c7ed33dc622` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:51.487186 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff0dfb-8b91-4e26-85f3-5d461716cee6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fd78159a01c4498b21b2c7ed33dc622)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:51.489575 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff0dfb-8b91-4e26-85f3-5d461716cee6 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:51.503707 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b956278-1f29-4c69-9b20-aadcb20c87fd admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:51.519837 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0056d-f640-44eb-945b-55bd11c1bd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:51.521503 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0056d-f640-44eb-945b-55bd11c1bd7f admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:51.522493 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0056d-f640-44eb-945b-55bd11c1bd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:51.527162 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0056d-f640-44eb-945b-55bd11c1bd7f admin admin] PATH_INFO: `/v3/projects/c643cefb38c648c888cd0f6b23821471/users/e4f1fb333aaa493f91c1ae14f4f08f58/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:51.561715 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-dcff0dfb-8b91-4e26-85f3-5d461716cee6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fd78159a01c4498b21b2c7ed33dc622', 'request_id': 'req-dcff0dfb-8b91-4e26-85f3-5d461716cee6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:51.565363 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:51.567723 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d0056d-f640-44eb-945b-55bd11c1bd7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c643cefb38c648c888cd0f6b23821471, user_id=e4f1fb333aaa493f91c1ae14f4f08f58, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:51.573807 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-dcff0dfb-8b91-4e26-85f3-5d461716cee6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fd78159a01c4498b21b2c7ed33dc622', 'request_id': 'req-dcff0dfb-8b91-4e26-85f3-5d461716cee6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:51.574804 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d0056d-f640-44eb-945b-55bd11c1bd7f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:51.588887 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-dcff0dfb-8b91-4e26-85f3-5d461716cee6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fd78159a01c4498b21b2c7ed33dc622', 'request_id': 'req-dcff0dfb-8b91-4e26-85f3-5d461716cee6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:51.592720 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:51.605811 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 850/1716] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:37:51 2022] PUT /identity/v3/projects/c643cefb38c648c888cd0f6b23821471/users/e4f1fb333aaa493f91c1ae14f4f08f58/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:51.607309 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f4afd-82f2-4369-b081-5553b5a13035 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:51.607633 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f4afd-82f2-4369-b081-5553b5a13035 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:51.608071 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f4afd-82f2-4369-b081-5553b5a13035 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:51.609411 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 851/1717] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 15:37:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:37:51.610190 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f4afd-82f2-4369-b081-5553b5a13035 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:51.613792 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-dcff0dfb-8b91-4e26-85f3-5d461716cee6 admin admin] The token cache is being invalidate because project 0fd78159a01c4498b21b2c7ed33dc622 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:37:51.614883 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-dcff0dfb-8b91-4e26-85f3-5d461716cee6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:51.615946 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-303f4afd-82f2-4369-b081-5553b5a13035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:51.618769 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-dcff0dfb-8b91-4e26-85f3-5d461716cee6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:51.621551 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 867/1718] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:37:51 2022] DELETE /identity/v3/projects/0fd78159a01c4498b21b2c7ed33dc622 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:51.628526 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd92be-5a80-41c2-be6d-62325c7afab3 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:51.629107 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd92be-5a80-41c2-be6d-62325c7afab3 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:51.630199 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd92be-5a80-41c2-be6d-62325c7afab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:51.663213 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-8fbd92be-5a80-41c2-be6d-62325c7afab3 None None] MFA Rules not processed for user `253947a5ef294d2bb828761873251bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:51.664399 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8fbd92be-5a80-41c2-be6d-62325c7afab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:51.805927 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 868/1719] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 15:37:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:51.806993 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd92be-5a80-41c2-be6d-62325c7afab3 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:51.809555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8fbd92be-5a80-41c2-be6d-62325c7afab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:51.810381 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f4afd-82f2-4369-b081-5553b5a13035 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:51.828445 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39186fc2-449a-462c-8d64-6216badec023 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:51.829761 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39186fc2-449a-462c-8d64-6216badec023 service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:51.830127 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39186fc2-449a-462c-8d64-6216badec023 service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:51.830498 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39186fc2-449a-462c-8d64-6216badec023 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:51.836978 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-39186fc2-449a-462c-8d64-6216badec023 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:51.861574 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39186fc2-449a-462c-8d64-6216badec023 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:51.863234 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39186fc2-449a-462c-8d64-6216badec023 service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:51.893108 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 852/1720] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:37:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:37:51.895240 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37de86-bcc2-44a1-a1d3-aab6788c579d None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:51.895529 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37de86-bcc2-44a1-a1d3-aab6788c579d None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:51.895836 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37de86-bcc2-44a1-a1d3-aab6788c579d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:51.934905 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd92be-5a80-41c2-be6d-62325c7afab3 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:51.940504 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ec9fa-4bac-4397-bb1e-d6596bd16a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:51.941480 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ec9fa-4bac-4397-bb1e-d6596bd16a53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:51.941977 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ec9fa-4bac-4397-bb1e-d6596bd16a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:51.942478 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ec9fa-4bac-4397-bb1e-d6596bd16a53 admin admin] PATH_INFO: `/v3/users/26ac52edd08042878cd0d54a6584058f` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:51.944275 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5ec9fa-4bac-4397-bb1e-d6596bd16a53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26ac52edd08042878cd0d54a6584058f)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:51.947010 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5ec9fa-4bac-4397-bb1e-d6596bd16a53 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:51.950909 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-1d37de86-bcc2-44a1-a1d3-aab6788c579d None None] MFA Rules not processed for user `e4f1fb333aaa493f91c1ae14f4f08f58`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:51.952166 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1d37de86-bcc2-44a1-a1d3-aab6788c579d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:52.046212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6f5ec9fa-4bac-4397-bb1e-d6596bd16a53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26ac52edd08042878cd0d54a6584058f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:52.048481 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6f5ec9fa-4bac-4397-bb1e-d6596bd16a53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26ac52edd08042878cd0d54a6584058f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:52.068792 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6f5ec9fa-4bac-4397-bb1e-d6596bd16a53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26ac52edd08042878cd0d54a6584058f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:52.080382 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6f5ec9fa-4bac-4397-bb1e-d6596bd16a53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26ac52edd08042878cd0d54a6584058f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:52.086063 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:52.095657 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6f5ec9fa-4bac-4397-bb1e-d6596bd16a53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26ac52edd08042878cd0d54a6584058f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:52.107909 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 869/1721] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:37:51 2022] DELETE /identity/v3/users/26ac52edd08042878cd0d54a6584058f => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:52.112550 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 853/1722] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:52.117666 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37de86-bcc2-44a1-a1d3-aab6788c579d None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:52.119408 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1d37de86-bcc2-44a1-a1d3-aab6788c579d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:52.124598 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ec9fa-4bac-4397-bb1e-d6596bd16a53 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:52.134326 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6f5ec9fa-4bac-4397-bb1e-d6596bd16a53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:52.229829 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ec9fa-4bac-4397-bb1e-d6596bd16a53 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:52.232155 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37de86-bcc2-44a1-a1d3-aab6788c579d None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:52.235848 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7adf166-9dbe-4fd8-8dd0-6645b4c471ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:52.237997 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7adf166-9dbe-4fd8-8dd0-6645b4c471ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:52.238395 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7adf166-9dbe-4fd8-8dd0-6645b4c471ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:52.238789 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7adf166-9dbe-4fd8-8dd0-6645b4c471ea admin admin] PATH_INFO: `/v3/projects/40b8719c00e54dca87df81ed4a755e8d` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:52.240158 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7adf166-9dbe-4fd8-8dd0-6645b4c471ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=40b8719c00e54dca87df81ed4a755e8d)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:52.242918 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7adf166-9dbe-4fd8-8dd0-6645b4c471ea admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:52.304240 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:52.321959 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d7adf166-9dbe-4fd8-8dd0-6645b4c471ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40b8719c00e54dca87df81ed4a755e8d', 'request_id': 'req-d7adf166-9dbe-4fd8-8dd0-6645b4c471ea'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:52.330358 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d7adf166-9dbe-4fd8-8dd0-6645b4c471ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40b8719c00e54dca87df81ed4a755e8d', 'request_id': 'req-d7adf166-9dbe-4fd8-8dd0-6645b4c471ea'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:52.344885 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d7adf166-9dbe-4fd8-8dd0-6645b4c471ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40b8719c00e54dca87df81ed4a755e8d', 'request_id': 'req-d7adf166-9dbe-4fd8-8dd0-6645b4c471ea'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:52.347587 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f3fbc-b995-478e-85b7-c400e2edc3de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:52.348213 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f3fbc-b995-478e-85b7-c400e2edc3de service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:52.348486 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f3fbc-b995-478e-85b7-c400e2edc3de service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:52.348825 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f3fbc-b995-478e-85b7-c400e2edc3de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:52.353635 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-bb3f3fbc-b995-478e-85b7-c400e2edc3de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:52.399813 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d7adf166-9dbe-4fd8-8dd0-6645b4c471ea admin admin] The token cache is being invalidate because project 40b8719c00e54dca87df81ed4a755e8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:37:52.401426 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d7adf166-9dbe-4fd8-8dd0-6645b4c471ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:52.403090 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d7adf166-9dbe-4fd8-8dd0-6645b4c471ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:52.414879 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 870/1723] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:37:52 2022] DELETE /identity/v3/projects/40b8719c00e54dca87df81ed4a755e8d => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:52.416795 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7adf166-9dbe-4fd8-8dd0-6645b4c471ea admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:52.422957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d7adf166-9dbe-4fd8-8dd0-6645b4c471ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:52.504734 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f3fbc-b995-478e-85b7-c400e2edc3de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:52.512083 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f3fbc-b995-478e-85b7-c400e2edc3de service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:52.539243 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 854/1724] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:37:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:37:52.547482 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f3fbc-b995-478e-85b7-c400e2edc3de service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:52.560609 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-bb3f3fbc-b995-478e-85b7-c400e2edc3de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:52.581031 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7adf166-9dbe-4fd8-8dd0-6645b4c471ea admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:52.583751 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f3fbc-b995-478e-85b7-c400e2edc3de service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:52.588576 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8645775-fb30-48a3-b5ea-7076fa0f8a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:52.589236 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8645775-fb30-48a3-b5ea-7076fa0f8a16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:52.589520 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8645775-fb30-48a3-b5ea-7076fa0f8a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:52.589794 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8645775-fb30-48a3-b5ea-7076fa0f8a16 admin admin] PATH_INFO: `/v3/projects/59bd6f7ddce4492eab64b95320608fa8` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:52.591102 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8645775-fb30-48a3-b5ea-7076fa0f8a16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59bd6f7ddce4492eab64b95320608fa8)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:52.593065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8645775-fb30-48a3-b5ea-7076fa0f8a16 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:52.608126 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad00ea6-8765-4b2f-a3cf-0d0b5cbb8b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:52.610167 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad00ea6-8765-4b2f-a3cf-0d0b5cbb8b49 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:52.610523 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad00ea6-8765-4b2f-a3cf-0d0b5cbb8b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:52.610871 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad00ea6-8765-4b2f-a3cf-0d0b5cbb8b49 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:52.611640 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad00ea6-8765-4b2f-a3cf-0d0b5cbb8b49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:52.620139 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad00ea6-8765-4b2f-a3cf-0d0b5cbb8b49 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:52.641775 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:52.666532 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 855/1725] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:37:52 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:52.671129 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e8645775-fb30-48a3-b5ea-7076fa0f8a16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59bd6f7ddce4492eab64b95320608fa8', 'request_id': 'req-e8645775-fb30-48a3-b5ea-7076fa0f8a16'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:52.671713 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad00ea6-8765-4b2f-a3cf-0d0b5cbb8b49 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:52.675281 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1ad00ea6-8765-4b2f-a3cf-0d0b5cbb8b49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:52.678063 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e8645775-fb30-48a3-b5ea-7076fa0f8a16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59bd6f7ddce4492eab64b95320608fa8', 'request_id': 'req-e8645775-fb30-48a3-b5ea-7076fa0f8a16'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:52.701787 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e8645775-fb30-48a3-b5ea-7076fa0f8a16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59bd6f7ddce4492eab64b95320608fa8', 'request_id': 'req-e8645775-fb30-48a3-b5ea-7076fa0f8a16'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:52.726248 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e8645775-fb30-48a3-b5ea-7076fa0f8a16 admin admin] The token cache is being invalidate because project 59bd6f7ddce4492eab64b95320608fa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:37:52.727230 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e8645775-fb30-48a3-b5ea-7076fa0f8a16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:52.727791 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e8645775-fb30-48a3-b5ea-7076fa0f8a16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:52.729801 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 871/1726] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:37:52 2022] DELETE /identity/v3/projects/59bd6f7ddce4492eab64b95320608fa8 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:52.730576 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8645775-fb30-48a3-b5ea-7076fa0f8a16 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:52.738268 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e8645775-fb30-48a3-b5ea-7076fa0f8a16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:52.897234 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8645775-fb30-48a3-b5ea-7076fa0f8a16 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:52.898877 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad00ea6-8765-4b2f-a3cf-0d0b5cbb8b49 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:52.909281 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b40381-c389-4754-a8f6-348579498e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:52.911605 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51775cd4-bcf1-4dd6-8df8-4352f3732a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:52.912168 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51775cd4-bcf1-4dd6-8df8-4352f3732a41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:52.913139 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51775cd4-bcf1-4dd6-8df8-4352f3732a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:52.913389 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51775cd4-bcf1-4dd6-8df8-4352f3732a41 admin admin] PATH_INFO: `/v3/users/3715bc7f981c43fc9fa89ae3784d8767` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:52.914457 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b40381-c389-4754-a8f6-348579498e95 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:52.914696 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b40381-c389-4754-a8f6-348579498e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:52.914963 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b40381-c389-4754-a8f6-348579498e95 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:52.915666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b40381-c389-4754-a8f6-348579498e95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:52.918441 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51775cd4-bcf1-4dd6-8df8-4352f3732a41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3715bc7f981c43fc9fa89ae3784d8767)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:52.919478 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b40381-c389-4754-a8f6-348579498e95 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:52.921938 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51775cd4-bcf1-4dd6-8df8-4352f3732a41 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:52.985891 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 872/1727] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:37:52 2022] POST /identity/v3/users => generated 294 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:52.987513 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c059a-7a97-45b7-aed2-0152caaea473 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:52.987802 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c059a-7a97-45b7-aed2-0152caaea473 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:52.988075 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c059a-7a97-45b7-aed2-0152caaea473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:53.051164 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-51775cd4-bcf1-4dd6-8df8-4352f3732a41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3715bc7f981c43fc9fa89ae3784d8767'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:53.051995 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-7f9c059a-7a97-45b7-aed2-0152caaea473 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:53.053976 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-51775cd4-bcf1-4dd6-8df8-4352f3732a41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3715bc7f981c43fc9fa89ae3784d8767'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:53.056878 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7f9c059a-7a97-45b7-aed2-0152caaea473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:53.070562 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-51775cd4-bcf1-4dd6-8df8-4352f3732a41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3715bc7f981c43fc9fa89ae3784d8767'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:53.074114 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:53.091463 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 873/1728] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:53.092491 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c059a-7a97-45b7-aed2-0152caaea473 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:53.101295 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-51775cd4-bcf1-4dd6-8df8-4352f3732a41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3715bc7f981c43fc9fa89ae3784d8767'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:53.101552 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7f9c059a-7a97-45b7-aed2-0152caaea473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:53.104261 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-51775cd4-bcf1-4dd6-8df8-4352f3732a41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3715bc7f981c43fc9fa89ae3784d8767'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:53.135455 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 856/1729] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:37:52 2022] DELETE /identity/v3/users/3715bc7f981c43fc9fa89ae3784d8767 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:53.136311 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51775cd4-bcf1-4dd6-8df8-4352f3732a41 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:53.138400 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-51775cd4-bcf1-4dd6-8df8-4352f3732a41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:53.152131 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c059a-7a97-45b7-aed2-0152caaea473 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:53.226505 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51775cd4-bcf1-4dd6-8df8-4352f3732a41 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:53.231995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b74fc-f753-4932-9a7a-15a4ab4793cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:53.232896 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b74fc-f753-4932-9a7a-15a4ab4793cf admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:53.233179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b74fc-f753-4932-9a7a-15a4ab4793cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:53.233457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b74fc-f753-4932-9a7a-15a4ab4793cf admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:53.234154 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b74fc-f753-4932-9a7a-15a4ab4793cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:53.236141 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b74fc-f753-4932-9a7a-15a4ab4793cf admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:53.251830 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 857/1730] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:37:53.253870 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc188f-6046-4e37-acc9-fb2045c2c925 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:53.254272 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc188f-6046-4e37-acc9-fb2045c2c925 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:53.254613 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc188f-6046-4e37-acc9-fb2045c2c925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:53.280802 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-63dc188f-6046-4e37-acc9-fb2045c2c925 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:53.282063 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-63dc188f-6046-4e37-acc9-fb2045c2c925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:53.293745 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 858/1731] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:53.295783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc188f-6046-4e37-acc9-fb2045c2c925 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:53.301359 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae4132-65a9-46bb-b404-a227f32e70e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:53.302145 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae4132-65a9-46bb-b404-a227f32e70e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:53.302527 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae4132-65a9-46bb-b404-a227f32e70e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:53.302959 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae4132-65a9-46bb-b404-a227f32e70e7 admin admin] PATH_INFO: `/v3/projects/ee8315fd8e39404c892af3fa6b2c29af` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:53.308074 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae4132-65a9-46bb-b404-a227f32e70e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee8315fd8e39404c892af3fa6b2c29af)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:53.310459 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae4132-65a9-46bb-b404-a227f32e70e7 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:53.322711 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc188f-6046-4e37-acc9-fb2045c2c925 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:53.331765 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce12e0a-bcd9-4614-9fb3-0b2b4334eaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:53.333638 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce12e0a-bcd9-4614-9fb3-0b2b4334eaef admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:53.335013 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce12e0a-bcd9-4614-9fb3-0b2b4334eaef admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:53.336030 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce12e0a-bcd9-4614-9fb3-0b2b4334eaef admin admin] PATH_INFO: `/v3/projects/24cb9dd2e2a4484bac2b9f208c25b175/users/58ccb345c4eb4f5389e08a1681d4b4de/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:53.356735 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce12e0a-bcd9-4614-9fb3-0b2b4334eaef admin admin] RBAC: Authorizing `identity:create_grant(project_id=24cb9dd2e2a4484bac2b9f208c25b175, user_id=58ccb345c4eb4f5389e08a1681d4b4de, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:53.359649 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce12e0a-bcd9-4614-9fb3-0b2b4334eaef admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:53.401497 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 859/1732] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:37:53 2022] PUT /identity/v3/projects/24cb9dd2e2a4484bac2b9f208c25b175/users/58ccb345c4eb4f5389e08a1681d4b4de/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:53.402666 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce12e0a-bcd9-4614-9fb3-0b2b4334eaef admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:53.436517 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:53.461700 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-17ae4132-65a9-46bb-b404-a227f32e70e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee8315fd8e39404c892af3fa6b2c29af', 'request_id': 'req-17ae4132-65a9-46bb-b404-a227f32e70e7'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:53.479147 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-17ae4132-65a9-46bb-b404-a227f32e70e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee8315fd8e39404c892af3fa6b2c29af', 'request_id': 'req-17ae4132-65a9-46bb-b404-a227f32e70e7'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:53.504507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-17ae4132-65a9-46bb-b404-a227f32e70e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee8315fd8e39404c892af3fa6b2c29af', 'request_id': 'req-17ae4132-65a9-46bb-b404-a227f32e70e7'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:53.537928 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-17ae4132-65a9-46bb-b404-a227f32e70e7 admin admin] The token cache is being invalidate because project ee8315fd8e39404c892af3fa6b2c29af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:37:53.538660 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-17ae4132-65a9-46bb-b404-a227f32e70e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:53.540413 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-17ae4132-65a9-46bb-b404-a227f32e70e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:53.548756 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce12e0a-bcd9-4614-9fb3-0b2b4334eaef admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:53.552154 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 874/1733] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:37:53 2022] DELETE /identity/v3/projects/ee8315fd8e39404c892af3fa6b2c29af => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:53.553988 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae4132-65a9-46bb-b404-a227f32e70e7 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:53.556150 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-17ae4132-65a9-46bb-b404-a227f32e70e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:53.647669 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:53.675300 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074dced1-729e-49bb-a2de-3c2d31415e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:53.677282 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074dced1-729e-49bb-a2de-3c2d31415e84 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:53.678514 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074dced1-729e-49bb-a2de-3c2d31415e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:53.679208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074dced1-729e-49bb-a2de-3c2d31415e84 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:53.680586 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074dced1-729e-49bb-a2de-3c2d31415e84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:37:53.681169 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074dced1-729e-49bb-a2de-3c2d31415e84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:53.683892 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074dced1-729e-49bb-a2de-3c2d31415e84 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:53.703876 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 860/1734] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:37:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:37:53.703876 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074dced1-729e-49bb-a2de-3c2d31415e84 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:53.703876 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-074dced1-729e-49bb-a2de-3c2d31415e84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:53.720728 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074dced1-729e-49bb-a2de-3c2d31415e84 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:53.729814 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bcfe00-d578-42bd-bdb1-42f887ce698b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:53.730586 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bcfe00-d578-42bd-bdb1-42f887ce698b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:53.730971 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bcfe00-d578-42bd-bdb1-42f887ce698b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:53.731388 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bcfe00-d578-42bd-bdb1-42f887ce698b admin admin] PATH_INFO: `/v3/projects/1eb9328a4bc849eaaad28b96916a7c67` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:53.732893 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bcfe00-d578-42bd-bdb1-42f887ce698b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eb9328a4bc849eaaad28b96916a7c67)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:53.734959 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bcfe00-d578-42bd-bdb1-42f887ce698b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:53.735705 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae4132-65a9-46bb-b404-a227f32e70e7 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:53.746201 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be6afc-45fd-437d-9a2d-93a34820b738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:53.746983 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be6afc-45fd-437d-9a2d-93a34820b738 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:53.747310 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be6afc-45fd-437d-9a2d-93a34820b738 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:53.747578 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be6afc-45fd-437d-9a2d-93a34820b738 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:53.748293 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60be6afc-45fd-437d-9a2d-93a34820b738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:53.750678 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60be6afc-45fd-437d-9a2d-93a34820b738 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:53.777898 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 875/1735] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:37:53.780719 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce2d71-c54a-4d6d-bbbc-f6f7dc7d0669 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:53.781009 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce2d71-c54a-4d6d-bbbc-f6f7dc7d0669 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:53.781288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce2d71-c54a-4d6d-bbbc-f6f7dc7d0669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:53.836665 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-98ce2d71-c54a-4d6d-bbbc-f6f7dc7d0669 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:53.837907 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-98ce2d71-c54a-4d6d-bbbc-f6f7dc7d0669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:53.851677 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-34bcfe00-d578-42bd-bdb1-42f887ce698b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eb9328a4bc849eaaad28b96916a7c67', 'request_id': 'req-34bcfe00-d578-42bd-bdb1-42f887ce698b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:53.863300 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-34bcfe00-d578-42bd-bdb1-42f887ce698b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eb9328a4bc849eaaad28b96916a7c67', 'request_id': 'req-34bcfe00-d578-42bd-bdb1-42f887ce698b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:53.875112 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-34bcfe00-d578-42bd-bdb1-42f887ce698b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eb9328a4bc849eaaad28b96916a7c67', 'request_id': 'req-34bcfe00-d578-42bd-bdb1-42f887ce698b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:53.900750 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-34bcfe00-d578-42bd-bdb1-42f887ce698b admin admin] The token cache is being invalidate because project 1eb9328a4bc849eaaad28b96916a7c67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:37:53.901044 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-34bcfe00-d578-42bd-bdb1-42f887ce698b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:53.901727 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-34bcfe00-d578-42bd-bdb1-42f887ce698b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:53.903635 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 861/1736] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:37:53 2022] DELETE /identity/v3/projects/1eb9328a4bc849eaaad28b96916a7c67 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:53.907398 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bcfe00-d578-42bd-bdb1-42f887ce698b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:53.908496 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-34bcfe00-d578-42bd-bdb1-42f887ce698b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:53.970847 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 876/1737] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:53.971487 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce2d71-c54a-4d6d-bbbc-f6f7dc7d0669 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:53.980686 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-98ce2d71-c54a-4d6d-bbbc-f6f7dc7d0669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:54.002863 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce2d71-c54a-4d6d-bbbc-f6f7dc7d0669 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:54.006966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bcfe00-d578-42bd-bdb1-42f887ce698b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:54.012901 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271784a9-37c6-4ab1-a33c-02efef1d4f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:54.013602 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271784a9-37c6-4ab1-a33c-02efef1d4f8a admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:54.014157 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271784a9-37c6-4ab1-a33c-02efef1d4f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:54.014442 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271784a9-37c6-4ab1-a33c-02efef1d4f8a admin admin] PATH_INFO: `/v3/projects/24cb9dd2e2a4484bac2b9f208c25b175/users/58ccb345c4eb4f5389e08a1681d4b4de/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:54.017114 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af0878f-e425-4ff9-98b8-49f6a50e389b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:54.017745 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0878f-e425-4ff9-98b8-49f6a50e389b admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:54.018080 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0878f-e425-4ff9-98b8-49f6a50e389b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:54.018355 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0878f-e425-4ff9-98b8-49f6a50e389b admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:54.019088 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af0878f-e425-4ff9-98b8-49f6a50e389b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:54.022666 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af0878f-e425-4ff9-98b8-49f6a50e389b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:54.023498 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271784a9-37c6-4ab1-a33c-02efef1d4f8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=24cb9dd2e2a4484bac2b9f208c25b175, user_id=58ccb345c4eb4f5389e08a1681d4b4de, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:54.026561 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271784a9-37c6-4ab1-a33c-02efef1d4f8a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:54.056264 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 877/1738] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:37:53 2022] PUT /identity/v3/projects/24cb9dd2e2a4484bac2b9f208c25b175/users/58ccb345c4eb4f5389e08a1681d4b4de/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:54.057559 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804c657-e850-4ef7-a924-59bd5dbb63ca None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:54.057847 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804c657-e850-4ef7-a924-59bd5dbb63ca None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:54.058126 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804c657-e850-4ef7-a924-59bd5dbb63ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:54.083759 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-6804c657-e850-4ef7-a924-59bd5dbb63ca None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:54.085311 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6804c657-e850-4ef7-a924-59bd5dbb63ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:54.085847 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 862/1739] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:37:53 2022] POST /identity/v3/projects => generated 385 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:54.094612 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393aa87-e125-4507-ba36-d1e996e02bb2 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:54.094915 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393aa87-e125-4507-ba36-d1e996e02bb2 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:54.095157 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393aa87-e125-4507-ba36-d1e996e02bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:54.137869 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-5393aa87-e125-4507-ba36-d1e996e02bb2 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:54.140326 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5393aa87-e125-4507-ba36-d1e996e02bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:54.149711 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:54.203280 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 878/1740] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:54.204652 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735028e4-caab-418a-8d6e-564335f2a023 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:54.204904 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735028e4-caab-418a-8d6e-564335f2a023 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:54.205181 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735028e4-caab-418a-8d6e-564335f2a023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:54.242116 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-735028e4-caab-418a-8d6e-564335f2a023 None None] MFA Rules not processed for user `58ccb345c4eb4f5389e08a1681d4b4de`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:54.243509 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-735028e4-caab-418a-8d6e-564335f2a023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:54.251042 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:54.282643 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 863/1741] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:54.284754 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5393aa87-e125-4507-ba36-d1e996e02bb2 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:54.301233 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5393aa87-e125-4507-ba36-d1e996e02bb2 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:54.314972 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1944b-b934-4e83-967f-9dc3b719dc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:54.316620 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1944b-b934-4e83-967f-9dc3b719dc51 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:54.317270 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1944b-b934-4e83-967f-9dc3b719dc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:54.317821 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1944b-b934-4e83-967f-9dc3b719dc51 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:54.320751 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a1944b-b934-4e83-967f-9dc3b719dc51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:54.323895 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a1944b-b934-4e83-967f-9dc3b719dc51 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:54.353838 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 864/1742] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:37:54 2022] POST /identity/v3/users => generated 293 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:54.354632 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 879/1743] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:54.356474 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29a0bb-71ce-46e1-8170-3b5d06f68bb1 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:54.356761 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29a0bb-71ce-46e1-8170-3b5d06f68bb1 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:54.357035 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29a0bb-71ce-46e1-8170-3b5d06f68bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:54.360110 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735028e4-caab-418a-8d6e-564335f2a023 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:54.377440 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735028e4-caab-418a-8d6e-564335f2a023 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:54.390982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0254a098-cee4-4ff2-a967-ab2e287aa3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:54.392023 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0254a098-cee4-4ff2-a967-ab2e287aa3be admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:54.392590 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0254a098-cee4-4ff2-a967-ab2e287aa3be admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:54.393200 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0254a098-cee4-4ff2-a967-ab2e287aa3be admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:54.394071 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0254a098-cee4-4ff2-a967-ab2e287aa3be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:37:54.394622 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0254a098-cee4-4ff2-a967-ab2e287aa3be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:54.396475 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0254a098-cee4-4ff2-a967-ab2e287aa3be admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:54.405885 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-ae29a0bb-71ce-46e1-8170-3b5d06f68bb1 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:54.411037 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ae29a0bb-71ce-46e1-8170-3b5d06f68bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:54.416071 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 880/1744] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:37:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:37:54.417444 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0254a098-cee4-4ff2-a967-ab2e287aa3be admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:54.429977 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0254a098-cee4-4ff2-a967-ab2e287aa3be admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:54.430209 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 865/1745] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:54.431742 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29a0bb-71ce-46e1-8170-3b5d06f68bb1 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:54.433158 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ae29a0bb-71ce-46e1-8170-3b5d06f68bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:54.437485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401edd38-4b8c-4fae-ae7e-5aee8564523f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:54.438176 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401edd38-4b8c-4fae-ae7e-5aee8564523f admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:54.438530 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401edd38-4b8c-4fae-ae7e-5aee8564523f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:54.438879 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401edd38-4b8c-4fae-ae7e-5aee8564523f admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:54.439649 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401edd38-4b8c-4fae-ae7e-5aee8564523f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:54.441375 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401edd38-4b8c-4fae-ae7e-5aee8564523f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:54.453899 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 881/1746] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:37:54.454871 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401edd38-4b8c-4fae-ae7e-5aee8564523f admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:54.466629 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401edd38-4b8c-4fae-ae7e-5aee8564523f admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:54.471936 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2834c8-7f97-4663-b2b0-5cec596b6d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:54.472643 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2834c8-7f97-4663-b2b0-5cec596b6d8b admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:54.472985 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2834c8-7f97-4663-b2b0-5cec596b6d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:54.473487 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2834c8-7f97-4663-b2b0-5cec596b6d8b admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:54.474053 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2834c8-7f97-4663-b2b0-5cec596b6d8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:54.476854 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2834c8-7f97-4663-b2b0-5cec596b6d8b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:54.526028 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 882/1747] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:37:54 2022] POST /identity/v3/projects => generated 391 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:54.527549 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2834c8-7f97-4663-b2b0-5cec596b6d8b admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:54.555426 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29a0bb-71ce-46e1-8170-3b5d06f68bb1 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:54.696350 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2834c8-7f97-4663-b2b0-5cec596b6d8b admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:54.713108 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690e2f6-6ecc-4641-80d4-afff398e5ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:54.713108 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690e2f6-6ecc-4641-80d4-afff398e5ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:54.713420 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690e2f6-6ecc-4641-80d4-afff398e5ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:54.713716 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690e2f6-6ecc-4641-80d4-afff398e5ff5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:54.716851 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2690e2f6-6ecc-4641-80d4-afff398e5ff5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:37:54.717298 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2690e2f6-6ecc-4641-80d4-afff398e5ff5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:54.726789 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2690e2f6-6ecc-4641-80d4-afff398e5ff5 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:54.728017 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3c0bc-5957-4e3b-9828-1eb15868199a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:54.728767 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3c0bc-5957-4e3b-9828-1eb15868199a service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:54.729045 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3c0bc-5957-4e3b-9828-1eb15868199a service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:54.729303 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3c0bc-5957-4e3b-9828-1eb15868199a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:54.763409 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 883/1748] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:37:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:37:54.763409 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690e2f6-6ecc-4641-80d4-afff398e5ff5 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:54.799808 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690e2f6-6ecc-4641-80d4-afff398e5ff5 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:54.829635 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17951a01-2ea4-4fdd-8186-a262ff4db074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:54.830275 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17951a01-2ea4-4fdd-8186-a262ff4db074 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:54.830563 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17951a01-2ea4-4fdd-8186-a262ff4db074 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:54.830838 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17951a01-2ea4-4fdd-8186-a262ff4db074 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:54.831529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17951a01-2ea4-4fdd-8186-a262ff4db074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:54.833158 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17951a01-2ea4-4fdd-8186-a262ff4db074 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:54.872451 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 884/1749] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:37:54.873340 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17951a01-2ea4-4fdd-8186-a262ff4db074 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:54.894607 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17951a01-2ea4-4fdd-8186-a262ff4db074 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:54.904767 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:54.908221 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2f933-45d9-4d9b-bbc2-9e32701b1632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:54.910078 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2f933-45d9-4d9b-bbc2-9e32701b1632 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:54.910078 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2f933-45d9-4d9b-bbc2-9e32701b1632 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:54.910445 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2f933-45d9-4d9b-bbc2-9e32701b1632 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:54.912885 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b3c0bc-5957-4e3b-9828-1eb15868199a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:54.913501 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2f933-45d9-4d9b-bbc2-9e32701b1632 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:54.917252 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b3c0bc-5957-4e3b-9828-1eb15868199a service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:54.918286 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2f933-45d9-4d9b-bbc2-9e32701b1632 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:54.944770 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 866/1750] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:37:54 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:37:54.945770 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3c0bc-5957-4e3b-9828-1eb15868199a service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:54.956781 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:54.967878 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3c0bc-5957-4e3b-9828-1eb15868199a service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:54.984612 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d64c3-dfc9-4098-b3e3-2d8d1a988751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:54.985208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d64c3-dfc9-4098-b3e3-2d8d1a988751 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:54.985493 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d64c3-dfc9-4098-b3e3-2d8d1a988751 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:54.985764 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d64c3-dfc9-4098-b3e3-2d8d1a988751 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:54.986474 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1d64c3-dfc9-4098-b3e3-2d8d1a988751 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:54.991773 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1d64c3-dfc9-4098-b3e3-2d8d1a988751 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:55.025176 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 885/1751] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:37:54 2022] POST /identity/v3/users => generated 296 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:55.026164 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2f933-45d9-4d9b-bbc2-9e32701b1632 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:55.058899 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2f933-45d9-4d9b-bbc2-9e32701b1632 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:55.078144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b8998-b055-47d5-8fee-961d8cb42344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:55.078770 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b8998-b055-47d5-8fee-961d8cb42344 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:55.081174 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b8998-b055-47d5-8fee-961d8cb42344 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:55.081304 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 867/1752] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:37:54 2022] POST /identity/v3/projects => generated 389 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:55.081566 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b8998-b055-47d5-8fee-961d8cb42344 admin admin] PATH_INFO: `/v3/projects/6b3cab93ecf94e63912fea3397d55b4f/users/e6002b79c5234c86a7aee79c4a245eaf/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:55.082139 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d64c3-dfc9-4098-b3e3-2d8d1a988751 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:55.146301 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1b8998-b055-47d5-8fee-961d8cb42344 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b3cab93ecf94e63912fea3397d55b4f, user_id=e6002b79c5234c86a7aee79c4a245eaf, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:55.149766 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1b8998-b055-47d5-8fee-961d8cb42344 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:55.185488 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 886/1753] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:37:55 2022] PUT /identity/v3/projects/6b3cab93ecf94e63912fea3397d55b4f/users/e6002b79c5234c86a7aee79c4a245eaf/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:55.186378 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b8998-b055-47d5-8fee-961d8cb42344 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:55.215281 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d64c3-dfc9-4098-b3e3-2d8d1a988751 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:55.362656 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b8998-b055-47d5-8fee-961d8cb42344 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:55.365243 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa1823-f97d-4ef8-b48d-cde4a7f49e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:55.368961 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa1823-f97d-4ef8-b48d-cde4a7f49e66 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:55.369629 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65124a9-15a5-4a1f-aebb-cfcd957ccf11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:55.370252 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65124a9-15a5-4a1f-aebb-cfcd957ccf11 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:55.370530 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65124a9-15a5-4a1f-aebb-cfcd957ccf11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:55.370798 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65124a9-15a5-4a1f-aebb-cfcd957ccf11 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:55.371478 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65124a9-15a5-4a1f-aebb-cfcd957ccf11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:55.371975 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa1823-f97d-4ef8-b48d-cde4a7f49e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:55.373578 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65124a9-15a5-4a1f-aebb-cfcd957ccf11 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:55.374309 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa1823-f97d-4ef8-b48d-cde4a7f49e66 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:55.375318 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa1823-f97d-4ef8-b48d-cde4a7f49e66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:55.382848 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa1823-f97d-4ef8-b48d-cde4a7f49e66 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:55.409701 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 887/1754] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:37:55 2022] POST /identity/v3/users => generated 295 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:55.411106 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71f550-9765-4ad6-9ced-b26165dce853 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:55.411392 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71f550-9765-4ad6-9ced-b26165dce853 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:55.411668 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71f550-9765-4ad6-9ced-b26165dce853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:55.434127 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 868/1755] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:37:55.435407 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f47c4b-c3ca-4dc4-86ec-1fe612198a17 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:55.435694 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f47c4b-c3ca-4dc4-86ec-1fe612198a17 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:55.435969 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f47c4b-c3ca-4dc4-86ec-1fe612198a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:55.528248 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-0f71f550-9765-4ad6-9ced-b26165dce853 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:55.530275 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0f71f550-9765-4ad6-9ced-b26165dce853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:55.542903 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-17f47c4b-c3ca-4dc4-86ec-1fe612198a17 None None] MFA Rules not processed for user `e6002b79c5234c86a7aee79c4a245eaf`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:55.544345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-17f47c4b-c3ca-4dc4-86ec-1fe612198a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:55.673398 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 888/1756] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 15:37:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:55.676206 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71f550-9765-4ad6-9ced-b26165dce853 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:55.720369 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71f550-9765-4ad6-9ced-b26165dce853 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:55.727884 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a249ce-09a1-4f19-9303-4b01f6ce38eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:55.728861 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a249ce-09a1-4f19-9303-4b01f6ce38eb admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:55.731429 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a249ce-09a1-4f19-9303-4b01f6ce38eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:55.732438 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a249ce-09a1-4f19-9303-4b01f6ce38eb admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:55.733402 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a249ce-09a1-4f19-9303-4b01f6ce38eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:55.735667 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a249ce-09a1-4f19-9303-4b01f6ce38eb admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:55.737050 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 869/1757] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:55.738085 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f47c4b-c3ca-4dc4-86ec-1fe612198a17 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:55.752187 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:55.759331 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 889/1758] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:37:55.759331 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a249ce-09a1-4f19-9303-4b01f6ce38eb admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:55.764971 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f47c4b-c3ca-4dc4-86ec-1fe612198a17 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:55.774453 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f5e26-b188-429d-8030-3a1f29217d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:55.775124 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f5e26-b188-429d-8030-3a1f29217d86 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:55.775348 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f5e26-b188-429d-8030-3a1f29217d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:55.776436 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f5e26-b188-429d-8030-3a1f29217d86 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:55.777093 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f5e26-b188-429d-8030-3a1f29217d86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:55.783649 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f5e26-b188-429d-8030-3a1f29217d86 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:55.785332 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a249ce-09a1-4f19-9303-4b01f6ce38eb admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:55.812426 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581496d-56a4-41d7-939d-fa479e636e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:55.813102 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581496d-56a4-41d7-939d-fa479e636e84 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:55.813380 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581496d-56a4-41d7-939d-fa479e636e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:55.813649 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581496d-56a4-41d7-939d-fa479e636e84 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:55.814288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2581496d-56a4-41d7-939d-fa479e636e84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:55.816647 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2581496d-56a4-41d7-939d-fa479e636e84 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:55.841173 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 870/1759] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:37:55.847435 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f5e26-b188-429d-8030-3a1f29217d86 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:55.860439 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:55.864899 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f5e26-b188-429d-8030-3a1f29217d86 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:55.872299 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 890/1760] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:37:55 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:55.876327 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581496d-56a4-41d7-939d-fa479e636e84 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:55.883632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba35cb68-defb-42c2-a849-acbe52a05074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:55.884519 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35cb68-defb-42c2-a849-acbe52a05074 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:55.884701 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35cb68-defb-42c2-a849-acbe52a05074 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:55.884977 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35cb68-defb-42c2-a849-acbe52a05074 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:55.886648 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba35cb68-defb-42c2-a849-acbe52a05074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:55.889287 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba35cb68-defb-42c2-a849-acbe52a05074 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:55.912102 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 871/1761] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:37:55.918715 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba35cb68-defb-42c2-a849-acbe52a05074 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:55.944000 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba35cb68-defb-42c2-a849-acbe52a05074 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:56.050238 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581496d-56a4-41d7-939d-fa479e636e84 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:56.057109 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10bb8d-b612-4367-80b4-5a8b501d692e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:56.058076 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10bb8d-b612-4367-80b4-5a8b501d692e admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:56.058565 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10bb8d-b612-4367-80b4-5a8b501d692e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:56.059234 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10bb8d-b612-4367-80b4-5a8b501d692e admin admin] PATH_INFO: `/v3/projects/a6cef739dab64042a213907e6360b88b/users/e1206394e083461db26e3e5b65051dec/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:56.075415 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4323ab4-0b4a-480d-85fe-27984355ffcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:56.076551 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4323ab4-0b4a-480d-85fe-27984355ffcc admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:56.076831 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4323ab4-0b4a-480d-85fe-27984355ffcc admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:56.077100 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4323ab4-0b4a-480d-85fe-27984355ffcc admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:56.078127 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4323ab4-0b4a-480d-85fe-27984355ffcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:56.081121 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be10bb8d-b612-4367-80b4-5a8b501d692e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6cef739dab64042a213907e6360b88b, user_id=e1206394e083461db26e3e5b65051dec, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:56.081884 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4323ab4-0b4a-480d-85fe-27984355ffcc admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:56.085327 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be10bb8d-b612-4367-80b4-5a8b501d692e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:56.126973 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 891/1762] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:37:55 2022] PUT /identity/v3/projects/a6cef739dab64042a213907e6360b88b/users/e1206394e083461db26e3e5b65051dec/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:56.128625 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10bb8d-b612-4367-80b4-5a8b501d692e admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:56.129191 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 872/1763] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:37:55 2022] POST /identity/v3/users => generated 299 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:56.131833 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4323ab4-0b4a-480d-85fe-27984355ffcc admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:56.139905 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f4323ab4-0b4a-480d-85fe-27984355ffcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:56.267163 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10bb8d-b612-4367-80b4-5a8b501d692e admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:56.282595 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e07e1-fd31-4e49-9d3c-8004dff90100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:56.283533 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e07e1-fd31-4e49-9d3c-8004dff90100 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:56.283947 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e07e1-fd31-4e49-9d3c-8004dff90100 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:56.284294 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e07e1-fd31-4e49-9d3c-8004dff90100 admin admin] PATH_INFO: `/v3/projects/f578d0e6a2d34a08a5f1f8cf4808bdd5/users/8e694885e1b14e94a1061d12473c2b4a/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:56.317095 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85e07e1-fd31-4e49-9d3c-8004dff90100 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f578d0e6a2d34a08a5f1f8cf4808bdd5, user_id=8e694885e1b14e94a1061d12473c2b4a, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:56.318675 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85e07e1-fd31-4e49-9d3c-8004dff90100 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:56.348410 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 892/1764] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:37:56 2022] PUT /identity/v3/projects/f578d0e6a2d34a08a5f1f8cf4808bdd5/users/8e694885e1b14e94a1061d12473c2b4a/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:56.349276 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e07e1-fd31-4e49-9d3c-8004dff90100 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:56.373458 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4323ab4-0b4a-480d-85fe-27984355ffcc admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:56.476308 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:56.497636 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e07e1-fd31-4e49-9d3c-8004dff90100 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:56.509351 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ae5ab-a1bb-4672-aff8-449f076deca4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:56.510365 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ae5ab-a1bb-4672-aff8-449f076deca4 service swift] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:56.510365 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ae5ab-a1bb-4672-aff8-449f076deca4 service swift] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:56.510529 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ae5ab-a1bb-4672-aff8-449f076deca4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:56.512578 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca661467-611e-47cb-8dac-e429a60b7618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:56.513211 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca661467-611e-47cb-8dac-e429a60b7618 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:56.513492 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca661467-611e-47cb-8dac-e429a60b7618 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:56.514136 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca661467-611e-47cb-8dac-e429a60b7618 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:56.514912 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca661467-611e-47cb-8dac-e429a60b7618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:56.516355 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca661467-611e-47cb-8dac-e429a60b7618 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:56.526654 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:56.540138 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 893/1765] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:37:56.541253 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd42229-eee2-47d9-8872-f08a3cef9853 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:56.541542 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd42229-eee2-47d9-8872-f08a3cef9853 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:56.541816 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd42229-eee2-47d9-8872-f08a3cef9853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:56.604947 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-cfd42229-eee2-47d9-8872-f08a3cef9853 None None] MFA Rules not processed for user `e1206394e083461db26e3e5b65051dec`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:56.606017 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-cfd42229-eee2-47d9-8872-f08a3cef9853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:56.648567 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3ae5ab-a1bb-4672-aff8-449f076deca4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:56.650726 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3ae5ab-a1bb-4672-aff8-449f076deca4 service swift] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:56.692412 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 873/1766] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 15:37:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:37:56.693365 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ae5ab-a1bb-4672-aff8-449f076deca4 service swift] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:56.700590 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3f3ae5ab-a1bb-4672-aff8-449f076deca4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:56.765771 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 894/1767] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:56 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:56.767337 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db6e1a-3de9-4a15-8997-f38bd405db3a None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:56.767630 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db6e1a-3de9-4a15-8997-f38bd405db3a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:56.767911 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db6e1a-3de9-4a15-8997-f38bd405db3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:56.848154 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-e5db6e1a-3de9-4a15-8997-f38bd405db3a None None] MFA Rules not processed for user `8e694885e1b14e94a1061d12473c2b4a`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:56.855360 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e5db6e1a-3de9-4a15-8997-f38bd405db3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:56.998151 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ae5ab-a1bb-4672-aff8-449f076deca4 service swift] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:57.029794 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3fcb40-a406-4a26-9828-6610016b4f95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:57.030554 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fcb40-a406-4a26-9828-6610016b4f95 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:57.030875 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fcb40-a406-4a26-9828-6610016b4f95 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:57.031178 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fcb40-a406-4a26-9828-6610016b4f95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:57.033187 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9f3fcb40-a406-4a26-9828-6610016b4f95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:57.135512 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 895/1768] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:56 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:57.137457 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db6e1a-3de9-4a15-8997-f38bd405db3a None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:57.161105 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db6e1a-3de9-4a15-8997-f38bd405db3a None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:57.192280 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab6e251-8bc2-4faf-bcb3-b07bf6112470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:57.193134 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6e251-8bc2-4faf-bcb3-b07bf6112470 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:57.193592 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6e251-8bc2-4faf-bcb3-b07bf6112470 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:57.194085 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6e251-8bc2-4faf-bcb3-b07bf6112470 admin admin] PATH_INFO: `/v3/projects/0c47883a165c4bd8bc3fd43920c9251d/users/6a83d3f420d3472586858e35b3829328/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:57.228551 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab6e251-8bc2-4faf-bcb3-b07bf6112470 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c47883a165c4bd8bc3fd43920c9251d, user_id=6a83d3f420d3472586858e35b3829328, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:57.231876 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3fcb40-a406-4a26-9828-6610016b4f95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:57.232223 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab6e251-8bc2-4faf-bcb3-b07bf6112470 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:57.233526 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3fcb40-a406-4a26-9828-6610016b4f95 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:57.262079 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 874/1769] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:37:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:37:57.264119 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3fcb40-a406-4a26-9828-6610016b4f95 service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:57.276740 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 896/1770] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:37:57 2022] PUT /identity/v3/projects/0c47883a165c4bd8bc3fd43920c9251d/users/6a83d3f420d3472586858e35b3829328/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:57.278237 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd2a4c7-2ce8-47c8-8c4f-064496b63c20 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:57.278528 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd2a4c7-2ce8-47c8-8c4f-064496b63c20 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:57.278796 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd2a4c7-2ce8-47c8-8c4f-064496b63c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:57.298845 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3fcb40-a406-4a26-9828-6610016b4f95 service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:57.440319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-ffd2a4c7-2ce8-47c8-8c4f-064496b63c20 None None] MFA Rules not processed for user `9a84bb38f6454574897120223b8fc140`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:57.444741 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ffd2a4c7-2ce8-47c8-8c4f-064496b63c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:57.447118 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:57.517410 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:57.535778 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b70af-891c-49f1-8cc7-40c6a6dc4e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:57.536758 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b70af-891c-49f1-8cc7-40c6a6dc4e91 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:57.537191 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b70af-891c-49f1-8cc7-40c6a6dc4e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:57.537348 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b70af-891c-49f1-8cc7-40c6a6dc4e91 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:57.538233 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b70af-891c-49f1-8cc7-40c6a6dc4e91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:57.542241 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b70af-891c-49f1-8cc7-40c6a6dc4e91 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:57.554282 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 897/1771] 10.222.0.77 () {58 vars in 1015 bytes} [Mon Aug 29 15:37:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:57.556288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd2a4c7-2ce8-47c8-8c4f-064496b63c20 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:57.580244 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd2a4c7-2ce8-47c8-8c4f-064496b63c20 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:57.594905 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb8b9d-d031-43fa-8642-e815297faeb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:57.597525 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb8b9d-d031-43fa-8642-e815297faeb5 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:57.597822 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb8b9d-d031-43fa-8642-e815297faeb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:57.598911 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb8b9d-d031-43fa-8642-e815297faeb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:57.599629 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb8b9d-d031-43fa-8642-e815297faeb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:57.607143 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb8b9d-d031-43fa-8642-e815297faeb5 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:57.636950 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 875/1772] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:37:57 2022] POST /identity/v3/projects => generated 391 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:57.638379 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b70af-891c-49f1-8cc7-40c6a6dc4e91 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:57.690472 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 898/1773] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:37:57 2022] POST /identity/v3/projects => generated 389 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:57.692774 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb8b9d-d031-43fa-8642-e815297faeb5 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:57.699067 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6bbb8b9d-d031-43fa-8642-e815297faeb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:57.900219 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb8b9d-d031-43fa-8642-e815297faeb5 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:57.907193 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12c659-f233-4186-b138-b879cc9e7440 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:57.907928 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12c659-f233-4186-b138-b879cc9e7440 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:57.908249 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12c659-f233-4186-b138-b879cc9e7440 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:57.908563 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12c659-f233-4186-b138-b879cc9e7440 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:57.915151 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b70af-891c-49f1-8cc7-40c6a6dc4e91 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:57.936996 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d12c659-f233-4186-b138-b879cc9e7440 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:57.938944 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d12c659-f233-4186-b138-b879cc9e7440 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:57.991061 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 899/1774] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:37:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:37:57.991061 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12c659-f233-4186-b138-b879cc9e7440 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:58.155368 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12c659-f233-4186-b138-b879cc9e7440 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:58.155620 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d6e07a-2c9d-43fb-9999-6d75de4eafd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:58.156098 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6e07a-2c9d-43fb-9999-6d75de4eafd7 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:58.156377 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6e07a-2c9d-43fb-9999-6d75de4eafd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:58.156670 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6e07a-2c9d-43fb-9999-6d75de4eafd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:58.157313 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d6e07a-2c9d-43fb-9999-6d75de4eafd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:58.159051 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d6e07a-2c9d-43fb-9999-6d75de4eafd7 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:58.161964 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e93d5-0175-4ab0-962d-67fb3b188e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:58.164679 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e93d5-0175-4ab0-962d-67fb3b188e9e admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:58.166073 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e93d5-0175-4ab0-962d-67fb3b188e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:58.166590 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e93d5-0175-4ab0-962d-67fb3b188e9e admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:58.168186 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29e93d5-0175-4ab0-962d-67fb3b188e9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:58.170932 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29e93d5-0175-4ab0-962d-67fb3b188e9e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:58.193547 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 876/1775] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 555 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:37:58.195781 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d6e07a-2c9d-43fb-9999-6d75de4eafd7 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:58.210202 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d6e07a-2c9d-43fb-9999-6d75de4eafd7 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:58.216920 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720daf51-e4e2-4fe3-96cc-b277690dbe94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:58.227316 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720daf51-e4e2-4fe3-96cc-b277690dbe94 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:58.227642 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720daf51-e4e2-4fe3-96cc-b277690dbe94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:58.227935 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720daf51-e4e2-4fe3-96cc-b277690dbe94 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:58.228649 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720daf51-e4e2-4fe3-96cc-b277690dbe94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:58.230627 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720daf51-e4e2-4fe3-96cc-b277690dbe94 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:58.234336 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 900/1776] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:37:57 2022] POST /identity/v3/users => generated 302 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:58.234336 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e93d5-0175-4ab0-962d-67fb3b188e9e admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:58.274103 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 877/1777] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:37:58 2022] POST /identity/v3/users => generated 301 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:58.275472 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e93d5-0175-4ab0-962d-67fb3b188e9e admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:58.284364 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720daf51-e4e2-4fe3-96cc-b277690dbe94 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:58.289198 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb93b2-5a1f-4316-8cfc-f8631d39e2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:58.291065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb93b2-5a1f-4316-8cfc-f8631d39e2d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:58.292760 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb93b2-5a1f-4316-8cfc-f8631d39e2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:58.293783 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb93b2-5a1f-4316-8cfc-f8631d39e2d6 admin admin] PATH_INFO: `/v3/projects/0c47883a165c4bd8bc3fd43920c9251d/users/6a83d3f420d3472586858e35b3829328/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:58.299167 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eb93b2-5a1f-4316-8cfc-f8631d39e2d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c47883a165c4bd8bc3fd43920c9251d, user_id=6a83d3f420d3472586858e35b3829328, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:58.304711 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eb93b2-5a1f-4316-8cfc-f8631d39e2d6 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:58.321797 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720daf51-e4e2-4fe3-96cc-b277690dbe94 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:58.340243 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd81809-5394-4bf7-8251-b4bb1bd0e622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:58.342862 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd81809-5394-4bf7-8251-b4bb1bd0e622 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:58.343438 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd81809-5394-4bf7-8251-b4bb1bd0e622 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:58.343906 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd81809-5394-4bf7-8251-b4bb1bd0e622 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:58.344860 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd81809-5394-4bf7-8251-b4bb1bd0e622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:58.359659 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd81809-5394-4bf7-8251-b4bb1bd0e622 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:58.362225 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 901/1778] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:37:58 2022] PUT /identity/v3/projects/0c47883a165c4bd8bc3fd43920c9251d/users/6a83d3f420d3472586858e35b3829328/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:58.365115 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb93b2-5a1f-4316-8cfc-f8631d39e2d6 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:58.416446 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 878/1779] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:37:58.418968 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476f77d-7505-4485-b7be-e4e7957ea1d1 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:58.422138 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476f77d-7505-4485-b7be-e4e7957ea1d1 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:58.422611 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476f77d-7505-4485-b7be-e4e7957ea1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:58.514828 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:58.529931 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-f476f77d-7505-4485-b7be-e4e7957ea1d1 None None] MFA Rules not processed for user `6a83d3f420d3472586858e35b3829328`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:58.531571 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f476f77d-7505-4485-b7be-e4e7957ea1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:58.545546 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb93b2-5a1f-4316-8cfc-f8631d39e2d6 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:58.552295 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382aa84-2e8c-42cd-aad9-8ca068131d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:58.553435 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382aa84-2e8c-42cd-aad9-8ca068131d5a admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:58.553970 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382aa84-2e8c-42cd-aad9-8ca068131d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:58.554344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382aa84-2e8c-42cd-aad9-8ca068131d5a admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:58.555202 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382aa84-2e8c-42cd-aad9-8ca068131d5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:58.557823 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382aa84-2e8c-42cd-aad9-8ca068131d5a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:58.574469 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 902/1780] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:37:58.577650 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382aa84-2e8c-42cd-aad9-8ca068131d5a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:58.598836 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382aa84-2e8c-42cd-aad9-8ca068131d5a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:58.604819 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:58.620067 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750d9cf-ad19-4aed-b51e-eb411a8c6939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:58.621827 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750d9cf-ad19-4aed-b51e-eb411a8c6939 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:58.622219 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750d9cf-ad19-4aed-b51e-eb411a8c6939 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:58.622599 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750d9cf-ad19-4aed-b51e-eb411a8c6939 admin admin] PATH_INFO: `/v3/projects/368a34556056443f861ec8f09cbe39a7/users/db6a093d0b4140c6af8de1ef0fc6a232/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:58.669842 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6750d9cf-ad19-4aed-b51e-eb411a8c6939 admin admin] RBAC: Authorizing `identity:create_grant(project_id=368a34556056443f861ec8f09cbe39a7, user_id=db6a093d0b4140c6af8de1ef0fc6a232, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:58.678757 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6750d9cf-ad19-4aed-b51e-eb411a8c6939 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:58.731111 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 903/1781] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:37:58 2022] PUT /identity/v3/projects/368a34556056443f861ec8f09cbe39a7/users/db6a093d0b4140c6af8de1ef0fc6a232/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:58.734464 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750d9cf-ad19-4aed-b51e-eb411a8c6939 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:58.799861 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 879/1782] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:58 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:58.801274 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f476f77d-7505-4485-b7be-e4e7957ea1d1 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:58.829842 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f476f77d-7505-4485-b7be-e4e7957ea1d1 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:59.058041 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750d9cf-ad19-4aed-b51e-eb411a8c6939 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:59.069438 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e3398-f6ac-4d37-baa1-3ec0eff68c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:59.070663 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e3398-f6ac-4d37-baa1-3ec0eff68c6d admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:59.071830 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e3398-f6ac-4d37-baa1-3ec0eff68c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:59.072394 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e3398-f6ac-4d37-baa1-3ec0eff68c6d admin admin] PATH_INFO: `/v3/projects/9dc3c7013c434641a8f461258d4e1d82/users/c874ced355e04bc5914827ffe2702e27/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:59.113731 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e3398-f6ac-4d37-baa1-3ec0eff68c6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dc3c7013c434641a8f461258d4e1d82, user_id=c874ced355e04bc5914827ffe2702e27, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:59.123953 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e3398-f6ac-4d37-baa1-3ec0eff68c6d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:59.125287 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626e1ee-4fd7-406d-9fdf-ee39e795ccb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:59.126103 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626e1ee-4fd7-406d-9fdf-ee39e795ccb6 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:59.126662 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626e1ee-4fd7-406d-9fdf-ee39e795ccb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:59.127250 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626e1ee-4fd7-406d-9fdf-ee39e795ccb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:59.128250 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a626e1ee-4fd7-406d-9fdf-ee39e795ccb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:59.132566 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a626e1ee-4fd7-406d-9fdf-ee39e795ccb6 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:59.159062 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 880/1783] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:37:59.159995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626e1ee-4fd7-406d-9fdf-ee39e795ccb6 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:59.181737 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 904/1784] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:37:58 2022] PUT /identity/v3/projects/9dc3c7013c434641a8f461258d4e1d82/users/c874ced355e04bc5914827ffe2702e27/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:59.184901 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e3398-f6ac-4d37-baa1-3ec0eff68c6d admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:59.323141 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e3398-f6ac-4d37-baa1-3ec0eff68c6d admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:59.329329 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26568eb1-5d53-4cd7-bc23-4b86167ac58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:59.330562 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26568eb1-5d53-4cd7-bc23-4b86167ac58e admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:59.331081 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26568eb1-5d53-4cd7-bc23-4b86167ac58e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:59.331951 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26568eb1-5d53-4cd7-bc23-4b86167ac58e admin admin] PATH_INFO: `/v3/projects/368a34556056443f861ec8f09cbe39a7/users/db6a093d0b4140c6af8de1ef0fc6a232/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:59.335159 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26568eb1-5d53-4cd7-bc23-4b86167ac58e admin admin] RBAC: Authorizing `identity:create_grant(project_id=368a34556056443f861ec8f09cbe39a7, user_id=db6a093d0b4140c6af8de1ef0fc6a232, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:59.338308 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26568eb1-5d53-4cd7-bc23-4b86167ac58e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:59.369743 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 905/1785] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:37:59 2022] PUT /identity/v3/projects/368a34556056443f861ec8f09cbe39a7/users/db6a093d0b4140c6af8de1ef0fc6a232/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:59.370091 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26568eb1-5d53-4cd7-bc23-4b86167ac58e admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:59.372086 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626e1ee-4fd7-406d-9fdf-ee39e795ccb6 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:59.517069 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:59.542098 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:59.597164 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26568eb1-5d53-4cd7-bc23-4b86167ac58e admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:59.598455 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef645233-6d5f-40d1-9683-0d6212d81911 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:59.599539 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef645233-6d5f-40d1-9683-0d6212d81911 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:59.601660 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef645233-6d5f-40d1-9683-0d6212d81911 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:59.602880 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef645233-6d5f-40d1-9683-0d6212d81911 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:59.610670 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df7ddfc-be48-42fc-bec7-f02c04b50fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:59.611435 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df7ddfc-be48-42fc-bec7-f02c04b50fbb admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:59.611812 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df7ddfc-be48-42fc-bec7-f02c04b50fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:59.612180 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df7ddfc-be48-42fc-bec7-f02c04b50fbb admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:59.616841 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df7ddfc-be48-42fc-bec7-f02c04b50fbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:59.623139 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df7ddfc-be48-42fc-bec7-f02c04b50fbb admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:59.647502 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 906/1786] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:37:59.652321 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bd486-c0b0-4bb0-a0e7-cfc7d83741a8 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:59.656775 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bd486-c0b0-4bb0-a0e7-cfc7d83741a8 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:59.657569 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bd486-c0b0-4bb0-a0e7-cfc7d83741a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:59.749729 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-418bd486-c0b0-4bb0-a0e7-cfc7d83741a8 None None] MFA Rules not processed for user `db6a093d0b4140c6af8de1ef0fc6a232`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:59.751086 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-418bd486-c0b0-4bb0-a0e7-cfc7d83741a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:59.768889 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef645233-6d5f-40d1-9683-0d6212d81911 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:59.770810 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef645233-6d5f-40d1-9683-0d6212d81911 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:59.793841 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 881/1787] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:37:59 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 634 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:37:59.798094 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef645233-6d5f-40d1-9683-0d6212d81911 service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:59.816072 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef645233-6d5f-40d1-9683-0d6212d81911 service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:59.828504 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef1e40-63df-45bb-a3cc-100457ad1af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:59.829356 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef1e40-63df-45bb-a3cc-100457ad1af1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:59.829826 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef1e40-63df-45bb-a3cc-100457ad1af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:59.831049 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef1e40-63df-45bb-a3cc-100457ad1af1 admin admin] PATH_INFO: `/v3/projects/9dc3c7013c434641a8f461258d4e1d82/users/c874ced355e04bc5914827ffe2702e27/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:59.835211 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ef1e40-63df-45bb-a3cc-100457ad1af1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dc3c7013c434641a8f461258d4e1d82, user_id=c874ced355e04bc5914827ffe2702e27, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:59.841569 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ef1e40-63df-45bb-a3cc-100457ad1af1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:59.862981 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 882/1788] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:37:59 2022] PUT /identity/v3/projects/9dc3c7013c434641a8f461258d4e1d82/users/c874ced355e04bc5914827ffe2702e27/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:59.874840 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f05b5-089b-44e2-8c19-5662baaf5765 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:59.877396 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f05b5-089b-44e2-8c19-5662baaf5765 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:59.878951 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f05b5-089b-44e2-8c19-5662baaf5765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:59.916659 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 907/1789] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:59 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:59.918390 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8560f7-b656-4a1b-b2fe-0f9ca5986214 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:59.919841 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8560f7-b656-4a1b-b2fe-0f9ca5986214 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:59.920721 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8560f7-b656-4a1b-b2fe-0f9ca5986214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:59.952238 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-467f05b5-089b-44e2-8c19-5662baaf5765 None None] MFA Rules not processed for user `06856f1488e44bde85de23a5effddbdd`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:59.953642 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-467f05b5-089b-44e2-8c19-5662baaf5765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:59.998138 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-3a8560f7-b656-4a1b-b2fe-0f9ca5986214 None None] MFA Rules not processed for user `c874ced355e04bc5914827ffe2702e27`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:00.000444 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3a8560f7-b656-4a1b-b2fe-0f9ca5986214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:00.138408 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 883/1790] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:59 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:00.145759 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f05b5-089b-44e2-8c19-5662baaf5765 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:00.147238 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-467f05b5-089b-44e2-8c19-5662baaf5765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:00.205532 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 908/1791] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:37:59 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:00.206136 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8560f7-b656-4a1b-b2fe-0f9ca5986214 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:00.309056 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:00.337416 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f05b5-089b-44e2-8c19-5662baaf5765 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:00.360987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151039e0-aa9d-49bb-8c2f-b515cc58e446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:00.363807 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151039e0-aa9d-49bb-8c2f-b515cc58e446 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:00.364260 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151039e0-aa9d-49bb-8c2f-b515cc58e446 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:00.364716 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151039e0-aa9d-49bb-8c2f-b515cc58e446 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:00.368288 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151039e0-aa9d-49bb-8c2f-b515cc58e446 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:00.374606 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151039e0-aa9d-49bb-8c2f-b515cc58e446 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:00.388555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8560f7-b656-4a1b-b2fe-0f9ca5986214 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:00.398959 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:00.405580 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2304ff-8fbb-4819-b3d4-bcad9ff89d2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:00.406341 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2304ff-8fbb-4819-b3d4-bcad9ff89d2a service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:00.407001 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2304ff-8fbb-4819-b3d4-bcad9ff89d2a service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:00.407001 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2304ff-8fbb-4819-b3d4-bcad9ff89d2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:00.438703 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 884/1792] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:38:00 2022] POST /identity/v3/projects => generated 403 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:38:00.444907 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151039e0-aa9d-49bb-8c2f-b515cc58e446 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:00.572916 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2304ff-8fbb-4819-b3d4-bcad9ff89d2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:00.576577 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2304ff-8fbb-4819-b3d4-bcad9ff89d2a service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:00.620244 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 909/1793] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:00 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:38:00.622428 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2304ff-8fbb-4819-b3d4-bcad9ff89d2a service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:00.645017 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2304ff-8fbb-4819-b3d4-bcad9ff89d2a service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:00.655295 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151039e0-aa9d-49bb-8c2f-b515cc58e446 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:00.663080 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f404858-475a-4212-90d8-1051ccad446a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:00.663912 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f404858-475a-4212-90d8-1051ccad446a service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:00.664184 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f404858-475a-4212-90d8-1051ccad446a service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:00.664456 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f404858-475a-4212-90d8-1051ccad446a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:00.744050 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f404858-475a-4212-90d8-1051ccad446a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:00.744050 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f404858-475a-4212-90d8-1051ccad446a service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:00.756527 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 885/1794] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:00 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:38:00.757832 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64cee1e-bf8b-450d-b630-3c359307ae41 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:00.758116 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64cee1e-bf8b-450d-b630-3c359307ae41 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:00.758409 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64cee1e-bf8b-450d-b630-3c359307ae41 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:00.760547 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 886/1795] 10.222.0.83 () {54 vars in 921 bytes} [Mon Aug 29 15:38:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:38:00.761265 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64cee1e-bf8b-450d-b630-3c359307ae41 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:00.778612 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64cee1e-bf8b-450d-b630-3c359307ae41 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:00.785970 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c74bd-1bbf-472b-ad4c-0d8904b85940 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:00.786797 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c74bd-1bbf-472b-ad4c-0d8904b85940 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:00.787892 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c74bd-1bbf-472b-ad4c-0d8904b85940 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:00.788324 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c74bd-1bbf-472b-ad4c-0d8904b85940 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:00.856255 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d975f8-5ea3-47d6-bdee-bc90b2d78060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:00.864066 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d975f8-5ea3-47d6-bdee-bc90b2d78060 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:00.864461 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d975f8-5ea3-47d6-bdee-bc90b2d78060 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:00.865403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d975f8-5ea3-47d6-bdee-bc90b2d78060 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:00.868433 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d975f8-5ea3-47d6-bdee-bc90b2d78060 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:00.872302 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c74bd-1bbf-472b-ad4c-0d8904b85940 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:00.873716 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c74bd-1bbf-472b-ad4c-0d8904b85940 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:00.874493 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d975f8-5ea3-47d6-bdee-bc90b2d78060 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:00.886321 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 887/1796] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:00 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:38:00.887879 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95fefe-01a4-43b7-8ada-f89a49f8debb None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:00.888164 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95fefe-01a4-43b7-8ada-f89a49f8debb None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:00.888436 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95fefe-01a4-43b7-8ada-f89a49f8debb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:00.945477 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 910/1797] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:38:00 2022] POST /identity/v3/users => generated 308 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:00.949256 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d975f8-5ea3-47d6-bdee-bc90b2d78060 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:00.962247 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-3e95fefe-01a4-43b7-8ada-f89a49f8debb None None] MFA Rules not processed for user `253947a5ef294d2bb828761873251bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:00.965516 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3e95fefe-01a4-43b7-8ada-f89a49f8debb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:00.980440 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d975f8-5ea3-47d6-bdee-bc90b2d78060 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:00.988102 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 888/1798] 10.222.0.83 () {58 vars in 1018 bytes} [Mon Aug 29 15:38:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:00.995347 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a92a5f-4afb-4aa1-a2ea-fa9fff70b5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:01.000100 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a92a5f-4afb-4aa1-a2ea-fa9fff70b5ac admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:01.000376 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a92a5f-4afb-4aa1-a2ea-fa9fff70b5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:01.000653 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a92a5f-4afb-4aa1-a2ea-fa9fff70b5ac admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:01.003542 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a92a5f-4afb-4aa1-a2ea-fa9fff70b5ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:01.005179 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a92a5f-4afb-4aa1-a2ea-fa9fff70b5ac admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:01.036581 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 911/1799] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:01.038873 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95fefe-01a4-43b7-8ada-f89a49f8debb None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:01.068706 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95fefe-01a4-43b7-8ada-f89a49f8debb None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:01.077974 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cda6cd-90dc-402f-a211-f7cc65d78894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:01.078250 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cda6cd-90dc-402f-a211-f7cc65d78894 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:01.078385 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cda6cd-90dc-402f-a211-f7cc65d78894 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:01.079215 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cda6cd-90dc-402f-a211-f7cc65d78894 admin admin] PATH_INFO: `/v3/projects/3c07d296b6904cf1af9bdba98ce434e9/users/f2c1a5b07fa94554878fe1d7c2d86992/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:01.096467 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:01.107286 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cda6cd-90dc-402f-a211-f7cc65d78894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c07d296b6904cf1af9bdba98ce434e9, user_id=f2c1a5b07fa94554878fe1d7c2d86992, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:01.112164 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cda6cd-90dc-402f-a211-f7cc65d78894 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:01.134965 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 889/1800] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:38:01 2022] PUT /identity/v3/projects/3c07d296b6904cf1af9bdba98ce434e9/users/f2c1a5b07fa94554878fe1d7c2d86992/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:38:01.139238 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a92a5f-4afb-4aa1-a2ea-fa9fff70b5ac admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:01.153379 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cda6cd-90dc-402f-a211-f7cc65d78894 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:01.155903 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a92a5f-4afb-4aa1-a2ea-fa9fff70b5ac admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:01.302506 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cda6cd-90dc-402f-a211-f7cc65d78894 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:01.311336 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a52e6-9291-4f02-ad65-6c0298e6cc1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:01.312162 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a52e6-9291-4f02-ad65-6c0298e6cc1d service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:01.312441 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a52e6-9291-4f02-ad65-6c0298e6cc1d service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:01.312713 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a52e6-9291-4f02-ad65-6c0298e6cc1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:01.323696 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:01.324884 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957a52e6-9291-4f02-ad65-6c0298e6cc1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:01.326884 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957a52e6-9291-4f02-ad65-6c0298e6cc1d service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:01.342737 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289014e1-a136-4a22-82f5-9810e9197154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:01.354192 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 890/1801] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:38:01.355207 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a52e6-9291-4f02-ad65-6c0298e6cc1d service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:01.360127 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289014e1-a136-4a22-82f5-9810e9197154 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:01.362654 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289014e1-a136-4a22-82f5-9810e9197154 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:01.365181 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289014e1-a136-4a22-82f5-9810e9197154 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:01.371066 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289014e1-a136-4a22-82f5-9810e9197154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:01.378685 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289014e1-a136-4a22-82f5-9810e9197154 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:01.381288 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a52e6-9291-4f02-ad65-6c0298e6cc1d service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:01.399366 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4953d790-ae79-43a3-932a-dc429f0ed73b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:01.401214 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953d790-ae79-43a3-932a-dc429f0ed73b service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:01.402915 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953d790-ae79-43a3-932a-dc429f0ed73b service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:01.403414 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953d790-ae79-43a3-932a-dc429f0ed73b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:01.423269 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 912/1802] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:01.427317 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289014e1-a136-4a22-82f5-9810e9197154 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:01.461444 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289014e1-a136-4a22-82f5-9810e9197154 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:01.486568 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e352aff-563d-49e1-a785-e898807bed88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:01.488943 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e352aff-563d-49e1-a785-e898807bed88 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:01.490270 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e352aff-563d-49e1-a785-e898807bed88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:01.491365 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e352aff-563d-49e1-a785-e898807bed88 admin admin] PATH_INFO: `/v3/projects/3c07d296b6904cf1af9bdba98ce434e9/users/f2c1a5b07fa94554878fe1d7c2d86992/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:01.499003 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e352aff-563d-49e1-a785-e898807bed88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c07d296b6904cf1af9bdba98ce434e9, user_id=f2c1a5b07fa94554878fe1d7c2d86992, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:01.543837 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e352aff-563d-49e1-a785-e898807bed88 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:01.558127 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4953d790-ae79-43a3-932a-dc429f0ed73b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:01.560261 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4953d790-ae79-43a3-932a-dc429f0ed73b service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:01.587255 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 913/1804] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:38:01 2022] PUT /identity/v3/projects/3c07d296b6904cf1af9bdba98ce434e9/users/f2c1a5b07fa94554878fe1d7c2d86992/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:01.587710 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 891/1804] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:01 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:38:01.735616 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e352aff-563d-49e1-a785-e898807bed88 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:01.932447 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e352aff-563d-49e1-a785-e898807bed88 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:01.941155 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4d8d8-85c8-4ea4-8c0b-1f0cc2a416c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:01.942115 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4d8d8-85c8-4ea4-8c0b-1f0cc2a416c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:01.942566 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4d8d8-85c8-4ea4-8c0b-1f0cc2a416c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:01.943041 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4d8d8-85c8-4ea4-8c0b-1f0cc2a416c2 admin admin] PATH_INFO: `/v3/users/e1206394e083461db26e3e5b65051dec` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:01.945240 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c4d8d8-85c8-4ea4-8c0b-1f0cc2a416c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1206394e083461db26e3e5b65051dec)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:01.947479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c4d8d8-85c8-4ea4-8c0b-1f0cc2a416c2 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:02.084873 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-43c4d8d8-85c8-4ea4-8c0b-1f0cc2a416c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1206394e083461db26e3e5b65051dec'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:02.085986 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-43c4d8d8-85c8-4ea4-8c0b-1f0cc2a416c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1206394e083461db26e3e5b65051dec'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:02.109538 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-43c4d8d8-85c8-4ea4-8c0b-1f0cc2a416c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1206394e083461db26e3e5b65051dec'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:02.136728 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-43c4d8d8-85c8-4ea4-8c0b-1f0cc2a416c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1206394e083461db26e3e5b65051dec'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:02.151690 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-43c4d8d8-85c8-4ea4-8c0b-1f0cc2a416c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1206394e083461db26e3e5b65051dec'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:02.163296 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 914/1805] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:38:01 2022] DELETE /identity/v3/users/e1206394e083461db26e3e5b65051dec => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:02.167774 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a2233-1045-4bf8-8ba8-1c80b2a6de7e None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:02.168363 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a2233-1045-4bf8-8ba8-1c80b2a6de7e None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:02.168363 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a2233-1045-4bf8-8ba8-1c80b2a6de7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:02.257576 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-796a2233-1045-4bf8-8ba8-1c80b2a6de7e None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:02.273216 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-796a2233-1045-4bf8-8ba8-1c80b2a6de7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:02.332895 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4d8d8-85c8-4ea4-8c0b-1f0cc2a416c2 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:02.335285 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-43c4d8d8-85c8-4ea4-8c0b-1f0cc2a416c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:02.551982 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 892/1806] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:02.563580 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a2233-1045-4bf8-8ba8-1c80b2a6de7e None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:02.565143 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-796a2233-1045-4bf8-8ba8-1c80b2a6de7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:02.619212 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:02.658332 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:02.667944 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4d8d8-85c8-4ea4-8c0b-1f0cc2a416c2 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:02.685659 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c720a71-e779-47c5-9710-c5a7f21f7930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:02.686324 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c720a71-e779-47c5-9710-c5a7f21f7930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:02.686603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c720a71-e779-47c5-9710-c5a7f21f7930 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:02.686877 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c720a71-e779-47c5-9710-c5a7f21f7930 admin admin] PATH_INFO: `/v3/users/e4f1fb333aaa493f91c1ae14f4f08f58` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:02.691059 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c720a71-e779-47c5-9710-c5a7f21f7930 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4f1fb333aaa493f91c1ae14f4f08f58)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:02.699174 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c720a71-e779-47c5-9710-c5a7f21f7930 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:02.720097 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a2233-1045-4bf8-8ba8-1c80b2a6de7e None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:02.724345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca6cb5-194f-4afc-9d8d-f0ef80cadd7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:02.726480 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca6cb5-194f-4afc-9d8d-f0ef80cadd7a service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:02.726940 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca6cb5-194f-4afc-9d8d-f0ef80cadd7a service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:02.727786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca6cb5-194f-4afc-9d8d-f0ef80cadd7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:02.744085 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca6cb5-194f-4afc-9d8d-f0ef80cadd7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:02.745900 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca6cb5-194f-4afc-9d8d-f0ef80cadd7a service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:02.786191 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 893/1807] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:38:02.837488 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca6cb5-194f-4afc-9d8d-f0ef80cadd7a service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:02.839376 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-eeca6cb5-194f-4afc-9d8d-f0ef80cadd7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:02.847133 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0c720a71-e779-47c5-9710-c5a7f21f7930 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4f1fb333aaa493f91c1ae14f4f08f58'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:02.848905 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0c720a71-e779-47c5-9710-c5a7f21f7930 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4f1fb333aaa493f91c1ae14f4f08f58'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:02.878344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0c720a71-e779-47c5-9710-c5a7f21f7930 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4f1fb333aaa493f91c1ae14f4f08f58'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:02.883354 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca6cb5-194f-4afc-9d8d-f0ef80cadd7a service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:02.889854 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0c720a71-e779-47c5-9710-c5a7f21f7930 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4f1fb333aaa493f91c1ae14f4f08f58'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:02.902888 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0c720a71-e779-47c5-9710-c5a7f21f7930 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4f1fb333aaa493f91c1ae14f4f08f58'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:02.905052 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450e3cc-008c-4afe-a4c6-9f06f18c0182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:02.907327 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450e3cc-008c-4afe-a4c6-9f06f18c0182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:02.909679 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450e3cc-008c-4afe-a4c6-9f06f18c0182 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:02.910951 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450e3cc-008c-4afe-a4c6-9f06f18c0182 admin admin] PATH_INFO: `/v3/users/8e694885e1b14e94a1061d12473c2b4a` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:02.912019 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 915/1808] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:38:02 2022] DELETE /identity/v3/users/e4f1fb333aaa493f91c1ae14f4f08f58 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:38:02.914059 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c720a71-e779-47c5-9710-c5a7f21f7930 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:02.915808 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0c720a71-e779-47c5-9710-c5a7f21f7930 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:02.917241 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c450e3cc-008c-4afe-a4c6-9f06f18c0182 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e694885e1b14e94a1061d12473c2b4a)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:02.923182 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c450e3cc-008c-4afe-a4c6-9f06f18c0182 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:03.017574 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c720a71-e779-47c5-9710-c5a7f21f7930 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:03.025225 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f924e34-331e-4bd3-b837-0b5c1b57bfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:03.026474 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f924e34-331e-4bd3-b837-0b5c1b57bfae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:03.026849 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f924e34-331e-4bd3-b837-0b5c1b57bfae admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:03.027290 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f924e34-331e-4bd3-b837-0b5c1b57bfae admin admin] PATH_INFO: `/v3/users/e6002b79c5234c86a7aee79c4a245eaf` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:03.029874 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f924e34-331e-4bd3-b837-0b5c1b57bfae admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6002b79c5234c86a7aee79c4a245eaf)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:03.033189 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f924e34-331e-4bd3-b837-0b5c1b57bfae admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:03.058091 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c450e3cc-008c-4afe-a4c6-9f06f18c0182 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e694885e1b14e94a1061d12473c2b4a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:03.059899 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c450e3cc-008c-4afe-a4c6-9f06f18c0182 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e694885e1b14e94a1061d12473c2b4a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:03.085791 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c450e3cc-008c-4afe-a4c6-9f06f18c0182 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e694885e1b14e94a1061d12473c2b4a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:03.106087 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c450e3cc-008c-4afe-a4c6-9f06f18c0182 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e694885e1b14e94a1061d12473c2b4a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:03.106914 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c450e3cc-008c-4afe-a4c6-9f06f18c0182 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e694885e1b14e94a1061d12473c2b4a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:03.146348 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 894/1809] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:38:02 2022] DELETE /identity/v3/users/8e694885e1b14e94a1061d12473c2b4a => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:38:03.152668 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5f924e34-331e-4bd3-b837-0b5c1b57bfae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6002b79c5234c86a7aee79c4a245eaf'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:03.153406 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5f924e34-331e-4bd3-b837-0b5c1b57bfae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6002b79c5234c86a7aee79c4a245eaf'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:03.155291 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad21f8b-61c2-4020-9e39-1815bab422a1 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:03.155794 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad21f8b-61c2-4020-9e39-1815bab422a1 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:03.156088 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad21f8b-61c2-4020-9e39-1815bab422a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:03.198572 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5f924e34-331e-4bd3-b837-0b5c1b57bfae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6002b79c5234c86a7aee79c4a245eaf'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:03.198781 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-aad21f8b-61c2-4020-9e39-1815bab422a1 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:03.200363 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-aad21f8b-61c2-4020-9e39-1815bab422a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:03.217469 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5f924e34-331e-4bd3-b837-0b5c1b57bfae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6002b79c5234c86a7aee79c4a245eaf'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:03.224916 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:03.229920 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5f924e34-331e-4bd3-b837-0b5c1b57bfae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6002b79c5234c86a7aee79c4a245eaf'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:03.248365 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 916/1810] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:38:02 2022] DELETE /identity/v3/users/e6002b79c5234c86a7aee79c4a245eaf => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:03.253709 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2a6b7-9dfd-4f68-a114-44469eed2eef None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:03.254027 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2a6b7-9dfd-4f68-a114-44469eed2eef None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:03.254260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2a6b7-9dfd-4f68-a114-44469eed2eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:03.301890 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-17d2a6b7-9dfd-4f68-a114-44469eed2eef None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:03.309106 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-17d2a6b7-9dfd-4f68-a114-44469eed2eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:03.338792 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 895/1811] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:03.341276 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc399bb4-c924-48df-8bfc-83f12443771f None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:03.341565 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc399bb4-c924-48df-8bfc-83f12443771f None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:03.341926 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc399bb4-c924-48df-8bfc-83f12443771f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:03.390906 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-dc399bb4-c924-48df-8bfc-83f12443771f None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:03.392733 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-dc399bb4-c924-48df-8bfc-83f12443771f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:03.425903 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:03.443112 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 917/1812] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:03.443112 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2a6b7-9dfd-4f68-a114-44469eed2eef None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:03.455551 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-17d2a6b7-9dfd-4f68-a114-44469eed2eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:03.521086 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 896/1813] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:03.522735 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc399bb4-c924-48df-8bfc-83f12443771f None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:03.524350 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-dc399bb4-c924-48df-8bfc-83f12443771f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:03.586933 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2a6b7-9dfd-4f68-a114-44469eed2eef None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:03.598565 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe2263d-b567-4d15-b5a6-8dea98da3847 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:03.600970 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2263d-b567-4d15-b5a6-8dea98da3847 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:03.601375 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2263d-b567-4d15-b5a6-8dea98da3847 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:03.601739 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2263d-b567-4d15-b5a6-8dea98da3847 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:03.623643 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe2263d-b567-4d15-b5a6-8dea98da3847 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:03.625243 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe2263d-b567-4d15-b5a6-8dea98da3847 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:03.659222 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 918/1814] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:38:03.664909 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe2263d-b567-4d15-b5a6-8dea98da3847 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:03.686633 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe2263d-b567-4d15-b5a6-8dea98da3847 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:03.691517 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc399bb4-c924-48df-8bfc-83f12443771f None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:03.693160 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113475f1-390d-47bb-845a-efffc2ac831a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:03.694677 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113475f1-390d-47bb-845a-efffc2ac831a service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:03.694961 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113475f1-390d-47bb-845a-efffc2ac831a service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:03.695279 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113475f1-390d-47bb-845a-efffc2ac831a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:03.701936 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605be186-05e5-4c60-828c-80ed0a317c4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:03.701936 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605be186-05e5-4c60-828c-80ed0a317c4e service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:03.701936 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605be186-05e5-4c60-828c-80ed0a317c4e service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:03.701936 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605be186-05e5-4c60-828c-80ed0a317c4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:03.735569 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113475f1-390d-47bb-845a-efffc2ac831a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:03.744868 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113475f1-390d-47bb-845a-efffc2ac831a service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:03.745073 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605be186-05e5-4c60-828c-80ed0a317c4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:03.746532 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605be186-05e5-4c60-828c-80ed0a317c4e service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:03.760090 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 919/1815] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:38:03.779586 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 897/1816] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:38:05.025461 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113475f1-390d-47bb-845a-efffc2ac831a service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:05.027104 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-113475f1-390d-47bb-845a-efffc2ac831a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:05.050619 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113475f1-390d-47bb-845a-efffc2ac831a service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:05.075463 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77e2d8-6560-41de-aec5-a2ef224f81d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:05.076186 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77e2d8-6560-41de-aec5-a2ef224f81d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:05.076491 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77e2d8-6560-41de-aec5-a2ef224f81d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:05.076826 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77e2d8-6560-41de-aec5-a2ef224f81d8 admin admin] PATH_INFO: `/v3/projects/a6cef739dab64042a213907e6360b88b` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:05.081075 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa77e2d8-6560-41de-aec5-a2ef224f81d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6cef739dab64042a213907e6360b88b)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:05.082949 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa77e2d8-6560-41de-aec5-a2ef224f81d8 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:05.199300 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-aa77e2d8-6560-41de-aec5-a2ef224f81d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6cef739dab64042a213907e6360b88b', 'request_id': 'req-aa77e2d8-6560-41de-aec5-a2ef224f81d8'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:05.220605 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-aa77e2d8-6560-41de-aec5-a2ef224f81d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6cef739dab64042a213907e6360b88b', 'request_id': 'req-aa77e2d8-6560-41de-aec5-a2ef224f81d8'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:05.236645 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-aa77e2d8-6560-41de-aec5-a2ef224f81d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6cef739dab64042a213907e6360b88b', 'request_id': 'req-aa77e2d8-6560-41de-aec5-a2ef224f81d8'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:05.262645 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605be186-05e5-4c60-828c-80ed0a317c4e service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:05.267732 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-605be186-05e5-4c60-828c-80ed0a317c4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:05.329210 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605be186-05e5-4c60-828c-80ed0a317c4e service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:05.334663 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-aa77e2d8-6560-41de-aec5-a2ef224f81d8 admin admin] The token cache is being invalidate because project a6cef739dab64042a213907e6360b88b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:38:05.334663 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-aa77e2d8-6560-41de-aec5-a2ef224f81d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:05.336934 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-aa77e2d8-6560-41de-aec5-a2ef224f81d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:05.339230 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 920/1817] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:38:05 2022] DELETE /identity/v3/projects/a6cef739dab64042a213907e6360b88b => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:05.348577 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77e2d8-6560-41de-aec5-a2ef224f81d8 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:05.361353 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-aa77e2d8-6560-41de-aec5-a2ef224f81d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:05.396136 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:05.532175 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b915b1df-2da9-4fa3-8977-468e11f9c7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:05.532995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915b1df-2da9-4fa3-8977-468e11f9c7f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:05.535258 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915b1df-2da9-4fa3-8977-468e11f9c7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:05.535872 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915b1df-2da9-4fa3-8977-468e11f9c7f7 admin admin] PATH_INFO: `/v3/projects/c643cefb38c648c888cd0f6b23821471` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:05.539855 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b915b1df-2da9-4fa3-8977-468e11f9c7f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c643cefb38c648c888cd0f6b23821471)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:05.542498 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b915b1df-2da9-4fa3-8977-468e11f9c7f7 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:05.581374 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77e2d8-6560-41de-aec5-a2ef224f81d8 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:05.597522 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d3b91-1e34-4f73-bae2-cb1a4db096cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:05.598376 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d3b91-1e34-4f73-bae2-cb1a4db096cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:05.598876 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d3b91-1e34-4f73-bae2-cb1a4db096cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:05.599315 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d3b91-1e34-4f73-bae2-cb1a4db096cb admin admin] PATH_INFO: `/v3/projects/f578d0e6a2d34a08a5f1f8cf4808bdd5` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:05.611159 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d3b91-1e34-4f73-bae2-cb1a4db096cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f578d0e6a2d34a08a5f1f8cf4808bdd5)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:05.613455 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d3b91-1e34-4f73-bae2-cb1a4db096cb admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:05.712765 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b915b1df-2da9-4fa3-8977-468e11f9c7f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c643cefb38c648c888cd0f6b23821471', 'request_id': 'req-b915b1df-2da9-4fa3-8977-468e11f9c7f7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:05.723673 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b915b1df-2da9-4fa3-8977-468e11f9c7f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c643cefb38c648c888cd0f6b23821471', 'request_id': 'req-b915b1df-2da9-4fa3-8977-468e11f9c7f7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:05.736274 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b915b1df-2da9-4fa3-8977-468e11f9c7f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c643cefb38c648c888cd0f6b23821471', 'request_id': 'req-b915b1df-2da9-4fa3-8977-468e11f9c7f7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:05.760037 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:05.768608 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f27d3b91-1e34-4f73-bae2-cb1a4db096cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f578d0e6a2d34a08a5f1f8cf4808bdd5', 'request_id': 'req-f27d3b91-1e34-4f73-bae2-cb1a4db096cb'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:05.772644 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b915b1df-2da9-4fa3-8977-468e11f9c7f7 admin admin] The token cache is being invalidate because project c643cefb38c648c888cd0f6b23821471 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:38:05.773359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b915b1df-2da9-4fa3-8977-468e11f9c7f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:05.777716 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b915b1df-2da9-4fa3-8977-468e11f9c7f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:05.785741 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 898/1818] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:38:05 2022] DELETE /identity/v3/projects/c643cefb38c648c888cd0f6b23821471 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:38:05.785741 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b915b1df-2da9-4fa3-8977-468e11f9c7f7 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:05.788098 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f27d3b91-1e34-4f73-bae2-cb1a4db096cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f578d0e6a2d34a08a5f1f8cf4808bdd5', 'request_id': 'req-f27d3b91-1e34-4f73-bae2-cb1a4db096cb'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:05.788411 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b915b1df-2da9-4fa3-8977-468e11f9c7f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:05.819670 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f27d3b91-1e34-4f73-bae2-cb1a4db096cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f578d0e6a2d34a08a5f1f8cf4808bdd5', 'request_id': 'req-f27d3b91-1e34-4f73-bae2-cb1a4db096cb'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:05.857243 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f27d3b91-1e34-4f73-bae2-cb1a4db096cb admin admin] The token cache is being invalidate because project f578d0e6a2d34a08a5f1f8cf4808bdd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:38:05.857609 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f27d3b91-1e34-4f73-bae2-cb1a4db096cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:05.859236 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f27d3b91-1e34-4f73-bae2-cb1a4db096cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:05.861033 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 921/1819] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:38:05 2022] DELETE /identity/v3/projects/f578d0e6a2d34a08a5f1f8cf4808bdd5 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:05.862090 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d3b91-1e34-4f73-bae2-cb1a4db096cb admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:05.866881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f27d3b91-1e34-4f73-bae2-cb1a4db096cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:05.993764 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b915b1df-2da9-4fa3-8977-468e11f9c7f7 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:06.065936 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d3b91-1e34-4f73-bae2-cb1a4db096cb admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:06.076300 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc8312-e7a9-4129-a596-155b8e6169f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:06.076970 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc8312-e7a9-4129-a596-155b8e6169f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:06.077253 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc8312-e7a9-4129-a596-155b8e6169f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:06.077528 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc8312-e7a9-4129-a596-155b8e6169f0 admin admin] PATH_INFO: `/v3/projects/6b3cab93ecf94e63912fea3397d55b4f` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:06.079310 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc8312-e7a9-4129-a596-155b8e6169f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b3cab93ecf94e63912fea3397d55b4f)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:06.081866 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc8312-e7a9-4129-a596-155b8e6169f0 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:06.086060 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d514e-07f0-47ed-a1bf-bb6b337261aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:06.086864 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d514e-07f0-47ed-a1bf-bb6b337261aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:06.087415 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d514e-07f0-47ed-a1bf-bb6b337261aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:06.087755 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d514e-07f0-47ed-a1bf-bb6b337261aa admin admin] PATH_INFO: `/v3/users/db6a093d0b4140c6af8de1ef0fc6a232` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:06.089353 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d514e-07f0-47ed-a1bf-bb6b337261aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=db6a093d0b4140c6af8de1ef0fc6a232)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:06.091955 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d514e-07f0-47ed-a1bf-bb6b337261aa admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:06.152799 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:06.180209 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7abc8312-e7a9-4129-a596-155b8e6169f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b3cab93ecf94e63912fea3397d55b4f', 'request_id': 'req-7abc8312-e7a9-4129-a596-155b8e6169f0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:06.198078 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7abc8312-e7a9-4129-a596-155b8e6169f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b3cab93ecf94e63912fea3397d55b4f', 'request_id': 'req-7abc8312-e7a9-4129-a596-155b8e6169f0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:06.201543 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-576d514e-07f0-47ed-a1bf-bb6b337261aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db6a093d0b4140c6af8de1ef0fc6a232'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:06.203276 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-576d514e-07f0-47ed-a1bf-bb6b337261aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db6a093d0b4140c6af8de1ef0fc6a232'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:06.220766 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7abc8312-e7a9-4129-a596-155b8e6169f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b3cab93ecf94e63912fea3397d55b4f', 'request_id': 'req-7abc8312-e7a9-4129-a596-155b8e6169f0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:06.224476 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-576d514e-07f0-47ed-a1bf-bb6b337261aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db6a093d0b4140c6af8de1ef0fc6a232'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:06.259322 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7abc8312-e7a9-4129-a596-155b8e6169f0 admin admin] The token cache is being invalidate because project 6b3cab93ecf94e63912fea3397d55b4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:38:06.259624 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7abc8312-e7a9-4129-a596-155b8e6169f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:06.262031 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7abc8312-e7a9-4129-a596-155b8e6169f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:06.265539 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 922/1820] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:38:05 2022] DELETE /identity/v3/projects/6b3cab93ecf94e63912fea3397d55b4f => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:06.266383 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc8312-e7a9-4129-a596-155b8e6169f0 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:06.269067 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-576d514e-07f0-47ed-a1bf-bb6b337261aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db6a093d0b4140c6af8de1ef0fc6a232'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:06.272666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7abc8312-e7a9-4129-a596-155b8e6169f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:06.273601 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-576d514e-07f0-47ed-a1bf-bb6b337261aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db6a093d0b4140c6af8de1ef0fc6a232'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:06.331555 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 899/1821] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:38:05 2022] DELETE /identity/v3/users/db6a093d0b4140c6af8de1ef0fc6a232 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:06.336879 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d514e-07f0-47ed-a1bf-bb6b337261aa admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:06.338464 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-576d514e-07f0-47ed-a1bf-bb6b337261aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:06.432937 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:06.469096 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc8312-e7a9-4129-a596-155b8e6169f0 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:06.547750 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d514e-07f0-47ed-a1bf-bb6b337261aa admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:06.581135 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac68ea-18dc-497a-9778-163e06b4f331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:06.582133 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac68ea-18dc-497a-9778-163e06b4f331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:06.583086 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac68ea-18dc-497a-9778-163e06b4f331 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:06.584895 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac68ea-18dc-497a-9778-163e06b4f331 admin admin] PATH_INFO: `/v3/users/c874ced355e04bc5914827ffe2702e27` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:06.586717 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8622fdf1-0bc7-4da5-87ab-8a4a08468d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:06.587410 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ac68ea-18dc-497a-9778-163e06b4f331 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c874ced355e04bc5914827ffe2702e27)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:06.587546 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622fdf1-0bc7-4da5-87ab-8a4a08468d18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:06.588189 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622fdf1-0bc7-4da5-87ab-8a4a08468d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:06.588189 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622fdf1-0bc7-4da5-87ab-8a4a08468d18 admin admin] PATH_INFO: `/v3/users/58ccb345c4eb4f5389e08a1681d4b4de` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:06.592416 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ac68ea-18dc-497a-9778-163e06b4f331 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:06.603888 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8622fdf1-0bc7-4da5-87ab-8a4a08468d18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58ccb345c4eb4f5389e08a1681d4b4de)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:06.609060 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8622fdf1-0bc7-4da5-87ab-8a4a08468d18 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:06.774414 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-69ac68ea-18dc-497a-9778-163e06b4f331 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c874ced355e04bc5914827ffe2702e27'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:06.775181 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-69ac68ea-18dc-497a-9778-163e06b4f331 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c874ced355e04bc5914827ffe2702e27'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:06.780025 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8622fdf1-0bc7-4da5-87ab-8a4a08468d18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58ccb345c4eb4f5389e08a1681d4b4de'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:06.781531 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8622fdf1-0bc7-4da5-87ab-8a4a08468d18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58ccb345c4eb4f5389e08a1681d4b4de'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:06.787675 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-69ac68ea-18dc-497a-9778-163e06b4f331 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c874ced355e04bc5914827ffe2702e27'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:06.801212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8622fdf1-0bc7-4da5-87ab-8a4a08468d18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58ccb345c4eb4f5389e08a1681d4b4de'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:06.810990 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-69ac68ea-18dc-497a-9778-163e06b4f331 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c874ced355e04bc5914827ffe2702e27'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:06.816108 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-69ac68ea-18dc-497a-9778-163e06b4f331 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c874ced355e04bc5914827ffe2702e27'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:06.820474 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8622fdf1-0bc7-4da5-87ab-8a4a08468d18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58ccb345c4eb4f5389e08a1681d4b4de'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:06.828703 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:06.831888 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8622fdf1-0bc7-4da5-87ab-8a4a08468d18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58ccb345c4eb4f5389e08a1681d4b4de'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:06.855985 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 923/1822] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:38:06 2022] DELETE /identity/v3/users/58ccb345c4eb4f5389e08a1681d4b4de => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:06.857894 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8622fdf1-0bc7-4da5-87ab-8a4a08468d18 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:06.864851 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8622fdf1-0bc7-4da5-87ab-8a4a08468d18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:06.868419 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 900/1823] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:38:06 2022] DELETE /identity/v3/users/c874ced355e04bc5914827ffe2702e27 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:07.005547 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8622fdf1-0bc7-4da5-87ab-8a4a08468d18 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:07.116998 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4106b-94fd-4117-9a65-890433498963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:07.117729 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4106b-94fd-4117-9a65-890433498963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:07.118027 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4106b-94fd-4117-9a65-890433498963 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:07.118288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4106b-94fd-4117-9a65-890433498963 admin admin] PATH_INFO: `/v3/users/6a83d3f420d3472586858e35b3829328` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:07.120450 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4106b-94fd-4117-9a65-890433498963 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a83d3f420d3472586858e35b3829328)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:07.123552 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4106b-94fd-4117-9a65-890433498963 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:07.228319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2db4106b-94fd-4117-9a65-890433498963 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a83d3f420d3472586858e35b3829328'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:07.229205 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2db4106b-94fd-4117-9a65-890433498963 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a83d3f420d3472586858e35b3829328'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:07.252510 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2db4106b-94fd-4117-9a65-890433498963 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a83d3f420d3472586858e35b3829328'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:07.274294 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2db4106b-94fd-4117-9a65-890433498963 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a83d3f420d3472586858e35b3829328'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:07.285855 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2db4106b-94fd-4117-9a65-890433498963 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a83d3f420d3472586858e35b3829328'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:07.297044 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 924/1824] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:38:06 2022] DELETE /identity/v3/users/6a83d3f420d3472586858e35b3829328 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:07.866344 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac68ea-18dc-497a-9778-163e06b4f331 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:07.868773 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-69ac68ea-18dc-497a-9778-163e06b4f331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:07.893775 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac68ea-18dc-497a-9778-163e06b4f331 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:08.051437 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3916d2ca-9cac-4b9d-b944-6ff343bda726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:08.052635 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916d2ca-9cac-4b9d-b944-6ff343bda726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:08.053682 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916d2ca-9cac-4b9d-b944-6ff343bda726 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:08.054246 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916d2ca-9cac-4b9d-b944-6ff343bda726 admin admin] PATH_INFO: `/v3/projects/368a34556056443f861ec8f09cbe39a7` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:08.056902 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3916d2ca-9cac-4b9d-b944-6ff343bda726 admin admin] RBAC: Authorizing `identity:delete_project(project_id=368a34556056443f861ec8f09cbe39a7)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:08.059890 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3916d2ca-9cac-4b9d-b944-6ff343bda726 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:08.142546 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:08.145316 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3916d2ca-9cac-4b9d-b944-6ff343bda726 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '368a34556056443f861ec8f09cbe39a7', 'request_id': 'req-3916d2ca-9cac-4b9d-b944-6ff343bda726'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:08.157322 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3916d2ca-9cac-4b9d-b944-6ff343bda726 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '368a34556056443f861ec8f09cbe39a7', 'request_id': 'req-3916d2ca-9cac-4b9d-b944-6ff343bda726'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:08.170456 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3916d2ca-9cac-4b9d-b944-6ff343bda726 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '368a34556056443f861ec8f09cbe39a7', 'request_id': 'req-3916d2ca-9cac-4b9d-b944-6ff343bda726'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:08.193255 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4106b-94fd-4117-9a65-890433498963 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:08.195626 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2db4106b-94fd-4117-9a65-890433498963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:08.197456 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3916d2ca-9cac-4b9d-b944-6ff343bda726 admin admin] The token cache is being invalidate because project 368a34556056443f861ec8f09cbe39a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:38:08.197966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3916d2ca-9cac-4b9d-b944-6ff343bda726 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:08.200458 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3916d2ca-9cac-4b9d-b944-6ff343bda726 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:08.202898 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 901/1825] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:38:07 2022] DELETE /identity/v3/projects/368a34556056443f861ec8f09cbe39a7 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:08.207421 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4fec53-e269-4ac0-923d-22eb95979a06 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:08.207905 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4fec53-e269-4ac0-923d-22eb95979a06 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:08.208388 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4fec53-e269-4ac0-923d-22eb95979a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:08.225953 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4106b-94fd-4117-9a65-890433498963 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:08.233829 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-ec4fec53-e269-4ac0-923d-22eb95979a06 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:08.235786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ec4fec53-e269-4ac0-923d-22eb95979a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:08.273159 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:08.381979 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 902/1826] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:08.385955 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7104efe-a300-409a-abfa-85084641f178 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:08.386367 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7104efe-a300-409a-abfa-85084641f178 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:08.386720 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7104efe-a300-409a-abfa-85084641f178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:08.401555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a724633-33e5-40f4-ae83-6ce99c13b1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:08.417589 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a724633-33e5-40f4-ae83-6ce99c13b1c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:08.417916 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a724633-33e5-40f4-ae83-6ce99c13b1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:08.418200 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a724633-33e5-40f4-ae83-6ce99c13b1c5 admin admin] PATH_INFO: `/v3/projects/9dc3c7013c434641a8f461258d4e1d82` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:08.420722 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a724633-33e5-40f4-ae83-6ce99c13b1c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dc3c7013c434641a8f461258d4e1d82)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:08.424621 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a724633-33e5-40f4-ae83-6ce99c13b1c5 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:08.431783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-c7104efe-a300-409a-abfa-85084641f178 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:08.433027 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c7104efe-a300-409a-abfa-85084641f178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:08.453271 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 903/1827] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:08.457265 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7104efe-a300-409a-abfa-85084641f178 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:08.482410 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7104efe-a300-409a-abfa-85084641f178 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:08.495484 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2ed35-c457-4382-97c5-09f81efa7615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:08.496929 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2ed35-c457-4382-97c5-09f81efa7615 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:08.497210 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2ed35-c457-4382-97c5-09f81efa7615 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:08.497497 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2ed35-c457-4382-97c5-09f81efa7615 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:08.498127 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b2ed35-c457-4382-97c5-09f81efa7615 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:38:08.498431 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b2ed35-c457-4382-97c5-09f81efa7615 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:08.500085 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b2ed35-c457-4382-97c5-09f81efa7615 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:08.529608 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 904/1828] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:38:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:38:08.529608 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2ed35-c457-4382-97c5-09f81efa7615 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:08.531444 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b9b2ed35-c457-4382-97c5-09f81efa7615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:08.554152 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2ed35-c457-4382-97c5-09f81efa7615 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:08.557274 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5a724633-33e5-40f4-ae83-6ce99c13b1c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dc3c7013c434641a8f461258d4e1d82', 'request_id': 'req-5a724633-33e5-40f4-ae83-6ce99c13b1c5'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:08.573790 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5a724633-33e5-40f4-ae83-6ce99c13b1c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dc3c7013c434641a8f461258d4e1d82', 'request_id': 'req-5a724633-33e5-40f4-ae83-6ce99c13b1c5'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:08.588505 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5a724633-33e5-40f4-ae83-6ce99c13b1c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dc3c7013c434641a8f461258d4e1d82', 'request_id': 'req-5a724633-33e5-40f4-ae83-6ce99c13b1c5'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:08.614050 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5a724633-33e5-40f4-ae83-6ce99c13b1c5 admin admin] The token cache is being invalidate because project 9dc3c7013c434641a8f461258d4e1d82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:38:08.614438 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5a724633-33e5-40f4-ae83-6ce99c13b1c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:08.616738 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5a724633-33e5-40f4-ae83-6ce99c13b1c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:08.632494 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 925/1829] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:38:08 2022] DELETE /identity/v3/projects/9dc3c7013c434641a8f461258d4e1d82 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:08.636285 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a724633-33e5-40f4-ae83-6ce99c13b1c5 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:08.638636 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5a724633-33e5-40f4-ae83-6ce99c13b1c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:08.654826 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c0c7d-c5ae-4848-b944-0e0ea4492858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:08.655624 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c0c7d-c5ae-4848-b944-0e0ea4492858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:08.655908 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c0c7d-c5ae-4848-b944-0e0ea4492858 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:08.656183 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c0c7d-c5ae-4848-b944-0e0ea4492858 admin admin] PATH_INFO: `/v3/projects/0c47883a165c4bd8bc3fd43920c9251d` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:08.660402 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2c0c7d-c5ae-4848-b944-0e0ea4492858 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c47883a165c4bd8bc3fd43920c9251d)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:08.662991 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2c0c7d-c5ae-4848-b944-0e0ea4492858 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:08.761734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a724633-33e5-40f4-ae83-6ce99c13b1c5 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:08.782184 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ff2c0c7d-c5ae-4848-b944-0e0ea4492858 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c47883a165c4bd8bc3fd43920c9251d', 'request_id': 'req-ff2c0c7d-c5ae-4848-b944-0e0ea4492858'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:08.792614 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ff2c0c7d-c5ae-4848-b944-0e0ea4492858 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c47883a165c4bd8bc3fd43920c9251d', 'request_id': 'req-ff2c0c7d-c5ae-4848-b944-0e0ea4492858'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:08.793925 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:08.811345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ff2c0c7d-c5ae-4848-b944-0e0ea4492858 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c47883a165c4bd8bc3fd43920c9251d', 'request_id': 'req-ff2c0c7d-c5ae-4848-b944-0e0ea4492858'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:08.829768 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ff2c0c7d-c5ae-4848-b944-0e0ea4492858 admin admin] The token cache is being invalidate because project 0c47883a165c4bd8bc3fd43920c9251d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:38:08.830340 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ff2c0c7d-c5ae-4848-b944-0e0ea4492858 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:08.831303 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ff2c0c7d-c5ae-4848-b944-0e0ea4492858 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:08.837025 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652eeed-3b6d-4ba0-87d1-c1f1b9f376db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:08.837360 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 905/1830] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:38:08 2022] DELETE /identity/v3/projects/0c47883a165c4bd8bc3fd43920c9251d => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:08.838220 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652eeed-3b6d-4ba0-87d1-c1f1b9f376db admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:08.838345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c0c7d-c5ae-4848-b944-0e0ea4492858 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:08.838673 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652eeed-3b6d-4ba0-87d1-c1f1b9f376db admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:08.839120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652eeed-3b6d-4ba0-87d1-c1f1b9f376db admin admin] PATH_INFO: `/v3/projects/24cb9dd2e2a4484bac2b9f208c25b175` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:08.839667 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ff2c0c7d-c5ae-4848-b944-0e0ea4492858 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:08.840464 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a652eeed-3b6d-4ba0-87d1-c1f1b9f376db admin admin] RBAC: Authorizing `identity:delete_project(project_id=24cb9dd2e2a4484bac2b9f208c25b175)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:08.842817 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a652eeed-3b6d-4ba0-87d1-c1f1b9f376db admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:08.844655 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:08.855345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c0c7d-c5ae-4848-b944-0e0ea4492858 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:08.861142 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff01a2-2409-4451-98cf-ad1386492b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:08.861776 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff01a2-2409-4451-98cf-ad1386492b71 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:08.862057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff01a2-2409-4451-98cf-ad1386492b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:08.862357 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff01a2-2409-4451-98cf-ad1386492b71 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:08.863454 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff01a2-2409-4451-98cf-ad1386492b71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:08.865998 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff01a2-2409-4451-98cf-ad1386492b71 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:08.903962 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 906/1831] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:38:08 2022] POST /identity/v3/projects => generated 383 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:08.905272 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747b416-a1c3-465e-a886-831d16662a91 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:08.905555 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747b416-a1c3-465e-a886-831d16662a91 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:08.905829 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747b416-a1c3-465e-a886-831d16662a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:08.925065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a652eeed-3b6d-4ba0-87d1-c1f1b9f376db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24cb9dd2e2a4484bac2b9f208c25b175', 'request_id': 'req-a652eeed-3b6d-4ba0-87d1-c1f1b9f376db'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:08.937773 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a652eeed-3b6d-4ba0-87d1-c1f1b9f376db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24cb9dd2e2a4484bac2b9f208c25b175', 'request_id': 'req-a652eeed-3b6d-4ba0-87d1-c1f1b9f376db'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:08.941692 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-b747b416-a1c3-465e-a886-831d16662a91 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:08.945962 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b747b416-a1c3-465e-a886-831d16662a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:08.954318 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a652eeed-3b6d-4ba0-87d1-c1f1b9f376db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24cb9dd2e2a4484bac2b9f208c25b175', 'request_id': 'req-a652eeed-3b6d-4ba0-87d1-c1f1b9f376db'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:08.976621 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a652eeed-3b6d-4ba0-87d1-c1f1b9f376db admin admin] The token cache is being invalidate because project 24cb9dd2e2a4484bac2b9f208c25b175 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:38:08.976917 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a652eeed-3b6d-4ba0-87d1-c1f1b9f376db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:08.977752 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a652eeed-3b6d-4ba0-87d1-c1f1b9f376db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:08.982480 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 926/1832] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:38:08 2022] DELETE /identity/v3/projects/24cb9dd2e2a4484bac2b9f208c25b175 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:08.987819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffcf13-046b-45d8-a99c-dd6515d84cc2 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:08.988106 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffcf13-046b-45d8-a99c-dd6515d84cc2 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:08.988380 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffcf13-046b-45d8-a99c-dd6515d84cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:09.020857 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-0dffcf13-046b-45d8-a99c-dd6515d84cc2 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:09.023242 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0dffcf13-046b-45d8-a99c-dd6515d84cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:09.083128 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 907/1833] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:09.086894 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b747b416-a1c3-465e-a886-831d16662a91 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:09.090621 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b747b416-a1c3-465e-a886-831d16662a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:09.107013 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b747b416-a1c3-465e-a886-831d16662a91 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:09.116308 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb0be6-6e42-418e-974f-13f81650745c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:09.117403 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb0be6-6e42-418e-974f-13f81650745c admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:09.117925 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb0be6-6e42-418e-974f-13f81650745c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:09.118444 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb0be6-6e42-418e-974f-13f81650745c admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:09.119385 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb0be6-6e42-418e-974f-13f81650745c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:09.121773 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb0be6-6e42-418e-974f-13f81650745c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:09.147495 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 927/1834] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:09.149284 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33928a50-0b03-47fe-bf0a-24bdb492320a None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:09.149709 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33928a50-0b03-47fe-bf0a-24bdb492320a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:09.149967 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33928a50-0b03-47fe-bf0a-24bdb492320a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:09.159410 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 908/1835] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:38:09 2022] POST /identity/v3/users => generated 292 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:09.160882 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8221a9d-1eb6-4186-8ee3-e3245b6907d9 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:09.161238 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8221a9d-1eb6-4186-8ee3-e3245b6907d9 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:09.161601 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8221a9d-1eb6-4186-8ee3-e3245b6907d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:09.177439 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-33928a50-0b03-47fe-bf0a-24bdb492320a None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:09.179444 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-33928a50-0b03-47fe-bf0a-24bdb492320a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:09.197976 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 928/1836] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:09.197976 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318b96b-48b3-4bfd-b425-51129dd7aa6f None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:09.197976 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318b96b-48b3-4bfd-b425-51129dd7aa6f None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:09.197976 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318b96b-48b3-4bfd-b425-51129dd7aa6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:09.200510 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-f8221a9d-1eb6-4186-8ee3-e3245b6907d9 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:09.202398 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f8221a9d-1eb6-4186-8ee3-e3245b6907d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:09.217653 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 909/1837] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:09.218623 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8221a9d-1eb6-4186-8ee3-e3245b6907d9 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:09.220451 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-2318b96b-48b3-4bfd-b425-51129dd7aa6f None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:09.221795 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2318b96b-48b3-4bfd-b425-51129dd7aa6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:09.231164 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8221a9d-1eb6-4186-8ee3-e3245b6907d9 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:09.233833 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 929/1838] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:09.235124 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3f470-7cd8-42f1-a315-6c1f04dafd8d None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:09.235403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3f470-7cd8-42f1-a315-6c1f04dafd8d None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:09.235675 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3f470-7cd8-42f1-a315-6c1f04dafd8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:09.241559 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b438eb-e832-4807-918b-9bc69a71a32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:09.242437 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b438eb-e832-4807-918b-9bc69a71a32b admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:09.242911 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b438eb-e832-4807-918b-9bc69a71a32b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:09.243351 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b438eb-e832-4807-918b-9bc69a71a32b admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:09.244153 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b438eb-e832-4807-918b-9bc69a71a32b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:09.246230 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b438eb-e832-4807-918b-9bc69a71a32b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:09.261312 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-2dc3f470-7cd8-42f1-a315-6c1f04dafd8d None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:09.261530 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 910/1839] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:09.262468 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b438eb-e832-4807-918b-9bc69a71a32b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:09.262842 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2dc3f470-7cd8-42f1-a315-6c1f04dafd8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:09.273568 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b438eb-e832-4807-918b-9bc69a71a32b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:09.274895 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 930/1840] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:09.279899 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3f470-7cd8-42f1-a315-6c1f04dafd8d None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:09.281972 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7206cdf-ba30-40df-9793-3fdeb9e95e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:09.282725 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7206cdf-ba30-40df-9793-3fdeb9e95e9c admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:09.283173 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7206cdf-ba30-40df-9793-3fdeb9e95e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:09.283936 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7206cdf-ba30-40df-9793-3fdeb9e95e9c admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:09.284697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7206cdf-ba30-40df-9793-3fdeb9e95e9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:38:09.285131 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7206cdf-ba30-40df-9793-3fdeb9e95e9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:09.286913 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7206cdf-ba30-40df-9793-3fdeb9e95e9c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:09.292748 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3f470-7cd8-42f1-a315-6c1f04dafd8d None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:09.297793 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151375e-f40e-450f-8dc8-46e5a2bea250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:09.298420 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151375e-f40e-450f-8dc8-46e5a2bea250 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:09.298842 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151375e-f40e-450f-8dc8-46e5a2bea250 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:09.299154 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151375e-f40e-450f-8dc8-46e5a2bea250 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:09.300160 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2151375e-f40e-450f-8dc8-46e5a2bea250 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:38:09.300469 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2151375e-f40e-450f-8dc8-46e5a2bea250 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:09.302252 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2151375e-f40e-450f-8dc8-46e5a2bea250 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:09.303708 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 911/1841] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:38:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:38:09.308604 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7206cdf-ba30-40df-9793-3fdeb9e95e9c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:09.318715 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 931/1842] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:38:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:38:09.320015 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151375e-f40e-450f-8dc8-46e5a2bea250 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:09.325593 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7206cdf-ba30-40df-9793-3fdeb9e95e9c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:09.332161 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151375e-f40e-450f-8dc8-46e5a2bea250 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:09.338893 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4131c56-ba95-4cbd-bcf8-abc93d222160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:09.344178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4131c56-ba95-4cbd-bcf8-abc93d222160 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:09.344576 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4131c56-ba95-4cbd-bcf8-abc93d222160 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:09.345072 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4131c56-ba95-4cbd-bcf8-abc93d222160 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:09.345863 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4131c56-ba95-4cbd-bcf8-abc93d222160 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:38:09.346280 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4131c56-ba95-4cbd-bcf8-abc93d222160 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:09.348336 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4131c56-ba95-4cbd-bcf8-abc93d222160 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:09.350914 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b90f2-b5cb-4e43-93a1-20f44fd12d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:09.351626 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b90f2-b5cb-4e43-93a1-20f44fd12d48 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:09.351914 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b90f2-b5cb-4e43-93a1-20f44fd12d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:09.352189 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b90f2-b5cb-4e43-93a1-20f44fd12d48 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:09.352999 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4b90f2-b5cb-4e43-93a1-20f44fd12d48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:09.358277 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4b90f2-b5cb-4e43-93a1-20f44fd12d48 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:09.380809 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 932/1843] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:38:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:38:09.381956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4131c56-ba95-4cbd-bcf8-abc93d222160 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:09.388046 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 912/1844] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:09.389340 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b90f2-b5cb-4e43-93a1-20f44fd12d48 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:09.397944 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4131c56-ba95-4cbd-bcf8-abc93d222160 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:09.403669 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf4b9e-905f-49aa-8b15-8fae25f3d6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:09.404154 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b90f2-b5cb-4e43-93a1-20f44fd12d48 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:09.404723 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf4b9e-905f-49aa-8b15-8fae25f3d6f1 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:09.405212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf4b9e-905f-49aa-8b15-8fae25f3d6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:09.405668 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf4b9e-905f-49aa-8b15-8fae25f3d6f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:09.406494 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf4b9e-905f-49aa-8b15-8fae25f3d6f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:09.412802 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf4b9e-905f-49aa-8b15-8fae25f3d6f1 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:09.413011 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb2007-8fee-4905-8d71-0c42dcef8936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:09.413011 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb2007-8fee-4905-8d71-0c42dcef8936 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:09.413011 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb2007-8fee-4905-8d71-0c42dcef8936 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:09.413011 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb2007-8fee-4905-8d71-0c42dcef8936 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:09.413372 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb2007-8fee-4905-8d71-0c42dcef8936 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:09.414216 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb2007-8fee-4905-8d71-0c42dcef8936 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:09.445530 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 933/1845] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:38:09 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:09.446553 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf4b9e-905f-49aa-8b15-8fae25f3d6f1 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:09.454914 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 913/1846] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:38:09 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:09.456446 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb2007-8fee-4905-8d71-0c42dcef8936 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:09.485243 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:09.531731 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:DELETE=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:09.562287 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf4b9e-905f-49aa-8b15-8fae25f3d6f1 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:09.566660 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb2007-8fee-4905-8d71-0c42dcef8936 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:09.578509 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d9837-0896-4df2-a9cc-e3e1ee00b26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:09.579299 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d9837-0896-4df2-a9cc-e3e1ee00b26b admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:09.579576 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d9837-0896-4df2-a9cc-e3e1ee00b26b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:09.579845 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d9837-0896-4df2-a9cc-e3e1ee00b26b admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:09.580486 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d9837-0896-4df2-a9cc-e3e1ee00b26b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:09.582460 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d9837-0896-4df2-a9cc-e3e1ee00b26b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:09.586682 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef80a6-6a11-4b43-9fc0-beb6c0f0e266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:09.587860 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef80a6-6a11-4b43-9fc0-beb6c0f0e266 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:09.588867 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef80a6-6a11-4b43-9fc0-beb6c0f0e266 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:09.589811 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef80a6-6a11-4b43-9fc0-beb6c0f0e266 admin admin] PATH_INFO: `/v3/projects/9b91ca2a1fbd4d9baa5b8586c0bb3d0b/users/3be4ba54ab584eed886e96314efee34b/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:09.614926 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbef80a6-6a11-4b43-9fc0-beb6c0f0e266 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b91ca2a1fbd4d9baa5b8586c0bb3d0b, user_id=3be4ba54ab584eed886e96314efee34b, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:09.620635 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbef80a6-6a11-4b43-9fc0-beb6c0f0e266 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:09.645235 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 914/1847] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:38:09 2022] PUT /identity/v3/projects/9b91ca2a1fbd4d9baa5b8586c0bb3d0b/users/3be4ba54ab584eed886e96314efee34b/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:09.651131 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 934/1848] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:38:09 2022] POST /identity/v3/projects => generated 375 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:09.651131 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d9837-0896-4df2-a9cc-e3e1ee00b26b admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:09.652601 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef80a6-6a11-4b43-9fc0-beb6c0f0e266 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:09.733931 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef80a6-6a11-4b43-9fc0-beb6c0f0e266 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:09.778460 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d9837-0896-4df2-a9cc-e3e1ee00b26b admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:09.785412 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a210539-6d42-4716-a58b-f20572914afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:09.786332 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a210539-6d42-4716-a58b-f20572914afb admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:09.787854 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a210539-6d42-4716-a58b-f20572914afb admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:09.789524 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a210539-6d42-4716-a58b-f20572914afb admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:09.790956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a210539-6d42-4716-a58b-f20572914afb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:09.793332 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a210539-6d42-4716-a58b-f20572914afb admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:09.841185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d833f3-bac9-4396-ae17-2f69eae093f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:09.841823 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d833f3-bac9-4396-ae17-2f69eae093f6 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:09.842255 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d833f3-bac9-4396-ae17-2f69eae093f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:09.842422 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d833f3-bac9-4396-ae17-2f69eae093f6 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:09.843103 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d833f3-bac9-4396-ae17-2f69eae093f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:09.845675 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d833f3-bac9-4396-ae17-2f69eae093f6 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:09.864496 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 935/1849] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:38:09 2022] POST /identity/v3/users => generated 287 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:09.875951 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a210539-6d42-4716-a58b-f20572914afb admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:09.885459 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 915/1850] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:38:09 2022] POST /identity/v3/users => generated 293 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:09.885459 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde020fe-277b-45da-be2d-a924831020ff None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:09.885459 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde020fe-277b-45da-be2d-a924831020ff None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:09.886561 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde020fe-277b-45da-be2d-a924831020ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:09.894778 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a210539-6d42-4716-a58b-f20572914afb admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:09.911574 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8b12c-7ae1-4190-a7de-894a96a30fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:09.912471 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8b12c-7ae1-4190-a7de-894a96a30fee admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:09.912984 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8b12c-7ae1-4190-a7de-894a96a30fee admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:09.913173 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8b12c-7ae1-4190-a7de-894a96a30fee admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:09.913865 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea8b12c-7ae1-4190-a7de-894a96a30fee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:09.915981 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea8b12c-7ae1-4190-a7de-894a96a30fee admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:09.929770 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-dde020fe-277b-45da-be2d-a924831020ff None None] MFA Rules not processed for user `3be4ba54ab584eed886e96314efee34b`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:09.931129 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-dde020fe-277b-45da-be2d-a924831020ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:09.952574 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 936/1851] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:38:09 2022] POST /identity/v3/users => generated 288 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:09.954131 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8b12c-7ae1-4190-a7de-894a96a30fee admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:09.976774 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8b12c-7ae1-4190-a7de-894a96a30fee admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:09.993087 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b031522-971e-4334-93c4-b048b8845479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:09.994435 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b031522-971e-4334-93c4-b048b8845479 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:09.995136 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b031522-971e-4334-93c4-b048b8845479 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:09.995816 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b031522-971e-4334-93c4-b048b8845479 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:10.000147 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b031522-971e-4334-93c4-b048b8845479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:10.002183 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b031522-971e-4334-93c4-b048b8845479 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:10.009212 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:10.029524 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 916/1852] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:10.031232 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde020fe-277b-45da-be2d-a924831020ff None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:10.033393 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 937/1853] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:10.034352 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b031522-971e-4334-93c4-b048b8845479 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:10.047693 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b031522-971e-4334-93c4-b048b8845479 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:10.048563 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde020fe-277b-45da-be2d-a924831020ff None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:10.053548 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683379cd-1f19-465d-85ca-65ed0b189bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:10.054286 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683379cd-1f19-465d-85ca-65ed0b189bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:10.054996 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d545de-95f0-4500-bfb4-bb27df336724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:10.055360 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683379cd-1f19-465d-85ca-65ed0b189bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:10.055360 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683379cd-1f19-465d-85ca-65ed0b189bd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:10.055504 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d545de-95f0-4500-bfb4-bb27df336724 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:10.055504 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d545de-95f0-4500-bfb4-bb27df336724 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:10.055642 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d545de-95f0-4500-bfb4-bb27df336724 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:10.055710 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683379cd-1f19-465d-85ca-65ed0b189bd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:10.056468 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d545de-95f0-4500-bfb4-bb27df336724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:10.058345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d545de-95f0-4500-bfb4-bb27df336724 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:10.071961 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 917/1854] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:10.072835 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d545de-95f0-4500-bfb4-bb27df336724 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:10.073056 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683379cd-1f19-465d-85ca-65ed0b189bd7 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:10.085258 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d545de-95f0-4500-bfb4-bb27df336724 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:10.091221 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36e9f6-5381-4817-b375-997dc0ae0838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:10.091915 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36e9f6-5381-4817-b375-997dc0ae0838 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:10.092253 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36e9f6-5381-4817-b375-997dc0ae0838 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:10.092641 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36e9f6-5381-4817-b375-997dc0ae0838 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:10.093818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d36e9f6-5381-4817-b375-997dc0ae0838 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:10.095832 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d36e9f6-5381-4817-b375-997dc0ae0838 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:10.097013 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 938/1855] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:10.098079 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683379cd-1f19-465d-85ca-65ed0b189bd7 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:10.125301 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683379cd-1f19-465d-85ca-65ed0b189bd7 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:10.131198 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11eb792-d033-4e75-acd3-762669a7b178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:10.131914 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11eb792-d033-4e75-acd3-762669a7b178 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:10.132196 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11eb792-d033-4e75-acd3-762669a7b178 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:10.132472 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11eb792-d033-4e75-acd3-762669a7b178 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:10.133318 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11eb792-d033-4e75-acd3-762669a7b178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:10.134917 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11eb792-d033-4e75-acd3-762669a7b178 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:10.146239 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 918/1856] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:38:10 2022] POST /identity/v3/projects => generated 383 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:10.146239 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36e9f6-5381-4817-b375-997dc0ae0838 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:10.148061 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 939/1857] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:10.149039 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11eb792-d033-4e75-acd3-762669a7b178 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:10.166395 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11eb792-d033-4e75-acd3-762669a7b178 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:10.242899 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:10.266676 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c10d7-2a46-41f1-bac0-087b01d6aebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:10.268306 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c10d7-2a46-41f1-bac0-087b01d6aebf admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:10.268844 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c10d7-2a46-41f1-bac0-087b01d6aebf admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:10.269401 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c10d7-2a46-41f1-bac0-087b01d6aebf admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:10.270015 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36e9f6-5381-4817-b375-997dc0ae0838 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:10.271007 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c10d7-2a46-41f1-bac0-087b01d6aebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:10.275217 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c10d7-2a46-41f1-bac0-087b01d6aebf admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:10.276233 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c630f2-6b7a-4867-9254-9e1f0ef95c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:10.276856 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c630f2-6b7a-4867-9254-9e1f0ef95c3b admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:10.277134 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c630f2-6b7a-4867-9254-9e1f0ef95c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:10.277405 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c630f2-6b7a-4867-9254-9e1f0ef95c3b admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:10.278058 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c630f2-6b7a-4867-9254-9e1f0ef95c3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:10.279717 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c630f2-6b7a-4867-9254-9e1f0ef95c3b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:10.293729 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 940/1858] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:10.293729 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c10d7-2a46-41f1-bac0-087b01d6aebf admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:10.298535 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 919/1859] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:10.299769 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c630f2-6b7a-4867-9254-9e1f0ef95c3b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:10.306042 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c10d7-2a46-41f1-bac0-087b01d6aebf admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:10.313261 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c630f2-6b7a-4867-9254-9e1f0ef95c3b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:10.315413 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c23c5-30d3-43a2-b7ef-df11463816e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:10.316582 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c23c5-30d3-43a2-b7ef-df11463816e0 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:10.316931 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c23c5-30d3-43a2-b7ef-df11463816e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:10.317271 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c23c5-30d3-43a2-b7ef-df11463816e0 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:10.317982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9c23c5-30d3-43a2-b7ef-df11463816e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:10.321358 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9c23c5-30d3-43a2-b7ef-df11463816e0 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:10.321624 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d8e50-a378-444d-994a-64f7d3a90bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:10.322685 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d8e50-a378-444d-994a-64f7d3a90bd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:10.323201 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d8e50-a378-444d-994a-64f7d3a90bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:10.323783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d8e50-a378-444d-994a-64f7d3a90bd3 admin admin] PATH_INFO: `/v3/projects/0793cb46817e495bae9e712739eb9a89/users/77155e7bda94494faca02323b43832ba/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:10.343404 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d8e50-a378-444d-994a-64f7d3a90bd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0793cb46817e495bae9e712739eb9a89, user_id=77155e7bda94494faca02323b43832ba, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:10.347222 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d8e50-a378-444d-994a-64f7d3a90bd3 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:10.364703 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 941/1860] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:38:10 2022] POST /identity/v3/users => generated 298 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:10.367134 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 920/1861] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:38:10 2022] PUT /identity/v3/projects/0793cb46817e495bae9e712739eb9a89/users/77155e7bda94494faca02323b43832ba/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:10.368509 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d8e50-a378-444d-994a-64f7d3a90bd3 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:10.371148 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c23c5-30d3-43a2-b7ef-df11463816e0 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:10.390172 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c23c5-30d3-43a2-b7ef-df11463816e0 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:10.476382 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6937ac-6f49-4d19-bdd4-1212320e1d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:10.479375 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6937ac-6f49-4d19-bdd4-1212320e1d88 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:10.479647 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6937ac-6f49-4d19-bdd4-1212320e1d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:10.481052 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6937ac-6f49-4d19-bdd4-1212320e1d88 admin admin] PATH_INFO: `/v3/projects/83bffa43c9d949308afed8df7caf1035/users/ace496cd06a54a2ab90d281412248ab7/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:10.484698 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d8e50-a378-444d-994a-64f7d3a90bd3 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:10.491101 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d43cf-e228-4568-b060-3094c1d137c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:10.492499 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d43cf-e228-4568-b060-3094c1d137c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:10.492793 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d43cf-e228-4568-b060-3094c1d137c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:10.493070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d43cf-e228-4568-b060-3094c1d137c2 admin admin] PATH_INFO: `/v3/projects/13ee7f05500a437580afe08f38a79fb9/users/010ed8588b2d496bacedebc1863a3857/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:10.501660 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6937ac-6f49-4d19-bdd4-1212320e1d88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83bffa43c9d949308afed8df7caf1035, user_id=ace496cd06a54a2ab90d281412248ab7, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:10.506467 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6937ac-6f49-4d19-bdd4-1212320e1d88 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:10.513676 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d43cf-e228-4568-b060-3094c1d137c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13ee7f05500a437580afe08f38a79fb9, user_id=010ed8588b2d496bacedebc1863a3857, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:10.517445 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d43cf-e228-4568-b060-3094c1d137c2 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:10.529334 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 942/1862] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:38:10 2022] PUT /identity/v3/projects/83bffa43c9d949308afed8df7caf1035/users/ace496cd06a54a2ab90d281412248ab7/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:10.530251 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6937ac-6f49-4d19-bdd4-1212320e1d88 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:10.545650 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 921/1863] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:38:10 2022] PUT /identity/v3/projects/13ee7f05500a437580afe08f38a79fb9/users/010ed8588b2d496bacedebc1863a3857/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:10.547422 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133f152-be3d-44ff-8a60-dcf060bac01e None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:10.547942 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133f152-be3d-44ff-8a60-dcf060bac01e None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:10.548462 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133f152-be3d-44ff-8a60-dcf060bac01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:10.585551 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-8133f152-be3d-44ff-8a60-dcf060bac01e None None] MFA Rules not processed for user `77155e7bda94494faca02323b43832ba`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:10.587848 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8133f152-be3d-44ff-8a60-dcf060bac01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:10.594272 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:10.626442 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6937ac-6f49-4d19-bdd4-1212320e1d88 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:10.691922 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 922/1864] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:10.694028 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693606ea-91a2-467e-bd68-219f6af51290 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:10.694309 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693606ea-91a2-467e-bd68-219f6af51290 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:10.694743 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693606ea-91a2-467e-bd68-219f6af51290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:10.701464 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:10.760529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90893f3-620b-41f9-b022-785f77449788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:10.761259 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90893f3-620b-41f9-b022-785f77449788 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:10.761615 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90893f3-620b-41f9-b022-785f77449788 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:10.761965 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90893f3-620b-41f9-b022-785f77449788 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:10.762701 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90893f3-620b-41f9-b022-785f77449788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:10.764722 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90893f3-620b-41f9-b022-785f77449788 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:10.770331 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-693606ea-91a2-467e-bd68-219f6af51290 None None] MFA Rules not processed for user `ace496cd06a54a2ab90d281412248ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:10.772162 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-693606ea-91a2-467e-bd68-219f6af51290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:10.788808 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 943/1865] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:10.793042 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b7a3f-b695-4ac7-a10c-7f65b46adff1 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:10.793564 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b7a3f-b695-4ac7-a10c-7f65b46adff1 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:10.794093 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b7a3f-b695-4ac7-a10c-7f65b46adff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:10.845830 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-756b7a3f-b695-4ac7-a10c-7f65b46adff1 None None] MFA Rules not processed for user `010ed8588b2d496bacedebc1863a3857`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:10.847735 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-756b7a3f-b695-4ac7-a10c-7f65b46adff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:10.890454 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 923/1866] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:10.891745 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693606ea-91a2-467e-bd68-219f6af51290 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:10.906368 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693606ea-91a2-467e-bd68-219f6af51290 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:10.917641 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2215dd-ed23-408f-9380-97e78717268d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:10.918425 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2215dd-ed23-408f-9380-97e78717268d admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:10.918808 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2215dd-ed23-408f-9380-97e78717268d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:10.919377 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2215dd-ed23-408f-9380-97e78717268d admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:10.920145 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2215dd-ed23-408f-9380-97e78717268d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:10.922196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2215dd-ed23-408f-9380-97e78717268d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:10.959907 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 944/1867] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:10.961343 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b7a3f-b695-4ac7-a10c-7f65b46adff1 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:10.976389 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 924/1868] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:38:10 2022] POST /identity/v3/projects => generated 373 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:10.976389 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2215dd-ed23-408f-9380-97e78717268d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:10.981726 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b7a3f-b695-4ac7-a10c-7f65b46adff1 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:11.079953 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228ca95-da52-45de-8124-27105066fcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:11.080782 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228ca95-da52-45de-8124-27105066fcff admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:11.081306 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228ca95-da52-45de-8124-27105066fcff admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:11.081530 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228ca95-da52-45de-8124-27105066fcff admin admin] PATH_INFO: `/v3/projects/8873ed3cf9b9422f9479635f2a29f025/users/7afdd760a558462f9822cbe7b6a57798/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:11.088434 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2215dd-ed23-408f-9380-97e78717268d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:11.097401 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e9d5f-9df4-4e40-a2cb-e50b50a5d3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:11.098240 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e9d5f-9df4-4e40-a2cb-e50b50a5d3ea admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:11.098240 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e9d5f-9df4-4e40-a2cb-e50b50a5d3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:11.098488 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e9d5f-9df4-4e40-a2cb-e50b50a5d3ea admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:11.099176 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e9d5f-9df4-4e40-a2cb-e50b50a5d3ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:11.100781 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e228ca95-da52-45de-8124-27105066fcff admin admin] RBAC: Authorizing `identity:create_grant(project_id=8873ed3cf9b9422f9479635f2a29f025, user_id=7afdd760a558462f9822cbe7b6a57798, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:11.101991 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e9d5f-9df4-4e40-a2cb-e50b50a5d3ea admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:11.104019 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e228ca95-da52-45de-8124-27105066fcff admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:11.125665 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:11.125885 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 945/1869] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:38:10 2022] PUT /identity/v3/projects/8873ed3cf9b9422f9479635f2a29f025/users/7afdd760a558462f9822cbe7b6a57798/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:11.126564 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228ca95-da52-45de-8124-27105066fcff admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:11.143278 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 925/1870] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:38:10 2022] POST /identity/v3/projects => generated 375 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:11.144181 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e9d5f-9df4-4e40-a2cb-e50b50a5d3ea admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:11.197722 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228ca95-da52-45de-8124-27105066fcff admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:11.206005 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:11.217700 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e9d5f-9df4-4e40-a2cb-e50b50a5d3ea admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:11.222757 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ede4b5-5162-404b-87db-4d118f8825b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:11.223573 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ede4b5-5162-404b-87db-4d118f8825b1 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:11.223962 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ede4b5-5162-404b-87db-4d118f8825b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:11.224325 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ede4b5-5162-404b-87db-4d118f8825b1 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:11.225378 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ede4b5-5162-404b-87db-4d118f8825b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:11.227671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ede4b5-5162-404b-87db-4d118f8825b1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:11.252099 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 926/1871] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:38:11 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:11.253634 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eaeafa-670f-43a6-9faf-25bff86f2e3e None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:11.254067 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eaeafa-670f-43a6-9faf-25bff86f2e3e None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:11.254631 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eaeafa-670f-43a6-9faf-25bff86f2e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:11.272300 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c326a-5354-46e3-b9b5-9166c5e5a8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:11.273160 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c326a-5354-46e3-b9b5-9166c5e5a8bc admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:11.273542 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c326a-5354-46e3-b9b5-9166c5e5a8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:11.273836 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c326a-5354-46e3-b9b5-9166c5e5a8bc admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:11.274549 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c326a-5354-46e3-b9b5-9166c5e5a8bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:11.276592 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c326a-5354-46e3-b9b5-9166c5e5a8bc admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:11.305690 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-05eaeafa-670f-43a6-9faf-25bff86f2e3e None None] MFA Rules not processed for user `f2c1a5b07fa94554878fe1d7c2d86992`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:11.319378 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-05eaeafa-670f-43a6-9faf-25bff86f2e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:11.341627 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 946/1872] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:38:11 2022] POST /identity/v3/projects => generated 385 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:11.342612 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c326a-5354-46e3-b9b5-9166c5e5a8bc admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:11.415156 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 927/1873] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:11 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:11.416149 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eaeafa-670f-43a6-9faf-25bff86f2e3e None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:11.427398 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eaeafa-670f-43a6-9faf-25bff86f2e3e None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:11.434151 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c326a-5354-46e3-b9b5-9166c5e5a8bc admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:11.439373 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbbb329-dc25-44b4-b981-fe66ef80228d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:11.440037 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbb329-dc25-44b4-b981-fe66ef80228d admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:11.440324 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbb329-dc25-44b4-b981-fe66ef80228d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:11.440658 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbb329-dc25-44b4-b981-fe66ef80228d admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:11.441333 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbbb329-dc25-44b4-b981-fe66ef80228d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:11.442977 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbbb329-dc25-44b4-b981-fe66ef80228d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:11.446620 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47f163-31a2-41e1-8f77-2f0a8f4c7a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:11.447410 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47f163-31a2-41e1-8f77-2f0a8f4c7a2f admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:11.447787 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47f163-31a2-41e1-8f77-2f0a8f4c7a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:11.448170 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47f163-31a2-41e1-8f77-2f0a8f4c7a2f admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:11.449227 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb47f163-31a2-41e1-8f77-2f0a8f4c7a2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:11.451231 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb47f163-31a2-41e1-8f77-2f0a8f4c7a2f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:11.457085 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 947/1874] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:11.457085 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbbb329-dc25-44b4-b981-fe66ef80228d admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:11.467229 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbbb329-dc25-44b4-b981-fe66ef80228d admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:11.477730 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 928/1875] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:38:11 2022] POST /identity/v3/users => generated 294 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:11.477954 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4874acb-ee3a-484e-aeec-abcfc25f0532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:11.478562 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4874acb-ee3a-484e-aeec-abcfc25f0532 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:11.478847 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47f163-31a2-41e1-8f77-2f0a8f4c7a2f admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:11.478970 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4874acb-ee3a-484e-aeec-abcfc25f0532 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:11.479676 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4874acb-ee3a-484e-aeec-abcfc25f0532 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:11.480470 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4874acb-ee3a-484e-aeec-abcfc25f0532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:11.482171 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4874acb-ee3a-484e-aeec-abcfc25f0532 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:11.489871 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47f163-31a2-41e1-8f77-2f0a8f4c7a2f admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:11.495830 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9cb2c-1c2f-4eef-ac0c-b373c129a0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:11.496618 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9cb2c-1c2f-4eef-ac0c-b373c129a0cd admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:11.497054 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9cb2c-1c2f-4eef-ac0c-b373c129a0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:11.497430 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9cb2c-1c2f-4eef-ac0c-b373c129a0cd admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:11.498173 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f9cb2c-1c2f-4eef-ac0c-b373c129a0cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:11.499482 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 948/1876] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:11.500601 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f9cb2c-1c2f-4eef-ac0c-b373c129a0cd admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:11.500709 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4874acb-ee3a-484e-aeec-abcfc25f0532 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:11.503076 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d4874acb-ee3a-484e-aeec-abcfc25f0532 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:11.535853 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 929/1877] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:38:11 2022] POST /identity/v3/users => generated 299 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:11.535853 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9cb2c-1c2f-4eef-ac0c-b373c129a0cd admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:11.546006 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9cb2c-1c2f-4eef-ac0c-b373c129a0cd admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:11.553893 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14a13a-b195-427a-aa48-53de18708a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:11.554610 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14a13a-b195-427a-aa48-53de18708a7f admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:11.554890 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14a13a-b195-427a-aa48-53de18708a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:11.555209 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14a13a-b195-427a-aa48-53de18708a7f admin admin] PATH_INFO: `/v3/projects/8873ed3cf9b9422f9479635f2a29f025/users/7afdd760a558462f9822cbe7b6a57798/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:11.557175 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b14a13a-b195-427a-aa48-53de18708a7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8873ed3cf9b9422f9479635f2a29f025, user_id=7afdd760a558462f9822cbe7b6a57798, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:11.559928 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b14a13a-b195-427a-aa48-53de18708a7f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:11.575116 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 930/1878] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:38:11 2022] PUT /identity/v3/projects/8873ed3cf9b9422f9479635f2a29f025/users/7afdd760a558462f9822cbe7b6a57798/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:11.576132 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14a13a-b195-427a-aa48-53de18708a7f admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:11.616887 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:11.626143 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4874acb-ee3a-484e-aeec-abcfc25f0532 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:11.647868 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:11.668438 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14a13a-b195-427a-aa48-53de18708a7f admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:11.680279 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5330376-db6e-4db4-ba3a-a9d5d92c9209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:11.682040 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5330376-db6e-4db4-ba3a-a9d5d92c9209 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:11.682652 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5330376-db6e-4db4-ba3a-a9d5d92c9209 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:11.683177 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5330376-db6e-4db4-ba3a-a9d5d92c9209 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:11.684707 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5330376-db6e-4db4-ba3a-a9d5d92c9209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:11.687955 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5330376-db6e-4db4-ba3a-a9d5d92c9209 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:11.703860 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 931/1879] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:11.703860 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5330376-db6e-4db4-ba3a-a9d5d92c9209 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:11.714482 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5330376-db6e-4db4-ba3a-a9d5d92c9209 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:11.719872 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c6558-f6e7-4fa1-a056-772d0c2c1e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:11.720652 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c6558-f6e7-4fa1-a056-772d0c2c1e03 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:11.720955 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c6558-f6e7-4fa1-a056-772d0c2c1e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:11.721221 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c6558-f6e7-4fa1-a056-772d0c2c1e03 admin admin] PATH_INFO: `/v3/projects/8c08d800133c4864969672c78819b44f/users/016de1636425429384b2c7234b31c06d/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:11.731641 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb94c9c-14af-42bd-ba8b-dd639ef8f5d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:11.732382 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb94c9c-14af-42bd-ba8b-dd639ef8f5d5 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:11.733162 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb94c9c-14af-42bd-ba8b-dd639ef8f5d5 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:11.733515 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb94c9c-14af-42bd-ba8b-dd639ef8f5d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:11.735956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0bb94c9c-14af-42bd-ba8b-dd639ef8f5d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:11.745673 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c6558-f6e7-4fa1-a056-772d0c2c1e03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c08d800133c4864969672c78819b44f, user_id=016de1636425429384b2c7234b31c06d, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:11.749401 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c6558-f6e7-4fa1-a056-772d0c2c1e03 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:11.774793 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 932/1880] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:38:11 2022] PUT /identity/v3/projects/8c08d800133c4864969672c78819b44f/users/016de1636425429384b2c7234b31c06d/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:11.774793 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c6558-f6e7-4fa1-a056-772d0c2c1e03 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:11.837765 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb94c9c-14af-42bd-ba8b-dd639ef8f5d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:11.840681 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb94c9c-14af-42bd-ba8b-dd639ef8f5d5 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:11.856002 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 949/1881] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:11 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:38:11.857457 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62a34f-7dd0-40ec-8ec7-64991d8a788c None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:11.857815 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62a34f-7dd0-40ec-8ec7-64991d8a788c None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:11.858153 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62a34f-7dd0-40ec-8ec7-64991d8a788c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:11.877693 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c6558-f6e7-4fa1-a056-772d0c2c1e03 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:11.891110 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8078e3-89c8-410f-9d7b-04deebc25a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:11.892002 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8078e3-89c8-410f-9d7b-04deebc25a68 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:11.892382 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8078e3-89c8-410f-9d7b-04deebc25a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:11.892713 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8078e3-89c8-410f-9d7b-04deebc25a68 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:11.893565 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8078e3-89c8-410f-9d7b-04deebc25a68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:11.896250 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8078e3-89c8-410f-9d7b-04deebc25a68 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:11.907524 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-9f62a34f-7dd0-40ec-8ec7-64991d8a788c None None] MFA Rules not processed for user `7afdd760a558462f9822cbe7b6a57798`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:11.909371 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9f62a34f-7dd0-40ec-8ec7-64991d8a788c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:11.910696 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 933/1882] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:11.911714 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8078e3-89c8-410f-9d7b-04deebc25a68 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:11.925614 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8078e3-89c8-410f-9d7b-04deebc25a68 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:11.932761 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27990f69-2be7-472c-8a45-3413af8764e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:11.933605 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27990f69-2be7-472c-8a45-3413af8764e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:11.933889 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27990f69-2be7-472c-8a45-3413af8764e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:11.934164 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27990f69-2be7-472c-8a45-3413af8764e2 admin admin] PATH_INFO: `/v3/projects/d76ba312cb0343558cf07a809cac555a/users/fddbb38576054f039ef1e2c00249ba7e/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:11.960805 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27990f69-2be7-472c-8a45-3413af8764e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d76ba312cb0343558cf07a809cac555a, user_id=fddbb38576054f039ef1e2c00249ba7e, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:11.964771 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27990f69-2be7-472c-8a45-3413af8764e2 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:11.983184 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 934/1883] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:38:11 2022] PUT /identity/v3/projects/d76ba312cb0343558cf07a809cac555a/users/fddbb38576054f039ef1e2c00249ba7e/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:11.984938 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27990f69-2be7-472c-8a45-3413af8764e2 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:12.018280 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 950/1884] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:11 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:12.019432 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62a34f-7dd0-40ec-8ec7-64991d8a788c None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:12.062948 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27990f69-2be7-472c-8a45-3413af8764e2 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:12.067798 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b1f59-b84f-4a37-9501-288600095d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:12.068692 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b1f59-b84f-4a37-9501-288600095d38 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:12.068991 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b1f59-b84f-4a37-9501-288600095d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:12.069624 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b1f59-b84f-4a37-9501-288600095d38 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:12.069927 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b1f59-b84f-4a37-9501-288600095d38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:12.071701 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b1f59-b84f-4a37-9501-288600095d38 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:12.077582 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:12.083001 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 935/1885] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:12.087652 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b1f59-b84f-4a37-9501-288600095d38 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:12.094987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:12.100010 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b1f59-b84f-4a37-9501-288600095d38 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:12.107436 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e121647-1399-498a-8323-2154fba5d5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:12.108759 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e121647-1399-498a-8323-2154fba5d5c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:12.108878 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62a34f-7dd0-40ec-8ec7-64991d8a788c None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:12.109246 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e121647-1399-498a-8323-2154fba5d5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:12.109588 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e121647-1399-498a-8323-2154fba5d5c1 admin admin] PATH_INFO: `/v3/projects/3b7b790bc2b545109b7b17d26b85cb9c/users/b66f43896bed46f38ba26352ec7c0884/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:12.129393 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e121647-1399-498a-8323-2154fba5d5c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b7b790bc2b545109b7b17d26b85cb9c, user_id=b66f43896bed46f38ba26352ec7c0884, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:12.132424 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e121647-1399-498a-8323-2154fba5d5c1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:12.147960 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 936/1886] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:38:12 2022] PUT /identity/v3/projects/3b7b790bc2b545109b7b17d26b85cb9c/users/b66f43896bed46f38ba26352ec7c0884/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:12.149233 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e121647-1399-498a-8323-2154fba5d5c1 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:12.194649 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dbccb3-9a6f-4cba-8ab2-371ac84960dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:12.195519 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbccb3-9a6f-4cba-8ab2-371ac84960dd service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:12.195995 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbccb3-9a6f-4cba-8ab2-371ac84960dd service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:12.198379 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbccb3-9a6f-4cba-8ab2-371ac84960dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:12.231531 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e121647-1399-498a-8323-2154fba5d5c1 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:12.237386 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd7c1be-82a3-4a29-9e26-2ab072c0f0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:12.238147 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7c1be-82a3-4a29-9e26-2ab072c0f0f9 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:12.238484 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7c1be-82a3-4a29-9e26-2ab072c0f0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:12.238824 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7c1be-82a3-4a29-9e26-2ab072c0f0f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:12.239576 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd7c1be-82a3-4a29-9e26-2ab072c0f0f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:12.242636 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd7c1be-82a3-4a29-9e26-2ab072c0f0f9 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:12.256012 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 937/1887] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:12.257489 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd7c1be-82a3-4a29-9e26-2ab072c0f0f9 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:12.259611 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6cd7c1be-82a3-4a29-9e26-2ab072c0f0f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:12.279706 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dbccb3-9a6f-4cba-8ab2-371ac84960dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:12.281685 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dbccb3-9a6f-4cba-8ab2-371ac84960dd service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:12.292655 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 951/1888] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:12 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:38:12.293284 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dbccb3-9a6f-4cba-8ab2-371ac84960dd service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:12.304300 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dbccb3-9a6f-4cba-8ab2-371ac84960dd service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:12.310930 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4bca91-6fd8-42dc-84f6-3dfbf740d445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:12.311603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bca91-6fd8-42dc-84f6-3dfbf740d445 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:12.311894 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bca91-6fd8-42dc-84f6-3dfbf740d445 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:12.312519 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bca91-6fd8-42dc-84f6-3dfbf740d445 admin admin] PATH_INFO: `/v3/projects/8c08d800133c4864969672c78819b44f/users/016de1636425429384b2c7234b31c06d/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:12.315012 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4bca91-6fd8-42dc-84f6-3dfbf740d445 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c08d800133c4864969672c78819b44f, user_id=016de1636425429384b2c7234b31c06d, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:12.317960 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4bca91-6fd8-42dc-84f6-3dfbf740d445 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:12.343111 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 952/1889] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:38:12 2022] PUT /identity/v3/projects/8c08d800133c4864969672c78819b44f/users/016de1636425429384b2c7234b31c06d/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:12.345758 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4bca91-6fd8-42dc-84f6-3dfbf740d445 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:12.377069 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd7c1be-82a3-4a29-9e26-2ab072c0f0f9 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:12.428838 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4bca91-6fd8-42dc-84f6-3dfbf740d445 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:12.440967 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216823e7-a4bd-4590-8792-86c1e620ed7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:12.441592 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216823e7-a4bd-4590-8792-86c1e620ed7d admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:12.441864 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216823e7-a4bd-4590-8792-86c1e620ed7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:12.442132 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216823e7-a4bd-4590-8792-86c1e620ed7d admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:12.442862 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216823e7-a4bd-4590-8792-86c1e620ed7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:12.445286 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216823e7-a4bd-4590-8792-86c1e620ed7d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:12.448071 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:12.466758 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 953/1890] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:12.467707 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216823e7-a4bd-4590-8792-86c1e620ed7d admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:12.482597 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216823e7-a4bd-4590-8792-86c1e620ed7d admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:12.488432 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079fc22-6ef5-4112-ab42-8a034858cd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:12.489238 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079fc22-6ef5-4112-ab42-8a034858cd60 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:12.490046 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079fc22-6ef5-4112-ab42-8a034858cd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:12.490046 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079fc22-6ef5-4112-ab42-8a034858cd60 admin admin] PATH_INFO: `/v3/projects/d76ba312cb0343558cf07a809cac555a/users/fddbb38576054f039ef1e2c00249ba7e/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:12.492906 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5079fc22-6ef5-4112-ab42-8a034858cd60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d76ba312cb0343558cf07a809cac555a, user_id=fddbb38576054f039ef1e2c00249ba7e, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:12.496187 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac88977-d1b3-4bb5-9233-daf56f009613 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:12.496527 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5079fc22-6ef5-4112-ab42-8a034858cd60 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:12.497207 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac88977-d1b3-4bb5-9233-daf56f009613 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:12.497207 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac88977-d1b3-4bb5-9233-daf56f009613 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:12.497410 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac88977-d1b3-4bb5-9233-daf56f009613 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:12.509600 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 954/1891] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:38:12 2022] PUT /identity/v3/projects/d76ba312cb0343558cf07a809cac555a/users/fddbb38576054f039ef1e2c00249ba7e/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:12.510864 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08a459-edc1-4216-8d2f-802f339328cc None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:12.511215 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08a459-edc1-4216-8d2f-802f339328cc None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:12.511495 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08a459-edc1-4216-8d2f-802f339328cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:12.517662 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:12.549909 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-fb08a459-edc1-4216-8d2f-802f339328cc None None] MFA Rules not processed for user `016de1636425429384b2c7234b31c06d`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:12.551334 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-fb08a459-edc1-4216-8d2f-802f339328cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:12.586937 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac88977-d1b3-4bb5-9233-daf56f009613 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:12.588762 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac88977-d1b3-4bb5-9233-daf56f009613 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:12.599058 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 938/1892] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:12 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:38:12.600111 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac88977-d1b3-4bb5-9233-daf56f009613 service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:12.610647 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac88977-d1b3-4bb5-9233-daf56f009613 service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:12.649136 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 955/1893] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:12.649136 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d548d-3479-4bea-aa27-7fd970114cb4 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:12.649136 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d548d-3479-4bea-aa27-7fd970114cb4 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:12.649136 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d548d-3479-4bea-aa27-7fd970114cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:12.813450 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-e38d548d-3479-4bea-aa27-7fd970114cb4 None None] MFA Rules not processed for user `fddbb38576054f039ef1e2c00249ba7e`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:12.814779 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e38d548d-3479-4bea-aa27-7fd970114cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:12.881715 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d4c34-0170-49fc-b8c8-b30102d45a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:12.881715 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d4c34-0170-49fc-b8c8-b30102d45a1b admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:12.881715 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d4c34-0170-49fc-b8c8-b30102d45a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:12.881715 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d4c34-0170-49fc-b8c8-b30102d45a1b admin admin] PATH_INFO: `/v3/projects/3b7b790bc2b545109b7b17d26b85cb9c/users/b66f43896bed46f38ba26352ec7c0884/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:12.887919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d4c34-0170-49fc-b8c8-b30102d45a1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b7b790bc2b545109b7b17d26b85cb9c, user_id=b66f43896bed46f38ba26352ec7c0884, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:12.890712 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d4c34-0170-49fc-b8c8-b30102d45a1b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:12.929580 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 939/1894] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:38:12 2022] PUT /identity/v3/projects/3b7b790bc2b545109b7b17d26b85cb9c/users/b66f43896bed46f38ba26352ec7c0884/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:12.930755 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d4c34-0170-49fc-b8c8-b30102d45a1b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:12.968443 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 956/1895] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:12 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:12.971926 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c88c9-6a36-462f-8427-de35c3b7efe0 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:12.972584 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c88c9-6a36-462f-8427-de35c3b7efe0 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:12.972873 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c88c9-6a36-462f-8427-de35c3b7efe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:13.029484 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-955c88c9-6a36-462f-8427-de35c3b7efe0 None None] MFA Rules not processed for user `b66f43896bed46f38ba26352ec7c0884`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:13.031007 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-955c88c9-6a36-462f-8427-de35c3b7efe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:13.090806 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d4c34-0170-49fc-b8c8-b30102d45a1b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:13.103650 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d27874-4ce2-406f-876a-8736cb6318e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:13.104992 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d27874-4ce2-406f-876a-8736cb6318e3 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:13.105860 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d27874-4ce2-406f-876a-8736cb6318e3 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:13.106333 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d27874-4ce2-406f-876a-8736cb6318e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:13.129459 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:13.166871 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:13.189857 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 957/1896] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:12 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:13.191049 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c88c9-6a36-462f-8427-de35c3b7efe0 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:13.199299 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d27874-4ce2-406f-876a-8736cb6318e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:13.201834 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d27874-4ce2-406f-876a-8736cb6318e3 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:13.204478 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c88c9-6a36-462f-8427-de35c3b7efe0 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:13.215308 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4db48-3c6f-47cd-9d11-9acb71c6f466 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:13.216041 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4db48-3c6f-47cd-9d11-9acb71c6f466 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:13.216500 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4db48-3c6f-47cd-9d11-9acb71c6f466 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:13.217036 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4db48-3c6f-47cd-9d11-9acb71c6f466 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:13.228349 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 940/1897] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:12 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:38:13.230017 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bfa7fd-be03-4238-9736-be7c5ca1e560 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:13.230293 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bfa7fd-be03-4238-9736-be7c5ca1e560 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:13.230573 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bfa7fd-be03-4238-9736-be7c5ca1e560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:13.253861 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-34bfa7fd-be03-4238-9736-be7c5ca1e560 None None] MFA Rules not processed for user `010ed8588b2d496bacedebc1863a3857`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:13.255788 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-34bfa7fd-be03-4238-9736-be7c5ca1e560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:13.319048 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b4db48-3c6f-47cd-9d11-9acb71c6f466 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:13.321957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b4db48-3c6f-47cd-9d11-9acb71c6f466 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:13.344088 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 958/1898] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:13 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:38:13.356355 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 941/1899] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:13.468477 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4db48-3c6f-47cd-9d11-9acb71c6f466 service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:13.483397 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4db48-3c6f-47cd-9d11-9acb71c6f466 service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:13.490547 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d2669-094a-44b4-8126-301031e49ae0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:13.491670 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d2669-094a-44b4-8126-301031e49ae0 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:13.492068 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d2669-094a-44b4-8126-301031e49ae0 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:13.492460 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d2669-094a-44b4-8126-301031e49ae0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:13.503745 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d2669-094a-44b4-8126-301031e49ae0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:13.505516 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d2669-094a-44b4-8126-301031e49ae0 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:13.517673 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 959/1900] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:38:13.559345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bfa7fd-be03-4238-9736-be7c5ca1e560 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:13.577889 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bfa7fd-be03-4238-9736-be7c5ca1e560 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:13.589641 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4f835-2fe8-407d-88ad-2fbbe6a96da4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:13.590550 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4f835-2fe8-407d-88ad-2fbbe6a96da4 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:13.591113 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4f835-2fe8-407d-88ad-2fbbe6a96da4 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:13.591705 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4f835-2fe8-407d-88ad-2fbbe6a96da4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:13.660653 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a4f835-2fe8-407d-88ad-2fbbe6a96da4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:13.662804 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a4f835-2fe8-407d-88ad-2fbbe6a96da4 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:13.672972 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 942/1901] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:38:13.809286 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d2669-094a-44b4-8126-301031e49ae0 service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:13.904301 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d2669-094a-44b4-8126-301031e49ae0 service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:13.910766 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76218409-1a3a-4df1-99e1-c8958ca13477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:13.911538 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76218409-1a3a-4df1-99e1-c8958ca13477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:13.912914 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76218409-1a3a-4df1-99e1-c8958ca13477 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:13.913517 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76218409-1a3a-4df1-99e1-c8958ca13477 admin admin] PATH_INFO: `/v3/users/3be4ba54ab584eed886e96314efee34b` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:13.915272 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76218409-1a3a-4df1-99e1-c8958ca13477 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3be4ba54ab584eed886e96314efee34b)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:13.918447 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76218409-1a3a-4df1-99e1-c8958ca13477 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:13.988006 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-76218409-1a3a-4df1-99e1-c8958ca13477 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3be4ba54ab584eed886e96314efee34b'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:13.988931 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-76218409-1a3a-4df1-99e1-c8958ca13477 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3be4ba54ab584eed886e96314efee34b'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:14.005190 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:14.009656 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-76218409-1a3a-4df1-99e1-c8958ca13477 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3be4ba54ab584eed886e96314efee34b'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:14.027674 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-76218409-1a3a-4df1-99e1-c8958ca13477 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3be4ba54ab584eed886e96314efee34b'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:14.043224 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-76218409-1a3a-4df1-99e1-c8958ca13477 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3be4ba54ab584eed886e96314efee34b'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:14.054701 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 960/1902] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:38:13 2022] DELETE /identity/v3/users/3be4ba54ab584eed886e96314efee34b => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:14.058924 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fafa6-e1b3-453e-9eae-51af7759c974 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:14.059244 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fafa6-e1b3-453e-9eae-51af7759c974 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:14.059522 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fafa6-e1b3-453e-9eae-51af7759c974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:14.087929 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-1a4fafa6-e1b3-453e-9eae-51af7759c974 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:14.091175 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1a4fafa6-e1b3-453e-9eae-51af7759c974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:14.111835 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76218409-1a3a-4df1-99e1-c8958ca13477 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:14.113285 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-76218409-1a3a-4df1-99e1-c8958ca13477 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:14.187138 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 943/1903] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:38:14.201680 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4fafa6-e1b3-453e-9eae-51af7759c974 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:14.203834 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1a4fafa6-e1b3-453e-9eae-51af7759c974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:14.238381 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:14.245533 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76218409-1a3a-4df1-99e1-c8958ca13477 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:14.257414 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ecd6b-3996-40e0-aa41-8b70009f2846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:14.258099 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ecd6b-3996-40e0-aa41-8b70009f2846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:14.258384 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ecd6b-3996-40e0-aa41-8b70009f2846 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:14.258661 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ecd6b-3996-40e0-aa41-8b70009f2846 admin admin] PATH_INFO: `/v3/users/ace496cd06a54a2ab90d281412248ab7` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:14.262005 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4ecd6b-3996-40e0-aa41-8b70009f2846 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ace496cd06a54a2ab90d281412248ab7)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:14.267474 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4ecd6b-3996-40e0-aa41-8b70009f2846 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:14.336441 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4fafa6-e1b3-453e-9eae-51af7759c974 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:14.345636 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5cfa9-f7b9-4a93-a8fb-ccbad16c74d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:14.347115 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5cfa9-f7b9-4a93-a8fb-ccbad16c74d5 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:14.349204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5cfa9-f7b9-4a93-a8fb-ccbad16c74d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:14.350240 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5cfa9-f7b9-4a93-a8fb-ccbad16c74d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:14.364891 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ec4ecd6b-3996-40e0-aa41-8b70009f2846 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ace496cd06a54a2ab90d281412248ab7'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:14.366456 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ec4ecd6b-3996-40e0-aa41-8b70009f2846 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ace496cd06a54a2ab90d281412248ab7'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:14.370330 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f5cfa9-f7b9-4a93-a8fb-ccbad16c74d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:14.371820 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f5cfa9-f7b9-4a93-a8fb-ccbad16c74d5 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:14.384351 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 944/1904] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:38:14.422844 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ec4ecd6b-3996-40e0-aa41-8b70009f2846 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ace496cd06a54a2ab90d281412248ab7'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:14.436450 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ec4ecd6b-3996-40e0-aa41-8b70009f2846 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ace496cd06a54a2ab90d281412248ab7'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:14.457520 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ec4ecd6b-3996-40e0-aa41-8b70009f2846 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ace496cd06a54a2ab90d281412248ab7'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:14.470247 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 961/1905] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:38:14 2022] DELETE /identity/v3/users/ace496cd06a54a2ab90d281412248ab7 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:38:14.475116 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf38434-0945-489e-995f-7f8c9ccafe59 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:14.475404 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf38434-0945-489e-995f-7f8c9ccafe59 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:14.475671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf38434-0945-489e-995f-7f8c9ccafe59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:14.515938 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-ebf38434-0945-489e-995f-7f8c9ccafe59 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:14.517648 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ebf38434-0945-489e-995f-7f8c9ccafe59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:14.632476 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 945/1906] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:14.666289 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ecd6b-3996-40e0-aa41-8b70009f2846 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:14.668915 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ec4ecd6b-3996-40e0-aa41-8b70009f2846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:14.807102 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07945ae0-cb7e-4f75-8f18-d59123eb64e7 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:14.807573 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07945ae0-cb7e-4f75-8f18-d59123eb64e7 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:14.807990 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07945ae0-cb7e-4f75-8f18-d59123eb64e7 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:14.809970 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 946/1907] 10.222.0.83 () {54 vars in 921 bytes} [Mon Aug 29 15:38:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:38:14.817680 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ecd6b-3996-40e0-aa41-8b70009f2846 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:14.838603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c7336-6d8e-489f-bc8f-305f84d3d45a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:14.838603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c7336-6d8e-489f-bc8f-305f84d3d45a service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:14.838603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c7336-6d8e-489f-bc8f-305f84d3d45a service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:14.838914 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c7336-6d8e-489f-bc8f-305f84d3d45a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:14.850795 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336e490-cb93-4fd6-8fba-85e4c25a638c None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:14.852204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336e490-cb93-4fd6-8fba-85e4c25a638c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:14.852854 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336e490-cb93-4fd6-8fba-85e4c25a638c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:14.864841 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c7336-6d8e-489f-bc8f-305f84d3d45a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:14.868307 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c7336-6d8e-489f-bc8f-305f84d3d45a service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:14.894984 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:14.899724 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-5336e490-cb93-4fd6-8fba-85e4c25a638c None None] MFA Rules not processed for user `253947a5ef294d2bb828761873251bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:14.904429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5336e490-cb93-4fd6-8fba-85e4c25a638c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:14.910816 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 962/1908] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:38:14.911830 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c7336-6d8e-489f-bc8f-305f84d3d45a service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:14.916963 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8c6c7336-6d8e-489f-bc8f-305f84d3d45a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:14.986855 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c7336-6d8e-489f-bc8f-305f84d3d45a service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:15.005668 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142d770-19bd-4b4e-887f-047174071a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:15.006372 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142d770-19bd-4b4e-887f-047174071a94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:15.008122 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142d770-19bd-4b4e-887f-047174071a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:15.008591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142d770-19bd-4b4e-887f-047174071a94 admin admin] PATH_INFO: `/v3/projects/9b91ca2a1fbd4d9baa5b8586c0bb3d0b` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:15.013380 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2142d770-19bd-4b4e-887f-047174071a94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b91ca2a1fbd4d9baa5b8586c0bb3d0b)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:15.025329 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2142d770-19bd-4b4e-887f-047174071a94 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:15.078186 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 947/1909] 10.222.0.83 () {58 vars in 1018 bytes} [Mon Aug 29 15:38:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:38:15.127484 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2142d770-19bd-4b4e-887f-047174071a94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b91ca2a1fbd4d9baa5b8586c0bb3d0b', 'request_id': 'req-2142d770-19bd-4b4e-887f-047174071a94'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:15.134781 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2142d770-19bd-4b4e-887f-047174071a94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b91ca2a1fbd4d9baa5b8586c0bb3d0b', 'request_id': 'req-2142d770-19bd-4b4e-887f-047174071a94'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:15.136063 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5336e490-cb93-4fd6-8fba-85e4c25a638c None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:15.140298 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5336e490-cb93-4fd6-8fba-85e4c25a638c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:15.145461 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2142d770-19bd-4b4e-887f-047174071a94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b91ca2a1fbd4d9baa5b8586c0bb3d0b', 'request_id': 'req-2142d770-19bd-4b4e-887f-047174071a94'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:15.174298 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5336e490-cb93-4fd6-8fba-85e4c25a638c None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:15.179180 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2142d770-19bd-4b4e-887f-047174071a94 admin admin] The token cache is being invalidate because project 9b91ca2a1fbd4d9baa5b8586c0bb3d0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:38:15.179789 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2142d770-19bd-4b4e-887f-047174071a94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:15.180652 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2142d770-19bd-4b4e-887f-047174071a94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:15.183715 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 963/1910] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:38:14 2022] DELETE /identity/v3/projects/9b91ca2a1fbd4d9baa5b8586c0bb3d0b => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:15.187415 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142d770-19bd-4b4e-887f-047174071a94 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:15.190870 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2142d770-19bd-4b4e-887f-047174071a94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:15.327899 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142d770-19bd-4b4e-887f-047174071a94 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:15.352712 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d81a2c0-13c4-4c81-9057-60b67cb7f6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:15.353597 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81a2c0-13c4-4c81-9057-60b67cb7f6b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:15.354030 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81a2c0-13c4-4c81-9057-60b67cb7f6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:15.355397 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81a2c0-13c4-4c81-9057-60b67cb7f6b9 admin admin] PATH_INFO: `/v3/users/7afdd760a558462f9822cbe7b6a57798` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:15.360880 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d81a2c0-13c4-4c81-9057-60b67cb7f6b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7afdd760a558462f9822cbe7b6a57798)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:15.363230 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d81a2c0-13c4-4c81-9057-60b67cb7f6b9 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:15.373654 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:15.411786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b715691-8cc3-4b05-b76f-6c207df7e1aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:15.412885 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b715691-8cc3-4b05-b76f-6c207df7e1aa service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:15.413159 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b715691-8cc3-4b05-b76f-6c207df7e1aa service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:15.413427 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b715691-8cc3-4b05-b76f-6c207df7e1aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:15.420274 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9b715691-8cc3-4b05-b76f-6c207df7e1aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:15.456671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b715691-8cc3-4b05-b76f-6c207df7e1aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:15.458618 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b715691-8cc3-4b05-b76f-6c207df7e1aa service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:15.485120 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 948/1911] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:38:15.486601 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef39f4-b118-4c4e-9d03-804a080e6669 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:15.486898 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef39f4-b118-4c4e-9d03-804a080e6669 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:15.487185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef39f4-b118-4c4e-9d03-804a080e6669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:15.501367 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5d81a2c0-13c4-4c81-9057-60b67cb7f6b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7afdd760a558462f9822cbe7b6a57798'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:15.503753 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5d81a2c0-13c4-4c81-9057-60b67cb7f6b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7afdd760a558462f9822cbe7b6a57798'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:15.527304 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5d81a2c0-13c4-4c81-9057-60b67cb7f6b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7afdd760a558462f9822cbe7b6a57798'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:15.536594 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-12ef39f4-b118-4c4e-9d03-804a080e6669 None None] MFA Rules not processed for user `06856f1488e44bde85de23a5effddbdd`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:15.537699 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5d81a2c0-13c4-4c81-9057-60b67cb7f6b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7afdd760a558462f9822cbe7b6a57798'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:15.538176 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-12ef39f4-b118-4c4e-9d03-804a080e6669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:15.565979 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5d81a2c0-13c4-4c81-9057-60b67cb7f6b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7afdd760a558462f9822cbe7b6a57798'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:15.581268 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 964/1912] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:38:15 2022] DELETE /identity/v3/users/7afdd760a558462f9822cbe7b6a57798 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:15.582545 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d81a2c0-13c4-4c81-9057-60b67cb7f6b9 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:15.591342 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5d81a2c0-13c4-4c81-9057-60b67cb7f6b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:15.601559 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:15.666303 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 949/1913] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:15 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:15.687888 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d81a2c0-13c4-4c81-9057-60b67cb7f6b9 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:15.695836 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c59c6-fbd4-48f7-99a6-45681edf5446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:15.696629 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c59c6-fbd4-48f7-99a6-45681edf5446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:15.697009 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c59c6-fbd4-48f7-99a6-45681edf5446 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:15.697395 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c59c6-fbd4-48f7-99a6-45681edf5446 admin admin] PATH_INFO: `/v3/projects/83bffa43c9d949308afed8df7caf1035` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:15.698768 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25c59c6-fbd4-48f7-99a6-45681edf5446 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83bffa43c9d949308afed8df7caf1035)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:15.701370 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25c59c6-fbd4-48f7-99a6-45681edf5446 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:15.769800 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a25c59c6-fbd4-48f7-99a6-45681edf5446 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83bffa43c9d949308afed8df7caf1035', 'request_id': 'req-a25c59c6-fbd4-48f7-99a6-45681edf5446'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:15.777862 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a25c59c6-fbd4-48f7-99a6-45681edf5446 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83bffa43c9d949308afed8df7caf1035', 'request_id': 'req-a25c59c6-fbd4-48f7-99a6-45681edf5446'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:15.788530 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a25c59c6-fbd4-48f7-99a6-45681edf5446 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83bffa43c9d949308afed8df7caf1035', 'request_id': 'req-a25c59c6-fbd4-48f7-99a6-45681edf5446'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:15.801704 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a25c59c6-fbd4-48f7-99a6-45681edf5446 admin admin] The token cache is being invalidate because project 83bffa43c9d949308afed8df7caf1035 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:38:15.805565 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a25c59c6-fbd4-48f7-99a6-45681edf5446 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:15.806419 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a25c59c6-fbd4-48f7-99a6-45681edf5446 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:15.809231 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 965/1914] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:38:15 2022] DELETE /identity/v3/projects/83bffa43c9d949308afed8df7caf1035 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:15.813434 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef39f4-b118-4c4e-9d03-804a080e6669 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:15.827316 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef39f4-b118-4c4e-9d03-804a080e6669 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:15.917971 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652dcacf-222d-4c17-a980-d837544fdd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:15.918198 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652dcacf-222d-4c17-a980-d837544fdd55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:15.918640 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652dcacf-222d-4c17-a980-d837544fdd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:15.918775 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652dcacf-222d-4c17-a980-d837544fdd55 admin admin] PATH_INFO: `/v3/users/fddbb38576054f039ef1e2c00249ba7e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:15.920644 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652dcacf-222d-4c17-a980-d837544fdd55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fddbb38576054f039ef1e2c00249ba7e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:15.923152 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652dcacf-222d-4c17-a980-d837544fdd55 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:15.989058 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-652dcacf-222d-4c17-a980-d837544fdd55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fddbb38576054f039ef1e2c00249ba7e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:15.990174 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-652dcacf-222d-4c17-a980-d837544fdd55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fddbb38576054f039ef1e2c00249ba7e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:16.004511 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-652dcacf-222d-4c17-a980-d837544fdd55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fddbb38576054f039ef1e2c00249ba7e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:16.019014 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-652dcacf-222d-4c17-a980-d837544fdd55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fddbb38576054f039ef1e2c00249ba7e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:16.019927 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-652dcacf-222d-4c17-a980-d837544fdd55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fddbb38576054f039ef1e2c00249ba7e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:16.046839 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 950/1915] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:38:15 2022] DELETE /identity/v3/users/fddbb38576054f039ef1e2c00249ba7e => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:16.541856 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615ba5b-502b-4f4d-8c13-de2dfecf3773 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:16.542406 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615ba5b-502b-4f4d-8c13-de2dfecf3773 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:16.542577 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615ba5b-502b-4f4d-8c13-de2dfecf3773 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:16.553372 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 966/1916] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 15:38:16 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:38:16.560779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706c645-8e0f-4231-afc3-3a29f552b30d None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:16.561331 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706c645-8e0f-4231-afc3-3a29f552b30d None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:16.561331 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706c645-8e0f-4231-afc3-3a29f552b30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:16.578611 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:16.604050 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-4706c645-8e0f-4231-afc3-3a29f552b30d None None] MFA Rules not processed for user `9a84bb38f6454574897120223b8fc140`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:16.605572 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4706c645-8e0f-4231-afc3-3a29f552b30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:16.643105 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3615ba5b-502b-4f4d-8c13-de2dfecf3773 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:16.645182 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3615ba5b-502b-4f4d-8c13-de2dfecf3773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:16.706854 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 951/1917] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 15:38:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:16.714249 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706c645-8e0f-4231-afc3-3a29f552b30d None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:16.722020 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4706c645-8e0f-4231-afc3-3a29f552b30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:16.773487 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3615ba5b-502b-4f4d-8c13-de2dfecf3773 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:16.781288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f49ce-47e0-41da-87a4-b2e56d3f353f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:16.781953 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f49ce-47e0-41da-87a4-b2e56d3f353f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:16.782229 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f49ce-47e0-41da-87a4-b2e56d3f353f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:16.782503 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f49ce-47e0-41da-87a4-b2e56d3f353f admin admin] PATH_INFO: `/v3/projects/8873ed3cf9b9422f9479635f2a29f025` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:16.783701 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13f49ce-47e0-41da-87a4-b2e56d3f353f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8873ed3cf9b9422f9479635f2a29f025)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:16.786452 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13f49ce-47e0-41da-87a4-b2e56d3f353f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:16.858048 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706c645-8e0f-4231-afc3-3a29f552b30d None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:16.865770 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:16.884356 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e13f49ce-47e0-41da-87a4-b2e56d3f353f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8873ed3cf9b9422f9479635f2a29f025', 'request_id': 'req-e13f49ce-47e0-41da-87a4-b2e56d3f353f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:16.892524 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e13f49ce-47e0-41da-87a4-b2e56d3f353f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8873ed3cf9b9422f9479635f2a29f025', 'request_id': 'req-e13f49ce-47e0-41da-87a4-b2e56d3f353f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:16.908936 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e13f49ce-47e0-41da-87a4-b2e56d3f353f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8873ed3cf9b9422f9479635f2a29f025', 'request_id': 'req-e13f49ce-47e0-41da-87a4-b2e56d3f353f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:16.926563 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e13f49ce-47e0-41da-87a4-b2e56d3f353f admin admin] The token cache is being invalidate because project 8873ed3cf9b9422f9479635f2a29f025 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:38:16.927068 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e13f49ce-47e0-41da-87a4-b2e56d3f353f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:16.927853 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e13f49ce-47e0-41da-87a4-b2e56d3f353f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:16.933267 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 967/1918] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:38:16 2022] DELETE /identity/v3/projects/8873ed3cf9b9422f9479635f2a29f025 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:38:16.934418 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f49ce-47e0-41da-87a4-b2e56d3f353f admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:16.936101 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e13f49ce-47e0-41da-87a4-b2e56d3f353f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:16.949763 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af872a-ca02-4871-b974-ea08c3f6f0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:16.950423 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af872a-ca02-4871-b974-ea08c3f6f0d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:16.950702 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af872a-ca02-4871-b974-ea08c3f6f0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:16.951130 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af872a-ca02-4871-b974-ea08c3f6f0d5 admin admin] PATH_INFO: `/v3/projects/d76ba312cb0343558cf07a809cac555a` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:16.952728 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4af872a-ca02-4871-b974-ea08c3f6f0d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d76ba312cb0343558cf07a809cac555a)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:16.954763 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4af872a-ca02-4871-b974-ea08c3f6f0d5 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:17.007950 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f49ce-47e0-41da-87a4-b2e56d3f353f admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:17.020234 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a4af872a-ca02-4871-b974-ea08c3f6f0d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd76ba312cb0343558cf07a809cac555a', 'request_id': 'req-a4af872a-ca02-4871-b974-ea08c3f6f0d5'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:17.042768 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a4af872a-ca02-4871-b974-ea08c3f6f0d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd76ba312cb0343558cf07a809cac555a', 'request_id': 'req-a4af872a-ca02-4871-b974-ea08c3f6f0d5'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:17.046904 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:17.054568 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a4af872a-ca02-4871-b974-ea08c3f6f0d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd76ba312cb0343558cf07a809cac555a', 'request_id': 'req-a4af872a-ca02-4871-b974-ea08c3f6f0d5'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:17.072694 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a4af872a-ca02-4871-b974-ea08c3f6f0d5 admin admin] The token cache is being invalidate because project d76ba312cb0343558cf07a809cac555a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:38:17.073181 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a4af872a-ca02-4871-b974-ea08c3f6f0d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:17.074005 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a4af872a-ca02-4871-b974-ea08c3f6f0d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:17.076019 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 952/1919] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:38:16 2022] DELETE /identity/v3/projects/d76ba312cb0343558cf07a809cac555a => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:17.077509 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f691107-8c61-45c0-bba6-4c0853eedcf8 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:17.077783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f691107-8c61-45c0-bba6-4c0853eedcf8 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:17.078050 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f691107-8c61-45c0-bba6-4c0853eedcf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:17.081025 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7f61d-6351-4d66-903c-35a12105ff25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:17.083731 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7f61d-6351-4d66-903c-35a12105ff25 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:17.084576 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7f61d-6351-4d66-903c-35a12105ff25 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:17.084963 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7f61d-6351-4d66-903c-35a12105ff25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:17.087175 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d1b7f61d-6351-4d66-903c-35a12105ff25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:17.105436 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-0f691107-8c61-45c0-bba6-4c0853eedcf8 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:17.106854 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0f691107-8c61-45c0-bba6-4c0853eedcf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:17.110681 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b7f61d-6351-4d66-903c-35a12105ff25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:17.112388 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b7f61d-6351-4d66-903c-35a12105ff25 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:17.123502 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 968/1920] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:38:17.124589 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682627d-0636-4263-b340-925da879a321 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:17.124873 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682627d-0636-4263-b340-925da879a321 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:17.125144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682627d-0636-4263-b340-925da879a321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:17.153454 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-1682627d-0636-4263-b340-925da879a321 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:17.157031 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1682627d-0636-4263-b340-925da879a321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:17.211416 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 953/1921] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:17.219623 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fade6f-885b-48e1-926f-c80b4568f640 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:17.219912 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fade6f-885b-48e1-926f-c80b4568f640 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:17.220187 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fade6f-885b-48e1-926f-c80b4568f640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:17.239262 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 969/1922] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:17.241875 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-60fade6f-885b-48e1-926f-c80b4568f640 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:17.243119 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-60fade6f-885b-48e1-926f-c80b4568f640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:17.247866 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f136a-5a3b-4ab0-b753-ba2c6832f292 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:17.248371 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f136a-5a3b-4ab0-b753-ba2c6832f292 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:17.249073 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f136a-5a3b-4ab0-b753-ba2c6832f292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:17.251325 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 954/1923] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:38:17.255563 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fade6f-885b-48e1-926f-c80b4568f640 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:17.266432 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fade6f-885b-48e1-926f-c80b4568f640 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:17.272331 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d43cb-c8a2-4716-8c8e-a763dea8e8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:17.272953 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d43cb-c8a2-4716-8c8e-a763dea8e8ad admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:17.273233 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d43cb-c8a2-4716-8c8e-a763dea8e8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:17.273542 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d43cb-c8a2-4716-8c8e-a763dea8e8ad admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:17.274250 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d43cb-c8a2-4716-8c8e-a763dea8e8ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:38:17.274550 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d43cb-c8a2-4716-8c8e-a763dea8e8ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:17.276299 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d43cb-c8a2-4716-8c8e-a763dea8e8ad admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:17.278588 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-432f136a-5a3b-4ab0-b753-ba2c6832f292 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:17.280123 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-432f136a-5a3b-4ab0-b753-ba2c6832f292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:17.289554 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 970/1924] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:17.293314 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 955/1925] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:38:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:38:17.294601 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f136a-5a3b-4ab0-b753-ba2c6832f292 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:17.297729 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d43cb-c8a2-4716-8c8e-a763dea8e8ad admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:17.307654 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f136a-5a3b-4ab0-b753-ba2c6832f292 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:17.311318 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d43cb-c8a2-4716-8c8e-a763dea8e8ad admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:17.313159 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267d200-58ce-4f6e-ab07-27fd9186bb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:17.313771 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267d200-58ce-4f6e-ab07-27fd9186bb15 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:17.314019 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267d200-58ce-4f6e-ab07-27fd9186bb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:17.314300 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267d200-58ce-4f6e-ab07-27fd9186bb15 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:17.314944 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b267d200-58ce-4f6e-ab07-27fd9186bb15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:38:17.315373 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b267d200-58ce-4f6e-ab07-27fd9186bb15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:17.316630 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79828b-cefd-4779-862c-e4dbe692b937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:17.316938 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b267d200-58ce-4f6e-ab07-27fd9186bb15 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:17.317418 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79828b-cefd-4779-862c-e4dbe692b937 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:17.317787 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79828b-cefd-4779-862c-e4dbe692b937 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:17.318711 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79828b-cefd-4779-862c-e4dbe692b937 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:17.319496 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b79828b-cefd-4779-862c-e4dbe692b937 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:17.321387 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b79828b-cefd-4779-862c-e4dbe692b937 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:17.335075 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 971/1926] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:38:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:38:17.339340 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267d200-58ce-4f6e-ab07-27fd9186bb15 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:17.347985 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:17.355420 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267d200-58ce-4f6e-ab07-27fd9186bb15 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:17.365757 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 956/1927] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:38:17 2022] POST /identity/v3/projects => generated 375 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:17.365933 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5489c08-4e12-4040-b4cb-535aa01c8eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:17.365933 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5489c08-4e12-4040-b4cb-535aa01c8eb7 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:17.365933 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5489c08-4e12-4040-b4cb-535aa01c8eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:17.365933 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5489c08-4e12-4040-b4cb-535aa01c8eb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:17.366298 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5489c08-4e12-4040-b4cb-535aa01c8eb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:17.367556 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79828b-cefd-4779-862c-e4dbe692b937 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:17.369293 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5489c08-4e12-4040-b4cb-535aa01c8eb7 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:17.411218 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 972/1928] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:38:17 2022] POST /identity/v3/projects => generated 409 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:38:17.416872 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5489c08-4e12-4040-b4cb-535aa01c8eb7 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:17.493027 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79828b-cefd-4779-862c-e4dbe692b937 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:17.511120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5489c08-4e12-4040-b4cb-535aa01c8eb7 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:17.523957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae274fe4-debe-487f-9e88-39b7f12687b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:17.524715 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae274fe4-debe-487f-9e88-39b7f12687b6 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:17.525014 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae274fe4-debe-487f-9e88-39b7f12687b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:17.525379 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae274fe4-debe-487f-9e88-39b7f12687b6 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:17.526061 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae274fe4-debe-487f-9e88-39b7f12687b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:17.528283 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae274fe4-debe-487f-9e88-39b7f12687b6 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:17.567867 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 973/1929] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:38:17 2022] POST /identity/v3/users => generated 305 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:17.575138 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae274fe4-debe-487f-9e88-39b7f12687b6 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:17.597483 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae274fe4-debe-487f-9e88-39b7f12687b6 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:17.604601 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4996250-f908-424e-9828-b120b9c69779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:17.606377 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4996250-f908-424e-9828-b120b9c69779 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:17.606758 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4996250-f908-424e-9828-b120b9c69779 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:17.607180 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4996250-f908-424e-9828-b120b9c69779 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:17.607962 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4996250-f908-424e-9828-b120b9c69779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:17.611733 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4996250-f908-424e-9828-b120b9c69779 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:17.646510 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:17.647618 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 974/1930] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:17.649982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4996250-f908-424e-9828-b120b9c69779 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:17.667632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c07df1-d1de-4cfd-b5f3-c2422f7fb94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:17.668491 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c07df1-d1de-4cfd-b5f3-c2422f7fb94b admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:17.669686 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c07df1-d1de-4cfd-b5f3-c2422f7fb94b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:17.670226 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c07df1-d1de-4cfd-b5f3-c2422f7fb94b admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:17.671213 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c07df1-d1de-4cfd-b5f3-c2422f7fb94b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:17.673419 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4996250-f908-424e-9828-b120b9c69779 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:17.674973 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c07df1-d1de-4cfd-b5f3-c2422f7fb94b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:17.680731 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319edcad-57bf-458a-9709-99dcc91df956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:17.681478 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319edcad-57bf-458a-9709-99dcc91df956 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:17.681860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319edcad-57bf-458a-9709-99dcc91df956 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:17.683162 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319edcad-57bf-458a-9709-99dcc91df956 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:17.683162 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319edcad-57bf-458a-9709-99dcc91df956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:17.685316 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319edcad-57bf-458a-9709-99dcc91df956 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:17.713964 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 975/1931] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:17.716086 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319edcad-57bf-458a-9709-99dcc91df956 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:17.728737 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319edcad-57bf-458a-9709-99dcc91df956 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:17.734565 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e7fb5-9e4b-44e4-8132-1d0d97380c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:17.736677 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e7fb5-9e4b-44e4-8132-1d0d97380c1a admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:17.736904 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e7fb5-9e4b-44e4-8132-1d0d97380c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:17.737333 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e7fb5-9e4b-44e4-8132-1d0d97380c1a admin admin] PATH_INFO: `/v3/projects/70ff79163aa94ae087ed678244cc7123/users/593ea2cd4b8d4b5084bcb20e951bf615/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:17.764865 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 957/1932] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:38:17 2022] POST /identity/v3/users => generated 288 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:38:17.771739 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e7fb5-9e4b-44e4-8132-1d0d97380c1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=70ff79163aa94ae087ed678244cc7123, user_id=593ea2cd4b8d4b5084bcb20e951bf615, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:17.775158 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e7fb5-9e4b-44e4-8132-1d0d97380c1a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:17.775332 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c07df1-d1de-4cfd-b5f3-c2422f7fb94b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:17.794780 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 976/1933] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:38:17 2022] PUT /identity/v3/projects/70ff79163aa94ae087ed678244cc7123/users/593ea2cd4b8d4b5084bcb20e951bf615/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:17.813100 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dee20d-7f12-4dad-b3fd-fdc026216b0c None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:17.813391 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dee20d-7f12-4dad-b3fd-fdc026216b0c None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:17.813721 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dee20d-7f12-4dad-b3fd-fdc026216b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:17.829527 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c07df1-d1de-4cfd-b5f3-c2422f7fb94b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:17.889833 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-c7dee20d-7f12-4dad-b3fd-fdc026216b0c None None] MFA Rules not processed for user `593ea2cd4b8d4b5084bcb20e951bf615`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:17.894838 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c7dee20d-7f12-4dad-b3fd-fdc026216b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:17.989179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af58b4c-7ee4-4a47-84ff-015bbb0ff953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:17.990411 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af58b4c-7ee4-4a47-84ff-015bbb0ff953 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:17.990411 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af58b4c-7ee4-4a47-84ff-015bbb0ff953 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:17.990637 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af58b4c-7ee4-4a47-84ff-015bbb0ff953 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:17.991511 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af58b4c-7ee4-4a47-84ff-015bbb0ff953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:17.993293 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af58b4c-7ee4-4a47-84ff-015bbb0ff953 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:18.012913 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 958/1934] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:18.013697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af58b4c-7ee4-4a47-84ff-015bbb0ff953 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:18.025143 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af58b4c-7ee4-4a47-84ff-015bbb0ff953 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:18.033932 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcfe7db-0977-4b7f-bb36-57f1c88bdb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:18.035047 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfe7db-0977-4b7f-bb36-57f1c88bdb9e admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:18.035479 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfe7db-0977-4b7f-bb36-57f1c88bdb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:18.036073 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfe7db-0977-4b7f-bb36-57f1c88bdb9e admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:18.037888 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcfe7db-0977-4b7f-bb36-57f1c88bdb9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:18.040808 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcfe7db-0977-4b7f-bb36-57f1c88bdb9e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:18.054625 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 977/1935] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:17 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:18.064687 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dee20d-7f12-4dad-b3fd-fdc026216b0c None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:18.086774 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 959/1936] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:18.094482 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcfe7db-0977-4b7f-bb36-57f1c88bdb9e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:18.102204 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dee20d-7f12-4dad-b3fd-fdc026216b0c None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:18.107851 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0211af-3886-4fed-b350-2c47233bc6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:18.108485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0211af-3886-4fed-b350-2c47233bc6ee admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:18.108794 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0211af-3886-4fed-b350-2c47233bc6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:18.109032 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0211af-3886-4fed-b350-2c47233bc6ee admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:18.112174 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcfe7db-0977-4b7f-bb36-57f1c88bdb9e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:18.115980 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0211af-3886-4fed-b350-2c47233bc6ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:18.118397 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc16eed4-3ef2-483d-acdf-4ddd72eeabe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:18.118931 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0211af-3886-4fed-b350-2c47233bc6ee admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:18.119474 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16eed4-3ef2-483d-acdf-4ddd72eeabe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:18.120135 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16eed4-3ef2-483d-acdf-4ddd72eeabe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:18.120484 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16eed4-3ef2-483d-acdf-4ddd72eeabe8 admin admin] PATH_INFO: `/v3/projects/1fbf5987755b48d4a7ab9158be9dc1a7/users/c0fc1ed3b042422faaa12d3876787ae4/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:18.139919 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:18.148771 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc16eed4-3ef2-483d-acdf-4ddd72eeabe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fbf5987755b48d4a7ab9158be9dc1a7, user_id=c0fc1ed3b042422faaa12d3876787ae4, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:18.155012 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc16eed4-3ef2-483d-acdf-4ddd72eeabe8 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:18.177396 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 978/1937] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:38:18 2022] POST /identity/v3/projects => generated 411 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:18.178684 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0211af-3886-4fed-b350-2c47233bc6ee admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:18.180169 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 960/1938] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:38:18 2022] PUT /identity/v3/projects/1fbf5987755b48d4a7ab9158be9dc1a7/users/c0fc1ed3b042422faaa12d3876787ae4/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:18.191510 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646db17-6482-4858-8156-95b63a152516 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:18.192438 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646db17-6482-4858-8156-95b63a152516 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:18.192853 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646db17-6482-4858-8156-95b63a152516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:18.235175 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a646db17-6482-4858-8156-95b63a152516 None None] MFA Rules not processed for user `c0fc1ed3b042422faaa12d3876787ae4`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:18.236964 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a646db17-6482-4858-8156-95b63a152516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:18.291605 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0211af-3886-4fed-b350-2c47233bc6ee admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:18.297094 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973531a-ee5d-4ac2-8fbd-caf0531ff745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:18.298090 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973531a-ee5d-4ac2-8fbd-caf0531ff745 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:18.298463 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973531a-ee5d-4ac2-8fbd-caf0531ff745 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:18.298865 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973531a-ee5d-4ac2-8fbd-caf0531ff745 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:18.300298 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b973531a-ee5d-4ac2-8fbd-caf0531ff745 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:18.303189 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b973531a-ee5d-4ac2-8fbd-caf0531ff745 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:18.358569 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 979/1939] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:38:18 2022] POST /identity/v3/users => generated 312 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:18.359348 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 961/1940] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:38:18.359614 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973531a-ee5d-4ac2-8fbd-caf0531ff745 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:18.363346 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a646db17-6482-4858-8156-95b63a152516 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:18.385347 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a646db17-6482-4858-8156-95b63a152516 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:18.388204 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973531a-ee5d-4ac2-8fbd-caf0531ff745 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:18.410029 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ee461-dd29-478c-bcb6-63b4f5e587ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:18.410680 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ee461-dd29-478c-bcb6-63b4f5e587ea admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:18.410918 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f75672-7420-4113-a7e0-d018855948fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:18.411112 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ee461-dd29-478c-bcb6-63b4f5e587ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:18.411493 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ee461-dd29-478c-bcb6-63b4f5e587ea admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:18.411628 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f75672-7420-4113-a7e0-d018855948fa admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:18.411894 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f75672-7420-4113-a7e0-d018855948fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:18.412247 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f75672-7420-4113-a7e0-d018855948fa admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:18.412480 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ee461-dd29-478c-bcb6-63b4f5e587ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:18.412930 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f75672-7420-4113-a7e0-d018855948fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:18.415404 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ee461-dd29-478c-bcb6-63b4f5e587ea admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:18.415591 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f75672-7420-4113-a7e0-d018855948fa admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:18.447159 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 980/1941] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:18.451627 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ee461-dd29-478c-bcb6-63b4f5e587ea admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:18.465622 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 962/1942] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:38:18 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:38:18.469666 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f75672-7420-4113-a7e0-d018855948fa admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:18.476492 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ee461-dd29-478c-bcb6-63b4f5e587ea admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:18.503395 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:18.595059 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac0064-a3be-4acc-a4fd-ebf14420a727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:18.595059 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac0064-a3be-4acc-a4fd-ebf14420a727 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:18.595059 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac0064-a3be-4acc-a4fd-ebf14420a727 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:18.595059 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac0064-a3be-4acc-a4fd-ebf14420a727 admin admin] PATH_INFO: `/v3/projects/33ff2fb111bd450b9c2817f4a523a18c/users/77dfc1ab0428420fa02966697c1400d8/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:18.620547 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac0064-a3be-4acc-a4fd-ebf14420a727 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33ff2fb111bd450b9c2817f4a523a18c, user_id=77dfc1ab0428420fa02966697c1400d8, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:18.620547 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac0064-a3be-4acc-a4fd-ebf14420a727 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:18.623943 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f75672-7420-4113-a7e0-d018855948fa admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:18.638262 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8a807-0089-4a9f-911b-50590a4cc029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:18.639969 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8a807-0089-4a9f-911b-50590a4cc029 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:18.640316 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8a807-0089-4a9f-911b-50590a4cc029 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:18.640602 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8a807-0089-4a9f-911b-50590a4cc029 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:18.641359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8a807-0089-4a9f-911b-50590a4cc029 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:18.643861 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8a807-0089-4a9f-911b-50590a4cc029 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:18.655794 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 981/1943] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:38:18 2022] PUT /identity/v3/projects/33ff2fb111bd450b9c2817f4a523a18c/users/77dfc1ab0428420fa02966697c1400d8/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:18.656975 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac0064-a3be-4acc-a4fd-ebf14420a727 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:18.690260 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 963/1944] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:38:18 2022] POST /identity/v3/users => generated 293 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:38:18.695203 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8a807-0089-4a9f-911b-50590a4cc029 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:18.711528 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8a807-0089-4a9f-911b-50590a4cc029 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:18.755388 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:18.775578 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac0064-a3be-4acc-a4fd-ebf14420a727 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:18.784256 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa50014c-aaac-4e22-82c1-c0180cdf2f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:18.784926 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa50014c-aaac-4e22-82c1-c0180cdf2f5f admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:18.785435 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa50014c-aaac-4e22-82c1-c0180cdf2f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:18.787419 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa50014c-aaac-4e22-82c1-c0180cdf2f5f admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:18.791714 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa50014c-aaac-4e22-82c1-c0180cdf2f5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:18.793484 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa50014c-aaac-4e22-82c1-c0180cdf2f5f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:18.809288 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 982/1945] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:18.813788 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa50014c-aaac-4e22-82c1-c0180cdf2f5f admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:18.823810 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb6b042-7431-4ab4-93bf-bfd2063e8638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:18.824909 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6b042-7431-4ab4-93bf-bfd2063e8638 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:18.824909 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6b042-7431-4ab4-93bf-bfd2063e8638 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:18.825344 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6b042-7431-4ab4-93bf-bfd2063e8638 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:18.826155 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb6b042-7431-4ab4-93bf-bfd2063e8638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:18.828885 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb6b042-7431-4ab4-93bf-bfd2063e8638 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:18.836628 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa50014c-aaac-4e22-82c1-c0180cdf2f5f admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:18.843066 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 964/1946] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:18.846898 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb6b042-7431-4ab4-93bf-bfd2063e8638 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:18.852564 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9293dbc6-829d-45b5-a9ac-6da31115780b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:18.853273 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293dbc6-829d-45b5-a9ac-6da31115780b admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:18.853697 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293dbc6-829d-45b5-a9ac-6da31115780b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:18.853846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293dbc6-829d-45b5-a9ac-6da31115780b admin admin] PATH_INFO: `/v3/projects/33ff2fb111bd450b9c2817f4a523a18c/users/77dfc1ab0428420fa02966697c1400d8/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:18.858526 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9293dbc6-829d-45b5-a9ac-6da31115780b admin admin] RBAC: Authorizing `identity:create_grant(project_id=33ff2fb111bd450b9c2817f4a523a18c, user_id=77dfc1ab0428420fa02966697c1400d8, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:18.861294 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9293dbc6-829d-45b5-a9ac-6da31115780b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:18.863518 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb6b042-7431-4ab4-93bf-bfd2063e8638 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:18.869733 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5210c0f-8de6-4da3-b95d-c3eca8487b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:18.870623 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5210c0f-8de6-4da3-b95d-c3eca8487b47 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:18.871328 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5210c0f-8de6-4da3-b95d-c3eca8487b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:18.871787 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5210c0f-8de6-4da3-b95d-c3eca8487b47 admin admin] PATH_INFO: `/v3/projects/3e9d027b854d416799fd428b1eca0a25/users/9f6fe12df0c64e3290ad9f967ec4be08/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:18.889138 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 983/1947] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:38:18 2022] PUT /identity/v3/projects/33ff2fb111bd450b9c2817f4a523a18c/users/77dfc1ab0428420fa02966697c1400d8/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:18.898600 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5210c0f-8de6-4da3-b95d-c3eca8487b47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e9d027b854d416799fd428b1eca0a25, user_id=9f6fe12df0c64e3290ad9f967ec4be08, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:18.902099 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5210c0f-8de6-4da3-b95d-c3eca8487b47 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:18.902285 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258bd7f-3eea-4cb4-ba74-981c643f9858 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:18.902577 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258bd7f-3eea-4cb4-ba74-981c643f9858 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:18.903135 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258bd7f-3eea-4cb4-ba74-981c643f9858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:18.919399 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 965/1948] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:38:18 2022] PUT /identity/v3/projects/3e9d027b854d416799fd428b1eca0a25/users/9f6fe12df0c64e3290ad9f967ec4be08/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:38:18.923779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5210c0f-8de6-4da3-b95d-c3eca8487b47 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:18.960219 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-c258bd7f-3eea-4cb4-ba74-981c643f9858 None None] MFA Rules not processed for user `77dfc1ab0428420fa02966697c1400d8`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:18.962408 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c258bd7f-3eea-4cb4-ba74-981c643f9858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:19.002683 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5210c0f-8de6-4da3-b95d-c3eca8487b47 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:19.008869 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7871b-6e3d-4a3f-a1b6-2cda38291d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:19.009592 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7871b-6e3d-4a3f-a1b6-2cda38291d04 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:19.013208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7871b-6e3d-4a3f-a1b6-2cda38291d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:19.013208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7871b-6e3d-4a3f-a1b6-2cda38291d04 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:19.013208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7871b-6e3d-4a3f-a1b6-2cda38291d04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:19.013208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7871b-6e3d-4a3f-a1b6-2cda38291d04 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:19.054888 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 966/1949] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:38:19.056676 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7871b-6e3d-4a3f-a1b6-2cda38291d04 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:19.067862 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7871b-6e3d-4a3f-a1b6-2cda38291d04 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:19.075492 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8385d-7fc2-4ad3-bcbb-ab62c3790f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:19.076859 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8385d-7fc2-4ad3-bcbb-ab62c3790f9b admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:19.077461 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8385d-7fc2-4ad3-bcbb-ab62c3790f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:19.077897 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8385d-7fc2-4ad3-bcbb-ab62c3790f9b admin admin] PATH_INFO: `/v3/projects/3e9d027b854d416799fd428b1eca0a25/users/9f6fe12df0c64e3290ad9f967ec4be08/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:19.080258 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d8385d-7fc2-4ad3-bcbb-ab62c3790f9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e9d027b854d416799fd428b1eca0a25, user_id=9f6fe12df0c64e3290ad9f967ec4be08, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:19.084443 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d8385d-7fc2-4ad3-bcbb-ab62c3790f9b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:19.095651 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:19.105541 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 967/1950] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:38:19 2022] PUT /identity/v3/projects/3e9d027b854d416799fd428b1eca0a25/users/9f6fe12df0c64e3290ad9f967ec4be08/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:19.132700 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17151d25-0ee6-4e9f-b4e8-98671df93b22 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:19.133261 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17151d25-0ee6-4e9f-b4e8-98671df93b22 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:19.133683 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17151d25-0ee6-4e9f-b4e8-98671df93b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:19.154728 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 984/1951] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:18 2022] POST /identity/v3/auth/tokens => generated 3355 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:19.186653 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-17151d25-0ee6-4e9f-b4e8-98671df93b22 None None] MFA Rules not processed for user `9f6fe12df0c64e3290ad9f967ec4be08`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:19.188339 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-17151d25-0ee6-4e9f-b4e8-98671df93b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:19.232647 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258bd7f-3eea-4cb4-ba74-981c643f9858 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:19.234289 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c258bd7f-3eea-4cb4-ba74-981c643f9858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:19.299831 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 968/1952] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:19.308342 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17151d25-0ee6-4e9f-b4e8-98671df93b22 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:19.318068 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17151d25-0ee6-4e9f-b4e8-98671df93b22 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:19.324419 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68595d68-4794-4512-81fa-fc581cc43acb tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6fe12df0c64e3290ad9f967ec4be08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9d027b854d416799fd428b1eca0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:19.325262 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68595d68-4794-4512-81fa-fc581cc43acb tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:19.325706 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68595d68-4794-4512-81fa-fc581cc43acb tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:19.326283 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68595d68-4794-4512-81fa-fc581cc43acb tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:19.327319 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68595d68-4794-4512-81fa-fc581cc43acb tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:38:19.327625 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68595d68-4794-4512-81fa-fc581cc43acb tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:19.329261 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68595d68-4794-4512-81fa-fc581cc43acb tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:19.338349 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258bd7f-3eea-4cb4-ba74-981c643f9858 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:19.360226 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 969/1953] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:38:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:38:19.369966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68595d68-4794-4512-81fa-fc581cc43acb tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:19.380253 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68595d68-4794-4512-81fa-fc581cc43acb tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:19.385946 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec8d2e3-803c-4049-a640-7d0c275c2c99 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6fe12df0c64e3290ad9f967ec4be08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9d027b854d416799fd428b1eca0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:19.386549 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8d2e3-803c-4049-a640-7d0c275c2c99 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:19.386834 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8d2e3-803c-4049-a640-7d0c275c2c99 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:19.387178 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8d2e3-803c-4049-a640-7d0c275c2c99 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:19.387820 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec8d2e3-803c-4049-a640-7d0c275c2c99 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:19.390037 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec8d2e3-803c-4049-a640-7d0c275c2c99 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:19.430966 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 970/1954] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:38:19 2022] POST /identity/v3/projects => generated 369 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:19.434594 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec8d2e3-803c-4049-a640-7d0c275c2c99 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:19.450498 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:19.481501 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b5f66d-7904-4604-b16b-5236068d8376 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:19.482134 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5f66d-7904-4604-b16b-5236068d8376 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:19.482999 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5f66d-7904-4604-b16b-5236068d8376 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:19.483316 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5f66d-7904-4604-b16b-5236068d8376 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:19.562356 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec8d2e3-803c-4049-a640-7d0c275c2c99 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:19.592216 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578ba73-e665-43e5-8294-a4e38a597083 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6fe12df0c64e3290ad9f967ec4be08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9d027b854d416799fd428b1eca0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:19.593153 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578ba73-e665-43e5-8294-a4e38a597083 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:19.593469 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578ba73-e665-43e5-8294-a4e38a597083 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:19.595466 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578ba73-e665-43e5-8294-a4e38a597083 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:19.596130 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7578ba73-e665-43e5-8294-a4e38a597083 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:38:19.596571 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7578ba73-e665-43e5-8294-a4e38a597083 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:19.600879 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7578ba73-e665-43e5-8294-a4e38a597083 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:19.610273 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b5f66d-7904-4604-b16b-5236068d8376 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:19.611954 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b5f66d-7904-4604-b16b-5236068d8376 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:19.633041 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 985/1955] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:19 2022] GET /identity/v3/auth/tokens => generated 3355 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:38:19.639797 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 971/1956] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:38:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:38:19.817584 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b5f66d-7904-4604-b16b-5236068d8376 service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:19.836116 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b5f66d-7904-4604-b16b-5236068d8376 service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:19.929797 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee06c1-84e2-43ac-8d64-335043eb5cf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:19.930357 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee06c1-84e2-43ac-8d64-335043eb5cf5 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:19.930632 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee06c1-84e2-43ac-8d64-335043eb5cf5 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:19.930902 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee06c1-84e2-43ac-8d64-335043eb5cf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:19.945594 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee06c1-84e2-43ac-8d64-335043eb5cf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:19.947266 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee06c1-84e2-43ac-8d64-335043eb5cf5 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:19.958385 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 986/1957] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:19 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:38:19.976026 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99683cb3-dbe2-467f-b3f2-e462d798b721 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:19.976737 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99683cb3-dbe2-467f-b3f2-e462d798b721 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:19.976737 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99683cb3-dbe2-467f-b3f2-e462d798b721 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:19.978220 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 972/1958] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 15:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:38:19.991406 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee06c1-84e2-43ac-8d64-335043eb5cf5 service nova] Authenticating service token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:38:20.005080 n-d-836830-13 devstack@keystone.service[82148]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee06c1-84e2-43ac-8d64-335043eb5cf5 service nova] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Aug 29 15:38:20.005552 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee06c1-84e2-43ac-8d64-335043eb5cf5 service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:20.015386 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee06c1-84e2-43ac-8d64-335043eb5cf5 service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:20.020274 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125a6fbe-1f81-4528-805a-8ce2db88d0a2 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6fe12df0c64e3290ad9f967ec4be08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9d027b854d416799fd428b1eca0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:20.021339 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a6fbe-1f81-4528-805a-8ce2db88d0a2 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:20.021680 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a6fbe-1f81-4528-805a-8ce2db88d0a2 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:20.022440 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a6fbe-1f81-4528-805a-8ce2db88d0a2 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] PATH_INFO: `/v3/projects/faf537a2aa274e7e92fb1998c7dd1b86` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:20.023692 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125a6fbe-1f81-4528-805a-8ce2db88d0a2 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] RBAC: Authorizing `identity:get_project(project_id=faf537a2aa274e7e92fb1998c7dd1b86)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:20.026409 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125a6fbe-1f81-4528-805a-8ce2db88d0a2 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:20.028834 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 987/1959] 10.222.0.83 () {58 vars in 1443 bytes} [Mon Aug 29 15:38:19 2022] GET /identity/v3/projects/faf537a2aa274e7e92fb1998c7dd1b86 => generated 369 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:38:20.089144 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99683cb3-dbe2-467f-b3f2-e462d798b721 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:20.091560 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-99683cb3-dbe2-467f-b3f2-e462d798b721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:20.114777 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99683cb3-dbe2-467f-b3f2-e462d798b721 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:20.122172 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b99ff-1a68-4a4f-8112-ae21a1f5aff7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:20.122789 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b99ff-1a68-4a4f-8112-ae21a1f5aff7 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:20.123089 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b99ff-1a68-4a4f-8112-ae21a1f5aff7 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:20.123363 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b99ff-1a68-4a4f-8112-ae21a1f5aff7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:20.191704 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:20.210997 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1b99ff-1a68-4a4f-8112-ae21a1f5aff7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:20.212883 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1b99ff-1a68-4a4f-8112-ae21a1f5aff7 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:20.226453 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 973/1960] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:20 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:38:20.261253 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03410e2-e7e4-45d0-96ee-7998858f5315 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:20.261869 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03410e2-e7e4-45d0-96ee-7998858f5315 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:20.262357 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03410e2-e7e4-45d0-96ee-7998858f5315 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:20.265430 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 988/1961] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 15:38:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:38:20.270280 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b99ff-1a68-4a4f-8112-ae21a1f5aff7 service nova] Authenticating service token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:38:20.285449 n-d-836830-13 devstack@keystone.service[82149]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b99ff-1a68-4a4f-8112-ae21a1f5aff7 service nova] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Aug 29 15:38:20.285449 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b99ff-1a68-4a4f-8112-ae21a1f5aff7 service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:20.298691 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b99ff-1a68-4a4f-8112-ae21a1f5aff7 service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:20.305011 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d90d3b-7576-4964-ad73-a340bac6433e tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6fe12df0c64e3290ad9f967ec4be08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9d027b854d416799fd428b1eca0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:20.305692 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d90d3b-7576-4964-ad73-a340bac6433e tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:20.305949 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d90d3b-7576-4964-ad73-a340bac6433e tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:20.306226 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d90d3b-7576-4964-ad73-a340bac6433e tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] PATH_INFO: `/v3/projects/faf537a2aa274e7e92fb1998c7dd1b86` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:20.307801 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d90d3b-7576-4964-ad73-a340bac6433e tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] RBAC: Authorizing `identity:get_project(project_id=faf537a2aa274e7e92fb1998c7dd1b86)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:20.309869 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d90d3b-7576-4964-ad73-a340bac6433e tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:20.312164 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 974/1962] 10.222.0.83 () {58 vars in 1443 bytes} [Mon Aug 29 15:38:20 2022] GET /identity/v3/projects/faf537a2aa274e7e92fb1998c7dd1b86 => generated 369 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:38:20.370722 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03410e2-e7e4-45d0-96ee-7998858f5315 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:20.379605 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d90d3b-7576-4964-ad73-a340bac6433e tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:20.405129 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03410e2-e7e4-45d0-96ee-7998858f5315 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:20.417288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a12fac-f63f-4c86-972b-bc39d5ae4314 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6fe12df0c64e3290ad9f967ec4be08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9d027b854d416799fd428b1eca0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:20.418004 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a12fac-f63f-4c86-972b-bc39d5ae4314 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:20.418377 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a12fac-f63f-4c86-972b-bc39d5ae4314 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:20.418548 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a12fac-f63f-4c86-972b-bc39d5ae4314 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:20.420540 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a12fac-f63f-4c86-972b-bc39d5ae4314 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:38:20.420870 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a12fac-f63f-4c86-972b-bc39d5ae4314 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:20.422513 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a12fac-f63f-4c86-972b-bc39d5ae4314 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:20.451375 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 989/1963] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:38:20.456037 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a12fac-f63f-4c86-972b-bc39d5ae4314 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:20.472066 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a12fac-f63f-4c86-972b-bc39d5ae4314 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:20.478803 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cbdfcc-4b42-4122-8e0e-8e756026ccb9 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6fe12df0c64e3290ad9f967ec4be08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9d027b854d416799fd428b1eca0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:20.479581 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbdfcc-4b42-4122-8e0e-8e756026ccb9 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:20.479958 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbdfcc-4b42-4122-8e0e-8e756026ccb9 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:20.480350 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbdfcc-4b42-4122-8e0e-8e756026ccb9 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:20.481097 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cbdfcc-4b42-4122-8e0e-8e756026ccb9 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:20.483399 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cbdfcc-4b42-4122-8e0e-8e756026ccb9 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:20.492794 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d90d3b-7576-4964-ad73-a340bac6433e tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:20.505800 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9de4c0-df26-483e-8196-890303b83282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:20.508704 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9de4c0-df26-483e-8196-890303b83282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:20.512346 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9de4c0-df26-483e-8196-890303b83282 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:20.516592 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9de4c0-df26-483e-8196-890303b83282 admin admin] PATH_INFO: `/v3/users/593ea2cd4b8d4b5084bcb20e951bf615` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:20.524458 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9de4c0-df26-483e-8196-890303b83282 admin admin] RBAC: Authorizing `identity:delete_user(user_id=593ea2cd4b8d4b5084bcb20e951bf615)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:20.531067 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 990/1964] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:38:20 2022] POST /identity/v3/users => generated 381 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:20.535190 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cbdfcc-4b42-4122-8e0e-8e756026ccb9 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:20.536266 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9de4c0-df26-483e-8196-890303b83282 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:20.548465 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cbdfcc-4b42-4122-8e0e-8e756026ccb9 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:20.555412 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d920d9e-5dd0-4572-a48f-b4450f308133 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6fe12df0c64e3290ad9f967ec4be08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9d027b854d416799fd428b1eca0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:20.556410 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d920d9e-5dd0-4572-a48f-b4450f308133 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:20.557008 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d920d9e-5dd0-4572-a48f-b4450f308133 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:20.557432 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d920d9e-5dd0-4572-a48f-b4450f308133 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:20.558536 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d920d9e-5dd0-4572-a48f-b4450f308133 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:38:20.559069 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d920d9e-5dd0-4572-a48f-b4450f308133 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:20.561532 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d920d9e-5dd0-4572-a48f-b4450f308133 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:20.588114 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 991/1965] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:38:20.614394 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6b9de4c0-df26-483e-8196-890303b83282 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '593ea2cd4b8d4b5084bcb20e951bf615'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:20.615314 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6b9de4c0-df26-483e-8196-890303b83282 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '593ea2cd4b8d4b5084bcb20e951bf615'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:20.625416 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6b9de4c0-df26-483e-8196-890303b83282 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '593ea2cd4b8d4b5084bcb20e951bf615'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:20.648000 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04639d49-d293-4013-8955-3750320aa2fe None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:20.648531 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04639d49-d293-4013-8955-3750320aa2fe None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:20.648531 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04639d49-d293-4013-8955-3750320aa2fe None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:20.650307 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 992/1966] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 15:38:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:38:20.663738 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04639d49-d293-4013-8955-3750320aa2fe None None] Authenticating service token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:38:20.663947 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6b9de4c0-df26-483e-8196-890303b83282 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '593ea2cd4b8d4b5084bcb20e951bf615'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:20.666002 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6b9de4c0-df26-483e-8196-890303b83282 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '593ea2cd4b8d4b5084bcb20e951bf615'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:20.681836 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04639d49-d293-4013-8955-3750320aa2fe None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:20.691670 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 975/1967] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:38:20 2022] DELETE /identity/v3/users/593ea2cd4b8d4b5084bcb20e951bf615 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:38:20.692210 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04639d49-d293-4013-8955-3750320aa2fe None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:20.696329 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f733879-7e39-4d9f-b988-dc29ba3e7433 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:20.696761 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f733879-7e39-4d9f-b988-dc29ba3e7433 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:20.697049 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f733879-7e39-4d9f-b988-dc29ba3e7433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:20.723421 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-8f733879-7e39-4d9f-b988-dc29ba3e7433 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:20.725396 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:20.725611 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8f733879-7e39-4d9f-b988-dc29ba3e7433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:20.791920 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfcfef3-eadb-437c-857a-438dd26caede tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6fe12df0c64e3290ad9f967ec4be08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9d027b854d416799fd428b1eca0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:20.792576 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfcfef3-eadb-437c-857a-438dd26caede tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:20.792873 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfcfef3-eadb-437c-857a-438dd26caede tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:20.792988 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:20.793131 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfcfef3-eadb-437c-857a-438dd26caede tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] PATH_INFO: `/v3/projects/faf537a2aa274e7e92fb1998c7dd1b86` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:20.794519 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfcfef3-eadb-437c-857a-438dd26caede tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] RBAC: Authorizing `identity:get_project(project_id=faf537a2aa274e7e92fb1998c7dd1b86)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:20.796754 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfcfef3-eadb-437c-857a-438dd26caede tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:20.798469 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 993/1968] 10.222.0.83 () {58 vars in 1443 bytes} [Mon Aug 29 15:38:20 2022] GET /identity/v3/projects/faf537a2aa274e7e92fb1998c7dd1b86 => generated 369 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:38:20.812844 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 976/1969] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:38:20.823911 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfcfef3-eadb-437c-857a-438dd26caede tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:20.826095 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ddfcfef3-eadb-437c-857a-438dd26caede tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:20.939422 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfcfef3-eadb-437c-857a-438dd26caede tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:20.945835 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b001dbc-ae7f-4ea1-ba39-ff9c049f64e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:20.946482 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b001dbc-ae7f-4ea1-ba39-ff9c049f64e3 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:20.946874 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b001dbc-ae7f-4ea1-ba39-ff9c049f64e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:20.947232 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b001dbc-ae7f-4ea1-ba39-ff9c049f64e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:20.958180 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b001dbc-ae7f-4ea1-ba39-ff9c049f64e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:20.960942 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b001dbc-ae7f-4ea1-ba39-ff9c049f64e3 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:20.981124 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 994/1970] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:38:20.986475 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b9ae7-3614-4e1d-b380-461bc26e5168 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:20.986981 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b9ae7-3614-4e1d-b380-461bc26e5168 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:20.987096 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b9ae7-3614-4e1d-b380-461bc26e5168 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:20.988751 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 977/1971] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 15:38:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:38:20.994022 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b001dbc-ae7f-4ea1-ba39-ff9c049f64e3 service neutron] Authenticating service token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:38:20.995810 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5b001dbc-ae7f-4ea1-ba39-ff9c049f64e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:21.098298 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b001dbc-ae7f-4ea1-ba39-ff9c049f64e3 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:21.101253 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5b001dbc-ae7f-4ea1-ba39-ff9c049f64e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:21.126480 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b001dbc-ae7f-4ea1-ba39-ff9c049f64e3 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:21.131639 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309b66d-e00d-43a6-b33a-de2805d493a9 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6fe12df0c64e3290ad9f967ec4be08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9d027b854d416799fd428b1eca0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:21.132379 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309b66d-e00d-43a6-b33a-de2805d493a9 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:21.132785 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309b66d-e00d-43a6-b33a-de2805d493a9 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:21.133080 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309b66d-e00d-43a6-b33a-de2805d493a9 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] PATH_INFO: `/v3/projects/faf537a2aa274e7e92fb1998c7dd1b86` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:21.134352 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d309b66d-e00d-43a6-b33a-de2805d493a9 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] RBAC: Authorizing `identity:get_project(project_id=faf537a2aa274e7e92fb1998c7dd1b86)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:21.136573 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d309b66d-e00d-43a6-b33a-de2805d493a9 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:21.138341 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 995/1972] 10.222.0.83 () {58 vars in 1443 bytes} [Mon Aug 29 15:38:20 2022] GET /identity/v3/projects/faf537a2aa274e7e92fb1998c7dd1b86 => generated 369 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:38:21.169877 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b9ae7-3614-4e1d-b380-461bc26e5168 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:21.189742 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b9ae7-3614-4e1d-b380-461bc26e5168 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:21.195722 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acde42f-d3f3-417a-9013-80d3d9153ef2 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6fe12df0c64e3290ad9f967ec4be08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9d027b854d416799fd428b1eca0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:21.196380 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acde42f-d3f3-417a-9013-80d3d9153ef2 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:21.196661 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acde42f-d3f3-417a-9013-80d3d9153ef2 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:21.196945 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acde42f-d3f3-417a-9013-80d3d9153ef2 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] PATH_INFO: `/v3/users/4ab9ee1e8d19433ebf9cb952ac4961a9` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:21.212054 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acde42f-d3f3-417a-9013-80d3d9153ef2 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] RBAC: Authorizing `identity:delete_user(user_id=4ab9ee1e8d19433ebf9cb952ac4961a9)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:21.213923 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acde42f-d3f3-417a-9013-80d3d9153ef2 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:21.263964 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2acde42f-d3f3-417a-9013-80d3d9153ef2 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ab9ee1e8d19433ebf9cb952ac4961a9'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:21.264878 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2acde42f-d3f3-417a-9013-80d3d9153ef2 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ab9ee1e8d19433ebf9cb952ac4961a9'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:21.273499 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2acde42f-d3f3-417a-9013-80d3d9153ef2 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ab9ee1e8d19433ebf9cb952ac4961a9'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:21.280821 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2acde42f-d3f3-417a-9013-80d3d9153ef2 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ab9ee1e8d19433ebf9cb952ac4961a9'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:21.281496 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2acde42f-d3f3-417a-9013-80d3d9153ef2 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ab9ee1e8d19433ebf9cb952ac4961a9'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:21.309651 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 978/1973] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:38:21 2022] DELETE /identity/v3/users/4ab9ee1e8d19433ebf9cb952ac4961a9 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:21.314204 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309b66d-e00d-43a6-b33a-de2805d493a9 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:21.316215 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d309b66d-e00d-43a6-b33a-de2805d493a9 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:21.325618 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acde42f-d3f3-417a-9013-80d3d9153ef2 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:21.330117 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2acde42f-d3f3-417a-9013-80d3d9153ef2 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:21.331642 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309b66d-e00d-43a6-b33a-de2805d493a9 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:21.405101 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:21.414338 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910725a0-b928-4d3e-9200-e3844de763da tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6fe12df0c64e3290ad9f967ec4be08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9d027b854d416799fd428b1eca0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:21.415260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910725a0-b928-4d3e-9200-e3844de763da tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:21.415625 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910725a0-b928-4d3e-9200-e3844de763da tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:21.415979 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910725a0-b928-4d3e-9200-e3844de763da tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] PATH_INFO: `/v3/projects/faf537a2aa274e7e92fb1998c7dd1b86` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:21.417218 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910725a0-b928-4d3e-9200-e3844de763da tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] RBAC: Authorizing `identity:delete_project(project_id=faf537a2aa274e7e92fb1998c7dd1b86)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:21.419480 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acde42f-d3f3-417a-9013-80d3d9153ef2 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:21.419994 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910725a0-b928-4d3e-9200-e3844de763da tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:21.424308 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee119835-d45e-4ff5-9eae-8717d4c8d1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:21.424945 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee119835-d45e-4ff5-9eae-8717d4c8d1ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:21.425225 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee119835-d45e-4ff5-9eae-8717d4c8d1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:21.425499 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee119835-d45e-4ff5-9eae-8717d4c8d1ab admin admin] PATH_INFO: `/v3/projects/70ff79163aa94ae087ed678244cc7123` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:21.426625 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee119835-d45e-4ff5-9eae-8717d4c8d1ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=70ff79163aa94ae087ed678244cc7123)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:21.429009 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee119835-d45e-4ff5-9eae-8717d4c8d1ab admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:21.476379 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-910725a0-b928-4d3e-9200-e3844de763da tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faf537a2aa274e7e92fb1998c7dd1b86', 'request_id': 'req-910725a0-b928-4d3e-9200-e3844de763da'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:21.483670 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-910725a0-b928-4d3e-9200-e3844de763da tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faf537a2aa274e7e92fb1998c7dd1b86', 'request_id': 'req-910725a0-b928-4d3e-9200-e3844de763da'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:21.492728 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-910725a0-b928-4d3e-9200-e3844de763da tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faf537a2aa274e7e92fb1998c7dd1b86', 'request_id': 'req-910725a0-b928-4d3e-9200-e3844de763da'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:21.496026 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ee119835-d45e-4ff5-9eae-8717d4c8d1ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70ff79163aa94ae087ed678244cc7123', 'request_id': 'req-ee119835-d45e-4ff5-9eae-8717d4c8d1ab'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:21.506174 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-910725a0-b928-4d3e-9200-e3844de763da tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] The token cache is being invalidate because project faf537a2aa274e7e92fb1998c7dd1b86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:38:21.506595 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-910725a0-b928-4d3e-9200-e3844de763da tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:21.508188 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-910725a0-b928-4d3e-9200-e3844de763da tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:21.510181 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:21.510425 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 996/1974] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:38:21 2022] DELETE /identity/v3/projects/faf537a2aa274e7e92fb1998c7dd1b86 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:21.516123 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ee119835-d45e-4ff5-9eae-8717d4c8d1ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70ff79163aa94ae087ed678244cc7123', 'request_id': 'req-ee119835-d45e-4ff5-9eae-8717d4c8d1ab'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:21.516738 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910725a0-b928-4d3e-9200-e3844de763da tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:21.518245 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-910725a0-b928-4d3e-9200-e3844de763da tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:21.526624 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ee119835-d45e-4ff5-9eae-8717d4c8d1ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70ff79163aa94ae087ed678244cc7123', 'request_id': 'req-ee119835-d45e-4ff5-9eae-8717d4c8d1ab'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:21.549713 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ee119835-d45e-4ff5-9eae-8717d4c8d1ab admin admin] The token cache is being invalidate because project 70ff79163aa94ae087ed678244cc7123 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:38:21.549713 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ee119835-d45e-4ff5-9eae-8717d4c8d1ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:21.550613 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ee119835-d45e-4ff5-9eae-8717d4c8d1ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:21.554015 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 979/1975] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:38:21 2022] DELETE /identity/v3/projects/70ff79163aa94ae087ed678244cc7123 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:38:21.558066 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee119835-d45e-4ff5-9eae-8717d4c8d1ab admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:21.562267 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ee119835-d45e-4ff5-9eae-8717d4c8d1ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:21.603709 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910725a0-b928-4d3e-9200-e3844de763da tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:21.642756 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee119835-d45e-4ff5-9eae-8717d4c8d1ab admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:21.652113 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7692d-cdfd-4698-9b52-ec3843b05ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:21.653146 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7692d-cdfd-4698-9b52-ec3843b05ddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:21.653285 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7692d-cdfd-4698-9b52-ec3843b05ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:21.653630 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7692d-cdfd-4698-9b52-ec3843b05ddc admin admin] PATH_INFO: `/v3/users/77dfc1ab0428420fa02966697c1400d8` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:21.654983 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c7692d-cdfd-4698-9b52-ec3843b05ddc admin admin] RBAC: Authorizing `identity:delete_user(user_id=77dfc1ab0428420fa02966697c1400d8)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:21.657212 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c7692d-cdfd-4698-9b52-ec3843b05ddc admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:21.712457 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583b2bb-e8b8-4757-9cc6-1484e9f55b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:21.713128 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583b2bb-e8b8-4757-9cc6-1484e9f55b49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:21.717279 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583b2bb-e8b8-4757-9cc6-1484e9f55b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:21.717608 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583b2bb-e8b8-4757-9cc6-1484e9f55b49 admin admin] PATH_INFO: `/v3/users/c0fc1ed3b042422faaa12d3876787ae4` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:21.723189 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5583b2bb-e8b8-4757-9cc6-1484e9f55b49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0fc1ed3b042422faaa12d3876787ae4)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:21.728177 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5583b2bb-e8b8-4757-9cc6-1484e9f55b49 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:21.779534 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c6c7692d-cdfd-4698-9b52-ec3843b05ddc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77dfc1ab0428420fa02966697c1400d8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:21.780638 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c6c7692d-cdfd-4698-9b52-ec3843b05ddc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77dfc1ab0428420fa02966697c1400d8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:21.801013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:21.804407 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c6c7692d-cdfd-4698-9b52-ec3843b05ddc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77dfc1ab0428420fa02966697c1400d8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:21.819074 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c6c7692d-cdfd-4698-9b52-ec3843b05ddc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77dfc1ab0428420fa02966697c1400d8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:21.821327 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c6c7692d-cdfd-4698-9b52-ec3843b05ddc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77dfc1ab0428420fa02966697c1400d8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:21.829674 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5583b2bb-e8b8-4757-9cc6-1484e9f55b49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0fc1ed3b042422faaa12d3876787ae4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:21.830358 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5583b2bb-e8b8-4757-9cc6-1484e9f55b49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0fc1ed3b042422faaa12d3876787ae4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:21.857107 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5583b2bb-e8b8-4757-9cc6-1484e9f55b49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0fc1ed3b042422faaa12d3876787ae4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:21.867419 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 980/1976] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:38:21 2022] DELETE /identity/v3/users/77dfc1ab0428420fa02966697c1400d8 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:38:21.879403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5583b2bb-e8b8-4757-9cc6-1484e9f55b49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0fc1ed3b042422faaa12d3876787ae4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:21.890823 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5583b2bb-e8b8-4757-9cc6-1484e9f55b49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0fc1ed3b042422faaa12d3876787ae4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:21.900667 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 997/1977] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:38:21 2022] DELETE /identity/v3/users/c0fc1ed3b042422faaa12d3876787ae4 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:21.907774 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff713221-80c5-4cba-87b2-60f0d7290d52 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:21.907774 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff713221-80c5-4cba-87b2-60f0d7290d52 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:21.907774 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff713221-80c5-4cba-87b2-60f0d7290d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:21.927604 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-ff713221-80c5-4cba-87b2-60f0d7290d52 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:21.928823 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ff713221-80c5-4cba-87b2-60f0d7290d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:22.013177 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 981/1978] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:22.033077 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583b2bb-e8b8-4757-9cc6-1484e9f55b49 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:22.040113 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5583b2bb-e8b8-4757-9cc6-1484e9f55b49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:22.122969 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583b2bb-e8b8-4757-9cc6-1484e9f55b49 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:22.128011 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1745af-3752-448d-a973-07504c290440 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:22.128665 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1745af-3752-448d-a973-07504c290440 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:22.129062 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1745af-3752-448d-a973-07504c290440 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:22.129293 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1745af-3752-448d-a973-07504c290440 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:22.141989 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1745af-3752-448d-a973-07504c290440 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:22.142817 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1745af-3752-448d-a973-07504c290440 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:22.155365 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 998/1979] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:38:22.909895 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff713221-80c5-4cba-87b2-60f0d7290d52 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:22.912808 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ff713221-80c5-4cba-87b2-60f0d7290d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:22.922912 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:22.948991 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff713221-80c5-4cba-87b2-60f0d7290d52 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:22.968710 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9268a-4a61-46d5-8cbf-1a106f1363de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:22.969468 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9268a-4a61-46d5-8cbf-1a106f1363de admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:22.970676 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9268a-4a61-46d5-8cbf-1a106f1363de admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:22.970676 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9268a-4a61-46d5-8cbf-1a106f1363de admin admin] PATH_INFO: `/v3/projects/33ff2fb111bd450b9c2817f4a523a18c` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:22.971849 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a9268a-4a61-46d5-8cbf-1a106f1363de admin admin] RBAC: Authorizing `identity:delete_project(project_id=33ff2fb111bd450b9c2817f4a523a18c)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:22.974092 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a9268a-4a61-46d5-8cbf-1a106f1363de admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:23.062826 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-02a9268a-4a61-46d5-8cbf-1a106f1363de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33ff2fb111bd450b9c2817f4a523a18c', 'request_id': 'req-02a9268a-4a61-46d5-8cbf-1a106f1363de'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:23.078900 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-02a9268a-4a61-46d5-8cbf-1a106f1363de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33ff2fb111bd450b9c2817f4a523a18c', 'request_id': 'req-02a9268a-4a61-46d5-8cbf-1a106f1363de'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:23.089406 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-02a9268a-4a61-46d5-8cbf-1a106f1363de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33ff2fb111bd450b9c2817f4a523a18c', 'request_id': 'req-02a9268a-4a61-46d5-8cbf-1a106f1363de'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:23.110450 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-02a9268a-4a61-46d5-8cbf-1a106f1363de admin admin] The token cache is being invalidate because project 33ff2fb111bd450b9c2817f4a523a18c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:38:23.110759 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-02a9268a-4a61-46d5-8cbf-1a106f1363de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:23.111481 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-02a9268a-4a61-46d5-8cbf-1a106f1363de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:23.113046 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 982/1980] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:38:22 2022] DELETE /identity/v3/projects/33ff2fb111bd450b9c2817f4a523a18c => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:23.118635 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5cc74-d6cf-42cd-b329-e424fc07691a None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:23.119172 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5cc74-d6cf-42cd-b329-e424fc07691a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:23.119324 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5cc74-d6cf-42cd-b329-e424fc07691a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:23.139147 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f75905-09fc-4afd-a663-1e47592f7276 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:23.139655 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f75905-09fc-4afd-a663-1e47592f7276 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:23.139915 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f75905-09fc-4afd-a663-1e47592f7276 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:23.141286 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 983/1981] 10.222.0.83 () {54 vars in 921 bytes} [Mon Aug 29 15:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:38:23.146789 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0fabd-b241-494c-a44a-7f823a332c2f None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:23.147051 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0fabd-b241-494c-a44a-7f823a332c2f None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:23.147315 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0fabd-b241-494c-a44a-7f823a332c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:23.148589 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-b5c5cc74-d6cf-42cd-b329-e424fc07691a None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:23.150070 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b5c5cc74-d6cf-42cd-b329-e424fc07691a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:23.172454 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-37d0fabd-b241-494c-a44a-7f823a332c2f None None] MFA Rules not processed for user `253947a5ef294d2bb828761873251bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:23.173897 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-37d0fabd-b241-494c-a44a-7f823a332c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:23.236456 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 999/1982] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:23.237419 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5cc74-d6cf-42cd-b329-e424fc07691a None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:23.238813 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b5c5cc74-d6cf-42cd-b329-e424fc07691a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:23.251071 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5cc74-d6cf-42cd-b329-e424fc07691a None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:23.256802 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c7f67-bd85-4553-8ac7-ed9e56b94547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:23.257437 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c7f67-bd85-4553-8ac7-ed9e56b94547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:23.257717 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c7f67-bd85-4553-8ac7-ed9e56b94547 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:23.257990 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c7f67-bd85-4553-8ac7-ed9e56b94547 admin admin] PATH_INFO: `/v3/projects/1fbf5987755b48d4a7ab9158be9dc1a7` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:23.259178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101c7f67-bd85-4553-8ac7-ed9e56b94547 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fbf5987755b48d4a7ab9158be9dc1a7)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:23.261131 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101c7f67-bd85-4553-8ac7-ed9e56b94547 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:23.264772 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 984/1983] 10.222.0.83 () {58 vars in 1018 bytes} [Mon Aug 29 15:38:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:38:23.266157 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a41300-c04d-4323-bbe6-8d5561864975 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:23.266464 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a41300-c04d-4323-bbe6-8d5561864975 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:23.266762 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a41300-c04d-4323-bbe6-8d5561864975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:23.288627 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-f2a41300-c04d-4323-bbe6-8d5561864975 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:23.289818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f2a41300-c04d-4323-bbe6-8d5561864975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:23.298459 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 985/1984] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:23.299413 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a41300-c04d-4323-bbe6-8d5561864975 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:23.300607 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f2a41300-c04d-4323-bbe6-8d5561864975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:23.310840 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-101c7f67-bd85-4553-8ac7-ed9e56b94547 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fbf5987755b48d4a7ab9158be9dc1a7', 'request_id': 'req-101c7f67-bd85-4553-8ac7-ed9e56b94547'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:23.312190 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:23.317016 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a41300-c04d-4323-bbe6-8d5561864975 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:23.317737 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-101c7f67-bd85-4553-8ac7-ed9e56b94547 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fbf5987755b48d4a7ab9158be9dc1a7', 'request_id': 'req-101c7f67-bd85-4553-8ac7-ed9e56b94547'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:23.327401 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-101c7f67-bd85-4553-8ac7-ed9e56b94547 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fbf5987755b48d4a7ab9158be9dc1a7', 'request_id': 'req-101c7f67-bd85-4553-8ac7-ed9e56b94547'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:23.345945 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-101c7f67-bd85-4553-8ac7-ed9e56b94547 admin admin] The token cache is being invalidate because project 1fbf5987755b48d4a7ab9158be9dc1a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:38:23.346390 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-101c7f67-bd85-4553-8ac7-ed9e56b94547 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:23.347262 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-101c7f67-bd85-4553-8ac7-ed9e56b94547 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:23.349730 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1000/1985] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:38:23 2022] DELETE /identity/v3/projects/1fbf5987755b48d4a7ab9158be9dc1a7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:23.350614 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c7f67-bd85-4553-8ac7-ed9e56b94547 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:23.352175 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-101c7f67-bd85-4553-8ac7-ed9e56b94547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:23.391170 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c422b-5000-42b0-9747-280132cc1dd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:23.391788 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c422b-5000-42b0-9747-280132cc1dd3 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:23.392072 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c422b-5000-42b0-9747-280132cc1dd3 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:23.392345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c422b-5000-42b0-9747-280132cc1dd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:23.394108 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-089c422b-5000-42b0-9747-280132cc1dd3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:23.404646 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:23.409345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c422b-5000-42b0-9747-280132cc1dd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:23.411957 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c422b-5000-42b0-9747-280132cc1dd3 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:23.429065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c7f67-bd85-4553-8ac7-ed9e56b94547 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:23.434010 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856386b2-babc-4942-b69a-281d7c6be29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:23.434711 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856386b2-babc-4942-b69a-281d7c6be29b admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:23.434821 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 986/1986] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:38:23.434993 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856386b2-babc-4942-b69a-281d7c6be29b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:23.435339 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856386b2-babc-4942-b69a-281d7c6be29b admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:23.436428 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856386b2-babc-4942-b69a-281d7c6be29b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:38:23.436736 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856386b2-babc-4942-b69a-281d7c6be29b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:23.438510 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c422b-5000-42b0-9747-280132cc1dd3 service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:23.438623 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856386b2-babc-4942-b69a-281d7c6be29b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:23.444478 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-089c422b-5000-42b0-9747-280132cc1dd3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:23.458321 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1001/1987] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:38:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:38:23.463805 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856386b2-babc-4942-b69a-281d7c6be29b admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:23.467852 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c422b-5000-42b0-9747-280132cc1dd3 service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:23.475594 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856386b2-babc-4942-b69a-281d7c6be29b admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:23.478236 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9757ad3-ed91-47ac-b539-bde9e5e2987b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:23.479084 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9757ad3-ed91-47ac-b539-bde9e5e2987b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:23.479365 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9757ad3-ed91-47ac-b539-bde9e5e2987b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:23.479806 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9757ad3-ed91-47ac-b539-bde9e5e2987b admin admin] PATH_INFO: `/v3/users/9f6fe12df0c64e3290ad9f967ec4be08` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:23.481867 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba4e25-4b80-4e0b-81f1-e2f4a1ec117c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:23.482474 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba4e25-4b80-4e0b-81f1-e2f4a1ec117c admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:23.482752 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba4e25-4b80-4e0b-81f1-e2f4a1ec117c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:23.483041 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba4e25-4b80-4e0b-81f1-e2f4a1ec117c admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:23.483370 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9757ad3-ed91-47ac-b539-bde9e5e2987b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f6fe12df0c64e3290ad9f967ec4be08)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:23.483699 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eba4e25-4b80-4e0b-81f1-e2f4a1ec117c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:23.485613 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eba4e25-4b80-4e0b-81f1-e2f4a1ec117c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:23.487725 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9757ad3-ed91-47ac-b539-bde9e5e2987b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:23.525111 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1002/1988] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:38:23 2022] POST /identity/v3/projects => generated 395 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:23.529179 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba4e25-4b80-4e0b-81f1-e2f4a1ec117c admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:23.564180 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e9757ad3-ed91-47ac-b539-bde9e5e2987b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f6fe12df0c64e3290ad9f967ec4be08'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:23.564856 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e9757ad3-ed91-47ac-b539-bde9e5e2987b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f6fe12df0c64e3290ad9f967ec4be08'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:23.574443 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e9757ad3-ed91-47ac-b539-bde9e5e2987b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f6fe12df0c64e3290ad9f967ec4be08'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:23.582481 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e9757ad3-ed91-47ac-b539-bde9e5e2987b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f6fe12df0c64e3290ad9f967ec4be08'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:23.583258 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e9757ad3-ed91-47ac-b539-bde9e5e2987b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f6fe12df0c64e3290ad9f967ec4be08'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:23.607706 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 987/1989] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:38:23 2022] DELETE /identity/v3/users/9f6fe12df0c64e3290ad9f967ec4be08 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:23.636868 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba4e25-4b80-4e0b-81f1-e2f4a1ec117c admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:23.729974 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:23.743311 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954695ea-55bb-4e2a-bd97-741c4225f716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:23.744381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954695ea-55bb-4e2a-bd97-741c4225f716 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:23.744882 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954695ea-55bb-4e2a-bd97-741c4225f716 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:23.746375 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954695ea-55bb-4e2a-bd97-741c4225f716 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:23.750186 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954695ea-55bb-4e2a-bd97-741c4225f716 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:23.753463 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954695ea-55bb-4e2a-bd97-741c4225f716 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:23.800739 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1003/1990] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:38:23 2022] POST /identity/v3/users => generated 298 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:23.804769 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9757ad3-ed91-47ac-b539-bde9e5e2987b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:23.807320 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e9757ad3-ed91-47ac-b539-bde9e5e2987b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:23.838675 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9757ad3-ed91-47ac-b539-bde9e5e2987b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:23.855811 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157bc08-2233-43e9-996b-0c4134fedabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:23.856520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157bc08-2233-43e9-996b-0c4134fedabb admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:23.856809 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157bc08-2233-43e9-996b-0c4134fedabb admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:23.857084 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157bc08-2233-43e9-996b-0c4134fedabb admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:23.857754 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157bc08-2233-43e9-996b-0c4134fedabb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:23.859515 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157bc08-2233-43e9-996b-0c4134fedabb admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:23.884297 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 988/1991] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:23.888419 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954695ea-55bb-4e2a-bd97-741c4225f716 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:23.903744 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954695ea-55bb-4e2a-bd97-741c4225f716 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:23.911382 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2eadf6-670e-4427-80c8-30483dee6e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:23.913288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2eadf6-670e-4427-80c8-30483dee6e28 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:23.914825 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2eadf6-670e-4427-80c8-30483dee6e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:23.915151 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2eadf6-670e-4427-80c8-30483dee6e28 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:23.915916 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2eadf6-670e-4427-80c8-30483dee6e28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:23.919510 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2eadf6-670e-4427-80c8-30483dee6e28 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:23.939243 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1004/1992] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:23.941665 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157bc08-2233-43e9-996b-0c4134fedabb admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:23.967068 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157bc08-2233-43e9-996b-0c4134fedabb admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:23.975752 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41022bb8-6450-4620-8922-517abd852cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:23.977594 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41022bb8-6450-4620-8922-517abd852cb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:23.978013 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41022bb8-6450-4620-8922-517abd852cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:23.978442 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41022bb8-6450-4620-8922-517abd852cb7 admin admin] PATH_INFO: `/v3/projects/70d66d1258d14a39b174734f9865c070/users/f12698b45a114720af9c98b163077f59/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:24.007601 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41022bb8-6450-4620-8922-517abd852cb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70d66d1258d14a39b174734f9865c070, user_id=f12698b45a114720af9c98b163077f59, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:24.013579 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41022bb8-6450-4620-8922-517abd852cb7 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:24.030661 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 989/1993] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:38:23 2022] PUT /identity/v3/projects/70d66d1258d14a39b174734f9865c070/users/f12698b45a114720af9c98b163077f59/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:24.036898 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf7704-6cf0-4ebf-abf3-20d2c9cbdfd6 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:24.037254 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf7704-6cf0-4ebf-abf3-20d2c9cbdfd6 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:24.037527 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf7704-6cf0-4ebf-abf3-20d2c9cbdfd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:24.055524 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41022bb8-6450-4620-8922-517abd852cb7 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:24.057892 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-41022bb8-6450-4620-8922-517abd852cb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:24.063018 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-10bf7704-6cf0-4ebf-abf3-20d2c9cbdfd6 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:24.064425 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-10bf7704-6cf0-4ebf-abf3-20d2c9cbdfd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:24.140343 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41022bb8-6450-4620-8922-517abd852cb7 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:24.142433 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1005/1994] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:24.147224 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22fd6f-8d5a-4c3f-b64a-d2bcb62b4b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:24.147885 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22fd6f-8d5a-4c3f-b64a-d2bcb62b4b4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:24.148166 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22fd6f-8d5a-4c3f-b64a-d2bcb62b4b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:24.148439 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22fd6f-8d5a-4c3f-b64a-d2bcb62b4b4b admin admin] PATH_INFO: `/v3/projects/3e9d027b854d416799fd428b1eca0a25` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:24.149651 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea22fd6f-8d5a-4c3f-b64a-d2bcb62b4b4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e9d027b854d416799fd428b1eca0a25)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:24.151694 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea22fd6f-8d5a-4c3f-b64a-d2bcb62b4b4b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:24.153010 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf7704-6cf0-4ebf-abf3-20d2c9cbdfd6 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:24.154683 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-10bf7704-6cf0-4ebf-abf3-20d2c9cbdfd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:24.196566 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:24.219690 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ea22fd6f-8d5a-4c3f-b64a-d2bcb62b4b4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e9d027b854d416799fd428b1eca0a25', 'request_id': 'req-ea22fd6f-8d5a-4c3f-b64a-d2bcb62b4b4b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:24.227209 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ea22fd6f-8d5a-4c3f-b64a-d2bcb62b4b4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e9d027b854d416799fd428b1eca0a25', 'request_id': 'req-ea22fd6f-8d5a-4c3f-b64a-d2bcb62b4b4b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:24.234423 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ea22fd6f-8d5a-4c3f-b64a-d2bcb62b4b4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e9d027b854d416799fd428b1eca0a25', 'request_id': 'req-ea22fd6f-8d5a-4c3f-b64a-d2bcb62b4b4b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:24.259810 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf7704-6cf0-4ebf-abf3-20d2c9cbdfd6 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:24.260031 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ea22fd6f-8d5a-4c3f-b64a-d2bcb62b4b4b admin admin] The token cache is being invalidate because project 3e9d027b854d416799fd428b1eca0a25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:38:24.260250 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ea22fd6f-8d5a-4c3f-b64a-d2bcb62b4b4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:24.261213 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ea22fd6f-8d5a-4c3f-b64a-d2bcb62b4b4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:24.264119 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 990/1995] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:38:24 2022] DELETE /identity/v3/projects/3e9d027b854d416799fd428b1eca0a25 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:38:24.269852 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f1322-608b-4cbe-926b-52492b4b588c None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:24.270461 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f1322-608b-4cbe-926b-52492b4b588c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:24.270916 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f1322-608b-4cbe-926b-52492b4b588c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:24.300241 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-606f1322-608b-4cbe-926b-52492b4b588c None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:24.301527 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-606f1322-608b-4cbe-926b-52492b4b588c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:24.331463 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea3496-6721-43b5-8b57-e3a3987ac97e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:24.332343 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea3496-6721-43b5-8b57-e3a3987ac97e service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:24.332771 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea3496-6721-43b5-8b57-e3a3987ac97e service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:24.333303 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea3496-6721-43b5-8b57-e3a3987ac97e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:24.336118 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8dea3496-6721-43b5-8b57-e3a3987ac97e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:24.414879 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:24.418743 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 991/1996] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:38:24.429985 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2369ca-469c-4450-9786-a6d2dc2da6c6 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:24.430287 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2369ca-469c-4450-9786-a6d2dc2da6c6 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:24.430571 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2369ca-469c-4450-9786-a6d2dc2da6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:24.444398 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea3496-6721-43b5-8b57-e3a3987ac97e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:24.446679 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea3496-6721-43b5-8b57-e3a3987ac97e service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:24.455313 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-0b2369ca-469c-4450-9786-a6d2dc2da6c6 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:24.456511 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0b2369ca-469c-4450-9786-a6d2dc2da6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:24.461706 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1006/1997] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:38:24.467603 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 992/1998] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:24.471873 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea3496-6721-43b5-8b57-e3a3987ac97e service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:24.482034 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea3496-6721-43b5-8b57-e3a3987ac97e service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:24.486712 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdac5c1-4405-4051-a9e7-01e6a0a1026e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:24.487349 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdac5c1-4405-4051-a9e7-01e6a0a1026e admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:24.487631 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdac5c1-4405-4051-a9e7-01e6a0a1026e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:24.487905 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdac5c1-4405-4051-a9e7-01e6a0a1026e admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:24.488557 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdac5c1-4405-4051-a9e7-01e6a0a1026e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:38:24.488860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdac5c1-4405-4051-a9e7-01e6a0a1026e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:24.490501 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdac5c1-4405-4051-a9e7-01e6a0a1026e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:24.503696 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1007/1999] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:38:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:38:24.508411 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2369ca-469c-4450-9786-a6d2dc2da6c6 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:24.518668 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2369ca-469c-4450-9786-a6d2dc2da6c6 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:24.524198 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a61f54-1042-4dca-b2c8-a1afd9c1322a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:24.524816 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a61f54-1042-4dca-b2c8-a1afd9c1322a admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:24.525258 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a61f54-1042-4dca-b2c8-a1afd9c1322a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:24.525534 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a61f54-1042-4dca-b2c8-a1afd9c1322a admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:24.526178 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a61f54-1042-4dca-b2c8-a1afd9c1322a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:24.528137 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a61f54-1042-4dca-b2c8-a1afd9c1322a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:24.559796 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 993/2000] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:38:24 2022] POST /identity/v3/projects => generated 391 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:24.561127 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdac5c1-4405-4051-a9e7-01e6a0a1026e admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:24.572308 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdac5c1-4405-4051-a9e7-01e6a0a1026e admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:24.641177 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d476e8-31e0-42ef-b692-1c6b09df648c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:24.641871 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d476e8-31e0-42ef-b692-1c6b09df648c admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:24.642308 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d476e8-31e0-42ef-b692-1c6b09df648c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:24.642591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d476e8-31e0-42ef-b692-1c6b09df648c admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:24.643370 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d476e8-31e0-42ef-b692-1c6b09df648c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:24.645338 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d476e8-31e0-42ef-b692-1c6b09df648c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:24.671373 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1008/2001] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:38:24 2022] POST /identity/v3/users => generated 296 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:24.675332 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a61f54-1042-4dca-b2c8-a1afd9c1322a admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:24.686979 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a61f54-1042-4dca-b2c8-a1afd9c1322a admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:24.700280 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed52a02-f977-416e-8f52-ca2087f6922e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:24.701378 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed52a02-f977-416e-8f52-ca2087f6922e admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:24.702179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed52a02-f977-416e-8f52-ca2087f6922e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:24.702179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed52a02-f977-416e-8f52-ca2087f6922e admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:24.702786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed52a02-f977-416e-8f52-ca2087f6922e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:24.704797 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed52a02-f977-416e-8f52-ca2087f6922e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:24.718494 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 994/2002] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:24.722823 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d476e8-31e0-42ef-b692-1c6b09df648c admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:24.734485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d476e8-31e0-42ef-b692-1c6b09df648c admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:24.745721 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5aac6-42bd-4ac0-aecb-6b7184e0e0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:24.746639 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5aac6-42bd-4ac0-aecb-6b7184e0e0da admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:24.747114 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5aac6-42bd-4ac0-aecb-6b7184e0e0da admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:24.747395 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5aac6-42bd-4ac0-aecb-6b7184e0e0da admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:24.748056 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe5aac6-42bd-4ac0-aecb-6b7184e0e0da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:24.749962 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe5aac6-42bd-4ac0-aecb-6b7184e0e0da admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:24.766554 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1009/2003] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:24.770773 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed52a02-f977-416e-8f52-ca2087f6922e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:24.782014 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed52a02-f977-416e-8f52-ca2087f6922e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:24.787666 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee5a2ff-52d9-4830-92e2-4857b07765de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:24.788550 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5a2ff-52d9-4830-92e2-4857b07765de admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:24.788922 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5a2ff-52d9-4830-92e2-4857b07765de admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:24.789224 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5a2ff-52d9-4830-92e2-4857b07765de admin admin] PATH_INFO: `/v3/projects/4eb72ca72c184912903e49c3c4ece997/users/c634e1d6a7c04e06bffa147e1fc01484/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:24.806517 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee5a2ff-52d9-4830-92e2-4857b07765de admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eb72ca72c184912903e49c3c4ece997, user_id=c634e1d6a7c04e06bffa147e1fc01484, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:24.809451 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee5a2ff-52d9-4830-92e2-4857b07765de admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:24.829156 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 995/2004] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:38:24 2022] PUT /identity/v3/projects/4eb72ca72c184912903e49c3c4ece997/users/c634e1d6a7c04e06bffa147e1fc01484/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:24.842789 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092317e-5dd3-4dcd-9341-084bb21b2054 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:24.843459 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092317e-5dd3-4dcd-9341-084bb21b2054 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:24.844055 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092317e-5dd3-4dcd-9341-084bb21b2054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:24.887403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-4092317e-5dd3-4dcd-9341-084bb21b2054 None None] MFA Rules not processed for user `c634e1d6a7c04e06bffa147e1fc01484`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:24.888735 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4092317e-5dd3-4dcd-9341-084bb21b2054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:24.962127 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1010/2005] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:24 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:24.966691 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee5a2ff-52d9-4830-92e2-4857b07765de admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:25.033273 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee5a2ff-52d9-4830-92e2-4857b07765de admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:25.039331 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91adc752-03c8-4713-8bdf-8d0115854107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:25.039981 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91adc752-03c8-4713-8bdf-8d0115854107 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:25.040261 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91adc752-03c8-4713-8bdf-8d0115854107 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:25.040532 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91adc752-03c8-4713-8bdf-8d0115854107 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:25.041218 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91adc752-03c8-4713-8bdf-8d0115854107 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:25.043295 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91adc752-03c8-4713-8bdf-8d0115854107 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:25.048232 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:25.076805 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 996/2006] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:38:24 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:25.081165 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092317e-5dd3-4dcd-9341-084bb21b2054 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:25.095203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092317e-5dd3-4dcd-9341-084bb21b2054 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:25.134443 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:25.160934 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a1492-27f9-4dea-bedb-7c36b9d6d068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:25.161712 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a1492-27f9-4dea-bedb-7c36b9d6d068 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:25.162075 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a1492-27f9-4dea-bedb-7c36b9d6d068 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:25.162863 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a1492-27f9-4dea-bedb-7c36b9d6d068 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:25.163692 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a1492-27f9-4dea-bedb-7c36b9d6d068 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:25.165803 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a1492-27f9-4dea-bedb-7c36b9d6d068 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:25.197128 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1011/2007] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:38:25 2022] POST /identity/v3/users => generated 299 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:25.201385 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91adc752-03c8-4713-8bdf-8d0115854107 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:25.214624 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91adc752-03c8-4713-8bdf-8d0115854107 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:25.220044 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea8c8c-74ff-4649-be0a-a32e4e9c5683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:25.220785 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea8c8c-74ff-4649-be0a-a32e4e9c5683 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:25.221235 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea8c8c-74ff-4649-be0a-a32e4e9c5683 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:25.221651 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea8c8c-74ff-4649-be0a-a32e4e9c5683 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:25.222473 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea8c8c-74ff-4649-be0a-a32e4e9c5683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:25.224489 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea8c8c-74ff-4649-be0a-a32e4e9c5683 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:25.236535 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 997/2008] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:38:25.241181 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a1492-27f9-4dea-bedb-7c36b9d6d068 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:25.251387 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a1492-27f9-4dea-bedb-7c36b9d6d068 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:25.258123 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c8f45e-7b6b-4074-b98e-2b1ceecba0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:25.258826 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8f45e-7b6b-4074-b98e-2b1ceecba0da admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:25.259163 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8f45e-7b6b-4074-b98e-2b1ceecba0da admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:25.259982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8f45e-7b6b-4074-b98e-2b1ceecba0da admin admin] PATH_INFO: `/v3/projects/67ca0b8aee9c456ea89afedb257e1365/users/73548e01b48147a2a9b8987528ecbeb7/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:25.277491 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c8f45e-7b6b-4074-b98e-2b1ceecba0da admin admin] RBAC: Authorizing `identity:create_grant(project_id=67ca0b8aee9c456ea89afedb257e1365, user_id=73548e01b48147a2a9b8987528ecbeb7, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:25.280872 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c8f45e-7b6b-4074-b98e-2b1ceecba0da admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:25.297824 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1012/2009] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:38:25 2022] PUT /identity/v3/projects/67ca0b8aee9c456ea89afedb257e1365/users/73548e01b48147a2a9b8987528ecbeb7/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:25.300971 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea8c8c-74ff-4649-be0a-a32e4e9c5683 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:25.314948 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea8c8c-74ff-4649-be0a-a32e4e9c5683 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:25.388128 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e725a16-cdc6-4e3f-9577-12e37fd139d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:25.389022 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e725a16-cdc6-4e3f-9577-12e37fd139d9 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:25.389283 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e725a16-cdc6-4e3f-9577-12e37fd139d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:25.389780 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e725a16-cdc6-4e3f-9577-12e37fd139d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:25.390429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e725a16-cdc6-4e3f-9577-12e37fd139d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:25.392077 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e725a16-cdc6-4e3f-9577-12e37fd139d9 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:25.406030 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 998/2010] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:25.410047 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c8f45e-7b6b-4074-b98e-2b1ceecba0da admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:25.421790 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c8f45e-7b6b-4074-b98e-2b1ceecba0da admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:25.428478 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f599e94-39a1-41ee-bd69-f84fefb91728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:25.429475 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f599e94-39a1-41ee-bd69-f84fefb91728 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:25.429845 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f599e94-39a1-41ee-bd69-f84fefb91728 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:25.430185 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f599e94-39a1-41ee-bd69-f84fefb91728 admin admin] PATH_INFO: `/v3/projects/67ca0b8aee9c456ea89afedb257e1365/users/73548e01b48147a2a9b8987528ecbeb7/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:25.441134 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f599e94-39a1-41ee-bd69-f84fefb91728 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67ca0b8aee9c456ea89afedb257e1365, user_id=73548e01b48147a2a9b8987528ecbeb7, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:25.448038 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f599e94-39a1-41ee-bd69-f84fefb91728 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:25.463312 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1013/2011] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:38:25 2022] PUT /identity/v3/projects/67ca0b8aee9c456ea89afedb257e1365/users/73548e01b48147a2a9b8987528ecbeb7/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:38:25.474188 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846e484-1266-4f98-8568-ca3756dcff5c None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:25.474898 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846e484-1266-4f98-8568-ca3756dcff5c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:25.475014 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846e484-1266-4f98-8568-ca3756dcff5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:25.509730 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-8846e484-1266-4f98-8568-ca3756dcff5c None None] MFA Rules not processed for user `73548e01b48147a2a9b8987528ecbeb7`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:25.515306 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8846e484-1266-4f98-8568-ca3756dcff5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:25.636041 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 999/2012] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:25 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:25.645778 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f599e94-39a1-41ee-bd69-f84fefb91728 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:25.648866 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4f599e94-39a1-41ee-bd69-f84fefb91728 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:25.714224 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1da36-ab38-465e-b0fd-6573b495a618 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:25.714744 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1da36-ab38-465e-b0fd-6573b495a618 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:25.715152 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1da36-ab38-465e-b0fd-6573b495a618 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:25.716817 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1000/2013] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 15:38:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:38:25.730654 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee699520-7c44-4c29-86d3-2e0c24d62355 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:25.730994 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee699520-7c44-4c29-86d3-2e0c24d62355 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:25.731467 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee699520-7c44-4c29-86d3-2e0c24d62355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:25.764156 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-ee699520-7c44-4c29-86d3-2e0c24d62355 None None] MFA Rules not processed for user `c190fa4a280c41c684130e069bee99eb`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:25.766858 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ee699520-7c44-4c29-86d3-2e0c24d62355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:25.794043 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f599e94-39a1-41ee-bd69-f84fefb91728 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:25.803581 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb61c9-0524-43a8-a0fc-0e089225f354 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:25.805135 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb61c9-0524-43a8-a0fc-0e089225f354 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:25.805433 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb61c9-0524-43a8-a0fc-0e089225f354 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:25.805712 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb61c9-0524-43a8-a0fc-0e089225f354 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:25.842852 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:25.877460 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1001/2014] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 15:38:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:25.893441 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eb61c9-0524-43a8-a0fc-0e089225f354 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:25.895200 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eb61c9-0524-43a8-a0fc-0e089225f354 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:25.904353 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee699520-7c44-4c29-86d3-2e0c24d62355 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:25.906061 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ee699520-7c44-4c29-86d3-2e0c24d62355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:25.910747 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1014/2015] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:25 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:38:25.939924 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee699520-7c44-4c29-86d3-2e0c24d62355 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:25.946248 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91950436-f676-460f-80f6-8462a14d714a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:25.946893 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91950436-f676-460f-80f6-8462a14d714a service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:25.947219 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91950436-f676-460f-80f6-8462a14d714a service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:25.947483 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91950436-f676-460f-80f6-8462a14d714a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:25.957674 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91950436-f676-460f-80f6-8462a14d714a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:25.960038 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91950436-f676-460f-80f6-8462a14d714a service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:25.973242 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1002/2016] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:38:26.549093 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d77aa1-32f8-486c-98ab-d6c4e385787c None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:26.549625 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d77aa1-32f8-486c-98ab-d6c4e385787c None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:26.550629 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d77aa1-32f8-486c-98ab-d6c4e385787c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:26.594862 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-28d77aa1-32f8-486c-98ab-d6c4e385787c None None] MFA Rules not processed for user `9a84bb38f6454574897120223b8fc140`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:26.602738 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-28d77aa1-32f8-486c-98ab-d6c4e385787c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:26.656187 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:26.731932 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1015/2017] 10.222.0.78 () {58 vars in 1015 bytes} [Mon Aug 29 15:38:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:26.805070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91950436-f676-460f-80f6-8462a14d714a service placement] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:26.806169 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-91950436-f676-460f-80f6-8462a14d714a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:26.830524 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91950436-f676-460f-80f6-8462a14d714a service placement] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:26.839004 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb5640-c67e-4f4a-8d11-6ddfecfd0abd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:26.840186 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb5640-c67e-4f4a-8d11-6ddfecfd0abd service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:26.840535 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb5640-c67e-4f4a-8d11-6ddfecfd0abd service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:26.841129 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb5640-c67e-4f4a-8d11-6ddfecfd0abd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:26.888017 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb5640-c67e-4f4a-8d11-6ddfecfd0abd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:26.903048 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb5640-c67e-4f4a-8d11-6ddfecfd0abd service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:26.930545 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1003/2018] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:38:27.457918 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d77aa1-32f8-486c-98ab-d6c4e385787c None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:27.460361 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-28d77aa1-32f8-486c-98ab-d6c4e385787c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:27.497602 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d77aa1-32f8-486c-98ab-d6c4e385787c None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:27.509758 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ca460-001d-44ad-8b4a-199b0fa87993 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:27.511898 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ca460-001d-44ad-8b4a-199b0fa87993 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:27.512373 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ca460-001d-44ad-8b4a-199b0fa87993 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:27.515081 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ca460-001d-44ad-8b4a-199b0fa87993 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:27.527362 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ca460-001d-44ad-8b4a-199b0fa87993 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:27.529433 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ca460-001d-44ad-8b4a-199b0fa87993 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:27.544208 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1016/2019] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:27 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:38:30.860151 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb5640-c67e-4f4a-8d11-6ddfecfd0abd service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:30.865891 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8cdb5640-c67e-4f4a-8d11-6ddfecfd0abd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:31.001155 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb5640-c67e-4f4a-8d11-6ddfecfd0abd service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:31.016871 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24164dfb-ae2c-47f1-a5f8-fd6c77b128ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:31.018220 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24164dfb-ae2c-47f1-a5f8-fd6c77b128ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:31.018643 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24164dfb-ae2c-47f1-a5f8-fd6c77b128ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:31.019095 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24164dfb-ae2c-47f1-a5f8-fd6c77b128ab admin admin] PATH_INFO: `/v3/users/5e28d9cf20fd472fa10758ee58fca256` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:31.020510 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24164dfb-ae2c-47f1-a5f8-fd6c77b128ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e28d9cf20fd472fa10758ee58fca256)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:31.024619 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24164dfb-ae2c-47f1-a5f8-fd6c77b128ab admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:31.149788 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-24164dfb-ae2c-47f1-a5f8-fd6c77b128ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e28d9cf20fd472fa10758ee58fca256'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:31.150993 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-24164dfb-ae2c-47f1-a5f8-fd6c77b128ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e28d9cf20fd472fa10758ee58fca256'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:31.175493 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-24164dfb-ae2c-47f1-a5f8-fd6c77b128ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e28d9cf20fd472fa10758ee58fca256'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:31.184838 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-24164dfb-ae2c-47f1-a5f8-fd6c77b128ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e28d9cf20fd472fa10758ee58fca256'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:31.186658 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-24164dfb-ae2c-47f1-a5f8-fd6c77b128ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e28d9cf20fd472fa10758ee58fca256'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:31.221994 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1004/2020] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:38:30 2022] DELETE /identity/v3/users/5e28d9cf20fd472fa10758ee58fca256 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:31.224263 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8637e7c-3206-4128-9d4d-d9d239a852f4 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:31.225268 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8637e7c-3206-4128-9d4d-d9d239a852f4 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:31.225732 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8637e7c-3206-4128-9d4d-d9d239a852f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:31.291751 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-e8637e7c-3206-4128-9d4d-d9d239a852f4 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:31.293188 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e8637e7c-3206-4128-9d4d-d9d239a852f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:31.459833 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24164dfb-ae2c-47f1-a5f8-fd6c77b128ab admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:31.461044 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1017/2021] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:38:31.461834 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-24164dfb-ae2c-47f1-a5f8-fd6c77b128ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:31.542085 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:31.555742 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24164dfb-ae2c-47f1-a5f8-fd6c77b128ab admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:31.560835 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638d7cb-160e-4d2b-bac6-ad345ead85af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:31.561712 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638d7cb-160e-4d2b-bac6-ad345ead85af service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:31.562367 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638d7cb-160e-4d2b-bac6-ad345ead85af service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:31.562745 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638d7cb-160e-4d2b-bac6-ad345ead85af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:31.595835 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8638d7cb-160e-4d2b-bac6-ad345ead85af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:31.601443 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8638d7cb-160e-4d2b-bac6-ad345ead85af service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:31.618912 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1005/2022] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:38:32.257416 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8637e7c-3206-4128-9d4d-d9d239a852f4 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:32.258968 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e8637e7c-3206-4128-9d4d-d9d239a852f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:32.276449 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8637e7c-3206-4128-9d4d-d9d239a852f4 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:32.286941 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd23192-2cc9-49fa-8d48-7ea9fb010ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:32.288068 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd23192-2cc9-49fa-8d48-7ea9fb010ce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:32.288509 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd23192-2cc9-49fa-8d48-7ea9fb010ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:32.288937 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd23192-2cc9-49fa-8d48-7ea9fb010ce7 admin admin] PATH_INFO: `/v3/projects/6ee6ad6ff1354ed8a6885c43d77ae1be` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:32.291756 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd23192-2cc9-49fa-8d48-7ea9fb010ce7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ee6ad6ff1354ed8a6885c43d77ae1be)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:32.294675 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd23192-2cc9-49fa-8d48-7ea9fb010ce7 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:32.407140 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3fd23192-2cc9-49fa-8d48-7ea9fb010ce7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ee6ad6ff1354ed8a6885c43d77ae1be', 'request_id': 'req-3fd23192-2cc9-49fa-8d48-7ea9fb010ce7'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:32.415409 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3fd23192-2cc9-49fa-8d48-7ea9fb010ce7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ee6ad6ff1354ed8a6885c43d77ae1be', 'request_id': 'req-3fd23192-2cc9-49fa-8d48-7ea9fb010ce7'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:32.425555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3fd23192-2cc9-49fa-8d48-7ea9fb010ce7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ee6ad6ff1354ed8a6885c43d77ae1be', 'request_id': 'req-3fd23192-2cc9-49fa-8d48-7ea9fb010ce7'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:32.446861 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3fd23192-2cc9-49fa-8d48-7ea9fb010ce7 admin admin] The token cache is being invalidate because project 6ee6ad6ff1354ed8a6885c43d77ae1be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:38:32.447217 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3fd23192-2cc9-49fa-8d48-7ea9fb010ce7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:32.448128 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3fd23192-2cc9-49fa-8d48-7ea9fb010ce7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:32.450872 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1018/2023] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:38:32 2022] DELETE /identity/v3/projects/6ee6ad6ff1354ed8a6885c43d77ae1be => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:32.454531 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638d7cb-160e-4d2b-bac6-ad345ead85af service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:32.467799 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638d7cb-160e-4d2b-bac6-ad345ead85af service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:32.565128 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc513556-b1aa-4a4f-8c16-d096c0b204ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:32.565958 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc513556-b1aa-4a4f-8c16-d096c0b204ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:32.566427 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc513556-b1aa-4a4f-8c16-d096c0b204ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:32.567144 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc513556-b1aa-4a4f-8c16-d096c0b204ff admin admin] PATH_INFO: `/v3/users/4f5210a00e48424abc9a4f59f7984ad8` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:32.570145 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc513556-b1aa-4a4f-8c16-d096c0b204ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f5210a00e48424abc9a4f59f7984ad8)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:32.572563 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc513556-b1aa-4a4f-8c16-d096c0b204ff admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:32.689718 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-dc513556-b1aa-4a4f-8c16-d096c0b204ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f5210a00e48424abc9a4f59f7984ad8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:32.690604 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-dc513556-b1aa-4a4f-8c16-d096c0b204ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f5210a00e48424abc9a4f59f7984ad8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:32.700340 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2ce63-c305-4cce-9bc2-2d8f4278e6e4 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:32.700712 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2ce63-c305-4cce-9bc2-2d8f4278e6e4 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:32.700999 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2ce63-c305-4cce-9bc2-2d8f4278e6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:32.708293 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-dc513556-b1aa-4a4f-8c16-d096c0b204ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f5210a00e48424abc9a4f59f7984ad8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:32.721373 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-dc513556-b1aa-4a4f-8c16-d096c0b204ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f5210a00e48424abc9a4f59f7984ad8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:32.722364 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-dc513556-b1aa-4a4f-8c16-d096c0b204ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f5210a00e48424abc9a4f59f7984ad8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:32.745984 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1006/2024] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:38:32 2022] DELETE /identity/v3/users/4f5210a00e48424abc9a4f59f7984ad8 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:32.749956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-2db2ce63-c305-4cce-9bc2-2d8f4278e6e4 None None] MFA Rules not processed for user `f12698b45a114720af9c98b163077f59`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:32.751463 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2db2ce63-c305-4cce-9bc2-2d8f4278e6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:32.821128 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:32.908014 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1019/2025] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:32 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:32.913820 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc513556-b1aa-4a4f-8c16-d096c0b204ff admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:32.915279 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-dc513556-b1aa-4a4f-8c16-d096c0b204ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:33.036616 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc513556-b1aa-4a4f-8c16-d096c0b204ff admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:33.048132 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e8134-26ab-4160-8909-cfbb36f5d4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:33.049925 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e8134-26ab-4160-8909-cfbb36f5d4e1 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:33.050226 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e8134-26ab-4160-8909-cfbb36f5d4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:33.051509 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e8134-26ab-4160-8909-cfbb36f5d4e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:33.053198 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e8134-26ab-4160-8909-cfbb36f5d4e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:33.056736 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e8134-26ab-4160-8909-cfbb36f5d4e1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:33.079309 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:33.125771 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1007/2026] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:38:32 2022] POST /identity/v3/projects => generated 397 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:33.129522 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2ce63-c305-4cce-9bc2-2d8f4278e6e4 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:33.143560 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2ce63-c305-4cce-9bc2-2d8f4278e6e4 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:33.274158 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564021f-6736-469a-ad50-7acef09e626f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:33.274785 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564021f-6736-469a-ad50-7acef09e626f admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:33.275388 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564021f-6736-469a-ad50-7acef09e626f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:33.275835 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564021f-6736-469a-ad50-7acef09e626f admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:33.276613 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2564021f-6736-469a-ad50-7acef09e626f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:33.293514 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2564021f-6736-469a-ad50-7acef09e626f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:33.329377 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e8134-26ab-4160-8909-cfbb36f5d4e1 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:33.332028 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-611e8134-26ab-4160-8909-cfbb36f5d4e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:33.339679 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1020/2027] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:38:33 2022] POST /identity/v3/users => generated 305 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:33.342145 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564021f-6736-469a-ad50-7acef09e626f admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:33.379998 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564021f-6736-469a-ad50-7acef09e626f admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:33.395867 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a294d2-8993-44cc-ade2-b04ed8d981d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:33.396591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a294d2-8993-44cc-ade2-b04ed8d981d4 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:33.396862 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a294d2-8993-44cc-ade2-b04ed8d981d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:33.397132 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a294d2-8993-44cc-ade2-b04ed8d981d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:33.397775 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a294d2-8993-44cc-ade2-b04ed8d981d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:33.400818 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a294d2-8993-44cc-ade2-b04ed8d981d4 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:33.428610 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1021/2028] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:33.431090 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a294d2-8993-44cc-ade2-b04ed8d981d4 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:33.461664 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a294d2-8993-44cc-ade2-b04ed8d981d4 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:33.472840 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52874781-aba7-4a12-9f22-5ca32fc08968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:33.473766 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52874781-aba7-4a12-9f22-5ca32fc08968 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:33.474183 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52874781-aba7-4a12-9f22-5ca32fc08968 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:33.474664 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52874781-aba7-4a12-9f22-5ca32fc08968 admin admin] PATH_INFO: `/v3/projects/26f2897e6c834a6092115b0996f73672/users/bb270a356b6e45088b6bdceac76bddff/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:33.477486 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e8134-26ab-4160-8909-cfbb36f5d4e1 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:33.484407 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0bf15e-a78a-49e2-8a96-6ac0370fa943 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:33.485770 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0bf15e-a78a-49e2-8a96-6ac0370fa943 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:33.487437 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0bf15e-a78a-49e2-8a96-6ac0370fa943 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:33.487952 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0bf15e-a78a-49e2-8a96-6ac0370fa943 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:33.492035 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2d0bf15e-a78a-49e2-8a96-6ac0370fa943 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:33.503485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52874781-aba7-4a12-9f22-5ca32fc08968 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26f2897e6c834a6092115b0996f73672, user_id=bb270a356b6e45088b6bdceac76bddff, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:33.506744 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52874781-aba7-4a12-9f22-5ca32fc08968 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:33.538393 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1022/2029] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:38:33 2022] PUT /identity/v3/projects/26f2897e6c834a6092115b0996f73672/users/bb270a356b6e45088b6bdceac76bddff/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:33.539389 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52874781-aba7-4a12-9f22-5ca32fc08968 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:33.548420 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-52874781-aba7-4a12-9f22-5ca32fc08968 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:33.579068 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0bf15e-a78a-49e2-8a96-6ac0370fa943 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:33.580754 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0bf15e-a78a-49e2-8a96-6ac0370fa943 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:33.591727 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1008/2030] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:33 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:38:33.603567 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0bf15e-a78a-49e2-8a96-6ac0370fa943 service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:33.627687 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0bf15e-a78a-49e2-8a96-6ac0370fa943 service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:33.662662 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52874781-aba7-4a12-9f22-5ca32fc08968 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:33.681560 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a1ee0-be1f-468d-b30a-dc5135e3d604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:33.682220 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a1ee0-be1f-468d-b30a-dc5135e3d604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:33.682497 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a1ee0-be1f-468d-b30a-dc5135e3d604 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:33.682766 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a1ee0-be1f-468d-b30a-dc5135e3d604 admin admin] PATH_INFO: `/v3/projects/ca0de5a5e0b04a10a89e50800c0a0f28` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:33.684086 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a1ee0-be1f-468d-b30a-dc5135e3d604 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca0de5a5e0b04a10a89e50800c0a0f28)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:33.688553 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a1ee0-be1f-468d-b30a-dc5135e3d604 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:33.769748 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1cf4f-365c-4074-9e73-5f3477d2f7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:33.770848 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1cf4f-365c-4074-9e73-5f3477d2f7f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:33.771798 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1cf4f-365c-4074-9e73-5f3477d2f7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:33.775273 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1cf4f-365c-4074-9e73-5f3477d2f7f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:33.776057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af1cf4f-365c-4074-9e73-5f3477d2f7f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:33.780636 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af1cf4f-365c-4074-9e73-5f3477d2f7f1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:33.782402 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:33.802283 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1009/2031] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:33.809658 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1cf4f-365c-4074-9e73-5f3477d2f7f1 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:33.811661 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-109a1ee0-be1f-468d-b30a-dc5135e3d604 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca0de5a5e0b04a10a89e50800c0a0f28', 'request_id': 'req-109a1ee0-be1f-468d-b30a-dc5135e3d604'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:33.829221 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-109a1ee0-be1f-468d-b30a-dc5135e3d604 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca0de5a5e0b04a10a89e50800c0a0f28', 'request_id': 'req-109a1ee0-be1f-468d-b30a-dc5135e3d604'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:33.835311 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1cf4f-365c-4074-9e73-5f3477d2f7f1 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:33.850437 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-109a1ee0-be1f-468d-b30a-dc5135e3d604 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca0de5a5e0b04a10a89e50800c0a0f28', 'request_id': 'req-109a1ee0-be1f-468d-b30a-dc5135e3d604'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:33.875628 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-109a1ee0-be1f-468d-b30a-dc5135e3d604 admin admin] The token cache is being invalidate because project ca0de5a5e0b04a10a89e50800c0a0f28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:38:33.875928 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-109a1ee0-be1f-468d-b30a-dc5135e3d604 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:33.878700 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-109a1ee0-be1f-468d-b30a-dc5135e3d604 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:33.887185 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1023/2032] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:38:33 2022] DELETE /identity/v3/projects/ca0de5a5e0b04a10a89e50800c0a0f28 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:33.888611 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb10fc-ed4d-48ed-b3f2-7efaea2a79f0 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:33.888908 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb10fc-ed4d-48ed-b3f2-7efaea2a79f0 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:33.891351 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb10fc-ed4d-48ed-b3f2-7efaea2a79f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:33.902084 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:33.945239 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-97eb10fc-ed4d-48ed-b3f2-7efaea2a79f0 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:33.946912 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-97eb10fc-ed4d-48ed-b3f2-7efaea2a79f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:34.023776 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc29a8c-c25d-4cbd-9f24-d585f0cc815a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:34.024371 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc29a8c-c25d-4cbd-9f24-d585f0cc815a admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:34.027797 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc29a8c-c25d-4cbd-9f24-d585f0cc815a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:34.028101 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc29a8c-c25d-4cbd-9f24-d585f0cc815a admin admin] PATH_INFO: `/v3/projects/26f2897e6c834a6092115b0996f73672/users/bb270a356b6e45088b6bdceac76bddff/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:34.032554 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc29a8c-c25d-4cbd-9f24-d585f0cc815a admin admin] RBAC: Authorizing `identity:create_grant(project_id=26f2897e6c834a6092115b0996f73672, user_id=bb270a356b6e45088b6bdceac76bddff, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:34.039725 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc29a8c-c25d-4cbd-9f24-d585f0cc815a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:34.077987 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1010/2033] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:38:33 2022] PUT /identity/v3/projects/26f2897e6c834a6092115b0996f73672/users/bb270a356b6e45088b6bdceac76bddff/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:34.079180 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc29a8c-c25d-4cbd-9f24-d585f0cc815a admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:34.081146 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4fc29a8c-c25d-4cbd-9f24-d585f0cc815a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:34.139492 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1024/2034] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:34.141394 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868cc159-6068-4977-9582-e258209f96f3 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:34.145534 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868cc159-6068-4977-9582-e258209f96f3 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:34.145920 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868cc159-6068-4977-9582-e258209f96f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:34.189689 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-868cc159-6068-4977-9582-e258209f96f3 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:34.197599 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-868cc159-6068-4977-9582-e258209f96f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:34.274778 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc29a8c-c25d-4cbd-9f24-d585f0cc815a admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:34.280677 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1025/2035] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:34.281782 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868cc159-6068-4977-9582-e258209f96f3 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:34.291779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264eed2-1f26-44b6-bfbf-700263ddeebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:34.292511 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264eed2-1f26-44b6-bfbf-700263ddeebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:34.293715 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868cc159-6068-4977-9582-e258209f96f3 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:34.293831 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264eed2-1f26-44b6-bfbf-700263ddeebf admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:34.294150 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264eed2-1f26-44b6-bfbf-700263ddeebf admin admin] PATH_INFO: `/v3/users/c634e1d6a7c04e06bffa147e1fc01484` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:34.297119 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3264eed2-1f26-44b6-bfbf-700263ddeebf admin admin] RBAC: Authorizing `identity:delete_user(user_id=c634e1d6a7c04e06bffa147e1fc01484)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:34.300552 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bcaad1-ba9f-4383-b92b-5cb5bbccfcd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:34.301280 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bcaad1-ba9f-4383-b92b-5cb5bbccfcd0 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:34.301661 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bcaad1-ba9f-4383-b92b-5cb5bbccfcd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:34.302031 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bcaad1-ba9f-4383-b92b-5cb5bbccfcd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:34.303379 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bcaad1-ba9f-4383-b92b-5cb5bbccfcd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:38:34.303782 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bcaad1-ba9f-4383-b92b-5cb5bbccfcd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:34.304076 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3264eed2-1f26-44b6-bfbf-700263ddeebf admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:34.305583 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bcaad1-ba9f-4383-b92b-5cb5bbccfcd0 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:34.324848 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1026/2036] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:38:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:38:34.326014 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bcaad1-ba9f-4383-b92b-5cb5bbccfcd0 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:34.339594 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bcaad1-ba9f-4383-b92b-5cb5bbccfcd0 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:34.345582 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997ce6b-229d-495f-b1c8-8c7c229b9018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:34.346472 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997ce6b-229d-495f-b1c8-8c7c229b9018 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:34.346868 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997ce6b-229d-495f-b1c8-8c7c229b9018 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:34.347284 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997ce6b-229d-495f-b1c8-8c7c229b9018 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:34.348050 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b997ce6b-229d-495f-b1c8-8c7c229b9018 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:34.350595 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b997ce6b-229d-495f-b1c8-8c7c229b9018 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:34.401865 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1027/2037] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:38:34 2022] POST /identity/v3/projects => generated 389 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:34.405741 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997ce6b-229d-495f-b1c8-8c7c229b9018 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:34.407998 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3264eed2-1f26-44b6-bfbf-700263ddeebf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c634e1d6a7c04e06bffa147e1fc01484'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:34.408848 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3264eed2-1f26-44b6-bfbf-700263ddeebf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c634e1d6a7c04e06bffa147e1fc01484'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:34.420189 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3264eed2-1f26-44b6-bfbf-700263ddeebf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c634e1d6a7c04e06bffa147e1fc01484'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:34.430385 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3264eed2-1f26-44b6-bfbf-700263ddeebf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c634e1d6a7c04e06bffa147e1fc01484'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:34.431560 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3264eed2-1f26-44b6-bfbf-700263ddeebf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c634e1d6a7c04e06bffa147e1fc01484'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:34.478073 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1011/2038] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:38:34 2022] DELETE /identity/v3/users/c634e1d6a7c04e06bffa147e1fc01484 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:34.482596 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd1210-0a3f-42ed-9a18-1c7b729e6fce None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:34.483034 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd1210-0a3f-42ed-9a18-1c7b729e6fce None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:34.483438 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd1210-0a3f-42ed-9a18-1c7b729e6fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:34.488305 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:34.529124 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-2efd1210-0a3f-42ed-9a18-1c7b729e6fce None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:34.532772 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2efd1210-0a3f-42ed-9a18-1c7b729e6fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:34.537769 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997ce6b-229d-495f-b1c8-8c7c229b9018 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:34.597007 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:34.663932 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1012/2039] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:34.664948 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd1210-0a3f-42ed-9a18-1c7b729e6fce None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:34.666645 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2efd1210-0a3f-42ed-9a18-1c7b729e6fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:34.680352 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93306231-9254-4337-a1ba-01f098088b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:34.683487 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93306231-9254-4337-a1ba-01f098088b1a admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:34.684220 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd1210-0a3f-42ed-9a18-1c7b729e6fce None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:34.685128 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93306231-9254-4337-a1ba-01f098088b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:34.686324 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93306231-9254-4337-a1ba-01f098088b1a admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:34.694560 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93306231-9254-4337-a1ba-01f098088b1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:34.701939 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93306231-9254-4337-a1ba-01f098088b1a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:34.707365 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e8333a-75a3-410a-a635-59c2773f0156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:34.708296 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e8333a-75a3-410a-a635-59c2773f0156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:34.708755 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e8333a-75a3-410a-a635-59c2773f0156 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:34.709189 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e8333a-75a3-410a-a635-59c2773f0156 admin admin] PATH_INFO: `/v3/users/77155e7bda94494faca02323b43832ba` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:34.710815 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e8333a-75a3-410a-a635-59c2773f0156 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77155e7bda94494faca02323b43832ba)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:34.713113 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e8333a-75a3-410a-a635-59c2773f0156 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:34.783341 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1028/2040] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:38:34 2022] POST /identity/v3/users => generated 295 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:34.786518 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93306231-9254-4337-a1ba-01f098088b1a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:34.789785 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-93306231-9254-4337-a1ba-01f098088b1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:34.823593 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-63e8333a-75a3-410a-a635-59c2773f0156 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77155e7bda94494faca02323b43832ba'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:34.824999 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-63e8333a-75a3-410a-a635-59c2773f0156 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77155e7bda94494faca02323b43832ba'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:34.843137 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-63e8333a-75a3-410a-a635-59c2773f0156 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77155e7bda94494faca02323b43832ba'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:34.854678 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-63e8333a-75a3-410a-a635-59c2773f0156 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77155e7bda94494faca02323b43832ba'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:34.856837 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-63e8333a-75a3-410a-a635-59c2773f0156 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77155e7bda94494faca02323b43832ba'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:34.909048 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1013/2041] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:38:34 2022] DELETE /identity/v3/users/77155e7bda94494faca02323b43832ba => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:34.909048 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e8333a-75a3-410a-a635-59c2773f0156 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:34.911874 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-63e8333a-75a3-410a-a635-59c2773f0156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:34.962298 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93306231-9254-4337-a1ba-01f098088b1a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:35.075241 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236be8e-3d8f-411b-822e-be2b587d3b4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:35.075958 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236be8e-3d8f-411b-822e-be2b587d3b4a service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:35.076281 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236be8e-3d8f-411b-822e-be2b587d3b4a service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:35.077162 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236be8e-3d8f-411b-822e-be2b587d3b4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:35.079204 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f236be8e-3d8f-411b-822e-be2b587d3b4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:35.101564 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236be8e-3d8f-411b-822e-be2b587d3b4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:35.104218 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236be8e-3d8f-411b-822e-be2b587d3b4a service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:35.110612 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e8333a-75a3-410a-a635-59c2773f0156 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:35.121393 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1029/2042] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:38:35.122642 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236be8e-3d8f-411b-822e-be2b587d3b4a service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:35.123208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d3aac-0ce2-440d-9b7a-c2fc522b83d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:35.123852 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d3aac-0ce2-440d-9b7a-c2fc522b83d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:35.124134 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d3aac-0ce2-440d-9b7a-c2fc522b83d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:35.124401 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d3aac-0ce2-440d-9b7a-c2fc522b83d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:35.125217 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f236be8e-3d8f-411b-822e-be2b587d3b4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:35.125772 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35d3aac-0ce2-440d-9b7a-c2fc522b83d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:35.127497 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35d3aac-0ce2-440d-9b7a-c2fc522b83d2 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:35.141809 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236be8e-3d8f-411b-822e-be2b587d3b4a service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:35.149350 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1441f9e-9bd9-499f-a1ea-7bdeca716280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:35.151239 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1441f9e-9bd9-499f-a1ea-7bdeca716280 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:35.153132 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1441f9e-9bd9-499f-a1ea-7bdeca716280 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:35.153633 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1441f9e-9bd9-499f-a1ea-7bdeca716280 admin admin] PATH_INFO: `/v3/users/a726e7ddb8914b72925d217021404000` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:35.155503 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1441f9e-9bd9-499f-a1ea-7bdeca716280 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a726e7ddb8914b72925d217021404000)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:35.155850 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1014/2043] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:35.161674 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1441f9e-9bd9-499f-a1ea-7bdeca716280 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:35.171059 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b593a76-f69b-4953-a67c-975d9d33b520 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:35.171280 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b593a76-f69b-4953-a67c-975d9d33b520 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:35.171576 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b593a76-f69b-4953-a67c-975d9d33b520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:35.198872 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:35.236908 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-5b593a76-f69b-4953-a67c-975d9d33b520 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:35.245137 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5b593a76-f69b-4953-a67c-975d9d33b520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:35.269765 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1015/2044] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:35.270624 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b593a76-f69b-4953-a67c-975d9d33b520 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:35.274318 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a1441f9e-9bd9-499f-a1ea-7bdeca716280 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a726e7ddb8914b72925d217021404000'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:35.276039 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a1441f9e-9bd9-499f-a1ea-7bdeca716280 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a726e7ddb8914b72925d217021404000'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:35.291679 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b593a76-f69b-4953-a67c-975d9d33b520 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:35.305398 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6958458-68b8-40e3-a44f-c4d30703ee3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:35.306278 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6958458-68b8-40e3-a44f-c4d30703ee3e admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:35.306850 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6958458-68b8-40e3-a44f-c4d30703ee3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:35.307943 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6958458-68b8-40e3-a44f-c4d30703ee3e admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:35.315801 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6958458-68b8-40e3-a44f-c4d30703ee3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:35.318562 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6958458-68b8-40e3-a44f-c4d30703ee3e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:35.326236 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a1441f9e-9bd9-499f-a1ea-7bdeca716280 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a726e7ddb8914b72925d217021404000'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:35.341622 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a1441f9e-9bd9-499f-a1ea-7bdeca716280 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a726e7ddb8914b72925d217021404000'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:35.357650 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1016/2045] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:35 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:35.361236 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6958458-68b8-40e3-a44f-c4d30703ee3e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:35.367220 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b6958458-68b8-40e3-a44f-c4d30703ee3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:35.381091 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a1441f9e-9bd9-499f-a1ea-7bdeca716280 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a726e7ddb8914b72925d217021404000'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:35.395893 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6958458-68b8-40e3-a44f-c4d30703ee3e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:35.402891 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954437f9-c0ea-4305-b1d5-b31b8b9dddc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:35.403571 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954437f9-c0ea-4305-b1d5-b31b8b9dddc8 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:35.403845 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954437f9-c0ea-4305-b1d5-b31b8b9dddc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:35.404187 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954437f9-c0ea-4305-b1d5-b31b8b9dddc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:35.406278 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-954437f9-c0ea-4305-b1d5-b31b8b9dddc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:35.411464 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1030/2046] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:38:35 2022] DELETE /identity/v3/users/a726e7ddb8914b72925d217021404000 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:35.415525 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1441f9e-9bd9-499f-a1ea-7bdeca716280 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:35.420800 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a1441f9e-9bd9-499f-a1ea-7bdeca716280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:35.437914 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954437f9-c0ea-4305-b1d5-b31b8b9dddc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:35.440851 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954437f9-c0ea-4305-b1d5-b31b8b9dddc8 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:35.472492 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1017/2047] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:38:35.473816 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d01a3-ba32-444b-b7bc-19ea7b9b9dc8 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:35.474365 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d01a3-ba32-444b-b7bc-19ea7b9b9dc8 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:35.475630 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d01a3-ba32-444b-b7bc-19ea7b9b9dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:35.536339 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1441f9e-9bd9-499f-a1ea-7bdeca716280 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:35.539799 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-b13d01a3-ba32-444b-b7bc-19ea7b9b9dc8 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:35.541501 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b13d01a3-ba32-444b-b7bc-19ea7b9b9dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:35.566466 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1018/2048] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:35.573650 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca37848-354b-4295-ac1a-8a874e282f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:35.574808 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca37848-354b-4295-ac1a-8a874e282f49 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:35.574993 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca37848-354b-4295-ac1a-8a874e282f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:35.577025 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca37848-354b-4295-ac1a-8a874e282f49 admin admin] PATH_INFO: `/v3/projects/13ccf42f8444482a9e97a08cf7668fd7/users/e63e67306f07404dab97802890c990a0/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:35.577533 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d01a3-ba32-444b-b7bc-19ea7b9b9dc8 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:35.586473 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b13d01a3-ba32-444b-b7bc-19ea7b9b9dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:35.609832 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:35.650652 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca37848-354b-4295-ac1a-8a874e282f49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13ccf42f8444482a9e97a08cf7668fd7, user_id=e63e67306f07404dab97802890c990a0, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:35.654331 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca37848-354b-4295-ac1a-8a874e282f49 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:35.701374 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1031/2049] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:38:35 2022] PUT /identity/v3/projects/13ccf42f8444482a9e97a08cf7668fd7/users/e63e67306f07404dab97802890c990a0/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:35.706595 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9aba46-9c13-4505-8a22-0c967d78fa8b None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:35.706964 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9aba46-9c13-4505-8a22-0c967d78fa8b None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:35.707334 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9aba46-9c13-4505-8a22-0c967d78fa8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:35.756780 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d01a3-ba32-444b-b7bc-19ea7b9b9dc8 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:35.772683 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-cb9aba46-9c13-4505-8a22-0c967d78fa8b None None] MFA Rules not processed for user `e63e67306f07404dab97802890c990a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:35.774288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-cb9aba46-9c13-4505-8a22-0c967d78fa8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:35.927258 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1032/2050] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:35 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:38:35.928871 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9aba46-9c13-4505-8a22-0c967d78fa8b None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:35.931687 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-cb9aba46-9c13-4505-8a22-0c967d78fa8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:35.956516 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:36.035125 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16303d19-0585-46ef-b5c9-e0853c6582cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:36.035961 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16303d19-0585-46ef-b5c9-e0853c6582cf service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:36.036337 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16303d19-0585-46ef-b5c9-e0853c6582cf service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:36.038390 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16303d19-0585-46ef-b5c9-e0853c6582cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:36.059328 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9aba46-9c13-4505-8a22-0c967d78fa8b None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:36.069713 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16303d19-0585-46ef-b5c9-e0853c6582cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:36.075648 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16303d19-0585-46ef-b5c9-e0853c6582cf service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:36.075798 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c0067-5ef0-4bcf-bed2-4905a8bea5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:36.078676 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c0067-5ef0-4bcf-bed2-4905a8bea5b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:36.078961 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c0067-5ef0-4bcf-bed2-4905a8bea5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:36.079270 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c0067-5ef0-4bcf-bed2-4905a8bea5b8 admin admin] PATH_INFO: `/v3/projects/4eb72ca72c184912903e49c3c4ece997` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:36.082241 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010c0067-5ef0-4bcf-bed2-4905a8bea5b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4eb72ca72c184912903e49c3c4ece997)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:36.084294 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010c0067-5ef0-4bcf-bed2-4905a8bea5b8 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:36.114967 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1019/2051] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:38:36.118718 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16303d19-0585-46ef-b5c9-e0853c6582cf service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:36.161780 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16303d19-0585-46ef-b5c9-e0853c6582cf service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:36.186051 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-010c0067-5ef0-4bcf-bed2-4905a8bea5b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4eb72ca72c184912903e49c3c4ece997', 'request_id': 'req-010c0067-5ef0-4bcf-bed2-4905a8bea5b8'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:36.203758 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-010c0067-5ef0-4bcf-bed2-4905a8bea5b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4eb72ca72c184912903e49c3c4ece997', 'request_id': 'req-010c0067-5ef0-4bcf-bed2-4905a8bea5b8'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:36.228402 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-010c0067-5ef0-4bcf-bed2-4905a8bea5b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4eb72ca72c184912903e49c3c4ece997', 'request_id': 'req-010c0067-5ef0-4bcf-bed2-4905a8bea5b8'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:36.255041 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-010c0067-5ef0-4bcf-bed2-4905a8bea5b8 admin admin] The token cache is being invalidate because project 4eb72ca72c184912903e49c3c4ece997 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:38:36.255414 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-010c0067-5ef0-4bcf-bed2-4905a8bea5b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:36.260129 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-010c0067-5ef0-4bcf-bed2-4905a8bea5b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:36.266219 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1033/2052] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:38:35 2022] DELETE /identity/v3/projects/4eb72ca72c184912903e49c3c4ece997 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:36.270271 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c0067-5ef0-4bcf-bed2-4905a8bea5b8 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:36.274112 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8acd21-6f4b-475d-b3fb-2a8fd13c4c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:36.274740 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8acd21-6f4b-475d-b3fb-2a8fd13c4c9b admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:36.274944 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-010c0067-5ef0-4bcf-bed2-4905a8bea5b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:36.275071 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8acd21-6f4b-475d-b3fb-2a8fd13c4c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:36.275781 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8acd21-6f4b-475d-b3fb-2a8fd13c4c9b admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:36.276563 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8acd21-6f4b-475d-b3fb-2a8fd13c4c9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:36.278531 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8acd21-6f4b-475d-b3fb-2a8fd13c4c9b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:36.304671 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c0067-5ef0-4bcf-bed2-4905a8bea5b8 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:36.318195 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1020/2053] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:38:36 2022] POST /identity/v3/projects => generated 389 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:36.322669 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8acd21-6f4b-475d-b3fb-2a8fd13c4c9b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:36.323393 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57575b19-0d94-4591-ba97-d24c7d2bf6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:36.325489 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57575b19-0d94-4591-ba97-d24c7d2bf6e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:36.325779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1e8acd21-6f4b-475d-b3fb-2a8fd13c4c9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:36.325911 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57575b19-0d94-4591-ba97-d24c7d2bf6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:36.326101 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57575b19-0d94-4591-ba97-d24c7d2bf6e1 admin admin] PATH_INFO: `/v3/users/73548e01b48147a2a9b8987528ecbeb7` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:36.330126 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57575b19-0d94-4591-ba97-d24c7d2bf6e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73548e01b48147a2a9b8987528ecbeb7)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:36.337070 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57575b19-0d94-4591-ba97-d24c7d2bf6e1 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:36.413258 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:36.446780 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8acd21-6f4b-475d-b3fb-2a8fd13c4c9b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:36.455167 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-57575b19-0d94-4591-ba97-d24c7d2bf6e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73548e01b48147a2a9b8987528ecbeb7'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:36.456293 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-57575b19-0d94-4591-ba97-d24c7d2bf6e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73548e01b48147a2a9b8987528ecbeb7'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:36.461232 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a25cea-4ec8-42b5-af32-2d8461e55915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:36.463542 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a25cea-4ec8-42b5-af32-2d8461e55915 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:36.463819 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a25cea-4ec8-42b5-af32-2d8461e55915 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:36.464088 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a25cea-4ec8-42b5-af32-2d8461e55915 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:36.464741 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a25cea-4ec8-42b5-af32-2d8461e55915 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:36.473489 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a25cea-4ec8-42b5-af32-2d8461e55915 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:36.496632 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-57575b19-0d94-4591-ba97-d24c7d2bf6e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73548e01b48147a2a9b8987528ecbeb7'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:36.517654 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-57575b19-0d94-4591-ba97-d24c7d2bf6e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73548e01b48147a2a9b8987528ecbeb7'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:36.536417 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1021/2054] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:38:36 2022] POST /identity/v3/users => generated 301 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:36.540618 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a25cea-4ec8-42b5-af32-2d8461e55915 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:36.541309 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-57575b19-0d94-4591-ba97-d24c7d2bf6e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73548e01b48147a2a9b8987528ecbeb7'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:36.574525 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1034/2055] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:38:36 2022] DELETE /identity/v3/users/73548e01b48147a2a9b8987528ecbeb7 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:36.581700 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a25cea-4ec8-42b5-af32-2d8461e55915 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:36.679821 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b27ed-9ba4-409f-af4e-cd1e332da3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:36.680501 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b27ed-9ba4-409f-af4e-cd1e332da3ab admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:36.681058 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b27ed-9ba4-409f-af4e-cd1e332da3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:36.681250 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b27ed-9ba4-409f-af4e-cd1e332da3ab admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:36.681983 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4b27ed-9ba4-409f-af4e-cd1e332da3ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:36.684066 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4b27ed-9ba4-409f-af4e-cd1e332da3ab admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:36.706868 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1022/2056] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:36 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:36.711727 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57575b19-0d94-4591-ba97-d24c7d2bf6e1 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:36.713358 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-57575b19-0d94-4591-ba97-d24c7d2bf6e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:36.735513 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57575b19-0d94-4591-ba97-d24c7d2bf6e1 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:36.759113 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b27ed-9ba4-409f-af4e-cd1e332da3ab admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:36.760945 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8d4b27ed-9ba4-409f-af4e-cd1e332da3ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:36.772715 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065febd-81b9-480e-84b2-4d93c3418dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:36.773437 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065febd-81b9-480e-84b2-4d93c3418dc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:36.773711 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065febd-81b9-480e-84b2-4d93c3418dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:36.773984 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065febd-81b9-480e-84b2-4d93c3418dc1 admin admin] PATH_INFO: `/v3/projects/7a1284a5cd1145cbb5f79aeef145d0ac/users/8c7fdb13ee3b48a0ad869e275ddc5d69/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:36.785602 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:36.806569 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b27ed-9ba4-409f-af4e-cd1e332da3ab admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:36.821956 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b76d3b-5c2f-45b5-a76a-39c7981f930c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:36.822617 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b76d3b-5c2f-45b5-a76a-39c7981f930c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:36.822896 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b76d3b-5c2f-45b5-a76a-39c7981f930c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:36.823223 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b76d3b-5c2f-45b5-a76a-39c7981f930c admin admin] PATH_INFO: `/v3/projects/0793cb46817e495bae9e712739eb9a89` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:36.831480 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b76d3b-5c2f-45b5-a76a-39c7981f930c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0793cb46817e495bae9e712739eb9a89)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:36.833553 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b76d3b-5c2f-45b5-a76a-39c7981f930c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:36.837702 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7065febd-81b9-480e-84b2-4d93c3418dc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a1284a5cd1145cbb5f79aeef145d0ac, user_id=8c7fdb13ee3b48a0ad869e275ddc5d69, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:36.842919 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7065febd-81b9-480e-84b2-4d93c3418dc1 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:36.885690 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1035/2057] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:38:36 2022] PUT /identity/v3/projects/7a1284a5cd1145cbb5f79aeef145d0ac/users/8c7fdb13ee3b48a0ad869e275ddc5d69/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:36.889076 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065febd-81b9-480e-84b2-4d93c3418dc1 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:36.996140 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d0b76d3b-5c2f-45b5-a76a-39c7981f930c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0793cb46817e495bae9e712739eb9a89', 'request_id': 'req-d0b76d3b-5c2f-45b5-a76a-39c7981f930c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:37.013379 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d0b76d3b-5c2f-45b5-a76a-39c7981f930c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0793cb46817e495bae9e712739eb9a89', 'request_id': 'req-d0b76d3b-5c2f-45b5-a76a-39c7981f930c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:37.031734 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d0b76d3b-5c2f-45b5-a76a-39c7981f930c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0793cb46817e495bae9e712739eb9a89', 'request_id': 'req-d0b76d3b-5c2f-45b5-a76a-39c7981f930c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:37.046694 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065febd-81b9-480e-84b2-4d93c3418dc1 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:37.066738 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d0b76d3b-5c2f-45b5-a76a-39c7981f930c admin admin] The token cache is being invalidate because project 0793cb46817e495bae9e712739eb9a89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:38:37.068025 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d0b76d3b-5c2f-45b5-a76a-39c7981f930c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:37.071906 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d0b76d3b-5c2f-45b5-a76a-39c7981f930c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:37.078770 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1023/2058] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:38:36 2022] DELETE /identity/v3/projects/0793cb46817e495bae9e712739eb9a89 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:37.082728 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b76d3b-5c2f-45b5-a76a-39c7981f930c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:37.087459 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d0b76d3b-5c2f-45b5-a76a-39c7981f930c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:37.216061 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53d998-c740-427e-a045-114012d00316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:37.217083 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53d998-c740-427e-a045-114012d00316 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:37.217367 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53d998-c740-427e-a045-114012d00316 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:37.217638 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53d998-c740-427e-a045-114012d00316 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:37.218295 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa53d998-c740-427e-a045-114012d00316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:37.220720 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa53d998-c740-427e-a045-114012d00316 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:37.234203 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1036/2059] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:36 2022] GET /identity/v3/roles => generated 1420 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:37.238623 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53d998-c740-427e-a045-114012d00316 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:37.242064 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-aa53d998-c740-427e-a045-114012d00316 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:37.258824 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53d998-c740-427e-a045-114012d00316 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:37.267276 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff86722-5b06-4ad7-9fa9-9345fa711fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:37.267925 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff86722-5b06-4ad7-9fa9-9345fa711fb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:37.268357 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff86722-5b06-4ad7-9fa9-9345fa711fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:37.269145 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff86722-5b06-4ad7-9fa9-9345fa711fb4 admin admin] PATH_INFO: `/v3/users/016de1636425429384b2c7234b31c06d` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:37.272247 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff86722-5b06-4ad7-9fa9-9345fa711fb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=016de1636425429384b2c7234b31c06d)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:37.275096 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff86722-5b06-4ad7-9fa9-9345fa711fb4 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:37.280017 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b76d3b-5c2f-45b5-a76a-39c7981f930c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:37.301593 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02332d0-563f-4da8-8c65-070649e09397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:37.303292 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02332d0-563f-4da8-8c65-070649e09397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:37.303944 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02332d0-563f-4da8-8c65-070649e09397 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:37.304257 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02332d0-563f-4da8-8c65-070649e09397 admin admin] PATH_INFO: `/v3/projects/67ca0b8aee9c456ea89afedb257e1365` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:37.305725 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02332d0-563f-4da8-8c65-070649e09397 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67ca0b8aee9c456ea89afedb257e1365)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:37.310645 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02332d0-563f-4da8-8c65-070649e09397 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:37.319785 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:37.406076 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6ff86722-5b06-4ad7-9fa9-9345fa711fb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '016de1636425429384b2c7234b31c06d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:37.406076 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6ff86722-5b06-4ad7-9fa9-9345fa711fb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '016de1636425429384b2c7234b31c06d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:37.409298 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d02332d0-563f-4da8-8c65-070649e09397 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67ca0b8aee9c456ea89afedb257e1365', 'request_id': 'req-d02332d0-563f-4da8-8c65-070649e09397'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:37.421957 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d02332d0-563f-4da8-8c65-070649e09397 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67ca0b8aee9c456ea89afedb257e1365', 'request_id': 'req-d02332d0-563f-4da8-8c65-070649e09397'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:37.434365 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d02332d0-563f-4da8-8c65-070649e09397 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67ca0b8aee9c456ea89afedb257e1365', 'request_id': 'req-d02332d0-563f-4da8-8c65-070649e09397'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:37.438273 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6ff86722-5b06-4ad7-9fa9-9345fa711fb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '016de1636425429384b2c7234b31c06d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:37.453198 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6ff86722-5b06-4ad7-9fa9-9345fa711fb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '016de1636425429384b2c7234b31c06d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:37.461018 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d02332d0-563f-4da8-8c65-070649e09397 admin admin] The token cache is being invalidate because project 67ca0b8aee9c456ea89afedb257e1365 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:38:37.462228 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d02332d0-563f-4da8-8c65-070649e09397 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:37.464651 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d02332d0-563f-4da8-8c65-070649e09397 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:37.468224 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1024/2060] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:38:37 2022] DELETE /identity/v3/projects/67ca0b8aee9c456ea89afedb257e1365 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:37.473833 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02332d0-563f-4da8-8c65-070649e09397 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:37.475176 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6ff86722-5b06-4ad7-9fa9-9345fa711fb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '016de1636425429384b2c7234b31c06d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:37.478525 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:37.479201 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d02332d0-563f-4da8-8c65-070649e09397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:37.486260 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1037/2061] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:38:37 2022] DELETE /identity/v3/users/016de1636425429384b2c7234b31c06d => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:37.487540 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff86722-5b06-4ad7-9fa9-9345fa711fb4 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:37.501299 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6ff86722-5b06-4ad7-9fa9-9345fa711fb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:37.621090 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02332d0-563f-4da8-8c65-070649e09397 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:37.720352 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff86722-5b06-4ad7-9fa9-9345fa711fb4 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:37.734529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73990f0c-8f2b-49d9-8412-2b1acfbac193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:37.737146 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73990f0c-8f2b-49d9-8412-2b1acfbac193 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:37.737620 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73990f0c-8f2b-49d9-8412-2b1acfbac193 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:37.737900 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73990f0c-8f2b-49d9-8412-2b1acfbac193 admin admin] PATH_INFO: `/v3/projects/7a1284a5cd1145cbb5f79aeef145d0ac/users/8c7fdb13ee3b48a0ad869e275ddc5d69/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:37.749493 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73990f0c-8f2b-49d9-8412-2b1acfbac193 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a1284a5cd1145cbb5f79aeef145d0ac, user_id=8c7fdb13ee3b48a0ad869e275ddc5d69, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:37.756306 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73990f0c-8f2b-49d9-8412-2b1acfbac193 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:37.791885 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1038/2062] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:38:37 2022] PUT /identity/v3/projects/7a1284a5cd1145cbb5f79aeef145d0ac/users/8c7fdb13ee3b48a0ad869e275ddc5d69/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:37.794690 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4a2d7-a54d-4411-97eb-07f5af7e762c None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:37.794982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4a2d7-a54d-4411-97eb-07f5af7e762c None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:37.795851 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4a2d7-a54d-4411-97eb-07f5af7e762c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:37.812869 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd156b8-1043-45e3-8c12-611010615b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:37.815497 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd156b8-1043-45e3-8c12-611010615b0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:37.815809 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd156b8-1043-45e3-8c12-611010615b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:37.816907 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd156b8-1043-45e3-8c12-611010615b0e admin admin] PATH_INFO: `/v3/users/c90a7444d98e4f45a03053fd032694db` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:37.827084 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd156b8-1043-45e3-8c12-611010615b0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c90a7444d98e4f45a03053fd032694db)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:37.827084 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd156b8-1043-45e3-8c12-611010615b0e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:37.874460 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-99b4a2d7-a54d-4411-97eb-07f5af7e762c None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:37.879925 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-99b4a2d7-a54d-4411-97eb-07f5af7e762c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:37.951442 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:37.977634 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3bd156b8-1043-45e3-8c12-611010615b0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c90a7444d98e4f45a03053fd032694db'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:37.980213 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3bd156b8-1043-45e3-8c12-611010615b0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c90a7444d98e4f45a03053fd032694db'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:38.000512 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3bd156b8-1043-45e3-8c12-611010615b0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c90a7444d98e4f45a03053fd032694db'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:38.017054 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3bd156b8-1043-45e3-8c12-611010615b0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c90a7444d98e4f45a03053fd032694db'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:38.017808 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3bd156b8-1043-45e3-8c12-611010615b0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c90a7444d98e4f45a03053fd032694db'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:38.059493 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1039/2063] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:38.060108 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597969d-a77d-4bef-b6e6-9ba39f6b98fc None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:38.060108 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597969d-a77d-4bef-b6e6-9ba39f6b98fc None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:38.060380 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597969d-a77d-4bef-b6e6-9ba39f6b98fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:38.073539 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1025/2064] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:38:37 2022] DELETE /identity/v3/users/c90a7444d98e4f45a03053fd032694db => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:38.073539 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36bd3f-b0c3-425b-8a1e-c1de493c257f None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:38.073539 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36bd3f-b0c3-425b-8a1e-c1de493c257f None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:38.073539 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36bd3f-b0c3-425b-8a1e-c1de493c257f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:38.114064 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-9597969d-a77d-4bef-b6e6-9ba39f6b98fc None None] MFA Rules not processed for user `8c7fdb13ee3b48a0ad869e275ddc5d69`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:38.119799 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9597969d-a77d-4bef-b6e6-9ba39f6b98fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:38.147264 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-9e36bd3f-b0c3-425b-8a1e-c1de493c257f None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:38.149175 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9e36bd3f-b0c3-425b-8a1e-c1de493c257f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:38.348112 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1040/2065] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:38 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:38.349632 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f78a2-aee6-4a31-88fe-e8d69fe4b6fa None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:38.350124 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f78a2-aee6-4a31-88fe-e8d69fe4b6fa None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:38.351003 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f78a2-aee6-4a31-88fe-e8d69fe4b6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:38.388216 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1026/2066] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:38.389175 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e36bd3f-b0c3-425b-8a1e-c1de493c257f None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:38.390827 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9e36bd3f-b0c3-425b-8a1e-c1de493c257f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:38.408536 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e36bd3f-b0c3-425b-8a1e-c1de493c257f None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:38.427993 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae527c3-2312-488f-adf9-3c148b620319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:38.428920 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae527c3-2312-488f-adf9-3c148b620319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:38.429342 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae527c3-2312-488f-adf9-3c148b620319 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:38.430538 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae527c3-2312-488f-adf9-3c148b620319 admin admin] PATH_INFO: `/v3/projects/09bab46673824d9ba81dc152cc0a3895` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:38.432959 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae527c3-2312-488f-adf9-3c148b620319 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09bab46673824d9ba81dc152cc0a3895)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:38.435137 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae527c3-2312-488f-adf9-3c148b620319 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:38.435857 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-c50f78a2-aee6-4a31-88fe-e8d69fe4b6fa None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:38.438114 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c50f78a2-aee6-4a31-88fe-e8d69fe4b6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:38.484802 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1041/2067] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:38.506216 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419f400-b09a-4c1d-b35b-db277c984b6a None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:38.506863 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419f400-b09a-4c1d-b35b-db277c984b6a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:38.522360 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419f400-b09a-4c1d-b35b-db277c984b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:38.603899 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-0419f400-b09a-4c1d-b35b-db277c984b6a None None] MFA Rules not processed for user `e63e67306f07404dab97802890c990a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:38.609866 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0419f400-b09a-4c1d-b35b-db277c984b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:38.629508 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:38.642468 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0ae527c3-2312-488f-adf9-3c148b620319 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09bab46673824d9ba81dc152cc0a3895', 'request_id': 'req-0ae527c3-2312-488f-adf9-3c148b620319'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:38.671173 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0ae527c3-2312-488f-adf9-3c148b620319 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09bab46673824d9ba81dc152cc0a3895', 'request_id': 'req-0ae527c3-2312-488f-adf9-3c148b620319'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:38.682261 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0ae527c3-2312-488f-adf9-3c148b620319 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09bab46673824d9ba81dc152cc0a3895', 'request_id': 'req-0ae527c3-2312-488f-adf9-3c148b620319'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:38.708369 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0ae527c3-2312-488f-adf9-3c148b620319 admin admin] The token cache is being invalidate because project 09bab46673824d9ba81dc152cc0a3895 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:38:38.708764 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0ae527c3-2312-488f-adf9-3c148b620319 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:38.710353 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0ae527c3-2312-488f-adf9-3c148b620319 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:38.713062 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1027/2068] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:38:38 2022] DELETE /identity/v3/projects/09bab46673824d9ba81dc152cc0a3895 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:38.714851 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae527c3-2312-488f-adf9-3c148b620319 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:38.716583 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0ae527c3-2312-488f-adf9-3c148b620319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:38.788772 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1042/2069] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:38.796506 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0419f400-b09a-4c1d-b35b-db277c984b6a None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:38.799853 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0419f400-b09a-4c1d-b35b-db277c984b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:38.854989 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:38.903014 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae527c3-2312-488f-adf9-3c148b620319 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:38.911074 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a18000-e383-4121-9e91-44936144104f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:38.912973 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a18000-e383-4121-9e91-44936144104f admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:38.913252 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a18000-e383-4121-9e91-44936144104f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:38.913639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a18000-e383-4121-9e91-44936144104f admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:38.914319 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a18000-e383-4121-9e91-44936144104f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:38:38.914621 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a18000-e383-4121-9e91-44936144104f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:38.916303 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a18000-e383-4121-9e91-44936144104f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:38.942189 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1028/2070] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:38:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:38:38.946723 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a18000-e383-4121-9e91-44936144104f admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:38.951833 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0419f400-b09a-4c1d-b35b-db277c984b6a None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:38.954054 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-58a18000-e383-4121-9e91-44936144104f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:38.960884 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2082e4b-0664-496c-a317-434350de293a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:38.961559 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2082e4b-0664-496c-a317-434350de293a service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:38.961842 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2082e4b-0664-496c-a317-434350de293a service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:38.962118 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2082e4b-0664-496c-a317-434350de293a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:38.971953 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f2082e4b-0664-496c-a317-434350de293a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:38.990296 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a18000-e383-4121-9e91-44936144104f admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:38.992266 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2082e4b-0664-496c-a317-434350de293a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:38.993759 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2082e4b-0664-496c-a317-434350de293a service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:39.013131 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76078c-fdc3-453e-ac22-a37c784d2ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:39.013812 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76078c-fdc3-453e-ac22-a37c784d2ca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:39.014094 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76078c-fdc3-453e-ac22-a37c784d2ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:39.014356 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76078c-fdc3-453e-ac22-a37c784d2ca5 admin admin] PATH_INFO: `/v3/projects/8c08d800133c4864969672c78819b44f` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:39.015879 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c76078c-fdc3-453e-ac22-a37c784d2ca5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c08d800133c4864969672c78819b44f)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:39.017830 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c76078c-fdc3-453e-ac22-a37c784d2ca5 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:39.024514 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1043/2071] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:38:39.025934 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2082e4b-0664-496c-a317-434350de293a service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:39.028350 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f2082e4b-0664-496c-a317-434350de293a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:39.044711 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2082e4b-0664-496c-a317-434350de293a service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:39.059061 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4292cd7b-4f89-48ff-893a-84a80d08e3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:39.059730 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292cd7b-4f89-48ff-893a-84a80d08e3d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:39.060010 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292cd7b-4f89-48ff-893a-84a80d08e3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:39.060285 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292cd7b-4f89-48ff-893a-84a80d08e3d5 admin admin] PATH_INFO: `/v3/users/07cc2434228943d5b28b74e9423429e4` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:39.062741 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4292cd7b-4f89-48ff-893a-84a80d08e3d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07cc2434228943d5b28b74e9423429e4)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:39.064774 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4292cd7b-4f89-48ff-893a-84a80d08e3d5 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:39.140124 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2c76078c-fdc3-453e-ac22-a37c784d2ca5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c08d800133c4864969672c78819b44f', 'request_id': 'req-2c76078c-fdc3-453e-ac22-a37c784d2ca5'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:39.150829 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2c76078c-fdc3-453e-ac22-a37c784d2ca5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c08d800133c4864969672c78819b44f', 'request_id': 'req-2c76078c-fdc3-453e-ac22-a37c784d2ca5'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:39.174010 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2c76078c-fdc3-453e-ac22-a37c784d2ca5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c08d800133c4864969672c78819b44f', 'request_id': 'req-2c76078c-fdc3-453e-ac22-a37c784d2ca5'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:39.185927 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4292cd7b-4f89-48ff-893a-84a80d08e3d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07cc2434228943d5b28b74e9423429e4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:39.187140 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4292cd7b-4f89-48ff-893a-84a80d08e3d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07cc2434228943d5b28b74e9423429e4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:39.192214 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2c76078c-fdc3-453e-ac22-a37c784d2ca5 admin admin] The token cache is being invalidate because project 8c08d800133c4864969672c78819b44f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:38:39.192599 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2c76078c-fdc3-453e-ac22-a37c784d2ca5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:39.199552 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2c76078c-fdc3-453e-ac22-a37c784d2ca5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:39.204993 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1029/2072] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:38:38 2022] DELETE /identity/v3/projects/8c08d800133c4864969672c78819b44f => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:39.205987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76078c-fdc3-453e-ac22-a37c784d2ca5 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:39.208730 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4292cd7b-4f89-48ff-893a-84a80d08e3d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07cc2434228943d5b28b74e9423429e4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:39.219918 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2c76078c-fdc3-453e-ac22-a37c784d2ca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:39.231165 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4292cd7b-4f89-48ff-893a-84a80d08e3d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07cc2434228943d5b28b74e9423429e4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:39.258141 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4292cd7b-4f89-48ff-893a-84a80d08e3d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07cc2434228943d5b28b74e9423429e4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:39.268616 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1044/2073] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:38:39 2022] DELETE /identity/v3/users/07cc2434228943d5b28b74e9423429e4 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:39.269836 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4292cd7b-4f89-48ff-893a-84a80d08e3d5 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:39.282169 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4292cd7b-4f89-48ff-893a-84a80d08e3d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:39.408110 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:39.421318 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76078c-fdc3-453e-ac22-a37c784d2ca5 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:39.477944 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4292cd7b-4f89-48ff-893a-84a80d08e3d5 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:39.495214 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5a060-6992-4467-8439-1adc3c77f1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:39.495849 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5a060-6992-4467-8439-1adc3c77f1a2 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:39.497130 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5a060-6992-4467-8439-1adc3c77f1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:39.506695 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5a060-6992-4467-8439-1adc3c77f1a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:39.507598 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d5a060-6992-4467-8439-1adc3c77f1a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:39.509572 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d5a060-6992-4467-8439-1adc3c77f1a2 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:39.565241 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1045/2074] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:38:39 2022] POST /identity/v3/projects => generated 393 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:39.566893 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54810e88-92ab-4f1c-abab-99a25f4ef805 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:39.567309 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54810e88-92ab-4f1c-abab-99a25f4ef805 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:39.567702 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54810e88-92ab-4f1c-abab-99a25f4ef805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:39.587098 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:39.616934 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-54810e88-92ab-4f1c-abab-99a25f4ef805 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:39.618249 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-54810e88-92ab-4f1c-abab-99a25f4ef805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:39.630068 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05726c2-fdcf-4223-8cff-93a9bc73d906 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:39.630989 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05726c2-fdcf-4223-8cff-93a9bc73d906 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:39.631418 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05726c2-fdcf-4223-8cff-93a9bc73d906 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:39.631755 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05726c2-fdcf-4223-8cff-93a9bc73d906 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:39.639188 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e05726c2-fdcf-4223-8cff-93a9bc73d906 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:39.772237 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1046/2075] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:39.773156 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54810e88-92ab-4f1c-abab-99a25f4ef805 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:39.786504 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54810e88-92ab-4f1c-abab-99a25f4ef805 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:39.793154 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a8ee2-6050-45e7-a52e-d132749af009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:39.793956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a8ee2-6050-45e7-a52e-d132749af009 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:39.794364 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a8ee2-6050-45e7-a52e-d132749af009 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:39.794704 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a8ee2-6050-45e7-a52e-d132749af009 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:39.795598 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a8ee2-6050-45e7-a52e-d132749af009 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:39.798569 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a8ee2-6050-45e7-a52e-d132749af009 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:39.843682 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1047/2076] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:38:39 2022] POST /identity/v3/users => generated 297 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:39.843682 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095dee82-3ce8-4916-ad62-348fa651818c None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:39.843682 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095dee82-3ce8-4916-ad62-348fa651818c None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:39.843682 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095dee82-3ce8-4916-ad62-348fa651818c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:39.857597 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05726c2-fdcf-4223-8cff-93a9bc73d906 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:39.859251 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05726c2-fdcf-4223-8cff-93a9bc73d906 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:39.878962 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-095dee82-3ce8-4916-ad62-348fa651818c None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:39.880358 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1030/2077] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:39 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 675 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:38:39.880634 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-095dee82-3ce8-4916-ad62-348fa651818c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:39.881462 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05726c2-fdcf-4223-8cff-93a9bc73d906 service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:39.892328 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1048/2078] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:39.896598 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095dee82-3ce8-4916-ad62-348fa651818c None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:39.909368 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05726c2-fdcf-4223-8cff-93a9bc73d906 service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:39.910483 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095dee82-3ce8-4916-ad62-348fa651818c None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:39.917443 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b9ae27-00cc-4aa8-9c0f-ae11b83ccf93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:39.923906 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2511121a-ab46-410c-afcd-fa2a83a1a4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:39.924688 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511121a-ab46-410c-afcd-fa2a83a1a4eb admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:39.924913 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b9ae27-00cc-4aa8-9c0f-ae11b83ccf93 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:39.925047 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511121a-ab46-410c-afcd-fa2a83a1a4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:39.925279 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511121a-ab46-410c-afcd-fa2a83a1a4eb admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:39.925609 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b9ae27-00cc-4aa8-9c0f-ae11b83ccf93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:39.925937 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2511121a-ab46-410c-afcd-fa2a83a1a4eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:39.926220 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b9ae27-00cc-4aa8-9c0f-ae11b83ccf93 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:39.927095 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b9ae27-00cc-4aa8-9c0f-ae11b83ccf93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:38:39.928132 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b9ae27-00cc-4aa8-9c0f-ae11b83ccf93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:39.928300 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2511121a-ab46-410c-afcd-fa2a83a1a4eb admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:39.931123 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b9ae27-00cc-4aa8-9c0f-ae11b83ccf93 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:39.944882 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1031/2079] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:39 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:39.955129 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1049/2080] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:38:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:38:39.956147 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2511121a-ab46-410c-afcd-fa2a83a1a4eb admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:39.968258 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b9ae27-00cc-4aa8-9c0f-ae11b83ccf93 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:39.985575 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2511121a-ab46-410c-afcd-fa2a83a1a4eb admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:39.993409 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775ab7b-0bab-4516-b2c1-cc033c997e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:39.997639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775ab7b-0bab-4516-b2c1-cc033c997e13 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:39.997969 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775ab7b-0bab-4516-b2c1-cc033c997e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:39.998241 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775ab7b-0bab-4516-b2c1-cc033c997e13 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:39.998941 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7775ab7b-0bab-4516-b2c1-cc033c997e13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:40.000626 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7775ab7b-0bab-4516-b2c1-cc033c997e13 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:40.002109 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b9ae27-00cc-4aa8-9c0f-ae11b83ccf93 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:40.019778 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1032/2081] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:39 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:40.022949 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775ab7b-0bab-4516-b2c1-cc033c997e13 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:40.030784 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe891c6a-aede-4a34-960f-7d1487bf1be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:40.031619 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe891c6a-aede-4a34-960f-7d1487bf1be2 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:40.032182 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe891c6a-aede-4a34-960f-7d1487bf1be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:40.032311 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe891c6a-aede-4a34-960f-7d1487bf1be2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:40.032957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe891c6a-aede-4a34-960f-7d1487bf1be2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:40.038055 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe891c6a-aede-4a34-960f-7d1487bf1be2 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:40.048239 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775ab7b-0bab-4516-b2c1-cc033c997e13 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:40.071476 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d47e7-726a-4cf0-8e5f-9e721434b9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:40.072170 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d47e7-726a-4cf0-8e5f-9e721434b9ac admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:40.072828 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d47e7-726a-4cf0-8e5f-9e721434b9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:40.073200 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d47e7-726a-4cf0-8e5f-9e721434b9ac admin admin] PATH_INFO: `/v3/projects/7261af070ed14fdba6888924eefb492a/users/30d7f5f663fe43aaa83d4f896fc177db/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:40.102432 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1050/2082] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:38:39 2022] POST /identity/v3/projects => generated 397 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:38:40.106666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe891c6a-aede-4a34-960f-7d1487bf1be2 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:40.128714 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d47e7-726a-4cf0-8e5f-9e721434b9ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=7261af070ed14fdba6888924eefb492a, user_id=30d7f5f663fe43aaa83d4f896fc177db, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:40.134651 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d47e7-726a-4cf0-8e5f-9e721434b9ac admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:40.205359 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1033/2083] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:38:40 2022] PUT /identity/v3/projects/7261af070ed14fdba6888924eefb492a/users/30d7f5f663fe43aaa83d4f896fc177db/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:40.206488 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d47e7-726a-4cf0-8e5f-9e721434b9ac admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:40.216795 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-659d47e7-726a-4cf0-8e5f-9e721434b9ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:40.310479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe891c6a-aede-4a34-960f-7d1487bf1be2 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:40.316243 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:40.336276 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d47e7-726a-4cf0-8e5f-9e721434b9ac admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:40.344181 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e706f50-e696-4112-a463-4c7c6efe25f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:40.345115 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e706f50-e696-4112-a463-4c7c6efe25f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:40.345505 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e706f50-e696-4112-a463-4c7c6efe25f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:40.345776 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e706f50-e696-4112-a463-4c7c6efe25f4 admin admin] PATH_INFO: `/v3/projects/ad02710a3a7e4eb59b295ba888a328a4` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:40.347194 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e706f50-e696-4112-a463-4c7c6efe25f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad02710a3a7e4eb59b295ba888a328a4)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:40.350199 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e706f50-e696-4112-a463-4c7c6efe25f4 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:40.391628 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5decd-8252-4af4-81e9-9082c295ace8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:40.392412 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5decd-8252-4af4-81e9-9082c295ace8 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:40.392762 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5decd-8252-4af4-81e9-9082c295ace8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:40.393724 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5decd-8252-4af4-81e9-9082c295ace8 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:40.394428 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e5decd-8252-4af4-81e9-9082c295ace8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:40.398769 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e5decd-8252-4af4-81e9-9082c295ace8 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:40.444613 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1051/2084] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:38:40 2022] POST /identity/v3/users => generated 299 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:40.450774 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5c7ab-2413-4e50-994c-afc732237770 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:40.450924 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5c7ab-2413-4e50-994c-afc732237770 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:40.451214 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5c7ab-2413-4e50-994c-afc732237770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:40.465624 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1e706f50-e696-4112-a463-4c7c6efe25f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad02710a3a7e4eb59b295ba888a328a4', 'request_id': 'req-1e706f50-e696-4112-a463-4c7c6efe25f4'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:40.470285 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:40.494471 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1e706f50-e696-4112-a463-4c7c6efe25f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad02710a3a7e4eb59b295ba888a328a4', 'request_id': 'req-1e706f50-e696-4112-a463-4c7c6efe25f4'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:40.507980 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-63f5c7ab-2413-4e50-994c-afc732237770 None None] MFA Rules not processed for user `30d7f5f663fe43aaa83d4f896fc177db`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:40.508543 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1e706f50-e696-4112-a463-4c7c6efe25f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad02710a3a7e4eb59b295ba888a328a4', 'request_id': 'req-1e706f50-e696-4112-a463-4c7c6efe25f4'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:40.509451 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-63f5c7ab-2413-4e50-994c-afc732237770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:40.544406 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1e706f50-e696-4112-a463-4c7c6efe25f4 admin admin] The token cache is being invalidate because project ad02710a3a7e4eb59b295ba888a328a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:38:40.545679 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1e706f50-e696-4112-a463-4c7c6efe25f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:40.550621 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1e706f50-e696-4112-a463-4c7c6efe25f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:40.554977 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1034/2085] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:38:40 2022] DELETE /identity/v3/projects/ad02710a3a7e4eb59b295ba888a328a4 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:40.559972 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e706f50-e696-4112-a463-4c7c6efe25f4 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:40.563925 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1e706f50-e696-4112-a463-4c7c6efe25f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:40.612355 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1052/2086] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:40 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:40.613904 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519189bf-937c-4d50-a913-56098a76f8d6 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:40.614189 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519189bf-937c-4d50-a913-56098a76f8d6 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:40.614461 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519189bf-937c-4d50-a913-56098a76f8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:40.668594 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-519189bf-937c-4d50-a913-56098a76f8d6 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:40.669860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-519189bf-937c-4d50-a913-56098a76f8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:40.698897 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e706f50-e696-4112-a463-4c7c6efe25f4 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:40.707731 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6551d0-d8cf-4010-88e8-b69f5ffd97cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:40.708370 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6551d0-d8cf-4010-88e8-b69f5ffd97cf admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:40.709158 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6551d0-d8cf-4010-88e8-b69f5ffd97cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:40.709528 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6551d0-d8cf-4010-88e8-b69f5ffd97cf admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:40.710974 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6551d0-d8cf-4010-88e8-b69f5ffd97cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:40.713246 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6551d0-d8cf-4010-88e8-b69f5ffd97cf admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:40.743664 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1035/2087] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:40.744703 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6551d0-d8cf-4010-88e8-b69f5ffd97cf admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:40.746724 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1b6551d0-d8cf-4010-88e8-b69f5ffd97cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:40.767523 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6551d0-d8cf-4010-88e8-b69f5ffd97cf admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:40.781865 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48873b7-2bc4-4a37-8c9b-6cc868da1c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:40.783076 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48873b7-2bc4-4a37-8c9b-6cc868da1c5c admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:40.783368 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48873b7-2bc4-4a37-8c9b-6cc868da1c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:40.783640 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48873b7-2bc4-4a37-8c9b-6cc868da1c5c admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:40.784292 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48873b7-2bc4-4a37-8c9b-6cc868da1c5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:40.786222 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48873b7-2bc4-4a37-8c9b-6cc868da1c5c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:40.795647 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1053/2088] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:40.796768 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519189bf-937c-4d50-a913-56098a76f8d6 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:40.824042 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519189bf-937c-4d50-a913-56098a76f8d6 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:40.833231 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1036/2089] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:38:40 2022] POST /identity/v3/projects => generated 393 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:40.834255 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875984e1-1c47-4b00-ad1e-1e6a05e45d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:40.834951 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875984e1-1c47-4b00-ad1e-1e6a05e45d08 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:40.835280 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875984e1-1c47-4b00-ad1e-1e6a05e45d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:40.835614 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875984e1-1c47-4b00-ad1e-1e6a05e45d08 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:40.835712 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9c24c-6f2f-45de-b405-53e94d764a68 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:40.835898 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9c24c-6f2f-45de-b405-53e94d764a68 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:40.836170 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9c24c-6f2f-45de-b405-53e94d764a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:40.836262 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875984e1-1c47-4b00-ad1e-1e6a05e45d08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:40.838166 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875984e1-1c47-4b00-ad1e-1e6a05e45d08 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:40.850232 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1054/2090] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:40.867112 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875984e1-1c47-4b00-ad1e-1e6a05e45d08 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:40.873476 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-eef9c24c-6f2f-45de-b405-53e94d764a68 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:40.875194 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-eef9c24c-6f2f-45de-b405-53e94d764a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:40.904529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875984e1-1c47-4b00-ad1e-1e6a05e45d08 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:40.932561 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:40.985178 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1037/2091] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:40.989506 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9c24c-6f2f-45de-b405-53e94d764a68 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:41.000429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9c24c-6f2f-45de-b405-53e94d764a68 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:41.007148 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb9041-4bb2-473b-940e-189691ffb99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:41.008283 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb9041-4bb2-473b-940e-189691ffb99c admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:41.008594 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb9041-4bb2-473b-940e-189691ffb99c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:41.009485 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb9041-4bb2-473b-940e-189691ffb99c admin admin] PATH_INFO: `/v3/projects/2da09625509a4cb883cfd164e66dc795/users/93b93788fbf74965a928d861437f36c6/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:41.018429 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728cc3ea-a6a7-4d4b-b936-b310c81264d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:41.019082 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728cc3ea-a6a7-4d4b-b936-b310c81264d8 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:41.019403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728cc3ea-a6a7-4d4b-b936-b310c81264d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:41.019672 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728cc3ea-a6a7-4d4b-b936-b310c81264d8 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:41.020309 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728cc3ea-a6a7-4d4b-b936-b310c81264d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:41.023254 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728cc3ea-a6a7-4d4b-b936-b310c81264d8 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:41.030502 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbb9041-4bb2-473b-940e-189691ffb99c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2da09625509a4cb883cfd164e66dc795, user_id=93b93788fbf74965a928d861437f36c6, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:41.035815 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbb9041-4bb2-473b-940e-189691ffb99c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:41.051195 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1055/2092] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:38:40 2022] POST /identity/v3/users => generated 303 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:41.052422 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728cc3ea-a6a7-4d4b-b936-b310c81264d8 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:41.053581 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1038/2093] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:38:40 2022] PUT /identity/v3/projects/2da09625509a4cb883cfd164e66dc795/users/93b93788fbf74965a928d861437f36c6/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:41.054543 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb9041-4bb2-473b-940e-189691ffb99c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:41.057631 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-728cc3ea-a6a7-4d4b-b936-b310c81264d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:41.076790 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728cc3ea-a6a7-4d4b-b936-b310c81264d8 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:41.103553 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:41.175382 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb9041-4bb2-473b-940e-189691ffb99c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:41.185395 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ab9d6-5bb9-4b0a-bea5-865272e78400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:41.187198 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ab9d6-5bb9-4b0a-bea5-865272e78400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:41.187777 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ab9d6-5bb9-4b0a-bea5-865272e78400 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:41.188227 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ab9d6-5bb9-4b0a-bea5-865272e78400 admin admin] PATH_INFO: `/v3/projects/a63b84eca3324578bdefd2847fa23158` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:41.189085 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ae11e-ccf7-4650-9602-2666fb42829f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:41.189983 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ae11e-ccf7-4650-9602-2666fb42829f admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:41.190334 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ae11e-ccf7-4650-9602-2666fb42829f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:41.190683 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ae11e-ccf7-4650-9602-2666fb42829f admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:41.191334 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9ab9d6-5bb9-4b0a-bea5-865272e78400 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a63b84eca3324578bdefd2847fa23158)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:41.191442 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ae11e-ccf7-4650-9602-2666fb42829f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:38:41.192485 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ae11e-ccf7-4650-9602-2666fb42829f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:41.194313 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9ab9d6-5bb9-4b0a-bea5-865272e78400 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:41.198047 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ae11e-ccf7-4650-9602-2666fb42829f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:41.230731 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1039/2094] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:38:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:38:41.235733 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ae11e-ccf7-4650-9602-2666fb42829f admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:41.253085 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ae11e-ccf7-4650-9602-2666fb42829f admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:41.272780 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3c097-e2fb-4572-b865-07ad9598028c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:41.273660 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3c097-e2fb-4572-b865-07ad9598028c admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:41.274256 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3c097-e2fb-4572-b865-07ad9598028c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:41.274537 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3c097-e2fb-4572-b865-07ad9598028c admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:41.276558 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b3c097-e2fb-4572-b865-07ad9598028c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:41.278258 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b3c097-e2fb-4572-b865-07ad9598028c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:41.305790 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2a9ab9d6-5bb9-4b0a-bea5-865272e78400 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a63b84eca3324578bdefd2847fa23158', 'request_id': 'req-2a9ab9d6-5bb9-4b0a-bea5-865272e78400'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:41.310240 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1040/2095] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:41.313150 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2a9ab9d6-5bb9-4b0a-bea5-865272e78400 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a63b84eca3324578bdefd2847fa23158', 'request_id': 'req-2a9ab9d6-5bb9-4b0a-bea5-865272e78400'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:41.317487 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e15a02-7791-4546-8e2c-fea723f2c867 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:41.317686 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e15a02-7791-4546-8e2c-fea723f2c867 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:41.318489 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e15a02-7791-4546-8e2c-fea723f2c867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:41.329402 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2a9ab9d6-5bb9-4b0a-bea5-865272e78400 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a63b84eca3324578bdefd2847fa23158', 'request_id': 'req-2a9ab9d6-5bb9-4b0a-bea5-865272e78400'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:41.352669 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2a9ab9d6-5bb9-4b0a-bea5-865272e78400 admin admin] The token cache is being invalidate because project a63b84eca3324578bdefd2847fa23158 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:38:41.353376 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2a9ab9d6-5bb9-4b0a-bea5-865272e78400 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:41.353660 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2a9ab9d6-5bb9-4b0a-bea5-865272e78400 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:41.360591 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1056/2096] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:38:41 2022] DELETE /identity/v3/projects/a63b84eca3324578bdefd2847fa23158 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:41.361519 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ab9d6-5bb9-4b0a-bea5-865272e78400 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:41.371497 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2a9ab9d6-5bb9-4b0a-bea5-865272e78400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:41.378999 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-c5e15a02-7791-4546-8e2c-fea723f2c867 None None] MFA Rules not processed for user `93b93788fbf74965a928d861437f36c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:41.379829 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c5e15a02-7791-4546-8e2c-fea723f2c867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:41.449705 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:41.517971 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ab9d6-5bb9-4b0a-bea5-865272e78400 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:41.529827 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e243c7f3-107a-4087-8600-3dbb2e2f78a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:41.531418 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243c7f3-107a-4087-8600-3dbb2e2f78a9 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:41.532168 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243c7f3-107a-4087-8600-3dbb2e2f78a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:41.532630 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243c7f3-107a-4087-8600-3dbb2e2f78a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:41.533466 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e243c7f3-107a-4087-8600-3dbb2e2f78a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:41.535639 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e243c7f3-107a-4087-8600-3dbb2e2f78a9 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:41.543890 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1041/2097] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:41 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:41.543890 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e15a02-7791-4546-8e2c-fea723f2c867 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:41.554055 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c5e15a02-7791-4546-8e2c-fea723f2c867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:41.586516 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e15a02-7791-4546-8e2c-fea723f2c867 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:41.593026 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1057/2098] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:38:41 2022] POST /identity/v3/projects => generated 393 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:41.594973 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e243c7f3-107a-4087-8600-3dbb2e2f78a9 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:41.597624 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d4c0dc-8ff8-4391-9b76-31a0356efc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:41.598312 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d4c0dc-8ff8-4391-9b76-31a0356efc93 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:41.598589 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d4c0dc-8ff8-4391-9b76-31a0356efc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:41.598862 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d4c0dc-8ff8-4391-9b76-31a0356efc93 admin admin] PATH_INFO: `/v3/projects/c72d064008ff43c9b5a6d851503ef3e4/users/89dd90556e0448b9a4d529d0c598ce5b/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:41.599219 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e243c7f3-107a-4087-8600-3dbb2e2f78a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:41.635798 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d4c0dc-8ff8-4391-9b76-31a0356efc93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c72d064008ff43c9b5a6d851503ef3e4, user_id=89dd90556e0448b9a4d529d0c598ce5b, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:41.638490 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d4c0dc-8ff8-4391-9b76-31a0356efc93 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:41.664654 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1042/2099] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:38:41 2022] PUT /identity/v3/projects/c72d064008ff43c9b5a6d851503ef3e4/users/89dd90556e0448b9a4d529d0c598ce5b/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:41.664654 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d4c0dc-8ff8-4391-9b76-31a0356efc93 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:41.667856 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-58d4c0dc-8ff8-4391-9b76-31a0356efc93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:41.731989 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e243c7f3-107a-4087-8600-3dbb2e2f78a9 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:41.801632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d4c0dc-8ff8-4391-9b76-31a0356efc93 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:41.811429 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319fa5a6-f930-457f-98bd-ed58820cd51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:41.812151 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319fa5a6-f930-457f-98bd-ed58820cd51c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:41.812478 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319fa5a6-f930-457f-98bd-ed58820cd51c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:41.812756 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319fa5a6-f930-457f-98bd-ed58820cd51c admin admin] PATH_INFO: `/v3/users/f8045d0542154b06b845a173a438d6e2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:41.814030 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319fa5a6-f930-457f-98bd-ed58820cd51c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8045d0542154b06b845a173a438d6e2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:41.816324 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319fa5a6-f930-457f-98bd-ed58820cd51c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:41.818877 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45238c05-b702-48b9-bbdf-2907e77df850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:41.819550 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45238c05-b702-48b9-bbdf-2907e77df850 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:41.819828 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45238c05-b702-48b9-bbdf-2907e77df850 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:41.820098 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45238c05-b702-48b9-bbdf-2907e77df850 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:41.820754 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45238c05-b702-48b9-bbdf-2907e77df850 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:41.822723 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45238c05-b702-48b9-bbdf-2907e77df850 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:41.887437 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1043/2100] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:38:41 2022] POST /identity/v3/projects => generated 399 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:41.889196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45238c05-b702-48b9-bbdf-2907e77df850 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:41.898401 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:41.910562 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-319fa5a6-f930-457f-98bd-ed58820cd51c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8045d0542154b06b845a173a438d6e2'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:41.914430 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-319fa5a6-f930-457f-98bd-ed58820cd51c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8045d0542154b06b845a173a438d6e2'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:41.948842 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-319fa5a6-f930-457f-98bd-ed58820cd51c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8045d0542154b06b845a173a438d6e2'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:41.953467 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:41.969918 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-319fa5a6-f930-457f-98bd-ed58820cd51c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8045d0542154b06b845a173a438d6e2'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:41.991509 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-319fa5a6-f930-457f-98bd-ed58820cd51c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8045d0542154b06b845a173a438d6e2'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:42.009242 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1058/2101] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:38:41 2022] DELETE /identity/v3/users/f8045d0542154b06b845a173a438d6e2 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:42.018022 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319fa5a6-f930-457f-98bd-ed58820cd51c admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:42.023992 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-319fa5a6-f930-457f-98bd-ed58820cd51c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:42.048548 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45238c05-b702-48b9-bbdf-2907e77df850 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:42.148874 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28481e-cd4f-48c4-ba24-ed2e226f43c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:42.150386 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28481e-cd4f-48c4-ba24-ed2e226f43c7 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:42.150685 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28481e-cd4f-48c4-ba24-ed2e226f43c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:42.150989 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28481e-cd4f-48c4-ba24-ed2e226f43c7 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:42.151826 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e28481e-cd4f-48c4-ba24-ed2e226f43c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:42.155208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e28481e-cd4f-48c4-ba24-ed2e226f43c7 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:42.199192 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319fa5a6-f930-457f-98bd-ed58820cd51c admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:42.206624 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1044/2102] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:38:41 2022] POST /identity/v3/users => generated 297 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:42.210160 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28481e-cd4f-48c4-ba24-ed2e226f43c7 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:42.213579 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5e28481e-cd4f-48c4-ba24-ed2e226f43c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:42.214913 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ab61d-653f-47e9-9f1b-87c1803e00cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:42.215755 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ab61d-653f-47e9-9f1b-87c1803e00cf admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:42.216109 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ab61d-653f-47e9-9f1b-87c1803e00cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:42.216456 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ab61d-653f-47e9-9f1b-87c1803e00cf admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:42.217376 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ab61d-653f-47e9-9f1b-87c1803e00cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:42.219114 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ab61d-653f-47e9-9f1b-87c1803e00cf admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:42.247560 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1059/2103] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:42.257594 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28481e-cd4f-48c4-ba24-ed2e226f43c7 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:42.262048 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ab61d-653f-47e9-9f1b-87c1803e00cf admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:42.272812 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-991ab61d-653f-47e9-9f1b-87c1803e00cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:42.274946 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2274bce9-81c7-4e43-a188-bbbf83e99c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:42.276058 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274bce9-81c7-4e43-a188-bbbf83e99c81 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:42.277720 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274bce9-81c7-4e43-a188-bbbf83e99c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:42.278197 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274bce9-81c7-4e43-a188-bbbf83e99c81 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:42.281882 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2274bce9-81c7-4e43-a188-bbbf83e99c81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:42.283986 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2274bce9-81c7-4e43-a188-bbbf83e99c81 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:42.312183 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ab61d-653f-47e9-9f1b-87c1803e00cf admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:42.336972 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1045/2104] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:38:42 2022] POST /identity/v3/users => generated 306 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:42.338310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2274bce9-81c7-4e43-a188-bbbf83e99c81 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:42.341490 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c35f6-c1e4-4441-b66b-e8c21cc6d3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:42.342128 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c35f6-c1e4-4441-b66b-e8c21cc6d3cc admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:42.342409 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c35f6-c1e4-4441-b66b-e8c21cc6d3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:42.342839 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c35f6-c1e4-4441-b66b-e8c21cc6d3cc admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:42.343683 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5c35f6-c1e4-4441-b66b-e8c21cc6d3cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:42.345334 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5c35f6-c1e4-4441-b66b-e8c21cc6d3cc admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:42.360876 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2274bce9-81c7-4e43-a188-bbbf83e99c81 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:42.367015 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1060/2105] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:42.370663 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c35f6-c1e4-4441-b66b-e8c21cc6d3cc admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:42.379865 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7dc8a1-e4e7-4ee5-a4c0-037649bd7ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:42.381368 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7dc8a1-e4e7-4ee5-a4c0-037649bd7ce1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:42.381684 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7dc8a1-e4e7-4ee5-a4c0-037649bd7ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:42.381996 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7dc8a1-e4e7-4ee5-a4c0-037649bd7ce1 admin admin] PATH_INFO: `/v3/projects/c72d064008ff43c9b5a6d851503ef3e4/users/89dd90556e0448b9a4d529d0c598ce5b/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:42.384193 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7dc8a1-e4e7-4ee5-a4c0-037649bd7ce1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c72d064008ff43c9b5a6d851503ef3e4, user_id=89dd90556e0448b9a4d529d0c598ce5b, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:42.389360 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7dc8a1-e4e7-4ee5-a4c0-037649bd7ce1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:42.393029 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c35f6-c1e4-4441-b66b-e8c21cc6d3cc admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:42.407576 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf97213-14b6-4aff-9f90-996a4803e9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:42.408055 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf97213-14b6-4aff-9f90-996a4803e9ed admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:42.408335 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf97213-14b6-4aff-9f90-996a4803e9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:42.408612 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf97213-14b6-4aff-9f90-996a4803e9ed admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:42.409265 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf97213-14b6-4aff-9f90-996a4803e9ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:42.410704 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1046/2106] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:38:42 2022] PUT /identity/v3/projects/c72d064008ff43c9b5a6d851503ef3e4/users/89dd90556e0448b9a4d529d0c598ce5b/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:42.415920 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7dc8a1-e4e7-4ee5-a4c0-037649bd7ce1 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:42.421297 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf97213-14b6-4aff-9f90-996a4803e9ed admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:42.454182 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1061/2107] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:42.455636 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba4d92-d894-4386-8e19-f4f672a675c7 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:42.455929 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba4d92-d894-4386-8e19-f4f672a675c7 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:42.459637 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba4d92-d894-4386-8e19-f4f672a675c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:42.524272 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7dc8a1-e4e7-4ee5-a4c0-037649bd7ce1 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:42.526757 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-54ba4d92-d894-4386-8e19-f4f672a675c7 None None] MFA Rules not processed for user `89dd90556e0448b9a4d529d0c598ce5b`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:42.528466 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-54ba4d92-d894-4386-8e19-f4f672a675c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:42.534129 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd859d-d0b2-47b0-ad33-2945dedc1bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:42.534755 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd859d-d0b2-47b0-ad33-2945dedc1bcf admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:42.535052 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd859d-d0b2-47b0-ad33-2945dedc1bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:42.535333 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd859d-d0b2-47b0-ad33-2945dedc1bcf admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:42.535985 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbd859d-d0b2-47b0-ad33-2945dedc1bcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:42.538283 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbd859d-d0b2-47b0-ad33-2945dedc1bcf admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:42.559128 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1047/2108] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:42.559128 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd859d-d0b2-47b0-ad33-2945dedc1bcf admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:42.570814 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:42.578976 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd859d-d0b2-47b0-ad33-2945dedc1bcf admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:42.588226 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f59db6-6628-40fe-a534-60d86dd22082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:42.589147 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f59db6-6628-40fe-a534-60d86dd22082 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:42.589617 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f59db6-6628-40fe-a534-60d86dd22082 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:42.589904 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f59db6-6628-40fe-a534-60d86dd22082 admin admin] PATH_INFO: `/v3/projects/7f0ab849ef5645f093be2726cdee452c/users/6a9cc3578acc48fdbeef31b84ff27d4c/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:42.611655 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f59db6-6628-40fe-a534-60d86dd22082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f0ab849ef5645f093be2726cdee452c, user_id=6a9cc3578acc48fdbeef31b84ff27d4c, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:42.616503 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f59db6-6628-40fe-a534-60d86dd22082 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:42.634470 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1048/2109] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:38:42 2022] PUT /identity/v3/projects/7f0ab849ef5645f093be2726cdee452c/users/6a9cc3578acc48fdbeef31b84ff27d4c/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:42.635602 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f59db6-6628-40fe-a534-60d86dd22082 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:42.662409 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1062/2110] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:42 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:42.675405 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba4d92-d894-4386-8e19-f4f672a675c7 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:42.695195 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba4d92-d894-4386-8e19-f4f672a675c7 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:42.762279 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:42.777250 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f59db6-6628-40fe-a534-60d86dd22082 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:42.789388 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb720356-029e-40ab-9fb6-544f61ae0ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:42.790163 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb720356-029e-40ab-9fb6-544f61ae0ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:42.790444 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb720356-029e-40ab-9fb6-544f61ae0ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:42.790713 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb720356-029e-40ab-9fb6-544f61ae0ef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:42.791379 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8d37c-693a-48bd-8525-6fc7956a19a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:42.791504 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb720356-029e-40ab-9fb6-544f61ae0ef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:42.792376 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8d37c-693a-48bd-8525-6fc7956a19a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:42.792855 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8d37c-693a-48bd-8525-6fc7956a19a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:42.793127 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb720356-029e-40ab-9fb6-544f61ae0ef8 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:42.794204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8d37c-693a-48bd-8525-6fc7956a19a5 admin admin] PATH_INFO: `/v3/projects/a75d546db2fb40baa9ad3d22fbeb7ce1/users/9219bd04e3094ffabddfc2b0d2e18583/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:42.809586 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1063/2111] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:42.809586 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dacba8-fa49-466f-b48d-554a5f68ccad None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:42.809586 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dacba8-fa49-466f-b48d-554a5f68ccad None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:42.809586 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dacba8-fa49-466f-b48d-554a5f68ccad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:42.816627 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b8d37c-693a-48bd-8525-6fc7956a19a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a75d546db2fb40baa9ad3d22fbeb7ce1, user_id=9219bd04e3094ffabddfc2b0d2e18583, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:42.820443 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b8d37c-693a-48bd-8525-6fc7956a19a5 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:42.830902 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-e1dacba8-fa49-466f-b48d-554a5f68ccad None None] MFA Rules not processed for user `30d7f5f663fe43aaa83d4f896fc177db`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:42.832473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e1dacba8-fa49-466f-b48d-554a5f68ccad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:42.869413 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1049/2112] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:38:42 2022] PUT /identity/v3/projects/a75d546db2fb40baa9ad3d22fbeb7ce1/users/9219bd04e3094ffabddfc2b0d2e18583/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:42.873333 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8d37c-693a-48bd-8525-6fc7956a19a5 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:42.876213 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a3b8d37c-693a-48bd-8525-6fc7956a19a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:42.919227 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1064/2113] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:42 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:42.919227 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dacba8-fa49-466f-b48d-554a5f68ccad None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:43.005184 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dacba8-fa49-466f-b48d-554a5f68ccad None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:43.006791 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8d37c-693a-48bd-8525-6fc7956a19a5 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:43.012519 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3cd5d-d5d9-4a6e-aa7f-5e3f209fb157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:43.013403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3cd5d-d5d9-4a6e-aa7f-5e3f209fb157 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:43.013744 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3cd5d-d5d9-4a6e-aa7f-5e3f209fb157 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:43.014125 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3cd5d-d5d9-4a6e-aa7f-5e3f209fb157 admin admin] PATH_INFO: `/v3/projects/7f0ab849ef5645f093be2726cdee452c/users/6a9cc3578acc48fdbeef31b84ff27d4c/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:43.017028 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f3cd5d-d5d9-4a6e-aa7f-5e3f209fb157 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f0ab849ef5645f093be2726cdee452c, user_id=6a9cc3578acc48fdbeef31b84ff27d4c, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:43.020024 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056cbaff-b67d-43b8-b23a-51c6d56179d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:43.020396 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f3cd5d-d5d9-4a6e-aa7f-5e3f209fb157 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:43.021204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056cbaff-b67d-43b8-b23a-51c6d56179d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:43.022385 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056cbaff-b67d-43b8-b23a-51c6d56179d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:43.022825 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056cbaff-b67d-43b8-b23a-51c6d56179d4 admin admin] PATH_INFO: `/v3/projects/23102ab5fb294dd58fbce2d1550b0c64` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:43.024702 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056cbaff-b67d-43b8-b23a-51c6d56179d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23102ab5fb294dd58fbce2d1550b0c64)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:43.027098 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056cbaff-b67d-43b8-b23a-51c6d56179d4 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:43.034603 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1065/2114] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:38:42 2022] PUT /identity/v3/projects/7f0ab849ef5645f093be2726cdee452c/users/6a9cc3578acc48fdbeef31b84ff27d4c/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:43.036337 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ebd62-cb6e-445d-b164-651a88ec6509 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:43.036887 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ebd62-cb6e-445d-b164-651a88ec6509 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:43.037235 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ebd62-cb6e-445d-b164-651a88ec6509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:43.085061 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-704ebd62-cb6e-445d-b164-651a88ec6509 None None] MFA Rules not processed for user `9219bd04e3094ffabddfc2b0d2e18583`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:43.086626 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-704ebd62-cb6e-445d-b164-651a88ec6509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:43.122718 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-056cbaff-b67d-43b8-b23a-51c6d56179d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23102ab5fb294dd58fbce2d1550b0c64', 'request_id': 'req-056cbaff-b67d-43b8-b23a-51c6d56179d4'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:43.162090 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-056cbaff-b67d-43b8-b23a-51c6d56179d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23102ab5fb294dd58fbce2d1550b0c64', 'request_id': 'req-056cbaff-b67d-43b8-b23a-51c6d56179d4'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:43.178653 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-056cbaff-b67d-43b8-b23a-51c6d56179d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23102ab5fb294dd58fbce2d1550b0c64', 'request_id': 'req-056cbaff-b67d-43b8-b23a-51c6d56179d4'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:43.182915 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:43.205561 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-056cbaff-b67d-43b8-b23a-51c6d56179d4 admin admin] The token cache is being invalidate because project 23102ab5fb294dd58fbce2d1550b0c64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:38:43.206754 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-056cbaff-b67d-43b8-b23a-51c6d56179d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:43.207989 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-056cbaff-b67d-43b8-b23a-51c6d56179d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:43.217375 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1050/2115] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:38:42 2022] DELETE /identity/v3/projects/23102ab5fb294dd58fbce2d1550b0c64 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:43.222617 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056cbaff-b67d-43b8-b23a-51c6d56179d4 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:43.226771 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-056cbaff-b67d-43b8-b23a-51c6d56179d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:43.275466 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1066/2116] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:43 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:43.276975 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99107537-3c66-4c75-8d15-230f7030c3ca None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:43.277326 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99107537-3c66-4c75-8d15-230f7030c3ca None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:43.277666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99107537-3c66-4c75-8d15-230f7030c3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:43.311553 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:43.323148 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-99107537-3c66-4c75-8d15-230f7030c3ca None None] MFA Rules not processed for user `6a9cc3578acc48fdbeef31b84ff27d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:43.324770 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-99107537-3c66-4c75-8d15-230f7030c3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:43.383099 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056cbaff-b67d-43b8-b23a-51c6d56179d4 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:43.393622 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d589e-afad-4f51-843b-1ad7e69b622d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:43.394352 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d589e-afad-4f51-843b-1ad7e69b622d service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:43.394636 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d589e-afad-4f51-843b-1ad7e69b622d service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:43.394907 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d589e-afad-4f51-843b-1ad7e69b622d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:43.403838 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-493d589e-afad-4f51-843b-1ad7e69b622d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:43.495291 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1067/2117] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:43 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:43.495291 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d9fc3-102e-40b7-9ede-ffa2d9b5d705 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:43.495291 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d9fc3-102e-40b7-9ede-ffa2d9b5d705 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:43.495291 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d9fc3-102e-40b7-9ede-ffa2d9b5d705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:43.532324 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-172d9fc3-102e-40b7-9ede-ffa2d9b5d705 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:43.533662 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-172d9fc3-102e-40b7-9ede-ffa2d9b5d705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:43.577266 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d589e-afad-4f51-843b-1ad7e69b622d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:43.583490 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d589e-afad-4f51-843b-1ad7e69b622d service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:43.605618 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1051/2118] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:43 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:38:43.607126 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d589e-afad-4f51-843b-1ad7e69b622d service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:43.615526 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-493d589e-afad-4f51-843b-1ad7e69b622d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:43.669387 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1068/2119] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:43.679487 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c387c-3b0b-48fe-bb89-504a838a3790 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:43.683208 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c387c-3b0b-48fe-bb89-504a838a3790 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:43.683671 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c387c-3b0b-48fe-bb89-504a838a3790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:43.720640 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-b64c387c-3b0b-48fe-bb89-504a838a3790 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:43.722249 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b64c387c-3b0b-48fe-bb89-504a838a3790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:43.777142 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1069/2120] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:43.777142 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c387c-3b0b-48fe-bb89-504a838a3790 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:43.784021 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b64c387c-3b0b-48fe-bb89-504a838a3790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:43.788459 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d589e-afad-4f51-843b-1ad7e69b622d service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:43.808967 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d32abb-9fad-402b-bcf0-8a8e9b1f0604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:43.809960 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d32abb-9fad-402b-bcf0-8a8e9b1f0604 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:43.810515 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d32abb-9fad-402b-bcf0-8a8e9b1f0604 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:43.810937 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d32abb-9fad-402b-bcf0-8a8e9b1f0604 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:43.811765 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d32abb-9fad-402b-bcf0-8a8e9b1f0604 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:43.813869 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d32abb-9fad-402b-bcf0-8a8e9b1f0604 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:43.825989 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c387c-3b0b-48fe-bb89-504a838a3790 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:43.843753 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8d093-cef9-44a7-899b-99b80bd4fca7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:43.844659 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8d093-cef9-44a7-899b-99b80bd4fca7 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:43.844945 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8d093-cef9-44a7-899b-99b80bd4fca7 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:43.845218 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8d093-cef9-44a7-899b-99b80bd4fca7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:43.850806 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-aea8d093-cef9-44a7-899b-99b80bd4fca7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:43.883149 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1052/2121] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:38:43 2022] POST /identity/v3/projects => generated 393 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:43.884120 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d32abb-9fad-402b-bcf0-8a8e9b1f0604 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:43.916342 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:44.003391 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea8d093-cef9-44a7-899b-99b80bd4fca7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:44.005040 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea8d093-cef9-44a7-899b-99b80bd4fca7 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:44.022323 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d32abb-9fad-402b-bcf0-8a8e9b1f0604 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:44.040859 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1070/2122] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:43 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:38:44.041651 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8d093-cef9-44a7-899b-99b80bd4fca7 service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:44.044432 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e3a47-c38a-43d3-839c-f136842f553d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:44.045180 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e3a47-c38a-43d3-839c-f136842f553d admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:44.045492 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e3a47-c38a-43d3-839c-f136842f553d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:44.045767 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e3a47-c38a-43d3-839c-f136842f553d admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:44.056679 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e3a47-c38a-43d3-839c-f136842f553d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:38:44.056679 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e3a47-c38a-43d3-839c-f136842f553d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:44.057830 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e3a47-c38a-43d3-839c-f136842f553d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:44.084963 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8d093-cef9-44a7-899b-99b80bd4fca7 service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:44.101799 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1053/2123] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:38:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:38:44.102424 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e3a47-c38a-43d3-839c-f136842f553d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:44.104524 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f1b20-6ec1-42fd-8b7f-5d8d1883c7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:44.105157 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f1b20-6ec1-42fd-8b7f-5d8d1883c7c8 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:44.105514 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f1b20-6ec1-42fd-8b7f-5d8d1883c7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:44.105740 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f1b20-6ec1-42fd-8b7f-5d8d1883c7c8 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:44.106386 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f1b20-6ec1-42fd-8b7f-5d8d1883c7c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:44.118765 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f1b20-6ec1-42fd-8b7f-5d8d1883c7c8 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:44.129632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e3a47-c38a-43d3-839c-f136842f553d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:44.140889 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873bf00e-2ec7-4e03-b6ec-5872c13389f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:44.141507 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873bf00e-2ec7-4e03-b6ec-5872c13389f0 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:44.141935 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873bf00e-2ec7-4e03-b6ec-5872c13389f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:44.142370 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873bf00e-2ec7-4e03-b6ec-5872c13389f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:44.143048 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873bf00e-2ec7-4e03-b6ec-5872c13389f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:44.145167 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873bf00e-2ec7-4e03-b6ec-5872c13389f0 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:44.165621 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1071/2124] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:38:44 2022] POST /identity/v3/users => generated 303 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:44.165621 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f1b20-6ec1-42fd-8b7f-5d8d1883c7c8 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:44.189340 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f1b20-6ec1-42fd-8b7f-5d8d1883c7c8 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:44.198439 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16952566-f1fb-4d06-810d-23be5c86e788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:44.199094 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16952566-f1fb-4d06-810d-23be5c86e788 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:44.199457 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16952566-f1fb-4d06-810d-23be5c86e788 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:44.199794 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16952566-f1fb-4d06-810d-23be5c86e788 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:44.200971 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16952566-f1fb-4d06-810d-23be5c86e788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:44.208221 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16952566-f1fb-4d06-810d-23be5c86e788 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:44.226036 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1054/2125] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:38:44 2022] POST /identity/v3/projects => generated 401 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:44.227799 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873bf00e-2ec7-4e03-b6ec-5872c13389f0 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:44.234990 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:44.255502 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1072/2126] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:44.257840 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16952566-f1fb-4d06-810d-23be5c86e788 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:44.281345 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16952566-f1fb-4d06-810d-23be5c86e788 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:44.421781 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873bf00e-2ec7-4e03-b6ec-5872c13389f0 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:44.430456 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d98e7-741e-4fe0-b5a3-9abe6562fba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:44.431273 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d98e7-741e-4fe0-b5a3-9abe6562fba0 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:44.431849 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d98e7-741e-4fe0-b5a3-9abe6562fba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:44.432267 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d98e7-741e-4fe0-b5a3-9abe6562fba0 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:44.434041 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d98e7-741e-4fe0-b5a3-9abe6562fba0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:44.437637 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e2f6b4-58f6-4ed5-959c-ce868838337b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:44.438682 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2f6b4-58f6-4ed5-959c-ce868838337b admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:44.438998 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d98e7-741e-4fe0-b5a3-9abe6562fba0 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:44.439437 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2f6b4-58f6-4ed5-959c-ce868838337b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:44.439972 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2f6b4-58f6-4ed5-959c-ce868838337b admin admin] PATH_INFO: `/v3/projects/ecea19ee353d4977baafbdf022b94887/users/9a1de22711264e42abe8de3f935f35b1/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:44.482105 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1055/2127] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:38:44 2022] POST /identity/v3/users => generated 301 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:44.492381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e2f6b4-58f6-4ed5-959c-ce868838337b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecea19ee353d4977baafbdf022b94887, user_id=9a1de22711264e42abe8de3f935f35b1, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:44.495462 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e2f6b4-58f6-4ed5-959c-ce868838337b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:44.504090 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d98e7-741e-4fe0-b5a3-9abe6562fba0 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:44.531885 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1073/2128] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:38:44 2022] PUT /identity/v3/projects/ecea19ee353d4977baafbdf022b94887/users/9a1de22711264e42abe8de3f935f35b1/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:44.531885 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e2f6b4-58f6-4ed5-959c-ce868838337b admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:44.660177 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d98e7-741e-4fe0-b5a3-9abe6562fba0 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:44.676852 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e2f6b4-58f6-4ed5-959c-ce868838337b admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:44.688947 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:44.689460 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa153193-a317-4e96-9ec7-aad592e30d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:44.690473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa153193-a317-4e96-9ec7-aad592e30d51 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:44.691403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa153193-a317-4e96-9ec7-aad592e30d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:44.691890 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa153193-a317-4e96-9ec7-aad592e30d51 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:44.692759 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa153193-a317-4e96-9ec7-aad592e30d51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:44.694894 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa153193-a317-4e96-9ec7-aad592e30d51 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:44.718482 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1074/2129] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:44.719694 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa153193-a317-4e96-9ec7-aad592e30d51 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:44.757175 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa153193-a317-4e96-9ec7-aad592e30d51 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:44.768269 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e32c7-eb2f-4b83-952e-840bc6f2bec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:44.768974 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e32c7-eb2f-4b83-952e-840bc6f2bec5 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:44.769336 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e32c7-eb2f-4b83-952e-840bc6f2bec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:44.769680 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e32c7-eb2f-4b83-952e-840bc6f2bec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:44.770404 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6e32c7-eb2f-4b83-952e-840bc6f2bec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:44.775553 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6e32c7-eb2f-4b83-952e-840bc6f2bec5 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:44.805919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce1eec-e2ee-461a-9592-2e50ca1a05fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:44.806569 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1075/2130] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:44.807636 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e32c7-eb2f-4b83-952e-840bc6f2bec5 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:44.808552 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce1eec-e2ee-461a-9592-2e50ca1a05fc service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:44.809147 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce1eec-e2ee-461a-9592-2e50ca1a05fc service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:44.810267 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce1eec-e2ee-461a-9592-2e50ca1a05fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:44.833409 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e32c7-eb2f-4b83-952e-840bc6f2bec5 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:44.848578 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e202217-cf4e-4a10-b0bf-50f73447eda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:44.850193 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e202217-cf4e-4a10-b0bf-50f73447eda3 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:44.850834 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e202217-cf4e-4a10-b0bf-50f73447eda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:44.851181 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e202217-cf4e-4a10-b0bf-50f73447eda3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:44.851846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e202217-cf4e-4a10-b0bf-50f73447eda3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:44.853814 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e202217-cf4e-4a10-b0bf-50f73447eda3 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:44.887058 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1076/2131] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:44.887963 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e202217-cf4e-4a10-b0bf-50f73447eda3 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:44.922744 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e202217-cf4e-4a10-b0bf-50f73447eda3 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:44.946045 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5059c20-1f27-4f9c-8849-3a62c344f71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:44.946759 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5059c20-1f27-4f9c-8849-3a62c344f71a admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:44.947050 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5059c20-1f27-4f9c-8849-3a62c344f71a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:44.947335 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5059c20-1f27-4f9c-8849-3a62c344f71a admin admin] PATH_INFO: `/v3/projects/ecea19ee353d4977baafbdf022b94887/users/9a1de22711264e42abe8de3f935f35b1/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:44.960240 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5059c20-1f27-4f9c-8849-3a62c344f71a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecea19ee353d4977baafbdf022b94887, user_id=9a1de22711264e42abe8de3f935f35b1, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:44.966328 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5059c20-1f27-4f9c-8849-3a62c344f71a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:44.990016 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce1eec-e2ee-461a-9592-2e50ca1a05fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:44.994293 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce1eec-e2ee-461a-9592-2e50ca1a05fc service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:44.995614 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1077/2132] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:38:44 2022] PUT /identity/v3/projects/ecea19ee353d4977baafbdf022b94887/users/9a1de22711264e42abe8de3f935f35b1/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:44.999432 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5059c20-1f27-4f9c-8849-3a62c344f71a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:45.017171 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1056/2133] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:44 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:38:45.035950 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce1eec-e2ee-461a-9592-2e50ca1a05fc service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:45.066248 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:45.069055 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce1eec-e2ee-461a-9592-2e50ca1a05fc service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:45.102528 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5059c20-1f27-4f9c-8849-3a62c344f71a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:45.109272 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83acd4ca-ab04-4b9d-aa90-1a5cc43f147f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:45.110190 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acd4ca-ab04-4b9d-aa90-1a5cc43f147f service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:45.110540 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acd4ca-ab04-4b9d-aa90-1a5cc43f147f service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:45.110893 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acd4ca-ab04-4b9d-aa90-1a5cc43f147f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:45.119505 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-83acd4ca-ab04-4b9d-aa90-1a5cc43f147f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:45.282710 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f6273-2ca6-4c4b-915b-23efc69c2715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:45.284130 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f6273-2ca6-4c4b-915b-23efc69c2715 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:45.284130 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f6273-2ca6-4c4b-915b-23efc69c2715 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:45.284130 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f6273-2ca6-4c4b-915b-23efc69c2715 admin admin] PATH_INFO: `/v3/projects/31534f72535e49e7b43e1904b1772d34/users/f4606fc339fe4f2288286f804c6f94cf/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:45.289605 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83acd4ca-ab04-4b9d-aa90-1a5cc43f147f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:45.291522 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83acd4ca-ab04-4b9d-aa90-1a5cc43f147f service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:45.308541 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1078/2134] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:44 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:38:45.318799 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f6273-2ca6-4c4b-915b-23efc69c2715 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31534f72535e49e7b43e1904b1772d34, user_id=f4606fc339fe4f2288286f804c6f94cf, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:45.320723 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739792ba-e28f-4eef-a277-04c1cffdb1b4 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:45.322007 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f6273-2ca6-4c4b-915b-23efc69c2715 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:45.322959 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739792ba-e28f-4eef-a277-04c1cffdb1b4 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:45.323480 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739792ba-e28f-4eef-a277-04c1cffdb1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:45.361280 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1057/2135] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:38:45 2022] PUT /identity/v3/projects/31534f72535e49e7b43e1904b1772d34/users/f4606fc339fe4f2288286f804c6f94cf/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:45.374762 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81026bf-7415-4149-b65f-d84f59ad6d74 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:45.375195 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81026bf-7415-4149-b65f-d84f59ad6d74 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:45.376032 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81026bf-7415-4149-b65f-d84f59ad6d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:45.397743 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-739792ba-e28f-4eef-a277-04c1cffdb1b4 None None] MFA Rules not processed for user `9a1de22711264e42abe8de3f935f35b1`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:45.399198 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-739792ba-e28f-4eef-a277-04c1cffdb1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:45.432199 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-f81026bf-7415-4149-b65f-d84f59ad6d74 None None] MFA Rules not processed for user `f4606fc339fe4f2288286f804c6f94cf`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:45.433435 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f81026bf-7415-4149-b65f-d84f59ad6d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:45.485830 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:45.624388 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1058/2136] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:45 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:38:45.624388 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948b222-a776-4210-87af-64b522066a89 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:45.624388 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948b222-a776-4210-87af-64b522066a89 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:45.624388 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948b222-a776-4210-87af-64b522066a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:45.634263 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1079/2137] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:45 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:45.635747 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739792ba-e28f-4eef-a277-04c1cffdb1b4 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:45.653044 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a948b222-a776-4210-87af-64b522066a89 None None] MFA Rules not processed for user `9a84bb38f6454574897120223b8fc140`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:45.654598 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a948b222-a776-4210-87af-64b522066a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:45.776078 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1059/2138] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 15:38:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:45.785270 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948b222-a776-4210-87af-64b522066a89 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:45.798582 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739792ba-e28f-4eef-a277-04c1cffdb1b4 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:45.813256 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f514f-521c-44e3-8eee-d478c777478d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:45.814048 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f514f-521c-44e3-8eee-d478c777478d admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:45.814336 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f514f-521c-44e3-8eee-d478c777478d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:45.814809 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f514f-521c-44e3-8eee-d478c777478d admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:45.815066 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948b222-a776-4210-87af-64b522066a89 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:45.815584 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6f514f-521c-44e3-8eee-d478c777478d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:45.819237 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6f514f-521c-44e3-8eee-d478c777478d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:45.834783 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:45.847048 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562cc540-eb1b-4bfa-88a6-d1ae0d443b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:45.847839 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562cc540-eb1b-4bfa-88a6-d1ae0d443b98 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:45.848121 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562cc540-eb1b-4bfa-88a6-d1ae0d443b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:45.848392 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562cc540-eb1b-4bfa-88a6-d1ae0d443b98 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:45.849290 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562cc540-eb1b-4bfa-88a6-d1ae0d443b98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:45.852804 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562cc540-eb1b-4bfa-88a6-d1ae0d443b98 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:45.901225 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1080/2139] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:38:45 2022] POST /identity/v3/projects => generated 403 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:45.902233 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f514f-521c-44e3-8eee-d478c777478d admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:45.913701 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9b6f514f-521c-44e3-8eee-d478c777478d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:45.947606 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1060/2140] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:38:45 2022] POST /identity/v3/projects => generated 393 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:45.948871 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562cc540-eb1b-4bfa-88a6-d1ae0d443b98 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:45.956584 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-562cc540-eb1b-4bfa-88a6-d1ae0d443b98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:46.048955 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f514f-521c-44e3-8eee-d478c777478d admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:46.153144 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562cc540-eb1b-4bfa-88a6-d1ae0d443b98 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:46.159427 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b7b46-4e29-4cfb-9d5c-cb0ed3b56a3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:46.160052 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b7b46-4e29-4cfb-9d5c-cb0ed3b56a3b service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:46.160326 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b7b46-4e29-4cfb-9d5c-cb0ed3b56a3b service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:46.160594 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b7b46-4e29-4cfb-9d5c-cb0ed3b56a3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:46.169921 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b7b46-4e29-4cfb-9d5c-cb0ed3b56a3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:46.171434 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b7b46-4e29-4cfb-9d5c-cb0ed3b56a3b service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:46.178479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a8c1a4-8019-4c2f-9d9b-9eec5536b476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:46.180470 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8c1a4-8019-4c2f-9d9b-9eec5536b476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:46.180761 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8c1a4-8019-4c2f-9d9b-9eec5536b476 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:46.181039 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8c1a4-8019-4c2f-9d9b-9eec5536b476 admin admin] PATH_INFO: `/v3/users/93b93788fbf74965a928d861437f36c6` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:46.181899 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1061/2141] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:38:46.182819 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b7b46-4e29-4cfb-9d5c-cb0ed3b56a3b service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:46.189869 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a8c1a4-8019-4c2f-9d9b-9eec5536b476 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93b93788fbf74965a928d861437f36c6)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:46.192029 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a8c1a4-8019-4c2f-9d9b-9eec5536b476 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:46.197923 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b7b46-4e29-4cfb-9d5c-cb0ed3b56a3b service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:46.206393 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c828c-f1a5-4242-b197-064a2dfe4db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:46.208145 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c828c-f1a5-4242-b197-064a2dfe4db3 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:46.208286 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c828c-f1a5-4242-b197-064a2dfe4db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:46.208477 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c828c-f1a5-4242-b197-064a2dfe4db3 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:46.210110 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c828c-f1a5-4242-b197-064a2dfe4db3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:46.212531 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c828c-f1a5-4242-b197-064a2dfe4db3 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:46.248027 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1062/2142] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:38:46 2022] POST /identity/v3/users => generated 308 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:46.248027 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c828c-f1a5-4242-b197-064a2dfe4db3 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:46.269746 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c828c-f1a5-4242-b197-064a2dfe4db3 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:46.275881 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574faa54-2f42-4954-bc7d-2ea240469b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:46.277047 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574faa54-2f42-4954-bc7d-2ea240469b03 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:46.277327 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574faa54-2f42-4954-bc7d-2ea240469b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:46.277597 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574faa54-2f42-4954-bc7d-2ea240469b03 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:46.278255 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574faa54-2f42-4954-bc7d-2ea240469b03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:46.280842 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574faa54-2f42-4954-bc7d-2ea240469b03 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:46.307281 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-72a8c1a4-8019-4c2f-9d9b-9eec5536b476 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93b93788fbf74965a928d861437f36c6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:46.308031 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-72a8c1a4-8019-4c2f-9d9b-9eec5536b476 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93b93788fbf74965a928d861437f36c6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:46.320449 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1063/2143] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:38:46 2022] POST /identity/v3/users => generated 297 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:46.320449 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2913b02-010b-4461-8356-34ebe22f4eb3 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:46.320449 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2913b02-010b-4461-8356-34ebe22f4eb3 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:46.322732 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2913b02-010b-4461-8356-34ebe22f4eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:46.343829 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-72a8c1a4-8019-4c2f-9d9b-9eec5536b476 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93b93788fbf74965a928d861437f36c6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:46.368784 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-d2913b02-010b-4461-8356-34ebe22f4eb3 None None] MFA Rules not processed for user `bb270a356b6e45088b6bdceac76bddff`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:46.370489 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d2913b02-010b-4461-8356-34ebe22f4eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:46.372580 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-72a8c1a4-8019-4c2f-9d9b-9eec5536b476 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93b93788fbf74965a928d861437f36c6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:46.375789 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:46.402219 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-72a8c1a4-8019-4c2f-9d9b-9eec5536b476 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93b93788fbf74965a928d861437f36c6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:46.416155 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1081/2144] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:38:45 2022] DELETE /identity/v3/users/93b93788fbf74965a928d861437f36c6 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:46.417203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a8c1a4-8019-4c2f-9d9b-9eec5536b476 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:46.428211 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-72a8c1a4-8019-4c2f-9d9b-9eec5536b476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:46.450627 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:46.513650 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1064/2145] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:46 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:46.513650 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2913b02-010b-4461-8356-34ebe22f4eb3 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:46.518553 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d2913b02-010b-4461-8356-34ebe22f4eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:46.555599 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2913b02-010b-4461-8356-34ebe22f4eb3 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:46.563002 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65531148-d95c-4697-b772-d2ec74bce560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:46.564810 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a8c1a4-8019-4c2f-9d9b-9eec5536b476 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:46.568966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65531148-d95c-4697-b772-d2ec74bce560 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:46.572056 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65531148-d95c-4697-b772-d2ec74bce560 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:46.572391 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d8d1d-13d7-4921-af0a-04a0e44021f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:46.572769 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65531148-d95c-4697-b772-d2ec74bce560 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:46.573018 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d8d1d-13d7-4921-af0a-04a0e44021f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:46.573296 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d8d1d-13d7-4921-af0a-04a0e44021f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:46.573563 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d8d1d-13d7-4921-af0a-04a0e44021f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:46.574216 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656d8d1d-13d7-4921-af0a-04a0e44021f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:46.576084 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656d8d1d-13d7-4921-af0a-04a0e44021f5 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:46.577943 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65531148-d95c-4697-b772-d2ec74bce560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:46.579903 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65531148-d95c-4697-b772-d2ec74bce560 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:46.598450 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1082/2146] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:46.603931 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50d62c-2d35-4254-86a9-44a70c9179ec None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:46.604130 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50d62c-2d35-4254-86a9-44a70c9179ec None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:46.605504 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50d62c-2d35-4254-86a9-44a70c9179ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:46.616503 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1065/2147] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:46.619547 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdbb50-d281-44b8-bff4-9cdb8ee47007 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:46.622322 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdbb50-d281-44b8-bff4-9cdb8ee47007 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:46.622767 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdbb50-d281-44b8-bff4-9cdb8ee47007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:46.631416 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-aa50d62c-2d35-4254-86a9-44a70c9179ec None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:46.632797 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-aa50d62c-2d35-4254-86a9-44a70c9179ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:46.642332 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1083/2148] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:46.643106 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50d62c-2d35-4254-86a9-44a70c9179ec None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:46.657284 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50d62c-2d35-4254-86a9-44a70c9179ec None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:46.664919 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd5d14-966e-473d-b4f0-3191075273ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:46.665599 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd5d14-966e-473d-b4f0-3191075273ca admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:46.665927 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd5d14-966e-473d-b4f0-3191075273ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:46.666355 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd5d14-966e-473d-b4f0-3191075273ca admin admin] PATH_INFO: `/v3/projects/2e9b5476d08040c4b1b24e87f40d78e4/users/38bbfbfe975543769bfe3efd1a5d7cb0/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:46.676470 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-adbdbb50-d281-44b8-bff4-9cdb8ee47007 None None] MFA Rules not processed for user `f12698b45a114720af9c98b163077f59`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:46.680508 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-adbdbb50-d281-44b8-bff4-9cdb8ee47007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:46.691948 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd5d14-966e-473d-b4f0-3191075273ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e9b5476d08040c4b1b24e87f40d78e4, user_id=38bbfbfe975543769bfe3efd1a5d7cb0, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:46.697185 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd5d14-966e-473d-b4f0-3191075273ca admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:46.733335 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1084/2149] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:38:46 2022] PUT /identity/v3/projects/2e9b5476d08040c4b1b24e87f40d78e4/users/38bbfbfe975543769bfe3efd1a5d7cb0/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:46.733335 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd5d14-966e-473d-b4f0-3191075273ca admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:46.822917 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1066/2150] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:46 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:46.826092 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbdbb50-d281-44b8-bff4-9cdb8ee47007 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:46.828044 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-adbdbb50-d281-44b8-bff4-9cdb8ee47007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:46.899891 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd5d14-966e-473d-b4f0-3191075273ca admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:46.916121 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debbf42-5777-4218-b1b3-94d6dd28b5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:46.916809 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debbf42-5777-4218-b1b3-94d6dd28b5aa admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:46.917090 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debbf42-5777-4218-b1b3-94d6dd28b5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:46.917362 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debbf42-5777-4218-b1b3-94d6dd28b5aa admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:46.918026 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5debbf42-5777-4218-b1b3-94d6dd28b5aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:46.921928 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5debbf42-5777-4218-b1b3-94d6dd28b5aa admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:46.954766 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1085/2151] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:46.956908 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debbf42-5777-4218-b1b3-94d6dd28b5aa admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:46.969149 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbdbb50-d281-44b8-bff4-9cdb8ee47007 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:46.984702 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debbf42-5777-4218-b1b3-94d6dd28b5aa admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:47.009671 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e486b5ef-405a-485a-98ea-e86f53f7f446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:47.010592 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486b5ef-405a-485a-98ea-e86f53f7f446 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:47.011003 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486b5ef-405a-485a-98ea-e86f53f7f446 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:47.011650 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486b5ef-405a-485a-98ea-e86f53f7f446 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:47.012434 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e486b5ef-405a-485a-98ea-e86f53f7f446 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:47.017085 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e486b5ef-405a-485a-98ea-e86f53f7f446 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:47.034829 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87b2ed-c972-40fd-87ec-652b3e3a2509 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:47.034829 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87b2ed-c972-40fd-87ec-652b3e3a2509 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:47.035592 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87b2ed-c972-40fd-87ec-652b3e3a2509 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:47.035592 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87b2ed-c972-40fd-87ec-652b3e3a2509 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:47.042550 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:47.048212 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1086/2152] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:47.048379 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f87b2ed-c972-40fd-87ec-652b3e3a2509 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:47.048841 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f87b2ed-c972-40fd-87ec-652b3e3a2509 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:47.049715 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e486b5ef-405a-485a-98ea-e86f53f7f446 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:47.060793 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1067/2153] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:38:47.062149 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87b2ed-c972-40fd-87ec-652b3e3a2509 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:47.065550 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7f87b2ed-c972-40fd-87ec-652b3e3a2509 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:47.069114 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e486b5ef-405a-485a-98ea-e86f53f7f446 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:47.075661 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682cf16b-8c60-4c8a-bd69-34066964736c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:47.075661 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cf16b-8c60-4c8a-bd69-34066964736c admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:47.075661 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cf16b-8c60-4c8a-bd69-34066964736c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:47.075987 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cf16b-8c60-4c8a-bd69-34066964736c admin admin] PATH_INFO: `/v3/projects/d7bf3bf3b2aa46f9b8a821aeffd4570c/users/98c1cb38626e479c9c3ab9c5efeb0303/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:47.098890 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682cf16b-8c60-4c8a-bd69-34066964736c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7bf3bf3b2aa46f9b8a821aeffd4570c, user_id=98c1cb38626e479c9c3ab9c5efeb0303, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:47.103750 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682cf16b-8c60-4c8a-bd69-34066964736c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:47.144405 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1087/2154] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:38:47 2022] PUT /identity/v3/projects/d7bf3bf3b2aa46f9b8a821aeffd4570c/users/98c1cb38626e479c9c3ab9c5efeb0303/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:47.147262 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770d45e-304d-470c-b905-4678b9a264d9 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:47.147696 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770d45e-304d-470c-b905-4678b9a264d9 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:47.147975 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770d45e-304d-470c-b905-4678b9a264d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:47.180759 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-6770d45e-304d-470c-b905-4678b9a264d9 None None] MFA Rules not processed for user `010ed8588b2d496bacedebc1863a3857`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:47.182123 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6770d45e-304d-470c-b905-4678b9a264d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:47.222221 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87b2ed-c972-40fd-87ec-652b3e3a2509 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:47.266227 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:47.312182 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097afd77-9a95-415a-b94f-6ee6db32a8e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:47.313070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097afd77-9a95-415a-b94f-6ee6db32a8e4 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:47.313413 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097afd77-9a95-415a-b94f-6ee6db32a8e4 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:47.313755 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097afd77-9a95-415a-b94f-6ee6db32a8e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:47.317241 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-097afd77-9a95-415a-b94f-6ee6db32a8e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:47.346862 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1088/2155] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:47.346862 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770d45e-304d-470c-b905-4678b9a264d9 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:47.423408 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097afd77-9a95-415a-b94f-6ee6db32a8e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:47.425066 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097afd77-9a95-415a-b94f-6ee6db32a8e4 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:47.447205 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1068/2156] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:47 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:38:47.448145 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8748f80-5c51-4ae2-a103-71de8d84c9a4 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:47.448625 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8748f80-5c51-4ae2-a103-71de8d84c9a4 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:47.450072 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8748f80-5c51-4ae2-a103-71de8d84c9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:47.530002 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-c8748f80-5c51-4ae2-a103-71de8d84c9a4 None None] MFA Rules not processed for user `98c1cb38626e479c9c3ab9c5efeb0303`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:47.536983 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c8748f80-5c51-4ae2-a103-71de8d84c9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:47.550520 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770d45e-304d-470c-b905-4678b9a264d9 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:47.564451 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b26d93-98b6-45a8-a28b-938acfd61673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:47.565323 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b26d93-98b6-45a8-a28b-938acfd61673 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:47.565602 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b26d93-98b6-45a8-a28b-938acfd61673 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:47.565873 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b26d93-98b6-45a8-a28b-938acfd61673 admin admin] PATH_INFO: `/v3/projects/2e9b5476d08040c4b1b24e87f40d78e4/users/38bbfbfe975543769bfe3efd1a5d7cb0/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:47.586240 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b26d93-98b6-45a8-a28b-938acfd61673 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e9b5476d08040c4b1b24e87f40d78e4, user_id=38bbfbfe975543769bfe3efd1a5d7cb0, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:47.592714 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b26d93-98b6-45a8-a28b-938acfd61673 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:47.595114 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:47.619689 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1089/2157] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:38:47 2022] PUT /identity/v3/projects/2e9b5476d08040c4b1b24e87f40d78e4/users/38bbfbfe975543769bfe3efd1a5d7cb0/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:47.632387 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6b0d3-9345-4c45-8f80-6a9c8a935c8d None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:47.632669 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6b0d3-9345-4c45-8f80-6a9c8a935c8d None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:47.632945 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6b0d3-9345-4c45-8f80-6a9c8a935c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:47.688122 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-74a6b0d3-9345-4c45-8f80-6a9c8a935c8d None None] MFA Rules not processed for user `38bbfbfe975543769bfe3efd1a5d7cb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:47.689394 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-74a6b0d3-9345-4c45-8f80-6a9c8a935c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:47.715535 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1069/2158] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:47 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:47.827823 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1090/2159] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:47 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:48.065537 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8748f80-5c51-4ae2-a103-71de8d84c9a4 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:48.067153 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c8748f80-5c51-4ae2-a103-71de8d84c9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:48.096898 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8748f80-5c51-4ae2-a103-71de8d84c9a4 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:48.267055 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35e09d-2fb3-40e8-8d4e-15947ac2e80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:48.267712 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35e09d-2fb3-40e8-8d4e-15947ac2e80c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:48.267988 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35e09d-2fb3-40e8-8d4e-15947ac2e80c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:48.268260 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35e09d-2fb3-40e8-8d4e-15947ac2e80c admin admin] PATH_INFO: `/v3/projects/2da09625509a4cb883cfd164e66dc795` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:48.269948 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a35e09d-2fb3-40e8-8d4e-15947ac2e80c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2da09625509a4cb883cfd164e66dc795)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:48.272503 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a35e09d-2fb3-40e8-8d4e-15947ac2e80c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:48.416192 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9a35e09d-2fb3-40e8-8d4e-15947ac2e80c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2da09625509a4cb883cfd164e66dc795', 'request_id': 'req-9a35e09d-2fb3-40e8-8d4e-15947ac2e80c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:48.416533 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a6b0d3-9345-4c45-8f80-6a9c8a935c8d None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:48.418014 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-74a6b0d3-9345-4c45-8f80-6a9c8a935c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:48.435839 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9a35e09d-2fb3-40e8-8d4e-15947ac2e80c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2da09625509a4cb883cfd164e66dc795', 'request_id': 'req-9a35e09d-2fb3-40e8-8d4e-15947ac2e80c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:48.446119 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9a35e09d-2fb3-40e8-8d4e-15947ac2e80c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2da09625509a4cb883cfd164e66dc795', 'request_id': 'req-9a35e09d-2fb3-40e8-8d4e-15947ac2e80c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:48.468460 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9a35e09d-2fb3-40e8-8d4e-15947ac2e80c admin admin] The token cache is being invalidate because project 2da09625509a4cb883cfd164e66dc795 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:38:48.468745 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9a35e09d-2fb3-40e8-8d4e-15947ac2e80c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:48.469538 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9a35e09d-2fb3-40e8-8d4e-15947ac2e80c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:48.473203 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1070/2160] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:38:48 2022] DELETE /identity/v3/projects/2da09625509a4cb883cfd164e66dc795 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:48.478133 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35e09d-2fb3-40e8-8d4e-15947ac2e80c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:48.481989 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9a35e09d-2fb3-40e8-8d4e-15947ac2e80c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:48.644989 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:48.663617 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a6b0d3-9345-4c45-8f80-6a9c8a935c8d None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:48.691173 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:48.741526 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35e09d-2fb3-40e8-8d4e-15947ac2e80c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:48.753100 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31d587-c9f1-4efc-a42e-6dc3f3b6691a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:48.756631 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31d587-c9f1-4efc-a42e-6dc3f3b6691a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:48.757089 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31d587-c9f1-4efc-a42e-6dc3f3b6691a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:48.758136 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31d587-c9f1-4efc-a42e-6dc3f3b6691a admin admin] PATH_INFO: `/v3/users/6a9cc3578acc48fdbeef31b84ff27d4c` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:48.767939 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c31d587-c9f1-4efc-a42e-6dc3f3b6691a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a9cc3578acc48fdbeef31b84ff27d4c)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:48.770189 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c31d587-c9f1-4efc-a42e-6dc3f3b6691a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:48.890654 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37a634e-7fae-4195-a647-19df7dea88e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:48.891361 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a634e-7fae-4195-a647-19df7dea88e4 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:48.893083 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a634e-7fae-4195-a647-19df7dea88e4 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:48.893394 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a634e-7fae-4195-a647-19df7dea88e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:48.895645 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2c31d587-c9f1-4efc-a42e-6dc3f3b6691a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a9cc3578acc48fdbeef31b84ff27d4c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:48.898228 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c37a634e-7fae-4195-a647-19df7dea88e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:48.899426 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2c31d587-c9f1-4efc-a42e-6dc3f3b6691a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a9cc3578acc48fdbeef31b84ff27d4c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:48.918334 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2c31d587-c9f1-4efc-a42e-6dc3f3b6691a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a9cc3578acc48fdbeef31b84ff27d4c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:48.948226 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2c31d587-c9f1-4efc-a42e-6dc3f3b6691a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a9cc3578acc48fdbeef31b84ff27d4c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:48.949560 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2c31d587-c9f1-4efc-a42e-6dc3f3b6691a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a9cc3578acc48fdbeef31b84ff27d4c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:49.020879 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1071/2161] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:38:48 2022] DELETE /identity/v3/users/6a9cc3578acc48fdbeef31b84ff27d4c => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:38:49.030901 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31d587-c9f1-4efc-a42e-6dc3f3b6691a admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:49.034900 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2c31d587-c9f1-4efc-a42e-6dc3f3b6691a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:49.040001 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37a634e-7fae-4195-a647-19df7dea88e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:49.042773 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37a634e-7fae-4195-a647-19df7dea88e4 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:49.069742 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1091/2162] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:48 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 653 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:38:49.253673 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31d587-c9f1-4efc-a42e-6dc3f3b6691a admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:49.274035 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000c481-eb1b-416f-a528-ad3c68bd9045 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:49.275577 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000c481-eb1b-416f-a528-ad3c68bd9045 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:49.276007 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000c481-eb1b-416f-a528-ad3c68bd9045 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:49.276450 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000c481-eb1b-416f-a528-ad3c68bd9045 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:49.280517 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a000c481-eb1b-416f-a528-ad3c68bd9045 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:49.403678 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a000c481-eb1b-416f-a528-ad3c68bd9045 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:49.405683 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a000c481-eb1b-416f-a528-ad3c68bd9045 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:49.412780 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:49.420388 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1072/2163] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:49 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:38:49.916204 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1007d01-2ad5-4c33-abdd-9b9737cc8744 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:49.917133 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1007d01-2ad5-4c33-abdd-9b9737cc8744 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:49.917586 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1007d01-2ad5-4c33-abdd-9b9737cc8744 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:49.921882 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1092/2164] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 15:38:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:38:49.929457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000c481-eb1b-416f-a528-ad3c68bd9045 service nova] Authenticating service token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:38:49.942129 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000c481-eb1b-416f-a528-ad3c68bd9045 service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:49.943732 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a000c481-eb1b-416f-a528-ad3c68bd9045 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:50.059522 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000c481-eb1b-416f-a528-ad3c68bd9045 service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:50.064497 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f275ef20-de74-4eba-ad86-c4d4cdc8842d tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1de22711264e42abe8de3f935f35b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecea19ee353d4977baafbdf022b94887', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:50.065223 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275ef20-de74-4eba-ad86-c4d4cdc8842d tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:50.065581 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275ef20-de74-4eba-ad86-c4d4cdc8842d tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:50.066112 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275ef20-de74-4eba-ad86-c4d4cdc8842d tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] PATH_INFO: `/v3/projects/a75d546db2fb40baa9ad3d22fbeb7ce1` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:50.067390 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f275ef20-de74-4eba-ad86-c4d4cdc8842d tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] RBAC: Authorizing `identity:get_project(project_id=a75d546db2fb40baa9ad3d22fbeb7ce1)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:50.070836 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f275ef20-de74-4eba-ad86-c4d4cdc8842d tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:50.088770 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1073/2165] 10.222.0.83 () {58 vars in 1443 bytes} [Mon Aug 29 15:38:49 2022] GET /identity/v3/projects/a75d546db2fb40baa9ad3d22fbeb7ce1 => generated 393 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:38:50.129613 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f02924-22d3-41ba-a0e5-1fbb36bf3d90 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:50.129907 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f02924-22d3-41ba-a0e5-1fbb36bf3d90 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:50.130196 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f02924-22d3-41ba-a0e5-1fbb36bf3d90 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:50.131763 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1093/2166] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 15:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:38:50.136753 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f275ef20-de74-4eba-ad86-c4d4cdc8842d tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] Authenticating service token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:38:50.158334 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f275ef20-de74-4eba-ad86-c4d4cdc8842d tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:50.181740 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f275ef20-de74-4eba-ad86-c4d4cdc8842d tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:50.195517 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca21933-c50b-41a2-8035-e041af538092 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1de22711264e42abe8de3f935f35b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecea19ee353d4977baafbdf022b94887', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:50.196610 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca21933-c50b-41a2-8035-e041af538092 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:50.197132 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca21933-c50b-41a2-8035-e041af538092 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:50.197727 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca21933-c50b-41a2-8035-e041af538092 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] PATH_INFO: `/v3/projects/a75d546db2fb40baa9ad3d22fbeb7ce1` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:50.199887 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca21933-c50b-41a2-8035-e041af538092 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] RBAC: Authorizing `identity:get_project(project_id=a75d546db2fb40baa9ad3d22fbeb7ce1)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:50.202882 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca21933-c50b-41a2-8035-e041af538092 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:50.205484 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1074/2167] 10.222.0.83 () {58 vars in 1443 bytes} [Mon Aug 29 15:38:50 2022] GET /identity/v3/projects/a75d546db2fb40baa9ad3d22fbeb7ce1 => generated 393 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:38:50.229374 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f02924-22d3-41ba-a0e5-1fbb36bf3d90 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:50.231417 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-59f02924-22d3-41ba-a0e5-1fbb36bf3d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:50.281272 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2f736-ff9e-44f2-adf5-5aaeb51cd6ac None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:50.281819 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2f736-ff9e-44f2-adf5-5aaeb51cd6ac None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:50.281819 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2f736-ff9e-44f2-adf5-5aaeb51cd6ac None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:50.283190 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1075/2168] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 15:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:38:50.293997 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf2f736-ff9e-44f2-adf5-5aaeb51cd6ac None None] Authenticating service token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:38:50.327105 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf2f736-ff9e-44f2-adf5-5aaeb51cd6ac None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:50.342732 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf2f736-ff9e-44f2-adf5-5aaeb51cd6ac None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:50.347982 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee0fc2-5600-4de6-979b-1da11998f398 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1de22711264e42abe8de3f935f35b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecea19ee353d4977baafbdf022b94887', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:50.348756 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee0fc2-5600-4de6-979b-1da11998f398 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:50.349059 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee0fc2-5600-4de6-979b-1da11998f398 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:50.349551 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee0fc2-5600-4de6-979b-1da11998f398 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] PATH_INFO: `/v3/projects/a75d546db2fb40baa9ad3d22fbeb7ce1` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:50.351217 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee0fc2-5600-4de6-979b-1da11998f398 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] RBAC: Authorizing `identity:get_project(project_id=a75d546db2fb40baa9ad3d22fbeb7ce1)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:50.364802 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee0fc2-5600-4de6-979b-1da11998f398 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:50.365872 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f02924-22d3-41ba-a0e5-1fbb36bf3d90 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:50.371672 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc027d4e-1103-4817-8320-2935c120cc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:50.372645 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc027d4e-1103-4817-8320-2935c120cc8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:50.373352 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc027d4e-1103-4817-8320-2935c120cc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:50.373913 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc027d4e-1103-4817-8320-2935c120cc8a admin admin] PATH_INFO: `/v3/projects/7f0ab849ef5645f093be2726cdee452c` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:50.375900 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc027d4e-1103-4817-8320-2935c120cc8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f0ab849ef5645f093be2726cdee452c)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:50.377522 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1076/2169] 10.222.0.83 () {58 vars in 1443 bytes} [Mon Aug 29 15:38:50 2022] GET /identity/v3/projects/a75d546db2fb40baa9ad3d22fbeb7ce1 => generated 393 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:38:50.378222 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc027d4e-1103-4817-8320-2935c120cc8a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:50.447382 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:50.469263 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fc027d4e-1103-4817-8320-2935c120cc8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f0ab849ef5645f093be2726cdee452c', 'request_id': 'req-fc027d4e-1103-4817-8320-2935c120cc8a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:50.478136 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fc027d4e-1103-4817-8320-2935c120cc8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f0ab849ef5645f093be2726cdee452c', 'request_id': 'req-fc027d4e-1103-4817-8320-2935c120cc8a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:50.494682 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fc027d4e-1103-4817-8320-2935c120cc8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f0ab849ef5645f093be2726cdee452c', 'request_id': 'req-fc027d4e-1103-4817-8320-2935c120cc8a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:50.512398 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fc027d4e-1103-4817-8320-2935c120cc8a admin admin] The token cache is being invalidate because project 7f0ab849ef5645f093be2726cdee452c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:38:50.513006 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fc027d4e-1103-4817-8320-2935c120cc8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:50.514336 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fc027d4e-1103-4817-8320-2935c120cc8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:50.516978 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1094/2170] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:38:50 2022] DELETE /identity/v3/projects/7f0ab849ef5645f093be2726cdee452c => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:50.522584 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd3a64-2391-4e26-8ffc-caf2806659e0 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:50.523079 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd3a64-2391-4e26-8ffc-caf2806659e0 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:50.523597 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd3a64-2391-4e26-8ffc-caf2806659e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:50.556893 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc027d4e-1103-4817-8320-2935c120cc8a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:50.558878 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-fc027d4e-1103-4817-8320-2935c120cc8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:50.593839 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-39dd3a64-2391-4e26-8ffc-caf2806659e0 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:50.596588 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-39dd3a64-2391-4e26-8ffc-caf2806659e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:50.716127 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1077/2171] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:50.718270 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d844faa5-7193-4930-8d19-cc637bda5a46 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:50.720144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc027d4e-1103-4817-8320-2935c120cc8a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:50.720932 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d844faa5-7193-4930-8d19-cc637bda5a46 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:50.721193 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d844faa5-7193-4930-8d19-cc637bda5a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:50.740486 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2dea9f-5573-411e-957b-2db2ca874fe1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:50.741131 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2dea9f-5573-411e-957b-2db2ca874fe1 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:50.741442 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2dea9f-5573-411e-957b-2db2ca874fe1 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:50.741700 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2dea9f-5573-411e-957b-2db2ca874fe1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:50.747460 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-fb2dea9f-5573-411e-957b-2db2ca874fe1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:50.749954 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-d844faa5-7193-4930-8d19-cc637bda5a46 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:50.751224 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d844faa5-7193-4930-8d19-cc637bda5a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:50.766525 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1078/2172] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:38:50.771087 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d844faa5-7193-4930-8d19-cc637bda5a46 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:50.789031 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d844faa5-7193-4930-8d19-cc637bda5a46 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:50.803923 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70301f1a-1cc3-42f5-880e-b461399c35a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:50.806251 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70301f1a-1cc3-42f5-880e-b461399c35a1 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:50.807158 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70301f1a-1cc3-42f5-880e-b461399c35a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:50.808478 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70301f1a-1cc3-42f5-880e-b461399c35a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:50.809741 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70301f1a-1cc3-42f5-880e-b461399c35a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:38:50.810295 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70301f1a-1cc3-42f5-880e-b461399c35a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:50.813975 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70301f1a-1cc3-42f5-880e-b461399c35a1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:50.827474 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2dea9f-5573-411e-957b-2db2ca874fe1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:50.829915 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2dea9f-5573-411e-957b-2db2ca874fe1 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:50.841250 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1079/2173] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:38:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:38:50.841977 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1095/2174] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:50 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:38:50.852111 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70301f1a-1cc3-42f5-880e-b461399c35a1 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:50.866947 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2dea9f-5573-411e-957b-2db2ca874fe1 service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:50.868658 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-fb2dea9f-5573-411e-957b-2db2ca874fe1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:50.872256 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70301f1a-1cc3-42f5-880e-b461399c35a1 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:50.878561 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee257c-a202-45f4-8f8c-25b3fe5659b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:50.879461 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee257c-a202-45f4-8f8c-25b3fe5659b4 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:50.879957 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee257c-a202-45f4-8f8c-25b3fe5659b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:50.881388 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee257c-a202-45f4-8f8c-25b3fe5659b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:50.882233 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee257c-a202-45f4-8f8c-25b3fe5659b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:50.885308 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee257c-a202-45f4-8f8c-25b3fe5659b4 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:50.894739 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2dea9f-5573-411e-957b-2db2ca874fe1 service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:50.905307 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b621015e-ad64-4e9d-bad3-3c87a4f92548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:50.906199 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621015e-ad64-4e9d-bad3-3c87a4f92548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:50.906491 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621015e-ad64-4e9d-bad3-3c87a4f92548 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:50.907309 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621015e-ad64-4e9d-bad3-3c87a4f92548 admin admin] PATH_INFO: `/v3/users/f4606fc339fe4f2288286f804c6f94cf` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:50.919977 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b621015e-ad64-4e9d-bad3-3c87a4f92548 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4606fc339fe4f2288286f804c6f94cf)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:50.922098 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b621015e-ad64-4e9d-bad3-3c87a4f92548 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:50.938999 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1080/2175] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:38:50 2022] POST /identity/v3/projects => generated 375 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:50.944648 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee257c-a202-45f4-8f8c-25b3fe5659b4 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:50.994370 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b621015e-ad64-4e9d-bad3-3c87a4f92548 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4606fc339fe4f2288286f804c6f94cf'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:50.995468 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b621015e-ad64-4e9d-bad3-3c87a4f92548 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4606fc339fe4f2288286f804c6f94cf'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:51.004350 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:51.014221 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:51.015418 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b621015e-ad64-4e9d-bad3-3c87a4f92548 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4606fc339fe4f2288286f804c6f94cf'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:51.032104 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b621015e-ad64-4e9d-bad3-3c87a4f92548 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4606fc339fe4f2288286f804c6f94cf'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:51.043608 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b621015e-ad64-4e9d-bad3-3c87a4f92548 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4606fc339fe4f2288286f804c6f94cf'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:51.045290 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee257c-a202-45f4-8f8c-25b3fe5659b4 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:51.050517 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae6821-e5bf-483a-8358-82775e755831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:51.051172 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae6821-e5bf-483a-8358-82775e755831 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:51.051444 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae6821-e5bf-483a-8358-82775e755831 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:51.051906 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1096/2176] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:38:50 2022] DELETE /identity/v3/users/f4606fc339fe4f2288286f804c6f94cf => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:38:51.052156 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae6821-e5bf-483a-8358-82775e755831 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:51.053789 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae6821-e5bf-483a-8358-82775e755831 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:51.055992 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae6821-e5bf-483a-8358-82775e755831 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:51.057018 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e1630-ddf3-4fff-851c-23c0ed4a5c3c None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:51.057305 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e1630-ddf3-4fff-851c-23c0ed4a5c3c None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:51.058704 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e1630-ddf3-4fff-851c-23c0ed4a5c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:51.080327 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1081/2177] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:38:50 2022] POST /identity/v3/users => generated 288 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:51.084582 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae6821-e5bf-483a-8358-82775e755831 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:51.088057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0dae6821-e5bf-483a-8358-82775e755831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:51.094364 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-ac2e1630-ddf3-4fff-851c-23c0ed4a5c3c None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:51.096472 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ac2e1630-ddf3-4fff-851c-23c0ed4a5c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:51.103405 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae6821-e5bf-483a-8358-82775e755831 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:51.176841 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05224c3c-1837-4127-b5d1-1b3c576faacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:51.177503 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05224c3c-1837-4127-b5d1-1b3c576faacb admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:51.177777 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05224c3c-1837-4127-b5d1-1b3c576faacb admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:51.178013 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05224c3c-1837-4127-b5d1-1b3c576faacb admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:51.178662 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05224c3c-1837-4127-b5d1-1b3c576faacb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:51.180430 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05224c3c-1837-4127-b5d1-1b3c576faacb admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:51.183563 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1097/2178] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:51.187543 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e1630-ddf3-4fff-851c-23c0ed4a5c3c None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:51.190072 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ac2e1630-ddf3-4fff-851c-23c0ed4a5c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:51.191089 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1082/2179] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:51.195461 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05224c3c-1837-4127-b5d1-1b3c576faacb admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:51.206490 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05224c3c-1837-4127-b5d1-1b3c576faacb admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:51.213556 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7bd50-5f0e-465b-8868-a277b45fdc75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:51.214169 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7bd50-5f0e-465b-8868-a277b45fdc75 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:51.214443 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7bd50-5f0e-465b-8868-a277b45fdc75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:51.214710 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7bd50-5f0e-465b-8868-a277b45fdc75 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:51.215407 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f7bd50-5f0e-465b-8868-a277b45fdc75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:51.217161 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f7bd50-5f0e-465b-8868-a277b45fdc75 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:51.229163 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1083/2180] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:51.230101 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7bd50-5f0e-465b-8868-a277b45fdc75 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:51.231914 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-01f7bd50-5f0e-465b-8868-a277b45fdc75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:51.290717 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e1630-ddf3-4fff-851c-23c0ed4a5c3c None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:51.296736 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347c711-6c96-4332-97b7-892e21992134 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:51.297355 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347c711-6c96-4332-97b7-892e21992134 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:51.297634 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347c711-6c96-4332-97b7-892e21992134 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:51.297903 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347c711-6c96-4332-97b7-892e21992134 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:51.299734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1347c711-6c96-4332-97b7-892e21992134 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:51.304208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7bd50-5f0e-465b-8868-a277b45fdc75 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:51.308102 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4eea6-9dc8-4b96-85fa-4e50c4b2c719 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:51.308701 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4eea6-9dc8-4b96-85fa-4e50c4b2c719 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:51.308975 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4eea6-9dc8-4b96-85fa-4e50c4b2c719 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:51.309242 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4eea6-9dc8-4b96-85fa-4e50c4b2c719 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:51.321103 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d4eea6-9dc8-4b96-85fa-4e50c4b2c719 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:51.322469 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d4eea6-9dc8-4b96-85fa-4e50c4b2c719 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:51.334365 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1084/2181] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:38:51.335300 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4eea6-9dc8-4b96-85fa-4e50c4b2c719 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:51.346699 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4eea6-9dc8-4b96-85fa-4e50c4b2c719 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:51.356623 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0a8d6-8844-4113-aaaa-7d98e50451c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:51.357265 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0a8d6-8844-4113-aaaa-7d98e50451c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:51.357672 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0a8d6-8844-4113-aaaa-7d98e50451c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:51.357791 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0a8d6-8844-4113-aaaa-7d98e50451c3 admin admin] PATH_INFO: `/v3/projects/2cbf43758c944fe6bb6fad543fd251a6/users/03d025c6b7ec4069be6e2f560f992041/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:51.374557 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e0a8d6-8844-4113-aaaa-7d98e50451c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cbf43758c944fe6bb6fad543fd251a6, user_id=03d025c6b7ec4069be6e2f560f992041, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:51.377436 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e0a8d6-8844-4113-aaaa-7d98e50451c3 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:51.397492 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1347c711-6c96-4332-97b7-892e21992134 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:51.399218 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1085/2182] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:38:51 2022] PUT /identity/v3/projects/2cbf43758c944fe6bb6fad543fd251a6/users/03d025c6b7ec4069be6e2f560f992041/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:51.399347 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1347c711-6c96-4332-97b7-892e21992134 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:51.409610 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390dd8e0-8293-49c0-90e9-3b9c435c245b None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:51.410321 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1098/2183] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:51 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:38:51.410791 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390dd8e0-8293-49c0-90e9-3b9c435c245b None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:51.411093 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390dd8e0-8293-49c0-90e9-3b9c435c245b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:51.465384 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-390dd8e0-8293-49c0-90e9-3b9c435c245b None None] MFA Rules not processed for user `03d025c6b7ec4069be6e2f560f992041`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:51.467254 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-390dd8e0-8293-49c0-90e9-3b9c435c245b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:51.500257 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:51.569380 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1086/2184] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:38:51.574134 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347c711-6c96-4332-97b7-892e21992134 service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:51.587597 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347c711-6c96-4332-97b7-892e21992134 service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:51.587992 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df81a24-f7ba-46bf-a216-56c1e6ba743b None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:51.588289 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df81a24-f7ba-46bf-a216-56c1e6ba743b None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:51.588593 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df81a24-f7ba-46bf-a216-56c1e6ba743b None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:51.590072 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1087/2185] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 15:38:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:38:51.596068 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df81a24-f7ba-46bf-a216-56c1e6ba743b None None] Authenticating service token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:38:51.597849 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2df81a24-f7ba-46bf-a216-56c1e6ba743b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:51.617530 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:51.705340 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df81a24-f7ba-46bf-a216-56c1e6ba743b None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:51.706593 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2df81a24-f7ba-46bf-a216-56c1e6ba743b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:51.712951 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307a5285-705c-49ec-9fdb-ab84fac5f4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:51.714186 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a5285-705c-49ec-9fdb-ab84fac5f4b5 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:51.714785 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a5285-705c-49ec-9fdb-ab84fac5f4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:51.714785 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a5285-705c-49ec-9fdb-ab84fac5f4b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:51.715904 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307a5285-705c-49ec-9fdb-ab84fac5f4b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:51.718492 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307a5285-705c-49ec-9fdb-ab84fac5f4b5 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:51.752857 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1099/2186] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:38:51 2022] POST /identity/v3/projects => generated 373 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:51.753787 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307a5285-705c-49ec-9fdb-ab84fac5f4b5 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:51.756099 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-307a5285-705c-49ec-9fdb-ab84fac5f4b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:51.791737 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df81a24-f7ba-46bf-a216-56c1e6ba743b None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:51.836824 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307a5285-705c-49ec-9fdb-ab84fac5f4b5 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:51.841965 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b305ced-ef36-4a66-84d3-770cca55b197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:51.842703 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b305ced-ef36-4a66-84d3-770cca55b197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:51.843076 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b305ced-ef36-4a66-84d3-770cca55b197 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:51.843446 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b305ced-ef36-4a66-84d3-770cca55b197 admin admin] PATH_INFO: `/v3/projects/31534f72535e49e7b43e1904b1772d34` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:51.844823 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b305ced-ef36-4a66-84d3-770cca55b197 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31534f72535e49e7b43e1904b1772d34)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:51.846952 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b305ced-ef36-4a66-84d3-770cca55b197 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:51.867836 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe2348c-5c59-4b7d-96d4-bfcb24c3b826 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1de22711264e42abe8de3f935f35b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecea19ee353d4977baafbdf022b94887', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:51.868485 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2348c-5c59-4b7d-96d4-bfcb24c3b826 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:51.868765 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2348c-5c59-4b7d-96d4-bfcb24c3b826 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:51.869037 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2348c-5c59-4b7d-96d4-bfcb24c3b826 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] PATH_INFO: `/v3/projects/a75d546db2fb40baa9ad3d22fbeb7ce1` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:51.870197 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe2348c-5c59-4b7d-96d4-bfcb24c3b826 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] RBAC: Authorizing `identity:get_project(project_id=a75d546db2fb40baa9ad3d22fbeb7ce1)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:51.873084 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe2348c-5c59-4b7d-96d4-bfcb24c3b826 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:51.879126 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1088/2187] 10.222.0.83 () {58 vars in 1443 bytes} [Mon Aug 29 15:38:51 2022] GET /identity/v3/projects/a75d546db2fb40baa9ad3d22fbeb7ce1 => generated 393 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:38:51.880831 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe2348c-5c59-4b7d-96d4-bfcb24c3b826 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:51.895843 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe2348c-5c59-4b7d-96d4-bfcb24c3b826 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:51.905974 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db2bcf-5f9b-4af4-ad5a-dd1e26f2873f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:51.906644 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db2bcf-5f9b-4af4-ad5a-dd1e26f2873f admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:51.906978 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db2bcf-5f9b-4af4-ad5a-dd1e26f2873f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:51.907429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db2bcf-5f9b-4af4-ad5a-dd1e26f2873f admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:51.908260 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55db2bcf-5f9b-4af4-ad5a-dd1e26f2873f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:51.910520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55db2bcf-5f9b-4af4-ad5a-dd1e26f2873f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:51.921620 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:51.929328 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0b305ced-ef36-4a66-84d3-770cca55b197 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31534f72535e49e7b43e1904b1772d34', 'request_id': 'req-0b305ced-ef36-4a66-84d3-770cca55b197'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:51.940539 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1089/2188] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:38:51 2022] POST /identity/v3/users => generated 293 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:51.948491 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0b305ced-ef36-4a66-84d3-770cca55b197 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31534f72535e49e7b43e1904b1772d34', 'request_id': 'req-0b305ced-ef36-4a66-84d3-770cca55b197'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:51.949894 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db2bcf-5f9b-4af4-ad5a-dd1e26f2873f admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:51.962383 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0b305ced-ef36-4a66-84d3-770cca55b197 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31534f72535e49e7b43e1904b1772d34', 'request_id': 'req-0b305ced-ef36-4a66-84d3-770cca55b197'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:51.984127 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db2bcf-5f9b-4af4-ad5a-dd1e26f2873f admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:51.984963 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0b305ced-ef36-4a66-84d3-770cca55b197 admin admin] The token cache is being invalidate because project 31534f72535e49e7b43e1904b1772d34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:38:51.985326 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0b305ced-ef36-4a66-84d3-770cca55b197 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:51.986219 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0b305ced-ef36-4a66-84d3-770cca55b197 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:51.989097 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1100/2189] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:38:51 2022] DELETE /identity/v3/projects/31534f72535e49e7b43e1904b1772d34 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:51.991186 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0f129-9026-452d-ba2f-2578158fdfd0 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:51.991835 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0f129-9026-452d-ba2f-2578158fdfd0 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:51.992525 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0f129-9026-452d-ba2f-2578158fdfd0 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:51.995554 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1101/2190] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 15:38:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:38:51.996916 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0f129-9026-452d-ba2f-2578158fdfd0 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:52.000125 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9be0f129-9026-452d-ba2f-2578158fdfd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:52.041280 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:52.061668 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40182e09-246a-4929-bbab-e5bf9be7b26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:52.062283 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40182e09-246a-4929-bbab-e5bf9be7b26f admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:52.062554 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40182e09-246a-4929-bbab-e5bf9be7b26f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:52.062818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40182e09-246a-4929-bbab-e5bf9be7b26f admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:52.063507 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40182e09-246a-4929-bbab-e5bf9be7b26f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:52.065110 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40182e09-246a-4929-bbab-e5bf9be7b26f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:52.077446 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1090/2191] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:52.078356 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40182e09-246a-4929-bbab-e5bf9be7b26f admin admin] Authenticating service token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:38:52.080077 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-40182e09-246a-4929-bbab-e5bf9be7b26f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:52.086869 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0f129-9026-452d-ba2f-2578158fdfd0 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:52.091804 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae571c-6e72-4225-8d09-945f12ec91a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:52.092555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae571c-6e72-4225-8d09-945f12ec91a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:52.092829 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae571c-6e72-4225-8d09-945f12ec91a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:52.093098 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae571c-6e72-4225-8d09-945f12ec91a8 admin admin] PATH_INFO: `/v3/users/38bbfbfe975543769bfe3efd1a5d7cb0` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:52.094559 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae571c-6e72-4225-8d09-945f12ec91a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38bbfbfe975543769bfe3efd1a5d7cb0)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:52.096526 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae571c-6e72-4225-8d09-945f12ec91a8 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:52.198337 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-11ae571c-6e72-4225-8d09-945f12ec91a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38bbfbfe975543769bfe3efd1a5d7cb0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:52.199134 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-11ae571c-6e72-4225-8d09-945f12ec91a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38bbfbfe975543769bfe3efd1a5d7cb0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:52.220460 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-11ae571c-6e72-4225-8d09-945f12ec91a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38bbfbfe975543769bfe3efd1a5d7cb0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:52.234700 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-11ae571c-6e72-4225-8d09-945f12ec91a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38bbfbfe975543769bfe3efd1a5d7cb0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:52.238092 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40182e09-246a-4929-bbab-e5bf9be7b26f admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:52.241966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-40182e09-246a-4929-bbab-e5bf9be7b26f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:52.262751 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-11ae571c-6e72-4225-8d09-945f12ec91a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38bbfbfe975543769bfe3efd1a5d7cb0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:52.272759 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1102/2192] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:38:51 2022] DELETE /identity/v3/users/38bbfbfe975543769bfe3efd1a5d7cb0 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:52.275678 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae571c-6e72-4225-8d09-945f12ec91a8 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:52.279454 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-11ae571c-6e72-4225-8d09-945f12ec91a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:52.405760 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae571c-6e72-4225-8d09-945f12ec91a8 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:52.415805 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c378959-0ada-4cb7-8bc3-ae0d00a9f22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:52.416499 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c378959-0ada-4cb7-8bc3-ae0d00a9f22b admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:52.416900 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c378959-0ada-4cb7-8bc3-ae0d00a9f22b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:52.417182 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c378959-0ada-4cb7-8bc3-ae0d00a9f22b admin admin] PATH_INFO: `/v3/projects/3de9c364ce18429cb7b464aeea76b3e4/users/b1db1584b8944aa39d318522d0f502d4/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:52.428227 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40182e09-246a-4929-bbab-e5bf9be7b26f admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:52.456709 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c378959-0ada-4cb7-8bc3-ae0d00a9f22b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3de9c364ce18429cb7b464aeea76b3e4, user_id=b1db1584b8944aa39d318522d0f502d4, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:52.461774 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c378959-0ada-4cb7-8bc3-ae0d00a9f22b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:52.492972 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:52.500194 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1103/2193] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:38:52 2022] PUT /identity/v3/projects/3de9c364ce18429cb7b464aeea76b3e4/users/b1db1584b8944aa39d318522d0f502d4/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:52.505036 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c378959-0ada-4cb7-8bc3-ae0d00a9f22b admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:52.563639 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:52.586720 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea157ff-2de1-458a-822f-f86eb915e81b tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1de22711264e42abe8de3f935f35b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecea19ee353d4977baafbdf022b94887', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:52.587528 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea157ff-2de1-458a-822f-f86eb915e81b tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:52.590055 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea157ff-2de1-458a-822f-f86eb915e81b tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:52.590479 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea157ff-2de1-458a-822f-f86eb915e81b tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] PATH_INFO: `/v3/projects/a75d546db2fb40baa9ad3d22fbeb7ce1` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:52.592375 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea157ff-2de1-458a-822f-f86eb915e81b tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] RBAC: Authorizing `identity:get_project(project_id=a75d546db2fb40baa9ad3d22fbeb7ce1)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:52.597157 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea157ff-2de1-458a-822f-f86eb915e81b tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:52.603755 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1091/2194] 10.222.0.83 () {58 vars in 1443 bytes} [Mon Aug 29 15:38:52 2022] GET /identity/v3/projects/a75d546db2fb40baa9ad3d22fbeb7ce1 => generated 393 bytes in 526 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:38:52.623299 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c378959-0ada-4cb7-8bc3-ae0d00a9f22b admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:52.629653 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7001cf63-2e7e-4088-b84d-db4daae05033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:52.631373 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001cf63-2e7e-4088-b84d-db4daae05033 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:52.631944 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001cf63-2e7e-4088-b84d-db4daae05033 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:52.632400 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001cf63-2e7e-4088-b84d-db4daae05033 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:52.633139 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7001cf63-2e7e-4088-b84d-db4daae05033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:52.634887 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7001cf63-2e7e-4088-b84d-db4daae05033 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:52.650547 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1104/2195] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:52.652949 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea157ff-2de1-458a-822f-f86eb915e81b tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:52.672437 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea157ff-2de1-458a-822f-f86eb915e81b tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:52.678925 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d527178-a56f-41ac-8450-b319f1569bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:52.679700 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d527178-a56f-41ac-8450-b319f1569bc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:52.680032 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d527178-a56f-41ac-8450-b319f1569bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:52.680255 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d527178-a56f-41ac-8450-b319f1569bc9 admin admin] PATH_INFO: `/v3/projects/3de9c364ce18429cb7b464aeea76b3e4/users/b1db1584b8944aa39d318522d0f502d4/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:52.687889 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d527178-a56f-41ac-8450-b319f1569bc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3de9c364ce18429cb7b464aeea76b3e4, user_id=b1db1584b8944aa39d318522d0f502d4, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:52.702652 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d527178-a56f-41ac-8450-b319f1569bc9 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:52.719447 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1092/2196] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:38:52 2022] PUT /identity/v3/projects/3de9c364ce18429cb7b464aeea76b3e4/users/b1db1584b8944aa39d318522d0f502d4/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:52.735589 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69af344-64f0-4044-ba05-6c511e03bd1e None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:52.736817 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69af344-64f0-4044-ba05-6c511e03bd1e None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:52.736817 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69af344-64f0-4044-ba05-6c511e03bd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:52.819963 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-e69af344-64f0-4044-ba05-6c511e03bd1e None None] MFA Rules not processed for user `b1db1584b8944aa39d318522d0f502d4`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:52.823107 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e69af344-64f0-4044-ba05-6c511e03bd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:52.990570 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1cdcf-254e-492b-a60e-a746a72c067b None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:52.990887 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1cdcf-254e-492b-a60e-a746a72c067b None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:52.992502 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1cdcf-254e-492b-a60e-a746a72c067b None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:52.993917 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1093/2197] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 15:38:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:38:53.008848 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1105/2198] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:52 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:53.014024 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1cdcf-254e-492b-a60e-a746a72c067b None None] Authenticating service token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:38:53.016161 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a5a1cdcf-254e-492b-a60e-a746a72c067b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:53.022846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69af344-64f0-4044-ba05-6c511e03bd1e None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:53.048617 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69af344-64f0-4044-ba05-6c511e03bd1e None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:53.066521 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ecfac-e19e-4480-9492-10b6baab3cf6 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1db1584b8944aa39d318522d0f502d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3de9c364ce18429cb7b464aeea76b3e4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:53.067106 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ecfac-e19e-4480-9492-10b6baab3cf6 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:53.067395 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ecfac-e19e-4480-9492-10b6baab3cf6 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:53.067668 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ecfac-e19e-4480-9492-10b6baab3cf6 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:53.068367 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ecfac-e19e-4480-9492-10b6baab3cf6 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:38:53.068676 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ecfac-e19e-4480-9492-10b6baab3cf6 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:53.070322 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ecfac-e19e-4480-9492-10b6baab3cf6 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:53.089524 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1106/2199] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:38:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:38:53.091500 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ecfac-e19e-4480-9492-10b6baab3cf6 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:53.097211 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-de3ecfac-e19e-4480-9492-10b6baab3cf6 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:53.150878 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1cdcf-254e-492b-a60e-a746a72c067b None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:53.152157 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a5a1cdcf-254e-492b-a60e-a746a72c067b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:53.173097 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ecfac-e19e-4480-9492-10b6baab3cf6 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:53.178586 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c953858-801d-4f08-af60-2a63e679cc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:53.179249 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c953858-801d-4f08-af60-2a63e679cc02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:53.179528 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c953858-801d-4f08-af60-2a63e679cc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:53.179802 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c953858-801d-4f08-af60-2a63e679cc02 admin admin] PATH_INFO: `/v3/projects/2e9b5476d08040c4b1b24e87f40d78e4` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:53.180929 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c953858-801d-4f08-af60-2a63e679cc02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e9b5476d08040c4b1b24e87f40d78e4)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:53.182846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c953858-801d-4f08-af60-2a63e679cc02 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:53.220657 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1cdcf-254e-492b-a60e-a746a72c067b None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:53.225060 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:53.233304 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3c953858-801d-4f08-af60-2a63e679cc02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e9b5476d08040c4b1b24e87f40d78e4', 'request_id': 'req-3c953858-801d-4f08-af60-2a63e679cc02'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:53.238734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3c953858-801d-4f08-af60-2a63e679cc02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e9b5476d08040c4b1b24e87f40d78e4', 'request_id': 'req-3c953858-801d-4f08-af60-2a63e679cc02'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:53.250140 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3c953858-801d-4f08-af60-2a63e679cc02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e9b5476d08040c4b1b24e87f40d78e4', 'request_id': 'req-3c953858-801d-4f08-af60-2a63e679cc02'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:53.264242 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3c953858-801d-4f08-af60-2a63e679cc02 admin admin] The token cache is being invalidate because project 2e9b5476d08040c4b1b24e87f40d78e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:38:53.264536 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3c953858-801d-4f08-af60-2a63e679cc02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:53.266070 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3c953858-801d-4f08-af60-2a63e679cc02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:53.267671 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1107/2200] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:38:53 2022] DELETE /identity/v3/projects/2e9b5476d08040c4b1b24e87f40d78e4 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:53.268554 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c953858-801d-4f08-af60-2a63e679cc02 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:53.272891 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3c953858-801d-4f08-af60-2a63e679cc02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:53.275732 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:53.283159 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f97cf-5dba-42f7-9bd5-0b47cb62b1e3 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1de22711264e42abe8de3f935f35b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecea19ee353d4977baafbdf022b94887', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:53.284021 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f97cf-5dba-42f7-9bd5-0b47cb62b1e3 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:53.284490 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f97cf-5dba-42f7-9bd5-0b47cb62b1e3 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:53.284769 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f97cf-5dba-42f7-9bd5-0b47cb62b1e3 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] PATH_INFO: `/v3/projects/d7bf3bf3b2aa46f9b8a821aeffd4570c` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:53.285902 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f97cf-5dba-42f7-9bd5-0b47cb62b1e3 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] RBAC: Authorizing `identity:get_project(project_id=d7bf3bf3b2aa46f9b8a821aeffd4570c)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:53.288549 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f97cf-5dba-42f7-9bd5-0b47cb62b1e3 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:53.290709 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1094/2201] 10.222.0.83 () {58 vars in 1443 bytes} [Mon Aug 29 15:38:53 2022] GET /identity/v3/projects/d7bf3bf3b2aa46f9b8a821aeffd4570c => generated 393 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:38:53.291964 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a26be-e4a0-490c-96f0-e49409be3a7e None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:53.292264 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a26be-e4a0-490c-96f0-e49409be3a7e None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:53.292545 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a26be-e4a0-490c-96f0-e49409be3a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:53.317144 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-726a26be-e4a0-490c-96f0-e49409be3a7e None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:53.318775 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-726a26be-e4a0-490c-96f0-e49409be3a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:53.349020 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c953858-801d-4f08-af60-2a63e679cc02 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:53.354656 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcbeddc-071d-4478-b583-32c418f013df tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1db1584b8944aa39d318522d0f502d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3de9c364ce18429cb7b464aeea76b3e4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:53.355308 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcbeddc-071d-4478-b583-32c418f013df tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:53.355594 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcbeddc-071d-4478-b583-32c418f013df tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:53.355923 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcbeddc-071d-4478-b583-32c418f013df tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:53.357593 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcbeddc-071d-4478-b583-32c418f013df tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:53.358705 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcbeddc-071d-4478-b583-32c418f013df tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:53.386938 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1095/2202] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:53.401308 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba1ee1-70ba-4123-a9d4-5c97a37b08ca None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:53.402005 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba1ee1-70ba-4123-a9d4-5c97a37b08ca None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:53.402284 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba1ee1-70ba-4123-a9d4-5c97a37b08ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:53.426889 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1108/2203] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:38:53 2022] POST /identity/v3/projects => generated 369 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:53.428139 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcbeddc-071d-4478-b583-32c418f013df tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:53.431220 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-72ba1ee1-70ba-4123-a9d4-5c97a37b08ca None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:53.431759 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-edcbeddc-071d-4478-b583-32c418f013df tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:53.432734 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-72ba1ee1-70ba-4123-a9d4-5c97a37b08ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:53.529361 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1096/2204] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:53.530789 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba1ee1-70ba-4123-a9d4-5c97a37b08ca None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:53.587673 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcbeddc-071d-4478-b583-32c418f013df tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:53.594733 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8aed8-6653-456c-92bd-b26c4602a22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:53.595515 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8aed8-6653-456c-92bd-b26c4602a22f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:53.595793 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8aed8-6653-456c-92bd-b26c4602a22f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:53.596067 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8aed8-6653-456c-92bd-b26c4602a22f admin admin] PATH_INFO: `/v3/users/9219bd04e3094ffabddfc2b0d2e18583` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:53.598056 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c8aed8-6653-456c-92bd-b26c4602a22f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9219bd04e3094ffabddfc2b0d2e18583)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:53.601592 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c8aed8-6653-456c-92bd-b26c4602a22f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:53.637659 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba1ee1-70ba-4123-a9d4-5c97a37b08ca None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:53.656908 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0680b20-6fc6-4cc9-aaf5-ca7591af7edc tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1db1584b8944aa39d318522d0f502d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3de9c364ce18429cb7b464aeea76b3e4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:53.657718 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0680b20-6fc6-4cc9-aaf5-ca7591af7edc tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:53.658129 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0680b20-6fc6-4cc9-aaf5-ca7591af7edc tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:53.658331 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0680b20-6fc6-4cc9-aaf5-ca7591af7edc tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:53.658983 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0680b20-6fc6-4cc9-aaf5-ca7591af7edc tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:38:53.659373 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0680b20-6fc6-4cc9-aaf5-ca7591af7edc tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:53.661206 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0680b20-6fc6-4cc9-aaf5-ca7591af7edc tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:53.683152 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-84c8aed8-6653-456c-92bd-b26c4602a22f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9219bd04e3094ffabddfc2b0d2e18583'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:53.686479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-84c8aed8-6653-456c-92bd-b26c4602a22f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9219bd04e3094ffabddfc2b0d2e18583'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:53.688002 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1097/2205] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:38:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:38:53.689094 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0680b20-6fc6-4cc9-aaf5-ca7591af7edc tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:53.732241 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:53.737322 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0680b20-6fc6-4cc9-aaf5-ca7591af7edc tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:53.747404 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d6a2c-5579-4ab7-b6a8-c6c2dcc38821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:53.748257 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d6a2c-5579-4ab7-b6a8-c6c2dcc38821 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:53.748539 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d6a2c-5579-4ab7-b6a8-c6c2dcc38821 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:53.748863 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d6a2c-5579-4ab7-b6a8-c6c2dcc38821 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:53.749528 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d6a2c-5579-4ab7-b6a8-c6c2dcc38821 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:38:53.749830 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d6a2c-5579-4ab7-b6a8-c6c2dcc38821 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:53.753221 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d6a2c-5579-4ab7-b6a8-c6c2dcc38821 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:53.754241 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-84c8aed8-6653-456c-92bd-b26c4602a22f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9219bd04e3094ffabddfc2b0d2e18583'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:53.770107 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-84c8aed8-6653-456c-92bd-b26c4602a22f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9219bd04e3094ffabddfc2b0d2e18583'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:53.781757 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-84c8aed8-6653-456c-92bd-b26c4602a22f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9219bd04e3094ffabddfc2b0d2e18583'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:53.790873 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1109/2206] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:38:53 2022] DELETE /identity/v3/users/9219bd04e3094ffabddfc2b0d2e18583 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:53.795095 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1098/2207] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:38:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:38:53.795740 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8aed8-6653-456c-92bd-b26c4602a22f admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:53.795897 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eae066-1143-4ba2-a9d7-92c5ea4ca936 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:53.796185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eae066-1143-4ba2-a9d7-92c5ea4ca936 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:53.796454 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eae066-1143-4ba2-a9d7-92c5ea4ca936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:53.797627 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-84c8aed8-6653-456c-92bd-b26c4602a22f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:53.831862 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-66eae066-1143-4ba2-a9d7-92c5ea4ca936 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:53.834014 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-66eae066-1143-4ba2-a9d7-92c5ea4ca936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:53.877633 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:53.897327 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8aed8-6653-456c-92bd-b26c4602a22f admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:53.904078 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6330c0-c2a8-4d03-8101-845b061a34a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:53.904863 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6330c0-c2a8-4d03-8101-845b061a34a8 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:53.905288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6330c0-c2a8-4d03-8101-845b061a34a8 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:53.905768 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6330c0-c2a8-4d03-8101-845b061a34a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:53.908517 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ca6330c0-c2a8-4d03-8101-845b061a34a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:53.937544 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1099/2208] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:53.938922 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eae066-1143-4ba2-a9d7-92c5ea4ca936 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:53.940746 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-66eae066-1143-4ba2-a9d7-92c5ea4ca936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:53.954106 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eae066-1143-4ba2-a9d7-92c5ea4ca936 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:53.962394 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae52352-c430-49d2-9cd4-87b8c94609b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:53.962394 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae52352-c430-49d2-9cd4-87b8c94609b5 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:53.962685 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae52352-c430-49d2-9cd4-87b8c94609b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:53.962949 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae52352-c430-49d2-9cd4-87b8c94609b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:53.963613 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae52352-c430-49d2-9cd4-87b8c94609b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:53.966598 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae52352-c430-49d2-9cd4-87b8c94609b5 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:53.995850 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6330c0-c2a8-4d03-8101-845b061a34a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:53.999375 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6330c0-c2a8-4d03-8101-845b061a34a8 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:54.014946 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1100/2209] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:38:53 2022] POST /identity/v3/projects => generated 383 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:54.014946 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae52352-c430-49d2-9cd4-87b8c94609b5 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:54.014946 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-cae52352-c430-49d2-9cd4-87b8c94609b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:54.026310 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1110/2210] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:53 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:38:54.027835 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6330c0-c2a8-4d03-8101-845b061a34a8 service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:54.040803 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6330c0-c2a8-4d03-8101-845b061a34a8 service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:54.122379 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae52352-c430-49d2-9cd4-87b8c94609b5 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:54.128178 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75897a-88c8-4d5a-94c5-fa1a70c83cd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:54.129404 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75897a-88c8-4d5a-94c5-fa1a70c83cd8 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:54.129962 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75897a-88c8-4d5a-94c5-fa1a70c83cd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:54.130256 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75897a-88c8-4d5a-94c5-fa1a70c83cd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:54.131942 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343aec8e-a74d-4497-87aa-c8db06f74290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:54.132676 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343aec8e-a74d-4497-87aa-c8db06f74290 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:54.134599 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343aec8e-a74d-4497-87aa-c8db06f74290 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:54.135604 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343aec8e-a74d-4497-87aa-c8db06f74290 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:54.136454 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343aec8e-a74d-4497-87aa-c8db06f74290 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:54.139420 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343aec8e-a74d-4497-87aa-c8db06f74290 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:54.147701 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75897a-88c8-4d5a-94c5-fa1a70c83cd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:54.150837 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75897a-88c8-4d5a-94c5-fa1a70c83cd8 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:54.163390 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:54.163684 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1101/2211] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:38:54.165477 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7408157-0277-462b-bc60-46a5ac24846b None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:54.165917 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7408157-0277-462b-bc60-46a5ac24846b None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:54.166383 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7408157-0277-462b-bc60-46a5ac24846b None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:54.167999 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1102/2212] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 15:38:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:38:54.176141 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7408157-0277-462b-bc60-46a5ac24846b None None] Authenticating service token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:38:54.186975 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1111/2213] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:38:54 2022] POST /identity/v3/users => generated 292 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:54.193351 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343aec8e-a74d-4497-87aa-c8db06f74290 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:54.213649 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343aec8e-a74d-4497-87aa-c8db06f74290 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:54.223852 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00d20f-44ed-4820-9e38-3356503a3f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:54.226409 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00d20f-44ed-4820-9e38-3356503a3f50 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:54.227124 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00d20f-44ed-4820-9e38-3356503a3f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:54.227593 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00d20f-44ed-4820-9e38-3356503a3f50 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:54.229239 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e00d20f-44ed-4820-9e38-3356503a3f50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:54.231967 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e00d20f-44ed-4820-9e38-3356503a3f50 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:54.246359 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1112/2214] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:54.251697 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00d20f-44ed-4820-9e38-3356503a3f50 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:54.265658 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00d20f-44ed-4820-9e38-3356503a3f50 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:54.272203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54afa743-6fc8-4bb7-b695-0d4d6a3bd89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:54.273373 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afa743-6fc8-4bb7-b695-0d4d6a3bd89a admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:54.273677 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afa743-6fc8-4bb7-b695-0d4d6a3bd89a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:54.274479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afa743-6fc8-4bb7-b695-0d4d6a3bd89a admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:54.275221 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54afa743-6fc8-4bb7-b695-0d4d6a3bd89a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:54.277337 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54afa743-6fc8-4bb7-b695-0d4d6a3bd89a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:54.289932 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1113/2215] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:54.294120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54afa743-6fc8-4bb7-b695-0d4d6a3bd89a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:54.308131 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54afa743-6fc8-4bb7-b695-0d4d6a3bd89a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:54.315242 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73067e9c-36d7-445f-b648-de760bb27bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:54.316049 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73067e9c-36d7-445f-b648-de760bb27bf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:54.316424 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73067e9c-36d7-445f-b648-de760bb27bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:54.316989 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73067e9c-36d7-445f-b648-de760bb27bf4 admin admin] PATH_INFO: `/v3/projects/b14d17b6ccdc4d4d874ff1e303d3eb6c/users/53387bcdf14248b9bdf716e782b786d7/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:54.338176 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73067e9c-36d7-445f-b648-de760bb27bf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b14d17b6ccdc4d4d874ff1e303d3eb6c, user_id=53387bcdf14248b9bdf716e782b786d7, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:54.340716 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7408157-0277-462b-bc60-46a5ac24846b None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:54.342389 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73067e9c-36d7-445f-b648-de760bb27bf4 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:54.363526 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1114/2216] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:38:54 2022] PUT /identity/v3/projects/b14d17b6ccdc4d4d874ff1e303d3eb6c/users/53387bcdf14248b9bdf716e782b786d7/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:54.369164 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e61041-f239-4b57-b46c-d8869529cffb None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:54.369662 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e61041-f239-4b57-b46c-d8869529cffb None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:54.370030 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e61041-f239-4b57-b46c-d8869529cffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:54.408414 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-28e61041-f239-4b57-b46c-d8869529cffb None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:54.409730 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-28e61041-f239-4b57-b46c-d8869529cffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:54.424053 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:54.464432 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7408157-0277-462b-bc60-46a5ac24846b None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:54.527556 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1115/2217] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:54.551516 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e61041-f239-4b57-b46c-d8869529cffb None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:54.554131 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-28e61041-f239-4b57-b46c-d8869529cffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:54.569389 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d9e4c6-21d0-45a6-9169-6eb02870ff70 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1db1584b8944aa39d318522d0f502d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3de9c364ce18429cb7b464aeea76b3e4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:54.570416 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9e4c6-21d0-45a6-9169-6eb02870ff70 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:54.571552 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9e4c6-21d0-45a6-9169-6eb02870ff70 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:54.572061 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9e4c6-21d0-45a6-9169-6eb02870ff70 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] PATH_INFO: `/v3/projects/f03b5a83a1334637a71483a2fe697557` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:54.575370 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d9e4c6-21d0-45a6-9169-6eb02870ff70 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: Authorizing `identity:get_project(project_id=f03b5a83a1334637a71483a2fe697557)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:54.580011 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d9e4c6-21d0-45a6-9169-6eb02870ff70 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:54.590220 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1103/2218] 10.222.0.83 () {58 vars in 1443 bytes} [Mon Aug 29 15:38:54 2022] GET /identity/v3/projects/f03b5a83a1334637a71483a2fe697557 => generated 369 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:38:54.633956 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f6ff9-280d-42c3-a587-b2e93ebbb3c9 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:54.634477 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f6ff9-280d-42c3-a587-b2e93ebbb3c9 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:54.635642 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f6ff9-280d-42c3-a587-b2e93ebbb3c9 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:54.638254 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1104/2219] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 15:38:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:38:54.647078 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f6ff9-280d-42c3-a587-b2e93ebbb3c9 None None] Authenticating service token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:38:54.649975 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-883f6ff9-280d-42c3-a587-b2e93ebbb3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:54.668767 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e61041-f239-4b57-b46c-d8869529cffb None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:54.675080 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320acbe-4ce0-45fc-a791-337f47f55615 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:54.675855 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320acbe-4ce0-45fc-a791-337f47f55615 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:54.676616 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320acbe-4ce0-45fc-a791-337f47f55615 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:54.676869 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320acbe-4ce0-45fc-a791-337f47f55615 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:54.692580 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9320acbe-4ce0-45fc-a791-337f47f55615 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:54.695716 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9320acbe-4ce0-45fc-a791-337f47f55615 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:54.714304 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1116/2220] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:38:54.819002 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f6ff9-280d-42c3-a587-b2e93ebbb3c9 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:54.840498 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f6ff9-280d-42c3-a587-b2e93ebbb3c9 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:54.850929 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ba1df-3118-49e5-b5f6-0278bc9427af tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1db1584b8944aa39d318522d0f502d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3de9c364ce18429cb7b464aeea76b3e4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:54.852279 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ba1df-3118-49e5-b5f6-0278bc9427af tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:54.852553 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ba1df-3118-49e5-b5f6-0278bc9427af tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:54.853309 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ba1df-3118-49e5-b5f6-0278bc9427af tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] PATH_INFO: `/v3/projects/f03b5a83a1334637a71483a2fe697557` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:54.854728 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ba1df-3118-49e5-b5f6-0278bc9427af tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: Authorizing `identity:get_project(project_id=f03b5a83a1334637a71483a2fe697557)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:54.857931 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ba1df-3118-49e5-b5f6-0278bc9427af tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:54.861527 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1105/2221] 10.222.0.83 () {58 vars in 1443 bytes} [Mon Aug 29 15:38:54 2022] GET /identity/v3/projects/f03b5a83a1334637a71483a2fe697557 => generated 369 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:38:54.963721 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320acbe-4ce0-45fc-a791-337f47f55615 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:54.965463 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9320acbe-4ce0-45fc-a791-337f47f55615 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:54.997018 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320acbe-4ce0-45fc-a791-337f47f55615 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:55.008195 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce230b-66e4-49c7-9fa0-d926150a1337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:55.009461 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce230b-66e4-49c7-9fa0-d926150a1337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:55.009839 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce230b-66e4-49c7-9fa0-d926150a1337 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:55.010740 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce230b-66e4-49c7-9fa0-d926150a1337 admin admin] PATH_INFO: `/v3/projects/a75d546db2fb40baa9ad3d22fbeb7ce1` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:55.012859 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ce230b-66e4-49c7-9fa0-d926150a1337 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a75d546db2fb40baa9ad3d22fbeb7ce1)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:55.016623 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ce230b-66e4-49c7-9fa0-d926150a1337 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:55.130398 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:INSERT=2,keystone:SELECT=95,keystone:DELETE=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:55.148434 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a8ce230b-66e4-49c7-9fa0-d926150a1337 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a75d546db2fb40baa9ad3d22fbeb7ce1', 'request_id': 'req-a8ce230b-66e4-49c7-9fa0-d926150a1337'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:55.165292 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a8ce230b-66e4-49c7-9fa0-d926150a1337 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a75d546db2fb40baa9ad3d22fbeb7ce1', 'request_id': 'req-a8ce230b-66e4-49c7-9fa0-d926150a1337'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:55.180797 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a8ce230b-66e4-49c7-9fa0-d926150a1337 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a75d546db2fb40baa9ad3d22fbeb7ce1', 'request_id': 'req-a8ce230b-66e4-49c7-9fa0-d926150a1337'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:55.198168 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a8ce230b-66e4-49c7-9fa0-d926150a1337 admin admin] The token cache is being invalidate because project a75d546db2fb40baa9ad3d22fbeb7ce1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:38:55.198641 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a8ce230b-66e4-49c7-9fa0-d926150a1337 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:55.199690 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a8ce230b-66e4-49c7-9fa0-d926150a1337 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:55.205840 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1117/2222] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:38:54 2022] DELETE /identity/v3/projects/a75d546db2fb40baa9ad3d22fbeb7ce1 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:55.208025 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ba1df-3118-49e5-b5f6-0278bc9427af tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:55.217713 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d66ba1df-3118-49e5-b5f6-0278bc9427af tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:55.246550 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ba1df-3118-49e5-b5f6-0278bc9427af tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:55.304853 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0090d-2256-4608-bc2b-9c16635fe019 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:55.305069 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0090d-2256-4608-bc2b-9c16635fe019 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:55.305349 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0090d-2256-4608-bc2b-9c16635fe019 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:55.308601 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1118/2223] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 15:38:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:38:55.313497 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0090d-2256-4608-bc2b-9c16635fe019 None None] Authenticating service token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:38:55.315546 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1dc0090d-2256-4608-bc2b-9c16635fe019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:55.450957 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb9174-27f4-4abf-af55-574c11527b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:55.451655 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb9174-27f4-4abf-af55-574c11527b6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:55.451899 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb9174-27f4-4abf-af55-574c11527b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:55.452161 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb9174-27f4-4abf-af55-574c11527b6b admin admin] PATH_INFO: `/v3/users/9a1de22711264e42abe8de3f935f35b1` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:55.453354 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb9174-27f4-4abf-af55-574c11527b6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a1de22711264e42abe8de3f935f35b1)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:55.459719 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb9174-27f4-4abf-af55-574c11527b6b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:55.506595 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:55.524952 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0090d-2256-4608-bc2b-9c16635fe019 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:55.526723 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1dc0090d-2256-4608-bc2b-9c16635fe019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:55.600026 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-62cb9174-27f4-4abf-af55-574c11527b6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a1de22711264e42abe8de3f935f35b1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:55.601249 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-62cb9174-27f4-4abf-af55-574c11527b6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a1de22711264e42abe8de3f935f35b1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:55.623909 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-62cb9174-27f4-4abf-af55-574c11527b6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a1de22711264e42abe8de3f935f35b1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:55.646497 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-62cb9174-27f4-4abf-af55-574c11527b6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a1de22711264e42abe8de3f935f35b1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:55.649711 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-62cb9174-27f4-4abf-af55-574c11527b6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a1de22711264e42abe8de3f935f35b1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:55.661529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0090d-2256-4608-bc2b-9c16635fe019 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:55.674932 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b749b3f-980f-40c9-a60e-9aed9b3074c0 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1db1584b8944aa39d318522d0f502d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3de9c364ce18429cb7b464aeea76b3e4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:55.675615 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b749b3f-980f-40c9-a60e-9aed9b3074c0 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:55.678190 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b749b3f-980f-40c9-a60e-9aed9b3074c0 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:55.678834 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b749b3f-980f-40c9-a60e-9aed9b3074c0 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] PATH_INFO: `/v3/projects/f03b5a83a1334637a71483a2fe697557` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:55.682192 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b749b3f-980f-40c9-a60e-9aed9b3074c0 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: Authorizing `identity:get_project(project_id=f03b5a83a1334637a71483a2fe697557)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:55.684324 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b749b3f-980f-40c9-a60e-9aed9b3074c0 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:55.691525 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1119/2224] 10.222.0.83 () {58 vars in 1443 bytes} [Mon Aug 29 15:38:55 2022] GET /identity/v3/projects/f03b5a83a1334637a71483a2fe697557 => generated 369 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:38:55.695088 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1106/2225] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:38:55 2022] DELETE /identity/v3/users/9a1de22711264e42abe8de3f935f35b1 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:55.726756 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b749b3f-980f-40c9-a60e-9aed9b3074c0 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:55.729491 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3b749b3f-980f-40c9-a60e-9aed9b3074c0 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:55.750038 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b749b3f-980f-40c9-a60e-9aed9b3074c0 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:55.835341 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2261f9d-5051-4fbe-90a3-f16496b86ddc tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1db1584b8944aa39d318522d0f502d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3de9c364ce18429cb7b464aeea76b3e4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:55.836138 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2261f9d-5051-4fbe-90a3-f16496b86ddc tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:55.836428 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2261f9d-5051-4fbe-90a3-f16496b86ddc tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:55.836704 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2261f9d-5051-4fbe-90a3-f16496b86ddc tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] PATH_INFO: `/v3/projects/f03b5a83a1334637a71483a2fe697557` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:55.837901 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2261f9d-5051-4fbe-90a3-f16496b86ddc tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f03b5a83a1334637a71483a2fe697557)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:55.839914 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2261f9d-5051-4fbe-90a3-f16496b86ddc tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:55.859295 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:55.918589 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e2261f9d-5051-4fbe-90a3-f16496b86ddc tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f03b5a83a1334637a71483a2fe697557', 'request_id': 'req-e2261f9d-5051-4fbe-90a3-f16496b86ddc'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:55.927840 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e2261f9d-5051-4fbe-90a3-f16496b86ddc tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f03b5a83a1334637a71483a2fe697557', 'request_id': 'req-e2261f9d-5051-4fbe-90a3-f16496b86ddc'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:55.941380 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e2261f9d-5051-4fbe-90a3-f16496b86ddc tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f03b5a83a1334637a71483a2fe697557', 'request_id': 'req-e2261f9d-5051-4fbe-90a3-f16496b86ddc'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:55.962284 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e2261f9d-5051-4fbe-90a3-f16496b86ddc tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] The token cache is being invalidate because project f03b5a83a1334637a71483a2fe697557 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:38:55.962652 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e2261f9d-5051-4fbe-90a3-f16496b86ddc tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:55.963434 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e2261f9d-5051-4fbe-90a3-f16496b86ddc tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:55.972725 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1120/2226] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:38:55 2022] DELETE /identity/v3/projects/f03b5a83a1334637a71483a2fe697557 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:56.329631 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9ae9d-0001-4f53-adb1-dd13d3cf9877 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:56.329878 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9ae9d-0001-4f53-adb1-dd13d3cf9877 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:56.330150 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9ae9d-0001-4f53-adb1-dd13d3cf9877 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:56.331947 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1107/2227] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 15:38:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:38:56.346054 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2261f9d-5051-4fbe-90a3-f16496b86ddc tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Authenticating service token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:38:56.347748 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e2261f9d-5051-4fbe-90a3-f16496b86ddc tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:56.458212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2261f9d-5051-4fbe-90a3-f16496b86ddc tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:56.460014 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e2261f9d-5051-4fbe-90a3-f16496b86ddc tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:56.553166 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2261f9d-5051-4fbe-90a3-f16496b86ddc tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:56.558615 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d26ff98-3bde-4595-abf9-843a4e6276f3 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1db1584b8944aa39d318522d0f502d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3de9c364ce18429cb7b464aeea76b3e4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:56.559515 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26ff98-3bde-4595-abf9-843a4e6276f3 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:56.559633 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26ff98-3bde-4595-abf9-843a4e6276f3 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:56.559892 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26ff98-3bde-4595-abf9-843a4e6276f3 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] PATH_INFO: `/v3/projects/2cbf43758c944fe6bb6fad543fd251a6` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:56.561121 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d26ff98-3bde-4595-abf9-843a4e6276f3 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: Authorizing `identity:get_project(project_id=2cbf43758c944fe6bb6fad543fd251a6)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:56.563567 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d26ff98-3bde-4595-abf9-843a4e6276f3 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:56.565424 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1121/2228] 10.222.0.83 () {58 vars in 1443 bytes} [Mon Aug 29 15:38:56 2022] GET /identity/v3/projects/2cbf43758c944fe6bb6fad543fd251a6 => generated 375 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:38:56.588358 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9ae9d-0001-4f53-adb1-dd13d3cf9877 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:56.617184 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9ae9d-0001-4f53-adb1-dd13d3cf9877 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:56.628574 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f261c78-bd4b-46f9-be23-07d12f1a915d tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1db1584b8944aa39d318522d0f502d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3de9c364ce18429cb7b464aeea76b3e4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:56.629938 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f261c78-bd4b-46f9-be23-07d12f1a915d tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:56.629938 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f261c78-bd4b-46f9-be23-07d12f1a915d tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:56.630225 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f261c78-bd4b-46f9-be23-07d12f1a915d tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:56.631502 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f261c78-bd4b-46f9-be23-07d12f1a915d tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:38:56.631958 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f261c78-bd4b-46f9-be23-07d12f1a915d tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:56.636529 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f261c78-bd4b-46f9-be23-07d12f1a915d tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:56.676688 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1108/2229] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:38:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:38:56.681457 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d26ff98-3bde-4595-abf9-843a4e6276f3 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:56.697023 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d26ff98-3bde-4595-abf9-843a4e6276f3 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:56.703480 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ebcd78-bb0e-4fab-99b4-5e3bae6027b3 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1db1584b8944aa39d318522d0f502d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3de9c364ce18429cb7b464aeea76b3e4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:56.704637 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ebcd78-bb0e-4fab-99b4-5e3bae6027b3 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:56.708361 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ebcd78-bb0e-4fab-99b4-5e3bae6027b3 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:56.709037 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ebcd78-bb0e-4fab-99b4-5e3bae6027b3 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:56.710071 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ebcd78-bb0e-4fab-99b4-5e3bae6027b3 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:56.712470 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ebcd78-bb0e-4fab-99b4-5e3bae6027b3 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:56.758068 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1122/2230] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:38:56 2022] POST /identity/v3/projects => generated 371 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:56.762847 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f261c78-bd4b-46f9-be23-07d12f1a915d tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:56.779158 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f261c78-bd4b-46f9-be23-07d12f1a915d tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:56.889745 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125a67c3-9f5e-45d2-88c5-59c64341af5f tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1db1584b8944aa39d318522d0f502d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3de9c364ce18429cb7b464aeea76b3e4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:56.891204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a67c3-9f5e-45d2-88c5-59c64341af5f tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:56.891496 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a67c3-9f5e-45d2-88c5-59c64341af5f tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:56.891771 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a67c3-9f5e-45d2-88c5-59c64341af5f tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:56.892853 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125a67c3-9f5e-45d2-88c5-59c64341af5f tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:38:56.893181 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125a67c3-9f5e-45d2-88c5-59c64341af5f tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:56.896602 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125a67c3-9f5e-45d2-88c5-59c64341af5f tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:56.928573 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1109/2231] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:38:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:38:56.950132 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44ffb7-9ed9-4653-a427-935daafa092e None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:56.950421 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44ffb7-9ed9-4653-a427-935daafa092e None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:56.950699 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44ffb7-9ed9-4653-a427-935daafa092e None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:56.952432 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1123/2232] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 15:38:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:38:56.957902 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125a67c3-9f5e-45d2-88c5-59c64341af5f tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Authenticating service token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:38:56.960305 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-125a67c3-9f5e-45d2-88c5-59c64341af5f tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:57.042307 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125a67c3-9f5e-45d2-88c5-59c64341af5f tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:57.052533 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125a67c3-9f5e-45d2-88c5-59c64341af5f tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:57.058098 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64a353-7f06-40d4-8885-67620c889931 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1db1584b8944aa39d318522d0f502d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3de9c364ce18429cb7b464aeea76b3e4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:57.059161 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64a353-7f06-40d4-8885-67620c889931 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:57.059161 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64a353-7f06-40d4-8885-67620c889931 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:57.059376 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64a353-7f06-40d4-8885-67620c889931 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] PATH_INFO: `/v3/projects/62f1f658f0944b66a46b5e496f61ec14` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:57.060687 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64a353-7f06-40d4-8885-67620c889931 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: Authorizing `identity:get_project(project_id=62f1f658f0944b66a46b5e496f61ec14)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:57.062916 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64a353-7f06-40d4-8885-67620c889931 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:57.064898 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1110/2233] 10.222.0.83 () {58 vars in 1443 bytes} [Mon Aug 29 15:38:56 2022] GET /identity/v3/projects/62f1f658f0944b66a46b5e496f61ec14 => generated 371 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:38:57.160888 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205fafe2-ea0c-4103-b383-c18f127a90b2 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:57.161086 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205fafe2-ea0c-4103-b383-c18f127a90b2 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:57.161359 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205fafe2-ea0c-4103-b383-c18f127a90b2 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:57.163669 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1124/2234] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 15:38:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:38:57.168854 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64a353-7f06-40d4-8885-67620c889931 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Authenticating service token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:38:57.182480 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64a353-7f06-40d4-8885-67620c889931 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:57.187056 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:57.195576 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64a353-7f06-40d4-8885-67620c889931 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:57.201369 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c8d533-a00f-4f3d-b45f-8ee81cd71a46 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1db1584b8944aa39d318522d0f502d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3de9c364ce18429cb7b464aeea76b3e4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:57.202087 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c8d533-a00f-4f3d-b45f-8ee81cd71a46 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:57.202430 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c8d533-a00f-4f3d-b45f-8ee81cd71a46 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:57.202766 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c8d533-a00f-4f3d-b45f-8ee81cd71a46 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] PATH_INFO: `/v3/projects/62f1f658f0944b66a46b5e496f61ec14` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:57.203980 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c8d533-a00f-4f3d-b45f-8ee81cd71a46 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: Authorizing `identity:get_project(project_id=62f1f658f0944b66a46b5e496f61ec14)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:57.206098 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c8d533-a00f-4f3d-b45f-8ee81cd71a46 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:57.207881 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1111/2235] 10.222.0.83 () {58 vars in 1443 bytes} [Mon Aug 29 15:38:57 2022] GET /identity/v3/projects/62f1f658f0944b66a46b5e496f61ec14 => generated 371 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:38:57.254117 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205fafe2-ea0c-4103-b383-c18f127a90b2 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:57.267839 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205fafe2-ea0c-4103-b383-c18f127a90b2 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:57.272992 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b435c-7a88-4201-83bd-f71629468867 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1db1584b8944aa39d318522d0f502d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3de9c364ce18429cb7b464aeea76b3e4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:57.273712 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b435c-7a88-4201-83bd-f71629468867 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:57.274094 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b435c-7a88-4201-83bd-f71629468867 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:57.274467 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b435c-7a88-4201-83bd-f71629468867 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:57.275261 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b435c-7a88-4201-83bd-f71629468867 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:38:57.275667 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b435c-7a88-4201-83bd-f71629468867 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:57.277405 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b435c-7a88-4201-83bd-f71629468867 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:57.297016 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c8d533-a00f-4f3d-b45f-8ee81cd71a46 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:57.298182 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1125/2236] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:38:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:38:57.320515 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c8d533-a00f-4f3d-b45f-8ee81cd71a46 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:57.328616 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d4370-c09c-4775-bec8-66913c9624cc tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1db1584b8944aa39d318522d0f502d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3de9c364ce18429cb7b464aeea76b3e4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:57.329995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d4370-c09c-4775-bec8-66913c9624cc tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:57.330489 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d4370-c09c-4775-bec8-66913c9624cc tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:57.330922 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d4370-c09c-4775-bec8-66913c9624cc tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:57.332391 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d4370-c09c-4775-bec8-66913c9624cc tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:57.335531 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d4370-c09c-4775-bec8-66913c9624cc tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:57.393317 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1112/2237] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:38:57 2022] POST /identity/v3/users => generated 381 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:38:57.395455 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b435c-7a88-4201-83bd-f71629468867 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:57.403710 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:57.413015 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b435c-7a88-4201-83bd-f71629468867 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:57.422677 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e0b0f6-9115-4a86-b6f5-1577992c360e tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1db1584b8944aa39d318522d0f502d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3de9c364ce18429cb7b464aeea76b3e4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:57.424425 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0b0f6-9115-4a86-b6f5-1577992c360e tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:57.424806 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0b0f6-9115-4a86-b6f5-1577992c360e tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:57.425711 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0b0f6-9115-4a86-b6f5-1577992c360e tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:57.426649 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e0b0f6-9115-4a86-b6f5-1577992c360e tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:38:57.432137 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e0b0f6-9115-4a86-b6f5-1577992c360e tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:57.432461 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d4370-c09c-4775-bec8-66913c9624cc tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:57.435781 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f75d4370-c09c-4775-bec8-66913c9624cc tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:57.437164 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e0b0f6-9115-4a86-b6f5-1577992c360e tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:57.457393 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1126/2238] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:38:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:38:57.580320 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d4370-c09c-4775-bec8-66913c9624cc tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:57.590325 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68365a8-71ce-4c0c-84ea-fedaeb8b9eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:57.591322 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68365a8-71ce-4c0c-84ea-fedaeb8b9eda admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:57.591747 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68365a8-71ce-4c0c-84ea-fedaeb8b9eda admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:57.592077 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68365a8-71ce-4c0c-84ea-fedaeb8b9eda admin admin] PATH_INFO: `/v3/projects/ecea19ee353d4977baafbdf022b94887` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:57.595108 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68365a8-71ce-4c0c-84ea-fedaeb8b9eda admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecea19ee353d4977baafbdf022b94887)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:57.598991 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68365a8-71ce-4c0c-84ea-fedaeb8b9eda admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:57.647548 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc71a5-e795-4bb8-b29b-e066ed94067e None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:57.647881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc71a5-e795-4bb8-b29b-e066ed94067e None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:57.648148 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc71a5-e795-4bb8-b29b-e066ed94067e None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:57.650119 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1127/2239] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 15:38:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:38:57.660130 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc71a5-e795-4bb8-b29b-e066ed94067e None None] Authenticating service token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:38:57.686015 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc71a5-e795-4bb8-b29b-e066ed94067e None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:57.715209 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc71a5-e795-4bb8-b29b-e066ed94067e None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:57.725353 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b68365a8-71ce-4c0c-84ea-fedaeb8b9eda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecea19ee353d4977baafbdf022b94887', 'request_id': 'req-b68365a8-71ce-4c0c-84ea-fedaeb8b9eda'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:57.732395 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b68365a8-71ce-4c0c-84ea-fedaeb8b9eda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecea19ee353d4977baafbdf022b94887', 'request_id': 'req-b68365a8-71ce-4c0c-84ea-fedaeb8b9eda'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:57.749351 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b68365a8-71ce-4c0c-84ea-fedaeb8b9eda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecea19ee353d4977baafbdf022b94887', 'request_id': 'req-b68365a8-71ce-4c0c-84ea-fedaeb8b9eda'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:57.768087 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b68365a8-71ce-4c0c-84ea-fedaeb8b9eda admin admin] The token cache is being invalidate because project ecea19ee353d4977baafbdf022b94887 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:38:57.768491 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b68365a8-71ce-4c0c-84ea-fedaeb8b9eda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:57.769772 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b68365a8-71ce-4c0c-84ea-fedaeb8b9eda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:57.772814 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1113/2240] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:38:57 2022] DELETE /identity/v3/projects/ecea19ee353d4977baafbdf022b94887 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:57.780605 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68365a8-71ce-4c0c-84ea-fedaeb8b9eda admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:57.783741 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b68365a8-71ce-4c0c-84ea-fedaeb8b9eda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:57.814520 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c2ce5-7dd6-4303-8ba7-80e8ab3228d4 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1db1584b8944aa39d318522d0f502d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3de9c364ce18429cb7b464aeea76b3e4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:57.815438 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c2ce5-7dd6-4303-8ba7-80e8ab3228d4 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:57.815900 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c2ce5-7dd6-4303-8ba7-80e8ab3228d4 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:57.816328 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c2ce5-7dd6-4303-8ba7-80e8ab3228d4 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] PATH_INFO: `/v3/projects/62f1f658f0944b66a46b5e496f61ec14` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:57.817706 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c2ce5-7dd6-4303-8ba7-80e8ab3228d4 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: Authorizing `identity:get_project(project_id=62f1f658f0944b66a46b5e496f61ec14)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:57.820564 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c2ce5-7dd6-4303-8ba7-80e8ab3228d4 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:57.822460 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1128/2241] 10.222.0.83 () {58 vars in 1443 bytes} [Mon Aug 29 15:38:57 2022] GET /identity/v3/projects/62f1f658f0944b66a46b5e496f61ec14 => generated 371 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:38:57.930536 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68365a8-71ce-4c0c-84ea-fedaeb8b9eda admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:57.941558 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd3dbce-1cd4-4c0c-83ee-95517b5924d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:57.942483 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3dbce-1cd4-4c0c-83ee-95517b5924d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:57.942483 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3dbce-1cd4-4c0c-83ee-95517b5924d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:57.943404 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3dbce-1cd4-4c0c-83ee-95517b5924d8 admin admin] PATH_INFO: `/v3/users/98c1cb38626e479c9c3ab9c5efeb0303` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:57.946620 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd3dbce-1cd4-4c0c-83ee-95517b5924d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98c1cb38626e479c9c3ab9c5efeb0303)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:57.952346 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd3dbce-1cd4-4c0c-83ee-95517b5924d8 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:57.983304 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:58.074065 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7dd3dbce-1cd4-4c0c-83ee-95517b5924d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98c1cb38626e479c9c3ab9c5efeb0303'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:58.074065 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7dd3dbce-1cd4-4c0c-83ee-95517b5924d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98c1cb38626e479c9c3ab9c5efeb0303'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:58.084997 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7dd3dbce-1cd4-4c0c-83ee-95517b5924d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98c1cb38626e479c9c3ab9c5efeb0303'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:58.094905 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17d6c6-015e-4717-b134-8fe00fb97e95 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:58.095280 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17d6c6-015e-4717-b134-8fe00fb97e95 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:58.095639 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17d6c6-015e-4717-b134-8fe00fb97e95 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:58.096740 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7dd3dbce-1cd4-4c0c-83ee-95517b5924d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98c1cb38626e479c9c3ab9c5efeb0303'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:58.097156 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1129/2242] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 15:38:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:38:58.097794 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7dd3dbce-1cd4-4c0c-83ee-95517b5924d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98c1cb38626e479c9c3ab9c5efeb0303'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:58.106034 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17d6c6-015e-4717-b134-8fe00fb97e95 None None] Authenticating service token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:38:58.109238 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9b17d6c6-015e-4717-b134-8fe00fb97e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:58.123166 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1114/2243] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:38:57 2022] DELETE /identity/v3/users/98c1cb38626e479c9c3ab9c5efeb0303 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:58.252395 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17d6c6-015e-4717-b134-8fe00fb97e95 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:58.254442 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9b17d6c6-015e-4717-b134-8fe00fb97e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:58.274626 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17d6c6-015e-4717-b134-8fe00fb97e95 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:58.366837 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c9808-8989-4ef7-a3ae-19fee216538c tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1db1584b8944aa39d318522d0f502d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3de9c364ce18429cb7b464aeea76b3e4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:58.367523 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c9808-8989-4ef7-a3ae-19fee216538c tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:58.367923 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c9808-8989-4ef7-a3ae-19fee216538c tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:58.368141 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c9808-8989-4ef7-a3ae-19fee216538c tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] PATH_INFO: `/v3/projects/62f1f658f0944b66a46b5e496f61ec14` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:58.369334 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883c9808-8989-4ef7-a3ae-19fee216538c tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: Authorizing `identity:get_project(project_id=62f1f658f0944b66a46b5e496f61ec14)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:58.371475 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883c9808-8989-4ef7-a3ae-19fee216538c tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:58.373492 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1130/2244] 10.222.0.83 () {58 vars in 1443 bytes} [Mon Aug 29 15:38:58 2022] GET /identity/v3/projects/62f1f658f0944b66a46b5e496f61ec14 => generated 371 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:38:58.440648 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd3dbce-1cd4-4c0c-83ee-95517b5924d8 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:58.461122 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd3dbce-1cd4-4c0c-83ee-95517b5924d8 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:58.469916 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726255db-073a-4b09-9098-1c3cf717ee4b tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1db1584b8944aa39d318522d0f502d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3de9c364ce18429cb7b464aeea76b3e4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:58.470961 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726255db-073a-4b09-9098-1c3cf717ee4b tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:58.471553 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726255db-073a-4b09-9098-1c3cf717ee4b tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:58.472057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726255db-073a-4b09-9098-1c3cf717ee4b tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] PATH_INFO: `/v3/users/79469725d8b24289846eef62bf0427d6` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:58.511608 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726255db-073a-4b09-9098-1c3cf717ee4b tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: Authorizing `identity:delete_user(user_id=79469725d8b24289846eef62bf0427d6)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:58.515496 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726255db-073a-4b09-9098-1c3cf717ee4b tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:58.600507 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-726255db-073a-4b09-9098-1c3cf717ee4b tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79469725d8b24289846eef62bf0427d6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:58.602318 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-726255db-073a-4b09-9098-1c3cf717ee4b tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79469725d8b24289846eef62bf0427d6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:58.617507 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-726255db-073a-4b09-9098-1c3cf717ee4b tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79469725d8b24289846eef62bf0427d6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:58.636501 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-726255db-073a-4b09-9098-1c3cf717ee4b tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79469725d8b24289846eef62bf0427d6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:58.637304 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-726255db-073a-4b09-9098-1c3cf717ee4b tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79469725d8b24289846eef62bf0427d6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:58.670549 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1115/2245] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:38:58 2022] DELETE /identity/v3/users/79469725d8b24289846eef62bf0427d6 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:58.672193 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c9808-8989-4ef7-a3ae-19fee216538c tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:58.680054 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-883c9808-8989-4ef7-a3ae-19fee216538c tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:58.687624 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726255db-073a-4b09-9098-1c3cf717ee4b tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:58.703277 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-726255db-073a-4b09-9098-1c3cf717ee4b tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:58.708512 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c9808-8989-4ef7-a3ae-19fee216538c tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:58.757409 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:58.810620 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:58.839402 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726255db-073a-4b09-9098-1c3cf717ee4b tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:58.848421 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c1cf4-0fa5-4faa-aa06-49e619cb0ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:58.850321 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c1cf4-0fa5-4faa-aa06-49e619cb0ae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:58.850783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c1cf4-0fa5-4faa-aa06-49e619cb0ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:58.851306 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c1cf4-0fa5-4faa-aa06-49e619cb0ae6 admin admin] PATH_INFO: `/v3/projects/d7bf3bf3b2aa46f9b8a821aeffd4570c` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:58.859544 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c1cf4-0fa5-4faa-aa06-49e619cb0ae6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7bf3bf3b2aa46f9b8a821aeffd4570c)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:58.861602 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ced09-8564-4c79-bdba-e0a7682c61f5 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1db1584b8944aa39d318522d0f502d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3de9c364ce18429cb7b464aeea76b3e4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:58.861743 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c1cf4-0fa5-4faa-aa06-49e619cb0ae6 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:58.862774 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ced09-8564-4c79-bdba-e0a7682c61f5 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:58.863156 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ced09-8564-4c79-bdba-e0a7682c61f5 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:58.863497 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ced09-8564-4c79-bdba-e0a7682c61f5 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] PATH_INFO: `/v3/projects/62f1f658f0944b66a46b5e496f61ec14` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:58.865284 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073ced09-8564-4c79-bdba-e0a7682c61f5 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: Authorizing `identity:delete_project(project_id=62f1f658f0944b66a46b5e496f61ec14)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:58.867824 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073ced09-8564-4c79-bdba-e0a7682c61f5 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:59.018375 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f73c1cf4-0fa5-4faa-aa06-49e619cb0ae6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7bf3bf3b2aa46f9b8a821aeffd4570c', 'request_id': 'req-f73c1cf4-0fa5-4faa-aa06-49e619cb0ae6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:59.020294 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-073ced09-8564-4c79-bdba-e0a7682c61f5 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62f1f658f0944b66a46b5e496f61ec14', 'request_id': 'req-073ced09-8564-4c79-bdba-e0a7682c61f5'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:59.030535 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-073ced09-8564-4c79-bdba-e0a7682c61f5 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62f1f658f0944b66a46b5e496f61ec14', 'request_id': 'req-073ced09-8564-4c79-bdba-e0a7682c61f5'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:59.031907 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f73c1cf4-0fa5-4faa-aa06-49e619cb0ae6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7bf3bf3b2aa46f9b8a821aeffd4570c', 'request_id': 'req-f73c1cf4-0fa5-4faa-aa06-49e619cb0ae6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:59.042520 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-073ced09-8564-4c79-bdba-e0a7682c61f5 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62f1f658f0944b66a46b5e496f61ec14', 'request_id': 'req-073ced09-8564-4c79-bdba-e0a7682c61f5'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:59.047910 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f73c1cf4-0fa5-4faa-aa06-49e619cb0ae6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7bf3bf3b2aa46f9b8a821aeffd4570c', 'request_id': 'req-f73c1cf4-0fa5-4faa-aa06-49e619cb0ae6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:59.060204 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-073ced09-8564-4c79-bdba-e0a7682c61f5 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] The token cache is being invalidate because project 62f1f658f0944b66a46b5e496f61ec14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:38:59.060765 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-073ced09-8564-4c79-bdba-e0a7682c61f5 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:59.062526 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-073ced09-8564-4c79-bdba-e0a7682c61f5 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:59.065960 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1131/2246] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:38:58 2022] DELETE /identity/v3/projects/62f1f658f0944b66a46b5e496f61ec14 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:59.079831 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f73c1cf4-0fa5-4faa-aa06-49e619cb0ae6 admin admin] The token cache is being invalidate because project d7bf3bf3b2aa46f9b8a821aeffd4570c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:38:59.084107 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f73c1cf4-0fa5-4faa-aa06-49e619cb0ae6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:59.085234 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f73c1cf4-0fa5-4faa-aa06-49e619cb0ae6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:59.087058 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1116/2247] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:38:58 2022] DELETE /identity/v3/projects/d7bf3bf3b2aa46f9b8a821aeffd4570c => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:59.093129 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17e270-3686-4dfd-a046-9c25a1446cf7 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:59.093413 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17e270-3686-4dfd-a046-9c25a1446cf7 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:59.093923 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17e270-3686-4dfd-a046-9c25a1446cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:59.130032 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-3d17e270-3686-4dfd-a046-9c25a1446cf7 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:59.133014 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3d17e270-3686-4dfd-a046-9c25a1446cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:59.228741 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1132/2248] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:59.246153 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df105621-b80b-44ac-8f2a-436a1a1bb539 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:59.246521 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df105621-b80b-44ac-8f2a-436a1a1bb539 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:59.250547 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378037f-fbdf-4f20-8880-02d8180ddc36 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:59.251229 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378037f-fbdf-4f20-8880-02d8180ddc36 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:59.251364 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df105621-b80b-44ac-8f2a-436a1a1bb539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:59.251846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378037f-fbdf-4f20-8880-02d8180ddc36 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:59.255787 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1133/2249] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 15:38:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:38:59.264125 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6378037f-fbdf-4f20-8880-02d8180ddc36 None None] Authenticating service token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:38:59.268077 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6378037f-fbdf-4f20-8880-02d8180ddc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:59.283068 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-df105621-b80b-44ac-8f2a-436a1a1bb539 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:59.284562 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-df105621-b80b-44ac-8f2a-436a1a1bb539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:59.294835 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1117/2250] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:38:59.300628 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df105621-b80b-44ac-8f2a-436a1a1bb539 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:59.321760 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df105621-b80b-44ac-8f2a-436a1a1bb539 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:59.336328 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10554a81-7578-4e39-9690-143ea7cc427e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:59.336846 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10554a81-7578-4e39-9690-143ea7cc427e admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:59.337131 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10554a81-7578-4e39-9690-143ea7cc427e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:59.337404 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10554a81-7578-4e39-9690-143ea7cc427e admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:59.338067 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10554a81-7578-4e39-9690-143ea7cc427e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:38:59.338370 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10554a81-7578-4e39-9690-143ea7cc427e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:59.340023 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10554a81-7578-4e39-9690-143ea7cc427e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:59.353161 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1118/2251] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:38:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:38:59.357359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10554a81-7578-4e39-9690-143ea7cc427e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:59.366546 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:59.386290 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10554a81-7578-4e39-9690-143ea7cc427e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:59.393030 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f9472-f502-4943-a4ed-31fd671dc06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:59.394493 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f9472-f502-4943-a4ed-31fd671dc06c admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:59.394870 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f9472-f502-4943-a4ed-31fd671dc06c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:59.395267 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f9472-f502-4943-a4ed-31fd671dc06c admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:59.396921 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7f9472-f502-4943-a4ed-31fd671dc06c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:59.398862 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6378037f-fbdf-4f20-8880-02d8180ddc36 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:59.399573 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7f9472-f502-4943-a4ed-31fd671dc06c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:59.401130 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6378037f-fbdf-4f20-8880-02d8180ddc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:59.451556 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1119/2252] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:38:59 2022] POST /identity/v3/projects => generated 389 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:59.453110 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f9472-f502-4943-a4ed-31fd671dc06c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:59.546955 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6378037f-fbdf-4f20-8880-02d8180ddc36 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:59.586787 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f9472-f502-4943-a4ed-31fd671dc06c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:59.593471 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58750a64-ee66-4a17-bcc2-e45cf6eb318b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:59.594225 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58750a64-ee66-4a17-bcc2-e45cf6eb318b admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:59.595563 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58750a64-ee66-4a17-bcc2-e45cf6eb318b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:59.596052 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58750a64-ee66-4a17-bcc2-e45cf6eb318b admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:59.596570 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58750a64-ee66-4a17-bcc2-e45cf6eb318b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:59.599676 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58750a64-ee66-4a17-bcc2-e45cf6eb318b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:59.641336 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1120/2253] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:38:59 2022] POST /identity/v3/users => generated 295 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:59.644792 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58750a64-ee66-4a17-bcc2-e45cf6eb318b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:59.663738 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58750a64-ee66-4a17-bcc2-e45cf6eb318b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:59.672370 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffdf491-e37f-40f6-8c3d-c61187dfec16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:59.673377 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffdf491-e37f-40f6-8c3d-c61187dfec16 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:59.673864 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffdf491-e37f-40f6-8c3d-c61187dfec16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:59.674299 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffdf491-e37f-40f6-8c3d-c61187dfec16 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:59.675255 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffdf491-e37f-40f6-8c3d-c61187dfec16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:59.679614 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a512d62c-9c78-4763-b56e-4796cb551751 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1db1584b8944aa39d318522d0f502d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3de9c364ce18429cb7b464aeea76b3e4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:59.680278 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512d62c-9c78-4763-b56e-4796cb551751 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:59.680564 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512d62c-9c78-4763-b56e-4796cb551751 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:59.680852 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512d62c-9c78-4763-b56e-4796cb551751 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] PATH_INFO: `/v3/projects/2cbf43758c944fe6bb6fad543fd251a6` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:59.681147 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffdf491-e37f-40f6-8c3d-c61187dfec16 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:59.694358 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a512d62c-9c78-4763-b56e-4796cb551751 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: Authorizing `identity:get_project(project_id=2cbf43758c944fe6bb6fad543fd251a6)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:59.696659 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a512d62c-9c78-4763-b56e-4796cb551751 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:59.698806 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1134/2254] 10.222.0.83 () {58 vars in 1443 bytes} [Mon Aug 29 15:38:59 2022] GET /identity/v3/projects/2cbf43758c944fe6bb6fad543fd251a6 => generated 375 bytes in 435 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:38:59.718226 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1121/2255] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:59.718839 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a512d62c-9c78-4763-b56e-4796cb551751 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:59.737068 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a512d62c-9c78-4763-b56e-4796cb551751 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:59.755444 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e1f5b8-92e0-4098-84c3-06f3fa540a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:59.756402 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1f5b8-92e0-4098-84c3-06f3fa540a81 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:59.756702 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1f5b8-92e0-4098-84c3-06f3fa540a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:59.756949 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1f5b8-92e0-4098-84c3-06f3fa540a81 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:59.765029 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e1f5b8-92e0-4098-84c3-06f3fa540a81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:59.768437 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e1f5b8-92e0-4098-84c3-06f3fa540a81 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:59.792874 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1135/2256] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:59.796964 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffdf491-e37f-40f6-8c3d-c61187dfec16 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:59.809479 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffdf491-e37f-40f6-8c3d-c61187dfec16 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:59.830591 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b277b3a-2f9e-4611-a8e8-dc9e15139353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:59.831308 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b277b3a-2f9e-4611-a8e8-dc9e15139353 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:59.831584 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b277b3a-2f9e-4611-a8e8-dc9e15139353 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:59.831857 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b277b3a-2f9e-4611-a8e8-dc9e15139353 admin admin] PATH_INFO: `/v3/projects/aa50357b944d4845b57d1fb86b94db98/users/cefc6870c1c440238cc5b2208e38c514/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:59.872018 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b277b3a-2f9e-4611-a8e8-dc9e15139353 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa50357b944d4845b57d1fb86b94db98, user_id=cefc6870c1c440238cc5b2208e38c514, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:59.876297 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7930b9f-6457-4489-bd22-575f4517a55a None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:59.876805 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b277b3a-2f9e-4611-a8e8-dc9e15139353 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:59.877109 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7930b9f-6457-4489-bd22-575f4517a55a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:59.877460 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7930b9f-6457-4489-bd22-575f4517a55a None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:59.879389 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1136/2257] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 15:38:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:38:59.881000 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:59.892973 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7930b9f-6457-4489-bd22-575f4517a55a None None] Authenticating service token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:38:59.898898 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f7930b9f-6457-4489-bd22-575f4517a55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:59.918403 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1122/2258] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:38:59 2022] PUT /identity/v3/projects/aa50357b944d4845b57d1fb86b94db98/users/cefc6870c1c440238cc5b2208e38c514/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:38:59.920100 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd35ba-6e47-467c-9518-c52430ffb062 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:59.920499 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd35ba-6e47-467c-9518-c52430ffb062 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:59.920878 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd35ba-6e47-467c-9518-c52430ffb062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:59.971907 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-43dd35ba-6e47-467c-9518-c52430ffb062 None None] MFA Rules not processed for user `cefc6870c1c440238cc5b2208e38c514`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:59.974912 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-43dd35ba-6e47-467c-9518-c52430ffb062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:00.091672 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1123/2259] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:38:59 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:39:00.095963 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd35ba-6e47-467c-9518-c52430ffb062 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:00.102169 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7930b9f-6457-4489-bd22-575f4517a55a None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:00.165495 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:00.244452 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd35ba-6e47-467c-9518-c52430ffb062 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:00.247422 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7930b9f-6457-4489-bd22-575f4517a55a None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:00.257716 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fbc2aa-1edc-483c-923f-3b8bfca92cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:00.259037 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbc2aa-1edc-483c-923f-3b8bfca92cc2 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:00.260427 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ffc972-7631-400f-910f-d5f53a3ff08a tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1db1584b8944aa39d318522d0f502d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3de9c364ce18429cb7b464aeea76b3e4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:00.261499 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffc972-7631-400f-910f-d5f53a3ff08a tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:00.261643 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbc2aa-1edc-483c-923f-3b8bfca92cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:00.261989 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbc2aa-1edc-483c-923f-3b8bfca92cc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:00.262596 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffc972-7631-400f-910f-d5f53a3ff08a tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:00.263170 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fbc2aa-1edc-483c-923f-3b8bfca92cc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:00.263753 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffc972-7631-400f-910f-d5f53a3ff08a tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] PATH_INFO: `/v3/projects/2cbf43758c944fe6bb6fad543fd251a6` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:00.267154 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ffc972-7631-400f-910f-d5f53a3ff08a tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: Authorizing `identity:get_project(project_id=2cbf43758c944fe6bb6fad543fd251a6)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:00.267941 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fbc2aa-1edc-483c-923f-3b8bfca92cc2 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:00.272941 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ffc972-7631-400f-910f-d5f53a3ff08a tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:00.285648 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1137/2260] 10.222.0.83 () {58 vars in 1443 bytes} [Mon Aug 29 15:38:59 2022] GET /identity/v3/projects/2cbf43758c944fe6bb6fad543fd251a6 => generated 375 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:39:00.327535 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1124/2261] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:39:00 2022] POST /identity/v3/projects => generated 391 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:39:00.327657 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ffc972-7631-400f-910f-d5f53a3ff08a tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:00.341956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ffc972-7631-400f-910f-d5f53a3ff08a tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:00.452272 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a11ddb-9ce9-4d28-a943-1bddf8dc1563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:00.453148 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a11ddb-9ce9-4d28-a943-1bddf8dc1563 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:00.453538 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a11ddb-9ce9-4d28-a943-1bddf8dc1563 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:00.453817 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a11ddb-9ce9-4d28-a943-1bddf8dc1563 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:00.454868 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a11ddb-9ce9-4d28-a943-1bddf8dc1563 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:00.457464 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a11ddb-9ce9-4d28-a943-1bddf8dc1563 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:00.503604 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1138/2262] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:39:00 2022] POST /identity/v3/users => generated 302 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:39:00.508493 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fbc2aa-1edc-483c-923f-3b8bfca92cc2 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:00.525477 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fbc2aa-1edc-483c-923f-3b8bfca92cc2 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:00.531620 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778ed3f-a2be-4c93-8ab0-fea7727a5dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:00.532752 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778ed3f-a2be-4c93-8ab0-fea7727a5dfa admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:00.533103 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778ed3f-a2be-4c93-8ab0-fea7727a5dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:00.533442 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778ed3f-a2be-4c93-8ab0-fea7727a5dfa admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:00.534190 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e778ed3f-a2be-4c93-8ab0-fea7727a5dfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:00.536060 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e778ed3f-a2be-4c93-8ab0-fea7727a5dfa admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:00.557224 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1125/2263] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:00.558383 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a11ddb-9ce9-4d28-a943-1bddf8dc1563 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:00.572176 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a11ddb-9ce9-4d28-a943-1bddf8dc1563 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:00.579332 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ce0e0-8f90-42bb-aa0c-a979642f693a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:00.580461 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ce0e0-8f90-42bb-aa0c-a979642f693a admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:00.580919 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ce0e0-8f90-42bb-aa0c-a979642f693a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:00.581199 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ce0e0-8f90-42bb-aa0c-a979642f693a admin admin] PATH_INFO: `/v3/projects/75bf5fb6be8245ef8f96ecf0d09166a6/users/11887ebf88754171a892947003c2f7d2/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:00.610662 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1ce0e0-8f90-42bb-aa0c-a979642f693a admin admin] RBAC: Authorizing `identity:create_grant(project_id=75bf5fb6be8245ef8f96ecf0d09166a6, user_id=11887ebf88754171a892947003c2f7d2, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:00.614957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1ce0e0-8f90-42bb-aa0c-a979642f693a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:00.638216 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778ed3f-a2be-4c93-8ab0-fea7727a5dfa admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:00.644665 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1139/2264] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:39:00 2022] PUT /identity/v3/projects/75bf5fb6be8245ef8f96ecf0d09166a6/users/11887ebf88754171a892947003c2f7d2/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:39:00.653502 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778ed3f-a2be-4c93-8ab0-fea7727a5dfa admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:00.739412 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:00.764806 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bfb3c5-52c2-4504-944f-2ef17642c96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:00.765626 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bfb3c5-52c2-4504-944f-2ef17642c96b admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:00.765903 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bfb3c5-52c2-4504-944f-2ef17642c96b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:00.766170 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bfb3c5-52c2-4504-944f-2ef17642c96b admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:00.766881 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bfb3c5-52c2-4504-944f-2ef17642c96b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:00.768888 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bfb3c5-52c2-4504-944f-2ef17642c96b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:00.786896 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ce0e0-8f90-42bb-aa0c-a979642f693a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:00.795066 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1126/2265] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:00.804139 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ce0e0-8f90-42bb-aa0c-a979642f693a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:00.810121 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563cfcb4-44f4-45df-a8f6-affc1e4fb9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:00.810780 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563cfcb4-44f4-45df-a8f6-affc1e4fb9c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:00.811098 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563cfcb4-44f4-45df-a8f6-affc1e4fb9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:00.811348 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563cfcb4-44f4-45df-a8f6-affc1e4fb9c5 admin admin] PATH_INFO: `/v3/projects/75bf5fb6be8245ef8f96ecf0d09166a6/users/11887ebf88754171a892947003c2f7d2/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:00.813664 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563cfcb4-44f4-45df-a8f6-affc1e4fb9c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75bf5fb6be8245ef8f96ecf0d09166a6, user_id=11887ebf88754171a892947003c2f7d2, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:00.816736 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563cfcb4-44f4-45df-a8f6-affc1e4fb9c5 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:00.830927 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1140/2266] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:39:00 2022] PUT /identity/v3/projects/75bf5fb6be8245ef8f96ecf0d09166a6/users/11887ebf88754171a892947003c2f7d2/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:00.843413 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4f2c2-2262-48e5-adf9-ff9034c31bd7 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:00.843603 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4f2c2-2262-48e5-adf9-ff9034c31bd7 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:00.843794 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4f2c2-2262-48e5-adf9-ff9034c31bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:00.886415 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-b9e4f2c2-2262-48e5-adf9-ff9034c31bd7 None None] MFA Rules not processed for user `11887ebf88754171a892947003c2f7d2`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:00.887685 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b9e4f2c2-2262-48e5-adf9-ff9034c31bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:00.994744 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1127/2267] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:00 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:01.080349 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a25f2-4148-4ef7-a753-ac0b8a6de671 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:01.080712 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a25f2-4148-4ef7-a753-ac0b8a6de671 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:01.080996 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a25f2-4148-4ef7-a753-ac0b8a6de671 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:01.082485 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1141/2268] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 15:39:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:39:01.087712 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4f2c2-2262-48e5-adf9-ff9034c31bd7 None None] Authenticating service token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:39:01.191136 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4f2c2-2262-48e5-adf9-ff9034c31bd7 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:01.271764 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4f2c2-2262-48e5-adf9-ff9034c31bd7 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:01.277216 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1038db1-28c9-47bc-9080-756612b5b159 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1db1584b8944aa39d318522d0f502d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3de9c364ce18429cb7b464aeea76b3e4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:01.277867 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1038db1-28c9-47bc-9080-756612b5b159 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:01.278145 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1038db1-28c9-47bc-9080-756612b5b159 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:01.278416 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1038db1-28c9-47bc-9080-756612b5b159 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] PATH_INFO: `/v3/projects/2cbf43758c944fe6bb6fad543fd251a6` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:01.279587 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1038db1-28c9-47bc-9080-756612b5b159 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: Authorizing `identity:get_project(project_id=2cbf43758c944fe6bb6fad543fd251a6)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:01.281656 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1038db1-28c9-47bc-9080-756612b5b159 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:01.284583 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1128/2269] 10.222.0.83 () {58 vars in 1443 bytes} [Mon Aug 29 15:39:01 2022] GET /identity/v3/projects/2cbf43758c944fe6bb6fad543fd251a6 => generated 375 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:39:01.692527 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a25f2-4148-4ef7-a753-ac0b8a6de671 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:01.723873 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a25f2-4148-4ef7-a753-ac0b8a6de671 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:01.732238 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f525f5b-4a3c-4de2-8a0c-eb24ae39de65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:01.732238 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f525f5b-4a3c-4de2-8a0c-eb24ae39de65 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:01.732238 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f525f5b-4a3c-4de2-8a0c-eb24ae39de65 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:01.732238 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f525f5b-4a3c-4de2-8a0c-eb24ae39de65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:01.766807 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f525f5b-4a3c-4de2-8a0c-eb24ae39de65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:01.768692 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f525f5b-4a3c-4de2-8a0c-eb24ae39de65 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:01.790363 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1142/2270] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:39:01 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:39:01.931407 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1038db1-28c9-47bc-9080-756612b5b159 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:01.933173 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f1038db1-28c9-47bc-9080-756612b5b159 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:01.981530 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:02.097991 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1038db1-28c9-47bc-9080-756612b5b159 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:02.112086 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab5246-8226-4019-879b-1cf6572e5d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:02.113374 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab5246-8226-4019-879b-1cf6572e5d16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:02.115505 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab5246-8226-4019-879b-1cf6572e5d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:02.115931 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab5246-8226-4019-879b-1cf6572e5d16 admin admin] PATH_INFO: `/v3/users/03d025c6b7ec4069be6e2f560f992041` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:02.118173 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab5246-8226-4019-879b-1cf6572e5d16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03d025c6b7ec4069be6e2f560f992041)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:02.123750 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab5246-8226-4019-879b-1cf6572e5d16 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:02.241856 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7bab5246-8226-4019-879b-1cf6572e5d16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03d025c6b7ec4069be6e2f560f992041'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:02.243485 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7bab5246-8226-4019-879b-1cf6572e5d16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03d025c6b7ec4069be6e2f560f992041'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:02.262414 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7bab5246-8226-4019-879b-1cf6572e5d16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03d025c6b7ec4069be6e2f560f992041'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:02.274207 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7bab5246-8226-4019-879b-1cf6572e5d16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03d025c6b7ec4069be6e2f560f992041'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:02.275158 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7bab5246-8226-4019-879b-1cf6572e5d16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03d025c6b7ec4069be6e2f560f992041'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:02.305946 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1129/2271] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:39:01 2022] DELETE /identity/v3/users/03d025c6b7ec4069be6e2f560f992041 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:02.307138 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9d394-564e-4eec-98a5-e38a34cb8a6b None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:02.307308 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9d394-564e-4eec-98a5-e38a34cb8a6b None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:02.307586 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9d394-564e-4eec-98a5-e38a34cb8a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:02.329895 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-89e9d394-564e-4eec-98a5-e38a34cb8a6b None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:02.331164 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-89e9d394-564e-4eec-98a5-e38a34cb8a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:02.403141 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1143/2272] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:02.423496 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab5246-8226-4019-879b-1cf6572e5d16 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:02.425512 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7bab5246-8226-4019-879b-1cf6572e5d16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:02.535981 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9d394-564e-4eec-98a5-e38a34cb8a6b None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:02.538462 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-89e9d394-564e-4eec-98a5-e38a34cb8a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:02.548211 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab5246-8226-4019-879b-1cf6572e5d16 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:02.550405 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:02.556950 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f8cf5-f054-4b91-b0c4-084689cc50b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:02.557730 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9d394-564e-4eec-98a5-e38a34cb8a6b None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:02.558233 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f8cf5-f054-4b91-b0c4-084689cc50b0 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:02.560111 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f8cf5-f054-4b91-b0c4-084689cc50b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:02.560604 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f8cf5-f054-4b91-b0c4-084689cc50b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:02.565402 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0fd751-8667-46f7-b886-dc6d1bb00389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:02.566403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0fd751-8667-46f7-b886-dc6d1bb00389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:02.566853 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0fd751-8667-46f7-b886-dc6d1bb00389 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:02.567351 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0fd751-8667-46f7-b886-dc6d1bb00389 admin admin] PATH_INFO: `/v3/users/cefc6870c1c440238cc5b2208e38c514` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:02.569299 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0fd751-8667-46f7-b886-dc6d1bb00389 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cefc6870c1c440238cc5b2208e38c514)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:02.571784 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0fd751-8667-46f7-b886-dc6d1bb00389 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:02.574938 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f8cf5-f054-4b91-b0c4-084689cc50b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:02.577284 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f8cf5-f054-4b91-b0c4-084689cc50b0 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:02.597292 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1130/2273] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:39:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:39:02.639838 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7e0fd751-8667-46f7-b886-dc6d1bb00389 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cefc6870c1c440238cc5b2208e38c514'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:02.640823 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7e0fd751-8667-46f7-b886-dc6d1bb00389 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cefc6870c1c440238cc5b2208e38c514'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:02.668347 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7e0fd751-8667-46f7-b886-dc6d1bb00389 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cefc6870c1c440238cc5b2208e38c514'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:02.688943 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7e0fd751-8667-46f7-b886-dc6d1bb00389 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cefc6870c1c440238cc5b2208e38c514'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:02.702237 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7e0fd751-8667-46f7-b886-dc6d1bb00389 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cefc6870c1c440238cc5b2208e38c514'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:02.711639 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1144/2274] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:39:02 2022] DELETE /identity/v3/users/cefc6870c1c440238cc5b2208e38c514 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:02.717519 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae6a3f8-a030-4245-a88b-b9e4174cddf3 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:02.718202 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae6a3f8-a030-4245-a88b-b9e4174cddf3 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:02.718683 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae6a3f8-a030-4245-a88b-b9e4174cddf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:02.750046 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-3ae6a3f8-a030-4245-a88b-b9e4174cddf3 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:02.754066 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3ae6a3f8-a030-4245-a88b-b9e4174cddf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:02.812442 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:02.871236 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1131/2275] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:02.896974 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0fd751-8667-46f7-b886-dc6d1bb00389 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:02.898548 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7e0fd751-8667-46f7-b886-dc6d1bb00389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:03.025617 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0fd751-8667-46f7-b886-dc6d1bb00389 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:03.029480 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467cdef8-3d5b-40eb-a451-f27d853a27fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:03.030290 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467cdef8-3d5b-40eb-a451-f27d853a27fa service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:03.031281 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467cdef8-3d5b-40eb-a451-f27d853a27fa service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:03.031281 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467cdef8-3d5b-40eb-a451-f27d853a27fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:03.042597 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467cdef8-3d5b-40eb-a451-f27d853a27fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:03.044177 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467cdef8-3d5b-40eb-a451-f27d853a27fa service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:03.057882 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1145/2276] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:39:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:39:03.166601 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae6a3f8-a030-4245-a88b-b9e4174cddf3 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:03.168882 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3ae6a3f8-a030-4245-a88b-b9e4174cddf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:03.181902 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae6a3f8-a030-4245-a88b-b9e4174cddf3 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:03.187747 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf193d1-6ec2-43ab-8a11-5b3d2d013d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:03.188656 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf193d1-6ec2-43ab-8a11-5b3d2d013d83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:03.188977 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf193d1-6ec2-43ab-8a11-5b3d2d013d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:03.189258 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf193d1-6ec2-43ab-8a11-5b3d2d013d83 admin admin] PATH_INFO: `/v3/users/30d7f5f663fe43aaa83d4f896fc177db` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:03.190767 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf193d1-6ec2-43ab-8a11-5b3d2d013d83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30d7f5f663fe43aaa83d4f896fc177db)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:03.192830 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf193d1-6ec2-43ab-8a11-5b3d2d013d83 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:03.270616 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ddf193d1-6ec2-43ab-8a11-5b3d2d013d83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30d7f5f663fe43aaa83d4f896fc177db'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:03.271951 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ddf193d1-6ec2-43ab-8a11-5b3d2d013d83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30d7f5f663fe43aaa83d4f896fc177db'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:03.293249 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ddf193d1-6ec2-43ab-8a11-5b3d2d013d83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30d7f5f663fe43aaa83d4f896fc177db'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:03.303436 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467cdef8-3d5b-40eb-a451-f27d853a27fa service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:03.306093 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-467cdef8-3d5b-40eb-a451-f27d853a27fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:03.326740 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ddf193d1-6ec2-43ab-8a11-5b3d2d013d83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30d7f5f663fe43aaa83d4f896fc177db'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:03.327874 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ddf193d1-6ec2-43ab-8a11-5b3d2d013d83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30d7f5f663fe43aaa83d4f896fc177db'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:03.331546 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467cdef8-3d5b-40eb-a451-f27d853a27fa service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:03.352351 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ded86e-cc97-4bad-9747-80dab6afe10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:03.352351 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ded86e-cc97-4bad-9747-80dab6afe10d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:03.352351 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ded86e-cc97-4bad-9747-80dab6afe10d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:03.352351 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ded86e-cc97-4bad-9747-80dab6afe10d admin admin] PATH_INFO: `/v3/projects/2cbf43758c944fe6bb6fad543fd251a6` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:03.353393 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ded86e-cc97-4bad-9747-80dab6afe10d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cbf43758c944fe6bb6fad543fd251a6)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:03.355607 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ded86e-cc97-4bad-9747-80dab6afe10d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:03.383356 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1132/2277] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:39:03 2022] DELETE /identity/v3/users/30d7f5f663fe43aaa83d4f896fc177db => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:03.385183 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc05e2-0cd7-4a32-a4e7-c351689ff340 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:03.386549 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc05e2-0cd7-4a32-a4e7-c351689ff340 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:03.387605 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc05e2-0cd7-4a32-a4e7-c351689ff340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:03.424390 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-e7fc05e2-0cd7-4a32-a4e7-c351689ff340 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:03.424390 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e7fc05e2-0cd7-4a32-a4e7-c351689ff340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:03.526335 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d3ded86e-cc97-4bad-9747-80dab6afe10d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cbf43758c944fe6bb6fad543fd251a6', 'request_id': 'req-d3ded86e-cc97-4bad-9747-80dab6afe10d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:03.532387 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d3ded86e-cc97-4bad-9747-80dab6afe10d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cbf43758c944fe6bb6fad543fd251a6', 'request_id': 'req-d3ded86e-cc97-4bad-9747-80dab6afe10d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:03.547303 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d3ded86e-cc97-4bad-9747-80dab6afe10d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cbf43758c944fe6bb6fad543fd251a6', 'request_id': 'req-d3ded86e-cc97-4bad-9747-80dab6afe10d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:03.560662 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1133/2278] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:03.566553 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d3ded86e-cc97-4bad-9747-80dab6afe10d admin admin] The token cache is being invalidate because project 2cbf43758c944fe6bb6fad543fd251a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:39:03.567096 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d3ded86e-cc97-4bad-9747-80dab6afe10d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:03.568868 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d3ded86e-cc97-4bad-9747-80dab6afe10d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:03.571102 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc05e2-0cd7-4a32-a4e7-c351689ff340 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:03.572512 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1146/2279] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:39:03 2022] DELETE /identity/v3/projects/2cbf43758c944fe6bb6fad543fd251a6 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:03.575539 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e7fc05e2-0cd7-4a32-a4e7-c351689ff340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:03.583415 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ded86e-cc97-4bad-9747-80dab6afe10d admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:03.586491 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d3ded86e-cc97-4bad-9747-80dab6afe10d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:03.603927 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:03.742679 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc05e2-0cd7-4a32-a4e7-c351689ff340 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:03.774532 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:03.814417 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ded86e-cc97-4bad-9747-80dab6afe10d admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:03.828428 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb4f244-28c7-40f3-88a4-8006618ee392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:03.829354 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4f244-28c7-40f3-88a4-8006618ee392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:03.829778 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4f244-28c7-40f3-88a4-8006618ee392 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:03.830191 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4f244-28c7-40f3-88a4-8006618ee392 admin admin] PATH_INFO: `/v3/users/b1db1584b8944aa39d318522d0f502d4` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:03.831644 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb4f244-28c7-40f3-88a4-8006618ee392 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1db1584b8944aa39d318522d0f502d4)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:03.834906 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb4f244-28c7-40f3-88a4-8006618ee392 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:03.846044 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d86aa-fb50-41e3-a4f6-70a042348a68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:03.846044 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d86aa-fb50-41e3-a4f6-70a042348a68 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:03.846383 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d86aa-fb50-41e3-a4f6-70a042348a68 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:03.846756 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d86aa-fb50-41e3-a4f6-70a042348a68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:03.850297 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3c5d86aa-fb50-41e3-a4f6-70a042348a68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:03.871361 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d86aa-fb50-41e3-a4f6-70a042348a68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:03.874426 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d86aa-fb50-41e3-a4f6-70a042348a68 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:03.891297 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1134/2280] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:39:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:39:03.892628 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d86aa-fb50-41e3-a4f6-70a042348a68 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:03.896202 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3c5d86aa-fb50-41e3-a4f6-70a042348a68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:03.968294 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-bcb4f244-28c7-40f3-88a4-8006618ee392 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1db1584b8944aa39d318522d0f502d4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:03.969167 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-bcb4f244-28c7-40f3-88a4-8006618ee392 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1db1584b8944aa39d318522d0f502d4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:03.994629 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-bcb4f244-28c7-40f3-88a4-8006618ee392 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1db1584b8944aa39d318522d0f502d4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:04.006020 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-bcb4f244-28c7-40f3-88a4-8006618ee392 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1db1584b8944aa39d318522d0f502d4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:04.019553 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-bcb4f244-28c7-40f3-88a4-8006618ee392 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1db1584b8944aa39d318522d0f502d4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:04.029653 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1147/2281] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:39:03 2022] DELETE /identity/v3/users/b1db1584b8944aa39d318522d0f502d4 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:04.062244 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d86aa-fb50-41e3-a4f6-70a042348a68 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:04.165262 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9db5fe-a544-498e-9a3e-730a0716e6bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:04.166072 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9db5fe-a544-498e-9a3e-730a0716e6bb service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:04.166617 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9db5fe-a544-498e-9a3e-730a0716e6bb service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:04.167375 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9db5fe-a544-498e-9a3e-730a0716e6bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:04.169551 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ec9db5fe-a544-498e-9a3e-730a0716e6bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:04.237295 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:04.274817 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9db5fe-a544-498e-9a3e-730a0716e6bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:04.277967 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9db5fe-a544-498e-9a3e-730a0716e6bb service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:04.296809 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1135/2282] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:39:03 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:39:04.560507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb4f244-28c7-40f3-88a4-8006618ee392 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:04.561465 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-bcb4f244-28c7-40f3-88a4-8006618ee392 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:04.700749 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb4f244-28c7-40f3-88a4-8006618ee392 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:04.715822 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d971364e-efc3-4d0f-ba64-f5e14895d296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:04.716641 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971364e-efc3-4d0f-ba64-f5e14895d296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:04.716922 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971364e-efc3-4d0f-ba64-f5e14895d296 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:04.717377 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971364e-efc3-4d0f-ba64-f5e14895d296 admin admin] PATH_INFO: `/v3/projects/7261af070ed14fdba6888924eefb492a` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:04.720425 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d971364e-efc3-4d0f-ba64-f5e14895d296 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7261af070ed14fdba6888924eefb492a)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:04.726603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d971364e-efc3-4d0f-ba64-f5e14895d296 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:04.729598 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9db5fe-a544-498e-9a3e-730a0716e6bb service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:04.731111 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ec9db5fe-a544-498e-9a3e-730a0716e6bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:04.748774 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9db5fe-a544-498e-9a3e-730a0716e6bb service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:04.755753 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f85388c-5039-4587-9a87-3cc2df14c7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:04.756917 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f85388c-5039-4587-9a87-3cc2df14c7a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:04.757354 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f85388c-5039-4587-9a87-3cc2df14c7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:04.757743 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f85388c-5039-4587-9a87-3cc2df14c7a4 admin admin] PATH_INFO: `/v3/projects/aa50357b944d4845b57d1fb86b94db98` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:04.759937 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f85388c-5039-4587-9a87-3cc2df14c7a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa50357b944d4845b57d1fb86b94db98)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:04.762359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f85388c-5039-4587-9a87-3cc2df14c7a4 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:04.815353 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:04.866686 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d971364e-efc3-4d0f-ba64-f5e14895d296 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7261af070ed14fdba6888924eefb492a', 'request_id': 'req-d971364e-efc3-4d0f-ba64-f5e14895d296'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:04.877204 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d971364e-efc3-4d0f-ba64-f5e14895d296 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7261af070ed14fdba6888924eefb492a', 'request_id': 'req-d971364e-efc3-4d0f-ba64-f5e14895d296'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:04.877447 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5f85388c-5039-4587-9a87-3cc2df14c7a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa50357b944d4845b57d1fb86b94db98', 'request_id': 'req-5f85388c-5039-4587-9a87-3cc2df14c7a4'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:04.888148 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5f85388c-5039-4587-9a87-3cc2df14c7a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa50357b944d4845b57d1fb86b94db98', 'request_id': 'req-5f85388c-5039-4587-9a87-3cc2df14c7a4'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:04.891013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d971364e-efc3-4d0f-ba64-f5e14895d296 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7261af070ed14fdba6888924eefb492a', 'request_id': 'req-d971364e-efc3-4d0f-ba64-f5e14895d296'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:04.900812 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5f85388c-5039-4587-9a87-3cc2df14c7a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa50357b944d4845b57d1fb86b94db98', 'request_id': 'req-5f85388c-5039-4587-9a87-3cc2df14c7a4'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:04.908796 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d971364e-efc3-4d0f-ba64-f5e14895d296 admin admin] The token cache is being invalidate because project 7261af070ed14fdba6888924eefb492a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:39:04.909055 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d971364e-efc3-4d0f-ba64-f5e14895d296 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:04.909913 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d971364e-efc3-4d0f-ba64-f5e14895d296 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:04.913125 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1148/2283] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:39:04 2022] DELETE /identity/v3/projects/7261af070ed14fdba6888924eefb492a => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:04.914948 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38778fd3-7d25-40a2-92b6-5bbfa97a80ea None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:04.917163 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38778fd3-7d25-40a2-92b6-5bbfa97a80ea None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:04.917620 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38778fd3-7d25-40a2-92b6-5bbfa97a80ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:04.921296 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5f85388c-5039-4587-9a87-3cc2df14c7a4 admin admin] The token cache is being invalidate because project aa50357b944d4845b57d1fb86b94db98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:39:04.921790 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5f85388c-5039-4587-9a87-3cc2df14c7a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:04.922573 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5f85388c-5039-4587-9a87-3cc2df14c7a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:04.928284 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1136/2284] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:39:04 2022] DELETE /identity/v3/projects/aa50357b944d4845b57d1fb86b94db98 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:39:04.928284 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f85388c-5039-4587-9a87-3cc2df14c7a4 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:04.928284 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5f85388c-5039-4587-9a87-3cc2df14c7a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:04.948572 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-38778fd3-7d25-40a2-92b6-5bbfa97a80ea None None] MFA Rules not processed for user `06856f1488e44bde85de23a5effddbdd`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:04.950945 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-38778fd3-7d25-40a2-92b6-5bbfa97a80ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:05.017305 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f85388c-5039-4587-9a87-3cc2df14c7a4 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:05.026308 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdffb642-d08a-495f-be08-1d0de203b615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:05.026964 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffb642-d08a-495f-be08-1d0de203b615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:05.027375 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffb642-d08a-495f-be08-1d0de203b615 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:05.041927 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffb642-d08a-495f-be08-1d0de203b615 admin admin] PATH_INFO: `/v3/users/89dd90556e0448b9a4d529d0c598ce5b` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:05.044571 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdffb642-d08a-495f-be08-1d0de203b615 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89dd90556e0448b9a4d529d0c598ce5b)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:05.044862 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdffb642-d08a-495f-be08-1d0de203b615 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:05.069017 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1149/2285] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:04 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:05.069767 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38778fd3-7d25-40a2-92b6-5bbfa97a80ea None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:05.102299 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-38778fd3-7d25-40a2-92b6-5bbfa97a80ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:05.136267 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fdffb642-d08a-495f-be08-1d0de203b615 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89dd90556e0448b9a4d529d0c598ce5b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:05.136970 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fdffb642-d08a-495f-be08-1d0de203b615 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89dd90556e0448b9a4d529d0c598ce5b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:05.151066 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38778fd3-7d25-40a2-92b6-5bbfa97a80ea None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:05.151684 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fdffb642-d08a-495f-be08-1d0de203b615 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89dd90556e0448b9a4d529d0c598ce5b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:05.165759 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fdffb642-d08a-495f-be08-1d0de203b615 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89dd90556e0448b9a4d529d0c598ce5b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:05.166621 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fdffb642-d08a-495f-be08-1d0de203b615 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89dd90556e0448b9a4d529d0c598ce5b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:05.170389 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2015a4a2-a4e4-42ef-9f11-bf8e03ef94c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:05.171523 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:05.172355 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015a4a2-a4e4-42ef-9f11-bf8e03ef94c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:05.172827 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015a4a2-a4e4-42ef-9f11-bf8e03ef94c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:05.173316 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015a4a2-a4e4-42ef-9f11-bf8e03ef94c8 admin admin] PATH_INFO: `/v3/users/11887ebf88754171a892947003c2f7d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:05.174851 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2015a4a2-a4e4-42ef-9f11-bf8e03ef94c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11887ebf88754171a892947003c2f7d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:05.177068 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2015a4a2-a4e4-42ef-9f11-bf8e03ef94c8 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:05.217278 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1137/2286] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:39:04 2022] DELETE /identity/v3/users/89dd90556e0448b9a4d529d0c598ce5b => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:05.218684 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdffb642-d08a-495f-be08-1d0de203b615 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:05.221191 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-fdffb642-d08a-495f-be08-1d0de203b615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:05.276212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2015a4a2-a4e4-42ef-9f11-bf8e03ef94c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11887ebf88754171a892947003c2f7d2'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:05.276922 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2015a4a2-a4e4-42ef-9f11-bf8e03ef94c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11887ebf88754171a892947003c2f7d2'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:05.297360 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2015a4a2-a4e4-42ef-9f11-bf8e03ef94c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11887ebf88754171a892947003c2f7d2'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:05.313536 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2015a4a2-a4e4-42ef-9f11-bf8e03ef94c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11887ebf88754171a892947003c2f7d2'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:05.328938 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2015a4a2-a4e4-42ef-9f11-bf8e03ef94c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11887ebf88754171a892947003c2f7d2'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:05.342541 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1150/2287] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:39:05 2022] DELETE /identity/v3/users/11887ebf88754171a892947003c2f7d2 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:05.373961 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdffb642-d08a-495f-be08-1d0de203b615 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:05.578607 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ecb73b-17eb-498f-958b-25fb224459ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:05.579869 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ecb73b-17eb-498f-958b-25fb224459ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:05.580711 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ecb73b-17eb-498f-958b-25fb224459ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:05.581853 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ecb73b-17eb-498f-958b-25fb224459ad admin admin] PATH_INFO: `/v3/projects/3de9c364ce18429cb7b464aeea76b3e4` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:05.596441 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ecb73b-17eb-498f-958b-25fb224459ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=3de9c364ce18429cb7b464aeea76b3e4)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:05.601856 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e471a-8d6c-4acc-b9c5-5894094b69e0 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:05.603369 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e471a-8d6c-4acc-b9c5-5894094b69e0 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:05.607659 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e471a-8d6c-4acc-b9c5-5894094b69e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:05.624456 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ecb73b-17eb-498f-958b-25fb224459ad admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:05.698354 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-562e471a-8d6c-4acc-b9c5-5894094b69e0 None None] MFA Rules not processed for user `53387bcdf14248b9bdf716e782b786d7`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:05.702072 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-562e471a-8d6c-4acc-b9c5-5894094b69e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:05.752074 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:05.755056 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f2ecb73b-17eb-498f-958b-25fb224459ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3de9c364ce18429cb7b464aeea76b3e4', 'request_id': 'req-f2ecb73b-17eb-498f-958b-25fb224459ad'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:05.777636 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f2ecb73b-17eb-498f-958b-25fb224459ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3de9c364ce18429cb7b464aeea76b3e4', 'request_id': 'req-f2ecb73b-17eb-498f-958b-25fb224459ad'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:05.781390 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f2ecb73b-17eb-498f-958b-25fb224459ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3de9c364ce18429cb7b464aeea76b3e4', 'request_id': 'req-f2ecb73b-17eb-498f-958b-25fb224459ad'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:05.814394 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f2ecb73b-17eb-498f-958b-25fb224459ad admin admin] The token cache is being invalidate because project 3de9c364ce18429cb7b464aeea76b3e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:39:05.814702 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f2ecb73b-17eb-498f-958b-25fb224459ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:05.817196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f2ecb73b-17eb-498f-958b-25fb224459ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:05.828042 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1138/2288] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:39:05 2022] DELETE /identity/v3/projects/3de9c364ce18429cb7b464aeea76b3e4 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:05.831518 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c8e68-4c47-4631-90ed-25d544674443 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:05.832542 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c8e68-4c47-4631-90ed-25d544674443 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:05.832894 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c8e68-4c47-4631-90ed-25d544674443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:05.883833 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-689c8e68-4c47-4631-90ed-25d544674443 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:05.885193 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-689c8e68-4c47-4631-90ed-25d544674443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:05.893221 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1151/2289] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:39:05.898109 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e471a-8d6c-4acc-b9c5-5894094b69e0 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:05.903346 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-562e471a-8d6c-4acc-b9c5-5894094b69e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:05.929013 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:05.942571 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e471a-8d6c-4acc-b9c5-5894094b69e0 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:06.057456 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1139/2290] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:06.058487 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689c8e68-4c47-4631-90ed-25d544674443 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:06.072940 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780eb2e9-f01f-475c-a3c5-a28799d20ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:06.074890 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780eb2e9-f01f-475c-a3c5-a28799d20ad3 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:06.076080 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780eb2e9-f01f-475c-a3c5-a28799d20ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:06.076487 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780eb2e9-f01f-475c-a3c5-a28799d20ad3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:06.077052 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-689c8e68-4c47-4631-90ed-25d544674443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:06.077981 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780eb2e9-f01f-475c-a3c5-a28799d20ad3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:06.079606 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780eb2e9-f01f-475c-a3c5-a28799d20ad3 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:06.113605 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689c8e68-4c47-4631-90ed-25d544674443 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:06.120688 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24be0be-5440-4d68-8430-3708aca01232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:06.121894 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24be0be-5440-4d68-8430-3708aca01232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:06.122452 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24be0be-5440-4d68-8430-3708aca01232 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:06.124771 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24be0be-5440-4d68-8430-3708aca01232 admin admin] PATH_INFO: `/v3/projects/c72d064008ff43c9b5a6d851503ef3e4` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:06.126846 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24be0be-5440-4d68-8430-3708aca01232 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c72d064008ff43c9b5a6d851503ef3e4)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:06.129293 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24be0be-5440-4d68-8430-3708aca01232 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:06.145683 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1152/2291] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:39:05 2022] POST /identity/v3/projects => generated 385 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:39:06.149268 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488867e-9aea-49df-bc61-8471006a7171 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:06.150513 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488867e-9aea-49df-bc61-8471006a7171 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:06.151071 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488867e-9aea-49df-bc61-8471006a7171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:06.203326 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b24be0be-5440-4d68-8430-3708aca01232 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c72d064008ff43c9b5a6d851503ef3e4', 'request_id': 'req-b24be0be-5440-4d68-8430-3708aca01232'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:06.211607 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-0488867e-9aea-49df-bc61-8471006a7171 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:06.214924 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b24be0be-5440-4d68-8430-3708aca01232 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c72d064008ff43c9b5a6d851503ef3e4', 'request_id': 'req-b24be0be-5440-4d68-8430-3708aca01232'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:06.215248 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0488867e-9aea-49df-bc61-8471006a7171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:06.222359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b24be0be-5440-4d68-8430-3708aca01232 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c72d064008ff43c9b5a6d851503ef3e4', 'request_id': 'req-b24be0be-5440-4d68-8430-3708aca01232'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:06.242680 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b24be0be-5440-4d68-8430-3708aca01232 admin admin] The token cache is being invalidate because project c72d064008ff43c9b5a6d851503ef3e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:39:06.242980 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b24be0be-5440-4d68-8430-3708aca01232 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:06.243719 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b24be0be-5440-4d68-8430-3708aca01232 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:06.250570 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1140/2292] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:39:06 2022] DELETE /identity/v3/projects/c72d064008ff43c9b5a6d851503ef3e4 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:06.251665 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24be0be-5440-4d68-8430-3708aca01232 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:06.253246 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b24be0be-5440-4d68-8430-3708aca01232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:06.373478 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24be0be-5440-4d68-8430-3708aca01232 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:06.379643 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70faf423-449b-4a0e-9b53-ef607d9fa4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:06.380945 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70faf423-449b-4a0e-9b53-ef607d9fa4f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:06.381220 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1153/2293] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:06.381333 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70faf423-449b-4a0e-9b53-ef607d9fa4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:06.382077 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488867e-9aea-49df-bc61-8471006a7171 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:06.385214 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70faf423-449b-4a0e-9b53-ef607d9fa4f0 admin admin] PATH_INFO: `/v3/projects/75bf5fb6be8245ef8f96ecf0d09166a6` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:06.387101 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0488867e-9aea-49df-bc61-8471006a7171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:06.387417 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70faf423-449b-4a0e-9b53-ef607d9fa4f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75bf5fb6be8245ef8f96ecf0d09166a6)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:06.389908 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70faf423-449b-4a0e-9b53-ef607d9fa4f0 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:06.424782 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488867e-9aea-49df-bc61-8471006a7171 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:06.435971 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d962b1-373f-46c6-aecd-deb6062cac1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:06.436796 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d962b1-373f-46c6-aecd-deb6062cac1f admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:06.437297 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d962b1-373f-46c6-aecd-deb6062cac1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:06.437580 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d962b1-373f-46c6-aecd-deb6062cac1f admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:06.439676 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d962b1-373f-46c6-aecd-deb6062cac1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:06.445436 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d962b1-373f-46c6-aecd-deb6062cac1f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:06.458292 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:06.460835 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-70faf423-449b-4a0e-9b53-ef607d9fa4f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75bf5fb6be8245ef8f96ecf0d09166a6', 'request_id': 'req-70faf423-449b-4a0e-9b53-ef607d9fa4f0'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:06.471450 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-70faf423-449b-4a0e-9b53-ef607d9fa4f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75bf5fb6be8245ef8f96ecf0d09166a6', 'request_id': 'req-70faf423-449b-4a0e-9b53-ef607d9fa4f0'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:06.486083 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-70faf423-449b-4a0e-9b53-ef607d9fa4f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75bf5fb6be8245ef8f96ecf0d09166a6', 'request_id': 'req-70faf423-449b-4a0e-9b53-ef607d9fa4f0'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:06.507194 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1154/2294] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:39:06 2022] POST /identity/v3/users => generated 299 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:39:06.508500 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5c75f-2f40-4b73-b9d2-24ad2cef7b0c None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:06.508773 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5c75f-2f40-4b73-b9d2-24ad2cef7b0c None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:06.509052 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5c75f-2f40-4b73-b9d2-24ad2cef7b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:06.509785 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-70faf423-449b-4a0e-9b53-ef607d9fa4f0 admin admin] The token cache is being invalidate because project 75bf5fb6be8245ef8f96ecf0d09166a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:39:06.510092 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-70faf423-449b-4a0e-9b53-ef607d9fa4f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:06.511271 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-70faf423-449b-4a0e-9b53-ef607d9fa4f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:06.518037 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1141/2295] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:39:06 2022] DELETE /identity/v3/projects/75bf5fb6be8245ef8f96ecf0d09166a6 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:06.519141 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70faf423-449b-4a0e-9b53-ef607d9fa4f0 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:06.522835 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-70faf423-449b-4a0e-9b53-ef607d9fa4f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:06.581582 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-a0c5c75f-2f40-4b73-b9d2-24ad2cef7b0c None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:06.582631 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a0c5c75f-2f40-4b73-b9d2-24ad2cef7b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:06.621123 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70faf423-449b-4a0e-9b53-ef607d9fa4f0 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:06.626520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ea362-4d52-4fc7-b0a0-05eb2a6790e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:06.627195 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ea362-4d52-4fc7-b0a0-05eb2a6790e5 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:06.627476 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ea362-4d52-4fc7-b0a0-05eb2a6790e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:06.627750 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ea362-4d52-4fc7-b0a0-05eb2a6790e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:06.628406 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ea362-4d52-4fc7-b0a0-05eb2a6790e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:39:06.629091 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ea362-4d52-4fc7-b0a0-05eb2a6790e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:06.630589 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ea362-4d52-4fc7-b0a0-05eb2a6790e5 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:06.632551 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:06.652689 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1142/2296] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:39:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:39:06.654780 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ea362-4d52-4fc7-b0a0-05eb2a6790e5 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:06.657124 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-110ea362-4d52-4fc7-b0a0-05eb2a6790e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:06.674365 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ea362-4d52-4fc7-b0a0-05eb2a6790e5 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:06.691502 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088848da-7d54-40a9-8e6f-ed8b7d4265f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:06.692138 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088848da-7d54-40a9-8e6f-ed8b7d4265f2 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:06.692420 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088848da-7d54-40a9-8e6f-ed8b7d4265f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:06.693305 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088848da-7d54-40a9-8e6f-ed8b7d4265f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:06.694170 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088848da-7d54-40a9-8e6f-ed8b7d4265f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:06.699058 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088848da-7d54-40a9-8e6f-ed8b7d4265f2 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:06.723532 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1155/2297] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:06.723532 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609eb26f-6d37-41c3-8016-c2ceac32303f None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:06.723532 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609eb26f-6d37-41c3-8016-c2ceac32303f None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:06.723532 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609eb26f-6d37-41c3-8016-c2ceac32303f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:06.737066 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1143/2298] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:06.737985 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088848da-7d54-40a9-8e6f-ed8b7d4265f2 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:06.764779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088848da-7d54-40a9-8e6f-ed8b7d4265f2 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:06.768194 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-609eb26f-6d37-41c3-8016-c2ceac32303f None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:06.769934 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-609eb26f-6d37-41c3-8016-c2ceac32303f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:06.776995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62584571-e1af-471b-8ca9-cc92176aa476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:06.778252 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62584571-e1af-471b-8ca9-cc92176aa476 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:06.778523 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62584571-e1af-471b-8ca9-cc92176aa476 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:06.778791 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62584571-e1af-471b-8ca9-cc92176aa476 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:06.779477 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62584571-e1af-471b-8ca9-cc92176aa476 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:06.784005 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1156/2299] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:06.785629 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863d8d6-4e9a-4403-9692-df2d0da39a1f None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:06.785976 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863d8d6-4e9a-4403-9692-df2d0da39a1f None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:06.786254 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863d8d6-4e9a-4403-9692-df2d0da39a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:06.792752 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62584571-e1af-471b-8ca9-cc92176aa476 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:06.823421 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-e863d8d6-4e9a-4403-9692-df2d0da39a1f None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:06.825982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e863d8d6-4e9a-4403-9692-df2d0da39a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:06.840235 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1157/2300] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:06.844883 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e863d8d6-4e9a-4403-9692-df2d0da39a1f None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:06.858147 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e863d8d6-4e9a-4403-9692-df2d0da39a1f None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:06.862665 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1144/2301] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:39:06 2022] POST /identity/v3/projects => generated 377 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:39:06.864333 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f72e7-11bf-4b42-ace2-32eefb67e241 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:06.864817 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f72e7-11bf-4b42-ace2-32eefb67e241 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:06.865184 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f72e7-11bf-4b42-ace2-32eefb67e241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:06.892818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-d76f72e7-11bf-4b42-ace2-32eefb67e241 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:06.894114 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d76f72e7-11bf-4b42-ace2-32eefb67e241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:06.986549 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6182a597-ee8c-410e-8e6e-1581d8c0531f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:06.988846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182a597-ee8c-410e-8e6e-1581d8c0531f admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:06.989245 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182a597-ee8c-410e-8e6e-1581d8c0531f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:06.991536 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182a597-ee8c-410e-8e6e-1581d8c0531f admin admin] PATH_INFO: `/v3/projects/a622fa01676b457e8bc242b060df727a/users/d6b7cd8a80a14209a18d66171186acaf/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:07.006143 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1145/2302] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:07.009376 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f72e7-11bf-4b42-ace2-32eefb67e241 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:07.028182 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6182a597-ee8c-410e-8e6e-1581d8c0531f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a622fa01676b457e8bc242b060df727a, user_id=d6b7cd8a80a14209a18d66171186acaf, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:07.032332 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6182a597-ee8c-410e-8e6e-1581d8c0531f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:07.034765 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f72e7-11bf-4b42-ace2-32eefb67e241 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:07.045048 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27cefe9-3c27-4e14-b138-75c7df33b948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:07.046117 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27cefe9-3c27-4e14-b138-75c7df33b948 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:07.046407 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27cefe9-3c27-4e14-b138-75c7df33b948 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:07.046685 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27cefe9-3c27-4e14-b138-75c7df33b948 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:07.047433 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27cefe9-3c27-4e14-b138-75c7df33b948 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:39:07.049674 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27cefe9-3c27-4e14-b138-75c7df33b948 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:07.056664 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27cefe9-3c27-4e14-b138-75c7df33b948 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:07.063266 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1158/2303] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:39:06 2022] PUT /identity/v3/projects/a622fa01676b457e8bc242b060df727a/users/d6b7cd8a80a14209a18d66171186acaf/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:07.066938 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6182a597-ee8c-410e-8e6e-1581d8c0531f admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:07.085413 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1146/2304] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:39:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:39:07.093057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27cefe9-3c27-4e14-b138-75c7df33b948 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:07.112424 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27cefe9-3c27-4e14-b138-75c7df33b948 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:07.149272 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:07.194075 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6182a597-ee8c-410e-8e6e-1581d8c0531f admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:07.200881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e6636-4f40-4511-939a-4d4dfa6a6bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:07.201634 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e6636-4f40-4511-939a-4d4dfa6a6bac admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:07.202014 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e6636-4f40-4511-939a-4d4dfa6a6bac admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:07.202388 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e6636-4f40-4511-939a-4d4dfa6a6bac admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:07.203392 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e6636-4f40-4511-939a-4d4dfa6a6bac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:07.205831 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e6636-4f40-4511-939a-4d4dfa6a6bac admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:07.218711 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e169339c-2d4f-4acc-8bc8-60a1599aac6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:07.220359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169339c-2d4f-4acc-8bc8-60a1599aac6b admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:07.220842 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169339c-2d4f-4acc-8bc8-60a1599aac6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:07.221380 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169339c-2d4f-4acc-8bc8-60a1599aac6b admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:07.222250 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e169339c-2d4f-4acc-8bc8-60a1599aac6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:39:07.222744 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e169339c-2d4f-4acc-8bc8-60a1599aac6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:07.240648 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e169339c-2d4f-4acc-8bc8-60a1599aac6b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:07.241358 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1159/2305] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:39:07 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:39:07.242368 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e6636-4f40-4511-939a-4d4dfa6a6bac admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:07.259724 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e6636-4f40-4511-939a-4d4dfa6a6bac admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:07.265510 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1147/2306] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:39:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:39:07.266801 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e169339c-2d4f-4acc-8bc8-60a1599aac6b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:07.276408 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5018308a-0877-46f0-9b96-91312f9796bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:07.277170 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018308a-0877-46f0-9b96-91312f9796bd admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:07.277490 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018308a-0877-46f0-9b96-91312f9796bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:07.277802 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018308a-0877-46f0-9b96-91312f9796bd admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:07.278598 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5018308a-0877-46f0-9b96-91312f9796bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:07.280385 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5018308a-0877-46f0-9b96-91312f9796bd admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:07.294266 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e169339c-2d4f-4acc-8bc8-60a1599aac6b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:07.297708 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1160/2307] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:07.298733 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5018308a-0877-46f0-9b96-91312f9796bd admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:07.307856 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ecf8ec-2547-4619-a2c0-1706f9e60a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:07.308802 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ecf8ec-2547-4619-a2c0-1706f9e60a5c admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:07.309002 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ecf8ec-2547-4619-a2c0-1706f9e60a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:07.309234 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ecf8ec-2547-4619-a2c0-1706f9e60a5c admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:07.309881 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ecf8ec-2547-4619-a2c0-1706f9e60a5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:07.311057 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5018308a-0877-46f0-9b96-91312f9796bd admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:07.311891 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ecf8ec-2547-4619-a2c0-1706f9e60a5c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:07.319129 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c8cae4-60be-4121-8be8-a8201ab39d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:07.319775 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8cae4-60be-4121-8be8-a8201ab39d28 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:07.320099 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8cae4-60be-4121-8be8-a8201ab39d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:07.320373 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8cae4-60be-4121-8be8-a8201ab39d28 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:07.321119 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c8cae4-60be-4121-8be8-a8201ab39d28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:07.323432 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c8cae4-60be-4121-8be8-a8201ab39d28 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:07.347187 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1161/2308] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:07.349913 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c8cae4-60be-4121-8be8-a8201ab39d28 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:07.360104 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:07.367520 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c8cae4-60be-4121-8be8-a8201ab39d28 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:07.381245 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0144f4-f712-42b5-a39f-a6181a3714f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:07.381998 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0144f4-f712-42b5-a39f-a6181a3714f1 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:07.382281 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0144f4-f712-42b5-a39f-a6181a3714f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:07.382603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0144f4-f712-42b5-a39f-a6181a3714f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:07.383357 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0144f4-f712-42b5-a39f-a6181a3714f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:07.386095 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0144f4-f712-42b5-a39f-a6181a3714f1 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:07.401112 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1148/2309] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:39:07 2022] POST /identity/v3/projects => generated 395 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:39:07.402148 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ecf8ec-2547-4619-a2c0-1706f9e60a5c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:07.452144 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1162/2310] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:39:07 2022] POST /identity/v3/projects => generated 393 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:39:07.452144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0144f4-f712-42b5-a39f-a6181a3714f1 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:07.565766 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0144f4-f712-42b5-a39f-a6181a3714f1 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:07.573069 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb774645-379d-4edd-aaab-de45668b0f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:07.573769 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb774645-379d-4edd-aaab-de45668b0f81 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:07.574054 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb774645-379d-4edd-aaab-de45668b0f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:07.574326 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb774645-379d-4edd-aaab-de45668b0f81 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:07.575065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb774645-379d-4edd-aaab-de45668b0f81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:07.576835 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb774645-379d-4edd-aaab-de45668b0f81 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:07.580633 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ecf8ec-2547-4619-a2c0-1706f9e60a5c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:07.588486 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12ec7f-7ea5-4b33-bcb5-9865069d8e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:07.589867 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12ec7f-7ea5-4b33-bcb5-9865069d8e82 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:07.590347 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12ec7f-7ea5-4b33-bcb5-9865069d8e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:07.590845 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12ec7f-7ea5-4b33-bcb5-9865069d8e82 admin admin] PATH_INFO: `/v3/projects/a622fa01676b457e8bc242b060df727a/users/d6b7cd8a80a14209a18d66171186acaf/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:07.593505 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1163/2311] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:07.594525 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb774645-379d-4edd-aaab-de45668b0f81 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:07.600402 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa12ec7f-7ea5-4b33-bcb5-9865069d8e82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a622fa01676b457e8bc242b060df727a, user_id=d6b7cd8a80a14209a18d66171186acaf, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:07.604283 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa12ec7f-7ea5-4b33-bcb5-9865069d8e82 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:07.610174 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb774645-379d-4edd-aaab-de45668b0f81 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:07.616731 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4769d3b-e5da-483f-85ae-6f874eef957e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:07.617564 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4769d3b-e5da-483f-85ae-6f874eef957e admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:07.617913 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4769d3b-e5da-483f-85ae-6f874eef957e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:07.618114 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4769d3b-e5da-483f-85ae-6f874eef957e admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:07.620543 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4769d3b-e5da-483f-85ae-6f874eef957e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:07.620669 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1149/2312] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:39:07 2022] PUT /identity/v3/projects/a622fa01676b457e8bc242b060df727a/users/d6b7cd8a80a14209a18d66171186acaf/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:07.622706 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4769d3b-e5da-483f-85ae-6f874eef957e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:07.639157 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12ec7f-7ea5-4b33-bcb5-9865069d8e82 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:07.669386 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1164/2313] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:39:07 2022] POST /identity/v3/users => generated 298 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:39:07.669386 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4769d3b-e5da-483f-85ae-6f874eef957e admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:07.707526 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4769d3b-e5da-483f-85ae-6f874eef957e admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:07.806915 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dff706-7044-4651-9f33-81cc6a6319d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:07.807648 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dff706-7044-4651-9f33-81cc6a6319d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:07.807925 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dff706-7044-4651-9f33-81cc6a6319d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:07.808216 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dff706-7044-4651-9f33-81cc6a6319d8 admin admin] PATH_INFO: `/v3/projects/068087b8e3274eb98dabdb60c8db2368/users/67701a88fc354d4c9ae7d16f8ee1355b/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:07.826295 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dff706-7044-4651-9f33-81cc6a6319d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=068087b8e3274eb98dabdb60c8db2368, user_id=67701a88fc354d4c9ae7d16f8ee1355b, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:07.827950 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12ec7f-7ea5-4b33-bcb5-9865069d8e82 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:07.829159 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dff706-7044-4651-9f33-81cc6a6319d8 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:07.838024 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64120ee0-67af-4193-9a15-07cf61897dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:07.838708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64120ee0-67af-4193-9a15-07cf61897dcb admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:07.839097 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64120ee0-67af-4193-9a15-07cf61897dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:07.839382 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64120ee0-67af-4193-9a15-07cf61897dcb admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:07.840034 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64120ee0-67af-4193-9a15-07cf61897dcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:07.853215 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64120ee0-67af-4193-9a15-07cf61897dcb admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:07.855232 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1165/2314] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:39:07 2022] PUT /identity/v3/projects/068087b8e3274eb98dabdb60c8db2368/users/67701a88fc354d4c9ae7d16f8ee1355b/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:07.857098 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dff706-7044-4651-9f33-81cc6a6319d8 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:07.906184 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1150/2315] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:39:07 2022] POST /identity/v3/users => generated 297 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:39:07.908958 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a20c63-0f07-4c1a-9859-91795ecc5a1f None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:07.911319 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a20c63-0f07-4c1a-9859-91795ecc5a1f None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:07.911319 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a20c63-0f07-4c1a-9859-91795ecc5a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:08.019396 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:08.024938 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-18a20c63-0f07-4c1a-9859-91795ecc5a1f None None] MFA Rules not processed for user `67701a88fc354d4c9ae7d16f8ee1355b`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:08.040236 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-18a20c63-0f07-4c1a-9859-91795ecc5a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:08.064386 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:08.094937 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dff706-7044-4651-9f33-81cc6a6319d8 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:08.137474 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa5cf8-f3a0-4163-a163-cbafb86a0630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:08.139278 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa5cf8-f3a0-4163-a163-cbafb86a0630 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:08.169013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa5cf8-f3a0-4163-a163-cbafb86a0630 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:08.171688 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa5cf8-f3a0-4163-a163-cbafb86a0630 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:08.182723 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fa5cf8-f3a0-4163-a163-cbafb86a0630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:08.190519 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fa5cf8-f3a0-4163-a163-cbafb86a0630 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:08.234945 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1166/2316] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:08.235862 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa5cf8-f3a0-4163-a163-cbafb86a0630 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:08.255179 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1151/2317] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:08.259287 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a20c63-0f07-4c1a-9859-91795ecc5a1f None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:08.278023 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a20c63-0f07-4c1a-9859-91795ecc5a1f None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:08.278714 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa5cf8-f3a0-4163-a163-cbafb86a0630 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:08.289225 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257d016-3e98-41eb-925f-84a7524164ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:08.289956 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257d016-3e98-41eb-925f-84a7524164ff admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:08.290314 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257d016-3e98-41eb-925f-84a7524164ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:08.290591 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257d016-3e98-41eb-925f-84a7524164ff admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:08.291425 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0257d016-3e98-41eb-925f-84a7524164ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:08.295699 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0257d016-3e98-41eb-925f-84a7524164ff admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:08.295853 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee9c60-e789-430d-b1a1-bd1309a51b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:08.296333 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee9c60-e789-430d-b1a1-bd1309a51b3e admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:08.296613 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee9c60-e789-430d-b1a1-bd1309a51b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:08.296883 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee9c60-e789-430d-b1a1-bd1309a51b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:08.298565 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee9c60-e789-430d-b1a1-bd1309a51b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:08.307196 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee9c60-e789-430d-b1a1-bd1309a51b3e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:08.328145 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1152/2318] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:08.329016 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257d016-3e98-41eb-925f-84a7524164ff admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:08.330082 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1167/2319] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:08.336161 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee9c60-e789-430d-b1a1-bd1309a51b3e admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:08.355983 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257d016-3e98-41eb-925f-84a7524164ff admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:08.373514 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee9c60-e789-430d-b1a1-bd1309a51b3e admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:08.376839 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cebfabc-71ee-4a89-bc35-846bc7fa2847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:08.377486 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebfabc-71ee-4a89-bc35-846bc7fa2847 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:08.377881 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebfabc-71ee-4a89-bc35-846bc7fa2847 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:08.378696 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebfabc-71ee-4a89-bc35-846bc7fa2847 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:08.379528 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cebfabc-71ee-4a89-bc35-846bc7fa2847 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:08.383102 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cebfabc-71ee-4a89-bc35-846bc7fa2847 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:08.389158 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36bdef9-8f51-40c7-a048-2ab0825db047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:08.389848 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36bdef9-8f51-40c7-a048-2ab0825db047 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:08.390127 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36bdef9-8f51-40c7-a048-2ab0825db047 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:08.390658 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36bdef9-8f51-40c7-a048-2ab0825db047 admin admin] PATH_INFO: `/v3/projects/32b1119bf8134e529b2eede6020ac5f7/users/b88e2477a1f045ddad0b708732a31225/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:08.419304 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36bdef9-8f51-40c7-a048-2ab0825db047 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32b1119bf8134e529b2eede6020ac5f7, user_id=b88e2477a1f045ddad0b708732a31225, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:08.422151 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36bdef9-8f51-40c7-a048-2ab0825db047 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:08.445630 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1153/2320] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:39:08 2022] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:39:08.447062 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cebfabc-71ee-4a89-bc35-846bc7fa2847 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:08.456796 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1168/2321] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:39:08 2022] PUT /identity/v3/projects/32b1119bf8134e529b2eede6020ac5f7/users/b88e2477a1f045ddad0b708732a31225/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:08.464392 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36bdef9-8f51-40c7-a048-2ab0825db047 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:08.618114 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cebfabc-71ee-4a89-bc35-846bc7fa2847 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:08.622028 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36bdef9-8f51-40c7-a048-2ab0825db047 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:08.628526 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a42c88c-c85a-4a6c-85cd-68823c9e5e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:08.630396 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b933c-290e-4af9-9d39-ee6f171aa1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:08.631122 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b933c-290e-4af9-9d39-ee6f171aa1f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:08.631436 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b933c-290e-4af9-9d39-ee6f171aa1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:08.631652 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42c88c-c85a-4a6c-85cd-68823c9e5e03 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:08.631779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b933c-290e-4af9-9d39-ee6f171aa1f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:08.632058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42c88c-c85a-4a6c-85cd-68823c9e5e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:08.632410 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42c88c-c85a-4a6c-85cd-68823c9e5e03 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:08.632745 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b933c-290e-4af9-9d39-ee6f171aa1f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:08.633221 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a42c88c-c85a-4a6c-85cd-68823c9e5e03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:08.637844 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b933c-290e-4af9-9d39-ee6f171aa1f6 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:08.638650 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a42c88c-c85a-4a6c-85cd-68823c9e5e03 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:08.662569 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1154/2322] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:08.664191 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5c7c5-a27f-43fc-8faa-55078f655326 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:08.664538 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5c7c5-a27f-43fc-8faa-55078f655326 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:08.664797 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5c7c5-a27f-43fc-8faa-55078f655326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:08.676862 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1169/2323] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:39:08 2022] POST /identity/v3/users => generated 294 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:39:08.678339 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a42c88c-c85a-4a6c-85cd-68823c9e5e03 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:08.696298 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a42c88c-c85a-4a6c-85cd-68823c9e5e03 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:08.727817 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e4f4b-c383-4eb3-bc91-e37c3703610f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:08.728699 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e4f4b-c383-4eb3-bc91-e37c3703610f admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:08.729070 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e4f4b-c383-4eb3-bc91-e37c3703610f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:08.729441 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e4f4b-c383-4eb3-bc91-e37c3703610f admin admin] PATH_INFO: `/v3/projects/6e264b8d7bbf425fbdd9ea9153e2647c/users/36647de173424b3980252aca9d676ccb/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:08.751164 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433e4f4b-c383-4eb3-bc91-e37c3703610f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e264b8d7bbf425fbdd9ea9153e2647c, user_id=36647de173424b3980252aca9d676ccb, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:08.754138 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433e4f4b-c383-4eb3-bc91-e37c3703610f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:08.760370 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-2bb5c7c5-a27f-43fc-8faa-55078f655326 None None] MFA Rules not processed for user `b88e2477a1f045ddad0b708732a31225`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:08.761670 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2bb5c7c5-a27f-43fc-8faa-55078f655326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:08.777518 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1170/2324] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:39:08 2022] PUT /identity/v3/projects/6e264b8d7bbf425fbdd9ea9153e2647c/users/36647de173424b3980252aca9d676ccb/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:08.784495 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e4f4b-c383-4eb3-bc91-e37c3703610f admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:09.022452 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:09.036003 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1155/2325] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:08 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:09.037736 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8017867-d7ff-4845-b808-3f06e223093c None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:09.037905 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8017867-d7ff-4845-b808-3f06e223093c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:09.038168 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8017867-d7ff-4845-b808-3f06e223093c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:09.084083 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e4f4b-c383-4eb3-bc91-e37c3703610f admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:09.105833 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea7f266-313c-43f2-91bb-e61357a50e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:09.107173 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7f266-313c-43f2-91bb-e61357a50e67 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:09.107645 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7f266-313c-43f2-91bb-e61357a50e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:09.108097 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7f266-313c-43f2-91bb-e61357a50e67 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:09.108979 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea7f266-313c-43f2-91bb-e61357a50e67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:09.110784 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea7f266-313c-43f2-91bb-e61357a50e67 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:09.153743 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1171/2326] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:09.158110 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-e8017867-d7ff-4845-b808-3f06e223093c None None] MFA Rules not processed for user `36647de173424b3980252aca9d676ccb`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:09.160286 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e8017867-d7ff-4845-b808-3f06e223093c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:09.161394 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea7f266-313c-43f2-91bb-e61357a50e67 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:09.191120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea7f266-313c-43f2-91bb-e61357a50e67 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:09.210764 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe5cec-c84f-41dc-9138-c7db17415ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:09.212582 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe5cec-c84f-41dc-9138-c7db17415ba1 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:09.212864 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe5cec-c84f-41dc-9138-c7db17415ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:09.213140 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe5cec-c84f-41dc-9138-c7db17415ba1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:09.213795 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe5cec-c84f-41dc-9138-c7db17415ba1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:09.219052 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe5cec-c84f-41dc-9138-c7db17415ba1 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:09.242787 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:09.327054 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1172/2327] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:39:09 2022] POST /identity/v3/projects => generated 393 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:39:09.331121 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe5cec-c84f-41dc-9138-c7db17415ba1 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:09.409652 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1156/2328] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:09 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:09.413734 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8017867-d7ff-4845-b808-3f06e223093c None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:09.450520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8017867-d7ff-4845-b808-3f06e223093c None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:09.543603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe5cec-c84f-41dc-9138-c7db17415ba1 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:09.566750 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88bf74b-4071-4d1e-a757-5062e26877ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:09.567626 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88bf74b-4071-4d1e-a757-5062e26877ae admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:09.568184 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88bf74b-4071-4d1e-a757-5062e26877ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:09.568776 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88bf74b-4071-4d1e-a757-5062e26877ae admin admin] PATH_INFO: `/v3/projects/5deefbb32a254e42a6193ac0ff2d30b6/users/f9feee1111ed47078d21023834d46344/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:09.637905 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88bf74b-4071-4d1e-a757-5062e26877ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=5deefbb32a254e42a6193ac0ff2d30b6, user_id=f9feee1111ed47078d21023834d46344, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:09.642988 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88bf74b-4071-4d1e-a757-5062e26877ae admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:09.679731 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c583be29-1f60-4dca-9dcc-66e87a2cfea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:09.680366 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583be29-1f60-4dca-9dcc-66e87a2cfea5 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:09.680672 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583be29-1f60-4dca-9dcc-66e87a2cfea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:09.680949 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583be29-1f60-4dca-9dcc-66e87a2cfea5 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:09.681595 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c583be29-1f60-4dca-9dcc-66e87a2cfea5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:09.683739 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c583be29-1f60-4dca-9dcc-66e87a2cfea5 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:09.694823 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1173/2329] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:39:09 2022] PUT /identity/v3/projects/5deefbb32a254e42a6193ac0ff2d30b6/users/f9feee1111ed47078d21023834d46344/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:09.695699 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88bf74b-4071-4d1e-a757-5062e26877ae admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:09.746807 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1157/2330] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:39:09 2022] POST /identity/v3/users => generated 303 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:39:09.747859 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c583be29-1f60-4dca-9dcc-66e87a2cfea5 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:09.773051 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c583be29-1f60-4dca-9dcc-66e87a2cfea5 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:09.953732 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88bf74b-4071-4d1e-a757-5062e26877ae admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:09.963617 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520eb0da-54fa-463d-9270-4db8515b5dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:09.965230 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520eb0da-54fa-463d-9270-4db8515b5dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:09.965230 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520eb0da-54fa-463d-9270-4db8515b5dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:09.965230 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520eb0da-54fa-463d-9270-4db8515b5dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:09.967978 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520eb0da-54fa-463d-9270-4db8515b5dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:09.969961 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520eb0da-54fa-463d-9270-4db8515b5dd0 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:09.978600 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042eb76-7a81-449e-be89-c8b4f78cd49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:09.981547 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042eb76-7a81-449e-be89-c8b4f78cd49c admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:09.982397 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042eb76-7a81-449e-be89-c8b4f78cd49c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:09.984822 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042eb76-7a81-449e-be89-c8b4f78cd49c admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:09.987296 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2042eb76-7a81-449e-be89-c8b4f78cd49c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:09.994154 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2042eb76-7a81-449e-be89-c8b4f78cd49c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:09.997111 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1158/2331] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:09.998155 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520eb0da-54fa-463d-9270-4db8515b5dd0 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:10.028516 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520eb0da-54fa-463d-9270-4db8515b5dd0 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:10.039615 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d236d-2a20-421b-ad7e-5d81ef172adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:10.040260 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d236d-2a20-421b-ad7e-5d81ef172adb admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:10.040540 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d236d-2a20-421b-ad7e-5d81ef172adb admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:10.040807 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d236d-2a20-421b-ad7e-5d81ef172adb admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:10.041466 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9d236d-2a20-421b-ad7e-5d81ef172adb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:10.043179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9d236d-2a20-421b-ad7e-5d81ef172adb admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:10.072658 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1159/2332] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:10.077722 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d236d-2a20-421b-ad7e-5d81ef172adb admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:10.089096 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:10.098701 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d236d-2a20-421b-ad7e-5d81ef172adb admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:10.111997 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4048b2-a516-4f93-a787-0fd24d48b71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:10.112756 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4048b2-a516-4f93-a787-0fd24d48b71b admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:10.113044 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4048b2-a516-4f93-a787-0fd24d48b71b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:10.113366 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4048b2-a516-4f93-a787-0fd24d48b71b admin admin] PATH_INFO: `/v3/projects/5deefbb32a254e42a6193ac0ff2d30b6/users/f9feee1111ed47078d21023834d46344/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:10.127882 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4048b2-a516-4f93-a787-0fd24d48b71b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5deefbb32a254e42a6193ac0ff2d30b6, user_id=f9feee1111ed47078d21023834d46344, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:10.130969 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1174/2333] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:39:09 2022] POST /identity/v3/projects => generated 395 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:39:10.132260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042eb76-7a81-449e-be89-c8b4f78cd49c admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:10.141509 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4048b2-a516-4f93-a787-0fd24d48b71b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:10.194432 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1160/2334] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:39:10 2022] PUT /identity/v3/projects/5deefbb32a254e42a6193ac0ff2d30b6/users/f9feee1111ed47078d21023834d46344/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:10.203177 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4048b2-a516-4f93-a787-0fd24d48b71b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:10.272442 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:10.295813 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042eb76-7a81-449e-be89-c8b4f78cd49c admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:10.402637 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4048b2-a516-4f93-a787-0fd24d48b71b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:10.419066 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ca23a-4a3f-4e3a-96c5-ec3319805336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:10.425094 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ca23a-4a3f-4e3a-96c5-ec3319805336 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:10.425598 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ca23a-4a3f-4e3a-96c5-ec3319805336 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:10.426719 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ca23a-4a3f-4e3a-96c5-ec3319805336 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:10.430113 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ca23a-4a3f-4e3a-96c5-ec3319805336 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:10.440691 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ca23a-4a3f-4e3a-96c5-ec3319805336 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:10.467063 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d7139-4705-447d-a40c-c5e6c29ef8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:10.468150 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d7139-4705-447d-a40c-c5e6c29ef8e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:10.468479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d7139-4705-447d-a40c-c5e6c29ef8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:10.468755 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d7139-4705-447d-a40c-c5e6c29ef8e1 admin admin] PATH_INFO: `/v3/projects/a55ede7021bf4db7b8508f882a2ce19d/users/943071af3c3d4c4881240892eae7226d/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:10.513451 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686d7139-4705-447d-a40c-c5e6c29ef8e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a55ede7021bf4db7b8508f882a2ce19d, user_id=943071af3c3d4c4881240892eae7226d, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:10.516769 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686d7139-4705-447d-a40c-c5e6c29ef8e1 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:10.518918 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1161/2335] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:39:10 2022] POST /identity/v3/users => generated 304 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:39:10.522877 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68267115-cd5d-4bab-b7ec-766d6c609c8e None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:10.523320 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68267115-cd5d-4bab-b7ec-766d6c609c8e None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:10.524768 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68267115-cd5d-4bab-b7ec-766d6c609c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:10.569353 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1175/2336] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:39:10 2022] PUT /identity/v3/projects/a55ede7021bf4db7b8508f882a2ce19d/users/943071af3c3d4c4881240892eae7226d/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:10.569353 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d7139-4705-447d-a40c-c5e6c29ef8e1 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:10.602351 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-68267115-cd5d-4bab-b7ec-766d6c609c8e None None] MFA Rules not processed for user `f9feee1111ed47078d21023834d46344`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:10.604241 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-68267115-cd5d-4bab-b7ec-766d6c609c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:10.726804 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d7139-4705-447d-a40c-c5e6c29ef8e1 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:10.749512 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ec9d0-3fe8-4161-9e5d-f3de7715fa1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:10.759314 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ec9d0-3fe8-4161-9e5d-f3de7715fa1e admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:10.759314 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ec9d0-3fe8-4161-9e5d-f3de7715fa1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:10.759314 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ec9d0-3fe8-4161-9e5d-f3de7715fa1e admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:10.759314 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ec9d0-3fe8-4161-9e5d-f3de7715fa1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:10.764388 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ec9d0-3fe8-4161-9e5d-f3de7715fa1e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:10.792245 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1176/2337] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:10.809945 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ec9d0-3fe8-4161-9e5d-f3de7715fa1e admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:10.826965 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1162/2338] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:10 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:10.828412 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68267115-cd5d-4bab-b7ec-766d6c609c8e None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:10.845429 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ec9d0-3fe8-4161-9e5d-f3de7715fa1e admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:10.857259 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4680d3e8-8813-438f-b641-ec6843c2aa47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:10.857903 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680d3e8-8813-438f-b641-ec6843c2aa47 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:10.858180 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680d3e8-8813-438f-b641-ec6843c2aa47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:10.858452 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680d3e8-8813-438f-b641-ec6843c2aa47 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:10.859139 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4680d3e8-8813-438f-b641-ec6843c2aa47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:10.860762 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4680d3e8-8813-438f-b641-ec6843c2aa47 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:10.863538 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68267115-cd5d-4bab-b7ec-766d6c609c8e None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:10.884335 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc718423-0172-416f-b1b1-2d3c5fcc7e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:10.888144 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1177/2339] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:10.888144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a1c4df-6dcf-4a69-827c-1941e2a17359 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:10.888144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a1c4df-6dcf-4a69-827c-1941e2a17359 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:10.888144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a1c4df-6dcf-4a69-827c-1941e2a17359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:10.891254 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc718423-0172-416f-b1b1-2d3c5fcc7e76 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:10.891840 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc718423-0172-416f-b1b1-2d3c5fcc7e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:10.892382 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc718423-0172-416f-b1b1-2d3c5fcc7e76 admin admin] PATH_INFO: `/v3/projects/bf2484eec1cf470099b2ea872d52c664/users/a3dd6e2c4e484639b09921f2b5bf6227/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:10.932535 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-33a1c4df-6dcf-4a69-827c-1941e2a17359 None None] MFA Rules not processed for user `67701a88fc354d4c9ae7d16f8ee1355b`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:10.935735 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-33a1c4df-6dcf-4a69-827c-1941e2a17359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:10.943165 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc718423-0172-416f-b1b1-2d3c5fcc7e76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf2484eec1cf470099b2ea872d52c664, user_id=a3dd6e2c4e484639b09921f2b5bf6227, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:10.947129 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc718423-0172-416f-b1b1-2d3c5fcc7e76 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:11.018733 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1163/2340] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:39:10 2022] PUT /identity/v3/projects/bf2484eec1cf470099b2ea872d52c664/users/a3dd6e2c4e484639b09921f2b5bf6227/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:11.019938 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc718423-0172-416f-b1b1-2d3c5fcc7e76 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:11.105893 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1178/2341] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:11.109128 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a1c4df-6dcf-4a69-827c-1941e2a17359 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:11.136253 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a1c4df-6dcf-4a69-827c-1941e2a17359 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:11.159956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:11.185725 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:11.248174 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc718423-0172-416f-b1b1-2d3c5fcc7e76 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:11.270673 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583f2be-ec91-4af7-a1c4-fecbb20704f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:11.272570 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583f2be-ec91-4af7-a1c4-fecbb20704f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:11.273235 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583f2be-ec91-4af7-a1c4-fecbb20704f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:11.273527 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583f2be-ec91-4af7-a1c4-fecbb20704f7 admin admin] PATH_INFO: `/v3/projects/a55ede7021bf4db7b8508f882a2ce19d/users/943071af3c3d4c4881240892eae7226d/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:11.277183 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5583f2be-ec91-4af7-a1c4-fecbb20704f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a55ede7021bf4db7b8508f882a2ce19d, user_id=943071af3c3d4c4881240892eae7226d, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:11.284293 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5583f2be-ec91-4af7-a1c4-fecbb20704f7 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:11.322356 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f2673-6498-4ca9-8d03-a187a2026c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:11.323095 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f2673-6498-4ca9-8d03-a187a2026c05 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:11.323302 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f2673-6498-4ca9-8d03-a187a2026c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:11.323570 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f2673-6498-4ca9-8d03-a187a2026c05 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:11.326667 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f2673-6498-4ca9-8d03-a187a2026c05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:11.327360 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1164/2342] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:39:11 2022] PUT /identity/v3/projects/a55ede7021bf4db7b8508f882a2ce19d/users/943071af3c3d4c4881240892eae7226d/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:11.331101 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f2673-6498-4ca9-8d03-a187a2026c05 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:11.346085 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583f2be-ec91-4af7-a1c4-fecbb20704f7 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:11.354213 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5583f2be-ec91-4af7-a1c4-fecbb20704f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:11.367044 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1179/2343] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:11.370734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0446337-6d53-48af-9c05-07091d03cbcd None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:11.370734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0446337-6d53-48af-9c05-07091d03cbcd None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:11.370949 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0446337-6d53-48af-9c05-07091d03cbcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:11.448431 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-d0446337-6d53-48af-9c05-07091d03cbcd None None] MFA Rules not processed for user `943071af3c3d4c4881240892eae7226d`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:11.449794 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d0446337-6d53-48af-9c05-07091d03cbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:11.614322 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1180/2344] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:11 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:11.615797 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0446337-6d53-48af-9c05-07091d03cbcd None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:11.634399 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583f2be-ec91-4af7-a1c4-fecbb20704f7 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:11.665858 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536a633-fad8-48fe-8a53-48715b144e0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:11.666501 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536a633-fad8-48fe-8a53-48715b144e0a service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:11.666780 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536a633-fad8-48fe-8a53-48715b144e0a service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:11.667069 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536a633-fad8-48fe-8a53-48715b144e0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:11.769222 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0446337-6d53-48af-9c05-07091d03cbcd None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:11.778731 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f0de2-7209-4a2c-a9ea-f45a80b5b34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:11.780407 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f0de2-7209-4a2c-a9ea-f45a80b5b34a admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:11.780862 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f0de2-7209-4a2c-a9ea-f45a80b5b34a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:11.781300 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f0de2-7209-4a2c-a9ea-f45a80b5b34a admin admin] PATH_INFO: `/v3/projects/bf2484eec1cf470099b2ea872d52c664/users/a3dd6e2c4e484639b09921f2b5bf6227/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:11.784000 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f0de2-7209-4a2c-a9ea-f45a80b5b34a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf2484eec1cf470099b2ea872d52c664, user_id=a3dd6e2c4e484639b09921f2b5bf6227, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:11.794652 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f0de2-7209-4a2c-a9ea-f45a80b5b34a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:11.821066 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a536a633-fad8-48fe-8a53-48715b144e0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:11.822188 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1181/2345] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:39:11 2022] PUT /identity/v3/projects/bf2484eec1cf470099b2ea872d52c664/users/a3dd6e2c4e484639b09921f2b5bf6227/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:11.822489 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a536a633-fad8-48fe-8a53-48715b144e0a service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:11.824163 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d097c12-5514-4d20-9403-6911b079cb83 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:11.824633 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d097c12-5514-4d20-9403-6911b079cb83 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:11.825060 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d097c12-5514-4d20-9403-6911b079cb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:11.845511 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1165/2346] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:39:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:39:11.926523 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-8d097c12-5514-4d20-9403-6911b079cb83 None None] MFA Rules not processed for user `a3dd6e2c4e484639b09921f2b5bf6227`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:11.931272 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8d097c12-5514-4d20-9403-6911b079cb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:11.956090 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:12.061353 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1182/2347] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:11 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:12.478762 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536a633-fad8-48fe-8a53-48715b144e0a service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:12.485754 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a536a633-fad8-48fe-8a53-48715b144e0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:12.518565 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536a633-fad8-48fe-8a53-48715b144e0a service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:12.659064 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f11a26-34f7-494f-8bde-36fe408b4ddb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:12.660987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f11a26-34f7-494f-8bde-36fe408b4ddb service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:12.661266 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f11a26-34f7-494f-8bde-36fe408b4ddb service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:12.662049 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f11a26-34f7-494f-8bde-36fe408b4ddb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:12.696490 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:12.842933 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f11a26-34f7-494f-8bde-36fe408b4ddb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:12.845301 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f11a26-34f7-494f-8bde-36fe408b4ddb service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:12.921649 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1166/2348] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:39:12 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:39:13.115466 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1445e-2089-495b-a5dd-cc543495ac34 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:13.115466 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1445e-2089-495b-a5dd-cc543495ac34 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:13.115947 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f11a26-34f7-494f-8bde-36fe408b4ddb service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:13.116071 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1445e-2089-495b-a5dd-cc543495ac34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:13.145745 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f11a26-34f7-494f-8bde-36fe408b4ddb service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:13.156609 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f868d9-5a18-4700-ab95-13ff1624631f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:13.157231 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f868d9-5a18-4700-ab95-13ff1624631f service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:13.159171 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f868d9-5a18-4700-ab95-13ff1624631f service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:13.159479 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f868d9-5a18-4700-ab95-13ff1624631f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:13.182429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f868d9-5a18-4700-ab95-13ff1624631f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:13.184660 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-c1e1445e-2089-495b-a5dd-cc543495ac34 None None] MFA Rules not processed for user `67701a88fc354d4c9ae7d16f8ee1355b`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:13.185880 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c1e1445e-2089-495b-a5dd-cc543495ac34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:13.188434 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f868d9-5a18-4700-ab95-13ff1624631f service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:13.211082 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1167/2349] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:39:13 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:39:13.368927 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1183/2350] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:13.703866 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f868d9-5a18-4700-ab95-13ff1624631f service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:13.734943 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f868d9-5a18-4700-ab95-13ff1624631f service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:13.751910 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9744e8-a22b-4782-a8ec-0a7f347b29b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:13.752809 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9744e8-a22b-4782-a8ec-0a7f347b29b2 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:13.753211 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9744e8-a22b-4782-a8ec-0a7f347b29b2 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:13.753605 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9744e8-a22b-4782-a8ec-0a7f347b29b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:13.756139 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-fe9744e8-a22b-4782-a8ec-0a7f347b29b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:13.916342 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9744e8-a22b-4782-a8ec-0a7f347b29b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:13.918848 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9744e8-a22b-4782-a8ec-0a7f347b29b2 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:13.945676 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1168/2351] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:39:13 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:39:14.497255 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e1445e-2089-495b-a5dd-cc543495ac34 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:14.688305 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e1445e-2089-495b-a5dd-cc543495ac34 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:14.694809 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a385f-3930-443f-b59e-64514e346898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:14.696282 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a385f-3930-443f-b59e-64514e346898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:14.696836 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a385f-3930-443f-b59e-64514e346898 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:14.697431 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a385f-3930-443f-b59e-64514e346898 admin admin] PATH_INFO: `/v3/users/36647de173424b3980252aca9d676ccb` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:14.699070 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a385f-3930-443f-b59e-64514e346898 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36647de173424b3980252aca9d676ccb)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:14.701756 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a385f-3930-443f-b59e-64514e346898 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:14.796735 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-813a385f-3930-443f-b59e-64514e346898 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36647de173424b3980252aca9d676ccb'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:14.801984 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-813a385f-3930-443f-b59e-64514e346898 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36647de173424b3980252aca9d676ccb'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:14.817248 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:14.822453 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-813a385f-3930-443f-b59e-64514e346898 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36647de173424b3980252aca9d676ccb'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:14.835329 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-813a385f-3930-443f-b59e-64514e346898 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36647de173424b3980252aca9d676ccb'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:14.856654 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-813a385f-3930-443f-b59e-64514e346898 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36647de173424b3980252aca9d676ccb'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:14.867389 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1184/2352] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:39:14 2022] DELETE /identity/v3/users/36647de173424b3980252aca9d676ccb => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:14.875070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a421d9-c52d-48c7-b239-6f388176c065 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:14.876052 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a421d9-c52d-48c7-b239-6f388176c065 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:14.876631 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a421d9-c52d-48c7-b239-6f388176c065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:14.929166 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-00a421d9-c52d-48c7-b239-6f388176c065 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:14.932838 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-00a421d9-c52d-48c7-b239-6f388176c065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:15.066982 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1169/2353] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:15.117853 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed853f-0fa6-455e-a8d2-d2979924456c None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:15.118149 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed853f-0fa6-455e-a8d2-d2979924456c None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:15.118427 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed853f-0fa6-455e-a8d2-d2979924456c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:15.131638 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a421d9-c52d-48c7-b239-6f388176c065 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:15.133382 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-00a421d9-c52d-48c7-b239-6f388176c065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:15.163669 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-beed853f-0fa6-455e-a8d2-d2979924456c None None] MFA Rules not processed for user `e63e67306f07404dab97802890c990a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:15.167381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-beed853f-0fa6-455e-a8d2-d2979924456c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:15.199061 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:15.258020 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a421d9-c52d-48c7-b239-6f388176c065 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:15.271945 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c004010-f1ba-48bd-8dcc-ea0c356d2554 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:15.272859 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c004010-f1ba-48bd-8dcc-ea0c356d2554 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:15.273354 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c004010-f1ba-48bd-8dcc-ea0c356d2554 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:15.273777 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c004010-f1ba-48bd-8dcc-ea0c356d2554 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:15.291102 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c004010-f1ba-48bd-8dcc-ea0c356d2554 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:15.291311 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1185/2354] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:15 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:15.293166 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c004010-f1ba-48bd-8dcc-ea0c356d2554 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:15.316089 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1170/2355] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:39:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:39:16.579428 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed853f-0fa6-455e-a8d2-d2979924456c None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:16.580993 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-beed853f-0fa6-455e-a8d2-d2979924456c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:16.619005 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed853f-0fa6-455e-a8d2-d2979924456c None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:16.629145 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ec285-b3a8-48d0-9f08-28342c718c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:16.629806 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ec285-b3a8-48d0-9f08-28342c718c7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:16.630089 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ec285-b3a8-48d0-9f08-28342c718c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:16.630415 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ec285-b3a8-48d0-9f08-28342c718c7e admin admin] PATH_INFO: `/v3/projects/6e264b8d7bbf425fbdd9ea9153e2647c` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:16.633780 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ec285-b3a8-48d0-9f08-28342c718c7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e264b8d7bbf425fbdd9ea9153e2647c)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:16.638555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ec285-b3a8-48d0-9f08-28342c718c7e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:16.777822 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-df4ec285-b3a8-48d0-9f08-28342c718c7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e264b8d7bbf425fbdd9ea9153e2647c', 'request_id': 'req-df4ec285-b3a8-48d0-9f08-28342c718c7e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:16.792396 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-df4ec285-b3a8-48d0-9f08-28342c718c7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e264b8d7bbf425fbdd9ea9153e2647c', 'request_id': 'req-df4ec285-b3a8-48d0-9f08-28342c718c7e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:16.808369 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-df4ec285-b3a8-48d0-9f08-28342c718c7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e264b8d7bbf425fbdd9ea9153e2647c', 'request_id': 'req-df4ec285-b3a8-48d0-9f08-28342c718c7e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:16.838923 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-df4ec285-b3a8-48d0-9f08-28342c718c7e admin admin] The token cache is being invalidate because project 6e264b8d7bbf425fbdd9ea9153e2647c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:39:16.839635 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-df4ec285-b3a8-48d0-9f08-28342c718c7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:16.843191 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-df4ec285-b3a8-48d0-9f08-28342c718c7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:16.848892 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1186/2356] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:39:16 2022] DELETE /identity/v3/projects/6e264b8d7bbf425fbdd9ea9153e2647c => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:16.849285 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c004010-f1ba-48bd-8dcc-ea0c356d2554 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:16.864322 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c004010-f1ba-48bd-8dcc-ea0c356d2554 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:16.930189 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ec285-b3a8-48d0-9f08-28342c718c7e admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:16.933008 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-df4ec285-b3a8-48d0-9f08-28342c718c7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:17.075870 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f942f526-8e7f-4b2e-b880-a5076bbfd588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:17.076536 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942f526-8e7f-4b2e-b880-a5076bbfd588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:17.076814 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942f526-8e7f-4b2e-b880-a5076bbfd588 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:17.077086 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942f526-8e7f-4b2e-b880-a5076bbfd588 admin admin] PATH_INFO: `/v3/users/a3dd6e2c4e484639b09921f2b5bf6227` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:17.078239 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f942f526-8e7f-4b2e-b880-a5076bbfd588 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3dd6e2c4e484639b09921f2b5bf6227)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:17.080224 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f942f526-8e7f-4b2e-b880-a5076bbfd588 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:17.214819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ec285-b3a8-48d0-9f08-28342c718c7e admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:17.240492 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d850ab-7a1d-4986-a68d-2bc59a212f65 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:17.241208 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d850ab-7a1d-4986-a68d-2bc59a212f65 service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:17.241488 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d850ab-7a1d-4986-a68d-2bc59a212f65 service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:17.252871 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d850ab-7a1d-4986-a68d-2bc59a212f65 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:17.258534 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-19d850ab-7a1d-4986-a68d-2bc59a212f65 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:17.290777 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:17.292760 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f942f526-8e7f-4b2e-b880-a5076bbfd588 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3dd6e2c4e484639b09921f2b5bf6227'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:17.296381 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f942f526-8e7f-4b2e-b880-a5076bbfd588 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3dd6e2c4e484639b09921f2b5bf6227'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:17.299453 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d850ab-7a1d-4986-a68d-2bc59a212f65 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:17.301535 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d850ab-7a1d-4986-a68d-2bc59a212f65 service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:17.314430 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f942f526-8e7f-4b2e-b880-a5076bbfd588 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3dd6e2c4e484639b09921f2b5bf6227'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:17.318337 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1187/2357] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:39:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:39:17.332128 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f942f526-8e7f-4b2e-b880-a5076bbfd588 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3dd6e2c4e484639b09921f2b5bf6227'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:17.334358 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f942f526-8e7f-4b2e-b880-a5076bbfd588 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3dd6e2c4e484639b09921f2b5bf6227'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:17.414047 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1171/2358] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:39:16 2022] DELETE /identity/v3/users/a3dd6e2c4e484639b09921f2b5bf6227 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:18.101765 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d850ab-7a1d-4986-a68d-2bc59a212f65 service placement] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:18.104400 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-19d850ab-7a1d-4986-a68d-2bc59a212f65 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:18.189148 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d850ab-7a1d-4986-a68d-2bc59a212f65 service placement] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:18.401132 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c45021-cc5e-414c-82fc-9f088d9a682d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:18.404479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c45021-cc5e-414c-82fc-9f088d9a682d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:18.404778 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c45021-cc5e-414c-82fc-9f088d9a682d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:18.405059 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c45021-cc5e-414c-82fc-9f088d9a682d admin admin] PATH_INFO: `/v3/projects/bf2484eec1cf470099b2ea872d52c664` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:18.409101 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c45021-cc5e-414c-82fc-9f088d9a682d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf2484eec1cf470099b2ea872d52c664)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:18.415830 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c45021-cc5e-414c-82fc-9f088d9a682d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:18.498846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-01c45021-cc5e-414c-82fc-9f088d9a682d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf2484eec1cf470099b2ea872d52c664', 'request_id': 'req-01c45021-cc5e-414c-82fc-9f088d9a682d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:18.517772 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-01c45021-cc5e-414c-82fc-9f088d9a682d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf2484eec1cf470099b2ea872d52c664', 'request_id': 'req-01c45021-cc5e-414c-82fc-9f088d9a682d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:18.534434 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-01c45021-cc5e-414c-82fc-9f088d9a682d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf2484eec1cf470099b2ea872d52c664', 'request_id': 'req-01c45021-cc5e-414c-82fc-9f088d9a682d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:18.553940 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-01c45021-cc5e-414c-82fc-9f088d9a682d admin admin] The token cache is being invalidate because project bf2484eec1cf470099b2ea872d52c664 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:39:18.554236 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-01c45021-cc5e-414c-82fc-9f088d9a682d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:18.555376 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-01c45021-cc5e-414c-82fc-9f088d9a682d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:18.557493 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1188/2359] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:39:18 2022] DELETE /identity/v3/projects/bf2484eec1cf470099b2ea872d52c664 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:18.562584 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168df07-13f3-495b-8749-e90ae39f2ac3 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:18.563094 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168df07-13f3-495b-8749-e90ae39f2ac3 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:18.563094 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168df07-13f3-495b-8749-e90ae39f2ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:18.589176 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-6168df07-13f3-495b-8749-e90ae39f2ac3 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:18.590551 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6168df07-13f3-495b-8749-e90ae39f2ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:18.625373 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c45021-cc5e-414c-82fc-9f088d9a682d admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:18.626811 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-01c45021-cc5e-414c-82fc-9f088d9a682d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:18.669352 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:18.728333 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1172/2360] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:18.738276 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366302cd-9e23-4bcf-aff2-778c8c728745 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:18.739652 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366302cd-9e23-4bcf-aff2-778c8c728745 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:18.739652 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366302cd-9e23-4bcf-aff2-778c8c728745 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:18.758457 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1173/2361] 10.222.0.83 () {54 vars in 921 bytes} [Mon Aug 29 15:39:18 2022] GET /identity => generated 270 bytes in 23 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:39:18.760080 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5c1dd-e3f1-4ad1-b5b6-802c03010f70 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:18.760454 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5c1dd-e3f1-4ad1-b5b6-802c03010f70 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:18.760945 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5c1dd-e3f1-4ad1-b5b6-802c03010f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:18.801611 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-34d5c1dd-e3f1-4ad1-b5b6-802c03010f70 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:18.803429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-34d5c1dd-e3f1-4ad1-b5b6-802c03010f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:18.815949 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1174/2362] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:18.818352 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8495e3c-c29c-444a-9dc6-084f895c7d99 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:18.818859 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8495e3c-c29c-444a-9dc6-084f895c7d99 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:18.819673 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8495e3c-c29c-444a-9dc6-084f895c7d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:18.844064 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a8495e3c-c29c-444a-9dc6-084f895c7d99 None None] MFA Rules not processed for user `253947a5ef294d2bb828761873251bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:18.845650 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a8495e3c-c29c-444a-9dc6-084f895c7d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:18.870027 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c45021-cc5e-414c-82fc-9f088d9a682d admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:18.873880 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1175/2363] 10.222.0.83 () {58 vars in 1018 bytes} [Mon Aug 29 15:39:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:18.875132 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8495e3c-c29c-444a-9dc6-084f895c7d99 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:18.889570 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c23f6ce-6478-4dd7-b9ff-ac7a50acd502 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:18.890209 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23f6ce-6478-4dd7-b9ff-ac7a50acd502 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:18.890485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23f6ce-6478-4dd7-b9ff-ac7a50acd502 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:18.891004 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23f6ce-6478-4dd7-b9ff-ac7a50acd502 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:18.895654 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8495e3c-c29c-444a-9dc6-084f895c7d99 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:18.898160 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9c23f6ce-6478-4dd7-b9ff-ac7a50acd502 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:18.902187 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99672be4-9bc5-4c28-bfda-b979e1952248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:18.903406 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99672be4-9bc5-4c28-bfda-b979e1952248 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:18.904026 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99672be4-9bc5-4c28-bfda-b979e1952248 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:18.904925 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99672be4-9bc5-4c28-bfda-b979e1952248 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:18.905794 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99672be4-9bc5-4c28-bfda-b979e1952248 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:39:18.906327 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99672be4-9bc5-4c28-bfda-b979e1952248 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:18.908216 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99672be4-9bc5-4c28-bfda-b979e1952248 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:18.937272 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1176/2364] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:39:18.942432 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99672be4-9bc5-4c28-bfda-b979e1952248 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:18.945933 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-99672be4-9bc5-4c28-bfda-b979e1952248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:18.955364 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:19.057094 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c23f6ce-6478-4dd7-b9ff-ac7a50acd502 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:19.061261 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c23f6ce-6478-4dd7-b9ff-ac7a50acd502 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:19.090312 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1189/2365] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:39:18 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:39:19.092439 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c23f6ce-6478-4dd7-b9ff-ac7a50acd502 service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:19.096978 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99672be4-9bc5-4c28-bfda-b979e1952248 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:19.110008 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8176795-7ec3-43e1-8491-ed38a155ca81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:19.117084 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8176795-7ec3-43e1-8491-ed38a155ca81 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:19.117487 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8176795-7ec3-43e1-8491-ed38a155ca81 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:19.120189 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8176795-7ec3-43e1-8491-ed38a155ca81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:19.129494 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c23f6ce-6478-4dd7-b9ff-ac7a50acd502 service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:19.147469 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4805614-8b1a-4b77-a9aa-67ece629666c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:19.148272 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4805614-8b1a-4b77-a9aa-67ece629666c admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:19.148871 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4805614-8b1a-4b77-a9aa-67ece629666c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:19.149148 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4805614-8b1a-4b77-a9aa-67ece629666c admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:19.149868 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4805614-8b1a-4b77-a9aa-67ece629666c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:19.152584 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8176795-7ec3-43e1-8491-ed38a155ca81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:19.154218 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8176795-7ec3-43e1-8491-ed38a155ca81 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:19.158133 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4805614-8b1a-4b77-a9aa-67ece629666c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:19.175349 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1177/2366] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:39:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:39:19.176225 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8176795-7ec3-43e1-8491-ed38a155ca81 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:19.193300 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e8176795-7ec3-43e1-8491-ed38a155ca81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:19.224886 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1190/2367] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:39:19 2022] POST /identity/v3/projects => generated 375 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:39:19.226470 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c50378-0215-44e8-a7c5-c66dfd439d87 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:19.226834 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c50378-0215-44e8-a7c5-c66dfd439d87 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:19.227128 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c50378-0215-44e8-a7c5-c66dfd439d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:19.230609 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8176795-7ec3-43e1-8491-ed38a155ca81 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:19.275038 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-11c50378-0215-44e8-a7c5-c66dfd439d87 None None] MFA Rules not processed for user `9a84bb38f6454574897120223b8fc140`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:19.278349 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-11c50378-0215-44e8-a7c5-c66dfd439d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:19.360141 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcfe514-3511-43d0-a7e1-a0c7f8b3a5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:19.361052 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfe514-3511-43d0-a7e1-a0c7f8b3a5c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:19.362045 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfe514-3511-43d0-a7e1-a0c7f8b3a5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:19.362475 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfe514-3511-43d0-a7e1-a0c7f8b3a5c6 admin admin] PATH_INFO: `/v3/users/b88e2477a1f045ddad0b708732a31225` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:19.363981 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcfe514-3511-43d0-a7e1-a0c7f8b3a5c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b88e2477a1f045ddad0b708732a31225)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:19.366975 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcfe514-3511-43d0-a7e1-a0c7f8b3a5c6 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:19.372206 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1191/2368] 10.222.0.83 () {58 vars in 1018 bytes} [Mon Aug 29 15:39:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:19.373372 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c50378-0215-44e8-a7c5-c66dfd439d87 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:19.400960 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c50378-0215-44e8-a7c5-c66dfd439d87 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:19.405986 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231733f-da52-4336-bbe6-34b080a3852c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:19.406612 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231733f-da52-4336-bbe6-34b080a3852c admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:19.406892 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231733f-da52-4336-bbe6-34b080a3852c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:19.407261 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231733f-da52-4336-bbe6-34b080a3852c admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:19.408439 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4231733f-da52-4336-bbe6-34b080a3852c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:19.412218 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4231733f-da52-4336-bbe6-34b080a3852c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:19.477783 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1192/2369] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:39:19 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:39:19.485197 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231733f-da52-4336-bbe6-34b080a3852c admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:19.503208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ebcfe514-3511-43d0-a7e1-a0c7f8b3a5c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b88e2477a1f045ddad0b708732a31225'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:19.503919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ebcfe514-3511-43d0-a7e1-a0c7f8b3a5c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b88e2477a1f045ddad0b708732a31225'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:19.518841 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ebcfe514-3511-43d0-a7e1-a0c7f8b3a5c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b88e2477a1f045ddad0b708732a31225'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:19.527334 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231733f-da52-4336-bbe6-34b080a3852c admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:19.527498 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ebcfe514-3511-43d0-a7e1-a0c7f8b3a5c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b88e2477a1f045ddad0b708732a31225'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:19.529720 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ebcfe514-3511-43d0-a7e1-a0c7f8b3a5c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b88e2477a1f045ddad0b708732a31225'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:19.541683 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64e27b-e07c-4580-a6c1-057655525d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:19.542714 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64e27b-e07c-4580-a6c1-057655525d33 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:19.543122 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64e27b-e07c-4580-a6c1-057655525d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:19.543638 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64e27b-e07c-4580-a6c1-057655525d33 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:19.544974 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e64e27b-e07c-4580-a6c1-057655525d33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:19.547922 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e64e27b-e07c-4580-a6c1-057655525d33 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:19.552645 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:19.601619 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1193/2370] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:19.602635 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64e27b-e07c-4580-a6c1-057655525d33 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:19.603291 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1178/2371] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:39:19 2022] DELETE /identity/v3/users/b88e2477a1f045ddad0b708732a31225 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:19.604352 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcfe514-3511-43d0-a7e1-a0c7f8b3a5c6 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:19.607261 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7e64e27b-e07c-4580-a6c1-057655525d33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:19.608731 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ebcfe514-3511-43d0-a7e1-a0c7f8b3a5c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:19.624041 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64e27b-e07c-4580-a6c1-057655525d33 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:19.734284 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133fd9a2-795b-4588-8daf-2728e49bb6db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:19.735396 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133fd9a2-795b-4588-8daf-2728e49bb6db service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:19.735769 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133fd9a2-795b-4588-8daf-2728e49bb6db service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:19.736208 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133fd9a2-795b-4588-8daf-2728e49bb6db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:19.743775 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-133fd9a2-795b-4588-8daf-2728e49bb6db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:19.762915 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcfe514-3511-43d0-a7e1-a0c7f8b3a5c6 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:19.767660 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133fd9a2-795b-4588-8daf-2728e49bb6db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:19.770441 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133fd9a2-795b-4588-8daf-2728e49bb6db service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:19.778428 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39586e5e-c48d-4cd8-a156-c6e324973eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:19.779162 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39586e5e-c48d-4cd8-a156-c6e324973eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:19.779513 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39586e5e-c48d-4cd8-a156-c6e324973eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:19.779849 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39586e5e-c48d-4cd8-a156-c6e324973eb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:19.780539 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39586e5e-c48d-4cd8-a156-c6e324973eb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:19.783376 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39586e5e-c48d-4cd8-a156-c6e324973eb1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:19.799714 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1179/2372] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:19.801173 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09dff4-b83f-4b07-8d37-0ad61283b767 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:19.802532 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09dff4-b83f-4b07-8d37-0ad61283b767 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:19.802840 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09dff4-b83f-4b07-8d37-0ad61283b767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:19.822756 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1194/2373] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:39:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:39:19.826736 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133fd9a2-795b-4588-8daf-2728e49bb6db service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:19.830383 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-6a09dff4-b83f-4b07-8d37-0ad61283b767 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:19.831735 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6a09dff4-b83f-4b07-8d37-0ad61283b767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:19.843408 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1180/2374] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:19.854762 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a09dff4-b83f-4b07-8d37-0ad61283b767 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:19.856344 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6a09dff4-b83f-4b07-8d37-0ad61283b767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:19.863170 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133fd9a2-795b-4588-8daf-2728e49bb6db service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:19.879571 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32f998-1ae0-42e9-b03c-28a8a785e8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:19.882653 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32f998-1ae0-42e9-b03c-28a8a785e8f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:19.883052 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32f998-1ae0-42e9-b03c-28a8a785e8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:19.883393 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32f998-1ae0-42e9-b03c-28a8a785e8f7 admin admin] PATH_INFO: `/v3/projects/4180687b0247484fa510599d9f9c618c/users/f8a0c242c0c0443bbb99e1cd5371933e/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:19.883855 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a09dff4-b83f-4b07-8d37-0ad61283b767 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:19.888246 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b333c0-c70c-4250-80d0-77a7333a57aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:19.889644 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b333c0-c70c-4250-80d0-77a7333a57aa service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:19.890116 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b333c0-c70c-4250-80d0-77a7333a57aa service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:19.890999 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b333c0-c70c-4250-80d0-77a7333a57aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:19.908270 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b333c0-c70c-4250-80d0-77a7333a57aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:19.909743 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b333c0-c70c-4250-80d0-77a7333a57aa service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:19.917781 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32f998-1ae0-42e9-b03c-28a8a785e8f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4180687b0247484fa510599d9f9c618c, user_id=f8a0c242c0c0443bbb99e1cd5371933e, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:19.921246 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32f998-1ae0-42e9-b03c-28a8a785e8f7 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:19.940374 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1181/2375] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:39:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:39:19.946447 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:19.968906 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1195/2376] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:39:19 2022] PUT /identity/v3/projects/4180687b0247484fa510599d9f9c618c/users/f8a0c242c0c0443bbb99e1cd5371933e/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:19.970764 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cb9e2-fe9b-4c36-8a45-f5896b2b660f None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:19.971103 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cb9e2-fe9b-4c36-8a45-f5896b2b660f None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:19.972089 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cb9e2-fe9b-4c36-8a45-f5896b2b660f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:20.039861 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-516cb9e2-fe9b-4c36-8a45-f5896b2b660f None None] MFA Rules not processed for user `f8a0c242c0c0443bbb99e1cd5371933e`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:20.041487 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-516cb9e2-fe9b-4c36-8a45-f5896b2b660f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:20.230901 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32f998-1ae0-42e9-b03c-28a8a785e8f7 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:20.236914 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1182/2377] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:20.387924 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32f998-1ae0-42e9-b03c-28a8a785e8f7 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:20.393893 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e65442-0709-44bf-aba1-98e0b13afd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:20.394518 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e65442-0709-44bf-aba1-98e0b13afd6f admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:20.394959 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e65442-0709-44bf-aba1-98e0b13afd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:20.395367 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e65442-0709-44bf-aba1-98e0b13afd6f admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:20.396626 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e65442-0709-44bf-aba1-98e0b13afd6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:20.400786 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e65442-0709-44bf-aba1-98e0b13afd6f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:20.446193 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516cb9e2-fe9b-4c36-8a45-f5896b2b660f None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:20.452600 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1196/2378] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:39:20 2022] POST /identity/v3/projects => generated 377 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:39:20.465325 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516cb9e2-fe9b-4c36-8a45-f5896b2b660f None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:20.552971 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:20.566557 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa14f186-5926-4e8b-9520-55d0f3356c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:20.567523 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14f186-5926-4e8b-9520-55d0f3356c9b admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:20.568162 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14f186-5926-4e8b-9520-55d0f3356c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:20.568560 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14f186-5926-4e8b-9520-55d0f3356c9b admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:20.569378 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa14f186-5926-4e8b-9520-55d0f3356c9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:20.572164 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa14f186-5926-4e8b-9520-55d0f3356c9b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:20.613684 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1183/2379] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:39:20 2022] POST /identity/v3/users => generated 295 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:39:20.618117 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e65442-0709-44bf-aba1-98e0b13afd6f admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:20.629303 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e65442-0709-44bf-aba1-98e0b13afd6f admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:20.643879 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa14f186-5926-4e8b-9520-55d0f3356c9b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:20.648196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-aa14f186-5926-4e8b-9520-55d0f3356c9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:20.653405 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a8565d-3dd7-45a7-a196-4cc706b4a0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:20.654221 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8565d-3dd7-45a7-a196-4cc706b4a0d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:20.654642 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8565d-3dd7-45a7-a196-4cc706b4a0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:20.655090 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8565d-3dd7-45a7-a196-4cc706b4a0d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:20.656223 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a8565d-3dd7-45a7-a196-4cc706b4a0d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:20.667433 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa14f186-5926-4e8b-9520-55d0f3356c9b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:20.668038 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a8565d-3dd7-45a7-a196-4cc706b4a0d2 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:20.672954 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa32b4-1e0b-4415-bb4f-dfc08115983d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:20.673609 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa32b4-1e0b-4415-bb4f-dfc08115983d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:20.673950 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa32b4-1e0b-4415-bb4f-dfc08115983d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:20.674265 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa32b4-1e0b-4415-bb4f-dfc08115983d admin admin] PATH_INFO: `/v3/projects/32b1119bf8134e529b2eede6020ac5f7` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:20.675832 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa32b4-1e0b-4415-bb4f-dfc08115983d admin admin] RBAC: Authorizing `identity:delete_project(project_id=32b1119bf8134e529b2eede6020ac5f7)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:20.679106 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa32b4-1e0b-4415-bb4f-dfc08115983d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:20.695216 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1197/2380] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:20.704409 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a8565d-3dd7-45a7-a196-4cc706b4a0d2 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:20.742737 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a8565d-3dd7-45a7-a196-4cc706b4a0d2 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:20.766342 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a52a04-7042-4dad-95f0-d8e0c043f54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:20.767038 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a52a04-7042-4dad-95f0-d8e0c043f54a admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:20.767321 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a52a04-7042-4dad-95f0-d8e0c043f54a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:20.767606 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a52a04-7042-4dad-95f0-d8e0c043f54a admin admin] PATH_INFO: `/v3/projects/358d784c7a48416bb9bf68d7c6adee3f/users/d8f725e9c0a2461a9f1ecf7614603b36/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:20.782446 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b7aa32b4-1e0b-4415-bb4f-dfc08115983d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32b1119bf8134e529b2eede6020ac5f7', 'request_id': 'req-b7aa32b4-1e0b-4415-bb4f-dfc08115983d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:20.795138 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b7aa32b4-1e0b-4415-bb4f-dfc08115983d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32b1119bf8134e529b2eede6020ac5f7', 'request_id': 'req-b7aa32b4-1e0b-4415-bb4f-dfc08115983d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:20.808867 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a52a04-7042-4dad-95f0-d8e0c043f54a admin admin] RBAC: Authorizing `identity:create_grant(project_id=358d784c7a48416bb9bf68d7c6adee3f, user_id=d8f725e9c0a2461a9f1ecf7614603b36, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:20.811815 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a52a04-7042-4dad-95f0-d8e0c043f54a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:20.822270 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b7aa32b4-1e0b-4415-bb4f-dfc08115983d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32b1119bf8134e529b2eede6020ac5f7', 'request_id': 'req-b7aa32b4-1e0b-4415-bb4f-dfc08115983d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:20.842699 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1198/2381] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:39:20 2022] PUT /identity/v3/projects/358d784c7a48416bb9bf68d7c6adee3f/users/d8f725e9c0a2461a9f1ecf7614603b36/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:20.850459 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a52a04-7042-4dad-95f0-d8e0c043f54a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:20.851376 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b7aa32b4-1e0b-4415-bb4f-dfc08115983d admin admin] The token cache is being invalidate because project 32b1119bf8134e529b2eede6020ac5f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:39:20.851734 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b7aa32b4-1e0b-4415-bb4f-dfc08115983d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:20.852644 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b7aa32b4-1e0b-4415-bb4f-dfc08115983d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:20.856113 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1184/2382] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:39:20 2022] DELETE /identity/v3/projects/32b1119bf8134e529b2eede6020ac5f7 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:20.861997 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa32b4-1e0b-4415-bb4f-dfc08115983d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:20.864388 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b7aa32b4-1e0b-4415-bb4f-dfc08115983d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:20.997732 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a52a04-7042-4dad-95f0-d8e0c043f54a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:21.005751 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d4cab1-26e0-409e-9172-de73cdd84b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:21.006571 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4cab1-26e0-409e-9172-de73cdd84b6b admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:21.006904 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4cab1-26e0-409e-9172-de73cdd84b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:21.007206 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4cab1-26e0-409e-9172-de73cdd84b6b admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:21.007345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa32b4-1e0b-4415-bb4f-dfc08115983d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:21.007894 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d4cab1-26e0-409e-9172-de73cdd84b6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:21.009826 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d4cab1-26e0-409e-9172-de73cdd84b6b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:21.016623 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e933b2-42f2-4e00-9bda-d847b16785f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:21.017677 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e933b2-42f2-4e00-9bda-d847b16785f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:21.018169 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e933b2-42f2-4e00-9bda-d847b16785f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:21.018636 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e933b2-42f2-4e00-9bda-d847b16785f1 admin admin] PATH_INFO: `/v3/users/943071af3c3d4c4881240892eae7226d` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:21.020931 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e933b2-42f2-4e00-9bda-d847b16785f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=943071af3c3d4c4881240892eae7226d)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:21.023095 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1199/2383] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:21.023575 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e933b2-42f2-4e00-9bda-d847b16785f1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:21.027869 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d4cab1-26e0-409e-9172-de73cdd84b6b admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:21.030381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a1d4cab1-26e0-409e-9172-de73cdd84b6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:21.046581 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d4cab1-26e0-409e-9172-de73cdd84b6b admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:21.051937 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5d589-48d4-4d29-ae34-ea356e6b79d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:21.053130 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5d589-48d4-4d29-ae34-ea356e6b79d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:21.053649 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5d589-48d4-4d29-ae34-ea356e6b79d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:21.054133 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5d589-48d4-4d29-ae34-ea356e6b79d4 admin admin] PATH_INFO: `/v3/projects/358d784c7a48416bb9bf68d7c6adee3f/users/d8f725e9c0a2461a9f1ecf7614603b36/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:21.056776 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f5d589-48d4-4d29-ae34-ea356e6b79d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=358d784c7a48416bb9bf68d7c6adee3f, user_id=d8f725e9c0a2461a9f1ecf7614603b36, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:21.060845 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f5d589-48d4-4d29-ae34-ea356e6b79d4 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:21.093370 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1200/2384] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:39:21 2022] PUT /identity/v3/projects/358d784c7a48416bb9bf68d7c6adee3f/users/d8f725e9c0a2461a9f1ecf7614603b36/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:21.096176 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30969d7-ec7c-426b-9120-5c2a28bb585c None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:21.096462 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30969d7-ec7c-426b-9120-5c2a28bb585c None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:21.096785 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30969d7-ec7c-426b-9120-5c2a28bb585c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:21.112159 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-65e933b2-42f2-4e00-9bda-d847b16785f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '943071af3c3d4c4881240892eae7226d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:21.113300 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-65e933b2-42f2-4e00-9bda-d847b16785f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '943071af3c3d4c4881240892eae7226d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:21.126551 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-65e933b2-42f2-4e00-9bda-d847b16785f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '943071af3c3d4c4881240892eae7226d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:21.138568 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-d30969d7-ec7c-426b-9120-5c2a28bb585c None None] MFA Rules not processed for user `d8f725e9c0a2461a9f1ecf7614603b36`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:21.139821 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d30969d7-ec7c-426b-9120-5c2a28bb585c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:21.142406 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-65e933b2-42f2-4e00-9bda-d847b16785f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '943071af3c3d4c4881240892eae7226d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:21.143447 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-65e933b2-42f2-4e00-9bda-d847b16785f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '943071af3c3d4c4881240892eae7226d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:21.147142 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=80,keystone:INSERT=5,keystone:DELETE=15 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:21.170967 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1185/2385] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:39:20 2022] DELETE /identity/v3/users/943071af3c3d4c4881240892eae7226d => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:21.180972 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:21.251072 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1201/2386] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:21 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:22.219757 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e933b2-42f2-4e00-9bda-d847b16785f1 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:22.222255 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-65e933b2-42f2-4e00-9bda-d847b16785f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:22.318443 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e933b2-42f2-4e00-9bda-d847b16785f1 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:22.324301 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b015728-cf0b-4b34-af39-bad89500b2bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:22.324937 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b015728-cf0b-4b34-af39-bad89500b2bd service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:22.325220 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b015728-cf0b-4b34-af39-bad89500b2bd service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:22.325637 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b015728-cf0b-4b34-af39-bad89500b2bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:22.375946 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30969d7-ec7c-426b-9120-5c2a28bb585c None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:22.378351 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d30969d7-ec7c-426b-9120-5c2a28bb585c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:22.464686 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b015728-cf0b-4b34-af39-bad89500b2bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:22.467201 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b015728-cf0b-4b34-af39-bad89500b2bd service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:22.480966 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30969d7-ec7c-426b-9120-5c2a28bb585c None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:22.482392 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1186/2387] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:39:22 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:39:22.550917 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf31851-392c-4071-9022-847769de3bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:22.551720 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf31851-392c-4071-9022-847769de3bee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:22.552193 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf31851-392c-4071-9022-847769de3bee admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:22.552608 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf31851-392c-4071-9022-847769de3bee admin admin] PATH_INFO: `/v3/projects/a55ede7021bf4db7b8508f882a2ce19d` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:22.554145 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf31851-392c-4071-9022-847769de3bee admin admin] RBAC: Authorizing `identity:delete_project(project_id=a55ede7021bf4db7b8508f882a2ce19d)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:22.556235 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf31851-392c-4071-9022-847769de3bee admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:22.649096 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ebf31851-392c-4071-9022-847769de3bee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a55ede7021bf4db7b8508f882a2ce19d', 'request_id': 'req-ebf31851-392c-4071-9022-847769de3bee'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:22.663959 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ebf31851-392c-4071-9022-847769de3bee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a55ede7021bf4db7b8508f882a2ce19d', 'request_id': 'req-ebf31851-392c-4071-9022-847769de3bee'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:22.678526 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ebf31851-392c-4071-9022-847769de3bee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a55ede7021bf4db7b8508f882a2ce19d', 'request_id': 'req-ebf31851-392c-4071-9022-847769de3bee'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:22.682592 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:22.710783 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ebf31851-392c-4071-9022-847769de3bee admin admin] The token cache is being invalidate because project a55ede7021bf4db7b8508f882a2ce19d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:39:22.711243 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ebf31851-392c-4071-9022-847769de3bee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:22.715449 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ebf31851-392c-4071-9022-847769de3bee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:22.722457 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1202/2388] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:39:22 2022] DELETE /identity/v3/projects/a55ede7021bf4db7b8508f882a2ce19d => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:22.731279 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022805b-073a-4443-98c7-0a8f491bea7d None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:22.731561 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022805b-073a-4443-98c7-0a8f491bea7d None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:22.731830 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022805b-073a-4443-98c7-0a8f491bea7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:22.763309 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-0022805b-073a-4443-98c7-0a8f491bea7d None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:22.766441 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0022805b-073a-4443-98c7-0a8f491bea7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:22.850879 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1187/2389] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:22.861509 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ffd61-0057-4b1a-98a9-bf13c0c1202d None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:22.862326 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ffd61-0057-4b1a-98a9-bf13c0c1202d None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:22.862781 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ffd61-0057-4b1a-98a9-bf13c0c1202d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:22.886975 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-2f1ffd61-0057-4b1a-98a9-bf13c0c1202d None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:22.888673 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2f1ffd61-0057-4b1a-98a9-bf13c0c1202d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:22.901761 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022805b-073a-4443-98c7-0a8f491bea7d None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:22.912229 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022805b-073a-4443-98c7-0a8f491bea7d None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:22.912890 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1203/2390] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:22.918828 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdcdfb5-96e8-4abf-b3ea-50378ef93e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:22.920155 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdcdfb5-96e8-4abf-b3ea-50378ef93e65 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:22.920364 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdcdfb5-96e8-4abf-b3ea-50378ef93e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:22.920592 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdcdfb5-96e8-4abf-b3ea-50378ef93e65 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:22.921407 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdcdfb5-96e8-4abf-b3ea-50378ef93e65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:39:22.921711 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdcdfb5-96e8-4abf-b3ea-50378ef93e65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:22.923529 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdcdfb5-96e8-4abf-b3ea-50378ef93e65 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:22.938052 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1188/2391] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:39:22.942428 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ffd61-0057-4b1a-98a9-bf13c0c1202d None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:22.953534 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ffd61-0057-4b1a-98a9-bf13c0c1202d None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:22.959568 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c2814-17ee-4b4b-b7ad-b226c474288e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:22.959972 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c2814-17ee-4b4b-b7ad-b226c474288e admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:22.960318 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c2814-17ee-4b4b-b7ad-b226c474288e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:22.960720 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c2814-17ee-4b4b-b7ad-b226c474288e admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:22.961506 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c2814-17ee-4b4b-b7ad-b226c474288e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:22.963590 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c2814-17ee-4b4b-b7ad-b226c474288e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:22.997822 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1204/2392] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:39:22 2022] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:39:22.999514 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdcdfb5-96e8-4abf-b3ea-50378ef93e65 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:23.004985 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:23.012758 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdcdfb5-96e8-4abf-b3ea-50378ef93e65 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:23.103400 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a585e0d-e4e6-4b71-9a1d-549854b91b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:23.104167 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a585e0d-e4e6-4b71-9a1d-549854b91b98 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:23.104625 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a585e0d-e4e6-4b71-9a1d-549854b91b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:23.105206 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a585e0d-e4e6-4b71-9a1d-549854b91b98 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:23.106614 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a585e0d-e4e6-4b71-9a1d-549854b91b98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:23.109823 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a585e0d-e4e6-4b71-9a1d-549854b91b98 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:23.154158 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1189/2393] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:39:22 2022] POST /identity/v3/users => generated 283 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:39:23.159016 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c2814-17ee-4b4b-b7ad-b226c474288e admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:23.180381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c2814-17ee-4b4b-b7ad-b226c474288e admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:23.192002 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc053c4-de95-4383-a484-1eb0751274a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:23.195103 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc053c4-de95-4383-a484-1eb0751274a8 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:23.195456 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc053c4-de95-4383-a484-1eb0751274a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:23.196091 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc053c4-de95-4383-a484-1eb0751274a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:23.198492 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc053c4-de95-4383-a484-1eb0751274a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:23.202609 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc053c4-de95-4383-a484-1eb0751274a8 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:23.222765 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1205/2394] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:23.224615 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a585e0d-e4e6-4b71-9a1d-549854b91b98 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:23.238486 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a585e0d-e4e6-4b71-9a1d-549854b91b98 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:23.248374 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf893c9d-1893-42e6-a188-b166e3d42624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:23.248796 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf893c9d-1893-42e6-a188-b166e3d42624 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:23.263180 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa4861-1d22-4780-8872-77ca2041e9fa None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:23.263867 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa4861-1d22-4780-8872-77ca2041e9fa None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:23.264968 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa4861-1d22-4780-8872-77ca2041e9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:23.286519 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf893c9d-1893-42e6-a188-b166e3d42624 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:23.288632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf893c9d-1893-42e6-a188-b166e3d42624 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:23.289475 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf893c9d-1893-42e6-a188-b166e3d42624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:23.299258 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf893c9d-1893-42e6-a188-b166e3d42624 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:23.320804 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1190/2395] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:23.325043 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf893c9d-1893-42e6-a188-b166e3d42624 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:23.338653 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf893c9d-1893-42e6-a188-b166e3d42624 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:23.344662 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b6dcc-f90d-4acb-ad77-42f0a466734a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:23.346406 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b6dcc-f90d-4acb-ad77-42f0a466734a admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:23.346793 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b6dcc-f90d-4acb-ad77-42f0a466734a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:23.347418 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b6dcc-f90d-4acb-ad77-42f0a466734a admin admin] PATH_INFO: `/v3/projects/b0c4051fa5084b638108f191a7c1365b/users/09663bec61af43278da1d69c37594558/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:23.350308 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-aafa4861-1d22-4780-8872-77ca2041e9fa None None] MFA Rules not processed for user `d6b7cd8a80a14209a18d66171186acaf`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:23.352372 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-aafa4861-1d22-4780-8872-77ca2041e9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:23.377223 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b6dcc-f90d-4acb-ad77-42f0a466734a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0c4051fa5084b638108f191a7c1365b, user_id=09663bec61af43278da1d69c37594558, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:23.383862 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b6dcc-f90d-4acb-ad77-42f0a466734a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:23.430225 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1191/2396] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:39:23 2022] PUT /identity/v3/projects/b0c4051fa5084b638108f191a7c1365b/users/09663bec61af43278da1d69c37594558/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:23.435344 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56239da9-0785-473d-b72c-22cdc88e5d23 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:23.436009 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56239da9-0785-473d-b72c-22cdc88e5d23 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:23.436830 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56239da9-0785-473d-b72c-22cdc88e5d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:23.477074 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1206/2397] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:23 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:23.484446 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-56239da9-0785-473d-b72c-22cdc88e5d23 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:23.486196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-56239da9-0785-473d-b72c-22cdc88e5d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:23.651158 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1192/2398] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:39:23.693943 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa4861-1d22-4780-8872-77ca2041e9fa None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:23.696280 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-aafa4861-1d22-4780-8872-77ca2041e9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:23.831888 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56239da9-0785-473d-b72c-22cdc88e5d23 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:23.833916 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-56239da9-0785-473d-b72c-22cdc88e5d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:23.854081 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa4861-1d22-4780-8872-77ca2041e9fa None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:23.953282 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7443833-cf3e-4e28-bcec-df5fb7a6948f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:23.954703 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7443833-cf3e-4e28-bcec-df5fb7a6948f service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:23.955302 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:23.957045 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7443833-cf3e-4e28-bcec-df5fb7a6948f service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:23.957884 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7443833-cf3e-4e28-bcec-df5fb7a6948f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:23.978438 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7443833-cf3e-4e28-bcec-df5fb7a6948f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:23.980382 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7443833-cf3e-4e28-bcec-df5fb7a6948f service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:23.988406 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:23.999421 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56239da9-0785-473d-b72c-22cdc88e5d23 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:24.008660 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1207/2399] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:39:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:39:24.010355 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04593cd9-7925-413f-902c-40eb2fbb26b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:24.011242 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04593cd9-7925-413f-902c-40eb2fbb26b8 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:24.011717 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04593cd9-7925-413f-902c-40eb2fbb26b8 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:24.012169 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04593cd9-7925-413f-902c-40eb2fbb26b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:24.014135 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-04593cd9-7925-413f-902c-40eb2fbb26b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:24.101513 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04593cd9-7925-413f-902c-40eb2fbb26b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:24.104215 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04593cd9-7925-413f-902c-40eb2fbb26b8 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:24.119413 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1193/2400] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:39:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:39:24.584440 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7443833-cf3e-4e28-bcec-df5fb7a6948f service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:24.586027 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a7443833-cf3e-4e28-bcec-df5fb7a6948f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:24.614046 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7443833-cf3e-4e28-bcec-df5fb7a6948f service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:24.624042 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474f8926-db30-4b4f-86e3-50aa34d86bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:24.624693 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f8926-db30-4b4f-86e3-50aa34d86bb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:24.624969 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f8926-db30-4b4f-86e3-50aa34d86bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:24.625235 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f8926-db30-4b4f-86e3-50aa34d86bb3 admin admin] PATH_INFO: `/v3/users/f8a0c242c0c0443bbb99e1cd5371933e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:24.628259 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474f8926-db30-4b4f-86e3-50aa34d86bb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8a0c242c0c0443bbb99e1cd5371933e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:24.630475 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474f8926-db30-4b4f-86e3-50aa34d86bb3 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:24.719437 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-474f8926-db30-4b4f-86e3-50aa34d86bb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8a0c242c0c0443bbb99e1cd5371933e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:24.720587 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-474f8926-db30-4b4f-86e3-50aa34d86bb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8a0c242c0c0443bbb99e1cd5371933e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:24.740703 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-474f8926-db30-4b4f-86e3-50aa34d86bb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8a0c242c0c0443bbb99e1cd5371933e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:24.756724 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-474f8926-db30-4b4f-86e3-50aa34d86bb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8a0c242c0c0443bbb99e1cd5371933e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:24.769651 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-474f8926-db30-4b4f-86e3-50aa34d86bb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8a0c242c0c0443bbb99e1cd5371933e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:24.782675 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1208/2401] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:39:24 2022] DELETE /identity/v3/users/f8a0c242c0c0443bbb99e1cd5371933e => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:24.786045 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b4c79-fd15-4d65-8375-94142f74757a None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:24.787209 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b4c79-fd15-4d65-8375-94142f74757a None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:24.787313 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b4c79-fd15-4d65-8375-94142f74757a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:24.812104 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-6d2b4c79-fd15-4d65-8375-94142f74757a None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:24.813389 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6d2b4c79-fd15-4d65-8375-94142f74757a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:24.944708 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1194/2402] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:24.974669 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474f8926-db30-4b4f-86e3-50aa34d86bb3 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:24.976599 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-474f8926-db30-4b4f-86e3-50aa34d86bb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:25.067370 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474f8926-db30-4b4f-86e3-50aa34d86bb3 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:25.072073 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f0918-6e59-43e0-a94e-5fa7a0b6db75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:25.073160 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f0918-6e59-43e0-a94e-5fa7a0b6db75 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:25.073329 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f0918-6e59-43e0-a94e-5fa7a0b6db75 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:25.073700 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f0918-6e59-43e0-a94e-5fa7a0b6db75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:25.090724 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f0918-6e59-43e0-a94e-5fa7a0b6db75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:25.094193 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f0918-6e59-43e0-a94e-5fa7a0b6db75 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:25.128456 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1209/2403] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:39:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:39:27.098284 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b4c79-fd15-4d65-8375-94142f74757a None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:27.100488 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6d2b4c79-fd15-4d65-8375-94142f74757a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:27.129345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b4c79-fd15-4d65-8375-94142f74757a None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:27.151181 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea4580-b8fa-49dd-b777-ccdcc19032aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:27.152175 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea4580-b8fa-49dd-b777-ccdcc19032aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:27.152641 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea4580-b8fa-49dd-b777-ccdcc19032aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:27.153093 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea4580-b8fa-49dd-b777-ccdcc19032aa admin admin] PATH_INFO: `/v3/projects/4180687b0247484fa510599d9f9c618c` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:27.155712 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea4580-b8fa-49dd-b777-ccdcc19032aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=4180687b0247484fa510599d9f9c618c)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:27.157884 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea4580-b8fa-49dd-b777-ccdcc19032aa admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:27.245932 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9fea4580-b8fa-49dd-b777-ccdcc19032aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4180687b0247484fa510599d9f9c618c', 'request_id': 'req-9fea4580-b8fa-49dd-b777-ccdcc19032aa'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:27.252619 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9fea4580-b8fa-49dd-b777-ccdcc19032aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4180687b0247484fa510599d9f9c618c', 'request_id': 'req-9fea4580-b8fa-49dd-b777-ccdcc19032aa'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:27.261386 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9fea4580-b8fa-49dd-b777-ccdcc19032aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4180687b0247484fa510599d9f9c618c', 'request_id': 'req-9fea4580-b8fa-49dd-b777-ccdcc19032aa'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:27.290369 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9fea4580-b8fa-49dd-b777-ccdcc19032aa admin admin] The token cache is being invalidate because project 4180687b0247484fa510599d9f9c618c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:39:27.291750 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9fea4580-b8fa-49dd-b777-ccdcc19032aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:27.293422 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9fea4580-b8fa-49dd-b777-ccdcc19032aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:27.295339 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1195/2404] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:39:27 2022] DELETE /identity/v3/projects/4180687b0247484fa510599d9f9c618c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:27.299595 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f0918-6e59-43e0-a94e-5fa7a0b6db75 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:27.315517 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f0918-6e59-43e0-a94e-5fa7a0b6db75 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:27.462836 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09434834-552e-44cd-b63a-82f959e2e6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:27.463927 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09434834-552e-44cd-b63a-82f959e2e6f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:27.464210 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09434834-552e-44cd-b63a-82f959e2e6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:27.464490 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09434834-552e-44cd-b63a-82f959e2e6f7 admin admin] PATH_INFO: `/v3/users/d8f725e9c0a2461a9f1ecf7614603b36` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:27.469670 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09434834-552e-44cd-b63a-82f959e2e6f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8f725e9c0a2461a9f1ecf7614603b36)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:27.471802 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09434834-552e-44cd-b63a-82f959e2e6f7 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:27.509531 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:27.579294 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-09434834-552e-44cd-b63a-82f959e2e6f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8f725e9c0a2461a9f1ecf7614603b36'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:27.580004 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-09434834-552e-44cd-b63a-82f959e2e6f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8f725e9c0a2461a9f1ecf7614603b36'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:27.607678 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-09434834-552e-44cd-b63a-82f959e2e6f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8f725e9c0a2461a9f1ecf7614603b36'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:27.619633 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-09434834-552e-44cd-b63a-82f959e2e6f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8f725e9c0a2461a9f1ecf7614603b36'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:27.629661 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-09434834-552e-44cd-b63a-82f959e2e6f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8f725e9c0a2461a9f1ecf7614603b36'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:27.641452 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1210/2405] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:39:27 2022] DELETE /identity/v3/users/d8f725e9c0a2461a9f1ecf7614603b36 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:29.707919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea4580-b8fa-49dd-b777-ccdcc19032aa admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:29.710194 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9fea4580-b8fa-49dd-b777-ccdcc19032aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:29.764083 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea4580-b8fa-49dd-b777-ccdcc19032aa admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:29.814849 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:29.945140 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd367c4-7ed2-464f-a47c-741bd3553c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:29.945803 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd367c4-7ed2-464f-a47c-741bd3553c09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:29.946085 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd367c4-7ed2-464f-a47c-741bd3553c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:29.946361 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd367c4-7ed2-464f-a47c-741bd3553c09 admin admin] PATH_INFO: `/v3/projects/358d784c7a48416bb9bf68d7c6adee3f` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:29.948189 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd367c4-7ed2-464f-a47c-741bd3553c09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=358d784c7a48416bb9bf68d7c6adee3f)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:29.950170 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd367c4-7ed2-464f-a47c-741bd3553c09 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:30.093070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-dcd367c4-7ed2-464f-a47c-741bd3553c09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '358d784c7a48416bb9bf68d7c6adee3f', 'request_id': 'req-dcd367c4-7ed2-464f-a47c-741bd3553c09'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:30.118471 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-dcd367c4-7ed2-464f-a47c-741bd3553c09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '358d784c7a48416bb9bf68d7c6adee3f', 'request_id': 'req-dcd367c4-7ed2-464f-a47c-741bd3553c09'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:30.138788 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-dcd367c4-7ed2-464f-a47c-741bd3553c09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '358d784c7a48416bb9bf68d7c6adee3f', 'request_id': 'req-dcd367c4-7ed2-464f-a47c-741bd3553c09'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:30.166706 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-dcd367c4-7ed2-464f-a47c-741bd3553c09 admin admin] The token cache is being invalidate because project 358d784c7a48416bb9bf68d7c6adee3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:39:30.167003 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-dcd367c4-7ed2-464f-a47c-741bd3553c09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:30.168445 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-dcd367c4-7ed2-464f-a47c-741bd3553c09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:30.170597 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1196/2406] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:39:29 2022] DELETE /identity/v3/projects/358d784c7a48416bb9bf68d7c6adee3f => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:39:30.177619 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e9c52-978e-439c-9ee1-86cd07bf46b7 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:30.180235 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e9c52-978e-439c-9ee1-86cd07bf46b7 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:30.180781 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e9c52-978e-439c-9ee1-86cd07bf46b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:30.213440 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-ac6e9c52-978e-439c-9ee1-86cd07bf46b7 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:30.214965 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ac6e9c52-978e-439c-9ee1-86cd07bf46b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:30.348401 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78736c2-5a39-42b6-94be-6b3d6513692e None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:30.348690 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78736c2-5a39-42b6-94be-6b3d6513692e None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:30.349057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78736c2-5a39-42b6-94be-6b3d6513692e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:30.353551 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1211/2407] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:30.372250 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-f78736c2-5a39-42b6-94be-6b3d6513692e None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:30.374188 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f78736c2-5a39-42b6-94be-6b3d6513692e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:30.387482 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1197/2408] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:30.389855 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e9c52-978e-439c-9ee1-86cd07bf46b7 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:30.400923 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e9c52-978e-439c-9ee1-86cd07bf46b7 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:30.406137 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019208eb-4a03-45fa-ad6c-252f115cc8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:30.406890 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019208eb-4a03-45fa-ad6c-252f115cc8e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:30.407430 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019208eb-4a03-45fa-ad6c-252f115cc8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:30.407837 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019208eb-4a03-45fa-ad6c-252f115cc8e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:30.408676 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019208eb-4a03-45fa-ad6c-252f115cc8e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:39:30.408989 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019208eb-4a03-45fa-ad6c-252f115cc8e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:30.411144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019208eb-4a03-45fa-ad6c-252f115cc8e4 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:30.439280 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1212/2409] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:39:30.440175 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78736c2-5a39-42b6-94be-6b3d6513692e None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:30.464750 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78736c2-5a39-42b6-94be-6b3d6513692e None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:30.465362 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1256a6-d181-4e11-b77d-ff746e3f89b2 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:30.465712 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1256a6-d181-4e11-b77d-ff746e3f89b2 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:30.466049 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1256a6-d181-4e11-b77d-ff746e3f89b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:30.481176 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331e85da-f1bf-44f7-9140-e7fb4228c79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:30.481909 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e85da-f1bf-44f7-9140-e7fb4228c79c admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:30.482265 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e85da-f1bf-44f7-9140-e7fb4228c79c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:30.482662 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e85da-f1bf-44f7-9140-e7fb4228c79c admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:30.483530 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331e85da-f1bf-44f7-9140-e7fb4228c79c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:30.485554 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331e85da-f1bf-44f7-9140-e7fb4228c79c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:30.489207 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-cf1256a6-d181-4e11-b77d-ff746e3f89b2 None None] MFA Rules not processed for user `53387bcdf14248b9bdf716e782b786d7`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:30.491591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-cf1256a6-d181-4e11-b77d-ff746e3f89b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:30.519631 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1198/2410] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:39:30 2022] POST /identity/v3/projects => generated 373 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:39:30.523600 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331e85da-f1bf-44f7-9140-e7fb4228c79c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:30.630806 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1213/2411] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:39:30.677936 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331e85da-f1bf-44f7-9140-e7fb4228c79c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:30.696660 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf992510-4d35-4ce9-9d2e-278447004b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:30.698010 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf992510-4d35-4ce9-9d2e-278447004b7d admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:30.698293 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf992510-4d35-4ce9-9d2e-278447004b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:30.698571 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf992510-4d35-4ce9-9d2e-278447004b7d admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:30.699264 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf992510-4d35-4ce9-9d2e-278447004b7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:30.707887 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf992510-4d35-4ce9-9d2e-278447004b7d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:30.751468 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1199/2412] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:39:30 2022] POST /identity/v3/users => generated 287 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:39:30.754864 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1256a6-d181-4e11-b77d-ff746e3f89b2 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:30.787620 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1256a6-d181-4e11-b77d-ff746e3f89b2 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:30.804669 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca88c10-66d5-41dd-a55b-877023b0d6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:30.807081 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca88c10-66d5-41dd-a55b-877023b0d6f2 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:30.807935 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca88c10-66d5-41dd-a55b-877023b0d6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:30.816477 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca88c10-66d5-41dd-a55b-877023b0d6f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:30.819281 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca88c10-66d5-41dd-a55b-877023b0d6f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:30.832532 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca88c10-66d5-41dd-a55b-877023b0d6f2 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:30.873251 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1214/2413] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:30.875093 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf992510-4d35-4ce9-9d2e-278447004b7d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:30.895466 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf992510-4d35-4ce9-9d2e-278447004b7d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:30.902152 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de728f9-19f6-418d-9112-366396efc647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:30.902799 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de728f9-19f6-418d-9112-366396efc647 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:30.905603 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de728f9-19f6-418d-9112-366396efc647 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:30.905930 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de728f9-19f6-418d-9112-366396efc647 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:30.907459 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de728f9-19f6-418d-9112-366396efc647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:30.911186 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de728f9-19f6-418d-9112-366396efc647 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:30.925052 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:30.947451 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1200/2414] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:30.950680 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca88c10-66d5-41dd-a55b-877023b0d6f2 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:30.967269 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca88c10-66d5-41dd-a55b-877023b0d6f2 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:30.984897 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23200b0d-b6a4-486d-9655-98c45bf29931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:30.985733 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23200b0d-b6a4-486d-9655-98c45bf29931 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:30.986127 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23200b0d-b6a4-486d-9655-98c45bf29931 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:30.986513 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23200b0d-b6a4-486d-9655-98c45bf29931 admin admin] PATH_INFO: `/v3/projects/95b8e2179e1f4fa6bf596a8dd85f761c/users/cc90d88d1e574a94858bbe2523855caa/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:31.021831 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:31.032411 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23200b0d-b6a4-486d-9655-98c45bf29931 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95b8e2179e1f4fa6bf596a8dd85f761c, user_id=cc90d88d1e574a94858bbe2523855caa, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:31.040970 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23200b0d-b6a4-486d-9655-98c45bf29931 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:31.089844 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1215/2415] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:39:30 2022] PUT /identity/v3/projects/95b8e2179e1f4fa6bf596a8dd85f761c/users/cc90d88d1e574a94858bbe2523855caa/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:31.102079 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff826ab-a435-4694-b6bc-6f982a60fe54 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:31.102585 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff826ab-a435-4694-b6bc-6f982a60fe54 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:31.103179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff826ab-a435-4694-b6bc-6f982a60fe54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:31.163393 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-cff826ab-a435-4694-b6bc-6f982a60fe54 None None] MFA Rules not processed for user `cc90d88d1e574a94858bbe2523855caa`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:31.164979 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-cff826ab-a435-4694-b6bc-6f982a60fe54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:31.258464 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1201/2416] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:39:31.265656 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23200b0d-b6a4-486d-9655-98c45bf29931 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:31.379919 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23200b0d-b6a4-486d-9655-98c45bf29931 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:31.396332 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c50f55-2a05-4ccb-8010-985d72bc2593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:31.397512 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c50f55-2a05-4ccb-8010-985d72bc2593 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:31.397804 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c50f55-2a05-4ccb-8010-985d72bc2593 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:31.399370 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c50f55-2a05-4ccb-8010-985d72bc2593 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:31.400127 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c50f55-2a05-4ccb-8010-985d72bc2593 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:31.404136 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c50f55-2a05-4ccb-8010-985d72bc2593 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:31.471401 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1216/2417] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:39:31 2022] POST /identity/v3/projects => generated 375 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:39:31.472791 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff826ab-a435-4694-b6bc-6f982a60fe54 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:31.485712 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff826ab-a435-4694-b6bc-6f982a60fe54 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:31.570265 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67146e-525d-4303-ac7a-acd384ea676a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:31.571064 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67146e-525d-4303-ac7a-acd384ea676a admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:31.571444 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67146e-525d-4303-ac7a-acd384ea676a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:31.571855 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67146e-525d-4303-ac7a-acd384ea676a admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:31.573006 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b67146e-525d-4303-ac7a-acd384ea676a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:31.575694 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b67146e-525d-4303-ac7a-acd384ea676a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:31.614161 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1202/2418] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:39:31 2022] POST /identity/v3/users => generated 294 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:39:31.618638 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c50f55-2a05-4ccb-8010-985d72bc2593 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:31.633868 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c50f55-2a05-4ccb-8010-985d72bc2593 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:31.639752 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2dbba-c901-43e5-87f5-8c0b0e83a57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:31.640507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2dbba-c901-43e5-87f5-8c0b0e83a57f admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:31.641135 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2dbba-c901-43e5-87f5-8c0b0e83a57f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:31.641557 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2dbba-c901-43e5-87f5-8c0b0e83a57f admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:31.642507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2dbba-c901-43e5-87f5-8c0b0e83a57f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:31.644531 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2dbba-c901-43e5-87f5-8c0b0e83a57f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:31.660458 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1217/2419] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:31.665623 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67146e-525d-4303-ac7a-acd384ea676a admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:31.679162 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67146e-525d-4303-ac7a-acd384ea676a admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:31.694142 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a470d4f-62ee-41e1-8ee4-0e0759ec2086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:31.694887 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a470d4f-62ee-41e1-8ee4-0e0759ec2086 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:31.695200 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a470d4f-62ee-41e1-8ee4-0e0759ec2086 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:31.695468 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a470d4f-62ee-41e1-8ee4-0e0759ec2086 admin admin] PATH_INFO: `/v3/projects/1c4d01c4eddd43e09ec8e7efc2bdc2a5/users/daf5d8de71074057871a3091617bda2a/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:31.752699 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a470d4f-62ee-41e1-8ee4-0e0759ec2086 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c4d01c4eddd43e09ec8e7efc2bdc2a5, user_id=daf5d8de71074057871a3091617bda2a, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:31.760628 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a470d4f-62ee-41e1-8ee4-0e0759ec2086 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:31.787344 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1203/2420] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:39:31 2022] PUT /identity/v3/projects/1c4d01c4eddd43e09ec8e7efc2bdc2a5/users/daf5d8de71074057871a3091617bda2a/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:31.794147 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2dbba-c901-43e5-87f5-8c0b0e83a57f admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:31.814562 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2dbba-c901-43e5-87f5-8c0b0e83a57f admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:31.931944 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae812f81-cedb-499c-a9d4-f0b39c6312e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:31.932574 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae812f81-cedb-499c-a9d4-f0b39c6312e7 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:31.932851 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae812f81-cedb-499c-a9d4-f0b39c6312e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:31.933127 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae812f81-cedb-499c-a9d4-f0b39c6312e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:31.934280 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae812f81-cedb-499c-a9d4-f0b39c6312e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:31.936208 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae812f81-cedb-499c-a9d4-f0b39c6312e7 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:31.949326 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1218/2421] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:31 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:31.953119 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a470d4f-62ee-41e1-8ee4-0e0759ec2086 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:31.969677 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a470d4f-62ee-41e1-8ee4-0e0759ec2086 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:31.977316 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa1376-213c-476d-8774-5c9cf916876c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:31.978746 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa1376-213c-476d-8774-5c9cf916876c admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:31.979124 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa1376-213c-476d-8774-5c9cf916876c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:31.979871 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa1376-213c-476d-8774-5c9cf916876c admin admin] PATH_INFO: `/v3/projects/1c4d01c4eddd43e09ec8e7efc2bdc2a5/users/daf5d8de71074057871a3091617bda2a/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:31.985308 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa1376-213c-476d-8774-5c9cf916876c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c4d01c4eddd43e09ec8e7efc2bdc2a5, user_id=daf5d8de71074057871a3091617bda2a, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:31.988154 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa1376-213c-476d-8774-5c9cf916876c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:32.013074 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1204/2422] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:39:31 2022] PUT /identity/v3/projects/1c4d01c4eddd43e09ec8e7efc2bdc2a5/users/daf5d8de71074057871a3091617bda2a/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:39:32.024087 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062d806-d300-4b98-8e12-d995e8940e06 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:32.025624 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062d806-d300-4b98-8e12-d995e8940e06 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:32.025624 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062d806-d300-4b98-8e12-d995e8940e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:32.072069 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-5062d806-d300-4b98-8e12-d995e8940e06 None None] MFA Rules not processed for user `daf5d8de71074057871a3091617bda2a`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:32.073314 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5062d806-d300-4b98-8e12-d995e8940e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:32.151471 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:32.196236 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1219/2423] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:32 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:32.206971 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1b5df-06d5-4230-80b4-04be4b6ea5ff None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:32.207209 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1b5df-06d5-4230-80b4-04be4b6ea5ff None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:32.207492 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1b5df-06d5-4230-80b4-04be4b6ea5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:32.245412 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-72d1b5df-06d5-4230-80b4-04be4b6ea5ff None None] MFA Rules not processed for user `cc90d88d1e574a94858bbe2523855caa`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:32.246810 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-72d1b5df-06d5-4230-80b4-04be4b6ea5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:32.329301 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:32.377029 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1205/2424] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:32.914050 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062d806-d300-4b98-8e12-d995e8940e06 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:32.916131 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5062d806-d300-4b98-8e12-d995e8940e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:33.033350 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062d806-d300-4b98-8e12-d995e8940e06 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:33.046704 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8547e468-b41a-4a46-a9fe-cfc7a06c5723 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:33.047753 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547e468-b41a-4a46-a9fe-cfc7a06c5723 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:33.048583 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547e468-b41a-4a46-a9fe-cfc7a06c5723 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:33.049431 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547e468-b41a-4a46-a9fe-cfc7a06c5723 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:33.069160 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8547e468-b41a-4a46-a9fe-cfc7a06c5723 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:33.080756 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8547e468-b41a-4a46-a9fe-cfc7a06c5723 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:33.100603 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1220/2425] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:39:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:39:37.248091 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf924c55-9037-4442-8fe3-479693eb0769 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:37.249108 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf924c55-9037-4442-8fe3-479693eb0769 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:37.249454 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf924c55-9037-4442-8fe3-479693eb0769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:37.309097 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-cf924c55-9037-4442-8fe3-479693eb0769 None None] MFA Rules not processed for user `67701a88fc354d4c9ae7d16f8ee1355b`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:37.310760 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-cf924c55-9037-4442-8fe3-479693eb0769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:37.435928 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1206/2426] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:38.728301 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384531fd-0d2b-4402-a238-0e6d33488233 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:38.729442 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384531fd-0d2b-4402-a238-0e6d33488233 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:38.729934 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384531fd-0d2b-4402-a238-0e6d33488233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:38.797658 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-384531fd-0d2b-4402-a238-0e6d33488233 None None] MFA Rules not processed for user `09663bec61af43278da1d69c37594558`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:38.799107 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-384531fd-0d2b-4402-a238-0e6d33488233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:38.904437 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf924c55-9037-4442-8fe3-479693eb0769 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:38.906596 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-cf924c55-9037-4442-8fe3-479693eb0769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:38.929884 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1221/2427] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:38.943591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db3930-c027-4b8a-9b25-d6bb51354541 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:38.943591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db3930-c027-4b8a-9b25-d6bb51354541 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:38.944514 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db3930-c027-4b8a-9b25-d6bb51354541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:38.992790 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-f6db3930-c027-4b8a-9b25-d6bb51354541 None None] MFA Rules not processed for user `09663bec61af43278da1d69c37594558`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:38.993911 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f6db3930-c027-4b8a-9b25-d6bb51354541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:39.017392 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1222/2428] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:39:39.029782 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db3930-c027-4b8a-9b25-d6bb51354541 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:39.030902 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f6db3930-c027-4b8a-9b25-d6bb51354541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:39.035524 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf924c55-9037-4442-8fe3-479693eb0769 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:39.048187 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f5783-5491-45ab-916c-1b5c1dd7ace8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:39.049171 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f5783-5491-45ab-916c-1b5c1dd7ace8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:39.049610 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f5783-5491-45ab-916c-1b5c1dd7ace8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:39.050152 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f5783-5491-45ab-916c-1b5c1dd7ace8 admin admin] PATH_INFO: `/v3/users/010ed8588b2d496bacedebc1863a3857` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:39.051707 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628f5783-5491-45ab-916c-1b5c1dd7ace8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=010ed8588b2d496bacedebc1863a3857)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:39.052701 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db3930-c027-4b8a-9b25-d6bb51354541 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:39.061082 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628f5783-5491-45ab-916c-1b5c1dd7ace8 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:39.066536 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf390d7-ec73-4f70-ac9b-ffdc56615110 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:39.067208 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf390d7-ec73-4f70-ac9b-ffdc56615110 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:39.067535 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf390d7-ec73-4f70-ac9b-ffdc56615110 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:39.069195 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf390d7-ec73-4f70-ac9b-ffdc56615110 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:39.143734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf390d7-ec73-4f70-ac9b-ffdc56615110 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:39.145842 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf390d7-ec73-4f70-ac9b-ffdc56615110 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:39.174445 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1223/2429] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:39:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:39:39.270295 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-628f5783-5491-45ab-916c-1b5c1dd7ace8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '010ed8588b2d496bacedebc1863a3857'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:39.272179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-628f5783-5491-45ab-916c-1b5c1dd7ace8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '010ed8588b2d496bacedebc1863a3857'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:39.293809 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-628f5783-5491-45ab-916c-1b5c1dd7ace8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '010ed8588b2d496bacedebc1863a3857'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:39.324551 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-628f5783-5491-45ab-916c-1b5c1dd7ace8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '010ed8588b2d496bacedebc1863a3857'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:39.325701 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-628f5783-5491-45ab-916c-1b5c1dd7ace8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '010ed8588b2d496bacedebc1863a3857'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:39.372786 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1207/2430] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:39:38 2022] DELETE /identity/v3/users/010ed8588b2d496bacedebc1863a3857 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:39.377161 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38043c-23b7-43ac-95e8-a86f102884d2 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:39.377715 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38043c-23b7-43ac-95e8-a86f102884d2 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:39.377985 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38043c-23b7-43ac-95e8-a86f102884d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:39.420654 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-3f38043c-23b7-43ac-95e8-a86f102884d2 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:39.421956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3f38043c-23b7-43ac-95e8-a86f102884d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:39.525939 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:39.589774 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1224/2431] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:39.615082 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f5783-5491-45ab-916c-1b5c1dd7ace8 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:39.618096 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-628f5783-5491-45ab-916c-1b5c1dd7ace8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:39.648268 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:39.804615 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f5783-5491-45ab-916c-1b5c1dd7ace8 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:39.808696 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d05e99-8a1d-4be6-87b6-e1a5976b6d60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:39.809332 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d05e99-8a1d-4be6-87b6-e1a5976b6d60 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:39.809608 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d05e99-8a1d-4be6-87b6-e1a5976b6d60 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:39.809881 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d05e99-8a1d-4be6-87b6-e1a5976b6d60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:39.839159 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d05e99-8a1d-4be6-87b6-e1a5976b6d60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:39.840939 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d05e99-8a1d-4be6-87b6-e1a5976b6d60 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:39.861765 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1208/2432] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:39:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:39:40.407806 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38043c-23b7-43ac-95e8-a86f102884d2 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:40.409561 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3f38043c-23b7-43ac-95e8-a86f102884d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:40.443620 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38043c-23b7-43ac-95e8-a86f102884d2 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:40.469284 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e17bd-0846-4966-8a3e-adb8485a5a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:40.470009 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e17bd-0846-4966-8a3e-adb8485a5a86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:40.470496 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e17bd-0846-4966-8a3e-adb8485a5a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:40.470828 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e17bd-0846-4966-8a3e-adb8485a5a86 admin admin] PATH_INFO: `/v3/projects/13ee7f05500a437580afe08f38a79fb9` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:40.473296 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87e17bd-0846-4966-8a3e-adb8485a5a86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13ee7f05500a437580afe08f38a79fb9)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:40.477669 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87e17bd-0846-4966-8a3e-adb8485a5a86 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:40.658056 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f87e17bd-0846-4966-8a3e-adb8485a5a86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13ee7f05500a437580afe08f38a79fb9', 'request_id': 'req-f87e17bd-0846-4966-8a3e-adb8485a5a86'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:40.671881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f87e17bd-0846-4966-8a3e-adb8485a5a86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13ee7f05500a437580afe08f38a79fb9', 'request_id': 'req-f87e17bd-0846-4966-8a3e-adb8485a5a86'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:40.689679 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f87e17bd-0846-4966-8a3e-adb8485a5a86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13ee7f05500a437580afe08f38a79fb9', 'request_id': 'req-f87e17bd-0846-4966-8a3e-adb8485a5a86'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:40.713475 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f87e17bd-0846-4966-8a3e-adb8485a5a86 admin admin] The token cache is being invalidate because project 13ee7f05500a437580afe08f38a79fb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:39:40.713770 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f87e17bd-0846-4966-8a3e-adb8485a5a86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:40.716137 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f87e17bd-0846-4966-8a3e-adb8485a5a86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:40.721995 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1225/2433] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:39:40 2022] DELETE /identity/v3/projects/13ee7f05500a437580afe08f38a79fb9 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:40.726950 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d05e99-8a1d-4be6-87b6-e1a5976b6d60 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:40.776772 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d05e99-8a1d-4be6-87b6-e1a5976b6d60 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:40.968860 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fafd8c5-b8ea-4581-a156-9f5edbbc982c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:40.970226 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafd8c5-b8ea-4581-a156-9f5edbbc982c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:40.970515 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafd8c5-b8ea-4581-a156-9f5edbbc982c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:40.970781 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafd8c5-b8ea-4581-a156-9f5edbbc982c admin admin] PATH_INFO: `/v3/users/b66f43896bed46f38ba26352ec7c0884` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:40.972106 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fafd8c5-b8ea-4581-a156-9f5edbbc982c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b66f43896bed46f38ba26352ec7c0884)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:40.986738 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fafd8c5-b8ea-4581-a156-9f5edbbc982c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:41.085074 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5fafd8c5-b8ea-4581-a156-9f5edbbc982c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b66f43896bed46f38ba26352ec7c0884'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:41.086383 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5fafd8c5-b8ea-4581-a156-9f5edbbc982c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b66f43896bed46f38ba26352ec7c0884'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:41.101326 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5fafd8c5-b8ea-4581-a156-9f5edbbc982c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b66f43896bed46f38ba26352ec7c0884'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:41.114503 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5fafd8c5-b8ea-4581-a156-9f5edbbc982c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b66f43896bed46f38ba26352ec7c0884'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:41.115604 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5fafd8c5-b8ea-4581-a156-9f5edbbc982c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b66f43896bed46f38ba26352ec7c0884'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:41.191155 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1209/2434] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:39:40 2022] DELETE /identity/v3/users/b66f43896bed46f38ba26352ec7c0884 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:42.093914 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e17bd-0846-4966-8a3e-adb8485a5a86 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:42.096572 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f87e17bd-0846-4966-8a3e-adb8485a5a86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:42.121541 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e17bd-0846-4966-8a3e-adb8485a5a86 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:42.232935 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6392e265-af11-49e6-9a57-f8ce494cac1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:42.233578 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392e265-af11-49e6-9a57-f8ce494cac1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:42.234024 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392e265-af11-49e6-9a57-f8ce494cac1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:42.234512 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392e265-af11-49e6-9a57-f8ce494cac1b admin admin] PATH_INFO: `/v3/projects/3b7b790bc2b545109b7b17d26b85cb9c` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:42.235881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6392e265-af11-49e6-9a57-f8ce494cac1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b7b790bc2b545109b7b17d26b85cb9c)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:42.238135 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6392e265-af11-49e6-9a57-f8ce494cac1b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:42.306967 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6392e265-af11-49e6-9a57-f8ce494cac1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b7b790bc2b545109b7b17d26b85cb9c', 'request_id': 'req-6392e265-af11-49e6-9a57-f8ce494cac1b'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:42.320860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6392e265-af11-49e6-9a57-f8ce494cac1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b7b790bc2b545109b7b17d26b85cb9c', 'request_id': 'req-6392e265-af11-49e6-9a57-f8ce494cac1b'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:42.344605 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6392e265-af11-49e6-9a57-f8ce494cac1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b7b790bc2b545109b7b17d26b85cb9c', 'request_id': 'req-6392e265-af11-49e6-9a57-f8ce494cac1b'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:42.348125 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:42.397147 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6392e265-af11-49e6-9a57-f8ce494cac1b admin admin] The token cache is being invalidate because project 3b7b790bc2b545109b7b17d26b85cb9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:39:42.400697 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6392e265-af11-49e6-9a57-f8ce494cac1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:42.401419 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6392e265-af11-49e6-9a57-f8ce494cac1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:42.406710 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1226/2435] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:39:42 2022] DELETE /identity/v3/projects/3b7b790bc2b545109b7b17d26b85cb9c => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:39:42.410653 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d966a-5a50-4144-945f-fc3d403abf1c None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:42.414619 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d966a-5a50-4144-945f-fc3d403abf1c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:42.415352 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d966a-5a50-4144-945f-fc3d403abf1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:42.465585 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a30d966a-5a50-4144-945f-fc3d403abf1c None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:42.467186 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a30d966a-5a50-4144-945f-fc3d403abf1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:42.508738 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:42.583793 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1210/2436] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:42.585848 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b60d3-8d62-4de8-8080-38a4871d17dc None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:42.586159 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b60d3-8d62-4de8-8080-38a4871d17dc None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:42.586437 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b60d3-8d62-4de8-8080-38a4871d17dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:42.629105 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-959b60d3-8d62-4de8-8080-38a4871d17dc None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:42.631045 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-959b60d3-8d62-4de8-8080-38a4871d17dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:42.646952 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1227/2437] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:39:42.651707 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d966a-5a50-4144-945f-fc3d403abf1c None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:42.667057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d966a-5a50-4144-945f-fc3d403abf1c None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:42.679448 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3eca4-4b83-4b7d-bd45-202cffb3aa4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:42.680137 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3eca4-4b83-4b7d-bd45-202cffb3aa4a admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:42.680411 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3eca4-4b83-4b7d-bd45-202cffb3aa4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:42.680770 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3eca4-4b83-4b7d-bd45-202cffb3aa4a admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:42.681372 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e3eca4-4b83-4b7d-bd45-202cffb3aa4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:39:42.681668 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e3eca4-4b83-4b7d-bd45-202cffb3aa4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:42.687273 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e3eca4-4b83-4b7d-bd45-202cffb3aa4a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:42.754173 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b60d3-8d62-4de8-8080-38a4871d17dc None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:42.760027 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1211/2438] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:39:42.773505 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b60d3-8d62-4de8-8080-38a4871d17dc None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:42.791863 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e3d29-c1e9-4a9d-aac6-799e1d721eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:42.793027 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e3d29-c1e9-4a9d-aac6-799e1d721eda admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:42.793843 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e3d29-c1e9-4a9d-aac6-799e1d721eda admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:42.794124 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e3d29-c1e9-4a9d-aac6-799e1d721eda admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:42.794791 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501e3d29-c1e9-4a9d-aac6-799e1d721eda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:42.800175 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501e3d29-c1e9-4a9d-aac6-799e1d721eda admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:42.842437 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43e359-d11f-4677-b391-b2356098a5ac None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:42.842970 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43e359-d11f-4677-b391-b2356098a5ac None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:42.843360 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43e359-d11f-4677-b391-b2356098a5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:42.901923 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-6c43e359-d11f-4677-b391-b2356098a5ac None None] MFA Rules not processed for user `f12698b45a114720af9c98b163077f59`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:42.904679 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6c43e359-d11f-4677-b391-b2356098a5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:42.951387 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1228/2439] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:39:42 2022] POST /identity/v3/projects => generated 377 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:39:42.952495 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e3d29-c1e9-4a9d-aac6-799e1d721eda admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:43.065940 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1212/2440] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:42 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:43.116411 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e3d29-c1e9-4a9d-aac6-799e1d721eda admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:43.136976 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb13ceb-6292-41c8-a6e1-75c55c6686e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:43.142994 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb13ceb-6292-41c8-a6e1-75c55c6686e1 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:43.143540 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb13ceb-6292-41c8-a6e1-75c55c6686e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:43.143998 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb13ceb-6292-41c8-a6e1-75c55c6686e1 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:43.145319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb13ceb-6292-41c8-a6e1-75c55c6686e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:43.147765 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb13ceb-6292-41c8-a6e1-75c55c6686e1 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:43.179050 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1229/2441] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:39:42 2022] POST /identity/v3/users => generated 289 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:39:43.182999 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43e359-d11f-4677-b391-b2356098a5ac None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:43.213034 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43e359-d11f-4677-b391-b2356098a5ac None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:43.230965 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174c197-a872-49a2-9900-20a0ff7d67ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:43.231908 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174c197-a872-49a2-9900-20a0ff7d67ee admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:43.232479 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174c197-a872-49a2-9900-20a0ff7d67ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:43.232899 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174c197-a872-49a2-9900-20a0ff7d67ee admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:43.233712 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f174c197-a872-49a2-9900-20a0ff7d67ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:43.235880 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f174c197-a872-49a2-9900-20a0ff7d67ee admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:43.251583 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1213/2442] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:43.255713 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb13ceb-6292-41c8-a6e1-75c55c6686e1 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:43.270165 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb13ceb-6292-41c8-a6e1-75c55c6686e1 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:43.283586 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808fd8e-2532-484c-bbfa-3de92d26d6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:43.284562 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808fd8e-2532-484c-bbfa-3de92d26d6fb admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:43.284999 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808fd8e-2532-484c-bbfa-3de92d26d6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:43.285434 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808fd8e-2532-484c-bbfa-3de92d26d6fb admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:43.287651 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b808fd8e-2532-484c-bbfa-3de92d26d6fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:43.289603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b808fd8e-2532-484c-bbfa-3de92d26d6fb admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:43.304259 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1230/2443] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:43.308810 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174c197-a872-49a2-9900-20a0ff7d67ee admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:43.332756 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174c197-a872-49a2-9900-20a0ff7d67ee admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:43.343480 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322acfb-63b7-4cf3-906a-bb08c728946b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:43.344179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322acfb-63b7-4cf3-906a-bb08c728946b admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:43.344518 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322acfb-63b7-4cf3-906a-bb08c728946b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:43.344726 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322acfb-63b7-4cf3-906a-bb08c728946b admin admin] PATH_INFO: `/v3/projects/6eef6b55c1114685b8921e0222db9e5e/users/48cf49dc78d4433eb7f63d768403e023/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:43.368738 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8322acfb-63b7-4cf3-906a-bb08c728946b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eef6b55c1114685b8921e0222db9e5e, user_id=48cf49dc78d4433eb7f63d768403e023, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:43.373008 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8322acfb-63b7-4cf3-906a-bb08c728946b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:43.391459 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1214/2444] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:39:43 2022] PUT /identity/v3/projects/6eef6b55c1114685b8921e0222db9e5e/users/48cf49dc78d4433eb7f63d768403e023/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:43.402391 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b6cbd-9623-441f-87d1-edddbcc3ed02 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:43.403014 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b6cbd-9623-441f-87d1-edddbcc3ed02 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:43.403525 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b6cbd-9623-441f-87d1-edddbcc3ed02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:43.444658 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-bb0b6cbd-9623-441f-87d1-edddbcc3ed02 None None] MFA Rules not processed for user `48cf49dc78d4433eb7f63d768403e023`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:43.446320 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-bb0b6cbd-9623-441f-87d1-edddbcc3ed02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:43.545325 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1231/2445] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:43.551198 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322acfb-63b7-4cf3-906a-bb08c728946b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:43.699334 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322acfb-63b7-4cf3-906a-bb08c728946b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:43.708854 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6069d2-4870-4ac6-ba1d-89c9f29f510f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:43.710009 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6069d2-4870-4ac6-ba1d-89c9f29f510f admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:43.710502 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6069d2-4870-4ac6-ba1d-89c9f29f510f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:43.711363 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6069d2-4870-4ac6-ba1d-89c9f29f510f admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:43.713210 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6069d2-4870-4ac6-ba1d-89c9f29f510f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:43.717454 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6069d2-4870-4ac6-ba1d-89c9f29f510f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:43.788263 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1215/2446] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:39:43 2022] POST /identity/v3/projects => generated 379 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:39:43.792392 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b6cbd-9623-441f-87d1-edddbcc3ed02 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:43.812838 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b6cbd-9623-441f-87d1-edddbcc3ed02 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:43.907804 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:43.949019 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd6d38a-0d48-4a22-ab27-e704a8bed82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:43.949858 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6d38a-0d48-4a22-ab27-e704a8bed82d admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:43.950288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6d38a-0d48-4a22-ab27-e704a8bed82d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:43.950806 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6d38a-0d48-4a22-ab27-e704a8bed82d admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:43.951642 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd6d38a-0d48-4a22-ab27-e704a8bed82d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:43.953909 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd6d38a-0d48-4a22-ab27-e704a8bed82d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:44.000203 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1232/2447] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:39:43 2022] POST /identity/v3/users => generated 296 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:39:44.007592 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6069d2-4870-4ac6-ba1d-89c9f29f510f admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:44.042749 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6069d2-4870-4ac6-ba1d-89c9f29f510f admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:44.050987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f0f26-6a02-494a-9c24-45db7d91bccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:44.052310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f0f26-6a02-494a-9c24-45db7d91bccb admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:44.052605 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f0f26-6a02-494a-9c24-45db7d91bccb admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:44.052868 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f0f26-6a02-494a-9c24-45db7d91bccb admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:44.053733 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f0f26-6a02-494a-9c24-45db7d91bccb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:44.055775 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f0f26-6a02-494a-9c24-45db7d91bccb admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:44.094713 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1216/2448] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:44.098820 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd6d38a-0d48-4a22-ab27-e704a8bed82d admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:44.114888 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd6d38a-0d48-4a22-ab27-e704a8bed82d admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:44.134222 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e7672-0bde-4a22-ab8c-70ca955f0433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:44.135125 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e7672-0bde-4a22-ab8c-70ca955f0433 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:44.135502 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e7672-0bde-4a22-ab8c-70ca955f0433 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:44.135863 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e7672-0bde-4a22-ab8c-70ca955f0433 admin admin] PATH_INFO: `/v3/projects/6fe206d7441349be8da98b44bffe0e9a/users/31891c679c3d4113b7515305389b6097/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:44.157125 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e7672-0bde-4a22-ab8c-70ca955f0433 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fe206d7441349be8da98b44bffe0e9a, user_id=31891c679c3d4113b7515305389b6097, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:44.162596 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e7672-0bde-4a22-ab8c-70ca955f0433 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:44.186620 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1233/2449] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:39:44 2022] PUT /identity/v3/projects/6fe206d7441349be8da98b44bffe0e9a/users/31891c679c3d4113b7515305389b6097/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:44.190304 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f0f26-6a02-494a-9c24-45db7d91bccb admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:44.198560 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:44.203178 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f0f26-6a02-494a-9c24-45db7d91bccb admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:44.291332 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab330792-a674-4e6a-bff4-24932c5774a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:44.292461 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab330792-a674-4e6a-bff4-24932c5774a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:44.292944 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab330792-a674-4e6a-bff4-24932c5774a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:44.293462 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab330792-a674-4e6a-bff4-24932c5774a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:44.301302 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab330792-a674-4e6a-bff4-24932c5774a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:44.303706 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab330792-a674-4e6a-bff4-24932c5774a9 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:44.315492 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1217/2450] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:44.320600 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e7672-0bde-4a22-ab8c-70ca955f0433 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:44.334628 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e7672-0bde-4a22-ab8c-70ca955f0433 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:44.340543 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac079f6c-6ad5-498a-946c-e48b1cc94ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:44.341975 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac079f6c-6ad5-498a-946c-e48b1cc94ba7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:44.342368 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac079f6c-6ad5-498a-946c-e48b1cc94ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:44.342713 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac079f6c-6ad5-498a-946c-e48b1cc94ba7 admin admin] PATH_INFO: `/v3/projects/6fe206d7441349be8da98b44bffe0e9a/users/31891c679c3d4113b7515305389b6097/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:44.346032 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac079f6c-6ad5-498a-946c-e48b1cc94ba7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fe206d7441349be8da98b44bffe0e9a, user_id=31891c679c3d4113b7515305389b6097, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:44.349808 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac079f6c-6ad5-498a-946c-e48b1cc94ba7 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:44.380754 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1234/2451] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:39:44 2022] PUT /identity/v3/projects/6fe206d7441349be8da98b44bffe0e9a/users/31891c679c3d4113b7515305389b6097/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:39:44.389685 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba790b46-3229-4651-9eee-a3f1a84e55c4 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:44.390038 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba790b46-3229-4651-9eee-a3f1a84e55c4 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:44.391978 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba790b46-3229-4651-9eee-a3f1a84e55c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:44.484287 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-ba790b46-3229-4651-9eee-a3f1a84e55c4 None None] MFA Rules not processed for user `31891c679c3d4113b7515305389b6097`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:44.485712 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ba790b46-3229-4651-9eee-a3f1a84e55c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:44.630820 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1218/2452] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:44 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:39:45.408136 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac079f6c-6ad5-498a-946c-e48b1cc94ba7 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:45.410155 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ac079f6c-6ad5-498a-946c-e48b1cc94ba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:45.524726 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac079f6c-6ad5-498a-946c-e48b1cc94ba7 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:45.530811 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a93be8-e6ce-44ad-88e1-c5c2a569f5b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:45.532110 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a93be8-e6ce-44ad-88e1-c5c2a569f5b6 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:45.532395 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a93be8-e6ce-44ad-88e1-c5c2a569f5b6 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:45.532669 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a93be8-e6ce-44ad-88e1-c5c2a569f5b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:45.543016 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a93be8-e6ce-44ad-88e1-c5c2a569f5b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:45.545788 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a93be8-e6ce-44ad-88e1-c5c2a569f5b6 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:45.567519 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1235/2453] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:39:45 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:39:45.941581 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba790b46-3229-4651-9eee-a3f1a84e55c4 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:46.011932 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba790b46-3229-4651-9eee-a3f1a84e55c4 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:46.019647 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a97c0-5016-4bec-8c69-16f530fb1dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:46.020726 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a97c0-5016-4bec-8c69-16f530fb1dfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:46.021240 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a97c0-5016-4bec-8c69-16f530fb1dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:46.021662 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a97c0-5016-4bec-8c69-16f530fb1dfc admin admin] PATH_INFO: `/v3/users/48cf49dc78d4433eb7f63d768403e023` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:46.023401 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2a97c0-5016-4bec-8c69-16f530fb1dfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=48cf49dc78d4433eb7f63d768403e023)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:46.025786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2a97c0-5016-4bec-8c69-16f530fb1dfc admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:46.062251 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:46.090074 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6d2a97c0-5016-4bec-8c69-16f530fb1dfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48cf49dc78d4433eb7f63d768403e023'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:46.090744 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6d2a97c0-5016-4bec-8c69-16f530fb1dfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48cf49dc78d4433eb7f63d768403e023'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:46.102569 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6d2a97c0-5016-4bec-8c69-16f530fb1dfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48cf49dc78d4433eb7f63d768403e023'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:46.112177 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6d2a97c0-5016-4bec-8c69-16f530fb1dfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48cf49dc78d4433eb7f63d768403e023'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:46.112964 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6d2a97c0-5016-4bec-8c69-16f530fb1dfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48cf49dc78d4433eb7f63d768403e023'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:46.139832 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1219/2454] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:39:45 2022] DELETE /identity/v3/users/48cf49dc78d4433eb7f63d768403e023 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:46.148737 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a497ae3-ab0a-43fe-b9da-2e99b86646bc None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:46.149085 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a497ae3-ab0a-43fe-b9da-2e99b86646bc None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:46.149548 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a497ae3-ab0a-43fe-b9da-2e99b86646bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:46.169095 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-8a497ae3-ab0a-43fe-b9da-2e99b86646bc None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:46.170338 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8a497ae3-ab0a-43fe-b9da-2e99b86646bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:46.233829 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1236/2455] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:46.244032 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a97c0-5016-4bec-8c69-16f530fb1dfc admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:46.245548 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6d2a97c0-5016-4bec-8c69-16f530fb1dfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:46.305920 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a97c0-5016-4bec-8c69-16f530fb1dfc admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:46.310965 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f05436-864c-47ad-a7ea-1327ccf56970 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:46.311633 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f05436-864c-47ad-a7ea-1327ccf56970 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:46.311918 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f05436-864c-47ad-a7ea-1327ccf56970 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:46.312186 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f05436-864c-47ad-a7ea-1327ccf56970 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:46.322853 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f05436-864c-47ad-a7ea-1327ccf56970 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:46.324332 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f05436-864c-47ad-a7ea-1327ccf56970 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:46.336622 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1220/2456] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:39:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:39:46.669851 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a497ae3-ab0a-43fe-b9da-2e99b86646bc None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:46.671392 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8a497ae3-ab0a-43fe-b9da-2e99b86646bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:46.687845 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a497ae3-ab0a-43fe-b9da-2e99b86646bc None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:46.692819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247108e-a10c-4281-ba2f-d7df5e5bcfea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:46.693609 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247108e-a10c-4281-ba2f-d7df5e5bcfea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:46.694102 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247108e-a10c-4281-ba2f-d7df5e5bcfea admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:46.694448 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247108e-a10c-4281-ba2f-d7df5e5bcfea admin admin] PATH_INFO: `/v3/projects/6eef6b55c1114685b8921e0222db9e5e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:46.695843 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7247108e-a10c-4281-ba2f-d7df5e5bcfea admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eef6b55c1114685b8921e0222db9e5e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:46.703619 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7247108e-a10c-4281-ba2f-d7df5e5bcfea admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:46.712728 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:46.756045 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7247108e-a10c-4281-ba2f-d7df5e5bcfea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eef6b55c1114685b8921e0222db9e5e', 'request_id': 'req-7247108e-a10c-4281-ba2f-d7df5e5bcfea'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:46.761794 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7247108e-a10c-4281-ba2f-d7df5e5bcfea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eef6b55c1114685b8921e0222db9e5e', 'request_id': 'req-7247108e-a10c-4281-ba2f-d7df5e5bcfea'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:46.769452 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7247108e-a10c-4281-ba2f-d7df5e5bcfea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eef6b55c1114685b8921e0222db9e5e', 'request_id': 'req-7247108e-a10c-4281-ba2f-d7df5e5bcfea'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:46.781855 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7247108e-a10c-4281-ba2f-d7df5e5bcfea admin admin] The token cache is being invalidate because project 6eef6b55c1114685b8921e0222db9e5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:39:46.782138 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7247108e-a10c-4281-ba2f-d7df5e5bcfea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:46.782787 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7247108e-a10c-4281-ba2f-d7df5e5bcfea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:46.784552 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1237/2457] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:39:46 2022] DELETE /identity/v3/projects/6eef6b55c1114685b8921e0222db9e5e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:46.789537 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f05436-864c-47ad-a7ea-1327ccf56970 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:46.804011 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f05436-864c-47ad-a7ea-1327ccf56970 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:46.899230 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f1e0b-fddf-4e13-9dc4-9398cb195b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:46.907103 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f1e0b-fddf-4e13-9dc4-9398cb195b35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:46.907103 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f1e0b-fddf-4e13-9dc4-9398cb195b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:46.907103 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f1e0b-fddf-4e13-9dc4-9398cb195b35 admin admin] PATH_INFO: `/v3/users/31891c679c3d4113b7515305389b6097` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:46.907103 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f1e0b-fddf-4e13-9dc4-9398cb195b35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31891c679c3d4113b7515305389b6097)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:46.909890 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f1e0b-fddf-4e13-9dc4-9398cb195b35 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:46.987482 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2c2f1e0b-fddf-4e13-9dc4-9398cb195b35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31891c679c3d4113b7515305389b6097'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:46.988508 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2c2f1e0b-fddf-4e13-9dc4-9398cb195b35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31891c679c3d4113b7515305389b6097'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:46.990836 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:46.998059 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2c2f1e0b-fddf-4e13-9dc4-9398cb195b35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31891c679c3d4113b7515305389b6097'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:47.007628 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2c2f1e0b-fddf-4e13-9dc4-9398cb195b35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31891c679c3d4113b7515305389b6097'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:47.008537 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2c2f1e0b-fddf-4e13-9dc4-9398cb195b35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31891c679c3d4113b7515305389b6097'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:47.030838 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1221/2458] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:39:46 2022] DELETE /identity/v3/users/31891c679c3d4113b7515305389b6097 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:39:47.089572 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247108e-a10c-4281-ba2f-d7df5e5bcfea admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:47.091596 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7247108e-a10c-4281-ba2f-d7df5e5bcfea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:47.107063 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247108e-a10c-4281-ba2f-d7df5e5bcfea admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:47.178860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265393ca-5f67-40a3-bfd4-33dd412868d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:47.179558 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265393ca-5f67-40a3-bfd4-33dd412868d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:47.179838 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265393ca-5f67-40a3-bfd4-33dd412868d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:47.180112 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265393ca-5f67-40a3-bfd4-33dd412868d7 admin admin] PATH_INFO: `/v3/users/e63e67306f07404dab97802890c990a0` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:47.181412 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265393ca-5f67-40a3-bfd4-33dd412868d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e63e67306f07404dab97802890c990a0)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:47.183525 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265393ca-5f67-40a3-bfd4-33dd412868d7 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:47.256509 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-265393ca-5f67-40a3-bfd4-33dd412868d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e63e67306f07404dab97802890c990a0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:47.257394 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-265393ca-5f67-40a3-bfd4-33dd412868d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e63e67306f07404dab97802890c990a0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:47.273494 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-265393ca-5f67-40a3-bfd4-33dd412868d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e63e67306f07404dab97802890c990a0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:47.282480 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-265393ca-5f67-40a3-bfd4-33dd412868d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e63e67306f07404dab97802890c990a0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:47.294417 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-265393ca-5f67-40a3-bfd4-33dd412868d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e63e67306f07404dab97802890c990a0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:47.300948 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1238/2459] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:39:47 2022] DELETE /identity/v3/users/e63e67306f07404dab97802890c990a0 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:47.306821 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7975a49-07dc-4550-b22c-730e703c7ce6 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:47.307130 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7975a49-07dc-4550-b22c-730e703c7ce6 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:47.307742 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7975a49-07dc-4550-b22c-730e703c7ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:47.329457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-f7975a49-07dc-4550-b22c-730e703c7ce6 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:47.330691 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f7975a49-07dc-4550-b22c-730e703c7ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:47.359661 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265393ca-5f67-40a3-bfd4-33dd412868d7 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:47.361090 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-265393ca-5f67-40a3-bfd4-33dd412868d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:47.395017 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:47.400554 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1222/2460] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:47.416689 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7975a49-07dc-4550-b22c-730e703c7ce6 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:47.418287 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f7975a49-07dc-4550-b22c-730e703c7ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:47.457416 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265393ca-5f67-40a3-bfd4-33dd412868d7 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:47.463612 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d86c52-dbe4-4b19-b907-08acc9d3011b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:47.464240 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d86c52-dbe4-4b19-b907-08acc9d3011b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:47.464516 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d86c52-dbe4-4b19-b907-08acc9d3011b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:47.464789 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d86c52-dbe4-4b19-b907-08acc9d3011b admin admin] PATH_INFO: `/v3/projects/6fe206d7441349be8da98b44bffe0e9a` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:47.465901 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d86c52-dbe4-4b19-b907-08acc9d3011b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fe206d7441349be8da98b44bffe0e9a)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:47.467847 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d86c52-dbe4-4b19-b907-08acc9d3011b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:47.488349 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7975a49-07dc-4550-b22c-730e703c7ce6 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:47.493193 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8dd6f-d100-4ec9-9891-fc1e9125a95c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:47.494277 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8dd6f-d100-4ec9-9891-fc1e9125a95c service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:47.494552 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8dd6f-d100-4ec9-9891-fc1e9125a95c service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:47.494819 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8dd6f-d100-4ec9-9891-fc1e9125a95c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:47.505873 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad8dd6f-d100-4ec9-9891-fc1e9125a95c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:47.507772 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad8dd6f-d100-4ec9-9891-fc1e9125a95c service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:47.518949 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1223/2461] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:39:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:39:47.523335 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-38d86c52-dbe4-4b19-b907-08acc9d3011b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fe206d7441349be8da98b44bffe0e9a', 'request_id': 'req-38d86c52-dbe4-4b19-b907-08acc9d3011b'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:47.529482 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-38d86c52-dbe4-4b19-b907-08acc9d3011b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fe206d7441349be8da98b44bffe0e9a', 'request_id': 'req-38d86c52-dbe4-4b19-b907-08acc9d3011b'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:47.540180 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-38d86c52-dbe4-4b19-b907-08acc9d3011b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fe206d7441349be8da98b44bffe0e9a', 'request_id': 'req-38d86c52-dbe4-4b19-b907-08acc9d3011b'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:47.554831 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-38d86c52-dbe4-4b19-b907-08acc9d3011b admin admin] The token cache is being invalidate because project 6fe206d7441349be8da98b44bffe0e9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:39:47.555269 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-38d86c52-dbe4-4b19-b907-08acc9d3011b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:47.556023 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-38d86c52-dbe4-4b19-b907-08acc9d3011b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:47.558588 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1239/2462] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:39:47 2022] DELETE /identity/v3/projects/6fe206d7441349be8da98b44bffe0e9a => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:39:47.563225 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf13b95-df1d-4778-8a32-560c4fa7b1b8 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:47.563725 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf13b95-df1d-4778-8a32-560c4fa7b1b8 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:47.564146 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf13b95-df1d-4778-8a32-560c4fa7b1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:47.588622 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-fdf13b95-df1d-4778-8a32-560c4fa7b1b8 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:47.590108 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-fdf13b95-df1d-4778-8a32-560c4fa7b1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:47.679980 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e824eb-b59f-49f2-8fe3-263ce78cf6a0 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:47.680574 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e824eb-b59f-49f2-8fe3-263ce78cf6a0 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:47.680739 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e824eb-b59f-49f2-8fe3-263ce78cf6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:47.686163 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1224/2463] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:47.702658 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-b0e824eb-b59f-49f2-8fe3-263ce78cf6a0 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:47.703929 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b0e824eb-b59f-49f2-8fe3-263ce78cf6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:47.717416 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf13b95-df1d-4778-8a32-560c4fa7b1b8 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:47.717932 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1240/2464] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:47.728173 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf13b95-df1d-4778-8a32-560c4fa7b1b8 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:47.735437 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4828888-36a2-41ee-b13d-4177208ac2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:47.735437 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4828888-36a2-41ee-b13d-4177208ac2a4 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:47.735437 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4828888-36a2-41ee-b13d-4177208ac2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:47.735826 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4828888-36a2-41ee-b13d-4177208ac2a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:47.736545 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4828888-36a2-41ee-b13d-4177208ac2a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:39:47.736931 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4828888-36a2-41ee-b13d-4177208ac2a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:47.738697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4828888-36a2-41ee-b13d-4177208ac2a4 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:47.749779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:47.767540 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1225/2465] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:39:47.768893 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e824eb-b59f-49f2-8fe3-263ce78cf6a0 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:47.781183 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e824eb-b59f-49f2-8fe3-263ce78cf6a0 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:47.799658 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508cec73-84a3-4c93-b036-147b03d2ff11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:47.800294 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508cec73-84a3-4c93-b036-147b03d2ff11 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:47.800626 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508cec73-84a3-4c93-b036-147b03d2ff11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:47.800846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508cec73-84a3-4c93-b036-147b03d2ff11 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:47.801685 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508cec73-84a3-4c93-b036-147b03d2ff11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:47.804113 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508cec73-84a3-4c93-b036-147b03d2ff11 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:47.842947 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4828888-36a2-41ee-b13d-4177208ac2a4 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:47.845834 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b4828888-36a2-41ee-b13d-4177208ac2a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:47.846138 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1241/2466] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:39:47 2022] POST /identity/v3/projects => generated 377 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:39:47.848568 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508cec73-84a3-4c93-b036-147b03d2ff11 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:47.887429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4828888-36a2-41ee-b13d-4177208ac2a4 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:47.946330 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508cec73-84a3-4c93-b036-147b03d2ff11 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:47.952807 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d7345d-d57f-4468-90c7-ca90850883d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:47.953437 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7345d-d57f-4468-90c7-ca90850883d4 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:47.953719 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7345d-d57f-4468-90c7-ca90850883d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:47.953993 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7345d-d57f-4468-90c7-ca90850883d4 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:47.955750 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d7345d-d57f-4468-90c7-ca90850883d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:47.957673 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d7345d-d57f-4468-90c7-ca90850883d4 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:47.987863 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ec396-fa10-4748-be98-ef62ff727e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:47.988667 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ec396-fa10-4748-be98-ef62ff727e46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:47.989066 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ec396-fa10-4748-be98-ef62ff727e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:47.989488 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ec396-fa10-4748-be98-ef62ff727e46 admin admin] PATH_INFO: `/v3/projects/13ccf42f8444482a9e97a08cf7668fd7` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:47.996375 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773ec396-fa10-4748-be98-ef62ff727e46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13ccf42f8444482a9e97a08cf7668fd7)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:47.998793 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773ec396-fa10-4748-be98-ef62ff727e46 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:48.001629 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1242/2467] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:39:47 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:39:48.006612 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d7345d-d57f-4468-90c7-ca90850883d4 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:48.019921 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d7345d-d57f-4468-90c7-ca90850883d4 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:48.026280 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cd542-fa3e-412e-9daa-03c5453f5e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:48.026903 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cd542-fa3e-412e-9daa-03c5453f5e29 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:48.027226 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cd542-fa3e-412e-9daa-03c5453f5e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:48.027501 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cd542-fa3e-412e-9daa-03c5453f5e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:48.028160 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cd542-fa3e-412e-9daa-03c5453f5e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:48.029775 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cd542-fa3e-412e-9daa-03c5453f5e29 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:48.031571 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:48.048719 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1243/2468] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:39:48.049738 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cd542-fa3e-412e-9daa-03c5453f5e29 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:48.062784 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cd542-fa3e-412e-9daa-03c5453f5e29 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:48.069489 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c9dbc-487c-46ff-b121-91ab385a124a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:48.070119 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c9dbc-487c-46ff-b121-91ab385a124a admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:48.070443 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c9dbc-487c-46ff-b121-91ab385a124a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:48.070670 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c9dbc-487c-46ff-b121-91ab385a124a admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:48.071372 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c9dbc-487c-46ff-b121-91ab385a124a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:48.084656 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c9dbc-487c-46ff-b121-91ab385a124a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:48.088202 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1244/2469] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:48.089821 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c9dbc-487c-46ff-b121-91ab385a124a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:48.093742 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-773ec396-fa10-4748-be98-ef62ff727e46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13ccf42f8444482a9e97a08cf7668fd7', 'request_id': 'req-773ec396-fa10-4748-be98-ef62ff727e46'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:48.101168 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-773ec396-fa10-4748-be98-ef62ff727e46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13ccf42f8444482a9e97a08cf7668fd7', 'request_id': 'req-773ec396-fa10-4748-be98-ef62ff727e46'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:48.107162 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c9dbc-487c-46ff-b121-91ab385a124a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:48.108616 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-773ec396-fa10-4748-be98-ef62ff727e46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13ccf42f8444482a9e97a08cf7668fd7', 'request_id': 'req-773ec396-fa10-4748-be98-ef62ff727e46'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:48.127510 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-773ec396-fa10-4748-be98-ef62ff727e46 admin admin] The token cache is being invalidate because project 13ccf42f8444482a9e97a08cf7668fd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:39:48.127931 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-773ec396-fa10-4748-be98-ef62ff727e46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:48.128725 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-773ec396-fa10-4748-be98-ef62ff727e46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:48.131105 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1226/2470] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:39:47 2022] DELETE /identity/v3/projects/13ccf42f8444482a9e97a08cf7668fd7 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:39:48.135861 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ec396-fa10-4748-be98-ef62ff727e46 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:48.137523 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-773ec396-fa10-4748-be98-ef62ff727e46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:48.182765 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b68ec4-66cb-4761-81d6-c498e6523956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:48.183272 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b68ec4-66cb-4761-81d6-c498e6523956 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:48.184035 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b68ec4-66cb-4761-81d6-c498e6523956 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:48.184035 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b68ec4-66cb-4761-81d6-c498e6523956 admin admin] PATH_INFO: `/v3/projects/90d10fdad3184fc4b6813a8575069bc9/users/1fa00248ff214f93bcc67dd0d1a04c61/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:48.203277 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b68ec4-66cb-4761-81d6-c498e6523956 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90d10fdad3184fc4b6813a8575069bc9, user_id=1fa00248ff214f93bcc67dd0d1a04c61, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:48.206053 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b68ec4-66cb-4761-81d6-c498e6523956 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:48.215247 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ec396-fa10-4748-be98-ef62ff727e46 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:48.222263 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1245/2471] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:39:48 2022] PUT /identity/v3/projects/90d10fdad3184fc4b6813a8575069bc9/users/1fa00248ff214f93bcc67dd0d1a04c61/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:39:48.234867 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6eca3-d0a9-47c6-b093-1f4aa1240806 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:48.235291 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6eca3-d0a9-47c6-b093-1f4aa1240806 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:48.235685 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6eca3-d0a9-47c6-b093-1f4aa1240806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:48.254873 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:48.273809 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-67b6eca3-d0a9-47c6-b093-1f4aa1240806 None None] MFA Rules not processed for user `1fa00248ff214f93bcc67dd0d1a04c61`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:48.275454 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-67b6eca3-d0a9-47c6-b093-1f4aa1240806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:48.285544 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d3554-ade8-4279-a814-b68b25276460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:48.286877 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d3554-ade8-4279-a814-b68b25276460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:48.287187 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d3554-ade8-4279-a814-b68b25276460 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:48.287463 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d3554-ade8-4279-a814-b68b25276460 admin admin] PATH_INFO: `/v3/users/8c7fdb13ee3b48a0ad869e275ddc5d69` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:48.288729 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2d3554-ade8-4279-a814-b68b25276460 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c7fdb13ee3b48a0ad869e275ddc5d69)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:48.290745 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2d3554-ade8-4279-a814-b68b25276460 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:48.340004 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-cd2d3554-ade8-4279-a814-b68b25276460 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c7fdb13ee3b48a0ad869e275ddc5d69'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:48.341010 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-cd2d3554-ade8-4279-a814-b68b25276460 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c7fdb13ee3b48a0ad869e275ddc5d69'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:48.344798 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1246/2472] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:39:48.348467 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-cd2d3554-ade8-4279-a814-b68b25276460 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c7fdb13ee3b48a0ad869e275ddc5d69'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:48.351050 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b6eca3-d0a9-47c6-b093-1f4aa1240806 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:48.352545 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-67b6eca3-d0a9-47c6-b093-1f4aa1240806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:48.369773 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-cd2d3554-ade8-4279-a814-b68b25276460 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c7fdb13ee3b48a0ad869e275ddc5d69'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:48.370557 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-cd2d3554-ade8-4279-a814-b68b25276460 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c7fdb13ee3b48a0ad869e275ddc5d69'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:48.374294 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b6eca3-d0a9-47c6-b093-1f4aa1240806 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:48.383326 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617c961-ee01-4829-9132-932b8856005d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:48.384436 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617c961-ee01-4829-9132-932b8856005d admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:48.385173 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617c961-ee01-4829-9132-932b8856005d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:48.385533 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617c961-ee01-4829-9132-932b8856005d admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:48.386773 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4617c961-ee01-4829-9132-932b8856005d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:48.389138 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4617c961-ee01-4829-9132-932b8856005d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:48.393414 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1227/2473] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:39:48 2022] DELETE /identity/v3/users/8c7fdb13ee3b48a0ad869e275ddc5d69 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:48.426329 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1247/2474] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:39:48 2022] POST /identity/v3/projects => generated 375 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:39:48.430778 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d3554-ade8-4279-a814-b68b25276460 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:48.432329 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-cd2d3554-ade8-4279-a814-b68b25276460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:48.502687 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d3554-ade8-4279-a814-b68b25276460 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:48.565435 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf31a7c-d20c-4357-861b-dc28c7bc67ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:48.566039 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf31a7c-d20c-4357-861b-dc28c7bc67ba admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:48.566256 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf31a7c-d20c-4357-861b-dc28c7bc67ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:48.566518 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf31a7c-d20c-4357-861b-dc28c7bc67ba admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:48.567241 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf31a7c-d20c-4357-861b-dc28c7bc67ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:48.569326 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf31a7c-d20c-4357-861b-dc28c7bc67ba admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:48.577626 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:48.604457 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1228/2475] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:39:48 2022] POST /identity/v3/users => generated 294 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:39:48.606550 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617c961-ee01-4829-9132-932b8856005d admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:48.617835 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617c961-ee01-4829-9132-932b8856005d admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:48.622636 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afefc1c4-0c72-490a-be2e-ab971a448643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:48.623268 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afefc1c4-0c72-490a-be2e-ab971a448643 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:48.623546 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afefc1c4-0c72-490a-be2e-ab971a448643 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:48.623830 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afefc1c4-0c72-490a-be2e-ab971a448643 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:48.624544 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afefc1c4-0c72-490a-be2e-ab971a448643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:48.626194 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afefc1c4-0c72-490a-be2e-ab971a448643 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:48.636677 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1248/2476] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:48.640871 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf31a7c-d20c-4357-861b-dc28c7bc67ba admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:48.653115 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf31a7c-d20c-4357-861b-dc28c7bc67ba admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:48.658294 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a2394b-1411-43ef-a21c-d71cfce653b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:48.659054 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2394b-1411-43ef-a21c-d71cfce653b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:48.659417 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2394b-1411-43ef-a21c-d71cfce653b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:48.659755 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2394b-1411-43ef-a21c-d71cfce653b0 admin admin] PATH_INFO: `/v3/projects/e660481fe203413cbf8e0de889c1d287/users/52ea6a0f66d84517a3438086698094fc/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:48.679604 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a2394b-1411-43ef-a21c-d71cfce653b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e660481fe203413cbf8e0de889c1d287, user_id=52ea6a0f66d84517a3438086698094fc, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:48.682163 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a2394b-1411-43ef-a21c-d71cfce653b0 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:48.697615 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1229/2477] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:39:48 2022] PUT /identity/v3/projects/e660481fe203413cbf8e0de889c1d287/users/52ea6a0f66d84517a3438086698094fc/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:48.704244 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afefc1c4-0c72-490a-be2e-ab971a448643 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:48.715319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afefc1c4-0c72-490a-be2e-ab971a448643 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:48.735510 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:48.778928 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9cf3b-86d6-4ade-87af-bc1b6fe9c8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:48.779850 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9cf3b-86d6-4ade-87af-bc1b6fe9c8c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:48.780126 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9cf3b-86d6-4ade-87af-bc1b6fe9c8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:48.780397 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9cf3b-86d6-4ade-87af-bc1b6fe9c8c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:48.781049 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b9cf3b-86d6-4ade-87af-bc1b6fe9c8c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:48.782663 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b9cf3b-86d6-4ade-87af-bc1b6fe9c8c8 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:48.793828 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a2394b-1411-43ef-a21c-d71cfce653b0 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:48.795816 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-17a2394b-1411-43ef-a21c-d71cfce653b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:48.796590 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1249/2478] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:48.800755 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9cf3b-86d6-4ade-87af-bc1b6fe9c8c8 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:48.812354 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9cf3b-86d6-4ade-87af-bc1b6fe9c8c8 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:48.823085 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a2394b-1411-43ef-a21c-d71cfce653b0 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:48.823219 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571718ec-0f11-435a-a2b4-fe9a8281fdc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:48.824214 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571718ec-0f11-435a-a2b4-fe9a8281fdc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:48.825038 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571718ec-0f11-435a-a2b4-fe9a8281fdc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:48.826437 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571718ec-0f11-435a-a2b4-fe9a8281fdc8 admin admin] PATH_INFO: `/v3/projects/e660481fe203413cbf8e0de889c1d287/users/52ea6a0f66d84517a3438086698094fc/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:48.829352 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571718ec-0f11-435a-a2b4-fe9a8281fdc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e660481fe203413cbf8e0de889c1d287, user_id=52ea6a0f66d84517a3438086698094fc, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:48.829632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13761ee-6925-432e-a717-307e8874b0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:48.830590 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13761ee-6925-432e-a717-307e8874b0d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:48.831101 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13761ee-6925-432e-a717-307e8874b0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:48.831592 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13761ee-6925-432e-a717-307e8874b0d1 admin admin] PATH_INFO: `/v3/projects/7a1284a5cd1145cbb5f79aeef145d0ac` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:48.832996 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13761ee-6925-432e-a717-307e8874b0d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a1284a5cd1145cbb5f79aeef145d0ac)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:48.835700 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571718ec-0f11-435a-a2b4-fe9a8281fdc8 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:48.836405 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13761ee-6925-432e-a717-307e8874b0d1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:48.855603 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1250/2479] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:39:48 2022] PUT /identity/v3/projects/e660481fe203413cbf8e0de889c1d287/users/52ea6a0f66d84517a3438086698094fc/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:39:48.866191 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed87b70-778b-48a8-b187-857c65bdf93e None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:48.868559 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed87b70-778b-48a8-b187-857c65bdf93e None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:48.869015 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed87b70-778b-48a8-b187-857c65bdf93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:48.903234 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-fed87b70-778b-48a8-b187-857c65bdf93e None None] MFA Rules not processed for user `52ea6a0f66d84517a3438086698094fc`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:48.904514 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-fed87b70-778b-48a8-b187-857c65bdf93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:48.928409 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c13761ee-6925-432e-a717-307e8874b0d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a1284a5cd1145cbb5f79aeef145d0ac', 'request_id': 'req-c13761ee-6925-432e-a717-307e8874b0d1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:48.938582 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c13761ee-6925-432e-a717-307e8874b0d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a1284a5cd1145cbb5f79aeef145d0ac', 'request_id': 'req-c13761ee-6925-432e-a717-307e8874b0d1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:48.950405 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c13761ee-6925-432e-a717-307e8874b0d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a1284a5cd1145cbb5f79aeef145d0ac', 'request_id': 'req-c13761ee-6925-432e-a717-307e8874b0d1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:48.977257 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c13761ee-6925-432e-a717-307e8874b0d1 admin admin] The token cache is being invalidate because project 7a1284a5cd1145cbb5f79aeef145d0ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:39:48.977575 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c13761ee-6925-432e-a717-307e8874b0d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:48.978306 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c13761ee-6925-432e-a717-307e8874b0d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:48.979817 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1230/2480] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:39:48 2022] DELETE /identity/v3/projects/7a1284a5cd1145cbb5f79aeef145d0ac => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:39:48.984481 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957239ca-9a9d-464a-8172-d54efa1b5d5e None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:48.984765 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957239ca-9a9d-464a-8172-d54efa1b5d5e None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:48.985039 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957239ca-9a9d-464a-8172-d54efa1b5d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:49.013431 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1251/2481] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:48 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:49.025435 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-957239ca-9a9d-464a-8172-d54efa1b5d5e None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:49.026711 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-957239ca-9a9d-464a-8172-d54efa1b5d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:49.030876 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5592cc-53be-4887-8b96-60061fe62329 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:49.031379 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5592cc-53be-4887-8b96-60061fe62329 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:49.031751 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5592cc-53be-4887-8b96-60061fe62329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:49.069342 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-4c5592cc-53be-4887-8b96-60061fe62329 None None] MFA Rules not processed for user `1fa00248ff214f93bcc67dd0d1a04c61`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:49.070730 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4c5592cc-53be-4887-8b96-60061fe62329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:49.151961 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1231/2482] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:49.158219 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1252/2483] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:49.163673 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a8c03-e436-4e7b-a3d8-51ef5de03b72 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:49.163673 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a8c03-e436-4e7b-a3d8-51ef5de03b72 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:49.163673 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a8c03-e436-4e7b-a3d8-51ef5de03b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:49.184910 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-f37a8c03-e436-4e7b-a3d8-51ef5de03b72 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:49.186261 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f37a8c03-e436-4e7b-a3d8-51ef5de03b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:49.195778 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1232/2484] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:49.200161 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5592cc-53be-4887-8b96-60061fe62329 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:49.212260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5592cc-53be-4887-8b96-60061fe62329 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:49.216560 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a8c03-e436-4e7b-a3d8-51ef5de03b72 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:49.217548 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21cc953-05a2-48e9-afd1-9c18fd8bcc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:49.217945 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f37a8c03-e436-4e7b-a3d8-51ef5de03b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:49.218060 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21cc953-05a2-48e9-afd1-9c18fd8bcc3d admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:49.231045 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21cc953-05a2-48e9-afd1-9c18fd8bcc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:49.231045 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21cc953-05a2-48e9-afd1-9c18fd8bcc3d admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:49.231045 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21cc953-05a2-48e9-afd1-9c18fd8bcc3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:39:49.231045 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21cc953-05a2-48e9-afd1-9c18fd8bcc3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:49.231045 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21cc953-05a2-48e9-afd1-9c18fd8bcc3d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:49.236117 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1253/2485] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:39:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:39:49.241353 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21cc953-05a2-48e9-afd1-9c18fd8bcc3d admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:49.251634 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21cc953-05a2-48e9-afd1-9c18fd8bcc3d admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:49.257653 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd79325d-7a9f-4e91-a2f3-ee889466d771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:49.258454 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79325d-7a9f-4e91-a2f3-ee889466d771 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:49.258798 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79325d-7a9f-4e91-a2f3-ee889466d771 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:49.258993 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79325d-7a9f-4e91-a2f3-ee889466d771 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:49.259673 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd79325d-7a9f-4e91-a2f3-ee889466d771 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:49.261573 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd79325d-7a9f-4e91-a2f3-ee889466d771 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:49.277016 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:49.293391 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1254/2486] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:39:49 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:39:49.297280 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd79325d-7a9f-4e91-a2f3-ee889466d771 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:49.301578 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:49.322239 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a8c03-e436-4e7b-a3d8-51ef5de03b72 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:49.368607 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd79325d-7a9f-4e91-a2f3-ee889466d771 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:49.374468 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b6234-a0a2-4e20-9477-dbdf70b7d536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:49.375504 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b6234-a0a2-4e20-9477-dbdf70b7d536 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:49.375797 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b6234-a0a2-4e20-9477-dbdf70b7d536 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:49.376076 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b6234-a0a2-4e20-9477-dbdf70b7d536 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:49.377074 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149b6234-a0a2-4e20-9477-dbdf70b7d536 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:49.380424 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149b6234-a0a2-4e20-9477-dbdf70b7d536 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:49.405598 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb5f14-4c79-4d1c-8428-8b14c221de16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:49.406222 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb5f14-4c79-4d1c-8428-8b14c221de16 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:49.406512 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb5f14-4c79-4d1c-8428-8b14c221de16 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:49.406787 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb5f14-4c79-4d1c-8428-8b14c221de16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:49.410485 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1255/2487] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:39:49 2022] POST /identity/v3/users => generated 290 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:39:49.412243 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b6234-a0a2-4e20-9477-dbdf70b7d536 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:49.413208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6acb5f14-4c79-4d1c-8428-8b14c221de16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:49.424043 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b6234-a0a2-4e20-9477-dbdf70b7d536 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:49.430412 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a8f02-b148-4dd7-a78c-c039318f1a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:49.431226 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a8f02-b148-4dd7-a78c-c039318f1a60 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:49.431633 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a8f02-b148-4dd7-a78c-c039318f1a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:49.432002 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a8f02-b148-4dd7-a78c-c039318f1a60 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:49.432794 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459a8f02-b148-4dd7-a78c-c039318f1a60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:49.434562 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459a8f02-b148-4dd7-a78c-c039318f1a60 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:49.450020 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1256/2488] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:49.452974 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a8f02-b148-4dd7-a78c-c039318f1a60 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:49.463438 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a8f02-b148-4dd7-a78c-c039318f1a60 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:49.470794 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf72447-cdb6-41a7-8c55-83af05599e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:49.471676 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf72447-cdb6-41a7-8c55-83af05599e0f admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:49.471962 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf72447-cdb6-41a7-8c55-83af05599e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:49.472233 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf72447-cdb6-41a7-8c55-83af05599e0f admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:49.473009 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf72447-cdb6-41a7-8c55-83af05599e0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:49.474746 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf72447-cdb6-41a7-8c55-83af05599e0f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:49.487581 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1257/2489] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:39:49.492275 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf72447-cdb6-41a7-8c55-83af05599e0f admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:49.502253 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acb5f14-4c79-4d1c-8428-8b14c221de16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:49.504056 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acb5f14-4c79-4d1c-8428-8b14c221de16 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:49.504634 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf72447-cdb6-41a7-8c55-83af05599e0f admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:49.510311 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ac509-53f5-4064-9bc2-38c1a99de6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:49.511492 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ac509-53f5-4064-9bc2-38c1a99de6c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:49.511492 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ac509-53f5-4064-9bc2-38c1a99de6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:49.511836 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ac509-53f5-4064-9bc2-38c1a99de6c8 admin admin] PATH_INFO: `/v3/projects/8e4bb55738954024a58df82ddf006a67/users/b921cd0b8eb0469984348af6de61def2/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:49.523651 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1233/2490] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:39:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:39:49.532480 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0ac509-53f5-4064-9bc2-38c1a99de6c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e4bb55738954024a58df82ddf006a67, user_id=b921cd0b8eb0469984348af6de61def2, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:49.535418 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0ac509-53f5-4064-9bc2-38c1a99de6c8 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:49.564180 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1258/2491] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:39:49 2022] PUT /identity/v3/projects/8e4bb55738954024a58df82ddf006a67/users/b921cd0b8eb0469984348af6de61def2/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:39:49.565815 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a5dde-77fb-4699-b6d7-b586dd8f5b25 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:49.566123 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a5dde-77fb-4699-b6d7-b586dd8f5b25 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:49.566401 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a5dde-77fb-4699-b6d7-b586dd8f5b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:49.631928 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-756a5dde-77fb-4699-b6d7-b586dd8f5b25 None None] MFA Rules not processed for user `b921cd0b8eb0469984348af6de61def2`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:49.633408 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-756a5dde-77fb-4699-b6d7-b586dd8f5b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:49.735360 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1234/2492] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:39:49.745570 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ac509-53f5-4064-9bc2-38c1a99de6c8 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:49.883580 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ac509-53f5-4064-9bc2-38c1a99de6c8 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:49.889034 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c603e7-5f54-4e7c-bc9c-5aed11363798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:49.889657 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c603e7-5f54-4e7c-bc9c-5aed11363798 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:49.889935 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c603e7-5f54-4e7c-bc9c-5aed11363798 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:49.890228 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c603e7-5f54-4e7c-bc9c-5aed11363798 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:49.891040 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c603e7-5f54-4e7c-bc9c-5aed11363798 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:49.893796 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c603e7-5f54-4e7c-bc9c-5aed11363798 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:49.926072 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1259/2493] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:39:49 2022] POST /identity/v3/projects => generated 379 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:39:49.931000 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a5dde-77fb-4699-b6d7-b586dd8f5b25 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:49.943315 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a5dde-77fb-4699-b6d7-b586dd8f5b25 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:49.949498 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:50.012782 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a74aa-3973-4679-aa45-2c6737e1e0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:50.014509 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a74aa-3973-4679-aa45-2c6737e1e0cf admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:50.014509 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a74aa-3973-4679-aa45-2c6737e1e0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:50.014509 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a74aa-3973-4679-aa45-2c6737e1e0cf admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:50.014796 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a74aa-3973-4679-aa45-2c6737e1e0cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:50.016995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a74aa-3973-4679-aa45-2c6737e1e0cf admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:50.044746 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1235/2494] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:39:49 2022] POST /identity/v3/users => generated 296 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:39:50.046826 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c603e7-5f54-4e7c-bc9c-5aed11363798 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:50.058827 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c603e7-5f54-4e7c-bc9c-5aed11363798 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:50.071768 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436becb-7480-4600-bee6-284afc505948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:50.072474 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436becb-7480-4600-bee6-284afc505948 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:50.073652 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436becb-7480-4600-bee6-284afc505948 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:50.073941 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436becb-7480-4600-bee6-284afc505948 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:50.074742 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436becb-7480-4600-bee6-284afc505948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:50.079013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436becb-7480-4600-bee6-284afc505948 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:50.099478 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1260/2495] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:50.100717 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a74aa-3973-4679-aa45-2c6737e1e0cf admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:50.117935 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a74aa-3973-4679-aa45-2c6737e1e0cf admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:50.127144 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6574ed4c-6fc0-4d8f-ac2a-ce145936a414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:50.127861 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574ed4c-6fc0-4d8f-ac2a-ce145936a414 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:50.128298 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574ed4c-6fc0-4d8f-ac2a-ce145936a414 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:50.128768 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574ed4c-6fc0-4d8f-ac2a-ce145936a414 admin admin] PATH_INFO: `/v3/projects/682781ee54254bb99b802d657a4ebc78/users/b70a3363f8454260ac816e4b42ff55ff/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:50.152093 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6574ed4c-6fc0-4d8f-ac2a-ce145936a414 admin admin] RBAC: Authorizing `identity:create_grant(project_id=682781ee54254bb99b802d657a4ebc78, user_id=b70a3363f8454260ac816e4b42ff55ff, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:50.155170 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6574ed4c-6fc0-4d8f-ac2a-ce145936a414 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:50.199305 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1236/2496] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:39:50 2022] PUT /identity/v3/projects/682781ee54254bb99b802d657a4ebc78/users/b70a3363f8454260ac816e4b42ff55ff/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:50.203700 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436becb-7480-4600-bee6-284afc505948 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:50.231152 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436becb-7480-4600-bee6-284afc505948 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:50.273866 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:50.337924 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df118da3-b8e2-4d8a-ae18-937a71966f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:50.338679 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df118da3-b8e2-4d8a-ae18-937a71966f62 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:50.339018 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df118da3-b8e2-4d8a-ae18-937a71966f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:50.339584 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df118da3-b8e2-4d8a-ae18-937a71966f62 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:50.347587 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df118da3-b8e2-4d8a-ae18-937a71966f62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:50.354129 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df118da3-b8e2-4d8a-ae18-937a71966f62 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:50.373668 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1261/2497] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:50.374706 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6574ed4c-6fc0-4d8f-ac2a-ce145936a414 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:50.387451 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6574ed4c-6fc0-4d8f-ac2a-ce145936a414 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:50.409204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241bdcd0-c679-4f40-84f2-2d46f573b1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:50.410044 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bdcd0-c679-4f40-84f2-2d46f573b1d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:50.410327 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bdcd0-c679-4f40-84f2-2d46f573b1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:50.411412 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bdcd0-c679-4f40-84f2-2d46f573b1d2 admin admin] PATH_INFO: `/v3/projects/682781ee54254bb99b802d657a4ebc78/users/b70a3363f8454260ac816e4b42ff55ff/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:50.413954 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241bdcd0-c679-4f40-84f2-2d46f573b1d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=682781ee54254bb99b802d657a4ebc78, user_id=b70a3363f8454260ac816e4b42ff55ff, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:50.417284 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241bdcd0-c679-4f40-84f2-2d46f573b1d2 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:50.429868 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1237/2498] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:39:50 2022] PUT /identity/v3/projects/682781ee54254bb99b802d657a4ebc78/users/b70a3363f8454260ac816e4b42ff55ff/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:39:50.440622 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785b3fe-a385-4946-9cd4-0849c196ac7d None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:50.441035 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785b3fe-a385-4946-9cd4-0849c196ac7d None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:50.441348 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785b3fe-a385-4946-9cd4-0849c196ac7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:50.527857 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-b785b3fe-a385-4946-9cd4-0849c196ac7d None None] MFA Rules not processed for user `b70a3363f8454260ac816e4b42ff55ff`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:50.529061 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b785b3fe-a385-4946-9cd4-0849c196ac7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:50.710743 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1262/2499] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:50 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:50.886104 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241bdcd0-c679-4f40-84f2-2d46f573b1d2 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:50.993381 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241bdcd0-c679-4f40-84f2-2d46f573b1d2 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:50.999802 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb8e60-2fed-40eb-a160-62e0c96ccc85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:51.000762 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb8e60-2fed-40eb-a160-62e0c96ccc85 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:51.001147 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb8e60-2fed-40eb-a160-62e0c96ccc85 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:51.001524 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb8e60-2fed-40eb-a160-62e0c96ccc85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:51.012821 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bb8e60-2fed-40eb-a160-62e0c96ccc85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:51.014600 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bb8e60-2fed-40eb-a160-62e0c96ccc85 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:51.027693 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1238/2500] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:39:50 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:39:51.178862 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0acb8-1432-49fe-b1ee-db4f4b63427a None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:51.179811 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0acb8-1432-49fe-b1ee-db4f4b63427a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:51.180261 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0acb8-1432-49fe-b1ee-db4f4b63427a None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:51.182054 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1263/2501] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 15:39:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:39:51.188876 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb8e60-2fed-40eb-a160-62e0c96ccc85 service nova] Authenticating service token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:39:51.190710 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-65bb8e60-2fed-40eb-a160-62e0c96ccc85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:51.221285 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb8e60-2fed-40eb-a160-62e0c96ccc85 service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:51.241920 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb8e60-2fed-40eb-a160-62e0c96ccc85 service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:51.258234 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c2b15-1ca1-4d8b-9365-0a3e411c2447 tempest-FlavorsAccessTestJSON-1967575676 tempest-FlavorsAccessTestJSON-1967575676-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b70a3363f8454260ac816e4b42ff55ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682781ee54254bb99b802d657a4ebc78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:51.259223 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c2b15-1ca1-4d8b-9365-0a3e411c2447 tempest-FlavorsAccessTestJSON-1967575676 tempest-FlavorsAccessTestJSON-1967575676-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:51.259661 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c2b15-1ca1-4d8b-9365-0a3e411c2447 tempest-FlavorsAccessTestJSON-1967575676 tempest-FlavorsAccessTestJSON-1967575676-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:51.260034 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c2b15-1ca1-4d8b-9365-0a3e411c2447 tempest-FlavorsAccessTestJSON-1967575676 tempest-FlavorsAccessTestJSON-1967575676-project-admin] PATH_INFO: `/v3/projects/8e4bb55738954024a58df82ddf006a67` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:51.263073 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c2b15-1ca1-4d8b-9365-0a3e411c2447 tempest-FlavorsAccessTestJSON-1967575676 tempest-FlavorsAccessTestJSON-1967575676-project-admin] RBAC: Authorizing `identity:get_project(project_id=8e4bb55738954024a58df82ddf006a67)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:51.266537 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c2b15-1ca1-4d8b-9365-0a3e411c2447 tempest-FlavorsAccessTestJSON-1967575676 tempest-FlavorsAccessTestJSON-1967575676-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:51.268435 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1239/2502] 10.222.0.83 () {58 vars in 1443 bytes} [Mon Aug 29 15:39:51 2022] GET /identity/v3/projects/8e4bb55738954024a58df82ddf006a67 => generated 379 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:39:51.313913 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0acb8-1432-49fe-b1ee-db4f4b63427a None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:51.338701 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0acb8-1432-49fe-b1ee-db4f4b63427a None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:51.347824 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d6fdc0-95be-400a-92c3-80602b0a03e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:51.348999 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6fdc0-95be-400a-92c3-80602b0a03e7 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:51.348999 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6fdc0-95be-400a-92c3-80602b0a03e7 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:51.348999 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6fdc0-95be-400a-92c3-80602b0a03e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:51.512188 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d6fdc0-95be-400a-92c3-80602b0a03e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:51.514458 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d6fdc0-95be-400a-92c3-80602b0a03e7 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:51.527554 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1264/2503] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:39:51 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:39:51.675642 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3e8ec-a4f2-4424-8914-cdb2dbc00a43 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:51.675953 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3e8ec-a4f2-4424-8914-cdb2dbc00a43 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:51.676185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3e8ec-a4f2-4424-8914-cdb2dbc00a43 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:51.677849 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1240/2504] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 15:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:39:51.684435 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d6fdc0-95be-400a-92c3-80602b0a03e7 service nova] Authenticating service token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:39:51.696715 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d6fdc0-95be-400a-92c3-80602b0a03e7 service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:51.708802 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d6fdc0-95be-400a-92c3-80602b0a03e7 service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:51.714004 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3817ac2-f2c6-4eac-9299-6203d9cac98b tempest-FlavorsAccessTestJSON-1967575676 tempest-FlavorsAccessTestJSON-1967575676-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b70a3363f8454260ac816e4b42ff55ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682781ee54254bb99b802d657a4ebc78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:51.714739 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3817ac2-f2c6-4eac-9299-6203d9cac98b tempest-FlavorsAccessTestJSON-1967575676 tempest-FlavorsAccessTestJSON-1967575676-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:51.715213 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3817ac2-f2c6-4eac-9299-6203d9cac98b tempest-FlavorsAccessTestJSON-1967575676 tempest-FlavorsAccessTestJSON-1967575676-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:51.715494 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3817ac2-f2c6-4eac-9299-6203d9cac98b tempest-FlavorsAccessTestJSON-1967575676 tempest-FlavorsAccessTestJSON-1967575676-project-admin] PATH_INFO: `/v3/projects/8e4bb55738954024a58df82ddf006a67` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:51.716643 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3817ac2-f2c6-4eac-9299-6203d9cac98b tempest-FlavorsAccessTestJSON-1967575676 tempest-FlavorsAccessTestJSON-1967575676-project-admin] RBAC: Authorizing `identity:get_project(project_id=8e4bb55738954024a58df82ddf006a67)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:51.718776 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3817ac2-f2c6-4eac-9299-6203d9cac98b tempest-FlavorsAccessTestJSON-1967575676 tempest-FlavorsAccessTestJSON-1967575676-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:51.720690 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1265/2505] 10.222.0.83 () {58 vars in 1443 bytes} [Mon Aug 29 15:39:51 2022] GET /identity/v3/projects/8e4bb55738954024a58df82ddf006a67 => generated 379 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:39:52.172341 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3e8ec-a4f2-4424-8914-cdb2dbc00a43 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:52.221335 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:52.252657 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3e8ec-a4f2-4424-8914-cdb2dbc00a43 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:52.257996 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26720e9b-161b-46b6-8ef4-cb57f5c6ab9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:52.258709 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26720e9b-161b-46b6-8ef4-cb57f5c6ab9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:52.259081 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26720e9b-161b-46b6-8ef4-cb57f5c6ab9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:52.259363 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26720e9b-161b-46b6-8ef4-cb57f5c6ab9d admin admin] PATH_INFO: `/v3/users/b921cd0b8eb0469984348af6de61def2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:52.260538 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26720e9b-161b-46b6-8ef4-cb57f5c6ab9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b921cd0b8eb0469984348af6de61def2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:52.262535 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26720e9b-161b-46b6-8ef4-cb57f5c6ab9d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:52.313947 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-26720e9b-161b-46b6-8ef4-cb57f5c6ab9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b921cd0b8eb0469984348af6de61def2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:52.314688 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-26720e9b-161b-46b6-8ef4-cb57f5c6ab9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b921cd0b8eb0469984348af6de61def2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:52.324148 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-26720e9b-161b-46b6-8ef4-cb57f5c6ab9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b921cd0b8eb0469984348af6de61def2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:52.331691 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-26720e9b-161b-46b6-8ef4-cb57f5c6ab9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b921cd0b8eb0469984348af6de61def2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:52.332367 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-26720e9b-161b-46b6-8ef4-cb57f5c6ab9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b921cd0b8eb0469984348af6de61def2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:52.350404 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1241/2506] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:39:52 2022] DELETE /identity/v3/users/b921cd0b8eb0469984348af6de61def2 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:52.354992 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50175c48-7434-44dc-a02f-ba39462a15e6 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:52.355472 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50175c48-7434-44dc-a02f-ba39462a15e6 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:52.355591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50175c48-7434-44dc-a02f-ba39462a15e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:52.374955 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-50175c48-7434-44dc-a02f-ba39462a15e6 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:52.376278 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-50175c48-7434-44dc-a02f-ba39462a15e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:52.402666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:52.435613 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1266/2507] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:52.446025 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26720e9b-161b-46b6-8ef4-cb57f5c6ab9d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:52.447461 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-26720e9b-161b-46b6-8ef4-cb57f5c6ab9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:52.504490 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26720e9b-161b-46b6-8ef4-cb57f5c6ab9d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:52.508810 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555d8e1-e89f-4d06-976e-4a1588e3fd4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:52.509411 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555d8e1-e89f-4d06-976e-4a1588e3fd4c service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:52.509692 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555d8e1-e89f-4d06-976e-4a1588e3fd4c service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:52.509960 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555d8e1-e89f-4d06-976e-4a1588e3fd4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:52.519103 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6555d8e1-e89f-4d06-976e-4a1588e3fd4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:52.520669 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6555d8e1-e89f-4d06-976e-4a1588e3fd4c service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:52.530566 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1242/2508] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:39:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:39:52.818413 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50175c48-7434-44dc-a02f-ba39462a15e6 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:52.819975 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-50175c48-7434-44dc-a02f-ba39462a15e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:52.844146 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50175c48-7434-44dc-a02f-ba39462a15e6 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:52.855531 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0531d6e-5f6e-467a-9595-570aab948251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:52.856713 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0531d6e-5f6e-467a-9595-570aab948251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:52.857490 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0531d6e-5f6e-467a-9595-570aab948251 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:52.857941 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0531d6e-5f6e-467a-9595-570aab948251 admin admin] PATH_INFO: `/v3/projects/8e4bb55738954024a58df82ddf006a67` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:52.859311 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0531d6e-5f6e-467a-9595-570aab948251 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e4bb55738954024a58df82ddf006a67)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:52.861303 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0531d6e-5f6e-467a-9595-570aab948251 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:52.939208 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b0531d6e-5f6e-467a-9595-570aab948251 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e4bb55738954024a58df82ddf006a67', 'request_id': 'req-b0531d6e-5f6e-467a-9595-570aab948251'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:52.947285 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b0531d6e-5f6e-467a-9595-570aab948251 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e4bb55738954024a58df82ddf006a67', 'request_id': 'req-b0531d6e-5f6e-467a-9595-570aab948251'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:52.955961 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b0531d6e-5f6e-467a-9595-570aab948251 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e4bb55738954024a58df82ddf006a67', 'request_id': 'req-b0531d6e-5f6e-467a-9595-570aab948251'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:52.970543 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b0531d6e-5f6e-467a-9595-570aab948251 admin admin] The token cache is being invalidate because project 8e4bb55738954024a58df82ddf006a67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:39:52.970838 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b0531d6e-5f6e-467a-9595-570aab948251 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:52.971580 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b0531d6e-5f6e-467a-9595-570aab948251 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:52.976648 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1267/2509] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:39:52 2022] DELETE /identity/v3/projects/8e4bb55738954024a58df82ddf006a67 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:52.980572 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555d8e1-e89f-4d06-976e-4a1588e3fd4c service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:53.000467 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555d8e1-e89f-4d06-976e-4a1588e3fd4c service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:53.093413 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:53.102297 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de837d0b-562b-4f87-9214-f3526dacded7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:53.103093 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de837d0b-562b-4f87-9214-f3526dacded7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:53.103701 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de837d0b-562b-4f87-9214-f3526dacded7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:53.104362 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de837d0b-562b-4f87-9214-f3526dacded7 admin admin] PATH_INFO: `/v3/users/b70a3363f8454260ac816e4b42ff55ff` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:53.106109 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de837d0b-562b-4f87-9214-f3526dacded7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b70a3363f8454260ac816e4b42ff55ff)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:53.108586 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de837d0b-562b-4f87-9214-f3526dacded7 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:53.174674 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-de837d0b-562b-4f87-9214-f3526dacded7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b70a3363f8454260ac816e4b42ff55ff'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:53.175363 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-de837d0b-562b-4f87-9214-f3526dacded7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b70a3363f8454260ac816e4b42ff55ff'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:53.186627 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-de837d0b-562b-4f87-9214-f3526dacded7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b70a3363f8454260ac816e4b42ff55ff'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:53.194893 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-de837d0b-562b-4f87-9214-f3526dacded7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b70a3363f8454260ac816e4b42ff55ff'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:53.195558 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-de837d0b-562b-4f87-9214-f3526dacded7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b70a3363f8454260ac816e4b42ff55ff'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:53.215073 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1243/2510] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:39:52 2022] DELETE /identity/v3/users/b70a3363f8454260ac816e4b42ff55ff => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:53.515195 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0531d6e-5f6e-467a-9595-570aab948251 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:53.517611 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b0531d6e-5f6e-467a-9595-570aab948251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:53.538755 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0531d6e-5f6e-467a-9595-570aab948251 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:53.602621 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e3703-91fa-4853-9d2a-77ba86b62f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:53.603343 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e3703-91fa-4853-9d2a-77ba86b62f82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:53.603622 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e3703-91fa-4853-9d2a-77ba86b62f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:53.603896 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e3703-91fa-4853-9d2a-77ba86b62f82 admin admin] PATH_INFO: `/v3/projects/682781ee54254bb99b802d657a4ebc78` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:53.605087 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e3703-91fa-4853-9d2a-77ba86b62f82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=682781ee54254bb99b802d657a4ebc78)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:53.607103 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e3703-91fa-4853-9d2a-77ba86b62f82 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:53.660038 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c24e3703-91fa-4853-9d2a-77ba86b62f82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '682781ee54254bb99b802d657a4ebc78', 'request_id': 'req-c24e3703-91fa-4853-9d2a-77ba86b62f82'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:53.664827 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:53.666677 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c24e3703-91fa-4853-9d2a-77ba86b62f82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '682781ee54254bb99b802d657a4ebc78', 'request_id': 'req-c24e3703-91fa-4853-9d2a-77ba86b62f82'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:53.678099 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c24e3703-91fa-4853-9d2a-77ba86b62f82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '682781ee54254bb99b802d657a4ebc78', 'request_id': 'req-c24e3703-91fa-4853-9d2a-77ba86b62f82'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:53.690863 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c24e3703-91fa-4853-9d2a-77ba86b62f82 admin admin] The token cache is being invalidate because project 682781ee54254bb99b802d657a4ebc78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:39:53.691199 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c24e3703-91fa-4853-9d2a-77ba86b62f82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:53.691873 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c24e3703-91fa-4853-9d2a-77ba86b62f82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:53.693991 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1268/2511] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:39:53 2022] DELETE /identity/v3/projects/682781ee54254bb99b802d657a4ebc78 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:53.700305 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690daab-b4d0-49c2-9e48-e887b51329cf None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:53.700790 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690daab-b4d0-49c2-9e48-e887b51329cf None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:53.700790 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690daab-b4d0-49c2-9e48-e887b51329cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:53.721151 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-1690daab-b4d0-49c2-9e48-e887b51329cf None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:53.722690 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1690daab-b4d0-49c2-9e48-e887b51329cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:53.796633 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1244/2512] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:53.805398 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0917cff-7118-42cb-8713-dcbd5ba32278 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:53.805783 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0917cff-7118-42cb-8713-dcbd5ba32278 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:53.806123 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0917cff-7118-42cb-8713-dcbd5ba32278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:53.826944 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-c0917cff-7118-42cb-8713-dcbd5ba32278 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:53.828218 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c0917cff-7118-42cb-8713-dcbd5ba32278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:53.837177 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1269/2513] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:53.841568 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1690daab-b4d0-49c2-9e48-e887b51329cf None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:53.852421 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1690daab-b4d0-49c2-9e48-e887b51329cf None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:53.857637 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d80c7-885c-4a14-be07-c3e58bdefd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:53.858246 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d80c7-885c-4a14-be07-c3e58bdefd11 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:53.858525 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d80c7-885c-4a14-be07-c3e58bdefd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:53.858793 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d80c7-885c-4a14-be07-c3e58bdefd11 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:53.859475 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d80c7-885c-4a14-be07-c3e58bdefd11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:39:53.859775 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d80c7-885c-4a14-be07-c3e58bdefd11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:53.861464 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d80c7-885c-4a14-be07-c3e58bdefd11 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:53.877907 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1245/2514] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:39:53.879198 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0917cff-7118-42cb-8713-dcbd5ba32278 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:53.888354 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0917cff-7118-42cb-8713-dcbd5ba32278 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:53.893217 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c85717-9003-41cd-9f5b-26bde39110ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:53.893814 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c85717-9003-41cd-9f5b-26bde39110ac admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:53.894088 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c85717-9003-41cd-9f5b-26bde39110ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:53.894354 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c85717-9003-41cd-9f5b-26bde39110ac admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:53.894985 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c85717-9003-41cd-9f5b-26bde39110ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:53.897431 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c85717-9003-41cd-9f5b-26bde39110ac admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:53.926415 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1270/2515] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:39:53 2022] POST /identity/v3/projects => generated 393 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:39:53.931116 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d80c7-885c-4a14-be07-c3e58bdefd11 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:53.941318 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d80c7-885c-4a14-be07-c3e58bdefd11 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:54.000777 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c03293-0112-4d3e-b523-f370dbd3ef8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:54.001384 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c03293-0112-4d3e-b523-f370dbd3ef8d admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:54.001658 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c03293-0112-4d3e-b523-f370dbd3ef8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:54.001929 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c03293-0112-4d3e-b523-f370dbd3ef8d admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:54.002560 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c03293-0112-4d3e-b523-f370dbd3ef8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:54.004529 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c03293-0112-4d3e-b523-f370dbd3ef8d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:54.015578 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:54.033168 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1246/2516] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:39:53 2022] POST /identity/v3/users => generated 297 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:39:54.036841 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c85717-9003-41cd-9f5b-26bde39110ac admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:54.047212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c85717-9003-41cd-9f5b-26bde39110ac admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:54.052131 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97595a-5002-4ca5-ba39-27647cdf7ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:54.052788 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97595a-5002-4ca5-ba39-27647cdf7ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:54.053067 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97595a-5002-4ca5-ba39-27647cdf7ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:54.053344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97595a-5002-4ca5-ba39-27647cdf7ee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:54.054026 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f97595a-5002-4ca5-ba39-27647cdf7ee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:54.055681 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f97595a-5002-4ca5-ba39-27647cdf7ee3 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:54.066556 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1271/2517] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:54.071091 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c03293-0112-4d3e-b523-f370dbd3ef8d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:54.081420 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c03293-0112-4d3e-b523-f370dbd3ef8d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:54.087577 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df396b9-df95-4c65-bd39-4e8eb59ae3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:54.087706 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df396b9-df95-4c65-bd39-4e8eb59ae3a8 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:54.087919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df396b9-df95-4c65-bd39-4e8eb59ae3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:54.088214 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df396b9-df95-4c65-bd39-4e8eb59ae3a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:54.088833 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df396b9-df95-4c65-bd39-4e8eb59ae3a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:54.090449 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df396b9-df95-4c65-bd39-4e8eb59ae3a8 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:54.102564 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1247/2518] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:54.106923 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97595a-5002-4ca5-ba39-27647cdf7ee3 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:54.117730 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97595a-5002-4ca5-ba39-27647cdf7ee3 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:54.122453 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8351a517-0b60-4065-93d9-e533b2d7c047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:54.123142 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351a517-0b60-4065-93d9-e533b2d7c047 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:54.123424 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351a517-0b60-4065-93d9-e533b2d7c047 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:54.123698 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351a517-0b60-4065-93d9-e533b2d7c047 admin admin] PATH_INFO: `/v3/projects/ad4f35968d844f6fb4c73c36604b6f1e/users/6a9cf2e50f06417c9c31cf573419bb1b/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:54.138668 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8351a517-0b60-4065-93d9-e533b2d7c047 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad4f35968d844f6fb4c73c36604b6f1e, user_id=6a9cf2e50f06417c9c31cf573419bb1b, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:54.141600 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8351a517-0b60-4065-93d9-e533b2d7c047 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:54.157099 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1272/2519] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:39:54 2022] PUT /identity/v3/projects/ad4f35968d844f6fb4c73c36604b6f1e/users/6a9cf2e50f06417c9c31cf573419bb1b/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:54.168620 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8da26c-c546-4a47-aa53-27ede57d0d47 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:54.168903 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8da26c-c546-4a47-aa53-27ede57d0d47 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:54.169941 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8da26c-c546-4a47-aa53-27ede57d0d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:54.201425 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-ac8da26c-c546-4a47-aa53-27ede57d0d47 None None] MFA Rules not processed for user `6a9cf2e50f06417c9c31cf573419bb1b`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:54.202726 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ac8da26c-c546-4a47-aa53-27ede57d0d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:54.277507 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1248/2520] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:54 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:54.282006 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8351a517-0b60-4065-93d9-e533b2d7c047 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:54.360556 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8351a517-0b60-4065-93d9-e533b2d7c047 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:54.365868 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2c74f-a5af-441d-a0c0-4d1c6e7d9949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:54.366472 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2c74f-a5af-441d-a0c0-4d1c6e7d9949 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:54.366744 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2c74f-a5af-441d-a0c0-4d1c6e7d9949 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:54.367553 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2c74f-a5af-441d-a0c0-4d1c6e7d9949 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:54.367676 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc2c74f-a5af-441d-a0c0-4d1c6e7d9949 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:54.369857 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc2c74f-a5af-441d-a0c0-4d1c6e7d9949 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:54.403201 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1273/2521] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:39:54 2022] POST /identity/v3/projects => generated 391 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:39:54.405218 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8da26c-c546-4a47-aa53-27ede57d0d47 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:54.417338 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8da26c-c546-4a47-aa53-27ede57d0d47 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:54.511489 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a32de-ebf3-4145-bbcb-e50a922ef70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:54.512386 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a32de-ebf3-4145-bbcb-e50a922ef70b admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:54.512729 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a32de-ebf3-4145-bbcb-e50a922ef70b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:54.513585 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a32de-ebf3-4145-bbcb-e50a922ef70b admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:54.514425 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a32de-ebf3-4145-bbcb-e50a922ef70b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:54.517075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a32de-ebf3-4145-bbcb-e50a922ef70b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:54.549657 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1249/2522] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:39:54 2022] POST /identity/v3/users => generated 302 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:39:54.549766 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2c74f-a5af-441d-a0c0-4d1c6e7d9949 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:54.558598 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2c74f-a5af-441d-a0c0-4d1c6e7d9949 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:54.563561 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72b425-f6a3-4168-a148-a9bda2cf4605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:54.564167 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72b425-f6a3-4168-a148-a9bda2cf4605 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:54.564439 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72b425-f6a3-4168-a148-a9bda2cf4605 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:54.564703 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72b425-f6a3-4168-a148-a9bda2cf4605 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:54.565365 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce72b425-f6a3-4168-a148-a9bda2cf4605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:54.566990 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce72b425-f6a3-4168-a148-a9bda2cf4605 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:54.578911 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1274/2523] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:54.583827 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a32de-ebf3-4145-bbcb-e50a922ef70b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:54.594210 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a32de-ebf3-4145-bbcb-e50a922ef70b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:54.599665 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5242be-409c-40f7-8057-9201d6276bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:54.600463 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5242be-409c-40f7-8057-9201d6276bcc admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:54.600743 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5242be-409c-40f7-8057-9201d6276bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:54.601016 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5242be-409c-40f7-8057-9201d6276bcc admin admin] PATH_INFO: `/v3/projects/0173dc225726469ea54d23d52143b2c5/users/eece46ed1fc7453995d54fa0bc0ca4d9/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:54.616650 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5242be-409c-40f7-8057-9201d6276bcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0173dc225726469ea54d23d52143b2c5, user_id=eece46ed1fc7453995d54fa0bc0ca4d9, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:54.619419 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5242be-409c-40f7-8057-9201d6276bcc admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:54.634500 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1250/2524] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:39:54 2022] PUT /identity/v3/projects/0173dc225726469ea54d23d52143b2c5/users/eece46ed1fc7453995d54fa0bc0ca4d9/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:39:54.638526 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72b425-f6a3-4168-a148-a9bda2cf4605 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:54.649911 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72b425-f6a3-4168-a148-a9bda2cf4605 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:54.703001 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:54.711437 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e79bbd-cd02-4bf6-ae73-6dfec4aefa26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:54.712282 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e79bbd-cd02-4bf6-ae73-6dfec4aefa26 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:54.712553 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e79bbd-cd02-4bf6-ae73-6dfec4aefa26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:54.713094 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e79bbd-cd02-4bf6-ae73-6dfec4aefa26 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:54.713801 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e79bbd-cd02-4bf6-ae73-6dfec4aefa26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:54.716245 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e79bbd-cd02-4bf6-ae73-6dfec4aefa26 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:54.730619 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1275/2525] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:54.734874 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5242be-409c-40f7-8057-9201d6276bcc admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:54.746640 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5242be-409c-40f7-8057-9201d6276bcc admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:54.751428 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a396ef3-e39a-496e-a4fc-a079db345cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:54.752130 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a396ef3-e39a-496e-a4fc-a079db345cbb admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:54.752539 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a396ef3-e39a-496e-a4fc-a079db345cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:54.752708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a396ef3-e39a-496e-a4fc-a079db345cbb admin admin] PATH_INFO: `/v3/projects/0173dc225726469ea54d23d52143b2c5/users/eece46ed1fc7453995d54fa0bc0ca4d9/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:54.754598 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a396ef3-e39a-496e-a4fc-a079db345cbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0173dc225726469ea54d23d52143b2c5, user_id=eece46ed1fc7453995d54fa0bc0ca4d9, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:54.757950 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a396ef3-e39a-496e-a4fc-a079db345cbb admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:54.768860 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1251/2526] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:39:54 2022] PUT /identity/v3/projects/0173dc225726469ea54d23d52143b2c5/users/eece46ed1fc7453995d54fa0bc0ca4d9/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:39:54.780722 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffdc066-2559-4002-9f29-8786430cf7eb None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:54.781030 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffdc066-2559-4002-9f29-8786430cf7eb None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:54.781309 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffdc066-2559-4002-9f29-8786430cf7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:54.809948 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-6ffdc066-2559-4002-9f29-8786430cf7eb None None] MFA Rules not processed for user `eece46ed1fc7453995d54fa0bc0ca4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:54.811221 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6ffdc066-2559-4002-9f29-8786430cf7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:54.959957 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1276/2527] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:54 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:54.973835 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a396ef3-e39a-496e-a4fc-a079db345cbb admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:55.000524 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:55.038507 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a396ef3-e39a-496e-a4fc-a079db345cbb admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:55.043236 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b99169-06d6-439e-bbeb-8320c11fd4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:55.043953 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b99169-06d6-439e-bbeb-8320c11fd4df admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:55.044678 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b99169-06d6-439e-bbeb-8320c11fd4df admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:55.044678 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b99169-06d6-439e-bbeb-8320c11fd4df admin admin] PATH_INFO: `/v3/users/6a9cf2e50f06417c9c31cf573419bb1b` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:55.045969 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b99169-06d6-439e-bbeb-8320c11fd4df admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a9cf2e50f06417c9c31cf573419bb1b)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:55.048032 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b99169-06d6-439e-bbeb-8320c11fd4df admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:55.098843 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-98b99169-06d6-439e-bbeb-8320c11fd4df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a9cf2e50f06417c9c31cf573419bb1b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:55.099538 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-98b99169-06d6-439e-bbeb-8320c11fd4df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a9cf2e50f06417c9c31cf573419bb1b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:55.108308 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-98b99169-06d6-439e-bbeb-8320c11fd4df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a9cf2e50f06417c9c31cf573419bb1b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:55.116617 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-98b99169-06d6-439e-bbeb-8320c11fd4df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a9cf2e50f06417c9c31cf573419bb1b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:55.117296 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-98b99169-06d6-439e-bbeb-8320c11fd4df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a9cf2e50f06417c9c31cf573419bb1b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:55.152440 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1252/2528] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:39:54 2022] DELETE /identity/v3/users/6a9cf2e50f06417c9c31cf573419bb1b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:55.159419 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5205d80-7a5a-49c1-b38c-340288ac0b77 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:55.159834 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5205d80-7a5a-49c1-b38c-340288ac0b77 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:55.160268 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5205d80-7a5a-49c1-b38c-340288ac0b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:55.185695 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-f5205d80-7a5a-49c1-b38c-340288ac0b77 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:55.186910 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f5205d80-7a5a-49c1-b38c-340288ac0b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:55.264246 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1277/2529] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:55.274699 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b99169-06d6-439e-bbeb-8320c11fd4df admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:55.276229 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-98b99169-06d6-439e-bbeb-8320c11fd4df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:55.345655 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b99169-06d6-439e-bbeb-8320c11fd4df admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:55.350780 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd4b04-0ac2-47d1-ab4d-a8485d945a70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:55.351747 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd4b04-0ac2-47d1-ab4d-a8485d945a70 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:55.351966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd4b04-0ac2-47d1-ab4d-a8485d945a70 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:55.352297 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd4b04-0ac2-47d1-ab4d-a8485d945a70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:55.363609 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd4b04-0ac2-47d1-ab4d-a8485d945a70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:55.365835 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd4b04-0ac2-47d1-ab4d-a8485d945a70 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:55.376178 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1253/2530] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:39:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:39:55.729881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5205d80-7a5a-49c1-b38c-340288ac0b77 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:55.731965 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f5205d80-7a5a-49c1-b38c-340288ac0b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:55.747248 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5205d80-7a5a-49c1-b38c-340288ac0b77 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:55.754696 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f12a45-883e-4f9f-b34f-4bf8b2205678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:55.756062 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f12a45-883e-4f9f-b34f-4bf8b2205678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:55.756510 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f12a45-883e-4f9f-b34f-4bf8b2205678 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:55.757028 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f12a45-883e-4f9f-b34f-4bf8b2205678 admin admin] PATH_INFO: `/v3/projects/ad4f35968d844f6fb4c73c36604b6f1e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:55.758453 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f12a45-883e-4f9f-b34f-4bf8b2205678 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad4f35968d844f6fb4c73c36604b6f1e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:55.767835 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f12a45-883e-4f9f-b34f-4bf8b2205678 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:55.803661 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd4b04-0ac2-47d1-ab4d-a8485d945a70 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:55.806586 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-43dd4b04-0ac2-47d1-ab4d-a8485d945a70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:55.836482 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d7f12a45-883e-4f9f-b34f-4bf8b2205678 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad4f35968d844f6fb4c73c36604b6f1e', 'request_id': 'req-d7f12a45-883e-4f9f-b34f-4bf8b2205678'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:55.844468 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d7f12a45-883e-4f9f-b34f-4bf8b2205678 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad4f35968d844f6fb4c73c36604b6f1e', 'request_id': 'req-d7f12a45-883e-4f9f-b34f-4bf8b2205678'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:55.856696 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d7f12a45-883e-4f9f-b34f-4bf8b2205678 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad4f35968d844f6fb4c73c36604b6f1e', 'request_id': 'req-d7f12a45-883e-4f9f-b34f-4bf8b2205678'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:55.869469 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:55.876425 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d7f12a45-883e-4f9f-b34f-4bf8b2205678 admin admin] The token cache is being invalidate because project ad4f35968d844f6fb4c73c36604b6f1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:39:55.876758 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d7f12a45-883e-4f9f-b34f-4bf8b2205678 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:55.877527 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d7f12a45-883e-4f9f-b34f-4bf8b2205678 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:55.882349 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1278/2531] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:39:55 2022] DELETE /identity/v3/projects/ad4f35968d844f6fb4c73c36604b6f1e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:55.884538 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f12a45-883e-4f9f-b34f-4bf8b2205678 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:55.885731 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:55.888187 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d7f12a45-883e-4f9f-b34f-4bf8b2205678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:55.935264 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd4b04-0ac2-47d1-ab4d-a8485d945a70 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:55.993153 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f12a45-883e-4f9f-b34f-4bf8b2205678 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:55.998488 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d61a1cc-4db9-4fbb-89de-5ec595c12b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:55.999412 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61a1cc-4db9-4fbb-89de-5ec595c12b4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:55.999761 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61a1cc-4db9-4fbb-89de-5ec595c12b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:56.000638 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61a1cc-4db9-4fbb-89de-5ec595c12b4b admin admin] PATH_INFO: `/v3/users/eece46ed1fc7453995d54fa0bc0ca4d9` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:56.002265 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d61a1cc-4db9-4fbb-89de-5ec595c12b4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=eece46ed1fc7453995d54fa0bc0ca4d9)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:56.004522 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d61a1cc-4db9-4fbb-89de-5ec595c12b4b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:56.032952 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c931bb7-a479-4e16-9830-4d51350d6845 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:56.033477 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c931bb7-a479-4e16-9830-4d51350d6845 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:56.033763 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c931bb7-a479-4e16-9830-4d51350d6845 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:56.034033 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c931bb7-a479-4e16-9830-4d51350d6845 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:56.037870 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3c931bb7-a479-4e16-9830-4d51350d6845 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:56.063543 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5d61a1cc-4db9-4fbb-89de-5ec595c12b4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eece46ed1fc7453995d54fa0bc0ca4d9'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:56.064272 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5d61a1cc-4db9-4fbb-89de-5ec595c12b4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eece46ed1fc7453995d54fa0bc0ca4d9'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:56.077662 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5d61a1cc-4db9-4fbb-89de-5ec595c12b4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eece46ed1fc7453995d54fa0bc0ca4d9'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:56.087076 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5d61a1cc-4db9-4fbb-89de-5ec595c12b4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eece46ed1fc7453995d54fa0bc0ca4d9'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:56.094564 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5d61a1cc-4db9-4fbb-89de-5ec595c12b4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eece46ed1fc7453995d54fa0bc0ca4d9'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:56.101840 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1279/2532] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:39:55 2022] DELETE /identity/v3/users/eece46ed1fc7453995d54fa0bc0ca4d9 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:56.106644 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c931bb7-a479-4e16-9830-4d51350d6845 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:56.108971 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c931bb7-a479-4e16-9830-4d51350d6845 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:56.121085 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1254/2533] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:39:55 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:39:56.504266 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d61a1cc-4db9-4fbb-89de-5ec595c12b4b admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:56.507726 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5d61a1cc-4db9-4fbb-89de-5ec595c12b4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:56.607528 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d61a1cc-4db9-4fbb-89de-5ec595c12b4b admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:56.613361 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbcba97-a34b-401b-824b-d9bb1e09a495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:56.614075 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbcba97-a34b-401b-824b-d9bb1e09a495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:56.615151 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbcba97-a34b-401b-824b-d9bb1e09a495 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:56.615519 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbcba97-a34b-401b-824b-d9bb1e09a495 admin admin] PATH_INFO: `/v3/projects/0173dc225726469ea54d23d52143b2c5` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:56.618067 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbcba97-a34b-401b-824b-d9bb1e09a495 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0173dc225726469ea54d23d52143b2c5)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:56.620666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbcba97-a34b-401b-824b-d9bb1e09a495 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:56.649009 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:56.702834 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ddbcba97-a34b-401b-824b-d9bb1e09a495 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0173dc225726469ea54d23d52143b2c5', 'request_id': 'req-ddbcba97-a34b-401b-824b-d9bb1e09a495'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:56.716880 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ddbcba97-a34b-401b-824b-d9bb1e09a495 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0173dc225726469ea54d23d52143b2c5', 'request_id': 'req-ddbcba97-a34b-401b-824b-d9bb1e09a495'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:56.727679 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ddbcba97-a34b-401b-824b-d9bb1e09a495 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0173dc225726469ea54d23d52143b2c5', 'request_id': 'req-ddbcba97-a34b-401b-824b-d9bb1e09a495'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:56.742740 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ddbcba97-a34b-401b-824b-d9bb1e09a495 admin admin] The token cache is being invalidate because project 0173dc225726469ea54d23d52143b2c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:39:56.743435 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ddbcba97-a34b-401b-824b-d9bb1e09a495 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:56.743764 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ddbcba97-a34b-401b-824b-d9bb1e09a495 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:56.746425 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1280/2534] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:39:56 2022] DELETE /identity/v3/projects/0173dc225726469ea54d23d52143b2c5 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:56.751632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8720ef-d52f-47ae-99b3-f66fc3474e2d None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:56.752185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8720ef-d52f-47ae-99b3-f66fc3474e2d None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:56.752778 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8720ef-d52f-47ae-99b3-f66fc3474e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:56.790408 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-ff8720ef-d52f-47ae-99b3-f66fc3474e2d None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:56.791679 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ff8720ef-d52f-47ae-99b3-f66fc3474e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:56.869803 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1255/2535] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:56.877452 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca994cf-a5dc-4e87-8953-e02ae28b4511 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:56.877751 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca994cf-a5dc-4e87-8953-e02ae28b4511 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:56.878032 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca994cf-a5dc-4e87-8953-e02ae28b4511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:56.903292 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-3ca994cf-a5dc-4e87-8953-e02ae28b4511 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:56.904544 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3ca994cf-a5dc-4e87-8953-e02ae28b4511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:56.916368 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1281/2536] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:56.920956 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8720ef-d52f-47ae-99b3-f66fc3474e2d None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:56.934339 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8720ef-d52f-47ae-99b3-f66fc3474e2d None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:56.940400 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ce686-0692-4bde-9a05-f9e287036eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:56.941114 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ce686-0692-4bde-9a05-f9e287036eee admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:56.941773 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ce686-0692-4bde-9a05-f9e287036eee admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:56.941903 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ce686-0692-4bde-9a05-f9e287036eee admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:56.943124 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ce686-0692-4bde-9a05-f9e287036eee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:39:56.943731 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ce686-0692-4bde-9a05-f9e287036eee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:56.945539 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ce686-0692-4bde-9a05-f9e287036eee admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:56.966431 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1256/2537] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:39:56.967798 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca994cf-a5dc-4e87-8953-e02ae28b4511 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:56.983529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca994cf-a5dc-4e87-8953-e02ae28b4511 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:56.989097 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be1da7-11c7-404b-bbe5-400b39c461ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:56.989808 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be1da7-11c7-404b-bbe5-400b39c461ff admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:56.990095 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be1da7-11c7-404b-bbe5-400b39c461ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:56.990361 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be1da7-11c7-404b-bbe5-400b39c461ff admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:56.991065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be1da7-11c7-404b-bbe5-400b39c461ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:56.993303 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be1da7-11c7-404b-bbe5-400b39c461ff admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:57.041501 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1282/2538] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:39:56 2022] POST /identity/v3/projects => generated 383 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:39:57.046218 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ce686-0692-4bde-9a05-f9e287036eee admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:57.059997 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:57.065790 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ce686-0692-4bde-9a05-f9e287036eee admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:57.149207 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c5af5-0e77-4625-b2d4-8b99932865f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:57.149437 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c5af5-0e77-4625-b2d4-8b99932865f7 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:57.149842 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c5af5-0e77-4625-b2d4-8b99932865f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:57.150317 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c5af5-0e77-4625-b2d4-8b99932865f7 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:57.151125 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432c5af5-0e77-4625-b2d4-8b99932865f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:57.153367 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432c5af5-0e77-4625-b2d4-8b99932865f7 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:57.191196 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1257/2539] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:39:57 2022] POST /identity/v3/users => generated 292 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:39:57.196126 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be1da7-11c7-404b-bbe5-400b39c461ff admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:57.210228 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be1da7-11c7-404b-bbe5-400b39c461ff admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:57.225357 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eea418-f335-453f-8aa4-cb07ba548edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:57.226308 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eea418-f335-453f-8aa4-cb07ba548edd admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:57.226724 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eea418-f335-453f-8aa4-cb07ba548edd admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:57.227157 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eea418-f335-453f-8aa4-cb07ba548edd admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:57.228153 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eea418-f335-453f-8aa4-cb07ba548edd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:57.231176 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eea418-f335-453f-8aa4-cb07ba548edd admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:57.265884 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1283/2540] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:57.267437 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c5af5-0e77-4625-b2d4-8b99932865f7 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:57.280661 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c5af5-0e77-4625-b2d4-8b99932865f7 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:57.286438 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ec0c4-d90a-4036-b7c5-bf05900fdc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:57.287096 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ec0c4-d90a-4036-b7c5-bf05900fdc4f admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:57.287378 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ec0c4-d90a-4036-b7c5-bf05900fdc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:57.287649 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ec0c4-d90a-4036-b7c5-bf05900fdc4f admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:57.288297 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ec0c4-d90a-4036-b7c5-bf05900fdc4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:57.292125 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ec0c4-d90a-4036-b7c5-bf05900fdc4f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:57.312050 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1258/2541] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:57.314151 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eea418-f335-453f-8aa4-cb07ba548edd admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:57.328758 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eea418-f335-453f-8aa4-cb07ba548edd admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:57.336132 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9d5e4-7d71-4220-a938-27010d949be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:57.337194 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9d5e4-7d71-4220-a938-27010d949be5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:57.337660 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9d5e4-7d71-4220-a938-27010d949be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:57.338221 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9d5e4-7d71-4220-a938-27010d949be5 admin admin] PATH_INFO: `/v3/projects/cf5ca390dfe54719825925be37a4b7f9/users/36cd844e2ba64713801d4555b1dd50cc/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:57.357793 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f9d5e4-7d71-4220-a938-27010d949be5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf5ca390dfe54719825925be37a4b7f9, user_id=36cd844e2ba64713801d4555b1dd50cc, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:57.361107 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f9d5e4-7d71-4220-a938-27010d949be5 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:57.385177 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1284/2542] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:39:57 2022] PUT /identity/v3/projects/cf5ca390dfe54719825925be37a4b7f9/users/36cd844e2ba64713801d4555b1dd50cc/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:57.396544 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe9dfe-cc59-481e-b42b-7e1a87fc4401 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:57.396874 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe9dfe-cc59-481e-b42b-7e1a87fc4401 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:57.397105 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe9dfe-cc59-481e-b42b-7e1a87fc4401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:57.440793 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-5dbe9dfe-cc59-481e-b42b-7e1a87fc4401 None None] MFA Rules not processed for user `36cd844e2ba64713801d4555b1dd50cc`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:57.442064 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5dbe9dfe-cc59-481e-b42b-7e1a87fc4401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:57.541962 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1259/2543] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:57.546387 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9d5e4-7d71-4220-a938-27010d949be5 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:57.640842 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9d5e4-7d71-4220-a938-27010d949be5 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:57.648236 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a6154-e2f0-4404-8f90-f601b6d574bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:57.649128 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a6154-e2f0-4404-8f90-f601b6d574bf admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:57.649424 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a6154-e2f0-4404-8f90-f601b6d574bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:57.649678 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a6154-e2f0-4404-8f90-f601b6d574bf admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:57.650331 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1a6154-e2f0-4404-8f90-f601b6d574bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:57.652718 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1a6154-e2f0-4404-8f90-f601b6d574bf admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:57.693228 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1285/2544] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:39:57 2022] POST /identity/v3/projects => generated 383 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:39:57.697886 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe9dfe-cc59-481e-b42b-7e1a87fc4401 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:57.714798 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe9dfe-cc59-481e-b42b-7e1a87fc4401 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:57.825117 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da98cb5-a393-46a6-962e-08e13e97411b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:57.825759 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da98cb5-a393-46a6-962e-08e13e97411b admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:57.826044 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da98cb5-a393-46a6-962e-08e13e97411b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:57.826319 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da98cb5-a393-46a6-962e-08e13e97411b admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:57.828990 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da98cb5-a393-46a6-962e-08e13e97411b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:57.831103 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da98cb5-a393-46a6-962e-08e13e97411b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:57.883865 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1260/2545] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:39:57 2022] POST /identity/v3/users => generated 298 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:39:57.884555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a6154-e2f0-4404-8f90-f601b6d574bf admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:57.899092 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a6154-e2f0-4404-8f90-f601b6d574bf admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:57.913452 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8388e2a-7082-45f7-9853-be5b0fcc3deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:57.914091 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8388e2a-7082-45f7-9853-be5b0fcc3deb admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:57.914412 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8388e2a-7082-45f7-9853-be5b0fcc3deb admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:57.914715 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8388e2a-7082-45f7-9853-be5b0fcc3deb admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:57.915363 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8388e2a-7082-45f7-9853-be5b0fcc3deb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:57.917503 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8388e2a-7082-45f7-9853-be5b0fcc3deb admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:57.941737 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1286/2546] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:57.946474 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da98cb5-a393-46a6-962e-08e13e97411b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:57.953473 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:57.964237 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da98cb5-a393-46a6-962e-08e13e97411b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:57.975162 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7a37f-59dd-4108-9691-d2c43ee0a6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:57.976369 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7a37f-59dd-4108-9691-d2c43ee0a6a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:57.976835 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7a37f-59dd-4108-9691-d2c43ee0a6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:57.977293 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7a37f-59dd-4108-9691-d2c43ee0a6a8 admin admin] PATH_INFO: `/v3/projects/46fbb32a33a44113a1a0be1f11d2f8a2/users/b0d528f7c6b24ffbb2257e6e8390597d/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:58.012840 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b7a37f-59dd-4108-9691-d2c43ee0a6a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46fbb32a33a44113a1a0be1f11d2f8a2, user_id=b0d528f7c6b24ffbb2257e6e8390597d, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:58.018977 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b7a37f-59dd-4108-9691-d2c43ee0a6a8 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:58.059611 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1261/2547] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:39:57 2022] PUT /identity/v3/projects/46fbb32a33a44113a1a0be1f11d2f8a2/users/b0d528f7c6b24ffbb2257e6e8390597d/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:39:58.060490 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8388e2a-7082-45f7-9853-be5b0fcc3deb admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:58.078497 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8388e2a-7082-45f7-9853-be5b0fcc3deb admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:58.104255 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:58.185436 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a6475b-b99d-49e6-a66c-49850f304b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:58.186190 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6475b-b99d-49e6-a66c-49850f304b94 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:58.186856 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6475b-b99d-49e6-a66c-49850f304b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:58.187223 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6475b-b99d-49e6-a66c-49850f304b94 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:58.188204 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a6475b-b99d-49e6-a66c-49850f304b94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:58.189885 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a6475b-b99d-49e6-a66c-49850f304b94 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:58.221373 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1287/2548] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:58.225640 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7a37f-59dd-4108-9691-d2c43ee0a6a8 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:58.236592 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7a37f-59dd-4108-9691-d2c43ee0a6a8 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:58.242672 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ad3d2-9963-4ae1-af4c-c531040d51ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:58.243457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ad3d2-9963-4ae1-af4c-c531040d51ee admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:58.243791 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ad3d2-9963-4ae1-af4c-c531040d51ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:58.244125 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ad3d2-9963-4ae1-af4c-c531040d51ee admin admin] PATH_INFO: `/v3/projects/46fbb32a33a44113a1a0be1f11d2f8a2/users/b0d528f7c6b24ffbb2257e6e8390597d/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:58.246163 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ad3d2-9963-4ae1-af4c-c531040d51ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=46fbb32a33a44113a1a0be1f11d2f8a2, user_id=b0d528f7c6b24ffbb2257e6e8390597d, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:58.249073 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ad3d2-9963-4ae1-af4c-c531040d51ee admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:58.265449 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1262/2549] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:39:58 2022] PUT /identity/v3/projects/46fbb32a33a44113a1a0be1f11d2f8a2/users/b0d528f7c6b24ffbb2257e6e8390597d/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:58.277012 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512d5cd-4640-44d8-a8f6-c387aa5c472b None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:58.277291 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512d5cd-4640-44d8-a8f6-c387aa5c472b None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:58.277572 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512d5cd-4640-44d8-a8f6-c387aa5c472b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:58.311990 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-1512d5cd-4640-44d8-a8f6-c387aa5c472b None None] MFA Rules not processed for user `b0d528f7c6b24ffbb2257e6e8390597d`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:58.313563 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1512d5cd-4640-44d8-a8f6-c387aa5c472b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:58.415748 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1288/2550] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:39:58 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:58.547955 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ad3d2-9963-4ae1-af4c-c531040d51ee admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:58.550327 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-280ad3d2-9963-4ae1-af4c-c531040d51ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:58.649726 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ad3d2-9963-4ae1-af4c-c531040d51ee admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:58.655958 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5954f-3ea1-4b74-8b36-b0c5d5db4dc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:58.656806 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5954f-3ea1-4b74-8b36-b0c5d5db4dc5 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:58.657170 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5954f-3ea1-4b74-8b36-b0c5d5db4dc5 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:58.657510 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5954f-3ea1-4b74-8b36-b0c5d5db4dc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:58.669660 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf5954f-3ea1-4b74-8b36-b0c5d5db4dc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:58.671650 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf5954f-3ea1-4b74-8b36-b0c5d5db4dc5 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:58.686688 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1263/2551] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:39:58 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:39:59.904671 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512d5cd-4640-44d8-a8f6-c387aa5c472b None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:59.919051 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512d5cd-4640-44d8-a8f6-c387aa5c472b None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:59.924494 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9d8fd-e5ec-4fc0-b09d-75b570fe0a46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:59.926058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9d8fd-e5ec-4fc0-b09d-75b570fe0a46 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:59.926340 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9d8fd-e5ec-4fc0-b09d-75b570fe0a46 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:59.926618 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9d8fd-e5ec-4fc0-b09d-75b570fe0a46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:59.928452 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7ea9d8fd-e5ec-4fc0-b09d-75b570fe0a46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:00.000704 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9d8fd-e5ec-4fc0-b09d-75b570fe0a46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:00.002230 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9d8fd-e5ec-4fc0-b09d-75b570fe0a46 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:00.013187 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1289/2552] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:39:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:40:01.053506 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72b167-306d-4755-b2ef-31c32c51fd3b None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:01.055482 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72b167-306d-4755-b2ef-31c32c51fd3b None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:01.055989 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72b167-306d-4755-b2ef-31c32c51fd3b None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:01.058727 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1264/2553] 10.222.0.83 () {54 vars in 921 bytes} [Mon Aug 29 15:40:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:40:01.067379 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7fe8e-d101-458c-9f3e-f37f8dcdf160 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:01.067972 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7fe8e-d101-458c-9f3e-f37f8dcdf160 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:01.067972 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7fe8e-d101-458c-9f3e-f37f8dcdf160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:01.107800 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-e7c7fe8e-d101-458c-9f3e-f37f8dcdf160 None None] MFA Rules not processed for user `9a84bb38f6454574897120223b8fc140`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:01.109582 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e7c7fe8e-d101-458c-9f3e-f37f8dcdf160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:01.165522 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:01.207337 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1290/2554] 10.222.0.83 () {58 vars in 1018 bytes} [Mon Aug 29 15:40:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:01.217749 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de72b167-306d-4755-b2ef-31c32c51fd3b None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:01.219158 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-de72b167-306d-4755-b2ef-31c32c51fd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:01.234219 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de72b167-306d-4755-b2ef-31c32c51fd3b None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:01.238226 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53b524-2544-4924-803f-f3c40b60d627 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:01.239042 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53b524-2544-4924-803f-f3c40b60d627 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:01.239361 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53b524-2544-4924-803f-f3c40b60d627 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:01.239622 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53b524-2544-4924-803f-f3c40b60d627 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:01.247917 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b53b524-2544-4924-803f-f3c40b60d627 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:01.249774 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b53b524-2544-4924-803f-f3c40b60d627 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:01.262979 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1265/2555] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:40:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:40:01.676523 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f23f6c-09e1-44fd-95dd-c39889f8fcbd None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:01.677024 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f23f6c-09e1-44fd-95dd-c39889f8fcbd None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:01.677450 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f23f6c-09e1-44fd-95dd-c39889f8fcbd None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:01.679760 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1291/2556] 10.222.0.83 () {54 vars in 921 bytes} [Mon Aug 29 15:40:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:40:01.686703 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8faf5-84eb-4790-92e5-825bffb4133e None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:01.687067 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8faf5-84eb-4790-92e5-825bffb4133e None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:01.687522 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8faf5-84eb-4790-92e5-825bffb4133e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:01.728650 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-0ca8faf5-84eb-4790-92e5-825bffb4133e None None] MFA Rules not processed for user `253947a5ef294d2bb828761873251bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:01.730505 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0ca8faf5-84eb-4790-92e5-825bffb4133e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:01.761377 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1266/2557] 10.222.0.83 () {58 vars in 1018 bytes} [Mon Aug 29 15:40:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:01.777078 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f23f6c-09e1-44fd-95dd-c39889f8fcbd None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:01.780471 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca8faf5-84eb-4790-92e5-825bffb4133e None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:01.804538 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca8faf5-84eb-4790-92e5-825bffb4133e None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:01.816309 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe5fb1-8fb7-419f-9c03-47c2801bff49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:01.818316 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe5fb1-8fb7-419f-9c03-47c2801bff49 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:01.820096 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe5fb1-8fb7-419f-9c03-47c2801bff49 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:01.820375 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe5fb1-8fb7-419f-9c03-47c2801bff49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:01.857854 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fe5fb1-8fb7-419f-9c03-47c2801bff49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:01.860870 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fe5fb1-8fb7-419f-9c03-47c2801bff49 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:01.892965 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1267/2558] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:40:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:40:01.914529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f23f6c-09e1-44fd-95dd-c39889f8fcbd None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:01.920423 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e175826-43df-4c47-8e59-99fcc2efffa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:01.921403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e175826-43df-4c47-8e59-99fcc2efffa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:01.921898 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e175826-43df-4c47-8e59-99fcc2efffa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:01.922376 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e175826-43df-4c47-8e59-99fcc2efffa8 admin admin] PATH_INFO: `/v3/users/36cd844e2ba64713801d4555b1dd50cc` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:01.925253 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e175826-43df-4c47-8e59-99fcc2efffa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36cd844e2ba64713801d4555b1dd50cc)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:01.929382 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e175826-43df-4c47-8e59-99fcc2efffa8 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:02.048323 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8e175826-43df-4c47-8e59-99fcc2efffa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36cd844e2ba64713801d4555b1dd50cc'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:02.049184 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8e175826-43df-4c47-8e59-99fcc2efffa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36cd844e2ba64713801d4555b1dd50cc'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:02.078546 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8e175826-43df-4c47-8e59-99fcc2efffa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36cd844e2ba64713801d4555b1dd50cc'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:02.105477 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8e175826-43df-4c47-8e59-99fcc2efffa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36cd844e2ba64713801d4555b1dd50cc'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:02.117858 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8e175826-43df-4c47-8e59-99fcc2efffa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36cd844e2ba64713801d4555b1dd50cc'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:02.125668 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1292/2559] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:40:01 2022] DELETE /identity/v3/users/36cd844e2ba64713801d4555b1dd50cc => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:02.129855 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261406b5-a2a7-47d0-8d6e-30d66b7f522c None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:02.130415 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261406b5-a2a7-47d0-8d6e-30d66b7f522c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:02.130415 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261406b5-a2a7-47d0-8d6e-30d66b7f522c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:02.156777 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-261406b5-a2a7-47d0-8d6e-30d66b7f522c None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:02.158054 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-261406b5-a2a7-47d0-8d6e-30d66b7f522c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:02.257755 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1268/2560] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:40:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:02.273875 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e175826-43df-4c47-8e59-99fcc2efffa8 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:02.275942 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8e175826-43df-4c47-8e59-99fcc2efffa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:02.363845 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e175826-43df-4c47-8e59-99fcc2efffa8 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:02.368442 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a7e959-462f-4f7b-965e-b1383c680d5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:02.369128 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7e959-462f-4f7b-965e-b1383c680d5d service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:02.369514 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7e959-462f-4f7b-965e-b1383c680d5d service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:02.369841 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7e959-462f-4f7b-965e-b1383c680d5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:02.382216 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a7e959-462f-4f7b-965e-b1383c680d5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:02.384012 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a7e959-462f-4f7b-965e-b1383c680d5d service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:02.399503 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1293/2561] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:40:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:40:02.793172 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261406b5-a2a7-47d0-8d6e-30d66b7f522c None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:02.794689 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-261406b5-a2a7-47d0-8d6e-30d66b7f522c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:02.809204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261406b5-a2a7-47d0-8d6e-30d66b7f522c None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:02.815208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60290048-7294-46e4-a6e2-c938642fc228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:02.816057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60290048-7294-46e4-a6e2-c938642fc228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:02.816589 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60290048-7294-46e4-a6e2-c938642fc228 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:02.827278 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60290048-7294-46e4-a6e2-c938642fc228 admin admin] PATH_INFO: `/v3/projects/cf5ca390dfe54719825925be37a4b7f9` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:02.833834 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60290048-7294-46e4-a6e2-c938642fc228 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf5ca390dfe54719825925be37a4b7f9)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:02.835998 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60290048-7294-46e4-a6e2-c938642fc228 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:02.858547 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:02.899598 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-60290048-7294-46e4-a6e2-c938642fc228 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf5ca390dfe54719825925be37a4b7f9', 'request_id': 'req-60290048-7294-46e4-a6e2-c938642fc228'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:02.905371 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-60290048-7294-46e4-a6e2-c938642fc228 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf5ca390dfe54719825925be37a4b7f9', 'request_id': 'req-60290048-7294-46e4-a6e2-c938642fc228'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:02.912566 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-60290048-7294-46e4-a6e2-c938642fc228 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf5ca390dfe54719825925be37a4b7f9', 'request_id': 'req-60290048-7294-46e4-a6e2-c938642fc228'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:02.925411 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-60290048-7294-46e4-a6e2-c938642fc228 admin admin] The token cache is being invalidate because project cf5ca390dfe54719825925be37a4b7f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:40:02.925510 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-60290048-7294-46e4-a6e2-c938642fc228 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:02.927489 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-60290048-7294-46e4-a6e2-c938642fc228 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:02.931704 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1269/2562] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:02 2022] DELETE /identity/v3/projects/cf5ca390dfe54719825925be37a4b7f9 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:40:02.935813 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a7e959-462f-4f7b-965e-b1383c680d5d service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:02.948797 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a7e959-462f-4f7b-965e-b1383c680d5d service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:02.953207 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:03.011859 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f9f9d-2df1-4d22-983b-b98409ce871c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:03.012563 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f9f9d-2df1-4d22-983b-b98409ce871c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:03.012848 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f9f9d-2df1-4d22-983b-b98409ce871c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:03.013121 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f9f9d-2df1-4d22-983b-b98409ce871c admin admin] PATH_INFO: `/v3/users/b0d528f7c6b24ffbb2257e6e8390597d` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:03.014245 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911f9f9d-2df1-4d22-983b-b98409ce871c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0d528f7c6b24ffbb2257e6e8390597d)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:03.016203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911f9f9d-2df1-4d22-983b-b98409ce871c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:03.065303 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-911f9f9d-2df1-4d22-983b-b98409ce871c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0d528f7c6b24ffbb2257e6e8390597d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:03.065951 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-911f9f9d-2df1-4d22-983b-b98409ce871c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0d528f7c6b24ffbb2257e6e8390597d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:03.078949 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-911f9f9d-2df1-4d22-983b-b98409ce871c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0d528f7c6b24ffbb2257e6e8390597d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:03.087587 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-911f9f9d-2df1-4d22-983b-b98409ce871c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0d528f7c6b24ffbb2257e6e8390597d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:03.095187 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-911f9f9d-2df1-4d22-983b-b98409ce871c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0d528f7c6b24ffbb2257e6e8390597d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:03.101698 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1294/2563] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:40:02 2022] DELETE /identity/v3/users/b0d528f7c6b24ffbb2257e6e8390597d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:03.827010 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60290048-7294-46e4-a6e2-c938642fc228 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:03.828718 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-60290048-7294-46e4-a6e2-c938642fc228 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:03.841947 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60290048-7294-46e4-a6e2-c938642fc228 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:03.924639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bcb590-1515-4204-864b-688a2264248d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:03.925814 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bcb590-1515-4204-864b-688a2264248d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:03.926310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bcb590-1515-4204-864b-688a2264248d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:03.929147 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bcb590-1515-4204-864b-688a2264248d admin admin] PATH_INFO: `/v3/projects/46fbb32a33a44113a1a0be1f11d2f8a2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:03.930455 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bcb590-1515-4204-864b-688a2264248d admin admin] RBAC: Authorizing `identity:delete_project(project_id=46fbb32a33a44113a1a0be1f11d2f8a2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:03.933174 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bcb590-1515-4204-864b-688a2264248d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:03.983744 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-82bcb590-1515-4204-864b-688a2264248d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46fbb32a33a44113a1a0be1f11d2f8a2', 'request_id': 'req-82bcb590-1515-4204-864b-688a2264248d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:03.990180 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-82bcb590-1515-4204-864b-688a2264248d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46fbb32a33a44113a1a0be1f11d2f8a2', 'request_id': 'req-82bcb590-1515-4204-864b-688a2264248d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:03.996524 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-82bcb590-1515-4204-864b-688a2264248d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46fbb32a33a44113a1a0be1f11d2f8a2', 'request_id': 'req-82bcb590-1515-4204-864b-688a2264248d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:04.012130 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-82bcb590-1515-4204-864b-688a2264248d admin admin] The token cache is being invalidate because project 46fbb32a33a44113a1a0be1f11d2f8a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:40:04.012516 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-82bcb590-1515-4204-864b-688a2264248d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:04.013322 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-82bcb590-1515-4204-864b-688a2264248d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:04.015007 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1270/2564] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:03 2022] DELETE /identity/v3/projects/46fbb32a33a44113a1a0be1f11d2f8a2 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:04.020187 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae4782-e0b7-45e9-aede-efcdb9dfe291 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:04.021126 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae4782-e0b7-45e9-aede-efcdb9dfe291 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:04.021818 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae4782-e0b7-45e9-aede-efcdb9dfe291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:04.042568 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-88ae4782-e0b7-45e9-aede-efcdb9dfe291 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:04.043905 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-88ae4782-e0b7-45e9-aede-efcdb9dfe291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:04.123232 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1295/2565] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:40:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:04.131604 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d7647-37c1-4704-90d2-1f8b2e4a8b63 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:04.131931 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d7647-37c1-4704-90d2-1f8b2e4a8b63 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:04.132204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d7647-37c1-4704-90d2-1f8b2e4a8b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:04.156793 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-650d7647-37c1-4704-90d2-1f8b2e4a8b63 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:04.158196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-650d7647-37c1-4704-90d2-1f8b2e4a8b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:04.168673 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1271/2566] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:40:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:40:04.172391 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae4782-e0b7-45e9-aede-efcdb9dfe291 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:04.182908 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae4782-e0b7-45e9-aede-efcdb9dfe291 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:04.188438 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fedd48-f932-40a8-b9a6-4a1cd3904c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:04.189411 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fedd48-f932-40a8-b9a6-4a1cd3904c08 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:04.189692 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fedd48-f932-40a8-b9a6-4a1cd3904c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:04.189968 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fedd48-f932-40a8-b9a6-4a1cd3904c08 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:04.190635 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fedd48-f932-40a8-b9a6-4a1cd3904c08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:40:04.190942 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fedd48-f932-40a8-b9a6-4a1cd3904c08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:04.192709 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fedd48-f932-40a8-b9a6-4a1cd3904c08 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:04.211044 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1296/2567] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:40:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:40:04.214964 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d7647-37c1-4704-90d2-1f8b2e4a8b63 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:04.237828 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d7647-37c1-4704-90d2-1f8b2e4a8b63 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:04.243572 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a77364-d75b-4d7d-8aaa-e3f7ab8c51e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:04.244370 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a77364-d75b-4d7d-8aaa-e3f7ab8c51e0 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:04.244658 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a77364-d75b-4d7d-8aaa-e3f7ab8c51e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:04.244929 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a77364-d75b-4d7d-8aaa-e3f7ab8c51e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:04.245572 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a77364-d75b-4d7d-8aaa-e3f7ab8c51e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:04.247945 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a77364-d75b-4d7d-8aaa-e3f7ab8c51e0 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:04.297053 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1272/2568] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:40:04 2022] POST /identity/v3/projects => generated 381 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:40:04.301252 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fedd48-f932-40a8-b9a6-4a1cd3904c08 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:04.316228 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fedd48-f932-40a8-b9a6-4a1cd3904c08 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:04.327847 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:04.403508 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8e795-801c-4b67-a8c8-b42efc42ebde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:04.405212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8e795-801c-4b67-a8c8-b42efc42ebde admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:04.405212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8e795-801c-4b67-a8c8-b42efc42ebde admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:04.405212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8e795-801c-4b67-a8c8-b42efc42ebde admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:04.405614 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8e795-801c-4b67-a8c8-b42efc42ebde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:04.407669 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8e795-801c-4b67-a8c8-b42efc42ebde admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:04.435473 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1297/2569] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:40:04 2022] POST /identity/v3/users => generated 291 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:40:04.436488 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a77364-d75b-4d7d-8aaa-e3f7ab8c51e0 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:04.445929 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:04.457197 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a77364-d75b-4d7d-8aaa-e3f7ab8c51e0 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:04.464285 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee4589-4ea7-487c-b8aa-7a75b107fecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:04.464904 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee4589-4ea7-487c-b8aa-7a75b107fecd admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:04.465357 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee4589-4ea7-487c-b8aa-7a75b107fecd admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:04.465632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee4589-4ea7-487c-b8aa-7a75b107fecd admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:04.466653 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee4589-4ea7-487c-b8aa-7a75b107fecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:04.467992 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee4589-4ea7-487c-b8aa-7a75b107fecd admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:04.483230 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1273/2570] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:40:04.485695 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8e795-801c-4b67-a8c8-b42efc42ebde admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:04.497694 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8e795-801c-4b67-a8c8-b42efc42ebde admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:04.504274 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e1fe01-cb14-4fa9-8325-a53c5d8555e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:04.505458 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1fe01-cb14-4fa9-8325-a53c5d8555e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:04.505741 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1fe01-cb14-4fa9-8325-a53c5d8555e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:04.506012 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1fe01-cb14-4fa9-8325-a53c5d8555e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:04.506666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e1fe01-cb14-4fa9-8325-a53c5d8555e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:04.508309 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e1fe01-cb14-4fa9-8325-a53c5d8555e9 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:04.523958 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1298/2571] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:40:04.525137 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee4589-4ea7-487c-b8aa-7a75b107fecd admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:04.535080 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee4589-4ea7-487c-b8aa-7a75b107fecd admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:04.540172 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5994b-3644-41b9-81d7-fc25a334f092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:04.540833 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5994b-3644-41b9-81d7-fc25a334f092 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:04.541109 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5994b-3644-41b9-81d7-fc25a334f092 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:04.541381 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5994b-3644-41b9-81d7-fc25a334f092 admin admin] PATH_INFO: `/v3/projects/f4364bb3385f432b86b86da92c1553ea/users/e629ecae0d044a8eb294aec50c146387/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:04.557622 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc5994b-3644-41b9-81d7-fc25a334f092 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4364bb3385f432b86b86da92c1553ea, user_id=e629ecae0d044a8eb294aec50c146387, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:04.561911 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc5994b-3644-41b9-81d7-fc25a334f092 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:04.577162 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1274/2572] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:40:04 2022] PUT /identity/v3/projects/f4364bb3385f432b86b86da92c1553ea/users/e629ecae0d044a8eb294aec50c146387/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:40:04.588057 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8f02c-ed0a-4b54-b636-04cc1b11426e None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:04.588449 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8f02c-ed0a-4b54-b636-04cc1b11426e None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:04.588763 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8f02c-ed0a-4b54-b636-04cc1b11426e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:04.617725 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-5df8f02c-ed0a-4b54-b636-04cc1b11426e None None] MFA Rules not processed for user `e629ecae0d044a8eb294aec50c146387`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:04.618937 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5df8f02c-ed0a-4b54-b636-04cc1b11426e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:04.683466 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1299/2573] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:40:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:04.688004 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5994b-3644-41b9-81d7-fc25a334f092 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:04.751060 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5994b-3644-41b9-81d7-fc25a334f092 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:04.757106 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a044b71-db0f-4c14-92aa-e30ceff162c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:04.757773 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a044b71-db0f-4c14-92aa-e30ceff162c2 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:04.758051 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a044b71-db0f-4c14-92aa-e30ceff162c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:04.758318 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a044b71-db0f-4c14-92aa-e30ceff162c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:04.758962 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a044b71-db0f-4c14-92aa-e30ceff162c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:04.760900 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a044b71-db0f-4c14-92aa-e30ceff162c2 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:04.790403 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1275/2574] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:40:04 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:40:04.794490 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8f02c-ed0a-4b54-b636-04cc1b11426e None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:04.807006 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8f02c-ed0a-4b54-b636-04cc1b11426e None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:04.866763 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b540d-f23e-4749-8f5d-b7de771a23da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:04.867430 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b540d-f23e-4749-8f5d-b7de771a23da admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:04.867720 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b540d-f23e-4749-8f5d-b7de771a23da admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:04.867997 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b540d-f23e-4749-8f5d-b7de771a23da admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:04.868655 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b540d-f23e-4749-8f5d-b7de771a23da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:04.870586 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b540d-f23e-4749-8f5d-b7de771a23da admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:04.896891 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1300/2575] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:40:04 2022] POST /identity/v3/users => generated 298 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:40:04.900928 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a044b71-db0f-4c14-92aa-e30ceff162c2 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:04.913959 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a044b71-db0f-4c14-92aa-e30ceff162c2 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:04.936924 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588a38a-9833-4459-b811-ad0958b1c0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:04.937890 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588a38a-9833-4459-b811-ad0958b1c0d7 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:04.937890 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588a38a-9833-4459-b811-ad0958b1c0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:04.938196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588a38a-9833-4459-b811-ad0958b1c0d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:04.938823 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588a38a-9833-4459-b811-ad0958b1c0d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:04.940466 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588a38a-9833-4459-b811-ad0958b1c0d7 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:04.955301 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1276/2576] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:40:04.961452 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b540d-f23e-4749-8f5d-b7de771a23da admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:04.973207 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b540d-f23e-4749-8f5d-b7de771a23da admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:04.978939 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18258a-921d-4b89-8ad2-36bd6843c331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:04.979966 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18258a-921d-4b89-8ad2-36bd6843c331 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:04.980310 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18258a-921d-4b89-8ad2-36bd6843c331 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:04.980653 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18258a-921d-4b89-8ad2-36bd6843c331 admin admin] PATH_INFO: `/v3/projects/5b3cb63361424d64bb0b4c522482bd0d/users/0fe78085d9a9421dbf1a63dfe84d761a/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:04.994380 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:05.005441 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de18258a-921d-4b89-8ad2-36bd6843c331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b3cb63361424d64bb0b4c522482bd0d, user_id=0fe78085d9a9421dbf1a63dfe84d761a, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:05.011655 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de18258a-921d-4b89-8ad2-36bd6843c331 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:05.027523 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1301/2577] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:40:04 2022] PUT /identity/v3/projects/5b3cb63361424d64bb0b4c522482bd0d/users/0fe78085d9a9421dbf1a63dfe84d761a/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:05.031360 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588a38a-9833-4459-b811-ad0958b1c0d7 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:05.043335 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588a38a-9833-4459-b811-ad0958b1c0d7 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:05.119321 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a34dc-f609-4f9f-b742-db993b5e1bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:05.120038 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a34dc-f609-4f9f-b742-db993b5e1bfe admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:05.120442 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a34dc-f609-4f9f-b742-db993b5e1bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:05.120789 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a34dc-f609-4f9f-b742-db993b5e1bfe admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:05.121555 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9a34dc-f609-4f9f-b742-db993b5e1bfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:05.123258 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9a34dc-f609-4f9f-b742-db993b5e1bfe admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:05.137150 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1277/2578] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:40:05.139722 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18258a-921d-4b89-8ad2-36bd6843c331 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:05.152596 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18258a-921d-4b89-8ad2-36bd6843c331 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:05.159565 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7969445-5799-468c-92c7-fcf65aa86afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:05.160108 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7969445-5799-468c-92c7-fcf65aa86afa admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:05.160497 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7969445-5799-468c-92c7-fcf65aa86afa admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:05.162244 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7969445-5799-468c-92c7-fcf65aa86afa admin admin] PATH_INFO: `/v3/projects/5b3cb63361424d64bb0b4c522482bd0d/users/0fe78085d9a9421dbf1a63dfe84d761a/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:05.164492 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7969445-5799-468c-92c7-fcf65aa86afa admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b3cb63361424d64bb0b4c522482bd0d, user_id=0fe78085d9a9421dbf1a63dfe84d761a, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:05.167381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7969445-5799-468c-92c7-fcf65aa86afa admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:05.181260 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1302/2579] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:40:05 2022] PUT /identity/v3/projects/5b3cb63361424d64bb0b4c522482bd0d/users/0fe78085d9a9421dbf1a63dfe84d761a/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:05.194696 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa90d20-6af6-43cc-a096-49f88c83d36c None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:05.195050 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa90d20-6af6-43cc-a096-49f88c83d36c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:05.195426 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa90d20-6af6-43cc-a096-49f88c83d36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:05.232478 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-7fa90d20-6af6-43cc-a096-49f88c83d36c None None] MFA Rules not processed for user `0fe78085d9a9421dbf1a63dfe84d761a`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:05.233736 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7fa90d20-6af6-43cc-a096-49f88c83d36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:05.273214 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:05.339660 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1278/2580] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:40:05 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:05.394734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7969445-5799-468c-92c7-fcf65aa86afa admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:05.396590 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a7969445-5799-468c-92c7-fcf65aa86afa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:05.476806 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7969445-5799-468c-92c7-fcf65aa86afa admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:05.485058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e240ca2-a5fc-41b3-a9d8-e829330626ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:05.485633 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e240ca2-a5fc-41b3-a9d8-e829330626ae service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:05.485918 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e240ca2-a5fc-41b3-a9d8-e829330626ae service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:05.486195 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e240ca2-a5fc-41b3-a9d8-e829330626ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:05.497095 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e240ca2-a5fc-41b3-a9d8-e829330626ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:05.498731 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e240ca2-a5fc-41b3-a9d8-e829330626ae service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:05.526865 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1303/2581] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:40:05 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:40:05.904868 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa90d20-6af6-43cc-a096-49f88c83d36c None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:06.012124 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa90d20-6af6-43cc-a096-49f88c83d36c None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:06.017100 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5d73c-79e7-4d9d-a37c-41e51468de2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:06.017747 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5d73c-79e7-4d9d-a37c-41e51468de2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:06.018025 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5d73c-79e7-4d9d-a37c-41e51468de2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:06.018302 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5d73c-79e7-4d9d-a37c-41e51468de2c admin admin] PATH_INFO: `/v3/users/e629ecae0d044a8eb294aec50c146387` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:06.019505 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c5d73c-79e7-4d9d-a37c-41e51468de2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e629ecae0d044a8eb294aec50c146387)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:06.021843 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c5d73c-79e7-4d9d-a37c-41e51468de2c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:06.083756 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-79c5d73c-79e7-4d9d-a37c-41e51468de2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e629ecae0d044a8eb294aec50c146387'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:06.084932 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-79c5d73c-79e7-4d9d-a37c-41e51468de2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e629ecae0d044a8eb294aec50c146387'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:06.097255 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-79c5d73c-79e7-4d9d-a37c-41e51468de2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e629ecae0d044a8eb294aec50c146387'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:06.108180 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-79c5d73c-79e7-4d9d-a37c-41e51468de2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e629ecae0d044a8eb294aec50c146387'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:06.109063 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-79c5d73c-79e7-4d9d-a37c-41e51468de2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e629ecae0d044a8eb294aec50c146387'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:06.138279 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1279/2582] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:40:05 2022] DELETE /identity/v3/users/e629ecae0d044a8eb294aec50c146387 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:06.143135 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3700e-1a14-4910-81c8-4b7f322f3569 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:06.143952 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3700e-1a14-4910-81c8-4b7f322f3569 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:06.144501 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3700e-1a14-4910-81c8-4b7f322f3569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:06.178983 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-33a3700e-1a14-4910-81c8-4b7f322f3569 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:06.180602 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-33a3700e-1a14-4910-81c8-4b7f322f3569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:06.245951 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1304/2583] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:40:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:06.256043 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5d73c-79e7-4d9d-a37c-41e51468de2c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:06.258003 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-79c5d73c-79e7-4d9d-a37c-41e51468de2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:06.314367 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:06.330160 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5d73c-79e7-4d9d-a37c-41e51468de2c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:06.335187 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37895c-3f24-401e-90e9-0a8bd9344be8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:06.335818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37895c-3f24-401e-90e9-0a8bd9344be8 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:06.336097 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37895c-3f24-401e-90e9-0a8bd9344be8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:06.336368 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37895c-3f24-401e-90e9-0a8bd9344be8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:06.346278 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37895c-3f24-401e-90e9-0a8bd9344be8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:06.347889 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37895c-3f24-401e-90e9-0a8bd9344be8 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:06.358323 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1280/2584] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:40:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:40:06.706803 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a3700e-1a14-4910-81c8-4b7f322f3569 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:06.709446 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-33a3700e-1a14-4910-81c8-4b7f322f3569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:06.725170 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a3700e-1a14-4910-81c8-4b7f322f3569 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:06.730514 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014885e2-d46e-4f3c-9f96-86e343e1cc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:06.731272 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014885e2-d46e-4f3c-9f96-86e343e1cc07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:06.731476 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014885e2-d46e-4f3c-9f96-86e343e1cc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:06.732014 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014885e2-d46e-4f3c-9f96-86e343e1cc07 admin admin] PATH_INFO: `/v3/projects/f4364bb3385f432b86b86da92c1553ea` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:06.733429 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014885e2-d46e-4f3c-9f96-86e343e1cc07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4364bb3385f432b86b86da92c1553ea)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:06.735638 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014885e2-d46e-4f3c-9f96-86e343e1cc07 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:06.788000 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-014885e2-d46e-4f3c-9f96-86e343e1cc07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4364bb3385f432b86b86da92c1553ea', 'request_id': 'req-014885e2-d46e-4f3c-9f96-86e343e1cc07'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:06.791846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:06.794060 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-014885e2-d46e-4f3c-9f96-86e343e1cc07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4364bb3385f432b86b86da92c1553ea', 'request_id': 'req-014885e2-d46e-4f3c-9f96-86e343e1cc07'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:06.804767 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-014885e2-d46e-4f3c-9f96-86e343e1cc07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4364bb3385f432b86b86da92c1553ea', 'request_id': 'req-014885e2-d46e-4f3c-9f96-86e343e1cc07'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:06.816712 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-014885e2-d46e-4f3c-9f96-86e343e1cc07 admin admin] The token cache is being invalidate because project f4364bb3385f432b86b86da92c1553ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:40:06.816974 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-014885e2-d46e-4f3c-9f96-86e343e1cc07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:06.818170 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-014885e2-d46e-4f3c-9f96-86e343e1cc07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:06.819795 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1305/2585] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:06 2022] DELETE /identity/v3/projects/f4364bb3385f432b86b86da92c1553ea => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:40:06.824003 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37895c-3f24-401e-90e9-0a8bd9344be8 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:06.834775 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37895c-3f24-401e-90e9-0a8bd9344be8 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:06.901334 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729e05d-2d33-498d-bcce-c82e7b023e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:06.901968 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729e05d-2d33-498d-bcce-c82e7b023e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:06.902248 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729e05d-2d33-498d-bcce-c82e7b023e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:06.902647 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729e05d-2d33-498d-bcce-c82e7b023e60 admin admin] PATH_INFO: `/v3/users/0fe78085d9a9421dbf1a63dfe84d761a` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:06.903797 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729e05d-2d33-498d-bcce-c82e7b023e60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fe78085d9a9421dbf1a63dfe84d761a)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:06.905761 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729e05d-2d33-498d-bcce-c82e7b023e60 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:06.960996 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7729e05d-2d33-498d-bcce-c82e7b023e60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fe78085d9a9421dbf1a63dfe84d761a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:06.961924 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7729e05d-2d33-498d-bcce-c82e7b023e60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fe78085d9a9421dbf1a63dfe84d761a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:06.971917 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7729e05d-2d33-498d-bcce-c82e7b023e60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fe78085d9a9421dbf1a63dfe84d761a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:06.979907 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7729e05d-2d33-498d-bcce-c82e7b023e60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fe78085d9a9421dbf1a63dfe84d761a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:06.980750 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7729e05d-2d33-498d-bcce-c82e7b023e60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fe78085d9a9421dbf1a63dfe84d761a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:07.000210 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1281/2586] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:40:06 2022] DELETE /identity/v3/users/0fe78085d9a9421dbf1a63dfe84d761a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:07.408953 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014885e2-d46e-4f3c-9f96-86e343e1cc07 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:07.419890 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-014885e2-d46e-4f3c-9f96-86e343e1cc07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:07.434937 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014885e2-d46e-4f3c-9f96-86e343e1cc07 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:07.495714 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067e0f9-7fc9-4f24-951a-28978c5482d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:07.496351 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067e0f9-7fc9-4f24-951a-28978c5482d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:07.496630 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067e0f9-7fc9-4f24-951a-28978c5482d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:07.496902 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067e0f9-7fc9-4f24-951a-28978c5482d9 admin admin] PATH_INFO: `/v3/projects/5b3cb63361424d64bb0b4c522482bd0d` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:07.498009 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4067e0f9-7fc9-4f24-951a-28978c5482d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b3cb63361424d64bb0b4c522482bd0d)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:07.499975 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4067e0f9-7fc9-4f24-951a-28978c5482d9 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:07.548011 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4067e0f9-7fc9-4f24-951a-28978c5482d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b3cb63361424d64bb0b4c522482bd0d', 'request_id': 'req-4067e0f9-7fc9-4f24-951a-28978c5482d9'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:07.555833 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4067e0f9-7fc9-4f24-951a-28978c5482d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b3cb63361424d64bb0b4c522482bd0d', 'request_id': 'req-4067e0f9-7fc9-4f24-951a-28978c5482d9'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:07.563408 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4067e0f9-7fc9-4f24-951a-28978c5482d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b3cb63361424d64bb0b4c522482bd0d', 'request_id': 'req-4067e0f9-7fc9-4f24-951a-28978c5482d9'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:07.575977 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4067e0f9-7fc9-4f24-951a-28978c5482d9 admin admin] The token cache is being invalidate because project 5b3cb63361424d64bb0b4c522482bd0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:40:07.576665 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4067e0f9-7fc9-4f24-951a-28978c5482d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:07.577443 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4067e0f9-7fc9-4f24-951a-28978c5482d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:07.578948 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1306/2587] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:07 2022] DELETE /identity/v3/projects/5b3cb63361424d64bb0b4c522482bd0d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:07.584557 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30de1c-f885-46a6-9195-7a966d4848bf None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:07.584844 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30de1c-f885-46a6-9195-7a966d4848bf None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:07.585120 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30de1c-f885-46a6-9195-7a966d4848bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:07.606176 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-ac30de1c-f885-46a6-9195-7a966d4848bf None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:07.607454 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ac30de1c-f885-46a6-9195-7a966d4848bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:07.672095 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1282/2588] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:40:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:40:07.681559 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cf450-c2be-414f-80be-14e3fe1a6bf7 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:07.682018 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cf450-c2be-414f-80be-14e3fe1a6bf7 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:07.682430 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cf450-c2be-414f-80be-14e3fe1a6bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:07.706364 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-7d5cf450-c2be-414f-80be-14e3fe1a6bf7 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:07.707642 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7d5cf450-c2be-414f-80be-14e3fe1a6bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:07.716785 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1307/2589] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:40:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:07.720809 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30de1c-f885-46a6-9195-7a966d4848bf None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:07.727825 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:07.732905 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30de1c-f885-46a6-9195-7a966d4848bf None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:07.745907 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6aafe4-2afd-41d4-8bfe-c3e52f10b812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:07.746776 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6aafe4-2afd-41d4-8bfe-c3e52f10b812 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:07.747614 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6aafe4-2afd-41d4-8bfe-c3e52f10b812 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:07.747972 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6aafe4-2afd-41d4-8bfe-c3e52f10b812 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:07.748744 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6aafe4-2afd-41d4-8bfe-c3e52f10b812 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:40:07.749173 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6aafe4-2afd-41d4-8bfe-c3e52f10b812 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:07.751502 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6aafe4-2afd-41d4-8bfe-c3e52f10b812 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:07.768222 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1283/2590] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:40:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:40:07.769345 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5cf450-c2be-414f-80be-14e3fe1a6bf7 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:07.779584 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5cf450-c2be-414f-80be-14e3fe1a6bf7 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:07.784344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96c834-2ccd-429e-8e04-64cba305458c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:07.784974 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96c834-2ccd-429e-8e04-64cba305458c admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:07.785247 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96c834-2ccd-429e-8e04-64cba305458c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:07.785518 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96c834-2ccd-429e-8e04-64cba305458c admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:07.786915 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e96c834-2ccd-429e-8e04-64cba305458c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:07.788954 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e96c834-2ccd-429e-8e04-64cba305458c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:07.816304 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1308/2591] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:40:07 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:40:07.820217 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6aafe4-2afd-41d4-8bfe-c3e52f10b812 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:07.830521 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6aafe4-2afd-41d4-8bfe-c3e52f10b812 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:07.887720 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c150115-2d7f-4b1c-9e8c-84b3698f0d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:07.888238 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c150115-2d7f-4b1c-9e8c-84b3698f0d17 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:07.888512 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c150115-2d7f-4b1c-9e8c-84b3698f0d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:07.888779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c150115-2d7f-4b1c-9e8c-84b3698f0d17 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:07.889398 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c150115-2d7f-4b1c-9e8c-84b3698f0d17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:07.891347 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c150115-2d7f-4b1c-9e8c-84b3698f0d17 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:07.914792 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1284/2592] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:40:07 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:40:07.919260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96c834-2ccd-429e-8e04-64cba305458c admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:07.930710 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96c834-2ccd-429e-8e04-64cba305458c admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:07.935214 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda7f7b-4a86-4569-a1ba-d2693815e5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:07.935954 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda7f7b-4a86-4569-a1ba-d2693815e5e5 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:07.936365 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda7f7b-4a86-4569-a1ba-d2693815e5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:07.936705 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda7f7b-4a86-4569-a1ba-d2693815e5e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:07.937421 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda7f7b-4a86-4569-a1ba-d2693815e5e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:07.939158 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda7f7b-4a86-4569-a1ba-d2693815e5e5 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:07.950306 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1309/2593] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:40:07.954062 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c150115-2d7f-4b1c-9e8c-84b3698f0d17 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:07.965300 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c150115-2d7f-4b1c-9e8c-84b3698f0d17 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:07.970361 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe83ef-369a-4ab7-82bf-4dc9541a16cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:07.970978 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe83ef-369a-4ab7-82bf-4dc9541a16cd admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:07.971284 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe83ef-369a-4ab7-82bf-4dc9541a16cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:07.971554 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe83ef-369a-4ab7-82bf-4dc9541a16cd admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:07.972201 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe83ef-369a-4ab7-82bf-4dc9541a16cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:07.974704 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe83ef-369a-4ab7-82bf-4dc9541a16cd admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:07.986077 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1285/2594] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:40:07.990352 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda7f7b-4a86-4569-a1ba-d2693815e5e5 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:08.000955 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda7f7b-4a86-4569-a1ba-d2693815e5e5 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:08.005778 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407c633-f480-487b-bfaa-b96d49a76492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:08.006448 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407c633-f480-487b-bfaa-b96d49a76492 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:08.006727 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407c633-f480-487b-bfaa-b96d49a76492 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:08.007007 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407c633-f480-487b-bfaa-b96d49a76492 admin admin] PATH_INFO: `/v3/projects/89cf0630c24f4330a3ebb461132de7b0/users/1dc66163ccf54f19a9f2272586b3a2e3/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:08.023482 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9407c633-f480-487b-bfaa-b96d49a76492 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89cf0630c24f4330a3ebb461132de7b0, user_id=1dc66163ccf54f19a9f2272586b3a2e3, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:08.026191 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9407c633-f480-487b-bfaa-b96d49a76492 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:08.041350 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1310/2595] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:40:07 2022] PUT /identity/v3/projects/89cf0630c24f4330a3ebb461132de7b0/users/1dc66163ccf54f19a9f2272586b3a2e3/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:08.051770 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282d0f7-f7e5-4317-9d90-6528372a5ebd None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:08.052055 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282d0f7-f7e5-4317-9d90-6528372a5ebd None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:08.052323 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282d0f7-f7e5-4317-9d90-6528372a5ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:08.086955 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-f282d0f7-f7e5-4317-9d90-6528372a5ebd None None] MFA Rules not processed for user `1dc66163ccf54f19a9f2272586b3a2e3`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:08.088253 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f282d0f7-f7e5-4317-9d90-6528372a5ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:08.159817 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1286/2596] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:40:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:08.166929 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407c633-f480-487b-bfaa-b96d49a76492 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:08.179005 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:08.244891 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407c633-f480-487b-bfaa-b96d49a76492 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:08.248286 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d502a-1c6f-49db-8896-da5df5ccfdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:08.248890 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d502a-1c6f-49db-8896-da5df5ccfdc7 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:08.249182 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d502a-1c6f-49db-8896-da5df5ccfdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:08.249455 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d502a-1c6f-49db-8896-da5df5ccfdc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:08.250105 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d502a-1c6f-49db-8896-da5df5ccfdc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:08.252045 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d502a-1c6f-49db-8896-da5df5ccfdc7 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:08.285822 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1311/2597] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:40:08 2022] POST /identity/v3/projects => generated 375 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:40:08.287563 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f282d0f7-f7e5-4317-9d90-6528372a5ebd None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:08.298435 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f282d0f7-f7e5-4317-9d90-6528372a5ebd None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:08.358560 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724f01f-1901-4a17-a98a-3e9e140a8b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:08.359227 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724f01f-1901-4a17-a98a-3e9e140a8b67 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:08.359502 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724f01f-1901-4a17-a98a-3e9e140a8b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:08.359765 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724f01f-1901-4a17-a98a-3e9e140a8b67 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:08.360443 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6724f01f-1901-4a17-a98a-3e9e140a8b67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:08.362386 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6724f01f-1901-4a17-a98a-3e9e140a8b67 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:08.371239 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:08.387333 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1287/2598] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:40:08 2022] POST /identity/v3/users => generated 294 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:40:08.391492 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d502a-1c6f-49db-8896-da5df5ccfdc7 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:08.403109 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d502a-1c6f-49db-8896-da5df5ccfdc7 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:08.407929 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ef8cd3-114b-48b6-97f2-adb5c7b9dae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:08.408535 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef8cd3-114b-48b6-97f2-adb5c7b9dae6 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:08.408816 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef8cd3-114b-48b6-97f2-adb5c7b9dae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:08.409087 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef8cd3-114b-48b6-97f2-adb5c7b9dae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:08.409738 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ef8cd3-114b-48b6-97f2-adb5c7b9dae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:08.411458 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ef8cd3-114b-48b6-97f2-adb5c7b9dae6 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:08.422969 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1312/2599] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:40:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:40:08.427332 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724f01f-1901-4a17-a98a-3e9e140a8b67 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:08.438772 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724f01f-1901-4a17-a98a-3e9e140a8b67 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:08.444663 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3ca9b-94a6-4995-b881-29787cead6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:08.445480 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3ca9b-94a6-4995-b881-29787cead6a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:08.445645 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3ca9b-94a6-4995-b881-29787cead6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:08.445912 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3ca9b-94a6-4995-b881-29787cead6a1 admin admin] PATH_INFO: `/v3/projects/98def5b7062a4f87be715f44791dec42/users/8e0fed7e827e4595bdd66e2a6062d931/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:08.464785 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef3ca9b-94a6-4995-b881-29787cead6a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98def5b7062a4f87be715f44791dec42, user_id=8e0fed7e827e4595bdd66e2a6062d931, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:08.467589 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef3ca9b-94a6-4995-b881-29787cead6a1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:08.483909 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1288/2600] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:40:08 2022] PUT /identity/v3/projects/98def5b7062a4f87be715f44791dec42/users/8e0fed7e827e4595bdd66e2a6062d931/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:08.487713 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ef8cd3-114b-48b6-97f2-adb5c7b9dae6 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:08.500529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ef8cd3-114b-48b6-97f2-adb5c7b9dae6 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:08.578572 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d21f8-6f5c-4f5e-a4cf-1ffb4905b442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:08.579387 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d21f8-6f5c-4f5e-a4cf-1ffb4905b442 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:08.579819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d21f8-6f5c-4f5e-a4cf-1ffb4905b442 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:08.580100 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d21f8-6f5c-4f5e-a4cf-1ffb4905b442 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:08.580787 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d21f8-6f5c-4f5e-a4cf-1ffb4905b442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:08.582563 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d21f8-6f5c-4f5e-a4cf-1ffb4905b442 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:08.598806 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1313/2601] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:40:08 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:40:08.604226 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3ca9b-94a6-4995-b881-29787cead6a1 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:08.618575 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3ca9b-94a6-4995-b881-29787cead6a1 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:08.623479 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8006c-98a7-4101-8dc9-01775656f469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:08.624133 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8006c-98a7-4101-8dc9-01775656f469 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:08.624410 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8006c-98a7-4101-8dc9-01775656f469 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:08.624680 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8006c-98a7-4101-8dc9-01775656f469 admin admin] PATH_INFO: `/v3/projects/98def5b7062a4f87be715f44791dec42/users/8e0fed7e827e4595bdd66e2a6062d931/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:08.626626 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b8006c-98a7-4101-8dc9-01775656f469 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98def5b7062a4f87be715f44791dec42, user_id=8e0fed7e827e4595bdd66e2a6062d931, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:08.629288 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b8006c-98a7-4101-8dc9-01775656f469 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:08.640121 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1289/2602] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:40:08 2022] PUT /identity/v3/projects/98def5b7062a4f87be715f44791dec42/users/8e0fed7e827e4595bdd66e2a6062d931/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:08.651620 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fea5c1-5143-427e-82e6-da1b43f8ec40 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:08.651838 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fea5c1-5143-427e-82e6-da1b43f8ec40 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:08.652109 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fea5c1-5143-427e-82e6-da1b43f8ec40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:08.679852 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-a1fea5c1-5143-427e-82e6-da1b43f8ec40 None None] MFA Rules not processed for user `8e0fed7e827e4595bdd66e2a6062d931`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:08.681144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a1fea5c1-5143-427e-82e6-da1b43f8ec40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:08.753555 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1314/2603] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:40:08 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:08.760665 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8006c-98a7-4101-8dc9-01775656f469 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:08.772038 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8006c-98a7-4101-8dc9-01775656f469 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:08.776563 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963c2d9-3426-4cee-b9c3-811bd22c262c tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e0fed7e827e4595bdd66e2a6062d931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98def5b7062a4f87be715f44791dec42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:08.777169 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963c2d9-3426-4cee-b9c3-811bd22c262c tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:08.777448 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963c2d9-3426-4cee-b9c3-811bd22c262c tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:08.777719 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963c2d9-3426-4cee-b9c3-811bd22c262c tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:08.778505 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c963c2d9-3426-4cee-b9c3-811bd22c262c tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:40:08.778815 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c963c2d9-3426-4cee-b9c3-811bd22c262c tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:08.780474 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c963c2d9-3426-4cee-b9c3-811bd22c262c tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:08.793126 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1290/2604] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:40:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:40:08.797373 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fea5c1-5143-427e-82e6-da1b43f8ec40 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:08.803648 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:08.807771 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fea5c1-5143-427e-82e6-da1b43f8ec40 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:08.813517 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f1d97-0d21-4ac9-b7f6-63caae3c96ed tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e0fed7e827e4595bdd66e2a6062d931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98def5b7062a4f87be715f44791dec42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:08.814115 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f1d97-0d21-4ac9-b7f6-63caae3c96ed tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:08.814390 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f1d97-0d21-4ac9-b7f6-63caae3c96ed tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:08.814658 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f1d97-0d21-4ac9-b7f6-63caae3c96ed tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:08.815326 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f1d97-0d21-4ac9-b7f6-63caae3c96ed tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:08.817235 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f1d97-0d21-4ac9-b7f6-63caae3c96ed tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:08.844125 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1315/2605] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:40:08 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:40:08.848052 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963c2d9-3426-4cee-b9c3-811bd22c262c tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:08.858048 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963c2d9-3426-4cee-b9c3-811bd22c262c tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:08.918006 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879dd10-c22c-49b4-b08e-f7a0ffe75165 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e0fed7e827e4595bdd66e2a6062d931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98def5b7062a4f87be715f44791dec42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:08.918692 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879dd10-c22c-49b4-b08e-f7a0ffe75165 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:08.918794 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879dd10-c22c-49b4-b08e-f7a0ffe75165 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:08.919100 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879dd10-c22c-49b4-b08e-f7a0ffe75165 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:08.919755 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8879dd10-c22c-49b4-b08e-f7a0ffe75165 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:40:08.920068 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8879dd10-c22c-49b4-b08e-f7a0ffe75165 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:08.921742 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8879dd10-c22c-49b4-b08e-f7a0ffe75165 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:08.934453 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1291/2606] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:40:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:40:08.945037 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f1d97-0d21-4ac9-b7f6-63caae3c96ed tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:08.946844 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-747f1d97-0d21-4ac9-b7f6-63caae3c96ed tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:09.019876 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f1d97-0d21-4ac9-b7f6-63caae3c96ed tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:09.025604 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da792a6-168a-4f77-a0d8-5a98180f4e8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:09.026215 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da792a6-168a-4f77-a0d8-5a98180f4e8c service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:09.026493 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da792a6-168a-4f77-a0d8-5a98180f4e8c service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:09.026764 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da792a6-168a-4f77-a0d8-5a98180f4e8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:09.034825 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da792a6-168a-4f77-a0d8-5a98180f4e8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:09.037174 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da792a6-168a-4f77-a0d8-5a98180f4e8c service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:09.046466 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1316/2607] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:40:08 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:40:09.063519 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658c1b0-b2e4-4d58-b921-c774fb901382 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:09.063824 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658c1b0-b2e4-4d58-b921-c774fb901382 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:09.064105 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658c1b0-b2e4-4d58-b921-c774fb901382 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:09.065474 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1292/2608] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 15:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:40:09.069887 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da792a6-168a-4f77-a0d8-5a98180f4e8c service nova] Authenticating service token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:40:09.081142 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da792a6-168a-4f77-a0d8-5a98180f4e8c service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:09.089642 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da792a6-168a-4f77-a0d8-5a98180f4e8c service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:09.094530 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f2d16-caa9-4f2a-9494-cf177b0263aa tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e0fed7e827e4595bdd66e2a6062d931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98def5b7062a4f87be715f44791dec42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:09.095207 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f2d16-caa9-4f2a-9494-cf177b0263aa tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:09.095493 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f2d16-caa9-4f2a-9494-cf177b0263aa tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:09.095769 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f2d16-caa9-4f2a-9494-cf177b0263aa tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] PATH_INFO: `/v3/projects/fe9e5f1fc7494458b7eeaa8f50a51838` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:09.096903 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051f2d16-caa9-4f2a-9494-cf177b0263aa tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] RBAC: Authorizing `identity:get_project(project_id=fe9e5f1fc7494458b7eeaa8f50a51838)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:09.099512 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051f2d16-caa9-4f2a-9494-cf177b0263aa tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:09.101431 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1317/2609] 10.222.0.83 () {58 vars in 1443 bytes} [Mon Aug 29 15:40:09 2022] GET /identity/v3/projects/fe9e5f1fc7494458b7eeaa8f50a51838 => generated 369 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:40:09.190290 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e5079-9942-4b82-91a2-3ccdbd6f4816 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:09.190581 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e5079-9942-4b82-91a2-3ccdbd6f4816 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:09.190854 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e5079-9942-4b82-91a2-3ccdbd6f4816 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:09.192218 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1293/2610] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 15:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:40:09.197453 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f2d16-caa9-4f2a-9494-cf177b0263aa tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Authenticating service token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:40:09.210894 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f2d16-caa9-4f2a-9494-cf177b0263aa tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:09.219806 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f2d16-caa9-4f2a-9494-cf177b0263aa tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:09.225058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e96bca-9e4d-41b7-a7d3-0a9b9864dbfb tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e0fed7e827e4595bdd66e2a6062d931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98def5b7062a4f87be715f44791dec42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:09.225690 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e96bca-9e4d-41b7-a7d3-0a9b9864dbfb tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:09.225971 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e96bca-9e4d-41b7-a7d3-0a9b9864dbfb tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:09.226240 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e96bca-9e4d-41b7-a7d3-0a9b9864dbfb tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] PATH_INFO: `/v3/projects/fe9e5f1fc7494458b7eeaa8f50a51838` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:09.227414 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e96bca-9e4d-41b7-a7d3-0a9b9864dbfb tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] RBAC: Authorizing `identity:get_project(project_id=fe9e5f1fc7494458b7eeaa8f50a51838)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:09.229453 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e96bca-9e4d-41b7-a7d3-0a9b9864dbfb tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:09.231121 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1318/2611] 10.222.0.83 () {58 vars in 1443 bytes} [Mon Aug 29 15:40:09 2022] GET /identity/v3/projects/fe9e5f1fc7494458b7eeaa8f50a51838 => generated 369 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:40:09.285536 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e5079-9942-4b82-91a2-3ccdbd6f4816 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:09.298338 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e5079-9942-4b82-91a2-3ccdbd6f4816 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:09.304394 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ab001-e715-4050-b657-bc143a8f82a1 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e0fed7e827e4595bdd66e2a6062d931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98def5b7062a4f87be715f44791dec42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:09.305330 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ab001-e715-4050-b657-bc143a8f82a1 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:09.305612 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ab001-e715-4050-b657-bc143a8f82a1 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:09.305883 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ab001-e715-4050-b657-bc143a8f82a1 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:09.306552 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114ab001-e715-4050-b657-bc143a8f82a1 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:40:09.306861 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114ab001-e715-4050-b657-bc143a8f82a1 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:09.308500 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114ab001-e715-4050-b657-bc143a8f82a1 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:09.326241 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1294/2612] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:40:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:40:09.330619 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e96bca-9e4d-41b7-a7d3-0a9b9864dbfb tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:09.341430 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e96bca-9e4d-41b7-a7d3-0a9b9864dbfb tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:09.348305 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3ec2e-2053-4f3c-aaae-16451977e0d3 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e0fed7e827e4595bdd66e2a6062d931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98def5b7062a4f87be715f44791dec42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:09.349037 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3ec2e-2053-4f3c-aaae-16451977e0d3 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:09.349880 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3ec2e-2053-4f3c-aaae-16451977e0d3 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:09.349880 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3ec2e-2053-4f3c-aaae-16451977e0d3 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:09.350457 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b3ec2e-2053-4f3c-aaae-16451977e0d3 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:09.352575 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b3ec2e-2053-4f3c-aaae-16451977e0d3 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:09.378978 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1319/2613] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:40:09 2022] POST /identity/v3/users => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:40:09.383827 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ab001-e715-4050-b657-bc143a8f82a1 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:09.400609 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ab001-e715-4050-b657-bc143a8f82a1 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:09.406115 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a7217-b6d3-44d0-8211-0214b576e3f0 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e0fed7e827e4595bdd66e2a6062d931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98def5b7062a4f87be715f44791dec42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:09.407126 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a7217-b6d3-44d0-8211-0214b576e3f0 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:09.407126 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a7217-b6d3-44d0-8211-0214b576e3f0 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:09.407440 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a7217-b6d3-44d0-8211-0214b576e3f0 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:09.408242 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4a7217-b6d3-44d0-8211-0214b576e3f0 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:40:09.408560 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4a7217-b6d3-44d0-8211-0214b576e3f0 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:09.410221 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4a7217-b6d3-44d0-8211-0214b576e3f0 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:09.425843 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1295/2614] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:40:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:40:09.469874 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a060e-ecc7-49ec-aa98-e8460c79b09f None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:09.470401 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a060e-ecc7-49ec-aa98-e8460c79b09f None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:09.470498 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a060e-ecc7-49ec-aa98-e8460c79b09f None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:09.471825 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1320/2615] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 15:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:40:09.477564 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a7217-b6d3-44d0-8211-0214b576e3f0 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Authenticating service token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:40:09.479410 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0e4a7217-b6d3-44d0-8211-0214b576e3f0 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:09.497532 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a7217-b6d3-44d0-8211-0214b576e3f0 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:09.507308 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a7217-b6d3-44d0-8211-0214b576e3f0 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:09.511979 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933414b1-9a0b-46af-ae8b-021d32aa8b45 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e0fed7e827e4595bdd66e2a6062d931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98def5b7062a4f87be715f44791dec42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:09.512616 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933414b1-9a0b-46af-ae8b-021d32aa8b45 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:09.513047 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933414b1-9a0b-46af-ae8b-021d32aa8b45 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:09.513144 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933414b1-9a0b-46af-ae8b-021d32aa8b45 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] PATH_INFO: `/v3/projects/fe9e5f1fc7494458b7eeaa8f50a51838` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:09.514270 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933414b1-9a0b-46af-ae8b-021d32aa8b45 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] RBAC: Authorizing `identity:get_project(project_id=fe9e5f1fc7494458b7eeaa8f50a51838)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:09.516346 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933414b1-9a0b-46af-ae8b-021d32aa8b45 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:09.518256 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1296/2616] 10.222.0.83 () {58 vars in 1443 bytes} [Mon Aug 29 15:40:09 2022] GET /identity/v3/projects/fe9e5f1fc7494458b7eeaa8f50a51838 => generated 369 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:40:09.801424 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb226e-567b-4c94-8724-99233684e918 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:09.802390 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb226e-567b-4c94-8724-99233684e918 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:09.802701 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb226e-567b-4c94-8724-99233684e918 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:09.804211 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1321/2617] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 15:40:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:40:09.808859 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933414b1-9a0b-46af-ae8b-021d32aa8b45 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Authenticating service token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:40:09.822160 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933414b1-9a0b-46af-ae8b-021d32aa8b45 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:09.831015 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933414b1-9a0b-46af-ae8b-021d32aa8b45 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:09.836074 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b1b80-14b2-45b9-8866-c29806263e57 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e0fed7e827e4595bdd66e2a6062d931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98def5b7062a4f87be715f44791dec42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:09.836705 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b1b80-14b2-45b9-8866-c29806263e57 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:09.836982 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b1b80-14b2-45b9-8866-c29806263e57 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:09.837249 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b1b80-14b2-45b9-8866-c29806263e57 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] PATH_INFO: `/v3/projects/fe9e5f1fc7494458b7eeaa8f50a51838` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:09.838393 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b1b80-14b2-45b9-8866-c29806263e57 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] RBAC: Authorizing `identity:get_project(project_id=fe9e5f1fc7494458b7eeaa8f50a51838)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:09.840469 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b1b80-14b2-45b9-8866-c29806263e57 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:09.842127 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1297/2618] 10.222.0.83 () {58 vars in 1443 bytes} [Mon Aug 29 15:40:09 2022] GET /identity/v3/projects/fe9e5f1fc7494458b7eeaa8f50a51838 => generated 369 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:40:09.872845 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb226e-567b-4c94-8724-99233684e918 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:09.885426 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb226e-567b-4c94-8724-99233684e918 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:09.889890 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc0cd4-707c-46d8-916e-d772f50868d7 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e0fed7e827e4595bdd66e2a6062d931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98def5b7062a4f87be715f44791dec42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:09.890505 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc0cd4-707c-46d8-916e-d772f50868d7 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:09.890784 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc0cd4-707c-46d8-916e-d772f50868d7 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:09.891104 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc0cd4-707c-46d8-916e-d772f50868d7 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] PATH_INFO: `/v3/users/7d2dbf14950840a88ee59c39edef04fd` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:09.905472 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc0cd4-707c-46d8-916e-d772f50868d7 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7d2dbf14950840a88ee59c39edef04fd)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:09.907462 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc0cd4-707c-46d8-916e-d772f50868d7 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:09.951180 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-50bc0cd4-707c-46d8-916e-d772f50868d7 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d2dbf14950840a88ee59c39edef04fd'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:09.951855 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-50bc0cd4-707c-46d8-916e-d772f50868d7 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d2dbf14950840a88ee59c39edef04fd'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:09.964093 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-50bc0cd4-707c-46d8-916e-d772f50868d7 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d2dbf14950840a88ee59c39edef04fd'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:09.971601 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-50bc0cd4-707c-46d8-916e-d772f50868d7 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d2dbf14950840a88ee59c39edef04fd'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:09.976887 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:09.981050 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-50bc0cd4-707c-46d8-916e-d772f50868d7 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d2dbf14950840a88ee59c39edef04fd'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:09.987902 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1322/2619] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:40:09 2022] DELETE /identity/v3/users/7d2dbf14950840a88ee59c39edef04fd => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:09.992618 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b1b80-14b2-45b9-8866-c29806263e57 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:09.994272 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ba9b1b80-14b2-45b9-8866-c29806263e57 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:10.006987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b1b80-14b2-45b9-8866-c29806263e57 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:10.051348 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:10.064231 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b9723-17de-456f-8d88-5dc8f5ca8c6c tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e0fed7e827e4595bdd66e2a6062d931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98def5b7062a4f87be715f44791dec42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:10.064876 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b9723-17de-456f-8d88-5dc8f5ca8c6c tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:10.065155 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b9723-17de-456f-8d88-5dc8f5ca8c6c tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:10.065444 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b9723-17de-456f-8d88-5dc8f5ca8c6c tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] PATH_INFO: `/v3/projects/fe9e5f1fc7494458b7eeaa8f50a51838` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:10.066576 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b9723-17de-456f-8d88-5dc8f5ca8c6c tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fe9e5f1fc7494458b7eeaa8f50a51838)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:10.068565 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b9723-17de-456f-8d88-5dc8f5ca8c6c tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:10.116251 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-cf8b9723-17de-456f-8d88-5dc8f5ca8c6c tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe9e5f1fc7494458b7eeaa8f50a51838', 'request_id': 'req-cf8b9723-17de-456f-8d88-5dc8f5ca8c6c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:10.122218 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-cf8b9723-17de-456f-8d88-5dc8f5ca8c6c tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe9e5f1fc7494458b7eeaa8f50a51838', 'request_id': 'req-cf8b9723-17de-456f-8d88-5dc8f5ca8c6c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:10.128434 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-cf8b9723-17de-456f-8d88-5dc8f5ca8c6c tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe9e5f1fc7494458b7eeaa8f50a51838', 'request_id': 'req-cf8b9723-17de-456f-8d88-5dc8f5ca8c6c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:10.140609 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-cf8b9723-17de-456f-8d88-5dc8f5ca8c6c tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] The token cache is being invalidate because project fe9e5f1fc7494458b7eeaa8f50a51838 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:40:10.140901 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-cf8b9723-17de-456f-8d88-5dc8f5ca8c6c tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:10.141546 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-cf8b9723-17de-456f-8d88-5dc8f5ca8c6c tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:10.143399 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1298/2620] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:09 2022] DELETE /identity/v3/projects/fe9e5f1fc7494458b7eeaa8f50a51838 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:10.149419 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc0cd4-707c-46d8-916e-d772f50868d7 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:10.150829 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-50bc0cd4-707c-46d8-916e-d772f50868d7 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:10.216351 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc0cd4-707c-46d8-916e-d772f50868d7 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:10.272143 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcfcdf9-b6d4-4cd1-b7d5-ade85bcfeac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:10.272775 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcfcdf9-b6d4-4cd1-b7d5-ade85bcfeac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:10.273092 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcfcdf9-b6d4-4cd1-b7d5-ade85bcfeac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:10.273366 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcfcdf9-b6d4-4cd1-b7d5-ade85bcfeac4 admin admin] PATH_INFO: `/v3/users/1dc66163ccf54f19a9f2272586b3a2e3` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:10.274530 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcfcdf9-b6d4-4cd1-b7d5-ade85bcfeac4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dc66163ccf54f19a9f2272586b3a2e3)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:10.276844 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcfcdf9-b6d4-4cd1-b7d5-ade85bcfeac4 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:10.324303 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9dcfcdf9-b6d4-4cd1-b7d5-ade85bcfeac4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dc66163ccf54f19a9f2272586b3a2e3'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:10.324969 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9dcfcdf9-b6d4-4cd1-b7d5-ade85bcfeac4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dc66163ccf54f19a9f2272586b3a2e3'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:10.339043 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9dcfcdf9-b6d4-4cd1-b7d5-ade85bcfeac4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dc66163ccf54f19a9f2272586b3a2e3'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:10.346842 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9dcfcdf9-b6d4-4cd1-b7d5-ade85bcfeac4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dc66163ccf54f19a9f2272586b3a2e3'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:10.355433 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9dcfcdf9-b6d4-4cd1-b7d5-ade85bcfeac4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dc66163ccf54f19a9f2272586b3a2e3'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:10.361761 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1323/2621] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:40:10 2022] DELETE /identity/v3/users/1dc66163ccf54f19a9f2272586b3a2e3 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:10.366125 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c8414-cf0a-4d8c-b2df-542f88aadcce None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:10.366412 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c8414-cf0a-4d8c-b2df-542f88aadcce None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:10.366688 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c8414-cf0a-4d8c-b2df-542f88aadcce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:10.386626 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-4c4c8414-cf0a-4d8c-b2df-542f88aadcce None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:10.387937 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4c4c8414-cf0a-4d8c-b2df-542f88aadcce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:10.449919 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1299/2622] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:40:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:40:10.460864 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcfcdf9-b6d4-4cd1-b7d5-ade85bcfeac4 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:10.463201 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9dcfcdf9-b6d4-4cd1-b7d5-ade85bcfeac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:10.500684 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:10.543906 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcfcdf9-b6d4-4cd1-b7d5-ade85bcfeac4 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:10.547761 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92788d6-6b98-44bc-9f9d-e808cde39483 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:10.548369 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92788d6-6b98-44bc-9f9d-e808cde39483 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:10.548645 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92788d6-6b98-44bc-9f9d-e808cde39483 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:10.548915 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92788d6-6b98-44bc-9f9d-e808cde39483 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:10.558671 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92788d6-6b98-44bc-9f9d-e808cde39483 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:10.560164 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92788d6-6b98-44bc-9f9d-e808cde39483 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:10.571776 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1324/2623] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:40:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:40:11.014754 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c8414-cf0a-4d8c-b2df-542f88aadcce None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:11.016242 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4c4c8414-cf0a-4d8c-b2df-542f88aadcce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:11.049167 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c8414-cf0a-4d8c-b2df-542f88aadcce None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:11.055244 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d3d5e-782a-4350-8ada-589e972661d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:11.055931 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d3d5e-782a-4350-8ada-589e972661d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:11.056206 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d3d5e-782a-4350-8ada-589e972661d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:11.056516 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d3d5e-782a-4350-8ada-589e972661d2 admin admin] PATH_INFO: `/v3/projects/89cf0630c24f4330a3ebb461132de7b0` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:11.057756 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d3d5e-782a-4350-8ada-589e972661d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89cf0630c24f4330a3ebb461132de7b0)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:11.059773 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d3d5e-782a-4350-8ada-589e972661d2 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:11.114500 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7f5d3d5e-782a-4350-8ada-589e972661d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89cf0630c24f4330a3ebb461132de7b0', 'request_id': 'req-7f5d3d5e-782a-4350-8ada-589e972661d2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:11.120518 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7f5d3d5e-782a-4350-8ada-589e972661d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89cf0630c24f4330a3ebb461132de7b0', 'request_id': 'req-7f5d3d5e-782a-4350-8ada-589e972661d2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:11.128007 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7f5d3d5e-782a-4350-8ada-589e972661d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89cf0630c24f4330a3ebb461132de7b0', 'request_id': 'req-7f5d3d5e-782a-4350-8ada-589e972661d2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:11.141141 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7f5d3d5e-782a-4350-8ada-589e972661d2 admin admin] The token cache is being invalidate because project 89cf0630c24f4330a3ebb461132de7b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:40:11.141424 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7f5d3d5e-782a-4350-8ada-589e972661d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:11.142427 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7f5d3d5e-782a-4350-8ada-589e972661d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:11.143970 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1300/2624] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:11 2022] DELETE /identity/v3/projects/89cf0630c24f4330a3ebb461132de7b0 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:11.148715 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92788d6-6b98-44bc-9f9d-e808cde39483 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:11.158420 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92788d6-6b98-44bc-9f9d-e808cde39483 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:11.222457 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d69fe-7fa3-4cf1-b14f-428e5d28b11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:11.223205 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d69fe-7fa3-4cf1-b14f-428e5d28b11e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:11.223505 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d69fe-7fa3-4cf1-b14f-428e5d28b11e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:11.223789 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d69fe-7fa3-4cf1-b14f-428e5d28b11e admin admin] PATH_INFO: `/v3/users/8e0fed7e827e4595bdd66e2a6062d931` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:11.224949 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d69fe-7fa3-4cf1-b14f-428e5d28b11e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e0fed7e827e4595bdd66e2a6062d931)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:11.226879 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d69fe-7fa3-4cf1-b14f-428e5d28b11e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:11.284070 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-989d69fe-7fa3-4cf1-b14f-428e5d28b11e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e0fed7e827e4595bdd66e2a6062d931'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:11.284719 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-989d69fe-7fa3-4cf1-b14f-428e5d28b11e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e0fed7e827e4595bdd66e2a6062d931'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:11.297029 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-989d69fe-7fa3-4cf1-b14f-428e5d28b11e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e0fed7e827e4595bdd66e2a6062d931'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:11.305462 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-989d69fe-7fa3-4cf1-b14f-428e5d28b11e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e0fed7e827e4595bdd66e2a6062d931'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:11.312657 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-989d69fe-7fa3-4cf1-b14f-428e5d28b11e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e0fed7e827e4595bdd66e2a6062d931'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:11.319310 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1325/2625] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:40:11 2022] DELETE /identity/v3/users/8e0fed7e827e4595bdd66e2a6062d931 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:11.603323 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d3d5e-782a-4350-8ada-589e972661d2 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:11.604933 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7f5d3d5e-782a-4350-8ada-589e972661d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:11.616152 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:11.622983 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d3d5e-782a-4350-8ada-589e972661d2 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:11.688221 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa71e1-151d-49de-8d08-950cc84f611f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:11.688854 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa71e1-151d-49de-8d08-950cc84f611f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:11.689129 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa71e1-151d-49de-8d08-950cc84f611f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:11.689398 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa71e1-151d-49de-8d08-950cc84f611f admin admin] PATH_INFO: `/v3/projects/98def5b7062a4f87be715f44791dec42` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:11.690514 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa71e1-151d-49de-8d08-950cc84f611f admin admin] RBAC: Authorizing `identity:delete_project(project_id=98def5b7062a4f87be715f44791dec42)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:11.693123 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa71e1-151d-49de-8d08-950cc84f611f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:11.753604 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b2aa71e1-151d-49de-8d08-950cc84f611f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98def5b7062a4f87be715f44791dec42', 'request_id': 'req-b2aa71e1-151d-49de-8d08-950cc84f611f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:11.762854 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b2aa71e1-151d-49de-8d08-950cc84f611f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98def5b7062a4f87be715f44791dec42', 'request_id': 'req-b2aa71e1-151d-49de-8d08-950cc84f611f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:11.771506 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b2aa71e1-151d-49de-8d08-950cc84f611f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98def5b7062a4f87be715f44791dec42', 'request_id': 'req-b2aa71e1-151d-49de-8d08-950cc84f611f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:11.787445 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b2aa71e1-151d-49de-8d08-950cc84f611f admin admin] The token cache is being invalidate because project 98def5b7062a4f87be715f44791dec42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:40:11.787947 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b2aa71e1-151d-49de-8d08-950cc84f611f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:11.788987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b2aa71e1-151d-49de-8d08-950cc84f611f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:11.790648 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1301/2626] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:11 2022] DELETE /identity/v3/projects/98def5b7062a4f87be715f44791dec42 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:11.796874 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0f64c-c3d5-410c-8910-538ac01f4248 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:11.798025 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0f64c-c3d5-410c-8910-538ac01f4248 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:11.798510 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0f64c-c3d5-410c-8910-538ac01f4248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:11.824332 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-e2b0f64c-c3d5-410c-8910-538ac01f4248 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:11.826065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e2b0f64c-c3d5-410c-8910-538ac01f4248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:11.887386 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:11.928785 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1326/2627] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:40:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:11.936826 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee187569-f432-41e1-8086-95006d4ca28b None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:11.937245 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee187569-f432-41e1-8086-95006d4ca28b None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:11.937649 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee187569-f432-41e1-8086-95006d4ca28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:11.979561 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-ee187569-f432-41e1-8086-95006d4ca28b None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:11.981439 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ee187569-f432-41e1-8086-95006d4ca28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:12.001332 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1302/2628] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:40:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:12.006411 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b0f64c-c3d5-410c-8910-538ac01f4248 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:12.017491 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b0f64c-c3d5-410c-8910-538ac01f4248 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:12.028078 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33453b15-cdc9-4cfe-b0dc-5462d279c930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:12.028696 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33453b15-cdc9-4cfe-b0dc-5462d279c930 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:12.028969 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33453b15-cdc9-4cfe-b0dc-5462d279c930 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:12.029235 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33453b15-cdc9-4cfe-b0dc-5462d279c930 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:12.031067 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33453b15-cdc9-4cfe-b0dc-5462d279c930 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:40:12.031067 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33453b15-cdc9-4cfe-b0dc-5462d279c930 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:12.032304 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33453b15-cdc9-4cfe-b0dc-5462d279c930 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:12.049196 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1327/2629] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:40:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:40:12.050202 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee187569-f432-41e1-8086-95006d4ca28b None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:12.060691 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee187569-f432-41e1-8086-95006d4ca28b None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:12.066146 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8f6f6-c762-4ce6-aa53-1a1975d64f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:12.066756 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8f6f6-c762-4ce6-aa53-1a1975d64f01 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:12.067051 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8f6f6-c762-4ce6-aa53-1a1975d64f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:12.067614 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8f6f6-c762-4ce6-aa53-1a1975d64f01 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:12.068462 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb8f6f6-c762-4ce6-aa53-1a1975d64f01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:12.070392 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb8f6f6-c762-4ce6-aa53-1a1975d64f01 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:12.102266 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1303/2630] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:40:12 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:40:12.107953 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33453b15-cdc9-4cfe-b0dc-5462d279c930 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:12.124936 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33453b15-cdc9-4cfe-b0dc-5462d279c930 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:12.213479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4925b-c8dc-4e2c-b6a1-2543d3b2ca25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:12.214144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4925b-c8dc-4e2c-b6a1-2543d3b2ca25 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:12.214425 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4925b-c8dc-4e2c-b6a1-2543d3b2ca25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:12.214909 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4925b-c8dc-4e2c-b6a1-2543d3b2ca25 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:12.215600 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b4925b-c8dc-4e2c-b6a1-2543d3b2ca25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:12.217552 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b4925b-c8dc-4e2c-b6a1-2543d3b2ca25 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:12.243081 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1328/2631] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:40:12 2022] POST /identity/v3/users => generated 290 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:40:12.245526 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8f6f6-c762-4ce6-aa53-1a1975d64f01 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:12.255841 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8f6f6-c762-4ce6-aa53-1a1975d64f01 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:12.260587 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b56a28-24e2-454f-bbca-e7e4ba321e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:12.261285 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b56a28-24e2-454f-bbca-e7e4ba321e24 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:12.261565 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b56a28-24e2-454f-bbca-e7e4ba321e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:12.261835 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b56a28-24e2-454f-bbca-e7e4ba321e24 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:12.262474 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b56a28-24e2-454f-bbca-e7e4ba321e24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:12.264191 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b56a28-24e2-454f-bbca-e7e4ba321e24 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:12.275503 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1304/2632] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:40:12.279788 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4925b-c8dc-4e2c-b6a1-2543d3b2ca25 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:12.291201 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4925b-c8dc-4e2c-b6a1-2543d3b2ca25 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:12.296001 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7bd24-3cc7-4e5c-8414-ba42dcdbf3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:12.296558 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7bd24-3cc7-4e5c-8414-ba42dcdbf3a5 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:12.296840 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7bd24-3cc7-4e5c-8414-ba42dcdbf3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:12.297109 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7bd24-3cc7-4e5c-8414-ba42dcdbf3a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:12.297756 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb7bd24-3cc7-4e5c-8414-ba42dcdbf3a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:12.299393 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb7bd24-3cc7-4e5c-8414-ba42dcdbf3a5 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:12.310835 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1329/2633] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:40:12.315005 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b56a28-24e2-454f-bbca-e7e4ba321e24 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:12.325981 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b56a28-24e2-454f-bbca-e7e4ba321e24 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:12.331239 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a954f-fe47-4e44-b151-62fed350040c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:12.331985 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a954f-fe47-4e44-b151-62fed350040c admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:12.332260 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a954f-fe47-4e44-b151-62fed350040c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:12.332531 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a954f-fe47-4e44-b151-62fed350040c admin admin] PATH_INFO: `/v3/projects/30fdd0aadd2645a7924a9df2812307c8/users/408d9bbcf4c44fd294f4db903fb99df5/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:12.351155 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108a954f-fe47-4e44-b151-62fed350040c admin admin] RBAC: Authorizing `identity:create_grant(project_id=30fdd0aadd2645a7924a9df2812307c8, user_id=408d9bbcf4c44fd294f4db903fb99df5, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:12.351836 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108a954f-fe47-4e44-b151-62fed350040c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:12.365633 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1305/2634] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:40:12 2022] PUT /identity/v3/projects/30fdd0aadd2645a7924a9df2812307c8/users/408d9bbcf4c44fd294f4db903fb99df5/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:12.438668 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdaf337-746f-452a-9035-e61c15185748 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:12.438960 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdaf337-746f-452a-9035-e61c15185748 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:12.439260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdaf337-746f-452a-9035-e61c15185748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:12.471587 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-9cdaf337-746f-452a-9035-e61c15185748 None None] MFA Rules not processed for user `408d9bbcf4c44fd294f4db903fb99df5`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:12.473125 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9cdaf337-746f-452a-9035-e61c15185748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:12.540992 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1330/2635] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:40:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:12.545537 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a954f-fe47-4e44-b151-62fed350040c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:12.580124 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:12.621366 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a954f-fe47-4e44-b151-62fed350040c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:12.626631 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1c4c4-82db-4ec0-8362-04d1e93d7635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:12.627446 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1c4c4-82db-4ec0-8362-04d1e93d7635 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:12.627727 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1c4c4-82db-4ec0-8362-04d1e93d7635 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:12.628017 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1c4c4-82db-4ec0-8362-04d1e93d7635 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:12.628646 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1c4c4-82db-4ec0-8362-04d1e93d7635 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:12.631418 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1c4c4-82db-4ec0-8362-04d1e93d7635 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:12.673414 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1306/2636] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:40:12 2022] POST /identity/v3/projects => generated 381 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:40:12.678511 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdaf337-746f-452a-9035-e61c15185748 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:12.690450 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdaf337-746f-452a-9035-e61c15185748 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:12.736475 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:12.770223 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bbc100-da6f-496c-9d94-28842d0ee695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:12.771197 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bbc100-da6f-496c-9d94-28842d0ee695 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:12.771633 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bbc100-da6f-496c-9d94-28842d0ee695 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:12.771991 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bbc100-da6f-496c-9d94-28842d0ee695 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:12.772653 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bbc100-da6f-496c-9d94-28842d0ee695 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:12.774663 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bbc100-da6f-496c-9d94-28842d0ee695 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:12.799135 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1331/2637] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:40:12 2022] POST /identity/v3/users => generated 297 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:40:12.803402 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1c4c4-82db-4ec0-8362-04d1e93d7635 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:12.813989 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1c4c4-82db-4ec0-8362-04d1e93d7635 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:12.818764 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9334a437-af84-4b48-b2da-7b62fc02400f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:12.819404 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334a437-af84-4b48-b2da-7b62fc02400f admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:12.819681 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334a437-af84-4b48-b2da-7b62fc02400f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:12.820176 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334a437-af84-4b48-b2da-7b62fc02400f admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:12.820665 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9334a437-af84-4b48-b2da-7b62fc02400f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:12.822659 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9334a437-af84-4b48-b2da-7b62fc02400f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:12.834292 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1307/2638] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:40:12.838243 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bbc100-da6f-496c-9d94-28842d0ee695 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:12.848393 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bbc100-da6f-496c-9d94-28842d0ee695 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:12.854875 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d38682-732b-48c2-bca4-56e4668ee8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:12.855775 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d38682-732b-48c2-bca4-56e4668ee8ae admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:12.856203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d38682-732b-48c2-bca4-56e4668ee8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:12.856627 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d38682-732b-48c2-bca4-56e4668ee8ae admin admin] PATH_INFO: `/v3/projects/35837ff3c7364ab8afd47e3c34c6f7c8/users/98ef39fc75c94747b299e859a737ae73/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:12.875385 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d38682-732b-48c2-bca4-56e4668ee8ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=35837ff3c7364ab8afd47e3c34c6f7c8, user_id=98ef39fc75c94747b299e859a737ae73, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:12.878491 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d38682-732b-48c2-bca4-56e4668ee8ae admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:12.894133 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1332/2639] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:40:12 2022] PUT /identity/v3/projects/35837ff3c7364ab8afd47e3c34c6f7c8/users/98ef39fc75c94747b299e859a737ae73/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:12.898726 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9334a437-af84-4b48-b2da-7b62fc02400f admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:12.910520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9334a437-af84-4b48-b2da-7b62fc02400f admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:13.031531 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf16689-a18d-43b2-a665-ad9fc60e76b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:13.032171 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf16689-a18d-43b2-a665-ad9fc60e76b6 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:13.032465 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf16689-a18d-43b2-a665-ad9fc60e76b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:13.033581 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf16689-a18d-43b2-a665-ad9fc60e76b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:13.034415 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf16689-a18d-43b2-a665-ad9fc60e76b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:13.036729 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf16689-a18d-43b2-a665-ad9fc60e76b6 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:13.055114 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1308/2640] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:40:13.058782 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d38682-732b-48c2-bca4-56e4668ee8ae admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:13.080813 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d38682-732b-48c2-bca4-56e4668ee8ae admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:13.093456 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189f4a5-bc85-406b-9dba-492d6df1b1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:13.094146 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189f4a5-bc85-406b-9dba-492d6df1b1c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:13.094566 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189f4a5-bc85-406b-9dba-492d6df1b1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:13.094843 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189f4a5-bc85-406b-9dba-492d6df1b1c4 admin admin] PATH_INFO: `/v3/projects/35837ff3c7364ab8afd47e3c34c6f7c8/users/98ef39fc75c94747b299e859a737ae73/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:13.096826 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2189f4a5-bc85-406b-9dba-492d6df1b1c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35837ff3c7364ab8afd47e3c34c6f7c8, user_id=98ef39fc75c94747b299e859a737ae73, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:13.100161 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2189f4a5-bc85-406b-9dba-492d6df1b1c4 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:13.131860 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d90333-3c3d-4d2b-9f5e-4ebcc4b97d6a None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:13.132109 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1333/2641] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:40:13 2022] PUT /identity/v3/projects/35837ff3c7364ab8afd47e3c34c6f7c8/users/98ef39fc75c94747b299e859a737ae73/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:40:13.132211 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d90333-3c3d-4d2b-9f5e-4ebcc4b97d6a None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:13.132396 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d90333-3c3d-4d2b-9f5e-4ebcc4b97d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:13.176203 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-86d90333-3c3d-4d2b-9f5e-4ebcc4b97d6a None None] MFA Rules not processed for user `98ef39fc75c94747b299e859a737ae73`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:13.177992 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-86d90333-3c3d-4d2b-9f5e-4ebcc4b97d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:13.276699 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1309/2642] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:40:13 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:13.463778 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189f4a5-bc85-406b-9dba-492d6df1b1c4 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:13.465454 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2189f4a5-bc85-406b-9dba-492d6df1b1c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:13.548972 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189f4a5-bc85-406b-9dba-492d6df1b1c4 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:13.555078 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372617d-6533-45fa-9205-b92f0b77b6d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:13.555694 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372617d-6533-45fa-9205-b92f0b77b6d5 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:13.555967 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372617d-6533-45fa-9205-b92f0b77b6d5 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:13.556235 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372617d-6533-45fa-9205-b92f0b77b6d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:13.564615 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f372617d-6533-45fa-9205-b92f0b77b6d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:13.566179 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f372617d-6533-45fa-9205-b92f0b77b6d5 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:13.576622 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1334/2643] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:40:13 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:40:13.592985 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bb239-f5b2-48bc-bf5a-f91a05a7553b None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:13.593341 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bb239-f5b2-48bc-bf5a-f91a05a7553b None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:13.593687 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bb239-f5b2-48bc-bf5a-f91a05a7553b None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:13.595186 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1310/2644] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 15:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:40:13.601043 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372617d-6533-45fa-9205-b92f0b77b6d5 service nova] Authenticating service token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:40:13.613593 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372617d-6533-45fa-9205-b92f0b77b6d5 service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:13.625761 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372617d-6533-45fa-9205-b92f0b77b6d5 service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:13.631203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b613ae64-4a12-4098-899a-e02bfe0e9b3e tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ef39fc75c94747b299e859a737ae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35837ff3c7364ab8afd47e3c34c6f7c8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:13.632015 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613ae64-4a12-4098-899a-e02bfe0e9b3e tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:13.632532 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613ae64-4a12-4098-899a-e02bfe0e9b3e tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:13.632895 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613ae64-4a12-4098-899a-e02bfe0e9b3e tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] PATH_INFO: `/v3/projects/30fdd0aadd2645a7924a9df2812307c8` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:13.634205 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b613ae64-4a12-4098-899a-e02bfe0e9b3e tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] RBAC: Authorizing `identity:get_project(project_id=30fdd0aadd2645a7924a9df2812307c8)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:13.636403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b613ae64-4a12-4098-899a-e02bfe0e9b3e tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:13.639017 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1335/2645] 10.222.0.83 () {58 vars in 1443 bytes} [Mon Aug 29 15:40:13 2022] GET /identity/v3/projects/30fdd0aadd2645a7924a9df2812307c8 => generated 379 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:40:13.683171 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee40f7-db76-4010-8800-e2f35cbc9329 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:13.683507 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee40f7-db76-4010-8800-e2f35cbc9329 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:13.683863 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee40f7-db76-4010-8800-e2f35cbc9329 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:13.686147 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1311/2646] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 15:40:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:40:13.691898 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b613ae64-4a12-4098-899a-e02bfe0e9b3e tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Authenticating service token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:40:13.707792 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b613ae64-4a12-4098-899a-e02bfe0e9b3e tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:13.718703 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b613ae64-4a12-4098-899a-e02bfe0e9b3e tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:13.723979 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e6048-49e4-47ec-90fe-5d412f26f953 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ef39fc75c94747b299e859a737ae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35837ff3c7364ab8afd47e3c34c6f7c8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:13.724645 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e6048-49e4-47ec-90fe-5d412f26f953 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:13.724645 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e6048-49e4-47ec-90fe-5d412f26f953 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:13.724645 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e6048-49e4-47ec-90fe-5d412f26f953 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] PATH_INFO: `/v3/projects/30fdd0aadd2645a7924a9df2812307c8` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:13.726305 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e6048-49e4-47ec-90fe-5d412f26f953 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] RBAC: Authorizing `identity:get_project(project_id=30fdd0aadd2645a7924a9df2812307c8)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:13.728641 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e6048-49e4-47ec-90fe-5d412f26f953 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:13.730308 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1336/2647] 10.222.0.83 () {58 vars in 1443 bytes} [Mon Aug 29 15:40:13 2022] GET /identity/v3/projects/30fdd0aadd2645a7924a9df2812307c8 => generated 379 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:40:13.813008 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332d7ac-c4f5-4246-91c5-8d8fd34a0e49 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:13.813295 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332d7ac-c4f5-4246-91c5-8d8fd34a0e49 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:13.813570 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332d7ac-c4f5-4246-91c5-8d8fd34a0e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:13.833891 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-9332d7ac-c4f5-4246-91c5-8d8fd34a0e49 None None] MFA Rules not processed for user `408d9bbcf4c44fd294f4db903fb99df5`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:13.835053 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9332d7ac-c4f5-4246-91c5-8d8fd34a0e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:13.856756 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:13.894276 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1312/2648] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:40:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:13.907365 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e6048-49e4-47ec-90fe-5d412f26f953 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:13.909580 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-943e6048-49e4-47ec-90fe-5d412f26f953 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:13.926253 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e6048-49e4-47ec-90fe-5d412f26f953 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:13.932242 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95388d-4fca-40b4-8996-73fc6f4a10c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:13.932855 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95388d-4fca-40b4-8996-73fc6f4a10c0 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:13.933129 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95388d-4fca-40b4-8996-73fc6f4a10c0 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:13.933400 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95388d-4fca-40b4-8996-73fc6f4a10c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:13.941537 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db95388d-4fca-40b4-8996-73fc6f4a10c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:13.943344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db95388d-4fca-40b4-8996-73fc6f4a10c0 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:13.952479 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1337/2649] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:40:13 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:40:14.373199 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403257a-2d63-42cc-a00b-58630bb06af3 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:14.373749 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403257a-2d63-42cc-a00b-58630bb06af3 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:14.374874 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403257a-2d63-42cc-a00b-58630bb06af3 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:14.377559 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1313/2650] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 15:40:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:40:14.383078 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95388d-4fca-40b4-8996-73fc6f4a10c0 service nova] Authenticating service token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:40:14.394890 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95388d-4fca-40b4-8996-73fc6f4a10c0 service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:14.404983 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95388d-4fca-40b4-8996-73fc6f4a10c0 service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:14.409977 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc63ed-d4b7-4bbf-a4b6-01867d95d98f tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ef39fc75c94747b299e859a737ae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35837ff3c7364ab8afd47e3c34c6f7c8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:14.410664 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc63ed-d4b7-4bbf-a4b6-01867d95d98f tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:14.410937 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc63ed-d4b7-4bbf-a4b6-01867d95d98f tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:14.411781 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc63ed-d4b7-4bbf-a4b6-01867d95d98f tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] PATH_INFO: `/v3/projects/30fdd0aadd2645a7924a9df2812307c8` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:14.412955 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc63ed-d4b7-4bbf-a4b6-01867d95d98f tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] RBAC: Authorizing `identity:get_project(project_id=30fdd0aadd2645a7924a9df2812307c8)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:14.415015 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc63ed-d4b7-4bbf-a4b6-01867d95d98f tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:14.417059 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1338/2651] 10.222.0.83 () {58 vars in 1443 bytes} [Mon Aug 29 15:40:14 2022] GET /identity/v3/projects/30fdd0aadd2645a7924a9df2812307c8 => generated 379 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:40:14.705848 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7df74-c7c4-4171-b55e-76570266ba9d None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:14.705962 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7df74-c7c4-4171-b55e-76570266ba9d None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:14.706308 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7df74-c7c4-4171-b55e-76570266ba9d None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:14.707655 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1314/2652] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 15:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:40:14.714823 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc63ed-d4b7-4bbf-a4b6-01867d95d98f tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Authenticating service token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:40:14.734700 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc63ed-d4b7-4bbf-a4b6-01867d95d98f tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:14.749739 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc63ed-d4b7-4bbf-a4b6-01867d95d98f tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:14.754109 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446c5a0-f0b1-4252-862a-c588b897cde1 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ef39fc75c94747b299e859a737ae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35837ff3c7364ab8afd47e3c34c6f7c8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:14.754859 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446c5a0-f0b1-4252-862a-c588b897cde1 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:14.755177 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446c5a0-f0b1-4252-862a-c588b897cde1 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:14.755581 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446c5a0-f0b1-4252-862a-c588b897cde1 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] PATH_INFO: `/v3/projects/30fdd0aadd2645a7924a9df2812307c8` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:14.756644 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a446c5a0-f0b1-4252-862a-c588b897cde1 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] RBAC: Authorizing `identity:get_project(project_id=30fdd0aadd2645a7924a9df2812307c8)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:14.758896 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a446c5a0-f0b1-4252-862a-c588b897cde1 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:14.761739 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1339/2653] 10.222.0.83 () {58 vars in 1443 bytes} [Mon Aug 29 15:40:14 2022] GET /identity/v3/projects/30fdd0aadd2645a7924a9df2812307c8 => generated 379 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:40:15.152713 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333340d-9585-4e23-a7ed-ba052c708297 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:15.153532 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333340d-9585-4e23-a7ed-ba052c708297 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:15.153532 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333340d-9585-4e23-a7ed-ba052c708297 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:15.154609 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1315/2654] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 15:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:40:15.159654 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446c5a0-f0b1-4252-862a-c588b897cde1 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Authenticating service token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:40:15.173391 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446c5a0-f0b1-4252-862a-c588b897cde1 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:15.185001 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446c5a0-f0b1-4252-862a-c588b897cde1 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:15.190641 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4b267-a024-4095-bde7-68e884a28159 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ef39fc75c94747b299e859a737ae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35837ff3c7364ab8afd47e3c34c6f7c8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:15.191659 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4b267-a024-4095-bde7-68e884a28159 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:15.192207 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4b267-a024-4095-bde7-68e884a28159 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:15.193305 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4b267-a024-4095-bde7-68e884a28159 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] PATH_INFO: `/v3/projects/30fdd0aadd2645a7924a9df2812307c8` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:15.194657 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b4b267-a024-4095-bde7-68e884a28159 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] RBAC: Authorizing `identity:get_project(project_id=30fdd0aadd2645a7924a9df2812307c8)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:15.196926 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b4b267-a024-4095-bde7-68e884a28159 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:15.199267 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1340/2655] 10.222.0.83 () {58 vars in 1443 bytes} [Mon Aug 29 15:40:15 2022] GET /identity/v3/projects/30fdd0aadd2645a7924a9df2812307c8 => generated 379 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:40:15.293868 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c3798-02a0-4d9b-bd7c-bf4ef6224e17 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:15.294336 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c3798-02a0-4d9b-bd7c-bf4ef6224e17 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:15.295300 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c3798-02a0-4d9b-bd7c-bf4ef6224e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:15.350234 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad9555-3225-4a96-963c-2a0292672d68 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:15.350666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad9555-3225-4a96-963c-2a0292672d68 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:15.351111 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad9555-3225-4a96-963c-2a0292672d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:15.359244 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-893c3798-02a0-4d9b-bd7c-bf4ef6224e17 None None] MFA Rules not processed for user `408d9bbcf4c44fd294f4db903fb99df5`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:15.360695 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-893c3798-02a0-4d9b-bd7c-bf4ef6224e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:15.371085 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1316/2656] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:40:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:15.376709 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-c6ad9555-3225-4a96-963c-2a0292672d68 None None] MFA Rules not processed for user `253947a5ef294d2bb828761873251bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:15.378354 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c6ad9555-3225-4a96-963c-2a0292672d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:15.392733 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1341/2657] 10.222.0.83 () {58 vars in 1018 bytes} [Mon Aug 29 15:40:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:40:15.433986 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c3798-02a0-4d9b-bd7c-bf4ef6224e17 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:15.435547 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-893c3798-02a0-4d9b-bd7c-bf4ef6224e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:15.534282 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c3798-02a0-4d9b-bd7c-bf4ef6224e17 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:15.538993 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b30f3-22dd-4ad3-bbcf-df0543e09659 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:15.539997 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b30f3-22dd-4ad3-bbcf-df0543e09659 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:15.540433 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b30f3-22dd-4ad3-bbcf-df0543e09659 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:15.540952 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b30f3-22dd-4ad3-bbcf-df0543e09659 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:15.553872 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903b30f3-22dd-4ad3-bbcf-df0543e09659 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:15.555741 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903b30f3-22dd-4ad3-bbcf-df0543e09659 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:15.569407 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1317/2658] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:40:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:40:16.173417 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085cae6-3092-4323-8dc8-1e51df905461 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:16.174341 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085cae6-3092-4323-8dc8-1e51df905461 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:16.174626 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085cae6-3092-4323-8dc8-1e51df905461 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:16.176215 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1342/2659] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 15:40:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:40:16.182427 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b30f3-22dd-4ad3-bbcf-df0543e09659 service neutron] Authenticating service token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:40:16.195053 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b30f3-22dd-4ad3-bbcf-df0543e09659 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:16.207362 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b30f3-22dd-4ad3-bbcf-df0543e09659 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:16.212923 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03ba85-3856-4293-899a-c1fd08ed4064 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ef39fc75c94747b299e859a737ae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35837ff3c7364ab8afd47e3c34c6f7c8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:16.213494 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03ba85-3856-4293-899a-c1fd08ed4064 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:16.214255 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03ba85-3856-4293-899a-c1fd08ed4064 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:16.214255 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03ba85-3856-4293-899a-c1fd08ed4064 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] PATH_INFO: `/v3/projects/30fdd0aadd2645a7924a9df2812307c8` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:16.215262 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f03ba85-3856-4293-899a-c1fd08ed4064 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] RBAC: Authorizing `identity:get_project(project_id=30fdd0aadd2645a7924a9df2812307c8)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:16.217315 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f03ba85-3856-4293-899a-c1fd08ed4064 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:16.219845 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1318/2660] 10.222.0.83 () {58 vars in 1443 bytes} [Mon Aug 29 15:40:16 2022] GET /identity/v3/projects/30fdd0aadd2645a7924a9df2812307c8 => generated 379 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:40:16.689961 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39bd3e-8107-49df-b564-b4fd4f709836 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:16.690248 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39bd3e-8107-49df-b564-b4fd4f709836 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:16.690579 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39bd3e-8107-49df-b564-b4fd4f709836 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:16.692060 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1343/2661] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 15:40:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:40:16.702356 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03ba85-3856-4293-899a-c1fd08ed4064 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Authenticating service token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:40:16.724858 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03ba85-3856-4293-899a-c1fd08ed4064 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:16.759870 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03ba85-3856-4293-899a-c1fd08ed4064 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:16.765863 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ed55f-cfd4-475f-85d4-3cedefce38b0 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ef39fc75c94747b299e859a737ae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35837ff3c7364ab8afd47e3c34c6f7c8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:16.767713 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ed55f-cfd4-475f-85d4-3cedefce38b0 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:16.768183 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ed55f-cfd4-475f-85d4-3cedefce38b0 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:16.768627 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ed55f-cfd4-475f-85d4-3cedefce38b0 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] PATH_INFO: `/v3/projects/30fdd0aadd2645a7924a9df2812307c8` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:16.769969 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ed55f-cfd4-475f-85d4-3cedefce38b0 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] RBAC: Authorizing `identity:get_project(project_id=30fdd0aadd2645a7924a9df2812307c8)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:16.774006 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ed55f-cfd4-475f-85d4-3cedefce38b0 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:16.786156 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1319/2662] 10.222.0.83 () {58 vars in 1443 bytes} [Mon Aug 29 15:40:16 2022] GET /identity/v3/projects/30fdd0aadd2645a7924a9df2812307c8 => generated 379 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:40:16.820069 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ac42c-da5c-4e87-b85f-9766ad9ce906 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:16.820745 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ac42c-da5c-4e87-b85f-9766ad9ce906 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:16.821142 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ac42c-da5c-4e87-b85f-9766ad9ce906 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:16.822646 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1344/2663] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 15:40:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:40:16.834075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ed55f-cfd4-475f-85d4-3cedefce38b0 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Authenticating service token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:40:16.852414 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ed55f-cfd4-475f-85d4-3cedefce38b0 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:16.866515 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ed55f-cfd4-475f-85d4-3cedefce38b0 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:16.871334 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e928832-9525-4b71-b26b-ebf4c4a74b30 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ef39fc75c94747b299e859a737ae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35837ff3c7364ab8afd47e3c34c6f7c8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:16.871970 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e928832-9525-4b71-b26b-ebf4c4a74b30 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:16.872867 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e928832-9525-4b71-b26b-ebf4c4a74b30 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:16.872867 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e928832-9525-4b71-b26b-ebf4c4a74b30 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] PATH_INFO: `/v3/projects/30fdd0aadd2645a7924a9df2812307c8` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:16.873854 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e928832-9525-4b71-b26b-ebf4c4a74b30 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] RBAC: Authorizing `identity:get_project(project_id=30fdd0aadd2645a7924a9df2812307c8)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:16.875948 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e928832-9525-4b71-b26b-ebf4c4a74b30 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:16.877930 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1320/2664] 10.222.0.83 () {58 vars in 1443 bytes} [Mon Aug 29 15:40:16 2022] GET /identity/v3/projects/30fdd0aadd2645a7924a9df2812307c8 => generated 379 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:40:16.973957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4c27d-d35e-48b1-a6d5-580928b717a0 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:16.974877 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4c27d-d35e-48b1-a6d5-580928b717a0 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:16.975454 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4c27d-d35e-48b1-a6d5-580928b717a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:16.997652 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-ebf4c27d-d35e-48b1-a6d5-580928b717a0 None None] MFA Rules not processed for user `408d9bbcf4c44fd294f4db903fb99df5`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:16.998948 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ebf4c27d-d35e-48b1-a6d5-580928b717a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:17.006992 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1345/2665] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:40:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:17.845038 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fea3a8-bb6a-4f4c-8f07-8bab78f2f471 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:17.845578 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fea3a8-bb6a-4f4c-8f07-8bab78f2f471 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:17.845673 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fea3a8-bb6a-4f4c-8f07-8bab78f2f471 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:17.847153 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1321/2666] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 15:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:40:17.852160 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4c27d-d35e-48b1-a6d5-580928b717a0 None None] Authenticating service token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:40:17.860455 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:17.866133 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4c27d-d35e-48b1-a6d5-580928b717a0 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:17.877058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4c27d-d35e-48b1-a6d5-580928b717a0 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:17.882631 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a1c733-1b5a-49ae-90c8-414371c91ece tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ef39fc75c94747b299e859a737ae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35837ff3c7364ab8afd47e3c34c6f7c8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:17.883535 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a1c733-1b5a-49ae-90c8-414371c91ece tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:17.883818 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a1c733-1b5a-49ae-90c8-414371c91ece tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:17.884162 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a1c733-1b5a-49ae-90c8-414371c91ece tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] PATH_INFO: `/v3/projects/30fdd0aadd2645a7924a9df2812307c8` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:17.885265 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a1c733-1b5a-49ae-90c8-414371c91ece tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] RBAC: Authorizing `identity:get_project(project_id=30fdd0aadd2645a7924a9df2812307c8)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:17.887419 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a1c733-1b5a-49ae-90c8-414371c91ece tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:17.889261 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1346/2667] 10.222.0.83 () {58 vars in 1443 bytes} [Mon Aug 29 15:40:17 2022] GET /identity/v3/projects/30fdd0aadd2645a7924a9df2812307c8 => generated 379 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:40:18.091972 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fea3a8-bb6a-4f4c-8f07-8bab78f2f471 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:18.200873 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fea3a8-bb6a-4f4c-8f07-8bab78f2f471 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:18.207481 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6180e8df-c20a-4a8f-9f92-309fdbe85e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:18.209060 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180e8df-c20a-4a8f-9f92-309fdbe85e7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:18.209557 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180e8df-c20a-4a8f-9f92-309fdbe85e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:18.210044 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180e8df-c20a-4a8f-9f92-309fdbe85e7b admin admin] PATH_INFO: `/v3/users/408d9bbcf4c44fd294f4db903fb99df5` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:18.211413 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6180e8df-c20a-4a8f-9f92-309fdbe85e7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=408d9bbcf4c44fd294f4db903fb99df5)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:18.213745 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6180e8df-c20a-4a8f-9f92-309fdbe85e7b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:18.272578 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:18.291283 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6180e8df-c20a-4a8f-9f92-309fdbe85e7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '408d9bbcf4c44fd294f4db903fb99df5'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:18.293988 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6180e8df-c20a-4a8f-9f92-309fdbe85e7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '408d9bbcf4c44fd294f4db903fb99df5'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:18.308677 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6180e8df-c20a-4a8f-9f92-309fdbe85e7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '408d9bbcf4c44fd294f4db903fb99df5'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:18.319371 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6180e8df-c20a-4a8f-9f92-309fdbe85e7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '408d9bbcf4c44fd294f4db903fb99df5'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:18.324860 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6180e8df-c20a-4a8f-9f92-309fdbe85e7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '408d9bbcf4c44fd294f4db903fb99df5'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:18.383497 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1322/2668] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:40:18 2022] DELETE /identity/v3/users/408d9bbcf4c44fd294f4db903fb99df5 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:18.384316 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc48793-82f6-4ee8-8f6d-4db52589e6c9 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:18.386361 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc48793-82f6-4ee8-8f6d-4db52589e6c9 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:18.387339 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc48793-82f6-4ee8-8f6d-4db52589e6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:18.458180 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-3cc48793-82f6-4ee8-8f6d-4db52589e6c9 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:18.479202 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3cc48793-82f6-4ee8-8f6d-4db52589e6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:18.571610 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1347/2669] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:40:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:18.595752 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6180e8df-c20a-4a8f-9f92-309fdbe85e7b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:18.597407 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6180e8df-c20a-4a8f-9f92-309fdbe85e7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:18.725645 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6180e8df-c20a-4a8f-9f92-309fdbe85e7b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:18.730097 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c51338d-8286-403a-a2f2-10f2631226c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:18.730916 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51338d-8286-403a-a2f2-10f2631226c8 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:18.731390 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51338d-8286-403a-a2f2-10f2631226c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:18.759292 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51338d-8286-403a-a2f2-10f2631226c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:18.777117 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c51338d-8286-403a-a2f2-10f2631226c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:18.793639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c51338d-8286-403a-a2f2-10f2631226c8 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:18.815737 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1323/2670] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:40:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:40:19.234411 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc48793-82f6-4ee8-8f6d-4db52589e6c9 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:19.235979 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3cc48793-82f6-4ee8-8f6d-4db52589e6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:19.334002 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc48793-82f6-4ee8-8f6d-4db52589e6c9 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:19.340989 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3dd592-62c2-4c15-a1a4-c0d897d028a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:19.342161 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3dd592-62c2-4c15-a1a4-c0d897d028a9 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:19.342566 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3dd592-62c2-4c15-a1a4-c0d897d028a9 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:19.342706 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3dd592-62c2-4c15-a1a4-c0d897d028a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:19.344583 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1a3dd592-62c2-4c15-a1a4-c0d897d028a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:19.423056 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3dd592-62c2-4c15-a1a4-c0d897d028a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:19.424701 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3dd592-62c2-4c15-a1a4-c0d897d028a9 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:19.440476 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1348/2671] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:40:19 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:40:19.597277 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c51338d-8286-403a-a2f2-10f2631226c8 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:19.599580 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8c51338d-8286-403a-a2f2-10f2631226c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:19.620885 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c51338d-8286-403a-a2f2-10f2631226c8 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:19.628507 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10e8c45-bcfe-4f3e-a237-ddbb095c6759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:19.629288 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e8c45-bcfe-4f3e-a237-ddbb095c6759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:19.629656 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e8c45-bcfe-4f3e-a237-ddbb095c6759 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:19.630538 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e8c45-bcfe-4f3e-a237-ddbb095c6759 admin admin] PATH_INFO: `/v3/projects/30fdd0aadd2645a7924a9df2812307c8` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:19.631836 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10e8c45-bcfe-4f3e-a237-ddbb095c6759 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30fdd0aadd2645a7924a9df2812307c8)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:19.633944 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10e8c45-bcfe-4f3e-a237-ddbb095c6759 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:19.760989 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f10e8c45-bcfe-4f3e-a237-ddbb095c6759 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30fdd0aadd2645a7924a9df2812307c8', 'request_id': 'req-f10e8c45-bcfe-4f3e-a237-ddbb095c6759'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:19.766754 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f10e8c45-bcfe-4f3e-a237-ddbb095c6759 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30fdd0aadd2645a7924a9df2812307c8', 'request_id': 'req-f10e8c45-bcfe-4f3e-a237-ddbb095c6759'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:19.780473 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f10e8c45-bcfe-4f3e-a237-ddbb095c6759 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30fdd0aadd2645a7924a9df2812307c8', 'request_id': 'req-f10e8c45-bcfe-4f3e-a237-ddbb095c6759'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:19.799692 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f10e8c45-bcfe-4f3e-a237-ddbb095c6759 admin admin] The token cache is being invalidate because project 30fdd0aadd2645a7924a9df2812307c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:40:19.801339 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f10e8c45-bcfe-4f3e-a237-ddbb095c6759 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:19.806750 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f10e8c45-bcfe-4f3e-a237-ddbb095c6759 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:19.811394 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1324/2672] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:19 2022] DELETE /identity/v3/projects/30fdd0aadd2645a7924a9df2812307c8 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:19.812850 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3dd592-62c2-4c15-a1a4-c0d897d028a9 service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:19.847915 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3dd592-62c2-4c15-a1a4-c0d897d028a9 service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:19.906975 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:19.965964 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f38e1-ebe9-45da-b021-43a82ebbd52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:19.967012 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f38e1-ebe9-45da-b021-43a82ebbd52d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:19.967531 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f38e1-ebe9-45da-b021-43a82ebbd52d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:19.968051 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f38e1-ebe9-45da-b021-43a82ebbd52d admin admin] PATH_INFO: `/v3/users/98ef39fc75c94747b299e859a737ae73` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:19.969797 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f38e1-ebe9-45da-b021-43a82ebbd52d admin admin] RBAC: Authorizing `identity:delete_user(user_id=98ef39fc75c94747b299e859a737ae73)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:19.972572 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f38e1-ebe9-45da-b021-43a82ebbd52d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:20.039327 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2d1f38e1-ebe9-45da-b021-43a82ebbd52d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98ef39fc75c94747b299e859a737ae73'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:20.040105 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2d1f38e1-ebe9-45da-b021-43a82ebbd52d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98ef39fc75c94747b299e859a737ae73'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:20.058362 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2d1f38e1-ebe9-45da-b021-43a82ebbd52d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98ef39fc75c94747b299e859a737ae73'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:20.069894 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2d1f38e1-ebe9-45da-b021-43a82ebbd52d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98ef39fc75c94747b299e859a737ae73'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:20.079985 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2d1f38e1-ebe9-45da-b021-43a82ebbd52d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98ef39fc75c94747b299e859a737ae73'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:20.088411 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1349/2673] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:40:19 2022] DELETE /identity/v3/users/98ef39fc75c94747b299e859a737ae73 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:20.367387 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997b461-a670-4278-b06f-5afa5280c823 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:20.368017 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997b461-a670-4278-b06f-5afa5280c823 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:20.368490 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997b461-a670-4278-b06f-5afa5280c823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:20.405228 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-d997b461-a670-4278-b06f-5afa5280c823 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:20.406669 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d997b461-a670-4278-b06f-5afa5280c823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:20.465057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:20.513891 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1325/2674] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 15:40:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:20.598854 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f38e1-ebe9-45da-b021-43a82ebbd52d admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:20.607433 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997b461-a670-4278-b06f-5afa5280c823 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:20.609630 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2d1f38e1-ebe9-45da-b021-43a82ebbd52d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:20.612215 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d997b461-a670-4278-b06f-5afa5280c823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:20.730659 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997b461-a670-4278-b06f-5afa5280c823 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:20.734669 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f38e1-ebe9-45da-b021-43a82ebbd52d admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:20.737515 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c18e91-fcfd-4a5d-852b-8168369ad7cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:20.738481 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c18e91-fcfd-4a5d-852b-8168369ad7cb service swift] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:20.738945 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c18e91-fcfd-4a5d-852b-8168369ad7cb service swift] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:20.740317 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c18e91-fcfd-4a5d-852b-8168369ad7cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:20.748300 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1361d9-caf9-4abd-87a7-b41b29aae060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:20.749273 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1361d9-caf9-4abd-87a7-b41b29aae060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:20.749901 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1361d9-caf9-4abd-87a7-b41b29aae060 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:20.750346 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1361d9-caf9-4abd-87a7-b41b29aae060 admin admin] PATH_INFO: `/v3/projects/35837ff3c7364ab8afd47e3c34c6f7c8` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:20.751918 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1361d9-caf9-4abd-87a7-b41b29aae060 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35837ff3c7364ab8afd47e3c34c6f7c8)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:20.754021 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1361d9-caf9-4abd-87a7-b41b29aae060 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:20.759558 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c18e91-fcfd-4a5d-852b-8168369ad7cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:20.761182 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c18e91-fcfd-4a5d-852b-8168369ad7cb service swift] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:20.776292 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1326/2675] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 15:40:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:40:20.822173 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fe1361d9-caf9-4abd-87a7-b41b29aae060 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35837ff3c7364ab8afd47e3c34c6f7c8', 'request_id': 'req-fe1361d9-caf9-4abd-87a7-b41b29aae060'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:20.823941 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:20.829898 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fe1361d9-caf9-4abd-87a7-b41b29aae060 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35837ff3c7364ab8afd47e3c34c6f7c8', 'request_id': 'req-fe1361d9-caf9-4abd-87a7-b41b29aae060'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:20.842553 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fe1361d9-caf9-4abd-87a7-b41b29aae060 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35837ff3c7364ab8afd47e3c34c6f7c8', 'request_id': 'req-fe1361d9-caf9-4abd-87a7-b41b29aae060'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:20.871102 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fe1361d9-caf9-4abd-87a7-b41b29aae060 admin admin] The token cache is being invalidate because project 35837ff3c7364ab8afd47e3c34c6f7c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:40:20.871399 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fe1361d9-caf9-4abd-87a7-b41b29aae060 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:20.872272 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fe1361d9-caf9-4abd-87a7-b41b29aae060 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:20.874333 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1350/2676] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:20 2022] DELETE /identity/v3/projects/35837ff3c7364ab8afd47e3c34c6f7c8 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:20.881486 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb482b-9ffe-40fd-aed4-f655c38a7878 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:20.882369 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb482b-9ffe-40fd-aed4-f655c38a7878 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:20.882847 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb482b-9ffe-40fd-aed4-f655c38a7878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:20.917749 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-8edb482b-9ffe-40fd-aed4-f655c38a7878 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:20.919595 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8edb482b-9ffe-40fd-aed4-f655c38a7878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:21.006603 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1327/2677] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:40:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:21.015515 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95384136-80b9-4c3b-b7c5-4558a0deb989 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:21.016105 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95384136-80b9-4c3b-b7c5-4558a0deb989 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:21.016545 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95384136-80b9-4c3b-b7c5-4558a0deb989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:21.043815 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-95384136-80b9-4c3b-b7c5-4558a0deb989 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:21.045360 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-95384136-80b9-4c3b-b7c5-4558a0deb989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:21.056073 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1351/2678] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:40:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:21.064610 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb482b-9ffe-40fd-aed4-f655c38a7878 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:21.076127 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb482b-9ffe-40fd-aed4-f655c38a7878 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:21.085504 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb66c58-84cd-4ac2-975a-5472a0f48b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:21.086427 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb66c58-84cd-4ac2-975a-5472a0f48b78 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:21.086902 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb66c58-84cd-4ac2-975a-5472a0f48b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:21.087450 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb66c58-84cd-4ac2-975a-5472a0f48b78 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:21.088458 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb66c58-84cd-4ac2-975a-5472a0f48b78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:40:21.088912 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb66c58-84cd-4ac2-975a-5472a0f48b78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:21.090697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb66c58-84cd-4ac2-975a-5472a0f48b78 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:21.108497 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1328/2679] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:40:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:40:21.113512 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95384136-80b9-4c3b-b7c5-4558a0deb989 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:21.125013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95384136-80b9-4c3b-b7c5-4558a0deb989 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:21.131568 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0619c-81e1-4a01-8423-7d0a4ce33208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:21.132705 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0619c-81e1-4a01-8423-7d0a4ce33208 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:21.133406 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0619c-81e1-4a01-8423-7d0a4ce33208 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:21.133986 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0619c-81e1-4a01-8423-7d0a4ce33208 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:21.134953 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c0619c-81e1-4a01-8423-7d0a4ce33208 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:21.137057 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c0619c-81e1-4a01-8423-7d0a4ce33208 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:21.189062 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1352/2680] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:40:21 2022] POST /identity/v3/projects => generated 409 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:40:21.193445 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb66c58-84cd-4ac2-975a-5472a0f48b78 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:21.212152 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb66c58-84cd-4ac2-975a-5472a0f48b78 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:21.330806 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834635b-8f0c-498c-83c3-4fd0a0a875a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:21.331565 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834635b-8f0c-498c-83c3-4fd0a0a875a8 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:21.331920 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834635b-8f0c-498c-83c3-4fd0a0a875a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:21.332290 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834635b-8f0c-498c-83c3-4fd0a0a875a8 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:21.333150 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1834635b-8f0c-498c-83c3-4fd0a0a875a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:21.335273 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1834635b-8f0c-498c-83c3-4fd0a0a875a8 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:21.347123 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:21.362830 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1329/2681] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:40:21 2022] POST /identity/v3/users => generated 305 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:40:21.368510 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0619c-81e1-4a01-8423-7d0a4ce33208 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:21.382391 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0619c-81e1-4a01-8423-7d0a4ce33208 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:21.399852 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8cd37-8729-4419-b5e0-e09c11702a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:21.400851 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8cd37-8729-4419-b5e0-e09c11702a8c admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:21.401819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8cd37-8729-4419-b5e0-e09c11702a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:21.402102 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8cd37-8729-4419-b5e0-e09c11702a8c admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:21.402848 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a8cd37-8729-4419-b5e0-e09c11702a8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:21.405229 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a8cd37-8729-4419-b5e0-e09c11702a8c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:21.417133 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1353/2682] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:40:21.422692 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834635b-8f0c-498c-83c3-4fd0a0a875a8 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:21.441011 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834635b-8f0c-498c-83c3-4fd0a0a875a8 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:21.450433 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b92d0b-2ffd-4af8-aff9-72862dc755da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:21.451092 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b92d0b-2ffd-4af8-aff9-72862dc755da admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:21.451380 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b92d0b-2ffd-4af8-aff9-72862dc755da admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:21.451673 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b92d0b-2ffd-4af8-aff9-72862dc755da admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:21.452368 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b92d0b-2ffd-4af8-aff9-72862dc755da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:21.455560 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b92d0b-2ffd-4af8-aff9-72862dc755da admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:21.483401 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1330/2683] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:40:21.485533 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8cd37-8729-4419-b5e0-e09c11702a8c admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:21.508418 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8cd37-8729-4419-b5e0-e09c11702a8c admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:21.524595 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef77498-2815-4bb3-acc8-0f616a34a6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:21.525301 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef77498-2815-4bb3-acc8-0f616a34a6e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:21.525590 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef77498-2815-4bb3-acc8-0f616a34a6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:21.525894 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef77498-2815-4bb3-acc8-0f616a34a6e7 admin admin] PATH_INFO: `/v3/projects/66d4f49cd9094dd6b73c23856e8ff400/users/f8dbef4feae749b7b76362250fc396e6/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:21.547344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef77498-2815-4bb3-acc8-0f616a34a6e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66d4f49cd9094dd6b73c23856e8ff400, user_id=f8dbef4feae749b7b76362250fc396e6, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:21.551163 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef77498-2815-4bb3-acc8-0f616a34a6e7 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:21.591400 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1354/2684] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:40:21 2022] PUT /identity/v3/projects/66d4f49cd9094dd6b73c23856e8ff400/users/f8dbef4feae749b7b76362250fc396e6/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:21.602711 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db898e-752b-4392-9cff-cc68d6de311f None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:21.603008 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db898e-752b-4392-9cff-cc68d6de311f None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:21.603248 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db898e-752b-4392-9cff-cc68d6de311f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:21.667611 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-d1db898e-752b-4392-9cff-cc68d6de311f None None] MFA Rules not processed for user `f8dbef4feae749b7b76362250fc396e6`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:21.668405 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d1db898e-752b-4392-9cff-cc68d6de311f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:21.812939 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1331/2685] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:40:21 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:21.819931 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef77498-2815-4bb3-acc8-0f616a34a6e7 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:21.995539 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef77498-2815-4bb3-acc8-0f616a34a6e7 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:22.001101 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa49aab8-a14e-4fb1-9901-f302ccaad50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:22.002122 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49aab8-a14e-4fb1-9901-f302ccaad50a admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:22.002566 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49aab8-a14e-4fb1-9901-f302ccaad50a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:22.003013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49aab8-a14e-4fb1-9901-f302ccaad50a admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:22.004193 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa49aab8-a14e-4fb1-9901-f302ccaad50a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:22.007374 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa49aab8-a14e-4fb1-9901-f302ccaad50a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:22.064724 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1355/2686] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:40:21 2022] POST /identity/v3/projects => generated 405 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:40:22.065566 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db898e-752b-4392-9cff-cc68d6de311f None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:22.086381 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db898e-752b-4392-9cff-cc68d6de311f None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:22.239506 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b99ee7-a110-4082-981b-618f0e19bbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:22.241012 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b99ee7-a110-4082-981b-618f0e19bbac admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:22.241751 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b99ee7-a110-4082-981b-618f0e19bbac admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:22.242212 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b99ee7-a110-4082-981b-618f0e19bbac admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:22.245783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b99ee7-a110-4082-981b-618f0e19bbac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:22.248178 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b99ee7-a110-4082-981b-618f0e19bbac admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:22.290075 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1332/2687] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:40:22 2022] POST /identity/v3/users => generated 309 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:40:22.296247 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa49aab8-a14e-4fb1-9901-f302ccaad50a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:22.317251 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa49aab8-a14e-4fb1-9901-f302ccaad50a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:22.323605 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ccf07-a2fd-4720-865b-d9183cb87f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:22.324357 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ccf07-a2fd-4720-865b-d9183cb87f56 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:22.324713 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ccf07-a2fd-4720-865b-d9183cb87f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:22.325247 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ccf07-a2fd-4720-865b-d9183cb87f56 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:22.325908 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184ccf07-a2fd-4720-865b-d9183cb87f56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:22.327866 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184ccf07-a2fd-4720-865b-d9183cb87f56 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:22.351935 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1356/2688] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:40:22.353281 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b99ee7-a110-4082-981b-618f0e19bbac admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:22.365242 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b99ee7-a110-4082-981b-618f0e19bbac admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:22.370357 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b97fca-acf4-4008-8d53-de0f6d1abcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:22.370931 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b97fca-acf4-4008-8d53-de0f6d1abcf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:22.371254 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b97fca-acf4-4008-8d53-de0f6d1abcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:22.371526 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b97fca-acf4-4008-8d53-de0f6d1abcf7 admin admin] PATH_INFO: `/v3/projects/20b21f7a3fd044c7b4ddcfb746a521cc/users/17a57f7c64644d4c97fd5ccdcd0aa065/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:22.589779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b97fca-acf4-4008-8d53-de0f6d1abcf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20b21f7a3fd044c7b4ddcfb746a521cc, user_id=17a57f7c64644d4c97fd5ccdcd0aa065, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:22.596519 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b97fca-acf4-4008-8d53-de0f6d1abcf7 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:22.623668 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1333/2689] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:40:22 2022] PUT /identity/v3/projects/20b21f7a3fd044c7b4ddcfb746a521cc/users/17a57f7c64644d4c97fd5ccdcd0aa065/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:40:22.627605 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ccf07-a2fd-4720-865b-d9183cb87f56 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:22.641861 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ccf07-a2fd-4720-865b-d9183cb87f56 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:22.767606 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:22.805828 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c94dc-b3fd-46ee-9d22-20d680afdb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:22.806676 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c94dc-b3fd-46ee-9d22-20d680afdb1f admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:22.806959 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c94dc-b3fd-46ee-9d22-20d680afdb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:22.807269 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c94dc-b3fd-46ee-9d22-20d680afdb1f admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:22.809052 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998c94dc-b3fd-46ee-9d22-20d680afdb1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:22.811336 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998c94dc-b3fd-46ee-9d22-20d680afdb1f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:22.827980 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1357/2690] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:40:22.831341 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b97fca-acf4-4008-8d53-de0f6d1abcf7 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:22.851991 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b97fca-acf4-4008-8d53-de0f6d1abcf7 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:22.871722 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43adb02d-4e2d-4b08-a9c2-c14986017fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:22.872558 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43adb02d-4e2d-4b08-a9c2-c14986017fba admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:22.872870 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43adb02d-4e2d-4b08-a9c2-c14986017fba admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:22.873271 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43adb02d-4e2d-4b08-a9c2-c14986017fba admin admin] PATH_INFO: `/v3/projects/20b21f7a3fd044c7b4ddcfb746a521cc/users/17a57f7c64644d4c97fd5ccdcd0aa065/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:22.878159 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43adb02d-4e2d-4b08-a9c2-c14986017fba admin admin] RBAC: Authorizing `identity:create_grant(project_id=20b21f7a3fd044c7b4ddcfb746a521cc, user_id=17a57f7c64644d4c97fd5ccdcd0aa065, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:22.889960 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43adb02d-4e2d-4b08-a9c2-c14986017fba admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:22.941107 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1334/2691] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:40:22 2022] PUT /identity/v3/projects/20b21f7a3fd044c7b4ddcfb746a521cc/users/17a57f7c64644d4c97fd5ccdcd0aa065/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:22.953707 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a14a0-3ed0-4b0e-a3bb-10e217174c88 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:22.953991 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a14a0-3ed0-4b0e-a3bb-10e217174c88 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:22.954463 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a14a0-3ed0-4b0e-a3bb-10e217174c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:23.026666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-489a14a0-3ed0-4b0e-a3bb-10e217174c88 None None] MFA Rules not processed for user `17a57f7c64644d4c97fd5ccdcd0aa065`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:23.029927 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-489a14a0-3ed0-4b0e-a3bb-10e217174c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:23.229642 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43adb02d-4e2d-4b08-a9c2-c14986017fba admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:23.235015 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1358/2692] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:40:22 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:23.316502 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:23.434198 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43adb02d-4e2d-4b08-a9c2-c14986017fba admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:23.451911 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3102dc94-4a86-498c-83cb-c92fa0d9ca60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:23.454738 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102dc94-4a86-498c-83cb-c92fa0d9ca60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:23.456843 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102dc94-4a86-498c-83cb-c92fa0d9ca60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:23.457203 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102dc94-4a86-498c-83cb-c92fa0d9ca60 admin admin] PATH_INFO: `/v3/users/f8dbef4feae749b7b76362250fc396e6` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:23.460523 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3102dc94-4a86-498c-83cb-c92fa0d9ca60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8dbef4feae749b7b76362250fc396e6)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:23.468351 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3102dc94-4a86-498c-83cb-c92fa0d9ca60 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:23.596314 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3102dc94-4a86-498c-83cb-c92fa0d9ca60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8dbef4feae749b7b76362250fc396e6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:23.608263 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3102dc94-4a86-498c-83cb-c92fa0d9ca60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8dbef4feae749b7b76362250fc396e6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:23.624780 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3102dc94-4a86-498c-83cb-c92fa0d9ca60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8dbef4feae749b7b76362250fc396e6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:23.642971 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3102dc94-4a86-498c-83cb-c92fa0d9ca60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8dbef4feae749b7b76362250fc396e6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:23.647427 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3102dc94-4a86-498c-83cb-c92fa0d9ca60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8dbef4feae749b7b76362250fc396e6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:23.692980 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1335/2693] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:40:23 2022] DELETE /identity/v3/users/f8dbef4feae749b7b76362250fc396e6 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:40:23.697707 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e99e16-8a4a-4ea2-84b2-2668d4fce182 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:23.697999 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e99e16-8a4a-4ea2-84b2-2668d4fce182 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:23.698278 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e99e16-8a4a-4ea2-84b2-2668d4fce182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:23.751729 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-06e99e16-8a4a-4ea2-84b2-2668d4fce182 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:23.753611 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-06e99e16-8a4a-4ea2-84b2-2668d4fce182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:23.920777 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1359/2694] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:40:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:24.062762 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3102dc94-4a86-498c-83cb-c92fa0d9ca60 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:24.067378 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3102dc94-4a86-498c-83cb-c92fa0d9ca60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:24.204001 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3102dc94-4a86-498c-83cb-c92fa0d9ca60 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:24.219780 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab8af2-35f7-443e-b623-e8cdf2baef3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:24.220653 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab8af2-35f7-443e-b623-e8cdf2baef3d service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:24.221177 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab8af2-35f7-443e-b623-e8cdf2baef3d service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:24.222276 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab8af2-35f7-443e-b623-e8cdf2baef3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:24.247579 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab8af2-35f7-443e-b623-e8cdf2baef3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:24.252584 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab8af2-35f7-443e-b623-e8cdf2baef3d service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:24.271758 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1336/2695] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:40:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:40:25.786613 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e99e16-8a4a-4ea2-84b2-2668d4fce182 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:25.789788 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-06e99e16-8a4a-4ea2-84b2-2668d4fce182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:25.823989 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e99e16-8a4a-4ea2-84b2-2668d4fce182 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:25.831269 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286060d6-afae-44d1-9c05-a36fc5b7d380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:25.832127 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286060d6-afae-44d1-9c05-a36fc5b7d380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:25.832502 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286060d6-afae-44d1-9c05-a36fc5b7d380 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:25.833728 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286060d6-afae-44d1-9c05-a36fc5b7d380 admin admin] PATH_INFO: `/v3/projects/66d4f49cd9094dd6b73c23856e8ff400` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:25.835731 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286060d6-afae-44d1-9c05-a36fc5b7d380 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66d4f49cd9094dd6b73c23856e8ff400)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:25.838199 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286060d6-afae-44d1-9c05-a36fc5b7d380 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:25.924664 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-286060d6-afae-44d1-9c05-a36fc5b7d380 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66d4f49cd9094dd6b73c23856e8ff400', 'request_id': 'req-286060d6-afae-44d1-9c05-a36fc5b7d380'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:25.932443 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-286060d6-afae-44d1-9c05-a36fc5b7d380 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66d4f49cd9094dd6b73c23856e8ff400', 'request_id': 'req-286060d6-afae-44d1-9c05-a36fc5b7d380'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:25.963511 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-286060d6-afae-44d1-9c05-a36fc5b7d380 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66d4f49cd9094dd6b73c23856e8ff400', 'request_id': 'req-286060d6-afae-44d1-9c05-a36fc5b7d380'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:25.970359 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:26.020177 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-286060d6-afae-44d1-9c05-a36fc5b7d380 admin admin] The token cache is being invalidate because project 66d4f49cd9094dd6b73c23856e8ff400 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:40:26.022567 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-286060d6-afae-44d1-9c05-a36fc5b7d380 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:26.023617 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-286060d6-afae-44d1-9c05-a36fc5b7d380 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:26.028096 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1360/2696] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:25 2022] DELETE /identity/v3/projects/66d4f49cd9094dd6b73c23856e8ff400 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:40:26.042817 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab8af2-35f7-443e-b623-e8cdf2baef3d service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:26.061952 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab8af2-35f7-443e-b623-e8cdf2baef3d service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:26.174262 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:26.223052 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af3a29-f8bf-42fa-9c4b-b2a3ff46fd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:26.225339 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af3a29-f8bf-42fa-9c4b-b2a3ff46fd4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:26.226175 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af3a29-f8bf-42fa-9c4b-b2a3ff46fd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:26.226879 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af3a29-f8bf-42fa-9c4b-b2a3ff46fd4d admin admin] PATH_INFO: `/v3/users/17a57f7c64644d4c97fd5ccdcd0aa065` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:26.232031 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39af3a29-f8bf-42fa-9c4b-b2a3ff46fd4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=17a57f7c64644d4c97fd5ccdcd0aa065)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:26.237789 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39af3a29-f8bf-42fa-9c4b-b2a3ff46fd4d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:26.479359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-39af3a29-f8bf-42fa-9c4b-b2a3ff46fd4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17a57f7c64644d4c97fd5ccdcd0aa065'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:26.483146 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-39af3a29-f8bf-42fa-9c4b-b2a3ff46fd4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17a57f7c64644d4c97fd5ccdcd0aa065'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:26.521445 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-39af3a29-f8bf-42fa-9c4b-b2a3ff46fd4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17a57f7c64644d4c97fd5ccdcd0aa065'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:26.553374 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-39af3a29-f8bf-42fa-9c4b-b2a3ff46fd4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17a57f7c64644d4c97fd5ccdcd0aa065'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:26.557243 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-39af3a29-f8bf-42fa-9c4b-b2a3ff46fd4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17a57f7c64644d4c97fd5ccdcd0aa065'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:26.613712 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1337/2697] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:40:26 2022] DELETE /identity/v3/users/17a57f7c64644d4c97fd5ccdcd0aa065 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:27.136068 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286060d6-afae-44d1-9c05-a36fc5b7d380 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:27.137705 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-286060d6-afae-44d1-9c05-a36fc5b7d380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:27.184114 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286060d6-afae-44d1-9c05-a36fc5b7d380 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:27.410448 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb23f0-9a88-4bd7-8d43-fe9cfd701321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:27.413681 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb23f0-9a88-4bd7-8d43-fe9cfd701321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:27.414374 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb23f0-9a88-4bd7-8d43-fe9cfd701321 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:27.414857 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb23f0-9a88-4bd7-8d43-fe9cfd701321 admin admin] PATH_INFO: `/v3/users/1fa00248ff214f93bcc67dd0d1a04c61` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:27.419166 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb23f0-9a88-4bd7-8d43-fe9cfd701321 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fa00248ff214f93bcc67dd0d1a04c61)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:27.421650 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb23f0-9a88-4bd7-8d43-fe9cfd701321 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:27.616858 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-97fb23f0-9a88-4bd7-8d43-fe9cfd701321 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fa00248ff214f93bcc67dd0d1a04c61'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:27.619710 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-97fb23f0-9a88-4bd7-8d43-fe9cfd701321 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fa00248ff214f93bcc67dd0d1a04c61'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:27.670637 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-97fb23f0-9a88-4bd7-8d43-fe9cfd701321 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fa00248ff214f93bcc67dd0d1a04c61'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:27.752404 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-97fb23f0-9a88-4bd7-8d43-fe9cfd701321 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fa00248ff214f93bcc67dd0d1a04c61'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:27.771793 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-97fb23f0-9a88-4bd7-8d43-fe9cfd701321 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fa00248ff214f93bcc67dd0d1a04c61'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:27.814110 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1361/2698] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:40:27 2022] DELETE /identity/v3/users/1fa00248ff214f93bcc67dd0d1a04c61 => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:27.816070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c22bd8-ba74-40ee-8553-31282b017c88 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:27.816565 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c22bd8-ba74-40ee-8553-31282b017c88 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:27.816646 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c22bd8-ba74-40ee-8553-31282b017c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:27.852524 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-16c22bd8-ba74-40ee-8553-31282b017c88 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:27.856794 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-16c22bd8-ba74-40ee-8553-31282b017c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:28.056505 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1338/2699] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:40:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:28.077512 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb23f0-9a88-4bd7-8d43-fe9cfd701321 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:28.078966 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-97fb23f0-9a88-4bd7-8d43-fe9cfd701321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:28.242841 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb23f0-9a88-4bd7-8d43-fe9cfd701321 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:28.252372 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695147f7-f606-43c8-a5d5-52bb1a03f337 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:28.253304 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695147f7-f606-43c8-a5d5-52bb1a03f337 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:28.254473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695147f7-f606-43c8-a5d5-52bb1a03f337 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:28.255557 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695147f7-f606-43c8-a5d5-52bb1a03f337 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:28.275797 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695147f7-f606-43c8-a5d5-52bb1a03f337 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:28.278354 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695147f7-f606-43c8-a5d5-52bb1a03f337 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:28.316050 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1362/2700] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:40:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:40:28.382798 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b194a8-460d-4f96-8ceb-1c899b2e9fab None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:28.383968 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b194a8-460d-4f96-8ceb-1c899b2e9fab None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:28.384457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b194a8-460d-4f96-8ceb-1c899b2e9fab None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:28.387553 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1339/2701] 10.222.0.83 () {54 vars in 921 bytes} [Mon Aug 29 15:40:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:40:28.505886 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134aaa1-f120-4bf2-9e16-efd529551bd2 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:28.506290 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134aaa1-f120-4bf2-9e16-efd529551bd2 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:28.506482 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134aaa1-f120-4bf2-9e16-efd529551bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:28.527280 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b194a8-460d-4f96-8ceb-1c899b2e9fab None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:28.529103 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-39b194a8-460d-4f96-8ceb-1c899b2e9fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:28.580418 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-c134aaa1-f120-4bf2-9e16-efd529551bd2 None None] MFA Rules not processed for user `c190fa4a280c41c684130e069bee99eb`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:28.583776 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b194a8-460d-4f96-8ceb-1c899b2e9fab None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:28.585056 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c134aaa1-f120-4bf2-9e16-efd529551bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:28.595164 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d6246-ba8d-47e3-91ca-1ad76ce8a491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:28.595822 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d6246-ba8d-47e3-91ca-1ad76ce8a491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:28.596096 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d6246-ba8d-47e3-91ca-1ad76ce8a491 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:28.598234 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d6246-ba8d-47e3-91ca-1ad76ce8a491 admin admin] PATH_INFO: `/v3/projects/20b21f7a3fd044c7b4ddcfb746a521cc` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:28.601894 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332d6246-ba8d-47e3-91ca-1ad76ce8a491 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20b21f7a3fd044c7b4ddcfb746a521cc)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:28.623817 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332d6246-ba8d-47e3-91ca-1ad76ce8a491 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:28.623937 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:28.806034 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-332d6246-ba8d-47e3-91ca-1ad76ce8a491 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20b21f7a3fd044c7b4ddcfb746a521cc', 'request_id': 'req-332d6246-ba8d-47e3-91ca-1ad76ce8a491'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:28.833485 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1363/2702] 10.222.0.83 () {58 vars in 1018 bytes} [Mon Aug 29 15:40:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:28.839824 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-332d6246-ba8d-47e3-91ca-1ad76ce8a491 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20b21f7a3fd044c7b4ddcfb746a521cc', 'request_id': 'req-332d6246-ba8d-47e3-91ca-1ad76ce8a491'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:28.862264 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-332d6246-ba8d-47e3-91ca-1ad76ce8a491 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20b21f7a3fd044c7b4ddcfb746a521cc', 'request_id': 'req-332d6246-ba8d-47e3-91ca-1ad76ce8a491'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:28.864942 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:28.887138 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-332d6246-ba8d-47e3-91ca-1ad76ce8a491 admin admin] The token cache is being invalidate because project 20b21f7a3fd044c7b4ddcfb746a521cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:40:28.887450 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-332d6246-ba8d-47e3-91ca-1ad76ce8a491 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:28.893064 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-332d6246-ba8d-47e3-91ca-1ad76ce8a491 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:28.923353 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cef98a-d579-4030-8984-2edf1b968702 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:28.923670 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cef98a-d579-4030-8984-2edf1b968702 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:28.923948 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cef98a-d579-4030-8984-2edf1b968702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:28.924362 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1340/2703] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:28 2022] DELETE /identity/v3/projects/20b21f7a3fd044c7b4ddcfb746a521cc => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:28.929068 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d6246-ba8d-47e3-91ca-1ad76ce8a491 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:28.930922 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-332d6246-ba8d-47e3-91ca-1ad76ce8a491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:28.973805 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-02cef98a-d579-4030-8984-2edf1b968702 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:28.975426 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-02cef98a-d579-4030-8984-2edf1b968702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:29.044416 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d6246-ba8d-47e3-91ca-1ad76ce8a491 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:29.055890 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5272672c-3e08-4748-b3c8-0687a5331311 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:29.057752 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272672c-3e08-4748-b3c8-0687a5331311 service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:29.059298 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272672c-3e08-4748-b3c8-0687a5331311 service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:29.061543 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272672c-3e08-4748-b3c8-0687a5331311 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:29.063717 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5272672c-3e08-4748-b3c8-0687a5331311 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:29.081427 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5272672c-3e08-4748-b3c8-0687a5331311 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:29.086164 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5272672c-3e08-4748-b3c8-0687a5331311 service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:29.116378 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1341/2704] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:40:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:40:29.132222 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1364/2705] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:40:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:29.140599 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096815e-1a6a-46a1-a17d-2eab7e0273da None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:29.140785 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096815e-1a6a-46a1-a17d-2eab7e0273da None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:29.141087 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096815e-1a6a-46a1-a17d-2eab7e0273da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:29.191000 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a096815e-1a6a-46a1-a17d-2eab7e0273da None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:29.192890 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a096815e-1a6a-46a1-a17d-2eab7e0273da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:29.200347 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cef98a-d579-4030-8984-2edf1b968702 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:29.201744 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-02cef98a-d579-4030-8984-2edf1b968702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:29.215926 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1342/2706] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:40:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:29.217952 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096815e-1a6a-46a1-a17d-2eab7e0273da None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:29.226187 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cef98a-d579-4030-8984-2edf1b968702 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:29.233235 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096815e-1a6a-46a1-a17d-2eab7e0273da None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:29.237596 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21742e06-f9a6-4392-9e91-d5ab6dde7125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:29.238254 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21742e06-f9a6-4392-9e91-d5ab6dde7125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:29.238532 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21742e06-f9a6-4392-9e91-d5ab6dde7125 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:29.238799 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21742e06-f9a6-4392-9e91-d5ab6dde7125 admin admin] PATH_INFO: `/v3/projects/90d10fdad3184fc4b6813a8575069bc9` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:29.241624 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21742e06-f9a6-4392-9e91-d5ab6dde7125 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90d10fdad3184fc4b6813a8575069bc9)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:29.243629 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21742e06-f9a6-4392-9e91-d5ab6dde7125 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:29.250322 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df944b70-bf0d-4290-bbba-1170b8ded159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:29.250960 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df944b70-bf0d-4290-bbba-1170b8ded159 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:29.251291 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df944b70-bf0d-4290-bbba-1170b8ded159 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:29.251562 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df944b70-bf0d-4290-bbba-1170b8ded159 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:29.252219 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df944b70-bf0d-4290-bbba-1170b8ded159 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:40:29.252522 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df944b70-bf0d-4290-bbba-1170b8ded159 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:29.254162 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df944b70-bf0d-4290-bbba-1170b8ded159 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:29.282006 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1343/2707] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:40:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:40:29.286410 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df944b70-bf0d-4290-bbba-1170b8ded159 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:29.309303 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df944b70-bf0d-4290-bbba-1170b8ded159 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:29.316736 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696dcbe6-0f66-4da4-ab75-7674c8d67847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:29.317411 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696dcbe6-0f66-4da4-ab75-7674c8d67847 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:29.319342 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696dcbe6-0f66-4da4-ab75-7674c8d67847 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:29.319485 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696dcbe6-0f66-4da4-ab75-7674c8d67847 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:29.321018 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696dcbe6-0f66-4da4-ab75-7674c8d67847 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:29.323500 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696dcbe6-0f66-4da4-ab75-7674c8d67847 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:29.335918 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-21742e06-f9a6-4392-9e91-d5ab6dde7125 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90d10fdad3184fc4b6813a8575069bc9', 'request_id': 'req-21742e06-f9a6-4392-9e91-d5ab6dde7125'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:29.342973 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-21742e06-f9a6-4392-9e91-d5ab6dde7125 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90d10fdad3184fc4b6813a8575069bc9', 'request_id': 'req-21742e06-f9a6-4392-9e91-d5ab6dde7125'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:29.355361 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-21742e06-f9a6-4392-9e91-d5ab6dde7125 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90d10fdad3184fc4b6813a8575069bc9', 'request_id': 'req-21742e06-f9a6-4392-9e91-d5ab6dde7125'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:29.381670 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1344/2708] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:40:29 2022] POST /identity/v3/projects => generated 393 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:40:29.382547 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696dcbe6-0f66-4da4-ab75-7674c8d67847 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:29.388077 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-21742e06-f9a6-4392-9e91-d5ab6dde7125 admin admin] The token cache is being invalidate because project 90d10fdad3184fc4b6813a8575069bc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:40:29.389371 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-21742e06-f9a6-4392-9e91-d5ab6dde7125 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:29.391076 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-21742e06-f9a6-4392-9e91-d5ab6dde7125 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:29.394175 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1365/2709] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:29 2022] DELETE /identity/v3/projects/90d10fdad3184fc4b6813a8575069bc9 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:29.400091 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21742e06-f9a6-4392-9e91-d5ab6dde7125 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:29.402909 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-21742e06-f9a6-4392-9e91-d5ab6dde7125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:29.467492 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696dcbe6-0f66-4da4-ab75-7674c8d67847 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:29.472503 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da1752-80f8-4f91-a53b-2d33de2b797b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:29.474520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da1752-80f8-4f91-a53b-2d33de2b797b admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:29.474797 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da1752-80f8-4f91-a53b-2d33de2b797b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:29.474978 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da1752-80f8-4f91-a53b-2d33de2b797b admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:29.475673 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da1752-80f8-4f91-a53b-2d33de2b797b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:29.477500 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:29.477866 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da1752-80f8-4f91-a53b-2d33de2b797b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:29.522722 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1345/2710] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:40:29 2022] POST /identity/v3/users => generated 297 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:40:29.524437 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da1752-80f8-4f91-a53b-2d33de2b797b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:29.526428 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-81da1752-80f8-4f91-a53b-2d33de2b797b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:29.529102 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21742e06-f9a6-4392-9e91-d5ab6dde7125 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:29.535616 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8efcbf7-3031-423d-884a-26f27d0dd15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:29.537572 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efcbf7-3031-423d-884a-26f27d0dd15b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:29.537949 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efcbf7-3031-423d-884a-26f27d0dd15b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:29.538379 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efcbf7-3031-423d-884a-26f27d0dd15b admin admin] PATH_INFO: `/v3/users/52ea6a0f66d84517a3438086698094fc` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:29.539752 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8efcbf7-3031-423d-884a-26f27d0dd15b admin admin] RBAC: Authorizing `identity:delete_user(user_id=52ea6a0f66d84517a3438086698094fc)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:29.541942 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8efcbf7-3031-423d-884a-26f27d0dd15b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:29.542613 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da1752-80f8-4f91-a53b-2d33de2b797b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:29.551267 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86646d5-f06f-4447-959e-cc4c5fab9fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:29.552449 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86646d5-f06f-4447-959e-cc4c5fab9fcc admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:29.552924 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86646d5-f06f-4447-959e-cc4c5fab9fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:29.553383 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86646d5-f06f-4447-959e-cc4c5fab9fcc admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:29.554393 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86646d5-f06f-4447-959e-cc4c5fab9fcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:29.556557 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86646d5-f06f-4447-959e-cc4c5fab9fcc admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:29.573053 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1346/2711] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:40:29 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:40:29.575129 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86646d5-f06f-4447-959e-cc4c5fab9fcc admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:29.589501 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86646d5-f06f-4447-959e-cc4c5fab9fcc admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:29.595392 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6505689c-249a-41e5-a913-830f8f260168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:29.596175 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505689c-249a-41e5-a913-830f8f260168 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:29.596741 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505689c-249a-41e5-a913-830f8f260168 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:29.597167 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505689c-249a-41e5-a913-830f8f260168 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:29.598247 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6505689c-249a-41e5-a913-830f8f260168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:29.601300 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6505689c-249a-41e5-a913-830f8f260168 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:29.603836 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b8efcbf7-3031-423d-884a-26f27d0dd15b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52ea6a0f66d84517a3438086698094fc'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:29.604753 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b8efcbf7-3031-423d-884a-26f27d0dd15b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52ea6a0f66d84517a3438086698094fc'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:29.615695 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1347/2712] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:40:29 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:40:29.620551 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6505689c-249a-41e5-a913-830f8f260168 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:29.625548 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b8efcbf7-3031-423d-884a-26f27d0dd15b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52ea6a0f66d84517a3438086698094fc'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:29.634268 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6505689c-249a-41e5-a913-830f8f260168 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:29.635797 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b8efcbf7-3031-423d-884a-26f27d0dd15b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52ea6a0f66d84517a3438086698094fc'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:29.643738 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e919a-0295-43b7-87db-e2e9533891c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:29.644503 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e919a-0295-43b7-87db-e2e9533891c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:29.644851 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e919a-0295-43b7-87db-e2e9533891c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:29.645195 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e919a-0295-43b7-87db-e2e9533891c1 admin admin] PATH_INFO: `/v3/projects/936fa60fa7e24fd9b9014521544670dc/users/cd46d7afd06f41c2a09132a349aa3fd4/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:29.646253 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b8efcbf7-3031-423d-884a-26f27d0dd15b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52ea6a0f66d84517a3438086698094fc'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:29.648867 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:29.659324 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1366/2713] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:40:29 2022] DELETE /identity/v3/users/52ea6a0f66d84517a3438086698094fc => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:29.678063 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227e919a-0295-43b7-87db-e2e9533891c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=936fa60fa7e24fd9b9014521544670dc, user_id=cd46d7afd06f41c2a09132a349aa3fd4, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:29.682299 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227e919a-0295-43b7-87db-e2e9533891c1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:29.713093 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1348/2714] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:40:29 2022] PUT /identity/v3/projects/936fa60fa7e24fd9b9014521544670dc/users/cd46d7afd06f41c2a09132a349aa3fd4/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:29.729723 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f2331-ed95-4c6e-a8e6-77cca042b751 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:29.730430 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f2331-ed95-4c6e-a8e6-77cca042b751 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:29.730898 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f2331-ed95-4c6e-a8e6-77cca042b751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:29.820582 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-125f2331-ed95-4c6e-a8e6-77cca042b751 None None] MFA Rules not processed for user `cd46d7afd06f41c2a09132a349aa3fd4`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:29.822195 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-125f2331-ed95-4c6e-a8e6-77cca042b751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:30.044389 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1367/2715] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:40:29 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:30.048567 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e919a-0295-43b7-87db-e2e9533891c1 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:30.051179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-227e919a-0295-43b7-87db-e2e9533891c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:30.158607 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e919a-0295-43b7-87db-e2e9533891c1 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:30.165316 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e29cacf-146f-4daa-924e-17c57dd1f2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:30.166661 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29cacf-146f-4daa-924e-17c57dd1f2f9 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:30.167384 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29cacf-146f-4daa-924e-17c57dd1f2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:30.167870 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29cacf-146f-4daa-924e-17c57dd1f2f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:30.168825 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e29cacf-146f-4daa-924e-17c57dd1f2f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:30.171823 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e29cacf-146f-4daa-924e-17c57dd1f2f9 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:30.212761 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1349/2716] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:40:30 2022] POST /identity/v3/projects => generated 393 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:40:30.216463 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f2331-ed95-4c6e-a8e6-77cca042b751 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:30.235143 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f2331-ed95-4c6e-a8e6-77cca042b751 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:30.302582 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e29cacf-146f-4daa-924e-17c57dd1f2f9 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:30.304515 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6e29cacf-146f-4daa-924e-17c57dd1f2f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:30.313459 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:30.353358 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac42cb-7f73-4943-abcd-be8783c843c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:30.354315 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac42cb-7f73-4943-abcd-be8783c843c0 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:30.356246 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac42cb-7f73-4943-abcd-be8783c843c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:30.356673 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac42cb-7f73-4943-abcd-be8783c843c0 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:30.357890 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac42cb-7f73-4943-abcd-be8783c843c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:30.379541 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac42cb-7f73-4943-abcd-be8783c843c0 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:30.454369 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1368/2717] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:40:30 2022] POST /identity/v3/users => generated 303 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:40:30.455787 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac42cb-7f73-4943-abcd-be8783c843c0 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:30.468625 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac42cb-7f73-4943-abcd-be8783c843c0 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:30.472404 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e29cacf-146f-4daa-924e-17c57dd1f2f9 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:30.476929 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da349dd-1964-4c31-85ee-abb7ed6f2a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:30.477559 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da349dd-1964-4c31-85ee-abb7ed6f2a6a admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:30.477838 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da349dd-1964-4c31-85ee-abb7ed6f2a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:30.478114 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da349dd-1964-4c31-85ee-abb7ed6f2a6a admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:30.478896 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da349dd-1964-4c31-85ee-abb7ed6f2a6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:30.480565 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da349dd-1964-4c31-85ee-abb7ed6f2a6a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:30.482306 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5965004-4c31-4a8f-8d11-8999e5b1e4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:30.484316 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5965004-4c31-4a8f-8d11-8999e5b1e4e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:30.484824 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5965004-4c31-4a8f-8d11-8999e5b1e4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:30.485296 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5965004-4c31-4a8f-8d11-8999e5b1e4e1 admin admin] PATH_INFO: `/v3/projects/e660481fe203413cbf8e0de889c1d287` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:30.487466 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5965004-4c31-4a8f-8d11-8999e5b1e4e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e660481fe203413cbf8e0de889c1d287)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:30.494857 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5965004-4c31-4a8f-8d11-8999e5b1e4e1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:30.498729 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1369/2718] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:40:30.502857 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da349dd-1964-4c31-85ee-abb7ed6f2a6a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:30.515223 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da349dd-1964-4c31-85ee-abb7ed6f2a6a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:30.520996 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0651a555-03fd-4545-afc5-556072adccdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:30.521688 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651a555-03fd-4545-afc5-556072adccdb admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:30.521970 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651a555-03fd-4545-afc5-556072adccdb admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:30.522242 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651a555-03fd-4545-afc5-556072adccdb admin admin] PATH_INFO: `/v3/projects/b85774c4058e41039e37bf970208d1df/users/b707e515afc149219025d224fe1df8e0/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:30.544215 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0651a555-03fd-4545-afc5-556072adccdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b85774c4058e41039e37bf970208d1df, user_id=b707e515afc149219025d224fe1df8e0, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:30.547184 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0651a555-03fd-4545-afc5-556072adccdb admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:30.577418 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1370/2719] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:40:30 2022] PUT /identity/v3/projects/b85774c4058e41039e37bf970208d1df/users/b707e515afc149219025d224fe1df8e0/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:40:30.578401 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0651a555-03fd-4545-afc5-556072adccdb admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:30.634633 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a5965004-4c31-4a8f-8d11-8999e5b1e4e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e660481fe203413cbf8e0de889c1d287', 'request_id': 'req-a5965004-4c31-4a8f-8d11-8999e5b1e4e1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:30.648359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a5965004-4c31-4a8f-8d11-8999e5b1e4e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e660481fe203413cbf8e0de889c1d287', 'request_id': 'req-a5965004-4c31-4a8f-8d11-8999e5b1e4e1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:30.660501 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a5965004-4c31-4a8f-8d11-8999e5b1e4e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e660481fe203413cbf8e0de889c1d287', 'request_id': 'req-a5965004-4c31-4a8f-8d11-8999e5b1e4e1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:30.672320 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:30.681088 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a5965004-4c31-4a8f-8d11-8999e5b1e4e1 admin admin] The token cache is being invalidate because project e660481fe203413cbf8e0de889c1d287 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:40:30.681393 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a5965004-4c31-4a8f-8d11-8999e5b1e4e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:30.682351 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a5965004-4c31-4a8f-8d11-8999e5b1e4e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:30.689824 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1350/2720] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:30 2022] DELETE /identity/v3/projects/e660481fe203413cbf8e0de889c1d287 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:30.698677 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366f983-9e7f-4812-95c2-65d331ff8229 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:30.698962 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366f983-9e7f-4812-95c2-65d331ff8229 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:30.699273 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366f983-9e7f-4812-95c2-65d331ff8229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:30.737981 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a366f983-9e7f-4812-95c2-65d331ff8229 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:30.739325 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a366f983-9e7f-4812-95c2-65d331ff8229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:30.752899 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0651a555-03fd-4545-afc5-556072adccdb admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:30.901240 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e149301-3bed-4840-9e1f-c0f31ea50c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:30.902055 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e149301-3bed-4840-9e1f-c0f31ea50c18 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:30.902588 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e149301-3bed-4840-9e1f-c0f31ea50c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:30.903199 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e149301-3bed-4840-9e1f-c0f31ea50c18 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:30.904006 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e149301-3bed-4840-9e1f-c0f31ea50c18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:30.905808 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e149301-3bed-4840-9e1f-c0f31ea50c18 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:30.933975 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1371/2721] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:40:30.936618 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e149301-3bed-4840-9e1f-c0f31ea50c18 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:30.938344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2e149301-3bed-4840-9e1f-c0f31ea50c18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:30.959724 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1351/2722] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:40:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:30.965913 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06f791-67fd-4c06-b948-f1848562edbf None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:30.966200 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06f791-67fd-4c06-b948-f1848562edbf None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:30.966481 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06f791-67fd-4c06-b948-f1848562edbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:31.012622 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-5e06f791-67fd-4c06-b948-f1848562edbf None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:31.015185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5e06f791-67fd-4c06-b948-f1848562edbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:31.016756 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e149301-3bed-4840-9e1f-c0f31ea50c18 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:31.032647 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9190411e-f684-4ad6-9fd8-c7440a806d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:31.033343 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190411e-f684-4ad6-9fd8-c7440a806d17 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:31.035410 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190411e-f684-4ad6-9fd8-c7440a806d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:31.035713 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190411e-f684-4ad6-9fd8-c7440a806d17 admin admin] PATH_INFO: `/v3/projects/b85774c4058e41039e37bf970208d1df/users/b707e515afc149219025d224fe1df8e0/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:31.046085 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9190411e-f684-4ad6-9fd8-c7440a806d17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b85774c4058e41039e37bf970208d1df, user_id=b707e515afc149219025d224fe1df8e0, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:31.046085 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9190411e-f684-4ad6-9fd8-c7440a806d17 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:31.046726 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1352/2723] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:40:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:31.047833 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06f791-67fd-4c06-b948-f1848562edbf None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:31.064148 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06f791-67fd-4c06-b948-f1848562edbf None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:31.118827 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1372/2724] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:40:30 2022] PUT /identity/v3/projects/b85774c4058e41039e37bf970208d1df/users/b707e515afc149219025d224fe1df8e0/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:40:31.121573 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b5759-828f-498d-ae03-4c9e91f7f604 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:31.122343 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b5759-828f-498d-ae03-4c9e91f7f604 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:31.125745 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b5759-828f-498d-ae03-4c9e91f7f604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:31.210009 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-887b5759-828f-498d-ae03-4c9e91f7f604 None None] MFA Rules not processed for user `b707e515afc149219025d224fe1df8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:31.212915 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-887b5759-828f-498d-ae03-4c9e91f7f604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:31.216324 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94ef0d-44f0-4c1f-bb55-631168d83893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:31.218374 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94ef0d-44f0-4c1f-bb55-631168d83893 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:31.219383 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94ef0d-44f0-4c1f-bb55-631168d83893 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:31.220241 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94ef0d-44f0-4c1f-bb55-631168d83893 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:31.222081 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94ef0d-44f0-4c1f-bb55-631168d83893 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:40:31.223059 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94ef0d-44f0-4c1f-bb55-631168d83893 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:31.229386 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94ef0d-44f0-4c1f-bb55-631168d83893 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:31.251794 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:31.254350 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1353/2725] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:40:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:40:31.261128 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94ef0d-44f0-4c1f-bb55-631168d83893 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:31.285674 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94ef0d-44f0-4c1f-bb55-631168d83893 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:31.297239 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ebd73b-802c-4d40-adce-afec5d8e00ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:31.298027 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebd73b-802c-4d40-adce-afec5d8e00ae admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:31.298403 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebd73b-802c-4d40-adce-afec5d8e00ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:31.298775 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebd73b-802c-4d40-adce-afec5d8e00ae admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:31.300137 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ebd73b-802c-4d40-adce-afec5d8e00ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:31.304357 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ebd73b-802c-4d40-adce-afec5d8e00ae admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:31.365840 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1354/2726] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:40:31 2022] POST /identity/v3/projects => generated 387 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:40:31.369973 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ebd73b-802c-4d40-adce-afec5d8e00ae admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:31.411779 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1373/2727] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:40:31 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:31.413492 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d9a15-ca21-4cb6-bc61-2c169006dcc8 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:31.413696 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d9a15-ca21-4cb6-bc61-2c169006dcc8 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:31.413972 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d9a15-ca21-4cb6-bc61-2c169006dcc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:31.450671 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-2f0d9a15-ca21-4cb6-bc61-2c169006dcc8 None None] MFA Rules not processed for user `cd46d7afd06f41c2a09132a349aa3fd4`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:31.452277 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2f0d9a15-ca21-4cb6-bc61-2c169006dcc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:31.528493 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ebd73b-802c-4d40-adce-afec5d8e00ae admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:31.547688 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc86ec4f-f1bc-4988-9161-c3dd66472a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:31.548764 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86ec4f-f1bc-4988-9161-c3dd66472a85 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:31.549021 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86ec4f-f1bc-4988-9161-c3dd66472a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:31.549379 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86ec4f-f1bc-4988-9161-c3dd66472a85 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:31.550166 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc86ec4f-f1bc-4988-9161-c3dd66472a85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:31.552873 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc86ec4f-f1bc-4988-9161-c3dd66472a85 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:31.565044 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1374/2728] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:40:31 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:31.566108 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d9a15-ca21-4cb6-bc61-2c169006dcc8 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:31.571232 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2f0d9a15-ca21-4cb6-bc61-2c169006dcc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:31.590375 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:31.623258 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1355/2729] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:40:31 2022] POST /identity/v3/users => generated 294 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:40:31.628089 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc86ec4f-f1bc-4988-9161-c3dd66472a85 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:31.631036 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-dc86ec4f-f1bc-4988-9161-c3dd66472a85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:31.714132 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d9a15-ca21-4cb6-bc61-2c169006dcc8 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:31.729907 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eaf7ce-55ea-4ebd-bc80-e70535e41464 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:31.730597 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eaf7ce-55ea-4ebd-bc80-e70535e41464 service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:31.730872 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eaf7ce-55ea-4ebd-bc80-e70535e41464 service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:31.731166 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eaf7ce-55ea-4ebd-bc80-e70535e41464 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:31.735552 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-42eaf7ce-55ea-4ebd-bc80-e70535e41464 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:31.775961 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eaf7ce-55ea-4ebd-bc80-e70535e41464 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:31.780063 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eaf7ce-55ea-4ebd-bc80-e70535e41464 service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:31.816207 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1375/2730] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:40:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:40:31.821655 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eaf7ce-55ea-4ebd-bc80-e70535e41464 service placement] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:31.858499 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eaf7ce-55ea-4ebd-bc80-e70535e41464 service placement] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:31.862896 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc86ec4f-f1bc-4988-9161-c3dd66472a85 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:31.887210 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08984984-600c-4e70-80ae-783eb6deaec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:31.892219 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08984984-600c-4e70-80ae-783eb6deaec4 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:31.892793 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08984984-600c-4e70-80ae-783eb6deaec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:31.893031 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08984984-600c-4e70-80ae-783eb6deaec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:31.897174 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08984984-600c-4e70-80ae-783eb6deaec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:31.903782 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1cddee-b440-40c2-bcd9-a909a162ef81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:31.905293 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08984984-600c-4e70-80ae-783eb6deaec4 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:31.906760 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1cddee-b440-40c2-bcd9-a909a162ef81 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:31.906884 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1cddee-b440-40c2-bcd9-a909a162ef81 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:31.907137 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1cddee-b440-40c2-bcd9-a909a162ef81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:31.913478 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3b1cddee-b440-40c2-bcd9-a909a162ef81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:31.949485 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1376/2731] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:40:31.949485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08984984-600c-4e70-80ae-783eb6deaec4 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:31.952222 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1cddee-b440-40c2-bcd9-a909a162ef81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:31.973274 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1cddee-b440-40c2-bcd9-a909a162ef81 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:32.000587 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08984984-600c-4e70-80ae-783eb6deaec4 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:32.009796 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1356/2732] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:40:31 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:40:32.021058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866cbbe-e06f-4604-aa8c-ab1338eaf71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:32.022202 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866cbbe-e06f-4604-aa8c-ab1338eaf71e admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:32.031814 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866cbbe-e06f-4604-aa8c-ab1338eaf71e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:32.033810 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866cbbe-e06f-4604-aa8c-ab1338eaf71e admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:32.037442 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2866cbbe-e06f-4604-aa8c-ab1338eaf71e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:32.039837 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2866cbbe-e06f-4604-aa8c-ab1338eaf71e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:32.077639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1cddee-b440-40c2-bcd9-a909a162ef81 service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:32.080036 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1377/2733] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:40:32.090370 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1cddee-b440-40c2-bcd9-a909a162ef81 service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:32.107752 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ab55d-5e62-4a7c-87e0-27fa5d3caffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:32.108419 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ab55d-5e62-4a7c-87e0-27fa5d3caffd admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:32.108702 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ab55d-5e62-4a7c-87e0-27fa5d3caffd admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:32.108975 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ab55d-5e62-4a7c-87e0-27fa5d3caffd admin admin] PATH_INFO: `/v3/projects/3d98eb98aa5b4e5fb7266edf6fad84d7/users/e82ed6e01c904dbfbc7c337a32791fff/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:32.147584 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489ab55d-5e62-4a7c-87e0-27fa5d3caffd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d98eb98aa5b4e5fb7266edf6fad84d7, user_id=e82ed6e01c904dbfbc7c337a32791fff, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:32.150272 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489ab55d-5e62-4a7c-87e0-27fa5d3caffd admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:32.184013 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1357/2734] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:40:32 2022] PUT /identity/v3/projects/3d98eb98aa5b4e5fb7266edf6fad84d7/users/e82ed6e01c904dbfbc7c337a32791fff/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:32.189798 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1d76f-82eb-4530-9eaf-47d4cd2aab6b None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:32.190206 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1d76f-82eb-4530-9eaf-47d4cd2aab6b None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:32.190585 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1d76f-82eb-4530-9eaf-47d4cd2aab6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:32.236476 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-4fe1d76f-82eb-4530-9eaf-47d4cd2aab6b None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:32.241480 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4fe1d76f-82eb-4530-9eaf-47d4cd2aab6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:32.277442 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:32.334318 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1378/2735] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:40:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:32.362105 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ab55d-5e62-4a7c-87e0-27fa5d3caffd admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:32.363916 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-489ab55d-5e62-4a7c-87e0-27fa5d3caffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:32.638417 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ab55d-5e62-4a7c-87e0-27fa5d3caffd admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:32.659204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152101dd-2091-4038-a644-c8c364e553f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:32.659843 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152101dd-2091-4038-a644-c8c364e553f1 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:32.660130 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152101dd-2091-4038-a644-c8c364e553f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:32.665124 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152101dd-2091-4038-a644-c8c364e553f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:32.706888 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152101dd-2091-4038-a644-c8c364e553f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:32.709236 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152101dd-2091-4038-a644-c8c364e553f1 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:32.721074 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1358/2736] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:40:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:40:33.940465 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e068c7f-cb78-46af-b63d-ab1ea3067028 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:33.941075 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e068c7f-cb78-46af-b63d-ab1ea3067028 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:33.941075 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e068c7f-cb78-46af-b63d-ab1ea3067028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:34.029758 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-3e068c7f-cb78-46af-b63d-ab1ea3067028 None None] MFA Rules not processed for user `f12698b45a114720af9c98b163077f59`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:34.031523 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3e068c7f-cb78-46af-b63d-ab1ea3067028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:34.157609 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1379/2737] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:40:33 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:40:36.359531 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152101dd-2091-4038-a644-c8c364e553f1 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:36.361204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-152101dd-2091-4038-a644-c8c364e553f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:36.401297 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152101dd-2091-4038-a644-c8c364e553f1 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:36.448563 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b1224-6cac-4604-ac51-8a07fce28504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:36.449231 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b1224-6cac-4604-ac51-8a07fce28504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:36.449514 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b1224-6cac-4604-ac51-8a07fce28504 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:36.449791 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b1224-6cac-4604-ac51-8a07fce28504 admin admin] PATH_INFO: `/v3/users/06856f1488e44bde85de23a5effddbdd` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:36.459897 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b1224-6cac-4604-ac51-8a07fce28504 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06856f1488e44bde85de23a5effddbdd)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:36.466638 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b1224-6cac-4604-ac51-8a07fce28504 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:36.718116 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9f5b1224-6cac-4604-ac51-8a07fce28504 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06856f1488e44bde85de23a5effddbdd'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:36.720296 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9f5b1224-6cac-4604-ac51-8a07fce28504 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06856f1488e44bde85de23a5effddbdd'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:36.727204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:INSERT=3,keystone:SELECT=89,keystone:DELETE=8 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:36.735877 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9f5b1224-6cac-4604-ac51-8a07fce28504 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06856f1488e44bde85de23a5effddbdd'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:36.753026 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9f5b1224-6cac-4604-ac51-8a07fce28504 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06856f1488e44bde85de23a5effddbdd'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:36.754060 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9f5b1224-6cac-4604-ac51-8a07fce28504 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06856f1488e44bde85de23a5effddbdd'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:36.777974 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1359/2738] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:40:36 2022] DELETE /identity/v3/users/06856f1488e44bde85de23a5effddbdd => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:37.098531 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e068c7f-cb78-46af-b63d-ab1ea3067028 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:37.114025 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e068c7f-cb78-46af-b63d-ab1ea3067028 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:37.242055 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64dad7-8221-4e0f-96cb-0f3b31dfce41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:37.242804 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64dad7-8221-4e0f-96cb-0f3b31dfce41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:37.243157 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64dad7-8221-4e0f-96cb-0f3b31dfce41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:37.243605 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64dad7-8221-4e0f-96cb-0f3b31dfce41 admin admin] PATH_INFO: `/v3/projects/3ab5abb97d5e40b0a4dea82546dcb92c` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:37.245810 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c64dad7-8221-4e0f-96cb-0f3b31dfce41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ab5abb97d5e40b0a4dea82546dcb92c)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:37.248514 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c64dad7-8221-4e0f-96cb-0f3b31dfce41 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:37.369642 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2c64dad7-8221-4e0f-96cb-0f3b31dfce41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ab5abb97d5e40b0a4dea82546dcb92c', 'request_id': 'req-2c64dad7-8221-4e0f-96cb-0f3b31dfce41'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:37.387883 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2c64dad7-8221-4e0f-96cb-0f3b31dfce41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ab5abb97d5e40b0a4dea82546dcb92c', 'request_id': 'req-2c64dad7-8221-4e0f-96cb-0f3b31dfce41'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:37.405198 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2c64dad7-8221-4e0f-96cb-0f3b31dfce41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ab5abb97d5e40b0a4dea82546dcb92c', 'request_id': 'req-2c64dad7-8221-4e0f-96cb-0f3b31dfce41'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:37.428124 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2c64dad7-8221-4e0f-96cb-0f3b31dfce41 admin admin] The token cache is being invalidate because project 3ab5abb97d5e40b0a4dea82546dcb92c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:40:37.428482 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2c64dad7-8221-4e0f-96cb-0f3b31dfce41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:37.429171 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2c64dad7-8221-4e0f-96cb-0f3b31dfce41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:37.438472 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b1224-6cac-4604-ac51-8a07fce28504 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:37.440264 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9f5b1224-6cac-4604-ac51-8a07fce28504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:37.448063 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1380/2739] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:37 2022] DELETE /identity/v3/projects/3ab5abb97d5e40b0a4dea82546dcb92c => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:37.467844 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b1224-6cac-4604-ac51-8a07fce28504 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:37.609081 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b50db6-c33f-4358-84eb-eb05fbd231d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:37.609745 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b50db6-c33f-4358-84eb-eb05fbd231d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:37.610027 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b50db6-c33f-4358-84eb-eb05fbd231d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:37.610295 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b50db6-c33f-4358-84eb-eb05fbd231d9 admin admin] PATH_INFO: `/v3/users/f2c1a5b07fa94554878fe1d7c2d86992` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:37.611784 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b50db6-c33f-4358-84eb-eb05fbd231d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2c1a5b07fa94554878fe1d7c2d86992)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:37.619717 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b50db6-c33f-4358-84eb-eb05fbd231d9 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:37.738085 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-75b50db6-c33f-4358-84eb-eb05fbd231d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2c1a5b07fa94554878fe1d7c2d86992'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:37.739232 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-75b50db6-c33f-4358-84eb-eb05fbd231d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2c1a5b07fa94554878fe1d7c2d86992'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:37.764074 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-75b50db6-c33f-4358-84eb-eb05fbd231d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2c1a5b07fa94554878fe1d7c2d86992'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:37.781820 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-75b50db6-c33f-4358-84eb-eb05fbd231d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2c1a5b07fa94554878fe1d7c2d86992'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:37.783009 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-75b50db6-c33f-4358-84eb-eb05fbd231d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2c1a5b07fa94554878fe1d7c2d86992'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:37.811538 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1360/2740] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:40:37 2022] DELETE /identity/v3/users/f2c1a5b07fa94554878fe1d7c2d86992 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:38.524836 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64dad7-8221-4e0f-96cb-0f3b31dfce41 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:38.526791 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2c64dad7-8221-4e0f-96cb-0f3b31dfce41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:38.540975 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:38.552418 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64dad7-8221-4e0f-96cb-0f3b31dfce41 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:38.723946 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc99a4-f8c7-4375-b8f7-2f761247f3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:38.732867 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc99a4-f8c7-4375-b8f7-2f761247f3a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:38.732867 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc99a4-f8c7-4375-b8f7-2f761247f3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:38.732867 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc99a4-f8c7-4375-b8f7-2f761247f3a0 admin admin] PATH_INFO: `/v3/projects/3c07d296b6904cf1af9bdba98ce434e9` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:38.734666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc99a4-f8c7-4375-b8f7-2f761247f3a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c07d296b6904cf1af9bdba98ce434e9)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:38.748563 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc99a4-f8c7-4375-b8f7-2f761247f3a0 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:38.926182 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-87fc99a4-f8c7-4375-b8f7-2f761247f3a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c07d296b6904cf1af9bdba98ce434e9', 'request_id': 'req-87fc99a4-f8c7-4375-b8f7-2f761247f3a0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:38.936513 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-87fc99a4-f8c7-4375-b8f7-2f761247f3a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c07d296b6904cf1af9bdba98ce434e9', 'request_id': 'req-87fc99a4-f8c7-4375-b8f7-2f761247f3a0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:38.953801 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-87fc99a4-f8c7-4375-b8f7-2f761247f3a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c07d296b6904cf1af9bdba98ce434e9', 'request_id': 'req-87fc99a4-f8c7-4375-b8f7-2f761247f3a0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:38.976629 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-87fc99a4-f8c7-4375-b8f7-2f761247f3a0 admin admin] The token cache is being invalidate because project 3c07d296b6904cf1af9bdba98ce434e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:40:38.976629 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-87fc99a4-f8c7-4375-b8f7-2f761247f3a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:38.976983 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-87fc99a4-f8c7-4375-b8f7-2f761247f3a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:38.979279 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1381/2741] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:38 2022] DELETE /identity/v3/projects/3c07d296b6904cf1af9bdba98ce434e9 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:38.985039 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ef4a3-d380-4ed9-b7e0-48f8af7fc440 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:38.985588 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ef4a3-d380-4ed9-b7e0-48f8af7fc440 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:38.985588 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ef4a3-d380-4ed9-b7e0-48f8af7fc440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:39.025175 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-d42ef4a3-d380-4ed9-b7e0-48f8af7fc440 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:39.026646 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d42ef4a3-d380-4ed9-b7e0-48f8af7fc440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:39.107275 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:39.133475 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1361/2742] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:40:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:39.141808 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606d287-57d1-41d3-8143-cf28e7e766a6 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:39.141808 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606d287-57d1-41d3-8143-cf28e7e766a6 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:39.141808 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606d287-57d1-41d3-8143-cf28e7e766a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:39.205653 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-7606d287-57d1-41d3-8143-cf28e7e766a6 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:39.207149 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7606d287-57d1-41d3-8143-cf28e7e766a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:39.224892 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ef4a3-d380-4ed9-b7e0-48f8af7fc440 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:39.237851 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1382/2743] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:40:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:39.238894 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ef4a3-d380-4ed9-b7e0-48f8af7fc440 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:39.247671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f4205-0106-42c4-8c4b-9a874f422886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:39.248429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f4205-0106-42c4-8c4b-9a874f422886 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:39.248614 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f4205-0106-42c4-8c4b-9a874f422886 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:39.248890 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f4205-0106-42c4-8c4b-9a874f422886 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:39.249527 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8f4205-0106-42c4-8c4b-9a874f422886 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:40:39.249829 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8f4205-0106-42c4-8c4b-9a874f422886 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:39.251887 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8f4205-0106-42c4-8c4b-9a874f422886 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:39.279768 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7606d287-57d1-41d3-8143-cf28e7e766a6 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:39.286403 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1362/2744] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:40:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:40:39.291158 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7606d287-57d1-41d3-8143-cf28e7e766a6 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:39.299415 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410a11d-6a1b-4e11-b4ca-744eb98a9034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:39.300350 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410a11d-6a1b-4e11-b4ca-744eb98a9034 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:39.300866 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410a11d-6a1b-4e11-b4ca-744eb98a9034 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:39.301354 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410a11d-6a1b-4e11-b4ca-744eb98a9034 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:39.302732 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9410a11d-6a1b-4e11-b4ca-744eb98a9034 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:39.304943 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9410a11d-6a1b-4e11-b4ca-744eb98a9034 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:39.356693 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f4205-0106-42c4-8c4b-9a874f422886 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:39.369479 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1383/2745] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:40:39 2022] POST /identity/v3/projects => generated 383 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:40:39.374509 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f4205-0106-42c4-8c4b-9a874f422886 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:39.608215 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0518d3a-dde7-4a6e-8f3e-ceef7342eaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:39.608909 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0518d3a-dde7-4a6e-8f3e-ceef7342eaa8 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:39.609123 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0518d3a-dde7-4a6e-8f3e-ceef7342eaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:39.609394 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0518d3a-dde7-4a6e-8f3e-ceef7342eaa8 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:39.610039 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0518d3a-dde7-4a6e-8f3e-ceef7342eaa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:39.612038 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0518d3a-dde7-4a6e-8f3e-ceef7342eaa8 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:39.667379 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410a11d-6a1b-4e11-b4ca-744eb98a9034 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:39.668193 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1363/2746] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:40:39 2022] POST /identity/v3/users => generated 292 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:40:39.686720 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410a11d-6a1b-4e11-b4ca-744eb98a9034 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:39.707596 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df347f7b-6b41-449f-bd13-3c789bd7d8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:39.708288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df347f7b-6b41-449f-bd13-3c789bd7d8af admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:39.708581 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df347f7b-6b41-449f-bd13-3c789bd7d8af admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:39.711304 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df347f7b-6b41-449f-bd13-3c789bd7d8af admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:39.712074 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df347f7b-6b41-449f-bd13-3c789bd7d8af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:39.716376 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df347f7b-6b41-449f-bd13-3c789bd7d8af admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:39.752102 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1384/2747] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:40:39.756079 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0518d3a-dde7-4a6e-8f3e-ceef7342eaa8 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:39.773075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0518d3a-dde7-4a6e-8f3e-ceef7342eaa8 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:39.788741 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9149a3a-520a-4606-8b21-272661768e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:39.789476 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9149a3a-520a-4606-8b21-272661768e50 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:39.789762 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9149a3a-520a-4606-8b21-272661768e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:39.790042 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9149a3a-520a-4606-8b21-272661768e50 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:39.790814 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9149a3a-520a-4606-8b21-272661768e50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:39.792740 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9149a3a-520a-4606-8b21-272661768e50 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:39.841072 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1364/2748] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:40:39.845853 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df347f7b-6b41-449f-bd13-3c789bd7d8af admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:39.881031 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df347f7b-6b41-449f-bd13-3c789bd7d8af admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:39.909378 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2c4ac-1bdb-4313-8559-6f5755b85e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:39.910540 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2c4ac-1bdb-4313-8559-6f5755b85e7b admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:39.917821 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2c4ac-1bdb-4313-8559-6f5755b85e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:39.918256 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2c4ac-1bdb-4313-8559-6f5755b85e7b admin admin] PATH_INFO: `/v3/projects/51cfc9f7a4f147fdb4af41c3a4998b23/users/1ea687cf9a314739b76ca68d90960586/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:39.994611 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be2c4ac-1bdb-4313-8559-6f5755b85e7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=51cfc9f7a4f147fdb4af41c3a4998b23, user_id=1ea687cf9a314739b76ca68d90960586, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:40.004128 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be2c4ac-1bdb-4313-8559-6f5755b85e7b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:40.052889 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1385/2749] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:40:39 2022] PUT /identity/v3/projects/51cfc9f7a4f147fdb4af41c3a4998b23/users/1ea687cf9a314739b76ca68d90960586/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:40.064505 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af289570-0d9f-4a7f-ac5e-c6cdde954817 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:40.064998 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af289570-0d9f-4a7f-ac5e-c6cdde954817 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:40.065082 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af289570-0d9f-4a7f-ac5e-c6cdde954817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:40.170137 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-af289570-0d9f-4a7f-ac5e-c6cdde954817 None None] MFA Rules not processed for user `1ea687cf9a314739b76ca68d90960586`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:40.175058 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-af289570-0d9f-4a7f-ac5e-c6cdde954817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:40.454851 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1365/2750] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:40:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:40.462499 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2c4ac-1bdb-4313-8559-6f5755b85e7b admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:40.586415 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:40.668612 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2c4ac-1bdb-4313-8559-6f5755b85e7b admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:40.684311 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d9ead7-43eb-49cd-a059-9ae434adb070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:40.684957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9ead7-43eb-49cd-a059-9ae434adb070 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:40.685237 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9ead7-43eb-49cd-a059-9ae434adb070 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:40.685508 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9ead7-43eb-49cd-a059-9ae434adb070 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:40.686186 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d9ead7-43eb-49cd-a059-9ae434adb070 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:40.694461 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d9ead7-43eb-49cd-a059-9ae434adb070 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:40.776551 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1386/2751] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:40:40 2022] POST /identity/v3/projects => generated 385 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:40:40.777823 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af289570-0d9f-4a7f-ac5e-c6cdde954817 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:40.807233 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af289570-0d9f-4a7f-ac5e-c6cdde954817 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:40.970667 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:41.014201 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed6687-3112-4f81-8e20-84269e6f4998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:41.015277 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed6687-3112-4f81-8e20-84269e6f4998 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:41.015563 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed6687-3112-4f81-8e20-84269e6f4998 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:41.016065 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed6687-3112-4f81-8e20-84269e6f4998 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:41.017096 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ed6687-3112-4f81-8e20-84269e6f4998 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:41.020815 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ed6687-3112-4f81-8e20-84269e6f4998 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:41.095680 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1366/2752] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:40:40 2022] POST /identity/v3/users => generated 299 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:40:41.100438 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d9ead7-43eb-49cd-a059-9ae434adb070 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:41.118034 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d9ead7-43eb-49cd-a059-9ae434adb070 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:41.136504 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370abde-1c87-4b62-aa00-0c072e96f713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:41.137417 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370abde-1c87-4b62-aa00-0c072e96f713 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:41.137853 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370abde-1c87-4b62-aa00-0c072e96f713 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:41.138308 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370abde-1c87-4b62-aa00-0c072e96f713 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:41.139159 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0370abde-1c87-4b62-aa00-0c072e96f713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:41.141108 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0370abde-1c87-4b62-aa00-0c072e96f713 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:41.174052 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1387/2753] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:40:41.179564 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed6687-3112-4f81-8e20-84269e6f4998 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:41.210302 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed6687-3112-4f81-8e20-84269e6f4998 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:41.227253 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ce4cc-34cc-49bb-8cee-77c1c1124cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:41.233666 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ce4cc-34cc-49bb-8cee-77c1c1124cca admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:41.234391 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ce4cc-34cc-49bb-8cee-77c1c1124cca admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:41.237941 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ce4cc-34cc-49bb-8cee-77c1c1124cca admin admin] PATH_INFO: `/v3/projects/5fe0debde1d94b56b2a581d802fb15d8/users/517365dec9ad4625af0d764d1e8f0208/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:41.264162 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ce4cc-34cc-49bb-8cee-77c1c1124cca admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fe0debde1d94b56b2a581d802fb15d8, user_id=517365dec9ad4625af0d764d1e8f0208, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:41.268599 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ce4cc-34cc-49bb-8cee-77c1c1124cca admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:41.297372 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1367/2754] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:40:41 2022] PUT /identity/v3/projects/5fe0debde1d94b56b2a581d802fb15d8/users/517365dec9ad4625af0d764d1e8f0208/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:41.309753 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370abde-1c87-4b62-aa00-0c072e96f713 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:41.324404 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370abde-1c87-4b62-aa00-0c072e96f713 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:41.431233 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6757115-77db-46c0-a27f-2a4d42ad79fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:41.431867 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6757115-77db-46c0-a27f-2a4d42ad79fc admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:41.432148 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6757115-77db-46c0-a27f-2a4d42ad79fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:41.432421 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6757115-77db-46c0-a27f-2a4d42ad79fc admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:41.433074 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6757115-77db-46c0-a27f-2a4d42ad79fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:41.434710 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6757115-77db-46c0-a27f-2a4d42ad79fc admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:41.451295 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1388/2755] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:40:41.452766 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ce4cc-34cc-49bb-8cee-77c1c1124cca admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:41.468309 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ce4cc-34cc-49bb-8cee-77c1c1124cca admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:41.475116 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f2394b-d353-4d4b-93aa-f965c6f7366d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:41.476147 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2394b-d353-4d4b-93aa-f965c6f7366d admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:41.476868 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2394b-d353-4d4b-93aa-f965c6f7366d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:41.477358 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2394b-d353-4d4b-93aa-f965c6f7366d admin admin] PATH_INFO: `/v3/projects/5fe0debde1d94b56b2a581d802fb15d8/users/517365dec9ad4625af0d764d1e8f0208/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:41.479752 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f2394b-d353-4d4b-93aa-f965c6f7366d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fe0debde1d94b56b2a581d802fb15d8, user_id=517365dec9ad4625af0d764d1e8f0208, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:41.482903 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f2394b-d353-4d4b-93aa-f965c6f7366d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:41.513581 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7852e-0a8a-4187-968f-178f62255e69 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:41.513868 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7852e-0a8a-4187-968f-178f62255e69 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:41.515306 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7852e-0a8a-4187-968f-178f62255e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:41.523212 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1368/2756] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:40:41 2022] PUT /identity/v3/projects/5fe0debde1d94b56b2a581d802fb15d8/users/517365dec9ad4625af0d764d1e8f0208/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:41.551215 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-70c7852e-0a8a-4187-968f-178f62255e69 None None] MFA Rules not processed for user `517365dec9ad4625af0d764d1e8f0208`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:41.553782 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-70c7852e-0a8a-4187-968f-178f62255e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:41.694399 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1389/2757] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:40:41 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:41.712834 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f2394b-d353-4d4b-93aa-f965c6f7366d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:41.715544 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-62f2394b-d353-4d4b-93aa-f965c6f7366d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:41.844831 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f2394b-d353-4d4b-93aa-f965c6f7366d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:41.872162 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966804ac-2b45-47fe-99b5-a61b6ece1b91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:41.872861 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966804ac-2b45-47fe-99b5-a61b6ece1b91 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:41.873302 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966804ac-2b45-47fe-99b5-a61b6ece1b91 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:41.873585 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966804ac-2b45-47fe-99b5-a61b6ece1b91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:41.885532 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966804ac-2b45-47fe-99b5-a61b6ece1b91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:41.887248 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966804ac-2b45-47fe-99b5-a61b6ece1b91 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:41.902391 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1369/2758] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:40:41 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:40:42.484790 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7852e-0a8a-4187-968f-178f62255e69 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:42.558819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:42.639608 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7852e-0a8a-4187-968f-178f62255e69 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:42.659479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c224cc3a-616a-4a25-8ef3-40233310195a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:42.660333 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224cc3a-616a-4a25-8ef3-40233310195a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:42.661454 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224cc3a-616a-4a25-8ef3-40233310195a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:42.662273 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224cc3a-616a-4a25-8ef3-40233310195a admin admin] PATH_INFO: `/v3/users/1ea687cf9a314739b76ca68d90960586` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:42.663680 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c224cc3a-616a-4a25-8ef3-40233310195a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ea687cf9a314739b76ca68d90960586)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:42.667317 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c224cc3a-616a-4a25-8ef3-40233310195a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:42.813314 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c224cc3a-616a-4a25-8ef3-40233310195a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ea687cf9a314739b76ca68d90960586'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:42.815257 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c224cc3a-616a-4a25-8ef3-40233310195a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ea687cf9a314739b76ca68d90960586'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:42.875061 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c224cc3a-616a-4a25-8ef3-40233310195a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ea687cf9a314739b76ca68d90960586'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:42.886724 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c224cc3a-616a-4a25-8ef3-40233310195a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ea687cf9a314739b76ca68d90960586'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:42.907288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c224cc3a-616a-4a25-8ef3-40233310195a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ea687cf9a314739b76ca68d90960586'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:42.924707 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1390/2759] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:40:42 2022] DELETE /identity/v3/users/1ea687cf9a314739b76ca68d90960586 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:42.929527 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9086356-420b-44a9-b5d0-7ef404711e3a None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:42.931343 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9086356-420b-44a9-b5d0-7ef404711e3a None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:42.931854 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9086356-420b-44a9-b5d0-7ef404711e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:42.982534 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a9086356-420b-44a9-b5d0-7ef404711e3a None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:42.983812 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a9086356-420b-44a9-b5d0-7ef404711e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:43.089842 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1370/2760] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:40:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:43.132156 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c224cc3a-616a-4a25-8ef3-40233310195a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:43.134094 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c224cc3a-616a-4a25-8ef3-40233310195a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:43.236747 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c224cc3a-616a-4a25-8ef3-40233310195a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:43.246219 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2247135-a633-44af-b3c3-fc17e1f90dd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:43.248088 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2247135-a633-44af-b3c3-fc17e1f90dd7 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:43.248479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2247135-a633-44af-b3c3-fc17e1f90dd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:43.249008 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2247135-a633-44af-b3c3-fc17e1f90dd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:43.263702 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2247135-a633-44af-b3c3-fc17e1f90dd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:43.265284 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2247135-a633-44af-b3c3-fc17e1f90dd7 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:43.280003 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1391/2761] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:40:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:40:43.547950 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a89f2-3cc7-453f-b4e8-316c20c13cd4 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:43.548437 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a89f2-3cc7-453f-b4e8-316c20c13cd4 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:43.548864 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a89f2-3cc7-453f-b4e8-316c20c13cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:43.571191 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-419a89f2-3cc7-453f-b4e8-316c20c13cd4 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:43.572789 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-419a89f2-3cc7-453f-b4e8-316c20c13cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:43.626706 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:43.688311 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1371/2762] 10.222.0.83 () {58 vars in 967 bytes} [Mon Aug 29 15:40:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:43.711546 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2247135-a633-44af-b3c3-fc17e1f90dd7 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:43.713014 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d2247135-a633-44af-b3c3-fc17e1f90dd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:43.783730 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:43.827910 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2247135-a633-44af-b3c3-fc17e1f90dd7 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:43.860280 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144a991-bf80-44a0-b848-8955d5ad3c90 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:43.863087 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144a991-bf80-44a0-b848-8955d5ad3c90 service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:43.863569 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144a991-bf80-44a0-b848-8955d5ad3c90 service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:43.865163 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144a991-bf80-44a0-b848-8955d5ad3c90 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:43.889735 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144a991-bf80-44a0-b848-8955d5ad3c90 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:43.892002 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144a991-bf80-44a0-b848-8955d5ad3c90 service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:43.903843 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1392/2763] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 15:40:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:40:44.255603 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a89f2-3cc7-453f-b4e8-316c20c13cd4 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:44.257272 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-419a89f2-3cc7-453f-b4e8-316c20c13cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:44.283418 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a89f2-3cc7-453f-b4e8-316c20c13cd4 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:44.300005 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1760b556-b0fc-4978-aae2-ba12525f33f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:44.300660 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760b556-b0fc-4978-aae2-ba12525f33f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:44.300941 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760b556-b0fc-4978-aae2-ba12525f33f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:44.301211 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760b556-b0fc-4978-aae2-ba12525f33f3 admin admin] PATH_INFO: `/v3/projects/51cfc9f7a4f147fdb4af41c3a4998b23` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:44.303766 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1760b556-b0fc-4978-aae2-ba12525f33f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51cfc9f7a4f147fdb4af41c3a4998b23)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:44.306032 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1760b556-b0fc-4978-aae2-ba12525f33f3 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:44.457619 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1760b556-b0fc-4978-aae2-ba12525f33f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51cfc9f7a4f147fdb4af41c3a4998b23', 'request_id': 'req-1760b556-b0fc-4978-aae2-ba12525f33f3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:44.479721 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1760b556-b0fc-4978-aae2-ba12525f33f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51cfc9f7a4f147fdb4af41c3a4998b23', 'request_id': 'req-1760b556-b0fc-4978-aae2-ba12525f33f3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:44.495413 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1760b556-b0fc-4978-aae2-ba12525f33f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51cfc9f7a4f147fdb4af41c3a4998b23', 'request_id': 'req-1760b556-b0fc-4978-aae2-ba12525f33f3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:44.516642 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1760b556-b0fc-4978-aae2-ba12525f33f3 admin admin] The token cache is being invalidate because project 51cfc9f7a4f147fdb4af41c3a4998b23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:40:44.516935 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1760b556-b0fc-4978-aae2-ba12525f33f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:44.519415 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1760b556-b0fc-4978-aae2-ba12525f33f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:44.522245 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1372/2764] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:44 2022] DELETE /identity/v3/projects/51cfc9f7a4f147fdb4af41c3a4998b23 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:44.526397 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144a991-bf80-44a0-b848-8955d5ad3c90 service swift] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:44.538322 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144a991-bf80-44a0-b848-8955d5ad3c90 service swift] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:44.615355 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e310b-1f1a-4945-9d93-311c7d2cfb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:44.616212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e310b-1f1a-4945-9d93-311c7d2cfb14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:44.616498 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e310b-1f1a-4945-9d93-311c7d2cfb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:44.616769 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e310b-1f1a-4945-9d93-311c7d2cfb14 admin admin] PATH_INFO: `/v3/users/517365dec9ad4625af0d764d1e8f0208` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:44.618100 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e310b-1f1a-4945-9d93-311c7d2cfb14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=517365dec9ad4625af0d764d1e8f0208)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:44.620360 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e310b-1f1a-4945-9d93-311c7d2cfb14 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:44.705488 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0c3e310b-1f1a-4945-9d93-311c7d2cfb14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '517365dec9ad4625af0d764d1e8f0208'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:44.706309 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0c3e310b-1f1a-4945-9d93-311c7d2cfb14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '517365dec9ad4625af0d764d1e8f0208'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:44.727671 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0c3e310b-1f1a-4945-9d93-311c7d2cfb14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '517365dec9ad4625af0d764d1e8f0208'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:44.741570 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0c3e310b-1f1a-4945-9d93-311c7d2cfb14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '517365dec9ad4625af0d764d1e8f0208'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:44.762118 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0c3e310b-1f1a-4945-9d93-311c7d2cfb14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '517365dec9ad4625af0d764d1e8f0208'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:44.782446 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1393/2765] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:40:44 2022] DELETE /identity/v3/users/517365dec9ad4625af0d764d1e8f0208 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:44.865921 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c638c57-3a42-44bf-8f31-a8b5c0656866 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:44.866195 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c638c57-3a42-44bf-8f31-a8b5c0656866 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:44.866649 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c638c57-3a42-44bf-8f31-a8b5c0656866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:44.916038 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-1c638c57-3a42-44bf-8f31-a8b5c0656866 None None] MFA Rules not processed for user `09663bec61af43278da1d69c37594558`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:44.917591 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1c638c57-3a42-44bf-8f31-a8b5c0656866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:45.050356 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1373/2766] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:40:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:45.908864 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e310b-1f1a-4945-9d93-311c7d2cfb14 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:45.910638 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0c3e310b-1f1a-4945-9d93-311c7d2cfb14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:46.030160 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:46.044405 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e310b-1f1a-4945-9d93-311c7d2cfb14 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:46.051403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9565f6-da16-4f0e-8c3f-04e6819bcc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:46.052988 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9565f6-da16-4f0e-8c3f-04e6819bcc73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:46.053455 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9565f6-da16-4f0e-8c3f-04e6819bcc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:46.053896 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9565f6-da16-4f0e-8c3f-04e6819bcc73 admin admin] PATH_INFO: `/v3/projects/5fe0debde1d94b56b2a581d802fb15d8` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:46.055911 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9565f6-da16-4f0e-8c3f-04e6819bcc73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fe0debde1d94b56b2a581d802fb15d8)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:46.058151 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9565f6-da16-4f0e-8c3f-04e6819bcc73 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:46.127315 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ea9565f6-da16-4f0e-8c3f-04e6819bcc73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fe0debde1d94b56b2a581d802fb15d8', 'request_id': 'req-ea9565f6-da16-4f0e-8c3f-04e6819bcc73'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:46.135499 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ea9565f6-da16-4f0e-8c3f-04e6819bcc73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fe0debde1d94b56b2a581d802fb15d8', 'request_id': 'req-ea9565f6-da16-4f0e-8c3f-04e6819bcc73'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:46.151656 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ea9565f6-da16-4f0e-8c3f-04e6819bcc73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fe0debde1d94b56b2a581d802fb15d8', 'request_id': 'req-ea9565f6-da16-4f0e-8c3f-04e6819bcc73'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:46.170622 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ea9565f6-da16-4f0e-8c3f-04e6819bcc73 admin admin] The token cache is being invalidate because project 5fe0debde1d94b56b2a581d802fb15d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:40:46.170914 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ea9565f6-da16-4f0e-8c3f-04e6819bcc73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:46.171627 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ea9565f6-da16-4f0e-8c3f-04e6819bcc73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:46.177106 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1394/2767] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:45 2022] DELETE /identity/v3/projects/5fe0debde1d94b56b2a581d802fb15d8 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:46.179138 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e41136-752f-4e83-8f96-2a7d4c69e7c8 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:46.179579 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e41136-752f-4e83-8f96-2a7d4c69e7c8 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:46.179579 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e41136-752f-4e83-8f96-2a7d4c69e7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:46.210881 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-d1e41136-752f-4e83-8f96-2a7d4c69e7c8 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:46.214430 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d1e41136-752f-4e83-8f96-2a7d4c69e7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:46.291537 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:46.312645 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1374/2768] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:40:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:46.321144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe788c-8df0-4b4a-8ad2-deed7e672697 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:46.321430 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe788c-8df0-4b4a-8ad2-deed7e672697 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:46.321761 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe788c-8df0-4b4a-8ad2-deed7e672697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:46.361177 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-dcfe788c-8df0-4b4a-8ad2-deed7e672697 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:46.362177 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-dcfe788c-8df0-4b4a-8ad2-deed7e672697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:46.372490 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1395/2769] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:40:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:46.376718 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e41136-752f-4e83-8f96-2a7d4c69e7c8 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:46.388635 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e41136-752f-4e83-8f96-2a7d4c69e7c8 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:46.397644 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926258c-3c35-4324-954e-ee4b2bc20ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:46.398420 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926258c-3c35-4324-954e-ee4b2bc20ccb admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:46.398790 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926258c-3c35-4324-954e-ee4b2bc20ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:46.399180 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926258c-3c35-4324-954e-ee4b2bc20ccb admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:46.400095 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5926258c-3c35-4324-954e-ee4b2bc20ccb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:40:46.400493 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5926258c-3c35-4324-954e-ee4b2bc20ccb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:46.402228 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5926258c-3c35-4324-954e-ee4b2bc20ccb admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:46.435986 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1375/2770] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:40:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:40:46.440569 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe788c-8df0-4b4a-8ad2-deed7e672697 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:46.457641 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe788c-8df0-4b4a-8ad2-deed7e672697 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:46.479473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df5195-eecd-4f85-aeaf-9d0a8e20eba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:46.480249 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df5195-eecd-4f85-aeaf-9d0a8e20eba2 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:46.480623 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df5195-eecd-4f85-aeaf-9d0a8e20eba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:46.480988 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df5195-eecd-4f85-aeaf-9d0a8e20eba2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:46.481731 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5df5195-eecd-4f85-aeaf-9d0a8e20eba2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:46.488283 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5df5195-eecd-4f85-aeaf-9d0a8e20eba2 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:46.594661 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1396/2771] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:40:46 2022] POST /identity/v3/projects => generated 407 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:40:46.597354 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926258c-3c35-4324-954e-ee4b2bc20ccb admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:46.615829 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926258c-3c35-4324-954e-ee4b2bc20ccb admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:46.721167 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45dfd4-53fc-448f-b72c-a09bd01802bb None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:46.721571 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45dfd4-53fc-448f-b72c-a09bd01802bb None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:46.721858 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45dfd4-53fc-448f-b72c-a09bd01802bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:46.790975 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-ed45dfd4-53fc-448f-b72c-a09bd01802bb None None] MFA Rules not processed for user `e82ed6e01c904dbfbc7c337a32791fff`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:46.792817 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee43327-4641-4074-9947-60f35fe84416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:46.793530 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee43327-4641-4074-9947-60f35fe84416 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:46.793669 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ed45dfd4-53fc-448f-b72c-a09bd01802bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:46.793812 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee43327-4641-4074-9947-60f35fe84416 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:46.794091 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee43327-4641-4074-9947-60f35fe84416 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:46.794743 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee43327-4641-4074-9947-60f35fe84416 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:46.799904 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee43327-4641-4074-9947-60f35fe84416 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:46.846287 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1376/2772] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:40:46 2022] POST /identity/v3/users => generated 304 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:40:46.851572 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee43327-4641-4074-9947-60f35fe84416 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:46.876874 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee43327-4641-4074-9947-60f35fe84416 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:46.889310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c2af0-e7fd-4c8f-95a2-fd1b25157135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:46.889940 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c2af0-e7fd-4c8f-95a2-fd1b25157135 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:46.890217 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c2af0-e7fd-4c8f-95a2-fd1b25157135 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:46.890491 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c2af0-e7fd-4c8f-95a2-fd1b25157135 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:46.891270 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3c2af0-e7fd-4c8f-95a2-fd1b25157135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:46.893081 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3c2af0-e7fd-4c8f-95a2-fd1b25157135 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:46.912331 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1377/2773] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:40:46 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:40:46.919663 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c2af0-e7fd-4c8f-95a2-fd1b25157135 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:46.943471 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c2af0-e7fd-4c8f-95a2-fd1b25157135 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:46.959098 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b306f4f-4481-4862-bdd4-bf20d94ce096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:46.959662 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b306f4f-4481-4862-bdd4-bf20d94ce096 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:46.959941 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b306f4f-4481-4862-bdd4-bf20d94ce096 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:46.960209 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b306f4f-4481-4862-bdd4-bf20d94ce096 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:46.960854 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b306f4f-4481-4862-bdd4-bf20d94ce096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:46.965911 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b306f4f-4481-4862-bdd4-bf20d94ce096 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:46.993951 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1397/2774] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:40:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:40:47.004293 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1378/2775] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:40:46 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:40:47.009478 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed45dfd4-53fc-448f-b72c-a09bd01802bb None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:47.031088 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed45dfd4-53fc-448f-b72c-a09bd01802bb None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:47.045959 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7d87d-d132-4a4b-accf-74bea8357a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:47.046654 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7d87d-d132-4a4b-accf-74bea8357a56 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:47.046934 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7d87d-d132-4a4b-accf-74bea8357a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:47.047412 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7d87d-d132-4a4b-accf-74bea8357a56 admin admin] PATH_INFO: `/v3/projects/19418605190247a2ac94c09904361c36/users/050dba5d1d4a4ba39819ea9d5914841f/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:47.086289 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf7d87d-d132-4a4b-accf-74bea8357a56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19418605190247a2ac94c09904361c36, user_id=050dba5d1d4a4ba39819ea9d5914841f, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:47.089275 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf7d87d-d132-4a4b-accf-74bea8357a56 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:47.121342 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1398/2776] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:40:47 2022] PUT /identity/v3/projects/19418605190247a2ac94c09904361c36/users/050dba5d1d4a4ba39819ea9d5914841f/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:47.135534 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36f825-a1d3-41d8-8d67-6033947d5e5d None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:47.135677 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36f825-a1d3-41d8-8d67-6033947d5e5d None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:47.135899 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36f825-a1d3-41d8-8d67-6033947d5e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:47.209085 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-fb36f825-a1d3-41d8-8d67-6033947d5e5d None None] MFA Rules not processed for user `050dba5d1d4a4ba39819ea9d5914841f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:47.215852 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-fb36f825-a1d3-41d8-8d67-6033947d5e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:47.337720 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7d87d-d132-4a4b-accf-74bea8357a56 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:47.337954 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1379/2777] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:40:47 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:47.376585 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:47.393503 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb36f825-a1d3-41d8-8d67-6033947d5e5d None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:47.395639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-fb36f825-a1d3-41d8-8d67-6033947d5e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:47.484641 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7d87d-d132-4a4b-accf-74bea8357a56 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:47.500205 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b257d-d05a-4b3f-82e0-a63e93cda706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:47.501801 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b257d-d05a-4b3f-82e0-a63e93cda706 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:47.502196 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b257d-d05a-4b3f-82e0-a63e93cda706 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:47.503086 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b257d-d05a-4b3f-82e0-a63e93cda706 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:47.503867 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b257d-d05a-4b3f-82e0-a63e93cda706 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:47.512433 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b257d-d05a-4b3f-82e0-a63e93cda706 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:47.514401 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:47.582293 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1399/2778] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:40:47 2022] POST /identity/v3/projects => generated 409 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:40:47.583832 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb36f825-a1d3-41d8-8d67-6033947d5e5d None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:47.586550 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b257d-d05a-4b3f-82e0-a63e93cda706 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:47.716951 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b257d-d05a-4b3f-82e0-a63e93cda706 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:47.728314 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2609ac-90b9-454c-a6ee-295b85c6afda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:47.728996 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2609ac-90b9-454c-a6ee-295b85c6afda admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:47.739595 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2609ac-90b9-454c-a6ee-295b85c6afda admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:47.740693 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2609ac-90b9-454c-a6ee-295b85c6afda admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:47.748565 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2609ac-90b9-454c-a6ee-295b85c6afda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:47.756667 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2609ac-90b9-454c-a6ee-295b85c6afda admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:47.791791 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f19f01-e5ff-4b3d-a356-63a76d7fcd85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:47.797310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f19f01-e5ff-4b3d-a356-63a76d7fcd85 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:47.797625 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f19f01-e5ff-4b3d-a356-63a76d7fcd85 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:47.798010 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f19f01-e5ff-4b3d-a356-63a76d7fcd85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:47.823417 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1400/2779] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:40:47 2022] POST /identity/v3/users => generated 311 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:40:47.824773 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2609ac-90b9-454c-a6ee-295b85c6afda admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:47.843956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2609ac-90b9-454c-a6ee-295b85c6afda admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:47.860100 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f18d558-7332-46e2-a2d8-f4aa60e59d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:47.860818 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18d558-7332-46e2-a2d8-f4aa60e59d46 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:47.861175 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18d558-7332-46e2-a2d8-f4aa60e59d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:47.861502 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18d558-7332-46e2-a2d8-f4aa60e59d46 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:47.862357 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f18d558-7332-46e2-a2d8-f4aa60e59d46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:47.866962 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f18d558-7332-46e2-a2d8-f4aa60e59d46 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:47.903984 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1401/2780] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:40:47 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:40:47.906742 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f18d558-7332-46e2-a2d8-f4aa60e59d46 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:47.921677 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f19f01-e5ff-4b3d-a356-63a76d7fcd85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:47.924449 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f19f01-e5ff-4b3d-a356-63a76d7fcd85 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:47.926156 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f18d558-7332-46e2-a2d8-f4aa60e59d46 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:47.936739 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74bb666-9f73-415c-aaba-c5053d1bf983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:47.938061 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74bb666-9f73-415c-aaba-c5053d1bf983 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:47.941767 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74bb666-9f73-415c-aaba-c5053d1bf983 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:47.942971 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74bb666-9f73-415c-aaba-c5053d1bf983 admin admin] PATH_INFO: `/v3/projects/80ba92878ca0463e8d4ee6084f1295bc/users/c638559486414397a4a1208d92f2dc5a/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:47.943697 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1380/2781] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:40:47 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:40:47.967460 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74bb666-9f73-415c-aaba-c5053d1bf983 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80ba92878ca0463e8d4ee6084f1295bc, user_id=c638559486414397a4a1208d92f2dc5a, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:47.970817 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74bb666-9f73-415c-aaba-c5053d1bf983 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:47.993128 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1402/2782] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:40:47 2022] PUT /identity/v3/projects/80ba92878ca0463e8d4ee6084f1295bc/users/c638559486414397a4a1208d92f2dc5a/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:47.997075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f19f01-e5ff-4b3d-a356-63a76d7fcd85 service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:48.014362 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f19f01-e5ff-4b3d-a356-63a76d7fcd85 service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:48.088736 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe0e15-ffc1-4870-99a8-cc244c2e5d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:48.089257 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe0e15-ffc1-4870-99a8-cc244c2e5d20 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:48.089535 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe0e15-ffc1-4870-99a8-cc244c2e5d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:48.089806 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe0e15-ffc1-4870-99a8-cc244c2e5d20 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:48.090461 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbe0e15-ffc1-4870-99a8-cc244c2e5d20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:48.092535 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbe0e15-ffc1-4870-99a8-cc244c2e5d20 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:48.104902 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1381/2783] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:40:47 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:40:48.109111 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74bb666-9f73-415c-aaba-c5053d1bf983 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:48.125099 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74bb666-9f73-415c-aaba-c5053d1bf983 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:48.135862 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5b2d1-3bf3-47fd-895a-f2bf70ecd570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:48.136729 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5b2d1-3bf3-47fd-895a-f2bf70ecd570 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:48.137111 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5b2d1-3bf3-47fd-895a-f2bf70ecd570 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:48.137488 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5b2d1-3bf3-47fd-895a-f2bf70ecd570 admin admin] PATH_INFO: `/v3/projects/80ba92878ca0463e8d4ee6084f1295bc/users/c638559486414397a4a1208d92f2dc5a/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:48.140899 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa5b2d1-3bf3-47fd-895a-f2bf70ecd570 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80ba92878ca0463e8d4ee6084f1295bc, user_id=c638559486414397a4a1208d92f2dc5a, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:48.146013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa5b2d1-3bf3-47fd-895a-f2bf70ecd570 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:48.173422 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1403/2784] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:40:48 2022] PUT /identity/v3/projects/80ba92878ca0463e8d4ee6084f1295bc/users/c638559486414397a4a1208d92f2dc5a/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:48.184360 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df546fca-56a3-4a20-8090-9a6f53217c13 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:48.184650 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df546fca-56a3-4a20-8090-9a6f53217c13 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:48.185007 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df546fca-56a3-4a20-8090-9a6f53217c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:48.219585 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:48.232754 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-df546fca-56a3-4a20-8090-9a6f53217c13 None None] MFA Rules not processed for user `c638559486414397a4a1208d92f2dc5a`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:48.234127 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-df546fca-56a3-4a20-8090-9a6f53217c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:48.365581 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1382/2785] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:40:48 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:48.525551 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5b2d1-3bf3-47fd-895a-f2bf70ecd570 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:48.530434 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3aa5b2d1-3bf3-47fd-895a-f2bf70ecd570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:48.588419 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:48.622325 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5b2d1-3bf3-47fd-895a-f2bf70ecd570 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:48.628450 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d737f5-4554-4158-bff7-bee390fa4aab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:48.629756 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d737f5-4554-4158-bff7-bee390fa4aab service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:48.630192 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d737f5-4554-4158-bff7-bee390fa4aab service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:48.630477 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d737f5-4554-4158-bff7-bee390fa4aab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:48.639857 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d737f5-4554-4158-bff7-bee390fa4aab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:48.641460 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d737f5-4554-4158-bff7-bee390fa4aab service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:48.653604 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1404/2786] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:40:48 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:40:49.124786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df546fca-56a3-4a20-8090-9a6f53217c13 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:49.143133 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df546fca-56a3-4a20-8090-9a6f53217c13 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:49.153264 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bff55e3-f371-4e42-99f9-1de70ceb97c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:49.154351 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff55e3-f371-4e42-99f9-1de70ceb97c6 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:49.154851 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff55e3-f371-4e42-99f9-1de70ceb97c6 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:49.155219 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff55e3-f371-4e42-99f9-1de70ceb97c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:49.232605 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bff55e3-f371-4e42-99f9-1de70ceb97c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:49.234296 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bff55e3-f371-4e42-99f9-1de70ceb97c6 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:49.245358 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1383/2787] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:40:49 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:40:51.884456 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d737f5-4554-4158-bff7-bee390fa4aab service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:51.999975 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d737f5-4554-4158-bff7-bee390fa4aab service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:52.007539 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6633959-b202-4e82-9d7e-f192a833badc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:52.008225 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6633959-b202-4e82-9d7e-f192a833badc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:52.008597 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6633959-b202-4e82-9d7e-f192a833badc admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:52.008802 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6633959-b202-4e82-9d7e-f192a833badc admin admin] PATH_INFO: `/v3/users/050dba5d1d4a4ba39819ea9d5914841f` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:52.010137 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6633959-b202-4e82-9d7e-f192a833badc admin admin] RBAC: Authorizing `identity:delete_user(user_id=050dba5d1d4a4ba39819ea9d5914841f)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:52.013366 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6633959-b202-4e82-9d7e-f192a833badc admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:52.119986 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f6633959-b202-4e82-9d7e-f192a833badc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '050dba5d1d4a4ba39819ea9d5914841f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:52.120808 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f6633959-b202-4e82-9d7e-f192a833badc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '050dba5d1d4a4ba39819ea9d5914841f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:52.147437 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f6633959-b202-4e82-9d7e-f192a833badc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '050dba5d1d4a4ba39819ea9d5914841f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:52.163366 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f6633959-b202-4e82-9d7e-f192a833badc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '050dba5d1d4a4ba39819ea9d5914841f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:52.177728 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f6633959-b202-4e82-9d7e-f192a833badc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '050dba5d1d4a4ba39819ea9d5914841f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:52.194402 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68015f0-cce7-451c-85d6-b0eb0ebab467 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:52.195440 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68015f0-cce7-451c-85d6-b0eb0ebab467 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:52.196059 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68015f0-cce7-451c-85d6-b0eb0ebab467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:52.200258 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1405/2788] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:40:51 2022] DELETE /identity/v3/users/050dba5d1d4a4ba39819ea9d5914841f => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:52.230888 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-e68015f0-cce7-451c-85d6-b0eb0ebab467 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:52.232859 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e68015f0-cce7-451c-85d6-b0eb0ebab467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:52.308340 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1384/2789] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:40:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:52.329449 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6633959-b202-4e82-9d7e-f192a833badc admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:52.331834 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f6633959-b202-4e82-9d7e-f192a833badc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:52.446409 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6633959-b202-4e82-9d7e-f192a833badc admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:52.455820 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313056b9-3316-4f7a-a328-e91fb73f659b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:52.456582 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313056b9-3316-4f7a-a328-e91fb73f659b service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:52.456869 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313056b9-3316-4f7a-a328-e91fb73f659b service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:52.457138 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313056b9-3316-4f7a-a328-e91fb73f659b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:52.474654 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:52.483897 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313056b9-3316-4f7a-a328-e91fb73f659b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:52.486549 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313056b9-3316-4f7a-a328-e91fb73f659b service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:52.527003 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1406/2790] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:40:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:40:53.658171 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68015f0-cce7-451c-85d6-b0eb0ebab467 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:53.660185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e68015f0-cce7-451c-85d6-b0eb0ebab467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:53.672623 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68015f0-cce7-451c-85d6-b0eb0ebab467 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:53.678239 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9098aa3-42f2-4f25-9ffa-c6ea0eb9959d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:53.678986 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9098aa3-42f2-4f25-9ffa-c6ea0eb9959d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:53.679488 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9098aa3-42f2-4f25-9ffa-c6ea0eb9959d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:53.679957 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9098aa3-42f2-4f25-9ffa-c6ea0eb9959d admin admin] PATH_INFO: `/v3/projects/19418605190247a2ac94c09904361c36` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:53.681177 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9098aa3-42f2-4f25-9ffa-c6ea0eb9959d admin admin] RBAC: Authorizing `identity:delete_project(project_id=19418605190247a2ac94c09904361c36)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:53.683213 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9098aa3-42f2-4f25-9ffa-c6ea0eb9959d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:53.779250 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:53.797023 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e9098aa3-42f2-4f25-9ffa-c6ea0eb9959d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19418605190247a2ac94c09904361c36', 'request_id': 'req-e9098aa3-42f2-4f25-9ffa-c6ea0eb9959d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:53.804167 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e9098aa3-42f2-4f25-9ffa-c6ea0eb9959d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19418605190247a2ac94c09904361c36', 'request_id': 'req-e9098aa3-42f2-4f25-9ffa-c6ea0eb9959d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:53.811830 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e9098aa3-42f2-4f25-9ffa-c6ea0eb9959d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19418605190247a2ac94c09904361c36', 'request_id': 'req-e9098aa3-42f2-4f25-9ffa-c6ea0eb9959d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:53.832925 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e9098aa3-42f2-4f25-9ffa-c6ea0eb9959d admin admin] The token cache is being invalidate because project 19418605190247a2ac94c09904361c36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:40:53.833236 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e9098aa3-42f2-4f25-9ffa-c6ea0eb9959d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:53.834589 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e9098aa3-42f2-4f25-9ffa-c6ea0eb9959d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:53.837067 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1385/2791] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:53 2022] DELETE /identity/v3/projects/19418605190247a2ac94c09904361c36 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:53.841109 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313056b9-3316-4f7a-a328-e91fb73f659b service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:53.853472 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313056b9-3316-4f7a-a328-e91fb73f659b service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:53.885385 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9098aa3-42f2-4f25-9ffa-c6ea0eb9959d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:53.888177 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e9098aa3-42f2-4f25-9ffa-c6ea0eb9959d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:53.940485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebba957-4d06-47e5-91b8-9ea5b1b2c04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:53.941026 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebba957-4d06-47e5-91b8-9ea5b1b2c04f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:53.941308 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebba957-4d06-47e5-91b8-9ea5b1b2c04f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:53.941574 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebba957-4d06-47e5-91b8-9ea5b1b2c04f admin admin] PATH_INFO: `/v3/users/c638559486414397a4a1208d92f2dc5a` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:53.943789 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebba957-4d06-47e5-91b8-9ea5b1b2c04f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c638559486414397a4a1208d92f2dc5a)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:53.946685 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebba957-4d06-47e5-91b8-9ea5b1b2c04f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:54.031756 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9098aa3-42f2-4f25-9ffa-c6ea0eb9959d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:54.043766 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2ebba957-4d06-47e5-91b8-9ea5b1b2c04f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c638559486414397a4a1208d92f2dc5a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:54.044933 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ac177-6742-44a7-9a9a-c6f90ec637d8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:54.045256 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ac177-6742-44a7-9a9a-c6f90ec637d8 service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:54.045538 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ac177-6742-44a7-9a9a-c6f90ec637d8 service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:54.045651 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2ebba957-4d06-47e5-91b8-9ea5b1b2c04f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c638559486414397a4a1208d92f2dc5a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:54.045805 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ac177-6742-44a7-9a9a-c6f90ec637d8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:54.047764 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ef5ac177-6742-44a7-9a9a-c6f90ec637d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:54.063238 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ac177-6742-44a7-9a9a-c6f90ec637d8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:54.065270 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ac177-6742-44a7-9a9a-c6f90ec637d8 service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:54.078982 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1386/2792] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:40:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:40:54.092590 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2ebba957-4d06-47e5-91b8-9ea5b1b2c04f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c638559486414397a4a1208d92f2dc5a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:54.108908 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2ebba957-4d06-47e5-91b8-9ea5b1b2c04f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c638559486414397a4a1208d92f2dc5a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:54.122136 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2ebba957-4d06-47e5-91b8-9ea5b1b2c04f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c638559486414397a4a1208d92f2dc5a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:54.143116 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1407/2793] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:40:53 2022] DELETE /identity/v3/users/c638559486414397a4a1208d92f2dc5a => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:55.244990 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ac177-6742-44a7-9a9a-c6f90ec637d8 service placement] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:55.247885 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ef5ac177-6742-44a7-9a9a-c6f90ec637d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:55.267335 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ac177-6742-44a7-9a9a-c6f90ec637d8 service placement] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:55.356735 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f4206-13da-4bb5-afc6-34fa433afa00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:55.357788 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f4206-13da-4bb5-afc6-34fa433afa00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:55.358292 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f4206-13da-4bb5-afc6-34fa433afa00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:55.358741 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f4206-13da-4bb5-afc6-34fa433afa00 admin admin] PATH_INFO: `/v3/projects/80ba92878ca0463e8d4ee6084f1295bc` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:55.361805 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f4206-13da-4bb5-afc6-34fa433afa00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80ba92878ca0463e8d4ee6084f1295bc)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:55.365902 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f4206-13da-4bb5-afc6-34fa433afa00 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:55.437349 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d72f4206-13da-4bb5-afc6-34fa433afa00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80ba92878ca0463e8d4ee6084f1295bc', 'request_id': 'req-d72f4206-13da-4bb5-afc6-34fa433afa00'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:55.438908 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:55.447062 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d72f4206-13da-4bb5-afc6-34fa433afa00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80ba92878ca0463e8d4ee6084f1295bc', 'request_id': 'req-d72f4206-13da-4bb5-afc6-34fa433afa00'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:55.456941 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d72f4206-13da-4bb5-afc6-34fa433afa00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80ba92878ca0463e8d4ee6084f1295bc', 'request_id': 'req-d72f4206-13da-4bb5-afc6-34fa433afa00'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:55.477380 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d72f4206-13da-4bb5-afc6-34fa433afa00 admin admin] The token cache is being invalidate because project 80ba92878ca0463e8d4ee6084f1295bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:40:55.477942 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d72f4206-13da-4bb5-afc6-34fa433afa00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:55.479041 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d72f4206-13da-4bb5-afc6-34fa433afa00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:55.481220 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1387/2794] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:55 2022] DELETE /identity/v3/projects/80ba92878ca0463e8d4ee6084f1295bc => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:55.486061 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14932572-886b-43c2-bd2e-d5556bb561a2 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:55.486914 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14932572-886b-43c2-bd2e-d5556bb561a2 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:55.487534 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14932572-886b-43c2-bd2e-d5556bb561a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:55.517782 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-14932572-886b-43c2-bd2e-d5556bb561a2 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:55.519444 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-14932572-886b-43c2-bd2e-d5556bb561a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:55.625899 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1408/2795] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:55.635848 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e6d0d-b5d4-4cd7-9f6a-a73775e4e3bf None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:55.636511 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e6d0d-b5d4-4cd7-9f6a-a73775e4e3bf None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:55.636944 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e6d0d-b5d4-4cd7-9f6a-a73775e4e3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:55.663719 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-c55e6d0d-b5d4-4cd7-9f6a-a73775e4e3bf None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:55.664946 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c55e6d0d-b5d4-4cd7-9f6a-a73775e4e3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:55.673910 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1388/2796] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:40:55.678947 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14932572-886b-43c2-bd2e-d5556bb561a2 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:55.689831 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14932572-886b-43c2-bd2e-d5556bb561a2 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:55.695062 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f27e904-d38d-47a8-b6a4-2c98e8907126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:55.695714 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27e904-d38d-47a8-b6a4-2c98e8907126 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:55.695996 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27e904-d38d-47a8-b6a4-2c98e8907126 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:55.696269 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27e904-d38d-47a8-b6a4-2c98e8907126 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:55.696936 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f27e904-d38d-47a8-b6a4-2c98e8907126 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:40:55.697287 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f27e904-d38d-47a8-b6a4-2c98e8907126 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:55.698873 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f27e904-d38d-47a8-b6a4-2c98e8907126 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:55.726159 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1409/2797] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:40:55.731431 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e6d0d-b5d4-4cd7-9f6a-a73775e4e3bf None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:55.759888 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e6d0d-b5d4-4cd7-9f6a-a73775e4e3bf None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:55.767546 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f190ed-e5df-4b18-b400-2e2e16a49e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:55.768682 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f190ed-e5df-4b18-b400-2e2e16a49e81 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:55.769332 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f190ed-e5df-4b18-b400-2e2e16a49e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:55.769582 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f190ed-e5df-4b18-b400-2e2e16a49e81 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:55.771167 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f190ed-e5df-4b18-b400-2e2e16a49e81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:55.774202 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f190ed-e5df-4b18-b400-2e2e16a49e81 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:55.822083 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1389/2798] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:40:55 2022] POST /identity/v3/projects => generated 361 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:40:55.826744 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f27e904-d38d-47a8-b6a4-2c98e8907126 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:55.832297 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:55.844722 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f27e904-d38d-47a8-b6a4-2c98e8907126 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:55.959525 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97693270-6e17-42bc-b91d-63cdab571659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:55.960393 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97693270-6e17-42bc-b91d-63cdab571659 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:55.960531 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97693270-6e17-42bc-b91d-63cdab571659 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:55.960736 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97693270-6e17-42bc-b91d-63cdab571659 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:55.961624 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97693270-6e17-42bc-b91d-63cdab571659 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:55.964254 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97693270-6e17-42bc-b91d-63cdab571659 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:55.991291 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1410/2799] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:40:55 2022] POST /identity/v3/users => generated 281 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:40:55.995181 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f190ed-e5df-4b18-b400-2e2e16a49e81 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:56.006211 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f190ed-e5df-4b18-b400-2e2e16a49e81 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:56.011581 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190abb89-a7aa-4a29-bd18-945f0f0a9de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:56.012564 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190abb89-a7aa-4a29-bd18-945f0f0a9de9 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:56.013014 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190abb89-a7aa-4a29-bd18-945f0f0a9de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:56.013851 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190abb89-a7aa-4a29-bd18-945f0f0a9de9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:56.014595 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190abb89-a7aa-4a29-bd18-945f0f0a9de9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:56.017132 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190abb89-a7aa-4a29-bd18-945f0f0a9de9 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:56.034016 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1390/2800] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:40:56.035144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97693270-6e17-42bc-b91d-63cdab571659 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:56.062267 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97693270-6e17-42bc-b91d-63cdab571659 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:56.073606 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23600ad0-64e1-4a72-8178-86ff0814cea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:56.074274 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23600ad0-64e1-4a72-8178-86ff0814cea1 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:56.074516 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23600ad0-64e1-4a72-8178-86ff0814cea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:56.074784 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23600ad0-64e1-4a72-8178-86ff0814cea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:56.075465 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23600ad0-64e1-4a72-8178-86ff0814cea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:56.077067 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23600ad0-64e1-4a72-8178-86ff0814cea1 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:56.103624 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1411/2801] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:40:56.108794 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190abb89-a7aa-4a29-bd18-945f0f0a9de9 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:56.125041 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190abb89-a7aa-4a29-bd18-945f0f0a9de9 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:56.132235 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f3e9c8-ab5c-4718-8d12-58c50bfa6014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:56.133465 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3e9c8-ab5c-4718-8d12-58c50bfa6014 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:56.133805 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3e9c8-ab5c-4718-8d12-58c50bfa6014 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:56.134185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3e9c8-ab5c-4718-8d12-58c50bfa6014 admin admin] PATH_INFO: `/v3/projects/f010d5eebadc4952922a4ebd8fd2137e/users/68246995b8454902a524aa6e03a43b14/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:56.159526 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f3e9c8-ab5c-4718-8d12-58c50bfa6014 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f010d5eebadc4952922a4ebd8fd2137e, user_id=68246995b8454902a524aa6e03a43b14, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:56.165258 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f3e9c8-ab5c-4718-8d12-58c50bfa6014 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:56.185780 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1391/2802] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:40:56 2022] PUT /identity/v3/projects/f010d5eebadc4952922a4ebd8fd2137e/users/68246995b8454902a524aa6e03a43b14/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:56.196878 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ade24-9ad6-4116-94c1-0497a7bb9581 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:56.197218 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ade24-9ad6-4116-94c1-0497a7bb9581 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:56.197504 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ade24-9ad6-4116-94c1-0497a7bb9581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:56.244423 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-c41ade24-9ad6-4116-94c1-0497a7bb9581 None None] MFA Rules not processed for user `68246995b8454902a524aa6e03a43b14`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:56.245930 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c41ade24-9ad6-4116-94c1-0497a7bb9581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:56.389752 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1412/2803] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:40:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:40:56.394605 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f3e9c8-ab5c-4718-8d12-58c50bfa6014 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:56.476682 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f3e9c8-ab5c-4718-8d12-58c50bfa6014 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:56.481525 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df537b4f-854d-4d31-8fc3-98dea01696ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:56.482542 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df537b4f-854d-4d31-8fc3-98dea01696ff admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:56.482653 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df537b4f-854d-4d31-8fc3-98dea01696ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:56.482903 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df537b4f-854d-4d31-8fc3-98dea01696ff admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:56.483581 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df537b4f-854d-4d31-8fc3-98dea01696ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:56.485727 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df537b4f-854d-4d31-8fc3-98dea01696ff admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:56.519078 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1392/2804] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:40:56 2022] POST /identity/v3/projects => generated 361 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:40:56.523702 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ade24-9ad6-4116-94c1-0497a7bb9581 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:56.536442 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ade24-9ad6-4116-94c1-0497a7bb9581 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:56.612839 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3432d65a-2949-4725-b0f7-9ea874f8cbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:56.613467 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432d65a-2949-4725-b0f7-9ea874f8cbe6 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:56.615374 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432d65a-2949-4725-b0f7-9ea874f8cbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:56.615705 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432d65a-2949-4725-b0f7-9ea874f8cbe6 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:56.616379 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3432d65a-2949-4725-b0f7-9ea874f8cbe6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:56.618878 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3432d65a-2949-4725-b0f7-9ea874f8cbe6 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:56.639153 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:56.649597 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1413/2805] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:40:56 2022] POST /identity/v3/users => generated 287 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:40:56.650909 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df537b4f-854d-4d31-8fc3-98dea01696ff admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:56.662727 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df537b4f-854d-4d31-8fc3-98dea01696ff admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:56.669480 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ad5c1-3e37-4fb1-9fe4-3c9866b54b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:56.671529 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ad5c1-3e37-4fb1-9fe4-3c9866b54b7c admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:56.671824 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ad5c1-3e37-4fb1-9fe4-3c9866b54b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:56.672151 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ad5c1-3e37-4fb1-9fe4-3c9866b54b7c admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:56.684833 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654ad5c1-3e37-4fb1-9fe4-3c9866b54b7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:56.687953 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654ad5c1-3e37-4fb1-9fe4-3c9866b54b7c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:56.711514 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1393/2806] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:40:56.713006 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3432d65a-2949-4725-b0f7-9ea874f8cbe6 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:56.714940 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3432d65a-2949-4725-b0f7-9ea874f8cbe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:56.716118 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ad5c1-3e37-4fb1-9fe4-3c9866b54b7c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:56.728099 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ad5c1-3e37-4fb1-9fe4-3c9866b54b7c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:56.735398 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c53633-a005-49b0-9785-d7c6016f696b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:56.736131 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c53633-a005-49b0-9785-d7c6016f696b admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:56.736921 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c53633-a005-49b0-9785-d7c6016f696b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:56.737209 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c53633-a005-49b0-9785-d7c6016f696b admin admin] PATH_INFO: `/v3/projects/0c8ce7c93cc141cba016df37e384bad2/users/ff5507dccb7b498fb26634f0243d249c/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:56.766803 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c53633-a005-49b0-9785-d7c6016f696b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c8ce7c93cc141cba016df37e384bad2, user_id=ff5507dccb7b498fb26634f0243d249c, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:56.770663 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c53633-a005-49b0-9785-d7c6016f696b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:56.788566 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1394/2807] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:40:56 2022] PUT /identity/v3/projects/0c8ce7c93cc141cba016df37e384bad2/users/ff5507dccb7b498fb26634f0243d249c/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:56.795983 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c53633-a005-49b0-9785-d7c6016f696b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:56.797921 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3432d65a-2949-4725-b0f7-9ea874f8cbe6 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:56.840569 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=3,keystone:SELECT=92,keystone:INSERT=5 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:56.905436 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c53633-a005-49b0-9785-d7c6016f696b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:56.916565 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf75a9-7643-4c8d-b93a-37259d1786ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:56.917011 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf75a9-7643-4c8d-b93a-37259d1786ce admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:56.917283 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf75a9-7643-4c8d-b93a-37259d1786ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:56.918311 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf75a9-7643-4c8d-b93a-37259d1786ce admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:56.918983 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf75a9-7643-4c8d-b93a-37259d1786ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:56.920624 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf75a9-7643-4c8d-b93a-37259d1786ce admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:56.928637 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe8d5e-85c1-4796-b949-c29829f7bac1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:56.929259 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe8d5e-85c1-4796-b949-c29829f7bac1 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:56.929537 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe8d5e-85c1-4796-b949-c29829f7bac1 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:56.929811 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe8d5e-85c1-4796-b949-c29829f7bac1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:56.931643 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e9fe8d5e-85c1-4796-b949-c29829f7bac1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:56.945007 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1395/2808] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:40:56.946561 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf75a9-7643-4c8d-b93a-37259d1786ce admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:56.959889 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf75a9-7643-4c8d-b93a-37259d1786ce admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:56.965257 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91dd4c-1b17-4452-9650-877ffe550b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:56.966064 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91dd4c-1b17-4452-9650-877ffe550b09 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:56.966349 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91dd4c-1b17-4452-9650-877ffe550b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:56.966622 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91dd4c-1b17-4452-9650-877ffe550b09 admin admin] PATH_INFO: `/v3/projects/0c8ce7c93cc141cba016df37e384bad2/users/ff5507dccb7b498fb26634f0243d249c/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:56.968629 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d91dd4c-1b17-4452-9650-877ffe550b09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c8ce7c93cc141cba016df37e384bad2, user_id=ff5507dccb7b498fb26634f0243d249c, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:56.971690 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d91dd4c-1b17-4452-9650-877ffe550b09 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:56.988370 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1396/2809] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:40:56 2022] PUT /identity/v3/projects/0c8ce7c93cc141cba016df37e384bad2/users/ff5507dccb7b498fb26634f0243d249c/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:40:57.001472 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5f3c0-47e8-4bdc-807c-17d8e59b377b None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:57.001854 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5f3c0-47e8-4bdc-807c-17d8e59b377b None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:57.002205 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5f3c0-47e8-4bdc-807c-17d8e59b377b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:57.020963 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fe8d5e-85c1-4796-b949-c29829f7bac1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:57.022613 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fe8d5e-85c1-4796-b949-c29829f7bac1 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:57.047068 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1414/2810] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:40:56 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:40:57.069637 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77932a7-6393-4c91-8615-e4213bf78f7c None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:57.070037 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77932a7-6393-4c91-8615-e4213bf78f7c None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:57.070373 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77932a7-6393-4c91-8615-e4213bf78f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:57.075208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-bca5f3c0-47e8-4bdc-807c-17d8e59b377b None None] MFA Rules not processed for user `ff5507dccb7b498fb26634f0243d249c`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:57.079522 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-bca5f3c0-47e8-4bdc-807c-17d8e59b377b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:57.116863 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-e77932a7-6393-4c91-8615-e4213bf78f7c None None] MFA Rules not processed for user `cd46d7afd06f41c2a09132a349aa3fd4`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:57.119508 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e77932a7-6393-4c91-8615-e4213bf78f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:57.186000 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:57.267017 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1397/2811] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:40:56 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:57.277645 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1415/2812] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:40:57 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:57.605124 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5f3c0-47e8-4bdc-807c-17d8e59b377b None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:57.696491 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5f3c0-47e8-4bdc-807c-17d8e59b377b None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:57.708830 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c6fa2-f78f-41dc-9712-43bd866f5b06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:57.709602 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c6fa2-f78f-41dc-9712-43bd866f5b06 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:57.710595 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c6fa2-f78f-41dc-9712-43bd866f5b06 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:57.710916 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c6fa2-f78f-41dc-9712-43bd866f5b06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:57.727627 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0c6fa2-f78f-41dc-9712-43bd866f5b06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:57.729650 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0c6fa2-f78f-41dc-9712-43bd866f5b06 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:57.758625 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1398/2813] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:40:57 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:40:58.750948 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77932a7-6393-4c91-8615-e4213bf78f7c None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:58.823822 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77932a7-6393-4c91-8615-e4213bf78f7c None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:58.830733 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e9d4e6-6922-476c-802b-4eb64f8e5871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:58.831497 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9d4e6-6922-476c-802b-4eb64f8e5871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:58.831849 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9d4e6-6922-476c-802b-4eb64f8e5871 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:58.832187 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9d4e6-6922-476c-802b-4eb64f8e5871 admin admin] PATH_INFO: `/v3/users/68246995b8454902a524aa6e03a43b14` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:58.835721 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e9d4e6-6922-476c-802b-4eb64f8e5871 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68246995b8454902a524aa6e03a43b14)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:58.837826 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e9d4e6-6922-476c-802b-4eb64f8e5871 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:58.902269 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-79e9d4e6-6922-476c-802b-4eb64f8e5871 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68246995b8454902a524aa6e03a43b14'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:58.903386 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-79e9d4e6-6922-476c-802b-4eb64f8e5871 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68246995b8454902a524aa6e03a43b14'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:58.919548 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-79e9d4e6-6922-476c-802b-4eb64f8e5871 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68246995b8454902a524aa6e03a43b14'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:58.933347 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-79e9d4e6-6922-476c-802b-4eb64f8e5871 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68246995b8454902a524aa6e03a43b14'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:58.941450 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-79e9d4e6-6922-476c-802b-4eb64f8e5871 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68246995b8454902a524aa6e03a43b14'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:58.954126 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1416/2814] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:40:58 2022] DELETE /identity/v3/users/68246995b8454902a524aa6e03a43b14 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:58.960737 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32859ca-cff6-4ebd-825b-02e070d6a432 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:58.961308 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32859ca-cff6-4ebd-825b-02e070d6a432 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:58.962895 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32859ca-cff6-4ebd-825b-02e070d6a432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:58.983078 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-f32859ca-cff6-4ebd-825b-02e070d6a432 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:58.984819 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f32859ca-cff6-4ebd-825b-02e070d6a432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:59.001742 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:59.057239 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1399/2815] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:40:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:59.066785 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e9d4e6-6922-476c-802b-4eb64f8e5871 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:59.068402 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-79e9d4e6-6922-476c-802b-4eb64f8e5871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:59.151406 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e9d4e6-6922-476c-802b-4eb64f8e5871 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:59.155871 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d58b1-ea5d-4c16-aede-f3693ee6ef4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:59.156562 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d58b1-ea5d-4c16-aede-f3693ee6ef4d service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:59.156917 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d58b1-ea5d-4c16-aede-f3693ee6ef4d service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:59.157347 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d58b1-ea5d-4c16-aede-f3693ee6ef4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:59.168648 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4d58b1-ea5d-4c16-aede-f3693ee6ef4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:59.170203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4d58b1-ea5d-4c16-aede-f3693ee6ef4d service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:59.174767 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:59.182214 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1417/2816] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:40:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:40:59.868038 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32859ca-cff6-4ebd-825b-02e070d6a432 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:59.869817 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f32859ca-cff6-4ebd-825b-02e070d6a432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:59.888508 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32859ca-cff6-4ebd-825b-02e070d6a432 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:59.893509 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28f6a7-ec3a-4b69-9ed5-01c9cf9bd6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:59.894504 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28f6a7-ec3a-4b69-9ed5-01c9cf9bd6c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:59.894900 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28f6a7-ec3a-4b69-9ed5-01c9cf9bd6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:59.895840 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28f6a7-ec3a-4b69-9ed5-01c9cf9bd6c1 admin admin] PATH_INFO: `/v3/projects/f010d5eebadc4952922a4ebd8fd2137e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:59.897064 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c28f6a7-ec3a-4b69-9ed5-01c9cf9bd6c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f010d5eebadc4952922a4ebd8fd2137e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:59.899198 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c28f6a7-ec3a-4b69-9ed5-01c9cf9bd6c1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:59.988003 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3c28f6a7-ec3a-4b69-9ed5-01c9cf9bd6c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f010d5eebadc4952922a4ebd8fd2137e', 'request_id': 'req-3c28f6a7-ec3a-4b69-9ed5-01c9cf9bd6c1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:59.996916 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3c28f6a7-ec3a-4b69-9ed5-01c9cf9bd6c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f010d5eebadc4952922a4ebd8fd2137e', 'request_id': 'req-3c28f6a7-ec3a-4b69-9ed5-01c9cf9bd6c1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:00.005232 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3c28f6a7-ec3a-4b69-9ed5-01c9cf9bd6c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f010d5eebadc4952922a4ebd8fd2137e', 'request_id': 'req-3c28f6a7-ec3a-4b69-9ed5-01c9cf9bd6c1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:00.025614 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3c28f6a7-ec3a-4b69-9ed5-01c9cf9bd6c1 admin admin] The token cache is being invalidate because project f010d5eebadc4952922a4ebd8fd2137e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:41:00.025898 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3c28f6a7-ec3a-4b69-9ed5-01c9cf9bd6c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:00.027139 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3c28f6a7-ec3a-4b69-9ed5-01c9cf9bd6c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:00.028833 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1400/2817] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:59 2022] DELETE /identity/v3/projects/f010d5eebadc4952922a4ebd8fd2137e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:00.033141 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d58b1-ea5d-4c16-aede-f3693ee6ef4d service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:00.044425 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d58b1-ea5d-4c16-aede-f3693ee6ef4d service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:00.116791 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64743c44-9530-45ff-af8f-9bd85eaf3610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:00.117805 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64743c44-9530-45ff-af8f-9bd85eaf3610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:00.118085 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64743c44-9530-45ff-af8f-9bd85eaf3610 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:00.118362 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64743c44-9530-45ff-af8f-9bd85eaf3610 admin admin] PATH_INFO: `/v3/users/ff5507dccb7b498fb26634f0243d249c` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:00.124337 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64743c44-9530-45ff-af8f-9bd85eaf3610 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff5507dccb7b498fb26634f0243d249c)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:00.125645 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64743c44-9530-45ff-af8f-9bd85eaf3610 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:00.195479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-64743c44-9530-45ff-af8f-9bd85eaf3610 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff5507dccb7b498fb26634f0243d249c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:00.196543 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-64743c44-9530-45ff-af8f-9bd85eaf3610 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff5507dccb7b498fb26634f0243d249c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:00.224617 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-64743c44-9530-45ff-af8f-9bd85eaf3610 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff5507dccb7b498fb26634f0243d249c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:00.243037 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-64743c44-9530-45ff-af8f-9bd85eaf3610 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff5507dccb7b498fb26634f0243d249c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:00.258719 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-64743c44-9530-45ff-af8f-9bd85eaf3610 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff5507dccb7b498fb26634f0243d249c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:00.295017 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1418/2818] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:41:00 2022] DELETE /identity/v3/users/ff5507dccb7b498fb26634f0243d249c => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:41:00.793430 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28f6a7-ec3a-4b69-9ed5-01c9cf9bd6c1 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:00.794974 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3c28f6a7-ec3a-4b69-9ed5-01c9cf9bd6c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:00.816530 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28f6a7-ec3a-4b69-9ed5-01c9cf9bd6c1 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:00.939695 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d377b-dd5d-4d17-8686-949c50f71422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:00.940642 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d377b-dd5d-4d17-8686-949c50f71422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:00.941233 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d377b-dd5d-4d17-8686-949c50f71422 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:00.941644 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d377b-dd5d-4d17-8686-949c50f71422 admin admin] PATH_INFO: `/v3/projects/0c8ce7c93cc141cba016df37e384bad2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:00.945480 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23d377b-dd5d-4d17-8686-949c50f71422 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c8ce7c93cc141cba016df37e384bad2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:00.948158 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23d377b-dd5d-4d17-8686-949c50f71422 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:01.006904 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:01.011856 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a23d377b-dd5d-4d17-8686-949c50f71422 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c8ce7c93cc141cba016df37e384bad2', 'request_id': 'req-a23d377b-dd5d-4d17-8686-949c50f71422'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:01.019828 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a23d377b-dd5d-4d17-8686-949c50f71422 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c8ce7c93cc141cba016df37e384bad2', 'request_id': 'req-a23d377b-dd5d-4d17-8686-949c50f71422'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:01.026911 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a23d377b-dd5d-4d17-8686-949c50f71422 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c8ce7c93cc141cba016df37e384bad2', 'request_id': 'req-a23d377b-dd5d-4d17-8686-949c50f71422'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:01.042487 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a23d377b-dd5d-4d17-8686-949c50f71422 admin admin] The token cache is being invalidate because project 0c8ce7c93cc141cba016df37e384bad2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:41:01.042819 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a23d377b-dd5d-4d17-8686-949c50f71422 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:01.043776 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a23d377b-dd5d-4d17-8686-949c50f71422 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:01.045822 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1401/2819] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:41:00 2022] DELETE /identity/v3/projects/0c8ce7c93cc141cba016df37e384bad2 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:01.050569 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5ebf3-9540-462f-8ec6-c2bd71e0db7c None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:01.050992 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5ebf3-9540-462f-8ec6-c2bd71e0db7c None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:01.051207 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5ebf3-9540-462f-8ec6-c2bd71e0db7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:01.076198 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-5db5ebf3-9540-462f-8ec6-c2bd71e0db7c None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:01.077753 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5db5ebf3-9540-462f-8ec6-c2bd71e0db7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:01.159862 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1419/2820] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:01.165359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44436f56-3ff9-4780-959c-3e8600b43c51 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:01.165644 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44436f56-3ff9-4780-959c-3e8600b43c51 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:01.165917 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44436f56-3ff9-4780-959c-3e8600b43c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:01.188688 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-44436f56-3ff9-4780-959c-3e8600b43c51 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:01.190449 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-44436f56-3ff9-4780-959c-3e8600b43c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:01.202130 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1402/2821] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:01.205817 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5ebf3-9540-462f-8ec6-c2bd71e0db7c None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:01.218658 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5ebf3-9540-462f-8ec6-c2bd71e0db7c None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:01.227049 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bce6d1-266b-4dc2-b1e8-79a92d7c2ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:01.228186 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bce6d1-266b-4dc2-b1e8-79a92d7c2ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:01.228186 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bce6d1-266b-4dc2-b1e8-79a92d7c2ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:01.228186 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bce6d1-266b-4dc2-b1e8-79a92d7c2ab7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:01.229661 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bce6d1-266b-4dc2-b1e8-79a92d7c2ab7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:41:01.229963 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bce6d1-266b-4dc2-b1e8-79a92d7c2ab7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:01.233738 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bce6d1-266b-4dc2-b1e8-79a92d7c2ab7 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:01.247593 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1420/2822] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:41:01.252666 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44436f56-3ff9-4780-959c-3e8600b43c51 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:01.264939 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44436f56-3ff9-4780-959c-3e8600b43c51 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:01.271190 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061edec8-3d20-43f6-8e45-d942408eb434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:01.272200 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061edec8-3d20-43f6-8e45-d942408eb434 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:01.272581 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061edec8-3d20-43f6-8e45-d942408eb434 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:01.272843 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061edec8-3d20-43f6-8e45-d942408eb434 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:01.273727 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061edec8-3d20-43f6-8e45-d942408eb434 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:01.276383 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061edec8-3d20-43f6-8e45-d942408eb434 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:01.313936 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1403/2823] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:41:01 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:41:01.315129 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bce6d1-266b-4dc2-b1e8-79a92d7c2ab7 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:01.322950 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:01.327951 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bce6d1-266b-4dc2-b1e8-79a92d7c2ab7 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:01.416492 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca041f-8441-404b-af2f-58dcb93bf0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:01.417369 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca041f-8441-404b-af2f-58dcb93bf0a6 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:01.417796 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca041f-8441-404b-af2f-58dcb93bf0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:01.418241 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca041f-8441-404b-af2f-58dcb93bf0a6 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:01.419067 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca041f-8441-404b-af2f-58dcb93bf0a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:01.421175 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca041f-8441-404b-af2f-58dcb93bf0a6 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:01.450716 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1421/2824] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:41:01 2022] POST /identity/v3/users => generated 293 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:41:01.453021 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061edec8-3d20-43f6-8e45-d942408eb434 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:01.465393 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061edec8-3d20-43f6-8e45-d942408eb434 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:01.470967 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8105fe-90d9-4430-9422-a3803ac340d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:01.472036 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8105fe-90d9-4430-9422-a3803ac340d9 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:01.472732 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8105fe-90d9-4430-9422-a3803ac340d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:01.472732 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8105fe-90d9-4430-9422-a3803ac340d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:01.473430 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8105fe-90d9-4430-9422-a3803ac340d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:01.475231 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8105fe-90d9-4430-9422-a3803ac340d9 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:01.489521 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1404/2825] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:41:01.490847 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca041f-8441-404b-af2f-58dcb93bf0a6 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:01.502106 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca041f-8441-404b-af2f-58dcb93bf0a6 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:01.508200 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e1c5f-090f-4456-a32d-e7286af5314e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:01.508949 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e1c5f-090f-4456-a32d-e7286af5314e admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:01.509329 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e1c5f-090f-4456-a32d-e7286af5314e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:01.509708 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e1c5f-090f-4456-a32d-e7286af5314e admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:01.510470 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e1c5f-090f-4456-a32d-e7286af5314e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:01.512319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e1c5f-090f-4456-a32d-e7286af5314e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:01.530409 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1422/2826] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:41:01.532684 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8105fe-90d9-4430-9422-a3803ac340d9 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:01.545204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8105fe-90d9-4430-9422-a3803ac340d9 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:01.556488 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f2482-7f51-4bd8-9c4f-e306bb6355c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:01.557932 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f2482-7f51-4bd8-9c4f-e306bb6355c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:01.558220 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f2482-7f51-4bd8-9c4f-e306bb6355c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:01.558488 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f2482-7f51-4bd8-9c4f-e306bb6355c3 admin admin] PATH_INFO: `/v3/projects/ccadaa98571f44cfb524f1b3eb336b62/users/4efb903161254beabf4d979a6382e610/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:01.594771 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85f2482-7f51-4bd8-9c4f-e306bb6355c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccadaa98571f44cfb524f1b3eb336b62, user_id=4efb903161254beabf4d979a6382e610, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:01.595629 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85f2482-7f51-4bd8-9c4f-e306bb6355c3 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:01.630048 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1405/2827] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:41:01 2022] PUT /identity/v3/projects/ccadaa98571f44cfb524f1b3eb336b62/users/4efb903161254beabf4d979a6382e610/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:01.641390 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4cba8-0ad1-46d0-bfe4-ff4896100c96 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:01.642077 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4cba8-0ad1-46d0-bfe4-ff4896100c96 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:01.642569 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4cba8-0ad1-46d0-bfe4-ff4896100c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:01.688011 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-38a4cba8-0ad1-46d0-bfe4-ff4896100c96 None None] MFA Rules not processed for user `4efb903161254beabf4d979a6382e610`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:01.690184 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-38a4cba8-0ad1-46d0-bfe4-ff4896100c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:01.805041 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1423/2828] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:41:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:01.809282 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f2482-7f51-4bd8-9c4f-e306bb6355c3 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:01.915998 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f2482-7f51-4bd8-9c4f-e306bb6355c3 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:01.923447 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5753c0-2773-40c6-90e3-a1c9df5537c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:01.925092 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5753c0-2773-40c6-90e3-a1c9df5537c5 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:01.925691 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5753c0-2773-40c6-90e3-a1c9df5537c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:01.927284 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5753c0-2773-40c6-90e3-a1c9df5537c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:01.928887 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5753c0-2773-40c6-90e3-a1c9df5537c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:01.932439 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5753c0-2773-40c6-90e3-a1c9df5537c5 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:01.976878 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1406/2829] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:41:01 2022] POST /identity/v3/projects => generated 385 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:41:01.981168 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4cba8-0ad1-46d0-bfe4-ff4896100c96 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:01.993701 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4cba8-0ad1-46d0-bfe4-ff4896100c96 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:02.066211 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367233c-5b94-4003-a2fd-65b79e101a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:02.066875 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367233c-5b94-4003-a2fd-65b79e101a1f admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:02.067711 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367233c-5b94-4003-a2fd-65b79e101a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:02.068090 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367233c-5b94-4003-a2fd-65b79e101a1f admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:02.069026 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8367233c-5b94-4003-a2fd-65b79e101a1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:02.071121 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8367233c-5b94-4003-a2fd-65b79e101a1f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:02.099078 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1424/2830] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:41:01 2022] POST /identity/v3/users => generated 299 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:41:02.101234 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5753c0-2773-40c6-90e3-a1c9df5537c5 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:02.114640 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5753c0-2773-40c6-90e3-a1c9df5537c5 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:02.119763 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b1a2d-9826-4fc1-950f-c00fec7bea65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:02.120459 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b1a2d-9826-4fc1-950f-c00fec7bea65 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:02.120839 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b1a2d-9826-4fc1-950f-c00fec7bea65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:02.121155 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b1a2d-9826-4fc1-950f-c00fec7bea65 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:02.122198 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92b1a2d-9826-4fc1-950f-c00fec7bea65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:02.124054 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92b1a2d-9826-4fc1-950f-c00fec7bea65 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:02.158834 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367233c-5b94-4003-a2fd-65b79e101a1f admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:02.162151 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1407/2831] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:41:02.169867 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:02.185146 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367233c-5b94-4003-a2fd-65b79e101a1f admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:02.190162 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e1c023-9063-4ecb-9ce0-fd070d7e4297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:02.190992 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1c023-9063-4ecb-9ce0-fd070d7e4297 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:02.191189 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1c023-9063-4ecb-9ce0-fd070d7e4297 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:02.191466 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1c023-9063-4ecb-9ce0-fd070d7e4297 admin admin] PATH_INFO: `/v3/projects/d169fb5ba2c8441b96fe9ad0ce8b8e0b/users/0f622d6482ca42a2b1adc9ba759049de/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:02.210634 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e1c023-9063-4ecb-9ce0-fd070d7e4297 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d169fb5ba2c8441b96fe9ad0ce8b8e0b, user_id=0f622d6482ca42a2b1adc9ba759049de, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:02.213754 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e1c023-9063-4ecb-9ce0-fd070d7e4297 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:02.242269 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1425/2832] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:41:02 2022] PUT /identity/v3/projects/d169fb5ba2c8441b96fe9ad0ce8b8e0b/users/0f622d6482ca42a2b1adc9ba759049de/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:02.246459 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b1a2d-9826-4fc1-950f-c00fec7bea65 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:02.261775 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b1a2d-9826-4fc1-950f-c00fec7bea65 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:02.325321 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:02.362310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e541bb3-dc6f-45ff-8c89-6999e58b9414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:02.363405 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e541bb3-dc6f-45ff-8c89-6999e58b9414 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:02.364675 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e541bb3-dc6f-45ff-8c89-6999e58b9414 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:02.365297 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e541bb3-dc6f-45ff-8c89-6999e58b9414 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:02.366483 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e541bb3-dc6f-45ff-8c89-6999e58b9414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:02.368783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e541bb3-dc6f-45ff-8c89-6999e58b9414 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:02.383146 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1408/2833] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:41:02.387419 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e1c023-9063-4ecb-9ce0-fd070d7e4297 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:02.402160 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e1c023-9063-4ecb-9ce0-fd070d7e4297 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:02.409429 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b9bdc2-a9be-4ed8-ba20-0a30b46f9580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:02.410688 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b9bdc2-a9be-4ed8-ba20-0a30b46f9580 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:02.411721 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b9bdc2-a9be-4ed8-ba20-0a30b46f9580 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:02.412185 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b9bdc2-a9be-4ed8-ba20-0a30b46f9580 admin admin] PATH_INFO: `/v3/projects/d169fb5ba2c8441b96fe9ad0ce8b8e0b/users/0f622d6482ca42a2b1adc9ba759049de/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:02.414703 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b9bdc2-a9be-4ed8-ba20-0a30b46f9580 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d169fb5ba2c8441b96fe9ad0ce8b8e0b, user_id=0f622d6482ca42a2b1adc9ba759049de, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:02.417608 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b9bdc2-a9be-4ed8-ba20-0a30b46f9580 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:02.441808 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1426/2834] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:41:02 2022] PUT /identity/v3/projects/d169fb5ba2c8441b96fe9ad0ce8b8e0b/users/0f622d6482ca42a2b1adc9ba759049de/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:41:02.453100 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9158bda-7361-4492-a8c0-614390fd666c None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:02.453988 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9158bda-7361-4492-a8c0-614390fd666c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:02.454663 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9158bda-7361-4492-a8c0-614390fd666c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:02.529204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-b9158bda-7361-4492-a8c0-614390fd666c None None] MFA Rules not processed for user `0f622d6482ca42a2b1adc9ba759049de`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:02.530525 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b9158bda-7361-4492-a8c0-614390fd666c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:02.736832 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931c886-fef4-417d-910b-e5ac75f2833f None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:02.737124 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931c886-fef4-417d-910b-e5ac75f2833f None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:02.737653 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931c886-fef4-417d-910b-e5ac75f2833f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:02.799241 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1409/2835] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:41:02 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:02.810648 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-8931c886-fef4-417d-910b-e5ac75f2833f None None] MFA Rules not processed for user `cc90d88d1e574a94858bbe2523855caa`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:02.812698 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8931c886-fef4-417d-910b-e5ac75f2833f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:02.938832 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1427/2836] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:41:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:03.077602 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9158bda-7361-4492-a8c0-614390fd666c None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:03.079957 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b9158bda-7361-4492-a8c0-614390fd666c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:03.192081 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9158bda-7361-4492-a8c0-614390fd666c None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:03.200457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1a2c2-d244-421e-89a1-4bf8723d7209 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:03.202529 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1a2c2-d244-421e-89a1-4bf8723d7209 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:03.202824 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1a2c2-d244-421e-89a1-4bf8723d7209 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:03.203168 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1a2c2-d244-421e-89a1-4bf8723d7209 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:03.214319 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e1a2c2-d244-421e-89a1-4bf8723d7209 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:03.216186 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e1a2c2-d244-421e-89a1-4bf8723d7209 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:03.229566 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1410/2837] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:41:03 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:41:04.615654 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931c886-fef4-417d-910b-e5ac75f2833f None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:04.713125 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931c886-fef4-417d-910b-e5ac75f2833f None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:04.717855 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0776e3-38ee-4eae-a808-9bf926da6686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:04.718576 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0776e3-38ee-4eae-a808-9bf926da6686 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:04.719438 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0776e3-38ee-4eae-a808-9bf926da6686 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:04.719438 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0776e3-38ee-4eae-a808-9bf926da6686 admin admin] PATH_INFO: `/v3/users/4efb903161254beabf4d979a6382e610` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:04.720471 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0776e3-38ee-4eae-a808-9bf926da6686 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4efb903161254beabf4d979a6382e610)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:04.722492 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0776e3-38ee-4eae-a808-9bf926da6686 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:04.791831 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ba0776e3-38ee-4eae-a808-9bf926da6686 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4efb903161254beabf4d979a6382e610'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:04.792558 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ba0776e3-38ee-4eae-a808-9bf926da6686 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4efb903161254beabf4d979a6382e610'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:04.807270 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ba0776e3-38ee-4eae-a808-9bf926da6686 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4efb903161254beabf4d979a6382e610'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:04.819160 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ba0776e3-38ee-4eae-a808-9bf926da6686 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4efb903161254beabf4d979a6382e610'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:04.820668 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:04.832642 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ba0776e3-38ee-4eae-a808-9bf926da6686 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4efb903161254beabf4d979a6382e610'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:04.840365 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1428/2838] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:41:04 2022] DELETE /identity/v3/users/4efb903161254beabf4d979a6382e610 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:04.844699 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80223f2-a4c1-48b5-b658-a2e93ccad69e None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:04.845239 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80223f2-a4c1-48b5-b658-a2e93ccad69e None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:04.845239 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80223f2-a4c1-48b5-b658-a2e93ccad69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:04.865558 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-f80223f2-a4c1-48b5-b658-a2e93ccad69e None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:04.866727 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f80223f2-a4c1-48b5-b658-a2e93ccad69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:04.920740 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:04.942877 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1411/2839] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:41:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:04.955752 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0776e3-38ee-4eae-a808-9bf926da6686 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:04.957407 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ba0776e3-38ee-4eae-a808-9bf926da6686 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:05.028301 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0776e3-38ee-4eae-a808-9bf926da6686 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:05.035078 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f54c1d-a004-4572-ab63-8333e058730a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:05.037264 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f54c1d-a004-4572-ab63-8333e058730a service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:05.037768 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f54c1d-a004-4572-ab63-8333e058730a service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:05.039120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f54c1d-a004-4572-ab63-8333e058730a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:05.055208 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f54c1d-a004-4572-ab63-8333e058730a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:05.056670 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f54c1d-a004-4572-ab63-8333e058730a service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:05.066809 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1429/2840] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:41:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:41:05.390824 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80223f2-a4c1-48b5-b658-a2e93ccad69e None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:05.393037 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f80223f2-a4c1-48b5-b658-a2e93ccad69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:05.416845 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80223f2-a4c1-48b5-b658-a2e93ccad69e None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:05.421780 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764e04f-2f23-4df6-a461-9050252db8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:05.422515 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764e04f-2f23-4df6-a461-9050252db8c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:05.422825 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764e04f-2f23-4df6-a461-9050252db8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:05.423080 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764e04f-2f23-4df6-a461-9050252db8c1 admin admin] PATH_INFO: `/v3/projects/ccadaa98571f44cfb524f1b3eb336b62` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:05.424305 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a764e04f-2f23-4df6-a461-9050252db8c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccadaa98571f44cfb524f1b3eb336b62)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:05.426226 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a764e04f-2f23-4df6-a461-9050252db8c1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:05.477494 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a764e04f-2f23-4df6-a461-9050252db8c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccadaa98571f44cfb524f1b3eb336b62', 'request_id': 'req-a764e04f-2f23-4df6-a461-9050252db8c1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:05.483398 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a764e04f-2f23-4df6-a461-9050252db8c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccadaa98571f44cfb524f1b3eb336b62', 'request_id': 'req-a764e04f-2f23-4df6-a461-9050252db8c1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:05.490489 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a764e04f-2f23-4df6-a461-9050252db8c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccadaa98571f44cfb524f1b3eb336b62', 'request_id': 'req-a764e04f-2f23-4df6-a461-9050252db8c1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:05.505892 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a764e04f-2f23-4df6-a461-9050252db8c1 admin admin] The token cache is being invalidate because project ccadaa98571f44cfb524f1b3eb336b62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:41:05.506366 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a764e04f-2f23-4df6-a461-9050252db8c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:05.507014 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a764e04f-2f23-4df6-a461-9050252db8c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:05.508640 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1412/2841] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:41:05 2022] DELETE /identity/v3/projects/ccadaa98571f44cfb524f1b3eb336b62 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:05.512695 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f54c1d-a004-4572-ab63-8333e058730a service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:05.522767 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f54c1d-a004-4572-ab63-8333e058730a service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:05.580768 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c876bb-5222-4bda-bd45-bf6b8b233d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:05.581407 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c876bb-5222-4bda-bd45-bf6b8b233d62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:05.581685 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c876bb-5222-4bda-bd45-bf6b8b233d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:05.581975 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c876bb-5222-4bda-bd45-bf6b8b233d62 admin admin] PATH_INFO: `/v3/users/0f622d6482ca42a2b1adc9ba759049de` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:05.583245 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c876bb-5222-4bda-bd45-bf6b8b233d62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f622d6482ca42a2b1adc9ba759049de)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:05.585398 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c876bb-5222-4bda-bd45-bf6b8b233d62 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:05.637704 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-78c876bb-5222-4bda-bd45-bf6b8b233d62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f622d6482ca42a2b1adc9ba759049de'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:05.639733 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-78c876bb-5222-4bda-bd45-bf6b8b233d62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f622d6482ca42a2b1adc9ba759049de'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:05.653598 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-78c876bb-5222-4bda-bd45-bf6b8b233d62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f622d6482ca42a2b1adc9ba759049de'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:05.661760 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-78c876bb-5222-4bda-bd45-bf6b8b233d62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f622d6482ca42a2b1adc9ba759049de'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:05.669393 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-78c876bb-5222-4bda-bd45-bf6b8b233d62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f622d6482ca42a2b1adc9ba759049de'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:05.677055 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1430/2842] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:41:05 2022] DELETE /identity/v3/users/0f622d6482ca42a2b1adc9ba759049de => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:06.053334 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764e04f-2f23-4df6-a461-9050252db8c1 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:06.056671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a764e04f-2f23-4df6-a461-9050252db8c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:06.084009 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764e04f-2f23-4df6-a461-9050252db8c1 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:06.172408 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5759f-27de-4650-8b48-430235191989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:06.173574 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5759f-27de-4650-8b48-430235191989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:06.173574 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5759f-27de-4650-8b48-430235191989 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:06.173764 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5759f-27de-4650-8b48-430235191989 admin admin] PATH_INFO: `/v3/projects/d169fb5ba2c8441b96fe9ad0ce8b8e0b` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:06.175060 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5759f-27de-4650-8b48-430235191989 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d169fb5ba2c8441b96fe9ad0ce8b8e0b)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:06.177786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5759f-27de-4650-8b48-430235191989 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:06.232698 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d9a5759f-27de-4650-8b48-430235191989 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd169fb5ba2c8441b96fe9ad0ce8b8e0b', 'request_id': 'req-d9a5759f-27de-4650-8b48-430235191989'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:06.243529 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d9a5759f-27de-4650-8b48-430235191989 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd169fb5ba2c8441b96fe9ad0ce8b8e0b', 'request_id': 'req-d9a5759f-27de-4650-8b48-430235191989'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:06.252983 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d9a5759f-27de-4650-8b48-430235191989 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd169fb5ba2c8441b96fe9ad0ce8b8e0b', 'request_id': 'req-d9a5759f-27de-4650-8b48-430235191989'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:06.268032 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d9a5759f-27de-4650-8b48-430235191989 admin admin] The token cache is being invalidate because project d169fb5ba2c8441b96fe9ad0ce8b8e0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:41:06.268576 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d9a5759f-27de-4650-8b48-430235191989 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:06.269227 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d9a5759f-27de-4650-8b48-430235191989 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:06.271815 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1413/2843] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:41:06 2022] DELETE /identity/v3/projects/d169fb5ba2c8441b96fe9ad0ce8b8e0b => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:06.276746 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d3c9e-0816-4e5c-a5ba-86e867e97ba7 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:06.277103 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d3c9e-0816-4e5c-a5ba-86e867e97ba7 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:06.277474 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d3c9e-0816-4e5c-a5ba-86e867e97ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:06.298011 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-fc2d3c9e-0816-4e5c-a5ba-86e867e97ba7 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:06.299372 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-fc2d3c9e-0816-4e5c-a5ba-86e867e97ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:06.306128 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:06.366292 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1431/2844] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:41:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:41:06.375537 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f76294-5375-4c14-9d7e-ec8226483cf9 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:06.375821 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f76294-5375-4c14-9d7e-ec8226483cf9 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:06.376096 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f76294-5375-4c14-9d7e-ec8226483cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:06.386232 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:06.416704 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-18f76294-5375-4c14-9d7e-ec8226483cf9 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:06.419295 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-18f76294-5375-4c14-9d7e-ec8226483cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:06.438972 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1414/2845] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:41:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:06.440301 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d3c9e-0816-4e5c-a5ba-86e867e97ba7 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:06.453811 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d3c9e-0816-4e5c-a5ba-86e867e97ba7 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:06.459197 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4695c8f0-997a-4dc4-a50e-8846db822d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:06.460154 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695c8f0-997a-4dc4-a50e-8846db822d01 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:06.460541 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695c8f0-997a-4dc4-a50e-8846db822d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:06.460902 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695c8f0-997a-4dc4-a50e-8846db822d01 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:06.461662 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4695c8f0-997a-4dc4-a50e-8846db822d01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:41:06.462063 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4695c8f0-997a-4dc4-a50e-8846db822d01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:06.463861 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4695c8f0-997a-4dc4-a50e-8846db822d01 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:06.489465 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1432/2846] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:41:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:41:06.491872 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f76294-5375-4c14-9d7e-ec8226483cf9 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:06.502512 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f76294-5375-4c14-9d7e-ec8226483cf9 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:06.510774 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14671002-9c0c-445d-98b0-bceda05f2956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:06.511504 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14671002-9c0c-445d-98b0-bceda05f2956 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:06.511844 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14671002-9c0c-445d-98b0-bceda05f2956 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:06.512172 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14671002-9c0c-445d-98b0-bceda05f2956 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:06.512869 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14671002-9c0c-445d-98b0-bceda05f2956 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:06.514974 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14671002-9c0c-445d-98b0-bceda05f2956 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:06.546486 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1415/2847] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:41:06 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:41:06.550588 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4695c8f0-997a-4dc4-a50e-8846db822d01 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:06.566361 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4695c8f0-997a-4dc4-a50e-8846db822d01 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:06.624738 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb7e96-e3f9-4267-956e-0914cd3e72d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:06.625449 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb7e96-e3f9-4267-956e-0914cd3e72d6 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:06.625787 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb7e96-e3f9-4267-956e-0914cd3e72d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:06.626121 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb7e96-e3f9-4267-956e-0914cd3e72d6 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:06.626827 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb7e96-e3f9-4267-956e-0914cd3e72d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:06.628849 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb7e96-e3f9-4267-956e-0914cd3e72d6 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:06.655987 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1433/2848] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:41:06 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:41:06.657307 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14671002-9c0c-445d-98b0-bceda05f2956 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:06.670861 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14671002-9c0c-445d-98b0-bceda05f2956 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:06.675619 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ec490-cf71-42a4-af8c-e73836333dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:06.676842 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ec490-cf71-42a4-af8c-e73836333dab admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:06.677123 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ec490-cf71-42a4-af8c-e73836333dab admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:06.677459 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ec490-cf71-42a4-af8c-e73836333dab admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:06.678432 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ec490-cf71-42a4-af8c-e73836333dab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:06.680083 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ec490-cf71-42a4-af8c-e73836333dab admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:06.690998 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1416/2849] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:41:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:41:06.696108 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb7e96-e3f9-4267-956e-0914cd3e72d6 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:06.710402 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb7e96-e3f9-4267-956e-0914cd3e72d6 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:06.715045 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec0c10-2282-47d7-8a95-3780fd616aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:06.715794 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec0c10-2282-47d7-8a95-3780fd616aaf admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:06.716077 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec0c10-2282-47d7-8a95-3780fd616aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:06.716344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec0c10-2282-47d7-8a95-3780fd616aaf admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:06.716985 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec0c10-2282-47d7-8a95-3780fd616aaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:06.718589 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec0c10-2282-47d7-8a95-3780fd616aaf admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:06.731750 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1434/2850] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:41:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:41:06.735438 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ec490-cf71-42a4-af8c-e73836333dab admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:06.748032 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ec490-cf71-42a4-af8c-e73836333dab admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:06.752710 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc12d0ae-831f-4901-9638-606efa97853e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:06.753385 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12d0ae-831f-4901-9638-606efa97853e admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:06.753654 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12d0ae-831f-4901-9638-606efa97853e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:06.753917 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12d0ae-831f-4901-9638-606efa97853e admin admin] PATH_INFO: `/v3/projects/93cffdb3292247c69d9f8b425453962a/users/00c0fdb3a3524a93b7728b495750b95e/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:06.770242 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc12d0ae-831f-4901-9638-606efa97853e admin admin] RBAC: Authorizing `identity:create_grant(project_id=93cffdb3292247c69d9f8b425453962a, user_id=00c0fdb3a3524a93b7728b495750b95e, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:06.773084 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc12d0ae-831f-4901-9638-606efa97853e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:06.788403 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1417/2851] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:41:06 2022] PUT /identity/v3/projects/93cffdb3292247c69d9f8b425453962a/users/00c0fdb3a3524a93b7728b495750b95e/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:41:06.802239 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21714a5b-b864-446c-83ba-bcdfc028fb8c None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:06.802524 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21714a5b-b864-446c-83ba-bcdfc028fb8c None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:06.802794 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21714a5b-b864-446c-83ba-bcdfc028fb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:06.833700 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-21714a5b-b864-446c-83ba-bcdfc028fb8c None None] MFA Rules not processed for user `00c0fdb3a3524a93b7728b495750b95e`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:06.834964 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-21714a5b-b864-446c-83ba-bcdfc028fb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:06.911857 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1435/2852] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:41:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:41:06.915962 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc12d0ae-831f-4901-9638-606efa97853e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:07.050113 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc12d0ae-831f-4901-9638-606efa97853e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:07.061375 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3cb6d1-3615-4fba-88c6-9e7ea79ac5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:07.062289 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3cb6d1-3615-4fba-88c6-9e7ea79ac5d0 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:07.062392 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3cb6d1-3615-4fba-88c6-9e7ea79ac5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:07.062622 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3cb6d1-3615-4fba-88c6-9e7ea79ac5d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:07.063292 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3cb6d1-3615-4fba-88c6-9e7ea79ac5d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:07.066245 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3cb6d1-3615-4fba-88c6-9e7ea79ac5d0 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:07.108445 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1418/2853] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:41:06 2022] POST /identity/v3/projects => generated 371 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:41:07.110576 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21714a5b-b864-446c-83ba-bcdfc028fb8c None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:07.126125 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21714a5b-b864-446c-83ba-bcdfc028fb8c None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:07.131494 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:07.220760 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb21c1-da04-4a39-be2a-e8a26dcc9a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:07.221375 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb21c1-da04-4a39-be2a-e8a26dcc9a6b admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:07.221724 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb21c1-da04-4a39-be2a-e8a26dcc9a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:07.222059 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb21c1-da04-4a39-be2a-e8a26dcc9a6b admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:07.222861 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbb21c1-da04-4a39-be2a-e8a26dcc9a6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:07.225875 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbb21c1-da04-4a39-be2a-e8a26dcc9a6b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:07.256391 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1436/2854] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:41:07 2022] POST /identity/v3/users => generated 292 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:41:07.261167 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3cb6d1-3615-4fba-88c6-9e7ea79ac5d0 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:07.275104 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3cb6d1-3615-4fba-88c6-9e7ea79ac5d0 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:07.283298 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea0386-5e6f-4e3e-b4cb-d07777433492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:07.284305 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea0386-5e6f-4e3e-b4cb-d07777433492 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:07.284818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea0386-5e6f-4e3e-b4cb-d07777433492 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:07.285155 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea0386-5e6f-4e3e-b4cb-d07777433492 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:07.287124 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea0386-5e6f-4e3e-b4cb-d07777433492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:07.289507 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea0386-5e6f-4e3e-b4cb-d07777433492 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:07.305166 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1419/2855] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:41:07.309293 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb21c1-da04-4a39-be2a-e8a26dcc9a6b admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:07.325496 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb21c1-da04-4a39-be2a-e8a26dcc9a6b admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:07.330774 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2f978-21ad-489c-bffe-c8ed2c169fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:07.331667 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2f978-21ad-489c-bffe-c8ed2c169fb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:07.332013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2f978-21ad-489c-bffe-c8ed2c169fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:07.332360 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2f978-21ad-489c-bffe-c8ed2c169fb5 admin admin] PATH_INFO: `/v3/projects/d9a7498279404cd69323b0073b79833e/users/a2f92fde643d4a1687a2f3c17376e4bf/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:07.356248 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd2f978-21ad-489c-bffe-c8ed2c169fb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9a7498279404cd69323b0073b79833e, user_id=a2f92fde643d4a1687a2f3c17376e4bf, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:07.359762 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd2f978-21ad-489c-bffe-c8ed2c169fb5 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:07.380574 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1437/2856] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:41:07 2022] PUT /identity/v3/projects/d9a7498279404cd69323b0073b79833e/users/a2f92fde643d4a1687a2f3c17376e4bf/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:41:07.384487 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea0386-5e6f-4e3e-b4cb-d07777433492 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:07.396426 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea0386-5e6f-4e3e-b4cb-d07777433492 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:07.510679 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e75aa7-a3d7-4e51-924e-cda969d838d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:07.515277 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e75aa7-a3d7-4e51-924e-cda969d838d9 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:07.515649 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e75aa7-a3d7-4e51-924e-cda969d838d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:07.515994 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e75aa7-a3d7-4e51-924e-cda969d838d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:07.517377 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e75aa7-a3d7-4e51-924e-cda969d838d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:07.518892 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e75aa7-a3d7-4e51-924e-cda969d838d9 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:07.533736 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1420/2857] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:41:07.535130 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2f978-21ad-489c-bffe-c8ed2c169fb5 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:07.548622 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2f978-21ad-489c-bffe-c8ed2c169fb5 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:07.554049 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c7742-1fc9-44d7-b3b8-031c5234714b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:07.554775 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c7742-1fc9-44d7-b3b8-031c5234714b admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:07.555064 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c7742-1fc9-44d7-b3b8-031c5234714b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:07.555361 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c7742-1fc9-44d7-b3b8-031c5234714b admin admin] PATH_INFO: `/v3/projects/d9a7498279404cd69323b0073b79833e/users/a2f92fde643d4a1687a2f3c17376e4bf/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:07.557649 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c7742-1fc9-44d7-b3b8-031c5234714b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9a7498279404cd69323b0073b79833e, user_id=a2f92fde643d4a1687a2f3c17376e4bf, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:07.560468 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c7742-1fc9-44d7-b3b8-031c5234714b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:07.574020 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1438/2858] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:41:07 2022] PUT /identity/v3/projects/d9a7498279404cd69323b0073b79833e/users/a2f92fde643d4a1687a2f3c17376e4bf/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:41:07.586501 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc62ef3-8281-4f7b-a058-c037cac83ccb None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:07.586792 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc62ef3-8281-4f7b-a058-c037cac83ccb None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:07.587119 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc62ef3-8281-4f7b-a058-c037cac83ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:07.609343 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:07.623681 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-5fc62ef3-8281-4f7b-a058-c037cac83ccb None None] MFA Rules not processed for user `a2f92fde643d4a1687a2f3c17376e4bf`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:07.625259 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5fc62ef3-8281-4f7b-a058-c037cac83ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:07.790644 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1421/2859] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:41:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:07.802836 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9bc48-f483-4bc1-897c-fc2f0de33421 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:07.803408 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9bc48-f483-4bc1-897c-fc2f0de33421 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:07.803408 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9bc48-f483-4bc1-897c-fc2f0de33421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:07.852868 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-0df9bc48-f483-4bc1-897c-fc2f0de33421 None None] MFA Rules not processed for user `00c0fdb3a3524a93b7728b495750b95e`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:07.868030 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0df9bc48-f483-4bc1-897c-fc2f0de33421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:07.982574 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1439/2860] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:41:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:07.993996 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc62ef3-8281-4f7b-a058-c037cac83ccb None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:07.995467 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5fc62ef3-8281-4f7b-a058-c037cac83ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:08.096019 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc62ef3-8281-4f7b-a058-c037cac83ccb None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:08.102257 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d89a4d-0367-489c-a25e-21557438c3ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:08.102988 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d89a4d-0367-489c-a25e-21557438c3ee service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:08.103352 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d89a4d-0367-489c-a25e-21557438c3ee service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:08.103698 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d89a4d-0367-489c-a25e-21557438c3ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:08.112633 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d89a4d-0367-489c-a25e-21557438c3ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:08.115341 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d89a4d-0367-489c-a25e-21557438c3ee service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:08.128405 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1422/2861] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:41:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:41:10.203212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df9bc48-f483-4bc1-897c-fc2f0de33421 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:10.205715 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0df9bc48-f483-4bc1-897c-fc2f0de33421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:10.328999 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df9bc48-f483-4bc1-897c-fc2f0de33421 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:10.335224 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa9859-6c8e-46bb-8b26-85febd1a9f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:10.336152 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa9859-6c8e-46bb-8b26-85febd1a9f9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:10.336587 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa9859-6c8e-46bb-8b26-85febd1a9f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:10.337015 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa9859-6c8e-46bb-8b26-85febd1a9f9c admin admin] PATH_INFO: `/v3/users/e82ed6e01c904dbfbc7c337a32791fff` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:10.338397 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa9859-6c8e-46bb-8b26-85febd1a9f9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e82ed6e01c904dbfbc7c337a32791fff)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:10.340951 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa9859-6c8e-46bb-8b26-85febd1a9f9c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:10.347701 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:10.471265 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3ffa9859-6c8e-46bb-8b26-85febd1a9f9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e82ed6e01c904dbfbc7c337a32791fff'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:10.472260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3ffa9859-6c8e-46bb-8b26-85febd1a9f9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e82ed6e01c904dbfbc7c337a32791fff'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:10.516459 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3ffa9859-6c8e-46bb-8b26-85febd1a9f9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e82ed6e01c904dbfbc7c337a32791fff'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:10.532959 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3ffa9859-6c8e-46bb-8b26-85febd1a9f9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e82ed6e01c904dbfbc7c337a32791fff'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:10.558400 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3ffa9859-6c8e-46bb-8b26-85febd1a9f9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e82ed6e01c904dbfbc7c337a32791fff'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:10.576517 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1440/2862] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:41:10 2022] DELETE /identity/v3/users/e82ed6e01c904dbfbc7c337a32791fff => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:11.247800 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d89a4d-0367-489c-a25e-21557438c3ee service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:11.267292 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d89a4d-0367-489c-a25e-21557438c3ee service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:11.455172 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05465bb-7a9d-4050-a48e-89dc17effc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:11.456281 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05465bb-7a9d-4050-a48e-89dc17effc55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:11.456751 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05465bb-7a9d-4050-a48e-89dc17effc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:11.457172 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05465bb-7a9d-4050-a48e-89dc17effc55 admin admin] PATH_INFO: `/v3/projects/3d98eb98aa5b4e5fb7266edf6fad84d7` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:11.459108 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05465bb-7a9d-4050-a48e-89dc17effc55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d98eb98aa5b4e5fb7266edf6fad84d7)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:11.461963 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05465bb-7a9d-4050-a48e-89dc17effc55 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:11.498932 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:11.558874 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d05465bb-7a9d-4050-a48e-89dc17effc55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d98eb98aa5b4e5fb7266edf6fad84d7', 'request_id': 'req-d05465bb-7a9d-4050-a48e-89dc17effc55'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:11.564680 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d05465bb-7a9d-4050-a48e-89dc17effc55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d98eb98aa5b4e5fb7266edf6fad84d7', 'request_id': 'req-d05465bb-7a9d-4050-a48e-89dc17effc55'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:11.572154 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d05465bb-7a9d-4050-a48e-89dc17effc55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d98eb98aa5b4e5fb7266edf6fad84d7', 'request_id': 'req-d05465bb-7a9d-4050-a48e-89dc17effc55'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:11.585849 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d05465bb-7a9d-4050-a48e-89dc17effc55 admin admin] The token cache is being invalidate because project 3d98eb98aa5b4e5fb7266edf6fad84d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:41:11.586233 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d05465bb-7a9d-4050-a48e-89dc17effc55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:11.586877 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d05465bb-7a9d-4050-a48e-89dc17effc55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:11.588454 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1423/2863] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:41:11 2022] DELETE /identity/v3/projects/3d98eb98aa5b4e5fb7266edf6fad84d7 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:11.593484 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd545a-f82b-477b-8e0c-ad09520fbd9d None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:11.593959 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd545a-f82b-477b-8e0c-ad09520fbd9d None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:11.594056 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd545a-f82b-477b-8e0c-ad09520fbd9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:11.613604 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-35bd545a-f82b-477b-8e0c-ad09520fbd9d None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:11.615511 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-35bd545a-f82b-477b-8e0c-ad09520fbd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:11.713961 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1441/2864] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:41:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:41:11.722910 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9c2c9-fe6d-4043-8062-d08d9ca127fb None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:11.723470 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9c2c9-fe6d-4043-8062-d08d9ca127fb None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:11.724252 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9c2c9-fe6d-4043-8062-d08d9ca127fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:11.757268 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-88d9c2c9-fe6d-4043-8062-d08d9ca127fb None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:11.758743 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-88d9c2c9-fe6d-4043-8062-d08d9ca127fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:11.774710 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1424/2865] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:41:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:11.774920 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd545a-f82b-477b-8e0c-ad09520fbd9d None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:11.786950 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd545a-f82b-477b-8e0c-ad09520fbd9d None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:11.793078 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6c680-8500-469a-94ec-9dd8b1053a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:11.793896 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6c680-8500-469a-94ec-9dd8b1053a40 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:11.794181 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6c680-8500-469a-94ec-9dd8b1053a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:11.794665 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6c680-8500-469a-94ec-9dd8b1053a40 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:11.795375 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d6c680-8500-469a-94ec-9dd8b1053a40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:41:11.795678 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d6c680-8500-469a-94ec-9dd8b1053a40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:11.797470 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d6c680-8500-469a-94ec-9dd8b1053a40 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:11.812692 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1442/2866] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:41:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:41:11.816664 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d9c2c9-fe6d-4043-8062-d08d9ca127fb None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:11.828068 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d9c2c9-fe6d-4043-8062-d08d9ca127fb None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:11.835354 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc9487-1328-4e22-9c15-238a85459b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:11.836117 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc9487-1328-4e22-9c15-238a85459b6c admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:11.836494 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc9487-1328-4e22-9c15-238a85459b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:11.836867 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc9487-1328-4e22-9c15-238a85459b6c admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:11.837651 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dc9487-1328-4e22-9c15-238a85459b6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:11.839910 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dc9487-1328-4e22-9c15-238a85459b6c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:11.876307 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1425/2867] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:41:11 2022] POST /identity/v3/projects => generated 403 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:41:11.880677 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6c680-8500-469a-94ec-9dd8b1053a40 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:11.890931 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6c680-8500-469a-94ec-9dd8b1053a40 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:11.960654 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc8121-cbe7-42a1-98ab-f2e55545da2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:11.961347 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc8121-cbe7-42a1-98ab-f2e55545da2a admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:11.961627 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc8121-cbe7-42a1-98ab-f2e55545da2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:11.961902 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc8121-cbe7-42a1-98ab-f2e55545da2a admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:11.962606 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cc8121-cbe7-42a1-98ab-f2e55545da2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:11.965666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cc8121-cbe7-42a1-98ab-f2e55545da2a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:11.991836 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:11.998624 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1443/2868] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:41:11 2022] POST /identity/v3/users => generated 302 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:41:12.002422 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc9487-1328-4e22-9c15-238a85459b6c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:12.017110 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc9487-1328-4e22-9c15-238a85459b6c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:12.022884 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86768427-e119-48a5-80ae-cd712bc0e6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:12.023541 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86768427-e119-48a5-80ae-cd712bc0e6b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:12.023823 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86768427-e119-48a5-80ae-cd712bc0e6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:12.024096 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86768427-e119-48a5-80ae-cd712bc0e6b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:12.024824 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86768427-e119-48a5-80ae-cd712bc0e6b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:12.026843 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86768427-e119-48a5-80ae-cd712bc0e6b9 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:12.044119 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1426/2869] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:41:12.048175 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc8121-cbe7-42a1-98ab-f2e55545da2a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:12.060681 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc8121-cbe7-42a1-98ab-f2e55545da2a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:12.065777 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094fb0d0-9664-44b3-8d48-de47a3708977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:12.066652 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fb0d0-9664-44b3-8d48-de47a3708977 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:12.067551 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fb0d0-9664-44b3-8d48-de47a3708977 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:12.068190 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fb0d0-9664-44b3-8d48-de47a3708977 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:12.069124 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094fb0d0-9664-44b3-8d48-de47a3708977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:12.070989 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094fb0d0-9664-44b3-8d48-de47a3708977 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:12.087102 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1444/2870] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:41:12.090082 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86768427-e119-48a5-80ae-cd712bc0e6b9 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:12.100446 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86768427-e119-48a5-80ae-cd712bc0e6b9 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:12.105321 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e6f33-be8f-4368-98a9-20c41d794ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:12.105985 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e6f33-be8f-4368-98a9-20c41d794ab2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:12.106261 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e6f33-be8f-4368-98a9-20c41d794ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:12.106537 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e6f33-be8f-4368-98a9-20c41d794ab2 admin admin] PATH_INFO: `/v3/projects/f9db9f6ebf0b495a8bb1f85dc8fad7be/users/65a196bbedec4627be79cc71193843d8/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:12.124115 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0e6f33-be8f-4368-98a9-20c41d794ab2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9db9f6ebf0b495a8bb1f85dc8fad7be, user_id=65a196bbedec4627be79cc71193843d8, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:12.127206 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0e6f33-be8f-4368-98a9-20c41d794ab2 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:12.150365 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1427/2871] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:41:12 2022] PUT /identity/v3/projects/f9db9f6ebf0b495a8bb1f85dc8fad7be/users/65a196bbedec4627be79cc71193843d8/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:41:12.156128 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838f668-8ac6-42ff-8c93-3db220243fef None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:12.156695 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838f668-8ac6-42ff-8c93-3db220243fef None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:12.156695 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838f668-8ac6-42ff-8c93-3db220243fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:12.177509 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-5838f668-8ac6-42ff-8c93-3db220243fef None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:12.178737 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5838f668-8ac6-42ff-8c93-3db220243fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:12.240366 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1445/2872] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:41:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:41:12.249997 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e6f33-be8f-4368-98a9-20c41d794ab2 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:12.251766 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3f0e6f33-be8f-4368-98a9-20c41d794ab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:12.317845 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e6f33-be8f-4368-98a9-20c41d794ab2 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:12.323149 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d5871-75d5-42d6-937b-7adcb8dc9d81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:12.323959 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d5871-75d5-42d6-937b-7adcb8dc9d81 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:12.324245 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d5871-75d5-42d6-937b-7adcb8dc9d81 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:12.324516 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d5871-75d5-42d6-937b-7adcb8dc9d81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:12.336929 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d5871-75d5-42d6-937b-7adcb8dc9d81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:12.338396 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d5871-75d5-42d6-937b-7adcb8dc9d81 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:12.348452 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1428/2873] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:41:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:41:14.136985 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5838f668-8ac6-42ff-8c93-3db220243fef None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:14.139139 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5838f668-8ac6-42ff-8c93-3db220243fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:14.156880 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5838f668-8ac6-42ff-8c93-3db220243fef None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:14.165319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e723037-9757-4200-be73-70200a0d34cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:14.166555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e723037-9757-4200-be73-70200a0d34cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:14.166907 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e723037-9757-4200-be73-70200a0d34cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:14.167279 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e723037-9757-4200-be73-70200a0d34cb admin admin] PATH_INFO: `/v3/users/67701a88fc354d4c9ae7d16f8ee1355b` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:14.169063 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e723037-9757-4200-be73-70200a0d34cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=67701a88fc354d4c9ae7d16f8ee1355b)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:14.171634 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e723037-9757-4200-be73-70200a0d34cb admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:14.234889 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8e723037-9757-4200-be73-70200a0d34cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67701a88fc354d4c9ae7d16f8ee1355b'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:14.235584 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8e723037-9757-4200-be73-70200a0d34cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67701a88fc354d4c9ae7d16f8ee1355b'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:14.252713 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8e723037-9757-4200-be73-70200a0d34cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67701a88fc354d4c9ae7d16f8ee1355b'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:14.260794 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8e723037-9757-4200-be73-70200a0d34cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67701a88fc354d4c9ae7d16f8ee1355b'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:14.272969 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8e723037-9757-4200-be73-70200a0d34cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67701a88fc354d4c9ae7d16f8ee1355b'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:14.284889 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1446/2874] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:41:14 2022] DELETE /identity/v3/users/67701a88fc354d4c9ae7d16f8ee1355b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:14.286834 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ae8f9-e44b-4a4c-90b4-4c5e2bf642b8 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:14.287372 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ae8f9-e44b-4a4c-90b4-4c5e2bf642b8 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:14.287615 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ae8f9-e44b-4a4c-90b4-4c5e2bf642b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:14.313486 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-876ae8f9-e44b-4a4c-90b4-4c5e2bf642b8 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:14.315211 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-876ae8f9-e44b-4a4c-90b4-4c5e2bf642b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:14.463951 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:14.506995 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1429/2875] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:41:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:14.540143 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e723037-9757-4200-be73-70200a0d34cb admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:14.541623 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8e723037-9757-4200-be73-70200a0d34cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:14.649911 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e723037-9757-4200-be73-70200a0d34cb admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:14.656147 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d480ef04-29b7-4121-a186-508217325ca1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:14.656887 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480ef04-29b7-4121-a186-508217325ca1 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:14.657091 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480ef04-29b7-4121-a186-508217325ca1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:14.657366 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480ef04-29b7-4121-a186-508217325ca1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:14.668180 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d480ef04-29b7-4121-a186-508217325ca1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:14.669659 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d480ef04-29b7-4121-a186-508217325ca1 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:14.683581 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1447/2876] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:41:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:41:15.120531 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ae8f9-e44b-4a4c-90b4-4c5e2bf642b8 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:15.122812 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-876ae8f9-e44b-4a4c-90b4-4c5e2bf642b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:15.167953 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ae8f9-e44b-4a4c-90b4-4c5e2bf642b8 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:15.179798 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb1209-6d7e-45c3-bb56-f21029c08577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:15.180460 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb1209-6d7e-45c3-bb56-f21029c08577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:15.181382 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb1209-6d7e-45c3-bb56-f21029c08577 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:15.181607 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb1209-6d7e-45c3-bb56-f21029c08577 admin admin] PATH_INFO: `/v3/projects/068087b8e3274eb98dabdb60c8db2368` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:15.182952 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb1209-6d7e-45c3-bb56-f21029c08577 admin admin] RBAC: Authorizing `identity:delete_project(project_id=068087b8e3274eb98dabdb60c8db2368)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:15.188432 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb1209-6d7e-45c3-bb56-f21029c08577 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:15.293643 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f2bb1209-6d7e-45c3-bb56-f21029c08577 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '068087b8e3274eb98dabdb60c8db2368', 'request_id': 'req-f2bb1209-6d7e-45c3-bb56-f21029c08577'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:15.300499 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f2bb1209-6d7e-45c3-bb56-f21029c08577 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '068087b8e3274eb98dabdb60c8db2368', 'request_id': 'req-f2bb1209-6d7e-45c3-bb56-f21029c08577'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:15.309131 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f2bb1209-6d7e-45c3-bb56-f21029c08577 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '068087b8e3274eb98dabdb60c8db2368', 'request_id': 'req-f2bb1209-6d7e-45c3-bb56-f21029c08577'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:15.324826 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f2bb1209-6d7e-45c3-bb56-f21029c08577 admin admin] The token cache is being invalidate because project 068087b8e3274eb98dabdb60c8db2368 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:41:15.325312 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f2bb1209-6d7e-45c3-bb56-f21029c08577 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:15.326284 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f2bb1209-6d7e-45c3-bb56-f21029c08577 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:15.328628 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1430/2877] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:41:15 2022] DELETE /identity/v3/projects/068087b8e3274eb98dabdb60c8db2368 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:15.333090 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d480ef04-29b7-4121-a186-508217325ca1 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:15.349277 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:15.356384 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d480ef04-29b7-4121-a186-508217325ca1 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:15.438702 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c9ec4-6896-4677-aa88-e34359a1477b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:15.439927 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c9ec4-6896-4677-aa88-e34359a1477b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:15.440973 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c9ec4-6896-4677-aa88-e34359a1477b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:15.441676 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c9ec4-6896-4677-aa88-e34359a1477b admin admin] PATH_INFO: `/v3/users/f9feee1111ed47078d21023834d46344` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:15.445445 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c9ec4-6896-4677-aa88-e34359a1477b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9feee1111ed47078d21023834d46344)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:15.447724 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c9ec4-6896-4677-aa88-e34359a1477b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:15.674431 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-238c9ec4-6896-4677-aa88-e34359a1477b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9feee1111ed47078d21023834d46344'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:15.675534 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-238c9ec4-6896-4677-aa88-e34359a1477b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9feee1111ed47078d21023834d46344'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:15.689626 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-238c9ec4-6896-4677-aa88-e34359a1477b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9feee1111ed47078d21023834d46344'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:15.703136 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-238c9ec4-6896-4677-aa88-e34359a1477b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9feee1111ed47078d21023834d46344'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:15.708918 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-238c9ec4-6896-4677-aa88-e34359a1477b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9feee1111ed47078d21023834d46344'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:15.720368 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1448/2878] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:41:15 2022] DELETE /identity/v3/users/f9feee1111ed47078d21023834d46344 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:16.044350 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb1209-6d7e-45c3-bb56-f21029c08577 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:16.046066 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f2bb1209-6d7e-45c3-bb56-f21029c08577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:16.061149 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb1209-6d7e-45c3-bb56-f21029c08577 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:16.133326 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2311c1-a38a-4ab6-a7ee-c2cb8579eae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:16.134069 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2311c1-a38a-4ab6-a7ee-c2cb8579eae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:16.134432 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2311c1-a38a-4ab6-a7ee-c2cb8579eae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:16.134805 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2311c1-a38a-4ab6-a7ee-c2cb8579eae3 admin admin] PATH_INFO: `/v3/projects/5deefbb32a254e42a6193ac0ff2d30b6` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:16.136150 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2311c1-a38a-4ab6-a7ee-c2cb8579eae3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5deefbb32a254e42a6193ac0ff2d30b6)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:16.138173 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2311c1-a38a-4ab6-a7ee-c2cb8579eae3 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:16.204141 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1e2311c1-a38a-4ab6-a7ee-c2cb8579eae3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5deefbb32a254e42a6193ac0ff2d30b6', 'request_id': 'req-1e2311c1-a38a-4ab6-a7ee-c2cb8579eae3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:16.210978 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1e2311c1-a38a-4ab6-a7ee-c2cb8579eae3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5deefbb32a254e42a6193ac0ff2d30b6', 'request_id': 'req-1e2311c1-a38a-4ab6-a7ee-c2cb8579eae3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:16.228436 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1e2311c1-a38a-4ab6-a7ee-c2cb8579eae3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5deefbb32a254e42a6193ac0ff2d30b6', 'request_id': 'req-1e2311c1-a38a-4ab6-a7ee-c2cb8579eae3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:16.248065 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1e2311c1-a38a-4ab6-a7ee-c2cb8579eae3 admin admin] The token cache is being invalidate because project 5deefbb32a254e42a6193ac0ff2d30b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:41:16.248785 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1e2311c1-a38a-4ab6-a7ee-c2cb8579eae3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:16.249555 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1e2311c1-a38a-4ab6-a7ee-c2cb8579eae3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:16.259430 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1431/2879] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:41:16 2022] DELETE /identity/v3/projects/5deefbb32a254e42a6193ac0ff2d30b6 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:16.261517 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b0812-edee-4db1-9b19-fa79ff5cb44f None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:16.262112 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b0812-edee-4db1-9b19-fa79ff5cb44f None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:16.262654 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b0812-edee-4db1-9b19-fa79ff5cb44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:16.283985 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-863b0812-edee-4db1-9b19-fa79ff5cb44f None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:16.285185 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-863b0812-edee-4db1-9b19-fa79ff5cb44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:16.374421 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1449/2880] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:41:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:16.376966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1929a-eebd-4717-99c5-42bad6ac00b9 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:16.377387 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1929a-eebd-4717-99c5-42bad6ac00b9 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:16.377494 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1929a-eebd-4717-99c5-42bad6ac00b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:16.388519 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:16.403744 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-53d1929a-eebd-4717-99c5-42bad6ac00b9 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:16.405573 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-53d1929a-eebd-4717-99c5-42bad6ac00b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:16.415345 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1432/2881] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:41:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:41:16.419698 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b0812-edee-4db1-9b19-fa79ff5cb44f None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:16.429926 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b0812-edee-4db1-9b19-fa79ff5cb44f None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:16.435252 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a2a2a-9bf9-4fda-ac3f-407e840dfe8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:16.436191 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a2a2a-9bf9-4fda-ac3f-407e840dfe8a admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:16.436460 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a2a2a-9bf9-4fda-ac3f-407e840dfe8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:16.438027 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a2a2a-9bf9-4fda-ac3f-407e840dfe8a admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:16.438695 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a2a2a-9bf9-4fda-ac3f-407e840dfe8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:41:16.439002 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a2a2a-9bf9-4fda-ac3f-407e840dfe8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:16.440721 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a2a2a-9bf9-4fda-ac3f-407e840dfe8a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:16.454714 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1450/2882] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:41:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:41:16.459495 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d1929a-eebd-4717-99c5-42bad6ac00b9 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:16.469163 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d1929a-eebd-4717-99c5-42bad6ac00b9 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:16.474111 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426f66b-adb5-4008-9f81-efa176711c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:16.474877 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426f66b-adb5-4008-9f81-efa176711c3d admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:16.475240 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426f66b-adb5-4008-9f81-efa176711c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:16.476064 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426f66b-adb5-4008-9f81-efa176711c3d admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:16.476921 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7426f66b-adb5-4008-9f81-efa176711c3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:16.479256 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7426f66b-adb5-4008-9f81-efa176711c3d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:16.538292 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1433/2883] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:41:16 2022] POST /identity/v3/projects => generated 375 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:41:16.540365 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a2a2a-9bf9-4fda-ac3f-407e840dfe8a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:16.554426 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a2a2a-9bf9-4fda-ac3f-407e840dfe8a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:16.564508 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:16.628345 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef6b2d-3957-4923-8dfc-9c9a0eb0ca94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:16.630106 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef6b2d-3957-4923-8dfc-9c9a0eb0ca94 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:16.630456 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef6b2d-3957-4923-8dfc-9c9a0eb0ca94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:16.630800 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef6b2d-3957-4923-8dfc-9c9a0eb0ca94 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:16.632459 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aef6b2d-3957-4923-8dfc-9c9a0eb0ca94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:16.635675 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aef6b2d-3957-4923-8dfc-9c9a0eb0ca94 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:16.665898 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1451/2884] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:41:16 2022] POST /identity/v3/users => generated 288 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:41:16.669702 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426f66b-adb5-4008-9f81-efa176711c3d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:16.684400 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426f66b-adb5-4008-9f81-efa176711c3d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:16.691177 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68889ea3-2f7c-460d-b654-66b511de8489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:16.692756 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68889ea3-2f7c-460d-b654-66b511de8489 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:16.693199 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68889ea3-2f7c-460d-b654-66b511de8489 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:16.693659 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68889ea3-2f7c-460d-b654-66b511de8489 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:16.694823 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68889ea3-2f7c-460d-b654-66b511de8489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:16.696689 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68889ea3-2f7c-460d-b654-66b511de8489 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:16.719250 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1434/2885] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:41:16.722813 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef6b2d-3957-4923-8dfc-9c9a0eb0ca94 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:16.733027 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef6b2d-3957-4923-8dfc-9c9a0eb0ca94 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:16.738072 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5165e9b4-4edf-4a1f-9586-29bd93d6d953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:16.738671 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165e9b4-4edf-4a1f-9586-29bd93d6d953 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:16.738986 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165e9b4-4edf-4a1f-9586-29bd93d6d953 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:16.743165 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165e9b4-4edf-4a1f-9586-29bd93d6d953 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:16.743165 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5165e9b4-4edf-4a1f-9586-29bd93d6d953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:16.743165 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5165e9b4-4edf-4a1f-9586-29bd93d6d953 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:16.753110 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1452/2886] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:41:16.758368 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68889ea3-2f7c-460d-b654-66b511de8489 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:16.770917 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68889ea3-2f7c-460d-b654-66b511de8489 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:16.776845 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da5ce3-9331-44b7-9e22-dab97404a1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:16.777906 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da5ce3-9331-44b7-9e22-dab97404a1ae admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:16.778291 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da5ce3-9331-44b7-9e22-dab97404a1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:16.778803 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da5ce3-9331-44b7-9e22-dab97404a1ae admin admin] PATH_INFO: `/v3/projects/f6f4058c4a9b420dbdbe5658e3885ea0/users/99687f484fd745c68f95d11c7e8fd976/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:16.794450 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1da5ce3-9331-44b7-9e22-dab97404a1ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6f4058c4a9b420dbdbe5658e3885ea0, user_id=99687f484fd745c68f95d11c7e8fd976, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:16.797415 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1da5ce3-9331-44b7-9e22-dab97404a1ae admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:16.812623 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1435/2887] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:41:16 2022] PUT /identity/v3/projects/f6f4058c4a9b420dbdbe5658e3885ea0/users/99687f484fd745c68f95d11c7e8fd976/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:16.819666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7abdc-8d00-4c15-8553-15cb5f87c30a None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:16.820815 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7abdc-8d00-4c15-8553-15cb5f87c30a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:16.821637 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7abdc-8d00-4c15-8553-15cb5f87c30a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:16.844473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-d5f7abdc-8d00-4c15-8553-15cb5f87c30a None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:16.845712 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d5f7abdc-8d00-4c15-8553-15cb5f87c30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:16.952649 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1453/2888] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:41:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:16.960972 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da5ce3-9331-44b7-9e22-dab97404a1ae admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:16.963517 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c1da5ce3-9331-44b7-9e22-dab97404a1ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:17.108902 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da5ce3-9331-44b7-9e22-dab97404a1ae admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:17.113140 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e90473-692d-411d-8482-7ac131745e8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:17.114423 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e90473-692d-411d-8482-7ac131745e8d service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:17.114858 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e90473-692d-411d-8482-7ac131745e8d service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:17.115235 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e90473-692d-411d-8482-7ac131745e8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:17.137490 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e90473-692d-411d-8482-7ac131745e8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:17.139439 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e90473-692d-411d-8482-7ac131745e8d service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:17.151599 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1436/2889] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:41:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:41:19.217712 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747c09e-1eb8-439e-bf63-1b8b4463a77f None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:19.218245 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747c09e-1eb8-439e-bf63-1b8b4463a77f None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:19.218740 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747c09e-1eb8-439e-bf63-1b8b4463a77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:19.253674 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-c747c09e-1eb8-439e-bf63-1b8b4463a77f None None] MFA Rules not processed for user `65a196bbedec4627be79cc71193843d8`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:19.254973 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c747c09e-1eb8-439e-bf63-1b8b4463a77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:19.391498 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1454/2890] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:41:19 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:19.403831 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e90473-692d-411d-8482-7ac131745e8d service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:19.405460 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-75e90473-692d-411d-8482-7ac131745e8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:19.574593 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e90473-692d-411d-8482-7ac131745e8d service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:19.585584 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9733bb24-1092-434b-aa2e-eb3c3f5f20ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:19.586755 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733bb24-1092-434b-aa2e-eb3c3f5f20ed service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:19.586755 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733bb24-1092-434b-aa2e-eb3c3f5f20ed service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:19.586755 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733bb24-1092-434b-aa2e-eb3c3f5f20ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:19.600215 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9733bb24-1092-434b-aa2e-eb3c3f5f20ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:19.602522 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9733bb24-1092-434b-aa2e-eb3c3f5f20ed service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:19.627243 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1437/2891] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:41:19 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:41:26.049013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f05801-6649-41ba-b132-d93adba5088c None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:26.049451 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f05801-6649-41ba-b132-d93adba5088c None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:26.049570 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f05801-6649-41ba-b132-d93adba5088c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:26.114741 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-24f05801-6649-41ba-b132-d93adba5088c None None] MFA Rules not processed for user `99687f484fd745c68f95d11c7e8fd976`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:26.116062 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-24f05801-6649-41ba-b132-d93adba5088c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:26.127385 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:26.219223 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1455/2892] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:41:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:26.279691 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79bb77-0d48-40d2-b4f1-71d2c146d3ef None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:26.280263 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79bb77-0d48-40d2-b4f1-71d2c146d3ef None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:26.280263 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79bb77-0d48-40d2-b4f1-71d2c146d3ef None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:26.281769 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1438/2893] 10.222.0.83 () {54 vars in 921 bytes} [Mon Aug 29 15:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:41:26.320652 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4188cb1-7118-42ef-b52c-14e5f360c986 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:26.320936 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4188cb1-7118-42ef-b52c-14e5f360c986 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:26.321224 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4188cb1-7118-42ef-b52c-14e5f360c986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:26.361383 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-c4188cb1-7118-42ef-b52c-14e5f360c986 None None] MFA Rules not processed for user `c190fa4a280c41c684130e069bee99eb`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:26.365870 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c4188cb1-7118-42ef-b52c-14e5f360c986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:26.382799 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79bb77-0d48-40d2-b4f1-71d2c146d3ef None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:26.384625 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-bb79bb77-0d48-40d2-b4f1-71d2c146d3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:26.416081 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79bb77-0d48-40d2-b4f1-71d2c146d3ef None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:26.423548 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edda369-c951-4e39-ae63-413082ca5b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:26.426486 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edda369-c951-4e39-ae63-413082ca5b7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:26.427124 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edda369-c951-4e39-ae63-413082ca5b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:26.428534 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edda369-c951-4e39-ae63-413082ca5b7e admin admin] PATH_INFO: `/v3/users/65a196bbedec4627be79cc71193843d8` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:26.432257 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edda369-c951-4e39-ae63-413082ca5b7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=65a196bbedec4627be79cc71193843d8)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:26.434993 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edda369-c951-4e39-ae63-413082ca5b7e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:26.482008 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:26.542667 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8edda369-c951-4e39-ae63-413082ca5b7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65a196bbedec4627be79cc71193843d8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:26.544283 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8edda369-c951-4e39-ae63-413082ca5b7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65a196bbedec4627be79cc71193843d8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:26.558348 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8edda369-c951-4e39-ae63-413082ca5b7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65a196bbedec4627be79cc71193843d8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:26.563650 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1456/2894] 10.222.0.83 () {58 vars in 1018 bytes} [Mon Aug 29 15:41:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:26.564815 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4188cb1-7118-42ef-b52c-14e5f360c986 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:26.569804 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8edda369-c951-4e39-ae63-413082ca5b7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65a196bbedec4627be79cc71193843d8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:26.570618 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8edda369-c951-4e39-ae63-413082ca5b7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65a196bbedec4627be79cc71193843d8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:26.593899 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4188cb1-7118-42ef-b52c-14e5f360c986 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:26.603737 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1439/2895] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:41:26 2022] DELETE /identity/v3/users/65a196bbedec4627be79cc71193843d8 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:26.603737 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edda369-c951-4e39-ae63-413082ca5b7e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:26.603737 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8edda369-c951-4e39-ae63-413082ca5b7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:26.606669 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aeefc7-d5af-4f74-867a-3b315f6cea25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:26.608862 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aeefc7-d5af-4f74-867a-3b315f6cea25 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:26.609208 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aeefc7-d5af-4f74-867a-3b315f6cea25 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:26.609544 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aeefc7-d5af-4f74-867a-3b315f6cea25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:26.612279 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-60aeefc7-d5af-4f74-867a-3b315f6cea25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:26.634886 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aeefc7-d5af-4f74-867a-3b315f6cea25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:26.636899 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aeefc7-d5af-4f74-867a-3b315f6cea25 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:26.649391 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1457/2896] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:41:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:41:26.766209 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edda369-c951-4e39-ae63-413082ca5b7e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:26.773402 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab02189-4a53-4a63-a19a-ce64476ed8fc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:26.779945 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab02189-4a53-4a63-a19a-ce64476ed8fc service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:26.780287 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab02189-4a53-4a63-a19a-ce64476ed8fc service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:26.780568 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab02189-4a53-4a63-a19a-ce64476ed8fc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:26.782664 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-aab02189-4a53-4a63-a19a-ce64476ed8fc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:26.816239 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab02189-4a53-4a63-a19a-ce64476ed8fc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:26.819890 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab02189-4a53-4a63-a19a-ce64476ed8fc service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:26.833593 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1440/2897] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:41:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:41:27.040277 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aeefc7-d5af-4f74-867a-3b315f6cea25 service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:27.041523 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-60aeefc7-d5af-4f74-867a-3b315f6cea25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:27.060161 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aeefc7-d5af-4f74-867a-3b315f6cea25 service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:27.167543 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b98cc8-7aee-469d-875f-4df836a2ebca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:27.168464 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b98cc8-7aee-469d-875f-4df836a2ebca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:27.168924 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b98cc8-7aee-469d-875f-4df836a2ebca admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:27.169371 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b98cc8-7aee-469d-875f-4df836a2ebca admin admin] PATH_INFO: `/v3/projects/f9db9f6ebf0b495a8bb1f85dc8fad7be` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:27.170786 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b98cc8-7aee-469d-875f-4df836a2ebca admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9db9f6ebf0b495a8bb1f85dc8fad7be)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:27.172965 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b98cc8-7aee-469d-875f-4df836a2ebca admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:27.250989 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:27.289304 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d0b98cc8-7aee-469d-875f-4df836a2ebca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9db9f6ebf0b495a8bb1f85dc8fad7be', 'request_id': 'req-d0b98cc8-7aee-469d-875f-4df836a2ebca'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:27.304537 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d0b98cc8-7aee-469d-875f-4df836a2ebca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9db9f6ebf0b495a8bb1f85dc8fad7be', 'request_id': 'req-d0b98cc8-7aee-469d-875f-4df836a2ebca'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:27.319817 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d0b98cc8-7aee-469d-875f-4df836a2ebca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9db9f6ebf0b495a8bb1f85dc8fad7be', 'request_id': 'req-d0b98cc8-7aee-469d-875f-4df836a2ebca'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:27.370989 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d0b98cc8-7aee-469d-875f-4df836a2ebca admin admin] The token cache is being invalidate because project f9db9f6ebf0b495a8bb1f85dc8fad7be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:41:27.371467 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d0b98cc8-7aee-469d-875f-4df836a2ebca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:27.372429 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d0b98cc8-7aee-469d-875f-4df836a2ebca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:27.375148 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1458/2898] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:41:27 2022] DELETE /identity/v3/projects/f9db9f6ebf0b495a8bb1f85dc8fad7be => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:27.380525 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bdc08-8276-419b-a3c6-83151b152e69 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:27.381007 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bdc08-8276-419b-a3c6-83151b152e69 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:27.381533 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bdc08-8276-419b-a3c6-83151b152e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:27.444238 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-650bdc08-8276-419b-a3c6-83151b152e69 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:27.445737 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-650bdc08-8276-419b-a3c6-83151b152e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:27.595087 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1441/2899] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:41:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:27.598048 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07575c-c4fd-45f0-865c-868748c6624d None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:27.598942 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07575c-c4fd-45f0-865c-868748c6624d None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:27.599552 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07575c-c4fd-45f0-865c-868748c6624d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:27.640792 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-7c07575c-c4fd-45f0-865c-868748c6624d None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:27.644166 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7c07575c-c4fd-45f0-865c-868748c6624d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:27.669857 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1459/2900] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:41:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:27.671112 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650bdc08-8276-419b-a3c6-83151b152e69 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:27.688650 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650bdc08-8276-419b-a3c6-83151b152e69 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:27.706777 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625aa8b4-7d2e-46ef-843d-8a2c70ab22d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:27.707547 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625aa8b4-7d2e-46ef-843d-8a2c70ab22d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:27.707872 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625aa8b4-7d2e-46ef-843d-8a2c70ab22d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:27.708751 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625aa8b4-7d2e-46ef-843d-8a2c70ab22d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:27.709550 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625aa8b4-7d2e-46ef-843d-8a2c70ab22d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:41:27.709862 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625aa8b4-7d2e-46ef-843d-8a2c70ab22d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:27.713970 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625aa8b4-7d2e-46ef-843d-8a2c70ab22d5 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:27.749991 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1442/2901] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:41:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:41:27.754028 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c07575c-c4fd-45f0-865c-868748c6624d None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:27.770374 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c07575c-c4fd-45f0-865c-868748c6624d None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:27.788285 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa807f80-bf34-4bb0-9a7b-2654aff40a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:27.789286 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa807f80-bf34-4bb0-9a7b-2654aff40a27 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:27.789858 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa807f80-bf34-4bb0-9a7b-2654aff40a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:27.790297 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa807f80-bf34-4bb0-9a7b-2654aff40a27 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:27.791140 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa807f80-bf34-4bb0-9a7b-2654aff40a27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:27.793199 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa807f80-bf34-4bb0-9a7b-2654aff40a27 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:27.861034 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1460/2902] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:41:27 2022] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:41:27.865554 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625aa8b4-7d2e-46ef-843d-8a2c70ab22d5 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:27.882312 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625aa8b4-7d2e-46ef-843d-8a2c70ab22d5 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:27.913471 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:27.938868 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7224069-39c9-4463-b114-8f99588f013f None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:27.938868 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7224069-39c9-4463-b114-8f99588f013f None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:27.939159 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7224069-39c9-4463-b114-8f99588f013f None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:27.940825 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1461/2903] 10.222.0.83 () {54 vars in 921 bytes} [Mon Aug 29 15:41:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:41:27.956037 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc76d0c-b131-4e7a-ab3c-ff0a316e9e6a None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:27.956335 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc76d0c-b131-4e7a-ab3c-ff0a316e9e6a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:27.956585 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc76d0c-b131-4e7a-ab3c-ff0a316e9e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:27.999246 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-2bc76d0c-b131-4e7a-ab3c-ff0a316e9e6a None None] MFA Rules not processed for user `253947a5ef294d2bb828761873251bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:28.000447 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2bc76d0c-b131-4e7a-ab3c-ff0a316e9e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:28.040187 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba4f4f-eff3-4e9a-9c49-986ad39fbe5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:28.041354 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba4f4f-eff3-4e9a-9c49-986ad39fbe5e admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:28.041871 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba4f4f-eff3-4e9a-9c49-986ad39fbe5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:28.042361 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba4f4f-eff3-4e9a-9c49-986ad39fbe5e admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:28.043323 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eba4f4f-eff3-4e9a-9c49-986ad39fbe5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:28.045542 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eba4f4f-eff3-4e9a-9c49-986ad39fbe5e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:28.096293 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1443/2904] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:41:27 2022] POST /identity/v3/users => generated 290 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:41:28.097596 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba4f4f-eff3-4e9a-9c49-986ad39fbe5e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:28.114495 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba4f4f-eff3-4e9a-9c49-986ad39fbe5e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:28.121598 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd51dc0-2b52-4e05-97cf-ca257fb72097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:28.122560 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd51dc0-2b52-4e05-97cf-ca257fb72097 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:28.123100 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd51dc0-2b52-4e05-97cf-ca257fb72097 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:28.123694 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd51dc0-2b52-4e05-97cf-ca257fb72097 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:28.125263 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd51dc0-2b52-4e05-97cf-ca257fb72097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:28.127708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd51dc0-2b52-4e05-97cf-ca257fb72097 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:28.151580 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1444/2905] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:41:28.152534 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd51dc0-2b52-4e05-97cf-ca257fb72097 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:28.165616 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd51dc0-2b52-4e05-97cf-ca257fb72097 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:28.170788 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f06c29-2640-479d-b34e-c1403686fb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:28.171448 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f06c29-2640-479d-b34e-c1403686fb1d admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:28.172132 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f06c29-2640-479d-b34e-c1403686fb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:28.172419 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f06c29-2640-479d-b34e-c1403686fb1d admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:28.173535 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f06c29-2640-479d-b34e-c1403686fb1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:28.175637 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f06c29-2640-479d-b34e-c1403686fb1d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:28.196504 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1445/2906] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:41:28.197688 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f06c29-2640-479d-b34e-c1403686fb1d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:28.201080 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1462/2907] 10.222.0.83 () {58 vars in 1018 bytes} [Mon Aug 29 15:41:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:41:28.208751 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc76d0c-b131-4e7a-ab3c-ff0a316e9e6a None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:28.210279 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2bc76d0c-b131-4e7a-ab3c-ff0a316e9e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:28.211597 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f06c29-2640-479d-b34e-c1403686fb1d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:28.216958 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb6cdf-7694-4a73-b5d3-6f4a0ff62a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:28.217635 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb6cdf-7694-4a73-b5d3-6f4a0ff62a42 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:28.217915 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb6cdf-7694-4a73-b5d3-6f4a0ff62a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:28.218191 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb6cdf-7694-4a73-b5d3-6f4a0ff62a42 admin admin] PATH_INFO: `/v3/projects/96637b9e55854348add20636d3d92a85/users/cb47ac0e7edc41a59246fad43a1b5be1/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:28.244630 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cb6cdf-7694-4a73-b5d3-6f4a0ff62a42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96637b9e55854348add20636d3d92a85, user_id=cb47ac0e7edc41a59246fad43a1b5be1, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:28.250254 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cb6cdf-7694-4a73-b5d3-6f4a0ff62a42 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:28.282585 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc76d0c-b131-4e7a-ab3c-ff0a316e9e6a None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:28.290689 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1446/2908] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:41:28 2022] PUT /identity/v3/projects/96637b9e55854348add20636d3d92a85/users/cb47ac0e7edc41a59246fad43a1b5be1/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:28.362874 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9060f18-4598-4956-b7fe-8385c785c163 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:28.363215 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9060f18-4598-4956-b7fe-8385c785c163 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:28.363490 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9060f18-4598-4956-b7fe-8385c785c163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:28.375527 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:28.404751 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379dd16f-c596-4e95-8180-abdfef02d6e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:28.405669 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379dd16f-c596-4e95-8180-abdfef02d6e9 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:28.406351 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379dd16f-c596-4e95-8180-abdfef02d6e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:28.406739 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379dd16f-c596-4e95-8180-abdfef02d6e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:28.427230 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-e9060f18-4598-4956-b7fe-8385c785c163 None None] MFA Rules not processed for user `cb47ac0e7edc41a59246fad43a1b5be1`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:28.428603 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e9060f18-4598-4956-b7fe-8385c785c163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:28.559784 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379dd16f-c596-4e95-8180-abdfef02d6e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:28.562120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379dd16f-c596-4e95-8180-abdfef02d6e9 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:28.567540 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1447/2909] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:41:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:41:28.567540 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9060f18-4598-4956-b7fe-8385c785c163 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:28.571538 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e9060f18-4598-4956-b7fe-8385c785c163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:28.596939 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1463/2910] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:41:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:41:28.684535 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:28.691059 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9060f18-4598-4956-b7fe-8385c785c163 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:28.708043 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887b60e-fbf1-4d65-b34c-c9b477b4df6d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6b0f9835ed549cab91d684326be83fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:28.708175 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887b60e-fbf1-4d65-b34c-c9b477b4df6d service glance] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:28.708665 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887b60e-fbf1-4d65-b34c-c9b477b4df6d service glance] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:28.708819 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887b60e-fbf1-4d65-b34c-c9b477b4df6d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:28.740738 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2887b60e-fbf1-4d65-b34c-c9b477b4df6d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:28.755671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2887b60e-fbf1-4d65-b34c-c9b477b4df6d service glance] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:28.765572 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1448/2911] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:41:28 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:41:29.053243 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbcdb2-8a47-42c4-a635-0818c80b9db0 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:29.053461 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbcdb2-8a47-42c4-a635-0818c80b9db0 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:29.053692 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbcdb2-8a47-42c4-a635-0818c80b9db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:29.077130 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-4cfbcdb2-8a47-42c4-a635-0818c80b9db0 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:29.078640 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4cfbcdb2-8a47-42c4-a635-0818c80b9db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:29.201635 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1464/2912] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 15:41:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:29.227003 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887b60e-fbf1-4d65-b34c-c9b477b4df6d service glance] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:29.228460 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2887b60e-fbf1-4d65-b34c-c9b477b4df6d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:29.337745 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887b60e-fbf1-4d65-b34c-c9b477b4df6d service glance] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:29.345754 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507fbab2-395e-43af-b241-4ffa73ff981a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:29.346413 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507fbab2-395e-43af-b241-4ffa73ff981a service swift] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:29.346821 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507fbab2-395e-43af-b241-4ffa73ff981a service swift] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:29.348437 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507fbab2-395e-43af-b241-4ffa73ff981a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:29.364520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507fbab2-395e-43af-b241-4ffa73ff981a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:29.366888 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507fbab2-395e-43af-b241-4ffa73ff981a service swift] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:29.391325 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1449/2913] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 15:41:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:41:33.029177 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfbcdb2-8a47-42c4-a635-0818c80b9db0 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:33.030680 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4cfbcdb2-8a47-42c4-a635-0818c80b9db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:33.155875 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfbcdb2-8a47-42c4-a635-0818c80b9db0 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:33.164265 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0277210-afc8-46bf-987a-944d9d6799b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:33.165111 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0277210-afc8-46bf-987a-944d9d6799b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:33.165546 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0277210-afc8-46bf-987a-944d9d6799b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:33.165972 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0277210-afc8-46bf-987a-944d9d6799b0 admin admin] PATH_INFO: `/v3/users/cd46d7afd06f41c2a09132a349aa3fd4` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:33.167654 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0277210-afc8-46bf-987a-944d9d6799b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd46d7afd06f41c2a09132a349aa3fd4)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:33.170366 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0277210-afc8-46bf-987a-944d9d6799b0 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:33.229142 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:33.304518 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a0277210-afc8-46bf-987a-944d9d6799b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd46d7afd06f41c2a09132a349aa3fd4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:33.307682 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a0277210-afc8-46bf-987a-944d9d6799b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd46d7afd06f41c2a09132a349aa3fd4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:33.355415 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a0277210-afc8-46bf-987a-944d9d6799b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd46d7afd06f41c2a09132a349aa3fd4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:33.374639 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a0277210-afc8-46bf-987a-944d9d6799b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd46d7afd06f41c2a09132a349aa3fd4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:33.399899 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a0277210-afc8-46bf-987a-944d9d6799b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd46d7afd06f41c2a09132a349aa3fd4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:33.419211 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1465/2914] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:41:33 2022] DELETE /identity/v3/users/cd46d7afd06f41c2a09132a349aa3fd4 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:33.424183 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76523974-3178-43a3-adb2-dd6a17c9c7a0 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:33.424712 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76523974-3178-43a3-adb2-dd6a17c9c7a0 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:33.424712 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76523974-3178-43a3-adb2-dd6a17c9c7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:33.449798 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-76523974-3178-43a3-adb2-dd6a17c9c7a0 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:33.451136 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-76523974-3178-43a3-adb2-dd6a17c9c7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:33.547638 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1450/2915] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:41:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:33.609454 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0277210-afc8-46bf-987a-944d9d6799b0 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:33.615167 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a0277210-afc8-46bf-987a-944d9d6799b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:33.791092 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0277210-afc8-46bf-987a-944d9d6799b0 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:33.801207 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e19a2f-23eb-4c4a-a67f-232732623548 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:33.803509 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e19a2f-23eb-4c4a-a67f-232732623548 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:33.803839 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e19a2f-23eb-4c4a-a67f-232732623548 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:33.804119 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e19a2f-23eb-4c4a-a67f-232732623548 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:33.841848 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e19a2f-23eb-4c4a-a67f-232732623548 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:33.844194 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e19a2f-23eb-4c4a-a67f-232732623548 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:33.889128 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1466/2916] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:41:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:41:34.340318 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76523974-3178-43a3-adb2-dd6a17c9c7a0 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:34.342368 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-76523974-3178-43a3-adb2-dd6a17c9c7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:34.378459 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76523974-3178-43a3-adb2-dd6a17c9c7a0 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:34.399808 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2fa077-56dc-419a-904a-69054c3999f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:34.400562 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2fa077-56dc-419a-904a-69054c3999f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:34.400844 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2fa077-56dc-419a-904a-69054c3999f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:34.401121 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2fa077-56dc-419a-904a-69054c3999f6 admin admin] PATH_INFO: `/v3/projects/936fa60fa7e24fd9b9014521544670dc` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:34.402773 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2fa077-56dc-419a-904a-69054c3999f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=936fa60fa7e24fd9b9014521544670dc)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:34.404744 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2fa077-56dc-419a-904a-69054c3999f6 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:34.490024 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ee2fa077-56dc-419a-904a-69054c3999f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '936fa60fa7e24fd9b9014521544670dc', 'request_id': 'req-ee2fa077-56dc-419a-904a-69054c3999f6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:34.497432 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ee2fa077-56dc-419a-904a-69054c3999f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '936fa60fa7e24fd9b9014521544670dc', 'request_id': 'req-ee2fa077-56dc-419a-904a-69054c3999f6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:34.509419 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ee2fa077-56dc-419a-904a-69054c3999f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '936fa60fa7e24fd9b9014521544670dc', 'request_id': 'req-ee2fa077-56dc-419a-904a-69054c3999f6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:34.531071 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ee2fa077-56dc-419a-904a-69054c3999f6 admin admin] The token cache is being invalidate because project 936fa60fa7e24fd9b9014521544670dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:41:34.531587 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ee2fa077-56dc-419a-904a-69054c3999f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:34.532520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ee2fa077-56dc-419a-904a-69054c3999f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:34.535135 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1451/2917] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:41:34 2022] DELETE /identity/v3/projects/936fa60fa7e24fd9b9014521544670dc => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:34.541117 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e19a2f-23eb-4c4a-a67f-232732623548 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:34.554399 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e19a2f-23eb-4c4a-a67f-232732623548 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:34.657340 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70dd4e1-d5c0-454b-9ff0-ac209417181b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:34.657340 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70dd4e1-d5c0-454b-9ff0-ac209417181b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:34.657340 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70dd4e1-d5c0-454b-9ff0-ac209417181b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:34.657739 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70dd4e1-d5c0-454b-9ff0-ac209417181b admin admin] PATH_INFO: `/v3/users/b707e515afc149219025d224fe1df8e0` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:34.659055 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70dd4e1-d5c0-454b-9ff0-ac209417181b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b707e515afc149219025d224fe1df8e0)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:34.661831 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70dd4e1-d5c0-454b-9ff0-ac209417181b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:34.775310 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d70dd4e1-d5c0-454b-9ff0-ac209417181b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b707e515afc149219025d224fe1df8e0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:34.777163 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d70dd4e1-d5c0-454b-9ff0-ac209417181b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b707e515afc149219025d224fe1df8e0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:34.788737 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:34.814468 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d70dd4e1-d5c0-454b-9ff0-ac209417181b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b707e515afc149219025d224fe1df8e0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:34.836835 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d70dd4e1-d5c0-454b-9ff0-ac209417181b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b707e515afc149219025d224fe1df8e0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:34.853290 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d70dd4e1-d5c0-454b-9ff0-ac209417181b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b707e515afc149219025d224fe1df8e0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:34.861430 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1467/2918] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:41:34 2022] DELETE /identity/v3/users/b707e515afc149219025d224fe1df8e0 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:35.094869 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2fa077-56dc-419a-904a-69054c3999f6 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:35.096545 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ee2fa077-56dc-419a-904a-69054c3999f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:35.115359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:35.126042 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2fa077-56dc-419a-904a-69054c3999f6 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:35.202156 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44374f49-af7d-43bd-97c1-12bf00dce1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:35.202289 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44374f49-af7d-43bd-97c1-12bf00dce1b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:35.202472 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44374f49-af7d-43bd-97c1-12bf00dce1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:35.202877 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44374f49-af7d-43bd-97c1-12bf00dce1b6 admin admin] PATH_INFO: `/v3/projects/b85774c4058e41039e37bf970208d1df` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:35.204465 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44374f49-af7d-43bd-97c1-12bf00dce1b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b85774c4058e41039e37bf970208d1df)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:35.206252 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44374f49-af7d-43bd-97c1-12bf00dce1b6 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:35.299507 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-44374f49-af7d-43bd-97c1-12bf00dce1b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b85774c4058e41039e37bf970208d1df', 'request_id': 'req-44374f49-af7d-43bd-97c1-12bf00dce1b6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:35.305383 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-44374f49-af7d-43bd-97c1-12bf00dce1b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b85774c4058e41039e37bf970208d1df', 'request_id': 'req-44374f49-af7d-43bd-97c1-12bf00dce1b6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:35.314275 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-44374f49-af7d-43bd-97c1-12bf00dce1b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b85774c4058e41039e37bf970208d1df', 'request_id': 'req-44374f49-af7d-43bd-97c1-12bf00dce1b6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:35.330362 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-44374f49-af7d-43bd-97c1-12bf00dce1b6 admin admin] The token cache is being invalidate because project b85774c4058e41039e37bf970208d1df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:41:35.330803 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-44374f49-af7d-43bd-97c1-12bf00dce1b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:35.332071 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-44374f49-af7d-43bd-97c1-12bf00dce1b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:35.335464 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1452/2919] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:41:35 2022] DELETE /identity/v3/projects/b85774c4058e41039e37bf970208d1df => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:41:35.341259 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6aeb8-7a0b-4bdc-bab8-579a71f503a0 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:35.341567 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6aeb8-7a0b-4bdc-bab8-579a71f503a0 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:35.341861 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6aeb8-7a0b-4bdc-bab8-579a71f503a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:35.362183 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-e8e6aeb8-7a0b-4bdc-bab8-579a71f503a0 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:35.363427 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e8e6aeb8-7a0b-4bdc-bab8-579a71f503a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:35.439065 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1468/2920] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:41:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:41:35.445273 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fd1a2-26be-4cb9-b731-1fc6421c11ab None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:35.445583 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fd1a2-26be-4cb9-b731-1fc6421c11ab None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:35.445834 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fd1a2-26be-4cb9-b731-1fc6421c11ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:35.472413 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-6a0fd1a2-26be-4cb9-b731-1fc6421c11ab None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:35.473947 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6a0fd1a2-26be-4cb9-b731-1fc6421c11ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:35.483738 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1453/2921] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:41:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:35.487622 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6aeb8-7a0b-4bdc-bab8-579a71f503a0 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:35.500240 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6aeb8-7a0b-4bdc-bab8-579a71f503a0 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:35.508252 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f4fe3-e1d4-439d-84b9-47f54e60893d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:35.508959 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f4fe3-e1d4-439d-84b9-47f54e60893d admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:35.509317 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f4fe3-e1d4-439d-84b9-47f54e60893d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:35.509650 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f4fe3-e1d4-439d-84b9-47f54e60893d admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:35.510759 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4f4fe3-e1d4-439d-84b9-47f54e60893d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:41:35.511175 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4f4fe3-e1d4-439d-84b9-47f54e60893d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:35.513127 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4f4fe3-e1d4-439d-84b9-47f54e60893d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:35.534676 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1469/2922] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:41:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:41:35.534891 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0fd1a2-26be-4cb9-b731-1fc6421c11ab None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:35.549305 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0fd1a2-26be-4cb9-b731-1fc6421c11ab None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:35.556542 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72bbc63-27f2-4ffe-966a-7ea66472fcb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:35.557538 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bbc63-27f2-4ffe-966a-7ea66472fcb7 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:35.558058 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bbc63-27f2-4ffe-966a-7ea66472fcb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:35.558489 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bbc63-27f2-4ffe-966a-7ea66472fcb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:35.559453 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72bbc63-27f2-4ffe-966a-7ea66472fcb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:35.561870 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72bbc63-27f2-4ffe-966a-7ea66472fcb7 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:35.618210 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1454/2923] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:41:35 2022] POST /identity/v3/projects => generated 393 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:41:35.622771 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f4fe3-e1d4-439d-84b9-47f54e60893d admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:35.637708 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f4fe3-e1d4-439d-84b9-47f54e60893d admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:35.763417 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8161a-b40b-45b5-be64-548e92337578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:35.764144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8161a-b40b-45b5-be64-548e92337578 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:35.764429 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8161a-b40b-45b5-be64-548e92337578 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:35.764701 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8161a-b40b-45b5-be64-548e92337578 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:35.765342 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc8161a-b40b-45b5-be64-548e92337578 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:35.768032 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc8161a-b40b-45b5-be64-548e92337578 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:35.804909 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1470/2924] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:41:35 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:41:35.805444 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72bbc63-27f2-4ffe-966a-7ea66472fcb7 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:35.825908 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72bbc63-27f2-4ffe-966a-7ea66472fcb7 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:35.834517 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c8c83-213d-4f5e-975c-9fddd6f280d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:35.837891 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c8c83-213d-4f5e-975c-9fddd6f280d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:35.838392 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c8c83-213d-4f5e-975c-9fddd6f280d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:35.838881 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c8c83-213d-4f5e-975c-9fddd6f280d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:35.839977 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c8c83-213d-4f5e-975c-9fddd6f280d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:35.843288 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c8c83-213d-4f5e-975c-9fddd6f280d1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:35.866058 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1455/2925] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:41:35.870007 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8161a-b40b-45b5-be64-548e92337578 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:35.885229 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8161a-b40b-45b5-be64-548e92337578 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:35.909218 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd72a62-a173-487b-a6ce-bc0909306123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:35.917638 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd72a62-a173-487b-a6ce-bc0909306123 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:35.917638 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd72a62-a173-487b-a6ce-bc0909306123 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:35.917638 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd72a62-a173-487b-a6ce-bc0909306123 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:35.917638 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd72a62-a173-487b-a6ce-bc0909306123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:35.917638 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd72a62-a173-487b-a6ce-bc0909306123 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:35.934328 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1471/2926] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:41:35.938538 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c8c83-213d-4f5e-975c-9fddd6f280d1 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:35.949372 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c8c83-213d-4f5e-975c-9fddd6f280d1 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:35.955227 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a19f1-28d4-426f-975c-2c4123a0abb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:35.956325 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a19f1-28d4-426f-975c-2c4123a0abb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:35.956811 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a19f1-28d4-426f-975c-2c4123a0abb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:35.957284 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a19f1-28d4-426f-975c-2c4123a0abb7 admin admin] PATH_INFO: `/v3/projects/84a0d6189dd04531b9124e4e7d8eb2c6/users/60f6fe3ed2af4f6a944b314b2e0bc21b/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:35.975862 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a19f1-28d4-426f-975c-2c4123a0abb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84a0d6189dd04531b9124e4e7d8eb2c6, user_id=60f6fe3ed2af4f6a944b314b2e0bc21b, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:35.979252 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a19f1-28d4-426f-975c-2c4123a0abb7 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:35.994847 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1456/2927] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:41:35 2022] PUT /identity/v3/projects/84a0d6189dd04531b9124e4e7d8eb2c6/users/60f6fe3ed2af4f6a944b314b2e0bc21b/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:41:36.006145 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6a493-7eab-487c-804d-338975aca489 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:36.006397 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6a493-7eab-487c-804d-338975aca489 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:36.006693 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6a493-7eab-487c-804d-338975aca489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:36.084555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-9af6a493-7eab-487c-804d-338975aca489 None None] MFA Rules not processed for user `60f6fe3ed2af4f6a944b314b2e0bc21b`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:36.085786 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9af6a493-7eab-487c-804d-338975aca489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:36.121144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:36.184586 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1472/2928] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:41:36 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:36.191078 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a19f1-28d4-426f-975c-2c4123a0abb7 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:36.272075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:36.331470 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a19f1-28d4-426f-975c-2c4123a0abb7 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:36.337513 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7c770-bb69-40c9-912b-a1806683cfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:36.338694 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7c770-bb69-40c9-912b-a1806683cfc4 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:36.338975 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7c770-bb69-40c9-912b-a1806683cfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:36.339410 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7c770-bb69-40c9-912b-a1806683cfc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:36.340057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b7c770-bb69-40c9-912b-a1806683cfc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:36.342150 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b7c770-bb69-40c9-912b-a1806683cfc4 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:36.382661 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1457/2929] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:41:36 2022] POST /identity/v3/projects => generated 393 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:41:36.386674 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6a493-7eab-487c-804d-338975aca489 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:36.400629 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6a493-7eab-487c-804d-338975aca489 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:36.523890 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8e28e0-b742-4124-a115-4e5ed1fdb024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:36.524631 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e28e0-b742-4124-a115-4e5ed1fdb024 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:36.525005 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e28e0-b742-4124-a115-4e5ed1fdb024 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:36.525390 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e28e0-b742-4124-a115-4e5ed1fdb024 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:36.526848 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8e28e0-b742-4124-a115-4e5ed1fdb024 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:36.529622 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8e28e0-b742-4124-a115-4e5ed1fdb024 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:36.572359 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1473/2930] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:41:36 2022] POST /identity/v3/users => generated 303 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:41:36.578043 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7c770-bb69-40c9-912b-a1806683cfc4 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:36.594467 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7c770-bb69-40c9-912b-a1806683cfc4 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:36.605907 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a8cac2-8583-4e66-b27c-3ff3e7834d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:36.607116 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8cac2-8583-4e66-b27c-3ff3e7834d7d admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:36.607402 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8cac2-8583-4e66-b27c-3ff3e7834d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:36.607676 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8cac2-8583-4e66-b27c-3ff3e7834d7d admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:36.608626 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a8cac2-8583-4e66-b27c-3ff3e7834d7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:36.609923 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a8cac2-8583-4e66-b27c-3ff3e7834d7d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:36.639108 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1458/2931] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:41:36.642866 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8e28e0-b742-4124-a115-4e5ed1fdb024 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:36.658083 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8e28e0-b742-4124-a115-4e5ed1fdb024 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:36.670678 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a1e75-e3b7-4aa1-a0b9-a448fd3e0559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:36.671691 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a1e75-e3b7-4aa1-a0b9-a448fd3e0559 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:36.672123 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a1e75-e3b7-4aa1-a0b9-a448fd3e0559 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:36.672545 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a1e75-e3b7-4aa1-a0b9-a448fd3e0559 admin admin] PATH_INFO: `/v3/projects/d0ac8a1324c848a19548e9f85a9409de/users/8d7add98a1d34a41a0d3018f2ed80ff9/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:36.704070 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70a1e75-e3b7-4aa1-a0b9-a448fd3e0559 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0ac8a1324c848a19548e9f85a9409de, user_id=8d7add98a1d34a41a0d3018f2ed80ff9, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:36.720304 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70a1e75-e3b7-4aa1-a0b9-a448fd3e0559 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:36.760502 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1474/2932] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:41:36 2022] PUT /identity/v3/projects/d0ac8a1324c848a19548e9f85a9409de/users/8d7add98a1d34a41a0d3018f2ed80ff9/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:36.764625 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a8cac2-8583-4e66-b27c-3ff3e7834d7d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:36.798890 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a8cac2-8583-4e66-b27c-3ff3e7834d7d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:36.937101 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc1581b-5773-409a-b2f6-ce2a5cd1d4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:36.938062 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1581b-5773-409a-b2f6-ce2a5cd1d4bd admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:36.938701 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1581b-5773-409a-b2f6-ce2a5cd1d4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:36.939189 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1581b-5773-409a-b2f6-ce2a5cd1d4bd admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:36.940744 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc1581b-5773-409a-b2f6-ce2a5cd1d4bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:36.943658 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc1581b-5773-409a-b2f6-ce2a5cd1d4bd admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:36.961844 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1459/2933] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:41:36.965683 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a1e75-e3b7-4aa1-a0b9-a448fd3e0559 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:36.984818 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a1e75-e3b7-4aa1-a0b9-a448fd3e0559 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:36.993431 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f56ab-620d-4f38-8788-514022c89636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:36.994111 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f56ab-620d-4f38-8788-514022c89636 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:36.994387 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f56ab-620d-4f38-8788-514022c89636 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:36.994654 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f56ab-620d-4f38-8788-514022c89636 admin admin] PATH_INFO: `/v3/projects/d0ac8a1324c848a19548e9f85a9409de/users/8d7add98a1d34a41a0d3018f2ed80ff9/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:37.001975 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f56ab-620d-4f38-8788-514022c89636 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0ac8a1324c848a19548e9f85a9409de, user_id=8d7add98a1d34a41a0d3018f2ed80ff9, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:37.005306 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f56ab-620d-4f38-8788-514022c89636 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:37.036823 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1475/2934] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:41:36 2022] PUT /identity/v3/projects/d0ac8a1324c848a19548e9f85a9409de/users/8d7add98a1d34a41a0d3018f2ed80ff9/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:37.047263 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107768aa-098d-4b8b-b53c-625f7e9e6bcb None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:37.047424 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107768aa-098d-4b8b-b53c-625f7e9e6bcb None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:37.047646 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107768aa-098d-4b8b-b53c-625f7e9e6bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:37.077835 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-107768aa-098d-4b8b-b53c-625f7e9e6bcb None None] MFA Rules not processed for user `8d7add98a1d34a41a0d3018f2ed80ff9`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:37.079076 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-107768aa-098d-4b8b-b53c-625f7e9e6bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:37.166016 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1460/2935] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:41:37 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:37.329356 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f56ab-620d-4f38-8788-514022c89636 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:37.331276 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-075f56ab-620d-4f38-8788-514022c89636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:37.444430 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f56ab-620d-4f38-8788-514022c89636 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:37.450961 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77229ca-7b03-4e73-af07-7e1f2aea5b86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:37.451737 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77229ca-7b03-4e73-af07-7e1f2aea5b86 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:37.452015 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77229ca-7b03-4e73-af07-7e1f2aea5b86 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:37.452288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77229ca-7b03-4e73-af07-7e1f2aea5b86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:37.464234 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77229ca-7b03-4e73-af07-7e1f2aea5b86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:37.466813 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77229ca-7b03-4e73-af07-7e1f2aea5b86 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:37.488634 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1476/2936] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:41:37 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:41:37.774075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107768aa-098d-4b8b-b53c-625f7e9e6bcb None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:37.788529 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107768aa-098d-4b8b-b53c-625f7e9e6bcb None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:37.796269 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f612a-f59a-4804-8d32-abdb4271e6cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:37.797175 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f612a-f59a-4804-8d32-abdb4271e6cf service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:37.797293 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f32006-042d-4969-9d78-14f0d7d27177 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:37.797734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f32006-042d-4969-9d78-14f0d7d27177 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:37.797734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f32006-042d-4969-9d78-14f0d7d27177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:37.798816 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f612a-f59a-4804-8d32-abdb4271e6cf service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:37.799332 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f612a-f59a-4804-8d32-abdb4271e6cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:37.807291 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:37.827713 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-73f32006-042d-4969-9d78-14f0d7d27177 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:37.829344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-73f32006-042d-4969-9d78-14f0d7d27177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:37.833598 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:37.898678 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4f612a-f59a-4804-8d32-abdb4271e6cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:37.900449 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1477/2937] 10.222.0.83 () {58 vars in 967 bytes} [Mon Aug 29 15:41:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:37.900581 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4f612a-f59a-4804-8d32-abdb4271e6cf service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:37.911685 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1461/2938] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:41:37 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:41:37.929290 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f32006-042d-4969-9d78-14f0d7d27177 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:37.930698 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-73f32006-042d-4969-9d78-14f0d7d27177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:37.932297 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f612a-f59a-4804-8d32-abdb4271e6cf service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:38.032228 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f612a-f59a-4804-8d32-abdb4271e6cf service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:38.037456 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafac52-ec5c-4122-a723-66bb8260116d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:38.038104 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafac52-ec5c-4122-a723-66bb8260116d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:38.038384 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafac52-ec5c-4122-a723-66bb8260116d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:38.038657 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafac52-ec5c-4122-a723-66bb8260116d admin admin] PATH_INFO: `/v3/users/60f6fe3ed2af4f6a944b314b2e0bc21b` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:38.039889 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cafac52-ec5c-4122-a723-66bb8260116d admin admin] RBAC: Authorizing `identity:delete_user(user_id=60f6fe3ed2af4f6a944b314b2e0bc21b)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:38.040960 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f32006-042d-4969-9d78-14f0d7d27177 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:38.041924 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cafac52-ec5c-4122-a723-66bb8260116d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:38.061184 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a0b69-2074-4f0d-84c3-c062bf581b15 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:38.075048 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a0b69-2074-4f0d-84c3-c062bf581b15 service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:38.075599 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a0b69-2074-4f0d-84c3-c062bf581b15 service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:38.076039 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a0b69-2074-4f0d-84c3-c062bf581b15 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:38.094860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a0b69-2074-4f0d-84c3-c062bf581b15 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:38.100558 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a0b69-2074-4f0d-84c3-c062bf581b15 service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:38.119705 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1478/2939] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 15:41:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:41:38.159350 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7cafac52-ec5c-4122-a723-66bb8260116d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60f6fe3ed2af4f6a944b314b2e0bc21b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:38.161577 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7cafac52-ec5c-4122-a723-66bb8260116d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60f6fe3ed2af4f6a944b314b2e0bc21b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:38.180993 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7cafac52-ec5c-4122-a723-66bb8260116d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60f6fe3ed2af4f6a944b314b2e0bc21b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:38.199296 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7cafac52-ec5c-4122-a723-66bb8260116d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60f6fe3ed2af4f6a944b314b2e0bc21b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:38.200069 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7cafac52-ec5c-4122-a723-66bb8260116d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60f6fe3ed2af4f6a944b314b2e0bc21b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:38.239921 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1462/2940] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:41:37 2022] DELETE /identity/v3/users/60f6fe3ed2af4f6a944b314b2e0bc21b => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:38.244332 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179588e6-9e4d-46d0-bbb0-2c703d115f5a None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:38.244566 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179588e6-9e4d-46d0-bbb0-2c703d115f5a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:38.244862 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179588e6-9e4d-46d0-bbb0-2c703d115f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:38.312665 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-179588e6-9e4d-46d0-bbb0-2c703d115f5a None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:38.314117 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-179588e6-9e4d-46d0-bbb0-2c703d115f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:38.331345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafac52-ec5c-4122-a723-66bb8260116d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:38.332883 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7cafac52-ec5c-4122-a723-66bb8260116d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:38.486390 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1479/2941] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:41:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:38.496042 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:38.508036 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179588e6-9e4d-46d0-bbb0-2c703d115f5a None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:38.509593 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-179588e6-9e4d-46d0-bbb0-2c703d115f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:38.563373 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafac52-ec5c-4122-a723-66bb8260116d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:38.586785 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:38.587158 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c048c-54fc-45f0-802b-8fcf01716997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:38.587837 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c048c-54fc-45f0-802b-8fcf01716997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:38.588119 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c048c-54fc-45f0-802b-8fcf01716997 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:38.588400 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c048c-54fc-45f0-802b-8fcf01716997 admin admin] PATH_INFO: `/v3/users/cb47ac0e7edc41a59246fad43a1b5be1` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:38.592419 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7c048c-54fc-45f0-802b-8fcf01716997 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb47ac0e7edc41a59246fad43a1b5be1)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:38.599939 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7c048c-54fc-45f0-802b-8fcf01716997 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:38.607722 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179588e6-9e4d-46d0-bbb0-2c703d115f5a None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:38.611860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0771d-7840-4737-89b9-27fbb985a0eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:38.612642 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0771d-7840-4737-89b9-27fbb985a0eb service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:38.613010 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0771d-7840-4737-89b9-27fbb985a0eb service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:38.613395 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0771d-7840-4737-89b9-27fbb985a0eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:38.624772 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf0771d-7840-4737-89b9-27fbb985a0eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:38.626773 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf0771d-7840-4737-89b9-27fbb985a0eb service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:38.639492 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1480/2942] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:41:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:41:38.680472 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-eb7c048c-54fc-45f0-802b-8fcf01716997 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb47ac0e7edc41a59246fad43a1b5be1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:38.681186 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-eb7c048c-54fc-45f0-802b-8fcf01716997 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb47ac0e7edc41a59246fad43a1b5be1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:38.721930 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-eb7c048c-54fc-45f0-802b-8fcf01716997 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb47ac0e7edc41a59246fad43a1b5be1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:38.732198 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-eb7c048c-54fc-45f0-802b-8fcf01716997 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb47ac0e7edc41a59246fad43a1b5be1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:38.733045 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-eb7c048c-54fc-45f0-802b-8fcf01716997 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb47ac0e7edc41a59246fad43a1b5be1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:38.802301 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f231c5-51f5-4e89-8298-9572fdc2ae5e None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:38.802976 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f231c5-51f5-4e89-8298-9572fdc2ae5e None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:38.802976 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f231c5-51f5-4e89-8298-9572fdc2ae5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:38.811794 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1463/2943] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:41:38 2022] DELETE /identity/v3/users/cb47ac0e7edc41a59246fad43a1b5be1 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:41:38.833653 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-97f231c5-51f5-4e89-8298-9572fdc2ae5e None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:38.835443 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-97f231c5-51f5-4e89-8298-9572fdc2ae5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:38.981296 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1481/2944] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:41:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:38.992257 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c048c-54fc-45f0-802b-8fcf01716997 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:38.994875 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-eb7c048c-54fc-45f0-802b-8fcf01716997 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:39.078070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c048c-54fc-45f0-802b-8fcf01716997 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:39.082431 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62577ca8-b379-4da7-83b7-3d727ce6ca0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:39.083210 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62577ca8-b379-4da7-83b7-3d727ce6ca0c service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:39.083832 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62577ca8-b379-4da7-83b7-3d727ce6ca0c service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:39.084090 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62577ca8-b379-4da7-83b7-3d727ce6ca0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:39.097998 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62577ca8-b379-4da7-83b7-3d727ce6ca0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:39.101054 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62577ca8-b379-4da7-83b7-3d727ce6ca0c service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:39.130282 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1464/2945] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:41:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:41:39.488339 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f231c5-51f5-4e89-8298-9572fdc2ae5e None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:39.490247 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-97f231c5-51f5-4e89-8298-9572fdc2ae5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:39.534199 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f231c5-51f5-4e89-8298-9572fdc2ae5e None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:39.541422 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c85498-7058-4a8d-84f3-12d9ca263d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:39.542139 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c85498-7058-4a8d-84f3-12d9ca263d50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:39.542615 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c85498-7058-4a8d-84f3-12d9ca263d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:39.542956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c85498-7058-4a8d-84f3-12d9ca263d50 admin admin] PATH_INFO: `/v3/projects/84a0d6189dd04531b9124e4e7d8eb2c6` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:39.544392 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c85498-7058-4a8d-84f3-12d9ca263d50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84a0d6189dd04531b9124e4e7d8eb2c6)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:39.546444 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c85498-7058-4a8d-84f3-12d9ca263d50 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:39.610708 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d1c85498-7058-4a8d-84f3-12d9ca263d50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84a0d6189dd04531b9124e4e7d8eb2c6', 'request_id': 'req-d1c85498-7058-4a8d-84f3-12d9ca263d50'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:39.636263 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d1c85498-7058-4a8d-84f3-12d9ca263d50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84a0d6189dd04531b9124e4e7d8eb2c6', 'request_id': 'req-d1c85498-7058-4a8d-84f3-12d9ca263d50'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:39.648435 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d1c85498-7058-4a8d-84f3-12d9ca263d50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84a0d6189dd04531b9124e4e7d8eb2c6', 'request_id': 'req-d1c85498-7058-4a8d-84f3-12d9ca263d50'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:39.664137 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62577ca8-b379-4da7-83b7-3d727ce6ca0c service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:39.666005 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-62577ca8-b379-4da7-83b7-3d727ce6ca0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:39.689268 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62577ca8-b379-4da7-83b7-3d727ce6ca0c service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:39.695861 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d1c85498-7058-4a8d-84f3-12d9ca263d50 admin admin] The token cache is being invalidate because project 84a0d6189dd04531b9124e4e7d8eb2c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:41:39.696082 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d1c85498-7058-4a8d-84f3-12d9ca263d50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:39.696981 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d1c85498-7058-4a8d-84f3-12d9ca263d50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:39.699072 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1482/2946] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:41:39 2022] DELETE /identity/v3/projects/84a0d6189dd04531b9124e4e7d8eb2c6 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:39.702557 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c85498-7058-4a8d-84f3-12d9ca263d50 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:39.705876 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d1c85498-7058-4a8d-84f3-12d9ca263d50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:39.788621 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739de674-9053-41ed-ab53-5b77cf9ab1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:39.789540 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739de674-9053-41ed-ab53-5b77cf9ab1d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:39.790247 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739de674-9053-41ed-ab53-5b77cf9ab1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:39.790861 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739de674-9053-41ed-ab53-5b77cf9ab1d5 admin admin] PATH_INFO: `/v3/projects/96637b9e55854348add20636d3d92a85` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:39.792081 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739de674-9053-41ed-ab53-5b77cf9ab1d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96637b9e55854348add20636d3d92a85)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:39.794198 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739de674-9053-41ed-ab53-5b77cf9ab1d5 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:39.804436 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c85498-7058-4a8d-84f3-12d9ca263d50 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:39.806048 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:39.810684 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08803dcf-6b88-4993-a723-a50684501ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:39.811437 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08803dcf-6b88-4993-a723-a50684501ee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:39.811711 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08803dcf-6b88-4993-a723-a50684501ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:39.811979 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08803dcf-6b88-4993-a723-a50684501ee6 admin admin] PATH_INFO: `/v3/users/8d7add98a1d34a41a0d3018f2ed80ff9` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:39.813244 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08803dcf-6b88-4993-a723-a50684501ee6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d7add98a1d34a41a0d3018f2ed80ff9)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:39.815711 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08803dcf-6b88-4993-a723-a50684501ee6 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:39.828203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:39.884846 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-739de674-9053-41ed-ab53-5b77cf9ab1d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96637b9e55854348add20636d3d92a85', 'request_id': 'req-739de674-9053-41ed-ab53-5b77cf9ab1d5'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:39.891008 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-739de674-9053-41ed-ab53-5b77cf9ab1d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96637b9e55854348add20636d3d92a85', 'request_id': 'req-739de674-9053-41ed-ab53-5b77cf9ab1d5'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:39.898917 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-739de674-9053-41ed-ab53-5b77cf9ab1d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96637b9e55854348add20636d3d92a85', 'request_id': 'req-739de674-9053-41ed-ab53-5b77cf9ab1d5'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:39.908082 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-08803dcf-6b88-4993-a723-a50684501ee6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d7add98a1d34a41a0d3018f2ed80ff9'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:39.909341 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-08803dcf-6b88-4993-a723-a50684501ee6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d7add98a1d34a41a0d3018f2ed80ff9'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:39.920983 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-739de674-9053-41ed-ab53-5b77cf9ab1d5 admin admin] The token cache is being invalidate because project 96637b9e55854348add20636d3d92a85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:41:39.921279 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-739de674-9053-41ed-ab53-5b77cf9ab1d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:39.922134 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-739de674-9053-41ed-ab53-5b77cf9ab1d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:39.923712 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1465/2947] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:41:39 2022] DELETE /identity/v3/projects/96637b9e55854348add20636d3d92a85 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:39.928470 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-08803dcf-6b88-4993-a723-a50684501ee6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d7add98a1d34a41a0d3018f2ed80ff9'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:39.929531 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d353c16-5471-4b0a-9569-8d52cd8ec959 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:39.929891 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d353c16-5471-4b0a-9569-8d52cd8ec959 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:39.930251 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d353c16-5471-4b0a-9569-8d52cd8ec959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:39.940527 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-08803dcf-6b88-4993-a723-a50684501ee6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d7add98a1d34a41a0d3018f2ed80ff9'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:39.954163 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-08803dcf-6b88-4993-a723-a50684501ee6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d7add98a1d34a41a0d3018f2ed80ff9'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:39.962043 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-6d353c16-5471-4b0a-9569-8d52cd8ec959 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:39.965555 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6d353c16-5471-4b0a-9569-8d52cd8ec959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:39.967104 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1483/2948] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:41:39 2022] DELETE /identity/v3/users/8d7add98a1d34a41a0d3018f2ed80ff9 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:41:40.115889 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1466/2949] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:41:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:40.117231 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fa6ab-2a7f-4330-a82c-eecfa43848a4 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:40.117611 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fa6ab-2a7f-4330-a82c-eecfa43848a4 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:40.117958 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fa6ab-2a7f-4330-a82c-eecfa43848a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:40.179157 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-d90fa6ab-2a7f-4330-a82c-eecfa43848a4 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:40.180714 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d90fa6ab-2a7f-4330-a82c-eecfa43848a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:40.205919 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1484/2950] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:41:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:40.210834 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d353c16-5471-4b0a-9569-8d52cd8ec959 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:40.245568 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d353c16-5471-4b0a-9569-8d52cd8ec959 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:40.251004 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda094d-d5d6-412f-80d6-2e23082166c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:40.251664 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda094d-d5d6-412f-80d6-2e23082166c0 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:40.251939 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda094d-d5d6-412f-80d6-2e23082166c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:40.252203 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda094d-d5d6-412f-80d6-2e23082166c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:40.252880 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda094d-d5d6-412f-80d6-2e23082166c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:41:40.253176 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda094d-d5d6-412f-80d6-2e23082166c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:40.254818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda094d-d5d6-412f-80d6-2e23082166c0 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:40.274926 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1467/2951] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:41:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:41:40.279229 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90fa6ab-2a7f-4330-a82c-eecfa43848a4 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:40.291114 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90fa6ab-2a7f-4330-a82c-eecfa43848a4 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:40.296400 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d50f1-9f8c-4a6d-9290-c4ff46e36ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:40.297252 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d50f1-9f8c-4a6d-9290-c4ff46e36ff9 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:40.297745 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d50f1-9f8c-4a6d-9290-c4ff46e36ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:40.298222 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d50f1-9f8c-4a6d-9290-c4ff46e36ff9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:40.299088 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d50f1-9f8c-4a6d-9290-c4ff46e36ff9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:40.302126 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d50f1-9f8c-4a6d-9290-c4ff46e36ff9 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:40.348381 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda094d-d5d6-412f-80d6-2e23082166c0 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:40.368466 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1485/2952] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:41:40 2022] POST /identity/v3/projects => generated 385 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:41:40.370717 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda094d-d5d6-412f-80d6-2e23082166c0 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:40.549869 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a84d6-83af-49e0-8701-50693298ee4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:40.550513 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a84d6-83af-49e0-8701-50693298ee4d admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:40.553124 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a84d6-83af-49e0-8701-50693298ee4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:40.553634 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a84d6-83af-49e0-8701-50693298ee4d admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:40.554318 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a84d6-83af-49e0-8701-50693298ee4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:40.558664 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a84d6-83af-49e0-8701-50693298ee4d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:40.614684 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1468/2953] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:41:40 2022] POST /identity/v3/users => generated 293 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:41:40.618943 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d50f1-9f8c-4a6d-9290-c4ff46e36ff9 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:40.635152 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d50f1-9f8c-4a6d-9290-c4ff46e36ff9 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:40.646590 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417ed0d-d227-41e4-b5fa-3fafcfee87f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:40.647181 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417ed0d-d227-41e4-b5fa-3fafcfee87f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:40.647459 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417ed0d-d227-41e4-b5fa-3fafcfee87f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:40.647726 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417ed0d-d227-41e4-b5fa-3fafcfee87f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:40.648390 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1417ed0d-d227-41e4-b5fa-3fafcfee87f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:40.650034 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1417ed0d-d227-41e4-b5fa-3fafcfee87f6 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:40.682421 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1486/2954] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:41:40.686437 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a84d6-83af-49e0-8701-50693298ee4d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:40.702520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a84d6-83af-49e0-8701-50693298ee4d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:40.715768 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488ab0d-25df-42fe-8bf6-97629b0d4289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:40.716828 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488ab0d-25df-42fe-8bf6-97629b0d4289 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:40.717365 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488ab0d-25df-42fe-8bf6-97629b0d4289 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:40.717743 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488ab0d-25df-42fe-8bf6-97629b0d4289 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:40.718521 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5488ab0d-25df-42fe-8bf6-97629b0d4289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:40.721664 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5488ab0d-25df-42fe-8bf6-97629b0d4289 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:40.752385 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1469/2955] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:41:40.757194 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417ed0d-d227-41e4-b5fa-3fafcfee87f6 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:40.775483 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417ed0d-d227-41e4-b5fa-3fafcfee87f6 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:40.793754 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55118bde-d6fc-4d39-a666-88c94e09a015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:40.795066 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55118bde-d6fc-4d39-a666-88c94e09a015 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:40.795377 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55118bde-d6fc-4d39-a666-88c94e09a015 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:40.795742 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55118bde-d6fc-4d39-a666-88c94e09a015 admin admin] PATH_INFO: `/v3/projects/d41e3c60ee6c4e41bb046e0e585ae41d/users/29fa4fbf7bb34c13952163feeaafe738/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:40.809956 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488ab0d-25df-42fe-8bf6-97629b0d4289 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:40.812482 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5488ab0d-25df-42fe-8bf6-97629b0d4289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:40.820024 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55118bde-d6fc-4d39-a666-88c94e09a015 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d41e3c60ee6c4e41bb046e0e585ae41d, user_id=29fa4fbf7bb34c13952163feeaafe738, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:40.823275 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55118bde-d6fc-4d39-a666-88c94e09a015 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:40.824666 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:40.839383 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488ab0d-25df-42fe-8bf6-97629b0d4289 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:40.853645 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1487/2956] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:41:40 2022] PUT /identity/v3/projects/d41e3c60ee6c4e41bb046e0e585ae41d/users/29fa4fbf7bb34c13952163feeaafe738/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:41:40.863155 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d39f22-47bf-4b02-be9a-ba6edf8a8712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:40.864073 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d39f22-47bf-4b02-be9a-ba6edf8a8712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:40.864460 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ac7dd-2fc9-4eed-afb3-b576cb56452d None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:40.865178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ac7dd-2fc9-4eed-afb3-b576cb56452d None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:40.865178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ac7dd-2fc9-4eed-afb3-b576cb56452d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:40.865544 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d39f22-47bf-4b02-be9a-ba6edf8a8712 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:40.866100 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d39f22-47bf-4b02-be9a-ba6edf8a8712 admin admin] PATH_INFO: `/v3/projects/d0ac8a1324c848a19548e9f85a9409de` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:40.867712 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d39f22-47bf-4b02-be9a-ba6edf8a8712 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0ac8a1324c848a19548e9f85a9409de)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:40.869827 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d39f22-47bf-4b02-be9a-ba6edf8a8712 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:40.920091 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-7b4ac7dd-2fc9-4eed-afb3-b576cb56452d None None] MFA Rules not processed for user `29fa4fbf7bb34c13952163feeaafe738`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:40.923329 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7b4ac7dd-2fc9-4eed-afb3-b576cb56452d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:40.981994 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c5d39f22-47bf-4b02-be9a-ba6edf8a8712 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0ac8a1324c848a19548e9f85a9409de', 'request_id': 'req-c5d39f22-47bf-4b02-be9a-ba6edf8a8712'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:40.996082 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c5d39f22-47bf-4b02-be9a-ba6edf8a8712 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0ac8a1324c848a19548e9f85a9409de', 'request_id': 'req-c5d39f22-47bf-4b02-be9a-ba6edf8a8712'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:41.003867 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c5d39f22-47bf-4b02-be9a-ba6edf8a8712 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0ac8a1324c848a19548e9f85a9409de', 'request_id': 'req-c5d39f22-47bf-4b02-be9a-ba6edf8a8712'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:41.029619 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c5d39f22-47bf-4b02-be9a-ba6edf8a8712 admin admin] The token cache is being invalidate because project d0ac8a1324c848a19548e9f85a9409de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:41:41.029928 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c5d39f22-47bf-4b02-be9a-ba6edf8a8712 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:41.030573 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c5d39f22-47bf-4b02-be9a-ba6edf8a8712 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:41.032774 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1470/2957] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:41:40 2022] DELETE /identity/v3/projects/d0ac8a1324c848a19548e9f85a9409de => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:41.040232 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f00d9-2c8b-46ab-bf03-70ef995c9559 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:41.040542 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f00d9-2c8b-46ab-bf03-70ef995c9559 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:41.040787 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f00d9-2c8b-46ab-bf03-70ef995c9559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:41.065958 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-1e1f00d9-2c8b-46ab-bf03-70ef995c9559 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:41.068147 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1e1f00d9-2c8b-46ab-bf03-70ef995c9559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:41.076934 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1488/2958] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:41:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:41.090198 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ac7dd-2fc9-4eed-afb3-b576cb56452d None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:41.092291 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7b4ac7dd-2fc9-4eed-afb3-b576cb56452d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:41.106864 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:41.162517 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1471/2959] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:41:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:41.172264 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ac7dd-2fc9-4eed-afb3-b576cb56452d None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:41.173237 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b0151-ce50-4837-a1ee-fbe3aeaced99 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:41.173537 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b0151-ce50-4837-a1ee-fbe3aeaced99 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:41.174913 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b0151-ce50-4837-a1ee-fbe3aeaced99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:41.232427 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-317b0151-ce50-4837-a1ee-fbe3aeaced99 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:41.234010 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-317b0151-ce50-4837-a1ee-fbe3aeaced99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:41.250944 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1472/2960] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:41:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:41:41.252838 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b0151-ce50-4837-a1ee-fbe3aeaced99 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:41.274650 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b84c6-a69e-48dd-8e70-4a4d9bfd1d00 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6b0f9835ed549cab91d684326be83fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:41.275318 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b84c6-a69e-48dd-8e70-4a4d9bfd1d00 service glance] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:41.275603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b84c6-a69e-48dd-8e70-4a4d9bfd1d00 service glance] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:41.275878 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b84c6-a69e-48dd-8e70-4a4d9bfd1d00 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:41.276877 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b0151-ce50-4837-a1ee-fbe3aeaced99 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:41.282273 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365af20-db74-4201-afdc-dbd334b18c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:41.283128 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365af20-db74-4201-afdc-dbd334b18c53 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:41.283474 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365af20-db74-4201-afdc-dbd334b18c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:41.283842 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365af20-db74-4201-afdc-dbd334b18c53 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:41.284596 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e365af20-db74-4201-afdc-dbd334b18c53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:41:41.285050 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e365af20-db74-4201-afdc-dbd334b18c53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:41.287650 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e365af20-db74-4201-afdc-dbd334b18c53 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:41.303918 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1473/2961] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:41:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:41:41.308336 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365af20-db74-4201-afdc-dbd334b18c53 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:41.328372 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365af20-db74-4201-afdc-dbd334b18c53 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:41.342246 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0036ea-c941-45e9-ab89-4bc48ce0d237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:41.343281 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0036ea-c941-45e9-ab89-4bc48ce0d237 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:41.343833 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0036ea-c941-45e9-ab89-4bc48ce0d237 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:41.344311 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0036ea-c941-45e9-ab89-4bc48ce0d237 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:41.345214 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0036ea-c941-45e9-ab89-4bc48ce0d237 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:41.347741 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0036ea-c941-45e9-ab89-4bc48ce0d237 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:41.395735 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b84c6-a69e-48dd-8e70-4a4d9bfd1d00 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:41.397899 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b84c6-a69e-48dd-8e70-4a4d9bfd1d00 service glance] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:41.416787 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1474/2962] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:41:41 2022] POST /identity/v3/projects => generated 371 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:41:41.422538 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1489/2963] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:41:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:41:41.423387 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0036ea-c941-45e9-ab89-4bc48ce0d237 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:41.425328 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b84c6-a69e-48dd-8e70-4a4d9bfd1d00 service glance] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:41.428242 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-cf0036ea-c941-45e9-ab89-4bc48ce0d237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:41.469252 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b84c6-a69e-48dd-8e70-4a4d9bfd1d00 service glance] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:41.528773 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:41.578931 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d1f31-c491-4da3-8ac3-f15a7cb5116c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:41.579637 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d1f31-c491-4da3-8ac3-f15a7cb5116c admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:41.580005 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d1f31-c491-4da3-8ac3-f15a7cb5116c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:41.580330 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d1f31-c491-4da3-8ac3-f15a7cb5116c admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:41.581062 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d1f31-c491-4da3-8ac3-f15a7cb5116c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:41.583441 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d1f31-c491-4da3-8ac3-f15a7cb5116c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:41.591910 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0036ea-c941-45e9-ab89-4bc48ce0d237 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:41.598372 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04496273-5847-44b7-9f66-2bd6a9f8d3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:41.599652 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04496273-5847-44b7-9f66-2bd6a9f8d3c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:41.600552 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04496273-5847-44b7-9f66-2bd6a9f8d3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:41.601129 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04496273-5847-44b7-9f66-2bd6a9f8d3c7 admin admin] PATH_INFO: `/v3/users/99687f484fd745c68f95d11c7e8fd976` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:41.603196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04496273-5847-44b7-9f66-2bd6a9f8d3c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99687f484fd745c68f95d11c7e8fd976)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:41.605914 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04496273-5847-44b7-9f66-2bd6a9f8d3c7 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:41.618831 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1490/2964] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:41:41 2022] POST /identity/v3/users => generated 286 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:41:41.620399 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d1f31-c491-4da3-8ac3-f15a7cb5116c admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:41.634261 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d1f31-c491-4da3-8ac3-f15a7cb5116c admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:41.642125 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b3e951-f7df-408d-b82d-d022099dc5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:41.643367 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3e951-f7df-408d-b82d-d022099dc5f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:41.643752 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3e951-f7df-408d-b82d-d022099dc5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:41.644389 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3e951-f7df-408d-b82d-d022099dc5f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:41.645378 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b3e951-f7df-408d-b82d-d022099dc5f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:41.647374 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b3e951-f7df-408d-b82d-d022099dc5f6 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:41.650210 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:41.664721 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1491/2965] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:41:41.668524 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b3e951-f7df-408d-b82d-d022099dc5f6 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:41.677882 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-04496273-5847-44b7-9f66-2bd6a9f8d3c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99687f484fd745c68f95d11c7e8fd976'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:41.679674 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-04496273-5847-44b7-9f66-2bd6a9f8d3c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99687f484fd745c68f95d11c7e8fd976'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:41.683663 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b3e951-f7df-408d-b82d-d022099dc5f6 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:41.690091 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1125833-b1e8-438f-989e-762cacf2e91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:41.690904 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1125833-b1e8-438f-989e-762cacf2e91e admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:41.691256 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1125833-b1e8-438f-989e-762cacf2e91e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:41.691565 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1125833-b1e8-438f-989e-762cacf2e91e admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:41.693352 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1125833-b1e8-438f-989e-762cacf2e91e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:41.694292 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-04496273-5847-44b7-9f66-2bd6a9f8d3c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99687f484fd745c68f95d11c7e8fd976'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:41.695144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1125833-b1e8-438f-989e-762cacf2e91e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:41.708491 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-04496273-5847-44b7-9f66-2bd6a9f8d3c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99687f484fd745c68f95d11c7e8fd976'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:41.709306 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-04496273-5847-44b7-9f66-2bd6a9f8d3c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99687f484fd745c68f95d11c7e8fd976'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:41.709556 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1492/2966] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:41:41.713826 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1125833-b1e8-438f-989e-762cacf2e91e admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:41.716866 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d1125833-b1e8-438f-989e-762cacf2e91e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:41.735267 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1125833-b1e8-438f-989e-762cacf2e91e admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:41.736169 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1475/2967] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:41:41 2022] DELETE /identity/v3/users/99687f484fd745c68f95d11c7e8fd976 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:41.807779 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7759c9a8-fe6b-478c-884f-4fe769f6e394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:41.808825 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759c9a8-fe6b-478c-884f-4fe769f6e394 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:41.809442 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759c9a8-fe6b-478c-884f-4fe769f6e394 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:41.809938 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759c9a8-fe6b-478c-884f-4fe769f6e394 admin admin] PATH_INFO: `/v3/projects/1a13c91fde2944479ebd577d0f33186c/users/2d670e233ef344de895a6e235adadb60/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:41.828593 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7759c9a8-fe6b-478c-884f-4fe769f6e394 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a13c91fde2944479ebd577d0f33186c, user_id=2d670e233ef344de895a6e235adadb60, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:41.833106 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7759c9a8-fe6b-478c-884f-4fe769f6e394 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:41.853676 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1493/2968] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:41:41 2022] PUT /identity/v3/projects/1a13c91fde2944479ebd577d0f33186c/users/2d670e233ef344de895a6e235adadb60/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:41:41.868330 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f50ad-4cc0-4b83-a62d-b26cbd76b450 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:41.868617 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f50ad-4cc0-4b83-a62d-b26cbd76b450 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:41.868878 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f50ad-4cc0-4b83-a62d-b26cbd76b450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:41.900732 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-614f50ad-4cc0-4b83-a62d-b26cbd76b450 None None] MFA Rules not processed for user `2d670e233ef344de895a6e235adadb60`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:41.902255 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-614f50ad-4cc0-4b83-a62d-b26cbd76b450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:41.998480 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7759c9a8-fe6b-478c-884f-4fe769f6e394 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:42.000335 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7759c9a8-fe6b-478c-884f-4fe769f6e394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:42.033315 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1476/2969] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:41:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:42.047347 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f50ad-4cc0-4b83-a62d-b26cbd76b450 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:42.049094 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-614f50ad-4cc0-4b83-a62d-b26cbd76b450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:42.110739 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7759c9a8-fe6b-478c-884f-4fe769f6e394 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:42.116522 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae687cd-1005-4faa-a59d-507787d23bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:42.117302 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae687cd-1005-4faa-a59d-507787d23bd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:42.117840 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae687cd-1005-4faa-a59d-507787d23bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:42.117840 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae687cd-1005-4faa-a59d-507787d23bd4 admin admin] PATH_INFO: `/v3/projects/f6f4058c4a9b420dbdbe5658e3885ea0` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:42.119107 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae687cd-1005-4faa-a59d-507787d23bd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6f4058c4a9b420dbdbe5658e3885ea0)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:42.119336 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:42.121129 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae687cd-1005-4faa-a59d-507787d23bd4 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:42.152024 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f50ad-4cc0-4b83-a62d-b26cbd76b450 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:42.159590 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11480be2-4267-4dba-8cf9-6f1affbab0cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:42.160498 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11480be2-4267-4dba-8cf9-6f1affbab0cb service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:42.161495 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11480be2-4267-4dba-8cf9-6f1affbab0cb service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:42.161915 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11480be2-4267-4dba-8cf9-6f1affbab0cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:42.174619 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11480be2-4267-4dba-8cf9-6f1affbab0cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:42.177519 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4ae687cd-1005-4faa-a59d-507787d23bd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6f4058c4a9b420dbdbe5658e3885ea0', 'request_id': 'req-4ae687cd-1005-4faa-a59d-507787d23bd4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:42.179831 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11480be2-4267-4dba-8cf9-6f1affbab0cb service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:42.184297 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4ae687cd-1005-4faa-a59d-507787d23bd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6f4058c4a9b420dbdbe5658e3885ea0', 'request_id': 'req-4ae687cd-1005-4faa-a59d-507787d23bd4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:42.192416 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4ae687cd-1005-4faa-a59d-507787d23bd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6f4058c4a9b420dbdbe5658e3885ea0', 'request_id': 'req-4ae687cd-1005-4faa-a59d-507787d23bd4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:42.199529 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1477/2970] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:41:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:41:42.201659 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:42.205641 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4ae687cd-1005-4faa-a59d-507787d23bd4 admin admin] The token cache is being invalidate because project f6f4058c4a9b420dbdbe5658e3885ea0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:41:42.206176 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4ae687cd-1005-4faa-a59d-507787d23bd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:42.207153 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4ae687cd-1005-4faa-a59d-507787d23bd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:42.209925 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1494/2971] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:41:41 2022] DELETE /identity/v3/projects/f6f4058c4a9b420dbdbe5658e3885ea0 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:41:42.216769 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ddcd65-5d37-41ac-a039-170f5fbd4213 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:42.217055 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ddcd65-5d37-41ac-a039-170f5fbd4213 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:42.217329 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ddcd65-5d37-41ac-a039-170f5fbd4213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:42.256751 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-29ddcd65-5d37-41ac-a039-170f5fbd4213 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:42.259637 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-29ddcd65-5d37-41ac-a039-170f5fbd4213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:42.346754 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1478/2972] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:41:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:42.419281 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24dccc-2a53-4dab-8330-74565c994650 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:42.419577 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24dccc-2a53-4dab-8330-74565c994650 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:42.419834 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24dccc-2a53-4dab-8330-74565c994650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:42.447270 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-1d24dccc-2a53-4dab-8330-74565c994650 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:42.448504 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1d24dccc-2a53-4dab-8330-74565c994650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:42.462662 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1495/2973] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:41:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:42.464148 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ddcd65-5d37-41ac-a039-170f5fbd4213 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:42.484285 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ddcd65-5d37-41ac-a039-170f5fbd4213 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:42.497790 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99524a72-f917-407c-807a-dc7603f1e615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:42.498611 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99524a72-f917-407c-807a-dc7603f1e615 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:42.498905 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99524a72-f917-407c-807a-dc7603f1e615 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:42.499199 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99524a72-f917-407c-807a-dc7603f1e615 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:42.499937 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99524a72-f917-407c-807a-dc7603f1e615 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:41:42.500234 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99524a72-f917-407c-807a-dc7603f1e615 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:42.502317 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99524a72-f917-407c-807a-dc7603f1e615 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:42.534074 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1479/2974] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:41:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:41:42.539405 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d24dccc-2a53-4dab-8330-74565c994650 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:42.550790 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d24dccc-2a53-4dab-8330-74565c994650 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:42.563788 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b93b8e-e67c-4298-93a1-36f874231ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:42.575094 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b93b8e-e67c-4298-93a1-36f874231ce6 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:42.575094 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b93b8e-e67c-4298-93a1-36f874231ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:42.575094 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b93b8e-e67c-4298-93a1-36f874231ce6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:42.575094 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b93b8e-e67c-4298-93a1-36f874231ce6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:42.577550 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b93b8e-e67c-4298-93a1-36f874231ce6 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:42.628527 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1496/2975] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:41:42 2022] POST /identity/v3/projects => generated 389 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:41:42.633402 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99524a72-f917-407c-807a-dc7603f1e615 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:42.645886 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99524a72-f917-407c-807a-dc7603f1e615 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:42.707333 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538ad91-c30c-4afc-93d0-52a50e7fd606 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:42.709298 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538ad91-c30c-4afc-93d0-52a50e7fd606 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:42.709696 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538ad91-c30c-4afc-93d0-52a50e7fd606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:42.755155 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-6538ad91-c30c-4afc-93d0-52a50e7fd606 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:42.757597 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6538ad91-c30c-4afc-93d0-52a50e7fd606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:42.827881 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a286a5-6eb0-4462-950f-55b91808465d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:42.828718 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a286a5-6eb0-4462-950f-55b91808465d admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:42.830567 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a286a5-6eb0-4462-950f-55b91808465d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:42.830923 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a286a5-6eb0-4462-950f-55b91808465d admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:42.833172 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a286a5-6eb0-4462-950f-55b91808465d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:42.837988 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a286a5-6eb0-4462-950f-55b91808465d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:42.909500 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1480/2976] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:41:42 2022] POST /identity/v3/users => generated 295 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:41:42.914632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a286a5-6eb0-4462-950f-55b91808465d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:42.952719 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a286a5-6eb0-4462-950f-55b91808465d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:42.959345 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1497/2977] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 15:41:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:42.963529 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93834e7d-4334-40c5-a588-cd3ca9e9c885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:42.964278 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93834e7d-4334-40c5-a588-cd3ca9e9c885 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:42.964654 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93834e7d-4334-40c5-a588-cd3ca9e9c885 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:42.965029 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93834e7d-4334-40c5-a588-cd3ca9e9c885 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:42.976456 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93834e7d-4334-40c5-a588-cd3ca9e9c885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:42.979383 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538ad91-c30c-4afc-93d0-52a50e7fd606 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:42.980788 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93834e7d-4334-40c5-a588-cd3ca9e9c885 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:42.984813 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6538ad91-c30c-4afc-93d0-52a50e7fd606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:43.031682 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1481/2978] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:41:43.035354 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93834e7d-4334-40c5-a588-cd3ca9e9c885 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:43.049403 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93834e7d-4334-40c5-a588-cd3ca9e9c885 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:43.054807 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2ed45-af48-484f-b04d-b488feb3c1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:43.055652 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2ed45-af48-484f-b04d-b488feb3c1f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:43.055969 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2ed45-af48-484f-b04d-b488feb3c1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:43.056357 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2ed45-af48-484f-b04d-b488feb3c1f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:43.057227 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e2ed45-af48-484f-b04d-b488feb3c1f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:43.059302 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e2ed45-af48-484f-b04d-b488feb3c1f1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:43.102795 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1482/2979] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:41:43 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:41:43.106519 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2ed45-af48-484f-b04d-b488feb3c1f1 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:43.127805 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2ed45-af48-484f-b04d-b488feb3c1f1 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:43.137070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95cae65-4787-4ada-8b14-e45264f6b830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:43.138054 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95cae65-4787-4ada-8b14-e45264f6b830 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:43.138474 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95cae65-4787-4ada-8b14-e45264f6b830 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:43.138844 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95cae65-4787-4ada-8b14-e45264f6b830 admin admin] PATH_INFO: `/v3/projects/d8e7797583f743d49c21ee5e00523607/users/30f67d5baa4f4242b9a4d06603cdcad3/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:43.151371 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538ad91-c30c-4afc-93d0-52a50e7fd606 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:43.167229 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95cae65-4787-4ada-8b14-e45264f6b830 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8e7797583f743d49c21ee5e00523607, user_id=30f67d5baa4f4242b9a4d06603cdcad3, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:43.171716 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95cae65-4787-4ada-8b14-e45264f6b830 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:43.180998 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ec059-ca1d-40b7-94f6-214d88258f39 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:43.181816 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ec059-ca1d-40b7-94f6-214d88258f39 service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:43.182374 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ec059-ca1d-40b7-94f6-214d88258f39 service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:43.182762 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ec059-ca1d-40b7-94f6-214d88258f39 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:43.203085 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1483/2980] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:41:43 2022] PUT /identity/v3/projects/d8e7797583f743d49c21ee5e00523607/users/30f67d5baa4f4242b9a4d06603cdcad3/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:43.212165 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca84723-92c5-4caa-898f-4c746c659d7e None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:43.212644 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca84723-92c5-4caa-898f-4c746c659d7e None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:43.213064 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca84723-92c5-4caa-898f-4c746c659d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:43.214651 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95ec059-ca1d-40b7-94f6-214d88258f39 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:43.216633 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95ec059-ca1d-40b7-94f6-214d88258f39 service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:43.227738 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1498/2981] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 15:41:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 15:41:43.242016 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:43.266399 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-bca84723-92c5-4caa-898f-4c746c659d7e None None] MFA Rules not processed for user `30f67d5baa4f4242b9a4d06603cdcad3`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:43.268115 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-bca84723-92c5-4caa-898f-4c746c659d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:43.293277 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ec059-ca1d-40b7-94f6-214d88258f39 service swift] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:43.294900 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f95ec059-ca1d-40b7-94f6-214d88258f39 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:43.310076 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ec059-ca1d-40b7-94f6-214d88258f39 service swift] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:43.389548 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1484/2982] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:41:43 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:41:43.392054 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c61978-f5e0-438d-9b03-4fdd6a318d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:43.392954 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c61978-f5e0-438d-9b03-4fdd6a318d1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:43.393385 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c61978-f5e0-438d-9b03-4fdd6a318d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:43.393831 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c61978-f5e0-438d-9b03-4fdd6a318d1a admin admin] PATH_INFO: `/v3/users/2d670e233ef344de895a6e235adadb60` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:43.395697 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c61978-f5e0-438d-9b03-4fdd6a318d1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d670e233ef344de895a6e235adadb60)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:43.397943 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c61978-f5e0-438d-9b03-4fdd6a318d1a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:43.401402 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca84723-92c5-4caa-898f-4c746c659d7e None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:43.402776 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-bca84723-92c5-4caa-898f-4c746c659d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:43.410176 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:43.487170 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-46c61978-f5e0-438d-9b03-4fdd6a318d1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d670e233ef344de895a6e235adadb60'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:43.487999 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-46c61978-f5e0-438d-9b03-4fdd6a318d1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d670e233ef344de895a6e235adadb60'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:43.502227 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca84723-92c5-4caa-898f-4c746c659d7e None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:43.514070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee0a01-ce1e-4bd1-a5db-2f2a991933a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:43.515065 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee0a01-ce1e-4bd1-a5db-2f2a991933a8 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:43.515545 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee0a01-ce1e-4bd1-a5db-2f2a991933a8 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:43.515880 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee0a01-ce1e-4bd1-a5db-2f2a991933a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:43.517977 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-46c61978-f5e0-438d-9b03-4fdd6a318d1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d670e233ef344de895a6e235adadb60'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:43.528203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-46c61978-f5e0-438d-9b03-4fdd6a318d1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d670e233ef344de895a6e235adadb60'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:43.530238 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee0a01-ce1e-4bd1-a5db-2f2a991933a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:43.531947 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee0a01-ce1e-4bd1-a5db-2f2a991933a8 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:43.543689 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-46c61978-f5e0-438d-9b03-4fdd6a318d1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d670e233ef344de895a6e235adadb60'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:43.544825 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1485/2983] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:41:43 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:41:43.554467 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1499/2984] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:41:43 2022] DELETE /identity/v3/users/2d670e233ef344de895a6e235adadb60 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:41:43.561223 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa360c-6b46-4f96-b296-f973cf8a1623 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:43.561513 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa360c-6b46-4f96-b296-f973cf8a1623 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:43.561787 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa360c-6b46-4f96-b296-f973cf8a1623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:43.586125 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-6eaa360c-6b46-4f96-b296-f973cf8a1623 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:43.588050 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6eaa360c-6b46-4f96-b296-f973cf8a1623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:43.679058 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1486/2985] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:43.689292 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c61978-f5e0-438d-9b03-4fdd6a318d1a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:43.690713 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-46c61978-f5e0-438d-9b03-4fdd6a318d1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:43.776907 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c61978-f5e0-438d-9b03-4fdd6a318d1a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:43.783821 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e42a5-e85f-4b03-a196-a600179f2f6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:43.784766 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e42a5-e85f-4b03-a196-a600179f2f6b service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:43.785224 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e42a5-e85f-4b03-a196-a600179f2f6b service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:43.785503 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e42a5-e85f-4b03-a196-a600179f2f6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:43.803653 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70e42a5-e85f-4b03-a196-a600179f2f6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:43.805163 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70e42a5-e85f-4b03-a196-a600179f2f6b service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:43.818531 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1500/2986] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:41:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:41:43.856587 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa360c-6b46-4f96-b296-f973cf8a1623 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:43.858800 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6eaa360c-6b46-4f96-b296-f973cf8a1623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:43.872719 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa360c-6b46-4f96-b296-f973cf8a1623 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:43.878122 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51475b56-818d-4f59-b425-b8216c75f1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:43.878837 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51475b56-818d-4f59-b425-b8216c75f1ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:43.879217 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51475b56-818d-4f59-b425-b8216c75f1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:43.879722 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51475b56-818d-4f59-b425-b8216c75f1ba admin admin] PATH_INFO: `/v3/users/30f67d5baa4f4242b9a4d06603cdcad3` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:43.881160 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51475b56-818d-4f59-b425-b8216c75f1ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=30f67d5baa4f4242b9a4d06603cdcad3)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:43.883242 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51475b56-818d-4f59-b425-b8216c75f1ba admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:43.917828 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:43.947604 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-51475b56-818d-4f59-b425-b8216c75f1ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30f67d5baa4f4242b9a4d06603cdcad3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:43.948414 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-51475b56-818d-4f59-b425-b8216c75f1ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30f67d5baa4f4242b9a4d06603cdcad3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:43.957181 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-51475b56-818d-4f59-b425-b8216c75f1ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30f67d5baa4f4242b9a4d06603cdcad3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:43.965985 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-51475b56-818d-4f59-b425-b8216c75f1ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30f67d5baa4f4242b9a4d06603cdcad3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:43.966805 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-51475b56-818d-4f59-b425-b8216c75f1ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30f67d5baa4f4242b9a4d06603cdcad3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:44.004026 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1487/2987] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:41:43 2022] DELETE /identity/v3/users/30f67d5baa4f4242b9a4d06603cdcad3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:44.008749 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bbce1-6755-4a05-ba3b-d7037a74827b None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:44.010122 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bbce1-6755-4a05-ba3b-d7037a74827b None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:44.010574 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bbce1-6755-4a05-ba3b-d7037a74827b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:44.034772 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-449bbce1-6755-4a05-ba3b-d7037a74827b None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:44.037277 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-449bbce1-6755-4a05-ba3b-d7037a74827b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:44.129668 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1501/2988] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:41:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:44.143842 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51475b56-818d-4f59-b425-b8216c75f1ba admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:44.150943 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-51475b56-818d-4f59-b425-b8216c75f1ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:44.154064 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449bbce1-6755-4a05-ba3b-d7037a74827b None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:44.155742 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-449bbce1-6755-4a05-ba3b-d7037a74827b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:44.175504 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449bbce1-6755-4a05-ba3b-d7037a74827b None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:44.185696 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f129234-4883-449a-9fa9-d027a7ee3957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:44.186359 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f129234-4883-449a-9fa9-d027a7ee3957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:44.186728 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f129234-4883-449a-9fa9-d027a7ee3957 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:44.187017 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f129234-4883-449a-9fa9-d027a7ee3957 admin admin] PATH_INFO: `/v3/projects/1a13c91fde2944479ebd577d0f33186c` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:44.188232 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f129234-4883-449a-9fa9-d027a7ee3957 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a13c91fde2944479ebd577d0f33186c)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:44.190467 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f129234-4883-449a-9fa9-d027a7ee3957 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:44.240334 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:44.263490 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51475b56-818d-4f59-b425-b8216c75f1ba admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:44.281812 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5f129234-4883-449a-9fa9-d027a7ee3957 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a13c91fde2944479ebd577d0f33186c', 'request_id': 'req-5f129234-4883-449a-9fa9-d027a7ee3957'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:44.289220 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5f129234-4883-449a-9fa9-d027a7ee3957 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a13c91fde2944479ebd577d0f33186c', 'request_id': 'req-5f129234-4883-449a-9fa9-d027a7ee3957'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:44.299172 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5f129234-4883-449a-9fa9-d027a7ee3957 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a13c91fde2944479ebd577d0f33186c', 'request_id': 'req-5f129234-4883-449a-9fa9-d027a7ee3957'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:44.313939 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5f129234-4883-449a-9fa9-d027a7ee3957 admin admin] The token cache is being invalidate because project 1a13c91fde2944479ebd577d0f33186c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:41:44.314375 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5f129234-4883-449a-9fa9-d027a7ee3957 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:44.315141 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5f129234-4883-449a-9fa9-d027a7ee3957 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:44.317432 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1502/2989] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:41:44 2022] DELETE /identity/v3/projects/1a13c91fde2944479ebd577d0f33186c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:44.323071 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e5b5a-7c99-4a18-a5a2-ffd3c82a1709 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:44.323795 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e5b5a-7c99-4a18-a5a2-ffd3c82a1709 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:44.324171 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e5b5a-7c99-4a18-a5a2-ffd3c82a1709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:44.325995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a681f-dd4c-47a0-abc1-2f8218be304a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:44.326986 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a681f-dd4c-47a0-abc1-2f8218be304a service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:44.327606 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a681f-dd4c-47a0-abc1-2f8218be304a service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:44.328143 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a681f-dd4c-47a0-abc1-2f8218be304a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:44.330634 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6f6a681f-dd4c-47a0-abc1-2f8218be304a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:44.352463 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-717e5b5a-7c99-4a18-a5a2-ffd3c82a1709 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:44.353856 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-717e5b5a-7c99-4a18-a5a2-ffd3c82a1709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:44.424334 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a681f-dd4c-47a0-abc1-2f8218be304a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:44.426871 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a681f-dd4c-47a0-abc1-2f8218be304a service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:44.440241 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1503/2990] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:41:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:44.443467 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1488/2991] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:41:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:41:44.453305 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3e9d0-29a4-4009-9454-0044d0180077 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:44.453596 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3e9d0-29a4-4009-9454-0044d0180077 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:44.453869 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3e9d0-29a4-4009-9454-0044d0180077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:44.492097 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-b1e3e9d0-29a4-4009-9454-0044d0180077 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:44.493699 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b1e3e9d0-29a4-4009-9454-0044d0180077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:44.506395 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1504/2992] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:41:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:44.508187 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a681f-dd4c-47a0-abc1-2f8218be304a service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:44.514076 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:44.522939 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a681f-dd4c-47a0-abc1-2f8218be304a service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:44.533764 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230fd4f-d982-4849-96c8-f72d6e94ede2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:44.535482 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230fd4f-d982-4849-96c8-f72d6e94ede2 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:44.536625 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230fd4f-d982-4849-96c8-f72d6e94ede2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:44.536959 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230fd4f-d982-4849-96c8-f72d6e94ede2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:44.549993 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230fd4f-d982-4849-96c8-f72d6e94ede2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:41:44.550525 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230fd4f-d982-4849-96c8-f72d6e94ede2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:44.552484 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230fd4f-d982-4849-96c8-f72d6e94ede2 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:44.567640 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1489/2993] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:41:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:41:44.571970 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3e9d0-29a4-4009-9454-0044d0180077 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:44.582230 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3e9d0-29a4-4009-9454-0044d0180077 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:44.588174 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a391d-6b71-4de0-b39b-2517a90648dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:44.588915 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a391d-6b71-4de0-b39b-2517a90648dd admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:44.589252 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a391d-6b71-4de0-b39b-2517a90648dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:44.590076 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a391d-6b71-4de0-b39b-2517a90648dd admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:44.590829 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759a391d-6b71-4de0-b39b-2517a90648dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:44.592495 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759a391d-6b71-4de0-b39b-2517a90648dd admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:44.636044 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230fd4f-d982-4849-96c8-f72d6e94ede2 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:44.643666 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1505/2994] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:41:44 2022] POST /identity/v3/projects => generated 389 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:41:44.651424 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230fd4f-d982-4849-96c8-f72d6e94ede2 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:44.724855 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd5516-ae4f-4584-ac33-6ff45239ce4f None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:44.725710 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd5516-ae4f-4584-ac33-6ff45239ce4f None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:44.726061 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd5516-ae4f-4584-ac33-6ff45239ce4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:44.745685 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f3c47-ffe5-4847-9224-7cabcb91fba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:44.745685 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f3c47-ffe5-4847-9224-7cabcb91fba3 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:44.745685 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f3c47-ffe5-4847-9224-7cabcb91fba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:44.745685 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f3c47-ffe5-4847-9224-7cabcb91fba3 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:44.746235 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f3c47-ffe5-4847-9224-7cabcb91fba3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:44.746235 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f3c47-ffe5-4847-9224-7cabcb91fba3 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:44.753763 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-38bd5516-ae4f-4584-ac33-6ff45239ce4f None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:44.755497 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-38bd5516-ae4f-4584-ac33-6ff45239ce4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:44.790124 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1490/2995] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:41:44 2022] POST /identity/v3/users => generated 295 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:41:44.791198 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f3c47-ffe5-4847-9224-7cabcb91fba3 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:44.803435 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f3c47-ffe5-4847-9224-7cabcb91fba3 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:44.808645 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54537530-406b-4e1b-9a9d-56441277c918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:44.809402 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54537530-406b-4e1b-9a9d-56441277c918 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:44.809760 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54537530-406b-4e1b-9a9d-56441277c918 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:44.810141 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54537530-406b-4e1b-9a9d-56441277c918 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:44.811036 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54537530-406b-4e1b-9a9d-56441277c918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:44.812714 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54537530-406b-4e1b-9a9d-56441277c918 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:44.829247 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1491/2996] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:41:44.830818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54537530-406b-4e1b-9a9d-56441277c918 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:44.833779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-54537530-406b-4e1b-9a9d-56441277c918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:44.853596 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1506/2997] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 15:41:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:41:44.854766 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd5516-ae4f-4584-ac33-6ff45239ce4f None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:44.869432 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd5516-ae4f-4584-ac33-6ff45239ce4f None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:44.876364 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54537530-406b-4e1b-9a9d-56441277c918 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:44.878792 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f21627-118f-4246-961b-9e0a598aee44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:44.880091 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f21627-118f-4246-961b-9e0a598aee44 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:44.880467 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f21627-118f-4246-961b-9e0a598aee44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:44.880885 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f21627-118f-4246-961b-9e0a598aee44 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:44.881813 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f21627-118f-4246-961b-9e0a598aee44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:44.883821 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f21627-118f-4246-961b-9e0a598aee44 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:44.886288 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c418eec-3287-4a25-a80d-58659e4d4575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:44.887243 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c418eec-3287-4a25-a80d-58659e4d4575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:44.887934 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c418eec-3287-4a25-a80d-58659e4d4575 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:44.888373 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c418eec-3287-4a25-a80d-58659e4d4575 admin admin] PATH_INFO: `/v3/projects/d8e7797583f743d49c21ee5e00523607` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:44.891243 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c418eec-3287-4a25-a80d-58659e4d4575 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8e7797583f743d49c21ee5e00523607)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:44.893488 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c418eec-3287-4a25-a80d-58659e4d4575 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:44.901320 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1507/2998] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:41:44.901320 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f21627-118f-4246-961b-9e0a598aee44 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:44.903586 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e1f21627-118f-4246-961b-9e0a598aee44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:44.935885 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:44.969521 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9c418eec-3287-4a25-a80d-58659e4d4575 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8e7797583f743d49c21ee5e00523607', 'request_id': 'req-9c418eec-3287-4a25-a80d-58659e4d4575'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:44.984820 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9c418eec-3287-4a25-a80d-58659e4d4575 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8e7797583f743d49c21ee5e00523607', 'request_id': 'req-9c418eec-3287-4a25-a80d-58659e4d4575'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:45.011528 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9c418eec-3287-4a25-a80d-58659e4d4575 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8e7797583f743d49c21ee5e00523607', 'request_id': 'req-9c418eec-3287-4a25-a80d-58659e4d4575'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:45.015380 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f21627-118f-4246-961b-9e0a598aee44 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:45.028719 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9c418eec-3287-4a25-a80d-58659e4d4575 admin admin] The token cache is being invalidate because project d8e7797583f743d49c21ee5e00523607 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:41:45.029016 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9c418eec-3287-4a25-a80d-58659e4d4575 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:45.029675 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9c418eec-3287-4a25-a80d-58659e4d4575 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:45.031264 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1492/2999] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:41:44 2022] DELETE /identity/v3/projects/d8e7797583f743d49c21ee5e00523607 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:45.032012 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c418eec-3287-4a25-a80d-58659e4d4575 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:45.033392 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9c418eec-3287-4a25-a80d-58659e4d4575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:45.090823 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67312bbb-23b1-48d0-833a-ba4384734c98 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:45.091657 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67312bbb-23b1-48d0-833a-ba4384734c98 service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:45.092105 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67312bbb-23b1-48d0-833a-ba4384734c98 service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:45.092461 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67312bbb-23b1-48d0-833a-ba4384734c98 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:45.094738 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-67312bbb-23b1-48d0-833a-ba4384734c98 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:45.102816 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:45.121074 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c418eec-3287-4a25-a80d-58659e4d4575 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:45.126826 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49904f-fd77-4fd3-98d4-b3343b6d045e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:45.127819 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49904f-fd77-4fd3-98d4-b3343b6d045e admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:45.128211 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49904f-fd77-4fd3-98d4-b3343b6d045e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:45.128621 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49904f-fd77-4fd3-98d4-b3343b6d045e admin admin] PATH_INFO: `/v3/projects/b3a51af1d22640a7947141027832b034/users/ae91e75e4db544cda09ae9cbb5318b54/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:45.148194 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a49904f-fd77-4fd3-98d4-b3343b6d045e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3a51af1d22640a7947141027832b034, user_id=ae91e75e4db544cda09ae9cbb5318b54, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:45.151053 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a49904f-fd77-4fd3-98d4-b3343b6d045e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:45.167665 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1493/3000] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:41:45 2022] PUT /identity/v3/projects/b3a51af1d22640a7947141027832b034/users/ae91e75e4db544cda09ae9cbb5318b54/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:45.173056 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49904f-fd77-4fd3-98d4-b3343b6d045e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:45.173194 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67312bbb-23b1-48d0-833a-ba4384734c98 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:45.174292 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67312bbb-23b1-48d0-833a-ba4384734c98 service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:45.174477 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9a49904f-fd77-4fd3-98d4-b3343b6d045e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:45.185661 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1508/3001] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 15:41:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:41:45.186836 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72705b31-e310-44be-aeff-70c38dd67911 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:45.187484 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72705b31-e310-44be-aeff-70c38dd67911 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:45.187484 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72705b31-e310-44be-aeff-70c38dd67911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:45.219423 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-72705b31-e310-44be-aeff-70c38dd67911 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:45.220828 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-72705b31-e310-44be-aeff-70c38dd67911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:45.333353 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49904f-fd77-4fd3-98d4-b3343b6d045e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:45.347863 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1509/3002] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:45.349250 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a660d6-a854-4f65-ba15-23d19293a280 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:45.349540 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a660d6-a854-4f65-ba15-23d19293a280 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:45.349819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a660d6-a854-4f65-ba15-23d19293a280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:45.359458 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:45.364948 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea66a8c-4bd5-4a7b-8b18-b5ea0e8bf2f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:45.365608 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea66a8c-4bd5-4a7b-8b18-b5ea0e8bf2f2 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:45.365985 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea66a8c-4bd5-4a7b-8b18-b5ea0e8bf2f2 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:45.366147 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea66a8c-4bd5-4a7b-8b18-b5ea0e8bf2f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:45.370590 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-dea66a8c-4bd5-4a7b-8b18-b5ea0e8bf2f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:45.375800 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-49a660d6-a854-4f65-ba15-23d19293a280 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:45.377289 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-49a660d6-a854-4f65-ba15-23d19293a280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:45.388237 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1510/3003] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:45.390344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303cf74-8a6f-4c19-9d13-17f6d9a46fa4 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:45.390732 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303cf74-8a6f-4c19-9d13-17f6d9a46fa4 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:45.397638 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303cf74-8a6f-4c19-9d13-17f6d9a46fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:45.432531 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-1303cf74-8a6f-4c19-9d13-17f6d9a46fa4 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:45.433889 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1303cf74-8a6f-4c19-9d13-17f6d9a46fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:45.451874 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1511/3004] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:45.451874 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303cf74-8a6f-4c19-9d13-17f6d9a46fa4 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:45.454018 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1303cf74-8a6f-4c19-9d13-17f6d9a46fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:45.476306 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea66a8c-4bd5-4a7b-8b18-b5ea0e8bf2f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:45.478416 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea66a8c-4bd5-4a7b-8b18-b5ea0e8bf2f2 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:45.492969 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1494/3005] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:41:45 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:41:45.494915 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea66a8c-4bd5-4a7b-8b18-b5ea0e8bf2f2 service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:45.508707 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea66a8c-4bd5-4a7b-8b18-b5ea0e8bf2f2 service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:45.515343 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ee80e-1611-42f2-af6a-e3a1bdd71c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:45.516064 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ee80e-1611-42f2-af6a-e3a1bdd71c6b admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:45.516390 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ee80e-1611-42f2-af6a-e3a1bdd71c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:45.516724 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ee80e-1611-42f2-af6a-e3a1bdd71c6b admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:45.517437 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8ee80e-1611-42f2-af6a-e3a1bdd71c6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:41:45.517810 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8ee80e-1611-42f2-af6a-e3a1bdd71c6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:45.519874 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8ee80e-1611-42f2-af6a-e3a1bdd71c6b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:45.530205 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303cf74-8a6f-4c19-9d13-17f6d9a46fa4 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:45.536974 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c92150-2e0d-40e8-81a1-66e7dd07cfaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:45.538270 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c92150-2e0d-40e8-81a1-66e7dd07cfaf service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:45.538880 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c92150-2e0d-40e8-81a1-66e7dd07cfaf service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:45.539553 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c92150-2e0d-40e8-81a1-66e7dd07cfaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:45.551488 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1495/3006] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:41:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:41:45.557857 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ee80e-1611-42f2-af6a-e3a1bdd71c6b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:45.567570 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c92150-2e0d-40e8-81a1-66e7dd07cfaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:45.570701 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c92150-2e0d-40e8-81a1-66e7dd07cfaf service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:45.574727 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ee80e-1611-42f2-af6a-e3a1bdd71c6b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:45.583534 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b33f5d-ba86-40c3-b1c4-af9de2702f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:45.584357 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b33f5d-ba86-40c3-b1c4-af9de2702f16 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:45.584791 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b33f5d-ba86-40c3-b1c4-af9de2702f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:45.585230 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b33f5d-ba86-40c3-b1c4-af9de2702f16 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:45.586440 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b33f5d-ba86-40c3-b1c4-af9de2702f16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:45.588788 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b33f5d-ba86-40c3-b1c4-af9de2702f16 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:45.593304 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1512/3007] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:41:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:41:45.661397 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c92150-2e0d-40e8-81a1-66e7dd07cfaf service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:45.682718 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1496/3008] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:41:45 2022] POST /identity/v3/projects => generated 375 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:41:45.687071 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c92150-2e0d-40e8-81a1-66e7dd07cfaf service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:45.836411 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4ab8e-2684-4f65-a589-c4ea01925e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:45.837234 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4ab8e-2684-4f65-a589-c4ea01925e5e admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:45.837542 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4ab8e-2684-4f65-a589-c4ea01925e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:45.838210 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4ab8e-2684-4f65-a589-c4ea01925e5e admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:45.839144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc4ab8e-2684-4f65-a589-c4ea01925e5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:45.841260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc4ab8e-2684-4f65-a589-c4ea01925e5e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:45.889995 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1513/3009] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:41:45 2022] POST /identity/v3/users => generated 288 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:41:45.895777 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b33f5d-ba86-40c3-b1c4-af9de2702f16 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:45.909210 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b33f5d-ba86-40c3-b1c4-af9de2702f16 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:45.915938 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f850ae-7105-4afa-bc1b-2a7c2dcc5782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:45.916891 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f850ae-7105-4afa-bc1b-2a7c2dcc5782 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:45.917419 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f850ae-7105-4afa-bc1b-2a7c2dcc5782 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:45.917880 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f850ae-7105-4afa-bc1b-2a7c2dcc5782 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:45.918926 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f850ae-7105-4afa-bc1b-2a7c2dcc5782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:45.921687 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f850ae-7105-4afa-bc1b-2a7c2dcc5782 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:46.001373 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1497/3010] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:41:46.016317 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4ab8e-2684-4f65-a589-c4ea01925e5e admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:46.033666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4ab8e-2684-4f65-a589-c4ea01925e5e admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:46.038975 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bfbc71-8027-4eea-a457-ce025dad1760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:46.039835 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfbc71-8027-4eea-a457-ce025dad1760 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:46.040307 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfbc71-8027-4eea-a457-ce025dad1760 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:46.041251 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfbc71-8027-4eea-a457-ce025dad1760 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:46.042293 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bfbc71-8027-4eea-a457-ce025dad1760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:46.044944 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bfbc71-8027-4eea-a457-ce025dad1760 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:46.058688 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1514/3011] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:41:46.063133 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f850ae-7105-4afa-bc1b-2a7c2dcc5782 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:46.077862 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f850ae-7105-4afa-bc1b-2a7c2dcc5782 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:46.084477 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6501974e-438b-4dfb-8ca1-b7b1ad634cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:46.085261 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501974e-438b-4dfb-8ca1-b7b1ad634cec admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:46.085622 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501974e-438b-4dfb-8ca1-b7b1ad634cec admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:46.086085 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501974e-438b-4dfb-8ca1-b7b1ad634cec admin admin] PATH_INFO: `/v3/projects/2d32eb4fb5ea49e6ad495a8175ae5e3e/users/853f8300f9bb403b9cea4834c5a1edcb/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:46.105076 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6501974e-438b-4dfb-8ca1-b7b1ad634cec admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d32eb4fb5ea49e6ad495a8175ae5e3e, user_id=853f8300f9bb403b9cea4834c5a1edcb, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:46.107982 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6501974e-438b-4dfb-8ca1-b7b1ad634cec admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:46.114177 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:46.135839 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1498/3012] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:41:46 2022] PUT /identity/v3/projects/2d32eb4fb5ea49e6ad495a8175ae5e3e/users/853f8300f9bb403b9cea4834c5a1edcb/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:46.141349 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f37f7-9cb0-4eaf-ad93-deb1c48bb90d None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:46.141731 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f37f7-9cb0-4eaf-ad93-deb1c48bb90d None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:46.142076 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f37f7-9cb0-4eaf-ad93-deb1c48bb90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:46.177011 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-269f37f7-9cb0-4eaf-ad93-deb1c48bb90d None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:46.181831 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-269f37f7-9cb0-4eaf-ad93-deb1c48bb90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:46.310887 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1515/3013] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:41:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:41:46.347388 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6501974e-438b-4dfb-8ca1-b7b1ad634cec admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:46.350535 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6501974e-438b-4dfb-8ca1-b7b1ad634cec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:46.464447 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6501974e-438b-4dfb-8ca1-b7b1ad634cec admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:46.477488 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de088dfe-c2d4-404c-8b71-77d762358a63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:46.479006 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de088dfe-c2d4-404c-8b71-77d762358a63 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:46.479466 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de088dfe-c2d4-404c-8b71-77d762358a63 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:46.480003 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de088dfe-c2d4-404c-8b71-77d762358a63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:46.507182 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de088dfe-c2d4-404c-8b71-77d762358a63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:46.510283 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de088dfe-c2d4-404c-8b71-77d762358a63 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:46.546011 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1499/3014] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:41:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:41:47.287720 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd1150-7002-4da2-9288-107d657ac0af None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:47.288631 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd1150-7002-4da2-9288-107d657ac0af None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:47.290036 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd1150-7002-4da2-9288-107d657ac0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:47.318443 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-c4bd1150-7002-4da2-9288-107d657ac0af None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:47.320088 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c4bd1150-7002-4da2-9288-107d657ac0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:47.330104 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:47.430516 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1516/3015] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 15:41:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:47.445743 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de088dfe-c2d4-404c-8b71-77d762358a63 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:47.449670 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-de088dfe-c2d4-404c-8b71-77d762358a63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:47.580530 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de088dfe-c2d4-404c-8b71-77d762358a63 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:47.589033 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea99eb-0373-4524-8b57-a0d670d99974 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:47.590457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea99eb-0373-4524-8b57-a0d670d99974 service swift] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:47.590906 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea99eb-0373-4524-8b57-a0d670d99974 service swift] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:47.591354 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea99eb-0373-4524-8b57-a0d670d99974 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:47.606166 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea99eb-0373-4524-8b57-a0d670d99974 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:47.611784 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea99eb-0373-4524-8b57-a0d670d99974 service swift] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:47.639039 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1500/3016] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 15:41:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:41:48.037981 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687654fa-439d-44e6-ac1a-9cde15f9fea5 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:48.038317 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687654fa-439d-44e6-ac1a-9cde15f9fea5 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:48.038543 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687654fa-439d-44e6-ac1a-9cde15f9fea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:48.063712 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-687654fa-439d-44e6-ac1a-9cde15f9fea5 None None] MFA Rules not processed for user `29fa4fbf7bb34c13952163feeaafe738`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:48.065024 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-687654fa-439d-44e6-ac1a-9cde15f9fea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:48.155316 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1517/3017] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:41:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:48.721512 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04f43b-01ff-414f-87e3-1342804c8874 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:48.722076 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04f43b-01ff-414f-87e3-1342804c8874 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:48.722324 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04f43b-01ff-414f-87e3-1342804c8874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:48.757777 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-8f04f43b-01ff-414f-87e3-1342804c8874 None None] MFA Rules not processed for user `29fa4fbf7bb34c13952163feeaafe738`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:48.759235 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8f04f43b-01ff-414f-87e3-1342804c8874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:48.784918 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1501/3018] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:41:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:55.277602 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38009f18-bdaa-453e-af6a-9d052e04c6fa None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:55.278071 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38009f18-bdaa-453e-af6a-9d052e04c6fa None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:55.278156 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38009f18-bdaa-453e-af6a-9d052e04c6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:55.349297 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-38009f18-bdaa-453e-af6a-9d052e04c6fa None None] MFA Rules not processed for user `ae91e75e4db544cda09ae9cbb5318b54`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:55.363009 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-38009f18-bdaa-453e-af6a-9d052e04c6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:55.475069 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1518/3019] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:41:55 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:55.778920 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04f43b-01ff-414f-87e3-1342804c8874 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:55.900229 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04f43b-01ff-414f-87e3-1342804c8874 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:55.914639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160a4ac-9581-487b-b04e-3586d9342dfe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:55.915643 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160a4ac-9581-487b-b04e-3586d9342dfe service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:55.915891 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160a4ac-9581-487b-b04e-3586d9342dfe service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:55.916822 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160a4ac-9581-487b-b04e-3586d9342dfe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:55.935553 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160a4ac-9581-487b-b04e-3586d9342dfe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:55.938710 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160a4ac-9581-487b-b04e-3586d9342dfe service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:55.960692 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1502/3020] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:41:55 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:41:58.180602 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38009f18-bdaa-453e-af6a-9d052e04c6fa None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:58.198655 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38009f18-bdaa-453e-af6a-9d052e04c6fa None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:58.205050 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b617272e-1d54-4487-991b-f1cfd661aa8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:58.205679 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617272e-1d54-4487-991b-f1cfd661aa8e service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:58.205961 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617272e-1d54-4487-991b-f1cfd661aa8e service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:58.206237 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617272e-1d54-4487-991b-f1cfd661aa8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:58.208771 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b617272e-1d54-4487-991b-f1cfd661aa8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:58.283433 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:58.304403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b617272e-1d54-4487-991b-f1cfd661aa8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:58.306600 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b617272e-1d54-4487-991b-f1cfd661aa8e service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:58.319785 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1519/3021] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:41:58 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:41:58.587886 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377f79b-835e-4060-a77a-5ff995064335 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:58.588374 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377f79b-835e-4060-a77a-5ff995064335 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:58.588743 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377f79b-835e-4060-a77a-5ff995064335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:58.607046 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:58.637629 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a377f79b-835e-4060-a77a-5ff995064335 None None] MFA Rules not processed for user `853f8300f9bb403b9cea4834c5a1edcb`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:58.638959 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a377f79b-835e-4060-a77a-5ff995064335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:58.748958 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5bbbc-3b17-40ec-af4f-e39cb112cfe7 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:58.749479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5bbbc-3b17-40ec-af4f-e39cb112cfe7 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:58.749906 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5bbbc-3b17-40ec-af4f-e39cb112cfe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:58.757298 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1503/3022] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:41:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:41:58.776954 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-03c5bbbc-3b17-40ec-af4f-e39cb112cfe7 None None] MFA Rules not processed for user `853f8300f9bb403b9cea4834c5a1edcb`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:58.779051 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-03c5bbbc-3b17-40ec-af4f-e39cb112cfe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:58.805658 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1520/3023] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:41:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:59.718885 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377f79b-835e-4060-a77a-5ff995064335 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:59.735783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377f79b-835e-4060-a77a-5ff995064335 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:59.742494 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1272b-72aa-484e-a683-8ab128017bf7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:59.743412 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1272b-72aa-484e-a683-8ab128017bf7 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:59.743880 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1272b-72aa-484e-a683-8ab128017bf7 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:59.744389 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1272b-72aa-484e-a683-8ab128017bf7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:59.753569 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f1272b-72aa-484e-a683-8ab128017bf7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:59.756006 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f1272b-72aa-484e-a683-8ab128017bf7 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:59.781882 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1504/3024] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:41:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:42:05.682530 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f42eb-55ba-45c2-93a7-3b588eee5311 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:05.683191 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f42eb-55ba-45c2-93a7-3b588eee5311 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:05.683191 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f42eb-55ba-45c2-93a7-3b588eee5311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:05.727004 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-501f42eb-55ba-45c2-93a7-3b588eee5311 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:05.729679 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-501f42eb-55ba-45c2-93a7-3b588eee5311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:05.767249 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1521/3025] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 15:42:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:05.775408 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1272b-72aa-484e-a683-8ab128017bf7 service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:05.794326 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1272b-72aa-484e-a683-8ab128017bf7 service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:05.822194 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da88bf-629a-43ae-b88e-c2f5936ad8d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:05.822819 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da88bf-629a-43ae-b88e-c2f5936ad8d7 service swift] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:05.823135 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da88bf-629a-43ae-b88e-c2f5936ad8d7 service swift] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:05.823402 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da88bf-629a-43ae-b88e-c2f5936ad8d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:05.840410 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da88bf-629a-43ae-b88e-c2f5936ad8d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:05.842024 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da88bf-629a-43ae-b88e-c2f5936ad8d7 service swift] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:05.861682 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1505/3026] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 15:42:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:42:09.025584 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423523b-7d6f-4b2d-b529-d1a7fee3a36c None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:09.026516 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423523b-7d6f-4b2d-b529-d1a7fee3a36c None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:09.026952 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423523b-7d6f-4b2d-b529-d1a7fee3a36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:09.051316 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-1423523b-7d6f-4b2d-b529-d1a7fee3a36c None None] MFA Rules not processed for user `53387bcdf14248b9bdf716e782b786d7`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:09.052815 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1423523b-7d6f-4b2d-b529-d1a7fee3a36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:09.128098 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1522/3027] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:42:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:15.855070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=41 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:19.120781 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=38 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:22.327101 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da88bf-629a-43ae-b88e-c2f5936ad8d7 service swift] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:22.333334 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-73da88bf-629a-43ae-b88e-c2f5936ad8d7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:22.365069 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da88bf-629a-43ae-b88e-c2f5936ad8d7 service swift] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:22.373047 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760113d7-6c8e-4d5a-b144-383a3eb99fa0 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:22.373558 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760113d7-6c8e-4d5a-b144-383a3eb99fa0 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:22.374291 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760113d7-6c8e-4d5a-b144-383a3eb99fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:22.374638 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9629e2-1c10-4045-83ec-5e4a937fe47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:22.375315 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9629e2-1c10-4045-83ec-5e4a937fe47d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:22.375597 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9629e2-1c10-4045-83ec-5e4a937fe47d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:22.375871 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9629e2-1c10-4045-83ec-5e4a937fe47d admin admin] PATH_INFO: `/v3/users/00c0fdb3a3524a93b7728b495750b95e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:22.385663 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9629e2-1c10-4045-83ec-5e4a937fe47d admin admin] RBAC: Authorizing `identity:delete_user(user_id=00c0fdb3a3524a93b7728b495750b95e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:22.387849 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9629e2-1c10-4045-83ec-5e4a937fe47d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:22.405898 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-760113d7-6c8e-4d5a-b144-383a3eb99fa0 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:22.407189 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-760113d7-6c8e-4d5a-b144-383a3eb99fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:22.432904 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1523/3028] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 15:42:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 29 15:42:22.444622 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760113d7-6c8e-4d5a-b144-383a3eb99fa0 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:22.471553 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760113d7-6c8e-4d5a-b144-383a3eb99fa0 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:22.492804 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9873b72-a578-42f8-b5ba-2e0e0de254dc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:22.496622 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9873b72-a578-42f8-b5ba-2e0e0de254dc service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:22.497718 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9873b72-a578-42f8-b5ba-2e0e0de254dc service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:22.498911 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9873b72-a578-42f8-b5ba-2e0e0de254dc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:22.509965 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1f9629e2-1c10-4045-83ec-5e4a937fe47d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00c0fdb3a3524a93b7728b495750b95e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:22.518246 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1f9629e2-1c10-4045-83ec-5e4a937fe47d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00c0fdb3a3524a93b7728b495750b95e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:22.531738 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9873b72-a578-42f8-b5ba-2e0e0de254dc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:22.534690 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9873b72-a578-42f8-b5ba-2e0e0de254dc service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:22.541676 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1f9629e2-1c10-4045-83ec-5e4a937fe47d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00c0fdb3a3524a93b7728b495750b95e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:22.567359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1f9629e2-1c10-4045-83ec-5e4a937fe47d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00c0fdb3a3524a93b7728b495750b95e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:22.584204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1f9629e2-1c10-4045-83ec-5e4a937fe47d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00c0fdb3a3524a93b7728b495750b95e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:22.589936 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1524/3029] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 15:42:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:42:22.656105 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1506/3030] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:42:22 2022] DELETE /identity/v3/users/00c0fdb3a3524a93b7728b495750b95e => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:22.663970 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71469366-98a9-49cd-96ef-71367fe4d747 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:22.664261 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71469366-98a9-49cd-96ef-71367fe4d747 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:22.664540 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71469366-98a9-49cd-96ef-71367fe4d747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:22.727848 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-71469366-98a9-49cd-96ef-71367fe4d747 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:22.729196 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-71469366-98a9-49cd-96ef-71367fe4d747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:22.892186 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1525/3031] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:42:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:42:22.914243 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9629e2-1c10-4045-83ec-5e4a937fe47d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:22.916196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1f9629e2-1c10-4045-83ec-5e4a937fe47d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:23.070286 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9629e2-1c10-4045-83ec-5e4a937fe47d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:23.074421 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743439da-db6e-432a-9f21-bf0a3a46155d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:23.075097 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743439da-db6e-432a-9f21-bf0a3a46155d service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:23.075402 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743439da-db6e-432a-9f21-bf0a3a46155d service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:23.075671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743439da-db6e-432a-9f21-bf0a3a46155d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:23.104303 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743439da-db6e-432a-9f21-bf0a3a46155d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:23.116249 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743439da-db6e-432a-9f21-bf0a3a46155d service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:23.166981 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1507/3032] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:42:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:42:24.365947 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71469366-98a9-49cd-96ef-71367fe4d747 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:24.367575 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-71469366-98a9-49cd-96ef-71367fe4d747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:24.424370 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71469366-98a9-49cd-96ef-71367fe4d747 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:24.436035 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743439da-db6e-432a-9f21-bf0a3a46155d service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:24.437778 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-743439da-db6e-432a-9f21-bf0a3a46155d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:24.450114 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79947330-e4ab-4f9d-b3ca-8558c38cec43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:24.451249 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79947330-e4ab-4f9d-b3ca-8558c38cec43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:24.451759 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79947330-e4ab-4f9d-b3ca-8558c38cec43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:24.452211 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79947330-e4ab-4f9d-b3ca-8558c38cec43 admin admin] PATH_INFO: `/v3/users/ae91e75e4db544cda09ae9cbb5318b54` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:24.454643 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79947330-e4ab-4f9d-b3ca-8558c38cec43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae91e75e4db544cda09ae9cbb5318b54)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:24.457103 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79947330-e4ab-4f9d-b3ca-8558c38cec43 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:24.464045 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743439da-db6e-432a-9f21-bf0a3a46155d service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:24.479402 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c236f-346a-4ab3-9cd5-082f544e64cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:24.480346 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c236f-346a-4ab3-9cd5-082f544e64cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:24.480795 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c236f-346a-4ab3-9cd5-082f544e64cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:24.481233 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c236f-346a-4ab3-9cd5-082f544e64cd admin admin] PATH_INFO: `/v3/projects/93cffdb3292247c69d9f8b425453962a` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:24.485891 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c236f-346a-4ab3-9cd5-082f544e64cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=93cffdb3292247c69d9f8b425453962a)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:24.488271 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c236f-346a-4ab3-9cd5-082f544e64cd admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:24.570053 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-79947330-e4ab-4f9d-b3ca-8558c38cec43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae91e75e4db544cda09ae9cbb5318b54'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:24.570053 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-79947330-e4ab-4f9d-b3ca-8558c38cec43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae91e75e4db544cda09ae9cbb5318b54'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:24.611681 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-79947330-e4ab-4f9d-b3ca-8558c38cec43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae91e75e4db544cda09ae9cbb5318b54'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:24.634964 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-79947330-e4ab-4f9d-b3ca-8558c38cec43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae91e75e4db544cda09ae9cbb5318b54'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:24.640297 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-257c236f-346a-4ab3-9cd5-082f544e64cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93cffdb3292247c69d9f8b425453962a', 'request_id': 'req-257c236f-346a-4ab3-9cd5-082f544e64cd'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:24.662182 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-257c236f-346a-4ab3-9cd5-082f544e64cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93cffdb3292247c69d9f8b425453962a', 'request_id': 'req-257c236f-346a-4ab3-9cd5-082f544e64cd'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:24.664330 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-79947330-e4ab-4f9d-b3ca-8558c38cec43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae91e75e4db544cda09ae9cbb5318b54'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:24.684252 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-257c236f-346a-4ab3-9cd5-082f544e64cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93cffdb3292247c69d9f8b425453962a', 'request_id': 'req-257c236f-346a-4ab3-9cd5-082f544e64cd'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:24.684819 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1526/3033] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:42:24 2022] DELETE /identity/v3/users/ae91e75e4db544cda09ae9cbb5318b54 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:24.708656 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:24.715754 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-257c236f-346a-4ab3-9cd5-082f544e64cd admin admin] The token cache is being invalidate because project 93cffdb3292247c69d9f8b425453962a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:42:24.717625 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-257c236f-346a-4ab3-9cd5-082f544e64cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:24.718598 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-257c236f-346a-4ab3-9cd5-082f544e64cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:24.724804 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1508/3034] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:24 2022] DELETE /identity/v3/projects/93cffdb3292247c69d9f8b425453962a => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:24.728782 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79947330-e4ab-4f9d-b3ca-8558c38cec43 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:24.730587 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-79947330-e4ab-4f9d-b3ca-8558c38cec43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:24.857714 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:24.885638 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79947330-e4ab-4f9d-b3ca-8558c38cec43 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:24.905633 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4b6c9-6677-420a-ab98-9020df71095c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:24.906424 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4b6c9-6677-420a-ab98-9020df71095c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:24.906904 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4b6c9-6677-420a-ab98-9020df71095c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:24.907645 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4b6c9-6677-420a-ab98-9020df71095c admin admin] PATH_INFO: `/v3/users/a2f92fde643d4a1687a2f3c17376e4bf` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:24.909227 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4b6c9-6677-420a-ab98-9020df71095c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2f92fde643d4a1687a2f3c17376e4bf)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:24.915668 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4b6c9-6677-420a-ab98-9020df71095c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:25.040865 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-78a4b6c9-6677-420a-ab98-9020df71095c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2f92fde643d4a1687a2f3c17376e4bf'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:25.042011 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-78a4b6c9-6677-420a-ab98-9020df71095c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2f92fde643d4a1687a2f3c17376e4bf'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:25.079692 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-78a4b6c9-6677-420a-ab98-9020df71095c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2f92fde643d4a1687a2f3c17376e4bf'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:25.104870 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-78a4b6c9-6677-420a-ab98-9020df71095c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2f92fde643d4a1687a2f3c17376e4bf'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:25.123881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-78a4b6c9-6677-420a-ab98-9020df71095c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2f92fde643d4a1687a2f3c17376e4bf'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:25.148419 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1527/3035] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:42:24 2022] DELETE /identity/v3/users/a2f92fde643d4a1687a2f3c17376e4bf => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:25.828532 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c236f-346a-4ab3-9cd5-082f544e64cd admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:25.830738 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-257c236f-346a-4ab3-9cd5-082f544e64cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:25.981786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c236f-346a-4ab3-9cd5-082f544e64cd admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:26.095984 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4b6c9-6677-420a-ab98-9020df71095c admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:26.097504 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-78a4b6c9-6677-420a-ab98-9020df71095c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:26.128161 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3996e552-72e0-4697-8ca2-7593c11772d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:26.131831 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996e552-72e0-4697-8ca2-7593c11772d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:26.132278 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996e552-72e0-4697-8ca2-7593c11772d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:26.132775 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996e552-72e0-4697-8ca2-7593c11772d3 admin admin] PATH_INFO: `/v3/projects/d9a7498279404cd69323b0073b79833e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:26.137915 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3996e552-72e0-4697-8ca2-7593c11772d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9a7498279404cd69323b0073b79833e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:26.141385 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3996e552-72e0-4697-8ca2-7593c11772d3 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:26.243098 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3996e552-72e0-4697-8ca2-7593c11772d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9a7498279404cd69323b0073b79833e', 'request_id': 'req-3996e552-72e0-4697-8ca2-7593c11772d3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:26.250650 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3996e552-72e0-4697-8ca2-7593c11772d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9a7498279404cd69323b0073b79833e', 'request_id': 'req-3996e552-72e0-4697-8ca2-7593c11772d3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:26.259458 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3996e552-72e0-4697-8ca2-7593c11772d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9a7498279404cd69323b0073b79833e', 'request_id': 'req-3996e552-72e0-4697-8ca2-7593c11772d3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:26.290577 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3996e552-72e0-4697-8ca2-7593c11772d3 admin admin] The token cache is being invalidate because project d9a7498279404cd69323b0073b79833e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:42:26.291332 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3996e552-72e0-4697-8ca2-7593c11772d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:26.293085 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3996e552-72e0-4697-8ca2-7593c11772d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:26.300895 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1509/3036] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:25 2022] DELETE /identity/v3/projects/d9a7498279404cd69323b0073b79833e => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:26.303790 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139ee08-8e84-4b59-9812-3511608ceb25 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:26.304195 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139ee08-8e84-4b59-9812-3511608ceb25 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:26.304572 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139ee08-8e84-4b59-9812-3511608ceb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:26.330575 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-5139ee08-8e84-4b59-9812-3511608ceb25 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:26.334655 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5139ee08-8e84-4b59-9812-3511608ceb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:26.374979 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:26.390317 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4b6c9-6677-420a-ab98-9020df71095c admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:26.500474 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1510/3037] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:42:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:26.502158 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c37a4-d63f-47ee-ba6f-d17ebc8b1926 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:26.502451 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c37a4-d63f-47ee-ba6f-d17ebc8b1926 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:26.502731 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c37a4-d63f-47ee-ba6f-d17ebc8b1926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:26.531485 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-f99c37a4-d63f-47ee-ba6f-d17ebc8b1926 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:26.533555 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f99c37a4-d63f-47ee-ba6f-d17ebc8b1926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:26.546674 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1511/3038] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:42:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:42:26.548736 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c37a4-d63f-47ee-ba6f-d17ebc8b1926 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:26.564948 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c37a4-d63f-47ee-ba6f-d17ebc8b1926 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:26.571335 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088b956-5ba0-458b-9b2d-d8a6b0d3c7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:26.572088 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088b956-5ba0-458b-9b2d-d8a6b0d3c7f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:26.572466 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088b956-5ba0-458b-9b2d-d8a6b0d3c7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:26.572875 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088b956-5ba0-458b-9b2d-d8a6b0d3c7f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:26.573635 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d088b956-5ba0-458b-9b2d-d8a6b0d3c7f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:42:26.574099 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d088b956-5ba0-458b-9b2d-d8a6b0d3c7f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:26.575856 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d088b956-5ba0-458b-9b2d-d8a6b0d3c7f7 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:26.604745 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1512/3039] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:42:26.609993 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088b956-5ba0-458b-9b2d-d8a6b0d3c7f7 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:26.631375 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088b956-5ba0-458b-9b2d-d8a6b0d3c7f7 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:26.637016 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5186494-18a3-4d09-94f2-aa5527cceea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:26.639044 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5186494-18a3-4d09-94f2-aa5527cceea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:26.639553 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5186494-18a3-4d09-94f2-aa5527cceea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:26.640693 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5186494-18a3-4d09-94f2-aa5527cceea8 admin admin] PATH_INFO: `/v3/projects/b3a51af1d22640a7947141027832b034` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:26.643856 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5186494-18a3-4d09-94f2-aa5527cceea8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3a51af1d22640a7947141027832b034)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:26.644249 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8c87c-e93d-40e2-a72d-54d35158d10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:26.645480 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8c87c-e93d-40e2-a72d-54d35158d10e admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:26.645887 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8c87c-e93d-40e2-a72d-54d35158d10e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:26.646256 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8c87c-e93d-40e2-a72d-54d35158d10e admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:26.647085 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b8c87c-e93d-40e2-a72d-54d35158d10e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:26.651532 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5186494-18a3-4d09-94f2-aa5527cceea8 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:26.653529 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b8c87c-e93d-40e2-a72d-54d35158d10e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:26.729279 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1513/3040] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:42:26 2022] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:42:26.729919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8c87c-e93d-40e2-a72d-54d35158d10e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:26.751746 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:26.814864 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e5186494-18a3-4d09-94f2-aa5527cceea8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3a51af1d22640a7947141027832b034', 'request_id': 'req-e5186494-18a3-4d09-94f2-aa5527cceea8'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:26.840204 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e5186494-18a3-4d09-94f2-aa5527cceea8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3a51af1d22640a7947141027832b034', 'request_id': 'req-e5186494-18a3-4d09-94f2-aa5527cceea8'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:26.861865 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e5186494-18a3-4d09-94f2-aa5527cceea8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3a51af1d22640a7947141027832b034', 'request_id': 'req-e5186494-18a3-4d09-94f2-aa5527cceea8'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:26.882151 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e5186494-18a3-4d09-94f2-aa5527cceea8 admin admin] The token cache is being invalidate because project b3a51af1d22640a7947141027832b034 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:42:26.882507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e5186494-18a3-4d09-94f2-aa5527cceea8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:26.883779 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e5186494-18a3-4d09-94f2-aa5527cceea8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:26.889498 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1528/3041] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:26 2022] DELETE /identity/v3/projects/b3a51af1d22640a7947141027832b034 => generated 0 bytes in 793 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:42:26.891653 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8c87c-e93d-40e2-a72d-54d35158d10e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:26.896063 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21900d5-715e-4ae4-b46e-0a2efb32d9dc None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:26.896575 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21900d5-715e-4ae4-b46e-0a2efb32d9dc None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:26.897032 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21900d5-715e-4ae4-b46e-0a2efb32d9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:26.966122 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-b21900d5-715e-4ae4-b46e-0a2efb32d9dc None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:26.967426 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b21900d5-715e-4ae4-b46e-0a2efb32d9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:27.099821 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16585e6-0d52-4bed-8d30-9a3e381eaede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:27.100966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16585e6-0d52-4bed-8d30-9a3e381eaede admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:27.101459 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16585e6-0d52-4bed-8d30-9a3e381eaede admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:27.101966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16585e6-0d52-4bed-8d30-9a3e381eaede admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:27.102819 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16585e6-0d52-4bed-8d30-9a3e381eaede admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:27.105407 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16585e6-0d52-4bed-8d30-9a3e381eaede admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:27.117149 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1529/3042] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:42:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:27.126111 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44fae2-0f8d-4318-82e0-ed0f2666d018 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:27.126495 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44fae2-0f8d-4318-82e0-ed0f2666d018 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:27.126861 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44fae2-0f8d-4318-82e0-ed0f2666d018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:27.150334 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-bf44fae2-0f8d-4318-82e0-ed0f2666d018 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:27.151890 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-bf44fae2-0f8d-4318-82e0-ed0f2666d018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:27.172042 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1514/3043] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:42:26 2022] POST /identity/v3/users => generated 292 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:42:27.176109 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16585e6-0d52-4bed-8d30-9a3e381eaede admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:27.181916 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f16585e6-0d52-4bed-8d30-9a3e381eaede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:27.192327 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1530/3044] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:27.196646 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44fae2-0f8d-4318-82e0-ed0f2666d018 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:27.213606 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16585e6-0d52-4bed-8d30-9a3e381eaede admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:27.217615 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44fae2-0f8d-4318-82e0-ed0f2666d018 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:27.230241 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2015741-c007-411a-aae6-7ee9bff3def1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:27.230384 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2015741-c007-411a-aae6-7ee9bff3def1 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:27.230612 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2015741-c007-411a-aae6-7ee9bff3def1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:27.231041 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2015741-c007-411a-aae6-7ee9bff3def1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:27.232281 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c0587-9565-4f3e-841d-37b9d2d5dcc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:27.232890 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c0587-9565-4f3e-841d-37b9d2d5dcc3 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:27.233155 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c0587-9565-4f3e-841d-37b9d2d5dcc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:27.233568 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c0587-9565-4f3e-841d-37b9d2d5dcc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:27.234220 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c0587-9565-4f3e-841d-37b9d2d5dcc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:42:27.234517 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c0587-9565-4f3e-841d-37b9d2d5dcc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:27.235457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2015741-c007-411a-aae6-7ee9bff3def1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:27.238700 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c0587-9565-4f3e-841d-37b9d2d5dcc3 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:27.239747 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2015741-c007-411a-aae6-7ee9bff3def1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:27.266028 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1515/3045] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:42:27.266272 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1531/3046] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:42:27.271471 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2015741-c007-411a-aae6-7ee9bff3def1 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:27.274598 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c0587-9565-4f3e-841d-37b9d2d5dcc3 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:27.291537 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c0587-9565-4f3e-841d-37b9d2d5dcc3 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:27.296495 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2015741-c007-411a-aae6-7ee9bff3def1 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:27.305260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee93431-9cce-4397-9163-c4dbaa2ccfab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:27.305884 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee93431-9cce-4397-9163-c4dbaa2ccfab admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:27.306160 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee93431-9cce-4397-9163-c4dbaa2ccfab admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:27.306424 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee93431-9cce-4397-9163-c4dbaa2ccfab admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:27.307074 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee93431-9cce-4397-9163-c4dbaa2ccfab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:27.308980 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee93431-9cce-4397-9163-c4dbaa2ccfab admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:27.312041 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16035a06-d7b5-4b9a-b833-0793fffeced2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:27.312728 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16035a06-d7b5-4b9a-b833-0793fffeced2 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:27.313010 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16035a06-d7b5-4b9a-b833-0793fffeced2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:27.313284 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16035a06-d7b5-4b9a-b833-0793fffeced2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:27.314031 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16035a06-d7b5-4b9a-b833-0793fffeced2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:27.316332 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16035a06-d7b5-4b9a-b833-0793fffeced2 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:27.359008 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1516/3047] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:42:27.360125 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16035a06-d7b5-4b9a-b833-0793fffeced2 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:27.394749 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1532/3048] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:42:27 2022] POST /identity/v3/projects => generated 389 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:42:27.400959 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee93431-9cce-4397-9163-c4dbaa2ccfab admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:27.413300 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16035a06-d7b5-4b9a-b833-0793fffeced2 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:27.429442 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:27.527290 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee93431-9cce-4397-9163-c4dbaa2ccfab admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:27.535115 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b40029-dae3-4803-8143-2a03f1ab88f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:27.536887 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b40029-dae3-4803-8143-2a03f1ab88f9 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:27.537131 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b40029-dae3-4803-8143-2a03f1ab88f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:27.537688 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b40029-dae3-4803-8143-2a03f1ab88f9 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:27.538512 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b40029-dae3-4803-8143-2a03f1ab88f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:27.540982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b40029-dae3-4803-8143-2a03f1ab88f9 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:27.582049 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:27.608973 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1533/3049] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:42:27 2022] POST /identity/v3/users => generated 295 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:42:27.628004 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b40029-dae3-4803-8143-2a03f1ab88f9 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:27.643316 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b40029-dae3-4803-8143-2a03f1ab88f9 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:27.647090 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb401a-88c9-4529-ab57-8f429752783a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:27.648084 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb401a-88c9-4529-ab57-8f429752783a admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:27.648370 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb401a-88c9-4529-ab57-8f429752783a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:27.648648 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb401a-88c9-4529-ab57-8f429752783a admin admin] PATH_INFO: `/v3/projects/3da73abe36a64bde9e9fc9315f1a87b4/users/efd373f4dbd944aa82c96a42545c7479/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:27.658327 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea671a1-f1b5-4b80-bf92-b6bba550026e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:27.658959 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea671a1-f1b5-4b80-bf92-b6bba550026e admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:27.659394 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea671a1-f1b5-4b80-bf92-b6bba550026e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:27.659671 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea671a1-f1b5-4b80-bf92-b6bba550026e admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:27.660327 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea671a1-f1b5-4b80-bf92-b6bba550026e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:27.663349 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea671a1-f1b5-4b80-bf92-b6bba550026e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:27.675099 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1534/3050] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:42:27.679664 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea671a1-f1b5-4b80-bf92-b6bba550026e admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:27.694800 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea671a1-f1b5-4b80-bf92-b6bba550026e admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:27.696769 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb401a-88c9-4529-ab57-8f429752783a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3da73abe36a64bde9e9fc9315f1a87b4, user_id=efd373f4dbd944aa82c96a42545c7479, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:27.700465 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb401a-88c9-4529-ab57-8f429752783a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:27.711695 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622ec05-c543-479f-b9f8-14d9982dfdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:27.712674 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622ec05-c543-479f-b9f8-14d9982dfdca admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:27.713513 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622ec05-c543-479f-b9f8-14d9982dfdca admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:27.714029 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622ec05-c543-479f-b9f8-14d9982dfdca admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:27.716014 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5622ec05-c543-479f-b9f8-14d9982dfdca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:27.718401 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5622ec05-c543-479f-b9f8-14d9982dfdca admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:27.737818 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1535/3051] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:42:27.740427 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1517/3052] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:42:27 2022] PUT /identity/v3/projects/3da73abe36a64bde9e9fc9315f1a87b4/users/efd373f4dbd944aa82c96a42545c7479/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:27.765968 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622ec05-c543-479f-b9f8-14d9982dfdca admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:27.805279 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622ec05-c543-479f-b9f8-14d9982dfdca admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:27.827350 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe5921-5989-47b1-881c-a6d7bbff8838 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:27.827706 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe5921-5989-47b1-881c-a6d7bbff8838 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:27.827982 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe5921-5989-47b1-881c-a6d7bbff8838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:27.862669 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-91fe5921-5989-47b1-881c-a6d7bbff8838 None None] MFA Rules not processed for user `efd373f4dbd944aa82c96a42545c7479`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:27.864629 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-91fe5921-5989-47b1-881c-a6d7bbff8838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:27.976555 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1518/3053] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:42:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:42:27.977585 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fe5921-5989-47b1-881c-a6d7bbff8838 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:28.003195 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf3964d-6060-4797-9745-52170cb5186c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:28.004704 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3964d-6060-4797-9745-52170cb5186c admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:28.006644 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3964d-6060-4797-9745-52170cb5186c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:28.007241 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3964d-6060-4797-9745-52170cb5186c admin admin] PATH_INFO: `/v3/projects/d2f8b491e736447ebb4436c6bdd9125f/users/f4abb1099f2648998f7542cd84a737c4/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:28.045918 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf3964d-6060-4797-9745-52170cb5186c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2f8b491e736447ebb4436c6bdd9125f, user_id=f4abb1099f2648998f7542cd84a737c4, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:28.050058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf3964d-6060-4797-9745-52170cb5186c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:28.077209 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1536/3054] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:42:27 2022] PUT /identity/v3/projects/d2f8b491e736447ebb4436c6bdd9125f/users/f4abb1099f2648998f7542cd84a737c4/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:28.082136 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae4cf5-9d39-445f-a788-a6148257652a None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:28.083009 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae4cf5-9d39-445f-a788-a6148257652a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:28.083651 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae4cf5-9d39-445f-a788-a6148257652a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:28.115996 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-1cae4cf5-9d39-445f-a788-a6148257652a None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:28.118423 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1cae4cf5-9d39-445f-a788-a6148257652a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:28.212778 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1537/3055] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:42:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:28.214156 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7b106-36cc-4bb4-89f3-38a225a7b5a9 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:28.214476 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7b106-36cc-4bb4-89f3-38a225a7b5a9 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:28.214727 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7b106-36cc-4bb4-89f3-38a225a7b5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:28.235849 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-eae7b106-36cc-4bb4-89f3-38a225a7b5a9 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:28.237530 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-eae7b106-36cc-4bb4-89f3-38a225a7b5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:28.249408 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fe5921-5989-47b1-881c-a6d7bbff8838 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:28.256283 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca83a527-06f0-4e84-96a0-d2d42614fbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:28.257253 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca83a527-06f0-4e84-96a0-d2d42614fbc1 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:28.257808 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca83a527-06f0-4e84-96a0-d2d42614fbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:28.258313 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca83a527-06f0-4e84-96a0-d2d42614fbc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:28.259301 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca83a527-06f0-4e84-96a0-d2d42614fbc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:28.261758 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca83a527-06f0-4e84-96a0-d2d42614fbc1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:28.309823 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1519/3056] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:42:27 2022] POST /identity/v3/projects => generated 381 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:42:28.311280 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca83a527-06f0-4e84-96a0-d2d42614fbc1 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:28.312998 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ca83a527-06f0-4e84-96a0-d2d42614fbc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:28.321676 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1538/3057] 10.222.0.83 () {58 vars in 967 bytes} [Mon Aug 29 15:42:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:28.323389 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7b106-36cc-4bb4-89f3-38a225a7b5a9 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:28.325231 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:28.333530 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:28.341343 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7b106-36cc-4bb4-89f3-38a225a7b5a9 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:28.427613 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca83a527-06f0-4e84-96a0-d2d42614fbc1 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:28.432291 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf866e-51d6-48c8-a9e9-605671a7ae7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:28.432913 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf866e-51d6-48c8-a9e9-605671a7ae7f service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:28.433194 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf866e-51d6-48c8-a9e9-605671a7ae7f service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:28.433473 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf866e-51d6-48c8-a9e9-605671a7ae7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:28.475205 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d14915-ada0-43c2-a5b2-7630bfc6a833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:28.476428 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d14915-ada0-43c2-a5b2-7630bfc6a833 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:28.476939 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d14915-ada0-43c2-a5b2-7630bfc6a833 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:28.477570 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d14915-ada0-43c2-a5b2-7630bfc6a833 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:28.479372 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d14915-ada0-43c2-a5b2-7630bfc6a833 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:28.482868 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d14915-ada0-43c2-a5b2-7630bfc6a833 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:28.514496 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1539/3058] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:42:28 2022] POST /identity/v3/users => generated 297 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:42:28.515629 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d14915-ada0-43c2-a5b2-7630bfc6a833 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:28.517819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e7d14915-ada0-43c2-a5b2-7630bfc6a833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:28.541984 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cf866e-51d6-48c8-a9e9-605671a7ae7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:28.544237 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cf866e-51d6-48c8-a9e9-605671a7ae7f service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:28.573628 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1520/3059] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:42:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:42:28.577105 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf866e-51d6-48c8-a9e9-605671a7ae7f service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:28.601843 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf866e-51d6-48c8-a9e9-605671a7ae7f service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:28.612833 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75cd75-b70b-4b73-adad-fed1069b7182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:28.615159 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75cd75-b70b-4b73-adad-fed1069b7182 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:28.615544 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75cd75-b70b-4b73-adad-fed1069b7182 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:28.615954 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75cd75-b70b-4b73-adad-fed1069b7182 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:28.617103 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c75cd75-b70b-4b73-adad-fed1069b7182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:28.622021 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c75cd75-b70b-4b73-adad-fed1069b7182 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:28.634049 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d14915-ada0-43c2-a5b2-7630bfc6a833 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:28.639503 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1521/3060] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:42:28.643972 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75cd75-b70b-4b73-adad-fed1069b7182 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:28.652765 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a81870-cafc-4994-be01-ba15ef3bfacc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:28.653678 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a81870-cafc-4994-be01-ba15ef3bfacc service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:28.654126 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a81870-cafc-4994-be01-ba15ef3bfacc service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:28.654439 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a81870-cafc-4994-be01-ba15ef3bfacc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:28.658261 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75cd75-b70b-4b73-adad-fed1069b7182 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:28.674963 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762a8d1-d831-4a9b-a8bc-a17b81b87d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:28.675669 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762a8d1-d831-4a9b-a8bc-a17b81b87d68 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:28.675945 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762a8d1-d831-4a9b-a8bc-a17b81b87d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:28.675945 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762a8d1-d831-4a9b-a8bc-a17b81b87d68 admin admin] PATH_INFO: `/v3/projects/24181c85683240ababef9fe06a0b699b/users/d3f5e81aadde4cf298ab6d122ccd1c83/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:28.705925 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1762a8d1-d831-4a9b-a8bc-a17b81b87d68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24181c85683240ababef9fe06a0b699b, user_id=d3f5e81aadde4cf298ab6d122ccd1c83, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:28.709541 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1762a8d1-d831-4a9b-a8bc-a17b81b87d68 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:28.740339 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1522/3061] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:42:28 2022] PUT /identity/v3/projects/24181c85683240ababef9fe06a0b699b/users/d3f5e81aadde4cf298ab6d122ccd1c83/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:28.744355 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762a8d1-d831-4a9b-a8bc-a17b81b87d68 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:28.768239 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a81870-cafc-4994-be01-ba15ef3bfacc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:28.770039 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a81870-cafc-4994-be01-ba15ef3bfacc service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:28.782441 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1540/3062] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 15:42:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:42:28.866631 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762a8d1-d831-4a9b-a8bc-a17b81b87d68 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:28.882030 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d88d0b-9443-45c4-afeb-f860fe7172fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:28.882691 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d88d0b-9443-45c4-afeb-f860fe7172fd admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:28.883703 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d88d0b-9443-45c4-afeb-f860fe7172fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:28.884988 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d88d0b-9443-45c4-afeb-f860fe7172fd admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:28.886252 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d88d0b-9443-45c4-afeb-f860fe7172fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:28.888712 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d88d0b-9443-45c4-afeb-f860fe7172fd admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:28.903993 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1523/3063] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:42:28.907659 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a81870-cafc-4994-be01-ba15ef3bfacc service swift] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:28.920807 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a81870-cafc-4994-be01-ba15ef3bfacc service swift] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:28.926704 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3856b94-079f-4ae9-95a8-26b82a2b431e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:28.928653 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3856b94-079f-4ae9-95a8-26b82a2b431e admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:28.929203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3856b94-079f-4ae9-95a8-26b82a2b431e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:28.929629 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3856b94-079f-4ae9-95a8-26b82a2b431e admin admin] PATH_INFO: `/v3/projects/24181c85683240ababef9fe06a0b699b/users/d3f5e81aadde4cf298ab6d122ccd1c83/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:28.931927 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3856b94-079f-4ae9-95a8-26b82a2b431e admin admin] RBAC: Authorizing `identity:create_grant(project_id=24181c85683240ababef9fe06a0b699b, user_id=d3f5e81aadde4cf298ab6d122ccd1c83, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:28.934616 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3856b94-079f-4ae9-95a8-26b82a2b431e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:28.955067 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1541/3064] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:42:28 2022] PUT /identity/v3/projects/24181c85683240ababef9fe06a0b699b/users/d3f5e81aadde4cf298ab6d122ccd1c83/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:28.960114 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7027e-0ebb-4af5-ad8c-36066c1a1c2f None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:28.960530 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7027e-0ebb-4af5-ad8c-36066c1a1c2f None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:28.960891 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7027e-0ebb-4af5-ad8c-36066c1a1c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:28.997858 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-81c7027e-0ebb-4af5-ad8c-36066c1a1c2f None None] MFA Rules not processed for user `d3f5e81aadde4cf298ab6d122ccd1c83`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:28.999968 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-81c7027e-0ebb-4af5-ad8c-36066c1a1c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:29.007682 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:29.124492 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1524/3065] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:42:28 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:42:29.126772 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e837b3a-26d1-430a-b5fd-51e41c1782c6 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:29.127340 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e837b3a-26d1-430a-b5fd-51e41c1782c6 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:29.127340 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e837b3a-26d1-430a-b5fd-51e41c1782c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:29.162013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-0e837b3a-26d1-430a-b5fd-51e41c1782c6 None None] MFA Rules not processed for user `efd373f4dbd944aa82c96a42545c7479`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:29.163499 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0e837b3a-26d1-430a-b5fd-51e41c1782c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:29.202004 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:29.273340 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1542/3066] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:42:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:29.673255 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f8b38-9da7-4094-968e-ddbd513ef0b6 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:29.673547 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f8b38-9da7-4094-968e-ddbd513ef0b6 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:29.673823 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f8b38-9da7-4094-968e-ddbd513ef0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:29.717401 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-6b9f8b38-9da7-4094-968e-ddbd513ef0b6 None None] MFA Rules not processed for user `cc90d88d1e574a94858bbe2523855caa`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:29.719693 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6b9f8b38-9da7-4094-968e-ddbd513ef0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:29.883477 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1525/3067] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:42:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:30.117037 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e837b3a-26d1-430a-b5fd-51e41c1782c6 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:30.118580 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0e837b3a-26d1-430a-b5fd-51e41c1782c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:30.305318 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e837b3a-26d1-430a-b5fd-51e41c1782c6 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:30.322803 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b581a-2b26-4911-bbd2-b05f505fe420 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:30.324560 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b581a-2b26-4911-bbd2-b05f505fe420 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:30.324999 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b581a-2b26-4911-bbd2-b05f505fe420 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:30.325413 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b581a-2b26-4911-bbd2-b05f505fe420 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:30.343860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0b581a-2b26-4911-bbd2-b05f505fe420 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:30.350928 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0b581a-2b26-4911-bbd2-b05f505fe420 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:30.376732 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1543/3068] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:42:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:42:30.462961 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023140e3-a9eb-4c8c-88db-c2d4623f2139 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:30.463487 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023140e3-a9eb-4c8c-88db-c2d4623f2139 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:30.463613 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023140e3-a9eb-4c8c-88db-c2d4623f2139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:30.526034 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-023140e3-a9eb-4c8c-88db-c2d4623f2139 None None] MFA Rules not processed for user `09663bec61af43278da1d69c37594558`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:30.527363 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-023140e3-a9eb-4c8c-88db-c2d4623f2139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:30.676723 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1526/3069] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:42:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:39.088574 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302381e-9500-4769-bbbd-6cdd61f2b4b1 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:39.089206 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302381e-9500-4769-bbbd-6cdd61f2b4b1 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:39.089206 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302381e-9500-4769-bbbd-6cdd61f2b4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:39.175108 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-3302381e-9500-4769-bbbd-6cdd61f2b4b1 None None] MFA Rules not processed for user `853f8300f9bb403b9cea4834c5a1edcb`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:39.181488 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3302381e-9500-4769-bbbd-6cdd61f2b4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:39.526883 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1544/3070] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:42:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 439 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:40.655570 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=76 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:48.261086 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5320b0-3712-40c9-a3d7-690b2485f2db None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:48.262331 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5320b0-3712-40c9-a3d7-690b2485f2db None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:48.262842 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5320b0-3712-40c9-a3d7-690b2485f2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:48.309285 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-ce5320b0-3712-40c9-a3d7-690b2485f2db None None] MFA Rules not processed for user `f4abb1099f2648998f7542cd84a737c4`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:48.311873 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ce5320b0-3712-40c9-a3d7-690b2485f2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:48.441672 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1527/3071] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:42:48 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:48.442619 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302381e-9500-4769-bbbd-6cdd61f2b4b1 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:48.597178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:48.606398 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302381e-9500-4769-bbbd-6cdd61f2b4b1 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:48.614126 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d13d40-93aa-4081-be40-1ef0f3943a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:48.615147 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d13d40-93aa-4081-be40-1ef0f3943a7e admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:48.615584 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d13d40-93aa-4081-be40-1ef0f3943a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:48.616029 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d13d40-93aa-4081-be40-1ef0f3943a7e admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:48.617086 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d13d40-93aa-4081-be40-1ef0f3943a7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:48.619326 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d13d40-93aa-4081-be40-1ef0f3943a7e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:48.654961 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1545/3072] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:42:48 2022] POST /identity/v3/projects => generated 389 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:42:48.658995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5320b0-3712-40c9-a3d7-690b2485f2db None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:48.705038 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5320b0-3712-40c9-a3d7-690b2485f2db None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:48.795802 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f2242-4919-434d-8e41-3a5d539e76d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:48.796097 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f2242-4919-434d-8e41-3a5d539e76d5 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:48.796374 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f2242-4919-434d-8e41-3a5d539e76d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:48.796641 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f2242-4919-434d-8e41-3a5d539e76d5 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:48.797272 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f2242-4919-434d-8e41-3a5d539e76d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:48.799204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f2242-4919-434d-8e41-3a5d539e76d5 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:48.826166 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1528/3073] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:42:48 2022] POST /identity/v3/users => generated 301 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:42:48.830485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d13d40-93aa-4081-be40-1ef0f3943a7e admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:48.843738 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d13d40-93aa-4081-be40-1ef0f3943a7e admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:48.849673 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039c2d5-0d68-4b57-abab-b7362bf33c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:48.850452 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039c2d5-0d68-4b57-abab-b7362bf33c42 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:48.850836 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039c2d5-0d68-4b57-abab-b7362bf33c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:48.851241 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039c2d5-0d68-4b57-abab-b7362bf33c42 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:48.851986 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3039c2d5-0d68-4b57-abab-b7362bf33c42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:48.853845 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3039c2d5-0d68-4b57-abab-b7362bf33c42 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:48.867013 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1546/3074] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:42:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:42:48.871420 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f2242-4919-434d-8e41-3a5d539e76d5 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:48.884617 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f2242-4919-434d-8e41-3a5d539e76d5 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:48.889408 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa55e58-f14c-4596-83d4-e81fd242d3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:48.890391 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa55e58-f14c-4596-83d4-e81fd242d3cc admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:48.890739 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa55e58-f14c-4596-83d4-e81fd242d3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:48.891123 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa55e58-f14c-4596-83d4-e81fd242d3cc admin admin] PATH_INFO: `/v3/projects/b8b89579619e464987529c9922f25cda/users/2025c890c98746f2acdcf4c17f2d89da/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:48.911750 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa55e58-f14c-4596-83d4-e81fd242d3cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8b89579619e464987529c9922f25cda, user_id=2025c890c98746f2acdcf4c17f2d89da, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:48.914699 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa55e58-f14c-4596-83d4-e81fd242d3cc admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:48.934307 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1529/3075] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:42:48 2022] PUT /identity/v3/projects/b8b89579619e464987529c9922f25cda/users/2025c890c98746f2acdcf4c17f2d89da/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:42:48.937907 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039c2d5-0d68-4b57-abab-b7362bf33c42 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:48.948728 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039c2d5-0d68-4b57-abab-b7362bf33c42 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:49.013224 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f2bbf-1c3f-4994-bcbf-590045dd9dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:49.014042 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f2bbf-1c3f-4994-bcbf-590045dd9dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:49.014323 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f2bbf-1c3f-4994-bcbf-590045dd9dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:49.014588 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f2bbf-1c3f-4994-bcbf-590045dd9dc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:49.015346 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748f2bbf-1c3f-4994-bcbf-590045dd9dc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:49.017175 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748f2bbf-1c3f-4994-bcbf-590045dd9dc0 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:49.032238 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1547/3076] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:42:48 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:42:49.033478 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa55e58-f14c-4596-83d4-e81fd242d3cc admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:49.045179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa55e58-f14c-4596-83d4-e81fd242d3cc admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:49.049969 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a471cfe9-7840-4c11-ac11-a2ef6187b4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:49.051294 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471cfe9-7840-4c11-ac11-a2ef6187b4cb admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:49.051568 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471cfe9-7840-4c11-ac11-a2ef6187b4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:49.051947 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471cfe9-7840-4c11-ac11-a2ef6187b4cb admin admin] PATH_INFO: `/v3/projects/b8b89579619e464987529c9922f25cda/users/2025c890c98746f2acdcf4c17f2d89da/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:49.054065 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a471cfe9-7840-4c11-ac11-a2ef6187b4cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8b89579619e464987529c9922f25cda, user_id=2025c890c98746f2acdcf4c17f2d89da, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:49.056949 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a471cfe9-7840-4c11-ac11-a2ef6187b4cb admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:49.069062 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1530/3077] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:42:49 2022] PUT /identity/v3/projects/b8b89579619e464987529c9922f25cda/users/2025c890c98746f2acdcf4c17f2d89da/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:50.563466 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f2bbf-1c3f-4994-bcbf-590045dd9dc0 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:50.566806 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-748f2bbf-1c3f-4994-bcbf-590045dd9dc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:50.765820 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f2bbf-1c3f-4994-bcbf-590045dd9dc0 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:50.844867 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632be979-7d25-4527-8df5-e466745c0570 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:50.845869 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632be979-7d25-4527-8df5-e466745c0570 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:50.846393 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632be979-7d25-4527-8df5-e466745c0570 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:50.846886 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632be979-7d25-4527-8df5-e466745c0570 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:50.849974 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-632be979-7d25-4527-8df5-e466745c0570 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:50.925116 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:51.021790 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632be979-7d25-4527-8df5-e466745c0570 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:51.028006 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632be979-7d25-4527-8df5-e466745c0570 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:51.075121 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1548/3078] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:42:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:42:51.861784 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a471cfe9-7840-4c11-ac11-a2ef6187b4cb admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:51.864674 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a471cfe9-7840-4c11-ac11-a2ef6187b4cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:51.981456 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:52.010035 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a471cfe9-7840-4c11-ac11-a2ef6187b4cb admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:52.033501 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525c6e4-ac5b-463f-80ad-3210c59a922d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6b0f9835ed549cab91d684326be83fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:52.034264 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525c6e4-ac5b-463f-80ad-3210c59a922d service glance] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:52.034426 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525c6e4-ac5b-463f-80ad-3210c59a922d service glance] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:52.035254 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525c6e4-ac5b-463f-80ad-3210c59a922d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:52.044051 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3525c6e4-ac5b-463f-80ad-3210c59a922d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:52.107112 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3525c6e4-ac5b-463f-80ad-3210c59a922d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:52.108691 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3525c6e4-ac5b-463f-80ad-3210c59a922d service glance] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:52.147392 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1531/3079] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:42:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:42:53.721718 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61710291-ec61-4933-9348-6616054bd262 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:53.722252 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61710291-ec61-4933-9348-6616054bd262 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:53.722602 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61710291-ec61-4933-9348-6616054bd262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:53.759230 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-61710291-ec61-4933-9348-6616054bd262 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:53.763242 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-61710291-ec61-4933-9348-6616054bd262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:53.865846 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1549/3080] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 15:42:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:53.887213 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525c6e4-ac5b-463f-80ad-3210c59a922d service glance] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:54.014851 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525c6e4-ac5b-463f-80ad-3210c59a922d service glance] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:54.030339 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc5222-b66b-4d76-8a80-5141e60aef4a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:54.030977 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc5222-b66b-4d76-8a80-5141e60aef4a service swift] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:54.031293 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc5222-b66b-4d76-8a80-5141e60aef4a service swift] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:54.031561 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc5222-b66b-4d76-8a80-5141e60aef4a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:54.046466 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc5222-b66b-4d76-8a80-5141e60aef4a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:54.048994 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc5222-b66b-4d76-8a80-5141e60aef4a service swift] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:54.060857 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1532/3081] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 15:42:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:42:59.529391 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61710291-ec61-4933-9348-6616054bd262 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:59.544053 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61710291-ec61-4933-9348-6616054bd262 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:59.555796 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f50f801-bdac-4699-8d5e-f4d8271d1252 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:59.556443 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50f801-bdac-4699-8d5e-f4d8271d1252 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:59.558598 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50f801-bdac-4699-8d5e-f4d8271d1252 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:59.558877 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50f801-bdac-4699-8d5e-f4d8271d1252 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:59.570162 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8f50f801-bdac-4699-8d5e-f4d8271d1252 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:59.585234 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f50f801-bdac-4699-8d5e-f4d8271d1252 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:59.586572 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f50f801-bdac-4699-8d5e-f4d8271d1252 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:59.600148 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1550/3082] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:42:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:43:03.453736 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9ca41-46c4-489e-bb6f-bae3c6884445 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:03.454693 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9ca41-46c4-489e-bb6f-bae3c6884445 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:03.455429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9ca41-46c4-489e-bb6f-bae3c6884445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:03.494028 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-d3e9ca41-46c4-489e-bb6f-bae3c6884445 None None] MFA Rules not processed for user `2025c890c98746f2acdcf4c17f2d89da`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:43:03.495815 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d3e9ca41-46c4-489e-bb6f-bae3c6884445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:03.571702 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f50f801-bdac-4699-8d5e-f4d8271d1252 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:03.609521 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f50f801-bdac-4699-8d5e-f4d8271d1252 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:03.628558 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c98c1-6e4a-4b8b-bab1-4122d87b2c9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:03.629406 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c98c1-6e4a-4b8b-bab1-4122d87b2c9f service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:03.629783 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c98c1-6e4a-4b8b-bab1-4122d87b2c9f service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:03.630170 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c98c1-6e4a-4b8b-bab1-4122d87b2c9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:03.663395 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1533/3083] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:43:03 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:43:03.679820 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9ca41-46c4-489e-bb6f-bae3c6884445 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:03.682053 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d3e9ca41-46c4-489e-bb6f-bae3c6884445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:03.859208 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c98c1-6e4a-4b8b-bab1-4122d87b2c9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:03.864419 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c98c1-6e4a-4b8b-bab1-4122d87b2c9f service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:03.886944 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:03.892643 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1551/3084] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:43:03 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:43:03.945323 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9ca41-46c4-489e-bb6f-bae3c6884445 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:03.953987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfb096-d4ae-40ea-a0f0-046116b35239 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:03.954617 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfb096-d4ae-40ea-a0f0-046116b35239 service cinder] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:03.954983 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfb096-d4ae-40ea-a0f0-046116b35239 service cinder] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:03.955290 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfb096-d4ae-40ea-a0f0-046116b35239 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:04.113873 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bfb096-d4ae-40ea-a0f0-046116b35239 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:04.115401 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bfb096-d4ae-40ea-a0f0-046116b35239 service cinder] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:04.140437 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1534/3085] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:43:03 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:43:05.436466 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bc283-9671-4acc-a098-d8f9fe94b5c4 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:05.437161 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bc283-9671-4acc-a098-d8f9fe94b5c4 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:05.437161 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bc283-9671-4acc-a098-d8f9fe94b5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:05.491004 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-fe6bc283-9671-4acc-a098-d8f9fe94b5c4 None None] MFA Rules not processed for user `efd373f4dbd944aa82c96a42545c7479`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:43:05.492346 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-fe6bc283-9671-4acc-a098-d8f9fe94b5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:05.666571 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:05.692996 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1552/3086] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:43:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:43:08.039985 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfb096-d4ae-40ea-a0f0-046116b35239 service cinder] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:08.041742 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e9bfb096-d4ae-40ea-a0f0-046116b35239 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:08.216723 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6bc283-9671-4acc-a098-d8f9fe94b5c4 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:08.243660 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6bc283-9671-4acc-a098-d8f9fe94b5c4 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:08.259495 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33653233-f3c0-44c7-acdc-c968d40516d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:08.260378 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33653233-f3c0-44c7-acdc-c968d40516d6 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:08.260876 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfb096-d4ae-40ea-a0f0-046116b35239 service cinder] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:08.261119 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33653233-f3c0-44c7-acdc-c968d40516d6 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:08.261560 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33653233-f3c0-44c7-acdc-c968d40516d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:08.268152 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-33653233-f3c0-44c7-acdc-c968d40516d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:08.274427 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1623ec-5ccf-45a7-9007-4e86ae6d841f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:08.280732 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1623ec-5ccf-45a7-9007-4e86ae6d841f service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:08.281238 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1623ec-5ccf-45a7-9007-4e86ae6d841f service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:08.281625 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1623ec-5ccf-45a7-9007-4e86ae6d841f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:08.288336 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-dd1623ec-5ccf-45a7-9007-4e86ae6d841f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:08.311257 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33653233-f3c0-44c7-acdc-c968d40516d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:08.312046 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1623ec-5ccf-45a7-9007-4e86ae6d841f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:08.314217 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33653233-f3c0-44c7-acdc-c968d40516d6 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:08.314600 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1623ec-5ccf-45a7-9007-4e86ae6d841f service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:08.339697 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1535/3087] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:43:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:43:08.342443 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1553/3088] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:43:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:43:17.440627 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a21a5-6669-4781-8576-8eee5aa1b310 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:17.441376 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a21a5-6669-4781-8576-8eee5aa1b310 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:17.441376 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a21a5-6669-4781-8576-8eee5aa1b310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:17.476163 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-546a21a5-6669-4781-8576-8eee5aa1b310 None None] MFA Rules not processed for user `f12698b45a114720af9c98b163077f59`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:43:17.482769 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-546a21a5-6669-4781-8576-8eee5aa1b310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:17.595125 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1536/3089] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:43:17 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:43:18.334169 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=8 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:26.476400 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33653233-f3c0-44c7-acdc-c968d40516d6 service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:26.478643 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-33653233-f3c0-44c7-acdc-c968d40516d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:26.496497 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33653233-f3c0-44c7-acdc-c968d40516d6 service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:26.504145 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d75a56-21a5-45f0-8751-9a1bfcdcf651 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:26.505035 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d75a56-21a5-45f0-8751-9a1bfcdcf651 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:26.505500 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d75a56-21a5-45f0-8751-9a1bfcdcf651 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:26.505954 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d75a56-21a5-45f0-8751-9a1bfcdcf651 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:26.508141 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-31d75a56-21a5-45f0-8751-9a1bfcdcf651 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:26.525789 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d75a56-21a5-45f0-8751-9a1bfcdcf651 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:26.527952 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d75a56-21a5-45f0-8751-9a1bfcdcf651 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:26.555383 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1554/3090] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:43:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:43:27.572140 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=87 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:27.608819 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a21a5-6669-4781-8576-8eee5aa1b310 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:27.644322 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a21a5-6669-4781-8576-8eee5aa1b310 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:27.667306 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e34f0a8-7cd3-40b6-aa31-f90fd6a28bca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:27.667306 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34f0a8-7cd3-40b6-aa31-f90fd6a28bca service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:27.667306 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34f0a8-7cd3-40b6-aa31-f90fd6a28bca service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:27.667306 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34f0a8-7cd3-40b6-aa31-f90fd6a28bca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:27.670378 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6e34f0a8-7cd3-40b6-aa31-f90fd6a28bca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:27.745086 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e34f0a8-7cd3-40b6-aa31-f90fd6a28bca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:27.748913 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e34f0a8-7cd3-40b6-aa31-f90fd6a28bca service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:27.778939 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1537/3091] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:43:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:43:27.808331 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068331d-1d6d-4cb0-910a-344d0a57af42 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:27.808888 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068331d-1d6d-4cb0-910a-344d0a57af42 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:27.808888 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068331d-1d6d-4cb0-910a-344d0a57af42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:27.856018 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-4068331d-1d6d-4cb0-910a-344d0a57af42 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:43:27.858081 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4068331d-1d6d-4cb0-910a-344d0a57af42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:27.895714 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1555/3092] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 15:43:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:43:27.903335 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e34f0a8-7cd3-40b6-aa31-f90fd6a28bca service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:27.930143 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e34f0a8-7cd3-40b6-aa31-f90fd6a28bca service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:27.961412 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a7c95-a60f-4f51-9696-88a2b50e2216 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:27.963743 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a7c95-a60f-4f51-9696-88a2b50e2216 service swift] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:27.964029 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a7c95-a60f-4f51-9696-88a2b50e2216 service swift] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:27.964305 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a7c95-a60f-4f51-9696-88a2b50e2216 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:27.999826 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1a7c95-a60f-4f51-9696-88a2b50e2216 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:28.001437 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1a7c95-a60f-4f51-9696-88a2b50e2216 service swift] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:28.013620 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1538/3093] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 15:43:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 15:43:29.459040 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068331d-1d6d-4cb0-910a-344d0a57af42 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:29.461132 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4068331d-1d6d-4cb0-910a-344d0a57af42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:29.706126 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068331d-1d6d-4cb0-910a-344d0a57af42 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:29.716966 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7348140-7328-43d9-9eac-3304da36ad97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:29.717620 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7348140-7328-43d9-9eac-3304da36ad97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:29.717897 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7348140-7328-43d9-9eac-3304da36ad97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:29.718167 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7348140-7328-43d9-9eac-3304da36ad97 admin admin] PATH_INFO: `/v3/users/53387bcdf14248b9bdf716e782b786d7` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:29.721691 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7348140-7328-43d9-9eac-3304da36ad97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53387bcdf14248b9bdf716e782b786d7)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:29.728280 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7348140-7328-43d9-9eac-3304da36ad97 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:29.841465 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c7348140-7328-43d9-9eac-3304da36ad97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53387bcdf14248b9bdf716e782b786d7'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:29.842351 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c7348140-7328-43d9-9eac-3304da36ad97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53387bcdf14248b9bdf716e782b786d7'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:29.875671 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c7348140-7328-43d9-9eac-3304da36ad97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53387bcdf14248b9bdf716e782b786d7'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:29.895609 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c7348140-7328-43d9-9eac-3304da36ad97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53387bcdf14248b9bdf716e782b786d7'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:29.910973 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c7348140-7328-43d9-9eac-3304da36ad97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53387bcdf14248b9bdf716e782b786d7'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:29.923712 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1556/3094] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:43:29 2022] DELETE /identity/v3/users/53387bcdf14248b9bdf716e782b786d7 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:43:30.256693 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a7c95-a60f-4f51-9696-88a2b50e2216 service swift] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:30.279259 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a7c95-a60f-4f51-9696-88a2b50e2216 service swift] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:30.405494 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9a296-20d1-4d18-9488-3122cc7e79c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:30.405494 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9a296-20d1-4d18-9488-3122cc7e79c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:30.405494 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9a296-20d1-4d18-9488-3122cc7e79c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:30.405494 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9a296-20d1-4d18-9488-3122cc7e79c9 admin admin] PATH_INFO: `/v3/projects/b14d17b6ccdc4d4d874ff1e303d3eb6c` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:30.406257 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c9a296-20d1-4d18-9488-3122cc7e79c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b14d17b6ccdc4d4d874ff1e303d3eb6c)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:30.410672 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c9a296-20d1-4d18-9488-3122cc7e79c9 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:30.471866 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a7c9a296-20d1-4d18-9488-3122cc7e79c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b14d17b6ccdc4d4d874ff1e303d3eb6c', 'request_id': 'req-a7c9a296-20d1-4d18-9488-3122cc7e79c9'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:30.481554 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a7c9a296-20d1-4d18-9488-3122cc7e79c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b14d17b6ccdc4d4d874ff1e303d3eb6c', 'request_id': 'req-a7c9a296-20d1-4d18-9488-3122cc7e79c9'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:30.493510 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a7c9a296-20d1-4d18-9488-3122cc7e79c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b14d17b6ccdc4d4d874ff1e303d3eb6c', 'request_id': 'req-a7c9a296-20d1-4d18-9488-3122cc7e79c9'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:30.514049 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a7c9a296-20d1-4d18-9488-3122cc7e79c9 admin admin] The token cache is being invalidate because project b14d17b6ccdc4d4d874ff1e303d3eb6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:43:30.514364 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a7c9a296-20d1-4d18-9488-3122cc7e79c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:30.515101 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a7c9a296-20d1-4d18-9488-3122cc7e79c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:30.517411 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1539/3095] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:43:30 2022] DELETE /identity/v3/projects/b14d17b6ccdc4d4d874ff1e303d3eb6c => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:43:30.521817 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7348140-7328-43d9-9eac-3304da36ad97 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:30.524756 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c7348140-7328-43d9-9eac-3304da36ad97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:30.540895 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7348140-7328-43d9-9eac-3304da36ad97 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:30.647069 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c7354-f597-474e-862d-c9a8eb70e188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:30.647713 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c7354-f597-474e-862d-c9a8eb70e188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:30.647988 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c7354-f597-474e-862d-c9a8eb70e188 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:30.648255 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c7354-f597-474e-862d-c9a8eb70e188 admin admin] PATH_INFO: `/v3/users/d6b7cd8a80a14209a18d66171186acaf` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:30.649404 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c7354-f597-474e-862d-c9a8eb70e188 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6b7cd8a80a14209a18d66171186acaf)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:30.651432 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c7354-f597-474e-862d-c9a8eb70e188 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:30.653366 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:30.733666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4a9c7354-f597-474e-862d-c9a8eb70e188 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6b7cd8a80a14209a18d66171186acaf'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:30.736681 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4a9c7354-f597-474e-862d-c9a8eb70e188 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6b7cd8a80a14209a18d66171186acaf'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:30.780210 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4a9c7354-f597-474e-862d-c9a8eb70e188 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6b7cd8a80a14209a18d66171186acaf'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:30.794751 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4a9c7354-f597-474e-862d-c9a8eb70e188 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6b7cd8a80a14209a18d66171186acaf'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:30.809317 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4a9c7354-f597-474e-862d-c9a8eb70e188 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6b7cd8a80a14209a18d66171186acaf'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:30.826286 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1557/3096] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:43:30 2022] DELETE /identity/v3/users/d6b7cd8a80a14209a18d66171186acaf => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:43:31.324956 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9a296-20d1-4d18-9488-3122cc7e79c9 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:31.326377 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a7c9a296-20d1-4d18-9488-3122cc7e79c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:31.358613 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9a296-20d1-4d18-9488-3122cc7e79c9 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:31.568708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2402b4c-9e43-4798-a220-7bc80ac26dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:31.569558 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2402b4c-9e43-4798-a220-7bc80ac26dbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:31.570844 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2402b4c-9e43-4798-a220-7bc80ac26dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:31.571349 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2402b4c-9e43-4798-a220-7bc80ac26dbb admin admin] PATH_INFO: `/v3/projects/a622fa01676b457e8bc242b060df727a` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:31.572710 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2402b4c-9e43-4798-a220-7bc80ac26dbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a622fa01676b457e8bc242b060df727a)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:31.575760 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2402b4c-9e43-4798-a220-7bc80ac26dbb admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:31.601636 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:31.689201 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b2402b4c-9e43-4798-a220-7bc80ac26dbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a622fa01676b457e8bc242b060df727a', 'request_id': 'req-b2402b4c-9e43-4798-a220-7bc80ac26dbb'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:31.705811 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b2402b4c-9e43-4798-a220-7bc80ac26dbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a622fa01676b457e8bc242b060df727a', 'request_id': 'req-b2402b4c-9e43-4798-a220-7bc80ac26dbb'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:31.723120 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b2402b4c-9e43-4798-a220-7bc80ac26dbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a622fa01676b457e8bc242b060df727a', 'request_id': 'req-b2402b4c-9e43-4798-a220-7bc80ac26dbb'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:31.753942 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b2402b4c-9e43-4798-a220-7bc80ac26dbb admin admin] The token cache is being invalidate because project a622fa01676b457e8bc242b060df727a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:43:31.754489 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b2402b4c-9e43-4798-a220-7bc80ac26dbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:31.755388 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b2402b4c-9e43-4798-a220-7bc80ac26dbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:31.763623 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1540/3097] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:43:31 2022] DELETE /identity/v3/projects/a622fa01676b457e8bc242b060df727a => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:43:31.767214 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d325447-0362-4b9c-b1c5-39195d71c790 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:31.767214 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d325447-0362-4b9c-b1c5-39195d71c790 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:31.769490 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d325447-0362-4b9c-b1c5-39195d71c790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:31.806344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-5d325447-0362-4b9c-b1c5-39195d71c790 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:43:31.808002 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5d325447-0362-4b9c-b1c5-39195d71c790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:31.960842 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1558/3098] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:43:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:43:31.964345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c11c23-af80-4ab4-9268-603786be4235 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:31.964880 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c11c23-af80-4ab4-9268-603786be4235 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:31.965271 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c11c23-af80-4ab4-9268-603786be4235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:32.024932 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-53c11c23-af80-4ab4-9268-603786be4235 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:43:32.026230 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-53c11c23-af80-4ab4-9268-603786be4235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:32.044250 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1541/3099] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:43:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:43:32.049184 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d325447-0362-4b9c-b1c5-39195d71c790 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:32.062677 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d325447-0362-4b9c-b1c5-39195d71c790 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:32.068479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf27f9-76ad-481c-a7a3-fa43d6384b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:32.069141 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf27f9-76ad-481c-a7a3-fa43d6384b1b admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:32.069442 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf27f9-76ad-481c-a7a3-fa43d6384b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:32.069771 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf27f9-76ad-481c-a7a3-fa43d6384b1b admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:32.070610 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf27f9-76ad-481c-a7a3-fa43d6384b1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:43:32.071212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf27f9-76ad-481c-a7a3-fa43d6384b1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:32.075863 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf27f9-76ad-481c-a7a3-fa43d6384b1b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:32.115636 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c11c23-af80-4ab4-9268-603786be4235 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:32.122295 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1559/3100] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:43:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:43:32.128197 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c11c23-af80-4ab4-9268-603786be4235 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:32.133473 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a2efc-e23f-44ef-aa09-3515782354b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:32.134105 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a2efc-e23f-44ef-aa09-3515782354b7 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:32.134367 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a2efc-e23f-44ef-aa09-3515782354b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:32.134634 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a2efc-e23f-44ef-aa09-3515782354b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:32.135333 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799a2efc-e23f-44ef-aa09-3515782354b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:32.137846 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799a2efc-e23f-44ef-aa09-3515782354b7 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:32.181789 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1542/3101] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:43:32 2022] POST /identity/v3/projects => generated 397 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:43:32.187918 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf27f9-76ad-481c-a7a3-fa43d6384b1b admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:32.200865 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf27f9-76ad-481c-a7a3-fa43d6384b1b admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:32.305898 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a891f18-38f9-4e84-adf4-de074ae83bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:32.306809 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a891f18-38f9-4e84-adf4-de074ae83bcc admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:32.307124 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a891f18-38f9-4e84-adf4-de074ae83bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:32.307404 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a891f18-38f9-4e84-adf4-de074ae83bcc admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:32.308103 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a891f18-38f9-4e84-adf4-de074ae83bcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:32.310304 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a891f18-38f9-4e84-adf4-de074ae83bcc admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:32.327190 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:32.345246 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1560/3102] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:43:32 2022] POST /identity/v3/users => generated 299 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:43:32.346071 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a2efc-e23f-44ef-aa09-3515782354b7 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:32.364708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a2efc-e23f-44ef-aa09-3515782354b7 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:32.376642 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd4d6b6-0b72-4bf4-8a7d-956c8d7da8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:32.377895 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd4d6b6-0b72-4bf4-8a7d-956c8d7da8b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:32.382436 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd4d6b6-0b72-4bf4-8a7d-956c8d7da8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:32.382859 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd4d6b6-0b72-4bf4-8a7d-956c8d7da8b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:32.383961 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd4d6b6-0b72-4bf4-8a7d-956c8d7da8b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:32.385688 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd4d6b6-0b72-4bf4-8a7d-956c8d7da8b2 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:32.411992 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1543/3103] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:43:32 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:43:32.418946 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a891f18-38f9-4e84-adf4-de074ae83bcc admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:32.435437 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a891f18-38f9-4e84-adf4-de074ae83bcc admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:32.442468 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d3d5ce-cb62-4134-aa91-6d53b1f25710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:32.443237 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3d5ce-cb62-4134-aa91-6d53b1f25710 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:32.443618 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3d5ce-cb62-4134-aa91-6d53b1f25710 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:32.443975 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3d5ce-cb62-4134-aa91-6d53b1f25710 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:32.444734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d3d5ce-cb62-4134-aa91-6d53b1f25710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:32.446592 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d3d5ce-cb62-4134-aa91-6d53b1f25710 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:32.467142 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1561/3104] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:43:32 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:43:32.471827 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd4d6b6-0b72-4bf4-8a7d-956c8d7da8b2 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:32.486607 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd4d6b6-0b72-4bf4-8a7d-956c8d7da8b2 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:32.493394 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a70af60-8a29-423c-b478-9e6a3e0c93a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:32.494245 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70af60-8a29-423c-b478-9e6a3e0c93a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:32.494614 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70af60-8a29-423c-b478-9e6a3e0c93a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:32.495053 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70af60-8a29-423c-b478-9e6a3e0c93a9 admin admin] PATH_INFO: `/v3/projects/bd150e4d120d4c6584c650e747abb6a4/users/0c19d2e9ffa64e7586e35035176f1c26/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:32.516982 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a70af60-8a29-423c-b478-9e6a3e0c93a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd150e4d120d4c6584c650e747abb6a4, user_id=0c19d2e9ffa64e7586e35035176f1c26, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:32.523939 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a70af60-8a29-423c-b478-9e6a3e0c93a9 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:32.552377 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1544/3105] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:43:32 2022] PUT /identity/v3/projects/bd150e4d120d4c6584c650e747abb6a4/users/0c19d2e9ffa64e7586e35035176f1c26/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:43:32.552632 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16d54f-ada5-4e19-ada4-d60fa41606e9 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:32.552632 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16d54f-ada5-4e19-ada4-d60fa41606e9 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:32.552632 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16d54f-ada5-4e19-ada4-d60fa41606e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:32.584661 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-2a16d54f-ada5-4e19-ada4-d60fa41606e9 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:43:32.585831 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2a16d54f-ada5-4e19-ada4-d60fa41606e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:32.661220 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1562/3106] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:43:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:43:32.674883 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a70af60-8a29-423c-b478-9e6a3e0c93a9 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:32.677062 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4a70af60-8a29-423c-b478-9e6a3e0c93a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:32.781148 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a70af60-8a29-423c-b478-9e6a3e0c93a9 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:32.789151 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393c48e-16e9-48a4-a50c-23353f41dadd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:32.790128 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393c48e-16e9-48a4-a50c-23353f41dadd service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:32.790480 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393c48e-16e9-48a4-a50c-23353f41dadd service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:32.790826 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393c48e-16e9-48a4-a50c-23353f41dadd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:32.809538 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2393c48e-16e9-48a4-a50c-23353f41dadd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:32.811144 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2393c48e-16e9-48a4-a50c-23353f41dadd service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:32.824320 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1545/3107] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:43:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:43:38.959185 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16d54f-ada5-4e19-ada4-d60fa41606e9 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:38.961587 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2a16d54f-ada5-4e19-ada4-d60fa41606e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:39.156916 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16d54f-ada5-4e19-ada4-d60fa41606e9 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:39.180741 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f774e99-5fab-426c-aa56-9797a7a30550 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:39.182976 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f774e99-5fab-426c-aa56-9797a7a30550 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:39.185063 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f774e99-5fab-426c-aa56-9797a7a30550 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:39.186342 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f774e99-5fab-426c-aa56-9797a7a30550 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:39.190013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3f774e99-5fab-426c-aa56-9797a7a30550 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:39.207222 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f774e99-5fab-426c-aa56-9797a7a30550 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:39.210240 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f774e99-5fab-426c-aa56-9797a7a30550 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:39.255463 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1563/3108] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:43:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:43:39.802530 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ff79f-bf7a-4c83-8577-7124b7a5723a None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:39.803494 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ff79f-bf7a-4c83-8577-7124b7a5723a None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:39.803926 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ff79f-bf7a-4c83-8577-7124b7a5723a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:39.850854 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-094ff79f-bf7a-4c83-8577-7124b7a5723a None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:43:39.854395 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-094ff79f-bf7a-4c83-8577-7124b7a5723a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:39.947640 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:40.016565 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1546/3109] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 15:43:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:43:40.032559 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f774e99-5fab-426c-aa56-9797a7a30550 service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:40.034619 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3f774e99-5fab-426c-aa56-9797a7a30550 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:40.402971 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f774e99-5fab-426c-aa56-9797a7a30550 service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:40.409801 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5186d-7bd0-48e9-a843-feb69ae88190 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:40.411290 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5186d-7bd0-48e9-a843-feb69ae88190 service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:40.411752 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5186d-7bd0-48e9-a843-feb69ae88190 service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:40.412193 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5186d-7bd0-48e9-a843-feb69ae88190 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:40.422308 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f5186d-7bd0-48e9-a843-feb69ae88190 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:40.425661 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f5186d-7bd0-48e9-a843-feb69ae88190 service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:40.432557 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:40.443125 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1564/3110] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 15:43:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:43:40.804008 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae63e59-7b10-4cd9-b6fd-5ec599020977 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:40.804545 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae63e59-7b10-4cd9-b6fd-5ec599020977 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:40.804545 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae63e59-7b10-4cd9-b6fd-5ec599020977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:40.915991 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-dae63e59-7b10-4cd9-b6fd-5ec599020977 None None] MFA Rules not processed for user `0c19d2e9ffa64e7586e35035176f1c26`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:43:40.920259 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-dae63e59-7b10-4cd9-b6fd-5ec599020977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:41.062292 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1547/3111] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:43:40 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:43:41.072388 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4c52f-39bc-43b3-8b40-c4ce63803d44 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:41.073778 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4c52f-39bc-43b3-8b40-c4ce63803d44 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:41.074214 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4c52f-39bc-43b3-8b40-c4ce63803d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:41.117666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-2dd4c52f-39bc-43b3-8b40-c4ce63803d44 None None] MFA Rules not processed for user `0c19d2e9ffa64e7586e35035176f1c26`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:43:41.120248 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2dd4c52f-39bc-43b3-8b40-c4ce63803d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:41.139495 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1565/3112] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:43:41 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:43:46.208284 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae63e59-7b10-4cd9-b6fd-5ec599020977 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:46.231243 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae63e59-7b10-4cd9-b6fd-5ec599020977 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:46.263288 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99497613-0860-44df-9171-5acfd33e7a56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:46.264235 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99497613-0860-44df-9171-5acfd33e7a56 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:46.264674 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99497613-0860-44df-9171-5acfd33e7a56 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:46.265102 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99497613-0860-44df-9171-5acfd33e7a56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:46.288249 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99497613-0860-44df-9171-5acfd33e7a56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:46.292105 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99497613-0860-44df-9171-5acfd33e7a56 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:46.317906 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1548/3113] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:43:46 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:43:47.085145 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4c52f-39bc-43b3-8b40-c4ce63803d44 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:47.087512 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2dd4c52f-39bc-43b3-8b40-c4ce63803d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:47.247989 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99497613-0860-44df-9171-5acfd33e7a56 service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:47.260235 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99497613-0860-44df-9171-5acfd33e7a56 service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:47.267745 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4c52f-39bc-43b3-8b40-c4ce63803d44 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:47.273204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c01eaf-476a-41a7-acc8-6e528a084b84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:47.275808 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c01eaf-476a-41a7-acc8-6e528a084b84 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:47.276133 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c01eaf-476a-41a7-acc8-6e528a084b84 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:47.276399 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c01eaf-476a-41a7-acc8-6e528a084b84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:47.284447 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa27b2-0dfe-4236-8c89-0f85c23ec81a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:47.285087 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa27b2-0dfe-4236-8c89-0f85c23ec81a service cinder] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:47.286180 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-45c01eaf-476a-41a7-acc8-6e528a084b84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:47.290734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa27b2-0dfe-4236-8c89-0f85c23ec81a service cinder] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:47.291073 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa27b2-0dfe-4236-8c89-0f85c23ec81a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:47.300691 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-96fa27b2-0dfe-4236-8c89-0f85c23ec81a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:47.321265 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c01eaf-476a-41a7-acc8-6e528a084b84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:47.322936 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c01eaf-476a-41a7-acc8-6e528a084b84 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:47.358549 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1549/3114] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:43:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:43:47.473408 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa27b2-0dfe-4236-8c89-0f85c23ec81a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:47.475348 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa27b2-0dfe-4236-8c89-0f85c23ec81a service cinder] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:47.499604 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1566/3115] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:43:47 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:43:54.168118 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffaa027-20ee-4bf1-86db-1d578ff94354 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:54.169967 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffaa027-20ee-4bf1-86db-1d578ff94354 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:54.170459 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffaa027-20ee-4bf1-86db-1d578ff94354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:54.228562 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-cffaa027-20ee-4bf1-86db-1d578ff94354 None None] MFA Rules not processed for user `efd373f4dbd944aa82c96a42545c7479`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:43:54.233209 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-cffaa027-20ee-4bf1-86db-1d578ff94354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:54.450056 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1550/3116] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:43:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:43:57.485894 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=51 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:59.990914 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ab1c5-a587-41ea-9838-d7a6b5347f5d None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:59.992037 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ab1c5-a587-41ea-9838-d7a6b5347f5d None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:59.992537 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ab1c5-a587-41ea-9838-d7a6b5347f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:00.020779 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-de4ab1c5-a587-41ea-9838-d7a6b5347f5d None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:44:00.024268 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-de4ab1c5-a587-41ea-9838-d7a6b5347f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:00.059509 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1567/3117] 10.222.0.83 () {58 vars in 967 bytes} [Mon Aug 29 15:43:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:44:00.082508 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffaa027-20ee-4bf1-86db-1d578ff94354 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:00.112083 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffaa027-20ee-4bf1-86db-1d578ff94354 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:00.124916 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bfdb0d-1d35-4b15-9c1e-b19fd76c5768 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:00.126673 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfdb0d-1d35-4b15-9c1e-b19fd76c5768 service swift] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:00.127424 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfdb0d-1d35-4b15-9c1e-b19fd76c5768 service swift] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:00.128050 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfdb0d-1d35-4b15-9c1e-b19fd76c5768 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:00.141413 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bfdb0d-1d35-4b15-9c1e-b19fd76c5768 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:00.146642 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bfdb0d-1d35-4b15-9c1e-b19fd76c5768 service swift] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:00.169447 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1551/3118] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 15:44:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:44:00.749782 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa59a48-7773-49fa-a79e-f6edd2ffe426 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:00.750363 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa59a48-7773-49fa-a79e-f6edd2ffe426 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:00.751527 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa59a48-7773-49fa-a79e-f6edd2ffe426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:00.785239 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-4aa59a48-7773-49fa-a79e-f6edd2ffe426 None None] MFA Rules not processed for user `853f8300f9bb403b9cea4834c5a1edcb`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:44:00.786512 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4aa59a48-7773-49fa-a79e-f6edd2ffe426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:01.099915 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1568/3119] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:44:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:44:01.411868 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708111b-6af5-4a60-bdc7-f7372267c73a None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:01.412882 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708111b-6af5-4a60-bdc7-f7372267c73a None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:01.413311 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708111b-6af5-4a60-bdc7-f7372267c73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:01.480282 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-d708111b-6af5-4a60-bdc7-f7372267c73a None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:44:01.482193 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d708111b-6af5-4a60-bdc7-f7372267c73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:01.492346 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1552/3120] 10.222.0.83 () {58 vars in 967 bytes} [Mon Aug 29 15:44:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:44:01.524849 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa59a48-7773-49fa-a79e-f6edd2ffe426 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:01.547108 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa59a48-7773-49fa-a79e-f6edd2ffe426 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:01.554789 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e61fa4c-ef2d-45a9-8162-0a1a7b6f04d8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:01.555898 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61fa4c-ef2d-45a9-8162-0a1a7b6f04d8 service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:01.556407 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61fa4c-ef2d-45a9-8162-0a1a7b6f04d8 service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:01.556753 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61fa4c-ef2d-45a9-8162-0a1a7b6f04d8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:01.567563 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e61fa4c-ef2d-45a9-8162-0a1a7b6f04d8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:01.596555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e61fa4c-ef2d-45a9-8162-0a1a7b6f04d8 service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:01.621672 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1569/3121] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 15:44:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:44:04.146679 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708111b-6af5-4a60-bdc7-f7372267c73a None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:04.148352 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d708111b-6af5-4a60-bdc7-f7372267c73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:04.166987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708111b-6af5-4a60-bdc7-f7372267c73a None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:04.180362 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a6f74a-5067-4648-be03-2d16a3fe1b9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:04.184926 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6f74a-5067-4648-be03-2d16a3fe1b9f service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:04.185328 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6f74a-5067-4648-be03-2d16a3fe1b9f service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:04.185611 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6f74a-5067-4648-be03-2d16a3fe1b9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:04.200956 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-10a6f74a-5067-4648-be03-2d16a3fe1b9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:04.222969 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a6f74a-5067-4648-be03-2d16a3fe1b9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:04.224467 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a6f74a-5067-4648-be03-2d16a3fe1b9f service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:04.263453 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1553/3122] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:44:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:44:04.266119 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa311d75-6f2c-4d2a-872c-3f2f47bd367f None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:04.267198 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa311d75-6f2c-4d2a-872c-3f2f47bd367f None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:04.267915 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa311d75-6f2c-4d2a-872c-3f2f47bd367f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:04.311390 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-aa311d75-6f2c-4d2a-872c-3f2f47bd367f None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:44:04.313527 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-aa311d75-6f2c-4d2a-872c-3f2f47bd367f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:04.323581 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1570/3123] 10.222.0.83 () {58 vars in 967 bytes} [Mon Aug 29 15:44:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:44:04.341398 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a6f74a-5067-4648-be03-2d16a3fe1b9f service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:04.359590 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a6f74a-5067-4648-be03-2d16a3fe1b9f service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:04.367378 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef286f3-4e77-4b4d-a56f-f2b718e2b9f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:04.368922 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef286f3-4e77-4b4d-a56f-f2b718e2b9f4 service swift] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:04.369548 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef286f3-4e77-4b4d-a56f-f2b718e2b9f4 service swift] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:04.370098 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef286f3-4e77-4b4d-a56f-f2b718e2b9f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:04.383773 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef286f3-4e77-4b4d-a56f-f2b718e2b9f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:04.386547 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef286f3-4e77-4b4d-a56f-f2b718e2b9f4 service swift] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:04.395716 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:04.413584 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1554/3124] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 15:44:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:44:06.498667 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81cf67e-bae5-46d4-b3e2-559d788b46e4 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:06.499695 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81cf67e-bae5-46d4-b3e2-559d788b46e4 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:06.500522 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81cf67e-bae5-46d4-b3e2-559d788b46e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:06.546592 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-a81cf67e-bae5-46d4-b3e2-559d788b46e4 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:44:06.551076 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a81cf67e-bae5-46d4-b3e2-559d788b46e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:06.577973 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1571/3125] 10.222.0.83 () {58 vars in 967 bytes} [Mon Aug 29 15:44:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:44:06.592999 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef286f3-4e77-4b4d-a56f-f2b718e2b9f4 service swift] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:06.607772 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef286f3-4e77-4b4d-a56f-f2b718e2b9f4 service swift] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:06.614914 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31262e2a-73bb-40f7-bbb6-e63fff77f10b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:06.615896 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31262e2a-73bb-40f7-bbb6-e63fff77f10b service swift] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:06.616372 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31262e2a-73bb-40f7-bbb6-e63fff77f10b service swift] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:06.616644 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31262e2a-73bb-40f7-bbb6-e63fff77f10b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:06.627223 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31262e2a-73bb-40f7-bbb6-e63fff77f10b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:06.629109 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31262e2a-73bb-40f7-bbb6-e63fff77f10b service swift] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:06.665560 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1555/3126] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 15:44:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:44:06.840277 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844f0be-b0bb-4cb6-900c-561c24b971b6 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:06.840448 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844f0be-b0bb-4cb6-900c-561c24b971b6 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:06.840727 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844f0be-b0bb-4cb6-900c-561c24b971b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:06.882870 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-5844f0be-b0bb-4cb6-900c-561c24b971b6 None None] MFA Rules not processed for user `cc90d88d1e574a94858bbe2523855caa`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:44:06.884138 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5844f0be-b0bb-4cb6-900c-561c24b971b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:07.049449 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1572/3127] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:44:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:44:07.745061 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51026912-b2ce-4ee6-b6a7-c435994e3152 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:07.745615 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51026912-b2ce-4ee6-b6a7-c435994e3152 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:07.745866 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51026912-b2ce-4ee6-b6a7-c435994e3152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:07.801629 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-51026912-b2ce-4ee6-b6a7-c435994e3152 None None] MFA Rules not processed for user `09663bec61af43278da1d69c37594558`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:44:07.802977 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-51026912-b2ce-4ee6-b6a7-c435994e3152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:07.887647 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1556/3128] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:44:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:44:17.031079 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=65 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:17.879387 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=31 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:20.814501 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef517a24-4e80-41f0-a667-21ef25069c7a None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:20.815049 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef517a24-4e80-41f0-a667-21ef25069c7a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:20.815049 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef517a24-4e80-41f0-a667-21ef25069c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:20.835247 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-ef517a24-4e80-41f0-a667-21ef25069c7a None None] MFA Rules not processed for user `0c19d2e9ffa64e7586e35035176f1c26`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:44:20.836763 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ef517a24-4e80-41f0-a667-21ef25069c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:20.848814 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1573/3129] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:44:20 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:44:21.114287 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936ad9e-6222-4af6-84df-0878c3aa7520 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:21.114851 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936ad9e-6222-4af6-84df-0878c3aa7520 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:21.115115 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936ad9e-6222-4af6-84df-0878c3aa7520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:21.136589 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-1936ad9e-6222-4af6-84df-0878c3aa7520 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:44:21.137968 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1936ad9e-6222-4af6-84df-0878c3aa7520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:21.146118 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1557/3130] 10.222.0.83 () {58 vars in 967 bytes} [Mon Aug 29 15:44:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:44:21.164406 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef517a24-4e80-41f0-a667-21ef25069c7a None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:21.185099 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef517a24-4e80-41f0-a667-21ef25069c7a None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:21.194817 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef05d9-9caa-4c0f-ae33-154999f85a0e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:21.196378 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef05d9-9caa-4c0f-ae33-154999f85a0e service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:21.196955 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef05d9-9caa-4c0f-ae33-154999f85a0e service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:21.197613 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef05d9-9caa-4c0f-ae33-154999f85a0e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:21.210529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ef05d9-9caa-4c0f-ae33-154999f85a0e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:21.213321 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ef05d9-9caa-4c0f-ae33-154999f85a0e service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:21.223698 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1574/3131] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 15:44:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:44:21.541656 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd9125-e8d2-401b-86a4-0cb8ffc6207f None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:21.542014 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd9125-e8d2-401b-86a4-0cb8ffc6207f None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:21.542359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd9125-e8d2-401b-86a4-0cb8ffc6207f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:21.561599 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-fafd9125-e8d2-401b-86a4-0cb8ffc6207f None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:44:21.563081 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-fafd9125-e8d2-401b-86a4-0cb8ffc6207f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:21.570444 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1558/3132] 10.222.0.83 () {58 vars in 967 bytes} [Mon Aug 29 15:44:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:44:21.583574 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef05d9-9caa-4c0f-ae33-154999f85a0e service swift] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:21.595225 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef05d9-9caa-4c0f-ae33-154999f85a0e service swift] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:21.600595 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387bf758-6688-468a-8a4d-2c305510a6eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:21.601222 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387bf758-6688-468a-8a4d-2c305510a6eb service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:21.601499 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387bf758-6688-468a-8a4d-2c305510a6eb service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:21.601773 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387bf758-6688-468a-8a4d-2c305510a6eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:21.610323 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387bf758-6688-468a-8a4d-2c305510a6eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:21.611966 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387bf758-6688-468a-8a4d-2c305510a6eb service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:21.620520 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1575/3133] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 15:44:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 15:44:21.778084 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcb9a4-062c-4088-afcc-2e3756365c3c None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:21.779185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcb9a4-062c-4088-afcc-2e3756365c3c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:21.779439 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcb9a4-062c-4088-afcc-2e3756365c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:21.799978 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-bddcb9a4-062c-4088-afcc-2e3756365c3c None None] MFA Rules not processed for user `f4abb1099f2648998f7542cd84a737c4`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:44:21.801170 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-bddcb9a4-062c-4088-afcc-2e3756365c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:21.876909 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1559/3134] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:44:21 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:44:21.886824 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1601f0e-d041-41c5-b270-808e7c50b2f7 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:21.887420 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1601f0e-d041-41c5-b270-808e7c50b2f7 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:21.887420 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1601f0e-d041-41c5-b270-808e7c50b2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:21.909333 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-e1601f0e-d041-41c5-b270-808e7c50b2f7 None None] MFA Rules not processed for user `f4abb1099f2648998f7542cd84a737c4`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:44:21.910570 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e1601f0e-d041-41c5-b270-808e7c50b2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:21.928310 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1576/3135] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:44:21 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:44:22.020351 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9ad5a-0597-4d2d-9303-dcb389d94720 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:22.021058 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9ad5a-0597-4d2d-9303-dcb389d94720 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:22.021517 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9ad5a-0597-4d2d-9303-dcb389d94720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:22.044818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-cab9ad5a-0597-4d2d-9303-dcb389d94720 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:44:22.046207 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-cab9ad5a-0597-4d2d-9303-dcb389d94720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:22.056242 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1560/3136] 10.222.0.83 () {58 vars in 967 bytes} [Mon Aug 29 15:44:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:44:22.074778 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1601f0e-d041-41c5-b270-808e7c50b2f7 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:22.091262 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1601f0e-d041-41c5-b270-808e7c50b2f7 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:22.100003 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4638cd-a48b-47d3-b8ce-8aa2fc9652f7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:22.102567 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4638cd-a48b-47d3-b8ce-8aa2fc9652f7 service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:22.103262 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4638cd-a48b-47d3-b8ce-8aa2fc9652f7 service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:22.104922 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4638cd-a48b-47d3-b8ce-8aa2fc9652f7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:22.126963 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4638cd-a48b-47d3-b8ce-8aa2fc9652f7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:22.130319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4638cd-a48b-47d3-b8ce-8aa2fc9652f7 service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:22.144768 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1577/3137] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 15:44:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:44:22.319001 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab9ad5a-0597-4d2d-9303-dcb389d94720 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:22.320511 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-cab9ad5a-0597-4d2d-9303-dcb389d94720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:22.385821 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab9ad5a-0597-4d2d-9303-dcb389d94720 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:22.397290 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e98e7-66f5-408b-89eb-7b7475532433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:22.398251 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e98e7-66f5-408b-89eb-7b7475532433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:22.398770 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e98e7-66f5-408b-89eb-7b7475532433 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:22.399308 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e98e7-66f5-408b-89eb-7b7475532433 admin admin] PATH_INFO: `/v3/users/29fa4fbf7bb34c13952163feeaafe738` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:22.400805 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e98e7-66f5-408b-89eb-7b7475532433 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29fa4fbf7bb34c13952163feeaafe738)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:22.402984 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e98e7-66f5-408b-89eb-7b7475532433 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:22.542365 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7b2e98e7-66f5-408b-89eb-7b7475532433 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29fa4fbf7bb34c13952163feeaafe738'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:22.547372 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7b2e98e7-66f5-408b-89eb-7b7475532433 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29fa4fbf7bb34c13952163feeaafe738'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:22.560462 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7b2e98e7-66f5-408b-89eb-7b7475532433 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29fa4fbf7bb34c13952163feeaafe738'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:22.575243 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7b2e98e7-66f5-408b-89eb-7b7475532433 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29fa4fbf7bb34c13952163feeaafe738'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:22.578529 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7b2e98e7-66f5-408b-89eb-7b7475532433 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29fa4fbf7bb34c13952163feeaafe738'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:22.616906 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1561/3138] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:44:22 2022] DELETE /identity/v3/users/29fa4fbf7bb34c13952163feeaafe738 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:44:22.621639 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86dd52-5164-46b8-a519-e0c66e52aba7 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:22.622181 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86dd52-5164-46b8-a519-e0c66e52aba7 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:22.622898 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86dd52-5164-46b8-a519-e0c66e52aba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:22.650946 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-0b86dd52-5164-46b8-a519-e0c66e52aba7 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:44:22.652827 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0b86dd52-5164-46b8-a519-e0c66e52aba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:22.774282 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1578/3139] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:44:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:44:22.816783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e98e7-66f5-408b-89eb-7b7475532433 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:22.818428 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7b2e98e7-66f5-408b-89eb-7b7475532433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:22.956031 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e98e7-66f5-408b-89eb-7b7475532433 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:22.971225 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e08cd76-cf6b-4e55-9320-29923cd3accb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:22.972248 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08cd76-cf6b-4e55-9320-29923cd3accb service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:22.972980 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08cd76-cf6b-4e55-9320-29923cd3accb service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:22.973471 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08cd76-cf6b-4e55-9320-29923cd3accb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:22.994054 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e08cd76-cf6b-4e55-9320-29923cd3accb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:22.998524 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e08cd76-cf6b-4e55-9320-29923cd3accb service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:23.008244 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:23.017068 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1562/3140] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:44:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:44:24.211653 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b86dd52-5164-46b8-a519-e0c66e52aba7 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:24.215009 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0b86dd52-5164-46b8-a519-e0c66e52aba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:24.229828 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b86dd52-5164-46b8-a519-e0c66e52aba7 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:24.236068 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f74c9f-b512-4b0e-b4d4-f1edef80a942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:24.237029 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f74c9f-b512-4b0e-b4d4-f1edef80a942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:24.237297 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f74c9f-b512-4b0e-b4d4-f1edef80a942 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:24.237748 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f74c9f-b512-4b0e-b4d4-f1edef80a942 admin admin] PATH_INFO: `/v3/projects/d41e3c60ee6c4e41bb046e0e585ae41d` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:24.238924 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f74c9f-b512-4b0e-b4d4-f1edef80a942 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d41e3c60ee6c4e41bb046e0e585ae41d)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:24.241210 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f74c9f-b512-4b0e-b4d4-f1edef80a942 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:24.329825 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a6f74c9f-b512-4b0e-b4d4-f1edef80a942 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd41e3c60ee6c4e41bb046e0e585ae41d', 'request_id': 'req-a6f74c9f-b512-4b0e-b4d4-f1edef80a942'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:24.344376 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a6f74c9f-b512-4b0e-b4d4-f1edef80a942 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd41e3c60ee6c4e41bb046e0e585ae41d', 'request_id': 'req-a6f74c9f-b512-4b0e-b4d4-f1edef80a942'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:24.356435 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a6f74c9f-b512-4b0e-b4d4-f1edef80a942 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd41e3c60ee6c4e41bb046e0e585ae41d', 'request_id': 'req-a6f74c9f-b512-4b0e-b4d4-f1edef80a942'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:24.371074 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a6f74c9f-b512-4b0e-b4d4-f1edef80a942 admin admin] The token cache is being invalidate because project d41e3c60ee6c4e41bb046e0e585ae41d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:44:24.371759 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a6f74c9f-b512-4b0e-b4d4-f1edef80a942 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:24.372779 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a6f74c9f-b512-4b0e-b4d4-f1edef80a942 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:24.374951 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1579/3141] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:44:24 2022] DELETE /identity/v3/projects/d41e3c60ee6c4e41bb046e0e585ae41d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:44:24.380378 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6710df-9f04-4679-be77-6aa9fe459ca0 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:24.381310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6710df-9f04-4679-be77-6aa9fe459ca0 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:24.381794 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6710df-9f04-4679-be77-6aa9fe459ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:24.406167 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-0b6710df-9f04-4679-be77-6aa9fe459ca0 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:44:24.408945 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0b6710df-9f04-4679-be77-6aa9fe459ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:24.493511 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1563/3142] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:44:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:44:24.495229 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801d1c0-597d-49b7-9184-49b59d1b5c54 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:24.495512 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801d1c0-597d-49b7-9184-49b59d1b5c54 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:24.495979 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801d1c0-597d-49b7-9184-49b59d1b5c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:24.526816 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-8801d1c0-597d-49b7-9184-49b59d1b5c54 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:44:24.528931 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8801d1c0-597d-49b7-9184-49b59d1b5c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:24.544170 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1580/3143] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:44:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:44:24.544404 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6710df-9f04-4679-be77-6aa9fe459ca0 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:24.555912 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6710df-9f04-4679-be77-6aa9fe459ca0 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:24.560615 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10280f3-9fb1-4fc4-9124-ad19fd5da622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:24.561471 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10280f3-9fb1-4fc4-9124-ad19fd5da622 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:24.561745 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10280f3-9fb1-4fc4-9124-ad19fd5da622 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:24.562205 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10280f3-9fb1-4fc4-9124-ad19fd5da622 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:24.562909 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10280f3-9fb1-4fc4-9124-ad19fd5da622 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:44:24.563272 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10280f3-9fb1-4fc4-9124-ad19fd5da622 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:24.565076 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10280f3-9fb1-4fc4-9124-ad19fd5da622 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:24.581310 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1564/3144] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:44:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:44:24.587080 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801d1c0-597d-49b7-9184-49b59d1b5c54 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:24.597729 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801d1c0-597d-49b7-9184-49b59d1b5c54 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:24.603387 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5beb190-ee41-4f22-8228-2befd2286e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:24.604362 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5beb190-ee41-4f22-8228-2befd2286e05 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:24.604646 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5beb190-ee41-4f22-8228-2befd2286e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:24.604917 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5beb190-ee41-4f22-8228-2befd2286e05 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:24.605557 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5beb190-ee41-4f22-8228-2befd2286e05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:24.607831 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5beb190-ee41-4f22-8228-2befd2286e05 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:24.690321 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1581/3145] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:44:24 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:44:24.693225 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10280f3-9fb1-4fc4-9124-ad19fd5da622 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:24.720188 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10280f3-9fb1-4fc4-9124-ad19fd5da622 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:24.835508 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184fc65-5392-44f8-b8a5-c8f85f87d49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:24.836125 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184fc65-5392-44f8-b8a5-c8f85f87d49e admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:24.836405 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184fc65-5392-44f8-b8a5-c8f85f87d49e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:24.836677 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184fc65-5392-44f8-b8a5-c8f85f87d49e admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:24.837318 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5184fc65-5392-44f8-b8a5-c8f85f87d49e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:24.840478 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5184fc65-5392-44f8-b8a5-c8f85f87d49e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:24.879513 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5beb190-ee41-4f22-8228-2befd2286e05 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:24.879989 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1565/3146] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:44:24 2022] POST /identity/v3/users => generated 287 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:44:24.885688 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:24.893490 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5beb190-ee41-4f22-8228-2befd2286e05 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:24.907328 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205a1bc-e066-4685-afd0-f04a3887d8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:24.908409 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205a1bc-e066-4685-afd0-f04a3887d8c5 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:24.909471 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205a1bc-e066-4685-afd0-f04a3887d8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:24.910172 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205a1bc-e066-4685-afd0-f04a3887d8c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:24.911660 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3205a1bc-e066-4685-afd0-f04a3887d8c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:24.915224 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3205a1bc-e066-4685-afd0-f04a3887d8c5 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:24.939644 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1582/3147] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:44:24.939866 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184fc65-5392-44f8-b8a5-c8f85f87d49e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:24.952111 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184fc65-5392-44f8-b8a5-c8f85f87d49e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:24.958817 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0adb2f-f2b6-415d-9460-0717bb011099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:24.959557 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0adb2f-f2b6-415d-9460-0717bb011099 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:24.959783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0adb2f-f2b6-415d-9460-0717bb011099 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:24.960154 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0adb2f-f2b6-415d-9460-0717bb011099 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:24.960870 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0adb2f-f2b6-415d-9460-0717bb011099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:24.962587 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0adb2f-f2b6-415d-9460-0717bb011099 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:24.976779 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1566/3148] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:44:24.981176 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205a1bc-e066-4685-afd0-f04a3887d8c5 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:24.996419 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205a1bc-e066-4685-afd0-f04a3887d8c5 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:25.005804 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8671083-1b4a-4a8e-b2ee-d8bce55dff44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:25.006987 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8671083-1b4a-4a8e-b2ee-d8bce55dff44 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:25.007309 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8671083-1b4a-4a8e-b2ee-d8bce55dff44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:25.007591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8671083-1b4a-4a8e-b2ee-d8bce55dff44 admin admin] PATH_INFO: `/v3/projects/edc5a47442874025810a8512b46ede66/users/df4b0974fc1847f28842a4a18e97eb25/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:25.030454 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8671083-1b4a-4a8e-b2ee-d8bce55dff44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edc5a47442874025810a8512b46ede66, user_id=df4b0974fc1847f28842a4a18e97eb25, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:25.035241 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8671083-1b4a-4a8e-b2ee-d8bce55dff44 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:25.063843 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1583/3149] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:44:24 2022] PUT /identity/v3/projects/edc5a47442874025810a8512b46ede66/users/df4b0974fc1847f28842a4a18e97eb25/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:44:25.067152 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed41219-dabe-4da5-98f2-fa5b78d8b118 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:25.067438 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed41219-dabe-4da5-98f2-fa5b78d8b118 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:25.068311 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed41219-dabe-4da5-98f2-fa5b78d8b118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:25.107438 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-eed41219-dabe-4da5-98f2-fa5b78d8b118 None None] MFA Rules not processed for user `df4b0974fc1847f28842a4a18e97eb25`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:44:25.108662 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-eed41219-dabe-4da5-98f2-fa5b78d8b118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:25.184057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:25.203067 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1567/3150] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:44:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:44:26.178155 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8671083-1b4a-4a8e-b2ee-d8bce55dff44 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:26.180205 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b8671083-1b4a-4a8e-b2ee-d8bce55dff44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:26.273461 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8671083-1b4a-4a8e-b2ee-d8bce55dff44 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:26.280096 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a1b69-b0bf-4d35-8740-d52dd3ca7da7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:26.281054 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a1b69-b0bf-4d35-8740-d52dd3ca7da7 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:26.281548 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a1b69-b0bf-4d35-8740-d52dd3ca7da7 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:26.281871 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a1b69-b0bf-4d35-8740-d52dd3ca7da7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:26.291323 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81a1b69-b0bf-4d35-8740-d52dd3ca7da7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:26.293028 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81a1b69-b0bf-4d35-8740-d52dd3ca7da7 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:26.304422 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1584/3151] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:44:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:44:28.401119 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed339847-28a5-487d-b4c8-beee7805fb2d None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:28.402925 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed339847-28a5-487d-b4c8-beee7805fb2d None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:28.403544 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed339847-28a5-487d-b4c8-beee7805fb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:28.427599 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-ed339847-28a5-487d-b4c8-beee7805fb2d None None] MFA Rules not processed for user `efd373f4dbd944aa82c96a42545c7479`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:44:28.429274 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ed339847-28a5-487d-b4c8-beee7805fb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:28.495927 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1568/3152] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:44:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:44:28.900506 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a1b69-b0bf-4d35-8740-d52dd3ca7da7 service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:28.993956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a1b69-b0bf-4d35-8740-d52dd3ca7da7 service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:28.999314 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c88e2-4d73-4b09-8f63-d9697c77b853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:29.000159 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c88e2-4d73-4b09-8f63-d9697c77b853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:29.000537 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c88e2-4d73-4b09-8f63-d9697c77b853 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:29.001014 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c88e2-4d73-4b09-8f63-d9697c77b853 admin admin] PATH_INFO: `/v3/users/df4b0974fc1847f28842a4a18e97eb25` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:29.002686 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3c88e2-4d73-4b09-8f63-d9697c77b853 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df4b0974fc1847f28842a4a18e97eb25)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:29.004844 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3c88e2-4d73-4b09-8f63-d9697c77b853 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:29.088569 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1d3c88e2-4d73-4b09-8f63-d9697c77b853 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df4b0974fc1847f28842a4a18e97eb25'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:29.090178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1d3c88e2-4d73-4b09-8f63-d9697c77b853 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df4b0974fc1847f28842a4a18e97eb25'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:29.098516 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:29.111135 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1d3c88e2-4d73-4b09-8f63-d9697c77b853 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df4b0974fc1847f28842a4a18e97eb25'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:29.135524 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1d3c88e2-4d73-4b09-8f63-d9697c77b853 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df4b0974fc1847f28842a4a18e97eb25'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:29.158720 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1d3c88e2-4d73-4b09-8f63-d9697c77b853 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df4b0974fc1847f28842a4a18e97eb25'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:29.179134 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1585/3153] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:44:28 2022] DELETE /identity/v3/users/df4b0974fc1847f28842a4a18e97eb25 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:44:29.184461 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608b454-d97e-48a1-9a52-391f3d9df295 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:29.184701 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608b454-d97e-48a1-9a52-391f3d9df295 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:29.184978 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608b454-d97e-48a1-9a52-391f3d9df295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:29.226918 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-6608b454-d97e-48a1-9a52-391f3d9df295 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:44:29.230465 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6608b454-d97e-48a1-9a52-391f3d9df295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:29.342950 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1569/3154] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:44:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:44:29.354504 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c88e2-4d73-4b09-8f63-d9697c77b853 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:29.356056 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1d3c88e2-4d73-4b09-8f63-d9697c77b853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:29.516422 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c88e2-4d73-4b09-8f63-d9697c77b853 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:29.522032 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795b5dd-f6e2-407f-82cf-6e16e1eb622d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:29.522986 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795b5dd-f6e2-407f-82cf-6e16e1eb622d service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:29.523778 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795b5dd-f6e2-407f-82cf-6e16e1eb622d service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:29.524275 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795b5dd-f6e2-407f-82cf-6e16e1eb622d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:29.544232 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a795b5dd-f6e2-407f-82cf-6e16e1eb622d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:29.546176 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a795b5dd-f6e2-407f-82cf-6e16e1eb622d service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:29.559858 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1586/3155] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:44:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:44:29.922442 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608b454-d97e-48a1-9a52-391f3d9df295 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:29.924834 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6608b454-d97e-48a1-9a52-391f3d9df295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:29.937053 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608b454-d97e-48a1-9a52-391f3d9df295 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:29.942361 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1a1d2-afe6-4117-8c53-531f780f89c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:29.942998 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1a1d2-afe6-4117-8c53-531f780f89c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:29.943310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1a1d2-afe6-4117-8c53-531f780f89c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:29.943583 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1a1d2-afe6-4117-8c53-531f780f89c1 admin admin] PATH_INFO: `/v3/projects/edc5a47442874025810a8512b46ede66` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:29.944714 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c1a1d2-afe6-4117-8c53-531f780f89c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edc5a47442874025810a8512b46ede66)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:29.947470 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c1a1d2-afe6-4117-8c53-531f780f89c1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:29.997782 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-81c1a1d2-afe6-4117-8c53-531f780f89c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edc5a47442874025810a8512b46ede66', 'request_id': 'req-81c1a1d2-afe6-4117-8c53-531f780f89c1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:30.008096 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-81c1a1d2-afe6-4117-8c53-531f780f89c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edc5a47442874025810a8512b46ede66', 'request_id': 'req-81c1a1d2-afe6-4117-8c53-531f780f89c1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:30.014343 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-81c1a1d2-afe6-4117-8c53-531f780f89c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edc5a47442874025810a8512b46ede66', 'request_id': 'req-81c1a1d2-afe6-4117-8c53-531f780f89c1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:30.028882 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-81c1a1d2-afe6-4117-8c53-531f780f89c1 admin admin] The token cache is being invalidate because project edc5a47442874025810a8512b46ede66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:44:30.029105 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-81c1a1d2-afe6-4117-8c53-531f780f89c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:30.029732 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-81c1a1d2-afe6-4117-8c53-531f780f89c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:30.031254 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1570/3156] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:44:29 2022] DELETE /identity/v3/projects/edc5a47442874025810a8512b46ede66 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:44:30.036617 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97973370-5639-4015-9c8e-fe360638fb01 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:30.037122 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97973370-5639-4015-9c8e-fe360638fb01 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:30.037319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97973370-5639-4015-9c8e-fe360638fb01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:30.057256 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-97973370-5639-4015-9c8e-fe360638fb01 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:44:30.058591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-97973370-5639-4015-9c8e-fe360638fb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:30.118064 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1587/3157] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:44:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:44:30.128250 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ea154-4d78-4fda-ba7f-df59cff4fac0 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:30.128535 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ea154-4d78-4fda-ba7f-df59cff4fac0 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:30.128809 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ea154-4d78-4fda-ba7f-df59cff4fac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:30.184997 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-5d6ea154-4d78-4fda-ba7f-df59cff4fac0 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:44:30.186231 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5d6ea154-4d78-4fda-ba7f-df59cff4fac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:30.197364 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1571/3158] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:44:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:44:30.201477 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97973370-5639-4015-9c8e-fe360638fb01 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:30.216002 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97973370-5639-4015-9c8e-fe360638fb01 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:30.228535 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc76c81-d50b-4798-b6cf-2c9b1b932a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:30.229156 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc76c81-d50b-4798-b6cf-2c9b1b932a5d admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:30.229432 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc76c81-d50b-4798-b6cf-2c9b1b932a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:30.229881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc76c81-d50b-4798-b6cf-2c9b1b932a5d admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:30.230716 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc76c81-d50b-4798-b6cf-2c9b1b932a5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:44:30.231198 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc76c81-d50b-4798-b6cf-2c9b1b932a5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:30.232992 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc76c81-d50b-4798-b6cf-2c9b1b932a5d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:30.248796 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1588/3159] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:44:30.253781 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ea154-4d78-4fda-ba7f-df59cff4fac0 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:30.278428 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ea154-4d78-4fda-ba7f-df59cff4fac0 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:30.287677 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddffabc-7473-4d7d-854c-6638a57100f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:30.290451 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddffabc-7473-4d7d-854c-6638a57100f1 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:30.290451 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddffabc-7473-4d7d-854c-6638a57100f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:30.290451 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddffabc-7473-4d7d-854c-6638a57100f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:30.290451 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddffabc-7473-4d7d-854c-6638a57100f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:30.299439 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddffabc-7473-4d7d-854c-6638a57100f1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:30.323762 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:30.347058 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1572/3160] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:44:30 2022] POST /identity/v3/projects => generated 381 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:44:30.349037 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc76c81-d50b-4798-b6cf-2c9b1b932a5d admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:30.366298 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc76c81-d50b-4798-b6cf-2c9b1b932a5d admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:30.457527 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e3f7a6-ffc0-44e5-a31d-b29321e1d2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:30.458421 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3f7a6-ffc0-44e5-a31d-b29321e1d2e8 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:30.458858 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3f7a6-ffc0-44e5-a31d-b29321e1d2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:30.459264 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3f7a6-ffc0-44e5-a31d-b29321e1d2e8 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:30.460065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e3f7a6-ffc0-44e5-a31d-b29321e1d2e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:30.462224 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e3f7a6-ffc0-44e5-a31d-b29321e1d2e8 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:30.478522 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:30.502802 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1589/3161] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:44:30 2022] POST /identity/v3/users => generated 291 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:44:30.506604 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddffabc-7473-4d7d-854c-6638a57100f1 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:30.522262 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddffabc-7473-4d7d-854c-6638a57100f1 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:30.542990 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99008a1-2ec7-4ebc-b842-fde3dc6a17f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:30.543659 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99008a1-2ec7-4ebc-b842-fde3dc6a17f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:30.545553 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99008a1-2ec7-4ebc-b842-fde3dc6a17f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:30.545941 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99008a1-2ec7-4ebc-b842-fde3dc6a17f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:30.546702 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99008a1-2ec7-4ebc-b842-fde3dc6a17f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:30.548800 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99008a1-2ec7-4ebc-b842-fde3dc6a17f7 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:30.565691 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e3f7a6-ffc0-44e5-a31d-b29321e1d2e8 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:30.574622 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1573/3162] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:44:30.581305 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e3f7a6-ffc0-44e5-a31d-b29321e1d2e8 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:30.590245 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98ca6b-417f-4eca-9be1-2f394755af28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:30.591176 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98ca6b-417f-4eca-9be1-2f394755af28 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:30.591644 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98ca6b-417f-4eca-9be1-2f394755af28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:30.592280 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98ca6b-417f-4eca-9be1-2f394755af28 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:30.593270 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa98ca6b-417f-4eca-9be1-2f394755af28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:30.596004 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa98ca6b-417f-4eca-9be1-2f394755af28 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:30.612678 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1590/3163] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:44:30.616356 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99008a1-2ec7-4ebc-b842-fde3dc6a17f7 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:30.627648 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99008a1-2ec7-4ebc-b842-fde3dc6a17f7 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:30.633758 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fecb4e-2b5e-4520-add3-8cc2e54f54fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:30.634906 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fecb4e-2b5e-4520-add3-8cc2e54f54fd admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:30.635239 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fecb4e-2b5e-4520-add3-8cc2e54f54fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:30.635517 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fecb4e-2b5e-4520-add3-8cc2e54f54fd admin admin] PATH_INFO: `/v3/projects/a27922448d754caea1e19340b11bfd64/users/a9fcf93e985b4a09a67b719508d8f812/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:30.657395 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fecb4e-2b5e-4520-add3-8cc2e54f54fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a27922448d754caea1e19340b11bfd64, user_id=a9fcf93e985b4a09a67b719508d8f812, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:30.660277 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fecb4e-2b5e-4520-add3-8cc2e54f54fd admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:30.686211 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bcefb-710c-4ade-ba7a-ec59ae7a0cfa None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:30.686497 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bcefb-710c-4ade-ba7a-ec59ae7a0cfa None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:30.686771 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bcefb-710c-4ade-ba7a-ec59ae7a0cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:30.692180 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1574/3164] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:44:30 2022] PUT /identity/v3/projects/a27922448d754caea1e19340b11bfd64/users/a9fcf93e985b4a09a67b719508d8f812/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:44:30.731283 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-809bcefb-710c-4ade-ba7a-ec59ae7a0cfa None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:44:30.732577 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-809bcefb-710c-4ade-ba7a-ec59ae7a0cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:30.836558 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1591/3165] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:44:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:44:30.886235 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fecb4e-2b5e-4520-add3-8cc2e54f54fd admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:30.888084 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-39fecb4e-2b5e-4520-add3-8cc2e54f54fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:31.011585 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fecb4e-2b5e-4520-add3-8cc2e54f54fd admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:31.016453 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40060bd2-73ca-450d-8f0d-02a57f8a6785 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:31.017293 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40060bd2-73ca-450d-8f0d-02a57f8a6785 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:31.017757 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40060bd2-73ca-450d-8f0d-02a57f8a6785 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:31.018193 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40060bd2-73ca-450d-8f0d-02a57f8a6785 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:31.030136 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40060bd2-73ca-450d-8f0d-02a57f8a6785 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:31.032937 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40060bd2-73ca-450d-8f0d-02a57f8a6785 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:31.044390 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1575/3166] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:44:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:44:33.541149 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809bcefb-710c-4ade-ba7a-ec59ae7a0cfa None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:33.542707 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-809bcefb-710c-4ade-ba7a-ec59ae7a0cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:33.777076 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809bcefb-710c-4ade-ba7a-ec59ae7a0cfa None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:33.806712 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15472eb6-60be-4e01-b3a7-03d13a05d4d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:33.807773 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15472eb6-60be-4e01-b3a7-03d13a05d4d3 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:33.808087 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15472eb6-60be-4e01-b3a7-03d13a05d4d3 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:33.811462 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15472eb6-60be-4e01-b3a7-03d13a05d4d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:33.814593 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-15472eb6-60be-4e01-b3a7-03d13a05d4d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:33.975215 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15472eb6-60be-4e01-b3a7-03d13a05d4d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:33.977550 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15472eb6-60be-4e01-b3a7-03d13a05d4d3 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:34.008292 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1592/3167] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:44:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:44:38.853675 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40060bd2-73ca-450d-8f0d-02a57f8a6785 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:38.886755 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40060bd2-73ca-450d-8f0d-02a57f8a6785 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:38.903310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da1016-0f75-4f58-a987-c43a978ac503 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:38.904810 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da1016-0f75-4f58-a987-c43a978ac503 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:38.907141 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da1016-0f75-4f58-a987-c43a978ac503 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:38.907784 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da1016-0f75-4f58-a987-c43a978ac503 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:38.911055 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-37da1016-0f75-4f58-a987-c43a978ac503 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:39.053918 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da1016-0f75-4f58-a987-c43a978ac503 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:39.055888 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da1016-0f75-4f58-a987-c43a978ac503 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:39.077110 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1576/3168] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:44:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:44:42.883120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5f9b2-df8e-4972-b406-c9614b49329a None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:42.885102 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5f9b2-df8e-4972-b406-c9614b49329a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:42.885786 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5f9b2-df8e-4972-b406-c9614b49329a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:42.948321 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-3ac5f9b2-df8e-4972-b406-c9614b49329a None None] MFA Rules not processed for user `a9fcf93e985b4a09a67b719508d8f812`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:44:42.949702 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3ac5f9b2-df8e-4972-b406-c9614b49329a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:42.968343 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:43.106975 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1593/3169] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:44:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:44:45.002610 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da1016-0f75-4f58-a987-c43a978ac503 service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:45.004900 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-37da1016-0f75-4f58-a987-c43a978ac503 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:45.038471 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da1016-0f75-4f58-a987-c43a978ac503 service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:45.055234 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c0ecd-7155-4d4d-92f9-164ad9eb292b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:45.056314 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c0ecd-7155-4d4d-92f9-164ad9eb292b service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:45.056697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c0ecd-7155-4d4d-92f9-164ad9eb292b service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:45.057075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c0ecd-7155-4d4d-92f9-164ad9eb292b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:45.078090 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c0ecd-7155-4d4d-92f9-164ad9eb292b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:45.084652 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c0ecd-7155-4d4d-92f9-164ad9eb292b service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:45.114676 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1577/3170] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:44:45 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:44:46.657183 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5845b-2ba4-4bc7-b3a5-e19b30fb9152 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:46.657737 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5845b-2ba4-4bc7-b3a5-e19b30fb9152 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:46.658096 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5845b-2ba4-4bc7-b3a5-e19b30fb9152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:46.739478 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-82a5845b-2ba4-4bc7-b3a5-e19b30fb9152 None None] MFA Rules not processed for user `a9fcf93e985b4a09a67b719508d8f812`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:44:46.741003 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-82a5845b-2ba4-4bc7-b3a5-e19b30fb9152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:46.761905 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1594/3171] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:44:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:44:49.938848 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508789a-d887-40da-84f8-ec5058d4d5c8 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:49.939346 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508789a-d887-40da-84f8-ec5058d4d5c8 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:49.939702 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508789a-d887-40da-84f8-ec5058d4d5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:49.973943 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a508789a-d887-40da-84f8-ec5058d4d5c8 None None] MFA Rules not processed for user `853f8300f9bb403b9cea4834c5a1edcb`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:44:49.975296 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a508789a-d887-40da-84f8-ec5058d4d5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:50.056207 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:50.081353 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1578/3172] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:44:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:44:53.535209 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5845b-2ba4-4bc7-b3a5-e19b30fb9152 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:53.537472 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-82a5845b-2ba4-4bc7-b3a5-e19b30fb9152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:53.711273 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5845b-2ba4-4bc7-b3a5-e19b30fb9152 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:53.717157 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e3f97-8a1c-472c-91da-aa9d8f05c040 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:53.717790 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e3f97-8a1c-472c-91da-aa9d8f05c040 service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:53.718076 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e3f97-8a1c-472c-91da-aa9d8f05c040 service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:53.719073 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e3f97-8a1c-472c-91da-aa9d8f05c040 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:53.721035 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-015e3f97-8a1c-472c-91da-aa9d8f05c040 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:53.734750 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e3f97-8a1c-472c-91da-aa9d8f05c040 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:53.736877 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e3f97-8a1c-472c-91da-aa9d8f05c040 service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:53.771777 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1595/3173] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:44:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:44:54.157369 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508789a-d887-40da-84f8-ec5058d4d5c8 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:54.158907 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a508789a-d887-40da-84f8-ec5058d4d5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:54.191361 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508789a-d887-40da-84f8-ec5058d4d5c8 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:54.197540 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40984c4d-b096-42e0-9e70-ccc6d695dca7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:54.199461 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40984c4d-b096-42e0-9e70-ccc6d695dca7 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:54.200851 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40984c4d-b096-42e0-9e70-ccc6d695dca7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:54.201992 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40984c4d-b096-42e0-9e70-ccc6d695dca7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:54.213556 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-40984c4d-b096-42e0-9e70-ccc6d695dca7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:54.250275 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40984c4d-b096-42e0-9e70-ccc6d695dca7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:54.254516 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40984c4d-b096-42e0-9e70-ccc6d695dca7 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:54.271212 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1579/3174] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:44:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:44:54.456206 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e3f97-8a1c-472c-91da-aa9d8f05c040 service placement] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:54.457745 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-015e3f97-8a1c-472c-91da-aa9d8f05c040 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:54.479338 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e3f97-8a1c-472c-91da-aa9d8f05c040 service placement] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:54.487989 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efbde06-9538-42c5-9246-e1ce2b6fd84f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:54.489220 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbde06-9538-42c5-9246-e1ce2b6fd84f service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:54.489693 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbde06-9538-42c5-9246-e1ce2b6fd84f service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:54.490289 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbde06-9538-42c5-9246-e1ce2b6fd84f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:54.492968 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8efbde06-9538-42c5-9246-e1ce2b6fd84f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:54.508814 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efbde06-9538-42c5-9246-e1ce2b6fd84f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:54.510781 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efbde06-9538-42c5-9246-e1ce2b6fd84f service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:54.535402 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1596/3175] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:44:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:45:01.310052 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40984c4d-b096-42e0-9e70-ccc6d695dca7 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:01.327371 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40984c4d-b096-42e0-9e70-ccc6d695dca7 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:01.333643 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80aeb6-3736-42c2-b51e-ac74c849182a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:01.334258 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80aeb6-3736-42c2-b51e-ac74c849182a service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:01.334535 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80aeb6-3736-42c2-b51e-ac74c849182a service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:01.334802 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80aeb6-3736-42c2-b51e-ac74c849182a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:01.338383 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-be80aeb6-3736-42c2-b51e-ac74c849182a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:01.424281 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be80aeb6-3736-42c2-b51e-ac74c849182a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:01.426014 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be80aeb6-3736-42c2-b51e-ac74c849182a service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:01.436842 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1580/3176] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:45:01 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:45:04.518784 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=65 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:06.647258 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efbde06-9538-42c5-9246-e1ce2b6fd84f service placement] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:06.664447 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efbde06-9538-42c5-9246-e1ce2b6fd84f service placement] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:06.673787 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd4bf7-7674-41ff-864c-a0804a0fdcef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:06.674399 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd4bf7-7674-41ff-864c-a0804a0fdcef service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:06.675571 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd4bf7-7674-41ff-864c-a0804a0fdcef service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:06.676015 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd4bf7-7674-41ff-864c-a0804a0fdcef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:06.678190 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-78cd4bf7-7674-41ff-864c-a0804a0fdcef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:06.692072 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd4bf7-7674-41ff-864c-a0804a0fdcef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:06.694119 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd4bf7-7674-41ff-864c-a0804a0fdcef service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:06.729672 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1597/3177] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:45:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:45:10.704592 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c6393-cd43-41ce-b338-8eb484d54014 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:10.705134 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c6393-cd43-41ce-b338-8eb484d54014 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:10.705239 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c6393-cd43-41ce-b338-8eb484d54014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:10.745953 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-447c6393-cd43-41ce-b338-8eb484d54014 None None] MFA Rules not processed for user `efd373f4dbd944aa82c96a42545c7479`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:10.747210 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-447c6393-cd43-41ce-b338-8eb484d54014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:10.843632 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1581/3178] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:45:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:45:15.636799 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd4bf7-7674-41ff-864c-a0804a0fdcef service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:15.648511 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd4bf7-7674-41ff-864c-a0804a0fdcef service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:15.653044 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a15ef-317b-4016-93cf-12892d74092b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:15.653907 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a15ef-317b-4016-93cf-12892d74092b service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:15.654034 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a15ef-317b-4016-93cf-12892d74092b service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:15.654236 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a15ef-317b-4016-93cf-12892d74092b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:15.657324 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-821a15ef-317b-4016-93cf-12892d74092b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:15.671884 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a15ef-317b-4016-93cf-12892d74092b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:15.673881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a15ef-317b-4016-93cf-12892d74092b service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:15.685232 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1598/3179] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:45:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:45:20.830161 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=64 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:22.058880 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c6393-cd43-41ce-b338-8eb484d54014 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:22.061240 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-447c6393-cd43-41ce-b338-8eb484d54014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:22.078421 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c6393-cd43-41ce-b338-8eb484d54014 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:22.085787 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d242f50-6fa5-452b-b77b-139e940a869e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:22.086708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d242f50-6fa5-452b-b77b-139e940a869e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:22.096799 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d242f50-6fa5-452b-b77b-139e940a869e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:22.097152 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d242f50-6fa5-452b-b77b-139e940a869e admin admin] PATH_INFO: `/v3/users/09663bec61af43278da1d69c37594558` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:22.101989 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d242f50-6fa5-452b-b77b-139e940a869e admin admin] RBAC: Authorizing `identity:delete_user(user_id=09663bec61af43278da1d69c37594558)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:22.104247 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d242f50-6fa5-452b-b77b-139e940a869e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:22.187243 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8d242f50-6fa5-452b-b77b-139e940a869e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09663bec61af43278da1d69c37594558'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:22.188463 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8d242f50-6fa5-452b-b77b-139e940a869e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09663bec61af43278da1d69c37594558'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:22.197993 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8d242f50-6fa5-452b-b77b-139e940a869e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09663bec61af43278da1d69c37594558'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:22.210007 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8d242f50-6fa5-452b-b77b-139e940a869e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09663bec61af43278da1d69c37594558'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:22.211179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8d242f50-6fa5-452b-b77b-139e940a869e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09663bec61af43278da1d69c37594558'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:22.251524 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1582/3180] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:45:22 2022] DELETE /identity/v3/users/09663bec61af43278da1d69c37594558 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:45:22.434551 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff30cc-f13a-4cce-a5f2-f7a417e0e75d None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:22.435095 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff30cc-f13a-4cce-a5f2-f7a417e0e75d None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:22.435215 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff30cc-f13a-4cce-a5f2-f7a417e0e75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:22.469048 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-62ff30cc-f13a-4cce-a5f2-f7a417e0e75d None None] MFA Rules not processed for user `a9fcf93e985b4a09a67b719508d8f812`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:22.470288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-62ff30cc-f13a-4cce-a5f2-f7a417e0e75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:22.552097 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1599/3181] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:45:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:45:22.713299 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d242f50-6fa5-452b-b77b-139e940a869e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:22.715445 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8d242f50-6fa5-452b-b77b-139e940a869e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:22.889554 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d242f50-6fa5-452b-b77b-139e940a869e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:22.895677 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44918a9b-3c26-41e8-92e0-c2368b49f8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:22.896758 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44918a9b-3c26-41e8-92e0-c2368b49f8a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:22.897334 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44918a9b-3c26-41e8-92e0-c2368b49f8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:22.897766 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44918a9b-3c26-41e8-92e0-c2368b49f8a3 admin admin] PATH_INFO: `/v3/projects/b0c4051fa5084b638108f191a7c1365b` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:22.913084 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44918a9b-3c26-41e8-92e0-c2368b49f8a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0c4051fa5084b638108f191a7c1365b)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:22.915928 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44918a9b-3c26-41e8-92e0-c2368b49f8a3 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:23.058968 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-44918a9b-3c26-41e8-92e0-c2368b49f8a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0c4051fa5084b638108f191a7c1365b', 'request_id': 'req-44918a9b-3c26-41e8-92e0-c2368b49f8a3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:23.069699 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-44918a9b-3c26-41e8-92e0-c2368b49f8a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0c4051fa5084b638108f191a7c1365b', 'request_id': 'req-44918a9b-3c26-41e8-92e0-c2368b49f8a3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:23.084837 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-44918a9b-3c26-41e8-92e0-c2368b49f8a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0c4051fa5084b638108f191a7c1365b', 'request_id': 'req-44918a9b-3c26-41e8-92e0-c2368b49f8a3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:23.114980 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-44918a9b-3c26-41e8-92e0-c2368b49f8a3 admin admin] The token cache is being invalidate because project b0c4051fa5084b638108f191a7c1365b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:45:23.115422 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-44918a9b-3c26-41e8-92e0-c2368b49f8a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:23.116497 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-44918a9b-3c26-41e8-92e0-c2368b49f8a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:23.123402 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1583/3182] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:45:22 2022] DELETE /identity/v3/projects/b0c4051fa5084b638108f191a7c1365b => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:45:23.125224 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd549af-dc7f-452e-b07d-299fbf5ca528 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:23.125663 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd549af-dc7f-452e-b07d-299fbf5ca528 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:23.126025 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd549af-dc7f-452e-b07d-299fbf5ca528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:23.162727 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-9bd549af-dc7f-452e-b07d-299fbf5ca528 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:23.164338 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9bd549af-dc7f-452e-b07d-299fbf5ca528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:23.270891 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1600/3183] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:45:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:45:23.278627 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f2dff-15fb-4554-b64f-eaf2ab2617e3 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:23.278920 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f2dff-15fb-4554-b64f-eaf2ab2617e3 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:23.279238 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f2dff-15fb-4554-b64f-eaf2ab2617e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:23.288707 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:23.344790 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-5f2f2dff-15fb-4554-b64f-eaf2ab2617e3 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:23.346059 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5f2f2dff-15fb-4554-b64f-eaf2ab2617e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:23.393272 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1584/3184] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:45:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:45:23.394521 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd549af-dc7f-452e-b07d-299fbf5ca528 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:23.410720 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd549af-dc7f-452e-b07d-299fbf5ca528 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:23.426008 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a90067c-08a8-41ba-8ed3-1b2318a50290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:23.426647 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90067c-08a8-41ba-8ed3-1b2318a50290 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:23.426925 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90067c-08a8-41ba-8ed3-1b2318a50290 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:23.427221 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90067c-08a8-41ba-8ed3-1b2318a50290 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:23.427875 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a90067c-08a8-41ba-8ed3-1b2318a50290 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:45:23.428183 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a90067c-08a8-41ba-8ed3-1b2318a50290 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:23.429792 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a90067c-08a8-41ba-8ed3-1b2318a50290 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:23.459761 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1601/3185] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:45:23.472195 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f2dff-15fb-4554-b64f-eaf2ab2617e3 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:23.495919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f2dff-15fb-4554-b64f-eaf2ab2617e3 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:23.526506 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab3fbc-78ae-45c2-83df-b5692d2bfd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:23.527245 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab3fbc-78ae-45c2-83df-b5692d2bfd28 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:23.527564 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab3fbc-78ae-45c2-83df-b5692d2bfd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:23.527831 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab3fbc-78ae-45c2-83df-b5692d2bfd28 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:23.528468 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab3fbc-78ae-45c2-83df-b5692d2bfd28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:23.530447 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab3fbc-78ae-45c2-83df-b5692d2bfd28 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:23.597040 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a90067c-08a8-41ba-8ed3-1b2318a50290 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:23.597299 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1585/3186] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:45:23 2022] POST /identity/v3/projects => generated 383 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:45:23.616034 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a90067c-08a8-41ba-8ed3-1b2318a50290 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:23.723679 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b2291a-59b8-4c2d-92e7-8c062f0dcda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:23.724689 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2291a-59b8-4c2d-92e7-8c062f0dcda3 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:23.727279 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2291a-59b8-4c2d-92e7-8c062f0dcda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:23.727856 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2291a-59b8-4c2d-92e7-8c062f0dcda3 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:23.729134 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b2291a-59b8-4c2d-92e7-8c062f0dcda3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:23.735362 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b2291a-59b8-4c2d-92e7-8c062f0dcda3 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:23.749202 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:23.781121 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1602/3187] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:45:23 2022] POST /identity/v3/users => generated 292 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:45:23.784313 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab3fbc-78ae-45c2-83df-b5692d2bfd28 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:23.800936 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab3fbc-78ae-45c2-83df-b5692d2bfd28 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:23.808029 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11028db9-e2ba-4fd8-809c-8775f4f303e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:23.809665 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11028db9-e2ba-4fd8-809c-8775f4f303e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:23.810003 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11028db9-e2ba-4fd8-809c-8775f4f303e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:23.810279 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11028db9-e2ba-4fd8-809c-8775f4f303e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:23.810934 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11028db9-e2ba-4fd8-809c-8775f4f303e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:23.814239 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11028db9-e2ba-4fd8-809c-8775f4f303e2 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:23.829911 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1586/3188] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:45:23 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:45:23.833791 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b2291a-59b8-4c2d-92e7-8c062f0dcda3 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:23.845468 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f0dfc-dc0b-4f13-a246-59c8853c170b None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:23.846120 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f0dfc-dc0b-4f13-a246-59c8853c170b None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:23.846612 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f0dfc-dc0b-4f13-a246-59c8853c170b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:23.849231 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b2291a-59b8-4c2d-92e7-8c062f0dcda3 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:23.866576 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259cfeb7-15e3-4bc3-8a71-5c857571ea52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:23.867550 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cfeb7-15e3-4bc3-8a71-5c857571ea52 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:23.868087 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cfeb7-15e3-4bc3-8a71-5c857571ea52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:23.868561 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cfeb7-15e3-4bc3-8a71-5c857571ea52 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:23.869562 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259cfeb7-15e3-4bc3-8a71-5c857571ea52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:23.871896 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259cfeb7-15e3-4bc3-8a71-5c857571ea52 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:23.886704 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1603/3189] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:45:23 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:45:23.890967 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259cfeb7-15e3-4bc3-8a71-5c857571ea52 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:23.896125 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-0c0f0dfc-dc0b-4f13-a246-59c8853c170b None None] MFA Rules not processed for user `853f8300f9bb403b9cea4834c5a1edcb`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:23.898405 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0c0f0dfc-dc0b-4f13-a246-59c8853c170b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:23.907937 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259cfeb7-15e3-4bc3-8a71-5c857571ea52 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:23.919257 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a744e415-766c-4bbb-b6f1-0d226bd2eff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:23.920131 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744e415-766c-4bbb-b6f1-0d226bd2eff7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:23.921209 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744e415-766c-4bbb-b6f1-0d226bd2eff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:23.922101 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744e415-766c-4bbb-b6f1-0d226bd2eff7 admin admin] PATH_INFO: `/v3/projects/c649ecccd1a4487aa9e1a282d631be1a/users/5c9cc007c0504400b414c395570e98ca/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:23.960610 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a744e415-766c-4bbb-b6f1-0d226bd2eff7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c649ecccd1a4487aa9e1a282d631be1a, user_id=5c9cc007c0504400b414c395570e98ca, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:23.965094 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a744e415-766c-4bbb-b6f1-0d226bd2eff7 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:24.002325 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1604/3190] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:45:23 2022] PUT /identity/v3/projects/c649ecccd1a4487aa9e1a282d631be1a/users/5c9cc007c0504400b414c395570e98ca/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:45:24.007817 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5096a4-d764-4343-91fd-accdd08d27db None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:24.008116 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5096a4-d764-4343-91fd-accdd08d27db None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:24.008362 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5096a4-d764-4343-91fd-accdd08d27db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:24.025426 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1587/3191] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:45:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:45:24.039857 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-db5096a4-d764-4343-91fd-accdd08d27db None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:24.041001 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-db5096a4-d764-4343-91fd-accdd08d27db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:24.121217 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1605/3192] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:45:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:45:24.132985 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f0dfc-dc0b-4f13-a246-59c8853c170b None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:24.134577 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0c0f0dfc-dc0b-4f13-a246-59c8853c170b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:24.223061 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f0dfc-dc0b-4f13-a246-59c8853c170b None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:24.308488 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef703099-3425-4ad3-a91d-54d8b092ed5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:24.309544 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef703099-3425-4ad3-a91d-54d8b092ed5a service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:24.309889 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef703099-3425-4ad3-a91d-54d8b092ed5a service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:24.310251 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef703099-3425-4ad3-a91d-54d8b092ed5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:24.323662 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef703099-3425-4ad3-a91d-54d8b092ed5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:24.325406 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef703099-3425-4ad3-a91d-54d8b092ed5a service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:24.339045 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1588/3193] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:45:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:45:30.122609 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5096a4-d764-4343-91fd-accdd08d27db None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:30.124922 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-db5096a4-d764-4343-91fd-accdd08d27db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:30.216112 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5096a4-d764-4343-91fd-accdd08d27db None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:30.224674 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5de6c5-9406-416c-9558-40228f5d61ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:30.226630 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5de6c5-9406-416c-9558-40228f5d61ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:30.227479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5de6c5-9406-416c-9558-40228f5d61ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:30.227479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5de6c5-9406-416c-9558-40228f5d61ef admin admin] PATH_INFO: `/v3/users/0c19d2e9ffa64e7586e35035176f1c26` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:30.229666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5de6c5-9406-416c-9558-40228f5d61ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c19d2e9ffa64e7586e35035176f1c26)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:30.232110 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5de6c5-9406-416c-9558-40228f5d61ef admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:30.311947 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2c5de6c5-9406-416c-9558-40228f5d61ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c19d2e9ffa64e7586e35035176f1c26'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:30.312670 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2c5de6c5-9406-416c-9558-40228f5d61ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c19d2e9ffa64e7586e35035176f1c26'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:30.330949 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2c5de6c5-9406-416c-9558-40228f5d61ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c19d2e9ffa64e7586e35035176f1c26'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:30.342091 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2c5de6c5-9406-416c-9558-40228f5d61ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c19d2e9ffa64e7586e35035176f1c26'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:30.353089 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2c5de6c5-9406-416c-9558-40228f5d61ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c19d2e9ffa64e7586e35035176f1c26'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:30.355902 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:30.367060 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1606/3194] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:45:30 2022] DELETE /identity/v3/users/0c19d2e9ffa64e7586e35035176f1c26 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:45:30.692808 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef703099-3425-4ad3-a91d-54d8b092ed5a service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:30.783488 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:30.788906 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef703099-3425-4ad3-a91d-54d8b092ed5a service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:30.893139 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1c78c-6b53-4584-9c69-b799b7b78559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:30.894156 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1c78c-6b53-4584-9c69-b799b7b78559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:30.894521 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1c78c-6b53-4584-9c69-b799b7b78559 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:30.895053 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1c78c-6b53-4584-9c69-b799b7b78559 admin admin] PATH_INFO: `/v3/projects/bd150e4d120d4c6584c650e747abb6a4` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:30.896656 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d1c78c-6b53-4584-9c69-b799b7b78559 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd150e4d120d4c6584c650e747abb6a4)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:30.898743 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d1c78c-6b53-4584-9c69-b799b7b78559 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:30.970021 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c7d1c78c-6b53-4584-9c69-b799b7b78559 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd150e4d120d4c6584c650e747abb6a4', 'request_id': 'req-c7d1c78c-6b53-4584-9c69-b799b7b78559'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:30.979109 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c7d1c78c-6b53-4584-9c69-b799b7b78559 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd150e4d120d4c6584c650e747abb6a4', 'request_id': 'req-c7d1c78c-6b53-4584-9c69-b799b7b78559'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:30.990454 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c7d1c78c-6b53-4584-9c69-b799b7b78559 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd150e4d120d4c6584c650e747abb6a4', 'request_id': 'req-c7d1c78c-6b53-4584-9c69-b799b7b78559'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:31.010557 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c7d1c78c-6b53-4584-9c69-b799b7b78559 admin admin] The token cache is being invalidate because project bd150e4d120d4c6584c650e747abb6a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:45:31.011014 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c7d1c78c-6b53-4584-9c69-b799b7b78559 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:31.011876 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c7d1c78c-6b53-4584-9c69-b799b7b78559 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:31.018804 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1589/3195] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:45:30 2022] DELETE /identity/v3/projects/bd150e4d120d4c6584c650e747abb6a4 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:45:31.020013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de949c-f4a3-421c-a75f-129659d70c78 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:31.020622 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de949c-f4a3-421c-a75f-129659d70c78 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:31.020819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de949c-f4a3-421c-a75f-129659d70c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:31.072502 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-96de949c-f4a3-421c-a75f-129659d70c78 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:31.084960 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-96de949c-f4a3-421c-a75f-129659d70c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:31.227250 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1607/3196] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:45:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:45:31.235680 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026755aa-f46b-47a7-b117-b7a102ffafac None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:31.235968 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026755aa-f46b-47a7-b117-b7a102ffafac None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:31.236302 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026755aa-f46b-47a7-b117-b7a102ffafac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:31.266499 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-026755aa-f46b-47a7-b117-b7a102ffafac None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:31.267850 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-026755aa-f46b-47a7-b117-b7a102ffafac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:31.279792 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1590/3197] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:45:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:45:31.286369 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de949c-f4a3-421c-a75f-129659d70c78 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:31.298518 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de949c-f4a3-421c-a75f-129659d70c78 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:31.305156 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53aec8-071d-4bca-832b-ca82a5ac2c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:31.305864 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53aec8-071d-4bca-832b-ca82a5ac2c31 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:31.306658 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53aec8-071d-4bca-832b-ca82a5ac2c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:31.307005 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53aec8-071d-4bca-832b-ca82a5ac2c31 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:31.307872 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53aec8-071d-4bca-832b-ca82a5ac2c31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:45:31.308254 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53aec8-071d-4bca-832b-ca82a5ac2c31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:31.313524 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53aec8-071d-4bca-832b-ca82a5ac2c31 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:31.334228 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026755aa-f46b-47a7-b117-b7a102ffafac None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:31.340780 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1608/3198] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:45:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:45:31.351519 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026755aa-f46b-47a7-b117-b7a102ffafac None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:31.367940 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae5c69-7444-4fa6-834c-c1062b9d9c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:31.368975 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae5c69-7444-4fa6-834c-c1062b9d9c7c admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:31.369442 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae5c69-7444-4fa6-834c-c1062b9d9c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:31.370054 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae5c69-7444-4fa6-834c-c1062b9d9c7c admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:31.370886 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae5c69-7444-4fa6-834c-c1062b9d9c7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:31.374353 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae5c69-7444-4fa6-834c-c1062b9d9c7c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:31.454845 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1591/3199] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:45:31 2022] POST /identity/v3/projects => generated 413 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:45:31.456496 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53aec8-071d-4bca-832b-ca82a5ac2c31 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:31.477048 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53aec8-071d-4bca-832b-ca82a5ac2c31 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:31.586019 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a6a63-a7a4-4995-b52a-175b459a90af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:31.587008 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a6a63-a7a4-4995-b52a-175b459a90af admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:31.587983 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a6a63-a7a4-4995-b52a-175b459a90af admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:31.588615 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a6a63-a7a4-4995-b52a-175b459a90af admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:31.590570 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a6a63-a7a4-4995-b52a-175b459a90af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:31.595124 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a6a63-a7a4-4995-b52a-175b459a90af admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:31.646669 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1609/3200] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:45:31 2022] POST /identity/v3/users => generated 307 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:45:31.650869 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae5c69-7444-4fa6-834c-c1062b9d9c7c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:31.678331 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae5c69-7444-4fa6-834c-c1062b9d9c7c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:31.689511 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108e7a0-35fd-4044-bdd9-c6d343260877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:31.690637 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108e7a0-35fd-4044-bdd9-c6d343260877 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:31.690637 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108e7a0-35fd-4044-bdd9-c6d343260877 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:31.691006 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108e7a0-35fd-4044-bdd9-c6d343260877 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:31.693030 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108e7a0-35fd-4044-bdd9-c6d343260877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:31.701580 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108e7a0-35fd-4044-bdd9-c6d343260877 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:31.745280 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1592/3201] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:45:31 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:45:31.751422 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a6a63-a7a4-4995-b52a-175b459a90af admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:31.764224 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a6a63-a7a4-4995-b52a-175b459a90af admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:31.771618 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f3caf-28e7-4525-a7d3-6486bc601514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:31.772480 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f3caf-28e7-4525-a7d3-6486bc601514 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:31.772855 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f3caf-28e7-4525-a7d3-6486bc601514 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:31.774158 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f3caf-28e7-4525-a7d3-6486bc601514 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:31.774992 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f3caf-28e7-4525-a7d3-6486bc601514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:31.776732 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f3caf-28e7-4525-a7d3-6486bc601514 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:31.816329 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108e7a0-35fd-4044-bdd9-c6d343260877 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:31.827542 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1610/3202] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:45:31 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:45:31.836251 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108e7a0-35fd-4044-bdd9-c6d343260877 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:31.860632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab67cac-d90d-464e-8522-75b3d4f7f3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:31.861595 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab67cac-d90d-464e-8522-75b3d4f7f3c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:31.863897 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab67cac-d90d-464e-8522-75b3d4f7f3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:31.864299 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab67cac-d90d-464e-8522-75b3d4f7f3c6 admin admin] PATH_INFO: `/v3/projects/a25ad3634e624e9394ac4e588d773383/users/7058c725d25749af95e6a5fc806e27ef/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:31.929082 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab67cac-d90d-464e-8522-75b3d4f7f3c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a25ad3634e624e9394ac4e588d773383, user_id=7058c725d25749af95e6a5fc806e27ef, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:31.937799 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab67cac-d90d-464e-8522-75b3d4f7f3c6 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:31.978424 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751341e-0b26-43b2-b024-73c036922de5 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:31.978894 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751341e-0b26-43b2-b024-73c036922de5 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:31.979300 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751341e-0b26-43b2-b024-73c036922de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:31.984093 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1593/3203] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:45:31 2022] PUT /identity/v3/projects/a25ad3634e624e9394ac4e588d773383/users/7058c725d25749af95e6a5fc806e27ef/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:45:32.027209 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-a751341e-0b26-43b2-b024-73c036922de5 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:32.030479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a751341e-0b26-43b2-b024-73c036922de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:32.213286 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:32.249861 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1611/3204] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:45:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:45:32.336023 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab67cac-d90d-464e-8522-75b3d4f7f3c6 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:32.338218 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-bab67cac-d90d-464e-8522-75b3d4f7f3c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:32.471052 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:32.611727 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab67cac-d90d-464e-8522-75b3d4f7f3c6 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:32.626856 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a350ef-4982-4e8f-9c35-c2b5bd714e85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:32.627539 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a350ef-4982-4e8f-9c35-c2b5bd714e85 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:32.627821 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a350ef-4982-4e8f-9c35-c2b5bd714e85 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:32.628147 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a350ef-4982-4e8f-9c35-c2b5bd714e85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:32.648383 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a350ef-4982-4e8f-9c35-c2b5bd714e85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:32.649910 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a350ef-4982-4e8f-9c35-c2b5bd714e85 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:32.667830 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1594/3205] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:45:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:45:33.740623 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064ed8f-9ade-46c0-809c-309227262e40 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:33.741260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064ed8f-9ade-46c0-809c-309227262e40 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:33.741390 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064ed8f-9ade-46c0-809c-309227262e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:33.779487 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-d064ed8f-9ade-46c0-809c-309227262e40 None None] MFA Rules not processed for user `efd373f4dbd944aa82c96a42545c7479`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:33.782668 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d064ed8f-9ade-46c0-809c-309227262e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:33.916278 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1612/3206] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:45:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:45:35.680452 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a350ef-4982-4e8f-9c35-c2b5bd714e85 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:35.682956 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-31a350ef-4982-4e8f-9c35-c2b5bd714e85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:35.906536 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a350ef-4982-4e8f-9c35-c2b5bd714e85 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:35.922939 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4afb4-f9cb-4178-be22-2013c669a63c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:35.923695 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4afb4-f9cb-4178-be22-2013c669a63c service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:35.924753 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4afb4-f9cb-4178-be22-2013c669a63c service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:35.925010 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4afb4-f9cb-4178-be22-2013c669a63c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:35.929128 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-30b4afb4-f9cb-4178-be22-2013c669a63c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:35.947894 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b4afb4-f9cb-4178-be22-2013c669a63c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:35.949714 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b4afb4-f9cb-4178-be22-2013c669a63c service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:35.964410 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1595/3207] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:45:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:45:39.571582 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4ffc1-4b58-429b-b70c-88795dbc6499 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:39.572749 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4ffc1-4b58-429b-b70c-88795dbc6499 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:39.573448 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4ffc1-4b58-429b-b70c-88795dbc6499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:39.665872 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-16a4ffc1-4b58-429b-b70c-88795dbc6499 None None] MFA Rules not processed for user `5c9cc007c0504400b414c395570e98ca`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:39.668618 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-16a4ffc1-4b58-429b-b70c-88795dbc6499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:39.827960 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1613/3208] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:45:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:45:39.839604 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5a6da-788c-4a07-b9e7-f0b5465ae2f1 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:39.840212 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5a6da-788c-4a07-b9e7-f0b5465ae2f1 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:39.840432 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5a6da-788c-4a07-b9e7-f0b5465ae2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:39.881437 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-2ab5a6da-788c-4a07-b9e7-f0b5465ae2f1 None None] MFA Rules not processed for user `5c9cc007c0504400b414c395570e98ca`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:39.883009 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2ab5a6da-788c-4a07-b9e7-f0b5465ae2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:39.899368 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1596/3209] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:45:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:45:40.453868 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a4ffc1-4b58-429b-b70c-88795dbc6499 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:40.456110 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-16a4ffc1-4b58-429b-b70c-88795dbc6499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:40.563927 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a4ffc1-4b58-429b-b70c-88795dbc6499 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:40.572712 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199eb4b4-2169-49f7-9aee-fec98a3fd780 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:40.574180 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199eb4b4-2169-49f7-9aee-fec98a3fd780 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:40.574618 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199eb4b4-2169-49f7-9aee-fec98a3fd780 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:40.583357 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199eb4b4-2169-49f7-9aee-fec98a3fd780 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:40.597872 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199eb4b4-2169-49f7-9aee-fec98a3fd780 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:40.600675 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199eb4b4-2169-49f7-9aee-fec98a3fd780 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:40.618982 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1614/3210] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:45:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:45:49.860434 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=64 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:50.613473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:51.881339 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c72a9-536a-4f7b-a37f-5a082d840cdc None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:51.882165 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c72a9-536a-4f7b-a37f-5a082d840cdc None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:51.883282 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c72a9-536a-4f7b-a37f-5a082d840cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:51.964878 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-596c72a9-536a-4f7b-a37f-5a082d840cdc None None] MFA Rules not processed for user `7058c725d25749af95e6a5fc806e27ef`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:51.967585 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-596c72a9-536a-4f7b-a37f-5a082d840cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:52.216810 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1597/3211] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:45:51 2022] POST /identity/v3/auth/tokens => generated 3290 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:45:52.229533 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57815d31-c362-48ec-8ca0-690ca7201d93 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:52.230646 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57815d31-c362-48ec-8ca0-690ca7201d93 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:52.231116 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57815d31-c362-48ec-8ca0-690ca7201d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:52.286909 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-57815d31-c362-48ec-8ca0-690ca7201d93 None None] MFA Rules not processed for user `7058c725d25749af95e6a5fc806e27ef`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:52.299763 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-57815d31-c362-48ec-8ca0-690ca7201d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:52.322629 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1615/3212] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:45:52 2022] POST /identity/v3/auth/tokens => generated 3290 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:45:52.712017 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c72a9-536a-4f7b-a37f-5a082d840cdc None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:52.749416 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c72a9-536a-4f7b-a37f-5a082d840cdc None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:52.766851 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b173d-f7e7-4cf4-bd67-406485da8553 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:52.767900 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b173d-f7e7-4cf4-bd67-406485da8553 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:52.769359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b173d-f7e7-4cf4-bd67-406485da8553 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:52.769839 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b173d-f7e7-4cf4-bd67-406485da8553 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:52.788343 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064b173d-f7e7-4cf4-bd67-406485da8553 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:52.790556 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064b173d-f7e7-4cf4-bd67-406485da8553 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:52.833948 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1598/3213] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:45:52 2022] GET /identity/v3/auth/tokens => generated 3290 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:45:53.644841 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57815d31-c362-48ec-8ca0-690ca7201d93 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:53.647201 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-57815d31-c362-48ec-8ca0-690ca7201d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:53.680750 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57815d31-c362-48ec-8ca0-690ca7201d93 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:53.707302 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0daf51-2571-4d29-8b93-bec78edc7571 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:53.708760 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0daf51-2571-4d29-8b93-bec78edc7571 service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:53.710483 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0daf51-2571-4d29-8b93-bec78edc7571 service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:53.711884 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0daf51-2571-4d29-8b93-bec78edc7571 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:53.719332 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9e0daf51-2571-4d29-8b93-bec78edc7571 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:53.759295 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0daf51-2571-4d29-8b93-bec78edc7571 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:53.761112 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0daf51-2571-4d29-8b93-bec78edc7571 service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:53.784158 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1616/3214] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:45:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:46:02.799309 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=38 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:03.774907 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=9 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:19.639656 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b173d-f7e7-4cf4-bd67-406485da8553 service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:19.685744 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b173d-f7e7-4cf4-bd67-406485da8553 service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:19.694975 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e1da5-7235-48c1-a34c-3cf1b8169278 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:19.696292 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e1da5-7235-48c1-a34c-3cf1b8169278 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:19.696292 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e1da5-7235-48c1-a34c-3cf1b8169278 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:19.698265 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e1da5-7235-48c1-a34c-3cf1b8169278 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:19.701699 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9c9e1da5-7235-48c1-a34c-3cf1b8169278 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:19.829061 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e1da5-7235-48c1-a34c-3cf1b8169278 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:19.831266 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e1da5-7235-48c1-a34c-3cf1b8169278 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:19.849957 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1599/3215] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:46:19 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:46:24.378423 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0daf51-2571-4d29-8b93-bec78edc7571 service placement] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:24.392953 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0daf51-2571-4d29-8b93-bec78edc7571 service placement] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:24.400760 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c59cb-9f6b-490d-9c58-5149ebc95495 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:24.401541 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c59cb-9f6b-490d-9c58-5149ebc95495 service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:24.402127 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c59cb-9f6b-490d-9c58-5149ebc95495 service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:24.402623 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c59cb-9f6b-490d-9c58-5149ebc95495 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:24.405294 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-008c59cb-9f6b-490d-9c58-5149ebc95495 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:24.422182 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e1da5-7235-48c1-a34c-3cf1b8169278 service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:24.425544 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9c9e1da5-7235-48c1-a34c-3cf1b8169278 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:24.436603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c59cb-9f6b-490d-9c58-5149ebc95495 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:24.438419 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c59cb-9f6b-490d-9c58-5149ebc95495 service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:24.464558 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1617/3216] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:46:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:46:24.507485 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e1da5-7235-48c1-a34c-3cf1b8169278 service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:24.515067 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8592a847-5818-4795-b334-2060cd6e07b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:24.516043 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592a847-5818-4795-b334-2060cd6e07b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:24.516563 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592a847-5818-4795-b334-2060cd6e07b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:24.517084 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592a847-5818-4795-b334-2060cd6e07b1 admin admin] PATH_INFO: `/v3/users/a9fcf93e985b4a09a67b719508d8f812` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:24.518572 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8592a847-5818-4795-b334-2060cd6e07b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9fcf93e985b4a09a67b719508d8f812)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:24.523223 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8592a847-5818-4795-b334-2060cd6e07b1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:24.626244 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8592a847-5818-4795-b334-2060cd6e07b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9fcf93e985b4a09a67b719508d8f812'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:24.627453 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8592a847-5818-4795-b334-2060cd6e07b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9fcf93e985b4a09a67b719508d8f812'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:24.647557 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8592a847-5818-4795-b334-2060cd6e07b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9fcf93e985b4a09a67b719508d8f812'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:24.669619 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8592a847-5818-4795-b334-2060cd6e07b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9fcf93e985b4a09a67b719508d8f812'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:24.671156 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8592a847-5818-4795-b334-2060cd6e07b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9fcf93e985b4a09a67b719508d8f812'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:24.714654 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1600/3217] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:46:24 2022] DELETE /identity/v3/users/a9fcf93e985b4a09a67b719508d8f812 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:24.994866 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c59cb-9f6b-490d-9c58-5149ebc95495 service placement] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:25.008302 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c59cb-9f6b-490d-9c58-5149ebc95495 service placement] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:25.081724 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d49fd7-ecd7-4012-b554-ab6651d9f7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:25.082832 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d49fd7-ecd7-4012-b554-ab6651d9f7df admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:25.083543 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d49fd7-ecd7-4012-b554-ab6651d9f7df admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:25.083987 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d49fd7-ecd7-4012-b554-ab6651d9f7df admin admin] PATH_INFO: `/v3/projects/a27922448d754caea1e19340b11bfd64` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:25.085513 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d49fd7-ecd7-4012-b554-ab6651d9f7df admin admin] RBAC: Authorizing `identity:delete_project(project_id=a27922448d754caea1e19340b11bfd64)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:25.087764 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d49fd7-ecd7-4012-b554-ab6651d9f7df admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:25.152346 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-72d49fd7-ecd7-4012-b554-ab6651d9f7df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a27922448d754caea1e19340b11bfd64', 'request_id': 'req-72d49fd7-ecd7-4012-b554-ab6651d9f7df'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:25.163947 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-72d49fd7-ecd7-4012-b554-ab6651d9f7df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a27922448d754caea1e19340b11bfd64', 'request_id': 'req-72d49fd7-ecd7-4012-b554-ab6651d9f7df'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:25.176830 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-72d49fd7-ecd7-4012-b554-ab6651d9f7df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a27922448d754caea1e19340b11bfd64', 'request_id': 'req-72d49fd7-ecd7-4012-b554-ab6651d9f7df'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:25.199893 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-72d49fd7-ecd7-4012-b554-ab6651d9f7df admin admin] The token cache is being invalidate because project a27922448d754caea1e19340b11bfd64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:46:25.200282 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-72d49fd7-ecd7-4012-b554-ab6651d9f7df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:25.201734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-72d49fd7-ecd7-4012-b554-ab6651d9f7df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:25.203318 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1618/3218] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:46:24 2022] DELETE /identity/v3/projects/a27922448d754caea1e19340b11bfd64 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:25.209000 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24faa172-68d8-4389-b919-cbe488e112dd None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:25.209515 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24faa172-68d8-4389-b919-cbe488e112dd None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:25.209947 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24faa172-68d8-4389-b919-cbe488e112dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:25.260032 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:25.274903 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-24faa172-68d8-4389-b919-cbe488e112dd None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:25.276384 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-24faa172-68d8-4389-b919-cbe488e112dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:25.355766 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1601/3219] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:46:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:46:25.363412 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3798f63-4e37-46d0-94c0-0807106ffa51 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:25.363699 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3798f63-4e37-46d0-94c0-0807106ffa51 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:25.363976 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3798f63-4e37-46d0-94c0-0807106ffa51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:25.385132 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-a3798f63-4e37-46d0-94c0-0807106ffa51 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:25.386388 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a3798f63-4e37-46d0-94c0-0807106ffa51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:25.396018 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1619/3220] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:46:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:46:25.400354 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24faa172-68d8-4389-b919-cbe488e112dd None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:25.411078 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24faa172-68d8-4389-b919-cbe488e112dd None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:25.416240 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f945f3-3204-439b-bbe8-ea5f0d371f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:25.416867 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f945f3-3204-439b-bbe8-ea5f0d371f2c admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:25.417154 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f945f3-3204-439b-bbe8-ea5f0d371f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:25.417422 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f945f3-3204-439b-bbe8-ea5f0d371f2c admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:25.418065 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f945f3-3204-439b-bbe8-ea5f0d371f2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:46:25.418376 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f945f3-3204-439b-bbe8-ea5f0d371f2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:25.423776 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f945f3-3204-439b-bbe8-ea5f0d371f2c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:25.438466 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1602/3221] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:46:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:46:25.443224 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3798f63-4e37-46d0-94c0-0807106ffa51 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:25.454833 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3798f63-4e37-46d0-94c0-0807106ffa51 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:25.460220 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d0958c-c70d-4a53-9ac0-dc161a1ad776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:25.460833 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0958c-c70d-4a53-9ac0-dc161a1ad776 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:25.461118 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0958c-c70d-4a53-9ac0-dc161a1ad776 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:25.461393 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0958c-c70d-4a53-9ac0-dc161a1ad776 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:25.462040 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d0958c-c70d-4a53-9ac0-dc161a1ad776 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:25.464217 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d0958c-c70d-4a53-9ac0-dc161a1ad776 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:25.495176 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1620/3222] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:46:25 2022] POST /identity/v3/projects => generated 397 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:46:25.500379 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f945f3-3204-439b-bbe8-ea5f0d371f2c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:25.510977 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f945f3-3204-439b-bbe8-ea5f0d371f2c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:25.575636 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78e2f0-f92e-4757-940d-c0c6da258168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:25.577148 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78e2f0-f92e-4757-940d-c0c6da258168 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:25.577536 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78e2f0-f92e-4757-940d-c0c6da258168 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:25.577987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78e2f0-f92e-4757-940d-c0c6da258168 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:25.578860 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78e2f0-f92e-4757-940d-c0c6da258168 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:25.581745 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78e2f0-f92e-4757-940d-c0c6da258168 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:25.608264 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1603/3223] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:46:25 2022] POST /identity/v3/users => generated 299 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:25.612758 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d0958c-c70d-4a53-9ac0-dc161a1ad776 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:25.624885 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d0958c-c70d-4a53-9ac0-dc161a1ad776 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:25.629631 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3fb385-58e2-499a-a44d-a9cbab964de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:25.630228 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fb385-58e2-499a-a44d-a9cbab964de4 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:25.630501 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fb385-58e2-499a-a44d-a9cbab964de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:25.630765 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fb385-58e2-499a-a44d-a9cbab964de4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:25.631433 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3fb385-58e2-499a-a44d-a9cbab964de4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:25.633110 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3fb385-58e2-499a-a44d-a9cbab964de4 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:25.647391 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1621/3224] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:46:25.651649 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78e2f0-f92e-4757-940d-c0c6da258168 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:25.665042 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78e2f0-f92e-4757-940d-c0c6da258168 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:25.670191 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1e49b-cecd-4be0-bb34-15f9f54b78e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:25.670837 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1e49b-cecd-4be0-bb34-15f9f54b78e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:25.671163 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1e49b-cecd-4be0-bb34-15f9f54b78e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:25.671434 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1e49b-cecd-4be0-bb34-15f9f54b78e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:25.672110 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f1e49b-cecd-4be0-bb34-15f9f54b78e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:25.673740 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f1e49b-cecd-4be0-bb34-15f9f54b78e6 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:25.685946 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1604/3225] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:46:25.690345 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3fb385-58e2-499a-a44d-a9cbab964de4 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:25.703993 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3fb385-58e2-499a-a44d-a9cbab964de4 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:25.710272 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dacc42b-19e5-4439-b0fa-f26a36e6f303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:25.711506 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dacc42b-19e5-4439-b0fa-f26a36e6f303 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:25.711869 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dacc42b-19e5-4439-b0fa-f26a36e6f303 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:25.712335 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dacc42b-19e5-4439-b0fa-f26a36e6f303 admin admin] PATH_INFO: `/v3/projects/0a221479f5ac41ddbf38ca7b8551f0d3/users/acaa8c9ad876400b9878b6378b7bcdad/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:25.730490 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dacc42b-19e5-4439-b0fa-f26a36e6f303 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a221479f5ac41ddbf38ca7b8551f0d3, user_id=acaa8c9ad876400b9878b6378b7bcdad, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:25.733512 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dacc42b-19e5-4439-b0fa-f26a36e6f303 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:25.750415 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1622/3226] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:46:25 2022] PUT /identity/v3/projects/0a221479f5ac41ddbf38ca7b8551f0d3/users/acaa8c9ad876400b9878b6378b7bcdad/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:25.755628 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562c24b-5e8a-49e4-b252-1cf9ddf7981d None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:25.755907 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562c24b-5e8a-49e4-b252-1cf9ddf7981d None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:25.756282 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562c24b-5e8a-49e4-b252-1cf9ddf7981d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:25.777930 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-d562c24b-5e8a-49e4-b252-1cf9ddf7981d None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:25.779291 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d562c24b-5e8a-49e4-b252-1cf9ddf7981d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:25.848193 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1605/3227] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:46:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:46:25.862842 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dacc42b-19e5-4439-b0fa-f26a36e6f303 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:25.863874 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4dacc42b-19e5-4439-b0fa-f26a36e6f303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:25.893713 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:25.993883 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dacc42b-19e5-4439-b0fa-f26a36e6f303 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:26.000274 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e1584d-8692-4c65-a91e-7ccee17a1e6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:26.001326 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1584d-8692-4c65-a91e-7ccee17a1e6d service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:26.001909 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1584d-8692-4c65-a91e-7ccee17a1e6d service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:26.002391 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1584d-8692-4c65-a91e-7ccee17a1e6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:26.016055 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e1584d-8692-4c65-a91e-7ccee17a1e6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:26.017707 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e1584d-8692-4c65-a91e-7ccee17a1e6d service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:26.031886 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1623/3228] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:46:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:46:28.770475 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d562c24b-5e8a-49e4-b252-1cf9ddf7981d None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:28.786130 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d562c24b-5e8a-49e4-b252-1cf9ddf7981d None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:28.797959 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d34ad2-6b01-4188-a4ed-b8c941707eeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:28.798601 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d34ad2-6b01-4188-a4ed-b8c941707eeb service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:28.799008 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d34ad2-6b01-4188-a4ed-b8c941707eeb service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:28.799311 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d34ad2-6b01-4188-a4ed-b8c941707eeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:28.812546 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c6d34ad2-6b01-4188-a4ed-b8c941707eeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:28.826513 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:28.836121 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d34ad2-6b01-4188-a4ed-b8c941707eeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:28.837736 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d34ad2-6b01-4188-a4ed-b8c941707eeb service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:28.856334 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1606/3229] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:46:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:46:35.676412 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d848e48-b61f-4c97-80c8-06dffb98dd88 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:35.677100 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d848e48-b61f-4c97-80c8-06dffb98dd88 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:35.677100 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d848e48-b61f-4c97-80c8-06dffb98dd88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:35.713762 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-4d848e48-b61f-4c97-80c8-06dffb98dd88 None None] MFA Rules not processed for user `acaa8c9ad876400b9878b6378b7bcdad`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:35.715595 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4d848e48-b61f-4c97-80c8-06dffb98dd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:35.822324 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1624/3230] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:46:35 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:46:35.831442 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d34ad2-6b01-4188-a4ed-b8c941707eeb service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:35.834257 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c6d34ad2-6b01-4188-a4ed-b8c941707eeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:36.041102 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d34ad2-6b01-4188-a4ed-b8c941707eeb service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:36.062231 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a9b18-6c86-443f-89ca-54bc4fdeb3da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:36.063016 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a9b18-6c86-443f-89ca-54bc4fdeb3da service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:36.063497 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a9b18-6c86-443f-89ca-54bc4fdeb3da service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:36.063889 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a9b18-6c86-443f-89ca-54bc4fdeb3da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:36.082935 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50a9b18-6c86-443f-89ca-54bc4fdeb3da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:36.086592 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50a9b18-6c86-443f-89ca-54bc4fdeb3da service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:36.152438 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1607/3231] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:46:35 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:46:36.189825 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d848e48-b61f-4c97-80c8-06dffb98dd88 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:36.192426 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4d848e48-b61f-4c97-80c8-06dffb98dd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:36.430313 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d848e48-b61f-4c97-80c8-06dffb98dd88 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:36.438335 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873a9bf-2727-4105-a766-49945c2cd289 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:36.439317 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873a9bf-2727-4105-a766-49945c2cd289 service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:36.439432 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873a9bf-2727-4105-a766-49945c2cd289 service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:36.440334 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873a9bf-2727-4105-a766-49945c2cd289 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:36.441926 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1873a9bf-2727-4105-a766-49945c2cd289 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:36.461436 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1873a9bf-2727-4105-a766-49945c2cd289 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:36.463464 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1873a9bf-2727-4105-a766-49945c2cd289 service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:36.489579 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1625/3232] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:46:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:46:40.863732 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c7f19-ab10-484e-9a9f-dd8c494b8b20 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:40.864222 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c7f19-ab10-484e-9a9f-dd8c494b8b20 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:40.864316 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c7f19-ab10-484e-9a9f-dd8c494b8b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:40.899182 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-c02c7f19-ab10-484e-9a9f-dd8c494b8b20 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:40.901105 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c02c7f19-ab10-484e-9a9f-dd8c494b8b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:40.980217 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1608/3233] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 15:46:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:46:41.082509 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873a9bf-2727-4105-a766-49945c2cd289 service placement] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:41.084815 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1873a9bf-2727-4105-a766-49945c2cd289 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:41.112632 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:41.206294 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873a9bf-2727-4105-a766-49945c2cd289 service placement] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:41.212808 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865beee-fa38-4edf-b582-961d81d09711 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:41.213596 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865beee-fa38-4edf-b582-961d81d09711 service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:41.213721 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865beee-fa38-4edf-b582-961d81d09711 service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:41.213976 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865beee-fa38-4edf-b582-961d81d09711 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:41.228432 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8865beee-fa38-4edf-b582-961d81d09711 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:41.232603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8865beee-fa38-4edf-b582-961d81d09711 service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:41.243264 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1626/3234] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 15:46:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:46:49.349115 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c7f19-ab10-484e-9a9f-dd8c494b8b20 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:49.368295 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c7f19-ab10-484e-9a9f-dd8c494b8b20 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:49.422907 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a361b-745e-495d-8d75-8a148e64004b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:49.423794 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a361b-745e-495d-8d75-8a148e64004b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:49.424136 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a361b-745e-495d-8d75-8a148e64004b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:49.424484 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a361b-745e-495d-8d75-8a148e64004b admin admin] PATH_INFO: `/v3/users/acaa8c9ad876400b9878b6378b7bcdad` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:49.426662 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1a361b-745e-495d-8d75-8a148e64004b admin admin] RBAC: Authorizing `identity:delete_user(user_id=acaa8c9ad876400b9878b6378b7bcdad)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:49.429919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1a361b-745e-495d-8d75-8a148e64004b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:49.509294 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7a1a361b-745e-495d-8d75-8a148e64004b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acaa8c9ad876400b9878b6378b7bcdad'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:49.510160 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7a1a361b-745e-495d-8d75-8a148e64004b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acaa8c9ad876400b9878b6378b7bcdad'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:49.537290 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7a1a361b-745e-495d-8d75-8a148e64004b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acaa8c9ad876400b9878b6378b7bcdad'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:49.553503 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:49.566496 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7a1a361b-745e-495d-8d75-8a148e64004b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acaa8c9ad876400b9878b6378b7bcdad'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:49.570023 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7a1a361b-745e-495d-8d75-8a148e64004b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acaa8c9ad876400b9878b6378b7bcdad'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:49.655268 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1609/3235] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:46:49 2022] DELETE /identity/v3/users/acaa8c9ad876400b9878b6378b7bcdad => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:50.055242 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865beee-fa38-4edf-b582-961d81d09711 service swift] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:50.095710 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865beee-fa38-4edf-b582-961d81d09711 service swift] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:50.116675 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee2bd9-90e0-44b8-b589-aa4cb4d0d581 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:50.116933 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee2bd9-90e0-44b8-b589-aa4cb4d0d581 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:50.117210 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee2bd9-90e0-44b8-b589-aa4cb4d0d581 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:50.118724 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1610/3236] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 15:46:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:46:50.138754 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b1523-2f57-4d11-ab12-c71d367e1800 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:50.139114 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b1523-2f57-4d11-ab12-c71d367e1800 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:50.139350 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b1523-2f57-4d11-ab12-c71d367e1800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:50.195332 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-331b1523-2f57-4d11-ab12-c71d367e1800 None None] MFA Rules not processed for user `9a84bb38f6454574897120223b8fc140`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:50.196630 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-331b1523-2f57-4d11-ab12-c71d367e1800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:50.253001 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc8dde8-795e-4f39-8b19-d88a678b39fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:50.254092 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8dde8-795e-4f39-8b19-d88a678b39fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:50.254568 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8dde8-795e-4f39-8b19-d88a678b39fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:50.255087 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8dde8-795e-4f39-8b19-d88a678b39fb admin admin] PATH_INFO: `/v3/projects/0a221479f5ac41ddbf38ca7b8551f0d3` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:50.269611 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc8dde8-795e-4f39-8b19-d88a678b39fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a221479f5ac41ddbf38ca7b8551f0d3)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:50.272819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc8dde8-795e-4f39-8b19-d88a678b39fb admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:50.334090 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1611/3237] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 15:46:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:46:50.388916 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2dc8dde8-795e-4f39-8b19-d88a678b39fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a221479f5ac41ddbf38ca7b8551f0d3', 'request_id': 'req-2dc8dde8-795e-4f39-8b19-d88a678b39fb'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:50.400618 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2dc8dde8-795e-4f39-8b19-d88a678b39fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a221479f5ac41ddbf38ca7b8551f0d3', 'request_id': 'req-2dc8dde8-795e-4f39-8b19-d88a678b39fb'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:50.432387 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2dc8dde8-795e-4f39-8b19-d88a678b39fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a221479f5ac41ddbf38ca7b8551f0d3', 'request_id': 'req-2dc8dde8-795e-4f39-8b19-d88a678b39fb'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:50.462810 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2dc8dde8-795e-4f39-8b19-d88a678b39fb admin admin] The token cache is being invalidate because project 0a221479f5ac41ddbf38ca7b8551f0d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:46:50.466078 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2dc8dde8-795e-4f39-8b19-d88a678b39fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:50.466078 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2dc8dde8-795e-4f39-8b19-d88a678b39fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:50.470074 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1627/3238] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:46:50 2022] DELETE /identity/v3/projects/0a221479f5ac41ddbf38ca7b8551f0d3 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:50.471491 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2746b64-5241-4dce-bf23-bd2ad02315b4 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:50.471998 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2746b64-5241-4dce-bf23-bd2ad02315b4 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:50.472081 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2746b64-5241-4dce-bf23-bd2ad02315b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:50.510057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-c2746b64-5241-4dce-bf23-bd2ad02315b4 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:50.511337 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c2746b64-5241-4dce-bf23-bd2ad02315b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:50.635081 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1612/3239] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:46:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:46:50.644514 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d2b13-56e9-4c7a-bc5e-a2f24e3ffc97 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:50.644892 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d2b13-56e9-4c7a-bc5e-a2f24e3ffc97 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:50.645241 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d2b13-56e9-4c7a-bc5e-a2f24e3ffc97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:50.673668 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2746b64-5241-4dce-bf23-bd2ad02315b4 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:50.675415 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c2746b64-5241-4dce-bf23-bd2ad02315b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:50.717565 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-b20d2b13-56e9-4c7a-bc5e-a2f24e3ffc97 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:50.719128 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b20d2b13-56e9-4c7a-bc5e-a2f24e3ffc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:50.774388 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1628/3240] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:46:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:46:50.776829 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d2b13-56e9-4c7a-bc5e-a2f24e3ffc97 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:50.804349 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d2b13-56e9-4c7a-bc5e-a2f24e3ffc97 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:50.819242 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440988b-8a81-4fc7-bd4b-83effaccec9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:50.819926 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440988b-8a81-4fc7-bd4b-83effaccec9a admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:50.820203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440988b-8a81-4fc7-bd4b-83effaccec9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:50.820467 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440988b-8a81-4fc7-bd4b-83effaccec9a admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:50.821301 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5440988b-8a81-4fc7-bd4b-83effaccec9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:46:50.821607 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5440988b-8a81-4fc7-bd4b-83effaccec9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:50.823569 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5440988b-8a81-4fc7-bd4b-83effaccec9a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:50.860039 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1629/3241] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:46:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:46:50.864499 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440988b-8a81-4fc7-bd4b-83effaccec9a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:50.888236 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2746b64-5241-4dce-bf23-bd2ad02315b4 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:50.892413 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440988b-8a81-4fc7-bd4b-83effaccec9a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:50.899271 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c82a9b9-a0c4-48bb-8866-e9812b9437ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:50.899955 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82a9b9-a0c4-48bb-8866-e9812b9437ca service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:50.900231 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82a9b9-a0c4-48bb-8866-e9812b9437ca service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:50.900495 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82a9b9-a0c4-48bb-8866-e9812b9437ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:50.902837 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4c82a9b9-a0c4-48bb-8866-e9812b9437ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:50.905650 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b4710-1458-4179-867f-647e4cfbcf05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:50.906285 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b4710-1458-4179-867f-647e4cfbcf05 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:50.906564 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b4710-1458-4179-867f-647e4cfbcf05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:50.908083 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b4710-1458-4179-867f-647e4cfbcf05 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:50.908744 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88b4710-1458-4179-867f-647e4cfbcf05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:50.913704 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88b4710-1458-4179-867f-647e4cfbcf05 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:50.930737 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c82a9b9-a0c4-48bb-8866-e9812b9437ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:50.932248 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c82a9b9-a0c4-48bb-8866-e9812b9437ca service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:50.953015 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1613/3242] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:46:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:46:50.956170 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:50.998629 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1630/3243] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:46:50 2022] POST /identity/v3/projects => generated 391 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:50.998828 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c82a9b9-a0c4-48bb-8866-e9812b9437ca service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:51.015449 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c82a9b9-a0c4-48bb-8866-e9812b9437ca service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:51.096515 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:51.175668 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61434c33-b089-4373-98b1-5ff63c729de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:51.176304 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61434c33-b089-4373-98b1-5ff63c729de5 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:51.176576 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61434c33-b089-4373-98b1-5ff63c729de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:51.176934 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61434c33-b089-4373-98b1-5ff63c729de5 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:51.177578 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61434c33-b089-4373-98b1-5ff63c729de5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:51.179738 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61434c33-b089-4373-98b1-5ff63c729de5 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:51.241317 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1614/3244] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:46:50 2022] POST /identity/v3/users => generated 296 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:46:51.242504 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b4710-1458-4179-867f-647e4cfbcf05 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:51.262138 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b4710-1458-4179-867f-647e4cfbcf05 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:51.280684 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a3cc9-ff1b-4c38-a014-f9dd3830b99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:51.282050 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a3cc9-ff1b-4c38-a014-f9dd3830b99b admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:51.282413 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a3cc9-ff1b-4c38-a014-f9dd3830b99b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:51.283487 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a3cc9-ff1b-4c38-a014-f9dd3830b99b admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:51.284478 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a3cc9-ff1b-4c38-a014-f9dd3830b99b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:51.289216 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a3cc9-ff1b-4c38-a014-f9dd3830b99b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:51.326727 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1631/3245] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:46:51.330158 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61434c33-b089-4373-98b1-5ff63c729de5 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:51.342682 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61434c33-b089-4373-98b1-5ff63c729de5 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:51.359252 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87cebb-bc2d-44a1-935b-d978832f4f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:51.359966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87cebb-bc2d-44a1-935b-d978832f4f27 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:51.360315 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87cebb-bc2d-44a1-935b-d978832f4f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:51.360666 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87cebb-bc2d-44a1-935b-d978832f4f27 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:51.361386 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e87cebb-bc2d-44a1-935b-d978832f4f27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:51.365206 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e87cebb-bc2d-44a1-935b-d978832f4f27 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:51.392196 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a3cc9-ff1b-4c38-a014-f9dd3830b99b admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:51.395293 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1615/3246] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:46:51.414065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a3cc9-ff1b-4c38-a014-f9dd3830b99b admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:51.437189 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351710a-44de-444f-8513-437d3fae9d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:51.437884 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351710a-44de-444f-8513-437d3fae9d2b admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:51.438164 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351710a-44de-444f-8513-437d3fae9d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:51.438438 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351710a-44de-444f-8513-437d3fae9d2b admin admin] PATH_INFO: `/v3/projects/5cbb49e2c7b44bfc88daa86ad4a568c5/users/e77747aef70040c98167ea7daddf25c6/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:51.500472 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0351710a-44de-444f-8513-437d3fae9d2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cbb49e2c7b44bfc88daa86ad4a568c5, user_id=e77747aef70040c98167ea7daddf25c6, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:51.503196 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0351710a-44de-444f-8513-437d3fae9d2b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:51.549501 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1632/3247] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:46:51 2022] PUT /identity/v3/projects/5cbb49e2c7b44bfc88daa86ad4a568c5/users/e77747aef70040c98167ea7daddf25c6/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:51.554446 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbe18f-2604-43ab-bd2e-faf9c317083e None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:51.554952 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbe18f-2604-43ab-bd2e-faf9c317083e None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:51.555071 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbe18f-2604-43ab-bd2e-faf9c317083e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:51.594908 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-14cbe18f-2604-43ab-bd2e-faf9c317083e None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:51.599744 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-14cbe18f-2604-43ab-bd2e-faf9c317083e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:51.769745 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1616/3248] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:46:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:46:51.799988 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351710a-44de-444f-8513-437d3fae9d2b admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:51.943623 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351710a-44de-444f-8513-437d3fae9d2b admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:51.954870 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3aebb-8e62-4e36-b80e-9d0a5ccbedf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:51.955711 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3aebb-8e62-4e36-b80e-9d0a5ccbedf2 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:51.956096 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3aebb-8e62-4e36-b80e-9d0a5ccbedf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:51.956458 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3aebb-8e62-4e36-b80e-9d0a5ccbedf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:51.979387 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc3aebb-8e62-4e36-b80e-9d0a5ccbedf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:51.980845 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc3aebb-8e62-4e36-b80e-9d0a5ccbedf2 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:52.012421 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1633/3249] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:46:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:46:53.545903 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cbe18f-2604-43ab-bd2e-faf9c317083e None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:53.548238 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-14cbe18f-2604-43ab-bd2e-faf9c317083e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:53.573715 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cbe18f-2604-43ab-bd2e-faf9c317083e None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:53.586809 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d9413-4966-435e-9228-8809aba1d03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:53.587817 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d9413-4966-435e-9228-8809aba1d03f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:53.588247 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d9413-4966-435e-9228-8809aba1d03f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:53.588658 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d9413-4966-435e-9228-8809aba1d03f admin admin] PATH_INFO: `/v3/users/f12698b45a114720af9c98b163077f59` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:53.589975 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d9413-4966-435e-9228-8809aba1d03f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f12698b45a114720af9c98b163077f59)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:53.593279 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d9413-4966-435e-9228-8809aba1d03f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:53.694621 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3e7d9413-4966-435e-9228-8809aba1d03f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f12698b45a114720af9c98b163077f59'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:53.695777 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3e7d9413-4966-435e-9228-8809aba1d03f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f12698b45a114720af9c98b163077f59'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:53.718869 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3e7d9413-4966-435e-9228-8809aba1d03f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f12698b45a114720af9c98b163077f59'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:53.729641 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3e7d9413-4966-435e-9228-8809aba1d03f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f12698b45a114720af9c98b163077f59'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:53.731994 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3e7d9413-4966-435e-9228-8809aba1d03f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f12698b45a114720af9c98b163077f59'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:53.768127 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1617/3250] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:46:53 2022] DELETE /identity/v3/users/f12698b45a114720af9c98b163077f59 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:55.430037 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3aebb-8e62-4e36-b80e-9d0a5ccbedf2 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:55.442937 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3aebb-8e62-4e36-b80e-9d0a5ccbedf2 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:55.713623 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857f3ac-1fec-4e33-af84-3086394e02d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:55.714287 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857f3ac-1fec-4e33-af84-3086394e02d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:55.714563 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857f3ac-1fec-4e33-af84-3086394e02d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:55.714832 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857f3ac-1fec-4e33-af84-3086394e02d0 admin admin] PATH_INFO: `/v3/projects/70d66d1258d14a39b174734f9865c070` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:55.717899 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f857f3ac-1fec-4e33-af84-3086394e02d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70d66d1258d14a39b174734f9865c070)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:55.730405 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f857f3ac-1fec-4e33-af84-3086394e02d0 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:55.892080 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f857f3ac-1fec-4e33-af84-3086394e02d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70d66d1258d14a39b174734f9865c070', 'request_id': 'req-f857f3ac-1fec-4e33-af84-3086394e02d0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:55.909278 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f857f3ac-1fec-4e33-af84-3086394e02d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70d66d1258d14a39b174734f9865c070', 'request_id': 'req-f857f3ac-1fec-4e33-af84-3086394e02d0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:55.917270 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:55.932585 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f857f3ac-1fec-4e33-af84-3086394e02d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70d66d1258d14a39b174734f9865c070', 'request_id': 'req-f857f3ac-1fec-4e33-af84-3086394e02d0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:55.960929 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f857f3ac-1fec-4e33-af84-3086394e02d0 admin admin] The token cache is being invalidate because project 70d66d1258d14a39b174734f9865c070 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:46:55.961227 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f857f3ac-1fec-4e33-af84-3086394e02d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:55.962264 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f857f3ac-1fec-4e33-af84-3086394e02d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:55.970542 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1634/3251] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:46:55 2022] DELETE /identity/v3/projects/70d66d1258d14a39b174734f9865c070 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:55.971720 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d9413-4966-435e-9228-8809aba1d03f admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:55.973525 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3e7d9413-4966-435e-9228-8809aba1d03f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:56.012036 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d9413-4966-435e-9228-8809aba1d03f admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:56.053344 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:56.149730 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b693785-e8cd-4a9d-8db5-1e7fb3459a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:56.150316 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b693785-e8cd-4a9d-8db5-1e7fb3459a55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:56.154681 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b693785-e8cd-4a9d-8db5-1e7fb3459a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:56.154964 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b693785-e8cd-4a9d-8db5-1e7fb3459a55 admin admin] PATH_INFO: `/v3/users/bb270a356b6e45088b6bdceac76bddff` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:56.156423 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b693785-e8cd-4a9d-8db5-1e7fb3459a55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb270a356b6e45088b6bdceac76bddff)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:56.161768 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b693785-e8cd-4a9d-8db5-1e7fb3459a55 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:56.293202 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2b693785-e8cd-4a9d-8db5-1e7fb3459a55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb270a356b6e45088b6bdceac76bddff'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:56.294106 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2b693785-e8cd-4a9d-8db5-1e7fb3459a55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb270a356b6e45088b6bdceac76bddff'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:56.316310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2b693785-e8cd-4a9d-8db5-1e7fb3459a55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb270a356b6e45088b6bdceac76bddff'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:56.326553 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2b693785-e8cd-4a9d-8db5-1e7fb3459a55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb270a356b6e45088b6bdceac76bddff'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:56.328075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2b693785-e8cd-4a9d-8db5-1e7fb3459a55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb270a356b6e45088b6bdceac76bddff'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:56.370241 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1618/3252] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:46:55 2022] DELETE /identity/v3/users/bb270a356b6e45088b6bdceac76bddff => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:57.040191 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857f3ac-1fec-4e33-af84-3086394e02d0 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:57.041928 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f857f3ac-1fec-4e33-af84-3086394e02d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:57.083153 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857f3ac-1fec-4e33-af84-3086394e02d0 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:57.365502 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f648c2-1006-4c99-8507-94dde7d74301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:57.372373 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f648c2-1006-4c99-8507-94dde7d74301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:57.372658 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f648c2-1006-4c99-8507-94dde7d74301 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:57.372935 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f648c2-1006-4c99-8507-94dde7d74301 admin admin] PATH_INFO: `/v3/projects/26f2897e6c834a6092115b0996f73672` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:57.376431 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f648c2-1006-4c99-8507-94dde7d74301 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26f2897e6c834a6092115b0996f73672)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:57.381436 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f648c2-1006-4c99-8507-94dde7d74301 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:57.619354 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-14f648c2-1006-4c99-8507-94dde7d74301 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26f2897e6c834a6092115b0996f73672', 'request_id': 'req-14f648c2-1006-4c99-8507-94dde7d74301'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:57.637227 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-14f648c2-1006-4c99-8507-94dde7d74301 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26f2897e6c834a6092115b0996f73672', 'request_id': 'req-14f648c2-1006-4c99-8507-94dde7d74301'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:57.671814 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-14f648c2-1006-4c99-8507-94dde7d74301 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26f2897e6c834a6092115b0996f73672', 'request_id': 'req-14f648c2-1006-4c99-8507-94dde7d74301'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:57.704662 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-14f648c2-1006-4c99-8507-94dde7d74301 admin admin] The token cache is being invalidate because project 26f2897e6c834a6092115b0996f73672 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:46:57.704957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-14f648c2-1006-4c99-8507-94dde7d74301 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:57.707634 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-14f648c2-1006-4c99-8507-94dde7d74301 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:57.720526 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa506f-11d6-4387-884f-1543ce3c82dc None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:57.721051 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa506f-11d6-4387-884f-1543ce3c82dc None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:57.721051 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa506f-11d6-4387-884f-1543ce3c82dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:57.729227 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1635/3253] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:46:57 2022] DELETE /identity/v3/projects/26f2897e6c834a6092115b0996f73672 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:57.762140 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a8aa506f-11d6-4387-884f-1543ce3c82dc None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:57.764481 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a8aa506f-11d6-4387-884f-1543ce3c82dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:57.921619 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1619/3254] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:46:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:46:57.987199 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee53632-8985-44ac-872c-32c2093e6fe3 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:57.987516 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee53632-8985-44ac-872c-32c2093e6fe3 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:57.987825 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee53632-8985-44ac-872c-32c2093e6fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:58.025272 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-1ee53632-8985-44ac-872c-32c2093e6fe3 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:58.030542 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1ee53632-8985-44ac-872c-32c2093e6fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:58.057582 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1636/3255] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:46:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:46:58.061229 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa506f-11d6-4387-884f-1543ce3c82dc None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:58.080117 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa506f-11d6-4387-884f-1543ce3c82dc None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:58.097359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2e81c-d1c0-453f-90ca-534371899706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:58.097905 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2e81c-d1c0-453f-90ca-534371899706 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:58.098179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2e81c-d1c0-453f-90ca-534371899706 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:58.098449 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2e81c-d1c0-453f-90ca-534371899706 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:58.099136 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf2e81c-d1c0-453f-90ca-534371899706 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:46:58.099443 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf2e81c-d1c0-453f-90ca-534371899706 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:58.101056 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf2e81c-d1c0-453f-90ca-534371899706 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:58.150156 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1620/3256] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:46:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:46:58.154519 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee53632-8985-44ac-872c-32c2093e6fe3 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:58.170782 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee53632-8985-44ac-872c-32c2093e6fe3 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:58.182112 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bc680-057a-48d7-a441-9241edf218ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:58.182751 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bc680-057a-48d7-a441-9241edf218ad admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:58.183050 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bc680-057a-48d7-a441-9241edf218ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:58.183348 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bc680-057a-48d7-a441-9241edf218ad admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:58.218607 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5bc680-057a-48d7-a441-9241edf218ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:58.228885 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2e81c-d1c0-453f-90ca-534371899706 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:58.232384 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8bf2e81c-d1c0-453f-90ca-534371899706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:58.240542 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5bc680-057a-48d7-a441-9241edf218ad admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:58.259417 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2e81c-d1c0-453f-90ca-534371899706 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:58.274217 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d249819-a007-42f1-b53b-16d324e45f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:58.275187 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d249819-a007-42f1-b53b-16d324e45f04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:58.275667 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d249819-a007-42f1-b53b-16d324e45f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:58.276134 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d249819-a007-42f1-b53b-16d324e45f04 admin admin] PATH_INFO: `/v3/users/5c9cc007c0504400b414c395570e98ca` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:58.278749 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d249819-a007-42f1-b53b-16d324e45f04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c9cc007c0504400b414c395570e98ca)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:58.285687 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d249819-a007-42f1-b53b-16d324e45f04 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:58.336754 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1637/3257] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:46:58 2022] POST /identity/v3/projects => generated 405 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:58.338581 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bc680-057a-48d7-a441-9241edf218ad admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:58.365261 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:58.438982 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8d249819-a007-42f1-b53b-16d324e45f04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c9cc007c0504400b414c395570e98ca'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:58.442703 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8d249819-a007-42f1-b53b-16d324e45f04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c9cc007c0504400b414c395570e98ca'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:58.486425 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8d249819-a007-42f1-b53b-16d324e45f04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c9cc007c0504400b414c395570e98ca'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:58.528508 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8d249819-a007-42f1-b53b-16d324e45f04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c9cc007c0504400b414c395570e98ca'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:58.534002 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8d249819-a007-42f1-b53b-16d324e45f04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c9cc007c0504400b414c395570e98ca'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:58.600865 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:58.643247 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1621/3258] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:46:58 2022] DELETE /identity/v3/users/5c9cc007c0504400b414c395570e98ca => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:46:58.646184 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bc680-057a-48d7-a441-9241edf218ad admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:58.693919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d249819-a007-42f1-b53b-16d324e45f04 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:58.696236 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8d249819-a007-42f1-b53b-16d324e45f04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:58.800871 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3459747-2d9e-4912-bddc-672c1f318183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:58.801503 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3459747-2d9e-4912-bddc-672c1f318183 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:58.806646 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3459747-2d9e-4912-bddc-672c1f318183 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:58.806646 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3459747-2d9e-4912-bddc-672c1f318183 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:58.806646 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3459747-2d9e-4912-bddc-672c1f318183 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:58.806646 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3459747-2d9e-4912-bddc-672c1f318183 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:58.867625 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1638/3259] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:46:58 2022] POST /identity/v3/users => generated 303 bytes in 530 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:58.872934 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3459747-2d9e-4912-bddc-672c1f318183 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:58.877835 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c3459747-2d9e-4912-bddc-672c1f318183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:58.889444 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d249819-a007-42f1-b53b-16d324e45f04 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:58.903713 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354eac53-c9bc-4483-a9d7-670c9f2983e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:58.905224 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354eac53-c9bc-4483-a9d7-670c9f2983e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:58.905695 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354eac53-c9bc-4483-a9d7-670c9f2983e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:58.906163 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354eac53-c9bc-4483-a9d7-670c9f2983e8 admin admin] PATH_INFO: `/v3/users/cc90d88d1e574a94858bbe2523855caa` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:58.912043 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354eac53-c9bc-4483-a9d7-670c9f2983e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc90d88d1e574a94858bbe2523855caa)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:58.916012 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354eac53-c9bc-4483-a9d7-670c9f2983e8 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:58.917590 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3459747-2d9e-4912-bddc-672c1f318183 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:58.939236 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d288672e-a898-4ed2-b595-3b137ac292fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:58.939877 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288672e-a898-4ed2-b595-3b137ac292fa admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:58.940164 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288672e-a898-4ed2-b595-3b137ac292fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:58.940441 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288672e-a898-4ed2-b595-3b137ac292fa admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:58.941233 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d288672e-a898-4ed2-b595-3b137ac292fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:58.942741 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d288672e-a898-4ed2-b595-3b137ac292fa admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:58.979665 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1639/3260] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:46:58.986213 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d288672e-a898-4ed2-b595-3b137ac292fa admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:59.021833 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d288672e-a898-4ed2-b595-3b137ac292fa admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:59.050142 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b5094-48b6-4e9e-938a-180427ec8251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:59.050778 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b5094-48b6-4e9e-938a-180427ec8251 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:59.051104 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b5094-48b6-4e9e-938a-180427ec8251 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:59.051415 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b5094-48b6-4e9e-938a-180427ec8251 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:59.052106 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36b5094-48b6-4e9e-938a-180427ec8251 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:59.062988 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36b5094-48b6-4e9e-938a-180427ec8251 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:59.066677 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-354eac53-c9bc-4483-a9d7-670c9f2983e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc90d88d1e574a94858bbe2523855caa'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:59.067721 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-354eac53-c9bc-4483-a9d7-670c9f2983e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc90d88d1e574a94858bbe2523855caa'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:59.092788 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-354eac53-c9bc-4483-a9d7-670c9f2983e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc90d88d1e574a94858bbe2523855caa'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:59.106681 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1640/3261] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:46:59.111131 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b5094-48b6-4e9e-938a-180427ec8251 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:59.112409 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-354eac53-c9bc-4483-a9d7-670c9f2983e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc90d88d1e574a94858bbe2523855caa'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:59.113625 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-354eac53-c9bc-4483-a9d7-670c9f2983e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc90d88d1e574a94858bbe2523855caa'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:59.139723 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b5094-48b6-4e9e-938a-180427ec8251 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:59.150777 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531523c-ce35-4859-84ec-475658bb3e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:59.152147 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531523c-ce35-4859-84ec-475658bb3e29 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:59.152846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531523c-ce35-4859-84ec-475658bb3e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:59.153485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531523c-ce35-4859-84ec-475658bb3e29 admin admin] PATH_INFO: `/v3/projects/3934ada7361e4c729ac47f2288234d80/users/4b32312a6f064e4b95249481ff6cd530/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:59.156565 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1622/3262] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:46:58 2022] DELETE /identity/v3/users/cc90d88d1e574a94858bbe2523855caa => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:59.161931 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefc2fc-d5e9-43ff-a9f1-cc06dbb1132d None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:59.162493 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefc2fc-d5e9-43ff-a9f1-cc06dbb1132d None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:59.162971 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefc2fc-d5e9-43ff-a9f1-cc06dbb1132d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:59.176630 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531523c-ce35-4859-84ec-475658bb3e29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3934ada7361e4c729ac47f2288234d80, user_id=4b32312a6f064e4b95249481ff6cd530, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:59.180867 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531523c-ce35-4859-84ec-475658bb3e29 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:59.210065 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1641/3263] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:46:59 2022] PUT /identity/v3/projects/3934ada7361e4c729ac47f2288234d80/users/4b32312a6f064e4b95249481ff6cd530/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:59.220873 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af9dc2-3e7f-4aab-8ef2-60b2d8647b0f None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:59.221648 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af9dc2-3e7f-4aab-8ef2-60b2d8647b0f None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:59.222221 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af9dc2-3e7f-4aab-8ef2-60b2d8647b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:59.228198 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-3eefc2fc-d5e9-43ff-a9f1-cc06dbb1132d None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:59.229479 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3eefc2fc-d5e9-43ff-a9f1-cc06dbb1132d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:59.273888 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:59.276749 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-a6af9dc2-3e7f-4aab-8ef2-60b2d8647b0f None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:59.278513 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a6af9dc2-3e7f-4aab-8ef2-60b2d8647b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:59.446937 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1623/3264] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:46:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:46:59.462886 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eefc2fc-d5e9-43ff-a9f1-cc06dbb1132d None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:59.464425 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3eefc2fc-d5e9-43ff-a9f1-cc06dbb1132d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:59.495564 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1642/3265] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:46:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:46:59.550576 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af9dc2-3e7f-4aab-8ef2-60b2d8647b0f None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:59.553139 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a6af9dc2-3e7f-4aab-8ef2-60b2d8647b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:59.609907 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eefc2fc-d5e9-43ff-a9f1-cc06dbb1132d None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:59.615737 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f2118-8697-4052-ae47-0c1b45ad9d0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:59.616376 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f2118-8697-4052-ae47-0c1b45ad9d0a service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:59.616655 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f2118-8697-4052-ae47-0c1b45ad9d0a service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:59.616930 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f2118-8697-4052-ae47-0c1b45ad9d0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:59.655143 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0f2118-8697-4052-ae47-0c1b45ad9d0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:59.656624 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0f2118-8697-4052-ae47-0c1b45ad9d0a service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:59.681531 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1624/3266] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:46:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:46:59.682689 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f2118-8697-4052-ae47-0c1b45ad9d0a service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:59.686913 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3b0f2118-8697-4052-ae47-0c1b45ad9d0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:59.727743 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f2118-8697-4052-ae47-0c1b45ad9d0a service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:59.740194 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ddf6c1-6821-447b-a8cd-6271bdd07910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:59.742160 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ddf6c1-6821-447b-a8cd-6271bdd07910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:59.742649 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ddf6c1-6821-447b-a8cd-6271bdd07910 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:59.743224 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ddf6c1-6821-447b-a8cd-6271bdd07910 admin admin] PATH_INFO: `/v3/projects/c649ecccd1a4487aa9e1a282d631be1a` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:59.758285 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ddf6c1-6821-447b-a8cd-6271bdd07910 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c649ecccd1a4487aa9e1a282d631be1a)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:59.761322 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ddf6c1-6821-447b-a8cd-6271bdd07910 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:59.785120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:59.825274 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af9dc2-3e7f-4aab-8ef2-60b2d8647b0f None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:59.840973 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684570c4-3fbb-419a-ab29-bf27b60bc3ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:59.841815 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684570c4-3fbb-419a-ab29-bf27b60bc3ef service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:59.844004 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684570c4-3fbb-419a-ab29-bf27b60bc3ef service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:59.846072 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684570c4-3fbb-419a-ab29-bf27b60bc3ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:59.867299 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b8ddf6c1-6821-447b-a8cd-6271bdd07910 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c649ecccd1a4487aa9e1a282d631be1a', 'request_id': 'req-b8ddf6c1-6821-447b-a8cd-6271bdd07910'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:59.871130 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684570c4-3fbb-419a-ab29-bf27b60bc3ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:59.874838 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684570c4-3fbb-419a-ab29-bf27b60bc3ef service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:59.884403 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b8ddf6c1-6821-447b-a8cd-6271bdd07910 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c649ecccd1a4487aa9e1a282d631be1a', 'request_id': 'req-b8ddf6c1-6821-447b-a8cd-6271bdd07910'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:59.910758 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b8ddf6c1-6821-447b-a8cd-6271bdd07910 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c649ecccd1a4487aa9e1a282d631be1a', 'request_id': 'req-b8ddf6c1-6821-447b-a8cd-6271bdd07910'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:59.917493 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1643/3267] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:46:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:46:59.943799 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b8ddf6c1-6821-447b-a8cd-6271bdd07910 admin admin] The token cache is being invalidate because project c649ecccd1a4487aa9e1a282d631be1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:46:59.944173 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b8ddf6c1-6821-447b-a8cd-6271bdd07910 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:59.945167 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b8ddf6c1-6821-447b-a8cd-6271bdd07910 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:59.947207 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1625/3268] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:46:59 2022] DELETE /identity/v3/projects/c649ecccd1a4487aa9e1a282d631be1a => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:59.952664 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed95a71-3f01-451e-a992-7c3cda954756 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:59.953371 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed95a71-3f01-451e-a992-7c3cda954756 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:59.953805 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed95a71-3f01-451e-a992-7c3cda954756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:59.994180 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-8ed95a71-3f01-451e-a992-7c3cda954756 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:59.996003 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8ed95a71-3f01-451e-a992-7c3cda954756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:00.080810 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ddf6c1-6821-447b-a8cd-6271bdd07910 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:00.083386 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b8ddf6c1-6821-447b-a8cd-6271bdd07910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:00.145834 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1644/3269] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:46:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:00.166048 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217a70b-dc61-43e5-99c7-991e55b2ac31 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:00.166048 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217a70b-dc61-43e5-99c7-991e55b2ac31 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:00.166048 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217a70b-dc61-43e5-99c7-991e55b2ac31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:00.216642 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-c217a70b-dc61-43e5-99c7-991e55b2ac31 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:00.218118 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c217a70b-dc61-43e5-99c7-991e55b2ac31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:00.221684 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:00.246301 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ddf6c1-6821-447b-a8cd-6271bdd07910 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:00.248644 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1645/3270] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:47:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:00.253100 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c217a70b-dc61-43e5-99c7-991e55b2ac31 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:00.276773 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a905be1-d4e9-45c0-bf7e-51dd0f74f12e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:00.277412 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a905be1-d4e9-45c0-bf7e-51dd0f74f12e service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:00.278807 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c217a70b-dc61-43e5-99c7-991e55b2ac31 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:00.281162 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a905be1-d4e9-45c0-bf7e-51dd0f74f12e service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:00.281449 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a905be1-d4e9-45c0-bf7e-51dd0f74f12e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:00.290798 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4a905be1-d4e9-45c0-bf7e-51dd0f74f12e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:00.296633 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3df95-e8e4-404d-a73c-89eefaa94836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:00.299499 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3df95-e8e4-404d-a73c-89eefaa94836 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:00.300393 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3df95-e8e4-404d-a73c-89eefaa94836 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:00.300678 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3df95-e8e4-404d-a73c-89eefaa94836 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:00.301365 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a3df95-e8e4-404d-a73c-89eefaa94836 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:47:00.301880 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a3df95-e8e4-404d-a73c-89eefaa94836 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:00.307974 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a3df95-e8e4-404d-a73c-89eefaa94836 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:00.344861 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1646/3271] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:47:00.346041 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3df95-e8e4-404d-a73c-89eefaa94836 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:00.372646 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3df95-e8e4-404d-a73c-89eefaa94836 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:00.388662 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24114134-6c82-4380-91c3-1753f82e7ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:00.389324 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24114134-6c82-4380-91c3-1753f82e7ada admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:00.389611 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24114134-6c82-4380-91c3-1753f82e7ada admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:00.389890 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24114134-6c82-4380-91c3-1753f82e7ada admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:00.390663 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24114134-6c82-4380-91c3-1753f82e7ada admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:00.392685 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24114134-6c82-4380-91c3-1753f82e7ada admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:00.415895 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a905be1-d4e9-45c0-bf7e-51dd0f74f12e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:00.426381 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a905be1-d4e9-45c0-bf7e-51dd0f74f12e service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:00.454795 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1626/3272] 10.222.0.83 () {60 vars in 1396 bytes} [Mon Aug 29 15:47:00 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3252 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:47:00.459259 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1647/3273] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:47:00 2022] POST /identity/v3/projects => generated 381 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:00.460640 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a905be1-d4e9-45c0-bf7e-51dd0f74f12e service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:00.479877 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a905be1-d4e9-45c0-bf7e-51dd0f74f12e service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:00.592604 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c9778-eb34-4fb9-989b-5814a3de5aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:00.593256 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c9778-eb34-4fb9-989b-5814a3de5aeb admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:00.593535 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c9778-eb34-4fb9-989b-5814a3de5aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:00.594011 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c9778-eb34-4fb9-989b-5814a3de5aeb admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:00.594807 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2c9778-eb34-4fb9-989b-5814a3de5aeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:00.597579 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2c9778-eb34-4fb9-989b-5814a3de5aeb admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:00.665196 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1627/3274] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:47:00 2022] POST /identity/v3/users => generated 291 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:00.669131 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24114134-6c82-4380-91c3-1753f82e7ada admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:00.680066 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24114134-6c82-4380-91c3-1753f82e7ada admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:00.685968 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88bcd14-7ec2-4368-8cf7-b6c2d625de09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:00.686587 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88bcd14-7ec2-4368-8cf7-b6c2d625de09 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:00.686861 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88bcd14-7ec2-4368-8cf7-b6c2d625de09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:00.687164 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88bcd14-7ec2-4368-8cf7-b6c2d625de09 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:00.687808 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88bcd14-7ec2-4368-8cf7-b6c2d625de09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:00.689419 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88bcd14-7ec2-4368-8cf7-b6c2d625de09 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:00.706268 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1648/3275] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:47:00.706716 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c9778-eb34-4fb9-989b-5814a3de5aeb admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:00.723954 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c9778-eb34-4fb9-989b-5814a3de5aeb admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:00.734710 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152e8d7-384a-4dbf-a7b1-a54b1b6a192c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:00.735382 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152e8d7-384a-4dbf-a7b1-a54b1b6a192c admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:00.735673 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152e8d7-384a-4dbf-a7b1-a54b1b6a192c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:00.736196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152e8d7-384a-4dbf-a7b1-a54b1b6a192c admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:00.736854 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152e8d7-384a-4dbf-a7b1-a54b1b6a192c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:00.739276 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152e8d7-384a-4dbf-a7b1-a54b1b6a192c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:00.759755 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1628/3276] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:47:00.761173 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88bcd14-7ec2-4368-8cf7-b6c2d625de09 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:00.789818 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88bcd14-7ec2-4368-8cf7-b6c2d625de09 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:00.807577 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d80bb5-74f2-41a0-9e94-b633cd483c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:00.808577 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d80bb5-74f2-41a0-9e94-b633cd483c41 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:00.809584 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d80bb5-74f2-41a0-9e94-b633cd483c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:00.810033 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d80bb5-74f2-41a0-9e94-b633cd483c41 admin admin] PATH_INFO: `/v3/projects/99a31c64e992417d8862b3443fa8c105/users/085145c4942d4c889c291a99eb1d009a/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:00.838619 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d80bb5-74f2-41a0-9e94-b633cd483c41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99a31c64e992417d8862b3443fa8c105, user_id=085145c4942d4c889c291a99eb1d009a, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:00.842812 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d80bb5-74f2-41a0-9e94-b633cd483c41 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:00.869294 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1649/3277] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:47:00 2022] PUT /identity/v3/projects/99a31c64e992417d8862b3443fa8c105/users/085145c4942d4c889c291a99eb1d009a/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:00.871515 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e070a46-cda1-41a8-9108-b6650a507ddf None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:00.871803 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e070a46-cda1-41a8-9108-b6650a507ddf None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:00.872139 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e070a46-cda1-41a8-9108-b6650a507ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:00.938097 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-1e070a46-cda1-41a8-9108-b6650a507ddf None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:00.939383 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1e070a46-cda1-41a8-9108-b6650a507ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:01.076402 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1629/3278] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:47:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:01.096392 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d80bb5-74f2-41a0-9e94-b633cd483c41 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:01.099251 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-13d80bb5-74f2-41a0-9e94-b633cd483c41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:01.129881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d80bb5-74f2-41a0-9e94-b633cd483c41 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:01.145338 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55fc564-c192-4a28-a0f7-f2ccc59c2744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:01.146259 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fc564-c192-4a28-a0f7-f2ccc59c2744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:01.146819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fc564-c192-4a28-a0f7-f2ccc59c2744 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:01.146819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fc564-c192-4a28-a0f7-f2ccc59c2744 admin admin] PATH_INFO: `/v3/projects/95b8e2179e1f4fa6bf596a8dd85f761c` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:01.158092 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55fc564-c192-4a28-a0f7-f2ccc59c2744 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95b8e2179e1f4fa6bf596a8dd85f761c)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:01.161010 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55fc564-c192-4a28-a0f7-f2ccc59c2744 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:01.237836 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e070a46-cda1-41a8-9108-b6650a507ddf None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:01.240824 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1e070a46-cda1-41a8-9108-b6650a507ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:01.279651 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f55fc564-c192-4a28-a0f7-f2ccc59c2744 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95b8e2179e1f4fa6bf596a8dd85f761c', 'request_id': 'req-f55fc564-c192-4a28-a0f7-f2ccc59c2744'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:01.283886 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:01.300126 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f55fc564-c192-4a28-a0f7-f2ccc59c2744 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95b8e2179e1f4fa6bf596a8dd85f761c', 'request_id': 'req-f55fc564-c192-4a28-a0f7-f2ccc59c2744'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:01.322472 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f55fc564-c192-4a28-a0f7-f2ccc59c2744 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95b8e2179e1f4fa6bf596a8dd85f761c', 'request_id': 'req-f55fc564-c192-4a28-a0f7-f2ccc59c2744'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:01.324251 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:01.354738 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e070a46-cda1-41a8-9108-b6650a507ddf None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:01.357134 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f55fc564-c192-4a28-a0f7-f2ccc59c2744 admin admin] The token cache is being invalidate because project 95b8e2179e1f4fa6bf596a8dd85f761c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:47:01.357730 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f55fc564-c192-4a28-a0f7-f2ccc59c2744 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:01.359406 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f55fc564-c192-4a28-a0f7-f2ccc59c2744 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:01.366426 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1650/3279] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:01 2022] DELETE /identity/v3/projects/95b8e2179e1f4fa6bf596a8dd85f761c => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:01.367869 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55fc564-c192-4a28-a0f7-f2ccc59c2744 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:01.373937 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f55fc564-c192-4a28-a0f7-f2ccc59c2744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:01.440802 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3236c-ba68-49a3-925a-02a4ba655186 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:01.441468 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3236c-ba68-49a3-925a-02a4ba655186 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:01.442063 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3236c-ba68-49a3-925a-02a4ba655186 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:01.442346 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3236c-ba68-49a3-925a-02a4ba655186 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:01.444466 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e0c3236c-ba68-49a3-925a-02a4ba655186 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:01.524212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55fc564-c192-4a28-a0f7-f2ccc59c2744 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:01.535670 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b6320-e694-4838-a790-ecff3b755f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:01.540725 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b6320-e694-4838-a790-ecff3b755f4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:01.541306 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b6320-e694-4838-a790-ecff3b755f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:01.541786 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b6320-e694-4838-a790-ecff3b755f4a admin admin] PATH_INFO: `/v3/users/daf5d8de71074057871a3091617bda2a` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:01.544052 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b6320-e694-4838-a790-ecff3b755f4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=daf5d8de71074057871a3091617bda2a)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:01.546453 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b6320-e694-4838-a790-ecff3b755f4a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:01.549181 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c3236c-ba68-49a3-925a-02a4ba655186 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:01.551683 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c3236c-ba68-49a3-925a-02a4ba655186 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:01.573019 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1630/3280] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:47:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:47:01.648276 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-960b6320-e694-4838-a790-ecff3b755f4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daf5d8de71074057871a3091617bda2a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:01.649388 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-960b6320-e694-4838-a790-ecff3b755f4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daf5d8de71074057871a3091617bda2a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:01.667836 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-960b6320-e694-4838-a790-ecff3b755f4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daf5d8de71074057871a3091617bda2a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:01.700961 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-960b6320-e694-4838-a790-ecff3b755f4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daf5d8de71074057871a3091617bda2a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:01.748478 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-960b6320-e694-4838-a790-ecff3b755f4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daf5d8de71074057871a3091617bda2a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:01.761531 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1651/3281] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:47:01 2022] DELETE /identity/v3/users/daf5d8de71074057871a3091617bda2a => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:02.595874 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3236c-ba68-49a3-925a-02a4ba655186 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:02.611859 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3236c-ba68-49a3-925a-02a4ba655186 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:02.796252 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19f719-e247-4358-a97b-d85959a2370f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:02.798109 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19f719-e247-4358-a97b-d85959a2370f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:02.798402 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19f719-e247-4358-a97b-d85959a2370f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:02.798684 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19f719-e247-4358-a97b-d85959a2370f admin admin] PATH_INFO: `/v3/projects/1c4d01c4eddd43e09ec8e7efc2bdc2a5` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:02.801994 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb19f719-e247-4358-a97b-d85959a2370f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c4d01c4eddd43e09ec8e7efc2bdc2a5)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:02.820195 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb19f719-e247-4358-a97b-d85959a2370f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:02.978207 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:03.034041 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fb19f719-e247-4358-a97b-d85959a2370f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c4d01c4eddd43e09ec8e7efc2bdc2a5', 'request_id': 'req-fb19f719-e247-4358-a97b-d85959a2370f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:03.052344 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fb19f719-e247-4358-a97b-d85959a2370f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c4d01c4eddd43e09ec8e7efc2bdc2a5', 'request_id': 'req-fb19f719-e247-4358-a97b-d85959a2370f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:03.088498 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fb19f719-e247-4358-a97b-d85959a2370f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c4d01c4eddd43e09ec8e7efc2bdc2a5', 'request_id': 'req-fb19f719-e247-4358-a97b-d85959a2370f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:03.141696 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fb19f719-e247-4358-a97b-d85959a2370f admin admin] The token cache is being invalidate because project 1c4d01c4eddd43e09ec8e7efc2bdc2a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:47:03.150467 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fb19f719-e247-4358-a97b-d85959a2370f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:03.155240 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fb19f719-e247-4358-a97b-d85959a2370f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:03.162411 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1631/3282] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:02 2022] DELETE /identity/v3/projects/1c4d01c4eddd43e09ec8e7efc2bdc2a5 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:03.167350 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95718b-0a31-4d5d-a5c6-52c371d12261 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:03.168069 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95718b-0a31-4d5d-a5c6-52c371d12261 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:03.169757 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95718b-0a31-4d5d-a5c6-52c371d12261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:03.214992 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-1c95718b-0a31-4d5d-a5c6-52c371d12261 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:03.218789 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1c95718b-0a31-4d5d-a5c6-52c371d12261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:03.482945 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1652/3283] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:47:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:03.490173 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf6f1f-7531-4f8a-bd57-1e2c3434a40c None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:03.491337 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf6f1f-7531-4f8a-bd57-1e2c3434a40c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:03.491760 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf6f1f-7531-4f8a-bd57-1e2c3434a40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:03.541037 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-9baf6f1f-7531-4f8a-bd57-1e2c3434a40c None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:03.554917 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9baf6f1f-7531-4f8a-bd57-1e2c3434a40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:03.635946 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1632/3284] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:47:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:03.641046 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95718b-0a31-4d5d-a5c6-52c371d12261 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:03.694943 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95718b-0a31-4d5d-a5c6-52c371d12261 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:03.749745 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f79dac-e517-4e56-b483-a019b99d8c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:03.750853 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f79dac-e517-4e56-b483-a019b99d8c46 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:03.756699 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f79dac-e517-4e56-b483-a019b99d8c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:03.757318 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f79dac-e517-4e56-b483-a019b99d8c46 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:03.758241 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f79dac-e517-4e56-b483-a019b99d8c46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:47:03.758751 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f79dac-e517-4e56-b483-a019b99d8c46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:03.760796 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f79dac-e517-4e56-b483-a019b99d8c46 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:03.797237 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:03.805437 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1653/3285] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:47:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:47:03.860591 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf6f1f-7531-4f8a-bd57-1e2c3434a40c None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:03.898827 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf6f1f-7531-4f8a-bd57-1e2c3434a40c None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:03.904374 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885fbd7-2d2b-4525-b839-0525668da834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:03.905000 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885fbd7-2d2b-4525-b839-0525668da834 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:03.905277 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885fbd7-2d2b-4525-b839-0525668da834 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:03.905545 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885fbd7-2d2b-4525-b839-0525668da834 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:03.906176 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5885fbd7-2d2b-4525-b839-0525668da834 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:03.908331 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5885fbd7-2d2b-4525-b839-0525668da834 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:03.982550 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1633/3286] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:47:03 2022] POST /identity/v3/projects => generated 401 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:03.983975 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f79dac-e517-4e56-b483-a019b99d8c46 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:03.998173 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f79dac-e517-4e56-b483-a019b99d8c46 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:04.131909 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f787c-f944-48f0-9443-bc27a8d1fb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:04.133102 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f787c-f944-48f0-9443-bc27a8d1fb21 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:04.133102 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f787c-f944-48f0-9443-bc27a8d1fb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:04.133102 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f787c-f944-48f0-9443-bc27a8d1fb21 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:04.133746 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f787c-f944-48f0-9443-bc27a8d1fb21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:04.135774 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f787c-f944-48f0-9443-bc27a8d1fb21 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:04.181379 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1654/3287] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:47:03 2022] POST /identity/v3/users => generated 301 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:04.182566 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885fbd7-2d2b-4525-b839-0525668da834 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:04.210901 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885fbd7-2d2b-4525-b839-0525668da834 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:04.217666 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fbd686-fe71-45cf-bb02-005f2e621fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:04.218300 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbd686-fe71-45cf-bb02-005f2e621fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:04.218578 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbd686-fe71-45cf-bb02-005f2e621fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:04.218847 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbd686-fe71-45cf-bb02-005f2e621fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:04.219560 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fbd686-fe71-45cf-bb02-005f2e621fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:04.221183 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fbd686-fe71-45cf-bb02-005f2e621fa5 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:04.246255 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1634/3288] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:47:04.251010 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f787c-f944-48f0-9443-bc27a8d1fb21 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:04.262587 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f787c-f944-48f0-9443-bc27a8d1fb21 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:04.280788 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0900b8-6124-4a05-b0ac-d97a98a85bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:04.281710 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0900b8-6124-4a05-b0ac-d97a98a85bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:04.282124 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0900b8-6124-4a05-b0ac-d97a98a85bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:04.282542 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0900b8-6124-4a05-b0ac-d97a98a85bd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:04.283378 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0900b8-6124-4a05-b0ac-d97a98a85bd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:04.285161 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0900b8-6124-4a05-b0ac-d97a98a85bd2 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:04.311581 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1655/3289] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:47:04.315541 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fbd686-fe71-45cf-bb02-005f2e621fa5 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:04.329010 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fbd686-fe71-45cf-bb02-005f2e621fa5 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:04.342196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5817e-e4be-4a6d-b670-f2e2fe11d273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:04.343852 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5817e-e4be-4a6d-b670-f2e2fe11d273 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:04.345410 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5817e-e4be-4a6d-b670-f2e2fe11d273 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:04.347204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5817e-e4be-4a6d-b670-f2e2fe11d273 admin admin] PATH_INFO: `/v3/projects/ba5b90786abe449f83a54f3c96334bdd/users/aed6c4b8b7c04a6b95b51a18d7077d09/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:04.390891 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5817e-e4be-4a6d-b670-f2e2fe11d273 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba5b90786abe449f83a54f3c96334bdd, user_id=aed6c4b8b7c04a6b95b51a18d7077d09, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:04.393891 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5817e-e4be-4a6d-b670-f2e2fe11d273 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:04.428469 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1635/3290] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:47:04 2022] PUT /identity/v3/projects/ba5b90786abe449f83a54f3c96334bdd/users/aed6c4b8b7c04a6b95b51a18d7077d09/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:47:04.441693 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f507456-c5fd-48f4-8ac4-94f84def7761 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:04.442199 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f507456-c5fd-48f4-8ac4-94f84def7761 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:04.442695 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f507456-c5fd-48f4-8ac4-94f84def7761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:04.515676 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-1f507456-c5fd-48f4-8ac4-94f84def7761 None None] MFA Rules not processed for user `aed6c4b8b7c04a6b95b51a18d7077d09`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:04.517201 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1f507456-c5fd-48f4-8ac4-94f84def7761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:04.743328 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1656/3291] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:47:04 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:04.847844 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5817e-e4be-4a6d-b670-f2e2fe11d273 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:04.850076 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2fa5817e-e4be-4a6d-b670-f2e2fe11d273 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:04.859447 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f507456-c5fd-48f4-8ac4-94f84def7761 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:04.860992 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1f507456-c5fd-48f4-8ac4-94f84def7761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:05.049414 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5817e-e4be-4a6d-b670-f2e2fe11d273 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:05.054442 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad549811-e632-42e6-8c90-0bbea00be751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:05.055101 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad549811-e632-42e6-8c90-0bbea00be751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:05.055382 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad549811-e632-42e6-8c90-0bbea00be751 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:05.055679 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad549811-e632-42e6-8c90-0bbea00be751 admin admin] PATH_INFO: `/v3/users/efd373f4dbd944aa82c96a42545c7479` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:05.056852 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad549811-e632-42e6-8c90-0bbea00be751 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efd373f4dbd944aa82c96a42545c7479)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:05.059097 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad549811-e632-42e6-8c90-0bbea00be751 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:05.095305 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f507456-c5fd-48f4-8ac4-94f84def7761 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:05.119824 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee53d1-90ab-4106-896b-7993ec1162c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:05.123532 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee53d1-90ab-4106-896b-7993ec1162c3 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:05.124903 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee53d1-90ab-4106-896b-7993ec1162c3 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:05.126522 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee53d1-90ab-4106-896b-7993ec1162c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:05.148671 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:05.161744 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afee53d1-90ab-4106-896b-7993ec1162c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:05.166328 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ad549811-e632-42e6-8c90-0bbea00be751 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efd373f4dbd944aa82c96a42545c7479'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:05.168974 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ad549811-e632-42e6-8c90-0bbea00be751 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efd373f4dbd944aa82c96a42545c7479'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:05.173710 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=14,keystone:SELECT=82,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:05.178822 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afee53d1-90ab-4106-896b-7993ec1162c3 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:05.189419 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ad549811-e632-42e6-8c90-0bbea00be751 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efd373f4dbd944aa82c96a42545c7479'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:05.208806 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ad549811-e632-42e6-8c90-0bbea00be751 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efd373f4dbd944aa82c96a42545c7479'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:05.211434 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ad549811-e632-42e6-8c90-0bbea00be751 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efd373f4dbd944aa82c96a42545c7479'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:05.223980 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1657/3292] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:47:04 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:47:05.262954 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1636/3293] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:47:04 2022] DELETE /identity/v3/users/efd373f4dbd944aa82c96a42545c7479 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:47:05.267726 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d1e4b-8f5c-4646-a4dd-a94834389238 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:05.268006 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d1e4b-8f5c-4646-a4dd-a94834389238 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:05.268283 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d1e4b-8f5c-4646-a4dd-a94834389238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:05.317304 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad549811-e632-42e6-8c90-0bbea00be751 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:05.318879 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ad549811-e632-42e6-8c90-0bbea00be751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:05.323153 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-da3d1e4b-8f5c-4646-a4dd-a94834389238 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:05.327240 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-da3d1e4b-8f5c-4646-a4dd-a94834389238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:05.550354 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1658/3294] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:47:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:05.553894 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad549811-e632-42e6-8c90-0bbea00be751 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:05.571618 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d1a7c-fd26-4df2-a761-9139c376d95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:05.572106 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d1a7c-fd26-4df2-a761-9139c376d95e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:05.572385 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d1a7c-fd26-4df2-a761-9139c376d95e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:05.572660 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d1a7c-fd26-4df2-a761-9139c376d95e admin admin] PATH_INFO: `/v3/users/aed6c4b8b7c04a6b95b51a18d7077d09` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:05.580475 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d1a7c-fd26-4df2-a761-9139c376d95e admin admin] RBAC: Authorizing `identity:delete_user(user_id=aed6c4b8b7c04a6b95b51a18d7077d09)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:05.589806 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d1a7c-fd26-4df2-a761-9139c376d95e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:05.678114 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d1e4b-8f5c-4646-a4dd-a94834389238 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:05.680006 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-da3d1e4b-8f5c-4646-a4dd-a94834389238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:05.808566 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ce4d1a7c-fd26-4df2-a761-9139c376d95e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aed6c4b8b7c04a6b95b51a18d7077d09'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:05.810540 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ce4d1a7c-fd26-4df2-a761-9139c376d95e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aed6c4b8b7c04a6b95b51a18d7077d09'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:05.835187 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ce4d1a7c-fd26-4df2-a761-9139c376d95e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aed6c4b8b7c04a6b95b51a18d7077d09'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:05.847317 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ce4d1a7c-fd26-4df2-a761-9139c376d95e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aed6c4b8b7c04a6b95b51a18d7077d09'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:05.851424 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ce4d1a7c-fd26-4df2-a761-9139c376d95e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aed6c4b8b7c04a6b95b51a18d7077d09'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:05.883759 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d1e4b-8f5c-4646-a4dd-a94834389238 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:05.900693 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86c7ff-48a2-4657-a447-5a3a38034744 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:05.901861 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86c7ff-48a2-4657-a447-5a3a38034744 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:05.903411 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86c7ff-48a2-4657-a447-5a3a38034744 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:05.903680 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86c7ff-48a2-4657-a447-5a3a38034744 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:05.907900 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-aa86c7ff-48a2-4657-a447-5a3a38034744 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:05.924196 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1637/3295] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:47:05 2022] DELETE /identity/v3/users/aed6c4b8b7c04a6b95b51a18d7077d09 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:47:05.925100 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa86c7ff-48a2-4657-a447-5a3a38034744 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:05.928700 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ea1f4-5562-43f5-866a-19c778bf9097 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:05.929002 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ea1f4-5562-43f5-866a-19c778bf9097 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:05.929265 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ea1f4-5562-43f5-866a-19c778bf9097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:05.932495 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa86c7ff-48a2-4657-a447-5a3a38034744 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:05.961729 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1659/3296] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:47:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:47:05.985793 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-b22ea1f4-5562-43f5-866a-19c778bf9097 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:05.987248 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b22ea1f4-5562-43f5-866a-19c778bf9097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:06.092075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:06.138975 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1638/3297] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:47:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:47:06.219552 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86c7ff-48a2-4657-a447-5a3a38034744 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:06.225799 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-aa86c7ff-48a2-4657-a447-5a3a38034744 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:06.278618 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86c7ff-48a2-4657-a447-5a3a38034744 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:06.542090 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43570a-6153-43b4-8a9c-2efc6bbe9ebe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:06.542824 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43570a-6153-43b4-8a9c-2efc6bbe9ebe service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:06.543265 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43570a-6153-43b4-8a9c-2efc6bbe9ebe service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:06.543838 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43570a-6153-43b4-8a9c-2efc6bbe9ebe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:06.575840 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e43570a-6153-43b4-8a9c-2efc6bbe9ebe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:06.577474 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e43570a-6153-43b4-8a9c-2efc6bbe9ebe service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:06.592737 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1660/3298] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:47:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:47:07.721199 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ea1f4-5562-43f5-866a-19c778bf9097 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:07.723359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b22ea1f4-5562-43f5-866a-19c778bf9097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:07.753761 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ea1f4-5562-43f5-866a-19c778bf9097 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:07.769561 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fcaa1b-eecc-4530-9e0e-dd4f95a9ccad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:07.770323 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcaa1b-eecc-4530-9e0e-dd4f95a9ccad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:07.771692 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcaa1b-eecc-4530-9e0e-dd4f95a9ccad admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:07.772047 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcaa1b-eecc-4530-9e0e-dd4f95a9ccad admin admin] PATH_INFO: `/v3/projects/3da73abe36a64bde9e9fc9315f1a87b4` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:07.773533 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fcaa1b-eecc-4530-9e0e-dd4f95a9ccad admin admin] RBAC: Authorizing `identity:delete_project(project_id=3da73abe36a64bde9e9fc9315f1a87b4)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:07.776833 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fcaa1b-eecc-4530-9e0e-dd4f95a9ccad admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:07.955703 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-45fcaa1b-eecc-4530-9e0e-dd4f95a9ccad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3da73abe36a64bde9e9fc9315f1a87b4', 'request_id': 'req-45fcaa1b-eecc-4530-9e0e-dd4f95a9ccad'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:07.963565 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-45fcaa1b-eecc-4530-9e0e-dd4f95a9ccad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3da73abe36a64bde9e9fc9315f1a87b4', 'request_id': 'req-45fcaa1b-eecc-4530-9e0e-dd4f95a9ccad'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:07.974190 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-45fcaa1b-eecc-4530-9e0e-dd4f95a9ccad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3da73abe36a64bde9e9fc9315f1a87b4', 'request_id': 'req-45fcaa1b-eecc-4530-9e0e-dd4f95a9ccad'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:07.994529 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-45fcaa1b-eecc-4530-9e0e-dd4f95a9ccad admin admin] The token cache is being invalidate because project 3da73abe36a64bde9e9fc9315f1a87b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:47:07.994824 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-45fcaa1b-eecc-4530-9e0e-dd4f95a9ccad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:07.995566 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-45fcaa1b-eecc-4530-9e0e-dd4f95a9ccad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:07.998525 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1639/3299] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:07 2022] DELETE /identity/v3/projects/3da73abe36a64bde9e9fc9315f1a87b4 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:08.002567 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43570a-6153-43b4-8a9c-2efc6bbe9ebe service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:08.014722 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43570a-6153-43b4-8a9c-2efc6bbe9ebe service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:08.082228 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:08.149327 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3dbdd8-81fe-40ff-90ca-d922c28ef90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:08.150247 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3dbdd8-81fe-40ff-90ca-d922c28ef90b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:08.150724 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3dbdd8-81fe-40ff-90ca-d922c28ef90b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:08.151881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3dbdd8-81fe-40ff-90ca-d922c28ef90b admin admin] PATH_INFO: `/v3/users/d3f5e81aadde4cf298ab6d122ccd1c83` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:08.154050 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3dbdd8-81fe-40ff-90ca-d922c28ef90b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3f5e81aadde4cf298ab6d122ccd1c83)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:08.156835 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3dbdd8-81fe-40ff-90ca-d922c28ef90b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:08.269176 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3c3dbdd8-81fe-40ff-90ca-d922c28ef90b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3f5e81aadde4cf298ab6d122ccd1c83'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:08.270326 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3c3dbdd8-81fe-40ff-90ca-d922c28ef90b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3f5e81aadde4cf298ab6d122ccd1c83'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:08.303557 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3c3dbdd8-81fe-40ff-90ca-d922c28ef90b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3f5e81aadde4cf298ab6d122ccd1c83'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:08.317228 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3c3dbdd8-81fe-40ff-90ca-d922c28ef90b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3f5e81aadde4cf298ab6d122ccd1c83'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:08.328359 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3c3dbdd8-81fe-40ff-90ca-d922c28ef90b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3f5e81aadde4cf298ab6d122ccd1c83'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:08.340935 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1661/3300] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:47:08 2022] DELETE /identity/v3/users/d3f5e81aadde4cf298ab6d122ccd1c83 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:08.795231 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fcaa1b-eecc-4530-9e0e-dd4f95a9ccad admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:08.796749 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-45fcaa1b-eecc-4530-9e0e-dd4f95a9ccad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:08.819711 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fcaa1b-eecc-4530-9e0e-dd4f95a9ccad admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:08.989667 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691957ce-ff81-4eec-aa85-161b7c562ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:08.990400 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691957ce-ff81-4eec-aa85-161b7c562ce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:08.990751 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691957ce-ff81-4eec-aa85-161b7c562ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:08.991104 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691957ce-ff81-4eec-aa85-161b7c562ce6 admin admin] PATH_INFO: `/v3/projects/ba5b90786abe449f83a54f3c96334bdd` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:08.995520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691957ce-ff81-4eec-aa85-161b7c562ce6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba5b90786abe449f83a54f3c96334bdd)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:09.007732 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691957ce-ff81-4eec-aa85-161b7c562ce6 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:09.133158 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-691957ce-ff81-4eec-aa85-161b7c562ce6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba5b90786abe449f83a54f3c96334bdd', 'request_id': 'req-691957ce-ff81-4eec-aa85-161b7c562ce6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:09.154547 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-691957ce-ff81-4eec-aa85-161b7c562ce6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba5b90786abe449f83a54f3c96334bdd', 'request_id': 'req-691957ce-ff81-4eec-aa85-161b7c562ce6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:09.167619 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-691957ce-ff81-4eec-aa85-161b7c562ce6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba5b90786abe449f83a54f3c96334bdd', 'request_id': 'req-691957ce-ff81-4eec-aa85-161b7c562ce6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:09.210169 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-691957ce-ff81-4eec-aa85-161b7c562ce6 admin admin] The token cache is being invalidate because project ba5b90786abe449f83a54f3c96334bdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:47:09.210568 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-691957ce-ff81-4eec-aa85-161b7c562ce6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:09.211381 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-691957ce-ff81-4eec-aa85-161b7c562ce6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:09.228142 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1640/3301] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:08 2022] DELETE /identity/v3/projects/ba5b90786abe449f83a54f3c96334bdd => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:47:09.234379 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04faa0-877b-4767-bf2e-5fd42b457033 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:09.235211 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04faa0-877b-4767-bf2e-5fd42b457033 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:09.235211 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04faa0-877b-4767-bf2e-5fd42b457033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:09.281411 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-ef04faa0-877b-4767-bf2e-5fd42b457033 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:09.285127 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ef04faa0-877b-4767-bf2e-5fd42b457033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:09.472392 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236a50a-2536-40e8-a185-7df2b40a11b7 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:09.472586 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1662/3302] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:47:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:09.472668 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236a50a-2536-40e8-a185-7df2b40a11b7 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:09.472940 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236a50a-2536-40e8-a185-7df2b40a11b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:09.483440 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:09.501513 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-1236a50a-2536-40e8-a185-7df2b40a11b7 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:09.502773 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1236a50a-2536-40e8-a185-7df2b40a11b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:09.520430 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1641/3303] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:47:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:09.522550 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04faa0-877b-4767-bf2e-5fd42b457033 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:09.540037 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04faa0-877b-4767-bf2e-5fd42b457033 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:09.549073 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b3fc2-e462-4253-b33c-33ec80365ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:09.551289 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b3fc2-e462-4253-b33c-33ec80365ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:09.551973 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b3fc2-e462-4253-b33c-33ec80365ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:09.552513 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b3fc2-e462-4253-b33c-33ec80365ac8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:09.553626 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b3fc2-e462-4253-b33c-33ec80365ac8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:47:09.554359 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b3fc2-e462-4253-b33c-33ec80365ac8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:09.557490 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b3fc2-e462-4253-b33c-33ec80365ac8 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:09.584468 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1663/3304] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:47:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:47:09.585545 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1236a50a-2536-40e8-a185-7df2b40a11b7 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:09.602974 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1236a50a-2536-40e8-a185-7df2b40a11b7 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:09.666596 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46072a-cf3c-4afe-96d5-54db397558ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:09.667265 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea8bf6-4e75-4a72-9e04-a3f0c168a611 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:09.667698 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea8bf6-4e75-4a72-9e04-a3f0c168a611 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:09.669673 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46072a-cf3c-4afe-96d5-54db397558ad admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:09.669992 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea8bf6-4e75-4a72-9e04-a3f0c168a611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:09.670100 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46072a-cf3c-4afe-96d5-54db397558ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:09.672097 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46072a-cf3c-4afe-96d5-54db397558ad admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:09.673896 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46072a-cf3c-4afe-96d5-54db397558ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:09.680809 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46072a-cf3c-4afe-96d5-54db397558ad admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:09.765073 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-c9ea8bf6-4e75-4a72-9e04-a3f0c168a611 None None] MFA Rules not processed for user `e77747aef70040c98167ea7daddf25c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:09.766747 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c9ea8bf6-4e75-4a72-9e04-a3f0c168a611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:09.787354 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1642/3305] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:47:09 2022] POST /identity/v3/projects => generated 405 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:47:09.790972 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46072a-cf3c-4afe-96d5-54db397558ad admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:09.863414 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:09.948800 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1664/3306] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:47:09 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:09.950373 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea8bf6-4e75-4a72-9e04-a3f0c168a611 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:09.956624 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46072a-cf3c-4afe-96d5-54db397558ad admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:09.959349 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c9ea8bf6-4e75-4a72-9e04-a3f0c168a611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:09.963515 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681d99b-3726-4359-8771-ce0ac406085c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:09.964599 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681d99b-3726-4359-8771-ce0ac406085c admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:09.966093 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681d99b-3726-4359-8771-ce0ac406085c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:09.966741 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681d99b-3726-4359-8771-ce0ac406085c admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:09.967850 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681d99b-3726-4359-8771-ce0ac406085c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:09.970733 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681d99b-3726-4359-8771-ce0ac406085c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:09.995149 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea8bf6-4e75-4a72-9e04-a3f0c168a611 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:10.001029 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd2de8-268a-4286-88b5-abc680cbaeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:10.001675 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd2de8-268a-4286-88b5-abc680cbaeca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:10.001952 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd2de8-268a-4286-88b5-abc680cbaeca admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:10.002220 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd2de8-268a-4286-88b5-abc680cbaeca admin admin] PATH_INFO: `/v3/projects/24181c85683240ababef9fe06a0b699b` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:10.004030 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd2de8-268a-4286-88b5-abc680cbaeca admin admin] RBAC: Authorizing `identity:delete_project(project_id=24181c85683240ababef9fe06a0b699b)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:10.006031 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd2de8-268a-4286-88b5-abc680cbaeca admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:10.019537 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1643/3307] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:47:09 2022] POST /identity/v3/users => generated 303 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:10.024896 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193289d-7587-4779-b310-9269c03b79a1 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:10.026116 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193289d-7587-4779-b310-9269c03b79a1 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:10.026639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193289d-7587-4779-b310-9269c03b79a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:10.063992 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-5193289d-7587-4779-b310-9269c03b79a1 None None] MFA Rules not processed for user `e77747aef70040c98167ea7daddf25c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:10.069296 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5193289d-7587-4779-b310-9269c03b79a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:10.142646 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-33cd2de8-268a-4286-88b5-abc680cbaeca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24181c85683240ababef9fe06a0b699b', 'request_id': 'req-33cd2de8-268a-4286-88b5-abc680cbaeca'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:10.161309 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-33cd2de8-268a-4286-88b5-abc680cbaeca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24181c85683240ababef9fe06a0b699b', 'request_id': 'req-33cd2de8-268a-4286-88b5-abc680cbaeca'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:10.185219 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-33cd2de8-268a-4286-88b5-abc680cbaeca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24181c85683240ababef9fe06a0b699b', 'request_id': 'req-33cd2de8-268a-4286-88b5-abc680cbaeca'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:10.210755 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-33cd2de8-268a-4286-88b5-abc680cbaeca admin admin] The token cache is being invalidate because project 24181c85683240ababef9fe06a0b699b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:47:10.211817 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-33cd2de8-268a-4286-88b5-abc680cbaeca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:10.212771 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-33cd2de8-268a-4286-88b5-abc680cbaeca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:10.216822 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1665/3308] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:09 2022] DELETE /identity/v3/projects/24181c85683240ababef9fe06a0b699b => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:10.218605 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd2de8-268a-4286-88b5-abc680cbaeca admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:10.220291 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-33cd2de8-268a-4286-88b5-abc680cbaeca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:10.269727 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1644/3309] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:47:10 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:10.279288 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4ac22-29c3-41fc-9565-e6ac6ae126a7 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:10.279666 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4ac22-29c3-41fc-9565-e6ac6ae126a7 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:10.279951 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4ac22-29c3-41fc-9565-e6ac6ae126a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:10.316721 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-86f4ac22-29c3-41fc-9565-e6ac6ae126a7 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:10.317978 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-86f4ac22-29c3-41fc-9565-e6ac6ae126a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:10.409055 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd2de8-268a-4286-88b5-abc680cbaeca admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:10.424980 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97196f0-13f1-4228-b2f5-56fe9dcaa579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:10.428638 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97196f0-13f1-4228-b2f5-56fe9dcaa579 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:10.431335 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97196f0-13f1-4228-b2f5-56fe9dcaa579 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:10.431648 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97196f0-13f1-4228-b2f5-56fe9dcaa579 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:10.434504 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97196f0-13f1-4228-b2f5-56fe9dcaa579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:10.439076 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97196f0-13f1-4228-b2f5-56fe9dcaa579 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:10.467278 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1645/3311] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:10.467778 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1666/3311] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:47:10.467975 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4ac22-29c3-41fc-9565-e6ac6ae126a7 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:10.469808 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97196f0-13f1-4228-b2f5-56fe9dcaa579 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:10.475967 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-86f4ac22-29c3-41fc-9565-e6ac6ae126a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:10.492297 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97196f0-13f1-4228-b2f5-56fe9dcaa579 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:10.497506 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:10.501295 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea806f0-cfed-431e-ad8d-43e6a9388fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:10.501929 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea806f0-cfed-431e-ad8d-43e6a9388fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:10.502217 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea806f0-cfed-431e-ad8d-43e6a9388fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:10.502494 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea806f0-cfed-431e-ad8d-43e6a9388fc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:10.503199 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea806f0-cfed-431e-ad8d-43e6a9388fc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:10.505855 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea806f0-cfed-431e-ad8d-43e6a9388fc3 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:10.529411 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1667/3312] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:47:10.531764 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11a8fc-a042-49de-94f5-5d3f219f527f None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:10.532058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11a8fc-a042-49de-94f5-5d3f219f527f None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:10.532458 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11a8fc-a042-49de-94f5-5d3f219f527f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:10.558106 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-ea11a8fc-a042-49de-94f5-5d3f219f527f None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:10.561113 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ea11a8fc-a042-49de-94f5-5d3f219f527f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:10.572493 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1668/3313] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:10.573513 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11a8fc-a042-49de-94f5-5d3f219f527f None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:10.587063 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11a8fc-a042-49de-94f5-5d3f219f527f None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:10.594332 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60511e70-0ec0-4037-9d00-f9c98900a8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:10.595109 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60511e70-0ec0-4037-9d00-f9c98900a8aa admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:10.595400 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60511e70-0ec0-4037-9d00-f9c98900a8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:10.595671 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60511e70-0ec0-4037-9d00-f9c98900a8aa admin admin] PATH_INFO: `/v3/projects/dfb01eb303394c63b10e95487f67aa5d/users/3b926292fcc044389a38c8de0d293722/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:10.618376 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60511e70-0ec0-4037-9d00-f9c98900a8aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfb01eb303394c63b10e95487f67aa5d, user_id=3b926292fcc044389a38c8de0d293722, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:10.622559 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60511e70-0ec0-4037-9d00-f9c98900a8aa admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:10.646598 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4ac22-29c3-41fc-9565-e6ac6ae126a7 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:10.650263 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1669/3314] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:47:10 2022] PUT /identity/v3/projects/dfb01eb303394c63b10e95487f67aa5d/users/3b926292fcc044389a38c8de0d293722/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:10.651636 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60511e70-0ec0-4037-9d00-f9c98900a8aa admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:10.670164 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:10.766077 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad81d0a7-a032-4fd1-9478-c00eea0ef66c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:10.766711 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81d0a7-a032-4fd1-9478-c00eea0ef66c service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:10.767270 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81d0a7-a032-4fd1-9478-c00eea0ef66c service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:10.767493 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81d0a7-a032-4fd1-9478-c00eea0ef66c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:10.770640 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60511e70-0ec0-4037-9d00-f9c98900a8aa admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:10.770808 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ad81d0a7-a032-4fd1-9478-c00eea0ef66c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:10.776946 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015cb4d2-fec0-4b24-a909-b2c1d317f84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:10.777961 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015cb4d2-fec0-4b24-a909-b2c1d317f84b admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:10.778384 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015cb4d2-fec0-4b24-a909-b2c1d317f84b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:10.778796 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015cb4d2-fec0-4b24-a909-b2c1d317f84b admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:10.779926 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015cb4d2-fec0-4b24-a909-b2c1d317f84b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:47:10.780399 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015cb4d2-fec0-4b24-a909-b2c1d317f84b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:10.782752 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015cb4d2-fec0-4b24-a909-b2c1d317f84b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:10.805174 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1670/3315] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:47:10.810366 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008e3bb-b453-406a-b2f1-7a5d765743cb None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:10.810935 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008e3bb-b453-406a-b2f1-7a5d765743cb None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:10.811442 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008e3bb-b453-406a-b2f1-7a5d765743cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:10.838089 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-3008e3bb-b453-406a-b2f1-7a5d765743cb None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:10.842356 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3008e3bb-b453-406a-b2f1-7a5d765743cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:10.859265 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1671/3316] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:10.860630 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3008e3bb-b453-406a-b2f1-7a5d765743cb None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:10.875578 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3008e3bb-b453-406a-b2f1-7a5d765743cb None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:10.887418 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b57b7-b4be-4f90-a119-1d769929a4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:10.889142 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b57b7-b4be-4f90-a119-1d769929a4e3 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:10.889633 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b57b7-b4be-4f90-a119-1d769929a4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:10.890105 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b57b7-b4be-4f90-a119-1d769929a4e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:10.891143 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2b57b7-b4be-4f90-a119-1d769929a4e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:10.893745 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2b57b7-b4be-4f90-a119-1d769929a4e3 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:10.943895 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1672/3317] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:47:10 2022] POST /identity/v3/projects => generated 379 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:10.944399 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad81d0a7-a032-4fd1-9478-c00eea0ef66c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:10.945811 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b57b7-b4be-4f90-a119-1d769929a4e3 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:10.946573 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad81d0a7-a032-4fd1-9478-c00eea0ef66c service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:10.949604 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-fa2b57b7-b4be-4f90-a119-1d769929a4e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:10.975113 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1646/3318] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:47:10 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:47:10.976963 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad81d0a7-a032-4fd1-9478-c00eea0ef66c service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:11.007529 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad81d0a7-a032-4fd1-9478-c00eea0ef66c service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:11.098990 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b57b7-b4be-4f90-a119-1d769929a4e3 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:11.114046 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1695fe41-527a-47e2-83f1-eaf1065ba544 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:11.114306 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:11.115607 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695fe41-527a-47e2-83f1-eaf1065ba544 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:11.116270 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695fe41-527a-47e2-83f1-eaf1065ba544 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:11.116684 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695fe41-527a-47e2-83f1-eaf1065ba544 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:11.160025 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f13e92-275d-43ba-8b49-208c0173a3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:11.161089 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f13e92-275d-43ba-8b49-208c0173a3b5 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:11.161510 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f13e92-275d-43ba-8b49-208c0173a3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:11.161922 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f13e92-275d-43ba-8b49-208c0173a3b5 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:11.162718 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f13e92-275d-43ba-8b49-208c0173a3b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:11.171335 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f13e92-275d-43ba-8b49-208c0173a3b5 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:11.232829 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1647/3319] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:47:10 2022] POST /identity/v3/users => generated 290 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:11.236998 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f13e92-275d-43ba-8b49-208c0173a3b5 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:11.248540 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1695fe41-527a-47e2-83f1-eaf1065ba544 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:11.250252 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1695fe41-527a-47e2-83f1-eaf1065ba544 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:11.255914 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f13e92-275d-43ba-8b49-208c0173a3b5 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:11.265659 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1673/3320] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:47:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:47:11.278938 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973fd06-2dd7-476c-ba7b-a9a249cddc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:11.280848 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973fd06-2dd7-476c-ba7b-a9a249cddc0c admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:11.282150 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973fd06-2dd7-476c-ba7b-a9a249cddc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:11.283221 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973fd06-2dd7-476c-ba7b-a9a249cddc0c admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:11.284493 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4973fd06-2dd7-476c-ba7b-a9a249cddc0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:11.287214 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4973fd06-2dd7-476c-ba7b-a9a249cddc0c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:11.303794 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1648/3321] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:47:11.307975 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1695fe41-527a-47e2-83f1-eaf1065ba544 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:11.327720 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1695fe41-527a-47e2-83f1-eaf1065ba544 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:11.337245 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a49473-5d98-49ca-a9d0-9d1e36be8d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:11.339091 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a49473-5d98-49ca-a9d0-9d1e36be8d6f admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:11.339616 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a49473-5d98-49ca-a9d0-9d1e36be8d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:11.340175 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a49473-5d98-49ca-a9d0-9d1e36be8d6f admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:11.341054 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a49473-5d98-49ca-a9d0-9d1e36be8d6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:11.346799 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a49473-5d98-49ca-a9d0-9d1e36be8d6f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:11.366673 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1674/3322] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:47:11.370483 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973fd06-2dd7-476c-ba7b-a9a249cddc0c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:11.386841 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973fd06-2dd7-476c-ba7b-a9a249cddc0c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:11.404416 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8fd1f4-570d-49d2-b076-6da9ff267877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:11.407628 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fd1f4-570d-49d2-b076-6da9ff267877 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:11.408129 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fd1f4-570d-49d2-b076-6da9ff267877 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:11.409167 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fd1f4-570d-49d2-b076-6da9ff267877 admin admin] PATH_INFO: `/v3/projects/b4f05a49416c463084643b9c6bd91df7/users/36c57640941540989f44f908b4f87e4b/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:11.438555 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8fd1f4-570d-49d2-b076-6da9ff267877 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4f05a49416c463084643b9c6bd91df7, user_id=36c57640941540989f44f908b4f87e4b, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:11.463997 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8fd1f4-570d-49d2-b076-6da9ff267877 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:11.494568 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1649/3323] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:47:11 2022] PUT /identity/v3/projects/b4f05a49416c463084643b9c6bd91df7/users/36c57640941540989f44f908b4f87e4b/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:11.506281 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92090408-19a2-4842-853a-a58631ebda4a None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:11.506830 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92090408-19a2-4842-853a-a58631ebda4a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:11.506830 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92090408-19a2-4842-853a-a58631ebda4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:11.601359 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-92090408-19a2-4842-853a-a58631ebda4a None None] MFA Rules not processed for user `36c57640941540989f44f908b4f87e4b`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:11.602987 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-92090408-19a2-4842-853a-a58631ebda4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:11.623064 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:11.729467 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1675/3324] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:47:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:12.395800 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8fd1f4-570d-49d2-b076-6da9ff267877 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:12.398788 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6c8fd1f4-570d-49d2-b076-6da9ff267877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:12.610467 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8fd1f4-570d-49d2-b076-6da9ff267877 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:12.624184 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0793e-f0b0-483c-bef9-68e69651e4fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:12.624839 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0793e-f0b0-483c-bef9-68e69651e4fe service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:12.625108 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0793e-f0b0-483c-bef9-68e69651e4fe service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:12.625553 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0793e-f0b0-483c-bef9-68e69651e4fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:12.653208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed0793e-f0b0-483c-bef9-68e69651e4fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:12.654856 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed0793e-f0b0-483c-bef9-68e69651e4fe service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:12.704443 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1650/3325] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:47:12 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:47:13.066338 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16a878-c326-44c0-a82d-dc9a1e6df5aa None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:13.066949 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16a878-c326-44c0-a82d-dc9a1e6df5aa None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:13.067292 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16a878-c326-44c0-a82d-dc9a1e6df5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:13.111113 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-4f16a878-c326-44c0-a82d-dc9a1e6df5aa None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:13.112521 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4f16a878-c326-44c0-a82d-dc9a1e6df5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:13.328782 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1676/3326] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 15:47:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:13.343485 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0793e-f0b0-483c-bef9-68e69651e4fe service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:13.345123 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0ed0793e-f0b0-483c-bef9-68e69651e4fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:13.560632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0793e-f0b0-483c-bef9-68e69651e4fe service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:13.591184 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7ee03-0fc0-4f40-b5f4-cb67971bd6ca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:13.592529 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7ee03-0fc0-4f40-b5f4-cb67971bd6ca service swift] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:13.593157 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7ee03-0fc0-4f40-b5f4-cb67971bd6ca service swift] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:13.593813 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7ee03-0fc0-4f40-b5f4-cb67971bd6ca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:13.613828 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c7ee03-0fc0-4f40-b5f4-cb67971bd6ca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:13.616434 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c7ee03-0fc0-4f40-b5f4-cb67971bd6ca service swift] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:13.634496 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1651/3327] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 15:47:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:47:13.807367 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9dbe0-a88f-44a1-b033-546ee6ef0a35 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:13.807833 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9dbe0-a88f-44a1-b033-546ee6ef0a35 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:13.808175 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9dbe0-a88f-44a1-b033-546ee6ef0a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:13.885575 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-3be9dbe0-a88f-44a1-b033-546ee6ef0a35 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:13.916322 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3be9dbe0-a88f-44a1-b033-546ee6ef0a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:13.938139 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d87ef4-1b2f-4749-ba46-a87ddd366e70 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:13.938573 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d87ef4-1b2f-4749-ba46-a87ddd366e70 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:13.939012 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d87ef4-1b2f-4749-ba46-a87ddd366e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:13.955065 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1677/3328] 10.222.0.83 () {58 vars in 967 bytes} [Mon Aug 29 15:47:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:13.964966 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9dbe0-a88f-44a1-b033-546ee6ef0a35 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:13.990252 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-56d87ef4-1b2f-4749-ba46-a87ddd366e70 None None] MFA Rules not processed for user `36c57640941540989f44f908b4f87e4b`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:13.993175 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-56d87ef4-1b2f-4749-ba46-a87ddd366e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:13.994175 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9dbe0-a88f-44a1-b033-546ee6ef0a35 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:14.009305 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d95dc-688c-4e6a-ad05-13dbfc976d73 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:14.009983 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d95dc-688c-4e6a-ad05-13dbfc976d73 service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:14.010234 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d95dc-688c-4e6a-ad05-13dbfc976d73 service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:14.010509 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d95dc-688c-4e6a-ad05-13dbfc976d73 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:14.015490 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1652/3329] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:47:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:14.051405 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5d95dc-688c-4e6a-ad05-13dbfc976d73 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:14.056191 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5d95dc-688c-4e6a-ad05-13dbfc976d73 service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:14.082721 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1678/3330] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 15:47:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:47:16.001621 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba08a8e-08fe-4f0c-a3d3-d15cddf646d2 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:16.002139 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba08a8e-08fe-4f0c-a3d3-d15cddf646d2 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:16.002139 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba08a8e-08fe-4f0c-a3d3-d15cddf646d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:16.027186 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:16.072183 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-2ba08a8e-08fe-4f0c-a3d3-d15cddf646d2 None None] MFA Rules not processed for user `4b32312a6f064e4b95249481ff6cd530`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:16.073490 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2ba08a8e-08fe-4f0c-a3d3-d15cddf646d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:16.288509 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1653/3331] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:47:16 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:16.293784 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d95dc-688c-4e6a-ad05-13dbfc976d73 service swift] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:16.295442 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-fa5d95dc-688c-4e6a-ad05-13dbfc976d73 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:16.482054 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba08a8e-08fe-4f0c-a3d3-d15cddf646d2 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:16.483692 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2ba08a8e-08fe-4f0c-a3d3-d15cddf646d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:16.485799 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d95dc-688c-4e6a-ad05-13dbfc976d73 service swift] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:16.494298 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f1889-1e82-49a9-afc8-728b15157671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:16.494927 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f1889-1e82-49a9-afc8-728b15157671 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:16.495255 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f1889-1e82-49a9-afc8-728b15157671 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:16.495532 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f1889-1e82-49a9-afc8-728b15157671 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:16.496237 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f1889-1e82-49a9-afc8-728b15157671 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:16.499208 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f1889-1e82-49a9-afc8-728b15157671 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:16.535885 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1679/3332] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:47:16 2022] POST /identity/v3/projects => generated 405 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:47:16.541334 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f1889-1e82-49a9-afc8-728b15157671 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:16.565820 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:16.630912 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f1889-1e82-49a9-afc8-728b15157671 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:16.636617 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d19d2-a6d8-4008-94ce-dfc96d746e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:16.637563 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d19d2-a6d8-4008-94ce-dfc96d746e68 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:16.637851 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d19d2-a6d8-4008-94ce-dfc96d746e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:16.638167 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d19d2-a6d8-4008-94ce-dfc96d746e68 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:16.638884 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462d19d2-a6d8-4008-94ce-dfc96d746e68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:16.641008 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462d19d2-a6d8-4008-94ce-dfc96d746e68 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:16.657757 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba08a8e-08fe-4f0c-a3d3-d15cddf646d2 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:16.679832 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1680/3333] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:47:16 2022] POST /identity/v3/users => generated 309 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:47:16.684608 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d19d2-a6d8-4008-94ce-dfc96d746e68 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:16.710891 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d19d2-a6d8-4008-94ce-dfc96d746e68 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:16.725825 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c9a37-6de9-499a-870e-7105c2a14f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:16.726479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c9a37-6de9-499a-870e-7105c2a14f0a admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:16.726743 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c9a37-6de9-499a-870e-7105c2a14f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:16.727232 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c9a37-6de9-499a-870e-7105c2a14f0a admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:16.728471 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c9a37-6de9-499a-870e-7105c2a14f0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:16.730122 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c9a37-6de9-499a-870e-7105c2a14f0a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:16.761670 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1681/3334] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:16 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:47:16.767525 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c9a37-6de9-499a-870e-7105c2a14f0a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:16.779415 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f583aa0-514b-4670-8272-1e1257b0f352 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:16.780305 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f583aa0-514b-4670-8272-1e1257b0f352 service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:16.780305 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f583aa0-514b-4670-8272-1e1257b0f352 service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:16.780611 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f583aa0-514b-4670-8272-1e1257b0f352 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:16.782497 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6f583aa0-514b-4670-8272-1e1257b0f352 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:16.788155 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c9a37-6de9-499a-870e-7105c2a14f0a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:16.797253 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f583aa0-514b-4670-8272-1e1257b0f352 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:16.798893 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f583aa0-514b-4670-8272-1e1257b0f352 service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:16.799929 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce842c-8931-4a24-add7-8c0e870b43b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:16.800616 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce842c-8931-4a24-add7-8c0e870b43b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:16.800894 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce842c-8931-4a24-add7-8c0e870b43b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:16.801173 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce842c-8931-4a24-add7-8c0e870b43b5 admin admin] PATH_INFO: `/v3/projects/83e999a326324ed98b089b62ad99bd8b/users/89285e448a144b8c847a8c104a6f4755/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:16.823908 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ce842c-8931-4a24-add7-8c0e870b43b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83e999a326324ed98b089b62ad99bd8b, user_id=89285e448a144b8c847a8c104a6f4755, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:16.825814 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1654/3335] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:47:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:47:16.838085 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ce842c-8931-4a24-add7-8c0e870b43b5 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:16.881735 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1682/3336] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:47:16 2022] PUT /identity/v3/projects/83e999a326324ed98b089b62ad99bd8b/users/89285e448a144b8c847a8c104a6f4755/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:47:16.887601 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f583aa0-514b-4670-8272-1e1257b0f352 service placement] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:16.908191 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f583aa0-514b-4670-8272-1e1257b0f352 service placement] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:16.953783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:17.041572 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782cbb6-57f9-4489-8b00-54595e42ad7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:17.043832 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782cbb6-57f9-4489-8b00-54595e42ad7e admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:17.044444 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782cbb6-57f9-4489-8b00-54595e42ad7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:17.045236 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782cbb6-57f9-4489-8b00-54595e42ad7e admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:17.052612 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2782cbb6-57f9-4489-8b00-54595e42ad7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:17.056228 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2782cbb6-57f9-4489-8b00-54595e42ad7e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:17.080111 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1655/3337] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:16 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:47:17.081516 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce842c-8931-4a24-add7-8c0e870b43b5 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:17.097496 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce842c-8931-4a24-add7-8c0e870b43b5 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:17.116982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def6ad8b-dbab-444e-9155-2f6ecce7b0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:17.117672 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6ad8b-dbab-444e-9155-2f6ecce7b0f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:17.117950 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6ad8b-dbab-444e-9155-2f6ecce7b0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:17.118236 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6ad8b-dbab-444e-9155-2f6ecce7b0f6 admin admin] PATH_INFO: `/v3/projects/83e999a326324ed98b089b62ad99bd8b/users/89285e448a144b8c847a8c104a6f4755/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:17.120219 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def6ad8b-dbab-444e-9155-2f6ecce7b0f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83e999a326324ed98b089b62ad99bd8b, user_id=89285e448a144b8c847a8c104a6f4755, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:17.123941 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def6ad8b-dbab-444e-9155-2f6ecce7b0f6 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:17.151983 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1683/3338] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:47:17 2022] PUT /identity/v3/projects/83e999a326324ed98b089b62ad99bd8b/users/89285e448a144b8c847a8c104a6f4755/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:18.662963 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a1407-89d2-4254-9a26-254b2e5849f3 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:18.664116 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a1407-89d2-4254-9a26-254b2e5849f3 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:18.664575 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a1407-89d2-4254-9a26-254b2e5849f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:18.728205 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d69a9-16d7-42f0-b8a0-9ce04e2d9703 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:18.732268 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d69a9-16d7-42f0-b8a0-9ce04e2d9703 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:18.732832 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d69a9-16d7-42f0-b8a0-9ce04e2d9703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:18.761136 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-ac3a1407-89d2-4254-9a26-254b2e5849f3 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:18.763934 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ac3a1407-89d2-4254-9a26-254b2e5849f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:18.784408 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-722d69a9-16d7-42f0-b8a0-9ce04e2d9703 None None] MFA Rules not processed for user `853f8300f9bb403b9cea4834c5a1edcb`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:18.786553 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-722d69a9-16d7-42f0-b8a0-9ce04e2d9703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:18.917092 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1684/3339] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:47:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:18.917301 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1656/3340] 10.222.0.83 () {58 vars in 967 bytes} [Mon Aug 29 15:47:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:47:18.942683 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a1407-89d2-4254-9a26-254b2e5849f3 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:19.071768 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a1407-89d2-4254-9a26-254b2e5849f3 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:19.079992 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b903be-1200-4f78-9947-0c5c858a18d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:19.080919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b903be-1200-4f78-9947-0c5c858a18d3 service swift] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:19.081377 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b903be-1200-4f78-9947-0c5c858a18d3 service swift] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:19.081787 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b903be-1200-4f78-9947-0c5c858a18d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:19.095255 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b903be-1200-4f78-9947-0c5c858a18d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:19.097370 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b903be-1200-4f78-9947-0c5c858a18d3 service swift] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:19.110930 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1657/3341] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 15:47:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:47:19.138505 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f46ee-1b4c-4986-85ce-fa3dc713de46 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:19.139667 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f46ee-1b4c-4986-85ce-fa3dc713de46 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:19.140083 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f46ee-1b4c-4986-85ce-fa3dc713de46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:19.275356 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-292f46ee-1b4c-4986-85ce-fa3dc713de46 None None] MFA Rules not processed for user `085145c4942d4c889c291a99eb1d009a`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:19.278324 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-292f46ee-1b4c-4986-85ce-fa3dc713de46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:19.424161 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b903be-1200-4f78-9947-0c5c858a18d3 service swift] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:19.559507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:19.593988 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1685/3342] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:47:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:19.600695 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b903be-1200-4f78-9947-0c5c858a18d3 service swift] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:19.604086 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af852000-3b6a-4917-8f75-ed27c6b4032b None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:19.604368 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af852000-3b6a-4917-8f75-ed27c6b4032b None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:19.604733 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af852000-3b6a-4917-8f75-ed27c6b4032b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:19.614229 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8329bf-0930-41d6-b9dd-bfda837a01d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:19.614904 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8329bf-0930-41d6-b9dd-bfda837a01d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:19.615228 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8329bf-0930-41d6-b9dd-bfda837a01d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:19.615506 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8329bf-0930-41d6-b9dd-bfda837a01d0 admin admin] PATH_INFO: `/v3/users/36c57640941540989f44f908b4f87e4b` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:19.617567 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8329bf-0930-41d6-b9dd-bfda837a01d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36c57640941540989f44f908b4f87e4b)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:19.624076 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8329bf-0930-41d6-b9dd-bfda837a01d0 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:19.635749 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:19.635881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-af852000-3b6a-4917-8f75-ed27c6b4032b None None] MFA Rules not processed for user `085145c4942d4c889c291a99eb1d009a`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:19.638487 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-af852000-3b6a-4917-8f75-ed27c6b4032b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:19.652218 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1686/3343] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:47:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:47:19.802341 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-eb8329bf-0930-41d6-b9dd-bfda837a01d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36c57640941540989f44f908b4f87e4b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:19.804985 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-eb8329bf-0930-41d6-b9dd-bfda837a01d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36c57640941540989f44f908b4f87e4b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:19.823225 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-eb8329bf-0930-41d6-b9dd-bfda837a01d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36c57640941540989f44f908b4f87e4b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:19.844063 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-eb8329bf-0930-41d6-b9dd-bfda837a01d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36c57640941540989f44f908b4f87e4b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:19.846522 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-eb8329bf-0930-41d6-b9dd-bfda837a01d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36c57640941540989f44f908b4f87e4b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:19.896006 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1b486-69b8-4532-b547-9d744d384775 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:19.898040 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1b486-69b8-4532-b547-9d744d384775 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:19.898516 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1b486-69b8-4532-b547-9d744d384775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:19.901823 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1658/3344] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:47:19 2022] DELETE /identity/v3/users/36c57640941540989f44f908b4f87e4b => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:19.928729 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-8dd1b486-69b8-4532-b547-9d744d384775 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:19.933474 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8dd1b486-69b8-4532-b547-9d744d384775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:20.001642 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8329bf-0930-41d6-b9dd-bfda837a01d0 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:20.003953 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-eb8329bf-0930-41d6-b9dd-bfda837a01d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:20.102448 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8329bf-0930-41d6-b9dd-bfda837a01d0 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:20.110726 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e4d60-f244-42d8-8a31-30ddbdb57da6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:20.111420 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e4d60-f244-42d8-8a31-30ddbdb57da6 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:20.111699 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e4d60-f244-42d8-8a31-30ddbdb57da6 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:20.111970 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e4d60-f244-42d8-8a31-30ddbdb57da6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:20.113927 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2d3e4d60-f244-42d8-8a31-30ddbdb57da6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:20.129765 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1687/3345] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:47:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:20.194080 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd1b486-69b8-4532-b547-9d744d384775 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:20.198677 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8dd1b486-69b8-4532-b547-9d744d384775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:20.358280 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd1b486-69b8-4532-b547-9d744d384775 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:20.360930 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3e4d60-f244-42d8-8a31-30ddbdb57da6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:20.363094 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3e4d60-f244-42d8-8a31-30ddbdb57da6 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:20.373864 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247ed15-62f8-48b5-8dcf-28c1679c39ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:20.374504 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247ed15-62f8-48b5-8dcf-28c1679c39ba service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:20.374780 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247ed15-62f8-48b5-8dcf-28c1679c39ba service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:20.375209 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247ed15-62f8-48b5-8dcf-28c1679c39ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:20.377038 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1659/3346] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:47:20 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:47:20.398591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247ed15-62f8-48b5-8dcf-28c1679c39ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:20.400283 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247ed15-62f8-48b5-8dcf-28c1679c39ba service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:20.427513 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1688/3347] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:47:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:47:22.263702 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e4d60-f244-42d8-8a31-30ddbdb57da6 service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:22.265152 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2d3e4d60-f244-42d8-8a31-30ddbdb57da6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:22.286112 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e4d60-f244-42d8-8a31-30ddbdb57da6 service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:22.305399 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b60b0-efc1-4c1b-a55f-bf00930a7c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:22.308870 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b60b0-efc1-4c1b-a55f-bf00930a7c8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:22.310697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b60b0-efc1-4c1b-a55f-bf00930a7c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:22.311113 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b60b0-efc1-4c1b-a55f-bf00930a7c8c admin admin] PATH_INFO: `/v3/projects/b4f05a49416c463084643b9c6bd91df7` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:22.320641 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19b60b0-efc1-4c1b-a55f-bf00930a7c8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4f05a49416c463084643b9c6bd91df7)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:22.322667 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19b60b0-efc1-4c1b-a55f-bf00930a7c8c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:22.365944 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:22.484556 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c19b60b0-efc1-4c1b-a55f-bf00930a7c8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4f05a49416c463084643b9c6bd91df7', 'request_id': 'req-c19b60b0-efc1-4c1b-a55f-bf00930a7c8c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:22.500361 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c19b60b0-efc1-4c1b-a55f-bf00930a7c8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4f05a49416c463084643b9c6bd91df7', 'request_id': 'req-c19b60b0-efc1-4c1b-a55f-bf00930a7c8c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:22.525225 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c19b60b0-efc1-4c1b-a55f-bf00930a7c8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4f05a49416c463084643b9c6bd91df7', 'request_id': 'req-c19b60b0-efc1-4c1b-a55f-bf00930a7c8c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:22.548495 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c19b60b0-efc1-4c1b-a55f-bf00930a7c8c admin admin] The token cache is being invalidate because project b4f05a49416c463084643b9c6bd91df7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:47:22.548790 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c19b60b0-efc1-4c1b-a55f-bf00930a7c8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:22.552366 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c19b60b0-efc1-4c1b-a55f-bf00930a7c8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:22.554228 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1660/3348] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:22 2022] DELETE /identity/v3/projects/b4f05a49416c463084643b9c6bd91df7 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:22.561118 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55eb423-b487-4a2d-b348-a448aefb67f3 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:22.561693 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55eb423-b487-4a2d-b348-a448aefb67f3 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:22.561693 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55eb423-b487-4a2d-b348-a448aefb67f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:22.624078 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-b55eb423-b487-4a2d-b348-a448aefb67f3 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:22.625333 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b55eb423-b487-4a2d-b348-a448aefb67f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:22.819089 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1689/3349] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:47:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:22.821309 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de69ef-0d6f-4782-bb90-f88996ca9ea7 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:22.821590 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de69ef-0d6f-4782-bb90-f88996ca9ea7 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:22.821890 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de69ef-0d6f-4782-bb90-f88996ca9ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:22.895146 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-f0de69ef-0d6f-4782-bb90-f88996ca9ea7 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:22.896931 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f0de69ef-0d6f-4782-bb90-f88996ca9ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:22.924695 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1661/3350] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:47:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:22.929097 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55eb423-b487-4a2d-b348-a448aefb67f3 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:22.952439 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55eb423-b487-4a2d-b348-a448aefb67f3 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:22.970175 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82964f94-def6-4db9-8a96-406c67949645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:22.970817 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82964f94-def6-4db9-8a96-406c67949645 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:22.971117 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82964f94-def6-4db9-8a96-406c67949645 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:22.971693 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82964f94-def6-4db9-8a96-406c67949645 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:22.972512 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82964f94-def6-4db9-8a96-406c67949645 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:47:22.972976 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82964f94-def6-4db9-8a96-406c67949645 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:22.974761 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82964f94-def6-4db9-8a96-406c67949645 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:23.038176 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de69ef-0d6f-4782-bb90-f88996ca9ea7 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:23.044761 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1690/3351] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:47:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:47:23.051586 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de69ef-0d6f-4782-bb90-f88996ca9ea7 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:23.077364 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31df4d-529f-48df-813f-6a705823fd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:23.088193 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31df4d-529f-48df-813f-6a705823fd73 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:23.088588 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31df4d-529f-48df-813f-6a705823fd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:23.089188 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31df4d-529f-48df-813f-6a705823fd73 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:23.091273 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab31df4d-529f-48df-813f-6a705823fd73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:23.095883 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab31df4d-529f-48df-813f-6a705823fd73 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:23.199805 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1662/3352] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:47:23 2022] POST /identity/v3/projects => generated 397 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:47:23.204160 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82964f94-def6-4db9-8a96-406c67949645 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:23.226477 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82964f94-def6-4db9-8a96-406c67949645 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:23.296957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:23.592328 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34471477-a544-4688-8a74-24d29281a3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:23.592973 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34471477-a544-4688-8a74-24d29281a3a1 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:23.593231 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34471477-a544-4688-8a74-24d29281a3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:23.593690 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34471477-a544-4688-8a74-24d29281a3a1 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:23.594495 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34471477-a544-4688-8a74-24d29281a3a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:23.596650 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34471477-a544-4688-8a74-24d29281a3a1 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:23.645936 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1691/3353] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:47:23 2022] POST /identity/v3/users => generated 299 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:23.651070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31df4d-529f-48df-813f-6a705823fd73 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:23.679170 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31df4d-529f-48df-813f-6a705823fd73 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:23.705042 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f144ca75-78ad-4170-8662-6be3bf8df203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:23.706969 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144ca75-78ad-4170-8662-6be3bf8df203 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:23.710933 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144ca75-78ad-4170-8662-6be3bf8df203 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:23.711940 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144ca75-78ad-4170-8662-6be3bf8df203 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:23.713288 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f144ca75-78ad-4170-8662-6be3bf8df203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:23.721245 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f144ca75-78ad-4170-8662-6be3bf8df203 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:23.792682 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1663/3354] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:47:23.793805 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34471477-a544-4688-8a74-24d29281a3a1 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:23.819647 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34471477-a544-4688-8a74-24d29281a3a1 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:23.862947 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7b018-0b84-4546-b151-23dc2895edf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:23.870767 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7b018-0b84-4546-b151-23dc2895edf1 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:23.871213 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7b018-0b84-4546-b151-23dc2895edf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:23.871521 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7b018-0b84-4546-b151-23dc2895edf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:23.872238 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7b018-0b84-4546-b151-23dc2895edf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:23.873938 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7b018-0b84-4546-b151-23dc2895edf1 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:23.922590 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1692/3355] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:47:23.926131 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f144ca75-78ad-4170-8662-6be3bf8df203 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:23.968704 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f144ca75-78ad-4170-8662-6be3bf8df203 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:24.012867 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daec281-1d62-487a-a79d-ba39bfd00490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:24.013629 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daec281-1d62-487a-a79d-ba39bfd00490 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:24.013915 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daec281-1d62-487a-a79d-ba39bfd00490 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:24.014194 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daec281-1d62-487a-a79d-ba39bfd00490 admin admin] PATH_INFO: `/v3/projects/9b2c1f9e69b64705adce1bfa7230e8bd/users/90cf62e411444153b2f238fb2d2c31be/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:24.102083 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daec281-1d62-487a-a79d-ba39bfd00490 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b2c1f9e69b64705adce1bfa7230e8bd, user_id=90cf62e411444153b2f238fb2d2c31be, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:24.109694 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daec281-1d62-487a-a79d-ba39bfd00490 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:24.157108 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1664/3356] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:47:23 2022] PUT /identity/v3/projects/9b2c1f9e69b64705adce1bfa7230e8bd/users/90cf62e411444153b2f238fb2d2c31be/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:24.167653 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe4c55-0c45-4de0-af78-ec2a31b769fc None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:24.168398 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe4c55-0c45-4de0-af78-ec2a31b769fc None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:24.169422 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe4c55-0c45-4de0-af78-ec2a31b769fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:24.256492 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-afbe4c55-0c45-4de0-af78-ec2a31b769fc None None] MFA Rules not processed for user `90cf62e411444153b2f238fb2d2c31be`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:24.257767 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-afbe4c55-0c45-4de0-af78-ec2a31b769fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:24.412213 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1693/3357] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:47:24 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:47:24.534623 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daec281-1d62-487a-a79d-ba39bfd00490 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:24.546152 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6daec281-1d62-487a-a79d-ba39bfd00490 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:24.819109 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daec281-1d62-487a-a79d-ba39bfd00490 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:24.831828 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f562a707-6d00-4b3a-8479-0d1aae4fc22c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:24.831828 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562a707-6d00-4b3a-8479-0d1aae4fc22c service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:24.831828 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562a707-6d00-4b3a-8479-0d1aae4fc22c service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:24.832238 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562a707-6d00-4b3a-8479-0d1aae4fc22c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:24.857507 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f562a707-6d00-4b3a-8479-0d1aae4fc22c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:24.860803 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f562a707-6d00-4b3a-8479-0d1aae4fc22c service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:24.888847 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1665/3358] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:47:24 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:47:25.443822 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe4c55-0c45-4de0-af78-ec2a31b769fc None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:25.690950 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe4c55-0c45-4de0-af78-ec2a31b769fc None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:25.706140 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979bc8de-d9fa-460e-83a2-54bd7b920225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:25.709500 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bc8de-d9fa-460e-83a2-54bd7b920225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:25.710135 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bc8de-d9fa-460e-83a2-54bd7b920225 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:25.710588 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bc8de-d9fa-460e-83a2-54bd7b920225 admin admin] PATH_INFO: `/v3/users/90cf62e411444153b2f238fb2d2c31be` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:25.717513 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979bc8de-d9fa-460e-83a2-54bd7b920225 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90cf62e411444153b2f238fb2d2c31be)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:25.719550 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979bc8de-d9fa-460e-83a2-54bd7b920225 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:25.818683 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:25.929659 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-979bc8de-d9fa-460e-83a2-54bd7b920225 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90cf62e411444153b2f238fb2d2c31be'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:25.934724 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-979bc8de-d9fa-460e-83a2-54bd7b920225 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90cf62e411444153b2f238fb2d2c31be'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:25.994619 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-979bc8de-d9fa-460e-83a2-54bd7b920225 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90cf62e411444153b2f238fb2d2c31be'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:26.035366 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-979bc8de-d9fa-460e-83a2-54bd7b920225 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90cf62e411444153b2f238fb2d2c31be'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:26.059814 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-979bc8de-d9fa-460e-83a2-54bd7b920225 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90cf62e411444153b2f238fb2d2c31be'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:26.099406 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1694/3359] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:47:25 2022] DELETE /identity/v3/users/90cf62e411444153b2f238fb2d2c31be => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:26.101388 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d9ec2-42a0-45bb-8d81-0bd8c60b50ad None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:26.101859 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d9ec2-42a0-45bb-8d81-0bd8c60b50ad None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:26.101969 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d9ec2-42a0-45bb-8d81-0bd8c60b50ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:26.160327 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-1b5d9ec2-42a0-45bb-8d81-0bd8c60b50ad None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:26.161580 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1b5d9ec2-42a0-45bb-8d81-0bd8c60b50ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:26.200953 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:26.348889 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1666/3360] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:47:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:26.467957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979bc8de-d9fa-460e-83a2-54bd7b920225 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:26.469853 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-979bc8de-d9fa-460e-83a2-54bd7b920225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:26.625580 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979bc8de-d9fa-460e-83a2-54bd7b920225 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:26.632239 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0ef58-4a04-4503-a1d1-fee875ef2860 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:26.632890 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0ef58-4a04-4503-a1d1-fee875ef2860 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:26.633217 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0ef58-4a04-4503-a1d1-fee875ef2860 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:26.633442 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0ef58-4a04-4503-a1d1-fee875ef2860 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:26.672280 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0ef58-4a04-4503-a1d1-fee875ef2860 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:26.673777 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0ef58-4a04-4503-a1d1-fee875ef2860 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:26.712583 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1695/3361] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:47:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:47:29.466228 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d9ec2-42a0-45bb-8d81-0bd8c60b50ad None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:29.470119 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1b5d9ec2-42a0-45bb-8d81-0bd8c60b50ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:29.495347 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d9ec2-42a0-45bb-8d81-0bd8c60b50ad None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:29.504503 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc21d04-99ac-4b38-b47c-057ec708deea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:29.505268 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc21d04-99ac-4b38-b47c-057ec708deea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:29.505687 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc21d04-99ac-4b38-b47c-057ec708deea admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:29.506027 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc21d04-99ac-4b38-b47c-057ec708deea admin admin] PATH_INFO: `/v3/projects/9b2c1f9e69b64705adce1bfa7230e8bd` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:29.507461 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc21d04-99ac-4b38-b47c-057ec708deea admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b2c1f9e69b64705adce1bfa7230e8bd)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:29.509530 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc21d04-99ac-4b38-b47c-057ec708deea admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:29.655951 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7dc21d04-99ac-4b38-b47c-057ec708deea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b2c1f9e69b64705adce1bfa7230e8bd', 'request_id': 'req-7dc21d04-99ac-4b38-b47c-057ec708deea'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:29.686916 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7dc21d04-99ac-4b38-b47c-057ec708deea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b2c1f9e69b64705adce1bfa7230e8bd', 'request_id': 'req-7dc21d04-99ac-4b38-b47c-057ec708deea'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:29.695981 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7dc21d04-99ac-4b38-b47c-057ec708deea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b2c1f9e69b64705adce1bfa7230e8bd', 'request_id': 'req-7dc21d04-99ac-4b38-b47c-057ec708deea'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:29.727569 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7dc21d04-99ac-4b38-b47c-057ec708deea admin admin] The token cache is being invalidate because project 9b2c1f9e69b64705adce1bfa7230e8bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:47:29.727860 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7dc21d04-99ac-4b38-b47c-057ec708deea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:29.728528 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7dc21d04-99ac-4b38-b47c-057ec708deea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:29.736422 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1667/3362] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:29 2022] DELETE /identity/v3/projects/9b2c1f9e69b64705adce1bfa7230e8bd => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:29.743440 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc6c10-ec01-40ae-8c00-853cd9c612f1 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:29.744543 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc6c10-ec01-40ae-8c00-853cd9c612f1 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:29.745058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc6c10-ec01-40ae-8c00-853cd9c612f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:29.800187 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-1ecc6c10-ec01-40ae-8c00-853cd9c612f1 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:29.802649 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1ecc6c10-ec01-40ae-8c00-853cd9c612f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:29.948410 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1696/3363] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:47:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:47:29.952863 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647c14c-c078-4189-9a77-593b044a6ac6 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:29.953248 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647c14c-c078-4189-9a77-593b044a6ac6 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:29.953459 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647c14c-c078-4189-9a77-593b044a6ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:30.009048 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-2647c14c-c078-4189-9a77-593b044a6ac6 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:30.010393 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2647c14c-c078-4189-9a77-593b044a6ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:30.028219 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1668/3364] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:47:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:30.033134 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc6c10-ec01-40ae-8c00-853cd9c612f1 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:30.050038 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc6c10-ec01-40ae-8c00-853cd9c612f1 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:30.055675 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba44b6-3db7-48a7-9eaa-c102914c7bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:30.057021 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba44b6-3db7-48a7-9eaa-c102914c7bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:30.058089 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba44b6-3db7-48a7-9eaa-c102914c7bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:30.058861 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba44b6-3db7-48a7-9eaa-c102914c7bb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:30.059885 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba44b6-3db7-48a7-9eaa-c102914c7bb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:47:30.060378 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba44b6-3db7-48a7-9eaa-c102914c7bb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:30.062401 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba44b6-3db7-48a7-9eaa-c102914c7bb9 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:30.085253 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647c14c-c078-4189-9a77-593b044a6ac6 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:30.101440 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1697/3365] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:47:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:47:30.110293 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647c14c-c078-4189-9a77-593b044a6ac6 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:30.119746 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1aceae-82d3-49ce-a2e5-933a7a80625d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:30.121775 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1aceae-82d3-49ce-a2e5-933a7a80625d admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:30.122284 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1aceae-82d3-49ce-a2e5-933a7a80625d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:30.123104 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1aceae-82d3-49ce-a2e5-933a7a80625d admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:30.124426 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1aceae-82d3-49ce-a2e5-933a7a80625d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:30.126839 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1aceae-82d3-49ce-a2e5-933a7a80625d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:30.181543 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba44b6-3db7-48a7-9eaa-c102914c7bb9 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:30.183397 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1669/3366] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:47:30 2022] POST /identity/v3/projects => generated 397 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:30.213257 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba44b6-3db7-48a7-9eaa-c102914c7bb9 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:30.323141 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:30.387487 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6baa01-51e9-42b2-b9fb-40284daac205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:30.388654 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6baa01-51e9-42b2-b9fb-40284daac205 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:30.389150 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6baa01-51e9-42b2-b9fb-40284daac205 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:30.389642 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6baa01-51e9-42b2-b9fb-40284daac205 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:30.390495 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6baa01-51e9-42b2-b9fb-40284daac205 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:30.393681 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6baa01-51e9-42b2-b9fb-40284daac205 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:30.424728 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1698/3367] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:47:30 2022] POST /identity/v3/users => generated 299 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:30.429055 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1aceae-82d3-49ce-a2e5-933a7a80625d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:30.447305 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1aceae-82d3-49ce-a2e5-933a7a80625d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:30.455517 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566d2eb-dcdb-4f14-b1bf-3d8d0b383281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:30.456153 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566d2eb-dcdb-4f14-b1bf-3d8d0b383281 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:30.456942 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566d2eb-dcdb-4f14-b1bf-3d8d0b383281 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:30.457286 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566d2eb-dcdb-4f14-b1bf-3d8d0b383281 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:30.458530 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c566d2eb-dcdb-4f14-b1bf-3d8d0b383281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:30.460009 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c566d2eb-dcdb-4f14-b1bf-3d8d0b383281 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:30.493983 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6baa01-51e9-42b2-b9fb-40284daac205 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:30.502279 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1670/3368] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:47:30.509986 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6baa01-51e9-42b2-b9fb-40284daac205 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:30.518969 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c194b-1f93-487e-9252-10aa3105efc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:30.519948 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c194b-1f93-487e-9252-10aa3105efc1 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:30.519948 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c194b-1f93-487e-9252-10aa3105efc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:30.520247 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c194b-1f93-487e-9252-10aa3105efc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:30.520837 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c194b-1f93-487e-9252-10aa3105efc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:30.531911 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c194b-1f93-487e-9252-10aa3105efc1 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:30.547332 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1699/3369] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:47:30.551448 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566d2eb-dcdb-4f14-b1bf-3d8d0b383281 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:30.567333 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566d2eb-dcdb-4f14-b1bf-3d8d0b383281 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:30.592283 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec8e7c-67ee-467a-969b-ec85729fc45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:30.593220 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec8e7c-67ee-467a-969b-ec85729fc45b admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:30.593675 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec8e7c-67ee-467a-969b-ec85729fc45b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:30.594113 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec8e7c-67ee-467a-969b-ec85729fc45b admin admin] PATH_INFO: `/v3/projects/062ee746b4614e629a9d853a6d84a368/users/215e000f15f44b41aa38a41a941c16da/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:30.620609 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec8e7c-67ee-467a-969b-ec85729fc45b admin admin] RBAC: Authorizing `identity:create_grant(project_id=062ee746b4614e629a9d853a6d84a368, user_id=215e000f15f44b41aa38a41a941c16da, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:30.624274 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec8e7c-67ee-467a-969b-ec85729fc45b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:30.669592 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1671/3370] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:47:30 2022] PUT /identity/v3/projects/062ee746b4614e629a9d853a6d84a368/users/215e000f15f44b41aa38a41a941c16da/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:30.674671 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce743f-0abd-4c06-ab96-4a7f5cda44cd None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:30.675167 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce743f-0abd-4c06-ab96-4a7f5cda44cd None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:30.675545 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce743f-0abd-4c06-ab96-4a7f5cda44cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:30.719853 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-a6ce743f-0abd-4c06-ab96-4a7f5cda44cd None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:30.721603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a6ce743f-0abd-4c06-ab96-4a7f5cda44cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:30.818943 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1700/3371] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:47:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:47:30.842502 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec8e7c-67ee-467a-969b-ec85729fc45b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:30.844485 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-90ec8e7c-67ee-467a-969b-ec85729fc45b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:30.924736 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:30.970453 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec8e7c-67ee-467a-969b-ec85729fc45b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:30.977097 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85553ed5-e7da-4f7f-9be9-11b5d0cd7d62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:30.977958 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85553ed5-e7da-4f7f-9be9-11b5d0cd7d62 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:30.978338 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85553ed5-e7da-4f7f-9be9-11b5d0cd7d62 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:30.978756 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85553ed5-e7da-4f7f-9be9-11b5d0cd7d62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:30.990759 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85553ed5-e7da-4f7f-9be9-11b5d0cd7d62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:30.992549 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85553ed5-e7da-4f7f-9be9-11b5d0cd7d62 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:31.007723 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1672/3372] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:47:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:47:34.518714 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8befd4-7ef7-4283-ac23-c896bca3a4cf None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:34.519690 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8befd4-7ef7-4283-ac23-c896bca3a4cf None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:34.520252 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8befd4-7ef7-4283-ac23-c896bca3a4cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:34.618319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-5d8befd4-7ef7-4283-ac23-c896bca3a4cf None None] MFA Rules not processed for user `3b926292fcc044389a38c8de0d293722`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:34.624478 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5d8befd4-7ef7-4283-ac23-c896bca3a4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:34.771218 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1701/3373] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:47:34 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:34.784688 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85553ed5-e7da-4f7f-9be9-11b5d0cd7d62 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:34.787271 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-85553ed5-e7da-4f7f-9be9-11b5d0cd7d62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:34.954324 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85553ed5-e7da-4f7f-9be9-11b5d0cd7d62 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:34.974624 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9e216-a2d9-46ab-b5a0-092912bd8a8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:34.976880 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9e216-a2d9-46ab-b5a0-092912bd8a8a service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:34.978153 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9e216-a2d9-46ab-b5a0-092912bd8a8a service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:34.979590 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9e216-a2d9-46ab-b5a0-092912bd8a8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:35.010390 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce9e216-a2d9-46ab-b5a0-092912bd8a8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:35.014546 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce9e216-a2d9-46ab-b5a0-092912bd8a8a service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:35.040758 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1673/3374] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:47:34 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:47:40.262171 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8efd6-f86c-46ac-b0f2-9adb042ef19f None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:40.262811 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8efd6-f86c-46ac-b0f2-9adb042ef19f None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:40.262811 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8efd6-f86c-46ac-b0f2-9adb042ef19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:40.345164 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-fcc8efd6-f86c-46ac-b0f2-9adb042ef19f None None] MFA Rules not processed for user `89285e448a144b8c847a8c104a6f4755`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:40.346642 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-fcc8efd6-f86c-46ac-b0f2-9adb042ef19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:40.402867 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:40.477541 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1702/3375] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:47:40 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:44.123561 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9e216-a2d9-46ab-b5a0-092912bd8a8a service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:44.125107 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1ce9e216-a2d9-46ab-b5a0-092912bd8a8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:44.162605 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9e216-a2d9-46ab-b5a0-092912bd8a8a service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:44.179120 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff6fd5-a2b1-4cc2-b1c6-e3f2b6ecf194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:44.180105 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff6fd5-a2b1-4cc2-b1c6-e3f2b6ecf194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:44.180592 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff6fd5-a2b1-4cc2-b1c6-e3f2b6ecf194 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:44.181143 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff6fd5-a2b1-4cc2-b1c6-e3f2b6ecf194 admin admin] PATH_INFO: `/v3/users/7058c725d25749af95e6a5fc806e27ef` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:44.190785 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff6fd5-a2b1-4cc2-b1c6-e3f2b6ecf194 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7058c725d25749af95e6a5fc806e27ef)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:44.193095 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff6fd5-a2b1-4cc2-b1c6-e3f2b6ecf194 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:44.304420 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-22ff6fd5-a2b1-4cc2-b1c6-e3f2b6ecf194 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7058c725d25749af95e6a5fc806e27ef'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:44.306017 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-22ff6fd5-a2b1-4cc2-b1c6-e3f2b6ecf194 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7058c725d25749af95e6a5fc806e27ef'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:44.317866 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-22ff6fd5-a2b1-4cc2-b1c6-e3f2b6ecf194 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7058c725d25749af95e6a5fc806e27ef'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:44.399656 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-22ff6fd5-a2b1-4cc2-b1c6-e3f2b6ecf194 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7058c725d25749af95e6a5fc806e27ef'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:44.400577 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-22ff6fd5-a2b1-4cc2-b1c6-e3f2b6ecf194 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7058c725d25749af95e6a5fc806e27ef'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:44.431111 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1674/3376] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:47:44 2022] DELETE /identity/v3/users/7058c725d25749af95e6a5fc806e27ef => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:44.842932 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8efd6-f86c-46ac-b0f2-9adb042ef19f None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:44.868574 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8efd6-f86c-46ac-b0f2-9adb042ef19f None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:44.996866 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d22b3-56b8-4b8a-b337-948318a55263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:44.998158 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d22b3-56b8-4b8a-b337-948318a55263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:44.998486 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d22b3-56b8-4b8a-b337-948318a55263 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:44.999424 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d22b3-56b8-4b8a-b337-948318a55263 admin admin] PATH_INFO: `/v3/projects/a25ad3634e624e9394ac4e588d773383` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:45.001627 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d22b3-56b8-4b8a-b337-948318a55263 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a25ad3634e624e9394ac4e588d773383)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:45.004799 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d22b3-56b8-4b8a-b337-948318a55263 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:45.153479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-cb0d22b3-56b8-4b8a-b337-948318a55263 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a25ad3634e624e9394ac4e588d773383', 'request_id': 'req-cb0d22b3-56b8-4b8a-b337-948318a55263'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:45.186283 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-cb0d22b3-56b8-4b8a-b337-948318a55263 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a25ad3634e624e9394ac4e588d773383', 'request_id': 'req-cb0d22b3-56b8-4b8a-b337-948318a55263'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:45.219316 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-cb0d22b3-56b8-4b8a-b337-948318a55263 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a25ad3634e624e9394ac4e588d773383', 'request_id': 'req-cb0d22b3-56b8-4b8a-b337-948318a55263'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:45.304251 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-cb0d22b3-56b8-4b8a-b337-948318a55263 admin admin] The token cache is being invalidate because project a25ad3634e624e9394ac4e588d773383 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:47:45.304572 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-cb0d22b3-56b8-4b8a-b337-948318a55263 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:45.306991 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-cb0d22b3-56b8-4b8a-b337-948318a55263 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:45.314043 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1703/3377] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:44 2022] DELETE /identity/v3/projects/a25ad3634e624e9394ac4e588d773383 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:45.315733 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3a336-c37d-44b1-bd01-3b862a63f721 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:45.316243 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3a336-c37d-44b1-bd01-3b862a63f721 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:45.316332 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3a336-c37d-44b1-bd01-3b862a63f721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:45.410806 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-08a3a336-c37d-44b1-bd01-3b862a63f721 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:45.412240 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-08a3a336-c37d-44b1-bd01-3b862a63f721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:45.569967 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:45.679604 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d02fce-96fb-475c-b434-dc33bead2654 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:45.680517 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d02fce-96fb-475c-b434-dc33bead2654 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:45.681638 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d02fce-96fb-475c-b434-dc33bead2654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:45.684125 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1675/3378] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:47:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:45.721771 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-e6d02fce-96fb-475c-b434-dc33bead2654 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:45.724337 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e6d02fce-96fb-475c-b434-dc33bead2654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:45.750334 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1704/3379] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:47:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:45.751828 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a3a336-c37d-44b1-bd01-3b862a63f721 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:45.776715 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a3a336-c37d-44b1-bd01-3b862a63f721 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:45.794318 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abee108-a341-4070-8ac1-7971bd7d3895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:45.797503 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abee108-a341-4070-8ac1-7971bd7d3895 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:45.799293 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abee108-a341-4070-8ac1-7971bd7d3895 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:45.799701 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abee108-a341-4070-8ac1-7971bd7d3895 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:45.801000 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abee108-a341-4070-8ac1-7971bd7d3895 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:47:45.801527 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abee108-a341-4070-8ac1-7971bd7d3895 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:45.805191 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abee108-a341-4070-8ac1-7971bd7d3895 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:45.856855 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1676/3380] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:47:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:47:45.861308 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d02fce-96fb-475c-b434-dc33bead2654 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:45.875209 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d02fce-96fb-475c-b434-dc33bead2654 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:45.889597 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b4446-0159-477d-96b2-b19d32975bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:45.890399 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b4446-0159-477d-96b2-b19d32975bc4 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:45.890792 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b4446-0159-477d-96b2-b19d32975bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:45.891204 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b4446-0159-477d-96b2-b19d32975bc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:45.891967 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b4446-0159-477d-96b2-b19d32975bc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:45.894024 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b4446-0159-477d-96b2-b19d32975bc4 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:45.992377 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1705/3381] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:47:45 2022] POST /identity/v3/projects => generated 391 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:45.997154 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abee108-a341-4070-8ac1-7971bd7d3895 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:46.010763 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abee108-a341-4070-8ac1-7971bd7d3895 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:46.142852 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216a3e4-0d09-4eef-9121-e12624c0897d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:46.145844 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216a3e4-0d09-4eef-9121-e12624c0897d admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:46.146314 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216a3e4-0d09-4eef-9121-e12624c0897d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:46.146995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216a3e4-0d09-4eef-9121-e12624c0897d admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:46.148058 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6216a3e4-0d09-4eef-9121-e12624c0897d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:46.151580 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6216a3e4-0d09-4eef-9121-e12624c0897d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:46.203146 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1677/3382] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:47:45 2022] POST /identity/v3/users => generated 296 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:46.203988 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b4446-0159-477d-96b2-b19d32975bc4 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:46.228799 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b4446-0159-477d-96b2-b19d32975bc4 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:46.257390 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503c1261-2757-4246-972c-eafba7d10afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:46.258033 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c1261-2757-4246-972c-eafba7d10afc admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:46.258317 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c1261-2757-4246-972c-eafba7d10afc admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:46.258617 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c1261-2757-4246-972c-eafba7d10afc admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:46.259364 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503c1261-2757-4246-972c-eafba7d10afc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:46.260979 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503c1261-2757-4246-972c-eafba7d10afc admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:46.305843 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1706/3383] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:47:46.307738 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216a3e4-0d09-4eef-9121-e12624c0897d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:46.323346 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216a3e4-0d09-4eef-9121-e12624c0897d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:46.343309 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e11225-c9ca-4a32-8f43-09e47320b5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:46.343681 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e11225-c9ca-4a32-8f43-09e47320b5e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:46.344075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e11225-c9ca-4a32-8f43-09e47320b5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:46.344544 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e11225-c9ca-4a32-8f43-09e47320b5e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:46.345307 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e11225-c9ca-4a32-8f43-09e47320b5e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:46.348205 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e11225-c9ca-4a32-8f43-09e47320b5e9 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:46.353138 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15591daf-f2d1-40d3-9450-58a5d2e22d55 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:46.353437 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15591daf-f2d1-40d3-9450-58a5d2e22d55 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:46.353710 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15591daf-f2d1-40d3-9450-58a5d2e22d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:46.387503 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1678/3384] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:47:46.390778 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e11225-c9ca-4a32-8f43-09e47320b5e9 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:46.402963 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:46.432505 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e11225-c9ca-4a32-8f43-09e47320b5e9 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:46.440575 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-15591daf-f2d1-40d3-9450-58a5d2e22d55 None None] MFA Rules not processed for user `215e000f15f44b41aa38a41a941c16da`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:46.454928 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-15591daf-f2d1-40d3-9450-58a5d2e22d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:46.461908 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481bdd32-e9b5-4641-aa1b-8b0f08718f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:46.462607 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481bdd32-e9b5-4641-aa1b-8b0f08718f88 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:46.462890 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481bdd32-e9b5-4641-aa1b-8b0f08718f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:46.463418 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481bdd32-e9b5-4641-aa1b-8b0f08718f88 admin admin] PATH_INFO: `/v3/projects/774de53546094c33a65521de121366e7/users/59d14bdc698a4695a5905f38dd21937d/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:46.506925 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481bdd32-e9b5-4641-aa1b-8b0f08718f88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=774de53546094c33a65521de121366e7, user_id=59d14bdc698a4695a5905f38dd21937d, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:46.510570 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481bdd32-e9b5-4641-aa1b-8b0f08718f88 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:46.534145 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1679/3385] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:47:46 2022] PUT /identity/v3/projects/774de53546094c33a65521de121366e7/users/59d14bdc698a4695a5905f38dd21937d/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:46.540899 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f636d-241d-40f6-8c5b-83c2d425493d None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:46.541480 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f636d-241d-40f6-8c5b-83c2d425493d None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:46.541998 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f636d-241d-40f6-8c5b-83c2d425493d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:46.600332 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-0c1f636d-241d-40f6-8c5b-83c2d425493d None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:46.608117 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0c1f636d-241d-40f6-8c5b-83c2d425493d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:46.654807 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1707/3386] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:47:46 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:46.656397 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaaec6f-001c-4f12-a8a6-1bfdae923ebc None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:46.656789 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaaec6f-001c-4f12-a8a6-1bfdae923ebc None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:46.657298 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaaec6f-001c-4f12-a8a6-1bfdae923ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:46.723088 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-ebaaec6f-001c-4f12-a8a6-1bfdae923ebc None None] MFA Rules not processed for user `215e000f15f44b41aa38a41a941c16da`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:46.723088 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ebaaec6f-001c-4f12-a8a6-1bfdae923ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:46.804239 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1680/3387] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:47:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:46.816321 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f636d-241d-40f6-8c5b-83c2d425493d None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:46.817963 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0c1f636d-241d-40f6-8c5b-83c2d425493d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:46.876422 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1708/3388] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:47:46 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:46.889402 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:46.972426 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f636d-241d-40f6-8c5b-83c2d425493d None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:46.987987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bbc0d1-8eab-4de8-960e-ba63125b3f5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:46.989754 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbc0d1-8eab-4de8-960e-ba63125b3f5d service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:46.990278 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbc0d1-8eab-4de8-960e-ba63125b3f5d service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:46.990819 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbc0d1-8eab-4de8-960e-ba63125b3f5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:47.018796 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bbc0d1-8eab-4de8-960e-ba63125b3f5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:47.020579 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bbc0d1-8eab-4de8-960e-ba63125b3f5d service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:47.045937 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1681/3389] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:47:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:47:47.239108 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaaec6f-001c-4f12-a8a6-1bfdae923ebc None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:47.240796 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ebaaec6f-001c-4f12-a8a6-1bfdae923ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:47.496795 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaaec6f-001c-4f12-a8a6-1bfdae923ebc None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:47.518656 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bca772-ac15-4091-ab97-aafccfb24ffc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:47.521413 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bca772-ac15-4091-ab97-aafccfb24ffc service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:47.523636 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bca772-ac15-4091-ab97-aafccfb24ffc service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:47.524345 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bca772-ac15-4091-ab97-aafccfb24ffc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:47.545057 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bca772-ac15-4091-ab97-aafccfb24ffc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:47.547090 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bca772-ac15-4091-ab97-aafccfb24ffc service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:47.563164 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1709/3390] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:47:47 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:47:48.406314 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08bb44-7cf8-43cb-a14f-3bd63f52be5d None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:48.407215 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08bb44-7cf8-43cb-a14f-3bd63f52be5d None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:48.407676 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08bb44-7cf8-43cb-a14f-3bd63f52be5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:48.447754 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-7c08bb44-7cf8-43cb-a14f-3bd63f52be5d None None] MFA Rules not processed for user `085145c4942d4c889c291a99eb1d009a`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:48.450460 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7c08bb44-7cf8-43cb-a14f-3bd63f52be5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:48.583082 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1682/3391] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:47:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:51.608242 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bca772-ac15-4091-ab97-aafccfb24ffc service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:51.610292 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-82bca772-ac15-4091-ab97-aafccfb24ffc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:51.637765 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bca772-ac15-4091-ab97-aafccfb24ffc service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:51.651094 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859de72-7b9d-423d-9d56-c0b1d9e7f61b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:51.652900 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859de72-7b9d-423d-9d56-c0b1d9e7f61b service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:51.653190 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859de72-7b9d-423d-9d56-c0b1d9e7f61b service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:51.653652 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859de72-7b9d-423d-9d56-c0b1d9e7f61b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:51.666969 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8859de72-7b9d-423d-9d56-c0b1d9e7f61b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:51.744440 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8859de72-7b9d-423d-9d56-c0b1d9e7f61b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:51.751863 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8859de72-7b9d-423d-9d56-c0b1d9e7f61b service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:51.816437 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1710/3392] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:47:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:47:52.583466 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c08bb44-7cf8-43cb-a14f-3bd63f52be5d None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:52.599190 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c08bb44-7cf8-43cb-a14f-3bd63f52be5d None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:52.604519 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c8ac2b-8155-49f2-abfd-bb34012694dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:52.606125 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8ac2b-8155-49f2-abfd-bb34012694dd service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:52.606664 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8ac2b-8155-49f2-abfd-bb34012694dd service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:52.607132 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8ac2b-8155-49f2-abfd-bb34012694dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:52.609901 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-30c8ac2b-8155-49f2-abfd-bb34012694dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:52.644303 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c8ac2b-8155-49f2-abfd-bb34012694dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:52.648029 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c8ac2b-8155-49f2-abfd-bb34012694dd service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:52.711134 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1683/3393] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:47:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:47:57.863485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859de72-7b9d-423d-9d56-c0b1d9e7f61b service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:57.865487 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8859de72-7b9d-423d-9d56-c0b1d9e7f61b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:57.898082 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859de72-7b9d-423d-9d56-c0b1d9e7f61b service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:57.903613 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21f955-41b3-4578-8cbd-de50c5813408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:57.904522 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21f955-41b3-4578-8cbd-de50c5813408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:57.905044 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21f955-41b3-4578-8cbd-de50c5813408 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:57.905542 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21f955-41b3-4578-8cbd-de50c5813408 admin admin] PATH_INFO: `/v3/users/e77747aef70040c98167ea7daddf25c6` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:57.906973 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e21f955-41b3-4578-8cbd-de50c5813408 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e77747aef70040c98167ea7daddf25c6)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:57.909262 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e21f955-41b3-4578-8cbd-de50c5813408 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:57.931973 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:57.993652 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4e21f955-41b3-4578-8cbd-de50c5813408 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e77747aef70040c98167ea7daddf25c6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:57.994579 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4e21f955-41b3-4578-8cbd-de50c5813408 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e77747aef70040c98167ea7daddf25c6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:58.008307 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4e21f955-41b3-4578-8cbd-de50c5813408 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e77747aef70040c98167ea7daddf25c6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:58.036080 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4e21f955-41b3-4578-8cbd-de50c5813408 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e77747aef70040c98167ea7daddf25c6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:58.047782 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4e21f955-41b3-4578-8cbd-de50c5813408 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e77747aef70040c98167ea7daddf25c6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:58.060308 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1711/3394] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:47:57 2022] DELETE /identity/v3/users/e77747aef70040c98167ea7daddf25c6 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:58.554548 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c8ac2b-8155-49f2-abfd-bb34012694dd service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:58.573328 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c8ac2b-8155-49f2-abfd-bb34012694dd service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:58.759119 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537da69-b586-4bc1-99e5-ba3bb55e5bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:58.759765 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537da69-b586-4bc1-99e5-ba3bb55e5bfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:58.760046 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537da69-b586-4bc1-99e5-ba3bb55e5bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:58.760318 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537da69-b586-4bc1-99e5-ba3bb55e5bfb admin admin] PATH_INFO: `/v3/projects/5cbb49e2c7b44bfc88daa86ad4a568c5` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:58.764466 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537da69-b586-4bc1-99e5-ba3bb55e5bfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cbb49e2c7b44bfc88daa86ad4a568c5)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:58.766490 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537da69-b586-4bc1-99e5-ba3bb55e5bfb admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:58.936582 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7537da69-b586-4bc1-99e5-ba3bb55e5bfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cbb49e2c7b44bfc88daa86ad4a568c5', 'request_id': 'req-7537da69-b586-4bc1-99e5-ba3bb55e5bfb'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:58.956155 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7537da69-b586-4bc1-99e5-ba3bb55e5bfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cbb49e2c7b44bfc88daa86ad4a568c5', 'request_id': 'req-7537da69-b586-4bc1-99e5-ba3bb55e5bfb'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:58.960220 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:58.981218 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7537da69-b586-4bc1-99e5-ba3bb55e5bfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cbb49e2c7b44bfc88daa86ad4a568c5', 'request_id': 'req-7537da69-b586-4bc1-99e5-ba3bb55e5bfb'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:59.024608 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7537da69-b586-4bc1-99e5-ba3bb55e5bfb admin admin] The token cache is being invalidate because project 5cbb49e2c7b44bfc88daa86ad4a568c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:47:59.024902 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7537da69-b586-4bc1-99e5-ba3bb55e5bfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:59.025744 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7537da69-b586-4bc1-99e5-ba3bb55e5bfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:59.040736 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545fda7-698a-472b-ac28-137b13a77250 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:59.041762 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545fda7-698a-472b-ac28-137b13a77250 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:59.043251 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545fda7-698a-472b-ac28-137b13a77250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:59.044295 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1684/3395] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:58 2022] DELETE /identity/v3/projects/5cbb49e2c7b44bfc88daa86ad4a568c5 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:59.093728 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-1545fda7-698a-472b-ac28-137b13a77250 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:59.096035 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1545fda7-698a-472b-ac28-137b13a77250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:59.181423 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1712/3396] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:47:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:47:59.197196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b428b5-d3ef-4dbd-a9fc-b9bb29f570b8 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:59.197695 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b428b5-d3ef-4dbd-a9fc-b9bb29f570b8 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:59.197957 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b428b5-d3ef-4dbd-a9fc-b9bb29f570b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:59.232569 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-74b428b5-d3ef-4dbd-a9fc-b9bb29f570b8 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:59.234204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-74b428b5-d3ef-4dbd-a9fc-b9bb29f570b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:59.248621 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1685/3397] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:47:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:59.249628 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1545fda7-698a-472b-ac28-137b13a77250 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:59.264723 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1545fda7-698a-472b-ac28-137b13a77250 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:59.273611 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc392d-fbb4-4f00-93b0-e617c4b4851c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:59.274466 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc392d-fbb4-4f00-93b0-e617c4b4851c admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:59.274911 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc392d-fbb4-4f00-93b0-e617c4b4851c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:59.275359 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc392d-fbb4-4f00-93b0-e617c4b4851c admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:59.276166 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cc392d-fbb4-4f00-93b0-e617c4b4851c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:47:59.276661 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cc392d-fbb4-4f00-93b0-e617c4b4851c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:59.279287 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cc392d-fbb4-4f00-93b0-e617c4b4851c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:59.314188 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1713/3398] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:47:59.317324 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b428b5-d3ef-4dbd-a9fc-b9bb29f570b8 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:59.327202 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b428b5-d3ef-4dbd-a9fc-b9bb29f570b8 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:59.332669 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b991c-3340-45e1-90a5-c2d88604e9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:59.333791 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b991c-3340-45e1-90a5-c2d88604e9e3 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:59.333791 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b991c-3340-45e1-90a5-c2d88604e9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:59.333791 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b991c-3340-45e1-90a5-c2d88604e9e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:59.334480 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852b991c-3340-45e1-90a5-c2d88604e9e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:59.337020 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852b991c-3340-45e1-90a5-c2d88604e9e3 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:59.390766 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1686/3399] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:47:59 2022] POST /identity/v3/projects => generated 371 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:59.392238 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc392d-fbb4-4f00-93b0-e617c4b4851c admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:59.420904 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc392d-fbb4-4f00-93b0-e617c4b4851c admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:59.579243 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f671309-c239-4628-917c-7b988dced2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:59.581812 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f671309-c239-4628-917c-7b988dced2ab admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:59.582315 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f671309-c239-4628-917c-7b988dced2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:59.582793 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f671309-c239-4628-917c-7b988dced2ab admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:59.583735 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f671309-c239-4628-917c-7b988dced2ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:59.588700 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f671309-c239-4628-917c-7b988dced2ab admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:59.625324 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b991c-3340-45e1-90a5-c2d88604e9e3 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:59.664339 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1714/3400] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:47:59 2022] POST /identity/v3/users => generated 286 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:59.666812 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b991c-3340-45e1-90a5-c2d88604e9e3 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:59.688758 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24dbc9-de34-4b51-9854-5197a863cbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:59.690021 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24dbc9-de34-4b51-9854-5197a863cbb9 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:59.690498 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24dbc9-de34-4b51-9854-5197a863cbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:59.690911 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24dbc9-de34-4b51-9854-5197a863cbb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:59.691823 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24dbc9-de34-4b51-9854-5197a863cbb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:59.693800 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24dbc9-de34-4b51-9854-5197a863cbb9 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:59.723867 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f671309-c239-4628-917c-7b988dced2ab admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:59.724319 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1687/3401] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:47:59.742149 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f671309-c239-4628-917c-7b988dced2ab admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:59.764318 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb9e78-cf89-4052-a5e0-2e33b7fa4207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:59.767459 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb9e78-cf89-4052-a5e0-2e33b7fa4207 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:59.768216 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb9e78-cf89-4052-a5e0-2e33b7fa4207 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:59.768963 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb9e78-cf89-4052-a5e0-2e33b7fa4207 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:59.770490 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feb9e78-cf89-4052-a5e0-2e33b7fa4207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:59.776025 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feb9e78-cf89-4052-a5e0-2e33b7fa4207 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:59.781564 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:59.795615 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24dbc9-de34-4b51-9854-5197a863cbb9 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:59.798385 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5f24dbc9-de34-4b51-9854-5197a863cbb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:59.810256 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1715/3402] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:47:59.811797 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb9e78-cf89-4052-a5e0-2e33b7fa4207 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:59.825273 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb9e78-cf89-4052-a5e0-2e33b7fa4207 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:59.833167 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d7b8b7-dd6b-44fb-9134-f48b7460edb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:59.834582 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7b8b7-dd6b-44fb-9134-f48b7460edb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:59.834927 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7b8b7-dd6b-44fb-9134-f48b7460edb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:59.835969 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7b8b7-dd6b-44fb-9134-f48b7460edb0 admin admin] PATH_INFO: `/v3/projects/4914f89b57484044972fa80c6294b3bd/users/5bcbbc66ca5044ea8acda1b137f1d5b3/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:59.858355 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d7b8b7-dd6b-44fb-9134-f48b7460edb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4914f89b57484044972fa80c6294b3bd, user_id=5bcbbc66ca5044ea8acda1b137f1d5b3, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:59.862190 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d7b8b7-dd6b-44fb-9134-f48b7460edb0 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:59.890497 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1716/3403] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:47:59 2022] PUT /identity/v3/projects/4914f89b57484044972fa80c6294b3bd/users/5bcbbc66ca5044ea8acda1b137f1d5b3/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:59.892100 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7b885-0158-4ea3-ab89-18c737fec50d None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:59.892455 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7b885-0158-4ea3-ab89-18c737fec50d None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:59.892735 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7b885-0158-4ea3-ab89-18c737fec50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:59.923060 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24dbc9-de34-4b51-9854-5197a863cbb9 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:59.953450 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-9cf7b885-0158-4ea3-ab89-18c737fec50d None None] MFA Rules not processed for user `5bcbbc66ca5044ea8acda1b137f1d5b3`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:59.955428 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9cf7b885-0158-4ea3-ab89-18c737fec50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:00.008744 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ec6b60-4f02-4b6b-adb9-8e61ecacd6c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:00.009372 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec6b60-4f02-4b6b-adb9-8e61ecacd6c1 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:00.009651 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec6b60-4f02-4b6b-adb9-8e61ecacd6c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:00.009923 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec6b60-4f02-4b6b-adb9-8e61ecacd6c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:00.012879 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c2ec6b60-4f02-4b6b-adb9-8e61ecacd6c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:00.028764 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ec6b60-4f02-4b6b-adb9-8e61ecacd6c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:00.030192 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ec6b60-4f02-4b6b-adb9-8e61ecacd6c1 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:00.052267 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1688/3404] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:47:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:48:00.083152 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1717/3405] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:47:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:48:00.094725 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad229f6-cb2f-48eb-8308-859d8356f2bf None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:00.095590 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad229f6-cb2f-48eb-8308-859d8356f2bf None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:00.097163 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad229f6-cb2f-48eb-8308-859d8356f2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:00.126504 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-0ad229f6-cb2f-48eb-8308-859d8356f2bf None None] MFA Rules not processed for user `5bcbbc66ca5044ea8acda1b137f1d5b3`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:00.128076 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0ad229f6-cb2f-48eb-8308-859d8356f2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:00.141934 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1689/3406] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:48:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:48:00.151797 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7b885-0158-4ea3-ab89-18c737fec50d None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:00.154866 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9cf7b885-0158-4ea3-ab89-18c737fec50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:00.269727 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7b885-0158-4ea3-ab89-18c737fec50d None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:00.276625 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eeca97-873d-4661-abc9-ae5587a1f975 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:00.277318 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eeca97-873d-4661-abc9-ae5587a1f975 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:00.277623 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eeca97-873d-4661-abc9-ae5587a1f975 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:00.278443 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eeca97-873d-4661-abc9-ae5587a1f975 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:00.289434 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eeca97-873d-4661-abc9-ae5587a1f975 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:00.291346 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eeca97-873d-4661-abc9-ae5587a1f975 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:00.307254 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1718/3407] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:48:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:48:05.094944 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad229f6-cb2f-48eb-8308-859d8356f2bf None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:05.096501 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0ad229f6-cb2f-48eb-8308-859d8356f2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:05.315256 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad229f6-cb2f-48eb-8308-859d8356f2bf None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:05.324827 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54320f85-f4cc-41f3-bcaa-a46e800977cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:05.325957 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54320f85-f4cc-41f3-bcaa-a46e800977cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:05.326502 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54320f85-f4cc-41f3-bcaa-a46e800977cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:05.327129 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54320f85-f4cc-41f3-bcaa-a46e800977cf admin admin] PATH_INFO: `/v3/users/3b926292fcc044389a38c8de0d293722` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:05.328922 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54320f85-f4cc-41f3-bcaa-a46e800977cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b926292fcc044389a38c8de0d293722)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:05.331410 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54320f85-f4cc-41f3-bcaa-a46e800977cf admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:05.334136 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:05.438649 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-54320f85-f4cc-41f3-bcaa-a46e800977cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b926292fcc044389a38c8de0d293722'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:05.439351 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-54320f85-f4cc-41f3-bcaa-a46e800977cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b926292fcc044389a38c8de0d293722'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:05.455969 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-54320f85-f4cc-41f3-bcaa-a46e800977cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b926292fcc044389a38c8de0d293722'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:05.468874 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-54320f85-f4cc-41f3-bcaa-a46e800977cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b926292fcc044389a38c8de0d293722'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:05.469607 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-54320f85-f4cc-41f3-bcaa-a46e800977cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b926292fcc044389a38c8de0d293722'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:05.498774 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1690/3408] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:48:05 2022] DELETE /identity/v3/users/3b926292fcc044389a38c8de0d293722 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:05.664380 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cdee55-99a1-49c7-8a1a-aa303387e1e2 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:05.665348 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cdee55-99a1-49c7-8a1a-aa303387e1e2 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:05.665825 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cdee55-99a1-49c7-8a1a-aa303387e1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:05.756207 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-c6cdee55-99a1-49c7-8a1a-aa303387e1e2 None None] MFA Rules not processed for user `59d14bdc698a4695a5905f38dd21937d`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:05.762920 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c6cdee55-99a1-49c7-8a1a-aa303387e1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:05.789088 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54320f85-f4cc-41f3-bcaa-a46e800977cf admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:05.790721 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-54320f85-f4cc-41f3-bcaa-a46e800977cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:05.879257 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:05.972193 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54320f85-f4cc-41f3-bcaa-a46e800977cf admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:05.982482 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1719/3409] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:48:05 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:05.994215 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cdee55-99a1-49c7-8a1a-aa303387e1e2 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:05.996396 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c6cdee55-99a1-49c7-8a1a-aa303387e1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:05.997914 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3991c6-727b-413f-adf7-f520a60742f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:05.999404 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3991c6-727b-413f-adf7-f520a60742f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:05.999684 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3991c6-727b-413f-adf7-f520a60742f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:06.000033 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3991c6-727b-413f-adf7-f520a60742f6 admin admin] PATH_INFO: `/v3/projects/dfb01eb303394c63b10e95487f67aa5d` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:06.001626 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3991c6-727b-413f-adf7-f520a60742f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfb01eb303394c63b10e95487f67aa5d)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:06.003594 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3991c6-727b-413f-adf7-f520a60742f6 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:06.131490 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1f3991c6-727b-413f-adf7-f520a60742f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfb01eb303394c63b10e95487f67aa5d', 'request_id': 'req-1f3991c6-727b-413f-adf7-f520a60742f6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:06.142637 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1f3991c6-727b-413f-adf7-f520a60742f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfb01eb303394c63b10e95487f67aa5d', 'request_id': 'req-1f3991c6-727b-413f-adf7-f520a60742f6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:06.151439 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1f3991c6-727b-413f-adf7-f520a60742f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfb01eb303394c63b10e95487f67aa5d', 'request_id': 'req-1f3991c6-727b-413f-adf7-f520a60742f6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:06.182493 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1f3991c6-727b-413f-adf7-f520a60742f6 admin admin] The token cache is being invalidate because project dfb01eb303394c63b10e95487f67aa5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:48:06.182790 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1f3991c6-727b-413f-adf7-f520a60742f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:06.184806 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1f3991c6-727b-413f-adf7-f520a60742f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:06.186341 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cdee55-99a1-49c7-8a1a-aa303387e1e2 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:06.187521 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1691/3410] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:05 2022] DELETE /identity/v3/projects/dfb01eb303394c63b10e95487f67aa5d => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:06.194187 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b66878-2d7a-42da-982f-3b20b2fce866 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:06.194311 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b66878-2d7a-42da-982f-3b20b2fce866 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:06.194573 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b66878-2d7a-42da-982f-3b20b2fce866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:06.239423 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-20b66878-2d7a-42da-982f-3b20b2fce866 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:06.242747 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-20b66878-2d7a-42da-982f-3b20b2fce866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:06.256595 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:06.341759 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b2d0b-7ee7-42c1-adf0-588384e4813c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:06.343307 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b2d0b-7ee7-42c1-adf0-588384e4813c service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:06.343617 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b2d0b-7ee7-42c1-adf0-588384e4813c service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:06.343887 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b2d0b-7ee7-42c1-adf0-588384e4813c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:06.346089 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7d5b2d0b-7ee7-42c1-adf0-588384e4813c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:06.405585 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1692/3411] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:48:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:06.409208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997859e-b544-4c37-a8ad-9c6a2f3db3bf None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:06.409416 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997859e-b544-4c37-a8ad-9c6a2f3db3bf None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:06.409720 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997859e-b544-4c37-a8ad-9c6a2f3db3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:06.449134 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-6997859e-b544-4c37-a8ad-9c6a2f3db3bf None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:06.450604 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6997859e-b544-4c37-a8ad-9c6a2f3db3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:06.457448 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b2d0b-7ee7-42c1-adf0-588384e4813c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:06.459358 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b2d0b-7ee7-42c1-adf0-588384e4813c service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:06.459512 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1693/3412] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:48:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:06.463355 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997859e-b544-4c37-a8ad-9c6a2f3db3bf None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:06.476016 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997859e-b544-4c37-a8ad-9c6a2f3db3bf None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:06.484866 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1720/3413] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:48:05 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:48:06.485009 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f46db8-640e-4da2-a41e-709969d5d68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:06.486134 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f46db8-640e-4da2-a41e-709969d5d68d admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:06.486582 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f46db8-640e-4da2-a41e-709969d5d68d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:06.486857 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f46db8-640e-4da2-a41e-709969d5d68d admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:06.487609 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f46db8-640e-4da2-a41e-709969d5d68d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:48:06.487972 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f46db8-640e-4da2-a41e-709969d5d68d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:06.489658 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f46db8-640e-4da2-a41e-709969d5d68d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:06.533465 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1694/3414] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:48:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:48:06.538146 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b2d0b-7ee7-42c1-adf0-588384e4813c service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:06.559003 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b2d0b-7ee7-42c1-adf0-588384e4813c service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:06.572719 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5400ed-87db-416a-882f-9fd622895821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:06.573354 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5400ed-87db-416a-882f-9fd622895821 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:06.583046 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5400ed-87db-416a-882f-9fd622895821 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:06.583046 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5400ed-87db-416a-882f-9fd622895821 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:06.583046 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5400ed-87db-416a-882f-9fd622895821 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:06.583046 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5400ed-87db-416a-882f-9fd622895821 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:06.614372 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:06.667822 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1721/3415] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:48:06 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:06.669126 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f46db8-640e-4da2-a41e-709969d5d68d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:06.686664 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f46db8-640e-4da2-a41e-709969d5d68d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:06.858925 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb7933-f95a-4814-a473-55545c09b5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:06.859787 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb7933-f95a-4814-a473-55545c09b5ab admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:06.860067 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb7933-f95a-4814-a473-55545c09b5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:06.860340 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb7933-f95a-4814-a473-55545c09b5ab admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:06.860995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb7933-f95a-4814-a473-55545c09b5ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:06.863005 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb7933-f95a-4814-a473-55545c09b5ab admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:06.899746 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1695/3416] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:48:06 2022] POST /identity/v3/users => generated 293 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:06.900989 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5400ed-87db-416a-882f-9fd622895821 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:06.916828 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5400ed-87db-416a-882f-9fd622895821 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:06.924349 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623f56d-f249-4ab7-9a37-f7c1a927b2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:06.925694 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623f56d-f249-4ab7-9a37-f7c1a927b2a7 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:06.926064 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623f56d-f249-4ab7-9a37-f7c1a927b2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:06.926269 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623f56d-f249-4ab7-9a37-f7c1a927b2a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:06.926945 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8623f56d-f249-4ab7-9a37-f7c1a927b2a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:06.929477 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8623f56d-f249-4ab7-9a37-f7c1a927b2a7 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:06.960707 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb7933-f95a-4814-a473-55545c09b5ab admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:06.973984 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb7933-f95a-4814-a473-55545c09b5ab admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:06.975270 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1722/3417] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:48:06.988893 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351964a-47df-4c30-9427-5bf76a598e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:06.989443 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351964a-47df-4c30-9427-5bf76a598e0d admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:06.989721 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351964a-47df-4c30-9427-5bf76a598e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:06.995163 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351964a-47df-4c30-9427-5bf76a598e0d admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:06.996279 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1351964a-47df-4c30-9427-5bf76a598e0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:06.998013 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1351964a-47df-4c30-9427-5bf76a598e0d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:07.029308 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623f56d-f249-4ab7-9a37-f7c1a927b2a7 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:07.040460 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623f56d-f249-4ab7-9a37-f7c1a927b2a7 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:07.040780 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1696/3418] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:48:07.046708 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f71a5a-6fe6-4ce0-adfe-caccd678a081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:07.047524 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f71a5a-6fe6-4ce0-adfe-caccd678a081 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:07.048399 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f71a5a-6fe6-4ce0-adfe-caccd678a081 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:07.048676 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f71a5a-6fe6-4ce0-adfe-caccd678a081 admin admin] PATH_INFO: `/v3/projects/09841e55e1b145aaae76652d19a35da6/users/023ee959a1ca446fb620544563307863/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:07.067863 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f71a5a-6fe6-4ce0-adfe-caccd678a081 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09841e55e1b145aaae76652d19a35da6, user_id=023ee959a1ca446fb620544563307863, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:07.070814 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f71a5a-6fe6-4ce0-adfe-caccd678a081 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:07.094322 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74c156-c103-4f91-abf8-1ec754333e4f None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:07.095158 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74c156-c103-4f91-abf8-1ec754333e4f None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:07.095517 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74c156-c103-4f91-abf8-1ec754333e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:07.099246 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1723/3419] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:48:07 2022] PUT /identity/v3/projects/09841e55e1b145aaae76652d19a35da6/users/023ee959a1ca446fb620544563307863/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:07.118739 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-5d74c156-c103-4f91-abf8-1ec754333e4f None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:07.120174 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5d74c156-c103-4f91-abf8-1ec754333e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:07.215245 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1697/3420] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:48:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:07.242516 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f71a5a-6fe6-4ce0-adfe-caccd678a081 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:07.246430 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-27f71a5a-6fe6-4ce0-adfe-caccd678a081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:07.332678 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f71a5a-6fe6-4ce0-adfe-caccd678a081 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:07.338026 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256a463-2aff-402b-8861-cb4c3a31469e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:07.351052 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256a463-2aff-402b-8861-cb4c3a31469e service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:07.351052 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256a463-2aff-402b-8861-cb4c3a31469e service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:07.351052 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256a463-2aff-402b-8861-cb4c3a31469e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:07.368387 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c256a463-2aff-402b-8861-cb4c3a31469e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:07.370132 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c256a463-2aff-402b-8861-cb4c3a31469e service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:07.388328 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1724/3421] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:48:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:48:08.071821 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74c156-c103-4f91-abf8-1ec754333e4f None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:08.074445 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5d74c156-c103-4f91-abf8-1ec754333e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:08.087102 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74c156-c103-4f91-abf8-1ec754333e4f None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:08.103134 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c24de-6984-4701-8665-c85a9c24f728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:08.103744 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c24de-6984-4701-8665-c85a9c24f728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:08.104026 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c24de-6984-4701-8665-c85a9c24f728 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:08.104310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c24de-6984-4701-8665-c85a9c24f728 admin admin] PATH_INFO: `/v3/users/4b32312a6f064e4b95249481ff6cd530` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:08.107658 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45c24de-6984-4701-8665-c85a9c24f728 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b32312a6f064e4b95249481ff6cd530)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:08.114402 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45c24de-6984-4701-8665-c85a9c24f728 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:08.122520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:08.267404 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d45c24de-6984-4701-8665-c85a9c24f728 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b32312a6f064e4b95249481ff6cd530'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:08.268447 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d45c24de-6984-4701-8665-c85a9c24f728 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b32312a6f064e4b95249481ff6cd530'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:08.280372 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d45c24de-6984-4701-8665-c85a9c24f728 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b32312a6f064e4b95249481ff6cd530'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:08.293355 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d45c24de-6984-4701-8665-c85a9c24f728 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b32312a6f064e4b95249481ff6cd530'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:08.295324 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d45c24de-6984-4701-8665-c85a9c24f728 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b32312a6f064e4b95249481ff6cd530'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:08.320038 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1698/3422] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:48:08 2022] DELETE /identity/v3/users/4b32312a6f064e4b95249481ff6cd530 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:08.792054 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256a463-2aff-402b-8861-cb4c3a31469e service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:08.822181 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256a463-2aff-402b-8861-cb4c3a31469e service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:09.049403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e5a1c-fe2d-42aa-9e8f-c385e507005a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:09.053815 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e5a1c-fe2d-42aa-9e8f-c385e507005a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:09.054258 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e5a1c-fe2d-42aa-9e8f-c385e507005a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:09.054789 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e5a1c-fe2d-42aa-9e8f-c385e507005a admin admin] PATH_INFO: `/v3/projects/3934ada7361e4c729ac47f2288234d80` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:09.060350 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69e5a1c-fe2d-42aa-9e8f-c385e507005a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3934ada7361e4c729ac47f2288234d80)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:09.068012 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69e5a1c-fe2d-42aa-9e8f-c385e507005a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:09.172006 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a69e5a1c-fe2d-42aa-9e8f-c385e507005a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3934ada7361e4c729ac47f2288234d80', 'request_id': 'req-a69e5a1c-fe2d-42aa-9e8f-c385e507005a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:09.179446 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a69e5a1c-fe2d-42aa-9e8f-c385e507005a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3934ada7361e4c729ac47f2288234d80', 'request_id': 'req-a69e5a1c-fe2d-42aa-9e8f-c385e507005a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:09.182716 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:09.189686 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a69e5a1c-fe2d-42aa-9e8f-c385e507005a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3934ada7361e4c729ac47f2288234d80', 'request_id': 'req-a69e5a1c-fe2d-42aa-9e8f-c385e507005a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:09.218563 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a69e5a1c-fe2d-42aa-9e8f-c385e507005a admin admin] The token cache is being invalidate because project 3934ada7361e4c729ac47f2288234d80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:48:09.218864 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a69e5a1c-fe2d-42aa-9e8f-c385e507005a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:09.219659 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a69e5a1c-fe2d-42aa-9e8f-c385e507005a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:09.225084 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1725/3423] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:08 2022] DELETE /identity/v3/projects/3934ada7361e4c729ac47f2288234d80 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:09.226740 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c24de-6984-4701-8665-c85a9c24f728 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:09.228869 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d45c24de-6984-4701-8665-c85a9c24f728 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:09.260648 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c24de-6984-4701-8665-c85a9c24f728 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:09.403567 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1336354b-8313-42f5-953d-c0144553bf7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:09.405654 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336354b-8313-42f5-953d-c0144553bf7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:09.406154 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336354b-8313-42f5-953d-c0144553bf7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:09.407365 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336354b-8313-42f5-953d-c0144553bf7c admin admin] PATH_INFO: `/v3/users/89285e448a144b8c847a8c104a6f4755` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:09.410249 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1336354b-8313-42f5-953d-c0144553bf7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=89285e448a144b8c847a8c104a6f4755)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:09.412787 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1336354b-8313-42f5-953d-c0144553bf7c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:09.525478 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1336354b-8313-42f5-953d-c0144553bf7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89285e448a144b8c847a8c104a6f4755'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:09.527503 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1336354b-8313-42f5-953d-c0144553bf7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89285e448a144b8c847a8c104a6f4755'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:09.550285 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1336354b-8313-42f5-953d-c0144553bf7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89285e448a144b8c847a8c104a6f4755'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:09.576995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1336354b-8313-42f5-953d-c0144553bf7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89285e448a144b8c847a8c104a6f4755'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:09.578185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1336354b-8313-42f5-953d-c0144553bf7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89285e448a144b8c847a8c104a6f4755'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:09.606884 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:09.621607 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1699/3424] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:48:09 2022] DELETE /identity/v3/users/89285e448a144b8c847a8c104a6f4755 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:10.118310 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e5a1c-fe2d-42aa-9e8f-c385e507005a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:10.119846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a69e5a1c-fe2d-42aa-9e8f-c385e507005a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:10.184072 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e5a1c-fe2d-42aa-9e8f-c385e507005a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:10.348781 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f7108-9008-4b5e-9dc5-4950e1e36e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:10.349536 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f7108-9008-4b5e-9dc5-4950e1e36e84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:10.351127 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f7108-9008-4b5e-9dc5-4950e1e36e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:10.351421 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f7108-9008-4b5e-9dc5-4950e1e36e84 admin admin] PATH_INFO: `/v3/projects/83e999a326324ed98b089b62ad99bd8b` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:10.353989 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f7108-9008-4b5e-9dc5-4950e1e36e84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83e999a326324ed98b089b62ad99bd8b)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:10.360844 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f7108-9008-4b5e-9dc5-4950e1e36e84 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:10.482936 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8e6f7108-9008-4b5e-9dc5-4950e1e36e84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83e999a326324ed98b089b62ad99bd8b', 'request_id': 'req-8e6f7108-9008-4b5e-9dc5-4950e1e36e84'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:10.511001 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8e6f7108-9008-4b5e-9dc5-4950e1e36e84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83e999a326324ed98b089b62ad99bd8b', 'request_id': 'req-8e6f7108-9008-4b5e-9dc5-4950e1e36e84'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:10.529733 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8e6f7108-9008-4b5e-9dc5-4950e1e36e84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83e999a326324ed98b089b62ad99bd8b', 'request_id': 'req-8e6f7108-9008-4b5e-9dc5-4950e1e36e84'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:10.546217 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8e6f7108-9008-4b5e-9dc5-4950e1e36e84 admin admin] The token cache is being invalidate because project 83e999a326324ed98b089b62ad99bd8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:48:10.546728 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8e6f7108-9008-4b5e-9dc5-4950e1e36e84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:10.547717 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8e6f7108-9008-4b5e-9dc5-4950e1e36e84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:10.553429 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1726/3425] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:10 2022] DELETE /identity/v3/projects/83e999a326324ed98b089b62ad99bd8b => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:10.555647 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157c318-b5e7-4b7b-b5bb-f3c4b1248e6d None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:10.556136 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157c318-b5e7-4b7b-b5bb-f3c4b1248e6d None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:10.556385 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157c318-b5e7-4b7b-b5bb-f3c4b1248e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:10.619015 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a157c318-b5e7-4b7b-b5bb-f3c4b1248e6d None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:10.622324 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a157c318-b5e7-4b7b-b5bb-f3c4b1248e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:10.784568 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1700/3426] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:48:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:10.795609 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335194e8-bb79-4eec-a0bb-260348f82f0f None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:10.796484 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335194e8-bb79-4eec-a0bb-260348f82f0f None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:10.796970 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335194e8-bb79-4eec-a0bb-260348f82f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:10.839569 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-335194e8-bb79-4eec-a0bb-260348f82f0f None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:10.841147 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-335194e8-bb79-4eec-a0bb-260348f82f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:10.853083 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1727/3427] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:48:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:10.857832 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157c318-b5e7-4b7b-b5bb-f3c4b1248e6d None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:10.876134 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157c318-b5e7-4b7b-b5bb-f3c4b1248e6d None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:10.883283 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a93b3-e613-4c9c-b6a0-9cc628eecb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:10.884319 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a93b3-e613-4c9c-b6a0-9cc628eecb96 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:10.884804 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a93b3-e613-4c9c-b6a0-9cc628eecb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:10.885363 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a93b3-e613-4c9c-b6a0-9cc628eecb96 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:10.886582 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103a93b3-e613-4c9c-b6a0-9cc628eecb96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:48:10.887200 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103a93b3-e613-4c9c-b6a0-9cc628eecb96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:10.889584 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103a93b3-e613-4c9c-b6a0-9cc628eecb96 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:10.909304 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1701/3428] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:48:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:48:10.913677 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335194e8-bb79-4eec-a0bb-260348f82f0f None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:10.925193 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335194e8-bb79-4eec-a0bb-260348f82f0f None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:10.947828 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc357043-b04e-4e68-9b48-1e0ec5e9084e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:10.951107 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc357043-b04e-4e68-9b48-1e0ec5e9084e admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:10.951522 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc357043-b04e-4e68-9b48-1e0ec5e9084e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:10.951815 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc357043-b04e-4e68-9b48-1e0ec5e9084e admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:10.952593 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc357043-b04e-4e68-9b48-1e0ec5e9084e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:10.954537 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc357043-b04e-4e68-9b48-1e0ec5e9084e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:11.088781 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1728/3429] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:48:10 2022] POST /identity/v3/projects => generated 369 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:11.090056 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a93b3-e613-4c9c-b6a0-9cc628eecb96 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:11.100499 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a93b3-e613-4c9c-b6a0-9cc628eecb96 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:11.196995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd7c70-5d99-4f82-acc7-a92ff12aaade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:11.212020 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd7c70-5d99-4f82-acc7-a92ff12aaade admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:11.212387 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd7c70-5d99-4f82-acc7-a92ff12aaade admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:11.212739 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd7c70-5d99-4f82-acc7-a92ff12aaade admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:11.213522 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd7c70-5d99-4f82-acc7-a92ff12aaade admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:11.216557 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd7c70-5d99-4f82-acc7-a92ff12aaade admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:11.250545 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1702/3430] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:48:11 2022] POST /identity/v3/users => generated 285 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:11.251500 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc357043-b04e-4e68-9b48-1e0ec5e9084e admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:11.282335 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc357043-b04e-4e68-9b48-1e0ec5e9084e admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:11.297983 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b250f2-429f-4c18-a4e3-70e0f4efa086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:11.298626 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b250f2-429f-4c18-a4e3-70e0f4efa086 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:11.298938 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b250f2-429f-4c18-a4e3-70e0f4efa086 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:11.299276 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b250f2-429f-4c18-a4e3-70e0f4efa086 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:11.300196 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b250f2-429f-4c18-a4e3-70e0f4efa086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:11.317854 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b250f2-429f-4c18-a4e3-70e0f4efa086 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:11.335533 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1729/3431] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:48:11.337648 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd7c70-5d99-4f82-acc7-a92ff12aaade admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:11.352159 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd7c70-5d99-4f82-acc7-a92ff12aaade admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:11.374021 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4214907d-5b7f-493e-afcc-a5509fc71031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:11.374900 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214907d-5b7f-493e-afcc-a5509fc71031 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:11.375244 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214907d-5b7f-493e-afcc-a5509fc71031 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:11.375522 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214907d-5b7f-493e-afcc-a5509fc71031 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:11.377527 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4214907d-5b7f-493e-afcc-a5509fc71031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:11.380010 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4214907d-5b7f-493e-afcc-a5509fc71031 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:11.399072 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1703/3432] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:48:11.402915 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b250f2-429f-4c18-a4e3-70e0f4efa086 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:11.414758 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b250f2-429f-4c18-a4e3-70e0f4efa086 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:11.421684 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bbbfcb-5138-4a15-a7d8-ef495fcb3e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:11.422364 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbbfcb-5138-4a15-a7d8-ef495fcb3e14 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:11.422637 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbbfcb-5138-4a15-a7d8-ef495fcb3e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:11.423107 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbbfcb-5138-4a15-a7d8-ef495fcb3e14 admin admin] PATH_INFO: `/v3/projects/bb7c04ac8b544f4c89e51cf927bf6e25/users/71e0809663664b319388bcc890b6fdec/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:11.445362 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bbbfcb-5138-4a15-a7d8-ef495fcb3e14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb7c04ac8b544f4c89e51cf927bf6e25, user_id=71e0809663664b319388bcc890b6fdec, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:11.449340 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bbbfcb-5138-4a15-a7d8-ef495fcb3e14 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:11.472261 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1730/3433] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:48:11 2022] PUT /identity/v3/projects/bb7c04ac8b544f4c89e51cf927bf6e25/users/71e0809663664b319388bcc890b6fdec/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:11.477739 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbfa795-220e-4191-8d19-288c48cfdd20 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:11.478037 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbfa795-220e-4191-8d19-288c48cfdd20 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:11.478303 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbfa795-220e-4191-8d19-288c48cfdd20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:11.515496 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-edbfa795-220e-4191-8d19-288c48cfdd20 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:11.516970 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-edbfa795-220e-4191-8d19-288c48cfdd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:11.616311 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1704/3434] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:48:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:11.633993 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bbbfcb-5138-4a15-a7d8-ef495fcb3e14 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:11.636444 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-53bbbfcb-5138-4a15-a7d8-ef495fcb3e14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:11.670489 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:11.791340 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bbbfcb-5138-4a15-a7d8-ef495fcb3e14 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:11.800979 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd738b1-043f-4778-a56c-5546a667337f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:11.802193 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd738b1-043f-4778-a56c-5546a667337f service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:11.802475 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd738b1-043f-4778-a56c-5546a667337f service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:11.802751 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd738b1-043f-4778-a56c-5546a667337f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:11.833384 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd738b1-043f-4778-a56c-5546a667337f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:11.837775 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd738b1-043f-4778-a56c-5546a667337f service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:11.866883 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1731/3435] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:48:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:48:15.466966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbfa795-220e-4191-8d19-288c48cfdd20 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:15.468529 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-edbfa795-220e-4191-8d19-288c48cfdd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:15.492094 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbfa795-220e-4191-8d19-288c48cfdd20 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:15.497679 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f65629-d641-4830-a0fb-c2239dae94ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:15.498622 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f65629-d641-4830-a0fb-c2239dae94ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:15.499171 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f65629-d641-4830-a0fb-c2239dae94ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:15.499636 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f65629-d641-4830-a0fb-c2239dae94ac admin admin] PATH_INFO: `/v3/users/59d14bdc698a4695a5905f38dd21937d` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:15.501333 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f65629-d641-4830-a0fb-c2239dae94ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=59d14bdc698a4695a5905f38dd21937d)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:15.503793 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f65629-d641-4830-a0fb-c2239dae94ac admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:15.506368 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:15.671567 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-16f65629-d641-4830-a0fb-c2239dae94ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59d14bdc698a4695a5905f38dd21937d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:15.672500 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-16f65629-d641-4830-a0fb-c2239dae94ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59d14bdc698a4695a5905f38dd21937d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:15.686148 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-16f65629-d641-4830-a0fb-c2239dae94ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59d14bdc698a4695a5905f38dd21937d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:15.713797 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-16f65629-d641-4830-a0fb-c2239dae94ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59d14bdc698a4695a5905f38dd21937d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:15.715730 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-16f65629-d641-4830-a0fb-c2239dae94ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59d14bdc698a4695a5905f38dd21937d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:15.756878 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1705/3436] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:48:15 2022] DELETE /identity/v3/users/59d14bdc698a4695a5905f38dd21937d => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:16.794931 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd738b1-043f-4778-a56c-5546a667337f service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:16.829269 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd738b1-043f-4778-a56c-5546a667337f service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:16.948982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345aecac-1029-4da1-b6fb-f9bcddb44276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:16.950082 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345aecac-1029-4da1-b6fb-f9bcddb44276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:16.951924 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345aecac-1029-4da1-b6fb-f9bcddb44276 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:16.952530 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345aecac-1029-4da1-b6fb-f9bcddb44276 admin admin] PATH_INFO: `/v3/projects/774de53546094c33a65521de121366e7` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:16.956555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345aecac-1029-4da1-b6fb-f9bcddb44276 admin admin] RBAC: Authorizing `identity:delete_project(project_id=774de53546094c33a65521de121366e7)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:16.967486 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345aecac-1029-4da1-b6fb-f9bcddb44276 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:17.087837 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-345aecac-1029-4da1-b6fb-f9bcddb44276 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '774de53546094c33a65521de121366e7', 'request_id': 'req-345aecac-1029-4da1-b6fb-f9bcddb44276'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:17.103899 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-345aecac-1029-4da1-b6fb-f9bcddb44276 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '774de53546094c33a65521de121366e7', 'request_id': 'req-345aecac-1029-4da1-b6fb-f9bcddb44276'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:17.118129 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-345aecac-1029-4da1-b6fb-f9bcddb44276 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '774de53546094c33a65521de121366e7', 'request_id': 'req-345aecac-1029-4da1-b6fb-f9bcddb44276'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:17.145419 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-345aecac-1029-4da1-b6fb-f9bcddb44276 admin admin] The token cache is being invalidate because project 774de53546094c33a65521de121366e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:48:17.145724 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-345aecac-1029-4da1-b6fb-f9bcddb44276 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:17.147596 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-345aecac-1029-4da1-b6fb-f9bcddb44276 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:17.154347 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1732/3437] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:16 2022] DELETE /identity/v3/projects/774de53546094c33a65521de121366e7 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:17.159551 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d19f8-71c9-473d-9d03-95c4b1f04877 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:17.160016 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d19f8-71c9-473d-9d03-95c4b1f04877 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:17.161336 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d19f8-71c9-473d-9d03-95c4b1f04877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:17.211801 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-399d19f8-71c9-473d-9d03-95c4b1f04877 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:17.213174 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-399d19f8-71c9-473d-9d03-95c4b1f04877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:17.379346 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6f186-67ad-4779-8b1f-00634a0fa5f1 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:17.379623 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6f186-67ad-4779-8b1f-00634a0fa5f1 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:17.379899 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6f186-67ad-4779-8b1f-00634a0fa5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:17.383373 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1706/3438] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:48:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:17.409840 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-62d6f186-67ad-4779-8b1f-00634a0fa5f1 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:17.411954 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-62d6f186-67ad-4779-8b1f-00634a0fa5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:17.421928 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1733/3439] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:48:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:17.426748 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d19f8-71c9-473d-9d03-95c4b1f04877 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:17.440073 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d19f8-71c9-473d-9d03-95c4b1f04877 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:17.446680 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f15ca-52cf-456c-959f-7731bc40fa50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:17.447365 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f15ca-52cf-456c-959f-7731bc40fa50 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:17.447646 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f15ca-52cf-456c-959f-7731bc40fa50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:17.447920 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f15ca-52cf-456c-959f-7731bc40fa50 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:17.448920 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f15ca-52cf-456c-959f-7731bc40fa50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:48:17.449427 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f15ca-52cf-456c-959f-7731bc40fa50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:17.451251 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f15ca-52cf-456c-959f-7731bc40fa50 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:17.496093 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1707/3440] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:48:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:48:17.500722 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d6f186-67ad-4779-8b1f-00634a0fa5f1 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:17.516214 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d6f186-67ad-4779-8b1f-00634a0fa5f1 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:17.528357 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3facb8f-9ed3-4f51-8f97-3e30bb3d7063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:17.530493 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3facb8f-9ed3-4f51-8f97-3e30bb3d7063 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:17.532142 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3facb8f-9ed3-4f51-8f97-3e30bb3d7063 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:17.532659 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3facb8f-9ed3-4f51-8f97-3e30bb3d7063 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:17.534272 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3facb8f-9ed3-4f51-8f97-3e30bb3d7063 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:17.539544 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3facb8f-9ed3-4f51-8f97-3e30bb3d7063 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:17.617919 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1734/3441] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:48:17 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:17.619464 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f15ca-52cf-456c-959f-7731bc40fa50 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:17.637025 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f15ca-52cf-456c-959f-7731bc40fa50 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:17.792950 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9e5bf-9d17-45ae-824d-6b636909fd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:17.793717 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9e5bf-9d17-45ae-824d-6b636909fd0a admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:17.793992 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9e5bf-9d17-45ae-824d-6b636909fd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:17.795057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9e5bf-9d17-45ae-824d-6b636909fd0a admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:17.795856 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc9e5bf-9d17-45ae-824d-6b636909fd0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:17.798084 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc9e5bf-9d17-45ae-824d-6b636909fd0a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:17.817733 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:17.843935 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1708/3442] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:48:17 2022] POST /identity/v3/users => generated 292 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:17.847977 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3facb8f-9ed3-4f51-8f97-3e30bb3d7063 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:17.865949 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3facb8f-9ed3-4f51-8f97-3e30bb3d7063 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:17.873803 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe0cffe-6e63-49ac-89ee-a0379d350b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:17.874711 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0cffe-6e63-49ac-89ee-a0379d350b8e admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:17.875197 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0cffe-6e63-49ac-89ee-a0379d350b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:17.875816 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0cffe-6e63-49ac-89ee-a0379d350b8e admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:17.877008 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe0cffe-6e63-49ac-89ee-a0379d350b8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:17.879848 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe0cffe-6e63-49ac-89ee-a0379d350b8e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:17.896082 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1735/3443] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:48:17 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:48:17.900975 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9e5bf-9d17-45ae-824d-6b636909fd0a admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:17.915212 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9e5bf-9d17-45ae-824d-6b636909fd0a admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:17.922515 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb3c00-895b-45cc-9541-f32682eef464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:17.923464 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb3c00-895b-45cc-9541-f32682eef464 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:17.923743 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb3c00-895b-45cc-9541-f32682eef464 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:17.924013 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb3c00-895b-45cc-9541-f32682eef464 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:17.925131 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb3c00-895b-45cc-9541-f32682eef464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:17.926836 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb3c00-895b-45cc-9541-f32682eef464 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:17.948820 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1709/3444] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:48:17 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:48:17.950845 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe0cffe-6e63-49ac-89ee-a0379d350b8e admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:17.969204 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe0cffe-6e63-49ac-89ee-a0379d350b8e admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:17.985837 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051bf12-08b8-4133-bc7f-5ea7cf29adbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:17.986906 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051bf12-08b8-4133-bc7f-5ea7cf29adbe admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:17.987375 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051bf12-08b8-4133-bc7f-5ea7cf29adbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:17.987803 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051bf12-08b8-4133-bc7f-5ea7cf29adbe admin admin] PATH_INFO: `/v3/projects/d8c72636d6db42cfb42f0c535863a4b2/users/1ada57c2de1f4c1f90d6f8173289bbb1/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:17.994140 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:18.018835 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7051bf12-08b8-4133-bc7f-5ea7cf29adbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8c72636d6db42cfb42f0c535863a4b2, user_id=1ada57c2de1f4c1f90d6f8173289bbb1, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:18.031242 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7051bf12-08b8-4133-bc7f-5ea7cf29adbe admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:18.063698 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f979d5-2131-4cf5-bf7b-3972c9035c61 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:18.063932 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1736/3445] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:48:17 2022] PUT /identity/v3/projects/d8c72636d6db42cfb42f0c535863a4b2/users/1ada57c2de1f4c1f90d6f8173289bbb1/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:18.064038 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f979d5-2131-4cf5-bf7b-3972c9035c61 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:18.064232 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f979d5-2131-4cf5-bf7b-3972c9035c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:18.152607 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-22f979d5-2131-4cf5-bf7b-3972c9035c61 None None] MFA Rules not processed for user `1ada57c2de1f4c1f90d6f8173289bbb1`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:18.156009 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-22f979d5-2131-4cf5-bf7b-3972c9035c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:18.362328 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1710/3446] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:48:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:48:18.449125 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f30304-d9be-44b4-a74f-68e386ee0006 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:18.449794 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f30304-d9be-44b4-a74f-68e386ee0006 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:18.450406 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f30304-d9be-44b4-a74f-68e386ee0006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:18.490007 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-f2f30304-d9be-44b4-a74f-68e386ee0006 None None] MFA Rules not processed for user `1ada57c2de1f4c1f90d6f8173289bbb1`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:18.492151 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f2f30304-d9be-44b4-a74f-68e386ee0006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:18.512069 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1737/3447] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:48:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:18.696623 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f979d5-2131-4cf5-bf7b-3972c9035c61 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:18.699314 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-22f979d5-2131-4cf5-bf7b-3972c9035c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:18.718100 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fa4e0-9626-459c-b056-cca5ce5a0e04 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:18.718617 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fa4e0-9626-459c-b056-cca5ce5a0e04 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:18.719087 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fa4e0-9626-459c-b056-cca5ce5a0e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:18.770135 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-151fa4e0-9626-459c-b056-cca5ce5a0e04 None None] MFA Rules not processed for user `023ee959a1ca446fb620544563307863`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:18.772193 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-151fa4e0-9626-459c-b056-cca5ce5a0e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:18.864835 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f979d5-2131-4cf5-bf7b-3972c9035c61 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:18.878718 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac1b88-1c1f-4b90-9132-4521b49a8170 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:18.879380 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac1b88-1c1f-4b90-9132-4521b49a8170 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:18.879660 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac1b88-1c1f-4b90-9132-4521b49a8170 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:18.879933 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac1b88-1c1f-4b90-9132-4521b49a8170 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:18.902558 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ac1b88-1c1f-4b90-9132-4521b49a8170 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:18.904350 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ac1b88-1c1f-4b90-9132-4521b49a8170 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:18.916032 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1738/3448] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:48:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:48:18.929002 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1711/3449] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:48:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:48:19.024860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fa4e0-9626-459c-b056-cca5ce5a0e04 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:19.026243 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-151fa4e0-9626-459c-b056-cca5ce5a0e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:19.054738 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fa4e0-9626-459c-b056-cca5ce5a0e04 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:19.063654 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f94f9-e78e-45d0-8458-ba4722d205e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:19.064370 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f94f9-e78e-45d0-8458-ba4722d205e4 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:19.064915 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f94f9-e78e-45d0-8458-ba4722d205e4 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:19.065369 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f94f9-e78e-45d0-8458-ba4722d205e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:19.080020 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772f94f9-e78e-45d0-8458-ba4722d205e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:19.083603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772f94f9-e78e-45d0-8458-ba4722d205e4 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:19.096964 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1739/3450] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:48:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:48:19.666949 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac1b88-1c1f-4b90-9132-4521b49a8170 service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:19.668962 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a9ac1b88-1c1f-4b90-9132-4521b49a8170 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:19.773831 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:19.805390 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac1b88-1c1f-4b90-9132-4521b49a8170 service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:19.818783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8718be-e6d0-4937-abf9-fe4c362b80c1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:19.820195 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8718be-e6d0-4937-abf9-fe4c362b80c1 service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:19.821675 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8718be-e6d0-4937-abf9-fe4c362b80c1 service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:19.822325 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8718be-e6d0-4937-abf9-fe4c362b80c1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:19.829006 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2f8718be-e6d0-4937-abf9-fe4c362b80c1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:19.889592 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8718be-e6d0-4937-abf9-fe4c362b80c1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:19.891245 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8718be-e6d0-4937-abf9-fe4c362b80c1 service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:19.922385 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1712/3451] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:48:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:48:23.680982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f94f9-e78e-45d0-8458-ba4722d205e4 service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:23.716891 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f94f9-e78e-45d0-8458-ba4722d205e4 service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:23.745164 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2e465-a04a-4854-ad8c-a6d2d83dc38c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:23.746125 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2e465-a04a-4854-ad8c-a6d2d83dc38c service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:23.747062 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2e465-a04a-4854-ad8c-a6d2d83dc38c service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:23.747498 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2e465-a04a-4854-ad8c-a6d2d83dc38c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:23.749681 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-57a2e465-a04a-4854-ad8c-a6d2d83dc38c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:23.805065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a2e465-a04a-4854-ad8c-a6d2d83dc38c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:23.806875 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a2e465-a04a-4854-ad8c-a6d2d83dc38c service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:23.852146 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1740/3452] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:48:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:48:24.473071 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c20b0e-45af-4baa-8917-f58b633791dc None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:24.473992 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c20b0e-45af-4baa-8917-f58b633791dc None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:24.474491 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c20b0e-45af-4baa-8917-f58b633791dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:24.529931 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-94c20b0e-45af-4baa-8917-f58b633791dc None None] MFA Rules not processed for user `71e0809663664b319388bcc890b6fdec`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:24.541543 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-94c20b0e-45af-4baa-8917-f58b633791dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:24.769909 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1713/3453] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:48:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:24.770265 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2e465-a04a-4854-ad8c-a6d2d83dc38c service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:24.771754 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-57a2e465-a04a-4854-ad8c-a6d2d83dc38c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:24.835660 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812193eb-7db3-4e77-ad0c-81559869f59c None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:24.836356 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812193eb-7db3-4e77-ad0c-81559869f59c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:24.836823 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812193eb-7db3-4e77-ad0c-81559869f59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:24.884763 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-812193eb-7db3-4e77-ad0c-81559869f59c None None] MFA Rules not processed for user `023ee959a1ca446fb620544563307863`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:24.887137 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-812193eb-7db3-4e77-ad0c-81559869f59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:24.919495 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1714/3454] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:48:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:48:24.942157 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2e465-a04a-4854-ad8c-a6d2d83dc38c service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:24.951320 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7887d5f-5825-4b76-99a8-9a3386823d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:24.952796 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7887d5f-5825-4b76-99a8-9a3386823d2f admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:24.953265 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7887d5f-5825-4b76-99a8-9a3386823d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:24.954784 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7887d5f-5825-4b76-99a8-9a3386823d2f admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:24.955814 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7887d5f-5825-4b76-99a8-9a3386823d2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:24.960597 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7887d5f-5825-4b76-99a8-9a3386823d2f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:25.033722 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1741/3455] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:48:24 2022] POST /identity/v3/projects => generated 371 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:25.040197 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812193eb-7db3-4e77-ad0c-81559869f59c None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:25.056747 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812193eb-7db3-4e77-ad0c-81559869f59c None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:25.144082 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2565f3-e6b0-4214-a255-d35669604f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:25.145010 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2565f3-e6b0-4214-a255-d35669604f49 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:25.145524 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2565f3-e6b0-4214-a255-d35669604f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:25.145962 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2565f3-e6b0-4214-a255-d35669604f49 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:25.147616 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2565f3-e6b0-4214-a255-d35669604f49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:25.149972 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2565f3-e6b0-4214-a255-d35669604f49 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:25.195123 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1715/3456] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:48:25 2022] POST /identity/v3/users => generated 292 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:25.202476 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7887d5f-5825-4b76-99a8-9a3386823d2f admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:25.214333 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7887d5f-5825-4b76-99a8-9a3386823d2f admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:25.223740 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6444da-5c51-44cc-a635-e31cb586ab1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:25.224475 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6444da-5c51-44cc-a635-e31cb586ab1b admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:25.224778 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6444da-5c51-44cc-a635-e31cb586ab1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:25.225099 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6444da-5c51-44cc-a635-e31cb586ab1b admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:25.225684 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6444da-5c51-44cc-a635-e31cb586ab1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:25.231681 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6444da-5c51-44cc-a635-e31cb586ab1b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:25.252561 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2565f3-e6b0-4214-a255-d35669604f49 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:25.260198 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1742/3457] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:48:25.267269 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2565f3-e6b0-4214-a255-d35669604f49 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:25.273271 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daad7bcd-0ce8-4041-88a9-bb62397b72ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:25.273961 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad7bcd-0ce8-4041-88a9-bb62397b72ef admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:25.274235 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad7bcd-0ce8-4041-88a9-bb62397b72ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:25.274971 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad7bcd-0ce8-4041-88a9-bb62397b72ef admin admin] PATH_INFO: `/v3/projects/71acbbe4b87e46f8bba366fc1b3de54a/users/8400eaa8f2244744a7884877e577ad02/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:25.362860 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daad7bcd-0ce8-4041-88a9-bb62397b72ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=71acbbe4b87e46f8bba366fc1b3de54a, user_id=8400eaa8f2244744a7884877e577ad02, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:25.368143 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daad7bcd-0ce8-4041-88a9-bb62397b72ef admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:25.412478 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1716/3458] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:48:25 2022] PUT /identity/v3/projects/71acbbe4b87e46f8bba366fc1b3de54a/users/8400eaa8f2244744a7884877e577ad02/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:25.425749 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6444da-5c51-44cc-a635-e31cb586ab1b admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:25.445940 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6444da-5c51-44cc-a635-e31cb586ab1b admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:25.476195 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:25.626364 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30225269-9f04-4aee-b6f6-7139bfdaab05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:25.627433 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30225269-9f04-4aee-b6f6-7139bfdaab05 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:25.627895 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30225269-9f04-4aee-b6f6-7139bfdaab05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:25.628608 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30225269-9f04-4aee-b6f6-7139bfdaab05 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:25.629592 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30225269-9f04-4aee-b6f6-7139bfdaab05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:25.631614 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30225269-9f04-4aee-b6f6-7139bfdaab05 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:25.657137 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1743/3459] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:48:25.659039 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daad7bcd-0ce8-4041-88a9-bb62397b72ef admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:25.681066 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daad7bcd-0ce8-4041-88a9-bb62397b72ef admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:25.690756 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f47f72-7c32-4ef4-8403-9abbf15614de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:25.692435 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f47f72-7c32-4ef4-8403-9abbf15614de admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:25.692935 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f47f72-7c32-4ef4-8403-9abbf15614de admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:25.693640 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f47f72-7c32-4ef4-8403-9abbf15614de admin admin] PATH_INFO: `/v3/projects/71acbbe4b87e46f8bba366fc1b3de54a/users/8400eaa8f2244744a7884877e577ad02/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:25.703557 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f47f72-7c32-4ef4-8403-9abbf15614de admin admin] RBAC: Authorizing `identity:create_grant(project_id=71acbbe4b87e46f8bba366fc1b3de54a, user_id=8400eaa8f2244744a7884877e577ad02, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:25.711047 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f47f72-7c32-4ef4-8403-9abbf15614de admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:25.733900 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1717/3460] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:48:25 2022] PUT /identity/v3/projects/71acbbe4b87e46f8bba366fc1b3de54a/users/8400eaa8f2244744a7884877e577ad02/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:29.179281 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23226ea5-b079-4905-aa2e-44868baafcc8 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:29.182135 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23226ea5-b079-4905-aa2e-44868baafcc8 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:29.184016 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23226ea5-b079-4905-aa2e-44868baafcc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:29.250679 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-23226ea5-b079-4905-aa2e-44868baafcc8 None None] MFA Rules not processed for user `853f8300f9bb403b9cea4834c5a1edcb`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:29.253989 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-23226ea5-b079-4905-aa2e-44868baafcc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:29.379213 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1744/3461] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:48:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:33.224179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f47f72-7c32-4ef4-8403-9abbf15614de admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:33.227172 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-58f47f72-7c32-4ef4-8403-9abbf15614de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:33.283467 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:33.389317 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f47f72-7c32-4ef4-8403-9abbf15614de admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:33.410596 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce5a14-b1f1-41b3-87c4-63a248219943 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:33.411521 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce5a14-b1f1-41b3-87c4-63a248219943 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:33.413328 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce5a14-b1f1-41b3-87c4-63a248219943 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:33.415639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce5a14-b1f1-41b3-87c4-63a248219943 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:33.419229 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a8ce5a14-b1f1-41b3-87c4-63a248219943 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:33.445101 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ce5a14-b1f1-41b3-87c4-63a248219943 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:33.449282 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ce5a14-b1f1-41b3-87c4-63a248219943 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:33.469747 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1718/3462] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:48:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:48:35.830791 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23226ea5-b079-4905-aa2e-44868baafcc8 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:36.039794 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23226ea5-b079-4905-aa2e-44868baafcc8 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:36.062916 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040177bd-b5cf-4e78-a6d0-ebbbad4b1dae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:36.067836 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040177bd-b5cf-4e78-a6d0-ebbbad4b1dae service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:36.068610 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040177bd-b5cf-4e78-a6d0-ebbbad4b1dae service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:36.069083 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040177bd-b5cf-4e78-a6d0-ebbbad4b1dae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:36.073186 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-040177bd-b5cf-4e78-a6d0-ebbbad4b1dae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:36.125693 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040177bd-b5cf-4e78-a6d0-ebbbad4b1dae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:36.128161 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040177bd-b5cf-4e78-a6d0-ebbbad4b1dae service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:36.163329 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1745/3463] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:48:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:48:37.739147 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce5a14-b1f1-41b3-87c4-63a248219943 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:37.743293 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a8ce5a14-b1f1-41b3-87c4-63a248219943 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:37.828690 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce5a14-b1f1-41b3-87c4-63a248219943 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:37.835579 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcde2e8-6d05-4a92-a773-8a381669695b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:37.836237 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcde2e8-6d05-4a92-a773-8a381669695b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:37.836517 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcde2e8-6d05-4a92-a773-8a381669695b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:37.836939 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcde2e8-6d05-4a92-a773-8a381669695b admin admin] PATH_INFO: `/v3/users/085145c4942d4c889c291a99eb1d009a` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:37.838218 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcde2e8-6d05-4a92-a773-8a381669695b admin admin] RBAC: Authorizing `identity:delete_user(user_id=085145c4942d4c889c291a99eb1d009a)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:37.840841 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcde2e8-6d05-4a92-a773-8a381669695b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:37.909242 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-edcde2e8-6d05-4a92-a773-8a381669695b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '085145c4942d4c889c291a99eb1d009a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:37.910380 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-edcde2e8-6d05-4a92-a773-8a381669695b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '085145c4942d4c889c291a99eb1d009a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:37.921387 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-edcde2e8-6d05-4a92-a773-8a381669695b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '085145c4942d4c889c291a99eb1d009a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:37.931730 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-edcde2e8-6d05-4a92-a773-8a381669695b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '085145c4942d4c889c291a99eb1d009a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:37.933218 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-edcde2e8-6d05-4a92-a773-8a381669695b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '085145c4942d4c889c291a99eb1d009a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:37.975240 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1719/3464] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:48:37 2022] DELETE /identity/v3/users/085145c4942d4c889c291a99eb1d009a => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:38.350050 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040177bd-b5cf-4e78-a6d0-ebbbad4b1dae service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:38.365381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040177bd-b5cf-4e78-a6d0-ebbbad4b1dae service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:38.446367 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcde2e8-6d05-4a92-a773-8a381669695b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:38.449786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-edcde2e8-6d05-4a92-a773-8a381669695b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:38.454662 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:38.482638 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a924d81-845f-42a3-be24-8a5a84821d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:38.483562 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a924d81-845f-42a3-be24-8a5a84821d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:38.484476 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a924d81-845f-42a3-be24-8a5a84821d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:38.484641 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a924d81-845f-42a3-be24-8a5a84821d29 admin admin] PATH_INFO: `/v3/projects/99a31c64e992417d8862b3443fa8c105` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:38.486694 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a924d81-845f-42a3-be24-8a5a84821d29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99a31c64e992417d8862b3443fa8c105)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:38.488942 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a924d81-845f-42a3-be24-8a5a84821d29 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:38.591918 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5a924d81-845f-42a3-be24-8a5a84821d29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99a31c64e992417d8862b3443fa8c105', 'request_id': 'req-5a924d81-845f-42a3-be24-8a5a84821d29'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:38.602689 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5a924d81-845f-42a3-be24-8a5a84821d29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99a31c64e992417d8862b3443fa8c105', 'request_id': 'req-5a924d81-845f-42a3-be24-8a5a84821d29'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:38.617764 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5a924d81-845f-42a3-be24-8a5a84821d29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99a31c64e992417d8862b3443fa8c105', 'request_id': 'req-5a924d81-845f-42a3-be24-8a5a84821d29'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:38.618042 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:38.637924 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5a924d81-845f-42a3-be24-8a5a84821d29 admin admin] The token cache is being invalidate because project 99a31c64e992417d8862b3443fa8c105 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:48:38.639157 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5a924d81-845f-42a3-be24-8a5a84821d29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:38.639973 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5a924d81-845f-42a3-be24-8a5a84821d29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:38.642224 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1746/3465] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:38 2022] DELETE /identity/v3/projects/99a31c64e992417d8862b3443fa8c105 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:38.643780 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e2254-5f52-409d-93a4-97249e14b6a1 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:38.644294 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e2254-5f52-409d-93a4-97249e14b6a1 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:38.644718 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e2254-5f52-409d-93a4-97249e14b6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:38.675189 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcde2e8-6d05-4a92-a773-8a381669695b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:38.691367 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-9f0e2254-5f52-409d-93a4-97249e14b6a1 None None] MFA Rules not processed for user `8400eaa8f2244744a7884877e577ad02`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:38.694644 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9f0e2254-5f52-409d-93a4-97249e14b6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:38.855534 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1747/3466] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:48:38 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:38.858481 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e87bc-9702-429a-b178-711b8a000d93 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:38.859049 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e87bc-9702-429a-b178-711b8a000d93 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:38.861011 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e87bc-9702-429a-b178-711b8a000d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:38.869583 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe93f0f-e380-47eb-99b6-fe2980a6c49f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:38.871593 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe93f0f-e380-47eb-99b6-fe2980a6c49f service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:38.872042 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe93f0f-e380-47eb-99b6-fe2980a6c49f service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:38.872474 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe93f0f-e380-47eb-99b6-fe2980a6c49f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:38.874706 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-fbe93f0f-e380-47eb-99b6-fe2980a6c49f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:38.892763 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe93f0f-e380-47eb-99b6-fe2980a6c49f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:38.894719 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe93f0f-e380-47eb-99b6-fe2980a6c49f service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:38.906341 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-1a4e87bc-9702-429a-b178-711b8a000d93 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:38.908944 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1a4e87bc-9702-429a-b178-711b8a000d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:38.913014 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1720/3467] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:48:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:48:38.916218 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972d3b3-32c7-4666-9d2b-dbee82880558 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:38.917242 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972d3b3-32c7-4666-9d2b-dbee82880558 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:38.919199 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972d3b3-32c7-4666-9d2b-dbee82880558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:38.942486 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-b972d3b3-32c7-4666-9d2b-dbee82880558 None None] MFA Rules not processed for user `71e0809663664b319388bcc890b6fdec`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:38.943993 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b972d3b3-32c7-4666-9d2b-dbee82880558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:39.065037 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:39.093194 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1721/3468] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:48:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:39.095897 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1748/3469] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:48:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:39.096844 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55d6bf-232e-4809-a216-66c57345718b None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:39.097138 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55d6bf-232e-4809-a216-66c57345718b None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:39.097420 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55d6bf-232e-4809-a216-66c57345718b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:39.138398 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-0e55d6bf-232e-4809-a216-66c57345718b None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:39.139792 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0e55d6bf-232e-4809-a216-66c57345718b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:39.153149 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1722/3470] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:48:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:39.157264 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4e87bc-9702-429a-b178-711b8a000d93 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:39.169300 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4e87bc-9702-429a-b178-711b8a000d93 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:39.175603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4508c8cd-af6e-451c-a819-a25b5826ed74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:39.176238 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508c8cd-af6e-451c-a819-a25b5826ed74 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:39.176532 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508c8cd-af6e-451c-a819-a25b5826ed74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:39.176792 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508c8cd-af6e-451c-a819-a25b5826ed74 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:39.177506 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4508c8cd-af6e-451c-a819-a25b5826ed74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:48:39.177813 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4508c8cd-af6e-451c-a819-a25b5826ed74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:39.180225 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4508c8cd-af6e-451c-a819-a25b5826ed74 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:39.200649 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1749/3471] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:48:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:48:39.201391 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55d6bf-232e-4809-a216-66c57345718b None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:39.242056 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55d6bf-232e-4809-a216-66c57345718b None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:39.287754 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a659223a-fe41-4350-bfa7-3e7d80fe5120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:39.288525 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659223a-fe41-4350-bfa7-3e7d80fe5120 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:39.289014 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659223a-fe41-4350-bfa7-3e7d80fe5120 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:39.289460 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659223a-fe41-4350-bfa7-3e7d80fe5120 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:39.290289 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a659223a-fe41-4350-bfa7-3e7d80fe5120 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:39.297171 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a659223a-fe41-4350-bfa7-3e7d80fe5120 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:39.367288 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1723/3472] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:48:39 2022] POST /identity/v3/projects => generated 375 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:48:39.371572 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4508c8cd-af6e-451c-a819-a25b5826ed74 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:39.386966 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4508c8cd-af6e-451c-a819-a25b5826ed74 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:39.511538 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e0dcb9-8ff5-4a75-882f-99bd95a48bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:39.512162 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0dcb9-8ff5-4a75-882f-99bd95a48bd1 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:39.512549 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0dcb9-8ff5-4a75-882f-99bd95a48bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:39.512946 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0dcb9-8ff5-4a75-882f-99bd95a48bd1 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:39.513703 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e0dcb9-8ff5-4a75-882f-99bd95a48bd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:39.517104 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e0dcb9-8ff5-4a75-882f-99bd95a48bd1 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:39.563967 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1750/3473] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:48:39 2022] POST /identity/v3/users => generated 288 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:39.564944 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a659223a-fe41-4350-bfa7-3e7d80fe5120 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:39.579371 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a659223a-fe41-4350-bfa7-3e7d80fe5120 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:39.588310 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e0dcb9-8ff5-4a75-882f-99bd95a48bd1 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:39.590782 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b9e0dcb9-8ff5-4a75-882f-99bd95a48bd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:39.601776 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8ef8b-70fa-42da-8398-58c84037e10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:39.602908 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8ef8b-70fa-42da-8398-58c84037e10b admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:39.603239 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8ef8b-70fa-42da-8398-58c84037e10b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:39.603902 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8ef8b-70fa-42da-8398-58c84037e10b admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:39.605137 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8ef8b-70fa-42da-8398-58c84037e10b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:39.608664 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8ef8b-70fa-42da-8398-58c84037e10b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:39.627498 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1724/3474] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:48:39.631545 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8ef8b-70fa-42da-8398-58c84037e10b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:39.654232 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8ef8b-70fa-42da-8398-58c84037e10b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:39.665194 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad609869-d2d1-4638-8a68-69e27287d1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:39.666124 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad609869-d2d1-4638-8a68-69e27287d1bf admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:39.666927 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad609869-d2d1-4638-8a68-69e27287d1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:39.667861 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad609869-d2d1-4638-8a68-69e27287d1bf admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:39.668816 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad609869-d2d1-4638-8a68-69e27287d1bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:39.671825 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad609869-d2d1-4638-8a68-69e27287d1bf admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:39.694902 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1725/3475] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:48:39.701830 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad609869-d2d1-4638-8a68-69e27287d1bf admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:39.717552 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad609869-d2d1-4638-8a68-69e27287d1bf admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:39.724618 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5870b09e-0a98-46b7-901e-e6ec95ca630f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:39.725151 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870b09e-0a98-46b7-901e-e6ec95ca630f admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:39.725597 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870b09e-0a98-46b7-901e-e6ec95ca630f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:39.725982 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870b09e-0a98-46b7-901e-e6ec95ca630f admin admin] PATH_INFO: `/v3/projects/7ff0e0f8d06044de8b8be818bc760176/users/3fb56832bbeb4a74b67ba0c1f68b3aa6/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:39.760071 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e0dcb9-8ff5-4a75-882f-99bd95a48bd1 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:39.760295 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5870b09e-0a98-46b7-901e-e6ec95ca630f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ff0e0f8d06044de8b8be818bc760176, user_id=3fb56832bbeb4a74b67ba0c1f68b3aa6, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:39.765692 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5870b09e-0a98-46b7-901e-e6ec95ca630f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:39.767413 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2a589-a1c8-4ca1-ab82-780150501750 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:39.768153 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2a589-a1c8-4ca1-ab82-780150501750 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:39.768565 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2a589-a1c8-4ca1-ab82-780150501750 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:39.769227 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2a589-a1c8-4ca1-ab82-780150501750 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:39.771428 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1ee2a589-a1c8-4ca1-ab82-780150501750 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:39.783917 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:39.795395 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1726/3476] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:48:39 2022] PUT /identity/v3/projects/7ff0e0f8d06044de8b8be818bc760176/users/3fb56832bbeb4a74b67ba0c1f68b3aa6/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:39.799968 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67e498-9276-4df9-8ca7-c0f8e965fe0f None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:39.800401 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67e498-9276-4df9-8ca7-c0f8e965fe0f None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:39.800753 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67e498-9276-4df9-8ca7-c0f8e965fe0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:39.825234 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-8c67e498-9276-4df9-8ca7-c0f8e965fe0f None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:39.826894 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8c67e498-9276-4df9-8ca7-c0f8e965fe0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:39.852782 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee2a589-a1c8-4ca1-ab82-780150501750 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:39.854377 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee2a589-a1c8-4ca1-ab82-780150501750 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:39.866005 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1751/3477] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:48:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:48:39.926454 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1727/3478] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:48:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:39.935146 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2a589-a1c8-4ca1-ab82-780150501750 service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:39.937055 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1ee2a589-a1c8-4ca1-ab82-780150501750 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:39.951152 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:40.008628 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2a589-a1c8-4ca1-ab82-780150501750 service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:40.087821 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe61f1-b9f7-48e9-8e64-e43d5188052f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:40.089471 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe61f1-b9f7-48e9-8e64-e43d5188052f service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:40.089914 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe61f1-b9f7-48e9-8e64-e43d5188052f service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:40.090339 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe61f1-b9f7-48e9-8e64-e43d5188052f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:40.123958 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe61f1-b9f7-48e9-8e64-e43d5188052f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:40.126132 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe61f1-b9f7-48e9-8e64-e43d5188052f service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:40.156359 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1752/3479] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:48:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:48:41.606558 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33360b-b51c-428e-adb2-a316ceb71197 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:41.607131 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33360b-b51c-428e-adb2-a316ceb71197 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:41.608025 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33360b-b51c-428e-adb2-a316ceb71197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:41.665310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-aa33360b-b51c-428e-adb2-a316ceb71197 None None] MFA Rules not processed for user `215e000f15f44b41aa38a41a941c16da`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:41.667991 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-aa33360b-b51c-428e-adb2-a316ceb71197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:41.820310 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1728/3480] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:48:41 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:43.954596 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25bca78-b5ac-4d0e-88e3-73c9dd9b5cf3 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:43.955210 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25bca78-b5ac-4d0e-88e3-73c9dd9b5cf3 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:43.955433 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25bca78-b5ac-4d0e-88e3-73c9dd9b5cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:44.037219 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-b25bca78-b5ac-4d0e-88e3-73c9dd9b5cf3 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:44.038819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b25bca78-b5ac-4d0e-88e3-73c9dd9b5cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:44.152327 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1753/3481] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 15:48:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:44.253420 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa33360b-b51c-428e-adb2-a316ceb71197 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:44.255133 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-aa33360b-b51c-428e-adb2-a316ceb71197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:44.643805 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa33360b-b51c-428e-adb2-a316ceb71197 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:44.668712 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d7783-9f61-4298-9e5e-013ddd0aeb26 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:44.675328 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d7783-9f61-4298-9e5e-013ddd0aeb26 service swift] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:44.680027 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d7783-9f61-4298-9e5e-013ddd0aeb26 service swift] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:44.680534 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d7783-9f61-4298-9e5e-013ddd0aeb26 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:44.714956 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d7783-9f61-4298-9e5e-013ddd0aeb26 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:44.720047 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d7783-9f61-4298-9e5e-013ddd0aeb26 service swift] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:44.763458 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1729/3482] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 15:48:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:48:54.149887 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=82 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:54.154807 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25bca78-b5ac-4d0e-88e3-73c9dd9b5cf3 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:54.272282 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25bca78-b5ac-4d0e-88e3-73c9dd9b5cf3 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:54.280984 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06754a5b-8860-4934-8de9-751b53dfaf8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:54.282788 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06754a5b-8860-4934-8de9-751b53dfaf8c service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:54.283254 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06754a5b-8860-4934-8de9-751b53dfaf8c service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:54.283576 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06754a5b-8860-4934-8de9-751b53dfaf8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:54.287255 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-06754a5b-8860-4934-8de9-751b53dfaf8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:54.464125 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06754a5b-8860-4934-8de9-751b53dfaf8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:54.466016 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06754a5b-8860-4934-8de9-751b53dfaf8c service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:54.501965 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1754/3483] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:48:54 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:48:54.752706 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=93 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:55.267042 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d8c02-96b2-4b8a-a8d6-edde3add8e8c None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:55.267335 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d8c02-96b2-4b8a-a8d6-edde3add8e8c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:55.267701 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d8c02-96b2-4b8a-a8d6-edde3add8e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:55.320941 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-9f3d8c02-96b2-4b8a-a8d6-edde3add8e8c None None] MFA Rules not processed for user `3fb56832bbeb4a74b67ba0c1f68b3aa6`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:55.322233 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9f3d8c02-96b2-4b8a-a8d6-edde3add8e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:55.554227 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1730/3484] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:48:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:55.696293 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06754a5b-8860-4934-8de9-751b53dfaf8c service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:55.721828 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06754a5b-8860-4934-8de9-751b53dfaf8c service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:55.727769 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b19ce-2448-4d4a-85f9-8daaf576f602 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:55.728391 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b19ce-2448-4d4a-85f9-8daaf576f602 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:55.728666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b19ce-2448-4d4a-85f9-8daaf576f602 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:55.728962 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b19ce-2448-4d4a-85f9-8daaf576f602 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:55.754189 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b19ce-2448-4d4a-85f9-8daaf576f602 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:55.755986 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b19ce-2448-4d4a-85f9-8daaf576f602 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:55.782930 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1755/3485] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:48:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:48:59.411939 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f9b40-e5d6-4341-a4bf-e9f9046e3001 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:59.412812 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f9b40-e5d6-4341-a4bf-e9f9046e3001 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:59.413268 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f9b40-e5d6-4341-a4bf-e9f9046e3001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:59.459271 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-111f9b40-e5d6-4341-a4bf-e9f9046e3001 None None] MFA Rules not processed for user `3fb56832bbeb4a74b67ba0c1f68b3aa6`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:59.460511 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-111f9b40-e5d6-4341-a4bf-e9f9046e3001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:59.476644 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1731/3486] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:48:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:01.835302 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b19ce-2448-4d4a-85f9-8daaf576f602 service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:01.851854 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b19ce-2448-4d4a-85f9-8daaf576f602 service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:01.860818 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ec8dd-a55a-4b9e-bfb7-097db7472d7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:01.861753 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ec8dd-a55a-4b9e-bfb7-097db7472d7a service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:01.862484 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ec8dd-a55a-4b9e-bfb7-097db7472d7a service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:01.862962 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ec8dd-a55a-4b9e-bfb7-097db7472d7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:01.965540 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ec8dd-a55a-4b9e-bfb7-097db7472d7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:01.968316 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ec8dd-a55a-4b9e-bfb7-097db7472d7a service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:01.997282 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1756/3487] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:01 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:49:03.387696 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f9b40-e5d6-4341-a4bf-e9f9046e3001 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:03.402550 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f9b40-e5d6-4341-a4bf-e9f9046e3001 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:03.413125 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d8f92-5e21-4fc1-bcf2-12eb78ba6d44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:03.413773 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d8f92-5e21-4fc1-bcf2-12eb78ba6d44 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:03.414646 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d8f92-5e21-4fc1-bcf2-12eb78ba6d44 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:03.414926 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d8f92-5e21-4fc1-bcf2-12eb78ba6d44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:03.423482 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-606d8f92-5e21-4fc1-bcf2-12eb78ba6d44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:03.450121 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606d8f92-5e21-4fc1-bcf2-12eb78ba6d44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:03.451629 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606d8f92-5e21-4fc1-bcf2-12eb78ba6d44 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:03.464735 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1732/3488] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:49:05.246847 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ec8dd-a55a-4b9e-bfb7-097db7472d7a service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:05.249321 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-351ec8dd-a55a-4b9e-bfb7-097db7472d7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:05.264755 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ec8dd-a55a-4b9e-bfb7-097db7472d7a service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:05.271963 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7cc6b-e82f-4f46-ab40-bd20ba1abd0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:05.272890 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7cc6b-e82f-4f46-ab40-bd20ba1abd0e service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:05.273372 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7cc6b-e82f-4f46-ab40-bd20ba1abd0e service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:05.273848 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7cc6b-e82f-4f46-ab40-bd20ba1abd0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:05.279423 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e1a7cc6b-e82f-4f46-ab40-bd20ba1abd0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:05.300991 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a7cc6b-e82f-4f46-ab40-bd20ba1abd0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:05.303533 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a7cc6b-e82f-4f46-ab40-bd20ba1abd0e service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:05.321535 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1757/3489] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:49:07.172644 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff0591-835e-47fd-acff-bf3025e37b1b None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:07.173146 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff0591-835e-47fd-acff-bf3025e37b1b None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:07.173261 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff0591-835e-47fd-acff-bf3025e37b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:07.206406 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-27ff0591-835e-47fd-acff-bf3025e37b1b None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:07.208138 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-27ff0591-835e-47fd-acff-bf3025e37b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:07.217693 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1733/3490] 10.222.0.83 () {58 vars in 967 bytes} [Mon Aug 29 15:49:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:07.233497 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7cc6b-e82f-4f46-ab40-bd20ba1abd0e service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:07.243254 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:07.250956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7cc6b-e82f-4f46-ab40-bd20ba1abd0e service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:07.259491 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9882a-13de-48fc-8ad3-5b87de5fa62b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:07.261720 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9882a-13de-48fc-8ad3-5b87de5fa62b service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:07.262269 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9882a-13de-48fc-8ad3-5b87de5fa62b service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:07.262783 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9882a-13de-48fc-8ad3-5b87de5fa62b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:07.292260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf9882a-13de-48fc-8ad3-5b87de5fa62b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:07.294252 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf9882a-13de-48fc-8ad3-5b87de5fa62b service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:07.314831 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1758/3491] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 15:49:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:49:11.047899 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff0591-835e-47fd-acff-bf3025e37b1b None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:11.049593 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-27ff0591-835e-47fd-acff-bf3025e37b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:11.081350 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff0591-835e-47fd-acff-bf3025e37b1b None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:11.093980 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b9684-53dd-4505-9ffc-c25df33ee7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:11.094750 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b9684-53dd-4505-9ffc-c25df33ee7a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:11.095180 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b9684-53dd-4505-9ffc-c25df33ee7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:11.098947 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b9684-53dd-4505-9ffc-c25df33ee7a2 admin admin] PATH_INFO: `/v3/users/5bcbbc66ca5044ea8acda1b137f1d5b3` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:11.100644 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16b9684-53dd-4505-9ffc-c25df33ee7a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bcbbc66ca5044ea8acda1b137f1d5b3)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:11.103242 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16b9684-53dd-4505-9ffc-c25df33ee7a2 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:11.231093 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a16b9684-53dd-4505-9ffc-c25df33ee7a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bcbbc66ca5044ea8acda1b137f1d5b3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:11.231843 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a16b9684-53dd-4505-9ffc-c25df33ee7a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bcbbc66ca5044ea8acda1b137f1d5b3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:11.247549 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a16b9684-53dd-4505-9ffc-c25df33ee7a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bcbbc66ca5044ea8acda1b137f1d5b3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:11.261501 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a16b9684-53dd-4505-9ffc-c25df33ee7a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bcbbc66ca5044ea8acda1b137f1d5b3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:11.263069 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a16b9684-53dd-4505-9ffc-c25df33ee7a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bcbbc66ca5044ea8acda1b137f1d5b3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:11.315407 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1734/3492] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:49:11 2022] DELETE /identity/v3/users/5bcbbc66ca5044ea8acda1b137f1d5b3 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:11.319835 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab0676-19e2-4249-8bbe-8f09c209f83e None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:11.320744 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab0676-19e2-4249-8bbe-8f09c209f83e None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:11.321255 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab0676-19e2-4249-8bbe-8f09c209f83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:11.364261 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-1eab0676-19e2-4249-8bbe-8f09c209f83e None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:11.368155 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1eab0676-19e2-4249-8bbe-8f09c209f83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:11.479679 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1759/3493] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:11.502761 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b9684-53dd-4505-9ffc-c25df33ee7a2 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:11.502761 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a16b9684-53dd-4505-9ffc-c25df33ee7a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:11.590673 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:11.636275 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b9684-53dd-4505-9ffc-c25df33ee7a2 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:11.657289 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4d90f-cffe-48b0-97f1-e311ad2c1cbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:11.660310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4d90f-cffe-48b0-97f1-e311ad2c1cbf service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:11.660676 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4d90f-cffe-48b0-97f1-e311ad2c1cbf service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:11.661025 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4d90f-cffe-48b0-97f1-e311ad2c1cbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:11.686879 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c4d90f-cffe-48b0-97f1-e311ad2c1cbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:11.690150 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c4d90f-cffe-48b0-97f1-e311ad2c1cbf service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:11.719480 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1735/3494] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:49:11.773028 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab0676-19e2-4249-8bbe-8f09c209f83e None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:11.787942 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab0676-19e2-4249-8bbe-8f09c209f83e None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:11.799340 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5364e754-8954-4ce7-93f9-b72277b4302a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:11.800273 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364e754-8954-4ce7-93f9-b72277b4302a service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:11.800754 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364e754-8954-4ce7-93f9-b72277b4302a service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:11.803961 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364e754-8954-4ce7-93f9-b72277b4302a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:11.806757 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5364e754-8954-4ce7-93f9-b72277b4302a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:11.844342 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5364e754-8954-4ce7-93f9-b72277b4302a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:11.846683 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5364e754-8954-4ce7-93f9-b72277b4302a service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:11.861548 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1760/3495] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:49:13.113030 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4d90f-cffe-48b0-97f1-e311ad2c1cbf service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:13.114636 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e8c4d90f-cffe-48b0-97f1-e311ad2c1cbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:13.146026 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4d90f-cffe-48b0-97f1-e311ad2c1cbf service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:13.154104 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ace8c-cce0-48e8-8150-c31ca894bf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:13.155477 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ace8c-cce0-48e8-8150-c31ca894bf5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:13.155930 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ace8c-cce0-48e8-8150-c31ca894bf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:13.156279 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ace8c-cce0-48e8-8150-c31ca894bf5c admin admin] PATH_INFO: `/v3/projects/4914f89b57484044972fa80c6294b3bd` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:13.161995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4ace8c-cce0-48e8-8150-c31ca894bf5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4914f89b57484044972fa80c6294b3bd)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:13.164869 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4ace8c-cce0-48e8-8150-c31ca894bf5c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:13.194530 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9027c4-0b3d-4a2a-8696-520157c7dbbb None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:13.195103 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9027c4-0b3d-4a2a-8696-520157c7dbbb None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:13.195739 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9027c4-0b3d-4a2a-8696-520157c7dbbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:13.229643 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-bb9027c4-0b3d-4a2a-8696-520157c7dbbb None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:13.233070 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-bb9027c4-0b3d-4a2a-8696-520157c7dbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:13.257877 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ac4ace8c-cce0-48e8-8150-c31ca894bf5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4914f89b57484044972fa80c6294b3bd', 'request_id': 'req-ac4ace8c-cce0-48e8-8150-c31ca894bf5c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:13.268227 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ac4ace8c-cce0-48e8-8150-c31ca894bf5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4914f89b57484044972fa80c6294b3bd', 'request_id': 'req-ac4ace8c-cce0-48e8-8150-c31ca894bf5c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:13.278168 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ac4ace8c-cce0-48e8-8150-c31ca894bf5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4914f89b57484044972fa80c6294b3bd', 'request_id': 'req-ac4ace8c-cce0-48e8-8150-c31ca894bf5c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:13.307898 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ac4ace8c-cce0-48e8-8150-c31ca894bf5c admin admin] The token cache is being invalidate because project 4914f89b57484044972fa80c6294b3bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:49:13.308444 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ac4ace8c-cce0-48e8-8150-c31ca894bf5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:13.309858 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ac4ace8c-cce0-48e8-8150-c31ca894bf5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:13.311896 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1736/3496] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:13 2022] DELETE /identity/v3/projects/4914f89b57484044972fa80c6294b3bd => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:13.314065 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1761/3497] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 15:49:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:49:13.317251 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83e50f-bb7e-4e14-b344-7bbb10e4e734 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:13.317785 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83e50f-bb7e-4e14-b344-7bbb10e4e734 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:13.318289 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83e50f-bb7e-4e14-b344-7bbb10e4e734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:13.329658 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9027c4-0b3d-4a2a-8696-520157c7dbbb None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:13.331309 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-bb9027c4-0b3d-4a2a-8696-520157c7dbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:13.348574 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-0d83e50f-bb7e-4e14-b344-7bbb10e4e734 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:13.350076 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0d83e50f-bb7e-4e14-b344-7bbb10e4e734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:13.457869 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1737/3498] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:49:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:13.464959 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e570f3-a881-4b9b-9292-0fd8f52948e1 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:13.465246 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e570f3-a881-4b9b-9292-0fd8f52948e1 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:13.465524 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e570f3-a881-4b9b-9292-0fd8f52948e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:13.475541 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9027c4-0b3d-4a2a-8696-520157c7dbbb None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:13.482471 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235dc75-3f20-4218-9650-8977602853a3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:13.483261 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235dc75-3f20-4218-9650-8977602853a3 service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:13.483812 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235dc75-3f20-4218-9650-8977602853a3 service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:13.484183 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235dc75-3f20-4218-9650-8977602853a3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:13.486330 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c235dc75-3f20-4218-9650-8977602853a3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:13.489867 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-d9e570f3-a881-4b9b-9292-0fd8f52948e1 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:13.491594 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d9e570f3-a881-4b9b-9292-0fd8f52948e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:13.501023 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235dc75-3f20-4218-9650-8977602853a3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:13.503299 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235dc75-3f20-4218-9650-8977602853a3 service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:13.505174 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1738/3499] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:49:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:13.506062 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e570f3-a881-4b9b-9292-0fd8f52948e1 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:13.517814 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e570f3-a881-4b9b-9292-0fd8f52948e1 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:13.523387 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233034d-01f3-4bf0-adc5-953edc3c3133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:13.524018 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233034d-01f3-4bf0-adc5-953edc3c3133 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:13.524489 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233034d-01f3-4bf0-adc5-953edc3c3133 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:13.524687 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233034d-01f3-4bf0-adc5-953edc3c3133 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:13.525355 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233034d-01f3-4bf0-adc5-953edc3c3133 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:49:13.526310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233034d-01f3-4bf0-adc5-953edc3c3133 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:13.528091 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233034d-01f3-4bf0-adc5-953edc3c3133 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:13.530009 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1762/3500] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 15:49:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 15:49:13.548447 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1739/3501] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:49:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:49:13.555886 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235dc75-3f20-4218-9650-8977602853a3 service swift] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:13.612178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235dc75-3f20-4218-9650-8977602853a3 service swift] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:13.630806 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392294ed-f67f-4d8e-bd3b-00c8969e7b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:13.631915 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392294ed-f67f-4d8e-bd3b-00c8969e7b15 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:13.632385 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392294ed-f67f-4d8e-bd3b-00c8969e7b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:13.632841 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392294ed-f67f-4d8e-bd3b-00c8969e7b15 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:13.633706 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392294ed-f67f-4d8e-bd3b-00c8969e7b15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:13.637170 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392294ed-f67f-4d8e-bd3b-00c8969e7b15 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:13.697999 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:13.774606 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1763/3502] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:49:13 2022] POST /identity/v3/projects => generated 373 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:49:13.779872 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233034d-01f3-4bf0-adc5-953edc3c3133 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:13.792935 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233034d-01f3-4bf0-adc5-953edc3c3133 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:13.894383 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:13.943728 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf377eb5-25b8-4356-abe3-7eb8d685413a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:13.944806 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf377eb5-25b8-4356-abe3-7eb8d685413a admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:13.944806 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf377eb5-25b8-4356-abe3-7eb8d685413a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:13.945023 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf377eb5-25b8-4356-abe3-7eb8d685413a admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:13.945644 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf377eb5-25b8-4356-abe3-7eb8d685413a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:13.948387 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf377eb5-25b8-4356-abe3-7eb8d685413a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:13.996674 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1740/3503] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:49:13 2022] POST /identity/v3/users => generated 287 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:49:14.009890 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392294ed-f67f-4d8e-bd3b-00c8969e7b15 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:14.042559 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392294ed-f67f-4d8e-bd3b-00c8969e7b15 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:14.058802 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09aab99-7437-4eb3-9fd0-0aeb1f517dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:14.059486 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09aab99-7437-4eb3-9fd0-0aeb1f517dab admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:14.059842 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09aab99-7437-4eb3-9fd0-0aeb1f517dab admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:14.060120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09aab99-7437-4eb3-9fd0-0aeb1f517dab admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:14.060808 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09aab99-7437-4eb3-9fd0-0aeb1f517dab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:14.062826 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09aab99-7437-4eb3-9fd0-0aeb1f517dab admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:14.093509 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1764/3504] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:49:14.095316 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf377eb5-25b8-4356-abe3-7eb8d685413a admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:14.106293 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf377eb5-25b8-4356-abe3-7eb8d685413a admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:14.133938 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc835090-0df0-4dea-b069-44edc2e293b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:14.134584 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc835090-0df0-4dea-b069-44edc2e293b4 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:14.134866 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc835090-0df0-4dea-b069-44edc2e293b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:14.136069 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc835090-0df0-4dea-b069-44edc2e293b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:14.137083 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc835090-0df0-4dea-b069-44edc2e293b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:14.138796 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc835090-0df0-4dea-b069-44edc2e293b4 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:14.174707 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1741/3505] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:49:14.178853 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09aab99-7437-4eb3-9fd0-0aeb1f517dab admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:14.206527 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09aab99-7437-4eb3-9fd0-0aeb1f517dab admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:14.244273 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0447d88-ebde-4e15-a2f6-81298882ae81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:14.247105 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0447d88-ebde-4e15-a2f6-81298882ae81 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:14.247430 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0447d88-ebde-4e15-a2f6-81298882ae81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:14.247716 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0447d88-ebde-4e15-a2f6-81298882ae81 admin admin] PATH_INFO: `/v3/projects/5d9ee7e4ec4d4690b901fe6354191dec/users/5a0d010ab0524a1a93a92821e4b43e67/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:14.319015 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0447d88-ebde-4e15-a2f6-81298882ae81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d9ee7e4ec4d4690b901fe6354191dec, user_id=5a0d010ab0524a1a93a92821e4b43e67, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:14.323672 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0447d88-ebde-4e15-a2f6-81298882ae81 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:14.360994 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1765/3506] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:49:14 2022] PUT /identity/v3/projects/5d9ee7e4ec4d4690b901fe6354191dec/users/5a0d010ab0524a1a93a92821e4b43e67/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:14.372810 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f05617-8d91-4ff8-8c51-d06490101407 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:14.373200 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f05617-8d91-4ff8-8c51-d06490101407 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:14.373578 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f05617-8d91-4ff8-8c51-d06490101407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:14.452356 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-b0f05617-8d91-4ff8-8c51-d06490101407 None None] MFA Rules not processed for user `5a0d010ab0524a1a93a92821e4b43e67`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:14.454537 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b0f05617-8d91-4ff8-8c51-d06490101407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:14.670646 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1742/3507] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:49:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:14.672152 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21aab52-6679-443d-a593-3d0b67b47d93 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:14.672595 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21aab52-6679-443d-a593-3d0b67b47d93 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:14.673040 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21aab52-6679-443d-a593-3d0b67b47d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:14.753346 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-a21aab52-6679-443d-a593-3d0b67b47d93 None None] MFA Rules not processed for user `5a0d010ab0524a1a93a92821e4b43e67`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:14.754579 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a21aab52-6679-443d-a593-3d0b67b47d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:14.786171 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1766/3508] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:49:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:49:14.799095 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f05617-8d91-4ff8-8c51-d06490101407 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:14.800548 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b0f05617-8d91-4ff8-8c51-d06490101407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:15.012031 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f05617-8d91-4ff8-8c51-d06490101407 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:15.038958 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f991b05-8be2-4df9-b8a3-16743460d455 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:15.039634 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f991b05-8be2-4df9-b8a3-16743460d455 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:15.039922 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f991b05-8be2-4df9-b8a3-16743460d455 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:15.040175 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f991b05-8be2-4df9-b8a3-16743460d455 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:15.060553 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f991b05-8be2-4df9-b8a3-16743460d455 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:15.062416 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f991b05-8be2-4df9-b8a3-16743460d455 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:15.086391 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1743/3509] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:49:19.926284 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21aab52-6679-443d-a593-3d0b67b47d93 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:19.927732 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a21aab52-6679-443d-a593-3d0b67b47d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:20.046169 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21aab52-6679-443d-a593-3d0b67b47d93 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:20.053686 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9053e0-27db-420d-b97e-db6199f8fb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:20.054457 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9053e0-27db-420d-b97e-db6199f8fb4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:20.054738 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9053e0-27db-420d-b97e-db6199f8fb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:20.055009 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9053e0-27db-420d-b97e-db6199f8fb4c admin admin] PATH_INFO: `/v3/users/853f8300f9bb403b9cea4834c5a1edcb` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:20.056710 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9053e0-27db-420d-b97e-db6199f8fb4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=853f8300f9bb403b9cea4834c5a1edcb)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:20.059109 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9053e0-27db-420d-b97e-db6199f8fb4c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:20.150990 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3e9053e0-27db-420d-b97e-db6199f8fb4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '853f8300f9bb403b9cea4834c5a1edcb'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:20.188336 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3e9053e0-27db-420d-b97e-db6199f8fb4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '853f8300f9bb403b9cea4834c5a1edcb'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:20.196831 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3e9053e0-27db-420d-b97e-db6199f8fb4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '853f8300f9bb403b9cea4834c5a1edcb'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:20.224548 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3e9053e0-27db-420d-b97e-db6199f8fb4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '853f8300f9bb403b9cea4834c5a1edcb'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:20.248118 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3e9053e0-27db-420d-b97e-db6199f8fb4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '853f8300f9bb403b9cea4834c5a1edcb'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:20.261248 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1767/3510] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:49:19 2022] DELETE /identity/v3/users/853f8300f9bb403b9cea4834c5a1edcb => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:20.759063 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f991b05-8be2-4df9-b8a3-16743460d455 service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:20.771888 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f991b05-8be2-4df9-b8a3-16743460d455 service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:20.858332 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:20.911734 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4111141-0166-466b-a70c-17bd407d211a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:20.912466 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4111141-0166-466b-a70c-17bd407d211a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:20.913465 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4111141-0166-466b-a70c-17bd407d211a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:20.913840 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4111141-0166-466b-a70c-17bd407d211a admin admin] PATH_INFO: `/v3/projects/2d32eb4fb5ea49e6ad495a8175ae5e3e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:20.917598 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4111141-0166-466b-a70c-17bd407d211a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d32eb4fb5ea49e6ad495a8175ae5e3e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:20.919759 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4111141-0166-466b-a70c-17bd407d211a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:21.014744 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a4111141-0166-466b-a70c-17bd407d211a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'request_id': 'req-a4111141-0166-466b-a70c-17bd407d211a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:21.024150 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a4111141-0166-466b-a70c-17bd407d211a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'request_id': 'req-a4111141-0166-466b-a70c-17bd407d211a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:21.037850 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a4111141-0166-466b-a70c-17bd407d211a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'request_id': 'req-a4111141-0166-466b-a70c-17bd407d211a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:21.081185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a4111141-0166-466b-a70c-17bd407d211a admin admin] The token cache is being invalidate because project 2d32eb4fb5ea49e6ad495a8175ae5e3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:49:21.081622 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a4111141-0166-466b-a70c-17bd407d211a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:21.082460 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a4111141-0166-466b-a70c-17bd407d211a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:21.101757 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1744/3511] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:20 2022] DELETE /identity/v3/projects/2d32eb4fb5ea49e6ad495a8175ae5e3e => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:21.103499 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b636f276-fc33-4c64-9fc5-ccc88552c9e4 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:21.104643 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b636f276-fc33-4c64-9fc5-ccc88552c9e4 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:21.105141 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b636f276-fc33-4c64-9fc5-ccc88552c9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:21.148904 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-b636f276-fc33-4c64-9fc5-ccc88552c9e4 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:21.155646 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b636f276-fc33-4c64-9fc5-ccc88552c9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:21.253561 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:21.428048 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1768/3512] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:21.436697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422fab49-1e61-4022-9d6c-3aea21d38f96 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:21.437299 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422fab49-1e61-4022-9d6c-3aea21d38f96 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:21.437739 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422fab49-1e61-4022-9d6c-3aea21d38f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:21.467881 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-422fab49-1e61-4022-9d6c-3aea21d38f96 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:21.469377 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-422fab49-1e61-4022-9d6c-3aea21d38f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:21.478407 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1745/3513] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:21.482383 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b636f276-fc33-4c64-9fc5-ccc88552c9e4 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:21.504674 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b636f276-fc33-4c64-9fc5-ccc88552c9e4 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:21.515893 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996830ac-0672-4706-8889-fb9c055966cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:21.516997 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996830ac-0672-4706-8889-fb9c055966cf admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:21.517660 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996830ac-0672-4706-8889-fb9c055966cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:21.518212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996830ac-0672-4706-8889-fb9c055966cf admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:21.519358 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996830ac-0672-4706-8889-fb9c055966cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:49:21.520155 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996830ac-0672-4706-8889-fb9c055966cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:21.523219 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996830ac-0672-4706-8889-fb9c055966cf admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:21.567307 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1769/3514] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:49:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:49:21.583991 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422fab49-1e61-4022-9d6c-3aea21d38f96 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:21.595989 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422fab49-1e61-4022-9d6c-3aea21d38f96 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:21.602268 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0579939-fdde-43ba-b0ae-3813a547d2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:21.602898 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0579939-fdde-43ba-b0ae-3813a547d2cd admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:21.603209 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0579939-fdde-43ba-b0ae-3813a547d2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:21.603525 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0579939-fdde-43ba-b0ae-3813a547d2cd admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:21.604841 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0579939-fdde-43ba-b0ae-3813a547d2cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:21.606986 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0579939-fdde-43ba-b0ae-3813a547d2cd admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:21.683498 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1746/3515] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:49:21 2022] POST /identity/v3/projects => generated 397 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:49:21.687195 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996830ac-0672-4706-8889-fb9c055966cf admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:21.722427 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996830ac-0672-4706-8889-fb9c055966cf admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:21.894410 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48baf9d-5a4d-4023-bab1-4ca60ede47b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:21.896165 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48baf9d-5a4d-4023-bab1-4ca60ede47b8 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:21.896165 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48baf9d-5a4d-4023-bab1-4ca60ede47b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:21.896165 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48baf9d-5a4d-4023-bab1-4ca60ede47b8 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:21.896501 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48baf9d-5a4d-4023-bab1-4ca60ede47b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:21.898983 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48baf9d-5a4d-4023-bab1-4ca60ede47b8 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:21.941903 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1770/3516] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:49:21 2022] POST /identity/v3/users => generated 299 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:49:21.945748 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0579939-fdde-43ba-b0ae-3813a547d2cd admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:21.958345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0579939-fdde-43ba-b0ae-3813a547d2cd admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:21.990809 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca00b9-b15a-45e9-a1f1-7ac5165a2de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:21.991508 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca00b9-b15a-45e9-a1f1-7ac5165a2de1 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:21.991790 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca00b9-b15a-45e9-a1f1-7ac5165a2de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:21.992071 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca00b9-b15a-45e9-a1f1-7ac5165a2de1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:21.993225 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eca00b9-b15a-45e9-a1f1-7ac5165a2de1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:21.995626 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eca00b9-b15a-45e9-a1f1-7ac5165a2de1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:22.013434 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48baf9d-5a4d-4023-bab1-4ca60ede47b8 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:22.014162 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1747/3517] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:49:22.047594 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48baf9d-5a4d-4023-bab1-4ca60ede47b8 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:22.057949 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a47f1c-30e7-4841-8e48-0ead9c830892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:22.058573 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a47f1c-30e7-4841-8e48-0ead9c830892 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:22.058856 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a47f1c-30e7-4841-8e48-0ead9c830892 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:22.059154 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a47f1c-30e7-4841-8e48-0ead9c830892 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:22.060365 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a47f1c-30e7-4841-8e48-0ead9c830892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:22.063900 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a47f1c-30e7-4841-8e48-0ead9c830892 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:22.099952 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1771/3518] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:49:22.103426 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca00b9-b15a-45e9-a1f1-7ac5165a2de1 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:22.121087 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca00b9-b15a-45e9-a1f1-7ac5165a2de1 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:22.144145 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7b4ce-a9d9-4ce3-b43b-253b0dca5d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:22.144904 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7b4ce-a9d9-4ce3-b43b-253b0dca5d81 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:22.145192 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7b4ce-a9d9-4ce3-b43b-253b0dca5d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:22.145464 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7b4ce-a9d9-4ce3-b43b-253b0dca5d81 admin admin] PATH_INFO: `/v3/projects/12c5cbaae6dd4425b4048fc8a2f94e79/users/26954960fb8a407e9212fcc2b83ddd87/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:22.184969 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7b4ce-a9d9-4ce3-b43b-253b0dca5d81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12c5cbaae6dd4425b4048fc8a2f94e79, user_id=26954960fb8a407e9212fcc2b83ddd87, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:22.187712 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7b4ce-a9d9-4ce3-b43b-253b0dca5d81 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:22.228672 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dffa1b-5bb0-47c6-8b55-69e5435a6a36 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:22.229972 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1748/3519] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:49:22 2022] PUT /identity/v3/projects/12c5cbaae6dd4425b4048fc8a2f94e79/users/26954960fb8a407e9212fcc2b83ddd87/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:49:22.230549 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dffa1b-5bb0-47c6-8b55-69e5435a6a36 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:22.230850 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dffa1b-5bb0-47c6-8b55-69e5435a6a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:22.264172 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-d2dffa1b-5bb0-47c6-8b55-69e5435a6a36 None None] MFA Rules not processed for user `26954960fb8a407e9212fcc2b83ddd87`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:22.265692 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d2dffa1b-5bb0-47c6-8b55-69e5435a6a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:22.392921 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1772/3520] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:49:22 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:49:22.405487 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8774535-8767-465f-99d6-ed1774971bfd None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:22.405936 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8774535-8767-465f-99d6-ed1774971bfd None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:22.406314 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8774535-8767-465f-99d6-ed1774971bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:22.433093 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-e8774535-8767-465f-99d6-ed1774971bfd None None] MFA Rules not processed for user `26954960fb8a407e9212fcc2b83ddd87`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:22.435085 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e8774535-8767-465f-99d6-ed1774971bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:22.450534 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1749/3521] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:49:22 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:22.456557 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dffa1b-5bb0-47c6-8b55-69e5435a6a36 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:22.457976 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d2dffa1b-5bb0-47c6-8b55-69e5435a6a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:22.512145 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:22.580383 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dffa1b-5bb0-47c6-8b55-69e5435a6a36 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:22.590501 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1627be-0b08-4dbe-bdb0-c5c4f5cbc38d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:22.591257 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1627be-0b08-4dbe-bdb0-c5c4f5cbc38d service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:22.591603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1627be-0b08-4dbe-bdb0-c5c4f5cbc38d service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:22.591946 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1627be-0b08-4dbe-bdb0-c5c4f5cbc38d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:22.601116 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1627be-0b08-4dbe-bdb0-c5c4f5cbc38d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:22.602809 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1627be-0b08-4dbe-bdb0-c5c4f5cbc38d service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:22.625223 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1773/3522] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:22 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:49:22.642880 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26f1c2-ccca-46fc-9657-d3bf6a26c3d0 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:22.644692 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26f1c2-ccca-46fc-9657-d3bf6a26c3d0 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:22.646209 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26f1c2-ccca-46fc-9657-d3bf6a26c3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:22.690456 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-6a26f1c2-ccca-46fc-9657-d3bf6a26c3d0 None None] MFA Rules not processed for user `26954960fb8a407e9212fcc2b83ddd87`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:22.691703 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6a26f1c2-ccca-46fc-9657-d3bf6a26c3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:22.716385 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1750/3523] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:49:22 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:22.775570 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b09c9-d557-4c39-a926-0d27cfa52280 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:22.776365 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b09c9-d557-4c39-a926-0d27cfa52280 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:22.776798 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b09c9-d557-4c39-a926-0d27cfa52280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:22.824771 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-0b8b09c9-d557-4c39-a926-0d27cfa52280 None None] MFA Rules not processed for user `26954960fb8a407e9212fcc2b83ddd87`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:22.832167 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0b8b09c9-d557-4c39-a926-0d27cfa52280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:22.867186 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1774/3524] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:49:22 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:22.910294 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52b7ff-ee05-4d5f-badf-b08f666fbd8f None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:22.910672 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52b7ff-ee05-4d5f-badf-b08f666fbd8f None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:22.910846 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52b7ff-ee05-4d5f-badf-b08f666fbd8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:22.933561 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-dc52b7ff-ee05-4d5f-badf-b08f666fbd8f None None] MFA Rules not processed for user `26954960fb8a407e9212fcc2b83ddd87`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:22.934795 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-dc52b7ff-ee05-4d5f-badf-b08f666fbd8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:22.969146 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1751/3525] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:49:22 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:23.011423 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3dfad2-8563-4e11-8666-531cc64598af None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:23.011734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3dfad2-8563-4e11-8666-531cc64598af None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:23.012036 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3dfad2-8563-4e11-8666-531cc64598af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:23.040664 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-ed3dfad2-8563-4e11-8666-531cc64598af None None] MFA Rules not processed for user `26954960fb8a407e9212fcc2b83ddd87`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:23.042708 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ed3dfad2-8563-4e11-8666-531cc64598af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:23.050937 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1775/3526] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:49:23 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:23.108337 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc52b7ff-ee05-4d5f-badf-b08f666fbd8f None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:23.179707 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:23.206293 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc52b7ff-ee05-4d5f-badf-b08f666fbd8f None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:23.213443 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8d385-f385-4036-a9ff-aee781341c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:23.213443 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8d385-f385-4036-a9ff-aee781341c07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:23.213443 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8d385-f385-4036-a9ff-aee781341c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:23.213443 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8d385-f385-4036-a9ff-aee781341c07 admin admin] PATH_INFO: `/v3/users/26954960fb8a407e9212fcc2b83ddd87` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:23.216136 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c8d385-f385-4036-a9ff-aee781341c07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26954960fb8a407e9212fcc2b83ddd87)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:23.220791 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c8d385-f385-4036-a9ff-aee781341c07 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:23.301368 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-58c8d385-f385-4036-a9ff-aee781341c07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26954960fb8a407e9212fcc2b83ddd87'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:23.302043 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-58c8d385-f385-4036-a9ff-aee781341c07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26954960fb8a407e9212fcc2b83ddd87'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:23.318730 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-58c8d385-f385-4036-a9ff-aee781341c07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26954960fb8a407e9212fcc2b83ddd87'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:23.360806 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-58c8d385-f385-4036-a9ff-aee781341c07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26954960fb8a407e9212fcc2b83ddd87'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:23.361548 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-58c8d385-f385-4036-a9ff-aee781341c07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26954960fb8a407e9212fcc2b83ddd87'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:23.409722 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1752/3527] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:49:23 2022] DELETE /identity/v3/users/26954960fb8a407e9212fcc2b83ddd87 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:23.410921 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558fdaf-1423-4e46-9728-41c96c6e9a6e None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:23.411433 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558fdaf-1423-4e46-9728-41c96c6e9a6e None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:23.411530 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558fdaf-1423-4e46-9728-41c96c6e9a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:23.468640 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-2558fdaf-1423-4e46-9728-41c96c6e9a6e None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:23.471442 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2558fdaf-1423-4e46-9728-41c96c6e9a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:23.626058 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1776/3528] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:23.626954 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8d385-f385-4036-a9ff-aee781341c07 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:23.638234 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-58c8d385-f385-4036-a9ff-aee781341c07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:23.790818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8d385-f385-4036-a9ff-aee781341c07 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:23.795340 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b756f-0ddd-4608-9be5-96e0f7cda48e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:23.796126 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b756f-0ddd-4608-9be5-96e0f7cda48e service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:23.796498 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b756f-0ddd-4608-9be5-96e0f7cda48e service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:23.797132 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b756f-0ddd-4608-9be5-96e0f7cda48e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:23.818562 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b756f-0ddd-4608-9be5-96e0f7cda48e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:23.820404 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b756f-0ddd-4608-9be5-96e0f7cda48e service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:23.847439 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1753/3529] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:49:24.226402 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558fdaf-1423-4e46-9728-41c96c6e9a6e None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:24.229475 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2558fdaf-1423-4e46-9728-41c96c6e9a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:24.254927 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558fdaf-1423-4e46-9728-41c96c6e9a6e None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:24.268589 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae76326-f023-475a-862a-9d745ea63ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:24.268922 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae76326-f023-475a-862a-9d745ea63ff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:24.269368 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae76326-f023-475a-862a-9d745ea63ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:24.269522 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae76326-f023-475a-862a-9d745ea63ff0 admin admin] PATH_INFO: `/v3/projects/12c5cbaae6dd4425b4048fc8a2f94e79` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:24.272767 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae76326-f023-475a-862a-9d745ea63ff0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12c5cbaae6dd4425b4048fc8a2f94e79)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:24.274982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae76326-f023-475a-862a-9d745ea63ff0 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:24.399738 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fae76326-f023-475a-862a-9d745ea63ff0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12c5cbaae6dd4425b4048fc8a2f94e79', 'request_id': 'req-fae76326-f023-475a-862a-9d745ea63ff0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:24.416305 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fae76326-f023-475a-862a-9d745ea63ff0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12c5cbaae6dd4425b4048fc8a2f94e79', 'request_id': 'req-fae76326-f023-475a-862a-9d745ea63ff0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:24.428825 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fae76326-f023-475a-862a-9d745ea63ff0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12c5cbaae6dd4425b4048fc8a2f94e79', 'request_id': 'req-fae76326-f023-475a-862a-9d745ea63ff0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:24.453107 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fae76326-f023-475a-862a-9d745ea63ff0 admin admin] The token cache is being invalidate because project 12c5cbaae6dd4425b4048fc8a2f94e79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:49:24.453547 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fae76326-f023-475a-862a-9d745ea63ff0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:24.454284 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fae76326-f023-475a-862a-9d745ea63ff0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:24.457165 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1777/3530] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:24 2022] DELETE /identity/v3/projects/12c5cbaae6dd4425b4048fc8a2f94e79 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:24.466320 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693f925-aaa6-48f7-9f1f-52905b8ee96a None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:24.466808 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693f925-aaa6-48f7-9f1f-52905b8ee96a None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:24.466913 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693f925-aaa6-48f7-9f1f-52905b8ee96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:24.512143 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-b693f925-aaa6-48f7-9f1f-52905b8ee96a None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:24.513371 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b693f925-aaa6-48f7-9f1f-52905b8ee96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:24.656222 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1754/3531] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:49:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:24.668882 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2a328-4ded-4ff4-93cd-8fd0f91c1601 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:24.669338 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2a328-4ded-4ff4-93cd-8fd0f91c1601 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:24.669930 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2a328-4ded-4ff4-93cd-8fd0f91c1601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:24.705436 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-faf2a328-4ded-4ff4-93cd-8fd0f91c1601 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:24.706739 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-faf2a328-4ded-4ff4-93cd-8fd0f91c1601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:24.742872 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1778/3532] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:49:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:24.744870 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b693f925-aaa6-48f7-9f1f-52905b8ee96a None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:24.751199 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:24.768366 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b693f925-aaa6-48f7-9f1f-52905b8ee96a None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:24.783370 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0111a-2cbd-41ca-883f-0ee6f3da07a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:24.784010 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0111a-2cbd-41ca-883f-0ee6f3da07a4 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:24.784303 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0111a-2cbd-41ca-883f-0ee6f3da07a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:24.784567 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0111a-2cbd-41ca-883f-0ee6f3da07a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:24.785228 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0111a-2cbd-41ca-883f-0ee6f3da07a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:49:24.785728 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0111a-2cbd-41ca-883f-0ee6f3da07a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:24.787426 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0111a-2cbd-41ca-883f-0ee6f3da07a4 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:24.814032 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf2a328-4ded-4ff4-93cd-8fd0f91c1601 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:24.820174 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1755/3533] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:49:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:49:24.825262 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf2a328-4ded-4ff4-93cd-8fd0f91c1601 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:24.842853 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5aa24e-d545-4541-bf10-431acd522b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:24.846109 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5aa24e-d545-4541-bf10-431acd522b95 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:24.846598 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5aa24e-d545-4541-bf10-431acd522b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:24.849031 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5aa24e-d545-4541-bf10-431acd522b95 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:24.850106 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5aa24e-d545-4541-bf10-431acd522b95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:24.853048 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5aa24e-d545-4541-bf10-431acd522b95 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:24.871619 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:24.905861 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1779/3534] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:49:24 2022] POST /identity/v3/projects => generated 379 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:49:24.909745 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0111a-2cbd-41ca-883f-0ee6f3da07a4 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:24.948234 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0111a-2cbd-41ca-883f-0ee6f3da07a4 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:25.032428 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4026b78-8580-4842-9046-f1d39df8e9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:25.033053 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4026b78-8580-4842-9046-f1d39df8e9ac admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:25.033337 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4026b78-8580-4842-9046-f1d39df8e9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:25.033614 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4026b78-8580-4842-9046-f1d39df8e9ac admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:25.034264 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4026b78-8580-4842-9046-f1d39df8e9ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:25.036243 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4026b78-8580-4842-9046-f1d39df8e9ac admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:25.081311 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1756/3535] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:49:24 2022] POST /identity/v3/users => generated 290 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:49:25.085047 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5aa24e-d545-4541-bf10-431acd522b95 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:25.097021 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5aa24e-d545-4541-bf10-431acd522b95 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:25.102770 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef8581-01b0-41c9-8df3-d5e96463a6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:25.103445 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef8581-01b0-41c9-8df3-d5e96463a6dd admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:25.103762 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef8581-01b0-41c9-8df3-d5e96463a6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:25.104043 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef8581-01b0-41c9-8df3-d5e96463a6dd admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:25.104816 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef8581-01b0-41c9-8df3-d5e96463a6dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:25.106438 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef8581-01b0-41c9-8df3-d5e96463a6dd admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:25.122350 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1780/3536] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:49:25.126449 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4026b78-8580-4842-9046-f1d39df8e9ac admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:25.140826 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4026b78-8580-4842-9046-f1d39df8e9ac admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:25.146801 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c615a-34d8-418d-b2a1-9095820e439a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:25.147696 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c615a-34d8-418d-b2a1-9095820e439a admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:25.148479 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c615a-34d8-418d-b2a1-9095820e439a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:25.148957 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c615a-34d8-418d-b2a1-9095820e439a admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:25.149767 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c615a-34d8-418d-b2a1-9095820e439a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:25.153731 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c615a-34d8-418d-b2a1-9095820e439a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:25.169640 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1757/3537] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:49:25.174034 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef8581-01b0-41c9-8df3-d5e96463a6dd admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:25.189579 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef8581-01b0-41c9-8df3-d5e96463a6dd admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:25.195596 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6e518-b73e-4905-ab87-15dae22d07bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:25.196415 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6e518-b73e-4905-ab87-15dae22d07bb admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:25.196801 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6e518-b73e-4905-ab87-15dae22d07bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:25.197170 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6e518-b73e-4905-ab87-15dae22d07bb admin admin] PATH_INFO: `/v3/projects/5f7aaa8aa8d145ba9dbfccf8cd4f9e9d/users/67dd0372f7b442b3997a91623e18529b/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:25.218753 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6e518-b73e-4905-ab87-15dae22d07bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f7aaa8aa8d145ba9dbfccf8cd4f9e9d, user_id=67dd0372f7b442b3997a91623e18529b, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:25.221620 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6e518-b73e-4905-ab87-15dae22d07bb admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:25.245985 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1781/3538] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:49:25 2022] PUT /identity/v3/projects/5f7aaa8aa8d145ba9dbfccf8cd4f9e9d/users/67dd0372f7b442b3997a91623e18529b/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:49:25.251368 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3739a-9bab-49a9-a1be-a21bc08011aa None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:25.252052 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3739a-9bab-49a9-a1be-a21bc08011aa None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:25.252392 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3739a-9bab-49a9-a1be-a21bc08011aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:25.282473 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-52e3739a-9bab-49a9-a1be-a21bc08011aa None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:25.283739 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-52e3739a-9bab-49a9-a1be-a21bc08011aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:25.419849 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6e518-b73e-4905-ab87-15dae22d07bb admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:25.422479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1eb6e518-b73e-4905-ab87-15dae22d07bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:25.426169 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1758/3539] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:49:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:25.550663 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6e518-b73e-4905-ab87-15dae22d07bb admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:25.559297 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21c268-e398-4f2c-870a-ca822840daf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:25.559928 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21c268-e398-4f2c-870a-ca822840daf3 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:25.560203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21c268-e398-4f2c-870a-ca822840daf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:25.560486 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21c268-e398-4f2c-870a-ca822840daf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:25.582735 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa21c268-e398-4f2c-870a-ca822840daf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:25.584227 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa21c268-e398-4f2c-870a-ca822840daf3 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:25.606274 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1782/3540] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:49:31.381466 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee838a-92a1-469c-a62d-7f20dd2d0d54 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:31.382331 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee838a-92a1-469c-a62d-7f20dd2d0d54 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:31.383498 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee838a-92a1-469c-a62d-7f20dd2d0d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:31.478379 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-1aee838a-92a1-469c-a62d-7f20dd2d0d54 None None] MFA Rules not processed for user `71e0809663664b319388bcc890b6fdec`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:31.479489 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1aee838a-92a1-469c-a62d-7f20dd2d0d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:31.687585 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1759/3541] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:49:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:49:32.254858 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21c268-e398-4f2c-870a-ca822840daf3 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:32.271304 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21c268-e398-4f2c-870a-ca822840daf3 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:32.287314 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d2d9b-81cd-4c0a-8bf1-3be0a6c2b54f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:32.290772 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d2d9b-81cd-4c0a-8bf1-3be0a6c2b54f service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:32.291896 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d2d9b-81cd-4c0a-8bf1-3be0a6c2b54f service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:32.292234 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d2d9b-81cd-4c0a-8bf1-3be0a6c2b54f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:32.302566 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-219d2d9b-81cd-4c0a-8bf1-3be0a6c2b54f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:32.346060 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d2d9b-81cd-4c0a-8bf1-3be0a6c2b54f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:32.348660 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d2d9b-81cd-4c0a-8bf1-3be0a6c2b54f service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:32.363780 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1783/3542] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:49:32.629038 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf9648-77d9-4432-9dff-be3fc182de65 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:32.629899 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf9648-77d9-4432-9dff-be3fc182de65 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:32.630534 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf9648-77d9-4432-9dff-be3fc182de65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:32.690038 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-ffaf9648-77d9-4432-9dff-be3fc182de65 None None] MFA Rules not processed for user `215e000f15f44b41aa38a41a941c16da`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:32.691344 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ffaf9648-77d9-4432-9dff-be3fc182de65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:32.780084 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:32.968829 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1760/3543] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:49:32 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:38.121173 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32304f37-0d2e-4fdf-a0fa-aab4e0841d39 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:38.122079 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32304f37-0d2e-4fdf-a0fa-aab4e0841d39 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:38.122517 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32304f37-0d2e-4fdf-a0fa-aab4e0841d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:38.142891 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-32304f37-0d2e-4fdf-a0fa-aab4e0841d39 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:38.144183 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-32304f37-0d2e-4fdf-a0fa-aab4e0841d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:38.266728 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1784/3544] 10.222.0.83 () {58 vars in 967 bytes} [Mon Aug 29 15:49:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:49:38.282133 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf9648-77d9-4432-9dff-be3fc182de65 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:38.284525 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ffaf9648-77d9-4432-9dff-be3fc182de65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:38.447892 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf9648-77d9-4432-9dff-be3fc182de65 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:38.456891 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955bca7e-301a-4678-8f3c-6313b9023542 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:38.457581 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955bca7e-301a-4678-8f3c-6313b9023542 service swift] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:38.457858 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955bca7e-301a-4678-8f3c-6313b9023542 service swift] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:38.458304 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955bca7e-301a-4678-8f3c-6313b9023542 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:38.483920 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955bca7e-301a-4678-8f3c-6313b9023542 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:38.488489 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955bca7e-301a-4678-8f3c-6313b9023542 service swift] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:38.506094 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1761/3545] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 15:49:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:49:38.907960 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21565d-9cc0-4d57-918c-82870bf02d81 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:38.908396 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21565d-9cc0-4d57-918c-82870bf02d81 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:38.908499 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21565d-9cc0-4d57-918c-82870bf02d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:38.998506 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-fc21565d-9cc0-4d57-918c-82870bf02d81 None None] MFA Rules not processed for user `67dd0372f7b442b3997a91623e18529b`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:39.003161 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-fc21565d-9cc0-4d57-918c-82870bf02d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:39.105930 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:39.146348 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1785/3546] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:49:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:39.157614 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead32d54-768a-4d5e-add0-9b4c6056364d None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:39.157823 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead32d54-768a-4d5e-add0-9b4c6056364d None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:39.158096 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead32d54-768a-4d5e-add0-9b4c6056364d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:39.200434 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-ead32d54-768a-4d5e-add0-9b4c6056364d None None] MFA Rules not processed for user `67dd0372f7b442b3997a91623e18529b`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:39.201678 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ead32d54-768a-4d5e-add0-9b4c6056364d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:39.231241 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1762/3547] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:49:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:39.263695 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21565d-9cc0-4d57-918c-82870bf02d81 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:39.265444 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-fc21565d-9cc0-4d57-918c-82870bf02d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:39.375854 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21565d-9cc0-4d57-918c-82870bf02d81 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:39.386283 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4d86c-2fee-4446-b9bd-8248f3f3a289 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:39.386787 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4d86c-2fee-4446-b9bd-8248f3f3a289 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:39.387089 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4d86c-2fee-4446-b9bd-8248f3f3a289 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:39.387371 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4d86c-2fee-4446-b9bd-8248f3f3a289 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:39.400842 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f4d86c-2fee-4446-b9bd-8248f3f3a289 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:39.403070 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f4d86c-2fee-4446-b9bd-8248f3f3a289 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:39.417452 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1786/3548] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:39 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:49:45.300594 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead32d54-768a-4d5e-add0-9b4c6056364d None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:45.302439 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ead32d54-768a-4d5e-add0-9b4c6056364d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:45.319100 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead32d54-768a-4d5e-add0-9b4c6056364d None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:45.325280 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c95479-c638-4141-8c55-bbac2c2e50e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:45.326248 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c95479-c638-4141-8c55-bbac2c2e50e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:45.326681 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c95479-c638-4141-8c55-bbac2c2e50e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:45.327157 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c95479-c638-4141-8c55-bbac2c2e50e7 admin admin] PATH_INFO: `/v3/users/1ada57c2de1f4c1f90d6f8173289bbb1` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:45.329234 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c95479-c638-4141-8c55-bbac2c2e50e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ada57c2de1f4c1f90d6f8173289bbb1)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:45.331966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c95479-c638-4141-8c55-bbac2c2e50e7 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:45.458086 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-71c95479-c638-4141-8c55-bbac2c2e50e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ada57c2de1f4c1f90d6f8173289bbb1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:45.459302 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-71c95479-c638-4141-8c55-bbac2c2e50e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ada57c2de1f4c1f90d6f8173289bbb1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:45.485694 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-71c95479-c638-4141-8c55-bbac2c2e50e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ada57c2de1f4c1f90d6f8173289bbb1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:45.495351 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-71c95479-c638-4141-8c55-bbac2c2e50e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ada57c2de1f4c1f90d6f8173289bbb1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:45.496270 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-71c95479-c638-4141-8c55-bbac2c2e50e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ada57c2de1f4c1f90d6f8173289bbb1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:45.529986 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1763/3549] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:49:45 2022] DELETE /identity/v3/users/1ada57c2de1f4c1f90d6f8173289bbb1 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:49:45.538886 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517bb253-248e-4326-9cbc-8477639f70aa None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:45.538886 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517bb253-248e-4326-9cbc-8477639f70aa None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:45.538886 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517bb253-248e-4326-9cbc-8477639f70aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:45.566506 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-517bb253-248e-4326-9cbc-8477639f70aa None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:45.568097 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-517bb253-248e-4326-9cbc-8477639f70aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:45.692627 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1787/3550] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:49:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:49:45.694356 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c95479-c638-4141-8c55-bbac2c2e50e7 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:45.696140 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-71c95479-c638-4141-8c55-bbac2c2e50e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:45.740538 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:45.811877 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c95479-c638-4141-8c55-bbac2c2e50e7 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:45.817443 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eba6fd-6b65-4f18-82fd-921f08b098fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:45.818898 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eba6fd-6b65-4f18-82fd-921f08b098fb service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:45.819481 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eba6fd-6b65-4f18-82fd-921f08b098fb service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:45.820030 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eba6fd-6b65-4f18-82fd-921f08b098fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:45.839521 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eba6fd-6b65-4f18-82fd-921f08b098fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:45.841194 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eba6fd-6b65-4f18-82fd-921f08b098fb service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:45.855502 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1764/3551] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:49:46.490863 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517bb253-248e-4326-9cbc-8477639f70aa None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:46.492668 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-517bb253-248e-4326-9cbc-8477639f70aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:46.509743 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517bb253-248e-4326-9cbc-8477639f70aa None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:46.531729 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f950e-4094-4389-b0f3-fe3a0d57f862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:46.532556 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f950e-4094-4389-b0f3-fe3a0d57f862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:46.532960 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f950e-4094-4389-b0f3-fe3a0d57f862 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:46.533475 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f950e-4094-4389-b0f3-fe3a0d57f862 admin admin] PATH_INFO: `/v3/projects/d8c72636d6db42cfb42f0c535863a4b2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:46.534862 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f950e-4094-4389-b0f3-fe3a0d57f862 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8c72636d6db42cfb42f0c535863a4b2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:46.537144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f950e-4094-4389-b0f3-fe3a0d57f862 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:46.649857 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d65f950e-4094-4389-b0f3-fe3a0d57f862 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8c72636d6db42cfb42f0c535863a4b2', 'request_id': 'req-d65f950e-4094-4389-b0f3-fe3a0d57f862'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:46.664046 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d65f950e-4094-4389-b0f3-fe3a0d57f862 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8c72636d6db42cfb42f0c535863a4b2', 'request_id': 'req-d65f950e-4094-4389-b0f3-fe3a0d57f862'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:46.667744 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:46.680192 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d65f950e-4094-4389-b0f3-fe3a0d57f862 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8c72636d6db42cfb42f0c535863a4b2', 'request_id': 'req-d65f950e-4094-4389-b0f3-fe3a0d57f862'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:46.721405 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d65f950e-4094-4389-b0f3-fe3a0d57f862 admin admin] The token cache is being invalidate because project d8c72636d6db42cfb42f0c535863a4b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:49:46.721890 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d65f950e-4094-4389-b0f3-fe3a0d57f862 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:46.722771 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d65f950e-4094-4389-b0f3-fe3a0d57f862 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:46.725527 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1788/3552] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:46 2022] DELETE /identity/v3/projects/d8c72636d6db42cfb42f0c535863a4b2 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:46.730809 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c7417-590d-4a6c-99fd-92e58c51682d None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:46.731366 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c7417-590d-4a6c-99fd-92e58c51682d None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:46.731366 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c7417-590d-4a6c-99fd-92e58c51682d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:46.772904 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-d33c7417-590d-4a6c-99fd-92e58c51682d None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:46.774974 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d33c7417-590d-4a6c-99fd-92e58c51682d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:46.935327 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1765/3553] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:49:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:46.942693 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce368e1-807f-401a-95bb-257098838f2d None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:46.943955 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce368e1-807f-401a-95bb-257098838f2d None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:46.944384 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce368e1-807f-401a-95bb-257098838f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:47.005296 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-4ce368e1-807f-401a-95bb-257098838f2d None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:47.008637 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4ce368e1-807f-401a-95bb-257098838f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:47.028079 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1789/3554] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:49:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:47.029257 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c7417-590d-4a6c-99fd-92e58c51682d None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:47.040781 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c7417-590d-4a6c-99fd-92e58c51682d None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:47.055753 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5920a31-d9c1-45cf-b4a5-3c99433c4334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:47.058538 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5920a31-d9c1-45cf-b4a5-3c99433c4334 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:47.059005 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5920a31-d9c1-45cf-b4a5-3c99433c4334 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:47.059568 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5920a31-d9c1-45cf-b4a5-3c99433c4334 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:47.064066 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5920a31-d9c1-45cf-b4a5-3c99433c4334 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:49:47.064543 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5920a31-d9c1-45cf-b4a5-3c99433c4334 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:47.066491 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5920a31-d9c1-45cf-b4a5-3c99433c4334 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:47.095923 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1766/3555] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:49:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:49:47.100707 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce368e1-807f-401a-95bb-257098838f2d None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:47.113269 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce368e1-807f-401a-95bb-257098838f2d None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:47.129276 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f0ce51-1dea-410f-998d-d8cddfdd9758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:47.130271 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0ce51-1dea-410f-998d-d8cddfdd9758 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:47.130708 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0ce51-1dea-410f-998d-d8cddfdd9758 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:47.131197 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0ce51-1dea-410f-998d-d8cddfdd9758 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:47.132693 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f0ce51-1dea-410f-998d-d8cddfdd9758 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:47.136939 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f0ce51-1dea-410f-998d-d8cddfdd9758 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:47.225615 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1790/3556] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:49:47 2022] POST /identity/v3/projects => generated 373 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:49:47.230947 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5920a31-d9c1-45cf-b4a5-3c99433c4334 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:47.245919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5920a31-d9c1-45cf-b4a5-3c99433c4334 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:47.305214 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f0ce51-1dea-410f-998d-d8cddfdd9758 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:47.307371 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-06f0ce51-1dea-410f-998d-d8cddfdd9758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:47.402956 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd3a32-4afd-4dd1-bec4-888c121d2963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:47.403697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd3a32-4afd-4dd1-bec4-888c121d2963 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:47.403975 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd3a32-4afd-4dd1-bec4-888c121d2963 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:47.404246 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd3a32-4afd-4dd1-bec4-888c121d2963 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:47.405059 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd3a32-4afd-4dd1-bec4-888c121d2963 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:47.407493 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd3a32-4afd-4dd1-bec4-888c121d2963 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:47.435365 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1767/3557] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:49:47 2022] POST /identity/v3/users => generated 287 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:49:47.439318 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd3a32-4afd-4dd1-bec4-888c121d2963 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:47.452475 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd3a32-4afd-4dd1-bec4-888c121d2963 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:47.459534 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e511fb7-54ed-4bef-8d7e-af1526699bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:47.460251 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e511fb7-54ed-4bef-8d7e-af1526699bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:47.460609 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e511fb7-54ed-4bef-8d7e-af1526699bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:47.461006 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e511fb7-54ed-4bef-8d7e-af1526699bb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:47.461996 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e511fb7-54ed-4bef-8d7e-af1526699bb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:47.464027 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e511fb7-54ed-4bef-8d7e-af1526699bb1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:47.481262 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1768/3558] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:47 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:49:47.485028 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e511fb7-54ed-4bef-8d7e-af1526699bb1 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:47.512997 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e511fb7-54ed-4bef-8d7e-af1526699bb1 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:47.526085 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f3e76-5e8f-4fa2-841b-c431200c5f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:47.526909 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f3e76-5e8f-4fa2-841b-c431200c5f3c admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:47.527982 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f3e76-5e8f-4fa2-841b-c431200c5f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:47.529106 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f0ce51-1dea-410f-998d-d8cddfdd9758 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:47.529536 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f3e76-5e8f-4fa2-841b-c431200c5f3c admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:47.530318 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1f3e76-5e8f-4fa2-841b-c431200c5f3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:47.535474 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1f3e76-5e8f-4fa2-841b-c431200c5f3c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:47.546125 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c4736-4320-4be1-9fa7-5d0ae9d70e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:47.546804 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c4736-4320-4be1-9fa7-5d0ae9d70e45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:47.547115 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c4736-4320-4be1-9fa7-5d0ae9d70e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:47.547374 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c4736-4320-4be1-9fa7-5d0ae9d70e45 admin admin] PATH_INFO: `/v3/users/3fb56832bbeb4a74b67ba0c1f68b3aa6` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:47.548638 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830c4736-4320-4be1-9fa7-5d0ae9d70e45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fb56832bbeb4a74b67ba0c1f68b3aa6)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:47.550611 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830c4736-4320-4be1-9fa7-5d0ae9d70e45 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:47.557051 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1769/3559] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:47 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:49:47.562370 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f3e76-5e8f-4fa2-841b-c431200c5f3c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:47.587122 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f3e76-5e8f-4fa2-841b-c431200c5f3c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:47.604056 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a248f8-8006-4182-b05e-682b52e895ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:47.604822 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a248f8-8006-4182-b05e-682b52e895ff admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:47.605102 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a248f8-8006-4182-b05e-682b52e895ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:47.606875 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a248f8-8006-4182-b05e-682b52e895ff admin admin] PATH_INFO: `/v3/projects/0b9226ef51944386868307bcba62fdf7/users/6b5e922963614eac9b7432c64f3c2500/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:47.624289 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-830c4736-4320-4be1-9fa7-5d0ae9d70e45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fb56832bbeb4a74b67ba0c1f68b3aa6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:47.625246 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-830c4736-4320-4be1-9fa7-5d0ae9d70e45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fb56832bbeb4a74b67ba0c1f68b3aa6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:47.630464 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:47.635782 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a248f8-8006-4182-b05e-682b52e895ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b9226ef51944386868307bcba62fdf7, user_id=6b5e922963614eac9b7432c64f3c2500, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:47.640904 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a248f8-8006-4182-b05e-682b52e895ff admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:47.659524 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-830c4736-4320-4be1-9fa7-5d0ae9d70e45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fb56832bbeb4a74b67ba0c1f68b3aa6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:47.677826 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-830c4736-4320-4be1-9fa7-5d0ae9d70e45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fb56832bbeb4a74b67ba0c1f68b3aa6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:47.680781 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1770/3560] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:49:47 2022] PUT /identity/v3/projects/0b9226ef51944386868307bcba62fdf7/users/6b5e922963614eac9b7432c64f3c2500/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:47.688811 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3f08d-4752-45c4-8feb-909c56468e83 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:47.689097 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3f08d-4752-45c4-8feb-909c56468e83 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:47.689391 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3f08d-4752-45c4-8feb-909c56468e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:47.692586 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-830c4736-4320-4be1-9fa7-5d0ae9d70e45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fb56832bbeb4a74b67ba0c1f68b3aa6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:47.706186 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1791/3561] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:49:47 2022] DELETE /identity/v3/users/3fb56832bbeb4a74b67ba0c1f68b3aa6 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:47.724818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-18e3f08d-4752-45c4-8feb-909c56468e83 None None] MFA Rules not processed for user `6b5e922963614eac9b7432c64f3c2500`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:47.726702 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-18e3f08d-4752-45c4-8feb-909c56468e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:47.813824 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1771/3562] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:49:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:47.825422 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c4736-4320-4be1-9fa7-5d0ae9d70e45 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:47.826975 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-830c4736-4320-4be1-9fa7-5d0ae9d70e45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:47.910757 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:47.979666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c4736-4320-4be1-9fa7-5d0ae9d70e45 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:47.988179 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3b06f-2b13-436c-97c1-d060e25739f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:47.989988 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3b06f-2b13-436c-97c1-d060e25739f0 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:47.990564 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3b06f-2b13-436c-97c1-d060e25739f0 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:47.991117 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3b06f-2b13-436c-97c1-d060e25739f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:48.004248 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3b06f-2b13-436c-97c1-d060e25739f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:48.007763 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3b06f-2b13-436c-97c1-d060e25739f0 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:48.024346 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1792/3563] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:49:48.112893 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e3f08d-4752-45c4-8feb-909c56468e83 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:48.114753 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-18e3f08d-4752-45c4-8feb-909c56468e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:48.293656 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3b06f-2b13-436c-97c1-d060e25739f0 service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:48.295185 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-29f3b06f-2b13-436c-97c1-d060e25739f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:48.296087 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e3f08d-4752-45c4-8feb-909c56468e83 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:48.302244 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a490ff8-3e6d-431a-b175-f4349f175918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:48.303200 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a490ff8-3e6d-431a-b175-f4349f175918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:48.303568 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a490ff8-3e6d-431a-b175-f4349f175918 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:48.303842 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a490ff8-3e6d-431a-b175-f4349f175918 admin admin] PATH_INFO: `/v3/projects/7ff0e0f8d06044de8b8be818bc760176` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:48.305062 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a490ff8-3e6d-431a-b175-f4349f175918 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ff0e0f8d06044de8b8be818bc760176)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:48.307882 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a490ff8-3e6d-431a-b175-f4349f175918 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:48.310153 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3b06f-2b13-436c-97c1-d060e25739f0 service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:48.315449 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a2cc2e-e89f-44b2-939b-9e82196986d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:48.316968 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2cc2e-e89f-44b2-939b-9e82196986d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:48.317318 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2cc2e-e89f-44b2-939b-9e82196986d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:48.317665 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2cc2e-e89f-44b2-939b-9e82196986d9 admin admin] PATH_INFO: `/v3/users/6b5e922963614eac9b7432c64f3c2500` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:48.318936 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a2cc2e-e89f-44b2-939b-9e82196986d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b5e922963614eac9b7432c64f3c2500)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:48.320977 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a2cc2e-e89f-44b2-939b-9e82196986d9 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:48.379936 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7a490ff8-3e6d-431a-b175-f4349f175918 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ff0e0f8d06044de8b8be818bc760176', 'request_id': 'req-7a490ff8-3e6d-431a-b175-f4349f175918'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:48.389619 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7a490ff8-3e6d-431a-b175-f4349f175918 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ff0e0f8d06044de8b8be818bc760176', 'request_id': 'req-7a490ff8-3e6d-431a-b175-f4349f175918'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:48.397463 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7a490ff8-3e6d-431a-b175-f4349f175918 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ff0e0f8d06044de8b8be818bc760176', 'request_id': 'req-7a490ff8-3e6d-431a-b175-f4349f175918'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:48.399850 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-19a2cc2e-e89f-44b2-939b-9e82196986d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b5e922963614eac9b7432c64f3c2500'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:48.401591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-19a2cc2e-e89f-44b2-939b-9e82196986d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b5e922963614eac9b7432c64f3c2500'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:48.414908 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7a490ff8-3e6d-431a-b175-f4349f175918 admin admin] The token cache is being invalidate because project 7ff0e0f8d06044de8b8be818bc760176 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:49:48.415250 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7a490ff8-3e6d-431a-b175-f4349f175918 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:48.415986 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7a490ff8-3e6d-431a-b175-f4349f175918 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:48.419080 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1772/3564] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:48 2022] DELETE /identity/v3/projects/7ff0e0f8d06044de8b8be818bc760176 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:48.424732 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0e3b3-ad20-4e83-8dc4-9031c62e0541 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:48.424944 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-19a2cc2e-e89f-44b2-939b-9e82196986d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b5e922963614eac9b7432c64f3c2500'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:48.425198 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0e3b3-ad20-4e83-8dc4-9031c62e0541 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:48.425474 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0e3b3-ad20-4e83-8dc4-9031c62e0541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:48.438440 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-19a2cc2e-e89f-44b2-939b-9e82196986d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b5e922963614eac9b7432c64f3c2500'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:48.451873 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-19a2cc2e-e89f-44b2-939b-9e82196986d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b5e922963614eac9b7432c64f3c2500'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:48.458898 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1793/3565] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:49:48 2022] DELETE /identity/v3/users/6b5e922963614eac9b7432c64f3c2500 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:49:48.459197 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-c3c0e3b3-ad20-4e83-8dc4-9031c62e0541 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:48.460497 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c3c0e3b3-ad20-4e83-8dc4-9031c62e0541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:48.463696 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87428fb7-aeed-49aa-810c-3ba8f754e98d None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:48.464025 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87428fb7-aeed-49aa-810c-3ba8f754e98d None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:48.464306 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87428fb7-aeed-49aa-810c-3ba8f754e98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:48.467254 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:48.486099 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-87428fb7-aeed-49aa-810c-3ba8f754e98d None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:48.487896 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-87428fb7-aeed-49aa-810c-3ba8f754e98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:48.558366 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1773/3566] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:49:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:48.561923 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1794/3567] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:49:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:49:48.566278 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6651a-51bc-4adc-8bc1-8de394dbb01a None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:48.566602 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6651a-51bc-4adc-8bc1-8de394dbb01a None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:48.566910 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6651a-51bc-4adc-8bc1-8de394dbb01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:48.569287 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87428fb7-aeed-49aa-810c-3ba8f754e98d None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:48.570742 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-87428fb7-aeed-49aa-810c-3ba8f754e98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:48.589664 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-84e6651a-51bc-4adc-8bc1-8de394dbb01a None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:48.590873 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-84e6651a-51bc-4adc-8bc1-8de394dbb01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:48.599158 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1774/3568] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:49:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:49:48.603115 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6651a-51bc-4adc-8bc1-8de394dbb01a None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:48.615522 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6651a-51bc-4adc-8bc1-8de394dbb01a None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:48.621236 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f895db-fa0e-46c9-aee8-649232d27a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:48.622112 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f895db-fa0e-46c9-aee8-649232d27a08 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:48.622407 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f895db-fa0e-46c9-aee8-649232d27a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:48.622680 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f895db-fa0e-46c9-aee8-649232d27a08 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:48.623526 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f895db-fa0e-46c9-aee8-649232d27a08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:49:48.623838 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f895db-fa0e-46c9-aee8-649232d27a08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:48.625649 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f895db-fa0e-46c9-aee8-649232d27a08 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:48.626194 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:48.641822 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1775/3569] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:49:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:49:48.645394 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87428fb7-aeed-49aa-810c-3ba8f754e98d None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:48.645860 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f895db-fa0e-46c9-aee8-649232d27a08 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:48.652180 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b17208-83e3-4610-9dfa-5e3ea03a704d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:48.653265 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b17208-83e3-4610-9dfa-5e3ea03a704d service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:48.653832 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b17208-83e3-4610-9dfa-5e3ea03a704d service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:48.654370 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b17208-83e3-4610-9dfa-5e3ea03a704d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:48.661234 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f895db-fa0e-46c9-aee8-649232d27a08 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:48.667956 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad2690-544b-443d-ba9f-1acb31e791c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:48.668982 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad2690-544b-443d-ba9f-1acb31e791c2 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:48.669473 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad2690-544b-443d-ba9f-1acb31e791c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:48.669908 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad2690-544b-443d-ba9f-1acb31e791c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:48.670915 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad2690-544b-443d-ba9f-1acb31e791c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:48.673558 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad2690-544b-443d-ba9f-1acb31e791c2 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:48.679155 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b17208-83e3-4610-9dfa-5e3ea03a704d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:48.682440 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b17208-83e3-4610-9dfa-5e3ea03a704d service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:48.715925 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1795/3570] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:49:48.749171 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1776/3571] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:49:48 2022] POST /identity/v3/projects => generated 397 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:49:48.750457 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b17208-83e3-4610-9dfa-5e3ea03a704d service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:48.764102 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b17208-83e3-4610-9dfa-5e3ea03a704d service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:48.839555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ace4d-d7a9-4c47-a0ec-7f9e1e639c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:48.840279 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ace4d-d7a9-4c47-a0ec-7f9e1e639c5c admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:48.840678 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ace4d-d7a9-4c47-a0ec-7f9e1e639c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:48.841066 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ace4d-d7a9-4c47-a0ec-7f9e1e639c5c admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:48.841874 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966ace4d-d7a9-4c47-a0ec-7f9e1e639c5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:48.844328 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966ace4d-d7a9-4c47-a0ec-7f9e1e639c5c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:48.880334 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1796/3572] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:49:48 2022] POST /identity/v3/users => generated 299 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:49:48.883935 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad2690-544b-443d-ba9f-1acb31e791c2 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:48.899716 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad2690-544b-443d-ba9f-1acb31e791c2 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:48.904958 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda9704e-f311-4bcd-b9b4-254022d9e22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:48.905817 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9704e-f311-4bcd-b9b4-254022d9e22f admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:48.906032 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9704e-f311-4bcd-b9b4-254022d9e22f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:48.906331 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9704e-f311-4bcd-b9b4-254022d9e22f admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:48.906957 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda9704e-f311-4bcd-b9b4-254022d9e22f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:48.909546 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda9704e-f311-4bcd-b9b4-254022d9e22f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:48.922627 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1777/3573] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:49:48.926353 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ace4d-d7a9-4c47-a0ec-7f9e1e639c5c admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:48.939488 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ace4d-d7a9-4c47-a0ec-7f9e1e639c5c admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:48.946512 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84871eca-8916-4c22-b429-bb852b19cebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:48.948157 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84871eca-8916-4c22-b429-bb852b19cebb admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:48.949088 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84871eca-8916-4c22-b429-bb852b19cebb admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:48.949088 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84871eca-8916-4c22-b429-bb852b19cebb admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:48.949792 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84871eca-8916-4c22-b429-bb852b19cebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:48.952196 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84871eca-8916-4c22-b429-bb852b19cebb admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:48.974666 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1797/3574] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:49:48.975042 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda9704e-f311-4bcd-b9b4-254022d9e22f admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:48.982873 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda9704e-f311-4bcd-b9b4-254022d9e22f admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:48.995934 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d1476-0c69-4e67-90b3-0e5784d330ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:48.996838 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d1476-0c69-4e67-90b3-0e5784d330ea admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:48.997437 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d1476-0c69-4e67-90b3-0e5784d330ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:48.997871 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d1476-0c69-4e67-90b3-0e5784d330ea admin admin] PATH_INFO: `/v3/projects/6f2f45b5051c4899a770a38958c70caa/users/ea31195933be4477a588150bb1f67822/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:49.057008 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d1476-0c69-4e67-90b3-0e5784d330ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f2f45b5051c4899a770a38958c70caa, user_id=ea31195933be4477a588150bb1f67822, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:49.060266 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d1476-0c69-4e67-90b3-0e5784d330ea admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:49.102594 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1778/3575] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:49:48 2022] PUT /identity/v3/projects/6f2f45b5051c4899a770a38958c70caa/users/ea31195933be4477a588150bb1f67822/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:49.107990 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020e0f8-2eb0-404e-9f0a-b30c832bf2e3 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:49.108270 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020e0f8-2eb0-404e-9f0a-b30c832bf2e3 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:49.108662 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020e0f8-2eb0-404e-9f0a-b30c832bf2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:49.180595 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-8020e0f8-2eb0-404e-9f0a-b30c832bf2e3 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:49.186411 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8020e0f8-2eb0-404e-9f0a-b30c832bf2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:49.363976 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1798/3576] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:49:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:49.381874 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d1476-0c69-4e67-90b3-0e5784d330ea admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:49.384128 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6f9d1476-0c69-4e67-90b3-0e5784d330ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:49.497812 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d1476-0c69-4e67-90b3-0e5784d330ea admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:49.501554 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63037ca6-4309-43ce-a7ff-4632ed3aeaf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:49.502167 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63037ca6-4309-43ce-a7ff-4632ed3aeaf3 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:49.502440 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63037ca6-4309-43ce-a7ff-4632ed3aeaf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:49.502709 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63037ca6-4309-43ce-a7ff-4632ed3aeaf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:49.523152 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63037ca6-4309-43ce-a7ff-4632ed3aeaf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:49.524990 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63037ca6-4309-43ce-a7ff-4632ed3aeaf3 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:49.544524 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1779/3577] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:49:49.799578 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8020e0f8-2eb0-404e-9f0a-b30c832bf2e3 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:49.801190 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8020e0f8-2eb0-404e-9f0a-b30c832bf2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:49.816375 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8020e0f8-2eb0-404e-9f0a-b30c832bf2e3 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:49.823245 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d942f9-d46c-4747-8898-35f87a51f2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:49.823900 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d942f9-d46c-4747-8898-35f87a51f2f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:49.824730 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d942f9-d46c-4747-8898-35f87a51f2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:49.824730 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d942f9-d46c-4747-8898-35f87a51f2f9 admin admin] PATH_INFO: `/v3/projects/0b9226ef51944386868307bcba62fdf7` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:49.825718 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d942f9-d46c-4747-8898-35f87a51f2f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b9226ef51944386868307bcba62fdf7)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:49.827801 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d942f9-d46c-4747-8898-35f87a51f2f9 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:49.902609 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-90d942f9-d46c-4747-8898-35f87a51f2f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b9226ef51944386868307bcba62fdf7', 'request_id': 'req-90d942f9-d46c-4747-8898-35f87a51f2f9'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:49.906899 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:49.912439 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-90d942f9-d46c-4747-8898-35f87a51f2f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b9226ef51944386868307bcba62fdf7', 'request_id': 'req-90d942f9-d46c-4747-8898-35f87a51f2f9'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:49.927614 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-90d942f9-d46c-4747-8898-35f87a51f2f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b9226ef51944386868307bcba62fdf7', 'request_id': 'req-90d942f9-d46c-4747-8898-35f87a51f2f9'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:49.952186 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-90d942f9-d46c-4747-8898-35f87a51f2f9 admin admin] The token cache is being invalidate because project 0b9226ef51944386868307bcba62fdf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:49:49.952618 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-90d942f9-d46c-4747-8898-35f87a51f2f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:49.953500 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-90d942f9-d46c-4747-8898-35f87a51f2f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:49.955442 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1799/3578] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:49 2022] DELETE /identity/v3/projects/0b9226ef51944386868307bcba62fdf7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:49.960080 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf848e9-3595-4b75-a62d-af36f62ba656 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:49.961632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf848e9-3595-4b75-a62d-af36f62ba656 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:49.962131 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf848e9-3595-4b75-a62d-af36f62ba656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:49.987652 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-2bf848e9-3595-4b75-a62d-af36f62ba656 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:49.989274 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2bf848e9-3595-4b75-a62d-af36f62ba656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:50.037929 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:50.107115 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2699a67-b385-4b37-8564-4ccbd614d9df None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:50.107316 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1780/3579] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:49:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:50.107445 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2699a67-b385-4b37-8564-4ccbd614d9df None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:50.107669 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2699a67-b385-4b37-8564-4ccbd614d9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:50.168902 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-c2699a67-b385-4b37-8564-4ccbd614d9df None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:50.170390 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c2699a67-b385-4b37-8564-4ccbd614d9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:50.191984 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1800/3580] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:49:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:49:50.197153 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf848e9-3595-4b75-a62d-af36f62ba656 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:50.214793 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf848e9-3595-4b75-a62d-af36f62ba656 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:50.232844 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24b678-a8ba-44d6-bb17-09ac97e25f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:50.233318 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24b678-a8ba-44d6-bb17-09ac97e25f23 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:50.233682 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24b678-a8ba-44d6-bb17-09ac97e25f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:50.234022 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24b678-a8ba-44d6-bb17-09ac97e25f23 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:50.234924 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd24b678-a8ba-44d6-bb17-09ac97e25f23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:49:50.235326 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd24b678-a8ba-44d6-bb17-09ac97e25f23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:50.238728 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd24b678-a8ba-44d6-bb17-09ac97e25f23 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:50.267484 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1781/3581] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:49:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:49:50.273987 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2699a67-b385-4b37-8564-4ccbd614d9df None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:50.293575 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2699a67-b385-4b37-8564-4ccbd614d9df None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:50.314976 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb93f10-591d-4736-9579-42e133d307dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:50.315671 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb93f10-591d-4736-9579-42e133d307dd admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:50.315956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb93f10-591d-4736-9579-42e133d307dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:50.316232 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb93f10-591d-4736-9579-42e133d307dd admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:50.316893 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb93f10-591d-4736-9579-42e133d307dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:50.318868 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb93f10-591d-4736-9579-42e133d307dd admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:50.394659 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1801/3582] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:49:50 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:49:50.396044 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24b678-a8ba-44d6-bb17-09ac97e25f23 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:50.423272 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24b678-a8ba-44d6-bb17-09ac97e25f23 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:50.645571 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff16aef-e358-4faf-823d-35fd049460b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:50.647713 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff16aef-e358-4faf-823d-35fd049460b0 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:50.649009 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff16aef-e358-4faf-823d-35fd049460b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:50.649009 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff16aef-e358-4faf-823d-35fd049460b0 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:50.651236 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff16aef-e358-4faf-823d-35fd049460b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:50.663243 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff16aef-e358-4faf-823d-35fd049460b0 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:50.711833 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1782/3583] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:49:50 2022] POST /identity/v3/users => generated 293 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:49:50.717178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb93f10-591d-4736-9579-42e133d307dd admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:50.734063 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb93f10-591d-4736-9579-42e133d307dd admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:50.745529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093c0ce-fd41-4be5-b181-d4d0fb3c4428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:50.745529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093c0ce-fd41-4be5-b181-d4d0fb3c4428 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:50.745529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093c0ce-fd41-4be5-b181-d4d0fb3c4428 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:50.745529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093c0ce-fd41-4be5-b181-d4d0fb3c4428 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:50.746265 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0093c0ce-fd41-4be5-b181-d4d0fb3c4428 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:50.746809 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0093c0ce-fd41-4be5-b181-d4d0fb3c4428 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:50.768024 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1802/3584] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:49:50.772039 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff16aef-e358-4faf-823d-35fd049460b0 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:50.784968 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff16aef-e358-4faf-823d-35fd049460b0 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:50.791682 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a3a26-adbf-41ae-84fd-ecfd8dcc60fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:50.795110 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a3a26-adbf-41ae-84fd-ecfd8dcc60fa admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:50.795110 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a3a26-adbf-41ae-84fd-ecfd8dcc60fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:50.795110 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a3a26-adbf-41ae-84fd-ecfd8dcc60fa admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:50.795110 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a3a26-adbf-41ae-84fd-ecfd8dcc60fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:50.796818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a3a26-adbf-41ae-84fd-ecfd8dcc60fa admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:50.813573 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1783/3585] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:49:50.818286 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093c0ce-fd41-4be5-b181-d4d0fb3c4428 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:50.872536 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093c0ce-fd41-4be5-b181-d4d0fb3c4428 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:50.895856 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73027207-f636-4723-9b78-61d97a58640b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:50.896942 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73027207-f636-4723-9b78-61d97a58640b admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:50.897368 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73027207-f636-4723-9b78-61d97a58640b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:50.897831 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73027207-f636-4723-9b78-61d97a58640b admin admin] PATH_INFO: `/v3/projects/4ad98a291c274a0397f8e496f3f4d13b/users/e2438498746744e69065723b725b493d/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:50.941479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73027207-f636-4723-9b78-61d97a58640b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ad98a291c274a0397f8e496f3f4d13b, user_id=e2438498746744e69065723b725b493d, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:50.945383 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73027207-f636-4723-9b78-61d97a58640b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:51.017949 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889240e-2eca-4d80-9591-98de8b7ba388 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:51.017949 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889240e-2eca-4d80-9591-98de8b7ba388 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:51.017949 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889240e-2eca-4d80-9591-98de8b7ba388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:51.019083 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1803/3586] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:49:50 2022] PUT /identity/v3/projects/4ad98a291c274a0397f8e496f3f4d13b/users/e2438498746744e69065723b725b493d/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:51.087857 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-6889240e-2eca-4d80-9591-98de8b7ba388 None None] MFA Rules not processed for user `e2438498746744e69065723b725b493d`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:51.091527 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6889240e-2eca-4d80-9591-98de8b7ba388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:51.326723 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1784/3587] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:49:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:51.343119 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73027207-f636-4723-9b78-61d97a58640b admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:51.344989 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-73027207-f636-4723-9b78-61d97a58640b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:51.523734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73027207-f636-4723-9b78-61d97a58640b admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:51.531012 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5354904-49ca-4067-a04a-e3b2036c6c1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:51.531675 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5354904-49ca-4067-a04a-e3b2036c6c1a service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:51.531956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5354904-49ca-4067-a04a-e3b2036c6c1a service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:51.532379 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5354904-49ca-4067-a04a-e3b2036c6c1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:51.566316 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5354904-49ca-4067-a04a-e3b2036c6c1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:51.568194 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5354904-49ca-4067-a04a-e3b2036c6c1a service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:51.612980 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1804/3588] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:49:53.156630 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6889240e-2eca-4d80-9591-98de8b7ba388 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:53.223550 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:53.303015 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6889240e-2eca-4d80-9591-98de8b7ba388 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:53.317436 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7eb42-3f17-4092-a35b-e63d6209b95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:53.318105 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7eb42-3f17-4092-a35b-e63d6209b95b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:53.318382 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7eb42-3f17-4092-a35b-e63d6209b95b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:53.318653 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7eb42-3f17-4092-a35b-e63d6209b95b admin admin] PATH_INFO: `/v3/users/e2438498746744e69065723b725b493d` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:53.322595 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7eb42-3f17-4092-a35b-e63d6209b95b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2438498746744e69065723b725b493d)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:53.325431 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7eb42-3f17-4092-a35b-e63d6209b95b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:53.427469 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-85a7eb42-3f17-4092-a35b-e63d6209b95b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2438498746744e69065723b725b493d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:53.428146 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-85a7eb42-3f17-4092-a35b-e63d6209b95b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2438498746744e69065723b725b493d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:53.442087 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-85a7eb42-3f17-4092-a35b-e63d6209b95b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2438498746744e69065723b725b493d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:53.456332 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-85a7eb42-3f17-4092-a35b-e63d6209b95b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2438498746744e69065723b725b493d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:53.457044 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-85a7eb42-3f17-4092-a35b-e63d6209b95b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2438498746744e69065723b725b493d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:53.502502 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1785/3589] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:49:53 2022] DELETE /identity/v3/users/e2438498746744e69065723b725b493d => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:53.502852 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95be8fe-ed38-4d34-89c0-108d079acd46 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:53.502852 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95be8fe-ed38-4d34-89c0-108d079acd46 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:53.502852 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95be8fe-ed38-4d34-89c0-108d079acd46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:53.527767 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-e95be8fe-ed38-4d34-89c0-108d079acd46 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:53.529323 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e95be8fe-ed38-4d34-89c0-108d079acd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:53.620683 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1805/3590] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:49:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:53.649281 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7eb42-3f17-4092-a35b-e63d6209b95b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:53.662843 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-85a7eb42-3f17-4092-a35b-e63d6209b95b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:53.875415 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7eb42-3f17-4092-a35b-e63d6209b95b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:53.880158 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b7b67-938a-443d-8a8c-ff05d3d13b8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:53.880858 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b7b67-938a-443d-8a8c-ff05d3d13b8d service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:53.881184 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b7b67-938a-443d-8a8c-ff05d3d13b8d service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:53.881945 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b7b67-938a-443d-8a8c-ff05d3d13b8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:53.896929 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3b7b67-938a-443d-8a8c-ff05d3d13b8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:53.898737 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3b7b67-938a-443d-8a8c-ff05d3d13b8d service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:53.921221 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1786/3591] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:49:54.719002 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95be8fe-ed38-4d34-89c0-108d079acd46 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:54.721556 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e95be8fe-ed38-4d34-89c0-108d079acd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:54.748541 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:54.768379 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95be8fe-ed38-4d34-89c0-108d079acd46 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:54.792610 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b2765-8d26-4c33-8b7d-dfb010ec492c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:54.793537 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b2765-8d26-4c33-8b7d-dfb010ec492c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:54.793819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b2765-8d26-4c33-8b7d-dfb010ec492c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:54.794097 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b2765-8d26-4c33-8b7d-dfb010ec492c admin admin] PATH_INFO: `/v3/projects/4ad98a291c274a0397f8e496f3f4d13b` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:54.795371 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b2765-8d26-4c33-8b7d-dfb010ec492c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ad98a291c274a0397f8e496f3f4d13b)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:54.797308 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b2765-8d26-4c33-8b7d-dfb010ec492c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:54.919447 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c47b2765-8d26-4c33-8b7d-dfb010ec492c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ad98a291c274a0397f8e496f3f4d13b', 'request_id': 'req-c47b2765-8d26-4c33-8b7d-dfb010ec492c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:54.937663 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c47b2765-8d26-4c33-8b7d-dfb010ec492c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ad98a291c274a0397f8e496f3f4d13b', 'request_id': 'req-c47b2765-8d26-4c33-8b7d-dfb010ec492c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:54.958670 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c47b2765-8d26-4c33-8b7d-dfb010ec492c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ad98a291c274a0397f8e496f3f4d13b', 'request_id': 'req-c47b2765-8d26-4c33-8b7d-dfb010ec492c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:54.995436 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c47b2765-8d26-4c33-8b7d-dfb010ec492c admin admin] The token cache is being invalidate because project 4ad98a291c274a0397f8e496f3f4d13b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:49:54.995662 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c47b2765-8d26-4c33-8b7d-dfb010ec492c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:54.997556 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c47b2765-8d26-4c33-8b7d-dfb010ec492c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:55.000899 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1806/3592] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:54 2022] DELETE /identity/v3/projects/4ad98a291c274a0397f8e496f3f4d13b => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:55.005881 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45d330-0f3e-4863-95ec-fc18979d79e2 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:55.006728 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45d330-0f3e-4863-95ec-fc18979d79e2 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:55.007205 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45d330-0f3e-4863-95ec-fc18979d79e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:55.062804 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-ea45d330-0f3e-4863-95ec-fc18979d79e2 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:55.064092 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ea45d330-0f3e-4863-95ec-fc18979d79e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:55.157061 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:55.174758 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1787/3593] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:49:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:55.183249 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6e5f4-3fad-4cfc-bed5-aa653d2b881b None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:55.183904 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6e5f4-3fad-4cfc-bed5-aa653d2b881b None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:55.184551 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6e5f4-3fad-4cfc-bed5-aa653d2b881b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:55.209204 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-b1c6e5f4-3fad-4cfc-bed5-aa653d2b881b None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:55.210848 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b1c6e5f4-3fad-4cfc-bed5-aa653d2b881b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:55.225715 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1807/3594] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:49:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:55.229638 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45d330-0f3e-4863-95ec-fc18979d79e2 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:55.244386 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45d330-0f3e-4863-95ec-fc18979d79e2 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:55.253999 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46fe5bd-bb71-4f34-a9e7-7ae35d2220bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:55.254825 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46fe5bd-bb71-4f34-a9e7-7ae35d2220bc admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:55.255365 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46fe5bd-bb71-4f34-a9e7-7ae35d2220bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:55.255855 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46fe5bd-bb71-4f34-a9e7-7ae35d2220bc admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:55.256846 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46fe5bd-bb71-4f34-a9e7-7ae35d2220bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:49:55.257836 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46fe5bd-bb71-4f34-a9e7-7ae35d2220bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:55.261234 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46fe5bd-bb71-4f34-a9e7-7ae35d2220bc admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:55.279629 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1788/3595] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:49:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:49:55.284507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6e5f4-3fad-4cfc-bed5-aa653d2b881b None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:55.300263 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6e5f4-3fad-4cfc-bed5-aa653d2b881b None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:55.316561 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7c7de-836c-4449-8240-977ff1841fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:55.317502 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7c7de-836c-4449-8240-977ff1841fee admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:55.317937 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7c7de-836c-4449-8240-977ff1841fee admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:55.318377 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7c7de-836c-4449-8240-977ff1841fee admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:55.319214 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e7c7de-836c-4449-8240-977ff1841fee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:55.323524 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e7c7de-836c-4449-8240-977ff1841fee admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:55.386744 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1808/3596] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:49:55 2022] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:49:55.390773 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46fe5bd-bb71-4f34-a9e7-7ae35d2220bc admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:55.404077 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46fe5bd-bb71-4f34-a9e7-7ae35d2220bc admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:55.527428 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062ced8-35ee-43a1-87a8-ab5bbff03264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:55.528075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062ced8-35ee-43a1-87a8-ab5bbff03264 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:55.530391 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062ced8-35ee-43a1-87a8-ab5bbff03264 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:55.530733 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062ced8-35ee-43a1-87a8-ab5bbff03264 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:55.531432 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b062ced8-35ee-43a1-87a8-ab5bbff03264 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:55.537334 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b062ced8-35ee-43a1-87a8-ab5bbff03264 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:55.596200 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1789/3597] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:49:55 2022] POST /identity/v3/users => generated 288 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:49:55.599591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7c7de-836c-4449-8240-977ff1841fee admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:55.601390 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-67e7c7de-836c-4449-8240-977ff1841fee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:55.606684 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062ced8-35ee-43a1-87a8-ab5bbff03264 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:55.625946 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7c7de-836c-4449-8240-977ff1841fee admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:55.631419 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062ced8-35ee-43a1-87a8-ab5bbff03264 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:55.657784 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea500f3-c292-47b4-ac09-09627101dfdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:55.658449 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea500f3-c292-47b4-ac09-09627101dfdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:55.658729 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea500f3-c292-47b4-ac09-09627101dfdd admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:55.659002 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea500f3-c292-47b4-ac09-09627101dfdd admin admin] PATH_INFO: `/v3/users/5a0d010ab0524a1a93a92821e4b43e67` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:55.660894 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea500f3-c292-47b4-ac09-09627101dfdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a0d010ab0524a1a93a92821e4b43e67)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:55.662861 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea500f3-c292-47b4-ac09-09627101dfdd admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:55.665078 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97897020-d68d-466e-aed6-0531a9b8e7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:55.666241 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97897020-d68d-466e-aed6-0531a9b8e7ae admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:55.666521 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97897020-d68d-466e-aed6-0531a9b8e7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:55.666791 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97897020-d68d-466e-aed6-0531a9b8e7ae admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:55.667712 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97897020-d68d-466e-aed6-0531a9b8e7ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:55.669343 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97897020-d68d-466e-aed6-0531a9b8e7ae admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:55.713759 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1790/3598] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:49:55.714736 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97897020-d68d-466e-aed6-0531a9b8e7ae admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:55.740507 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97897020-d68d-466e-aed6-0531a9b8e7ae admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:55.748178 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4f892-40ba-4a0a-9c2d-029860216ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:55.748968 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4f892-40ba-4a0a-9c2d-029860216ded admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:55.749485 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4f892-40ba-4a0a-9c2d-029860216ded admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:55.749650 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4f892-40ba-4a0a-9c2d-029860216ded admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:55.750842 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a4f892-40ba-4a0a-9c2d-029860216ded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:55.753149 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a4f892-40ba-4a0a-9c2d-029860216ded admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:55.770250 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1791/3599] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:49:55.776445 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4f892-40ba-4a0a-9c2d-029860216ded admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:55.788369 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8ea500f3-c292-47b4-ac09-09627101dfdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a0d010ab0524a1a93a92821e4b43e67'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:55.789802 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8ea500f3-c292-47b4-ac09-09627101dfdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a0d010ab0524a1a93a92821e4b43e67'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:55.797502 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4f892-40ba-4a0a-9c2d-029860216ded admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:55.812161 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5097208-f4bf-423b-901a-36ee4934d0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:55.812901 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5097208-f4bf-423b-901a-36ee4934d0b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:55.813284 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5097208-f4bf-423b-901a-36ee4934d0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:55.813566 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5097208-f4bf-423b-901a-36ee4934d0b2 admin admin] PATH_INFO: `/v3/projects/75d361eb1cce4fb08e7947c1470cdeb6/users/28d34b8794c642fab7dda0d0e1b9b2f8/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:55.855735 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8ea500f3-c292-47b4-ac09-09627101dfdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a0d010ab0524a1a93a92821e4b43e67'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:55.887540 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8ea500f3-c292-47b4-ac09-09627101dfdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a0d010ab0524a1a93a92821e4b43e67'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:55.895347 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5097208-f4bf-423b-901a-36ee4934d0b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75d361eb1cce4fb08e7947c1470cdeb6, user_id=28d34b8794c642fab7dda0d0e1b9b2f8, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:55.918681 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5097208-f4bf-423b-901a-36ee4934d0b2 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:55.924635 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8ea500f3-c292-47b4-ac09-09627101dfdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a0d010ab0524a1a93a92821e4b43e67'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:55.934631 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1809/3600] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:49:55 2022] DELETE /identity/v3/users/5a0d010ab0524a1a93a92821e4b43e67 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:55.939473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993194f3-e367-4dab-a969-036c05d612f5 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:55.940116 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993194f3-e367-4dab-a969-036c05d612f5 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:55.940663 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993194f3-e367-4dab-a969-036c05d612f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:55.958720 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1792/3601] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:49:55 2022] PUT /identity/v3/projects/75d361eb1cce4fb08e7947c1470cdeb6/users/28d34b8794c642fab7dda0d0e1b9b2f8/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:55.960555 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a9405-f697-4bc9-9019-b902c2a0d099 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:55.960873 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a9405-f697-4bc9-9019-b902c2a0d099 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:55.961151 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a9405-f697-4bc9-9019-b902c2a0d099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:55.982203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-993194f3-e367-4dab-a969-036c05d612f5 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:55.983523 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-993194f3-e367-4dab-a969-036c05d612f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:56.021701 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-963a9405-f697-4bc9-9019-b902c2a0d099 None None] MFA Rules not processed for user `28d34b8794c642fab7dda0d0e1b9b2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:56.027536 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-963a9405-f697-4bc9-9019-b902c2a0d099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:56.031209 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:56.100950 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1810/3602] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:49:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:56.110732 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993194f3-e367-4dab-a969-036c05d612f5 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:56.112794 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-993194f3-e367-4dab-a969-036c05d612f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:56.219979 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1793/3603] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:49:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:49:56.284113 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993194f3-e367-4dab-a969-036c05d612f5 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:56.295749 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2f31f-7304-4176-a26f-caf01c484b3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:56.297397 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2f31f-7304-4176-a26f-caf01c484b3f service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:56.297852 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2f31f-7304-4176-a26f-caf01c484b3f service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:56.299793 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2f31f-7304-4176-a26f-caf01c484b3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:56.327876 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a2f31f-7304-4176-a26f-caf01c484b3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:56.330506 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a2f31f-7304-4176-a26f-caf01c484b3f service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:56.373698 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1811/3604] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:49:56.644039 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a9405-f697-4bc9-9019-b902c2a0d099 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:56.645712 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-963a9405-f697-4bc9-9019-b902c2a0d099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:56.687190 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:56.887049 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a9405-f697-4bc9-9019-b902c2a0d099 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:56.893526 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745eed7-ca9d-410d-9728-e47f1ef8a061 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:56.894248 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745eed7-ca9d-410d-9728-e47f1ef8a061 service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:56.894463 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745eed7-ca9d-410d-9728-e47f1ef8a061 service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:56.894742 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745eed7-ca9d-410d-9728-e47f1ef8a061 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:56.901809 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3745eed7-ca9d-410d-9728-e47f1ef8a061 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:56.936868 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3745eed7-ca9d-410d-9728-e47f1ef8a061 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:56.938510 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3745eed7-ca9d-410d-9728-e47f1ef8a061 service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:56.979829 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2f31f-7304-4176-a26f-caf01c484b3f service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:56.980455 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1794/3605] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:49:56.985233 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-68a2f31f-7304-4176-a26f-caf01c484b3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:57.196305 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2f31f-7304-4176-a26f-caf01c484b3f service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:57.217933 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b570acc6-cee1-4ba6-b116-933379c85364 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:57.221491 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570acc6-cee1-4ba6-b116-933379c85364 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:57.223188 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570acc6-cee1-4ba6-b116-933379c85364 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:57.224118 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570acc6-cee1-4ba6-b116-933379c85364 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:57.248061 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b570acc6-cee1-4ba6-b116-933379c85364 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:57.254530 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b570acc6-cee1-4ba6-b116-933379c85364 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:57.296977 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1812/3606] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:49:57.680335 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745eed7-ca9d-410d-9728-e47f1ef8a061 service placement] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:57.682628 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3745eed7-ca9d-410d-9728-e47f1ef8a061 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:57.696405 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745eed7-ca9d-410d-9728-e47f1ef8a061 service placement] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:57.701491 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4a942-8331-4dcf-8550-1a638fe24ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:57.702382 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4a942-8331-4dcf-8550-1a638fe24ba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:57.702819 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4a942-8331-4dcf-8550-1a638fe24ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:57.703288 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4a942-8331-4dcf-8550-1a638fe24ba7 admin admin] PATH_INFO: `/v3/projects/5d9ee7e4ec4d4690b901fe6354191dec` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:57.704611 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb4a942-8331-4dcf-8550-1a638fe24ba7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d9ee7e4ec4d4690b901fe6354191dec)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:57.707636 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb4a942-8331-4dcf-8550-1a638fe24ba7 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:57.798775 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-bfb4a942-8331-4dcf-8550-1a638fe24ba7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d9ee7e4ec4d4690b901fe6354191dec', 'request_id': 'req-bfb4a942-8331-4dcf-8550-1a638fe24ba7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:57.807899 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-bfb4a942-8331-4dcf-8550-1a638fe24ba7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d9ee7e4ec4d4690b901fe6354191dec', 'request_id': 'req-bfb4a942-8331-4dcf-8550-1a638fe24ba7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:57.818361 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-bfb4a942-8331-4dcf-8550-1a638fe24ba7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d9ee7e4ec4d4690b901fe6354191dec', 'request_id': 'req-bfb4a942-8331-4dcf-8550-1a638fe24ba7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:57.872932 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-bfb4a942-8331-4dcf-8550-1a638fe24ba7 admin admin] The token cache is being invalidate because project 5d9ee7e4ec4d4690b901fe6354191dec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:49:57.873699 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-bfb4a942-8331-4dcf-8550-1a638fe24ba7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:57.875316 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-bfb4a942-8331-4dcf-8550-1a638fe24ba7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:57.879779 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1795/3607] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:57 2022] DELETE /identity/v3/projects/5d9ee7e4ec4d4690b901fe6354191dec => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:57.884978 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ccdc1-f2b6-4023-abce-493acebb2d35 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:57.885320 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ccdc1-f2b6-4023-abce-493acebb2d35 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:57.885593 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ccdc1-f2b6-4023-abce-493acebb2d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:57.924273 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-e57ccdc1-f2b6-4023-abce-493acebb2d35 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:57.928415 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e57ccdc1-f2b6-4023-abce-493acebb2d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:58.062597 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:58.089150 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1813/3608] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:49:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:58.090706 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a938d9c-67fe-4fab-81e0-18d28fc8ffc0 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:58.090938 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a938d9c-67fe-4fab-81e0-18d28fc8ffc0 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:58.091653 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a938d9c-67fe-4fab-81e0-18d28fc8ffc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:58.137265 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-5a938d9c-67fe-4fab-81e0-18d28fc8ffc0 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:58.139010 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5a938d9c-67fe-4fab-81e0-18d28fc8ffc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:58.153089 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1796/3609] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:49:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:58.154428 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ccdc1-f2b6-4023-abce-493acebb2d35 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:58.168053 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ccdc1-f2b6-4023-abce-493acebb2d35 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:58.174953 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b739af4-f8f0-4e0c-8877-e0d39878e698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:58.175718 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b739af4-f8f0-4e0c-8877-e0d39878e698 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:58.176053 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b739af4-f8f0-4e0c-8877-e0d39878e698 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:58.176407 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b739af4-f8f0-4e0c-8877-e0d39878e698 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:58.177120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b739af4-f8f0-4e0c-8877-e0d39878e698 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:49:58.177490 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b739af4-f8f0-4e0c-8877-e0d39878e698 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:58.179486 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b739af4-f8f0-4e0c-8877-e0d39878e698 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:58.198331 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1814/3610] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:49:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:49:58.202336 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a938d9c-67fe-4fab-81e0-18d28fc8ffc0 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:58.222944 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a938d9c-67fe-4fab-81e0-18d28fc8ffc0 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:58.235318 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e4177-049b-4a2a-b082-f202cd7c2706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:58.236207 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e4177-049b-4a2a-b082-f202cd7c2706 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:58.237499 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e4177-049b-4a2a-b082-f202cd7c2706 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:58.237886 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e4177-049b-4a2a-b082-f202cd7c2706 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:58.239041 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988e4177-049b-4a2a-b082-f202cd7c2706 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:58.251363 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988e4177-049b-4a2a-b082-f202cd7c2706 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:58.303589 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b739af4-f8f0-4e0c-8877-e0d39878e698 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:58.304399 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1797/3611] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:49:58 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:49:58.315344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b739af4-f8f0-4e0c-8877-e0d39878e698 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:58.407699 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6cd35a-e224-4c74-b1dd-2f9a35f1414d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:58.408636 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6cd35a-e224-4c74-b1dd-2f9a35f1414d admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:58.409844 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6cd35a-e224-4c74-b1dd-2f9a35f1414d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:58.410280 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6cd35a-e224-4c74-b1dd-2f9a35f1414d admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:58.411153 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6cd35a-e224-4c74-b1dd-2f9a35f1414d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:58.413494 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6cd35a-e224-4c74-b1dd-2f9a35f1414d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:58.452292 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1815/3612] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:49:58 2022] POST /identity/v3/users => generated 294 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:49:58.456143 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e4177-049b-4a2a-b082-f202cd7c2706 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:58.468144 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e4177-049b-4a2a-b082-f202cd7c2706 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:58.475479 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6ffe2-3618-4ef0-a6c5-809b54069c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:58.477047 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6ffe2-3618-4ef0-a6c5-809b54069c52 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:58.477587 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6ffe2-3618-4ef0-a6c5-809b54069c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:58.478041 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6ffe2-3618-4ef0-a6c5-809b54069c52 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:58.479475 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6ffe2-3618-4ef0-a6c5-809b54069c52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:58.481311 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6ffe2-3618-4ef0-a6c5-809b54069c52 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:58.539126 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6cd35a-e224-4c74-b1dd-2f9a35f1414d admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:58.564403 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1798/3613] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:49:58.583521 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6cd35a-e224-4c74-b1dd-2f9a35f1414d admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:58.611242 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3cc988-3783-4b54-9645-0165a84c5054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:58.613100 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cc988-3783-4b54-9645-0165a84c5054 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:58.614795 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cc988-3783-4b54-9645-0165a84c5054 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:58.615880 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cc988-3783-4b54-9645-0165a84c5054 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:58.618823 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3cc988-3783-4b54-9645-0165a84c5054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:58.624525 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3cc988-3783-4b54-9645-0165a84c5054 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:58.659413 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1816/3614] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:49:58.664634 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6ffe2-3618-4ef0-a6c5-809b54069c52 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:58.692605 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6ffe2-3618-4ef0-a6c5-809b54069c52 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:58.715110 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9811d58-7fde-4a5a-8736-4490efe53719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:58.716328 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9811d58-7fde-4a5a-8736-4490efe53719 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:58.716763 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9811d58-7fde-4a5a-8736-4490efe53719 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:58.717187 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9811d58-7fde-4a5a-8736-4490efe53719 admin admin] PATH_INFO: `/v3/projects/3533b0c83a8445f39ebafd3f5a9f386e/users/9c3106f6533044ac9e1e1d2a94d0dce4/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:58.771542 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9811d58-7fde-4a5a-8736-4490efe53719 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3533b0c83a8445f39ebafd3f5a9f386e, user_id=9c3106f6533044ac9e1e1d2a94d0dce4, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:58.778870 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9811d58-7fde-4a5a-8736-4490efe53719 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:58.812643 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1799/3615] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:49:58 2022] PUT /identity/v3/projects/3533b0c83a8445f39ebafd3f5a9f386e/users/9c3106f6533044ac9e1e1d2a94d0dce4/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:58.817789 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b374aa2-7da7-4ff1-9bf0-8df67cc29893 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:58.817981 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b374aa2-7da7-4ff1-9bf0-8df67cc29893 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:58.818227 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b374aa2-7da7-4ff1-9bf0-8df67cc29893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:58.846850 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-7b374aa2-7da7-4ff1-9bf0-8df67cc29893 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:58.848744 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7b374aa2-7da7-4ff1-9bf0-8df67cc29893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:59.006931 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1817/3616] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:49:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:59.059648 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9811d58-7fde-4a5a-8736-4490efe53719 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:59.069968 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d9811d58-7fde-4a5a-8736-4490efe53719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:59.137693 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:59.216776 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9811d58-7fde-4a5a-8736-4490efe53719 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:59.229698 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c57a8-cc5a-4f6d-8a21-5585c094c3d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:59.230716 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c57a8-cc5a-4f6d-8a21-5585c094c3d8 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:59.231107 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c57a8-cc5a-4f6d-8a21-5585c094c3d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:59.231622 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c57a8-cc5a-4f6d-8a21-5585c094c3d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:59.253912 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c57a8-cc5a-4f6d-8a21-5585c094c3d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:59.255801 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c57a8-cc5a-4f6d-8a21-5585c094c3d8 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:59.269534 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1800/3617] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:50:00.056548 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c62aff0-af18-43e1-a4dd-bec5e9b40307 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:00.057860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c62aff0-af18-43e1-a4dd-bec5e9b40307 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:00.058366 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c62aff0-af18-43e1-a4dd-bec5e9b40307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:00.178973 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-0c62aff0-af18-43e1-a4dd-bec5e9b40307 None None] MFA Rules not processed for user `9c3106f6533044ac9e1e1d2a94d0dce4`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:00.187879 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0c62aff0-af18-43e1-a4dd-bec5e9b40307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:00.343905 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:00.372279 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1818/3618] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:00.382977 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8c275-1920-4417-a4cf-a1b99c9b5091 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:00.384209 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8c275-1920-4417-a4cf-a1b99c9b5091 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:00.385279 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8c275-1920-4417-a4cf-a1b99c9b5091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:00.410626 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-8bd8c275-1920-4417-a4cf-a1b99c9b5091 None None] MFA Rules not processed for user `9c3106f6533044ac9e1e1d2a94d0dce4`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:00.413232 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8bd8c275-1920-4417-a4cf-a1b99c9b5091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:00.424261 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1801/3619] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:00.729979 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c62aff0-af18-43e1-a4dd-bec5e9b40307 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:00.732253 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0c62aff0-af18-43e1-a4dd-bec5e9b40307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:00.860241 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206681d9-ab97-4a84-848f-2187a4687e86 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:00.860526 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206681d9-ab97-4a84-848f-2187a4687e86 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:00.860799 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206681d9-ab97-4a84-848f-2187a4687e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:00.886465 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c62aff0-af18-43e1-a4dd-bec5e9b40307 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:00.894596 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c465a3-97a4-4466-a48b-55299a96ee53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:00.895483 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c465a3-97a4-4466-a48b-55299a96ee53 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:00.895914 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c465a3-97a4-4466-a48b-55299a96ee53 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:00.896335 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c465a3-97a4-4466-a48b-55299a96ee53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:00.914692 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c465a3-97a4-4466-a48b-55299a96ee53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:00.919557 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c465a3-97a4-4466-a48b-55299a96ee53 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:00.926625 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-206681d9-ab97-4a84-848f-2187a4687e86 None None] MFA Rules not processed for user `ea31195933be4477a588150bb1f67822`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:00.929065 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-206681d9-ab97-4a84-848f-2187a4687e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:00.939752 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1819/3620] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:50:00 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:50:01.058224 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1802/3621] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:00 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:01.059486 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0194f4-c034-4439-b955-84bdc0229cfd None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:01.060269 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0194f4-c034-4439-b955-84bdc0229cfd None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:01.060548 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0194f4-c034-4439-b955-84bdc0229cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:01.102428 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-4a0194f4-c034-4439-b955-84bdc0229cfd None None] MFA Rules not processed for user `ea31195933be4477a588150bb1f67822`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:01.104896 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4a0194f4-c034-4439-b955-84bdc0229cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:01.113535 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1820/3622] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:01 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:50:01.372563 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206681d9-ab97-4a84-848f-2187a4687e86 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:01.374256 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-206681d9-ab97-4a84-848f-2187a4687e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:01.390928 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206681d9-ab97-4a84-848f-2187a4687e86 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:01.412588 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a466ac4-c48e-4ef6-bc3a-ce39de866a5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:01.413725 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a466ac4-c48e-4ef6-bc3a-ce39de866a5f service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:01.414225 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a466ac4-c48e-4ef6-bc3a-ce39de866a5f service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:01.414929 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a466ac4-c48e-4ef6-bc3a-ce39de866a5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:01.420260 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4a466ac4-c48e-4ef6-bc3a-ce39de866a5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:01.457230 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a466ac4-c48e-4ef6-bc3a-ce39de866a5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:01.460065 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a466ac4-c48e-4ef6-bc3a-ce39de866a5f service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:01.491645 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1803/3623] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:50:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:50:01.628537 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0194f4-c034-4439-b955-84bdc0229cfd None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:01.631122 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4a0194f4-c034-4439-b955-84bdc0229cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:01.666292 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0194f4-c034-4439-b955-84bdc0229cfd None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:01.677006 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad616bd3-178d-43b6-b6d9-489d263345f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:01.677640 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad616bd3-178d-43b6-b6d9-489d263345f3 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:01.677920 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad616bd3-178d-43b6-b6d9-489d263345f3 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:01.678193 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad616bd3-178d-43b6-b6d9-489d263345f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:01.691091 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad616bd3-178d-43b6-b6d9-489d263345f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:01.692734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad616bd3-178d-43b6-b6d9-489d263345f3 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:01.713685 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1821/3624] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:50:01 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:50:02.942765 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a466ac4-c48e-4ef6-bc3a-ce39de866a5f service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:02.959606 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a466ac4-c48e-4ef6-bc3a-ce39de866a5f service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:02.973334 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd65549-dd9a-4199-adcd-47ee2a4cc99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:02.974104 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd65549-dd9a-4199-adcd-47ee2a4cc99b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:02.974489 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd65549-dd9a-4199-adcd-47ee2a4cc99b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:02.974865 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd65549-dd9a-4199-adcd-47ee2a4cc99b admin admin] PATH_INFO: `/v3/users/9c3106f6533044ac9e1e1d2a94d0dce4` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:02.976188 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd65549-dd9a-4199-adcd-47ee2a4cc99b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c3106f6533044ac9e1e1d2a94d0dce4)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:02.988444 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd65549-dd9a-4199-adcd-47ee2a4cc99b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:03.068627 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad616bd3-178d-43b6-b6d9-489d263345f3 service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:03.073497 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ad616bd3-178d-43b6-b6d9-489d263345f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:03.092423 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4dd65549-dd9a-4199-adcd-47ee2a4cc99b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c3106f6533044ac9e1e1d2a94d0dce4'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:03.093783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4dd65549-dd9a-4199-adcd-47ee2a4cc99b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c3106f6533044ac9e1e1d2a94d0dce4'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:03.099848 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad616bd3-178d-43b6-b6d9-489d263345f3 service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:03.108658 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f55bd9-b6c5-43d0-9dff-3d050bff2950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:03.111261 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f55bd9-b6c5-43d0-9dff-3d050bff2950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:03.111556 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f55bd9-b6c5-43d0-9dff-3d050bff2950 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:03.111923 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f55bd9-b6c5-43d0-9dff-3d050bff2950 admin admin] PATH_INFO: `/v3/users/28d34b8794c642fab7dda0d0e1b9b2f8` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:03.113613 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4dd65549-dd9a-4199-adcd-47ee2a4cc99b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c3106f6533044ac9e1e1d2a94d0dce4'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:03.124454 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f55bd9-b6c5-43d0-9dff-3d050bff2950 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28d34b8794c642fab7dda0d0e1b9b2f8)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:03.128456 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4dd65549-dd9a-4199-adcd-47ee2a4cc99b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c3106f6533044ac9e1e1d2a94d0dce4'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:03.130337 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4dd65549-dd9a-4199-adcd-47ee2a4cc99b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c3106f6533044ac9e1e1d2a94d0dce4'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:03.132555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f55bd9-b6c5-43d0-9dff-3d050bff2950 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:03.191684 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1804/3625] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:50:02 2022] DELETE /identity/v3/users/9c3106f6533044ac9e1e1d2a94d0dce4 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:03.235945 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-60f55bd9-b6c5-43d0-9dff-3d050bff2950 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28d34b8794c642fab7dda0d0e1b9b2f8'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:03.236683 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-60f55bd9-b6c5-43d0-9dff-3d050bff2950 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28d34b8794c642fab7dda0d0e1b9b2f8'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:03.272240 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-60f55bd9-b6c5-43d0-9dff-3d050bff2950 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28d34b8794c642fab7dda0d0e1b9b2f8'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:03.292402 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-60f55bd9-b6c5-43d0-9dff-3d050bff2950 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28d34b8794c642fab7dda0d0e1b9b2f8'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:03.316461 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-60f55bd9-b6c5-43d0-9dff-3d050bff2950 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28d34b8794c642fab7dda0d0e1b9b2f8'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:03.327747 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1822/3626] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:50:03 2022] DELETE /identity/v3/users/28d34b8794c642fab7dda0d0e1b9b2f8 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:50:03.333227 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb943603-f631-44a9-9dd2-d58494944fb5 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:03.333692 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb943603-f631-44a9-9dd2-d58494944fb5 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:03.333969 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb943603-f631-44a9-9dd2-d58494944fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:03.360063 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:03.375334 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-fb943603-f631-44a9-9dd2-d58494944fb5 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:03.376857 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-fb943603-f631-44a9-9dd2-d58494944fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:03.532645 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1805/3627] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:03.545645 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f55bd9-b6c5-43d0-9dff-3d050bff2950 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:03.547194 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-60f55bd9-b6c5-43d0-9dff-3d050bff2950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:03.644156 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:03.658108 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb943603-f631-44a9-9dd2-d58494944fb5 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:03.664237 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-fb943603-f631-44a9-9dd2-d58494944fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:03.683876 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f55bd9-b6c5-43d0-9dff-3d050bff2950 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:03.687705 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037653f4-9f46-4c42-8380-0f926ee51e26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:03.688527 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037653f4-9f46-4c42-8380-0f926ee51e26 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:03.688769 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037653f4-9f46-4c42-8380-0f926ee51e26 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:03.689189 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037653f4-9f46-4c42-8380-0f926ee51e26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:03.709821 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037653f4-9f46-4c42-8380-0f926ee51e26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:03.711640 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037653f4-9f46-4c42-8380-0f926ee51e26 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:03.724930 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb943603-f631-44a9-9dd2-d58494944fb5 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:03.737250 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0984e1c5-581d-43b8-95e6-94b9283ac70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:03.737831 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984e1c5-581d-43b8-95e6-94b9283ac70b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:03.738110 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984e1c5-581d-43b8-95e6-94b9283ac70b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:03.738382 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984e1c5-581d-43b8-95e6-94b9283ac70b admin admin] PATH_INFO: `/v3/projects/3533b0c83a8445f39ebafd3f5a9f386e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:03.741556 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1823/3628] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:50:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:50:03.742245 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0984e1c5-581d-43b8-95e6-94b9283ac70b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3533b0c83a8445f39ebafd3f5a9f386e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:03.748830 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0984e1c5-581d-43b8-95e6-94b9283ac70b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:03.823728 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0984e1c5-581d-43b8-95e6-94b9283ac70b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3533b0c83a8445f39ebafd3f5a9f386e', 'request_id': 'req-0984e1c5-581d-43b8-95e6-94b9283ac70b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:03.844490 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0984e1c5-581d-43b8-95e6-94b9283ac70b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3533b0c83a8445f39ebafd3f5a9f386e', 'request_id': 'req-0984e1c5-581d-43b8-95e6-94b9283ac70b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:03.852057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0984e1c5-581d-43b8-95e6-94b9283ac70b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3533b0c83a8445f39ebafd3f5a9f386e', 'request_id': 'req-0984e1c5-581d-43b8-95e6-94b9283ac70b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:03.890808 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0984e1c5-581d-43b8-95e6-94b9283ac70b admin admin] The token cache is being invalidate because project 3533b0c83a8445f39ebafd3f5a9f386e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:50:03.891151 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0984e1c5-581d-43b8-95e6-94b9283ac70b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:03.892371 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0984e1c5-581d-43b8-95e6-94b9283ac70b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:03.896418 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1806/3629] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:50:03 2022] DELETE /identity/v3/projects/3533b0c83a8445f39ebafd3f5a9f386e => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:03.905593 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161fc6e-e3b2-4239-8050-79968ed1cb84 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:03.905881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161fc6e-e3b2-4239-8050-79968ed1cb84 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:03.906154 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161fc6e-e3b2-4239-8050-79968ed1cb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:03.930668 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-2161fc6e-e3b2-4239-8050-79968ed1cb84 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:03.932567 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2161fc6e-e3b2-4239-8050-79968ed1cb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:04.027588 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1824/3630] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:04.035268 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0a860-76ee-4cd6-838b-2501510a4aa2 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:04.036108 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0a860-76ee-4cd6-838b-2501510a4aa2 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:04.036602 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0a860-76ee-4cd6-838b-2501510a4aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:04.078360 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-4ca0a860-76ee-4cd6-838b-2501510a4aa2 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:04.081370 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4ca0a860-76ee-4cd6-838b-2501510a4aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:04.109181 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2161fc6e-e3b2-4239-8050-79968ed1cb84 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:04.122082 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1807/3631] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:04.125911 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2161fc6e-e3b2-4239-8050-79968ed1cb84 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:04.140696 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad26be-e0ac-40ad-a845-12201847b514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:04.141343 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad26be-e0ac-40ad-a845-12201847b514 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:04.141628 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad26be-e0ac-40ad-a845-12201847b514 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:04.141905 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad26be-e0ac-40ad-a845-12201847b514 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:04.142579 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad26be-e0ac-40ad-a845-12201847b514 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:50:04.142884 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad26be-e0ac-40ad-a845-12201847b514 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:04.144623 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad26be-e0ac-40ad-a845-12201847b514 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:04.175089 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1825/3632] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:50:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:50:04.179234 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca0a860-76ee-4cd6-838b-2501510a4aa2 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:04.194727 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca0a860-76ee-4cd6-838b-2501510a4aa2 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:04.213523 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c83db-cbb9-447b-a88f-9d31afa69610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:04.214775 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c83db-cbb9-447b-a88f-9d31afa69610 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:04.215252 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c83db-cbb9-447b-a88f-9d31afa69610 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:04.215666 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c83db-cbb9-447b-a88f-9d31afa69610 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:04.216460 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c83db-cbb9-447b-a88f-9d31afa69610 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:04.219016 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c83db-cbb9-447b-a88f-9d31afa69610 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:04.260337 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1808/3633] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:50:04 2022] POST /identity/v3/projects => generated 371 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:04.264215 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad26be-e0ac-40ad-a845-12201847b514 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:04.284347 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad26be-e0ac-40ad-a845-12201847b514 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:04.391225 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34238330-6391-457b-b084-e4b4f4d7550b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:04.391983 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34238330-6391-457b-b084-e4b4f4d7550b admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:04.392484 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34238330-6391-457b-b084-e4b4f4d7550b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:04.392996 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34238330-6391-457b-b084-e4b4f4d7550b admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:04.394074 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34238330-6391-457b-b084-e4b4f4d7550b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:04.396822 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34238330-6391-457b-b084-e4b4f4d7550b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:04.436503 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1826/3634] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:50:04 2022] POST /identity/v3/users => generated 286 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:50:04.437727 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c83db-cbb9-447b-a88f-9d31afa69610 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:04.449033 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c83db-cbb9-447b-a88f-9d31afa69610 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:04.455662 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca21a2-fbd8-4bc5-8dc1-b0d38e6e2748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:04.456294 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca21a2-fbd8-4bc5-8dc1-b0d38e6e2748 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:04.456548 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca21a2-fbd8-4bc5-8dc1-b0d38e6e2748 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:04.456817 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca21a2-fbd8-4bc5-8dc1-b0d38e6e2748 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:04.457631 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ca21a2-fbd8-4bc5-8dc1-b0d38e6e2748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:04.459271 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ca21a2-fbd8-4bc5-8dc1-b0d38e6e2748 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:04.498966 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1809/3635] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:50:04.500077 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34238330-6391-457b-b084-e4b4f4d7550b admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:04.515445 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34238330-6391-457b-b084-e4b4f4d7550b admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:04.524450 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35323879-c43b-423d-829b-26c81c43547b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:04.525748 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35323879-c43b-423d-829b-26c81c43547b admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:04.526165 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35323879-c43b-423d-829b-26c81c43547b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:04.526319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35323879-c43b-423d-829b-26c81c43547b admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:04.527001 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35323879-c43b-423d-829b-26c81c43547b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:04.545745 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35323879-c43b-423d-829b-26c81c43547b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:04.585711 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1827/3636] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:50:04.590673 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca21a2-fbd8-4bc5-8dc1-b0d38e6e2748 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:04.608843 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35323879-c43b-423d-829b-26c81c43547b admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:04.609717 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca21a2-fbd8-4bc5-8dc1-b0d38e6e2748 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:04.610852 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-35323879-c43b-423d-829b-26c81c43547b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:04.625043 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9b356-3831-487a-84d6-41c9a2b6864f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:04.625747 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9b356-3831-487a-84d6-41c9a2b6864f admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:04.626414 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9b356-3831-487a-84d6-41c9a2b6864f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:04.626414 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9b356-3831-487a-84d6-41c9a2b6864f admin admin] PATH_INFO: `/v3/projects/7f0618a8b4534455abe0c48576833023/users/e2b8c10d30a44ee2883f2abc1f5e96c2/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:04.640045 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35323879-c43b-423d-829b-26c81c43547b admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:04.655403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de8737-de2a-4cb5-81e1-bceede0a6e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:04.656075 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de8737-de2a-4cb5-81e1-bceede0a6e75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:04.656350 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de8737-de2a-4cb5-81e1-bceede0a6e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:04.656634 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de8737-de2a-4cb5-81e1-bceede0a6e75 admin admin] PATH_INFO: `/v3/projects/75d361eb1cce4fb08e7947c1470cdeb6` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:04.658047 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83de8737-de2a-4cb5-81e1-bceede0a6e75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75d361eb1cce4fb08e7947c1470cdeb6)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:04.658954 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df9b356-3831-487a-84d6-41c9a2b6864f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f0618a8b4534455abe0c48576833023, user_id=e2b8c10d30a44ee2883f2abc1f5e96c2, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:04.660152 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83de8737-de2a-4cb5-81e1-bceede0a6e75 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:04.668246 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df9b356-3831-487a-84d6-41c9a2b6864f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:04.719990 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1810/3637] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:50:04 2022] PUT /identity/v3/projects/7f0618a8b4534455abe0c48576833023/users/e2b8c10d30a44ee2883f2abc1f5e96c2/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:04.722071 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a8857-e2cf-415a-92f5-b4a284be60b5 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:04.722071 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a8857-e2cf-415a-92f5-b4a284be60b5 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:04.722071 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a8857-e2cf-415a-92f5-b4a284be60b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:04.769592 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:04.789270 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-831a8857-e2cf-415a-92f5-b4a284be60b5 None None] MFA Rules not processed for user `e2b8c10d30a44ee2883f2abc1f5e96c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:04.790558 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-831a8857-e2cf-415a-92f5-b4a284be60b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:04.793587 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-83de8737-de2a-4cb5-81e1-bceede0a6e75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75d361eb1cce4fb08e7947c1470cdeb6', 'request_id': 'req-83de8737-de2a-4cb5-81e1-bceede0a6e75'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:04.804689 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-83de8737-de2a-4cb5-81e1-bceede0a6e75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75d361eb1cce4fb08e7947c1470cdeb6', 'request_id': 'req-83de8737-de2a-4cb5-81e1-bceede0a6e75'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:04.823126 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-83de8737-de2a-4cb5-81e1-bceede0a6e75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75d361eb1cce4fb08e7947c1470cdeb6', 'request_id': 'req-83de8737-de2a-4cb5-81e1-bceede0a6e75'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:04.827762 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:04.887542 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-83de8737-de2a-4cb5-81e1-bceede0a6e75 admin admin] The token cache is being invalidate because project 75d361eb1cce4fb08e7947c1470cdeb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:50:04.887837 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-83de8737-de2a-4cb5-81e1-bceede0a6e75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:04.890437 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-83de8737-de2a-4cb5-81e1-bceede0a6e75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:04.899725 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1828/3638] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:50:04 2022] DELETE /identity/v3/projects/75d361eb1cce4fb08e7947c1470cdeb6 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:50:04.905050 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3f21a-798a-41cc-9afc-7b7c07612534 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:04.905335 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3f21a-798a-41cc-9afc-7b7c07612534 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:04.905629 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3f21a-798a-41cc-9afc-7b7c07612534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:05.000256 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-a2a3f21a-798a-41cc-9afc-7b7c07612534 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:05.001522 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a2a3f21a-798a-41cc-9afc-7b7c07612534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:05.069542 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1811/3639] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:50:05.074703 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a8857-e2cf-415a-92f5-b4a284be60b5 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:05.076569 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-831a8857-e2cf-415a-92f5-b4a284be60b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:05.244728 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1829/3640] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:05.250384 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f780f-4839-436e-921d-0cd0708fa27a None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:05.250956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f780f-4839-436e-921d-0cd0708fa27a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:05.251888 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f780f-4839-436e-921d-0cd0708fa27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:05.284051 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-4b3f780f-4839-436e-921d-0cd0708fa27a None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:05.285541 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4b3f780f-4839-436e-921d-0cd0708fa27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:05.300130 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1830/3641] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:50:05.305786 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f780f-4839-436e-921d-0cd0708fa27a None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:05.312235 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a8857-e2cf-415a-92f5-b4a284be60b5 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:05.324599 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f780f-4839-436e-921d-0cd0708fa27a None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:05.334992 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89924cf3-463c-4fa7-b6a4-5913a68b164e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:05.339050 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89924cf3-463c-4fa7-b6a4-5913a68b164e admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:05.339552 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89924cf3-463c-4fa7-b6a4-5913a68b164e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:05.340007 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89924cf3-463c-4fa7-b6a4-5913a68b164e admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:05.341062 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89924cf3-463c-4fa7-b6a4-5913a68b164e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:50:05.341669 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89924cf3-463c-4fa7-b6a4-5913a68b164e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:05.342282 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f99eac-5d5b-4cdf-ac89-8e4f42b26c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:05.343400 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f99eac-5d5b-4cdf-ac89-8e4f42b26c56 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:05.344192 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f99eac-5d5b-4cdf-ac89-8e4f42b26c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:05.344551 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f99eac-5d5b-4cdf-ac89-8e4f42b26c56 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:05.345621 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f99eac-5d5b-4cdf-ac89-8e4f42b26c56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:05.346622 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89924cf3-463c-4fa7-b6a4-5913a68b164e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:05.350897 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f99eac-5d5b-4cdf-ac89-8e4f42b26c56 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:05.384711 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1831/3642] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:50:05.390150 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89924cf3-463c-4fa7-b6a4-5913a68b164e admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:05.416111 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89924cf3-463c-4fa7-b6a4-5913a68b164e admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:05.422044 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c88837-4dfb-40b4-8aa8-a460664e8244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:05.423404 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c88837-4dfb-40b4-8aa8-a460664e8244 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:05.423404 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c88837-4dfb-40b4-8aa8-a460664e8244 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:05.423404 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c88837-4dfb-40b4-8aa8-a460664e8244 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:05.424013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c88837-4dfb-40b4-8aa8-a460664e8244 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:05.426005 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c88837-4dfb-40b4-8aa8-a460664e8244 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:05.505510 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1812/3643] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:50:05 2022] POST /identity/v3/projects => generated 371 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:05.508010 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f99eac-5d5b-4cdf-ac89-8e4f42b26c56 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:05.552642 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1832/3644] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:50:05 2022] POST /identity/v3/projects => generated 397 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:05.556556 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c88837-4dfb-40b4-8aa8-a460664e8244 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:05.669979 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f99eac-5d5b-4cdf-ac89-8e4f42b26c56 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:05.788790 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:05.802517 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c88837-4dfb-40b4-8aa8-a460664e8244 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:05.816540 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9cefb-47d2-40f0-8cfa-bf54e25ae941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:05.818392 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365b630-28b2-4b8a-9727-6296bf76eab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:05.819052 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365b630-28b2-4b8a-9727-6296bf76eab6 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:05.819182 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9cefb-47d2-40f0-8cfa-bf54e25ae941 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:05.819391 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365b630-28b2-4b8a-9727-6296bf76eab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:05.819731 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365b630-28b2-4b8a-9727-6296bf76eab6 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:05.819842 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9cefb-47d2-40f0-8cfa-bf54e25ae941 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:05.820313 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7365b630-28b2-4b8a-9727-6296bf76eab6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:05.820446 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9cefb-47d2-40f0-8cfa-bf54e25ae941 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:05.821398 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b9cefb-47d2-40f0-8cfa-bf54e25ae941 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:05.829499 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b9cefb-47d2-40f0-8cfa-bf54e25ae941 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:05.832898 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7365b630-28b2-4b8a-9727-6296bf76eab6 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:05.877022 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1813/3645] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:50:05 2022] POST /identity/v3/users => generated 292 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:05.884171 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365b630-28b2-4b8a-9727-6296bf76eab6 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:05.892671 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1833/3646] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:50:05 2022] POST /identity/v3/users => generated 299 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:05.893986 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9cefb-47d2-40f0-8cfa-bf54e25ae941 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:05.904943 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365b630-28b2-4b8a-9727-6296bf76eab6 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:05.913865 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9cefb-47d2-40f0-8cfa-bf54e25ae941 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:05.917047 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b0c7d-240a-4471-a6a8-a69ede7dbf35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:05.918094 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b0c7d-240a-4471-a6a8-a69ede7dbf35 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:05.918460 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b0c7d-240a-4471-a6a8-a69ede7dbf35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:05.918827 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b0c7d-240a-4471-a6a8-a69ede7dbf35 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:05.920288 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b0c7d-240a-4471-a6a8-a69ede7dbf35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:05.922590 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b0c7d-240a-4471-a6a8-a69ede7dbf35 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:05.934697 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83384d-b25d-4ead-bde6-79bf27eb5f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:05.935427 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83384d-b25d-4ead-bde6-79bf27eb5f57 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:05.935960 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83384d-b25d-4ead-bde6-79bf27eb5f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:05.937027 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83384d-b25d-4ead-bde6-79bf27eb5f57 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:05.938394 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d83384d-b25d-4ead-bde6-79bf27eb5f57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:05.940780 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d83384d-b25d-4ead-bde6-79bf27eb5f57 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:05.949509 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1814/3647] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:50:05.957655 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b0c7d-240a-4471-a6a8-a69ede7dbf35 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:05.993335 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1834/3648] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:50:06.000527 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83384d-b25d-4ead-bde6-79bf27eb5f57 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:06.003748 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b0c7d-240a-4471-a6a8-a69ede7dbf35 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:06.014134 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:06.018823 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7f31b-2e7e-4a03-9849-fbb89b3346ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:06.019740 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7f31b-2e7e-4a03-9849-fbb89b3346ec admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:06.020760 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7f31b-2e7e-4a03-9849-fbb89b3346ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:06.021582 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7f31b-2e7e-4a03-9849-fbb89b3346ec admin admin] PATH_INFO: `/v3/projects/d82e9c4031824fa089c23fb33d908a76/users/04412dcf3b3b4f62a8a0de47fcad9611/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:06.028875 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83384d-b25d-4ead-bde6-79bf27eb5f57 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:06.044448 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad3365-4677-42a6-9ad3-f2cc3ef659e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:06.045503 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad3365-4677-42a6-9ad3-f2cc3ef659e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:06.046156 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad3365-4677-42a6-9ad3-f2cc3ef659e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:06.046734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad3365-4677-42a6-9ad3-f2cc3ef659e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:06.048243 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad3365-4677-42a6-9ad3-f2cc3ef659e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:06.050114 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad3365-4677-42a6-9ad3-f2cc3ef659e1 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:06.063309 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa7f31b-2e7e-4a03-9849-fbb89b3346ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=d82e9c4031824fa089c23fb33d908a76, user_id=04412dcf3b3b4f62a8a0de47fcad9611, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:06.068807 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa7f31b-2e7e-4a03-9849-fbb89b3346ec admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:06.072146 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1835/3649] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:50:06.075341 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad3365-4677-42a6-9ad3-f2cc3ef659e1 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:06.091850 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad3365-4677-42a6-9ad3-f2cc3ef659e1 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:06.099122 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1815/3650] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:50:05 2022] PUT /identity/v3/projects/d82e9c4031824fa089c23fb33d908a76/users/04412dcf3b3b4f62a8a0de47fcad9611/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:06.102452 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7f31b-2e7e-4a03-9849-fbb89b3346ec admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:06.182992 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9440bca3-bc5f-4662-a61e-f7d1d8bb8688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:06.183845 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440bca3-bc5f-4662-a61e-f7d1d8bb8688 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:06.184398 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440bca3-bc5f-4662-a61e-f7d1d8bb8688 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:06.184930 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440bca3-bc5f-4662-a61e-f7d1d8bb8688 admin admin] PATH_INFO: `/v3/projects/1f1afd7f356f48c0a28802d75820fa0d/users/2a17e8433ab142cf99d200bfefde269d/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:06.215840 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9440bca3-bc5f-4662-a61e-f7d1d8bb8688 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f1afd7f356f48c0a28802d75820fa0d, user_id=2a17e8433ab142cf99d200bfefde269d, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:06.219245 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9440bca3-bc5f-4662-a61e-f7d1d8bb8688 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:06.270575 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1836/3651] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:50:06 2022] PUT /identity/v3/projects/1f1afd7f356f48c0a28802d75820fa0d/users/2a17e8433ab142cf99d200bfefde269d/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:06.279924 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7f31b-2e7e-4a03-9849-fbb89b3346ec admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:06.283224 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c9c14-9f86-42e2-85c5-64460517b866 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:06.283743 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c9c14-9f86-42e2-85c5-64460517b866 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:06.284334 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c9c14-9f86-42e2-85c5-64460517b866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:06.326685 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-557c9c14-9f86-42e2-85c5-64460517b866 None None] MFA Rules not processed for user `2a17e8433ab142cf99d200bfefde269d`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:06.328061 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-557c9c14-9f86-42e2-85c5-64460517b866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:06.410194 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2acab-1916-4e2d-afcc-2cd34628c4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:06.410874 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2acab-1916-4e2d-afcc-2cd34628c4f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:06.411249 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2acab-1916-4e2d-afcc-2cd34628c4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:06.411537 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2acab-1916-4e2d-afcc-2cd34628c4f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:06.412182 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2acab-1916-4e2d-afcc-2cd34628c4f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:06.414011 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2acab-1916-4e2d-afcc-2cd34628c4f6 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:06.438272 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1816/3652] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:50:06.442054 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2acab-1916-4e2d-afcc-2cd34628c4f6 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:06.454215 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2acab-1916-4e2d-afcc-2cd34628c4f6 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:06.460021 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63158e-faa1-48f7-a1e0-86954de96f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:06.460708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63158e-faa1-48f7-a1e0-86954de96f9b admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:06.460990 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63158e-faa1-48f7-a1e0-86954de96f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:06.461321 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63158e-faa1-48f7-a1e0-86954de96f9b admin admin] PATH_INFO: `/v3/projects/d82e9c4031824fa089c23fb33d908a76/users/04412dcf3b3b4f62a8a0de47fcad9611/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:06.463907 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e63158e-faa1-48f7-a1e0-86954de96f9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d82e9c4031824fa089c23fb33d908a76, user_id=04412dcf3b3b4f62a8a0de47fcad9611, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:06.464409 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1837/3653] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:06 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:06.467125 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e63158e-faa1-48f7-a1e0-86954de96f9b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:06.481567 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1817/3654] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:50:06 2022] PUT /identity/v3/projects/d82e9c4031824fa089c23fb33d908a76/users/04412dcf3b3b4f62a8a0de47fcad9611/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:50:06.543516 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c9c14-9f86-42e2-85c5-64460517b866 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:06.545354 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-557c9c14-9f86-42e2-85c5-64460517b866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:06.570429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a5ce9-d9ab-4e25-a911-2d50a65f58ee None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:06.570722 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a5ce9-d9ab-4e25-a911-2d50a65f58ee None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:06.571002 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a5ce9-d9ab-4e25-a911-2d50a65f58ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:06.637439 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-1e4a5ce9-d9ab-4e25-a911-2d50a65f58ee None None] MFA Rules not processed for user `04412dcf3b3b4f62a8a0de47fcad9611`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:06.641282 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1e4a5ce9-d9ab-4e25-a911-2d50a65f58ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:06.691829 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:06.702185 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c9c14-9f86-42e2-85c5-64460517b866 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:06.751661 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:06.823778 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee96971-b3ef-4ee9-8a47-7bed9d615cfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:06.824412 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee96971-b3ef-4ee9-8a47-7bed9d615cfb service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:06.824688 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee96971-b3ef-4ee9-8a47-7bed9d615cfb service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:06.824957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee96971-b3ef-4ee9-8a47-7bed9d615cfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:06.831053 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1818/3655] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:06 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:06.838961 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a5ce9-d9ab-4e25-a911-2d50a65f58ee None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:06.858025 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a5ce9-d9ab-4e25-a911-2d50a65f58ee None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:06.866583 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1bc873-c500-446c-97f4-0b611e0a3ffa tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04412dcf3b3b4f62a8a0de47fcad9611', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82e9c4031824fa089c23fb33d908a76', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:06.868555 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bc873-c500-446c-97f4-0b611e0a3ffa tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:06.869582 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bc873-c500-446c-97f4-0b611e0a3ffa tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:06.869942 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bc873-c500-446c-97f4-0b611e0a3ffa tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] PATH_INFO: `/v3/services` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:06.872082 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1bc873-c500-446c-97f4-0b611e0a3ffa tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:06.873172 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-5d1bc873-c500-446c-97f4-0b611e0a3ffa tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:50:06.873172 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 15:50:06.873172 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 15:50:06.874915 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1bc873-c500-446c-97f4-0b611e0a3ffa tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:06.939255 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1819/3656] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:50:06 2022] POST /identity/v3/services => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:06.942189 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1bc873-c500-446c-97f4-0b611e0a3ffa tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:06.980595 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee96971-b3ef-4ee9-8a47-7bed9d615cfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:06.985602 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee96971-b3ef-4ee9-8a47-7bed9d615cfb service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:07.016086 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1bc873-c500-446c-97f4-0b611e0a3ffa tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:07.018934 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1838/3657] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:50:06 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:50:07.028465 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c930dc4-c9fe-425c-a587-3c5c874e0d49 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04412dcf3b3b4f62a8a0de47fcad9611', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82e9c4031824fa089c23fb33d908a76', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:07.029115 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c930dc4-c9fe-425c-a587-3c5c874e0d49 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:07.029470 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c930dc4-c9fe-425c-a587-3c5c874e0d49 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:07.029670 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c930dc4-c9fe-425c-a587-3c5c874e0d49 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:07.030346 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c930dc4-c9fe-425c-a587-3c5c874e0d49 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:07.032620 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-3c930dc4-c9fe-425c-a587-3c5c874e0d49 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:50:07.032620 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 15:50:07.032620 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 15:50:07.036686 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c930dc4-c9fe-425c-a587-3c5c874e0d49 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:07.069971 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1820/3658] 10.222.0.83 () {60 vars in 1213 bytes} [Mon Aug 29 15:50:06 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:07.070883 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee96971-b3ef-4ee9-8a47-7bed9d615cfb service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:07.094641 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee96971-b3ef-4ee9-8a47-7bed9d615cfb service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:07.109524 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6cf2db-b941-4c4c-9154-eacef87ef442 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04412dcf3b3b4f62a8a0de47fcad9611', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82e9c4031824fa089c23fb33d908a76', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:07.110606 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6cf2db-b941-4c4c-9154-eacef87ef442 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:07.112424 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6cf2db-b941-4c4c-9154-eacef87ef442 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:07.114707 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6cf2db-b941-4c4c-9154-eacef87ef442 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] PATH_INFO: `/v3/services` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:07.116077 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6cf2db-b941-4c4c-9154-eacef87ef442 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:07.119803 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-1c6cf2db-b941-4c4c-9154-eacef87ef442 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:50:07.119803 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 15:50:07.119803 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 15:50:07.124647 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6cf2db-b941-4c4c-9154-eacef87ef442 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:07.164062 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1839/3659] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:50:07 2022] POST /identity/v3/services => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:07.165330 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c930dc4-c9fe-425c-a587-3c5c874e0d49 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:07.179564 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c930dc4-c9fe-425c-a587-3c5c874e0d49 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:07.216910 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed476b1a-1654-4f46-8fbe-cc5bd2bdb041 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:07.218183 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed476b1a-1654-4f46-8fbe-cc5bd2bdb041 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:07.218791 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed476b1a-1654-4f46-8fbe-cc5bd2bdb041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:07.223274 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c57f56-acc7-414a-bf4f-a6cd8f85bdc7 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04412dcf3b3b4f62a8a0de47fcad9611', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82e9c4031824fa089c23fb33d908a76', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:07.224469 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c57f56-acc7-414a-bf4f-a6cd8f85bdc7 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:07.224763 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c57f56-acc7-414a-bf4f-a6cd8f85bdc7 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:07.225041 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c57f56-acc7-414a-bf4f-a6cd8f85bdc7 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:07.226182 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c57f56-acc7-414a-bf4f-a6cd8f85bdc7 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:07.230482 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c57f56-acc7-414a-bf4f-a6cd8f85bdc7 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:07.266427 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1821/3660] 10.222.0.83 () {60 vars in 1213 bytes} [Mon Aug 29 15:50:07 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:07.273539 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c57f56-acc7-414a-bf4f-a6cd8f85bdc7 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:07.277116 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-ed476b1a-1654-4f46-8fbe-cc5bd2bdb041 None None] MFA Rules not processed for user `2a17e8433ab142cf99d200bfefde269d`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:07.278944 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ed476b1a-1654-4f46-8fbe-cc5bd2bdb041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:07.289177 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c57f56-acc7-414a-bf4f-a6cd8f85bdc7 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:07.311812 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f8515d-6f32-4f32-9cb6-a2f19c7178b0 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04412dcf3b3b4f62a8a0de47fcad9611', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82e9c4031824fa089c23fb33d908a76', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:07.313699 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8515d-6f32-4f32-9cb6-a2f19c7178b0 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:07.314794 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8515d-6f32-4f32-9cb6-a2f19c7178b0 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:07.316101 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8515d-6f32-4f32-9cb6-a2f19c7178b0 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:07.318976 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f8515d-6f32-4f32-9cb6-a2f19c7178b0 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:07.321970 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-07f8515d-6f32-4f32-9cb6-a2f19c7178b0 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:50:07.321970 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 15:50:07.321970 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 15:50:07.323622 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f8515d-6f32-4f32-9cb6-a2f19c7178b0 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:07.330835 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1840/3661] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:07 2022] POST /identity/v3/auth/tokens => generated 3539 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:07.334496 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1822/3662] 10.222.0.83 () {58 vars in 1191 bytes} [Mon Aug 29 15:50:07 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 765 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:50:07.335560 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f8515d-6f32-4f32-9cb6-a2f19c7178b0 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:07.346989 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f8515d-6f32-4f32-9cb6-a2f19c7178b0 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:07.351949 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d2ad19-2380-4923-b720-48634f4dea5b tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04412dcf3b3b4f62a8a0de47fcad9611', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82e9c4031824fa089c23fb33d908a76', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:07.352651 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2ad19-2380-4923-b720-48634f4dea5b tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:07.352937 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2ad19-2380-4923-b720-48634f4dea5b tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:07.353940 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2ad19-2380-4923-b720-48634f4dea5b tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/1b8f6789529a4d7b8fe6eed335ec007d` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:07.354552 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d2ad19-2380-4923-b720-48634f4dea5b tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=1b8f6789529a4d7b8fe6eed335ec007d)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:07.355767 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-e4d2ad19-2380-4923-b720-48634f4dea5b tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:50:07.355767 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 15:50:07.355767 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 15:50:07.356664 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d2ad19-2380-4923-b720-48634f4dea5b tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:07.366206 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1823/3663] 10.222.0.83 () {58 vars in 1290 bytes} [Mon Aug 29 15:50:07 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/1b8f6789529a4d7b8fe6eed335ec007d => generated 333 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:50:07.367974 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed476b1a-1654-4f46-8fbe-cc5bd2bdb041 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:07.398054 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed476b1a-1654-4f46-8fbe-cc5bd2bdb041 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:07.419270 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6d879-1905-4c07-938c-417ca3543282 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04412dcf3b3b4f62a8a0de47fcad9611', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82e9c4031824fa089c23fb33d908a76', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:07.420423 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6d879-1905-4c07-938c-417ca3543282 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:07.420718 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6d879-1905-4c07-938c-417ca3543282 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:07.421000 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6d879-1905-4c07-938c-417ca3543282 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/1b8f6789529a4d7b8fe6eed335ec007d` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:07.421634 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6d879-1905-4c07-938c-417ca3543282 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=1b8f6789529a4d7b8fe6eed335ec007d)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:07.422638 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-10e6d879-1905-4c07-938c-417ca3543282 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:50:07.422638 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 15:50:07.422638 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 15:50:07.423859 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6d879-1905-4c07-938c-417ca3543282 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:07.437952 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1841/3664] 10.222.0.83 () {58 vars in 1291 bytes} [Mon Aug 29 15:50:07 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/1b8f6789529a4d7b8fe6eed335ec007d => generated 0 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Aug 29 15:50:07.441078 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d2ad19-2380-4923-b720-48634f4dea5b tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:07.465232 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d2ad19-2380-4923-b720-48634f4dea5b tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:07.470734 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55693446-c31a-4721-b3bc-3c46883e0c7e tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04412dcf3b3b4f62a8a0de47fcad9611', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82e9c4031824fa089c23fb33d908a76', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:07.471886 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55693446-c31a-4721-b3bc-3c46883e0c7e tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:07.472241 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55693446-c31a-4721-b3bc-3c46883e0c7e tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:07.472591 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55693446-c31a-4721-b3bc-3c46883e0c7e tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/1b8f6789529a4d7b8fe6eed335ec007d` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:07.473694 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55693446-c31a-4721-b3bc-3c46883e0c7e tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=1b8f6789529a4d7b8fe6eed335ec007d)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:07.474797 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-55693446-c31a-4721-b3bc-3c46883e0c7e tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:50:07.474797 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 15:50:07.474797 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 15:50:07.475922 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55693446-c31a-4721-b3bc-3c46883e0c7e tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:07.491300 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1824/3665] 10.222.0.83 () {58 vars in 1293 bytes} [Mon Aug 29 15:50:07 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/1b8f6789529a4d7b8fe6eed335ec007d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:07.497104 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6d879-1905-4c07-938c-417ca3543282 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:07.522496 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6d879-1905-4c07-938c-417ca3543282 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:07.544964 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4873f5b-2675-4b06-99ae-d78fa6aa85b3 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04412dcf3b3b4f62a8a0de47fcad9611', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82e9c4031824fa089c23fb33d908a76', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:07.545864 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4873f5b-2675-4b06-99ae-d78fa6aa85b3 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:07.546364 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4873f5b-2675-4b06-99ae-d78fa6aa85b3 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:07.546835 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4873f5b-2675-4b06-99ae-d78fa6aa85b3 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:07.547699 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4873f5b-2675-4b06-99ae-d78fa6aa85b3 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:07.549049 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-f4873f5b-2675-4b06-99ae-d78fa6aa85b3 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:50:07.549049 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 15:50:07.549049 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 15:50:07.551372 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4873f5b-2675-4b06-99ae-d78fa6aa85b3 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:07.563482 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55693446-c31a-4721-b3bc-3c46883e0c7e tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:07.574720 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55693446-c31a-4721-b3bc-3c46883e0c7e tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:07.576037 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1842/3666] 10.222.0.83 () {58 vars in 1191 bytes} [Mon Aug 29 15:50:07 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 451 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:50:07.582922 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9f61a-6883-406e-a86b-82a26fa667b0 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04412dcf3b3b4f62a8a0de47fcad9611', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82e9c4031824fa089c23fb33d908a76', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:07.583767 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9f61a-6883-406e-a86b-82a26fa667b0 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:07.584055 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9f61a-6883-406e-a86b-82a26fa667b0 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:07.584334 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9f61a-6883-406e-a86b-82a26fa667b0 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/1b8f6789529a4d7b8fe6eed335ec007d` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:07.584935 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c9f61a-6883-406e-a86b-82a26fa667b0 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=1b8f6789529a4d7b8fe6eed335ec007d)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:07.587950 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c9f61a-6883-406e-a86b-82a26fa667b0 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:07.605490 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-07c9f61a-6883-406e-a86b-82a26fa667b0 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] Could not find Endpoint Group: 1b8f6789529a4d7b8fe6eed335ec007d.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 1b8f6789529a4d7b8fe6eed335ec007d. Aug 29 15:50:07.605490 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:50:07.605490 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:50:07.605490 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:50:07.605490 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:50:07.605490 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:50:07.605490 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:50:07.605490 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:50:07.605490 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:50:07.605490 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:50:07.605490 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:50:07.605490 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:50:07.605490 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_ep_filter.py", line 107, in delete Aug 29 15:50:07.605490 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return (PROVIDERS.catalog_api.delete_endpoint_group(endpoint_group_id), Aug 29 15:50:07.606498 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 519, in delete_endpoint_group Aug 29 15:50:07.606498 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application endpoint_group_ref = self._get_endpoint_group(session, Aug 29 15:50:07.606498 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 495, in _get_endpoint_group Aug 29 15:50:07.606498 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.EndpointGroupNotFound( Aug 29 15:50:07.606498 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 1b8f6789529a4d7b8fe6eed335ec007d. Aug 29 15:50:07.606498 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:50:07.611548 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4873f5b-2675-4b06-99ae-d78fa6aa85b3 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:07.632501 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1825/3667] 10.222.0.83 () {58 vars in 1293 bytes} [Mon Aug 29 15:50:07 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/1b8f6789529a4d7b8fe6eed335ec007d => generated 120 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 15:50:07.632681 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4873f5b-2675-4b06-99ae-d78fa6aa85b3 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:07.640496 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5897f1-fd55-4175-86a3-3655ea6bc717 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04412dcf3b3b4f62a8a0de47fcad9611', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82e9c4031824fa089c23fb33d908a76', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:07.641483 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5897f1-fd55-4175-86a3-3655ea6bc717 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:07.644256 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5897f1-fd55-4175-86a3-3655ea6bc717 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:07.644922 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5897f1-fd55-4175-86a3-3655ea6bc717 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] PATH_INFO: `/v3/services/4082248bc97846f694a278d49d9ef636` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:07.645806 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5897f1-fd55-4175-86a3-3655ea6bc717 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: Authorizing `identity:delete_service(service_id=4082248bc97846f694a278d49d9ef636)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:07.647335 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-3f5897f1-fd55-4175-86a3-3655ea6bc717 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:50:07.647335 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 15:50:07.647335 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 15:50:07.648635 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5897f1-fd55-4175-86a3-3655ea6bc717 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:07.689901 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1843/3668] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:50:07 2022] DELETE /identity/v3/services/4082248bc97846f694a278d49d9ef636 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:07.698233 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9f61a-6883-406e-a86b-82a26fa667b0 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:07.709154 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9f61a-6883-406e-a86b-82a26fa667b0 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:07.727814 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1589442-7590-4c3f-a91e-62199ab578df tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04412dcf3b3b4f62a8a0de47fcad9611', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82e9c4031824fa089c23fb33d908a76', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:07.728967 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1589442-7590-4c3f-a91e-62199ab578df tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:07.728967 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1589442-7590-4c3f-a91e-62199ab578df tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:07.729203 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1589442-7590-4c3f-a91e-62199ab578df tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] PATH_INFO: `/v3/services` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:07.730052 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1589442-7590-4c3f-a91e-62199ab578df tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:07.732740 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1589442-7590-4c3f-a91e-62199ab578df tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:07.765810 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5897f1-fd55-4175-86a3-3655ea6bc717 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:07.781680 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1826/3669] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:50:07 2022] POST /identity/v3/services => generated 289 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:07.787361 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5897f1-fd55-4175-86a3-3655ea6bc717 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:07.807062 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac87a6-c0ed-4e08-b164-111f4b17ae00 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04412dcf3b3b4f62a8a0de47fcad9611', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82e9c4031824fa089c23fb33d908a76', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:07.807903 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac87a6-c0ed-4e08-b164-111f4b17ae00 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:07.808211 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac87a6-c0ed-4e08-b164-111f4b17ae00 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:07.808736 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac87a6-c0ed-4e08-b164-111f4b17ae00 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:07.809482 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac87a6-c0ed-4e08-b164-111f4b17ae00 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:07.810703 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-14ac87a6-c0ed-4e08-b164-111f4b17ae00 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:50:07.810703 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 15:50:07.810703 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 15:50:07.811717 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac87a6-c0ed-4e08-b164-111f4b17ae00 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:07.833325 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1589442-7590-4c3f-a91e-62199ab578df tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:07.847117 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1844/3670] 10.222.0.83 () {60 vars in 1213 bytes} [Mon Aug 29 15:50:07 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:07.853883 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1589442-7590-4c3f-a91e-62199ab578df tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:07.859344 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4e6ba-11f3-43b8-abb4-14a6567abdb9 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04412dcf3b3b4f62a8a0de47fcad9611', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82e9c4031824fa089c23fb33d908a76', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:07.860457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4e6ba-11f3-43b8-abb4-14a6567abdb9 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:07.860814 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4e6ba-11f3-43b8-abb4-14a6567abdb9 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:07.861115 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4e6ba-11f3-43b8-abb4-14a6567abdb9 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] PATH_INFO: `/v3/services` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:07.862200 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b4e6ba-11f3-43b8-abb4-14a6567abdb9 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:07.864875 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b4e6ba-11f3-43b8-abb4-14a6567abdb9 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:07.886288 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1827/3671] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:50:07 2022] POST /identity/v3/services => generated 289 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:07.892097 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac87a6-c0ed-4e08-b164-111f4b17ae00 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:07.916654 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac87a6-c0ed-4e08-b164-111f4b17ae00 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:07.951950 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:07.967288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4158f99d-31eb-4393-a899-f99030be4faf tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04412dcf3b3b4f62a8a0de47fcad9611', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82e9c4031824fa089c23fb33d908a76', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:07.968001 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158f99d-31eb-4393-a899-f99030be4faf tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:07.969179 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158f99d-31eb-4393-a899-f99030be4faf tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:07.969473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158f99d-31eb-4393-a899-f99030be4faf tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/3c65af612d4846c8adaa7a2d23859502` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:07.970789 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4158f99d-31eb-4393-a899-f99030be4faf tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=3c65af612d4846c8adaa7a2d23859502)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:07.971928 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-4158f99d-31eb-4393-a899-f99030be4faf tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:50:07.971928 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 15:50:07.971928 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 15:50:07.973050 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4158f99d-31eb-4393-a899-f99030be4faf tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:07.989934 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1845/3672] 10.222.0.83 () {60 vars in 1313 bytes} [Mon Aug 29 15:50:07 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/3c65af612d4846c8adaa7a2d23859502 => generated 334 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:50:07.994713 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4e6ba-11f3-43b8-abb4-14a6567abdb9 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:08.028057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4e6ba-11f3-43b8-abb4-14a6567abdb9 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:08.045559 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb25fee-86ea-42f4-9f2d-6853c9442772 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04412dcf3b3b4f62a8a0de47fcad9611', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82e9c4031824fa089c23fb33d908a76', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:08.046468 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb25fee-86ea-42f4-9f2d-6853c9442772 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:08.048855 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb25fee-86ea-42f4-9f2d-6853c9442772 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:08.049159 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb25fee-86ea-42f4-9f2d-6853c9442772 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] PATH_INFO: `/v3/services/25af694465624049bb7a73a7d2b1ba6a` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:08.050715 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb25fee-86ea-42f4-9f2d-6853c9442772 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: Authorizing `identity:delete_service(service_id=25af694465624049bb7a73a7d2b1ba6a)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:08.051806 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-feb25fee-86ea-42f4-9f2d-6853c9442772 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:50:08.051806 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 15:50:08.051806 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 15:50:08.052700 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb25fee-86ea-42f4-9f2d-6853c9442772 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:08.121033 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1828/3673] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:50:07 2022] DELETE /identity/v3/services/25af694465624049bb7a73a7d2b1ba6a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:08.127682 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4158f99d-31eb-4393-a899-f99030be4faf tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:08.150909 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4158f99d-31eb-4393-a899-f99030be4faf tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:08.202529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9104e712-e505-4253-82e0-f9c4650cafaa tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04412dcf3b3b4f62a8a0de47fcad9611', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82e9c4031824fa089c23fb33d908a76', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:08.204265 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104e712-e505-4253-82e0-f9c4650cafaa tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:08.204553 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104e712-e505-4253-82e0-f9c4650cafaa tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:08.204833 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104e712-e505-4253-82e0-f9c4650cafaa tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/3c65af612d4846c8adaa7a2d23859502` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:08.207218 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9104e712-e505-4253-82e0-f9c4650cafaa tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=3c65af612d4846c8adaa7a2d23859502)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:08.217837 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-9104e712-e505-4253-82e0-f9c4650cafaa tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:50:08.217837 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 15:50:08.217837 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 15:50:08.217837 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9104e712-e505-4253-82e0-f9c4650cafaa tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:08.231854 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb25fee-86ea-42f4-9f2d-6853c9442772 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:08.257322 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1846/3674] 10.222.0.83 () {58 vars in 1293 bytes} [Mon Aug 29 15:50:08 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/3c65af612d4846c8adaa7a2d23859502 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:08.262546 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9104e712-e505-4253-82e0-f9c4650cafaa tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:08.293797 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9104e712-e505-4253-82e0-f9c4650cafaa tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:08.309988 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b094da2a-567b-4a53-bdf9-15b2981ad046 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04412dcf3b3b4f62a8a0de47fcad9611', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82e9c4031824fa089c23fb33d908a76', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:08.310655 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094da2a-567b-4a53-bdf9-15b2981ad046 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:08.311407 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094da2a-567b-4a53-bdf9-15b2981ad046 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:08.311407 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094da2a-567b-4a53-bdf9-15b2981ad046 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] PATH_INFO: `/v3/services/b1c5591d7d28485891f322cd3eb20f2a` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:08.312391 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b094da2a-567b-4a53-bdf9-15b2981ad046 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: Authorizing `identity:delete_service(service_id=b1c5591d7d28485891f322cd3eb20f2a)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:08.316577 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b094da2a-567b-4a53-bdf9-15b2981ad046 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:08.331517 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:08.370417 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1847/3675] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:50:08 2022] DELETE /identity/v3/services/b1c5591d7d28485891f322cd3eb20f2a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:08.375589 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b094da2a-567b-4a53-bdf9-15b2981ad046 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:08.430757 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb25fee-86ea-42f4-9f2d-6853c9442772 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:08.465246 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b094da2a-567b-4a53-bdf9-15b2981ad046 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:08.484387 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4508617d-75f6-46ae-a195-a3fd98f6bcf3 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04412dcf3b3b4f62a8a0de47fcad9611', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82e9c4031824fa089c23fb33d908a76', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:08.484740 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd68a49-545b-4218-a323-60601e480929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:08.486614 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd68a49-545b-4218-a323-60601e480929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:08.486918 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd68a49-545b-4218-a323-60601e480929 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:08.487233 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd68a49-545b-4218-a323-60601e480929 admin admin] PATH_INFO: `/v3/users/2a17e8433ab142cf99d200bfefde269d` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:08.487440 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508617d-75f6-46ae-a195-a3fd98f6bcf3 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:08.487883 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508617d-75f6-46ae-a195-a3fd98f6bcf3 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:08.488178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508617d-75f6-46ae-a195-a3fd98f6bcf3 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/cc8f6349030344b383c76e318c1acdf8` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:08.488449 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd68a49-545b-4218-a323-60601e480929 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a17e8433ab142cf99d200bfefde269d)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:08.488826 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4508617d-75f6-46ae-a195-a3fd98f6bcf3 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=cc8f6349030344b383c76e318c1acdf8)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:08.491476 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4508617d-75f6-46ae-a195-a3fd98f6bcf3 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:08.491632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd68a49-545b-4218-a323-60601e480929 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:08.526893 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1848/3676] 10.222.0.83 () {58 vars in 1293 bytes} [Mon Aug 29 15:50:08 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/cc8f6349030344b383c76e318c1acdf8 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:08.528009 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4508617d-75f6-46ae-a195-a3fd98f6bcf3 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:08.566570 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4508617d-75f6-46ae-a195-a3fd98f6bcf3 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:08.580421 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e80ce6-b2e3-4ffc-9611-f1d8d95791c2 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04412dcf3b3b4f62a8a0de47fcad9611', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82e9c4031824fa089c23fb33d908a76', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:08.582141 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e80ce6-b2e3-4ffc-9611-f1d8d95791c2 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:08.584105 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e80ce6-b2e3-4ffc-9611-f1d8d95791c2 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:08.584569 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e80ce6-b2e3-4ffc-9611-f1d8d95791c2 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] PATH_INFO: `/v3/services/167c92c538d54f28a7c59f6577a09ab6` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:08.585237 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e80ce6-b2e3-4ffc-9611-f1d8d95791c2 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: Authorizing `identity:delete_service(service_id=167c92c538d54f28a7c59f6577a09ab6)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:08.592627 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e80ce6-b2e3-4ffc-9611-f1d8d95791c2 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:08.610706 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fcd68a49-545b-4218-a323-60601e480929 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a17e8433ab142cf99d200bfefde269d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:08.612184 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fcd68a49-545b-4218-a323-60601e480929 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a17e8433ab142cf99d200bfefde269d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:08.631521 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fcd68a49-545b-4218-a323-60601e480929 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a17e8433ab142cf99d200bfefde269d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:08.647804 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1849/3677] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:50:08 2022] DELETE /identity/v3/services/167c92c538d54f28a7c59f6577a09ab6 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:08.647804 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e80ce6-b2e3-4ffc-9611-f1d8d95791c2 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:08.651361 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fcd68a49-545b-4218-a323-60601e480929 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a17e8433ab142cf99d200bfefde269d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:08.652927 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fcd68a49-545b-4218-a323-60601e480929 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a17e8433ab142cf99d200bfefde269d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:08.691743 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e80ce6-b2e3-4ffc-9611-f1d8d95791c2 tempest-EndPointGroupsTest-484335431 tempest-EndPointGroupsTest-484335431-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:08.704305 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1829/3678] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:50:08 2022] DELETE /identity/v3/users/2a17e8433ab142cf99d200bfefde269d => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:08.710226 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b633ef-e5dd-4ce5-bec5-be8c389906b6 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:08.710226 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b633ef-e5dd-4ce5-bec5-be8c389906b6 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:08.710226 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b633ef-e5dd-4ce5-bec5-be8c389906b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:08.715091 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b1776b-4777-433b-9fbc-be2890ff7481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:08.718021 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1776b-4777-433b-9fbc-be2890ff7481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:08.719048 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1776b-4777-433b-9fbc-be2890ff7481 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:08.719442 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1776b-4777-433b-9fbc-be2890ff7481 admin admin] PATH_INFO: `/v3/users/e2b8c10d30a44ee2883f2abc1f5e96c2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:08.721602 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b1776b-4777-433b-9fbc-be2890ff7481 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2b8c10d30a44ee2883f2abc1f5e96c2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:08.729618 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b1776b-4777-433b-9fbc-be2890ff7481 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:08.754135 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-34b633ef-e5dd-4ce5-bec5-be8c389906b6 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:08.755529 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-34b633ef-e5dd-4ce5-bec5-be8c389906b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:08.838325 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-78b1776b-4777-433b-9fbc-be2890ff7481 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2b8c10d30a44ee2883f2abc1f5e96c2'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:08.839856 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-78b1776b-4777-433b-9fbc-be2890ff7481 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2b8c10d30a44ee2883f2abc1f5e96c2'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:08.855915 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1830/3679] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:08.863953 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-78b1776b-4777-433b-9fbc-be2890ff7481 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2b8c10d30a44ee2883f2abc1f5e96c2'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:08.873410 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-78b1776b-4777-433b-9fbc-be2890ff7481 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2b8c10d30a44ee2883f2abc1f5e96c2'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:08.875244 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b633ef-e5dd-4ce5-bec5-be8c389906b6 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:08.879451 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-34b633ef-e5dd-4ce5-bec5-be8c389906b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:08.885305 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-78b1776b-4777-433b-9fbc-be2890ff7481 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2b8c10d30a44ee2883f2abc1f5e96c2'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:08.896386 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1850/3680] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:50:08 2022] DELETE /identity/v3/users/e2b8c10d30a44ee2883f2abc1f5e96c2 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:08.904424 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7911b20-0ab4-4e96-b437-79f30deb50a0 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:08.904424 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7911b20-0ab4-4e96-b437-79f30deb50a0 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:08.904424 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7911b20-0ab4-4e96-b437-79f30deb50a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:08.931718 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-d7911b20-0ab4-4e96-b437-79f30deb50a0 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:08.933487 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d7911b20-0ab4-4e96-b437-79f30deb50a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:08.949085 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:08.960657 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=80,keystone:UPDATE=1,keystone:DELETE=18,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:09.022277 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1851/3681] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:09.022776 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b633ef-e5dd-4ce5-bec5-be8c389906b6 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:09.045871 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7911b20-0ab4-4e96-b437-79f30deb50a0 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:09.047557 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d7911b20-0ab4-4e96-b437-79f30deb50a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:09.113445 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b0486-c5d7-42cb-a7f6-98330944c4c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:09.114299 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b0486-c5d7-42cb-a7f6-98330944c4c6 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:09.114685 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b0486-c5d7-42cb-a7f6-98330944c4c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:09.115183 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b0486-c5d7-42cb-a7f6-98330944c4c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:09.117578 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-632b0486-c5d7-42cb-a7f6-98330944c4c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:09.139521 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632b0486-c5d7-42cb-a7f6-98330944c4c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:09.139521 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632b0486-c5d7-42cb-a7f6-98330944c4c6 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:09.154349 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1831/3682] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:50:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:50:09.230045 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7911b20-0ab4-4e96-b437-79f30deb50a0 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:09.234535 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2537230-69e5-4764-82bb-edb6625c6d0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:09.235500 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2537230-69e5-4764-82bb-edb6625c6d0d service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:09.236060 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2537230-69e5-4764-82bb-edb6625c6d0d service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:09.236449 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2537230-69e5-4764-82bb-edb6625c6d0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:09.250065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2537230-69e5-4764-82bb-edb6625c6d0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:09.252167 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2537230-69e5-4764-82bb-edb6625c6d0d service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:09.264544 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1852/3683] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:50:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:50:10.724922 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b0486-c5d7-42cb-a7f6-98330944c4c6 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:10.727224 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-632b0486-c5d7-42cb-a7f6-98330944c4c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:10.754419 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b0486-c5d7-42cb-a7f6-98330944c4c6 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:10.768792 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1a323-4a2c-4cbf-9be6-7041eb10487d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:10.769578 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1a323-4a2c-4cbf-9be6-7041eb10487d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:10.770082 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1a323-4a2c-4cbf-9be6-7041eb10487d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:10.770751 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1a323-4a2c-4cbf-9be6-7041eb10487d admin admin] PATH_INFO: `/v3/projects/1f1afd7f356f48c0a28802d75820fa0d` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:10.772342 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1a323-4a2c-4cbf-9be6-7041eb10487d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f1afd7f356f48c0a28802d75820fa0d)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:10.774955 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1a323-4a2c-4cbf-9be6-7041eb10487d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:10.902206 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-52e1a323-4a2c-4cbf-9be6-7041eb10487d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f1afd7f356f48c0a28802d75820fa0d', 'request_id': 'req-52e1a323-4a2c-4cbf-9be6-7041eb10487d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:10.909123 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-52e1a323-4a2c-4cbf-9be6-7041eb10487d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f1afd7f356f48c0a28802d75820fa0d', 'request_id': 'req-52e1a323-4a2c-4cbf-9be6-7041eb10487d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:10.924051 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-52e1a323-4a2c-4cbf-9be6-7041eb10487d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f1afd7f356f48c0a28802d75820fa0d', 'request_id': 'req-52e1a323-4a2c-4cbf-9be6-7041eb10487d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:10.957743 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-52e1a323-4a2c-4cbf-9be6-7041eb10487d admin admin] The token cache is being invalidate because project 1f1afd7f356f48c0a28802d75820fa0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:50:10.958171 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-52e1a323-4a2c-4cbf-9be6-7041eb10487d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:10.960609 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-52e1a323-4a2c-4cbf-9be6-7041eb10487d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:10.963017 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1832/3684] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:50:10 2022] DELETE /identity/v3/projects/1f1afd7f356f48c0a28802d75820fa0d => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:10.967825 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e7231-84a4-4d72-a0f4-747a367c3658 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:10.968328 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e7231-84a4-4d72-a0f4-747a367c3658 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:10.968452 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e7231-84a4-4d72-a0f4-747a367c3658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:11.013603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-b69e7231-84a4-4d72-a0f4-747a367c3658 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:11.015504 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b69e7231-84a4-4d72-a0f4-747a367c3658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:11.019729 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1a323-4a2c-4cbf-9be6-7041eb10487d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:11.021268 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-52e1a323-4a2c-4cbf-9be6-7041eb10487d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:11.147407 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1853/3685] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:11.153417 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd1584-2283-4555-9710-66afef11249a None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:11.153714 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd1584-2283-4555-9710-66afef11249a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:11.154016 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd1584-2283-4555-9710-66afef11249a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:11.174400 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1a323-4a2c-4cbf-9be6-7041eb10487d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:11.188173 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad30f40-8899-4967-abaa-393713822c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:11.188931 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad30f40-8899-4967-abaa-393713822c8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:11.189279 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad30f40-8899-4967-abaa-393713822c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:11.189617 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad30f40-8899-4967-abaa-393713822c8b admin admin] PATH_INFO: `/v3/projects/7f0618a8b4534455abe0c48576833023` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:11.192142 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad30f40-8899-4967-abaa-393713822c8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f0618a8b4534455abe0c48576833023)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:11.199286 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad30f40-8899-4967-abaa-393713822c8b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:11.207130 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-fdfd1584-2283-4555-9710-66afef11249a None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:11.208305 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-fdfd1584-2283-4555-9710-66afef11249a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:11.221915 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:11.223579 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1854/3686] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:50:11.235850 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd1584-2283-4555-9710-66afef11249a None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:11.247542 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd1584-2283-4555-9710-66afef11249a None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:11.258381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989d203-9f91-4a66-8e39-2e1309f32974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:11.259418 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989d203-9f91-4a66-8e39-2e1309f32974 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:11.259913 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989d203-9f91-4a66-8e39-2e1309f32974 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:11.260462 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989d203-9f91-4a66-8e39-2e1309f32974 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:11.261779 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d989d203-9f91-4a66-8e39-2e1309f32974 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:50:11.262401 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d989d203-9f91-4a66-8e39-2e1309f32974 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:11.264597 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d989d203-9f91-4a66-8e39-2e1309f32974 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:11.285279 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1855/3687] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:50:11.301701 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989d203-9f91-4a66-8e39-2e1309f32974 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:11.321238 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989d203-9f91-4a66-8e39-2e1309f32974 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:11.374783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7ad30f40-8899-4967-abaa-393713822c8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f0618a8b4534455abe0c48576833023', 'request_id': 'req-7ad30f40-8899-4967-abaa-393713822c8b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:11.393031 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7ad30f40-8899-4967-abaa-393713822c8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f0618a8b4534455abe0c48576833023', 'request_id': 'req-7ad30f40-8899-4967-abaa-393713822c8b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:11.407877 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:11.423316 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7ad30f40-8899-4967-abaa-393713822c8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f0618a8b4534455abe0c48576833023', 'request_id': 'req-7ad30f40-8899-4967-abaa-393713822c8b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:11.481403 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7ad30f40-8899-4967-abaa-393713822c8b admin admin] The token cache is being invalidate because project 7f0618a8b4534455abe0c48576833023 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:50:11.481806 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7ad30f40-8899-4967-abaa-393713822c8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:11.483504 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7ad30f40-8899-4967-abaa-393713822c8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:11.485902 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c1835-5dc2-436a-9527-cdda40b247d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:11.486547 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c1835-5dc2-436a-9527-cdda40b247d9 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:11.486824 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c1835-5dc2-436a-9527-cdda40b247d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:11.487208 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c1835-5dc2-436a-9527-cdda40b247d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:11.487863 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c1835-5dc2-436a-9527-cdda40b247d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:11.489275 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1833/3688] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:50:11 2022] DELETE /identity/v3/projects/7f0618a8b4534455abe0c48576833023 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:11.490714 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c1835-5dc2-436a-9527-cdda40b247d9 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:11.492964 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad30f40-8899-4967-abaa-393713822c8b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:11.496991 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7ad30f40-8899-4967-abaa-393713822c8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:11.524204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad30f40-8899-4967-abaa-393713822c8b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:11.535208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a53cfd-93e3-4ad5-91d3-5f84e9117c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:11.537359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a53cfd-93e3-4ad5-91d3-5f84e9117c84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:11.537359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a53cfd-93e3-4ad5-91d3-5f84e9117c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:11.537359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a53cfd-93e3-4ad5-91d3-5f84e9117c84 admin admin] PATH_INFO: `/v3/users/04412dcf3b3b4f62a8a0de47fcad9611` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:11.537962 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a53cfd-93e3-4ad5-91d3-5f84e9117c84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04412dcf3b3b4f62a8a0de47fcad9611)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:11.540461 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a53cfd-93e3-4ad5-91d3-5f84e9117c84 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:11.559263 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1856/3689] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:50:11 2022] POST /identity/v3/projects => generated 385 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:11.560949 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c1835-5dc2-436a-9527-cdda40b247d9 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:11.566333 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f85c1835-5dc2-436a-9527-cdda40b247d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:11.642849 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-14a53cfd-93e3-4ad5-91d3-5f84e9117c84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04412dcf3b3b4f62a8a0de47fcad9611'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:11.644206 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-14a53cfd-93e3-4ad5-91d3-5f84e9117c84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04412dcf3b3b4f62a8a0de47fcad9611'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:11.655719 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-14a53cfd-93e3-4ad5-91d3-5f84e9117c84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04412dcf3b3b4f62a8a0de47fcad9611'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:11.668356 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-14a53cfd-93e3-4ad5-91d3-5f84e9117c84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04412dcf3b3b4f62a8a0de47fcad9611'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:11.670019 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-14a53cfd-93e3-4ad5-91d3-5f84e9117c84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04412dcf3b3b4f62a8a0de47fcad9611'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:11.683854 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c1835-5dc2-436a-9527-cdda40b247d9 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:11.695132 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ede056-debc-460d-b0f4-9c468161642a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:11.695762 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ede056-debc-460d-b0f4-9c468161642a admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:11.696043 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ede056-debc-460d-b0f4-9c468161642a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:11.696317 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ede056-debc-460d-b0f4-9c468161642a admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:11.697099 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ede056-debc-460d-b0f4-9c468161642a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:11.703699 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ede056-debc-460d-b0f4-9c468161642a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:11.708484 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1834/3690] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:50:11 2022] DELETE /identity/v3/users/04412dcf3b3b4f62a8a0de47fcad9611 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:11.745579 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1857/3691] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:50:11 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:11.746956 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a53cfd-93e3-4ad5-91d3-5f84e9117c84 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:11.750603 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-14a53cfd-93e3-4ad5-91d3-5f84e9117c84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:11.873440 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a53cfd-93e3-4ad5-91d3-5f84e9117c84 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:11.894437 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbdcbea-c878-4769-b383-00667303a2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:11.895196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbdcbea-c878-4769-b383-00667303a2fb admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:11.895796 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbdcbea-c878-4769-b383-00667303a2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:11.896084 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbdcbea-c878-4769-b383-00667303a2fb admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:11.896800 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbdcbea-c878-4769-b383-00667303a2fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:11.902906 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbdcbea-c878-4769-b383-00667303a2fb admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:11.934643 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ede056-debc-460d-b0f4-9c468161642a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:11.952018 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1835/3692] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:50:11.972420 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ede056-debc-460d-b0f4-9c468161642a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:11.983994 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b450c88-1a81-4bbb-8c57-6f1361c68e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:11.984381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b450c88-1a81-4bbb-8c57-6f1361c68e2d admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:11.984729 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b450c88-1a81-4bbb-8c57-6f1361c68e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:11.985009 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b450c88-1a81-4bbb-8c57-6f1361c68e2d admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:11.985733 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b450c88-1a81-4bbb-8c57-6f1361c68e2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:11.987577 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b450c88-1a81-4bbb-8c57-6f1361c68e2d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:12.030128 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1858/3693] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:50:12.032314 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbdcbea-c878-4769-b383-00667303a2fb admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:12.041221 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:12.046692 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbdcbea-c878-4769-b383-00667303a2fb admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:12.054736 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42e9af-8f63-4855-917e-44dac5c10356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:12.057722 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42e9af-8f63-4855-917e-44dac5c10356 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:12.058222 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42e9af-8f63-4855-917e-44dac5c10356 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:12.058853 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42e9af-8f63-4855-917e-44dac5c10356 admin admin] PATH_INFO: `/v3/projects/6d1b9fcde555493f86ea437619efbea9/users/d008ed466820477197b94d0c18f7eb1c/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:12.082602 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac42e9af-8f63-4855-917e-44dac5c10356 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d1b9fcde555493f86ea437619efbea9, user_id=d008ed466820477197b94d0c18f7eb1c, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:12.086514 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac42e9af-8f63-4855-917e-44dac5c10356 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:12.113702 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1836/3694] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:50:12 2022] PUT /identity/v3/projects/6d1b9fcde555493f86ea437619efbea9/users/d008ed466820477197b94d0c18f7eb1c/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:12.116212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aeeb98-c82a-4e61-ac82-86c55bb8b7af None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:12.116212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aeeb98-c82a-4e61-ac82-86c55bb8b7af None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:12.116515 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aeeb98-c82a-4e61-ac82-86c55bb8b7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:12.146982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-69aeeb98-c82a-4e61-ac82-86c55bb8b7af None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:12.148682 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-69aeeb98-c82a-4e61-ac82-86c55bb8b7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:12.252666 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1859/3695] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:12.284984 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42e9af-8f63-4855-917e-44dac5c10356 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:12.288278 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ac42e9af-8f63-4855-917e-44dac5c10356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:12.363013 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42e9af-8f63-4855-917e-44dac5c10356 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:12.367087 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a6392a-752e-40c0-a510-1458d4700796 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:12.367676 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6392a-752e-40c0-a510-1458d4700796 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:12.367954 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6392a-752e-40c0-a510-1458d4700796 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:12.368223 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6392a-752e-40c0-a510-1458d4700796 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:12.379365 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a6392a-752e-40c0-a510-1458d4700796 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:12.381084 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a6392a-752e-40c0-a510-1458d4700796 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:12.393579 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1837/3696] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:50:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:50:12.572696 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aeeb98-c82a-4e61-ac82-86c55bb8b7af None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:12.576886 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-69aeeb98-c82a-4e61-ac82-86c55bb8b7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:12.605407 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aeeb98-c82a-4e61-ac82-86c55bb8b7af None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:12.612267 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21202900-fd25-4da6-92db-3fe1c00cc570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:12.613090 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21202900-fd25-4da6-92db-3fe1c00cc570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:12.613375 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21202900-fd25-4da6-92db-3fe1c00cc570 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:12.613654 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21202900-fd25-4da6-92db-3fe1c00cc570 admin admin] PATH_INFO: `/v3/projects/d82e9c4031824fa089c23fb33d908a76` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:12.621791 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21202900-fd25-4da6-92db-3fe1c00cc570 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d82e9c4031824fa089c23fb33d908a76)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:12.624465 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21202900-fd25-4da6-92db-3fe1c00cc570 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:12.703345 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-21202900-fd25-4da6-92db-3fe1c00cc570 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd82e9c4031824fa089c23fb33d908a76', 'request_id': 'req-21202900-fd25-4da6-92db-3fe1c00cc570'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:12.705557 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:12.714863 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-21202900-fd25-4da6-92db-3fe1c00cc570 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd82e9c4031824fa089c23fb33d908a76', 'request_id': 'req-21202900-fd25-4da6-92db-3fe1c00cc570'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:12.727837 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-21202900-fd25-4da6-92db-3fe1c00cc570 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd82e9c4031824fa089c23fb33d908a76', 'request_id': 'req-21202900-fd25-4da6-92db-3fe1c00cc570'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:12.747625 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-21202900-fd25-4da6-92db-3fe1c00cc570 admin admin] The token cache is being invalidate because project d82e9c4031824fa089c23fb33d908a76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:50:12.747879 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-21202900-fd25-4da6-92db-3fe1c00cc570 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:12.748893 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-21202900-fd25-4da6-92db-3fe1c00cc570 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:12.754569 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1860/3697] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:50:12 2022] DELETE /identity/v3/projects/d82e9c4031824fa089c23fb33d908a76 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:50:12.760126 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae71a0-12b3-474d-bb8c-911686987e62 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:12.760670 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae71a0-12b3-474d-bb8c-911686987e62 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:12.761560 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae71a0-12b3-474d-bb8c-911686987e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:12.786849 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-caae71a0-12b3-474d-bb8c-911686987e62 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:12.789190 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-caae71a0-12b3-474d-bb8c-911686987e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:12.866990 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1838/3698] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:12.876813 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6fc32-f091-481d-8cf6-daa01728dab8 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:12.876813 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6fc32-f091-481d-8cf6-daa01728dab8 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:12.876813 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6fc32-f091-481d-8cf6-daa01728dab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:12.904365 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-30b6fc32-f091-481d-8cf6-daa01728dab8 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:12.906107 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-30b6fc32-f091-481d-8cf6-daa01728dab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:12.919270 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1861/3699] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:12.923685 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae71a0-12b3-474d-bb8c-911686987e62 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:12.937833 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae71a0-12b3-474d-bb8c-911686987e62 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:12.947900 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b75675-221f-49a4-ae77-09b00ad0a5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:12.949301 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b75675-221f-49a4-ae77-09b00ad0a5e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:12.949684 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b75675-221f-49a4-ae77-09b00ad0a5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:12.950058 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b75675-221f-49a4-ae77-09b00ad0a5e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:12.951154 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b75675-221f-49a4-ae77-09b00ad0a5e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:50:12.951556 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b75675-221f-49a4-ae77-09b00ad0a5e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:12.953636 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b75675-221f-49a4-ae77-09b00ad0a5e4 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:12.975198 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1839/3700] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:50:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:50:12.989020 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b6fc32-f091-481d-8cf6-daa01728dab8 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:13.014257 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b6fc32-f091-481d-8cf6-daa01728dab8 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:13.021565 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82e384-8b64-4bc9-a68b-ce6d79fc4b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:13.022114 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82e384-8b64-4bc9-a68b-ce6d79fc4b36 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:13.022398 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82e384-8b64-4bc9-a68b-ce6d79fc4b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:13.022786 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82e384-8b64-4bc9-a68b-ce6d79fc4b36 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:13.023479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df82e384-8b64-4bc9-a68b-ce6d79fc4b36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:13.028345 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df82e384-8b64-4bc9-a68b-ce6d79fc4b36 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:13.082518 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1862/3701] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:50:12 2022] POST /identity/v3/projects => generated 367 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:13.084699 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b75675-221f-49a4-ae77-09b00ad0a5e4 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:13.105880 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b75675-221f-49a4-ae77-09b00ad0a5e4 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:13.200921 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9a959-0dcc-4f6c-9ccf-f3eafe2b62c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:13.201946 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9a959-0dcc-4f6c-9ccf-f3eafe2b62c8 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:13.202318 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9a959-0dcc-4f6c-9ccf-f3eafe2b62c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:13.202706 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9a959-0dcc-4f6c-9ccf-f3eafe2b62c8 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:13.203536 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9a959-0dcc-4f6c-9ccf-f3eafe2b62c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:13.205971 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9a959-0dcc-4f6c-9ccf-f3eafe2b62c8 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:13.228953 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:13.242891 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1840/3702] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:50:13 2022] POST /identity/v3/users => generated 284 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:13.245932 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82e384-8b64-4bc9-a68b-ce6d79fc4b36 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:13.275206 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82e384-8b64-4bc9-a68b-ce6d79fc4b36 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:13.293338 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa72c5c4-d4bb-4498-93a2-6be472ee5eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:13.294337 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72c5c4-d4bb-4498-93a2-6be472ee5eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:13.294337 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72c5c4-d4bb-4498-93a2-6be472ee5eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:13.294556 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72c5c4-d4bb-4498-93a2-6be472ee5eb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:13.295151 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa72c5c4-d4bb-4498-93a2-6be472ee5eb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:13.299848 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa72c5c4-d4bb-4498-93a2-6be472ee5eb0 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:13.325100 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1863/3703] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:50:13.330623 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9a959-0dcc-4f6c-9ccf-f3eafe2b62c8 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:13.349422 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9a959-0dcc-4f6c-9ccf-f3eafe2b62c8 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:13.358493 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357298f-d5bb-4838-9b95-7508f235c5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:13.359496 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357298f-d5bb-4838-9b95-7508f235c5b1 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:13.360225 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357298f-d5bb-4838-9b95-7508f235c5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:13.360889 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357298f-d5bb-4838-9b95-7508f235c5b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:13.361652 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1357298f-d5bb-4838-9b95-7508f235c5b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:13.363594 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1357298f-d5bb-4838-9b95-7508f235c5b1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:13.388335 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1841/3704] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:50:13.389445 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa72c5c4-d4bb-4498-93a2-6be472ee5eb0 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:13.401325 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa72c5c4-d4bb-4498-93a2-6be472ee5eb0 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:13.408122 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d299315-b4b7-47d6-9e13-36c627d5dc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:13.409695 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d299315-b4b7-47d6-9e13-36c627d5dc74 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:13.409695 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d299315-b4b7-47d6-9e13-36c627d5dc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:13.409695 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d299315-b4b7-47d6-9e13-36c627d5dc74 admin admin] PATH_INFO: `/v3/projects/9d07965c9b4d4c8493d17da216b947bb/users/07d4caffee314c2a8962d33a5a70e565/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:13.434385 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d299315-b4b7-47d6-9e13-36c627d5dc74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d07965c9b4d4c8493d17da216b947bb, user_id=07d4caffee314c2a8962d33a5a70e565, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:13.442404 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d299315-b4b7-47d6-9e13-36c627d5dc74 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:13.461022 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1864/3705] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:50:13 2022] PUT /identity/v3/projects/9d07965c9b4d4c8493d17da216b947bb/users/07d4caffee314c2a8962d33a5a70e565/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:50:13.472588 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62b4c2-99c4-4dbf-8f85-e99a1c1568c6 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:13.472899 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62b4c2-99c4-4dbf-8f85-e99a1c1568c6 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:13.474098 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62b4c2-99c4-4dbf-8f85-e99a1c1568c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:13.510162 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-fc62b4c2-99c4-4dbf-8f85-e99a1c1568c6 None None] MFA Rules not processed for user `07d4caffee314c2a8962d33a5a70e565`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:13.512161 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-fc62b4c2-99c4-4dbf-8f85-e99a1c1568c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:13.637787 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d299315-b4b7-47d6-9e13-36c627d5dc74 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:13.638027 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1842/3706] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:13.758611 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d299315-b4b7-47d6-9e13-36c627d5dc74 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:13.769513 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11cc62a-fb6f-4353-9edd-9bd4bbf6c52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:13.770185 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cc62a-fb6f-4353-9edd-9bd4bbf6c52a admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:13.770595 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cc62a-fb6f-4353-9edd-9bd4bbf6c52a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:13.776430 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cc62a-fb6f-4353-9edd-9bd4bbf6c52a admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:13.779382 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11cc62a-fb6f-4353-9edd-9bd4bbf6c52a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:13.782517 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11cc62a-fb6f-4353-9edd-9bd4bbf6c52a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:13.828137 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1865/3707] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:50:13 2022] POST /identity/v3/projects => generated 369 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:50:13.832432 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62b4c2-99c4-4dbf-8f85-e99a1c1568c6 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:13.848248 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62b4c2-99c4-4dbf-8f85-e99a1c1568c6 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:13.934970 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e1904-6c5c-45d9-bfbc-7cc6ccad38fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:13.935801 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e1904-6c5c-45d9-bfbc-7cc6ccad38fc admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:13.936144 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e1904-6c5c-45d9-bfbc-7cc6ccad38fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:13.936467 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e1904-6c5c-45d9-bfbc-7cc6ccad38fc admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:13.937171 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61e1904-6c5c-45d9-bfbc-7cc6ccad38fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:13.939250 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61e1904-6c5c-45d9-bfbc-7cc6ccad38fc admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:13.970649 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11cc62a-fb6f-4353-9edd-9bd4bbf6c52a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:13.972758 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1843/3708] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:50:13 2022] POST /identity/v3/users => generated 291 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:13.982568 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11cc62a-fb6f-4353-9edd-9bd4bbf6c52a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:13.987803 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d989b52-7b3d-45f2-9abe-8a79b2fab227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:13.988525 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d989b52-7b3d-45f2-9abe-8a79b2fab227 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:13.988893 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d989b52-7b3d-45f2-9abe-8a79b2fab227 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:13.989159 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d989b52-7b3d-45f2-9abe-8a79b2fab227 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:13.989914 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d989b52-7b3d-45f2-9abe-8a79b2fab227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:13.991652 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d989b52-7b3d-45f2-9abe-8a79b2fab227 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:14.007070 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1866/3709] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:50:14.010861 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e1904-6c5c-45d9-bfbc-7cc6ccad38fc admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:14.026583 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e1904-6c5c-45d9-bfbc-7cc6ccad38fc admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:14.033894 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89585bf-d3bd-4279-b76c-1f64e7c772f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:14.034538 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89585bf-d3bd-4279-b76c-1f64e7c772f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:14.034821 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89585bf-d3bd-4279-b76c-1f64e7c772f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:14.035123 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89585bf-d3bd-4279-b76c-1f64e7c772f2 admin admin] PATH_INFO: `/v3/projects/9ddccbf3d8b74bd9a4340e8950f85945/users/5c7497279f2c4152ab4ec59f825f81ca/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:14.064326 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89585bf-d3bd-4279-b76c-1f64e7c772f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ddccbf3d8b74bd9a4340e8950f85945, user_id=5c7497279f2c4152ab4ec59f825f81ca, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:14.067709 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89585bf-d3bd-4279-b76c-1f64e7c772f2 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:14.086166 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1844/3710] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:50:14 2022] PUT /identity/v3/projects/9ddccbf3d8b74bd9a4340e8950f85945/users/5c7497279f2c4152ab4ec59f825f81ca/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:14.090181 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d989b52-7b3d-45f2-9abe-8a79b2fab227 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:14.101783 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d989b52-7b3d-45f2-9abe-8a79b2fab227 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:14.158722 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:14.184970 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f67f1-c527-4e0d-a711-c57f09b1000b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:14.185627 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f67f1-c527-4e0d-a711-c57f09b1000b admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:14.186061 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f67f1-c527-4e0d-a711-c57f09b1000b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:14.186507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f67f1-c527-4e0d-a711-c57f09b1000b admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:14.187428 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8f67f1-c527-4e0d-a711-c57f09b1000b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:14.190413 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8f67f1-c527-4e0d-a711-c57f09b1000b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:14.202639 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1867/3711] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:50:14.207758 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89585bf-d3bd-4279-b76c-1f64e7c772f2 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:14.222186 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89585bf-d3bd-4279-b76c-1f64e7c772f2 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:14.227613 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352d469-e4be-4043-a3ba-01d984be02ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:14.230014 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352d469-e4be-4043-a3ba-01d984be02ba admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:14.230014 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352d469-e4be-4043-a3ba-01d984be02ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:14.230596 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352d469-e4be-4043-a3ba-01d984be02ba admin admin] PATH_INFO: `/v3/projects/9ddccbf3d8b74bd9a4340e8950f85945/users/5c7497279f2c4152ab4ec59f825f81ca/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:14.233437 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352d469-e4be-4043-a3ba-01d984be02ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ddccbf3d8b74bd9a4340e8950f85945, user_id=5c7497279f2c4152ab4ec59f825f81ca, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:14.235849 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352d469-e4be-4043-a3ba-01d984be02ba admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:14.250497 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1845/3712] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:50:14 2022] PUT /identity/v3/projects/9ddccbf3d8b74bd9a4340e8950f85945/users/5c7497279f2c4152ab4ec59f825f81ca/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:14.263093 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89d975-2411-47f3-aa94-b675d29e1e65 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:14.263304 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89d975-2411-47f3-aa94-b675d29e1e65 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:14.263607 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89d975-2411-47f3-aa94-b675d29e1e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:14.312505 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-5e89d975-2411-47f3-aa94-b675d29e1e65 None None] MFA Rules not processed for user `5c7497279f2c4152ab4ec59f825f81ca`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:14.314187 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5e89d975-2411-47f3-aa94-b675d29e1e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:14.412378 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352d469-e4be-4043-a3ba-01d984be02ba admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:14.412587 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1868/3713] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:14 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:14.437990 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352d469-e4be-4043-a3ba-01d984be02ba admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:14.449850 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b23b9-bcca-4a76-be66-0b518916a950 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c7497279f2c4152ab4ec59f825f81ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ddccbf3d8b74bd9a4340e8950f85945', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:14.452395 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b23b9-bcca-4a76-be66-0b518916a950 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:14.452767 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b23b9-bcca-4a76-be66-0b518916a950 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:14.453103 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b23b9-bcca-4a76-be66-0b518916a950 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] PATH_INFO: `/v3/policies` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:14.454675 n-d-836830-13 devstack@keystone.service[82149]: WARNING oslo_log.versionutils [None req-cd0b23b9-bcca-4a76-be66-0b518916a950 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 29 15:50:14.455326 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b23b9-bcca-4a76-be66-0b518916a950 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:14.456850 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-cd0b23b9-bcca-4a76-be66-0b518916a950 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:50:14.456850 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 15:50:14.456850 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 15:50:14.457863 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b23b9-bcca-4a76-be66-0b518916a950 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:14.494449 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1846/3714] 10.222.0.83 () {60 vars in 1152 bytes} [Mon Aug 29 15:50:14 2022] POST /identity/v3/policies => generated 228 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:14.495857 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e89d975-2411-47f3-aa94-b675d29e1e65 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:14.507503 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e89d975-2411-47f3-aa94-b675d29e1e65 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:14.516745 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb00712-ad1c-4258-8cc4-e1f562ee9d1d tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c7497279f2c4152ab4ec59f825f81ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ddccbf3d8b74bd9a4340e8950f85945', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:14.517337 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb00712-ad1c-4258-8cc4-e1f562ee9d1d tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:14.517626 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb00712-ad1c-4258-8cc4-e1f562ee9d1d tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:14.518431 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb00712-ad1c-4258-8cc4-e1f562ee9d1d tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] PATH_INFO: `/v3/policies/a4bebc4959f04484a8287149c93b22f9` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:14.519440 n-d-836830-13 devstack@keystone.service[82148]: WARNING oslo_log.versionutils [None req-ceb00712-ad1c-4258-8cc4-e1f562ee9d1d tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 29 15:50:14.520198 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb00712-ad1c-4258-8cc4-e1f562ee9d1d tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=a4bebc4959f04484a8287149c93b22f9)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:14.521349 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-ceb00712-ad1c-4258-8cc4-e1f562ee9d1d tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:50:14.521349 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 15:50:14.521349 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 15:50:14.522233 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb00712-ad1c-4258-8cc4-e1f562ee9d1d tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:14.561183 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1869/3715] 10.222.0.83 () {60 vars in 1252 bytes} [Mon Aug 29 15:50:14 2022] PATCH /identity/v3/policies/a4bebc4959f04484a8287149c93b22f9 => generated 236 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:50:14.562580 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b23b9-bcca-4a76-be66-0b518916a950 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:14.592164 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b23b9-bcca-4a76-be66-0b518916a950 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:14.608173 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbd41e-3204-4db2-bfd4-c032897cc791 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c7497279f2c4152ab4ec59f825f81ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ddccbf3d8b74bd9a4340e8950f85945', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:14.609016 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbd41e-3204-4db2-bfd4-c032897cc791 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:14.609966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbd41e-3204-4db2-bfd4-c032897cc791 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:14.610927 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbd41e-3204-4db2-bfd4-c032897cc791 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] PATH_INFO: `/v3/policies/a4bebc4959f04484a8287149c93b22f9` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:14.614462 n-d-836830-13 devstack@keystone.service[82149]: WARNING oslo_log.versionutils [None req-a9bbd41e-3204-4db2-bfd4-c032897cc791 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 29 15:50:14.616064 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bbd41e-3204-4db2-bfd4-c032897cc791 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=a4bebc4959f04484a8287149c93b22f9)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:14.618095 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-a9bbd41e-3204-4db2-bfd4-c032897cc791 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:50:14.618095 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 15:50:14.618095 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 15:50:14.622041 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bbd41e-3204-4db2-bfd4-c032897cc791 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:14.645723 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1847/3716] 10.222.0.83 () {58 vars in 1230 bytes} [Mon Aug 29 15:50:14 2022] GET /identity/v3/policies/a4bebc4959f04484a8287149c93b22f9 => generated 236 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:50:14.651438 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb00712-ad1c-4258-8cc4-e1f562ee9d1d tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:14.671859 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb00712-ad1c-4258-8cc4-e1f562ee9d1d tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:14.686545 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb5f86a-5431-410e-8241-fbc81999aa89 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c7497279f2c4152ab4ec59f825f81ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ddccbf3d8b74bd9a4340e8950f85945', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:14.687599 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5f86a-5431-410e-8241-fbc81999aa89 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:14.687730 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5f86a-5431-410e-8241-fbc81999aa89 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:14.688573 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5f86a-5431-410e-8241-fbc81999aa89 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] PATH_INFO: `/v3/policies/a4bebc4959f04484a8287149c93b22f9` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:14.689434 n-d-836830-13 devstack@keystone.service[82148]: WARNING oslo_log.versionutils [None req-feb5f86a-5431-410e-8241-fbc81999aa89 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 29 15:50:14.690064 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb5f86a-5431-410e-8241-fbc81999aa89 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=a4bebc4959f04484a8287149c93b22f9)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:14.693020 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-feb5f86a-5431-410e-8241-fbc81999aa89 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:50:14.693020 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 15:50:14.693020 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 15:50:14.693020 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb5f86a-5431-410e-8241-fbc81999aa89 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:14.717688 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1870/3717] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:50:14 2022] DELETE /identity/v3/policies/a4bebc4959f04484a8287149c93b22f9 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:14.724910 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbd41e-3204-4db2-bfd4-c032897cc791 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:14.738488 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbd41e-3204-4db2-bfd4-c032897cc791 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:14.747127 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262b339-66d8-40c9-b837-8010e423a6c3 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c7497279f2c4152ab4ec59f825f81ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ddccbf3d8b74bd9a4340e8950f85945', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:14.748489 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262b339-66d8-40c9-b837-8010e423a6c3 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:14.748825 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262b339-66d8-40c9-b837-8010e423a6c3 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:14.749111 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262b339-66d8-40c9-b837-8010e423a6c3 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] PATH_INFO: `/v3/policies` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:14.750374 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262b339-66d8-40c9-b837-8010e423a6c3 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:14.752270 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262b339-66d8-40c9-b837-8010e423a6c3 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:14.756832 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:14.785353 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb5f86a-5431-410e-8241-fbc81999aa89 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:14.786342 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1848/3718] 10.222.0.83 () {60 vars in 1152 bytes} [Mon Aug 29 15:50:14 2022] POST /identity/v3/policies => generated 230 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:14.799338 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb5f86a-5431-410e-8241-fbc81999aa89 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:14.809733 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ae371-70b9-4833-9608-c03b1824ccd3 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c7497279f2c4152ab4ec59f825f81ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ddccbf3d8b74bd9a4340e8950f85945', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:14.832808 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ae371-70b9-4833-9608-c03b1824ccd3 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:14.833092 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ae371-70b9-4833-9608-c03b1824ccd3 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:14.837448 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ae371-70b9-4833-9608-c03b1824ccd3 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] PATH_INFO: `/v3/policies` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:14.838959 n-d-836830-13 devstack@keystone.service[82148]: WARNING oslo_log.versionutils [None req-d68ae371-70b9-4833-9608-c03b1824ccd3 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 29 15:50:14.841639 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ae371-70b9-4833-9608-c03b1824ccd3 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:14.843568 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-d68ae371-70b9-4833-9608-c03b1824ccd3 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:50:14.843568 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 15:50:14.843568 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 15:50:14.844480 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ae371-70b9-4833-9608-c03b1824ccd3 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:14.882316 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1871/3719] 10.222.0.83 () {60 vars in 1152 bytes} [Mon Aug 29 15:50:14 2022] POST /identity/v3/policies => generated 229 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:14.883151 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262b339-66d8-40c9-b837-8010e423a6c3 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:14.905476 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262b339-66d8-40c9-b837-8010e423a6c3 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:14.913705 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e0bbb7-8204-4e14-bf9b-cd3f24df4aa3 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c7497279f2c4152ab4ec59f825f81ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ddccbf3d8b74bd9a4340e8950f85945', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:14.914631 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0bbb7-8204-4e14-bf9b-cd3f24df4aa3 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:14.915140 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0bbb7-8204-4e14-bf9b-cd3f24df4aa3 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:14.916507 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0bbb7-8204-4e14-bf9b-cd3f24df4aa3 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] PATH_INFO: `/v3/policies` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:14.918716 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e0bbb7-8204-4e14-bf9b-cd3f24df4aa3 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:14.921793 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e0bbb7-8204-4e14-bf9b-cd3f24df4aa3 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:14.961465 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1849/3720] 10.222.0.83 () {60 vars in 1152 bytes} [Mon Aug 29 15:50:14 2022] POST /identity/v3/policies => generated 230 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:14.968577 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ae371-70b9-4833-9608-c03b1824ccd3 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:14.981394 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ae371-70b9-4833-9608-c03b1824ccd3 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:14.998702 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85566a35-2de6-4147-be19-f7f684370c36 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c7497279f2c4152ab4ec59f825f81ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ddccbf3d8b74bd9a4340e8950f85945', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:14.999402 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85566a35-2de6-4147-be19-f7f684370c36 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:14.999633 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85566a35-2de6-4147-be19-f7f684370c36 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:14.999906 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85566a35-2de6-4147-be19-f7f684370c36 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] PATH_INFO: `/v3/policies` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:15.000705 n-d-836830-13 devstack@keystone.service[82148]: WARNING oslo_log.versionutils [None req-85566a35-2de6-4147-be19-f7f684370c36 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 29 15:50:15.001556 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85566a35-2de6-4147-be19-f7f684370c36 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:15.002809 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-85566a35-2de6-4147-be19-f7f684370c36 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:50:15.002809 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 15:50:15.002809 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 15:50:15.003737 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85566a35-2de6-4147-be19-f7f684370c36 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:15.027526 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1872/3721] 10.222.0.83 () {58 vars in 1131 bytes} [Mon Aug 29 15:50:14 2022] GET /identity/v3/policies => generated 765 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:50:15.029688 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e0bbb7-8204-4e14-bf9b-cd3f24df4aa3 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:15.051932 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e0bbb7-8204-4e14-bf9b-cd3f24df4aa3 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:15.077374 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c22fc2c-833a-4001-abb0-31b4653f9b05 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c7497279f2c4152ab4ec59f825f81ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ddccbf3d8b74bd9a4340e8950f85945', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:15.078257 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22fc2c-833a-4001-abb0-31b4653f9b05 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:15.079394 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22fc2c-833a-4001-abb0-31b4653f9b05 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:15.079930 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22fc2c-833a-4001-abb0-31b4653f9b05 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] PATH_INFO: `/v3/policies/e06accfbf558421ca57b9d11c8538a89` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:15.080939 n-d-836830-13 devstack@keystone.service[82149]: WARNING oslo_log.versionutils [None req-6c22fc2c-833a-4001-abb0-31b4653f9b05 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 29 15:50:15.081657 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c22fc2c-833a-4001-abb0-31b4653f9b05 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=e06accfbf558421ca57b9d11c8538a89)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:15.083639 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-6c22fc2c-833a-4001-abb0-31b4653f9b05 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:50:15.083639 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 15:50:15.083639 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 15:50:15.084882 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c22fc2c-833a-4001-abb0-31b4653f9b05 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:15.116870 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85566a35-2de6-4147-be19-f7f684370c36 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:15.117357 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1850/3722] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:50:15 2022] DELETE /identity/v3/policies/e06accfbf558421ca57b9d11c8538a89 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:50:15.131145 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85566a35-2de6-4147-be19-f7f684370c36 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:15.138030 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cbb93a-0394-4ad1-b025-1adafafa7c1c tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c7497279f2c4152ab4ec59f825f81ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ddccbf3d8b74bd9a4340e8950f85945', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:15.138815 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cbb93a-0394-4ad1-b025-1adafafa7c1c tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:15.139157 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cbb93a-0394-4ad1-b025-1adafafa7c1c tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:15.139431 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cbb93a-0394-4ad1-b025-1adafafa7c1c tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] PATH_INFO: `/v3/policies/d661b1c6a208495eae49c977bda47195` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:15.140565 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cbb93a-0394-4ad1-b025-1adafafa7c1c tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=d661b1c6a208495eae49c977bda47195)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:15.142392 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cbb93a-0394-4ad1-b025-1adafafa7c1c tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:15.179523 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1873/3723] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:50:15 2022] DELETE /identity/v3/policies/d661b1c6a208495eae49c977bda47195 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:15.185347 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c22fc2c-833a-4001-abb0-31b4653f9b05 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:15.209984 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c22fc2c-833a-4001-abb0-31b4653f9b05 tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:15.239689 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b2c57-6382-425f-8305-0d51a2adbd8e tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c7497279f2c4152ab4ec59f825f81ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ddccbf3d8b74bd9a4340e8950f85945', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:15.240716 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b2c57-6382-425f-8305-0d51a2adbd8e tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:15.241267 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b2c57-6382-425f-8305-0d51a2adbd8e tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:15.241623 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b2c57-6382-425f-8305-0d51a2adbd8e tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] PATH_INFO: `/v3/policies/485939f60cc6477c8f3b6197dee0cc9a` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:15.254463 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31b2c57-6382-425f-8305-0d51a2adbd8e tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=485939f60cc6477c8f3b6197dee0cc9a)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:15.263639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31b2c57-6382-425f-8305-0d51a2adbd8e tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:15.309044 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1851/3724] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:50:15 2022] DELETE /identity/v3/policies/485939f60cc6477c8f3b6197dee0cc9a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:15.312479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cbb93a-0394-4ad1-b025-1adafafa7c1c tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:15.429294 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:15.444275 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cbb93a-0394-4ad1-b025-1adafafa7c1c tempest-PoliciesTestJSON-1877958867 tempest-PoliciesTestJSON-1877958867-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:15.464713 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a531b23-e1ae-4088-9618-5941711e7337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:15.465684 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a531b23-e1ae-4088-9618-5941711e7337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:15.466012 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a531b23-e1ae-4088-9618-5941711e7337 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:15.466350 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a531b23-e1ae-4088-9618-5941711e7337 admin admin] PATH_INFO: `/v3/users/07d4caffee314c2a8962d33a5a70e565` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:15.471506 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a531b23-e1ae-4088-9618-5941711e7337 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07d4caffee314c2a8962d33a5a70e565)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:15.475490 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a531b23-e1ae-4088-9618-5941711e7337 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:15.622421 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5a531b23-e1ae-4088-9618-5941711e7337 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07d4caffee314c2a8962d33a5a70e565'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:15.624521 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5a531b23-e1ae-4088-9618-5941711e7337 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07d4caffee314c2a8962d33a5a70e565'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:15.661200 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5a531b23-e1ae-4088-9618-5941711e7337 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07d4caffee314c2a8962d33a5a70e565'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:15.672919 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5a531b23-e1ae-4088-9618-5941711e7337 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07d4caffee314c2a8962d33a5a70e565'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:15.685982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5a531b23-e1ae-4088-9618-5941711e7337 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07d4caffee314c2a8962d33a5a70e565'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:15.718867 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1874/3725] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:50:15 2022] DELETE /identity/v3/users/07d4caffee314c2a8962d33a5a70e565 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:15.722573 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f1615-4018-4173-95ab-9953b4a23a62 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:15.722910 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f1615-4018-4173-95ab-9953b4a23a62 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:15.723149 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f1615-4018-4173-95ab-9953b4a23a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:15.754215 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-788f1615-4018-4173-95ab-9953b4a23a62 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:15.756136 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-788f1615-4018-4173-95ab-9953b4a23a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:15.846153 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1852/3726] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:15.861645 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a531b23-e1ae-4088-9618-5941711e7337 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:15.863966 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5a531b23-e1ae-4088-9618-5941711e7337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:15.980915 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a531b23-e1ae-4088-9618-5941711e7337 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:15.985853 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23570476-84ae-4832-b7a0-ad2a3d99cfef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:15.986957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23570476-84ae-4832-b7a0-ad2a3d99cfef service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:15.987434 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23570476-84ae-4832-b7a0-ad2a3d99cfef service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:15.987911 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23570476-84ae-4832-b7a0-ad2a3d99cfef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:16.006196 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23570476-84ae-4832-b7a0-ad2a3d99cfef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:16.008743 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23570476-84ae-4832-b7a0-ad2a3d99cfef service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:16.050226 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1875/3727] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:50:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:50:18.177735 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f1615-4018-4173-95ab-9953b4a23a62 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:18.179979 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-788f1615-4018-4173-95ab-9953b4a23a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:18.199699 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23570476-84ae-4832-b7a0-ad2a3d99cfef service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:18.201729 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-23570476-84ae-4832-b7a0-ad2a3d99cfef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:18.230566 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23570476-84ae-4832-b7a0-ad2a3d99cfef service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:18.244709 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb42d2-8d02-40c6-bf2e-ff774da133d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:18.245427 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb42d2-8d02-40c6-bf2e-ff774da133d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:18.245719 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb42d2-8d02-40c6-bf2e-ff774da133d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:18.246017 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb42d2-8d02-40c6-bf2e-ff774da133d9 admin admin] PATH_INFO: `/v3/projects/9d07965c9b4d4c8493d17da216b947bb` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:18.254430 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb42d2-8d02-40c6-bf2e-ff774da133d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d07965c9b4d4c8493d17da216b947bb)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:18.281607 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb42d2-8d02-40c6-bf2e-ff774da133d9 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:18.304079 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f1615-4018-4173-95ab-9953b4a23a62 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:18.325482 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b377f0-a893-411f-b087-17159256c758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:18.331483 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b377f0-a893-411f-b087-17159256c758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:18.331802 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b377f0-a893-411f-b087-17159256c758 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:18.332088 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b377f0-a893-411f-b087-17159256c758 admin admin] PATH_INFO: `/v3/users/67dd0372f7b442b3997a91623e18529b` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:18.338028 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b377f0-a893-411f-b087-17159256c758 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67dd0372f7b442b3997a91623e18529b)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:18.340358 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b377f0-a893-411f-b087-17159256c758 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:18.455276 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d1eb42d2-8d02-40c6-bf2e-ff774da133d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d07965c9b4d4c8493d17da216b947bb', 'request_id': 'req-d1eb42d2-8d02-40c6-bf2e-ff774da133d9'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:18.473445 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d1eb42d2-8d02-40c6-bf2e-ff774da133d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d07965c9b4d4c8493d17da216b947bb', 'request_id': 'req-d1eb42d2-8d02-40c6-bf2e-ff774da133d9'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:18.486568 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f0b377f0-a893-411f-b087-17159256c758 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67dd0372f7b442b3997a91623e18529b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:18.487274 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d1eb42d2-8d02-40c6-bf2e-ff774da133d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d07965c9b4d4c8493d17da216b947bb', 'request_id': 'req-d1eb42d2-8d02-40c6-bf2e-ff774da133d9'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:18.488702 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f0b377f0-a893-411f-b087-17159256c758 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67dd0372f7b442b3997a91623e18529b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:18.499417 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f0b377f0-a893-411f-b087-17159256c758 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67dd0372f7b442b3997a91623e18529b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:18.511510 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f0b377f0-a893-411f-b087-17159256c758 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67dd0372f7b442b3997a91623e18529b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:18.512406 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f0b377f0-a893-411f-b087-17159256c758 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67dd0372f7b442b3997a91623e18529b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:18.520182 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d1eb42d2-8d02-40c6-bf2e-ff774da133d9 admin admin] The token cache is being invalidate because project 9d07965c9b4d4c8493d17da216b947bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:50:18.526428 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d1eb42d2-8d02-40c6-bf2e-ff774da133d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:18.535592 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d1eb42d2-8d02-40c6-bf2e-ff774da133d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:18.544460 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1876/3728] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:50:18 2022] DELETE /identity/v3/projects/9d07965c9b4d4c8493d17da216b947bb => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:18.549301 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb42d2-8d02-40c6-bf2e-ff774da133d9 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:18.551714 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d1eb42d2-8d02-40c6-bf2e-ff774da133d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:18.568029 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:18.585164 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1853/3729] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:50:18 2022] DELETE /identity/v3/users/67dd0372f7b442b3997a91623e18529b => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:18.706524 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb42d2-8d02-40c6-bf2e-ff774da133d9 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:18.828125 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0de231-78a8-47e5-8d8e-33e49d113ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:18.828779 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0de231-78a8-47e5-8d8e-33e49d113ad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:18.829061 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0de231-78a8-47e5-8d8e-33e49d113ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:18.829334 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0de231-78a8-47e5-8d8e-33e49d113ad3 admin admin] PATH_INFO: `/v3/users/5c7497279f2c4152ab4ec59f825f81ca` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:18.830503 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0de231-78a8-47e5-8d8e-33e49d113ad3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c7497279f2c4152ab4ec59f825f81ca)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:18.833314 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0de231-78a8-47e5-8d8e-33e49d113ad3 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:18.955155 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0c0de231-78a8-47e5-8d8e-33e49d113ad3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c7497279f2c4152ab4ec59f825f81ca'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:18.956143 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0c0de231-78a8-47e5-8d8e-33e49d113ad3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c7497279f2c4152ab4ec59f825f81ca'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:18.982579 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0c0de231-78a8-47e5-8d8e-33e49d113ad3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c7497279f2c4152ab4ec59f825f81ca'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:18.999422 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0c0de231-78a8-47e5-8d8e-33e49d113ad3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c7497279f2c4152ab4ec59f825f81ca'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:19.008459 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0c0de231-78a8-47e5-8d8e-33e49d113ad3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c7497279f2c4152ab4ec59f825f81ca'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:19.022893 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1877/3730] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:50:18 2022] DELETE /identity/v3/users/5c7497279f2c4152ab4ec59f825f81ca => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:19.678181 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b377f0-a893-411f-b087-17159256c758 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:19.680394 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f0b377f0-a893-411f-b087-17159256c758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:19.702406 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b377f0-a893-411f-b087-17159256c758 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:19.769375 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:19.866696 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332bbf52-70ac-4c07-b12f-d9663c55faa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:19.867533 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332bbf52-70ac-4c07-b12f-d9663c55faa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:19.867682 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332bbf52-70ac-4c07-b12f-d9663c55faa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:19.867939 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332bbf52-70ac-4c07-b12f-d9663c55faa9 admin admin] PATH_INFO: `/v3/projects/5f7aaa8aa8d145ba9dbfccf8cd4f9e9d` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:19.869737 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332bbf52-70ac-4c07-b12f-d9663c55faa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f7aaa8aa8d145ba9dbfccf8cd4f9e9d)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:19.871804 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332bbf52-70ac-4c07-b12f-d9663c55faa9 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:19.950943 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-332bbf52-70ac-4c07-b12f-d9663c55faa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f7aaa8aa8d145ba9dbfccf8cd4f9e9d', 'request_id': 'req-332bbf52-70ac-4c07-b12f-d9663c55faa9'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:19.958348 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-332bbf52-70ac-4c07-b12f-d9663c55faa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f7aaa8aa8d145ba9dbfccf8cd4f9e9d', 'request_id': 'req-332bbf52-70ac-4c07-b12f-d9663c55faa9'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:19.967458 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-332bbf52-70ac-4c07-b12f-d9663c55faa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f7aaa8aa8d145ba9dbfccf8cd4f9e9d', 'request_id': 'req-332bbf52-70ac-4c07-b12f-d9663c55faa9'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:19.986258 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-332bbf52-70ac-4c07-b12f-d9663c55faa9 admin admin] The token cache is being invalidate because project 5f7aaa8aa8d145ba9dbfccf8cd4f9e9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:50:19.986458 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-332bbf52-70ac-4c07-b12f-d9663c55faa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:19.987170 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-332bbf52-70ac-4c07-b12f-d9663c55faa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:19.989091 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1854/3731] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:50:19 2022] DELETE /identity/v3/projects/5f7aaa8aa8d145ba9dbfccf8cd4f9e9d => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:19.994373 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a88b1c-f1a3-49f8-b1f6-b9a356d9e4bd None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:19.994898 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a88b1c-f1a3-49f8-b1f6-b9a356d9e4bd None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:19.995233 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a88b1c-f1a3-49f8-b1f6-b9a356d9e4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:20.078586 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-02a88b1c-f1a3-49f8-b1f6-b9a356d9e4bd None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:20.080232 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-02a88b1c-f1a3-49f8-b1f6-b9a356d9e4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:20.154548 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332bbf52-70ac-4c07-b12f-d9663c55faa9 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:20.158707 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-332bbf52-70ac-4c07-b12f-d9663c55faa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:20.182729 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:20.300482 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1878/3732] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:20.311424 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a099635-77c6-4983-a586-d88ccff898e6 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:20.311722 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a099635-77c6-4983-a586-d88ccff898e6 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:20.312002 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a099635-77c6-4983-a586-d88ccff898e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:20.335675 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332bbf52-70ac-4c07-b12f-d9663c55faa9 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:20.350379 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bad833-c6a8-40bd-9aee-9bfae31c1930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:20.351211 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bad833-c6a8-40bd-9aee-9bfae31c1930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:20.352022 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bad833-c6a8-40bd-9aee-9bfae31c1930 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:20.352022 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bad833-c6a8-40bd-9aee-9bfae31c1930 admin admin] PATH_INFO: `/v3/projects/9ddccbf3d8b74bd9a4340e8950f85945` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:20.354635 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bad833-c6a8-40bd-9aee-9bfae31c1930 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ddccbf3d8b74bd9a4340e8950f85945)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:20.362427 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bad833-c6a8-40bd-9aee-9bfae31c1930 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:20.371179 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-4a099635-77c6-4983-a586-d88ccff898e6 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:20.372570 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4a099635-77c6-4983-a586-d88ccff898e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:20.393645 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1879/3733] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:20.394946 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a099635-77c6-4983-a586-d88ccff898e6 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:20.417435 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a099635-77c6-4983-a586-d88ccff898e6 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:20.427701 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d293b-b104-4198-b893-873befd64e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:20.428332 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d293b-b104-4198-b893-873befd64e8e admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:20.428848 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d293b-b104-4198-b893-873befd64e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:20.430709 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d293b-b104-4198-b893-873befd64e8e admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:20.432692 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6d293b-b104-4198-b893-873befd64e8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:50:20.433763 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6d293b-b104-4198-b893-873befd64e8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:20.439194 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6d293b-b104-4198-b893-873befd64e8e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:20.476483 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e4bad833-c6a8-40bd-9aee-9bfae31c1930 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ddccbf3d8b74bd9a4340e8950f85945', 'request_id': 'req-e4bad833-c6a8-40bd-9aee-9bfae31c1930'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:20.477361 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1880/3734] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:50:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:50:20.482854 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d293b-b104-4198-b893-873befd64e8e admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:20.496938 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:20.499162 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e4bad833-c6a8-40bd-9aee-9bfae31c1930 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ddccbf3d8b74bd9a4340e8950f85945', 'request_id': 'req-e4bad833-c6a8-40bd-9aee-9bfae31c1930'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:20.508185 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d293b-b104-4198-b893-873befd64e8e admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:20.512523 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e4bad833-c6a8-40bd-9aee-9bfae31c1930 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ddccbf3d8b74bd9a4340e8950f85945', 'request_id': 'req-e4bad833-c6a8-40bd-9aee-9bfae31c1930'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:20.543478 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e4bad833-c6a8-40bd-9aee-9bfae31c1930 admin admin] The token cache is being invalidate because project 9ddccbf3d8b74bd9a4340e8950f85945 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:50:20.544482 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e4bad833-c6a8-40bd-9aee-9bfae31c1930 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:20.545609 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e4bad833-c6a8-40bd-9aee-9bfae31c1930 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:20.548585 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1855/3735] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:50:20 2022] DELETE /identity/v3/projects/9ddccbf3d8b74bd9a4340e8950f85945 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:50:20.559446 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacba4d-ade9-4ab6-a720-57b4281839e0 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:20.559857 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacba4d-ade9-4ab6-a720-57b4281839e0 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:20.560132 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacba4d-ade9-4ab6-a720-57b4281839e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:20.605036 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-3bacba4d-ade9-4ab6-a720-57b4281839e0 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:20.607010 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3bacba4d-ade9-4ab6-a720-57b4281839e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:20.620458 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f130b-2fa0-4cd6-8710-db8a3b6fa836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:20.620691 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f130b-2fa0-4cd6-8710-db8a3b6fa836 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:20.621001 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f130b-2fa0-4cd6-8710-db8a3b6fa836 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:20.621281 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f130b-2fa0-4cd6-8710-db8a3b6fa836 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:20.622115 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f130b-2fa0-4cd6-8710-db8a3b6fa836 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:20.624744 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f130b-2fa0-4cd6-8710-db8a3b6fa836 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:20.686412 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1881/3736] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:50:20 2022] POST /identity/v3/projects => generated 377 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:20.687438 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f130b-2fa0-4cd6-8710-db8a3b6fa836 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:20.690298 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-499f130b-2fa0-4cd6-8710-db8a3b6fa836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:20.697111 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1856/3737] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:50:20.726693 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4ac26-a085-4013-b808-7f608a767a7d None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:20.727710 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4ac26-a085-4013-b808-7f608a767a7d None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:20.728855 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4ac26-a085-4013-b808-7f608a767a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:20.769944 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-5cb4ac26-a085-4013-b808-7f608a767a7d None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:20.792488 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5cb4ac26-a085-4013-b808-7f608a767a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:20.843466 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f130b-2fa0-4cd6-8710-db8a3b6fa836 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:20.858198 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4a1f3-802f-4a14-83f8-2fed9abcdb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:20.858832 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4a1f3-802f-4a14-83f8-2fed9abcdb45 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:20.859133 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4a1f3-802f-4a14-83f8-2fed9abcdb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:20.859405 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4a1f3-802f-4a14-83f8-2fed9abcdb45 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:20.860046 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca4a1f3-802f-4a14-83f8-2fed9abcdb45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:20.862911 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca4a1f3-802f-4a14-83f8-2fed9abcdb45 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:20.913483 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1882/3738] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:50:20 2022] POST /identity/v3/users => generated 289 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:20.914521 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4a1f3-802f-4a14-83f8-2fed9abcdb45 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:20.937607 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4a1f3-802f-4a14-83f8-2fed9abcdb45 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:20.940441 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1857/3739] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:20.944285 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb4ac26-a085-4013-b808-7f608a767a7d None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:20.944913 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6559f-7484-4f7a-9fee-77025acbc464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:20.955570 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6559f-7484-4f7a-9fee-77025acbc464 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:20.956178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6559f-7484-4f7a-9fee-77025acbc464 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:20.956388 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6559f-7484-4f7a-9fee-77025acbc464 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:20.957100 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a6559f-7484-4f7a-9fee-77025acbc464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:20.958885 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb4ac26-a085-4013-b808-7f608a767a7d None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:20.959050 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a6559f-7484-4f7a-9fee-77025acbc464 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:20.971822 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e33fb2-3403-4ce3-8de5-3427eec64dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:20.972465 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e33fb2-3403-4ce3-8de5-3427eec64dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:20.972793 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e33fb2-3403-4ce3-8de5-3427eec64dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:20.973058 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e33fb2-3403-4ce3-8de5-3427eec64dc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:20.973682 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e33fb2-3403-4ce3-8de5-3427eec64dc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:50:20.973978 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e33fb2-3403-4ce3-8de5-3427eec64dc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:20.975639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e33fb2-3403-4ce3-8de5-3427eec64dc2 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:20.976221 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1883/3740] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:50:20.982545 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6559f-7484-4f7a-9fee-77025acbc464 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:21.005129 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6559f-7484-4f7a-9fee-77025acbc464 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:21.013353 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1858/3741] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:50:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:50:21.014328 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e33fb2-3403-4ce3-8de5-3427eec64dc2 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:21.017077 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b6c4d-01e8-45c3-beae-c07248f4bf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:21.017712 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b6c4d-01e8-45c3-beae-c07248f4bf69 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:21.018206 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b6c4d-01e8-45c3-beae-c07248f4bf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:21.018660 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b6c4d-01e8-45c3-beae-c07248f4bf69 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:21.019556 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b6c4d-01e8-45c3-beae-c07248f4bf69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:21.021373 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b6c4d-01e8-45c3-beae-c07248f4bf69 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:21.036995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e33fb2-3403-4ce3-8de5-3427eec64dc2 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:21.044620 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1884/3742] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:50:21.045746 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b6c4d-01e8-45c3-beae-c07248f4bf69 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:21.049997 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86322330-90b6-468d-bf86-acf6d0edfee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:21.050641 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86322330-90b6-468d-bf86-acf6d0edfee1 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:21.050920 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86322330-90b6-468d-bf86-acf6d0edfee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:21.051218 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86322330-90b6-468d-bf86-acf6d0edfee1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:21.051889 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86322330-90b6-468d-bf86-acf6d0edfee1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:21.052211 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:21.054387 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86322330-90b6-468d-bf86-acf6d0edfee1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:21.059912 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b6c4d-01e8-45c3-beae-c07248f4bf69 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:21.074672 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f19f6-c69a-4ff3-a92c-aeae956fec16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:21.077265 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f19f6-c69a-4ff3-a92c-aeae956fec16 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:21.077855 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f19f6-c69a-4ff3-a92c-aeae956fec16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:21.078309 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f19f6-c69a-4ff3-a92c-aeae956fec16 admin admin] PATH_INFO: `/v3/projects/bae88ae162c54e0f90d1465cb17cfbe1/users/8ab128ff99e24153960e42b8897ac4f1/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:21.112814 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f19f6-c69a-4ff3-a92c-aeae956fec16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bae88ae162c54e0f90d1465cb17cfbe1, user_id=8ab128ff99e24153960e42b8897ac4f1, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:21.114660 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1859/3743] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:50:21 2022] POST /identity/v3/projects => generated 393 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:50:21.119880 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86322330-90b6-468d-bf86-acf6d0edfee1 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:21.120387 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f19f6-c69a-4ff3-a92c-aeae956fec16 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:21.141616 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1885/3744] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:50:21 2022] PUT /identity/v3/projects/bae88ae162c54e0f90d1465cb17cfbe1/users/8ab128ff99e24153960e42b8897ac4f1/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:21.143391 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3dcc6f-18da-4f0f-bd5d-92c2e1f5204d None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:21.143908 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3dcc6f-18da-4f0f-bd5d-92c2e1f5204d None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:21.144363 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3dcc6f-18da-4f0f-bd5d-92c2e1f5204d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:21.168192 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-bf3dcc6f-18da-4f0f-bd5d-92c2e1f5204d None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:21.172190 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-bf3dcc6f-18da-4f0f-bd5d-92c2e1f5204d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:21.229473 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:21.249909 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86322330-90b6-468d-bf86-acf6d0edfee1 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:21.322639 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1886/3745] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:21.345165 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3dcc6f-18da-4f0f-bd5d-92c2e1f5204d None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:21.348485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-bf3dcc6f-18da-4f0f-bd5d-92c2e1f5204d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:21.404662 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e56f1b-8e53-41ba-89ff-246d2373cc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:21.405598 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e56f1b-8e53-41ba-89ff-246d2373cc6f admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:21.405983 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e56f1b-8e53-41ba-89ff-246d2373cc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:21.406475 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e56f1b-8e53-41ba-89ff-246d2373cc6f admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:21.407631 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e56f1b-8e53-41ba-89ff-246d2373cc6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:21.410002 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e56f1b-8e53-41ba-89ff-246d2373cc6f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:21.441862 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1860/3746] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:50:21 2022] POST /identity/v3/users => generated 297 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:21.445706 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e56f1b-8e53-41ba-89ff-246d2373cc6f admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:21.460979 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e56f1b-8e53-41ba-89ff-246d2373cc6f admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:21.469995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a4041b-5a16-4ae5-98ac-4d9ffa9259cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:21.471002 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a4041b-5a16-4ae5-98ac-4d9ffa9259cc admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:21.471616 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a4041b-5a16-4ae5-98ac-4d9ffa9259cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:21.472252 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a4041b-5a16-4ae5-98ac-4d9ffa9259cc admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:21.473364 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a4041b-5a16-4ae5-98ac-4d9ffa9259cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:21.475693 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a4041b-5a16-4ae5-98ac-4d9ffa9259cc admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:21.499585 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1861/3747] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:21 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:50:21.502403 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a4041b-5a16-4ae5-98ac-4d9ffa9259cc admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:21.521079 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3dcc6f-18da-4f0f-bd5d-92c2e1f5204d None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:21.532183 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a4041b-5a16-4ae5-98ac-4d9ffa9259cc admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:21.536026 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dedfc7-316f-443e-bbb3-49e7c7784371 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:21.536747 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dedfc7-316f-443e-bbb3-49e7c7784371 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:21.537542 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dedfc7-316f-443e-bbb3-49e7c7784371 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:21.538419 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dedfc7-316f-443e-bbb3-49e7c7784371 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:21.545462 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8a7f2-9350-4767-896d-62083dcc5898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:21.546522 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8a7f2-9350-4767-896d-62083dcc5898 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:21.547299 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8a7f2-9350-4767-896d-62083dcc5898 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:21.547422 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8a7f2-9350-4767-896d-62083dcc5898 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:21.551578 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a8a7f2-9350-4767-896d-62083dcc5898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:21.553228 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a8a7f2-9350-4767-896d-62083dcc5898 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:21.562037 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dedfc7-316f-443e-bbb3-49e7c7784371 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:21.563562 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dedfc7-316f-443e-bbb3-49e7c7784371 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:21.579646 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1887/3748] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:50:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:50:21.583513 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1862/3749] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:21 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:50:21.585396 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dedfc7-316f-443e-bbb3-49e7c7784371 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:21.602622 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dedfc7-316f-443e-bbb3-49e7c7784371 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:21.613578 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06095212-2152-4dd1-8e31-8cf250fc7301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:21.614452 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06095212-2152-4dd1-8e31-8cf250fc7301 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:21.614913 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06095212-2152-4dd1-8e31-8cf250fc7301 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:21.615517 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06095212-2152-4dd1-8e31-8cf250fc7301 admin admin] PATH_INFO: `/v3/projects/1fdc2b2a770a4c46bbb51076fba8a310/users/6e8ae33066d04769bc23a6d7bc55c55d/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:21.651666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06095212-2152-4dd1-8e31-8cf250fc7301 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fdc2b2a770a4c46bbb51076fba8a310, user_id=6e8ae33066d04769bc23a6d7bc55c55d, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:21.654923 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06095212-2152-4dd1-8e31-8cf250fc7301 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:21.675559 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1888/3750] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:50:21 2022] PUT /identity/v3/projects/1fdc2b2a770a4c46bbb51076fba8a310/users/6e8ae33066d04769bc23a6d7bc55c55d/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:21.687847 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f356f-4908-4bae-90d3-c1dfeb000fa2 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:21.688124 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f356f-4908-4bae-90d3-c1dfeb000fa2 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:21.688401 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f356f-4908-4bae-90d3-c1dfeb000fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:21.794313 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a64f356f-4908-4bae-90d3-c1dfeb000fa2 None None] MFA Rules not processed for user `6e8ae33066d04769bc23a6d7bc55c55d`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:21.796386 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a64f356f-4908-4bae-90d3-c1dfeb000fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:21.802508 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06095212-2152-4dd1-8e31-8cf250fc7301 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:21.804334 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-06095212-2152-4dd1-8e31-8cf250fc7301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:21.914000 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:21.915429 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1863/3751] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:21 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:21.920252 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f356f-4908-4bae-90d3-c1dfeb000fa2 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:21.922817 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06095212-2152-4dd1-8e31-8cf250fc7301 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:21.928261 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1b34a-110e-48e1-ac83-88752cd0a3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:21.928898 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1b34a-110e-48e1-ac83-88752cd0a3b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:21.929178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1b34a-110e-48e1-ac83-88752cd0a3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:21.929487 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1b34a-110e-48e1-ac83-88752cd0a3b4 admin admin] PATH_INFO: `/v3/users/f4abb1099f2648998f7542cd84a737c4` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:21.929736 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f356f-4908-4bae-90d3-c1dfeb000fa2 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:21.931040 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca1b34a-110e-48e1-ac83-88752cd0a3b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4abb1099f2648998f7542cd84a737c4)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:21.933217 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca1b34a-110e-48e1-ac83-88752cd0a3b4 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:21.935232 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad4ec1-09f8-446b-8d79-f61d31b5d511 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e8ae33066d04769bc23a6d7bc55c55d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdc2b2a770a4c46bbb51076fba8a310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:21.935980 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad4ec1-09f8-446b-8d79-f61d31b5d511 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:21.936330 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad4ec1-09f8-446b-8d79-f61d31b5d511 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:21.936679 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad4ec1-09f8-446b-8d79-f61d31b5d511 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] PATH_INFO: `/v3/users/6e8ae33066d04769bc23a6d7bc55c55d/application_credentials` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:21.937428 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad4ec1-09f8-446b-8d79-f61d31b5d511 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] RBAC: Authorizing `identity:create_application_credential(user_id=6e8ae33066d04769bc23a6d7bc55c55d)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:21.938699 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad4ec1-09f8-446b-8d79-f61d31b5d511 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:21.999892 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2ca1b34a-110e-48e1-ac83-88752cd0a3b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4abb1099f2648998f7542cd84a737c4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:22.000898 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2ca1b34a-110e-48e1-ac83-88752cd0a3b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4abb1099f2648998f7542cd84a737c4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:22.006749 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:22.017419 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2ca1b34a-110e-48e1-ac83-88752cd0a3b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4abb1099f2648998f7542cd84a737c4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:22.027946 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1864/3752] 10.222.0.83 () {60 vars in 1314 bytes} [Mon Aug 29 15:50:21 2022] POST /identity/v3/users/6e8ae33066d04769bc23a6d7bc55c55d/application_credentials => generated 789 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:22.028714 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2ca1b34a-110e-48e1-ac83-88752cd0a3b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4abb1099f2648998f7542cd84a737c4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:22.031722 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad4ec1-09f8-446b-8d79-f61d31b5d511 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:22.038450 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2ca1b34a-110e-48e1-ac83-88752cd0a3b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4abb1099f2648998f7542cd84a737c4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:22.043430 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad4ec1-09f8-446b-8d79-f61d31b5d511 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:22.047079 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1889/3753] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:50:21 2022] DELETE /identity/v3/users/f4abb1099f2648998f7542cd84a737c4 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:50:22.050763 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f80951-9eda-4d6b-863c-6be25095cd10 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e8ae33066d04769bc23a6d7bc55c55d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdc2b2a770a4c46bbb51076fba8a310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:22.051958 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f80951-9eda-4d6b-863c-6be25095cd10 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:22.051958 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f80951-9eda-4d6b-863c-6be25095cd10 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:22.052331 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f80951-9eda-4d6b-863c-6be25095cd10 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] PATH_INFO: `/v3/users/6e8ae33066d04769bc23a6d7bc55c55d/application_credentials/3c37cc963ec34299971c5977c71f0222` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:22.072753 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f80951-9eda-4d6b-863c-6be25095cd10 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] RBAC: Authorizing `identity:get_application_credential(user_id=6e8ae33066d04769bc23a6d7bc55c55d, application_credential_id=3c37cc963ec34299971c5977c71f0222)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:22.075254 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f80951-9eda-4d6b-863c-6be25095cd10 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:22.077486 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1865/3754] 10.222.0.83 () {58 vars in 1392 bytes} [Mon Aug 29 15:50:22 2022] GET /identity/v3/users/6e8ae33066d04769bc23a6d7bc55c55d/application_credentials/3c37cc963ec34299971c5977c71f0222 => generated 689 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:50:22.081753 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde77b8f-b259-4240-bb61-8139ec1a41ea None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:22.082045 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde77b8f-b259-4240-bb61-8139ec1a41ea None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:22.082322 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde77b8f-b259-4240-bb61-8139ec1a41ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:22.122421 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-fde77b8f-b259-4240-bb61-8139ec1a41ea None None] MFA Rules not processed for user `6e8ae33066d04769bc23a6d7bc55c55d`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:22.123633 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-fde77b8f-b259-4240-bb61-8139ec1a41ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:22.281776 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f80951-9eda-4d6b-863c-6be25095cd10 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:22.282610 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1890/3755] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:22 2022] POST /identity/v3/auth/tokens => generated 3427 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 406 bytes (2 switches on core 0) Aug 29 15:50:22.289001 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-55f80951-9eda-4d6b-863c-6be25095cd10 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:22.290415 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde77b8f-b259-4240-bb61-8139ec1a41ea None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:22.298241 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-fde77b8f-b259-4240-bb61-8139ec1a41ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:22.316767 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f80951-9eda-4d6b-863c-6be25095cd10 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:22.363965 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:22.413531 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde77b8f-b259-4240-bb61-8139ec1a41ea None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:22.423425 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce8548-1820-43a2-a8ef-3a38217d8a3e tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e8ae33066d04769bc23a6d7bc55c55d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdc2b2a770a4c46bbb51076fba8a310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:22.423922 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce8548-1820-43a2-a8ef-3a38217d8a3e tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:22.424201 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce8548-1820-43a2-a8ef-3a38217d8a3e tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:22.425153 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce8548-1820-43a2-a8ef-3a38217d8a3e tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] PATH_INFO: `/v3/users/6e8ae33066d04769bc23a6d7bc55c55d/application_credentials/3c37cc963ec34299971c5977c71f0222` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:22.427288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce8548-1820-43a2-a8ef-3a38217d8a3e tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] RBAC: Authorizing `identity:delete_application_credential(user_id=6e8ae33066d04769bc23a6d7bc55c55d, application_credential_id=3c37cc963ec34299971c5977c71f0222)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:22.429344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce8548-1820-43a2-a8ef-3a38217d8a3e tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:22.435122 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d69753-b1ab-4aee-b970-913f6252d570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:22.435827 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d69753-b1ab-4aee-b970-913f6252d570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:22.436258 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d69753-b1ab-4aee-b970-913f6252d570 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:22.436529 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d69753-b1ab-4aee-b970-913f6252d570 admin admin] PATH_INFO: `/v3/projects/d2f8b491e736447ebb4436c6bdd9125f` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:22.437774 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d69753-b1ab-4aee-b970-913f6252d570 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2f8b491e736447ebb4436c6bdd9125f)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:22.440039 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d69753-b1ab-4aee-b970-913f6252d570 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:22.461280 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1891/3756] 10.222.0.83 () {58 vars in 1395 bytes} [Mon Aug 29 15:50:22 2022] DELETE /identity/v3/users/6e8ae33066d04769bc23a6d7bc55c55d/application_credentials/3c37cc963ec34299971c5977c71f0222 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:22.467354 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce8548-1820-43a2-a8ef-3a38217d8a3e tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:22.481833 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce8548-1820-43a2-a8ef-3a38217d8a3e tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:22.487986 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3aed0d-6e79-4ef9-991c-1298773efdfd tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e8ae33066d04769bc23a6d7bc55c55d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdc2b2a770a4c46bbb51076fba8a310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:22.488729 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3aed0d-6e79-4ef9-991c-1298773efdfd tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:22.489135 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3aed0d-6e79-4ef9-991c-1298773efdfd tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:22.489648 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3aed0d-6e79-4ef9-991c-1298773efdfd tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] PATH_INFO: `/v3/users/6e8ae33066d04769bc23a6d7bc55c55d/application_credentials` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:22.491832 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3aed0d-6e79-4ef9-991c-1298773efdfd tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] RBAC: Authorizing `identity:create_application_credential(user_id=6e8ae33066d04769bc23a6d7bc55c55d)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:22.495010 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3aed0d-6e79-4ef9-991c-1298773efdfd tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:22.517941 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-41d69753-b1ab-4aee-b970-913f6252d570 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2f8b491e736447ebb4436c6bdd9125f', 'request_id': 'req-41d69753-b1ab-4aee-b970-913f6252d570'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:22.527970 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-41d69753-b1ab-4aee-b970-913f6252d570 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2f8b491e736447ebb4436c6bdd9125f', 'request_id': 'req-41d69753-b1ab-4aee-b970-913f6252d570'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:22.536787 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-41d69753-b1ab-4aee-b970-913f6252d570 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2f8b491e736447ebb4436c6bdd9125f', 'request_id': 'req-41d69753-b1ab-4aee-b970-913f6252d570'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:22.555428 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-41d69753-b1ab-4aee-b970-913f6252d570 admin admin] The token cache is being invalidate because project d2f8b491e736447ebb4436c6bdd9125f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:50:22.556016 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-41d69753-b1ab-4aee-b970-913f6252d570 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:22.558370 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-41d69753-b1ab-4aee-b970-913f6252d570 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:22.565966 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1866/3757] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:50:22 2022] DELETE /identity/v3/projects/d2f8b491e736447ebb4436c6bdd9125f => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:22.566302 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d69753-b1ab-4aee-b970-913f6252d570 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:22.570382 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-41d69753-b1ab-4aee-b970-913f6252d570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:22.620725 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1892/3758] 10.222.0.83 () {60 vars in 1315 bytes} [Mon Aug 29 15:50:22 2022] POST /identity/v3/users/6e8ae33066d04769bc23a6d7bc55c55d/application_credentials => generated 921 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:22.626050 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3aed0d-6e79-4ef9-991c-1298773efdfd tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:22.629236 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-dd3aed0d-6e79-4ef9-991c-1298773efdfd tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:22.662014 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3aed0d-6e79-4ef9-991c-1298773efdfd tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:22.685382 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d69753-b1ab-4aee-b970-913f6252d570 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:22.692546 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365feb40-e7a3-47cb-8016-9eb1dbedab4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:22.693285 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365feb40-e7a3-47cb-8016-9eb1dbedab4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:22.693633 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365feb40-e7a3-47cb-8016-9eb1dbedab4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:22.693980 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365feb40-e7a3-47cb-8016-9eb1dbedab4d admin admin] PATH_INFO: `/v3/users/2025c890c98746f2acdcf4c17f2d89da` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:22.695506 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365feb40-e7a3-47cb-8016-9eb1dbedab4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2025c890c98746f2acdcf4c17f2d89da)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:22.704957 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365feb40-e7a3-47cb-8016-9eb1dbedab4d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:22.720537 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:22.799385 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-365feb40-e7a3-47cb-8016-9eb1dbedab4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2025c890c98746f2acdcf4c17f2d89da'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:22.800984 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-365feb40-e7a3-47cb-8016-9eb1dbedab4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2025c890c98746f2acdcf4c17f2d89da'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:22.815406 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e0d68a-2278-4086-aa4f-122fb7591489 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e8ae33066d04769bc23a6d7bc55c55d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdc2b2a770a4c46bbb51076fba8a310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:22.817257 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0d68a-2278-4086-aa4f-122fb7591489 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:22.817385 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-365feb40-e7a3-47cb-8016-9eb1dbedab4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2025c890c98746f2acdcf4c17f2d89da'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:22.817591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0d68a-2278-4086-aa4f-122fb7591489 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:22.817934 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0d68a-2278-4086-aa4f-122fb7591489 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] PATH_INFO: `/v3/users/6e8ae33066d04769bc23a6d7bc55c55d/application_credentials/a694dd5aa33f4d9b8e988c1ae01304ce` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:22.835008 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-365feb40-e7a3-47cb-8016-9eb1dbedab4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2025c890c98746f2acdcf4c17f2d89da'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:22.836617 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-365feb40-e7a3-47cb-8016-9eb1dbedab4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2025c890c98746f2acdcf4c17f2d89da'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:22.856761 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e0d68a-2278-4086-aa4f-122fb7591489 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] RBAC: Authorizing `identity:delete_application_credential(user_id=6e8ae33066d04769bc23a6d7bc55c55d, application_credential_id=a694dd5aa33f4d9b8e988c1ae01304ce)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:22.861801 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e0d68a-2278-4086-aa4f-122fb7591489 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:22.885286 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1867/3759] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:50:22 2022] DELETE /identity/v3/users/2025c890c98746f2acdcf4c17f2d89da => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:22.938449 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1893/3760] 10.222.0.83 () {58 vars in 1395 bytes} [Mon Aug 29 15:50:22 2022] DELETE /identity/v3/users/6e8ae33066d04769bc23a6d7bc55c55d/application_credentials/a694dd5aa33f4d9b8e988c1ae01304ce => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:22.950713 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365feb40-e7a3-47cb-8016-9eb1dbedab4d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:22.955628 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-365feb40-e7a3-47cb-8016-9eb1dbedab4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:23.143430 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365feb40-e7a3-47cb-8016-9eb1dbedab4d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:23.154026 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2244f988-4974-4d10-8dfb-7656f19b7ecb tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e8ae33066d04769bc23a6d7bc55c55d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdc2b2a770a4c46bbb51076fba8a310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:23.155466 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244f988-4974-4d10-8dfb-7656f19b7ecb tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:23.156723 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244f988-4974-4d10-8dfb-7656f19b7ecb tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:23.157160 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244f988-4974-4d10-8dfb-7656f19b7ecb tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] PATH_INFO: `/v3/users/6e8ae33066d04769bc23a6d7bc55c55d/application_credentials` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:23.158000 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2244f988-4974-4d10-8dfb-7656f19b7ecb tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] RBAC: Authorizing `identity:create_application_credential(user_id=6e8ae33066d04769bc23a6d7bc55c55d)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:23.161732 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2244f988-4974-4d10-8dfb-7656f19b7ecb tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:23.293341 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1868/3761] 10.222.0.83 () {60 vars in 1315 bytes} [Mon Aug 29 15:50:22 2022] POST /identity/v3/users/6e8ae33066d04769bc23a6d7bc55c55d/application_credentials => generated 813 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:23.296859 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e0d68a-2278-4086-aa4f-122fb7591489 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:23.308084 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e0d68a-2278-4086-aa4f-122fb7591489 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:23.313586 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f59fd-8a18-40e1-81bd-ba4bbf64e821 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e8ae33066d04769bc23a6d7bc55c55d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdc2b2a770a4c46bbb51076fba8a310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:23.314263 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f59fd-8a18-40e1-81bd-ba4bbf64e821 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:23.314549 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f59fd-8a18-40e1-81bd-ba4bbf64e821 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:23.314827 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f59fd-8a18-40e1-81bd-ba4bbf64e821 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] PATH_INFO: `/v3/users/6e8ae33066d04769bc23a6d7bc55c55d/application_credentials/9dc41846ffe94190b44c296e497ebc7c` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:23.330477 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0f59fd-8a18-40e1-81bd-ba4bbf64e821 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] RBAC: Authorizing `identity:delete_application_credential(user_id=6e8ae33066d04769bc23a6d7bc55c55d, application_credential_id=9dc41846ffe94190b44c296e497ebc7c)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:23.332204 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0f59fd-8a18-40e1-81bd-ba4bbf64e821 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:23.333622 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37ffbf-78a1-4ed3-8ba4-6dc671618d36 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:23.333985 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37ffbf-78a1-4ed3-8ba4-6dc671618d36 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:23.334331 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37ffbf-78a1-4ed3-8ba4-6dc671618d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:23.348074 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:23.368573 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-5a37ffbf-78a1-4ed3-8ba4-6dc671618d36 None None] MFA Rules not processed for user `71e0809663664b319388bcc890b6fdec`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:23.370752 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5a37ffbf-78a1-4ed3-8ba4-6dc671618d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:23.382724 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1894/3762] 10.222.0.83 () {58 vars in 1395 bytes} [Mon Aug 29 15:50:23 2022] DELETE /identity/v3/users/6e8ae33066d04769bc23a6d7bc55c55d/application_credentials/9dc41846ffe94190b44c296e497ebc7c => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:23.385373 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f59fd-8a18-40e1-81bd-ba4bbf64e821 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:23.408098 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f59fd-8a18-40e1-81bd-ba4bbf64e821 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:23.419492 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea7cb9-3299-41df-89e6-8c47cc81c0c5 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e8ae33066d04769bc23a6d7bc55c55d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdc2b2a770a4c46bbb51076fba8a310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:23.420154 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea7cb9-3299-41df-89e6-8c47cc81c0c5 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:23.420438 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea7cb9-3299-41df-89e6-8c47cc81c0c5 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:23.420717 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea7cb9-3299-41df-89e6-8c47cc81c0c5 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] PATH_INFO: `/v3/users/6e8ae33066d04769bc23a6d7bc55c55d/application_credentials` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:23.422904 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea7cb9-3299-41df-89e6-8c47cc81c0c5 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] RBAC: Authorizing `identity:create_application_credential(user_id=6e8ae33066d04769bc23a6d7bc55c55d)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:23.425741 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea7cb9-3299-41df-89e6-8c47cc81c0c5 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:23.429711 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:23.517079 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1869/3763] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:23.598992 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1895/3764] 10.222.0.83 () {60 vars in 1314 bytes} [Mon Aug 29 15:50:23 2022] POST /identity/v3/users/6e8ae33066d04769bc23a6d7bc55c55d/application_credentials => generated 788 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:23.603196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37ffbf-78a1-4ed3-8ba4-6dc671618d36 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:23.631476 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea7cb9-3299-41df-89e6-8c47cc81c0c5 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:23.633288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1fea7cb9-3299-41df-89e6-8c47cc81c0c5 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:23.639386 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37ffbf-78a1-4ed3-8ba4-6dc671618d36 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:23.648026 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a9353-fdcf-4e48-a19b-bcd54245ab91 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e8ae33066d04769bc23a6d7bc55c55d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdc2b2a770a4c46bbb51076fba8a310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:23.649465 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a9353-fdcf-4e48-a19b-bcd54245ab91 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:23.649842 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a9353-fdcf-4e48-a19b-bcd54245ab91 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:23.651516 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a9353-fdcf-4e48-a19b-bcd54245ab91 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] PATH_INFO: `/v3/users/6e8ae33066d04769bc23a6d7bc55c55d/application_credentials` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:23.652395 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a9353-fdcf-4e48-a19b-bcd54245ab91 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] RBAC: Authorizing `identity:create_application_credential(user_id=6e8ae33066d04769bc23a6d7bc55c55d)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:23.654008 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a9353-fdcf-4e48-a19b-bcd54245ab91 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:23.747047 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea7cb9-3299-41df-89e6-8c47cc81c0c5 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:23.755478 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f17290-a5c0-408f-be4e-b3be367b1e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:23.766179 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f17290-a5c0-408f-be4e-b3be367b1e14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:23.766852 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f17290-a5c0-408f-be4e-b3be367b1e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:23.767388 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f17290-a5c0-408f-be4e-b3be367b1e14 admin admin] PATH_INFO: `/v3/projects/b8b89579619e464987529c9922f25cda` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:23.769286 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f17290-a5c0-408f-be4e-b3be367b1e14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8b89579619e464987529c9922f25cda)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:23.771645 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f17290-a5c0-408f-be4e-b3be367b1e14 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:23.835607 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1870/3765] 10.222.0.83 () {60 vars in 1314 bytes} [Mon Aug 29 15:50:23 2022] POST /identity/v3/users/6e8ae33066d04769bc23a6d7bc55c55d/application_credentials => generated 789 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:50:23.837832 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a9353-fdcf-4e48-a19b-bcd54245ab91 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:23.859919 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-20f17290-a5c0-408f-be4e-b3be367b1e14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8b89579619e464987529c9922f25cda', 'request_id': 'req-20f17290-a5c0-408f-be4e-b3be367b1e14'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:23.864561 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a9353-fdcf-4e48-a19b-bcd54245ab91 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:23.896748 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-20f17290-a5c0-408f-be4e-b3be367b1e14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8b89579619e464987529c9922f25cda', 'request_id': 'req-20f17290-a5c0-408f-be4e-b3be367b1e14'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:23.924484 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-20f17290-a5c0-408f-be4e-b3be367b1e14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8b89579619e464987529c9922f25cda', 'request_id': 'req-20f17290-a5c0-408f-be4e-b3be367b1e14'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:23.973301 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-20f17290-a5c0-408f-be4e-b3be367b1e14 admin admin] The token cache is being invalidate because project b8b89579619e464987529c9922f25cda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:50:23.975146 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-20f17290-a5c0-408f-be4e-b3be367b1e14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:23.979928 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-20f17290-a5c0-408f-be4e-b3be367b1e14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:23.986908 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1896/3766] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:50:23 2022] DELETE /identity/v3/projects/b8b89579619e464987529c9922f25cda => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:23.991823 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdfa5d-961b-4cfc-82dd-e59a31d31be4 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:23.994121 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdfa5d-961b-4cfc-82dd-e59a31d31be4 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:23.994975 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdfa5d-961b-4cfc-82dd-e59a31d31be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:24.052702 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-8fbdfa5d-961b-4cfc-82dd-e59a31d31be4 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:24.053632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893cadfb-8250-4e47-ab29-99ca9e0f8a14 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e8ae33066d04769bc23a6d7bc55c55d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdc2b2a770a4c46bbb51076fba8a310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:24.054480 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893cadfb-8250-4e47-ab29-99ca9e0f8a14 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:24.054931 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893cadfb-8250-4e47-ab29-99ca9e0f8a14 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:24.055227 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893cadfb-8250-4e47-ab29-99ca9e0f8a14 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] PATH_INFO: `/v3/users/6e8ae33066d04769bc23a6d7bc55c55d/application_credentials` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:24.056637 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893cadfb-8250-4e47-ab29-99ca9e0f8a14 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] RBAC: Authorizing `identity:list_application_credentials(user_id=6e8ae33066d04769bc23a6d7bc55c55d)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:24.058418 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893cadfb-8250-4e47-ab29-99ca9e0f8a14 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:24.061199 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8fbdfa5d-961b-4cfc-82dd-e59a31d31be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:24.084479 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1871/3767] 10.222.0.83 () {58 vars in 1293 bytes} [Mon Aug 29 15:50:23 2022] GET /identity/v3/users/6e8ae33066d04769bc23a6d7bc55c55d/application_credentials => generated 1501 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:50:24.090576 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:24.091315 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893cadfb-8250-4e47-ab29-99ca9e0f8a14 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:24.098139 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-893cadfb-8250-4e47-ab29-99ca9e0f8a14 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:24.122912 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893cadfb-8250-4e47-ab29-99ca9e0f8a14 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:24.133029 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1e624-e6fb-46a4-a8e2-69cba1e6271d tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e8ae33066d04769bc23a6d7bc55c55d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdc2b2a770a4c46bbb51076fba8a310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:24.133626 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1e624-e6fb-46a4-a8e2-69cba1e6271d tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:24.133907 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1e624-e6fb-46a4-a8e2-69cba1e6271d tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:24.134873 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1e624-e6fb-46a4-a8e2-69cba1e6271d tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] PATH_INFO: `/v3/users/6e8ae33066d04769bc23a6d7bc55c55d/application_credentials/cc4bdcabf5dc4a5bbdc337d17b77ed8e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:24.160029 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f1e624-e6fb-46a4-a8e2-69cba1e6271d tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] RBAC: Authorizing `identity:delete_application_credential(user_id=6e8ae33066d04769bc23a6d7bc55c55d, application_credential_id=cc4bdcabf5dc4a5bbdc337d17b77ed8e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:24.161724 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f1e624-e6fb-46a4-a8e2-69cba1e6271d tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:24.196251 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1872/3768] 10.222.0.83 () {58 vars in 1395 bytes} [Mon Aug 29 15:50:24 2022] DELETE /identity/v3/users/6e8ae33066d04769bc23a6d7bc55c55d/application_credentials/cc4bdcabf5dc4a5bbdc337d17b77ed8e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:24.198194 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1897/3769] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:24.198500 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1e624-e6fb-46a4-a8e2-69cba1e6271d tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:24.210187 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a97e19-5a0d-4d6b-980e-f191925ac21c None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:24.210561 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a97e19-5a0d-4d6b-980e-f191925ac21c None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:24.210764 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a97e19-5a0d-4d6b-980e-f191925ac21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:24.212278 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1e624-e6fb-46a4-a8e2-69cba1e6271d tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:24.220131 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a672f-c549-46b7-8fd8-42c4ede6a2ea tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e8ae33066d04769bc23a6d7bc55c55d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdc2b2a770a4c46bbb51076fba8a310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:24.220364 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a672f-c549-46b7-8fd8-42c4ede6a2ea tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:24.220639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a672f-c549-46b7-8fd8-42c4ede6a2ea tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:24.221097 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a672f-c549-46b7-8fd8-42c4ede6a2ea tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] PATH_INFO: `/v3/users/6e8ae33066d04769bc23a6d7bc55c55d/application_credentials/f4a7770d62044a71b27e1b9defbd9580` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:24.233707 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a672f-c549-46b7-8fd8-42c4ede6a2ea tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] RBAC: Authorizing `identity:delete_application_credential(user_id=6e8ae33066d04769bc23a6d7bc55c55d, application_credential_id=f4a7770d62044a71b27e1b9defbd9580)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:24.235591 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a672f-c549-46b7-8fd8-42c4ede6a2ea tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:24.263338 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:24.271960 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1873/3770] 10.222.0.83 () {58 vars in 1395 bytes} [Mon Aug 29 15:50:24 2022] DELETE /identity/v3/users/6e8ae33066d04769bc23a6d7bc55c55d/application_credentials/f4a7770d62044a71b27e1b9defbd9580 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:24.276773 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-62a97e19-5a0d-4d6b-980e-f191925ac21c None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:24.277912 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-62a97e19-5a0d-4d6b-980e-f191925ac21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:24.278383 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a672f-c549-46b7-8fd8-42c4ede6a2ea tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:24.295053 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a672f-c549-46b7-8fd8-42c4ede6a2ea tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:24.296654 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1898/3771] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:24.301649 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82605b2-6cf1-4a00-b6a2-633822818ad2 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e8ae33066d04769bc23a6d7bc55c55d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdc2b2a770a4c46bbb51076fba8a310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:24.302744 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82605b2-6cf1-4a00-b6a2-633822818ad2 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:24.302921 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a97e19-5a0d-4d6b-980e-f191925ac21c None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:24.303422 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82605b2-6cf1-4a00-b6a2-633822818ad2 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:24.303610 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82605b2-6cf1-4a00-b6a2-633822818ad2 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] PATH_INFO: `/v3/users/6e8ae33066d04769bc23a6d7bc55c55d/application_credentials` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:24.304362 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82605b2-6cf1-4a00-b6a2-633822818ad2 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] RBAC: Authorizing `identity:create_application_credential(user_id=6e8ae33066d04769bc23a6d7bc55c55d)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:24.305618 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82605b2-6cf1-4a00-b6a2-633822818ad2 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:24.330899 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a97e19-5a0d-4d6b-980e-f191925ac21c None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:24.344092 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00393b-379f-4e8c-bf7c-45f988886f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:24.345690 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00393b-379f-4e8c-bf7c-45f988886f3d admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:24.345819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00393b-379f-4e8c-bf7c-45f988886f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:24.348431 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00393b-379f-4e8c-bf7c-45f988886f3d admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:24.351956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d00393b-379f-4e8c-bf7c-45f988886f3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:50:24.352109 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d00393b-379f-4e8c-bf7c-45f988886f3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:24.355206 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d00393b-379f-4e8c-bf7c-45f988886f3d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:24.400304 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1899/3772] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:50:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:50:24.405642 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00393b-379f-4e8c-bf7c-45f988886f3d admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:24.430708 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00393b-379f-4e8c-bf7c-45f988886f3d admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:24.443897 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45322b46-4986-4b20-a2a3-ad5de81b3b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:24.445237 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45322b46-4986-4b20-a2a3-ad5de81b3b66 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:24.446339 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45322b46-4986-4b20-a2a3-ad5de81b3b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:24.447546 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45322b46-4986-4b20-a2a3-ad5de81b3b66 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:24.448747 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45322b46-4986-4b20-a2a3-ad5de81b3b66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:24.451865 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45322b46-4986-4b20-a2a3-ad5de81b3b66 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:24.497960 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1900/3773] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:50:24 2022] POST /identity/v3/projects => generated 387 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:24.499342 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45322b46-4986-4b20-a2a3-ad5de81b3b66 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:24.522305 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1874/3774] 10.222.0.83 () {60 vars in 1314 bytes} [Mon Aug 29 15:50:24 2022] POST /identity/v3/users/6e8ae33066d04769bc23a6d7bc55c55d/application_credentials => generated 789 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:24.523556 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82605b2-6cf1-4a00-b6a2-633822818ad2 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:24.556662 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82605b2-6cf1-4a00-b6a2-633822818ad2 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:24.681334 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45322b46-4986-4b20-a2a3-ad5de81b3b66 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:24.704764 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90de1e9-96b2-45d0-bb46-b5a54365ae70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:24.705529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90de1e9-96b2-45d0-bb46-b5a54365ae70 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:24.705812 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90de1e9-96b2-45d0-bb46-b5a54365ae70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:24.706088 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90de1e9-96b2-45d0-bb46-b5a54365ae70 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:24.706726 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90de1e9-96b2-45d0-bb46-b5a54365ae70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:24.708840 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90de1e9-96b2-45d0-bb46-b5a54365ae70 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:24.770306 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1901/3775] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:50:24 2022] POST /identity/v3/users => generated 294 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:24.771940 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a64dd-ea63-4734-80d1-06c6f26d71e4 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e8ae33066d04769bc23a6d7bc55c55d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdc2b2a770a4c46bbb51076fba8a310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:24.772297 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90de1e9-96b2-45d0-bb46-b5a54365ae70 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:24.773224 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a64dd-ea63-4734-80d1-06c6f26d71e4 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:24.773737 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a64dd-ea63-4734-80d1-06c6f26d71e4 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:24.774474 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a64dd-ea63-4734-80d1-06c6f26d71e4 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] PATH_INFO: `/v3/users/6e8ae33066d04769bc23a6d7bc55c55d/application_credentials` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:24.776324 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a64dd-ea63-4734-80d1-06c6f26d71e4 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] RBAC: Authorizing `identity:create_application_credential(user_id=6e8ae33066d04769bc23a6d7bc55c55d)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:24.778184 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a64dd-ea63-4734-80d1-06c6f26d71e4 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:24.778403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c90de1e9-96b2-45d0-bb46-b5a54365ae70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:24.818849 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90de1e9-96b2-45d0-bb46-b5a54365ae70 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:24.837916 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223cc66-ef8c-41b5-aca8-236a405151ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:24.838679 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223cc66-ef8c-41b5-aca8-236a405151ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:24.839102 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223cc66-ef8c-41b5-aca8-236a405151ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:24.839381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223cc66-ef8c-41b5-aca8-236a405151ee admin admin] PATH_INFO: `/v3/users/215e000f15f44b41aa38a41a941c16da` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:24.844190 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e223cc66-ef8c-41b5-aca8-236a405151ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=215e000f15f44b41aa38a41a941c16da)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:24.846177 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e223cc66-ef8c-41b5-aca8-236a405151ee admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:24.913153 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1875/3776] 10.222.0.83 () {60 vars in 1314 bytes} [Mon Aug 29 15:50:24 2022] POST /identity/v3/users/6e8ae33066d04769bc23a6d7bc55c55d/application_credentials => generated 789 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:24.918119 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d21b9-c9a8-468d-b2e3-2665ff1c3701 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:24.922281 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d21b9-c9a8-468d-b2e3-2665ff1c3701 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:24.923490 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d21b9-c9a8-468d-b2e3-2665ff1c3701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:24.974998 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e223cc66-ef8c-41b5-aca8-236a405151ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '215e000f15f44b41aa38a41a941c16da'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:24.976957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e223cc66-ef8c-41b5-aca8-236a405151ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '215e000f15f44b41aa38a41a941c16da'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:24.987106 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-352d21b9-c9a8-468d-b2e3-2665ff1c3701 None None] MFA Rules not processed for user `ea31195933be4477a588150bb1f67822`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:24.988747 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-352d21b9-c9a8-468d-b2e3-2665ff1c3701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:25.005540 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:25.014956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e223cc66-ef8c-41b5-aca8-236a405151ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '215e000f15f44b41aa38a41a941c16da'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:25.033835 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e223cc66-ef8c-41b5-aca8-236a405151ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '215e000f15f44b41aa38a41a941c16da'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:25.044845 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e223cc66-ef8c-41b5-aca8-236a405151ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '215e000f15f44b41aa38a41a941c16da'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:25.058139 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1902/3777] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:50:24 2022] DELETE /identity/v3/users/215e000f15f44b41aa38a41a941c16da => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:25.060562 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223cc66-ef8c-41b5-aca8-236a405151ee admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:25.061502 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e223cc66-ef8c-41b5-aca8-236a405151ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:25.080921 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:25.134992 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1876/3778] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:24 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:25.137802 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d21b9-c9a8-468d-b2e3-2665ff1c3701 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:25.139641 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-352d21b9-c9a8-468d-b2e3-2665ff1c3701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:25.177180 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d21b9-c9a8-468d-b2e3-2665ff1c3701 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:25.238278 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223cc66-ef8c-41b5-aca8-236a405151ee admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:25.253689 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6e11f-20a1-4fa3-bc1b-f1767f4bb6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:25.254689 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6e11f-20a1-4fa3-bc1b-f1767f4bb6bf admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:25.255205 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6e11f-20a1-4fa3-bc1b-f1767f4bb6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:25.255720 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6e11f-20a1-4fa3-bc1b-f1767f4bb6bf admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:25.256564 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6e11f-20a1-4fa3-bc1b-f1767f4bb6bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:25.258402 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6e11f-20a1-4fa3-bc1b-f1767f4bb6bf admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:25.290157 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1903/3779] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:25 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:50:25.294491 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ced947-e6de-4a94-97a3-9068c2d542ae None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:25.297686 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ced947-e6de-4a94-97a3-9068c2d542ae None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:25.298874 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ced947-e6de-4a94-97a3-9068c2d542ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:25.351339 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-76ced947-e6de-4a94-97a3-9068c2d542ae None None] MFA Rules not processed for user `ea31195933be4477a588150bb1f67822`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:25.355425 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-76ced947-e6de-4a94-97a3-9068c2d542ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:25.359860 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c45439-94cc-4b24-bc99-bc2bdc08d111 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e8ae33066d04769bc23a6d7bc55c55d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdc2b2a770a4c46bbb51076fba8a310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:25.360590 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c45439-94cc-4b24-bc99-bc2bdc08d111 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:25.360984 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c45439-94cc-4b24-bc99-bc2bdc08d111 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:25.361344 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c45439-94cc-4b24-bc99-bc2bdc08d111 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] PATH_INFO: `/v3/users/6e8ae33066d04769bc23a6d7bc55c55d/application_credentials` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:25.362144 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c45439-94cc-4b24-bc99-bc2bdc08d111 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] RBAC: Adding query filter params (name=tempest-application_credential-1379123317) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:50:25.362542 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c45439-94cc-4b24-bc99-bc2bdc08d111 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] RBAC: Authorizing `identity:list_application_credentials(user_id=6e8ae33066d04769bc23a6d7bc55c55d)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:25.366872 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c45439-94cc-4b24-bc99-bc2bdc08d111 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:25.391273 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1877/3780] 10.222.0.83 () {58 vars in 1386 bytes} [Mon Aug 29 15:50:25 2022] GET /identity/v3/users/6e8ae33066d04769bc23a6d7bc55c55d/application_credentials?name=tempest-application_credential-1379123317 => generated 887 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:50:25.392542 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c45439-94cc-4b24-bc99-bc2bdc08d111 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:25.421421 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c45439-94cc-4b24-bc99-bc2bdc08d111 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:25.433946 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e606f0-9bbe-42ae-ab0b-9da32c3c1313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:25.434706 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e606f0-9bbe-42ae-ab0b-9da32c3c1313 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:25.436741 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e606f0-9bbe-42ae-ab0b-9da32c3c1313 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:25.437113 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e606f0-9bbe-42ae-ab0b-9da32c3c1313 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:25.438537 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e606f0-9bbe-42ae-ab0b-9da32c3c1313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:25.443729 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e606f0-9bbe-42ae-ab0b-9da32c3c1313 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:25.469215 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1878/3781] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:25 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:50:25.471084 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e606f0-9bbe-42ae-ab0b-9da32c3c1313 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:25.489256 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1904/3782] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:25 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:25.489256 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ced947-e6de-4a94-97a3-9068c2d542ae None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:25.517782 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e606f0-9bbe-42ae-ab0b-9da32c3c1313 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:25.528848 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ced947-e6de-4a94-97a3-9068c2d542ae None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:25.534192 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf74b6-fb9d-4368-86d0-9de58dfa6486 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e8ae33066d04769bc23a6d7bc55c55d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdc2b2a770a4c46bbb51076fba8a310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:25.535108 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf74b6-fb9d-4368-86d0-9de58dfa6486 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:25.536799 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf74b6-fb9d-4368-86d0-9de58dfa6486 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:25.536799 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf74b6-fb9d-4368-86d0-9de58dfa6486 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] PATH_INFO: `/v3/users/6e8ae33066d04769bc23a6d7bc55c55d/application_credentials/fc91752bc80a4f1796923c5968e9c244` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:25.547679 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f773b4-0611-400d-9589-01ce81cad77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:25.548651 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f773b4-0611-400d-9589-01ce81cad77c admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:25.550331 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f773b4-0611-400d-9589-01ce81cad77c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:25.550885 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f773b4-0611-400d-9589-01ce81cad77c admin admin] PATH_INFO: `/v3/projects/65947505462641c1ac004cdacaa8317b/users/f5aa55b1030d49a7abf035fd56d8b9c2/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:25.553607 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf74b6-fb9d-4368-86d0-9de58dfa6486 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] RBAC: Authorizing `identity:delete_application_credential(user_id=6e8ae33066d04769bc23a6d7bc55c55d, application_credential_id=fc91752bc80a4f1796923c5968e9c244)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:25.555466 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf74b6-fb9d-4368-86d0-9de58dfa6486 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:25.583600 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f773b4-0611-400d-9589-01ce81cad77c admin admin] RBAC: Authorizing `identity:create_grant(project_id=65947505462641c1ac004cdacaa8317b, user_id=f5aa55b1030d49a7abf035fd56d8b9c2, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:25.588088 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f773b4-0611-400d-9589-01ce81cad77c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:25.602121 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1879/3783] 10.222.0.83 () {58 vars in 1395 bytes} [Mon Aug 29 15:50:25 2022] DELETE /identity/v3/users/6e8ae33066d04769bc23a6d7bc55c55d/application_credentials/fc91752bc80a4f1796923c5968e9c244 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:25.603909 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffa541-1033-4d62-8e9b-3a3650ee484f None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:25.605171 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffa541-1033-4d62-8e9b-3a3650ee484f None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:25.605448 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffa541-1033-4d62-8e9b-3a3650ee484f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:25.626803 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1905/3784] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:50:25 2022] PUT /identity/v3/projects/65947505462641c1ac004cdacaa8317b/users/f5aa55b1030d49a7abf035fd56d8b9c2/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:25.628093 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f773b4-0611-400d-9589-01ce81cad77c admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:25.655204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-63ffa541-1033-4d62-8e9b-3a3650ee484f None None] MFA Rules not processed for user `ea31195933be4477a588150bb1f67822`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:25.659415 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-63ffa541-1033-4d62-8e9b-3a3650ee484f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:25.818057 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f773b4-0611-400d-9589-01ce81cad77c admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:25.834415 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b614f60-e243-45c0-a55c-42e73ff94da1 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e8ae33066d04769bc23a6d7bc55c55d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdc2b2a770a4c46bbb51076fba8a310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:25.835139 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b614f60-e243-45c0-a55c-42e73ff94da1 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:25.835570 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b614f60-e243-45c0-a55c-42e73ff94da1 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:25.835872 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b614f60-e243-45c0-a55c-42e73ff94da1 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] PATH_INFO: `/v3/users/6e8ae33066d04769bc23a6d7bc55c55d/application_credentials/d93cd0924ec049dc87f8dc711cfb9ca3` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:25.839819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:25.855248 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1880/3785] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:25 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:25.856987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d551cb-7b9c-4c27-9cd5-406b7c0490c4 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:25.857383 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d551cb-7b9c-4c27-9cd5-406b7c0490c4 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:25.857761 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d551cb-7b9c-4c27-9cd5-406b7c0490c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:25.872213 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b614f60-e243-45c0-a55c-42e73ff94da1 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] RBAC: Authorizing `identity:delete_application_credential(user_id=6e8ae33066d04769bc23a6d7bc55c55d, application_credential_id=d93cd0924ec049dc87f8dc711cfb9ca3)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:25.872213 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b614f60-e243-45c0-a55c-42e73ff94da1 tempest-ApplicationCredentialsV3Test-1956110114 tempest-ApplicationCredentialsV3Test-1956110114-project] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:25.901150 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-52d551cb-7b9c-4c27-9cd5-406b7c0490c4 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:25.903085 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-52d551cb-7b9c-4c27-9cd5-406b7c0490c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:25.928554 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1906/3786] 10.222.0.83 () {58 vars in 1395 bytes} [Mon Aug 29 15:50:25 2022] DELETE /identity/v3/users/6e8ae33066d04769bc23a6d7bc55c55d/application_credentials/d93cd0924ec049dc87f8dc711cfb9ca3 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:25.928963 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff8a64-0924-4e74-be44-9e0463680e65 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:25.929258 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff8a64-0924-4e74-be44-9e0463680e65 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:25.929556 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff8a64-0924-4e74-be44-9e0463680e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:25.986700 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-c5ff8a64-0924-4e74-be44-9e0463680e65 None None] MFA Rules not processed for user `ea31195933be4477a588150bb1f67822`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:25.990222 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c5ff8a64-0924-4e74-be44-9e0463680e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:25.995175 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:26.005400 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1907/3787] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:25 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:26.015143 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff8a64-0924-4e74-be44-9e0463680e65 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:26.018671 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c5ff8a64-0924-4e74-be44-9e0463680e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:26.067449 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1881/3788] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:26.072999 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395a85d-b2ff-4c4f-9f8d-572b637a632c None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:26.073447 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395a85d-b2ff-4c4f-9f8d-572b637a632c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:26.074002 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395a85d-b2ff-4c4f-9f8d-572b637a632c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:26.101227 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-6395a85d-b2ff-4c4f-9f8d-572b637a632c None None] MFA Rules not processed for user `ea31195933be4477a588150bb1f67822`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:26.103902 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6395a85d-b2ff-4c4f-9f8d-572b637a632c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:26.120731 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1882/3789] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:26 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:26.122118 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395a85d-b2ff-4c4f-9f8d-572b637a632c None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:26.124848 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6395a85d-b2ff-4c4f-9f8d-572b637a632c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:26.190992 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395a85d-b2ff-4c4f-9f8d-572b637a632c None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:26.219253 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee92946c-c53b-4119-8358-7446ad7e6ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:26.219906 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92946c-c53b-4119-8358-7446ad7e6ff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:26.220180 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92946c-c53b-4119-8358-7446ad7e6ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:26.220446 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92946c-c53b-4119-8358-7446ad7e6ff7 admin admin] PATH_INFO: `/v3/projects/062ee746b4614e629a9d853a6d84a368` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:26.221888 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee92946c-c53b-4119-8358-7446ad7e6ff7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=062ee746b4614e629a9d853a6d84a368)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:26.224649 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee92946c-c53b-4119-8358-7446ad7e6ff7 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:26.287505 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff8a64-0924-4e74-be44-9e0463680e65 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:26.293653 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41309d3d-8751-4e16-8376-bdb4f9476839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:26.294324 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41309d3d-8751-4e16-8376-bdb4f9476839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:26.294603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41309d3d-8751-4e16-8376-bdb4f9476839 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:26.294884 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41309d3d-8751-4e16-8376-bdb4f9476839 admin admin] PATH_INFO: `/v3/users/6e8ae33066d04769bc23a6d7bc55c55d` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:26.296698 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41309d3d-8751-4e16-8376-bdb4f9476839 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e8ae33066d04769bc23a6d7bc55c55d)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:26.298765 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41309d3d-8751-4e16-8376-bdb4f9476839 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:26.430798 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-41309d3d-8751-4e16-8376-bdb4f9476839 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e8ae33066d04769bc23a6d7bc55c55d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:26.446096 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-41309d3d-8751-4e16-8376-bdb4f9476839 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e8ae33066d04769bc23a6d7bc55c55d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:26.488755 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-41309d3d-8751-4e16-8376-bdb4f9476839 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e8ae33066d04769bc23a6d7bc55c55d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:26.504401 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-41309d3d-8751-4e16-8376-bdb4f9476839 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e8ae33066d04769bc23a6d7bc55c55d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:26.516442 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ee92946c-c53b-4119-8358-7446ad7e6ff7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '062ee746b4614e629a9d853a6d84a368', 'request_id': 'req-ee92946c-c53b-4119-8358-7446ad7e6ff7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:26.552418 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-41309d3d-8751-4e16-8376-bdb4f9476839 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e8ae33066d04769bc23a6d7bc55c55d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:26.576185 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1908/3790] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:50:26 2022] DELETE /identity/v3/users/6e8ae33066d04769bc23a6d7bc55c55d => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:26.577476 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41309d3d-8751-4e16-8376-bdb4f9476839 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:26.582199 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-41309d3d-8751-4e16-8376-bdb4f9476839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:26.586839 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ee92946c-c53b-4119-8358-7446ad7e6ff7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '062ee746b4614e629a9d853a6d84a368', 'request_id': 'req-ee92946c-c53b-4119-8358-7446ad7e6ff7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:26.609916 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ee92946c-c53b-4119-8358-7446ad7e6ff7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '062ee746b4614e629a9d853a6d84a368', 'request_id': 'req-ee92946c-c53b-4119-8358-7446ad7e6ff7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:26.642767 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ee92946c-c53b-4119-8358-7446ad7e6ff7 admin admin] The token cache is being invalidate because project 062ee746b4614e629a9d853a6d84a368 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:50:26.643561 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ee92946c-c53b-4119-8358-7446ad7e6ff7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:26.645316 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ee92946c-c53b-4119-8358-7446ad7e6ff7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:26.648586 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1883/3791] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:50:26 2022] DELETE /identity/v3/projects/062ee746b4614e629a9d853a6d84a368 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:26.666687 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7607c79-dae3-4f90-8ca3-26124778f354 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:26.667667 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7607c79-dae3-4f90-8ca3-26124778f354 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:26.668429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7607c79-dae3-4f90-8ca3-26124778f354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:26.723435 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-c7607c79-dae3-4f90-8ca3-26124778f354 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:26.725880 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c7607c79-dae3-4f90-8ca3-26124778f354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:26.735671 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:26.780909 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41309d3d-8751-4e16-8376-bdb4f9476839 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:26.795347 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f059c-7db7-4cd7-946c-a0c9c446a773 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:26.795984 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f059c-7db7-4cd7-946c-a0c9c446a773 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:26.796263 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f059c-7db7-4cd7-946c-a0c9c446a773 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:26.796536 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f059c-7db7-4cd7-946c-a0c9c446a773 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:26.801214 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ec6f059c-7db7-4cd7-946c-a0c9c446a773 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:26.924434 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1884/3792] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:26.925878 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807ac7d-c8f2-49bd-b8f8-7d37203eb639 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:26.926167 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807ac7d-c8f2-49bd-b8f8-7d37203eb639 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:26.926443 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807ac7d-c8f2-49bd-b8f8-7d37203eb639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:27.030819 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-d807ac7d-c8f2-49bd-b8f8-7d37203eb639 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:27.035285 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d807ac7d-c8f2-49bd-b8f8-7d37203eb639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:27.043350 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6f059c-7db7-4cd7-946c-a0c9c446a773 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:27.057682 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6f059c-7db7-4cd7-946c-a0c9c446a773 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:27.081924 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1885/3793] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:27.082785 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807ac7d-c8f2-49bd-b8f8-7d37203eb639 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:27.094335 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1909/3794] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:50:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:50:27.096475 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79e765-aa69-4016-b212-bea3f3ba8d4e None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:27.097020 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79e765-aa69-4016-b212-bea3f3ba8d4e None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:27.097203 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d807ac7d-c8f2-49bd-b8f8-7d37203eb639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:27.097773 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79e765-aa69-4016-b212-bea3f3ba8d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:27.143834 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807ac7d-c8f2-49bd-b8f8-7d37203eb639 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:27.148168 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16f06d-c239-42d7-832a-f6d788689042 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:27.148919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16f06d-c239-42d7-832a-f6d788689042 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:27.149459 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16f06d-c239-42d7-832a-f6d788689042 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:27.150811 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16f06d-c239-42d7-832a-f6d788689042 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:27.162861 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f16f06d-c239-42d7-832a-f6d788689042 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:27.164389 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f16f06d-c239-42d7-832a-f6d788689042 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:27.175824 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-6e79e765-aa69-4016-b212-bea3f3ba8d4e None None] MFA Rules not processed for user `d008ed466820477197b94d0c18f7eb1c`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:27.177403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6e79e765-aa69-4016-b212-bea3f3ba8d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:27.177828 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1886/3795] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:50:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:50:27.179303 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bce48-7fdd-4617-ae4b-1fc165f04aa9 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:27.179622 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bce48-7fdd-4617-ae4b-1fc165f04aa9 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:27.179964 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bce48-7fdd-4617-ae4b-1fc165f04aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:27.227252 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-212bce48-7fdd-4617-ae4b-1fc165f04aa9 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:27.229690 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-212bce48-7fdd-4617-ae4b-1fc165f04aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:27.250578 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1887/3796] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:27.255106 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212bce48-7fdd-4617-ae4b-1fc165f04aa9 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:27.282020 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212bce48-7fdd-4617-ae4b-1fc165f04aa9 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:27.293038 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd07f5c-6aa0-450e-98d4-824f018c6ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:27.293770 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd07f5c-6aa0-450e-98d4-824f018c6ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:27.294118 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd07f5c-6aa0-450e-98d4-824f018c6ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:27.294855 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd07f5c-6aa0-450e-98d4-824f018c6ea0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:27.295624 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd07f5c-6aa0-450e-98d4-824f018c6ea0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:50:27.296056 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd07f5c-6aa0-450e-98d4-824f018c6ea0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:27.299607 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd07f5c-6aa0-450e-98d4-824f018c6ea0 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:27.326697 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1888/3797] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:50:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:50:27.333573 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd07f5c-6aa0-450e-98d4-824f018c6ea0 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:27.349051 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1910/3798] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:27.359521 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd07f5c-6aa0-450e-98d4-824f018c6ea0 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:27.365860 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35af5c7-3f43-40f2-9274-23fd198eb5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:27.367016 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35af5c7-3f43-40f2-9274-23fd198eb5f4 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:27.367414 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35af5c7-3f43-40f2-9274-23fd198eb5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:27.367781 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35af5c7-3f43-40f2-9274-23fd198eb5f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:27.368582 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35af5c7-3f43-40f2-9274-23fd198eb5f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:27.370764 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35af5c7-3f43-40f2-9274-23fd198eb5f4 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:27.406216 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:27.420289 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1889/3799] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:50:27 2022] POST /identity/v3/projects => generated 365 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:27.424075 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79e765-aa69-4016-b212-bea3f3ba8d4e None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:27.441652 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79e765-aa69-4016-b212-bea3f3ba8d4e None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:27.581231 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905040f2-7a60-4d3d-bd83-2e7eb038c54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:27.598370 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905040f2-7a60-4d3d-bd83-2e7eb038c54f admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:27.598944 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905040f2-7a60-4d3d-bd83-2e7eb038c54f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:27.599471 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905040f2-7a60-4d3d-bd83-2e7eb038c54f admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:27.602508 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905040f2-7a60-4d3d-bd83-2e7eb038c54f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:27.606560 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905040f2-7a60-4d3d-bd83-2e7eb038c54f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:27.654697 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1911/3800] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:50:27 2022] POST /identity/v3/users => generated 283 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:27.658478 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35af5c7-3f43-40f2-9274-23fd198eb5f4 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:27.725907 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35af5c7-3f43-40f2-9274-23fd198eb5f4 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:27.737093 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905040f2-7a60-4d3d-bd83-2e7eb038c54f admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:27.746200 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-905040f2-7a60-4d3d-bd83-2e7eb038c54f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:27.755845 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8595c6d-587d-4572-9fcf-8e6c1b3759ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:27.759823 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8595c6d-587d-4572-9fcf-8e6c1b3759ba admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:27.762640 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8595c6d-587d-4572-9fcf-8e6c1b3759ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:27.764082 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8595c6d-587d-4572-9fcf-8e6c1b3759ba admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:27.767735 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8595c6d-587d-4572-9fcf-8e6c1b3759ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:27.785540 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8595c6d-587d-4572-9fcf-8e6c1b3759ba admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:27.798507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:27.820675 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1890/3801] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:50:27.828365 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8595c6d-587d-4572-9fcf-8e6c1b3759ba admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:27.873195 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8595c6d-587d-4572-9fcf-8e6c1b3759ba admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:27.882470 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f417b-edb8-4a0b-90c6-b22e85474af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:27.885913 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f417b-edb8-4a0b-90c6-b22e85474af7 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:27.886410 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f417b-edb8-4a0b-90c6-b22e85474af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:27.886992 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f417b-edb8-4a0b-90c6-b22e85474af7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:27.890528 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991f417b-edb8-4a0b-90c6-b22e85474af7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:27.892462 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991f417b-edb8-4a0b-90c6-b22e85474af7 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:27.913376 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1891/3802] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:50:27.915339 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f417b-edb8-4a0b-90c6-b22e85474af7 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:27.944214 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f417b-edb8-4a0b-90c6-b22e85474af7 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:27.956982 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b316e-fa9c-47f9-80e0-9240af4214b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:27.957805 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b316e-fa9c-47f9-80e0-9240af4214b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:27.958092 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b316e-fa9c-47f9-80e0-9240af4214b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:27.958518 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b316e-fa9c-47f9-80e0-9240af4214b4 admin admin] PATH_INFO: `/v3/projects/a8591065e9fa421b8e44767aa38fd84f/users/a3e14fd42e5942199e28335124d59c75/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:27.980014 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905040f2-7a60-4d3d-bd83-2e7eb038c54f admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:27.980227 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b316e-fa9c-47f9-80e0-9240af4214b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8591065e9fa421b8e44767aa38fd84f, user_id=a3e14fd42e5942199e28335124d59c75, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:27.983932 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b316e-fa9c-47f9-80e0-9240af4214b4 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:27.999308 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea36acc-df25-42f2-9d16-78766878202a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:28.000025 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea36acc-df25-42f2-9d16-78766878202a service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:28.000310 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea36acc-df25-42f2-9d16-78766878202a service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:28.000588 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea36acc-df25-42f2-9d16-78766878202a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:28.011437 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1892/3803] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:50:27 2022] PUT /identity/v3/projects/a8591065e9fa421b8e44767aa38fd84f/users/a3e14fd42e5942199e28335124d59c75/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:28.013826 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18faeb92-0bf0-4f13-8223-3a0b2baa95af None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:28.014152 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18faeb92-0bf0-4f13-8223-3a0b2baa95af None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:28.014555 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18faeb92-0bf0-4f13-8223-3a0b2baa95af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:28.051255 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-18faeb92-0bf0-4f13-8223-3a0b2baa95af None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:28.054385 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-18faeb92-0bf0-4f13-8223-3a0b2baa95af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:28.162274 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea36acc-df25-42f2-9d16-78766878202a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:28.165970 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea36acc-df25-42f2-9d16-78766878202a service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:28.198448 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1912/3804] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:50:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:50:28.242574 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1893/3805] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:28.299226 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea36acc-df25-42f2-9d16-78766878202a service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:28.420127 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea36acc-df25-42f2-9d16-78766878202a service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:28.560674 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33970ba-e650-4546-a7ee-293a4a7adafe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:28.561354 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33970ba-e650-4546-a7ee-293a4a7adafe service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:28.561654 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33970ba-e650-4546-a7ee-293a4a7adafe service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:28.561934 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33970ba-e650-4546-a7ee-293a4a7adafe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:28.582351 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33970ba-e650-4546-a7ee-293a4a7adafe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:28.584441 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33970ba-e650-4546-a7ee-293a4a7adafe service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:28.595320 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:28.611648 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1913/3806] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:50:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:50:28.796299 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18faeb92-0bf0-4f13-8223-3a0b2baa95af None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:28.798113 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-18faeb92-0bf0-4f13-8223-3a0b2baa95af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:28.819178 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18faeb92-0bf0-4f13-8223-3a0b2baa95af None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:28.839551 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4a74e-7b74-45e5-aa11-68300b698343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:28.840296 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4a74e-7b74-45e5-aa11-68300b698343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:28.840677 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4a74e-7b74-45e5-aa11-68300b698343 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:28.841139 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4a74e-7b74-45e5-aa11-68300b698343 admin admin] PATH_INFO: `/v3/projects/1fdc2b2a770a4c46bbb51076fba8a310` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:28.848179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e4a74e-7b74-45e5-aa11-68300b698343 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fdc2b2a770a4c46bbb51076fba8a310)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:28.850274 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e4a74e-7b74-45e5-aa11-68300b698343 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:28.946538 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-69e4a74e-7b74-45e5-aa11-68300b698343 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fdc2b2a770a4c46bbb51076fba8a310', 'request_id': 'req-69e4a74e-7b74-45e5-aa11-68300b698343'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:28.953701 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-69e4a74e-7b74-45e5-aa11-68300b698343 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fdc2b2a770a4c46bbb51076fba8a310', 'request_id': 'req-69e4a74e-7b74-45e5-aa11-68300b698343'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:28.960805 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-69e4a74e-7b74-45e5-aa11-68300b698343 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fdc2b2a770a4c46bbb51076fba8a310', 'request_id': 'req-69e4a74e-7b74-45e5-aa11-68300b698343'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:28.988597 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-69e4a74e-7b74-45e5-aa11-68300b698343 admin admin] The token cache is being invalidate because project 1fdc2b2a770a4c46bbb51076fba8a310 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:50:28.988954 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-69e4a74e-7b74-45e5-aa11-68300b698343 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:28.989688 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-69e4a74e-7b74-45e5-aa11-68300b698343 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:28.991769 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1894/3807] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:50:28 2022] DELETE /identity/v3/projects/1fdc2b2a770a4c46bbb51076fba8a310 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:28.998640 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e35c7-d657-4567-a010-2b28bd7b5ee0 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:29.000244 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e35c7-d657-4567-a010-2b28bd7b5ee0 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:29.000765 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e35c7-d657-4567-a010-2b28bd7b5ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:29.044490 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-c93e35c7-d657-4567-a010-2b28bd7b5ee0 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:29.059279 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c93e35c7-d657-4567-a010-2b28bd7b5ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:29.169206 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1914/3808] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:29.177780 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a488632-3d61-4ea5-b6a4-2cbf60a61f3a None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:29.178354 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a488632-3d61-4ea5-b6a4-2cbf60a61f3a None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:29.178646 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a488632-3d61-4ea5-b6a4-2cbf60a61f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:29.209576 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-0a488632-3d61-4ea5-b6a4-2cbf60a61f3a None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:29.211873 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0a488632-3d61-4ea5-b6a4-2cbf60a61f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:29.222378 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1895/3809] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:29.226308 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e35c7-d657-4567-a010-2b28bd7b5ee0 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:29.243393 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e35c7-d657-4567-a010-2b28bd7b5ee0 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:29.259926 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb65a12e-ef7d-48d6-abeb-36bacd392b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:29.261035 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65a12e-ef7d-48d6-abeb-36bacd392b6f admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:29.261664 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65a12e-ef7d-48d6-abeb-36bacd392b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:29.262186 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65a12e-ef7d-48d6-abeb-36bacd392b6f admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:29.263043 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb65a12e-ef7d-48d6-abeb-36bacd392b6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:50:29.263706 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb65a12e-ef7d-48d6-abeb-36bacd392b6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:29.265659 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb65a12e-ef7d-48d6-abeb-36bacd392b6f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:29.291343 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1915/3810] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:50:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:50:29.294343 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a488632-3d61-4ea5-b6a4-2cbf60a61f3a None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:29.316405 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a488632-3d61-4ea5-b6a4-2cbf60a61f3a None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:29.332856 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a05014-2795-410f-812b-772709bb081a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:29.333500 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a05014-2795-410f-812b-772709bb081a admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:29.333782 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a05014-2795-410f-812b-772709bb081a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:29.334053 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a05014-2795-410f-812b-772709bb081a admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:29.337599 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a05014-2795-410f-812b-772709bb081a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:29.341151 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a05014-2795-410f-812b-772709bb081a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:29.390523 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1896/3811] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:50:29 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:29.394538 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb65a12e-ef7d-48d6-abeb-36bacd392b6f admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:29.407399 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb65a12e-ef7d-48d6-abeb-36bacd392b6f admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:29.506818 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80ac380-be6e-4e9d-8976-6443fa9f4a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:29.508222 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ac380-be6e-4e9d-8976-6443fa9f4a0d admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:29.508818 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ac380-be6e-4e9d-8976-6443fa9f4a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:29.509472 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ac380-be6e-4e9d-8976-6443fa9f4a0d admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:29.510647 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80ac380-be6e-4e9d-8976-6443fa9f4a0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:29.513705 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80ac380-be6e-4e9d-8976-6443fa9f4a0d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:29.560646 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1916/3812] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:50:29 2022] POST /identity/v3/users => generated 290 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:29.561853 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a05014-2795-410f-812b-772709bb081a admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:29.575549 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a05014-2795-410f-812b-772709bb081a admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:29.589907 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c9b1d-8d11-4dd5-a822-cea2649fce98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:29.591883 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c9b1d-8d11-4dd5-a822-cea2649fce98 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:29.592387 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c9b1d-8d11-4dd5-a822-cea2649fce98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:29.592853 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c9b1d-8d11-4dd5-a822-cea2649fce98 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:29.595272 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09c9b1d-8d11-4dd5-a822-cea2649fce98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:29.599380 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09c9b1d-8d11-4dd5-a822-cea2649fce98 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:29.610439 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:29.633581 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80ac380-be6e-4e9d-8976-6443fa9f4a0d admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:29.634373 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1897/3813] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:50:29.650316 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80ac380-be6e-4e9d-8976-6443fa9f4a0d admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:29.655512 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc62d9-98f6-4aef-b3c6-d9600c44c8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:29.656337 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc62d9-98f6-4aef-b3c6-d9600c44c8db admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:29.656764 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc62d9-98f6-4aef-b3c6-d9600c44c8db admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:29.657390 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc62d9-98f6-4aef-b3c6-d9600c44c8db admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:29.658246 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcc62d9-98f6-4aef-b3c6-d9600c44c8db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:29.660112 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcc62d9-98f6-4aef-b3c6-d9600c44c8db admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:29.680082 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c9b1d-8d11-4dd5-a822-cea2649fce98 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:29.689640 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1917/3814] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:50:29.693299 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c9b1d-8d11-4dd5-a822-cea2649fce98 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:29.716444 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ce8d2-c47d-49c1-8af5-4ab345a84ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:29.717558 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ce8d2-c47d-49c1-8af5-4ab345a84ad8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:29.717852 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ce8d2-c47d-49c1-8af5-4ab345a84ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:29.718281 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ce8d2-c47d-49c1-8af5-4ab345a84ad8 admin admin] PATH_INFO: `/v3/projects/7817da6ff0a744cc92b5c0a5f91a2be1/users/142608ffc0d94e0daec3ef4ac263912d/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:29.751183 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ce8d2-c47d-49c1-8af5-4ab345a84ad8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7817da6ff0a744cc92b5c0a5f91a2be1, user_id=142608ffc0d94e0daec3ef4ac263912d, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:29.754244 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ce8d2-c47d-49c1-8af5-4ab345a84ad8 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:29.794417 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1898/3815] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:50:29 2022] PUT /identity/v3/projects/7817da6ff0a744cc92b5c0a5f91a2be1/users/142608ffc0d94e0daec3ef4ac263912d/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:29.805231 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca12ddc-a5df-45d1-bd2c-a5e82ff032cf None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:29.805675 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca12ddc-a5df-45d1-bd2c-a5e82ff032cf None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:29.806656 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca12ddc-a5df-45d1-bd2c-a5e82ff032cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:29.867344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-4ca12ddc-a5df-45d1-bd2c-a5e82ff032cf None None] MFA Rules not processed for user `142608ffc0d94e0daec3ef4ac263912d`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:29.869744 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4ca12ddc-a5df-45d1-bd2c-a5e82ff032cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:29.900811 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cdc5f-e485-4ba2-80e6-94a8a997e3e8 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:29.901193 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cdc5f-e485-4ba2-80e6-94a8a997e3e8 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:29.901355 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cdc5f-e485-4ba2-80e6-94a8a997e3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:29.963612 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-ed0cdc5f-e485-4ba2-80e6-94a8a997e3e8 None None] MFA Rules not processed for user `f5aa55b1030d49a7abf035fd56d8b9c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:29.965139 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ed0cdc5f-e485-4ba2-80e6-94a8a997e3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:30.025443 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:30.047549 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1918/3816] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:30.052925 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca12ddc-a5df-45d1-bd2c-a5e82ff032cf None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:30.069664 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca12ddc-a5df-45d1-bd2c-a5e82ff032cf None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:30.078155 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475661d-f8e9-46c1-83a5-74667e7ac43c tempest-DefaultDomainTestJSON-2140672628 tempest-DefaultDomainTestJSON-2140672628-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '142608ffc0d94e0daec3ef4ac263912d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7817da6ff0a744cc92b5c0a5f91a2be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:30.081645 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475661d-f8e9-46c1-83a5-74667e7ac43c tempest-DefaultDomainTestJSON-2140672628 tempest-DefaultDomainTestJSON-2140672628-project] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:30.083959 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475661d-f8e9-46c1-83a5-74667e7ac43c tempest-DefaultDomainTestJSON-2140672628 tempest-DefaultDomainTestJSON-2140672628-project] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:30.084934 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475661d-f8e9-46c1-83a5-74667e7ac43c tempest-DefaultDomainTestJSON-2140672628 tempest-DefaultDomainTestJSON-2140672628-project] PATH_INFO: `/v3/domains/default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:30.088860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6475661d-f8e9-46c1-83a5-74667e7ac43c tempest-DefaultDomainTestJSON-2140672628 tempest-DefaultDomainTestJSON-2140672628-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:30.097887 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6475661d-f8e9-46c1-83a5-74667e7ac43c tempest-DefaultDomainTestJSON-2140672628 tempest-DefaultDomainTestJSON-2140672628-project] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:30.103691 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1919/3817] 10.222.0.83 () {58 vars in 1152 bytes} [Mon Aug 29 15:50:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:50:30.109021 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475661d-f8e9-46c1-83a5-74667e7ac43c tempest-DefaultDomainTestJSON-2140672628 tempest-DefaultDomainTestJSON-2140672628-project] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:30.164490 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1899/3818] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:50:30.175683 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db691a-7908-4f00-8a65-31565710593d None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:30.176242 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db691a-7908-4f00-8a65-31565710593d None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:30.176743 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db691a-7908-4f00-8a65-31565710593d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:30.204513 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-98db691a-7908-4f00-8a65-31565710593d None None] MFA Rules not processed for user `f5aa55b1030d49a7abf035fd56d8b9c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:30.206594 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-98db691a-7908-4f00-8a65-31565710593d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:30.226375 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1900/3819] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:30.237158 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e255e-c959-4854-a2d3-2e56b532a445 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:30.237816 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e255e-c959-4854-a2d3-2e56b532a445 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:30.238300 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e255e-c959-4854-a2d3-2e56b532a445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:30.252773 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475661d-f8e9-46c1-83a5-74667e7ac43c tempest-DefaultDomainTestJSON-2140672628 tempest-DefaultDomainTestJSON-2140672628-project] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:30.273002 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa6fd9-ce6c-476b-9c53-97c3e4d03169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:30.273714 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa6fd9-ce6c-476b-9c53-97c3e4d03169 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:30.274687 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa6fd9-ce6c-476b-9c53-97c3e4d03169 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:30.274687 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa6fd9-ce6c-476b-9c53-97c3e4d03169 admin admin] PATH_INFO: `/v3/users/142608ffc0d94e0daec3ef4ac263912d` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:30.277246 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa6fd9-ce6c-476b-9c53-97c3e4d03169 admin admin] RBAC: Authorizing `identity:delete_user(user_id=142608ffc0d94e0daec3ef4ac263912d)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:30.282069 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa6fd9-ce6c-476b-9c53-97c3e4d03169 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:30.287593 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-821e255e-c959-4854-a2d3-2e56b532a445 None None] MFA Rules not processed for user `f5aa55b1030d49a7abf035fd56d8b9c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:30.291079 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-821e255e-c959-4854-a2d3-2e56b532a445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:30.315081 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1901/3820] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:30.328928 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e255e-c959-4854-a2d3-2e56b532a445 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:30.332933 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-821e255e-c959-4854-a2d3-2e56b532a445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:30.417104 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-19aa6fd9-ce6c-476b-9c53-97c3e4d03169 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '142608ffc0d94e0daec3ef4ac263912d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:30.420403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-19aa6fd9-ce6c-476b-9c53-97c3e4d03169 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '142608ffc0d94e0daec3ef4ac263912d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:30.449152 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-19aa6fd9-ce6c-476b-9c53-97c3e4d03169 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '142608ffc0d94e0daec3ef4ac263912d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:30.473134 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-19aa6fd9-ce6c-476b-9c53-97c3e4d03169 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '142608ffc0d94e0daec3ef4ac263912d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:30.486218 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-19aa6fd9-ce6c-476b-9c53-97c3e4d03169 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '142608ffc0d94e0daec3ef4ac263912d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:30.507207 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1920/3821] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:50:30 2022] DELETE /identity/v3/users/142608ffc0d94e0daec3ef4ac263912d => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:30.512283 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308407d6-a8f6-4b7c-900b-e459e2b3fc62 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:30.512573 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308407d6-a8f6-4b7c-900b-e459e2b3fc62 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:30.512854 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308407d6-a8f6-4b7c-900b-e459e2b3fc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:30.515850 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e255e-c959-4854-a2d3-2e56b532a445 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:30.551560 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-308407d6-a8f6-4b7c-900b-e459e2b3fc62 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:30.552740 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-308407d6-a8f6-4b7c-900b-e459e2b3fc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:30.580621 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:30.616664 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e9108-7baa-4d02-969d-323494a88ed1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:30.617414 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e9108-7baa-4d02-969d-323494a88ed1 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:30.617792 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e9108-7baa-4d02-969d-323494a88ed1 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:30.618231 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e9108-7baa-4d02-969d-323494a88ed1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:30.620928 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b69e9108-7baa-4d02-969d-323494a88ed1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:30.707974 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1921/3822] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:50:30.749481 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308407d6-a8f6-4b7c-900b-e459e2b3fc62 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:30.752854 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-308407d6-a8f6-4b7c-900b-e459e2b3fc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:30.778720 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e9108-7baa-4d02-969d-323494a88ed1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:30.782692 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:30.783969 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e9108-7baa-4d02-969d-323494a88ed1 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:30.808018 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1902/3823] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:50:30 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:50:30.884891 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308407d6-a8f6-4b7c-900b-e459e2b3fc62 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:30.890324 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c933e24-bbbb-4f5d-961a-2a04a9629fec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:30.895072 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c933e24-bbbb-4f5d-961a-2a04a9629fec service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:30.895072 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c933e24-bbbb-4f5d-961a-2a04a9629fec service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:30.895072 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c933e24-bbbb-4f5d-961a-2a04a9629fec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:30.951980 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c933e24-bbbb-4f5d-961a-2a04a9629fec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:30.954006 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c933e24-bbbb-4f5d-961a-2a04a9629fec service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:30.985450 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1922/3824] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:50:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:50:32.945423 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e9108-7baa-4d02-969d-323494a88ed1 service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:32.951886 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b69e9108-7baa-4d02-969d-323494a88ed1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:32.989357 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e9108-7baa-4d02-969d-323494a88ed1 service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:33.001973 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc15f4f9-56a6-49a2-8f89-f230b95c2720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:33.002641 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15f4f9-56a6-49a2-8f89-f230b95c2720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:33.002919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15f4f9-56a6-49a2-8f89-f230b95c2720 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:33.003228 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15f4f9-56a6-49a2-8f89-f230b95c2720 admin admin] PATH_INFO: `/v3/projects/7817da6ff0a744cc92b5c0a5f91a2be1` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:33.010201 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc15f4f9-56a6-49a2-8f89-f230b95c2720 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7817da6ff0a744cc92b5c0a5f91a2be1)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:33.012202 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc15f4f9-56a6-49a2-8f89-f230b95c2720 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:33.144273 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-dc15f4f9-56a6-49a2-8f89-f230b95c2720 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7817da6ff0a744cc92b5c0a5f91a2be1', 'request_id': 'req-dc15f4f9-56a6-49a2-8f89-f230b95c2720'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:33.156965 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-dc15f4f9-56a6-49a2-8f89-f230b95c2720 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7817da6ff0a744cc92b5c0a5f91a2be1', 'request_id': 'req-dc15f4f9-56a6-49a2-8f89-f230b95c2720'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:33.185153 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-dc15f4f9-56a6-49a2-8f89-f230b95c2720 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7817da6ff0a744cc92b5c0a5f91a2be1', 'request_id': 'req-dc15f4f9-56a6-49a2-8f89-f230b95c2720'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:33.212131 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-dc15f4f9-56a6-49a2-8f89-f230b95c2720 admin admin] The token cache is being invalidate because project 7817da6ff0a744cc92b5c0a5f91a2be1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:50:33.226701 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-dc15f4f9-56a6-49a2-8f89-f230b95c2720 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:33.228582 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-dc15f4f9-56a6-49a2-8f89-f230b95c2720 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:33.235318 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1903/3825] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:50:32 2022] DELETE /identity/v3/projects/7817da6ff0a744cc92b5c0a5f91a2be1 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:33.238117 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436596c-db9d-47fc-8c8d-b3609ea08238 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:33.238117 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436596c-db9d-47fc-8c8d-b3609ea08238 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:33.238117 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436596c-db9d-47fc-8c8d-b3609ea08238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:33.286852 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-2436596c-db9d-47fc-8c8d-b3609ea08238 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:33.288418 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2436596c-db9d-47fc-8c8d-b3609ea08238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:33.507949 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1923/3826] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:33.517859 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce25ee-f26b-4cdb-b69a-1eebc0bca273 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:33.518251 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce25ee-f26b-4cdb-b69a-1eebc0bca273 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:33.518629 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce25ee-f26b-4cdb-b69a-1eebc0bca273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:33.563785 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-72ce25ee-f26b-4cdb-b69a-1eebc0bca273 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:33.565262 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-72ce25ee-f26b-4cdb-b69a-1eebc0bca273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:33.584750 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2436596c-db9d-47fc-8c8d-b3609ea08238 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:33.592502 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1904/3827] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:33.597008 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2436596c-db9d-47fc-8c8d-b3609ea08238 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:33.602311 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfb338-c06d-4e5b-97e5-0163d17433a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:33.603678 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfb338-c06d-4e5b-97e5-0163d17433a1 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:33.604221 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfb338-c06d-4e5b-97e5-0163d17433a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:33.604913 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfb338-c06d-4e5b-97e5-0163d17433a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:33.605694 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dfb338-c06d-4e5b-97e5-0163d17433a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:50:33.606106 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dfb338-c06d-4e5b-97e5-0163d17433a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:33.611349 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dfb338-c06d-4e5b-97e5-0163d17433a1 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:33.638075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce25ee-f26b-4cdb-b69a-1eebc0bca273 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:33.643371 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1924/3828] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:50:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:50:33.662050 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce25ee-f26b-4cdb-b69a-1eebc0bca273 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:33.669671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ef85f-771f-4100-9eba-24734b1696e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:33.673590 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ef85f-771f-4100-9eba-24734b1696e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:33.685218 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ef85f-771f-4100-9eba-24734b1696e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:33.685779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ef85f-771f-4100-9eba-24734b1696e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:33.686858 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ef85f-771f-4100-9eba-24734b1696e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:33.689327 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ef85f-771f-4100-9eba-24734b1696e2 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:33.778173 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b201c-0083-4dd1-b99e-79c359a33f51 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:33.778173 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b201c-0083-4dd1-b99e-79c359a33f51 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:33.778173 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b201c-0083-4dd1-b99e-79c359a33f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:33.860807 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-4d1b201c-0083-4dd1-b99e-79c359a33f51 None None] MFA Rules not processed for user `f5aa55b1030d49a7abf035fd56d8b9c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:33.861161 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1905/3829] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:50:33 2022] POST /identity/v3/projects => generated 385 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:50:33.862064 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4d1b201c-0083-4dd1-b99e-79c359a33f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:33.867803 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ef85f-771f-4100-9eba-24734b1696e2 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:33.999700 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:34.061690 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ef85f-771f-4100-9eba-24734b1696e2 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:34.071648 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb5422-2550-4329-96d6-900d91e44b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:34.072881 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb5422-2550-4329-96d6-900d91e44b16 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:34.073589 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb5422-2550-4329-96d6-900d91e44b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:34.074149 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb5422-2550-4329-96d6-900d91e44b16 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:34.075255 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb5422-2550-4329-96d6-900d91e44b16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:34.079573 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb5422-2550-4329-96d6-900d91e44b16 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:34.118359 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1925/3830] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:34.138992 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1906/3831] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:50:33 2022] POST /identity/v3/users => generated 299 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:34.142756 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b201c-0083-4dd1-b99e-79c359a33f51 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:34.164976 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b201c-0083-4dd1-b99e-79c359a33f51 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:34.178252 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4de63-57b6-4bb3-bc25-12d76251d1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:34.178870 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4de63-57b6-4bb3-bc25-12d76251d1a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:34.181332 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4de63-57b6-4bb3-bc25-12d76251d1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:34.181894 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4de63-57b6-4bb3-bc25-12d76251d1a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:34.183965 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db4de63-57b6-4bb3-bc25-12d76251d1a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:34.187383 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db4de63-57b6-4bb3-bc25-12d76251d1a3 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:34.218169 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1926/3832] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:50:34.219121 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb5422-2550-4329-96d6-900d91e44b16 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:34.238372 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb5422-2550-4329-96d6-900d91e44b16 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:34.247443 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbd7d5-c43d-49a3-9cd0-9e4f7d0fffe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:34.248384 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbd7d5-c43d-49a3-9cd0-9e4f7d0fffe6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:34.248808 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbd7d5-c43d-49a3-9cd0-9e4f7d0fffe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:34.249098 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbd7d5-c43d-49a3-9cd0-9e4f7d0fffe6 admin admin] PATH_INFO: `/v3/projects/28e8cadc266b447f9226a34dfcc79d2b/users/2070d2a9bc8349df855abb6685d3a16f/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:34.279612 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adbd7d5-c43d-49a3-9cd0-9e4f7d0fffe6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28e8cadc266b447f9226a34dfcc79d2b, user_id=2070d2a9bc8349df855abb6685d3a16f, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:34.308070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adbd7d5-c43d-49a3-9cd0-9e4f7d0fffe6 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:34.364016 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1907/3833] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:50:34 2022] PUT /identity/v3/projects/28e8cadc266b447f9226a34dfcc79d2b/users/2070d2a9bc8349df855abb6685d3a16f/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:34.368238 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4de63-57b6-4bb3-bc25-12d76251d1a3 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:34.407082 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4de63-57b6-4bb3-bc25-12d76251d1a3 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:34.526107 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:34.594413 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6fdf35-b597-4b40-9e5c-71b87b92c9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:34.595322 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6fdf35-b597-4b40-9e5c-71b87b92c9a1 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:34.595601 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6fdf35-b597-4b40-9e5c-71b87b92c9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:34.595878 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6fdf35-b597-4b40-9e5c-71b87b92c9a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:34.597082 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6fdf35-b597-4b40-9e5c-71b87b92c9a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:34.598721 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6fdf35-b597-4b40-9e5c-71b87b92c9a1 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:34.652726 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbd7d5-c43d-49a3-9cd0-9e4f7d0fffe6 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:34.653583 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1927/3834] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:50:34.667310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbd7d5-c43d-49a3-9cd0-9e4f7d0fffe6 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:34.693118 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db99c9f-8915-40b4-b56b-3ddebf90cae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:34.695558 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db99c9f-8915-40b4-b56b-3ddebf90cae8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:34.695992 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db99c9f-8915-40b4-b56b-3ddebf90cae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:34.696283 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db99c9f-8915-40b4-b56b-3ddebf90cae8 admin admin] PATH_INFO: `/v3/projects/28e8cadc266b447f9226a34dfcc79d2b/users/2070d2a9bc8349df855abb6685d3a16f/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:34.714863 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db99c9f-8915-40b4-b56b-3ddebf90cae8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28e8cadc266b447f9226a34dfcc79d2b, user_id=2070d2a9bc8349df855abb6685d3a16f, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:34.721976 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db99c9f-8915-40b4-b56b-3ddebf90cae8 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:34.779937 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1908/3835] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:50:34 2022] PUT /identity/v3/projects/28e8cadc266b447f9226a34dfcc79d2b/users/2070d2a9bc8349df855abb6685d3a16f/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:34.795138 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b51da-e24b-4a42-a7b9-29d7d9cb86d1 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:34.795423 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b51da-e24b-4a42-a7b9-29d7d9cb86d1 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:34.795701 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b51da-e24b-4a42-a7b9-29d7d9cb86d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:34.875954 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-857b51da-e24b-4a42-a7b9-29d7d9cb86d1 None None] MFA Rules not processed for user `2070d2a9bc8349df855abb6685d3a16f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:34.877524 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-857b51da-e24b-4a42-a7b9-29d7d9cb86d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:35.132091 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1928/3836] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:34 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:35.137970 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db99c9f-8915-40b4-b56b-3ddebf90cae8 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:35.302301 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db99c9f-8915-40b4-b56b-3ddebf90cae8 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:35.323645 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e7ab3-6b32-4849-9176-1069c40c540a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:35.324298 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e7ab3-6b32-4849-9176-1069c40c540a admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:35.324578 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e7ab3-6b32-4849-9176-1069c40c540a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:35.324848 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e7ab3-6b32-4849-9176-1069c40c540a admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:35.325513 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281e7ab3-6b32-4849-9176-1069c40c540a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:35.329958 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281e7ab3-6b32-4849-9176-1069c40c540a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:35.401203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b51da-e24b-4a42-a7b9-29d7d9cb86d1 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:35.401851 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1909/3837] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:50:35 2022] POST /identity/v3/projects => generated 383 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:35.419425 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b51da-e24b-4a42-a7b9-29d7d9cb86d1 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:35.531213 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b26bc8-fe07-4351-87a0-3dbf2fead70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:35.532455 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b26bc8-fe07-4351-87a0-3dbf2fead70a admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:35.532962 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b26bc8-fe07-4351-87a0-3dbf2fead70a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:35.533890 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b26bc8-fe07-4351-87a0-3dbf2fead70a admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:35.534805 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b26bc8-fe07-4351-87a0-3dbf2fead70a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:35.537607 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b26bc8-fe07-4351-87a0-3dbf2fead70a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:35.596355 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1929/3838] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:50:35 2022] POST /identity/v3/users => generated 292 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:50:35.601130 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e7ab3-6b32-4849-9176-1069c40c540a admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:35.618028 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e7ab3-6b32-4849-9176-1069c40c540a admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:35.652326 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6deb4f-2a74-48b5-a262-c1975e2af62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:35.654538 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6deb4f-2a74-48b5-a262-c1975e2af62f admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:35.655196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6deb4f-2a74-48b5-a262-c1975e2af62f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:35.655578 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6deb4f-2a74-48b5-a262-c1975e2af62f admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:35.656619 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6deb4f-2a74-48b5-a262-c1975e2af62f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:35.660473 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6deb4f-2a74-48b5-a262-c1975e2af62f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:35.698062 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b26bc8-fe07-4351-87a0-3dbf2fead70a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:35.699582 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1910/3839] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:35 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:50:35.722702 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b26bc8-fe07-4351-87a0-3dbf2fead70a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:35.744404 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf7cc1-cef2-43d3-8e31-ad2b9938dd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:35.745235 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf7cc1-cef2-43d3-8e31-ad2b9938dd2d admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:35.745518 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf7cc1-cef2-43d3-8e31-ad2b9938dd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:35.746326 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf7cc1-cef2-43d3-8e31-ad2b9938dd2d admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:35.747171 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf7cc1-cef2-43d3-8e31-ad2b9938dd2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:35.751640 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf7cc1-cef2-43d3-8e31-ad2b9938dd2d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:35.778854 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6deb4f-2a74-48b5-a262-c1975e2af62f admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:35.781282 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-fa6deb4f-2a74-48b5-a262-c1975e2af62f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:35.819764 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1930/3840] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:35 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:50:35.822591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf7cc1-cef2-43d3-8e31-ad2b9938dd2d admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:35.856856 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf7cc1-cef2-43d3-8e31-ad2b9938dd2d admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:35.882000 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d104a9-40b4-46ae-b03e-051f6d93d80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:35.882863 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d104a9-40b4-46ae-b03e-051f6d93d80d admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:35.886450 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d104a9-40b4-46ae-b03e-051f6d93d80d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:35.886828 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d104a9-40b4-46ae-b03e-051f6d93d80d admin admin] PATH_INFO: `/v3/projects/05727a67ad0b4f39b12ddd1bdb1df4be/users/f2cf11627eda49418d26a7f1434ca4f3/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:35.940745 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d104a9-40b4-46ae-b03e-051f6d93d80d admin admin] RBAC: Authorizing `identity:create_grant(project_id=05727a67ad0b4f39b12ddd1bdb1df4be, user_id=f2cf11627eda49418d26a7f1434ca4f3, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:35.957198 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d104a9-40b4-46ae-b03e-051f6d93d80d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:36.062773 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1931/3841] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:50:35 2022] PUT /identity/v3/projects/05727a67ad0b4f39b12ddd1bdb1df4be/users/f2cf11627eda49418d26a7f1434ca4f3/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:36.068106 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:36.069811 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c854f1d-fadd-4bf1-83d0-fd0c96858b20 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:36.070158 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c854f1d-fadd-4bf1-83d0-fd0c96858b20 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:36.070449 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c854f1d-fadd-4bf1-83d0-fd0c96858b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:36.097631 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6deb4f-2a74-48b5-a262-c1975e2af62f admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:36.156414 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:36.201331 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-4c854f1d-fadd-4bf1-83d0-fd0c96858b20 None None] MFA Rules not processed for user `f2cf11627eda49418d26a7f1434ca4f3`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:36.204729 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4c854f1d-fadd-4bf1-83d0-fd0c96858b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:36.348495 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d3272-49f4-45c4-bc82-bc9d49750879 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:36.352300 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d3272-49f4-45c4-bc82-bc9d49750879 service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:36.352575 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d3272-49f4-45c4-bc82-bc9d49750879 service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:36.355193 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d3272-49f4-45c4-bc82-bc9d49750879 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:36.362769 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-358d3272-49f4-45c4-bc82-bc9d49750879 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:36.427667 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d3272-49f4-45c4-bc82-bc9d49750879 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:36.430006 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d3272-49f4-45c4-bc82-bc9d49750879 service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:36.474317 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1911/3842] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:50:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 696 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:50:36.574935 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1932/3843] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 512 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:36.590263 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d3272-49f4-45c4-bc82-bc9d49750879 service placement] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:36.592174 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-358d3272-49f4-45c4-bc82-bc9d49750879 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:36.797166 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d3272-49f4-45c4-bc82-bc9d49750879 service placement] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:36.801147 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de96a7e6-279f-40f9-ad2d-e4bee92d732d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6b0f9835ed549cab91d684326be83fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:36.801771 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96a7e6-279f-40f9-ad2d-e4bee92d732d service glance] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:36.802047 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96a7e6-279f-40f9-ad2d-e4bee92d732d service glance] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:36.802316 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96a7e6-279f-40f9-ad2d-e4bee92d732d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:37.048184 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de96a7e6-279f-40f9-ad2d-e4bee92d732d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:37.049663 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de96a7e6-279f-40f9-ad2d-e4bee92d732d service glance] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:37.082333 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1912/3844] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:50:36 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:50:37.676480 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5d624-9df4-4406-b472-79844abb8dce None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:37.677831 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5d624-9df4-4406-b472-79844abb8dce None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:37.678763 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5d624-9df4-4406-b472-79844abb8dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:37.770381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-c0d5d624-9df4-4406-b472-79844abb8dce None None] MFA Rules not processed for user `f5aa55b1030d49a7abf035fd56d8b9c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:37.771960 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c0d5d624-9df4-4406-b472-79844abb8dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:37.940656 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1933/3845] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:50:38.041451 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de96a7e6-279f-40f9-ad2d-e4bee92d732d service glance] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:38.095945 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:38.096209 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b53524-1098-4922-bc76-a3fc3ad524f6 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:38.096209 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b53524-1098-4922-bc76-a3fc3ad524f6 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:38.096209 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b53524-1098-4922-bc76-a3fc3ad524f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:38.194510 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-30b53524-1098-4922-bc76-a3fc3ad524f6 None None] MFA Rules not processed for user `d008ed466820477197b94d0c18f7eb1c`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:38.216510 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-30b53524-1098-4922-bc76-a3fc3ad524f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:38.244676 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de96a7e6-279f-40f9-ad2d-e4bee92d732d service glance] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:38.263371 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b30c9-487d-434b-ad02-cd02011fc3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:38.276669 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b30c9-487d-434b-ad02-cd02011fc3e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:38.276971 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b30c9-487d-434b-ad02-cd02011fc3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:38.277235 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b30c9-487d-434b-ad02-cd02011fc3e3 admin admin] PATH_INFO: `/v3/users/2070d2a9bc8349df855abb6685d3a16f` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:38.284358 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5b30c9-487d-434b-ad02-cd02011fc3e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2070d2a9bc8349df855abb6685d3a16f)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:38.286327 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5b30c9-487d-434b-ad02-cd02011fc3e3 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:38.469712 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5e5b30c9-487d-434b-ad02-cd02011fc3e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2070d2a9bc8349df855abb6685d3a16f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:38.469978 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1934/3846] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:38.470158 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5e5b30c9-487d-434b-ad02-cd02011fc3e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2070d2a9bc8349df855abb6685d3a16f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:38.520141 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5e5b30c9-487d-434b-ad02-cd02011fc3e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2070d2a9bc8349df855abb6685d3a16f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:38.558418 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5e5b30c9-487d-434b-ad02-cd02011fc3e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2070d2a9bc8349df855abb6685d3a16f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:38.569789 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5e5b30c9-487d-434b-ad02-cd02011fc3e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2070d2a9bc8349df855abb6685d3a16f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:38.662758 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1913/3847] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:50:38 2022] DELETE /identity/v3/users/2070d2a9bc8349df855abb6685d3a16f => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:38.669420 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685542f0-b870-4771-99b9-8ca8094e88d5 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:38.669420 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685542f0-b870-4771-99b9-8ca8094e88d5 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:38.669420 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685542f0-b870-4771-99b9-8ca8094e88d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:38.727364 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-685542f0-b870-4771-99b9-8ca8094e88d5 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:38.733020 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-685542f0-b870-4771-99b9-8ca8094e88d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:38.940828 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:39.010839 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1935/3848] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:50:39.559294 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b30c9-487d-434b-ad02-cd02011fc3e3 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:39.561872 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5e5b30c9-487d-434b-ad02-cd02011fc3e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:39.748624 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b30c9-487d-434b-ad02-cd02011fc3e3 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:39.754327 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b6fb2e-2430-4812-a844-88489ad13d38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:39.754963 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6fb2e-2430-4812-a844-88489ad13d38 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:39.755325 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6fb2e-2430-4812-a844-88489ad13d38 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:39.755598 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6fb2e-2430-4812-a844-88489ad13d38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:39.773556 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b6fb2e-2430-4812-a844-88489ad13d38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:39.775789 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b6fb2e-2430-4812-a844-88489ad13d38 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:39.807203 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1914/3849] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:50:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:50:42.416441 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685542f0-b870-4771-99b9-8ca8094e88d5 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:42.418878 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-685542f0-b870-4771-99b9-8ca8094e88d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:42.458755 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685542f0-b870-4771-99b9-8ca8094e88d5 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:42.477250 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a204ab-977a-4911-9734-c4029ef4249c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:42.480998 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a204ab-977a-4911-9734-c4029ef4249c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:42.484117 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a204ab-977a-4911-9734-c4029ef4249c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:42.484436 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a204ab-977a-4911-9734-c4029ef4249c admin admin] PATH_INFO: `/v3/projects/28e8cadc266b447f9226a34dfcc79d2b` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:42.490229 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a204ab-977a-4911-9734-c4029ef4249c admin admin] RBAC: Authorizing `identity:delete_project(project_id=28e8cadc266b447f9226a34dfcc79d2b)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:42.499005 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a204ab-977a-4911-9734-c4029ef4249c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:42.767154 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-07a204ab-977a-4911-9734-c4029ef4249c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28e8cadc266b447f9226a34dfcc79d2b', 'request_id': 'req-07a204ab-977a-4911-9734-c4029ef4249c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:42.806744 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-07a204ab-977a-4911-9734-c4029ef4249c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28e8cadc266b447f9226a34dfcc79d2b', 'request_id': 'req-07a204ab-977a-4911-9734-c4029ef4249c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:42.834429 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-07a204ab-977a-4911-9734-c4029ef4249c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28e8cadc266b447f9226a34dfcc79d2b', 'request_id': 'req-07a204ab-977a-4911-9734-c4029ef4249c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:42.888714 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-07a204ab-977a-4911-9734-c4029ef4249c admin admin] The token cache is being invalidate because project 28e8cadc266b447f9226a34dfcc79d2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:50:42.889595 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-07a204ab-977a-4911-9734-c4029ef4249c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:42.891698 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-07a204ab-977a-4911-9734-c4029ef4249c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:42.899226 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1936/3850] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:50:42 2022] DELETE /identity/v3/projects/28e8cadc266b447f9226a34dfcc79d2b => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:42.904780 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b6fb2e-2430-4812-a844-88489ad13d38 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:42.924426 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b6fb2e-2430-4812-a844-88489ad13d38 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:43.099476 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:43.164216 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d94e4a-43f6-42f6-8258-012eeb5fe2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:43.169793 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d94e4a-43f6-42f6-8258-012eeb5fe2af admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:43.170203 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d94e4a-43f6-42f6-8258-012eeb5fe2af admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:43.172135 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d94e4a-43f6-42f6-8258-012eeb5fe2af admin admin] PATH_INFO: `/v3/users/f2cf11627eda49418d26a7f1434ca4f3` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:43.175800 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d94e4a-43f6-42f6-8258-012eeb5fe2af admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2cf11627eda49418d26a7f1434ca4f3)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:43.183087 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d94e4a-43f6-42f6-8258-012eeb5fe2af admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:43.337674 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-02d94e4a-43f6-42f6-8258-012eeb5fe2af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2cf11627eda49418d26a7f1434ca4f3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:43.339385 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-02d94e4a-43f6-42f6-8258-012eeb5fe2af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2cf11627eda49418d26a7f1434ca4f3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:43.362463 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-02d94e4a-43f6-42f6-8258-012eeb5fe2af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2cf11627eda49418d26a7f1434ca4f3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:43.377108 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-02d94e4a-43f6-42f6-8258-012eeb5fe2af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2cf11627eda49418d26a7f1434ca4f3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:43.383683 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-02d94e4a-43f6-42f6-8258-012eeb5fe2af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2cf11627eda49418d26a7f1434ca4f3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:43.413133 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1915/3851] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:50:42 2022] DELETE /identity/v3/users/f2cf11627eda49418d26a7f1434ca4f3 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:43.947062 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0a06d-e152-4155-8a7b-d560361250ff None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:43.949248 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0a06d-e152-4155-8a7b-d560361250ff None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:43.949887 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0a06d-e152-4155-8a7b-d560361250ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:44.007656 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-d9b0a06d-e152-4155-8a7b-d560361250ff None None] MFA Rules not processed for user `8ab128ff99e24153960e42b8897ac4f1`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:44.010368 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d9b0a06d-e152-4155-8a7b-d560361250ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:44.124900 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1937/3852] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:44.137084 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6c576-9e41-4781-93fe-2de5d532fea0 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:44.138156 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6c576-9e41-4781-93fe-2de5d532fea0 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:44.138644 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6c576-9e41-4781-93fe-2de5d532fea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:44.199150 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-7bd6c576-9e41-4781-93fe-2de5d532fea0 None None] MFA Rules not processed for user `8ab128ff99e24153960e42b8897ac4f1`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:44.204183 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7bd6c576-9e41-4781-93fe-2de5d532fea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:44.232518 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1916/3853] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:44.247402 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b0a06d-e152-4155-8a7b-d560361250ff None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:44.250351 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d9b0a06d-e152-4155-8a7b-d560361250ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:44.481017 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:44.507595 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b0a06d-e152-4155-8a7b-d560361250ff None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:44.523800 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b1565-c729-41b3-8c32-49974e665adc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:44.526715 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b1565-c729-41b3-8c32-49974e665adc service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:44.527826 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b1565-c729-41b3-8c32-49974e665adc service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:44.528337 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b1565-c729-41b3-8c32-49974e665adc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:44.541355 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b1565-c729-41b3-8c32-49974e665adc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:44.544144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b1565-c729-41b3-8c32-49974e665adc service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:44.556729 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1938/3854] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:50:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:50:46.034807 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd6c576-9e41-4781-93fe-2de5d532fea0 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:46.036611 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7bd6c576-9e41-4781-93fe-2de5d532fea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:46.279641 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd6c576-9e41-4781-93fe-2de5d532fea0 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:46.294327 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac88ad1-0083-417b-8904-2713fb80e1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:46.295689 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac88ad1-0083-417b-8904-2713fb80e1ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:46.296148 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac88ad1-0083-417b-8904-2713fb80e1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:46.296586 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac88ad1-0083-417b-8904-2713fb80e1ef admin admin] PATH_INFO: `/v3/projects/05727a67ad0b4f39b12ddd1bdb1df4be` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:46.300060 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac88ad1-0083-417b-8904-2713fb80e1ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=05727a67ad0b4f39b12ddd1bdb1df4be)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:46.320209 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac88ad1-0083-417b-8904-2713fb80e1ef admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:46.443521 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0ac88ad1-0083-417b-8904-2713fb80e1ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05727a67ad0b4f39b12ddd1bdb1df4be', 'request_id': 'req-0ac88ad1-0083-417b-8904-2713fb80e1ef'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:46.456338 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:46.461511 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0ac88ad1-0083-417b-8904-2713fb80e1ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05727a67ad0b4f39b12ddd1bdb1df4be', 'request_id': 'req-0ac88ad1-0083-417b-8904-2713fb80e1ef'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:46.482459 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0ac88ad1-0083-417b-8904-2713fb80e1ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05727a67ad0b4f39b12ddd1bdb1df4be', 'request_id': 'req-0ac88ad1-0083-417b-8904-2713fb80e1ef'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:46.517713 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0ac88ad1-0083-417b-8904-2713fb80e1ef admin admin] The token cache is being invalidate because project 05727a67ad0b4f39b12ddd1bdb1df4be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:50:46.519681 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0ac88ad1-0083-417b-8904-2713fb80e1ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:46.520474 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0ac88ad1-0083-417b-8904-2713fb80e1ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:46.526708 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1917/3855] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:50:46 2022] DELETE /identity/v3/projects/05727a67ad0b4f39b12ddd1bdb1df4be => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:46.532746 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10e736-8cb7-43a2-adb5-ad6e144db584 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:46.533310 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10e736-8cb7-43a2-adb5-ad6e144db584 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:46.533310 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10e736-8cb7-43a2-adb5-ad6e144db584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:46.580661 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-ec10e736-8cb7-43a2-adb5-ad6e144db584 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:46.590773 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ec10e736-8cb7-43a2-adb5-ad6e144db584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:46.819585 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1939/3856] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:46.834555 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576e010-fb17-439a-bc8a-6e6c82031b37 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:46.834880 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576e010-fb17-439a-bc8a-6e6c82031b37 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:46.835509 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576e010-fb17-439a-bc8a-6e6c82031b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:46.925210 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-8576e010-fb17-439a-bc8a-6e6c82031b37 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:46.931946 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8576e010-fb17-439a-bc8a-6e6c82031b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:46.971534 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1918/3857] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:46.972567 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10e736-8cb7-43a2-adb5-ad6e144db584 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:46.991877 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10e736-8cb7-43a2-adb5-ad6e144db584 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:47.004909 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890e0d0-1164-4b4a-a8db-a59d079c5ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:47.005723 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890e0d0-1164-4b4a-a8db-a59d079c5ffc admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:47.006112 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890e0d0-1164-4b4a-a8db-a59d079c5ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:47.006493 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890e0d0-1164-4b4a-a8db-a59d079c5ffc admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:47.007319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a890e0d0-1164-4b4a-a8db-a59d079c5ffc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:50:47.010799 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a890e0d0-1164-4b4a-a8db-a59d079c5ffc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:47.012630 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a890e0d0-1164-4b4a-a8db-a59d079c5ffc admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:47.052707 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1940/3858] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:50:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:50:47.054455 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576e010-fb17-439a-bc8a-6e6c82031b37 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:47.069929 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576e010-fb17-439a-bc8a-6e6c82031b37 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:47.080380 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f8207-724d-4ead-9ce7-97839818579c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:47.081173 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f8207-724d-4ead-9ce7-97839818579c admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:47.081692 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f8207-724d-4ead-9ce7-97839818579c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:47.082073 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f8207-724d-4ead-9ce7-97839818579c admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:47.082824 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6f8207-724d-4ead-9ce7-97839818579c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:47.093184 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6f8207-724d-4ead-9ce7-97839818579c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:47.216643 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1919/3859] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:50:47 2022] POST /identity/v3/projects => generated 385 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:47.220755 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890e0d0-1164-4b4a-a8db-a59d079c5ffc admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:47.234905 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890e0d0-1164-4b4a-a8db-a59d079c5ffc admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:47.386374 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2a52a-3e93-44b3-8d4d-07d0fd24a451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:47.387151 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2a52a-3e93-44b3-8d4d-07d0fd24a451 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:47.387544 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2a52a-3e93-44b3-8d4d-07d0fd24a451 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:47.387929 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2a52a-3e93-44b3-8d4d-07d0fd24a451 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:47.389235 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e2a52a-3e93-44b3-8d4d-07d0fd24a451 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:47.391364 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e2a52a-3e93-44b3-8d4d-07d0fd24a451 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:47.466591 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1941/3860] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:50:47 2022] POST /identity/v3/users => generated 293 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:47.469792 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f8207-724d-4ead-9ce7-97839818579c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:47.488157 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f8207-724d-4ead-9ce7-97839818579c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:47.502600 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388b770-acd6-4b13-9b2e-c0c5d26eb5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:47.503218 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388b770-acd6-4b13-9b2e-c0c5d26eb5cb admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:47.503499 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388b770-acd6-4b13-9b2e-c0c5d26eb5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:47.503766 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388b770-acd6-4b13-9b2e-c0c5d26eb5cb admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:47.506176 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a388b770-acd6-4b13-9b2e-c0c5d26eb5cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:47.510054 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a388b770-acd6-4b13-9b2e-c0c5d26eb5cb admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:47.547435 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1920/3861] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:50:47.551406 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2a52a-3e93-44b3-8d4d-07d0fd24a451 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:47.569287 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2a52a-3e93-44b3-8d4d-07d0fd24a451 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:47.577951 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf35ec4-2fbc-4883-a3a1-51bb691cb124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:47.578979 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf35ec4-2fbc-4883-a3a1-51bb691cb124 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:47.579505 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf35ec4-2fbc-4883-a3a1-51bb691cb124 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:47.579888 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf35ec4-2fbc-4883-a3a1-51bb691cb124 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:47.580650 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf35ec4-2fbc-4883-a3a1-51bb691cb124 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:47.582574 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf35ec4-2fbc-4883-a3a1-51bb691cb124 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:47.598247 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1942/3862] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:50:47.602080 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388b770-acd6-4b13-9b2e-c0c5d26eb5cb admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:47.620303 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388b770-acd6-4b13-9b2e-c0c5d26eb5cb admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:47.636079 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b9e49-46ad-484f-8630-40589c51e01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:47.638984 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b9e49-46ad-484f-8630-40589c51e01f admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:47.644582 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b9e49-46ad-484f-8630-40589c51e01f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:47.644875 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b9e49-46ad-484f-8630-40589c51e01f admin admin] PATH_INFO: `/v3/projects/10f20eef33b04be4bdc3f781710414b5/users/7995b06179de4773b88b70ccc87d45c7/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:47.695211 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068b9e49-46ad-484f-8630-40589c51e01f admin admin] RBAC: Authorizing `identity:create_grant(project_id=10f20eef33b04be4bdc3f781710414b5, user_id=7995b06179de4773b88b70ccc87d45c7, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:47.702812 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068b9e49-46ad-484f-8630-40589c51e01f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:47.735654 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1921/3863] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:50:47 2022] PUT /identity/v3/projects/10f20eef33b04be4bdc3f781710414b5/users/7995b06179de4773b88b70ccc87d45c7/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:47.747641 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fdb848-501b-40e7-bb0e-d1a99b05f7e9 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:47.748530 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fdb848-501b-40e7-bb0e-d1a99b05f7e9 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:47.749028 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fdb848-501b-40e7-bb0e-d1a99b05f7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:47.820634 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-e2fdb848-501b-40e7-bb0e-d1a99b05f7e9 None None] MFA Rules not processed for user `7995b06179de4773b88b70ccc87d45c7`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:47.830879 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e2fdb848-501b-40e7-bb0e-d1a99b05f7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:48.008567 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:48.094171 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1943/3864] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:48.098323 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b9e49-46ad-484f-8630-40589c51e01f admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:48.393264 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b9e49-46ad-484f-8630-40589c51e01f admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:48.416052 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa37d30-f4c6-424b-ab34-8a426ad2718c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:48.416915 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa37d30-f4c6-424b-ab34-8a426ad2718c admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:48.417282 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa37d30-f4c6-424b-ab34-8a426ad2718c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:48.417442 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa37d30-f4c6-424b-ab34-8a426ad2718c admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:48.418080 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa37d30-f4c6-424b-ab34-8a426ad2718c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:48.420141 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa37d30-f4c6-424b-ab34-8a426ad2718c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:48.484739 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1922/3865] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:50:48 2022] POST /identity/v3/projects => generated 383 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:48.489273 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fdb848-501b-40e7-bb0e-d1a99b05f7e9 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:48.507783 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fdb848-501b-40e7-bb0e-d1a99b05f7e9 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:48.736152 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c0d40-3c5d-4c10-8eac-0da206afd55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:48.744367 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c0d40-3c5d-4c10-8eac-0da206afd55e admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:48.756313 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c0d40-3c5d-4c10-8eac-0da206afd55e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:48.756593 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c0d40-3c5d-4c10-8eac-0da206afd55e admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:48.763835 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43c0d40-3c5d-4c10-8eac-0da206afd55e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:48.774374 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43c0d40-3c5d-4c10-8eac-0da206afd55e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:48.813453 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1944/3866] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:50:48 2022] POST /identity/v3/users => generated 298 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:48.817427 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa37d30-f4c6-424b-ab34-8a426ad2718c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:48.834797 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa37d30-f4c6-424b-ab34-8a426ad2718c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:48.851488 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e02dd-48a3-419d-84a1-d79f8da70c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:48.852122 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e02dd-48a3-419d-84a1-d79f8da70c40 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:48.852645 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e02dd-48a3-419d-84a1-d79f8da70c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:48.854000 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e02dd-48a3-419d-84a1-d79f8da70c40 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:48.855049 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e02dd-48a3-419d-84a1-d79f8da70c40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:48.860632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e02dd-48a3-419d-84a1-d79f8da70c40 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:48.913310 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1923/3867] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:48 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:50:48.917662 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c0d40-3c5d-4c10-8eac-0da206afd55e admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:48.967329 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c0d40-3c5d-4c10-8eac-0da206afd55e admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:48.995675 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c51256f-7682-4b20-bffc-8d3013a2004f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:48.999716 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51256f-7682-4b20-bffc-8d3013a2004f admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:49.004793 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51256f-7682-4b20-bffc-8d3013a2004f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:49.004793 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51256f-7682-4b20-bffc-8d3013a2004f admin admin] PATH_INFO: `/v3/projects/0409f73caa0f4f7194cc1c2b662d6962/users/8ea1bcba03e84ab6952d68147ffc8369/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:49.077839 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c51256f-7682-4b20-bffc-8d3013a2004f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0409f73caa0f4f7194cc1c2b662d6962, user_id=8ea1bcba03e84ab6952d68147ffc8369, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:49.088852 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c51256f-7682-4b20-bffc-8d3013a2004f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:49.133389 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1945/3868] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:50:48 2022] PUT /identity/v3/projects/0409f73caa0f4f7194cc1c2b662d6962/users/8ea1bcba03e84ab6952d68147ffc8369/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:49.138604 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e02dd-48a3-419d-84a1-d79f8da70c40 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:49.166498 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e02dd-48a3-419d-84a1-d79f8da70c40 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:49.306233 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:49.328031 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be7d45-7b3d-465a-9dd1-b0b6e6eefaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:49.328656 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be7d45-7b3d-465a-9dd1-b0b6e6eefaea admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:49.328936 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be7d45-7b3d-465a-9dd1-b0b6e6eefaea admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:49.329333 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be7d45-7b3d-465a-9dd1-b0b6e6eefaea admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:49.331896 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5be7d45-7b3d-465a-9dd1-b0b6e6eefaea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:49.333543 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5be7d45-7b3d-465a-9dd1-b0b6e6eefaea admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:49.358530 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1924/3869] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:50:49.362951 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c51256f-7682-4b20-bffc-8d3013a2004f admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:49.376560 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c51256f-7682-4b20-bffc-8d3013a2004f admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:49.382245 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f0dd74-333c-45c3-81e8-926a748c6ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:49.384241 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0dd74-333c-45c3-81e8-926a748c6ab4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:49.385145 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0dd74-333c-45c3-81e8-926a748c6ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:49.386002 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0dd74-333c-45c3-81e8-926a748c6ab4 admin admin] PATH_INFO: `/v3/projects/0409f73caa0f4f7194cc1c2b662d6962/users/8ea1bcba03e84ab6952d68147ffc8369/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:49.390546 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f0dd74-333c-45c3-81e8-926a748c6ab4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0409f73caa0f4f7194cc1c2b662d6962, user_id=8ea1bcba03e84ab6952d68147ffc8369, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:49.396701 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f0dd74-333c-45c3-81e8-926a748c6ab4 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:49.442396 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1946/3870] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:50:49 2022] PUT /identity/v3/projects/0409f73caa0f4f7194cc1c2b662d6962/users/8ea1bcba03e84ab6952d68147ffc8369/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:49.444492 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360599f2-df50-4c38-ab11-cab931e841ef None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:49.444640 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360599f2-df50-4c38-ab11-cab931e841ef None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:49.444836 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360599f2-df50-4c38-ab11-cab931e841ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:49.528960 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-360599f2-df50-4c38-ab11-cab931e841ef None None] MFA Rules not processed for user `8ea1bcba03e84ab6952d68147ffc8369`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:49.530560 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-360599f2-df50-4c38-ab11-cab931e841ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:49.718005 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1925/3871] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:49 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:49.966939 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f0dd74-333c-45c3-81e8-926a748c6ab4 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:49.974930 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c7f0dd74-333c-45c3-81e8-926a748c6ab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:50.200148 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f0dd74-333c-45c3-81e8-926a748c6ab4 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:50.209760 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7849eb2-90e1-46aa-8d5d-8d30dcc24bf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:50.210828 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7849eb2-90e1-46aa-8d5d-8d30dcc24bf3 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:50.211165 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7849eb2-90e1-46aa-8d5d-8d30dcc24bf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:50.211463 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7849eb2-90e1-46aa-8d5d-8d30dcc24bf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:50.237006 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7849eb2-90e1-46aa-8d5d-8d30dcc24bf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:50.238486 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7849eb2-90e1-46aa-8d5d-8d30dcc24bf3 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:50.260998 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1947/3872] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:50:49 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:50:55.269006 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360599f2-df50-4c38-ab11-cab931e841ef None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:55.270570 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-360599f2-df50-4c38-ab11-cab931e841ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:55.414361 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360599f2-df50-4c38-ab11-cab931e841ef None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:55.421716 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5756de-bc75-4844-b614-aa67b2e141f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:55.422378 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5756de-bc75-4844-b614-aa67b2e141f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:55.422892 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5756de-bc75-4844-b614-aa67b2e141f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:55.423203 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5756de-bc75-4844-b614-aa67b2e141f9 admin admin] PATH_INFO: `/v3/users/ea31195933be4477a588150bb1f67822` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:55.424379 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5756de-bc75-4844-b614-aa67b2e141f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea31195933be4477a588150bb1f67822)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:55.426341 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5756de-bc75-4844-b614-aa67b2e141f9 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:55.499015 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1a5756de-bc75-4844-b614-aa67b2e141f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea31195933be4477a588150bb1f67822'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:55.499661 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1a5756de-bc75-4844-b614-aa67b2e141f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea31195933be4477a588150bb1f67822'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:55.518341 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1a5756de-bc75-4844-b614-aa67b2e141f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea31195933be4477a588150bb1f67822'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:55.538572 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1a5756de-bc75-4844-b614-aa67b2e141f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea31195933be4477a588150bb1f67822'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:55.540639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1a5756de-bc75-4844-b614-aa67b2e141f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea31195933be4477a588150bb1f67822'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:55.557700 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:55.577026 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1926/3873] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:50:55 2022] DELETE /identity/v3/users/ea31195933be4477a588150bb1f67822 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:56.330761 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d654bd-1a2e-4d83-8a21-7ea331758217 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:56.331680 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d654bd-1a2e-4d83-8a21-7ea331758217 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:56.332145 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d654bd-1a2e-4d83-8a21-7ea331758217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:56.398893 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-52d654bd-1a2e-4d83-8a21-7ea331758217 None None] MFA Rules not processed for user `a3e14fd42e5942199e28335124d59c75`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:56.400777 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-52d654bd-1a2e-4d83-8a21-7ea331758217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:56.482774 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:56.588572 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5756de-bc75-4844-b614-aa67b2e141f9 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:56.590032 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1a5756de-bc75-4844-b614-aa67b2e141f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:56.603909 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1948/3874] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:56.616162 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d654bd-1a2e-4d83-8a21-7ea331758217 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:56.617936 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-52d654bd-1a2e-4d83-8a21-7ea331758217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:56.777776 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5756de-bc75-4844-b614-aa67b2e141f9 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:56.804858 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c777abb2-2f4b-4335-9fc7-2053a07f44a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:56.806060 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777abb2-2f4b-4335-9fc7-2053a07f44a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:56.806779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777abb2-2f4b-4335-9fc7-2053a07f44a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:56.807229 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777abb2-2f4b-4335-9fc7-2053a07f44a2 admin admin] PATH_INFO: `/v3/projects/6f2f45b5051c4899a770a38958c70caa` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:56.809614 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c777abb2-2f4b-4335-9fc7-2053a07f44a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f2f45b5051c4899a770a38958c70caa)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:56.811831 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c777abb2-2f4b-4335-9fc7-2053a07f44a2 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:56.853991 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d654bd-1a2e-4d83-8a21-7ea331758217 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:56.880406 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2351b-abbf-44bd-aff7-a91ba6bd0bf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:56.882689 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2351b-abbf-44bd-aff7-a91ba6bd0bf5 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:56.883796 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2351b-abbf-44bd-aff7-a91ba6bd0bf5 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:56.884262 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2351b-abbf-44bd-aff7-a91ba6bd0bf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:56.911657 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e2351b-abbf-44bd-aff7-a91ba6bd0bf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:56.914102 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e2351b-abbf-44bd-aff7-a91ba6bd0bf5 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:56.934968 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1949/3875] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:50:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:50:56.961483 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c777abb2-2f4b-4335-9fc7-2053a07f44a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f2f45b5051c4899a770a38958c70caa', 'request_id': 'req-c777abb2-2f4b-4335-9fc7-2053a07f44a2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:56.983885 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c777abb2-2f4b-4335-9fc7-2053a07f44a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f2f45b5051c4899a770a38958c70caa', 'request_id': 'req-c777abb2-2f4b-4335-9fc7-2053a07f44a2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:57.000544 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c777abb2-2f4b-4335-9fc7-2053a07f44a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f2f45b5051c4899a770a38958c70caa', 'request_id': 'req-c777abb2-2f4b-4335-9fc7-2053a07f44a2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:57.028536 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c777abb2-2f4b-4335-9fc7-2053a07f44a2 admin admin] The token cache is being invalidate because project 6f2f45b5051c4899a770a38958c70caa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:50:57.028536 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c777abb2-2f4b-4335-9fc7-2053a07f44a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:57.028536 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c777abb2-2f4b-4335-9fc7-2053a07f44a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:57.031523 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1927/3876] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:50:56 2022] DELETE /identity/v3/projects/6f2f45b5051c4899a770a38958c70caa => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:50:57.043344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778d59b-5acb-4005-a497-bbeecad6b423 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:57.052308 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778d59b-5acb-4005-a497-bbeecad6b423 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:57.053541 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778d59b-5acb-4005-a497-bbeecad6b423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:57.126083 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-2778d59b-5acb-4005-a497-bbeecad6b423 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:57.128636 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2778d59b-5acb-4005-a497-bbeecad6b423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:57.353562 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1950/3877] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:57.361721 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017eb6f-eb34-47cc-92be-bcaf19fd7e1d None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:57.362993 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017eb6f-eb34-47cc-92be-bcaf19fd7e1d None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:57.363511 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017eb6f-eb34-47cc-92be-bcaf19fd7e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:57.410760 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-c017eb6f-eb34-47cc-92be-bcaf19fd7e1d None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:57.412657 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c017eb6f-eb34-47cc-92be-bcaf19fd7e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:57.427350 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1928/3878] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:50:57.432178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2778d59b-5acb-4005-a497-bbeecad6b423 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:57.452228 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2778d59b-5acb-4005-a497-bbeecad6b423 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:57.462341 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198005f-3ce7-45c6-88c8-e45939e7bdd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:57.463184 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198005f-3ce7-45c6-88c8-e45939e7bdd5 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:57.463480 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198005f-3ce7-45c6-88c8-e45939e7bdd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:57.463757 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198005f-3ce7-45c6-88c8-e45939e7bdd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:57.464441 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198005f-3ce7-45c6-88c8-e45939e7bdd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:50:57.464738 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198005f-3ce7-45c6-88c8-e45939e7bdd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:57.466374 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198005f-3ce7-45c6-88c8-e45939e7bdd5 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:57.510297 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1951/3879] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:50:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:50:57.514590 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c017eb6f-eb34-47cc-92be-bcaf19fd7e1d None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:57.528679 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c017eb6f-eb34-47cc-92be-bcaf19fd7e1d None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:57.541484 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a57cf-a8aa-4af5-8a73-5a2e33ff487e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:57.542129 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a57cf-a8aa-4af5-8a73-5a2e33ff487e admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:57.542409 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a57cf-a8aa-4af5-8a73-5a2e33ff487e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:57.542683 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a57cf-a8aa-4af5-8a73-5a2e33ff487e admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:57.543357 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39a57cf-a8aa-4af5-8a73-5a2e33ff487e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:57.547050 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39a57cf-a8aa-4af5-8a73-5a2e33ff487e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:57.608517 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1929/3880] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:50:57 2022] POST /identity/v3/projects => generated 367 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:57.610923 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198005f-3ce7-45c6-88c8-e45939e7bdd5 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:57.622195 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198005f-3ce7-45c6-88c8-e45939e7bdd5 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:57.750607 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:57.794178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07115fed-559b-46e0-bec9-72c79ccf8788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:57.795244 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07115fed-559b-46e0-bec9-72c79ccf8788 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:57.795660 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07115fed-559b-46e0-bec9-72c79ccf8788 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:57.796249 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07115fed-559b-46e0-bec9-72c79ccf8788 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:57.797031 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07115fed-559b-46e0-bec9-72c79ccf8788 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:57.802329 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07115fed-559b-46e0-bec9-72c79ccf8788 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:57.854757 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1952/3881] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:50:57 2022] POST /identity/v3/users => generated 284 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:57.858152 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a57cf-a8aa-4af5-8a73-5a2e33ff487e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:57.880578 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a57cf-a8aa-4af5-8a73-5a2e33ff487e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:57.888200 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f30d97-539e-4dba-b952-f39a55c5f0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:57.889987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f30d97-539e-4dba-b952-f39a55c5f0ea admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:57.890644 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f30d97-539e-4dba-b952-f39a55c5f0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:57.891161 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f30d97-539e-4dba-b952-f39a55c5f0ea admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:57.892025 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f30d97-539e-4dba-b952-f39a55c5f0ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:57.901438 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f30d97-539e-4dba-b952-f39a55c5f0ea admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:57.915223 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1930/3882] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:50:57.918855 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07115fed-559b-46e0-bec9-72c79ccf8788 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:57.938892 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07115fed-559b-46e0-bec9-72c79ccf8788 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:57.945455 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec0e15-83b0-4d0d-8c19-a213da80ba03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:57.946974 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec0e15-83b0-4d0d-8c19-a213da80ba03 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:57.947933 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec0e15-83b0-4d0d-8c19-a213da80ba03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:57.948508 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec0e15-83b0-4d0d-8c19-a213da80ba03 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:57.949317 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec0e15-83b0-4d0d-8c19-a213da80ba03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:57.951607 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec0e15-83b0-4d0d-8c19-a213da80ba03 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:57.979446 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1953/3883] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:50:57.980927 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f30d97-539e-4dba-b952-f39a55c5f0ea admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:58.000775 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f30d97-539e-4dba-b952-f39a55c5f0ea admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:58.021702 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90160cd3-b7e2-4ede-b52b-9aa2a19900dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:58.022625 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90160cd3-b7e2-4ede-b52b-9aa2a19900dd admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:58.023160 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90160cd3-b7e2-4ede-b52b-9aa2a19900dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:58.023535 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90160cd3-b7e2-4ede-b52b-9aa2a19900dd admin admin] PATH_INFO: `/v3/projects/c5f1ceef95ae4b4f839e7dc297796f96/users/6c8240dd54f74ad4a1f664a790875be1/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:58.069507 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90160cd3-b7e2-4ede-b52b-9aa2a19900dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5f1ceef95ae4b4f839e7dc297796f96, user_id=6c8240dd54f74ad4a1f664a790875be1, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:58.078081 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90160cd3-b7e2-4ede-b52b-9aa2a19900dd admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:58.121997 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1931/3884] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:50:57 2022] PUT /identity/v3/projects/c5f1ceef95ae4b4f839e7dc297796f96/users/6c8240dd54f74ad4a1f664a790875be1/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:58.124612 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e22504-a0da-4f48-a642-402de0255268 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:58.125349 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e22504-a0da-4f48-a642-402de0255268 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:58.125707 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e22504-a0da-4f48-a642-402de0255268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:58.206127 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-48e22504-a0da-4f48-a642-402de0255268 None None] MFA Rules not processed for user `6c8240dd54f74ad4a1f664a790875be1`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:58.209289 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-48e22504-a0da-4f48-a642-402de0255268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:58.355580 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1954/3885] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:50:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:58.370309 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90160cd3-b7e2-4ede-b52b-9aa2a19900dd admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:58.372676 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-90160cd3-b7e2-4ede-b52b-9aa2a19900dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:58.420637 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:58.562411 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90160cd3-b7e2-4ede-b52b-9aa2a19900dd admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:58.568619 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09c8a60-7046-4df8-95d5-39803650f183 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:58.569410 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c8a60-7046-4df8-95d5-39803650f183 service cinder] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:58.569667 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c8a60-7046-4df8-95d5-39803650f183 service cinder] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:58.569962 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c8a60-7046-4df8-95d5-39803650f183 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:58.590732 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09c8a60-7046-4df8-95d5-39803650f183 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:58.595338 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09c8a60-7046-4df8-95d5-39803650f183 service cinder] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:58.625730 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1932/3886] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:50:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:51:00.610584 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e22504-a0da-4f48-a642-402de0255268 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:00.612165 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-48e22504-a0da-4f48-a642-402de0255268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:00.824484 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e22504-a0da-4f48-a642-402de0255268 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:00.833314 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ddee0-150e-46e2-9412-03593f2fd8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:00.834313 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ddee0-150e-46e2-9412-03593f2fd8e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:00.834836 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ddee0-150e-46e2-9412-03593f2fd8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:00.835343 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ddee0-150e-46e2-9412-03593f2fd8e2 admin admin] PATH_INFO: `/v3/users/7995b06179de4773b88b70ccc87d45c7` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:00.839822 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8ddee0-150e-46e2-9412-03593f2fd8e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7995b06179de4773b88b70ccc87d45c7)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:00.842133 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8ddee0-150e-46e2-9412-03593f2fd8e2 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:00.955447 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-bb8ddee0-150e-46e2-9412-03593f2fd8e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7995b06179de4773b88b70ccc87d45c7'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:00.956538 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-bb8ddee0-150e-46e2-9412-03593f2fd8e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7995b06179de4773b88b70ccc87d45c7'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:00.968013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:00.998870 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-bb8ddee0-150e-46e2-9412-03593f2fd8e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7995b06179de4773b88b70ccc87d45c7'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:01.010087 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-bb8ddee0-150e-46e2-9412-03593f2fd8e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7995b06179de4773b88b70ccc87d45c7'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:01.029729 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-bb8ddee0-150e-46e2-9412-03593f2fd8e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7995b06179de4773b88b70ccc87d45c7'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:01.044869 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1955/3887] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:51:00 2022] DELETE /identity/v3/users/7995b06179de4773b88b70ccc87d45c7 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:01.049218 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcdf44-39c4-4120-b902-4fe584c5dc41 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:01.049764 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcdf44-39c4-4120-b902-4fe584c5dc41 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:01.049965 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcdf44-39c4-4120-b902-4fe584c5dc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:01.086898 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a6bcdf44-39c4-4120-b902-4fe584c5dc41 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:51:01.090508 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a6bcdf44-39c4-4120-b902-4fe584c5dc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:01.263383 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1933/3888] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:51:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:51:01.341858 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ddee0-150e-46e2-9412-03593f2fd8e2 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:01.344075 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-bb8ddee0-150e-46e2-9412-03593f2fd8e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:01.489800 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ddee0-150e-46e2-9412-03593f2fd8e2 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:01.508035 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd71d2f7-07f1-493a-aa12-d23040004412 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:01.508839 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71d2f7-07f1-493a-aa12-d23040004412 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:01.509222 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71d2f7-07f1-493a-aa12-d23040004412 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:01.509601 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71d2f7-07f1-493a-aa12-d23040004412 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:01.532092 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd71d2f7-07f1-493a-aa12-d23040004412 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:01.533767 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd71d2f7-07f1-493a-aa12-d23040004412 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:01.554173 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1956/3889] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:51:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:51:02.803097 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bcdf44-39c4-4120-b902-4fe584c5dc41 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:02.804701 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a6bcdf44-39c4-4120-b902-4fe584c5dc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:02.828365 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bcdf44-39c4-4120-b902-4fe584c5dc41 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:02.837488 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f1102-a8ed-4299-84a3-3f70cc2bcf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:02.840281 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f1102-a8ed-4299-84a3-3f70cc2bcf9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:02.840605 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f1102-a8ed-4299-84a3-3f70cc2bcf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:02.840884 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f1102-a8ed-4299-84a3-3f70cc2bcf9f admin admin] PATH_INFO: `/v3/users/023ee959a1ca446fb620544563307863` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:02.843424 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f1102-a8ed-4299-84a3-3f70cc2bcf9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=023ee959a1ca446fb620544563307863)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:02.845824 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f1102-a8ed-4299-84a3-3f70cc2bcf9f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:02.964688 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd71d2f7-07f1-493a-aa12-d23040004412 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:02.966157 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-908f1102-a8ed-4299-84a3-3f70cc2bcf9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '023ee959a1ca446fb620544563307863'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:02.966461 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-bd71d2f7-07f1-493a-aa12-d23040004412 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:02.967045 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-908f1102-a8ed-4299-84a3-3f70cc2bcf9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '023ee959a1ca446fb620544563307863'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:02.976686 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-908f1102-a8ed-4299-84a3-3f70cc2bcf9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '023ee959a1ca446fb620544563307863'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:02.989020 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-908f1102-a8ed-4299-84a3-3f70cc2bcf9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '023ee959a1ca446fb620544563307863'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:02.989868 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-908f1102-a8ed-4299-84a3-3f70cc2bcf9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '023ee959a1ca446fb620544563307863'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:02.991659 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd71d2f7-07f1-493a-aa12-d23040004412 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:03.030340 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023e371-29c9-4ff0-a222-d4dca09ff2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:03.030995 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023e371-29c9-4ff0-a222-d4dca09ff2db admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:03.031313 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023e371-29c9-4ff0-a222-d4dca09ff2db admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:03.031590 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023e371-29c9-4ff0-a222-d4dca09ff2db admin admin] PATH_INFO: `/v3/projects/10f20eef33b04be4bdc3f781710414b5` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:03.036188 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5023e371-29c9-4ff0-a222-d4dca09ff2db admin admin] RBAC: Authorizing `identity:delete_project(project_id=10f20eef33b04be4bdc3f781710414b5)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:03.037221 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1934/3890] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:51:02 2022] DELETE /identity/v3/users/023ee959a1ca446fb620544563307863 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:03.040489 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5023e371-29c9-4ff0-a222-d4dca09ff2db admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:03.153139 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5023e371-29c9-4ff0-a222-d4dca09ff2db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10f20eef33b04be4bdc3f781710414b5', 'request_id': 'req-5023e371-29c9-4ff0-a222-d4dca09ff2db'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:03.166844 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5023e371-29c9-4ff0-a222-d4dca09ff2db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10f20eef33b04be4bdc3f781710414b5', 'request_id': 'req-5023e371-29c9-4ff0-a222-d4dca09ff2db'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:03.176884 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5023e371-29c9-4ff0-a222-d4dca09ff2db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10f20eef33b04be4bdc3f781710414b5', 'request_id': 'req-5023e371-29c9-4ff0-a222-d4dca09ff2db'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:03.197784 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5023e371-29c9-4ff0-a222-d4dca09ff2db admin admin] The token cache is being invalidate because project 10f20eef33b04be4bdc3f781710414b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:51:03.198143 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5023e371-29c9-4ff0-a222-d4dca09ff2db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:03.199426 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5023e371-29c9-4ff0-a222-d4dca09ff2db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:03.206641 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f1102-a8ed-4299-84a3-3f70cc2bcf9f admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:03.209353 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-908f1102-a8ed-4299-84a3-3f70cc2bcf9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:03.220109 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1957/3891] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:51:02 2022] DELETE /identity/v3/projects/10f20eef33b04be4bdc3f781710414b5 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:51:03.261640 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:03.319927 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f1102-a8ed-4299-84a3-3f70cc2bcf9f admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:03.417161 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023e371-29c9-4ff0-a222-d4dca09ff2db admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:03.419665 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5023e371-29c9-4ff0-a222-d4dca09ff2db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:03.447455 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68107b3a-59ef-4aac-a47e-fac0a62e1f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:03.448130 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68107b3a-59ef-4aac-a47e-fac0a62e1f08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:03.448406 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68107b3a-59ef-4aac-a47e-fac0a62e1f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:03.448676 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68107b3a-59ef-4aac-a47e-fac0a62e1f08 admin admin] PATH_INFO: `/v3/users/8ea1bcba03e84ab6952d68147ffc8369` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:03.454611 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68107b3a-59ef-4aac-a47e-fac0a62e1f08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ea1bcba03e84ab6952d68147ffc8369)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:03.460112 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68107b3a-59ef-4aac-a47e-fac0a62e1f08 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:03.583636 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-68107b3a-59ef-4aac-a47e-fac0a62e1f08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ea1bcba03e84ab6952d68147ffc8369'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:03.585242 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-68107b3a-59ef-4aac-a47e-fac0a62e1f08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ea1bcba03e84ab6952d68147ffc8369'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:03.604251 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-68107b3a-59ef-4aac-a47e-fac0a62e1f08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ea1bcba03e84ab6952d68147ffc8369'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:03.613791 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:03.620485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023e371-29c9-4ff0-a222-d4dca09ff2db admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:03.633071 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-68107b3a-59ef-4aac-a47e-fac0a62e1f08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ea1bcba03e84ab6952d68147ffc8369'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:03.634307 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-68107b3a-59ef-4aac-a47e-fac0a62e1f08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ea1bcba03e84ab6952d68147ffc8369'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:03.639797 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c11be4-0827-46bf-b596-37f784fb50f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:03.645305 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c11be4-0827-46bf-b596-37f784fb50f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:03.647282 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c11be4-0827-46bf-b596-37f784fb50f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:03.647947 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c11be4-0827-46bf-b596-37f784fb50f8 admin admin] PATH_INFO: `/v3/projects/09841e55e1b145aaae76652d19a35da6` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:03.652842 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c11be4-0827-46bf-b596-37f784fb50f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09841e55e1b145aaae76652d19a35da6)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:03.665348 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c11be4-0827-46bf-b596-37f784fb50f8 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:03.732407 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1935/3892] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:51:03 2022] DELETE /identity/v3/users/8ea1bcba03e84ab6952d68147ffc8369 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:03.791130 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-28c11be4-0827-46bf-b596-37f784fb50f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09841e55e1b145aaae76652d19a35da6', 'request_id': 'req-28c11be4-0827-46bf-b596-37f784fb50f8'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:03.804928 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-28c11be4-0827-46bf-b596-37f784fb50f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09841e55e1b145aaae76652d19a35da6', 'request_id': 'req-28c11be4-0827-46bf-b596-37f784fb50f8'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:03.820279 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-28c11be4-0827-46bf-b596-37f784fb50f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09841e55e1b145aaae76652d19a35da6', 'request_id': 'req-28c11be4-0827-46bf-b596-37f784fb50f8'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:03.835581 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-28c11be4-0827-46bf-b596-37f784fb50f8 admin admin] The token cache is being invalidate because project 09841e55e1b145aaae76652d19a35da6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:51:03.835967 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-28c11be4-0827-46bf-b596-37f784fb50f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:03.837308 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-28c11be4-0827-46bf-b596-37f784fb50f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:03.839089 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1958/3893] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:51:03 2022] DELETE /identity/v3/projects/09841e55e1b145aaae76652d19a35da6 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:03.846083 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d80de9-6707-4b55-8abc-e3b8ccbe17db None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:03.846083 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d80de9-6707-4b55-8abc-e3b8ccbe17db None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:03.846702 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d80de9-6707-4b55-8abc-e3b8ccbe17db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:03.878692 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-f5d80de9-6707-4b55-8abc-e3b8ccbe17db None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:51:03.880598 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f5d80de9-6707-4b55-8abc-e3b8ccbe17db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:04.065214 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:04.127068 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1936/3894] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:51:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:51:04.134926 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bb153-d99e-46c8-9ee5-1ccebb5ba83f None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:04.135488 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bb153-d99e-46c8-9ee5-1ccebb5ba83f None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:04.135488 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bb153-d99e-46c8-9ee5-1ccebb5ba83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:04.163666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-2b3bb153-d99e-46c8-9ee5-1ccebb5ba83f None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:51:04.165554 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2b3bb153-d99e-46c8-9ee5-1ccebb5ba83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:04.175512 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1959/3895] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:51:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:51:04.179986 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d80de9-6707-4b55-8abc-e3b8ccbe17db None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:04.210555 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d80de9-6707-4b55-8abc-e3b8ccbe17db None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:04.226903 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3bb153-d99e-46c8-9ee5-1ccebb5ba83f None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:04.228896 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2b3bb153-d99e-46c8-9ee5-1ccebb5ba83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:04.234894 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c38f76b-a1da-44b1-8460-e6a8d334efb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:04.237178 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38f76b-a1da-44b1-8460-e6a8d334efb4 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:04.237509 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38f76b-a1da-44b1-8460-e6a8d334efb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:04.237847 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38f76b-a1da-44b1-8460-e6a8d334efb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:04.238459 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c38f76b-a1da-44b1-8460-e6a8d334efb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:51:04.241297 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c38f76b-a1da-44b1-8460-e6a8d334efb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:04.243694 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c38f76b-a1da-44b1-8460-e6a8d334efb4 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:04.253686 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3bb153-d99e-46c8-9ee5-1ccebb5ba83f None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:04.272052 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624ff84-2d94-4961-8c68-fe82bfd62712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:04.277697 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1937/3896] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:51:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:51:04.277859 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624ff84-2d94-4961-8c68-fe82bfd62712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:04.277859 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624ff84-2d94-4961-8c68-fe82bfd62712 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:04.277859 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624ff84-2d94-4961-8c68-fe82bfd62712 admin admin] PATH_INFO: `/v3/projects/0409f73caa0f4f7194cc1c2b662d6962` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:04.278424 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c38f76b-a1da-44b1-8460-e6a8d334efb4 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:04.279170 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624ff84-2d94-4961-8c68-fe82bfd62712 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0409f73caa0f4f7194cc1c2b662d6962)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:04.291576 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624ff84-2d94-4961-8c68-fe82bfd62712 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:04.301704 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c38f76b-a1da-44b1-8460-e6a8d334efb4 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:04.308601 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf729ec-41d8-451c-85fe-e36daa8f0884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:04.309592 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf729ec-41d8-451c-85fe-e36daa8f0884 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:04.310116 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf729ec-41d8-451c-85fe-e36daa8f0884 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:04.310973 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf729ec-41d8-451c-85fe-e36daa8f0884 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:04.312645 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf729ec-41d8-451c-85fe-e36daa8f0884 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:04.315302 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf729ec-41d8-451c-85fe-e36daa8f0884 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:04.370855 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1938/3897] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:51:04 2022] POST /identity/v3/projects => generated 371 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:51:04.372362 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf729ec-41d8-451c-85fe-e36daa8f0884 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:04.412357 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6624ff84-2d94-4961-8c68-fe82bfd62712 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0409f73caa0f4f7194cc1c2b662d6962', 'request_id': 'req-6624ff84-2d94-4961-8c68-fe82bfd62712'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:04.429681 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6624ff84-2d94-4961-8c68-fe82bfd62712 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0409f73caa0f4f7194cc1c2b662d6962', 'request_id': 'req-6624ff84-2d94-4961-8c68-fe82bfd62712'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:04.444521 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6624ff84-2d94-4961-8c68-fe82bfd62712 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0409f73caa0f4f7194cc1c2b662d6962', 'request_id': 'req-6624ff84-2d94-4961-8c68-fe82bfd62712'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:04.472506 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6624ff84-2d94-4961-8c68-fe82bfd62712 admin admin] The token cache is being invalidate because project 0409f73caa0f4f7194cc1c2b662d6962 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:51:04.472849 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6624ff84-2d94-4961-8c68-fe82bfd62712 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:04.474441 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6624ff84-2d94-4961-8c68-fe82bfd62712 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:04.482574 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1960/3898] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:51:04 2022] DELETE /identity/v3/projects/0409f73caa0f4f7194cc1c2b662d6962 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:04.484728 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee64d8a-b5cf-4fbc-8e27-6fb7cb0c1ed1 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:04.485021 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee64d8a-b5cf-4fbc-8e27-6fb7cb0c1ed1 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:04.485497 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee64d8a-b5cf-4fbc-8e27-6fb7cb0c1ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:04.532598 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf729ec-41d8-451c-85fe-e36daa8f0884 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:04.544342 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-aee64d8a-b5cf-4fbc-8e27-6fb7cb0c1ed1 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:51:04.545696 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-aee64d8a-b5cf-4fbc-8e27-6fb7cb0c1ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:04.624644 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1961/3899] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:51:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:51:04.632491 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee64d8a-b5cf-4fbc-8e27-6fb7cb0c1ed1 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:04.641418 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-aee64d8a-b5cf-4fbc-8e27-6fb7cb0c1ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:04.652049 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2cbcdf-bf4d-4f34-8a92-ce60f91e943d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:04.652677 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2cbcdf-bf4d-4f34-8a92-ce60f91e943d admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:04.652950 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2cbcdf-bf4d-4f34-8a92-ce60f91e943d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:04.653258 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2cbcdf-bf4d-4f34-8a92-ce60f91e943d admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:04.653866 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2cbcdf-bf4d-4f34-8a92-ce60f91e943d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:04.655828 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2cbcdf-bf4d-4f34-8a92-ce60f91e943d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:04.660294 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:04.717766 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1939/3900] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:51:04 2022] POST /identity/v3/users => generated 286 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:51:04.717766 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d0cf2-37d1-4d77-9682-9cbe1c6b7950 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:04.717766 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d0cf2-37d1-4d77-9682-9cbe1c6b7950 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:04.717766 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d0cf2-37d1-4d77-9682-9cbe1c6b7950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:04.764971 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-877d0cf2-37d1-4d77-9682-9cbe1c6b7950 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:51:04.766697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-877d0cf2-37d1-4d77-9682-9cbe1c6b7950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:04.789936 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1940/3901] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:51:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:51:04.791075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d0cf2-37d1-4d77-9682-9cbe1c6b7950 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:04.793727 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-877d0cf2-37d1-4d77-9682-9cbe1c6b7950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:04.803773 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee64d8a-b5cf-4fbc-8e27-6fb7cb0c1ed1 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:04.812926 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d0cf2-37d1-4d77-9682-9cbe1c6b7950 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:04.813710 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a9592-bea7-4d16-925a-16db6c247524 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:04.814714 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a9592-bea7-4d16-925a-16db6c247524 service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:04.815407 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a9592-bea7-4d16-925a-16db6c247524 service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:04.816068 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a9592-bea7-4d16-925a-16db6c247524 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:04.819102 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ad1a9592-bea7-4d16-925a-16db6c247524 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:04.820809 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a117ec-8072-4da0-988f-bd5297c9a69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:04.822089 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a117ec-8072-4da0-988f-bd5297c9a69c admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:04.822378 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a117ec-8072-4da0-988f-bd5297c9a69c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:04.822692 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a117ec-8072-4da0-988f-bd5297c9a69c admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:04.824093 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a117ec-8072-4da0-988f-bd5297c9a69c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:04.826789 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a117ec-8072-4da0-988f-bd5297c9a69c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:04.841395 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a9592-bea7-4d16-925a-16db6c247524 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:04.843410 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a9592-bea7-4d16-925a-16db6c247524 service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:04.844498 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1941/3902] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:51:04.845510 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a117ec-8072-4da0-988f-bd5297c9a69c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:04.857406 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1962/3903] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:51:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:51:04.858514 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a9592-bea7-4d16-925a-16db6c247524 service placement] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:04.871114 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a117ec-8072-4da0-988f-bd5297c9a69c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:04.872906 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a9592-bea7-4d16-925a-16db6c247524 service placement] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:04.888004 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe006b8-1b12-4456-99c8-38dad1ecb2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:04.888004 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe006b8-1b12-4456-99c8-38dad1ecb2f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:04.888004 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe006b8-1b12-4456-99c8-38dad1ecb2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:04.888004 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe006b8-1b12-4456-99c8-38dad1ecb2f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:04.888361 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe006b8-1b12-4456-99c8-38dad1ecb2f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:51:04.888361 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe006b8-1b12-4456-99c8-38dad1ecb2f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:04.888513 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b8418-a9a7-48d6-828e-09127ecbacd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:04.888513 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b8418-a9a7-48d6-828e-09127ecbacd9 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:04.888687 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe006b8-1b12-4456-99c8-38dad1ecb2f7 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:04.888767 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b8418-a9a7-48d6-828e-09127ecbacd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:04.888767 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b8418-a9a7-48d6-828e-09127ecbacd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:04.900178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184b8418-a9a7-48d6-828e-09127ecbacd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:04.903661 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184b8418-a9a7-48d6-828e-09127ecbacd9 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:04.920065 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1963/3904] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:51:04.925387 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1942/3905] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:51:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:51:04.925593 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b8418-a9a7-48d6-828e-09127ecbacd9 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:04.927622 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe006b8-1b12-4456-99c8-38dad1ecb2f7 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:04.940657 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe006b8-1b12-4456-99c8-38dad1ecb2f7 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:04.944124 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b8418-a9a7-48d6-828e-09127ecbacd9 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:04.952913 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e472f15-2c7d-4791-9d2e-d4c92c0a8b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:04.953965 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e472f15-2c7d-4791-9d2e-d4c92c0a8b65 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:04.955468 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e472f15-2c7d-4791-9d2e-d4c92c0a8b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:04.956452 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e472f15-2c7d-4791-9d2e-d4c92c0a8b65 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:04.958237 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e472f15-2c7d-4791-9d2e-d4c92c0a8b65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:04.961331 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b421c5c-57b7-4d7b-ba50-def623894266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:04.962917 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b421c5c-57b7-4d7b-ba50-def623894266 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:04.964496 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b421c5c-57b7-4d7b-ba50-def623894266 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:04.965021 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e472f15-2c7d-4791-9d2e-d4c92c0a8b65 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:04.965489 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b421c5c-57b7-4d7b-ba50-def623894266 admin admin] PATH_INFO: `/v3/projects/befd8f594a954a1ea3ea172fafed14a3/users/00dee611719b433284d4258833021ec6/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:04.996020 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b421c5c-57b7-4d7b-ba50-def623894266 admin admin] RBAC: Authorizing `identity:create_grant(project_id=befd8f594a954a1ea3ea172fafed14a3, user_id=00dee611719b433284d4258833021ec6, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:04.999418 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b421c5c-57b7-4d7b-ba50-def623894266 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:05.020342 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1943/3907] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:51:04 2022] POST /identity/v3/projects => generated 373 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:51:05.020830 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1964/3907] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:51:04 2022] PUT /identity/v3/projects/befd8f594a954a1ea3ea172fafed14a3/users/00dee611719b433284d4258833021ec6/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:05.021717 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b421c5c-57b7-4d7b-ba50-def623894266 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:05.022765 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893175c-f377-4a79-adff-302281404ea7 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:05.023155 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893175c-f377-4a79-adff-302281404ea7 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:05.023503 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893175c-f377-4a79-adff-302281404ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:05.031846 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:05.046819 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-d893175c-f377-4a79-adff-302281404ea7 None None] MFA Rules not processed for user `a3e14fd42e5942199e28335124d59c75`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:51:05.048243 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d893175c-f377-4a79-adff-302281404ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:05.119185 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1944/3908] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:51:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:51:05.120100 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cca158-8544-4be4-9d73-b124f72365fe None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:05.120387 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cca158-8544-4be4-9d73-b124f72365fe None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:05.120670 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cca158-8544-4be4-9d73-b124f72365fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:05.153257 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-17cca158-8544-4be4-9d73-b124f72365fe None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:51:05.154412 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-17cca158-8544-4be4-9d73-b124f72365fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:05.168212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b421c5c-57b7-4d7b-ba50-def623894266 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:05.316802 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1945/3909] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:51:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:51:05.347367 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cca158-8544-4be4-9d73-b124f72365fe None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:05.347599 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-17cca158-8544-4be4-9d73-b124f72365fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:05.371053 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f76ec-2a5a-4f51-a108-9994631ff821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:05.372728 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f76ec-2a5a-4f51-a108-9994631ff821 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:05.373242 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f76ec-2a5a-4f51-a108-9994631ff821 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:05.373579 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f76ec-2a5a-4f51-a108-9994631ff821 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:05.375510 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f76ec-2a5a-4f51-a108-9994631ff821 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:05.378591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f76ec-2a5a-4f51-a108-9994631ff821 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:05.393490 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:05.425810 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1965/3910] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:51:05 2022] POST /identity/v3/users => generated 287 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:51:05.426986 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f76ec-2a5a-4f51-a108-9994631ff821 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:05.444457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cca158-8544-4be4-9d73-b124f72365fe None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:05.448512 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f76ec-2a5a-4f51-a108-9994631ff821 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:05.454128 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf3b40-b9b1-4f94-9a36-0cd2d60bc310 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:05.455306 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf3b40-b9b1-4f94-9a36-0cd2d60bc310 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:05.455989 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf3b40-b9b1-4f94-9a36-0cd2d60bc310 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:05.456385 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf3b40-b9b1-4f94-9a36-0cd2d60bc310 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:05.458457 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b36be1-5f14-484b-b7cf-f82f16453faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:05.459297 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b36be1-5f14-484b-b7cf-f82f16453faa admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:05.459997 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b36be1-5f14-484b-b7cf-f82f16453faa admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:05.466684 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b36be1-5f14-484b-b7cf-f82f16453faa admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:05.472333 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbf3b40-b9b1-4f94-9a36-0cd2d60bc310 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:05.474414 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbf3b40-b9b1-4f94-9a36-0cd2d60bc310 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:05.476938 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b36be1-5f14-484b-b7cf-f82f16453faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:05.485007 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b36be1-5f14-484b-b7cf-f82f16453faa admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:05.487997 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1946/3911] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:51:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:51:05.516561 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1966/3912] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:51:05 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:51:05.520623 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf3b40-b9b1-4f94-9a36-0cd2d60bc310 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:05.533323 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf3b40-b9b1-4f94-9a36-0cd2d60bc310 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:05.541118 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47123e-3a2b-48b5-a1e6-8e0e412d6217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:05.542132 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47123e-3a2b-48b5-a1e6-8e0e412d6217 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:05.542486 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47123e-3a2b-48b5-a1e6-8e0e412d6217 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:05.542825 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47123e-3a2b-48b5-a1e6-8e0e412d6217 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:05.543627 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a47123e-3a2b-48b5-a1e6-8e0e412d6217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:05.545479 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a47123e-3a2b-48b5-a1e6-8e0e412d6217 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:05.560012 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1947/3913] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:51:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:51:05.564061 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b36be1-5f14-484b-b7cf-f82f16453faa admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:05.576166 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b36be1-5f14-484b-b7cf-f82f16453faa admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:05.581673 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c508e-8b12-4ab2-81f3-c9e3688d4abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:05.582542 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c508e-8b12-4ab2-81f3-c9e3688d4abf admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:05.582920 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c508e-8b12-4ab2-81f3-c9e3688d4abf admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:05.583351 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c508e-8b12-4ab2-81f3-c9e3688d4abf admin admin] PATH_INFO: `/v3/projects/01cd135512284897b4ef1a9e923958bd/users/29bc3ad4c8e34addbb6ab1b8a41e86d2/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:05.608278 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c508e-8b12-4ab2-81f3-c9e3688d4abf admin admin] RBAC: Authorizing `identity:create_grant(project_id=01cd135512284897b4ef1a9e923958bd, user_id=29bc3ad4c8e34addbb6ab1b8a41e86d2, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:05.611701 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c508e-8b12-4ab2-81f3-c9e3688d4abf admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:05.634581 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1967/3914] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:51:05 2022] PUT /identity/v3/projects/01cd135512284897b4ef1a9e923958bd/users/29bc3ad4c8e34addbb6ab1b8a41e86d2/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:05.644993 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee2583-a28d-43c8-8682-3fd137f030e0 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:05.645280 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee2583-a28d-43c8-8682-3fd137f030e0 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:05.645556 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee2583-a28d-43c8-8682-3fd137f030e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:05.689745 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-9eee2583-a28d-43c8-8682-3fd137f030e0 None None] MFA Rules not processed for user `29bc3ad4c8e34addbb6ab1b8a41e86d2`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:51:05.691703 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9eee2583-a28d-43c8-8682-3fd137f030e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:05.751455 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:05.818114 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1948/3915] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:51:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:51:05.846845 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c508e-8b12-4ab2-81f3-c9e3688d4abf admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:05.848974 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-106c508e-8b12-4ab2-81f3-c9e3688d4abf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:05.973987 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c508e-8b12-4ab2-81f3-c9e3688d4abf admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:05.984298 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce2faf-5652-4d20-bf97-aeaf120ac445 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:05.984935 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce2faf-5652-4d20-bf97-aeaf120ac445 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:05.985212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce2faf-5652-4d20-bf97-aeaf120ac445 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:05.985558 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce2faf-5652-4d20-bf97-aeaf120ac445 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:05.997360 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ce2faf-5652-4d20-bf97-aeaf120ac445 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:05.999685 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ce2faf-5652-4d20-bf97-aeaf120ac445 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:06.013360 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1968/3916] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:51:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:51:15.812756 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=14 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:16.006257 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:INSERT=2,keystone:SELECT=43 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:23.357694 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075675e-244f-408b-ad38-e7f4e7c953a6 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:23.358252 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075675e-244f-408b-ad38-e7f4e7c953a6 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:23.358252 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075675e-244f-408b-ad38-e7f4e7c953a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:23.560031 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-0075675e-244f-408b-ad38-e7f4e7c953a6 None None] MFA Rules not processed for user `00dee611719b433284d4258833021ec6`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:51:23.561846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce2faf-5652-4d20-bf97-aeaf120ac445 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:23.566846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-41ce2faf-5652-4d20-bf97-aeaf120ac445 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:23.583810 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0075675e-244f-408b-ad38-e7f4e7c953a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:23.872747 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce2faf-5652-4d20-bf97-aeaf120ac445 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:23.881816 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7d65e-2d18-4898-8d8a-856b8a8949a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:23.882730 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7d65e-2d18-4898-8d8a-856b8a8949a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:23.885660 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7d65e-2d18-4898-8d8a-856b8a8949a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:23.886253 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7d65e-2d18-4898-8d8a-856b8a8949a3 admin admin] PATH_INFO: `/v3/users/6c8240dd54f74ad4a1f664a790875be1` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:23.888532 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c7d65e-2d18-4898-8d8a-856b8a8949a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c8240dd54f74ad4a1f664a790875be1)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:23.894588 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c7d65e-2d18-4898-8d8a-856b8a8949a3 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:23.939868 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1949/3917] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:51:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 583 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:51:23.947829 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff8a64-b26d-4160-9db0-0a9608ce3d8b None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:23.948120 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff8a64-b26d-4160-9db0-0a9608ce3d8b None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:23.948484 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff8a64-b26d-4160-9db0-0a9608ce3d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:24.003625 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-1eff8a64-b26d-4160-9db0-0a9608ce3d8b None None] MFA Rules not processed for user `00dee611719b433284d4258833021ec6`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:51:24.005085 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1eff8a64-b26d-4160-9db0-0a9608ce3d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:24.037579 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a8c7d65e-2d18-4898-8d8a-856b8a8949a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c8240dd54f74ad4a1f664a790875be1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:24.039881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a8c7d65e-2d18-4898-8d8a-856b8a8949a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c8240dd54f74ad4a1f664a790875be1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:24.046840 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1950/3918] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:51:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:51:24.067948 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a8c7d65e-2d18-4898-8d8a-856b8a8949a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c8240dd54f74ad4a1f664a790875be1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:24.088409 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a8c7d65e-2d18-4898-8d8a-856b8a8949a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c8240dd54f74ad4a1f664a790875be1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:24.101563 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a8c7d65e-2d18-4898-8d8a-856b8a8949a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c8240dd54f74ad4a1f664a790875be1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:24.126488 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1969/3919] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:51:23 2022] DELETE /identity/v3/users/6c8240dd54f74ad4a1f664a790875be1 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:51:24.129301 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aac004-09d6-4a89-b7c7-b339a8aa9500 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:24.129592 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aac004-09d6-4a89-b7c7-b339a8aa9500 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:24.129865 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aac004-09d6-4a89-b7c7-b339a8aa9500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:24.194161 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-53aac004-09d6-4a89-b7c7-b339a8aa9500 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:51:24.198591 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-53aac004-09d6-4a89-b7c7-b339a8aa9500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:24.391502 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7d65e-2d18-4898-8d8a-856b8a8949a3 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:24.393429 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a8c7d65e-2d18-4898-8d8a-856b8a8949a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:24.531462 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1951/3920] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:51:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:51:24.549425 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aac004-09d6-4a89-b7c7-b339a8aa9500 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:24.551161 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-53aac004-09d6-4a89-b7c7-b339a8aa9500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:24.713978 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7d65e-2d18-4898-8d8a-856b8a8949a3 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:24.763309 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb47fb4-d8c7-45e5-90b9-61d129b7503b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:24.763952 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb47fb4-d8c7-45e5-90b9-61d129b7503b service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:24.766649 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb47fb4-d8c7-45e5-90b9-61d129b7503b service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:24.766649 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb47fb4-d8c7-45e5-90b9-61d129b7503b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:24.777926 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2bb47fb4-d8c7-45e5-90b9-61d129b7503b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:24.815345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aac004-09d6-4a89-b7c7-b339a8aa9500 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:24.822088 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:24.832305 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeea232-37fc-4f6c-afa1-d032fc61188a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:24.832991 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeea232-37fc-4f6c-afa1-d032fc61188a service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:24.833385 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeea232-37fc-4f6c-afa1-d032fc61188a service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:24.833786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeea232-37fc-4f6c-afa1-d032fc61188a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:24.866607 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeea232-37fc-4f6c-afa1-d032fc61188a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:24.873676 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeea232-37fc-4f6c-afa1-d032fc61188a service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:24.921372 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1952/3921] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:51:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:51:24.933949 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb47fb4-d8c7-45e5-90b9-61d129b7503b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:24.943690 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb47fb4-d8c7-45e5-90b9-61d129b7503b service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:24.981506 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1970/3922] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:51:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:51:27.666502 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeea232-37fc-4f6c-afa1-d032fc61188a service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:27.668395 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0eeea232-37fc-4f6c-afa1-d032fc61188a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:27.703292 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeea232-37fc-4f6c-afa1-d032fc61188a service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:27.728966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff7456-edae-487b-803e-5f816faca404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:27.728966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff7456-edae-487b-803e-5f816faca404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:27.728966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff7456-edae-487b-803e-5f816faca404 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:27.728966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff7456-edae-487b-803e-5f816faca404 admin admin] PATH_INFO: `/v3/projects/c5f1ceef95ae4b4f839e7dc297796f96` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:27.729605 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff7456-edae-487b-803e-5f816faca404 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5f1ceef95ae4b4f839e7dc297796f96)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:27.730819 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff7456-edae-487b-803e-5f816faca404 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:27.803982 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:27.854271 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1bff7456-edae-487b-803e-5f816faca404 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5f1ceef95ae4b4f839e7dc297796f96', 'request_id': 'req-1bff7456-edae-487b-803e-5f816faca404'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:27.866070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1bff7456-edae-487b-803e-5f816faca404 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5f1ceef95ae4b4f839e7dc297796f96', 'request_id': 'req-1bff7456-edae-487b-803e-5f816faca404'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:27.885946 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1bff7456-edae-487b-803e-5f816faca404 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5f1ceef95ae4b4f839e7dc297796f96', 'request_id': 'req-1bff7456-edae-487b-803e-5f816faca404'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:27.910614 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1bff7456-edae-487b-803e-5f816faca404 admin admin] The token cache is being invalidate because project c5f1ceef95ae4b4f839e7dc297796f96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:51:27.911847 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1bff7456-edae-487b-803e-5f816faca404 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:27.912794 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1bff7456-edae-487b-803e-5f816faca404 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:27.921025 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b6800-62f8-45dd-b2f2-f54cd5d127b3 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:27.921477 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b6800-62f8-45dd-b2f2-f54cd5d127b3 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:27.921477 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b6800-62f8-45dd-b2f2-f54cd5d127b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:27.924243 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1953/3923] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:51:27 2022] DELETE /identity/v3/projects/c5f1ceef95ae4b4f839e7dc297796f96 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:27.970751 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-2d3b6800-62f8-45dd-b2f2-f54cd5d127b3 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:51:27.972037 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2d3b6800-62f8-45dd-b2f2-f54cd5d127b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:28.130671 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1971/3924] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:51:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:51:28.139981 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbfa4e-ecaf-4a96-afce-e30a5443de3e None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:28.140270 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbfa4e-ecaf-4a96-afce-e30a5443de3e None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:28.140546 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbfa4e-ecaf-4a96-afce-e30a5443de3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:28.186342 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-b4cbfa4e-ecaf-4a96-afce-e30a5443de3e None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:51:28.192277 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b4cbfa4e-ecaf-4a96-afce-e30a5443de3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:28.222698 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1954/3925] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:51:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:51:28.226987 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b6800-62f8-45dd-b2f2-f54cd5d127b3 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:28.244440 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b6800-62f8-45dd-b2f2-f54cd5d127b3 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:28.266734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362d50e-ebf9-4368-b626-dc8ca9b6e406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:28.267605 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362d50e-ebf9-4368-b626-dc8ca9b6e406 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:28.268044 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362d50e-ebf9-4368-b626-dc8ca9b6e406 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:28.268463 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362d50e-ebf9-4368-b626-dc8ca9b6e406 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:28.269288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0362d50e-ebf9-4368-b626-dc8ca9b6e406 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:51:28.270502 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0362d50e-ebf9-4368-b626-dc8ca9b6e406 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:28.272424 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0362d50e-ebf9-4368-b626-dc8ca9b6e406 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:28.325664 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1972/3926] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:51:28.327958 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cbfa4e-ecaf-4a96-afce-e30a5443de3e None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:28.348110 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cbfa4e-ecaf-4a96-afce-e30a5443de3e None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:28.363777 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a6cf4e-9749-4036-9091-c7bc96dd0afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:28.366756 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6cf4e-9749-4036-9091-c7bc96dd0afc admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:28.367169 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6cf4e-9749-4036-9091-c7bc96dd0afc admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:28.369157 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6cf4e-9749-4036-9091-c7bc96dd0afc admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:28.370044 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a6cf4e-9749-4036-9091-c7bc96dd0afc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:28.375860 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a6cf4e-9749-4036-9091-c7bc96dd0afc admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:28.435448 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362d50e-ebf9-4368-b626-dc8ca9b6e406 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:28.439206 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1955/3927] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:51:28 2022] POST /identity/v3/projects => generated 375 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:51:28.461289 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362d50e-ebf9-4368-b626-dc8ca9b6e406 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:28.679350 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdc87d9-520e-4fee-b63e-1c3f9cdeea6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:28.681767 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc87d9-520e-4fee-b63e-1c3f9cdeea6d admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:28.682344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc87d9-520e-4fee-b63e-1c3f9cdeea6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:28.682846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc87d9-520e-4fee-b63e-1c3f9cdeea6d admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:28.683922 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdc87d9-520e-4fee-b63e-1c3f9cdeea6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:28.687332 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdc87d9-520e-4fee-b63e-1c3f9cdeea6d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:28.734217 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1973/3928] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:51:28 2022] POST /identity/v3/users => generated 288 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:51:28.738021 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a6cf4e-9749-4036-9091-c7bc96dd0afc admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:28.760610 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a6cf4e-9749-4036-9091-c7bc96dd0afc admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:28.772461 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de94c1-a03f-42cb-9bd6-7a264119bb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:28.773100 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de94c1-a03f-42cb-9bd6-7a264119bb39 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:28.773393 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de94c1-a03f-42cb-9bd6-7a264119bb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:28.773711 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de94c1-a03f-42cb-9bd6-7a264119bb39 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:28.774346 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14de94c1-a03f-42cb-9bd6-7a264119bb39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:28.778242 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14de94c1-a03f-42cb-9bd6-7a264119bb39 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:28.828830 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1956/3929] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:51:28.833059 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdc87d9-520e-4fee-b63e-1c3f9cdeea6d admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:28.863168 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdc87d9-520e-4fee-b63e-1c3f9cdeea6d admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:28.878431 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ef44c-d7ca-4d69-a802-8ee9119b8039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:28.879090 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ef44c-d7ca-4d69-a802-8ee9119b8039 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:28.879437 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ef44c-d7ca-4d69-a802-8ee9119b8039 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:28.879646 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ef44c-d7ca-4d69-a802-8ee9119b8039 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:28.880382 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287ef44c-d7ca-4d69-a802-8ee9119b8039 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:28.882101 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287ef44c-d7ca-4d69-a802-8ee9119b8039 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:28.912723 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de94c1-a03f-42cb-9bd6-7a264119bb39 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:28.923964 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1974/3930] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:51:28.926941 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de94c1-a03f-42cb-9bd6-7a264119bb39 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:28.945122 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dce542-a625-4bd5-a9bb-bf3254c76249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:28.945888 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dce542-a625-4bd5-a9bb-bf3254c76249 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:28.946170 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dce542-a625-4bd5-a9bb-bf3254c76249 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:28.946446 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dce542-a625-4bd5-a9bb-bf3254c76249 admin admin] PATH_INFO: `/v3/projects/ecea52cef4ca497b904c97ab9e5b8500/users/28b5bdf9d4904401b5c1cdd35c290e11/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:28.990100 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dce542-a625-4bd5-a9bb-bf3254c76249 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecea52cef4ca497b904c97ab9e5b8500, user_id=28b5bdf9d4904401b5c1cdd35c290e11, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:28.993379 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dce542-a625-4bd5-a9bb-bf3254c76249 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:29.024746 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16016caa-a2b2-47b5-ba62-1e6a4758f87e None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:29.025480 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16016caa-a2b2-47b5-ba62-1e6a4758f87e None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:29.025763 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16016caa-a2b2-47b5-ba62-1e6a4758f87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:29.029086 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1957/3931] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:51:28 2022] PUT /identity/v3/projects/ecea52cef4ca497b904c97ab9e5b8500/users/28b5bdf9d4904401b5c1cdd35c290e11/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:29.097002 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-16016caa-a2b2-47b5-ba62-1e6a4758f87e None None] MFA Rules not processed for user `28b5bdf9d4904401b5c1cdd35c290e11`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:51:29.102953 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-16016caa-a2b2-47b5-ba62-1e6a4758f87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:29.129175 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:29.246539 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1975/3932] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:51:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:51:29.253576 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dce542-a625-4bd5-a9bb-bf3254c76249 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:29.255561 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b9dce542-a625-4bd5-a9bb-bf3254c76249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:29.392614 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dce542-a625-4bd5-a9bb-bf3254c76249 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:29.400668 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50b79e-010a-4a3e-b6b2-7867ffd004a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:29.401440 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50b79e-010a-4a3e-b6b2-7867ffd004a0 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:29.401813 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50b79e-010a-4a3e-b6b2-7867ffd004a0 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:29.402092 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50b79e-010a-4a3e-b6b2-7867ffd004a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:29.412225 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f50b79e-010a-4a3e-b6b2-7867ffd004a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:29.416182 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f50b79e-010a-4a3e-b6b2-7867ffd004a0 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:29.428406 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1958/3933] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:51:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:51:30.628351 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16016caa-a2b2-47b5-ba62-1e6a4758f87e None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:30.787368 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16016caa-a2b2-47b5-ba62-1e6a4758f87e None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:30.802247 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96791cd6-8877-4f25-a680-ae277ea466b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:30.803061 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96791cd6-8877-4f25-a680-ae277ea466b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:30.803590 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96791cd6-8877-4f25-a680-ae277ea466b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:30.804081 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96791cd6-8877-4f25-a680-ae277ea466b7 admin admin] PATH_INFO: `/v3/users/28b5bdf9d4904401b5c1cdd35c290e11` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:30.806750 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96791cd6-8877-4f25-a680-ae277ea466b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28b5bdf9d4904401b5c1cdd35c290e11)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:30.812028 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96791cd6-8877-4f25-a680-ae277ea466b7 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:30.932287 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-96791cd6-8877-4f25-a680-ae277ea466b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28b5bdf9d4904401b5c1cdd35c290e11'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:30.933122 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-96791cd6-8877-4f25-a680-ae277ea466b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28b5bdf9d4904401b5c1cdd35c290e11'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:30.965075 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-96791cd6-8877-4f25-a680-ae277ea466b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28b5bdf9d4904401b5c1cdd35c290e11'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:30.986007 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-96791cd6-8877-4f25-a680-ae277ea466b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28b5bdf9d4904401b5c1cdd35c290e11'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:31.001646 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-96791cd6-8877-4f25-a680-ae277ea466b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28b5bdf9d4904401b5c1cdd35c290e11'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:31.018974 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1976/3934] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:51:30 2022] DELETE /identity/v3/users/28b5bdf9d4904401b5c1cdd35c290e11 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:31.023873 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ca133-d551-4da1-bcd1-2dd19ce14dfe None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:31.024465 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ca133-d551-4da1-bcd1-2dd19ce14dfe None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:31.024584 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ca133-d551-4da1-bcd1-2dd19ce14dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:31.062113 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-8b2ca133-d551-4da1-bcd1-2dd19ce14dfe None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:51:31.067015 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8b2ca133-d551-4da1-bcd1-2dd19ce14dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:31.122982 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:31.185404 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1959/3935] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:51:31.193546 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96791cd6-8877-4f25-a680-ae277ea466b7 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:31.195292 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-96791cd6-8877-4f25-a680-ae277ea466b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:31.265989 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:31.316478 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96791cd6-8877-4f25-a680-ae277ea466b7 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:31.324605 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e1bafa-3acd-4c1d-800b-2b010b8c0254 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:31.325428 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1bafa-3acd-4c1d-800b-2b010b8c0254 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:31.325891 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1bafa-3acd-4c1d-800b-2b010b8c0254 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:31.326870 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1bafa-3acd-4c1d-800b-2b010b8c0254 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:31.358880 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e1bafa-3acd-4c1d-800b-2b010b8c0254 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:31.360401 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e1bafa-3acd-4c1d-800b-2b010b8c0254 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:31.372791 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1977/3936] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:51:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:51:31.908693 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ca133-d551-4da1-bcd1-2dd19ce14dfe None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:31.910269 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8b2ca133-d551-4da1-bcd1-2dd19ce14dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:31.926697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ca133-d551-4da1-bcd1-2dd19ce14dfe None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:31.943649 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60526a39-6458-49c7-9641-065396d0bcef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:31.944364 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60526a39-6458-49c7-9641-065396d0bcef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:31.944640 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60526a39-6458-49c7-9641-065396d0bcef admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:31.945106 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60526a39-6458-49c7-9641-065396d0bcef admin admin] PATH_INFO: `/v3/projects/ecea52cef4ca497b904c97ab9e5b8500` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:31.948822 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60526a39-6458-49c7-9641-065396d0bcef admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecea52cef4ca497b904c97ab9e5b8500)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:31.962506 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60526a39-6458-49c7-9641-065396d0bcef admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:32.032263 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-60526a39-6458-49c7-9641-065396d0bcef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecea52cef4ca497b904c97ab9e5b8500', 'request_id': 'req-60526a39-6458-49c7-9641-065396d0bcef'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:32.043700 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-60526a39-6458-49c7-9641-065396d0bcef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecea52cef4ca497b904c97ab9e5b8500', 'request_id': 'req-60526a39-6458-49c7-9641-065396d0bcef'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:32.054220 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-60526a39-6458-49c7-9641-065396d0bcef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecea52cef4ca497b904c97ab9e5b8500', 'request_id': 'req-60526a39-6458-49c7-9641-065396d0bcef'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:32.078383 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-60526a39-6458-49c7-9641-065396d0bcef admin admin] The token cache is being invalidate because project ecea52cef4ca497b904c97ab9e5b8500 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:51:32.078686 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-60526a39-6458-49c7-9641-065396d0bcef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:32.079371 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-60526a39-6458-49c7-9641-065396d0bcef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:32.087139 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1960/3937] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:51:31 2022] DELETE /identity/v3/projects/ecea52cef4ca497b904c97ab9e5b8500 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:51:32.088725 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74a297-9e5f-41b0-b313-abdc04a884c2 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:32.089211 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74a297-9e5f-41b0-b313-abdc04a884c2 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:32.089411 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74a297-9e5f-41b0-b313-abdc04a884c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:32.111625 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-7d74a297-9e5f-41b0-b313-abdc04a884c2 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:51:32.113391 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7d74a297-9e5f-41b0-b313-abdc04a884c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:32.250928 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1978/3938] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:51:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:51:32.259100 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce079ddf-4e4f-48e4-a89d-cac2f7d0efc5 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:32.259676 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce079ddf-4e4f-48e4-a89d-cac2f7d0efc5 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:32.260167 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce079ddf-4e4f-48e4-a89d-cac2f7d0efc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:32.325046 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-ce079ddf-4e4f-48e4-a89d-cac2f7d0efc5 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:51:32.326758 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ce079ddf-4e4f-48e4-a89d-cac2f7d0efc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:32.363511 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74a297-9e5f-41b0-b313-abdc04a884c2 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:32.364028 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1961/3939] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:51:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:51:32.375231 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74a297-9e5f-41b0-b313-abdc04a884c2 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:32.396324 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca9f6b-dbcf-46ac-ad8c-0d55b06f8aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:32.397050 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca9f6b-dbcf-46ac-ad8c-0d55b06f8aea admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:32.397392 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca9f6b-dbcf-46ac-ad8c-0d55b06f8aea admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:32.397730 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca9f6b-dbcf-46ac-ad8c-0d55b06f8aea admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:32.401121 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ca9f6b-dbcf-46ac-ad8c-0d55b06f8aea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:51:32.401872 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ca9f6b-dbcf-46ac-ad8c-0d55b06f8aea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:32.405349 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ca9f6b-dbcf-46ac-ad8c-0d55b06f8aea admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:32.439358 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1979/3940] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:51:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:51:32.443512 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce079ddf-4e4f-48e4-a89d-cac2f7d0efc5 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:32.457688 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce079ddf-4e4f-48e4-a89d-cac2f7d0efc5 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:32.470338 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb989a72-80b4-416f-af9a-b0369ddd1942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:32.471134 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb989a72-80b4-416f-af9a-b0369ddd1942 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:32.471394 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb989a72-80b4-416f-af9a-b0369ddd1942 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:32.471671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb989a72-80b4-416f-af9a-b0369ddd1942 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:32.472315 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb989a72-80b4-416f-af9a-b0369ddd1942 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:32.474463 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb989a72-80b4-416f-af9a-b0369ddd1942 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:32.544265 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1962/3941] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:51:32 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:51:32.545799 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca9f6b-dbcf-46ac-ad8c-0d55b06f8aea admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:32.564376 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca9f6b-dbcf-46ac-ad8c-0d55b06f8aea admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:32.679545 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb1f201-435f-4431-8fa1-2b9ae3c8ec35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:32.680324 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1f201-435f-4431-8fa1-2b9ae3c8ec35 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:32.680693 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1f201-435f-4431-8fa1-2b9ae3c8ec35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:32.681317 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1f201-435f-4431-8fa1-2b9ae3c8ec35 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:32.681975 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb1f201-435f-4431-8fa1-2b9ae3c8ec35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:32.683982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb1f201-435f-4431-8fa1-2b9ae3c8ec35 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:32.713462 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb989a72-80b4-416f-af9a-b0369ddd1942 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:32.721087 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1980/3942] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:51:32 2022] POST /identity/v3/users => generated 288 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:51:32.725188 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb989a72-80b4-416f-af9a-b0369ddd1942 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:32.731898 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f5620-9044-4ec5-87e5-bc0db74214fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:32.732180 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f5620-9044-4ec5-87e5-bc0db74214fe admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:32.732611 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f5620-9044-4ec5-87e5-bc0db74214fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:32.732965 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f5620-9044-4ec5-87e5-bc0db74214fe admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:32.733613 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114f5620-9044-4ec5-87e5-bc0db74214fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:32.735281 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114f5620-9044-4ec5-87e5-bc0db74214fe admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:32.759277 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1963/3943] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:51:32.763190 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb1f201-435f-4431-8fa1-2b9ae3c8ec35 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:32.777610 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb1f201-435f-4431-8fa1-2b9ae3c8ec35 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:32.782822 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba42cd65-fd50-48c1-9db9-3380b2c96b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:32.783982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42cd65-fd50-48c1-9db9-3380b2c96b64 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:32.783982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42cd65-fd50-48c1-9db9-3380b2c96b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:32.783982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42cd65-fd50-48c1-9db9-3380b2c96b64 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:32.784660 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba42cd65-fd50-48c1-9db9-3380b2c96b64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:32.788493 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba42cd65-fd50-48c1-9db9-3380b2c96b64 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:32.803101 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1981/3944] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:51:32.808021 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f5620-9044-4ec5-87e5-bc0db74214fe admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:32.820257 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f5620-9044-4ec5-87e5-bc0db74214fe admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:32.825556 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd3729-ef98-47a1-a8c7-24b777e92962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:32.826250 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd3729-ef98-47a1-a8c7-24b777e92962 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:32.826532 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd3729-ef98-47a1-a8c7-24b777e92962 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:32.826812 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd3729-ef98-47a1-a8c7-24b777e92962 admin admin] PATH_INFO: `/v3/projects/9974e4419b6242cfadd528ffb86581d3/users/2c2a2dc0b1b646d2ba8c4b1e65e75e67/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:32.866678 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fd3729-ef98-47a1-a8c7-24b777e92962 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9974e4419b6242cfadd528ffb86581d3, user_id=2c2a2dc0b1b646d2ba8c4b1e65e75e67, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:32.871777 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fd3729-ef98-47a1-a8c7-24b777e92962 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:32.920351 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1964/3945] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:51:32 2022] PUT /identity/v3/projects/9974e4419b6242cfadd528ffb86581d3/users/2c2a2dc0b1b646d2ba8c4b1e65e75e67/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:32.921548 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da09862-b6f2-4437-8886-8c7d49ba88ee None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:32.922008 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da09862-b6f2-4437-8886-8c7d49ba88ee None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:32.922106 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da09862-b6f2-4437-8886-8c7d49ba88ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:32.997570 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-2da09862-b6f2-4437-8886-8c7d49ba88ee None None] MFA Rules not processed for user `2c2a2dc0b1b646d2ba8c4b1e65e75e67`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:51:32.999718 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2da09862-b6f2-4437-8886-8c7d49ba88ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:33.102640 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:33.160053 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd3729-ef98-47a1-a8c7-24b777e92962 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:33.170801 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1982/3946] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:51:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:51:33.295338 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:33.325658 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd3729-ef98-47a1-a8c7-24b777e92962 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:33.335385 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe36d6-abe4-4094-8829-65443314233d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:33.336091 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe36d6-abe4-4094-8829-65443314233d admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:33.336478 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe36d6-abe4-4094-8829-65443314233d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:33.337104 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe36d6-abe4-4094-8829-65443314233d admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:33.337997 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe36d6-abe4-4094-8829-65443314233d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:33.339981 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe36d6-abe4-4094-8829-65443314233d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:33.383362 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1965/3947] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:51:33 2022] POST /identity/v3/projects => generated 375 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:51:33.384670 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da09862-b6f2-4437-8886-8c7d49ba88ee None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:33.419501 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da09862-b6f2-4437-8886-8c7d49ba88ee None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:33.554553 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d2678-e3f0-4aa6-8f17-e2d8f6750479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:33.556248 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d2678-e3f0-4aa6-8f17-e2d8f6750479 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:33.556782 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d2678-e3f0-4aa6-8f17-e2d8f6750479 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:33.557269 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d2678-e3f0-4aa6-8f17-e2d8f6750479 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:33.558128 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765d2678-e3f0-4aa6-8f17-e2d8f6750479 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:33.561654 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765d2678-e3f0-4aa6-8f17-e2d8f6750479 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:33.609184 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1983/3948] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:51:33 2022] POST /identity/v3/users => generated 294 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:51:33.613356 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe36d6-abe4-4094-8829-65443314233d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:33.633153 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe36d6-abe4-4094-8829-65443314233d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:33.643086 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d5228-9a94-43db-a0bb-b886e08f64ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:33.644150 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d5228-9a94-43db-a0bb-b886e08f64ef admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:33.644644 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d5228-9a94-43db-a0bb-b886e08f64ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:33.646254 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d5228-9a94-43db-a0bb-b886e08f64ef admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:33.647457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7d5228-9a94-43db-a0bb-b886e08f64ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:33.650966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7d5228-9a94-43db-a0bb-b886e08f64ef admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:33.672013 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1966/3949] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:51:33.674219 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d2678-e3f0-4aa6-8f17-e2d8f6750479 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:33.689254 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d2678-e3f0-4aa6-8f17-e2d8f6750479 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:33.696444 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8818cc8-8568-4779-a420-3494fe93b1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:33.696913 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8818cc8-8568-4779-a420-3494fe93b1a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:33.697870 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8818cc8-8568-4779-a420-3494fe93b1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:33.698372 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8818cc8-8568-4779-a420-3494fe93b1a6 admin admin] PATH_INFO: `/v3/projects/4a319a2ac64645518e88b0d0cd0d2033/users/3b4a1032e596465e8f3b01af0dcfb8a8/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:33.726420 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8818cc8-8568-4779-a420-3494fe93b1a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a319a2ac64645518e88b0d0cd0d2033, user_id=3b4a1032e596465e8f3b01af0dcfb8a8, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:33.731565 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8818cc8-8568-4779-a420-3494fe93b1a6 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:33.764900 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1984/3950] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:51:33 2022] PUT /identity/v3/projects/4a319a2ac64645518e88b0d0cd0d2033/users/3b4a1032e596465e8f3b01af0dcfb8a8/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:33.766386 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d5228-9a94-43db-a0bb-b886e08f64ef admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:33.786755 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d5228-9a94-43db-a0bb-b886e08f64ef admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:33.914246 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d370f7-48f9-4743-868e-c60cee25cc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:33.915983 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d370f7-48f9-4743-868e-c60cee25cc4b admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:33.916411 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d370f7-48f9-4743-868e-c60cee25cc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:33.916813 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d370f7-48f9-4743-868e-c60cee25cc4b admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:33.917786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d370f7-48f9-4743-868e-c60cee25cc4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:33.919743 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d370f7-48f9-4743-868e-c60cee25cc4b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:33.948738 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1967/3951] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:51:33.950201 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8818cc8-8568-4779-a420-3494fe93b1a6 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:33.966836 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8818cc8-8568-4779-a420-3494fe93b1a6 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:33.976972 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b23403-741c-467a-a21c-426f25b23867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:33.978934 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b23403-741c-467a-a21c-426f25b23867 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:33.979454 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b23403-741c-467a-a21c-426f25b23867 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:33.979917 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b23403-741c-467a-a21c-426f25b23867 admin admin] PATH_INFO: `/v3/projects/4a319a2ac64645518e88b0d0cd0d2033/users/3b4a1032e596465e8f3b01af0dcfb8a8/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:33.983257 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b23403-741c-467a-a21c-426f25b23867 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a319a2ac64645518e88b0d0cd0d2033, user_id=3b4a1032e596465e8f3b01af0dcfb8a8, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:33.986923 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b23403-741c-467a-a21c-426f25b23867 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:34.001436 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1985/3952] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:51:33 2022] PUT /identity/v3/projects/4a319a2ac64645518e88b0d0cd0d2033/users/3b4a1032e596465e8f3b01af0dcfb8a8/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:34.013728 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec4447-d4c9-42af-8dbd-c27576a4b823 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:34.014138 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec4447-d4c9-42af-8dbd-c27576a4b823 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:34.014490 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec4447-d4c9-42af-8dbd-c27576a4b823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:34.074518 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-fcec4447-d4c9-42af-8dbd-c27576a4b823 None None] MFA Rules not processed for user `3b4a1032e596465e8f3b01af0dcfb8a8`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:51:34.075937 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-fcec4447-d4c9-42af-8dbd-c27576a4b823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:34.191302 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1968/3953] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:51:34 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:51:34.205423 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b23403-741c-467a-a21c-426f25b23867 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:34.222187 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b23403-741c-467a-a21c-426f25b23867 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:34.231608 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099ad38-ab28-4c5a-9c2e-3d199ba7ca87 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4a1032e596465e8f3b01af0dcfb8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a319a2ac64645518e88b0d0cd0d2033', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:34.232542 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099ad38-ab28-4c5a-9c2e-3d199ba7ca87 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:34.233035 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099ad38-ab28-4c5a-9c2e-3d199ba7ca87 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:34.233495 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099ad38-ab28-4c5a-9c2e-3d199ba7ca87 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:34.234363 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099ad38-ab28-4c5a-9c2e-3d199ba7ca87 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:34.237493 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099ad38-ab28-4c5a-9c2e-3d199ba7ca87 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:34.305517 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1986/3954] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:51:34 2022] POST /identity/v3/projects => generated 351 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:51:34.309855 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec4447-d4c9-42af-8dbd-c27576a4b823 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:34.331306 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec4447-d4c9-42af-8dbd-c27576a4b823 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:34.407912 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:34.435791 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c5fc9-96a9-43f1-a986-ec93ea3d5d26 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4a1032e596465e8f3b01af0dcfb8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a319a2ac64645518e88b0d0cd0d2033', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:34.437400 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c5fc9-96a9-43f1-a986-ec93ea3d5d26 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:34.437400 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c5fc9-96a9-43f1-a986-ec93ea3d5d26 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:34.438667 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c5fc9-96a9-43f1-a986-ec93ea3d5d26 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:34.439381 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c5fc9-96a9-43f1-a986-ec93ea3d5d26 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:34.441260 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c5fc9-96a9-43f1-a986-ec93ea3d5d26 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:34.498987 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1969/3955] 10.222.0.83 () {60 vars in 1152 bytes} [Mon Aug 29 15:51:34 2022] POST /identity/v3/projects => generated 349 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:51:34.503417 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099ad38-ab28-4c5a-9c2e-3d199ba7ca87 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:34.523424 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099ad38-ab28-4c5a-9c2e-3d199ba7ca87 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:34.718594 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e954df-5224-4a70-9667-159814d53f43 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4a1032e596465e8f3b01af0dcfb8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a319a2ac64645518e88b0d0cd0d2033', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:34.719871 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e954df-5224-4a70-9667-159814d53f43 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:34.720308 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e954df-5224-4a70-9667-159814d53f43 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:34.720763 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e954df-5224-4a70-9667-159814d53f43 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] PATH_INFO: `/v3/users/2c2a2dc0b1b646d2ba8c4b1e65e75e67` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:34.722636 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e954df-5224-4a70-9667-159814d53f43 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] RBAC: Authorizing `identity:get_user(user_id=2c2a2dc0b1b646d2ba8c4b1e65e75e67)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:34.725667 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e954df-5224-4a70-9667-159814d53f43 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:34.728523 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1987/3956] 10.222.0.83 () {58 vars in 1221 bytes} [Mon Aug 29 15:51:34 2022] GET /identity/v3/users/2c2a2dc0b1b646d2ba8c4b1e65e75e67 => generated 288 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:51:34.733939 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c5fc9-96a9-43f1-a986-ec93ea3d5d26 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:34.754029 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c5fc9-96a9-43f1-a986-ec93ea3d5d26 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:34.761036 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628500e-eba3-419a-acbe-82da988191ea tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4a1032e596465e8f3b01af0dcfb8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a319a2ac64645518e88b0d0cd0d2033', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:34.761686 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628500e-eba3-419a-acbe-82da988191ea tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:34.761965 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628500e-eba3-419a-acbe-82da988191ea tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:34.762288 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628500e-eba3-419a-acbe-82da988191ea tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:34.763041 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6628500e-eba3-419a-acbe-82da988191ea tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:34.765141 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6628500e-eba3-419a-acbe-82da988191ea tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:34.812006 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1970/3957] 10.222.0.83 () {60 vars in 1162 bytes} [Mon Aug 29 15:51:34 2022] POST /identity/v3/credentials => generated 430 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:51:34.816396 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e954df-5224-4a70-9667-159814d53f43 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:34.825154 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:34.832518 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e954df-5224-4a70-9667-159814d53f43 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:34.851864 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e7fac-c58c-4e46-b39c-516a6f2ce08b tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4a1032e596465e8f3b01af0dcfb8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a319a2ac64645518e88b0d0cd0d2033', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:34.853043 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e7fac-c58c-4e46-b39c-516a6f2ce08b tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:34.853336 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e7fac-c58c-4e46-b39c-516a6f2ce08b tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:34.853699 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e7fac-c58c-4e46-b39c-516a6f2ce08b tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] PATH_INFO: `/v3/credentials/fd61da89227cef8d95c6fe3e2a346f607db2ad7ffe68459d61e969370331e18d` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:34.867004 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e7fac-c58c-4e46-b39c-516a6f2ce08b tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=fd61da89227cef8d95c6fe3e2a346f607db2ad7ffe68459d61e969370331e18d)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:34.872702 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e7fac-c58c-4e46-b39c-516a6f2ce08b tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:34.882391 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e7fac-c58c-4e46-b39c-516a6f2ce08b tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=fd61da89227cef8d95c6fe3e2a346f607db2ad7ffe68459d61e969370331e18d)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:34.885093 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e7fac-c58c-4e46-b39c-516a6f2ce08b tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:34.926846 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1988/3958] 10.222.0.83 () {60 vars in 1358 bytes} [Mon Aug 29 15:51:34 2022] PATCH /identity/v3/credentials/fd61da89227cef8d95c6fe3e2a346f607db2ad7ffe68459d61e969370331e18d => generated 436 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:51:34.934962 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628500e-eba3-419a-acbe-82da988191ea tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:34.950034 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628500e-eba3-419a-acbe-82da988191ea tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:34.973860 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff220b5-841e-4618-bcc7-54b0069c475b tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4a1032e596465e8f3b01af0dcfb8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a319a2ac64645518e88b0d0cd0d2033', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:34.974713 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff220b5-841e-4618-bcc7-54b0069c475b tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:34.975171 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff220b5-841e-4618-bcc7-54b0069c475b tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:34.975554 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff220b5-841e-4618-bcc7-54b0069c475b tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] PATH_INFO: `/v3/credentials/fd61da89227cef8d95c6fe3e2a346f607db2ad7ffe68459d61e969370331e18d` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:34.979661 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff220b5-841e-4618-bcc7-54b0069c475b tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=fd61da89227cef8d95c6fe3e2a346f607db2ad7ffe68459d61e969370331e18d)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:34.983114 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff220b5-841e-4618-bcc7-54b0069c475b tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:34.995436 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1971/3959] 10.222.0.83 () {58 vars in 1335 bytes} [Mon Aug 29 15:51:34 2022] GET /identity/v3/credentials/fd61da89227cef8d95c6fe3e2a346f607db2ad7ffe68459d61e969370331e18d => generated 436 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:51:34.996694 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e7fac-c58c-4e46-b39c-516a6f2ce08b tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:35.015549 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e7fac-c58c-4e46-b39c-516a6f2ce08b tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:35.022201 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70d7df-bbff-418f-a028-16003d29c7b2 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4a1032e596465e8f3b01af0dcfb8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a319a2ac64645518e88b0d0cd0d2033', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:35.023156 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70d7df-bbff-418f-a028-16003d29c7b2 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:35.023448 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70d7df-bbff-418f-a028-16003d29c7b2 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:35.023903 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70d7df-bbff-418f-a028-16003d29c7b2 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] PATH_INFO: `/v3/credentials/fd61da89227cef8d95c6fe3e2a346f607db2ad7ffe68459d61e969370331e18d` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:35.030590 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a70d7df-bbff-418f-a028-16003d29c7b2 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=fd61da89227cef8d95c6fe3e2a346f607db2ad7ffe68459d61e969370331e18d)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:35.032551 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a70d7df-bbff-418f-a028-16003d29c7b2 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:35.079121 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1989/3960] 10.222.0.83 () {58 vars in 1338 bytes} [Mon Aug 29 15:51:34 2022] DELETE /identity/v3/credentials/fd61da89227cef8d95c6fe3e2a346f607db2ad7ffe68459d61e969370331e18d => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:35.166351 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff220b5-841e-4618-bcc7-54b0069c475b tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:35.178464 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff220b5-841e-4618-bcc7-54b0069c475b tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:35.186656 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732528d-d7ad-42ec-857c-6f24c8672642 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4a1032e596465e8f3b01af0dcfb8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a319a2ac64645518e88b0d0cd0d2033', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:35.187673 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732528d-d7ad-42ec-857c-6f24c8672642 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:35.188258 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732528d-d7ad-42ec-857c-6f24c8672642 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:35.189346 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732528d-d7ad-42ec-857c-6f24c8672642 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:35.190256 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e732528d-d7ad-42ec-857c-6f24c8672642 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:35.192301 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e732528d-d7ad-42ec-857c-6f24c8672642 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:35.264239 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70d7df-bbff-418f-a028-16003d29c7b2 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:35.270235 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1972/3961] 10.222.0.83 () {60 vars in 1162 bytes} [Mon Aug 29 15:51:35 2022] POST /identity/v3/credentials => generated 430 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:51:35.281732 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70d7df-bbff-418f-a028-16003d29c7b2 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:35.287107 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e90c4-1396-4fa2-99d8-1cf8e0792939 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4a1032e596465e8f3b01af0dcfb8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a319a2ac64645518e88b0d0cd0d2033', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:35.287833 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e90c4-1396-4fa2-99d8-1cf8e0792939 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:35.288181 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e90c4-1396-4fa2-99d8-1cf8e0792939 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:35.288510 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e90c4-1396-4fa2-99d8-1cf8e0792939 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:35.290721 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e90c4-1396-4fa2-99d8-1cf8e0792939 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:35.292551 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e90c4-1396-4fa2-99d8-1cf8e0792939 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:35.330348 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1990/3962] 10.222.0.83 () {60 vars in 1162 bytes} [Mon Aug 29 15:51:35 2022] POST /identity/v3/credentials => generated 429 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:51:35.334655 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732528d-d7ad-42ec-857c-6f24c8672642 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:35.354315 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732528d-d7ad-42ec-857c-6f24c8672642 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:35.366292 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dbee6a-0793-448c-a486-a122faac9980 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4a1032e596465e8f3b01af0dcfb8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a319a2ac64645518e88b0d0cd0d2033', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:35.366992 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbee6a-0793-448c-a486-a122faac9980 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:35.368048 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbee6a-0793-448c-a486-a122faac9980 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:35.368546 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbee6a-0793-448c-a486-a122faac9980 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:35.369455 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dbee6a-0793-448c-a486-a122faac9980 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:35.371241 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dbee6a-0793-448c-a486-a122faac9980 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:35.406728 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dbee6a-0793-448c-a486-a122faac9980 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:35.408572 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dbee6a-0793-448c-a486-a122faac9980 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:35.413022 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dbee6a-0793-448c-a486-a122faac9980 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:35.415496 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dbee6a-0793-448c-a486-a122faac9980 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:35.419272 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1973/3963] 10.222.0.83 () {58 vars in 1140 bytes} [Mon Aug 29 15:51:35 2022] GET /identity/v3/credentials => generated 944 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:51:35.423569 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e90c4-1396-4fa2-99d8-1cf8e0792939 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:35.444514 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e90c4-1396-4fa2-99d8-1cf8e0792939 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:35.449964 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830ef5e-4211-42bd-876c-bfa0d1b0b8ed tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4a1032e596465e8f3b01af0dcfb8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a319a2ac64645518e88b0d0cd0d2033', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:35.450899 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830ef5e-4211-42bd-876c-bfa0d1b0b8ed tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:35.451397 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830ef5e-4211-42bd-876c-bfa0d1b0b8ed tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:35.460034 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830ef5e-4211-42bd-876c-bfa0d1b0b8ed tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] PATH_INFO: `/v3/credentials/ddc5ca6b2fb888357ad690555295982daf7e6aaf95cbb9a0aabc6e4970032aa7` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:35.463142 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e830ef5e-4211-42bd-876c-bfa0d1b0b8ed tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=ddc5ca6b2fb888357ad690555295982daf7e6aaf95cbb9a0aabc6e4970032aa7)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:35.465559 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e830ef5e-4211-42bd-876c-bfa0d1b0b8ed tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:35.486461 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1991/3964] 10.222.0.83 () {58 vars in 1338 bytes} [Mon Aug 29 15:51:35 2022] DELETE /identity/v3/credentials/ddc5ca6b2fb888357ad690555295982daf7e6aaf95cbb9a0aabc6e4970032aa7 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:35.494665 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dbee6a-0793-448c-a486-a122faac9980 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:35.515748 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dbee6a-0793-448c-a486-a122faac9980 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:35.526331 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76164c5a-a971-4d8e-90e0-b062bdaf0590 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4a1032e596465e8f3b01af0dcfb8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a319a2ac64645518e88b0d0cd0d2033', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:35.527002 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76164c5a-a971-4d8e-90e0-b062bdaf0590 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:35.529356 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76164c5a-a971-4d8e-90e0-b062bdaf0590 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:35.529623 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76164c5a-a971-4d8e-90e0-b062bdaf0590 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] PATH_INFO: `/v3/credentials/7f5c5396c474fa77f9f68efc50a393b7a98fcc5a03ff185efde4d58187af07b8` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:35.536283 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76164c5a-a971-4d8e-90e0-b062bdaf0590 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=7f5c5396c474fa77f9f68efc50a393b7a98fcc5a03ff185efde4d58187af07b8)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:35.541031 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76164c5a-a971-4d8e-90e0-b062bdaf0590 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:35.574772 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1974/3965] 10.222.0.83 () {58 vars in 1338 bytes} [Mon Aug 29 15:51:35 2022] DELETE /identity/v3/credentials/7f5c5396c474fa77f9f68efc50a393b7a98fcc5a03ff185efde4d58187af07b8 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:35.576663 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830ef5e-4211-42bd-876c-bfa0d1b0b8ed tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:35.606473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830ef5e-4211-42bd-876c-bfa0d1b0b8ed tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:35.624527 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c8f9b-3953-4c45-83f8-f3abcb157a9c tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4a1032e596465e8f3b01af0dcfb8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a319a2ac64645518e88b0d0cd0d2033', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:35.626629 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c8f9b-3953-4c45-83f8-f3abcb157a9c tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:35.626983 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c8f9b-3953-4c45-83f8-f3abcb157a9c tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:35.627315 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c8f9b-3953-4c45-83f8-f3abcb157a9c tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] PATH_INFO: `/v3/projects/6a2c1994b5e84ab98db8cdf799047c74` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:35.628577 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c8f9b-3953-4c45-83f8-f3abcb157a9c tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6a2c1994b5e84ab98db8cdf799047c74)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:35.637055 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c8f9b-3953-4c45-83f8-f3abcb157a9c tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:35.783545 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6d5c8f9b-3953-4c45-83f8-f3abcb157a9c tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a2c1994b5e84ab98db8cdf799047c74', 'request_id': 'req-6d5c8f9b-3953-4c45-83f8-f3abcb157a9c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:35.794220 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6d5c8f9b-3953-4c45-83f8-f3abcb157a9c tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a2c1994b5e84ab98db8cdf799047c74', 'request_id': 'req-6d5c8f9b-3953-4c45-83f8-f3abcb157a9c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:35.828123 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6d5c8f9b-3953-4c45-83f8-f3abcb157a9c tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a2c1994b5e84ab98db8cdf799047c74', 'request_id': 'req-6d5c8f9b-3953-4c45-83f8-f3abcb157a9c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:35.863160 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6d5c8f9b-3953-4c45-83f8-f3abcb157a9c tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] The token cache is being invalidate because project 6a2c1994b5e84ab98db8cdf799047c74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:51:35.863775 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6d5c8f9b-3953-4c45-83f8-f3abcb157a9c tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:35.865760 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6d5c8f9b-3953-4c45-83f8-f3abcb157a9c tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:35.869799 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1992/3966] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:51:35 2022] DELETE /identity/v3/projects/6a2c1994b5e84ab98db8cdf799047c74 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:35.875232 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76164c5a-a971-4d8e-90e0-b062bdaf0590 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:35.877780 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-76164c5a-a971-4d8e-90e0-b062bdaf0590 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:35.905016 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76164c5a-a971-4d8e-90e0-b062bdaf0590 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:36.044644 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9d514-4bea-40c1-8003-dccbb6130b82 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4a1032e596465e8f3b01af0dcfb8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a319a2ac64645518e88b0d0cd0d2033', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:36.045316 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9d514-4bea-40c1-8003-dccbb6130b82 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:36.045603 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9d514-4bea-40c1-8003-dccbb6130b82 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:36.045911 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9d514-4bea-40c1-8003-dccbb6130b82 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] PATH_INFO: `/v3/projects/688481142c0b4f55a1d55a30d7e80062` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:36.047664 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a9d514-4bea-40c1-8003-dccbb6130b82 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] RBAC: Authorizing `identity:delete_project(project_id=688481142c0b4f55a1d55a30d7e80062)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:36.049733 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a9d514-4bea-40c1-8003-dccbb6130b82 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:36.174014 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-65a9d514-4bea-40c1-8003-dccbb6130b82 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '688481142c0b4f55a1d55a30d7e80062', 'request_id': 'req-65a9d514-4bea-40c1-8003-dccbb6130b82'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:36.188377 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-65a9d514-4bea-40c1-8003-dccbb6130b82 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '688481142c0b4f55a1d55a30d7e80062', 'request_id': 'req-65a9d514-4bea-40c1-8003-dccbb6130b82'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:36.201689 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-65a9d514-4bea-40c1-8003-dccbb6130b82 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '688481142c0b4f55a1d55a30d7e80062', 'request_id': 'req-65a9d514-4bea-40c1-8003-dccbb6130b82'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:36.232132 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-65a9d514-4bea-40c1-8003-dccbb6130b82 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] The token cache is being invalidate because project 688481142c0b4f55a1d55a30d7e80062 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:51:36.232646 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-65a9d514-4bea-40c1-8003-dccbb6130b82 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:36.235298 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-65a9d514-4bea-40c1-8003-dccbb6130b82 tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:36.238003 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1975/3967] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:51:35 2022] DELETE /identity/v3/projects/688481142c0b4f55a1d55a30d7e80062 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:36.242102 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c8f9b-3953-4c45-83f8-f3abcb157a9c tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:36.247133 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6d5c8f9b-3953-4c45-83f8-f3abcb157a9c tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:36.389940 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c8f9b-3953-4c45-83f8-f3abcb157a9c tempest-CredentialsTestJSON-1510402123 tempest-CredentialsTestJSON-1510402123-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:36.434633 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=88,keystone:UPDATE=1,keystone:DELETE=9,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:36.485411 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9757626-2afc-4722-abd1-755577d2b27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:36.486176 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9757626-2afc-4722-abd1-755577d2b27a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:36.486640 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9757626-2afc-4722-abd1-755577d2b27a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:36.487003 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9757626-2afc-4722-abd1-755577d2b27a admin admin] PATH_INFO: `/v3/users/2c2a2dc0b1b646d2ba8c4b1e65e75e67` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:36.488358 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9757626-2afc-4722-abd1-755577d2b27a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c2a2dc0b1b646d2ba8c4b1e65e75e67)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:36.495582 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9757626-2afc-4722-abd1-755577d2b27a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:36.625108 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e9757626-2afc-4722-abd1-755577d2b27a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c2a2dc0b1b646d2ba8c4b1e65e75e67'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:36.626316 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e9757626-2afc-4722-abd1-755577d2b27a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c2a2dc0b1b646d2ba8c4b1e65e75e67'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:36.658493 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e9757626-2afc-4722-abd1-755577d2b27a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c2a2dc0b1b646d2ba8c4b1e65e75e67'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:36.671349 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e9757626-2afc-4722-abd1-755577d2b27a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c2a2dc0b1b646d2ba8c4b1e65e75e67'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:36.686964 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e9757626-2afc-4722-abd1-755577d2b27a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c2a2dc0b1b646d2ba8c4b1e65e75e67'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:36.702190 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1993/3968] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:51:36 2022] DELETE /identity/v3/users/2c2a2dc0b1b646d2ba8c4b1e65e75e67 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:36.703830 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c1a7f-e520-4dad-ae2c-0c3d90d9e139 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:36.704123 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c1a7f-e520-4dad-ae2c-0c3d90d9e139 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:36.704400 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c1a7f-e520-4dad-ae2c-0c3d90d9e139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:36.734207 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:36.762211 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-9d1c1a7f-e520-4dad-ae2c-0c3d90d9e139 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:51:36.769046 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9d1c1a7f-e520-4dad-ae2c-0c3d90d9e139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:36.911539 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1976/3969] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:51:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:51:36.970614 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9757626-2afc-4722-abd1-755577d2b27a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:36.975130 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e9757626-2afc-4722-abd1-755577d2b27a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:37.108241 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9757626-2afc-4722-abd1-755577d2b27a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:37.119523 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd128c9-2bec-4406-82d7-bdac266808e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:37.120307 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd128c9-2bec-4406-82d7-bdac266808e7 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:37.120591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd128c9-2bec-4406-82d7-bdac266808e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:37.120865 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd128c9-2bec-4406-82d7-bdac266808e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:37.141882 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd128c9-2bec-4406-82d7-bdac266808e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:37.144969 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd128c9-2bec-4406-82d7-bdac266808e7 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:37.173290 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1994/3970] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:51:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:51:38.397553 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c1a7f-e520-4dad-ae2c-0c3d90d9e139 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:38.400939 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9d1c1a7f-e520-4dad-ae2c-0c3d90d9e139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:38.433804 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c1a7f-e520-4dad-ae2c-0c3d90d9e139 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:38.455729 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61715d-9b47-4629-93cf-babcea33c321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:38.455990 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61715d-9b47-4629-93cf-babcea33c321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:38.456437 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61715d-9b47-4629-93cf-babcea33c321 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:38.457142 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61715d-9b47-4629-93cf-babcea33c321 admin admin] PATH_INFO: `/v3/projects/9974e4419b6242cfadd528ffb86581d3` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:38.462244 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba61715d-9b47-4629-93cf-babcea33c321 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9974e4419b6242cfadd528ffb86581d3)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:38.464705 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba61715d-9b47-4629-93cf-babcea33c321 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:38.584284 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ba61715d-9b47-4629-93cf-babcea33c321 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9974e4419b6242cfadd528ffb86581d3', 'request_id': 'req-ba61715d-9b47-4629-93cf-babcea33c321'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:38.602014 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ba61715d-9b47-4629-93cf-babcea33c321 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9974e4419b6242cfadd528ffb86581d3', 'request_id': 'req-ba61715d-9b47-4629-93cf-babcea33c321'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:38.609338 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ba61715d-9b47-4629-93cf-babcea33c321 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9974e4419b6242cfadd528ffb86581d3', 'request_id': 'req-ba61715d-9b47-4629-93cf-babcea33c321'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:38.631890 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ba61715d-9b47-4629-93cf-babcea33c321 admin admin] The token cache is being invalidate because project 9974e4419b6242cfadd528ffb86581d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:51:38.632407 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ba61715d-9b47-4629-93cf-babcea33c321 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:38.640697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ba61715d-9b47-4629-93cf-babcea33c321 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:38.642762 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1977/3971] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:51:38 2022] DELETE /identity/v3/projects/9974e4419b6242cfadd528ffb86581d3 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:38.647115 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd128c9-2bec-4406-82d7-bdac266808e7 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:38.661302 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd128c9-2bec-4406-82d7-bdac266808e7 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:38.841692 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942aade-f293-477a-a58c-d60b28e21d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:38.842360 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942aade-f293-477a-a58c-d60b28e21d8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:38.842638 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942aade-f293-477a-a58c-d60b28e21d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:38.842910 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942aade-f293-477a-a58c-d60b28e21d8e admin admin] PATH_INFO: `/v3/users/3b4a1032e596465e8f3b01af0dcfb8a8` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:38.844353 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9942aade-f293-477a-a58c-d60b28e21d8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b4a1032e596465e8f3b01af0dcfb8a8)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:38.847308 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9942aade-f293-477a-a58c-d60b28e21d8e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:38.849350 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:38.983491 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9942aade-f293-477a-a58c-d60b28e21d8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b4a1032e596465e8f3b01af0dcfb8a8'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:38.984491 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9942aade-f293-477a-a58c-d60b28e21d8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b4a1032e596465e8f3b01af0dcfb8a8'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:39.000395 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9942aade-f293-477a-a58c-d60b28e21d8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b4a1032e596465e8f3b01af0dcfb8a8'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:39.016802 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9942aade-f293-477a-a58c-d60b28e21d8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b4a1032e596465e8f3b01af0dcfb8a8'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:39.033332 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9942aade-f293-477a-a58c-d60b28e21d8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b4a1032e596465e8f3b01af0dcfb8a8'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:39.052652 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1995/3972] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:51:38 2022] DELETE /identity/v3/users/3b4a1032e596465e8f3b01af0dcfb8a8 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:39.660347 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61715d-9b47-4629-93cf-babcea33c321 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:39.661834 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ba61715d-9b47-4629-93cf-babcea33c321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:39.690466 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61715d-9b47-4629-93cf-babcea33c321 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:39.774708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab753ca7-68e4-4aa0-9521-2630e53d26e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:39.775010 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab753ca7-68e4-4aa0-9521-2630e53d26e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:39.775306 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab753ca7-68e4-4aa0-9521-2630e53d26e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:39.775874 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab753ca7-68e4-4aa0-9521-2630e53d26e0 admin admin] PATH_INFO: `/v3/projects/4a319a2ac64645518e88b0d0cd0d2033` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:39.777882 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab753ca7-68e4-4aa0-9521-2630e53d26e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a319a2ac64645518e88b0d0cd0d2033)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:39.780471 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab753ca7-68e4-4aa0-9521-2630e53d26e0 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:39.826725 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:39.845826 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ab753ca7-68e4-4aa0-9521-2630e53d26e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a319a2ac64645518e88b0d0cd0d2033', 'request_id': 'req-ab753ca7-68e4-4aa0-9521-2630e53d26e0'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:39.854004 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ab753ca7-68e4-4aa0-9521-2630e53d26e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a319a2ac64645518e88b0d0cd0d2033', 'request_id': 'req-ab753ca7-68e4-4aa0-9521-2630e53d26e0'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:39.864479 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ab753ca7-68e4-4aa0-9521-2630e53d26e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a319a2ac64645518e88b0d0cd0d2033', 'request_id': 'req-ab753ca7-68e4-4aa0-9521-2630e53d26e0'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:39.909987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ab753ca7-68e4-4aa0-9521-2630e53d26e0 admin admin] The token cache is being invalidate because project 4a319a2ac64645518e88b0d0cd0d2033 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:51:39.910209 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ab753ca7-68e4-4aa0-9521-2630e53d26e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:39.911221 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ab753ca7-68e4-4aa0-9521-2630e53d26e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:39.913629 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1978/3973] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:51:39 2022] DELETE /identity/v3/projects/4a319a2ac64645518e88b0d0cd0d2033 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:39.920208 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ecc388-8c3b-49b3-8825-18d25d14c254 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:39.920758 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ecc388-8c3b-49b3-8825-18d25d14c254 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:39.921380 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ecc388-8c3b-49b3-8825-18d25d14c254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:39.991297 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-50ecc388-8c3b-49b3-8825-18d25d14c254 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:51:39.993170 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-50ecc388-8c3b-49b3-8825-18d25d14c254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:40.135974 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1996/3974] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:51:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:51:40.144758 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ef8ef-aede-4688-be65-37b4016d1ff3 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:40.145087 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ef8ef-aede-4688-be65-37b4016d1ff3 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:40.145395 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ef8ef-aede-4688-be65-37b4016d1ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:40.228451 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-2f3ef8ef-aede-4688-be65-37b4016d1ff3 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:51:40.238165 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2f3ef8ef-aede-4688-be65-37b4016d1ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:40.291765 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1979/3975] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:51:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:51:40.292988 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ecc388-8c3b-49b3-8825-18d25d14c254 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:40.311952 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ecc388-8c3b-49b3-8825-18d25d14c254 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:40.349724 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b6900-3b8e-4b1f-bdce-9da5034283a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:40.350442 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b6900-3b8e-4b1f-bdce-9da5034283a0 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:40.350794 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b6900-3b8e-4b1f-bdce-9da5034283a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:40.351216 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b6900-3b8e-4b1f-bdce-9da5034283a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:40.352868 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b6900-3b8e-4b1f-bdce-9da5034283a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:51:40.353331 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b6900-3b8e-4b1f-bdce-9da5034283a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:40.356450 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b6900-3b8e-4b1f-bdce-9da5034283a0 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:40.387349 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1997/3976] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:51:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:51:40.394169 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ef8ef-aede-4688-be65-37b4016d1ff3 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:40.411226 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ef8ef-aede-4688-be65-37b4016d1ff3 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:40.420196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9138f-705d-4c2d-a13c-b1fbca4217f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:40.420972 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9138f-705d-4c2d-a13c-b1fbca4217f0 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:40.421306 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9138f-705d-4c2d-a13c-b1fbca4217f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:40.421645 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9138f-705d-4c2d-a13c-b1fbca4217f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:40.422364 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f9138f-705d-4c2d-a13c-b1fbca4217f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:40.424884 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f9138f-705d-4c2d-a13c-b1fbca4217f0 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:40.485671 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1980/3977] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:51:40 2022] POST /identity/v3/projects => generated 369 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:51:40.490154 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b6900-3b8e-4b1f-bdce-9da5034283a0 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:40.506017 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b6900-3b8e-4b1f-bdce-9da5034283a0 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:40.601480 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b66138-5e1b-4f45-a6eb-d438e2758d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:40.603422 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b66138-5e1b-4f45-a6eb-d438e2758d87 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:40.603729 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b66138-5e1b-4f45-a6eb-d438e2758d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:40.604086 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b66138-5e1b-4f45-a6eb-d438e2758d87 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:40.605401 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b66138-5e1b-4f45-a6eb-d438e2758d87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:40.608475 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b66138-5e1b-4f45-a6eb-d438e2758d87 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:40.621649 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:40.639598 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1998/3978] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:51:40 2022] POST /identity/v3/users => generated 285 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:51:40.641928 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9138f-705d-4c2d-a13c-b1fbca4217f0 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:40.655845 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9138f-705d-4c2d-a13c-b1fbca4217f0 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:40.660549 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a0927-64d0-4aa1-b2ba-ce3e4ab600c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:40.661302 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a0927-64d0-4aa1-b2ba-ce3e4ab600c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:40.661597 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a0927-64d0-4aa1-b2ba-ce3e4ab600c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:40.661945 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a0927-64d0-4aa1-b2ba-ce3e4ab600c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:40.662684 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a0927-64d0-4aa1-b2ba-ce3e4ab600c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:40.665114 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a0927-64d0-4aa1-b2ba-ce3e4ab600c4 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:40.682657 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1981/3979] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:51:40.684506 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b66138-5e1b-4f45-a6eb-d438e2758d87 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:40.697570 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b66138-5e1b-4f45-a6eb-d438e2758d87 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:40.708850 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e56402-0a9e-4a98-882b-3e35b04c3422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:40.709729 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e56402-0a9e-4a98-882b-3e35b04c3422 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:40.710219 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e56402-0a9e-4a98-882b-3e35b04c3422 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:40.710681 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e56402-0a9e-4a98-882b-3e35b04c3422 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:40.712369 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e56402-0a9e-4a98-882b-3e35b04c3422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:40.714403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e56402-0a9e-4a98-882b-3e35b04c3422 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:40.729941 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 1999/3980] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:51:40.734471 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a0927-64d0-4aa1-b2ba-ce3e4ab600c4 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:40.748926 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a0927-64d0-4aa1-b2ba-ce3e4ab600c4 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:40.755740 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065d0d4-3c16-4168-a25d-c5d9e6cf888f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:40.756436 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065d0d4-3c16-4168-a25d-c5d9e6cf888f admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:40.756715 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065d0d4-3c16-4168-a25d-c5d9e6cf888f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:40.756989 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065d0d4-3c16-4168-a25d-c5d9e6cf888f admin admin] PATH_INFO: `/v3/projects/a8df8cbaa7e54c698344025315932b8a/users/cdfed391809343df825a52bf9abc92bb/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:40.781046 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1065d0d4-3c16-4168-a25d-c5d9e6cf888f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8df8cbaa7e54c698344025315932b8a, user_id=cdfed391809343df825a52bf9abc92bb, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:40.784524 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1065d0d4-3c16-4168-a25d-c5d9e6cf888f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:40.817322 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1982/3981] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:51:40 2022] PUT /identity/v3/projects/a8df8cbaa7e54c698344025315932b8a/users/cdfed391809343df825a52bf9abc92bb/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:40.827681 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b426e25-ceba-4fdb-a8fa-1268498f2c28 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:40.827970 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b426e25-ceba-4fdb-a8fa-1268498f2c28 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:40.828244 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b426e25-ceba-4fdb-a8fa-1268498f2c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:40.875844 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-0b426e25-ceba-4fdb-a8fa-1268498f2c28 None None] MFA Rules not processed for user `cdfed391809343df825a52bf9abc92bb`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:51:40.877154 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0b426e25-ceba-4fdb-a8fa-1268498f2c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:40.961928 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2000/3982] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:51:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:51:40.966943 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065d0d4-3c16-4168-a25d-c5d9e6cf888f admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:41.057988 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065d0d4-3c16-4168-a25d-c5d9e6cf888f admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:41.065592 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab7bad1-1ca1-4803-bbb3-2479b4a12da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:41.066923 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7bad1-1ca1-4803-bbb3-2479b4a12da6 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:41.067543 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7bad1-1ca1-4803-bbb3-2479b4a12da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:41.068004 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7bad1-1ca1-4803-bbb3-2479b4a12da6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:41.069517 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab7bad1-1ca1-4803-bbb3-2479b4a12da6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:41.072510 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab7bad1-1ca1-4803-bbb3-2479b4a12da6 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:41.124501 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1983/3983] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:51:40 2022] POST /identity/v3/projects => generated 367 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:51:41.129602 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b426e25-ceba-4fdb-a8fa-1268498f2c28 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:41.148439 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b426e25-ceba-4fdb-a8fa-1268498f2c28 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:41.237130 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb63e02-e398-42de-a8f0-96111a17cef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:41.237935 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb63e02-e398-42de-a8f0-96111a17cef2 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:41.238216 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb63e02-e398-42de-a8f0-96111a17cef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:41.238799 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb63e02-e398-42de-a8f0-96111a17cef2 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:41.239477 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb63e02-e398-42de-a8f0-96111a17cef2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:41.241430 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb63e02-e398-42de-a8f0-96111a17cef2 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:41.284663 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2001/3984] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:51:41 2022] POST /identity/v3/users => generated 290 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:51:41.288144 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab7bad1-1ca1-4803-bbb3-2479b4a12da6 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:41.313746 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab7bad1-1ca1-4803-bbb3-2479b4a12da6 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:41.328338 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a565e0-29b0-4800-a417-d6d7bb5da9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:41.329032 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a565e0-29b0-4800-a417-d6d7bb5da9c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:41.329451 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a565e0-29b0-4800-a417-d6d7bb5da9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:41.329788 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a565e0-29b0-4800-a417-d6d7bb5da9c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:41.330567 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a565e0-29b0-4800-a417-d6d7bb5da9c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:41.332721 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a565e0-29b0-4800-a417-d6d7bb5da9c8 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:41.350621 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1984/3985] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:51:41.354967 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb63e02-e398-42de-a8f0-96111a17cef2 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:41.370459 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb63e02-e398-42de-a8f0-96111a17cef2 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:41.391890 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ecb54-484a-467e-ba8e-7c900979afff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:41.392958 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ecb54-484a-467e-ba8e-7c900979afff admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:41.393491 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ecb54-484a-467e-ba8e-7c900979afff admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:41.393902 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ecb54-484a-467e-ba8e-7c900979afff admin admin] PATH_INFO: `/v3/projects/37dafc5b2ed84ab0a6ed62152e8ff799/users/2b57b7bc454f4a938c358c9a063d4beb/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:41.417663 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ecb54-484a-467e-ba8e-7c900979afff admin admin] RBAC: Authorizing `identity:create_grant(project_id=37dafc5b2ed84ab0a6ed62152e8ff799, user_id=2b57b7bc454f4a938c358c9a063d4beb, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:41.421954 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ecb54-484a-467e-ba8e-7c900979afff admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:41.452580 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2002/3986] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:51:41 2022] PUT /identity/v3/projects/37dafc5b2ed84ab0a6ed62152e8ff799/users/2b57b7bc454f4a938c358c9a063d4beb/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:41.458614 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a565e0-29b0-4800-a417-d6d7bb5da9c8 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:41.501832 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a565e0-29b0-4800-a417-d6d7bb5da9c8 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:41.590587 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:41.657179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe9bce3-d656-4bb5-b868-8514143bc971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:41.660212 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9bce3-d656-4bb5-b868-8514143bc971 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:41.660774 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9bce3-d656-4bb5-b868-8514143bc971 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:41.661764 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9bce3-d656-4bb5-b868-8514143bc971 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:41.662744 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe9bce3-d656-4bb5-b868-8514143bc971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:41.665492 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe9bce3-d656-4bb5-b868-8514143bc971 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:41.678648 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1985/3987] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:51:41.684165 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ecb54-484a-467e-ba8e-7c900979afff admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:41.700706 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ecb54-484a-467e-ba8e-7c900979afff admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:41.714401 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b751b7-677d-4cc6-8d28-b9c93e1eea74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:41.715240 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b751b7-677d-4cc6-8d28-b9c93e1eea74 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:41.715582 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b751b7-677d-4cc6-8d28-b9c93e1eea74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:41.715931 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b751b7-677d-4cc6-8d28-b9c93e1eea74 admin admin] PATH_INFO: `/v3/projects/37dafc5b2ed84ab0a6ed62152e8ff799/users/2b57b7bc454f4a938c358c9a063d4beb/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:41.723864 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b751b7-677d-4cc6-8d28-b9c93e1eea74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37dafc5b2ed84ab0a6ed62152e8ff799, user_id=2b57b7bc454f4a938c358c9a063d4beb, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:41.731946 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b751b7-677d-4cc6-8d28-b9c93e1eea74 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:41.758816 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2003/3988] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:51:41 2022] PUT /identity/v3/projects/37dafc5b2ed84ab0a6ed62152e8ff799/users/2b57b7bc454f4a938c358c9a063d4beb/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:41.775692 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380f967-1ba9-4532-ae3b-03c8bc8c5662 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:41.776283 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380f967-1ba9-4532-ae3b-03c8bc8c5662 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:41.776659 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380f967-1ba9-4532-ae3b-03c8bc8c5662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:41.859739 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-9380f967-1ba9-4532-ae3b-03c8bc8c5662 None None] MFA Rules not processed for user `2b57b7bc454f4a938c358c9a063d4beb`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:51:41.860996 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9380f967-1ba9-4532-ae3b-03c8bc8c5662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:42.008233 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1986/3989] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:51:41 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:51:42.012771 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b751b7-677d-4cc6-8d28-b9c93e1eea74 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:42.026843 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b751b7-677d-4cc6-8d28-b9c93e1eea74 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:42.032235 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9448d6-eff9-4ac5-b1fa-738a4fdd988f tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b57b7bc454f4a938c358c9a063d4beb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dafc5b2ed84ab0a6ed62152e8ff799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:42.033224 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9448d6-eff9-4ac5-b1fa-738a4fdd988f tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:42.033678 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9448d6-eff9-4ac5-b1fa-738a4fdd988f tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:42.034104 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9448d6-eff9-4ac5-b1fa-738a4fdd988f tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:42.035099 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9448d6-eff9-4ac5-b1fa-738a4fdd988f tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:42.036534 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-4d9448d6-eff9-4ac5-b1fa-738a4fdd988f tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:51:42.036534 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 15:51:42.036534 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 15:51:42.037843 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9448d6-eff9-4ac5-b1fa-738a4fdd988f tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:42.079230 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2004/3990] 10.222.0.83 () {60 vars in 1149 bytes} [Mon Aug 29 15:51:42 2022] POST /identity/v3/domains => generated 276 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:51:42.080557 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9380f967-1ba9-4532-ae3b-03c8bc8c5662 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:42.094068 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9380f967-1ba9-4532-ae3b-03c8bc8c5662 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:42.199514 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338dd4d4-fc59-4b3d-8634-1aa6344c9c7d tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b57b7bc454f4a938c358c9a063d4beb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dafc5b2ed84ab0a6ed62152e8ff799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:42.200511 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338dd4d4-fc59-4b3d-8634-1aa6344c9c7d tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:42.200982 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338dd4d4-fc59-4b3d-8634-1aa6344c9c7d tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:42.201461 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338dd4d4-fc59-4b3d-8634-1aa6344c9c7d tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] PATH_INFO: `/v3/groups` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:42.203192 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338dd4d4-fc59-4b3d-8634-1aa6344c9c7d tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:42.205095 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-338dd4d4-fc59-4b3d-8634-1aa6344c9c7d tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:51:42.205095 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 15:51:42.205095 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 15:51:42.206848 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338dd4d4-fc59-4b3d-8634-1aa6344c9c7d tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:42.258072 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1987/3991] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:51:42 2022] POST /identity/v3/groups => generated 280 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:51:42.260207 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9448d6-eff9-4ac5-b1fa-738a4fdd988f tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:42.276565 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9448d6-eff9-4ac5-b1fa-738a4fdd988f tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:42.299339 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e4864-c343-4643-9f23-16374128d913 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b57b7bc454f4a938c358c9a063d4beb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dafc5b2ed84ab0a6ed62152e8ff799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:42.300066 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e4864-c343-4643-9f23-16374128d913 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:42.300354 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e4864-c343-4643-9f23-16374128d913 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:42.300627 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e4864-c343-4643-9f23-16374128d913 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] PATH_INFO: `/v3/groups/9b2b06fa7ff4438d8e78d030d2566887` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:42.319636 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11e4864-c343-4643-9f23-16374128d913 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorizing `identity:update_group(group_id=9b2b06fa7ff4438d8e78d030d2566887)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:42.320858 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-a11e4864-c343-4643-9f23-16374128d913 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:51:42.320858 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 15:51:42.320858 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 15:51:42.322214 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11e4864-c343-4643-9f23-16374128d913 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:42.329931 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:42.359381 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2005/3992] 10.222.0.83 () {60 vars in 1247 bytes} [Mon Aug 29 15:51:42 2022] PATCH /identity/v3/groups/9b2b06fa7ff4438d8e78d030d2566887 => generated 293 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:51:42.363774 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338dd4d4-fc59-4b3d-8634-1aa6344c9c7d tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:42.377314 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338dd4d4-fc59-4b3d-8634-1aa6344c9c7d tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:42.383962 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e654dba-a3e9-44c5-8c63-6f25c72b2be7 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b57b7bc454f4a938c358c9a063d4beb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dafc5b2ed84ab0a6ed62152e8ff799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:42.384744 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e654dba-a3e9-44c5-8c63-6f25c72b2be7 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:42.385093 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e654dba-a3e9-44c5-8c63-6f25c72b2be7 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:42.385460 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e654dba-a3e9-44c5-8c63-6f25c72b2be7 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] PATH_INFO: `/v3/groups/9b2b06fa7ff4438d8e78d030d2566887` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:42.396346 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e654dba-a3e9-44c5-8c63-6f25c72b2be7 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorizing `identity:get_group(group_id=9b2b06fa7ff4438d8e78d030d2566887)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:42.397502 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-3e654dba-a3e9-44c5-8c63-6f25c72b2be7 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:51:42.397502 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 15:51:42.397502 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 15:51:42.401428 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e654dba-a3e9-44c5-8c63-6f25c72b2be7 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:42.407753 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1988/3993] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:51:42 2022] GET /identity/v3/groups/9b2b06fa7ff4438d8e78d030d2566887 => generated 293 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:51:42.408865 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e4864-c343-4643-9f23-16374128d913 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:42.425188 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e4864-c343-4643-9f23-16374128d913 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:42.432712 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695178b-bbb6-4866-8036-f8568fb32dc3 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b57b7bc454f4a938c358c9a063d4beb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dafc5b2ed84ab0a6ed62152e8ff799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:42.433753 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695178b-bbb6-4866-8036-f8568fb32dc3 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:42.434255 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695178b-bbb6-4866-8036-f8568fb32dc3 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:42.434823 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695178b-bbb6-4866-8036-f8568fb32dc3 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] PATH_INFO: `/v3/groups/9b2b06fa7ff4438d8e78d030d2566887` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:42.436428 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695178b-bbb6-4866-8036-f8568fb32dc3 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorizing `identity:update_group(group_id=9b2b06fa7ff4438d8e78d030d2566887)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:42.439615 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695178b-bbb6-4866-8036-f8568fb32dc3 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:42.479672 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2006/3994] 10.222.0.83 () {60 vars in 1246 bytes} [Mon Aug 29 15:51:42 2022] PATCH /identity/v3/groups/9b2b06fa7ff4438d8e78d030d2566887 => generated 309 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:51:42.494310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e654dba-a3e9-44c5-8c63-6f25c72b2be7 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:42.505513 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e654dba-a3e9-44c5-8c63-6f25c72b2be7 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:42.512255 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d104c5-6ad9-4cba-9c82-6850c9fea3c4 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b57b7bc454f4a938c358c9a063d4beb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dafc5b2ed84ab0a6ed62152e8ff799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:42.513250 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d104c5-6ad9-4cba-9c82-6850c9fea3c4 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:42.513862 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d104c5-6ad9-4cba-9c82-6850c9fea3c4 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:42.514346 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d104c5-6ad9-4cba-9c82-6850c9fea3c4 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] PATH_INFO: `/v3/groups/9b2b06fa7ff4438d8e78d030d2566887` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:42.522713 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d104c5-6ad9-4cba-9c82-6850c9fea3c4 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorizing `identity:delete_group(group_id=9b2b06fa7ff4438d8e78d030d2566887)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:42.524448 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-11d104c5-6ad9-4cba-9c82-6850c9fea3c4 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:51:42.524448 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 15:51:42.524448 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 15:51:42.526909 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d104c5-6ad9-4cba-9c82-6850c9fea3c4 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:42.573348 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:42.634752 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1989/3995] 10.222.0.83 () {58 vars in 1227 bytes} [Mon Aug 29 15:51:42 2022] DELETE /identity/v3/groups/9b2b06fa7ff4438d8e78d030d2566887 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:51:42.639711 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695178b-bbb6-4866-8036-f8568fb32dc3 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:42.652698 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695178b-bbb6-4866-8036-f8568fb32dc3 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:42.764903 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e211b9-f539-4084-8794-2029e9cec925 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b57b7bc454f4a938c358c9a063d4beb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dafc5b2ed84ab0a6ed62152e8ff799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:42.765556 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e211b9-f539-4084-8794-2029e9cec925 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:42.765871 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e211b9-f539-4084-8794-2029e9cec925 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:42.766248 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e211b9-f539-4084-8794-2029e9cec925 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] PATH_INFO: `/v3/groups` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:42.767307 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e211b9-f539-4084-8794-2029e9cec925 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:42.768378 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-b6e211b9-f539-4084-8794-2029e9cec925 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:51:42.768378 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 15:51:42.768378 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 15:51:42.769882 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e211b9-f539-4084-8794-2029e9cec925 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:42.816695 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2007/3996] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:51:42 2022] POST /identity/v3/groups => generated 326 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:51:42.820363 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d104c5-6ad9-4cba-9c82-6850c9fea3c4 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:42.842022 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d104c5-6ad9-4cba-9c82-6850c9fea3c4 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:42.849675 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac7876-2f56-46d7-83e0-65dcfd5bb3a5 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b57b7bc454f4a938c358c9a063d4beb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dafc5b2ed84ab0a6ed62152e8ff799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:42.850796 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac7876-2f56-46d7-83e0-65dcfd5bb3a5 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:42.851330 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac7876-2f56-46d7-83e0-65dcfd5bb3a5 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:42.851788 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac7876-2f56-46d7-83e0-65dcfd5bb3a5 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:42.853310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac7876-2f56-46d7-83e0-65dcfd5bb3a5 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:42.856055 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac7876-2f56-46d7-83e0-65dcfd5bb3a5 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:42.912133 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1990/3997] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:51:42 2022] POST /identity/v3/users => generated 321 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:51:42.915942 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e211b9-f539-4084-8794-2029e9cec925 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:42.929299 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e211b9-f539-4084-8794-2029e9cec925 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:42.936403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a28784-4eff-41ee-99ae-1b6c266ff291 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b57b7bc454f4a938c358c9a063d4beb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dafc5b2ed84ab0a6ed62152e8ff799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:42.937241 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a28784-4eff-41ee-99ae-1b6c266ff291 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:42.938058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a28784-4eff-41ee-99ae-1b6c266ff291 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:42.938058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a28784-4eff-41ee-99ae-1b6c266ff291 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] PATH_INFO: `/v3/groups/3ca177c88beb4299a8e110cb8fa16f6a/users/9ad35553ed554b3183f40c7d44eb08d5` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:42.986843 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a28784-4eff-41ee-99ae-1b6c266ff291 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=3ca177c88beb4299a8e110cb8fa16f6a, user_id=9ad35553ed554b3183f40c7d44eb08d5)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:42.991341 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-50a28784-4eff-41ee-99ae-1b6c266ff291 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:51:42.991341 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 15:51:42.991341 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 15:51:42.993175 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a28784-4eff-41ee-99ae-1b6c266ff291 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:43.035655 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2008/3998] 10.222.0.83 () {60 vars in 1360 bytes} [Mon Aug 29 15:51:42 2022] PUT /identity/v3/groups/3ca177c88beb4299a8e110cb8fa16f6a/users/9ad35553ed554b3183f40c7d44eb08d5 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:43.039949 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac7876-2f56-46d7-83e0-65dcfd5bb3a5 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:43.051940 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac7876-2f56-46d7-83e0-65dcfd5bb3a5 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:43.125165 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74b548-477d-4077-aed7-a912cde30365 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b57b7bc454f4a938c358c9a063d4beb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dafc5b2ed84ab0a6ed62152e8ff799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:43.126591 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74b548-477d-4077-aed7-a912cde30365 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:43.126591 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74b548-477d-4077-aed7-a912cde30365 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:43.126591 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74b548-477d-4077-aed7-a912cde30365 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:43.127515 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f74b548-477d-4077-aed7-a912cde30365 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:43.130611 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f74b548-477d-4077-aed7-a912cde30365 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:43.163860 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1991/3999] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:51:43 2022] POST /identity/v3/users => generated 321 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:51:43.168476 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a28784-4eff-41ee-99ae-1b6c266ff291 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:43.179742 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a28784-4eff-41ee-99ae-1b6c266ff291 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:43.185681 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10923540-463a-4931-96ed-fc8fe517282e tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b57b7bc454f4a938c358c9a063d4beb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dafc5b2ed84ab0a6ed62152e8ff799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:43.186514 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10923540-463a-4931-96ed-fc8fe517282e tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:43.186905 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10923540-463a-4931-96ed-fc8fe517282e tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:43.187371 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10923540-463a-4931-96ed-fc8fe517282e tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] PATH_INFO: `/v3/groups/3ca177c88beb4299a8e110cb8fa16f6a/users/fcca8b0f1b0d441ba8003a0fca869f9e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:43.205270 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10923540-463a-4931-96ed-fc8fe517282e tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=3ca177c88beb4299a8e110cb8fa16f6a, user_id=fcca8b0f1b0d441ba8003a0fca869f9e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:43.207436 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10923540-463a-4931-96ed-fc8fe517282e tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:43.245011 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2009/4000] 10.222.0.83 () {60 vars in 1360 bytes} [Mon Aug 29 15:51:43 2022] PUT /identity/v3/groups/3ca177c88beb4299a8e110cb8fa16f6a/users/fcca8b0f1b0d441ba8003a0fca869f9e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:51:43.249349 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74b548-477d-4077-aed7-a912cde30365 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:43.261908 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74b548-477d-4077-aed7-a912cde30365 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:43.348365 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c4ceb-a6ba-4b2a-adc4-35144dddfd68 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b57b7bc454f4a938c358c9a063d4beb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dafc5b2ed84ab0a6ed62152e8ff799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:43.349027 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c4ceb-a6ba-4b2a-adc4-35144dddfd68 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:43.349272 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c4ceb-a6ba-4b2a-adc4-35144dddfd68 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:43.349546 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c4ceb-a6ba-4b2a-adc4-35144dddfd68 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:43.350375 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c4ceb-a6ba-4b2a-adc4-35144dddfd68 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:43.356431 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c4ceb-a6ba-4b2a-adc4-35144dddfd68 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:43.407971 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1992/4001] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:51:43 2022] POST /identity/v3/users => generated 323 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:51:43.412480 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10923540-463a-4931-96ed-fc8fe517282e tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:43.429726 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10923540-463a-4931-96ed-fc8fe517282e tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:43.440348 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77b720-4e9c-4f20-bb6e-d99d535b7093 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b57b7bc454f4a938c358c9a063d4beb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dafc5b2ed84ab0a6ed62152e8ff799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:43.442143 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77b720-4e9c-4f20-bb6e-d99d535b7093 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:43.442559 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77b720-4e9c-4f20-bb6e-d99d535b7093 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:43.442939 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77b720-4e9c-4f20-bb6e-d99d535b7093 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] PATH_INFO: `/v3/groups/3ca177c88beb4299a8e110cb8fa16f6a/users/c27291136246452483be0a2f9bea34bd` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:43.467967 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77b720-4e9c-4f20-bb6e-d99d535b7093 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=3ca177c88beb4299a8e110cb8fa16f6a, user_id=c27291136246452483be0a2f9bea34bd)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:43.470124 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77b720-4e9c-4f20-bb6e-d99d535b7093 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:43.505735 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2010/4002] 10.222.0.83 () {60 vars in 1360 bytes} [Mon Aug 29 15:51:43 2022] PUT /identity/v3/groups/3ca177c88beb4299a8e110cb8fa16f6a/users/c27291136246452483be0a2f9bea34bd => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:43.510665 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c4ceb-a6ba-4b2a-adc4-35144dddfd68 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:43.531156 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c4ceb-a6ba-4b2a-adc4-35144dddfd68 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:43.579610 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=4,keystone:SELECT=87,keystone:INSERT=9 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:43.626929 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d55ea-28f3-475c-9c11-8806b2ede27d tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b57b7bc454f4a938c358c9a063d4beb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dafc5b2ed84ab0a6ed62152e8ff799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:43.627820 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d55ea-28f3-475c-9c11-8806b2ede27d tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:43.628203 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d55ea-28f3-475c-9c11-8806b2ede27d tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:43.628484 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d55ea-28f3-475c-9c11-8806b2ede27d tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] PATH_INFO: `/v3/groups/3ca177c88beb4299a8e110cb8fa16f6a/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:43.629720 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881d55ea-28f3-475c-9c11-8806b2ede27d tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=3ca177c88beb4299a8e110cb8fa16f6a)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:43.630946 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-881d55ea-28f3-475c-9c11-8806b2ede27d tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:51:43.630946 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 15:51:43.630946 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 15:51:43.632338 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881d55ea-28f3-475c-9c11-8806b2ede27d tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:43.665337 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1993/4003] 10.222.0.83 () {58 vars in 1242 bytes} [Mon Aug 29 15:51:43 2022] GET /identity/v3/groups/3ca177c88beb4299a8e110cb8fa16f6a/users => generated 1081 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:51:43.672474 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77b720-4e9c-4f20-bb6e-d99d535b7093 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:43.688421 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77b720-4e9c-4f20-bb6e-d99d535b7093 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:43.695391 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57254d27-50e4-4072-bb1a-332c3b6fd4fa tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b57b7bc454f4a938c358c9a063d4beb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dafc5b2ed84ab0a6ed62152e8ff799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:43.696129 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57254d27-50e4-4072-bb1a-332c3b6fd4fa tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:43.696484 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57254d27-50e4-4072-bb1a-332c3b6fd4fa tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:43.696835 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57254d27-50e4-4072-bb1a-332c3b6fd4fa tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] PATH_INFO: `/v3/groups/3ca177c88beb4299a8e110cb8fa16f6a/users/9ad35553ed554b3183f40c7d44eb08d5` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:43.698717 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57254d27-50e4-4072-bb1a-332c3b6fd4fa tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=3ca177c88beb4299a8e110cb8fa16f6a, user_id=9ad35553ed554b3183f40c7d44eb08d5)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:43.700064 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-57254d27-50e4-4072-bb1a-332c3b6fd4fa tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:51:43.700064 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 15:51:43.700064 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 15:51:43.701385 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57254d27-50e4-4072-bb1a-332c3b6fd4fa tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:43.725334 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2011/4004] 10.222.0.83 () {58 vars in 1342 bytes} [Mon Aug 29 15:51:43 2022] HEAD /identity/v3/groups/3ca177c88beb4299a8e110cb8fa16f6a/users/9ad35553ed554b3183f40c7d44eb08d5 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:43.726554 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d55ea-28f3-475c-9c11-8806b2ede27d tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:43.745869 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d55ea-28f3-475c-9c11-8806b2ede27d tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:43.755805 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30406daf-03ff-4786-9459-5e0e6b4ab0ed tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b57b7bc454f4a938c358c9a063d4beb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dafc5b2ed84ab0a6ed62152e8ff799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:43.756820 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30406daf-03ff-4786-9459-5e0e6b4ab0ed tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:43.757305 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30406daf-03ff-4786-9459-5e0e6b4ab0ed tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:43.761622 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30406daf-03ff-4786-9459-5e0e6b4ab0ed tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] PATH_INFO: `/v3/groups/3ca177c88beb4299a8e110cb8fa16f6a/users/9ad35553ed554b3183f40c7d44eb08d5` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:43.767781 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30406daf-03ff-4786-9459-5e0e6b4ab0ed tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=3ca177c88beb4299a8e110cb8fa16f6a, user_id=9ad35553ed554b3183f40c7d44eb08d5)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:43.769075 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-30406daf-03ff-4786-9459-5e0e6b4ab0ed tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:51:43.769075 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 15:51:43.769075 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 15:51:43.771331 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30406daf-03ff-4786-9459-5e0e6b4ab0ed tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:43.795453 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-30406daf-03ff-4786-9459-5e0e6b4ab0ed tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '9ad35553ed554b3183f40c7d44eb08d5'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:43.824444 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1994/4005] 10.222.0.83 () {58 vars in 1344 bytes} [Mon Aug 29 15:51:43 2022] DELETE /identity/v3/groups/3ca177c88beb4299a8e110cb8fa16f6a/users/9ad35553ed554b3183f40c7d44eb08d5 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:43.829311 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57254d27-50e4-4072-bb1a-332c3b6fd4fa tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:43.845551 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57254d27-50e4-4072-bb1a-332c3b6fd4fa tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:43.869037 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:UPDATE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:44.016780 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf2e78-be98-45b1-8bdc-4ac1fbf88f24 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b57b7bc454f4a938c358c9a063d4beb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dafc5b2ed84ab0a6ed62152e8ff799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:44.017757 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf2e78-be98-45b1-8bdc-4ac1fbf88f24 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:44.018047 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf2e78-be98-45b1-8bdc-4ac1fbf88f24 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:44.018334 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf2e78-be98-45b1-8bdc-4ac1fbf88f24 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] PATH_INFO: `/v3/groups/3ca177c88beb4299a8e110cb8fa16f6a/users/fcca8b0f1b0d441ba8003a0fca869f9e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:44.022116 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf2e78-be98-45b1-8bdc-4ac1fbf88f24 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=3ca177c88beb4299a8e110cb8fa16f6a, user_id=fcca8b0f1b0d441ba8003a0fca869f9e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:44.025922 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf2e78-be98-45b1-8bdc-4ac1fbf88f24 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:44.050747 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2012/4006] 10.222.0.83 () {58 vars in 1342 bytes} [Mon Aug 29 15:51:43 2022] HEAD /identity/v3/groups/3ca177c88beb4299a8e110cb8fa16f6a/users/fcca8b0f1b0d441ba8003a0fca869f9e => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:44.055960 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30406daf-03ff-4786-9459-5e0e6b4ab0ed tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:44.072867 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30406daf-03ff-4786-9459-5e0e6b4ab0ed tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:44.120460 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae17fe8c-04a0-46e2-adc1-02aef17e7f8f tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b57b7bc454f4a938c358c9a063d4beb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dafc5b2ed84ab0a6ed62152e8ff799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:44.122933 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae17fe8c-04a0-46e2-adc1-02aef17e7f8f tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:44.124425 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae17fe8c-04a0-46e2-adc1-02aef17e7f8f tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:44.124810 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae17fe8c-04a0-46e2-adc1-02aef17e7f8f tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] PATH_INFO: `/v3/groups/3ca177c88beb4299a8e110cb8fa16f6a/users/fcca8b0f1b0d441ba8003a0fca869f9e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:44.128534 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae17fe8c-04a0-46e2-adc1-02aef17e7f8f tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=3ca177c88beb4299a8e110cb8fa16f6a, user_id=fcca8b0f1b0d441ba8003a0fca869f9e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:44.132329 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae17fe8c-04a0-46e2-adc1-02aef17e7f8f tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:44.147169 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ae17fe8c-04a0-46e2-adc1-02aef17e7f8f tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'fcca8b0f1b0d441ba8003a0fca869f9e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:44.193713 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1995/4007] 10.222.0.83 () {58 vars in 1344 bytes} [Mon Aug 29 15:51:44 2022] DELETE /identity/v3/groups/3ca177c88beb4299a8e110cb8fa16f6a/users/fcca8b0f1b0d441ba8003a0fca869f9e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:44.197724 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf2e78-be98-45b1-8bdc-4ac1fbf88f24 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:44.209880 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf2e78-be98-45b1-8bdc-4ac1fbf88f24 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:44.309610 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebace51-8f1f-4421-8749-037398f2b632 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b57b7bc454f4a938c358c9a063d4beb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dafc5b2ed84ab0a6ed62152e8ff799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:44.311447 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebace51-8f1f-4421-8749-037398f2b632 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:44.311967 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebace51-8f1f-4421-8749-037398f2b632 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:44.312340 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebace51-8f1f-4421-8749-037398f2b632 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] PATH_INFO: `/v3/groups/3ca177c88beb4299a8e110cb8fa16f6a/users/c27291136246452483be0a2f9bea34bd` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:44.316428 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebace51-8f1f-4421-8749-037398f2b632 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=3ca177c88beb4299a8e110cb8fa16f6a, user_id=c27291136246452483be0a2f9bea34bd)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:44.320306 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebace51-8f1f-4421-8749-037398f2b632 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:44.351550 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2013/4008] 10.222.0.83 () {58 vars in 1342 bytes} [Mon Aug 29 15:51:44 2022] HEAD /identity/v3/groups/3ca177c88beb4299a8e110cb8fa16f6a/users/c27291136246452483be0a2f9bea34bd => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:44.353468 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae17fe8c-04a0-46e2-adc1-02aef17e7f8f tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:44.365941 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae17fe8c-04a0-46e2-adc1-02aef17e7f8f tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:44.375390 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0fa913-eabb-4b77-aa8f-727506db70d5 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b57b7bc454f4a938c358c9a063d4beb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dafc5b2ed84ab0a6ed62152e8ff799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:44.376690 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fa913-eabb-4b77-aa8f-727506db70d5 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:44.376690 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fa913-eabb-4b77-aa8f-727506db70d5 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:44.376690 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fa913-eabb-4b77-aa8f-727506db70d5 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] PATH_INFO: `/v3/groups/3ca177c88beb4299a8e110cb8fa16f6a/users/c27291136246452483be0a2f9bea34bd` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:44.378307 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0fa913-eabb-4b77-aa8f-727506db70d5 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=3ca177c88beb4299a8e110cb8fa16f6a, user_id=c27291136246452483be0a2f9bea34bd)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:44.380561 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0fa913-eabb-4b77-aa8f-727506db70d5 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:44.392896 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-eb0fa913-eabb-4b77-aa8f-727506db70d5 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c27291136246452483be0a2f9bea34bd'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:44.417711 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1996/4009] 10.222.0.83 () {58 vars in 1344 bytes} [Mon Aug 29 15:51:44 2022] DELETE /identity/v3/groups/3ca177c88beb4299a8e110cb8fa16f6a/users/c27291136246452483be0a2f9bea34bd => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:44.421255 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebace51-8f1f-4421-8749-037398f2b632 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:44.434162 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebace51-8f1f-4421-8749-037398f2b632 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:44.540488 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ae062-fa17-4253-9a12-1d2ed8d5dbf3 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b57b7bc454f4a938c358c9a063d4beb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dafc5b2ed84ab0a6ed62152e8ff799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:44.541366 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ae062-fa17-4253-9a12-1d2ed8d5dbf3 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:44.542026 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ae062-fa17-4253-9a12-1d2ed8d5dbf3 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:44.542564 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ae062-fa17-4253-9a12-1d2ed8d5dbf3 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] PATH_INFO: `/v3/groups/3ca177c88beb4299a8e110cb8fa16f6a/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:44.544263 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ae062-fa17-4253-9a12-1d2ed8d5dbf3 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=3ca177c88beb4299a8e110cb8fa16f6a)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:44.545198 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-d77ae062-fa17-4253-9a12-1d2ed8d5dbf3 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:51:44.545198 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 15:51:44.545198 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 15:51:44.546720 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ae062-fa17-4253-9a12-1d2ed8d5dbf3 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:44.573351 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2014/4010] 10.222.0.83 () {58 vars in 1242 bytes} [Mon Aug 29 15:51:44 2022] GET /identity/v3/groups/3ca177c88beb4299a8e110cb8fa16f6a/users => generated 145 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:51:44.573788 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0fa913-eabb-4b77-aa8f-727506db70d5 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:44.587546 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0fa913-eabb-4b77-aa8f-727506db70d5 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:44.592959 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cca79d-4268-479d-8fb0-8869cc821130 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b57b7bc454f4a938c358c9a063d4beb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dafc5b2ed84ab0a6ed62152e8ff799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:44.593620 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cca79d-4268-479d-8fb0-8869cc821130 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:44.593899 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cca79d-4268-479d-8fb0-8869cc821130 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:44.594171 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cca79d-4268-479d-8fb0-8869cc821130 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] PATH_INFO: `/v3/users/c27291136246452483be0a2f9bea34bd` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:44.596206 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cca79d-4268-479d-8fb0-8869cc821130 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c27291136246452483be0a2f9bea34bd)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:44.598138 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cca79d-4268-479d-8fb0-8869cc821130 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:44.660307 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-19cca79d-4268-479d-8fb0-8869cc821130 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c27291136246452483be0a2f9bea34bd'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:44.661409 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-19cca79d-4268-479d-8fb0-8869cc821130 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c27291136246452483be0a2f9bea34bd'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:44.671975 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-19cca79d-4268-479d-8fb0-8869cc821130 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c27291136246452483be0a2f9bea34bd'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:44.683524 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-19cca79d-4268-479d-8fb0-8869cc821130 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c27291136246452483be0a2f9bea34bd'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:44.684953 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-19cca79d-4268-479d-8fb0-8869cc821130 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c27291136246452483be0a2f9bea34bd'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:44.717247 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1997/4011] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:51:44 2022] DELETE /identity/v3/users/c27291136246452483be0a2f9bea34bd => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:51:44.721090 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ae062-fa17-4253-9a12-1d2ed8d5dbf3 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:44.722887 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d77ae062-fa17-4253-9a12-1d2ed8d5dbf3 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:44.747678 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ae062-fa17-4253-9a12-1d2ed8d5dbf3 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:44.812977 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:44.874642 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281f00b-65f9-44ce-988b-c209dda1e293 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b57b7bc454f4a938c358c9a063d4beb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dafc5b2ed84ab0a6ed62152e8ff799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:44.875333 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281f00b-65f9-44ce-988b-c209dda1e293 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:44.875706 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281f00b-65f9-44ce-988b-c209dda1e293 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:44.876103 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281f00b-65f9-44ce-988b-c209dda1e293 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] PATH_INFO: `/v3/users/fcca8b0f1b0d441ba8003a0fca869f9e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:44.878045 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281f00b-65f9-44ce-988b-c209dda1e293 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorizing `identity:delete_user(user_id=fcca8b0f1b0d441ba8003a0fca869f9e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:44.880991 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281f00b-65f9-44ce-988b-c209dda1e293 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:44.981829 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0281f00b-65f9-44ce-988b-c209dda1e293 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcca8b0f1b0d441ba8003a0fca869f9e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:44.985133 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0281f00b-65f9-44ce-988b-c209dda1e293 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcca8b0f1b0d441ba8003a0fca869f9e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:45.011324 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0281f00b-65f9-44ce-988b-c209dda1e293 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcca8b0f1b0d441ba8003a0fca869f9e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:45.026796 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0281f00b-65f9-44ce-988b-c209dda1e293 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcca8b0f1b0d441ba8003a0fca869f9e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:45.046966 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0281f00b-65f9-44ce-988b-c209dda1e293 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcca8b0f1b0d441ba8003a0fca869f9e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:45.078961 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2015/4012] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:51:44 2022] DELETE /identity/v3/users/fcca8b0f1b0d441ba8003a0fca869f9e => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:45.081080 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cca79d-4268-479d-8fb0-8869cc821130 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:45.097589 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cca79d-4268-479d-8fb0-8869cc821130 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:45.210927 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=80,keystone:DELETE=16,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:45.283186 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6bd589-68bb-4687-ab6d-dc080411fccf tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b57b7bc454f4a938c358c9a063d4beb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dafc5b2ed84ab0a6ed62152e8ff799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:45.284085 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bd589-68bb-4687-ab6d-dc080411fccf tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:45.284591 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bd589-68bb-4687-ab6d-dc080411fccf tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:45.284969 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bd589-68bb-4687-ab6d-dc080411fccf tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] PATH_INFO: `/v3/users/9ad35553ed554b3183f40c7d44eb08d5` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:45.289325 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6bd589-68bb-4687-ab6d-dc080411fccf tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9ad35553ed554b3183f40c7d44eb08d5)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:45.296088 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6bd589-68bb-4687-ab6d-dc080411fccf tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:45.426077 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5f6bd589-68bb-4687-ab6d-dc080411fccf tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ad35553ed554b3183f40c7d44eb08d5'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:45.427183 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5f6bd589-68bb-4687-ab6d-dc080411fccf tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ad35553ed554b3183f40c7d44eb08d5'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:45.443095 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5f6bd589-68bb-4687-ab6d-dc080411fccf tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ad35553ed554b3183f40c7d44eb08d5'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:45.461223 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5f6bd589-68bb-4687-ab6d-dc080411fccf tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ad35553ed554b3183f40c7d44eb08d5'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:45.463983 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5f6bd589-68bb-4687-ab6d-dc080411fccf tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ad35553ed554b3183f40c7d44eb08d5'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:45.505856 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1998/4013] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:51:45 2022] DELETE /identity/v3/users/9ad35553ed554b3183f40c7d44eb08d5 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:45.511161 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281f00b-65f9-44ce-988b-c209dda1e293 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:45.512887 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0281f00b-65f9-44ce-988b-c209dda1e293 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:45.536530 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281f00b-65f9-44ce-988b-c209dda1e293 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:45.752345 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8de1bf-dbed-418e-94a7-01df16cbc7df tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b57b7bc454f4a938c358c9a063d4beb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dafc5b2ed84ab0a6ed62152e8ff799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:45.753531 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8de1bf-dbed-418e-94a7-01df16cbc7df tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:45.753997 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8de1bf-dbed-418e-94a7-01df16cbc7df tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:45.754456 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8de1bf-dbed-418e-94a7-01df16cbc7df tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] PATH_INFO: `/v3/groups/3ca177c88beb4299a8e110cb8fa16f6a` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:45.757239 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8de1bf-dbed-418e-94a7-01df16cbc7df tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorizing `identity:delete_group(group_id=3ca177c88beb4299a8e110cb8fa16f6a)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:45.761299 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-1b8de1bf-dbed-418e-94a7-01df16cbc7df tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:51:45.761299 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 15:51:45.761299 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 15:51:45.764310 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8de1bf-dbed-418e-94a7-01df16cbc7df tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:45.957696 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2016/4014] 10.222.0.83 () {58 vars in 1227 bytes} [Mon Aug 29 15:51:45 2022] DELETE /identity/v3/groups/3ca177c88beb4299a8e110cb8fa16f6a => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:51:45.965486 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6bd589-68bb-4687-ab6d-dc080411fccf tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:45.968464 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5f6bd589-68bb-4687-ab6d-dc080411fccf tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:46.026227 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6bd589-68bb-4687-ab6d-dc080411fccf tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:46.145166 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3002ab10-b70b-4b55-9635-de41e13cb773 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b57b7bc454f4a938c358c9a063d4beb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dafc5b2ed84ab0a6ed62152e8ff799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:46.146470 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002ab10-b70b-4b55-9635-de41e13cb773 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:46.147105 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002ab10-b70b-4b55-9635-de41e13cb773 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:46.151551 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002ab10-b70b-4b55-9635-de41e13cb773 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] PATH_INFO: `/v3/groups` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:46.153820 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3002ab10-b70b-4b55-9635-de41e13cb773 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:46.161615 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3002ab10-b70b-4b55-9635-de41e13cb773 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:46.204035 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8de1bf-dbed-418e-94a7-01df16cbc7df tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:46.204815 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 1999/4015] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:51:45 2022] POST /identity/v3/groups => generated 327 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:51:46.234333 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8de1bf-dbed-418e-94a7-01df16cbc7df tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:46.252573 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5a169-22b3-4b7c-91af-b18475d6b1b4 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b57b7bc454f4a938c358c9a063d4beb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dafc5b2ed84ab0a6ed62152e8ff799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:46.253561 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5a169-22b3-4b7c-91af-b18475d6b1b4 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:46.254000 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5a169-22b3-4b7c-91af-b18475d6b1b4 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:46.254471 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5a169-22b3-4b7c-91af-b18475d6b1b4 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] PATH_INFO: `/v3/groups` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:46.255523 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c5a169-22b3-4b7c-91af-b18475d6b1b4 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:46.257724 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c5a169-22b3-4b7c-91af-b18475d6b1b4 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:46.274641 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:46.292011 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3002ab10-b70b-4b55-9635-de41e13cb773 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:46.295503 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2017/4016] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:51:46 2022] POST /identity/v3/groups => generated 326 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:51:46.319855 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3002ab10-b70b-4b55-9635-de41e13cb773 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:46.332701 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9756f4-c11e-460e-a07c-7476ca7c328c tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b57b7bc454f4a938c358c9a063d4beb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dafc5b2ed84ab0a6ed62152e8ff799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:46.335219 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9756f4-c11e-460e-a07c-7476ca7c328c tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:46.335942 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9756f4-c11e-460e-a07c-7476ca7c328c tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:46.336436 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9756f4-c11e-460e-a07c-7476ca7c328c tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] PATH_INFO: `/v3/groups` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:46.338060 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9756f4-c11e-460e-a07c-7476ca7c328c tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:46.340189 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9756f4-c11e-460e-a07c-7476ca7c328c tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:46.378849 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2000/4017] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:51:46 2022] POST /identity/v3/groups => generated 325 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:51:46.380069 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5a169-22b3-4b7c-91af-b18475d6b1b4 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:46.393048 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5a169-22b3-4b7c-91af-b18475d6b1b4 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:46.403970 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71db747-8750-48b4-86c5-a316711099f8 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b57b7bc454f4a938c358c9a063d4beb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dafc5b2ed84ab0a6ed62152e8ff799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:46.404603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71db747-8750-48b4-86c5-a316711099f8 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:46.404922 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71db747-8750-48b4-86c5-a316711099f8 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:46.405200 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71db747-8750-48b4-86c5-a316711099f8 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] PATH_INFO: `/v3/groups` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:46.405841 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71db747-8750-48b4-86c5-a316711099f8 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:46.408085 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-f71db747-8750-48b4-86c5-a316711099f8 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:51:46.408085 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 15:51:46.408085 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 15:51:46.409271 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71db747-8750-48b4-86c5-a316711099f8 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:46.421467 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2018/4018] 10.222.0.83 () {58 vars in 1125 bytes} [Mon Aug 29 15:51:46 2022] GET /identity/v3/groups => generated 1488 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:51:46.425285 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9756f4-c11e-460e-a07c-7476ca7c328c tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:46.437603 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9756f4-c11e-460e-a07c-7476ca7c328c tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:46.443412 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c7b93-dfbb-4c5f-a2b5-9ece5cb6b1c6 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b57b7bc454f4a938c358c9a063d4beb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dafc5b2ed84ab0a6ed62152e8ff799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:46.448177 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c7b93-dfbb-4c5f-a2b5-9ece5cb6b1c6 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:46.450079 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c7b93-dfbb-4c5f-a2b5-9ece5cb6b1c6 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:46.450367 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c7b93-dfbb-4c5f-a2b5-9ece5cb6b1c6 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] PATH_INFO: `/v3/groups/11ab591c3a0547a48dff8b11b158232b` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:46.470172 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c7b93-dfbb-4c5f-a2b5-9ece5cb6b1c6 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorizing `identity:delete_group(group_id=11ab591c3a0547a48dff8b11b158232b)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:46.474498 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c7b93-dfbb-4c5f-a2b5-9ece5cb6b1c6 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:46.546574 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:46.568319 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2001/4019] 10.222.0.83 () {58 vars in 1227 bytes} [Mon Aug 29 15:51:46 2022] DELETE /identity/v3/groups/11ab591c3a0547a48dff8b11b158232b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:46.573456 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71db747-8750-48b4-86c5-a316711099f8 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:46.586895 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71db747-8750-48b4-86c5-a316711099f8 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:46.724869 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b0123-7247-40ed-934a-1f6b4ad0490a tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b57b7bc454f4a938c358c9a063d4beb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dafc5b2ed84ab0a6ed62152e8ff799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:46.725893 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b0123-7247-40ed-934a-1f6b4ad0490a tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:46.726341 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b0123-7247-40ed-934a-1f6b4ad0490a tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:46.726814 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b0123-7247-40ed-934a-1f6b4ad0490a tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] PATH_INFO: `/v3/groups/e8b53c99c3ad4785a5c46060fa923007` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:46.740348 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b0123-7247-40ed-934a-1f6b4ad0490a tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorizing `identity:delete_group(group_id=e8b53c99c3ad4785a5c46060fa923007)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:46.744239 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b0123-7247-40ed-934a-1f6b4ad0490a tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:46.830179 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2019/4020] 10.222.0.83 () {58 vars in 1227 bytes} [Mon Aug 29 15:51:46 2022] DELETE /identity/v3/groups/e8b53c99c3ad4785a5c46060fa923007 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:46.834077 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c7b93-dfbb-4c5f-a2b5-9ece5cb6b1c6 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:46.849579 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c7b93-dfbb-4c5f-a2b5-9ece5cb6b1c6 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:47.013814 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148166f6-9ad6-4938-96cc-e478aa3b2901 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b57b7bc454f4a938c358c9a063d4beb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dafc5b2ed84ab0a6ed62152e8ff799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:47.014553 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148166f6-9ad6-4938-96cc-e478aa3b2901 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:47.014888 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148166f6-9ad6-4938-96cc-e478aa3b2901 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:47.015514 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148166f6-9ad6-4938-96cc-e478aa3b2901 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] PATH_INFO: `/v3/groups/e2c68eb885af4f0d85488a470d9cc9a9` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:47.030565 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148166f6-9ad6-4938-96cc-e478aa3b2901 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorizing `identity:delete_group(group_id=e2c68eb885af4f0d85488a470d9cc9a9)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:47.032615 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148166f6-9ad6-4938-96cc-e478aa3b2901 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:47.132909 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2002/4021] 10.222.0.83 () {58 vars in 1227 bytes} [Mon Aug 29 15:51:46 2022] DELETE /identity/v3/groups/e2c68eb885af4f0d85488a470d9cc9a9 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:47.138428 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b0123-7247-40ed-934a-1f6b4ad0490a tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:47.150120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b0123-7247-40ed-934a-1f6b4ad0490a tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:47.236317 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2dd937-a40b-481d-b34b-3186b9683142 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b57b7bc454f4a938c358c9a063d4beb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dafc5b2ed84ab0a6ed62152e8ff799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:47.237116 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dd937-a40b-481d-b34b-3186b9683142 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:47.237643 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dd937-a40b-481d-b34b-3186b9683142 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:47.238200 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dd937-a40b-481d-b34b-3186b9683142 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:47.239047 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2dd937-a40b-481d-b34b-3186b9683142 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:47.240952 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2dd937-a40b-481d-b34b-3186b9683142 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:47.289031 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2020/4022] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:51:47 2022] POST /identity/v3/users => generated 319 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:51:47.293342 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148166f6-9ad6-4938-96cc-e478aa3b2901 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:47.315129 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148166f6-9ad6-4938-96cc-e478aa3b2901 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:47.324415 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b06e8-8f5f-42bb-a7f4-209b84d86d86 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b57b7bc454f4a938c358c9a063d4beb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dafc5b2ed84ab0a6ed62152e8ff799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:47.325242 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b06e8-8f5f-42bb-a7f4-209b84d86d86 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:47.325623 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b06e8-8f5f-42bb-a7f4-209b84d86d86 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:47.326012 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b06e8-8f5f-42bb-a7f4-209b84d86d86 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] PATH_INFO: `/v3/groups` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:47.327147 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0b06e8-8f5f-42bb-a7f4-209b84d86d86 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:47.330522 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0b06e8-8f5f-42bb-a7f4-209b84d86d86 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:47.356493 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2003/4023] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:51:47 2022] POST /identity/v3/groups => generated 327 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:51:47.359867 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2dd937-a40b-481d-b34b-3186b9683142 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:47.377817 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2dd937-a40b-481d-b34b-3186b9683142 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:47.385337 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f9acb-1414-4be0-a95e-b44adfb8394a tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b57b7bc454f4a938c358c9a063d4beb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dafc5b2ed84ab0a6ed62152e8ff799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:47.387071 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f9acb-1414-4be0-a95e-b44adfb8394a tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:47.387473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f9acb-1414-4be0-a95e-b44adfb8394a tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:47.388023 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f9acb-1414-4be0-a95e-b44adfb8394a tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] PATH_INFO: `/v3/groups/c4d48ff7f4024ac3b1c01a712755f811/users/232dcceb002d46f4ad57e5bd734a9d04` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:47.431570 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f9acb-1414-4be0-a95e-b44adfb8394a tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=c4d48ff7f4024ac3b1c01a712755f811, user_id=232dcceb002d46f4ad57e5bd734a9d04)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:47.434843 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f9acb-1414-4be0-a95e-b44adfb8394a tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:47.459981 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:47.482091 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2021/4024] 10.222.0.83 () {60 vars in 1360 bytes} [Mon Aug 29 15:51:47 2022] PUT /identity/v3/groups/c4d48ff7f4024ac3b1c01a712755f811/users/232dcceb002d46f4ad57e5bd734a9d04 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:47.486662 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b06e8-8f5f-42bb-a7f4-209b84d86d86 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:47.502004 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b06e8-8f5f-42bb-a7f4-209b84d86d86 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:47.593326 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6866e9f2-15a5-49f8-9258-0b2f9676a5a0 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b57b7bc454f4a938c358c9a063d4beb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dafc5b2ed84ab0a6ed62152e8ff799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:47.593964 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866e9f2-15a5-49f8-9258-0b2f9676a5a0 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:47.594252 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866e9f2-15a5-49f8-9258-0b2f9676a5a0 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:47.594535 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866e9f2-15a5-49f8-9258-0b2f9676a5a0 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] PATH_INFO: `/v3/groups` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:47.595231 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6866e9f2-15a5-49f8-9258-0b2f9676a5a0 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:47.597236 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6866e9f2-15a5-49f8-9258-0b2f9676a5a0 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:47.640388 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2004/4025] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:51:47 2022] POST /identity/v3/groups => generated 325 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:51:47.644145 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f9acb-1414-4be0-a95e-b44adfb8394a tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:47.664405 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f9acb-1414-4be0-a95e-b44adfb8394a tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:47.670684 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c0a55c-c7e5-4b04-8368-41850e42a746 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b57b7bc454f4a938c358c9a063d4beb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dafc5b2ed84ab0a6ed62152e8ff799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:47.671475 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0a55c-c7e5-4b04-8368-41850e42a746 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:47.671832 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0a55c-c7e5-4b04-8368-41850e42a746 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:47.672183 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0a55c-c7e5-4b04-8368-41850e42a746 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] PATH_INFO: `/v3/groups/84356ab1b34d4872a536d78807882403/users/232dcceb002d46f4ad57e5bd734a9d04` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:47.686424 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c0a55c-c7e5-4b04-8368-41850e42a746 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=84356ab1b34d4872a536d78807882403, user_id=232dcceb002d46f4ad57e5bd734a9d04)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:47.690215 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c0a55c-c7e5-4b04-8368-41850e42a746 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:47.726541 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2022/4026] 10.222.0.83 () {60 vars in 1360 bytes} [Mon Aug 29 15:51:47 2022] PUT /identity/v3/groups/84356ab1b34d4872a536d78807882403/users/232dcceb002d46f4ad57e5bd734a9d04 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:47.731320 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6866e9f2-15a5-49f8-9258-0b2f9676a5a0 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:47.743188 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6866e9f2-15a5-49f8-9258-0b2f9676a5a0 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:47.780510 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:47.910468 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82a117-ee80-4d76-a782-cd8ad10c690e tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b57b7bc454f4a938c358c9a063d4beb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dafc5b2ed84ab0a6ed62152e8ff799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:47.911485 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82a117-ee80-4d76-a782-cd8ad10c690e tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:47.911943 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82a117-ee80-4d76-a782-cd8ad10c690e tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:47.912397 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82a117-ee80-4d76-a782-cd8ad10c690e tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] PATH_INFO: `/v3/users/232dcceb002d46f4ad57e5bd734a9d04/groups` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:47.916117 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82a117-ee80-4d76-a782-cd8ad10c690e tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=232dcceb002d46f4ad57e5bd734a9d04)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:47.917502 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82a117-ee80-4d76-a782-cd8ad10c690e tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:47.970861 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2005/4027] 10.222.0.83 () {58 vars in 1242 bytes} [Mon Aug 29 15:51:47 2022] GET /identity/v3/users/232dcceb002d46f4ad57e5bd734a9d04/groups => generated 838 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:51:47.974836 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c0a55c-c7e5-4b04-8368-41850e42a746 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:47.997003 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c0a55c-c7e5-4b04-8368-41850e42a746 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:48.022222 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d7d498-d251-46b5-8dbe-cdb86b9b5bd6 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b57b7bc454f4a938c358c9a063d4beb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dafc5b2ed84ab0a6ed62152e8ff799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:48.023260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7d498-d251-46b5-8dbe-cdb86b9b5bd6 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:48.026313 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7d498-d251-46b5-8dbe-cdb86b9b5bd6 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:48.028736 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7d498-d251-46b5-8dbe-cdb86b9b5bd6 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] PATH_INFO: `/v3/groups/84356ab1b34d4872a536d78807882403` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:48.030869 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d7d498-d251-46b5-8dbe-cdb86b9b5bd6 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorizing `identity:delete_group(group_id=84356ab1b34d4872a536d78807882403)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:48.043840 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d7d498-d251-46b5-8dbe-cdb86b9b5bd6 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:48.197731 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2023/4028] 10.222.0.83 () {58 vars in 1227 bytes} [Mon Aug 29 15:51:47 2022] DELETE /identity/v3/groups/84356ab1b34d4872a536d78807882403 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:48.201943 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82a117-ee80-4d76-a782-cd8ad10c690e tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:48.215978 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82a117-ee80-4d76-a782-cd8ad10c690e tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:48.395521 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130658f-fa8f-4d7e-b6c7-44ed38c10367 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b57b7bc454f4a938c358c9a063d4beb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dafc5b2ed84ab0a6ed62152e8ff799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:48.397675 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130658f-fa8f-4d7e-b6c7-44ed38c10367 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:48.397675 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130658f-fa8f-4d7e-b6c7-44ed38c10367 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:48.398018 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130658f-fa8f-4d7e-b6c7-44ed38c10367 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] PATH_INFO: `/v3/groups/c4d48ff7f4024ac3b1c01a712755f811` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:48.402037 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5130658f-fa8f-4d7e-b6c7-44ed38c10367 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorizing `identity:delete_group(group_id=c4d48ff7f4024ac3b1c01a712755f811)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:48.406088 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5130658f-fa8f-4d7e-b6c7-44ed38c10367 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:48.516534 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2006/4029] 10.222.0.83 () {58 vars in 1227 bytes} [Mon Aug 29 15:51:48 2022] DELETE /identity/v3/groups/c4d48ff7f4024ac3b1c01a712755f811 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:48.520971 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d7d498-d251-46b5-8dbe-cdb86b9b5bd6 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:48.537258 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d7d498-d251-46b5-8dbe-cdb86b9b5bd6 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:48.703082 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ebf67-d0c8-40de-b3c4-3208605bdca3 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b57b7bc454f4a938c358c9a063d4beb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dafc5b2ed84ab0a6ed62152e8ff799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:48.703891 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ebf67-d0c8-40de-b3c4-3208605bdca3 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:48.704191 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ebf67-d0c8-40de-b3c4-3208605bdca3 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:48.704479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ebf67-d0c8-40de-b3c4-3208605bdca3 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] PATH_INFO: `/v3/users/232dcceb002d46f4ad57e5bd734a9d04` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:48.705879 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ebf67-d0c8-40de-b3c4-3208605bdca3 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorizing `identity:delete_user(user_id=232dcceb002d46f4ad57e5bd734a9d04)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:48.708178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ebf67-d0c8-40de-b3c4-3208605bdca3 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:48.866221 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-091ebf67-d0c8-40de-b3c4-3208605bdca3 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '232dcceb002d46f4ad57e5bd734a9d04'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:48.867010 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-091ebf67-d0c8-40de-b3c4-3208605bdca3 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '232dcceb002d46f4ad57e5bd734a9d04'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:48.911845 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-091ebf67-d0c8-40de-b3c4-3208605bdca3 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '232dcceb002d46f4ad57e5bd734a9d04'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:48.939153 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-091ebf67-d0c8-40de-b3c4-3208605bdca3 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '232dcceb002d46f4ad57e5bd734a9d04'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:48.957120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-091ebf67-d0c8-40de-b3c4-3208605bdca3 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '232dcceb002d46f4ad57e5bd734a9d04'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:48.959300 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=84,keystone:INSERT=2,keystone:DELETE=14 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:48.977893 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2024/4030] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:51:48 2022] DELETE /identity/v3/users/232dcceb002d46f4ad57e5bd734a9d04 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:48.988619 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130658f-fa8f-4d7e-b6c7-44ed38c10367 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:48.991131 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5130658f-fa8f-4d7e-b6c7-44ed38c10367 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:49.010049 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130658f-fa8f-4d7e-b6c7-44ed38c10367 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:49.098997 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3efd35-dc3f-4e21-b38f-be72b9b3d007 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b57b7bc454f4a938c358c9a063d4beb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dafc5b2ed84ab0a6ed62152e8ff799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:49.103637 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3efd35-dc3f-4e21-b38f-be72b9b3d007 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:49.104203 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3efd35-dc3f-4e21-b38f-be72b9b3d007 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:49.104693 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3efd35-dc3f-4e21-b38f-be72b9b3d007 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] PATH_INFO: `/v3/domains/202c2854b11b4c0bad4a908445f33c53` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:49.106681 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3efd35-dc3f-4e21-b38f-be72b9b3d007 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=202c2854b11b4c0bad4a908445f33c53)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:49.108955 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-0e3efd35-dc3f-4e21-b38f-be72b9b3d007 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:51:49.108955 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 15:51:49.108955 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 15:51:49.110520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3efd35-dc3f-4e21-b38f-be72b9b3d007 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:49.128873 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:49.146181 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0e3efd35-dc3f-4e21-b38f-be72b9b3d007 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '202c2854b11b4c0bad4a908445f33c53'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:49.147756 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0e3efd35-dc3f-4e21-b38f-be72b9b3d007 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '202c2854b11b4c0bad4a908445f33c53'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:49.191709 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0e3efd35-dc3f-4e21-b38f-be72b9b3d007 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '202c2854b11b4c0bad4a908445f33c53'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:49.192639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0e3efd35-dc3f-4e21-b38f-be72b9b3d007 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '202c2854b11b4c0bad4a908445f33c53'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:49.197604 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2007/4031] 10.222.0.83 () {60 vars in 1249 bytes} [Mon Aug 29 15:51:48 2022] PATCH /identity/v3/domains/202c2854b11b4c0bad4a908445f33c53 => generated 277 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:51:49.201592 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ebf67-d0c8-40de-b3c4-3208605bdca3 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:49.217796 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ebf67-d0c8-40de-b3c4-3208605bdca3 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:49.343500 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e85e5a4-2e30-46b2-b72e-71c8282cbe93 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b57b7bc454f4a938c358c9a063d4beb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dafc5b2ed84ab0a6ed62152e8ff799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:49.343500 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85e5a4-2e30-46b2-b72e-71c8282cbe93 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:49.343500 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85e5a4-2e30-46b2-b72e-71c8282cbe93 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:49.343815 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85e5a4-2e30-46b2-b72e-71c8282cbe93 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] PATH_INFO: `/v3/domains/202c2854b11b4c0bad4a908445f33c53` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:49.353737 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3efd35-dc3f-4e21-b38f-be72b9b3d007 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:49.360303 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0e3efd35-dc3f-4e21-b38f-be72b9b3d007 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:49.380965 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e85e5a4-2e30-46b2-b72e-71c8282cbe93 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=202c2854b11b4c0bad4a908445f33c53)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:49.382917 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-7e85e5a4-2e30-46b2-b72e-71c8282cbe93 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:51:49.382917 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 15:51:49.382917 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 15:51:49.385434 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e85e5a4-2e30-46b2-b72e-71c8282cbe93 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:49.434101 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7e85e5a4-2e30-46b2-b72e-71c8282cbe93 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '202c2854b11b4c0bad4a908445f33c53'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:49.450812 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7e85e5a4-2e30-46b2-b72e-71c8282cbe93 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '202c2854b11b4c0bad4a908445f33c53'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:49.505795 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3efd35-dc3f-4e21-b38f-be72b9b3d007 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:49.513582 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70802a1f-02fd-4b41-b162-ad13ab3c4ed7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:49.514382 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70802a1f-02fd-4b41-b162-ad13ab3c4ed7 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:49.514662 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70802a1f-02fd-4b41-b162-ad13ab3c4ed7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:49.514931 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70802a1f-02fd-4b41-b162-ad13ab3c4ed7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:49.517178 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-70802a1f-02fd-4b41-b162-ad13ab3c4ed7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:49.545687 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70802a1f-02fd-4b41-b162-ad13ab3c4ed7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:49.547215 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70802a1f-02fd-4b41-b162-ad13ab3c4ed7 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:49.556031 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7e85e5a4-2e30-46b2-b72e-71c8282cbe93 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '202c2854b11b4c0bad4a908445f33c53', 'request_id': 'req-7e85e5a4-2e30-46b2-b72e-71c8282cbe93'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:49.566606 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2008/4032] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:51:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:51:49.567950 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7e85e5a4-2e30-46b2-b72e-71c8282cbe93 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '202c2854b11b4c0bad4a908445f33c53', 'request_id': 'req-7e85e5a4-2e30-46b2-b72e-71c8282cbe93'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:49.579512 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7e85e5a4-2e30-46b2-b72e-71c8282cbe93 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '202c2854b11b4c0bad4a908445f33c53', 'request_id': 'req-7e85e5a4-2e30-46b2-b72e-71c8282cbe93'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:49.625019 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7e85e5a4-2e30-46b2-b72e-71c8282cbe93 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] The token cache is being invalidate because project 202c2854b11b4c0bad4a908445f33c53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:51:49.625396 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7e85e5a4-2e30-46b2-b72e-71c8282cbe93 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:49.626001 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7e85e5a4-2e30-46b2-b72e-71c8282cbe93 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:49.644174 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7e85e5a4-2e30-46b2-b72e-71c8282cbe93 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '202c2854b11b4c0bad4a908445f33c53', 'request_id': 'req-7e85e5a4-2e30-46b2-b72e-71c8282cbe93'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:49.645373 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7e85e5a4-2e30-46b2-b72e-71c8282cbe93 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '202c2854b11b4c0bad4a908445f33c53', 'request_id': 'req-7e85e5a4-2e30-46b2-b72e-71c8282cbe93'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:49.646426 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7e85e5a4-2e30-46b2-b72e-71c8282cbe93 tempest-GroupsV3TestJSON-257797662 tempest-GroupsV3TestJSON-257797662-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '202c2854b11b4c0bad4a908445f33c53', 'request_id': 'req-7e85e5a4-2e30-46b2-b72e-71c8282cbe93'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:49.669105 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2025/4033] 10.222.0.83 () {58 vars in 1230 bytes} [Mon Aug 29 15:51:49 2022] DELETE /identity/v3/domains/202c2854b11b4c0bad4a908445f33c53 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:49.670330 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70802a1f-02fd-4b41-b162-ad13ab3c4ed7 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:49.672212 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-70802a1f-02fd-4b41-b162-ad13ab3c4ed7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:49.777196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70802a1f-02fd-4b41-b162-ad13ab3c4ed7 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:49.940221 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2743e8-516f-4db0-9405-149989075ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:49.941388 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2743e8-516f-4db0-9405-149989075ff2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:49.941855 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2743e8-516f-4db0-9405-149989075ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:49.942425 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2743e8-516f-4db0-9405-149989075ff2 admin admin] PATH_INFO: `/v3/users/cdfed391809343df825a52bf9abc92bb` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:49.944676 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2743e8-516f-4db0-9405-149989075ff2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdfed391809343df825a52bf9abc92bb)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:49.948180 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2743e8-516f-4db0-9405-149989075ff2 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:49.988509 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:DELETE=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:50.020691 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6a2743e8-516f-4db0-9405-149989075ff2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdfed391809343df825a52bf9abc92bb'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:50.021532 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6a2743e8-516f-4db0-9405-149989075ff2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdfed391809343df825a52bf9abc92bb'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:50.045832 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6a2743e8-516f-4db0-9405-149989075ff2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdfed391809343df825a52bf9abc92bb'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:50.067818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6a2743e8-516f-4db0-9405-149989075ff2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdfed391809343df825a52bf9abc92bb'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:50.068580 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6a2743e8-516f-4db0-9405-149989075ff2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdfed391809343df825a52bf9abc92bb'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:50.095635 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2009/4034] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:51:49 2022] DELETE /identity/v3/users/cdfed391809343df825a52bf9abc92bb => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:50.100821 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b1b80-c98f-4dc7-aa1f-6daf7fc7c429 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:50.101199 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b1b80-c98f-4dc7-aa1f-6daf7fc7c429 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:50.101559 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b1b80-c98f-4dc7-aa1f-6daf7fc7c429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:50.155794 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-9e9b1b80-c98f-4dc7-aa1f-6daf7fc7c429 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:51:50.157730 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9e9b1b80-c98f-4dc7-aa1f-6daf7fc7c429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:50.204407 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:50.312322 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2026/4035] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:51:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:51:50.325520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2743e8-516f-4db0-9405-149989075ff2 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:50.328274 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6a2743e8-516f-4db0-9405-149989075ff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:50.495862 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2743e8-516f-4db0-9405-149989075ff2 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:50.501174 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cca112-d5fa-4096-877d-4bf7af726f7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:50.502011 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cca112-d5fa-4096-877d-4bf7af726f7f service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:50.502338 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cca112-d5fa-4096-877d-4bf7af726f7f service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:50.502855 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cca112-d5fa-4096-877d-4bf7af726f7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:50.519526 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cca112-d5fa-4096-877d-4bf7af726f7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:50.521379 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cca112-d5fa-4096-877d-4bf7af726f7f service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:50.574333 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2010/4036] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:51:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:51:51.895889 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b1b80-c98f-4dc7-aa1f-6daf7fc7c429 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:51.899903 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9e9b1b80-c98f-4dc7-aa1f-6daf7fc7c429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:51.951011 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b1b80-c98f-4dc7-aa1f-6daf7fc7c429 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:51.962576 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185d43b-e3ae-44f3-9d70-ba6f9613d152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:51.963261 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185d43b-e3ae-44f3-9d70-ba6f9613d152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:51.964003 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185d43b-e3ae-44f3-9d70-ba6f9613d152 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:51.964003 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185d43b-e3ae-44f3-9d70-ba6f9613d152 admin admin] PATH_INFO: `/v3/projects/a8df8cbaa7e54c698344025315932b8a` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:51.964972 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0185d43b-e3ae-44f3-9d70-ba6f9613d152 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8df8cbaa7e54c698344025315932b8a)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:51.966899 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0185d43b-e3ae-44f3-9d70-ba6f9613d152 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:52.102406 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0185d43b-e3ae-44f3-9d70-ba6f9613d152 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8df8cbaa7e54c698344025315932b8a', 'request_id': 'req-0185d43b-e3ae-44f3-9d70-ba6f9613d152'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:52.110217 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0185d43b-e3ae-44f3-9d70-ba6f9613d152 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8df8cbaa7e54c698344025315932b8a', 'request_id': 'req-0185d43b-e3ae-44f3-9d70-ba6f9613d152'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:52.122915 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0185d43b-e3ae-44f3-9d70-ba6f9613d152 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8df8cbaa7e54c698344025315932b8a', 'request_id': 'req-0185d43b-e3ae-44f3-9d70-ba6f9613d152'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:52.139226 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0185d43b-e3ae-44f3-9d70-ba6f9613d152 admin admin] The token cache is being invalidate because project a8df8cbaa7e54c698344025315932b8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:51:52.139567 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0185d43b-e3ae-44f3-9d70-ba6f9613d152 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:52.142172 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0185d43b-e3ae-44f3-9d70-ba6f9613d152 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:52.145501 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2027/4037] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:51:51 2022] DELETE /identity/v3/projects/a8df8cbaa7e54c698344025315932b8a => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:52.150375 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cca112-d5fa-4096-877d-4bf7af726f7f service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:52.166437 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cca112-d5fa-4096-877d-4bf7af726f7f service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:52.321624 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe347266-34a1-4d36-95ae-9fbae02ebeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:52.322427 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe347266-34a1-4d36-95ae-9fbae02ebeb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:52.323280 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe347266-34a1-4d36-95ae-9fbae02ebeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:52.323563 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe347266-34a1-4d36-95ae-9fbae02ebeb6 admin admin] PATH_INFO: `/v3/users/2b57b7bc454f4a938c358c9a063d4beb` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:52.327216 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe347266-34a1-4d36-95ae-9fbae02ebeb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b57b7bc454f4a938c358c9a063d4beb)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:52.332704 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe347266-34a1-4d36-95ae-9fbae02ebeb6 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:52.438685 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fe347266-34a1-4d36-95ae-9fbae02ebeb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b57b7bc454f4a938c358c9a063d4beb'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:52.439552 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fe347266-34a1-4d36-95ae-9fbae02ebeb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b57b7bc454f4a938c358c9a063d4beb'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:52.442229 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:52.455661 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fe347266-34a1-4d36-95ae-9fbae02ebeb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b57b7bc454f4a938c358c9a063d4beb'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:52.467751 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fe347266-34a1-4d36-95ae-9fbae02ebeb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b57b7bc454f4a938c358c9a063d4beb'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:52.472811 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fe347266-34a1-4d36-95ae-9fbae02ebeb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b57b7bc454f4a938c358c9a063d4beb'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:52.514150 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2011/4038] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:51:52 2022] DELETE /identity/v3/users/2b57b7bc454f4a938c358c9a063d4beb => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:51:52.974310 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185d43b-e3ae-44f3-9d70-ba6f9613d152 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:52.975918 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0185d43b-e3ae-44f3-9d70-ba6f9613d152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:52.995720 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185d43b-e3ae-44f3-9d70-ba6f9613d152 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:53.137229 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd2824-e81f-4bd1-836d-0f501f5ec599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:53.138120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd2824-e81f-4bd1-836d-0f501f5ec599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:53.138470 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd2824-e81f-4bd1-836d-0f501f5ec599 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:53.138818 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd2824-e81f-4bd1-836d-0f501f5ec599 admin admin] PATH_INFO: `/v3/projects/37dafc5b2ed84ab0a6ed62152e8ff799` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:53.140065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd2824-e81f-4bd1-836d-0f501f5ec599 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37dafc5b2ed84ab0a6ed62152e8ff799)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:53.142761 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd2824-e81f-4bd1-836d-0f501f5ec599 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:53.230143 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-adcd2824-e81f-4bd1-836d-0f501f5ec599 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37dafc5b2ed84ab0a6ed62152e8ff799', 'request_id': 'req-adcd2824-e81f-4bd1-836d-0f501f5ec599'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:53.239932 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-adcd2824-e81f-4bd1-836d-0f501f5ec599 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37dafc5b2ed84ab0a6ed62152e8ff799', 'request_id': 'req-adcd2824-e81f-4bd1-836d-0f501f5ec599'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:53.248256 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:53.261849 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-adcd2824-e81f-4bd1-836d-0f501f5ec599 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37dafc5b2ed84ab0a6ed62152e8ff799', 'request_id': 'req-adcd2824-e81f-4bd1-836d-0f501f5ec599'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:53.287975 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-adcd2824-e81f-4bd1-836d-0f501f5ec599 admin admin] The token cache is being invalidate because project 37dafc5b2ed84ab0a6ed62152e8ff799 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:51:53.288293 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-adcd2824-e81f-4bd1-836d-0f501f5ec599 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:53.289004 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-adcd2824-e81f-4bd1-836d-0f501f5ec599 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:53.293208 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2028/4039] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:51:52 2022] DELETE /identity/v3/projects/37dafc5b2ed84ab0a6ed62152e8ff799 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:53.297951 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f639912-712b-425f-869b-c96d26b5fffc None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:53.298413 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f639912-712b-425f-869b-c96d26b5fffc None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:53.298523 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f639912-712b-425f-869b-c96d26b5fffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:53.328398 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-0f639912-712b-425f-869b-c96d26b5fffc None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:51:53.329974 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0f639912-712b-425f-869b-c96d26b5fffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:53.478623 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2012/4040] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:51:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:51:53.481103 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6edc96-ee30-4049-a40c-e2ae881d3433 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:53.481391 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6edc96-ee30-4049-a40c-e2ae881d3433 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:53.481665 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6edc96-ee30-4049-a40c-e2ae881d3433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:53.575684 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-5a6edc96-ee30-4049-a40c-e2ae881d3433 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:51:53.581403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5a6edc96-ee30-4049-a40c-e2ae881d3433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:53.619140 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f639912-712b-425f-869b-c96d26b5fffc None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:53.619392 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2029/4041] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:51:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:51:53.638224 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f639912-712b-425f-869b-c96d26b5fffc None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:53.647613 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b8ee0-ea75-46c2-9f10-9fa66772f2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:53.648745 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b8ee0-ea75-46c2-9f10-9fa66772f2cb admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:53.649206 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b8ee0-ea75-46c2-9f10-9fa66772f2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:53.649652 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b8ee0-ea75-46c2-9f10-9fa66772f2cb admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:53.653908 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b8ee0-ea75-46c2-9f10-9fa66772f2cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:51:53.654513 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b8ee0-ea75-46c2-9f10-9fa66772f2cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:53.658437 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b8ee0-ea75-46c2-9f10-9fa66772f2cb admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:53.691457 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2013/4042] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:51:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:51:53.696298 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6edc96-ee30-4049-a40c-e2ae881d3433 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:53.716773 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6edc96-ee30-4049-a40c-e2ae881d3433 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:53.728658 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f7234-5dbb-4e4d-a670-058e7b2eab24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:53.729564 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f7234-5dbb-4e4d-a670-058e7b2eab24 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:53.730073 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f7234-5dbb-4e4d-a670-058e7b2eab24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:53.730523 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f7234-5dbb-4e4d-a670-058e7b2eab24 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:53.731371 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f7234-5dbb-4e4d-a670-058e7b2eab24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:53.734340 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f7234-5dbb-4e4d-a670-058e7b2eab24 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:53.832805 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2030/4043] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:51:53 2022] POST /identity/v3/projects => generated 393 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:51:53.838538 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b8ee0-ea75-46c2-9f10-9fa66772f2cb admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:53.861478 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b8ee0-ea75-46c2-9f10-9fa66772f2cb admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:54.029729 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b59bba-0cc4-412c-be80-01835e4a7b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:54.030363 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b59bba-0cc4-412c-be80-01835e4a7b86 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:54.030639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b59bba-0cc4-412c-be80-01835e4a7b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:54.030907 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b59bba-0cc4-412c-be80-01835e4a7b86 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:54.032123 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b59bba-0cc4-412c-be80-01835e4a7b86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:54.034134 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b59bba-0cc4-412c-be80-01835e4a7b86 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:54.099746 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f7234-5dbb-4e4d-a670-058e7b2eab24 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:54.102851 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2014/4044] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:51:53 2022] POST /identity/v3/users => generated 303 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:51:54.112880 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f7234-5dbb-4e4d-a670-058e7b2eab24 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:54.131837 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae898e15-c9f6-49b0-a7d6-6faee253e2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:54.132687 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae898e15-c9f6-49b0-a7d6-6faee253e2e8 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:54.133013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae898e15-c9f6-49b0-a7d6-6faee253e2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:54.133991 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae898e15-c9f6-49b0-a7d6-6faee253e2e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:54.134710 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae898e15-c9f6-49b0-a7d6-6faee253e2e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:54.136394 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae898e15-c9f6-49b0-a7d6-6faee253e2e8 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:54.166955 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2031/4045] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:51:54.170337 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b59bba-0cc4-412c-be80-01835e4a7b86 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:54.192716 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b59bba-0cc4-412c-be80-01835e4a7b86 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:54.208340 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6208f8-03b2-40f0-a991-83d30860e16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:54.218826 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6208f8-03b2-40f0-a991-83d30860e16c admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:54.221894 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6208f8-03b2-40f0-a991-83d30860e16c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:54.223203 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6208f8-03b2-40f0-a991-83d30860e16c admin admin] PATH_INFO: `/v3/projects/b31c153ab25e425bb0d73dcc24d53104/users/75310bc100b2481ca6642d2bd4b54680/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:54.260403 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6208f8-03b2-40f0-a991-83d30860e16c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b31c153ab25e425bb0d73dcc24d53104, user_id=75310bc100b2481ca6642d2bd4b54680, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:54.272476 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6208f8-03b2-40f0-a991-83d30860e16c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:54.311952 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2015/4046] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:51:54 2022] PUT /identity/v3/projects/b31c153ab25e425bb0d73dcc24d53104/users/75310bc100b2481ca6642d2bd4b54680/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:54.313674 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae898e15-c9f6-49b0-a7d6-6faee253e2e8 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:54.361748 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae898e15-c9f6-49b0-a7d6-6faee253e2e8 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:54.516194 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e327b0c9-60db-4a89-91e1-982cb82a709d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:54.516804 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327b0c9-60db-4a89-91e1-982cb82a709d admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:54.517086 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327b0c9-60db-4a89-91e1-982cb82a709d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:54.517362 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327b0c9-60db-4a89-91e1-982cb82a709d admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:54.518050 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e327b0c9-60db-4a89-91e1-982cb82a709d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:54.520098 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e327b0c9-60db-4a89-91e1-982cb82a709d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:54.560963 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2032/4047] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:51:54.565537 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6208f8-03b2-40f0-a991-83d30860e16c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:54.590260 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6208f8-03b2-40f0-a991-83d30860e16c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:54.597342 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d95d07-7b30-4be2-8fbd-5503a135b973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:54.598799 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d95d07-7b30-4be2-8fbd-5503a135b973 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:54.599461 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d95d07-7b30-4be2-8fbd-5503a135b973 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:54.600107 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d95d07-7b30-4be2-8fbd-5503a135b973 admin admin] PATH_INFO: `/v3/projects/b31c153ab25e425bb0d73dcc24d53104/users/75310bc100b2481ca6642d2bd4b54680/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:54.603012 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d95d07-7b30-4be2-8fbd-5503a135b973 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b31c153ab25e425bb0d73dcc24d53104, user_id=75310bc100b2481ca6642d2bd4b54680, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:54.606053 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d95d07-7b30-4be2-8fbd-5503a135b973 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:54.623984 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2016/4048] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:51:54 2022] PUT /identity/v3/projects/b31c153ab25e425bb0d73dcc24d53104/users/75310bc100b2481ca6642d2bd4b54680/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:54.635367 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb9d9c-309b-43e6-90fb-91a7d976d4ee None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:54.635633 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb9d9c-309b-43e6-90fb-91a7d976d4ee None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:54.636408 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb9d9c-309b-43e6-90fb-91a7d976d4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:54.683411 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-97cb9d9c-309b-43e6-90fb-91a7d976d4ee None None] MFA Rules not processed for user `75310bc100b2481ca6642d2bd4b54680`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:51:54.685418 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-97cb9d9c-309b-43e6-90fb-91a7d976d4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:54.786432 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2033/4049] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:51:54 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:51:54.787560 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d95d07-7b30-4be2-8fbd-5503a135b973 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:54.799131 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:INSERT=6,keystone:DELETE=3,keystone:SELECT=91 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:54.884491 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d95d07-7b30-4be2-8fbd-5503a135b973 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:54.890160 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a10ee0-639e-4609-afe3-724c0af80873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:54.890834 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a10ee0-639e-4609-afe3-724c0af80873 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:54.891142 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a10ee0-639e-4609-afe3-724c0af80873 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:54.891413 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a10ee0-639e-4609-afe3-724c0af80873 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:54.892362 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a10ee0-639e-4609-afe3-724c0af80873 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:54.894678 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a10ee0-639e-4609-afe3-724c0af80873 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:54.937932 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2017/4050] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:51:54 2022] POST /identity/v3/projects => generated 393 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:51:54.940316 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb9d9c-309b-43e6-90fb-91a7d976d4ee None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:54.958681 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb9d9c-309b-43e6-90fb-91a7d976d4ee None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:55.004969 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:55.071353 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06705a8b-4e44-4cdb-ab25-3060965e70f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:55.072247 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06705a8b-4e44-4cdb-ab25-3060965e70f3 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:55.072547 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06705a8b-4e44-4cdb-ab25-3060965e70f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:55.075344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06705a8b-4e44-4cdb-ab25-3060965e70f3 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:55.076736 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06705a8b-4e44-4cdb-ab25-3060965e70f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:55.078794 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06705a8b-4e44-4cdb-ab25-3060965e70f3 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:55.119286 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2034/4051] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:51:54 2022] POST /identity/v3/users => generated 297 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:51:55.123141 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a10ee0-639e-4609-afe3-724c0af80873 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:55.140694 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a10ee0-639e-4609-afe3-724c0af80873 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:55.146850 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b20cdf-8b8f-4d1f-b208-d4268f6b0b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:55.148046 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b20cdf-8b8f-4d1f-b208-d4268f6b0b44 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:55.148336 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b20cdf-8b8f-4d1f-b208-d4268f6b0b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:55.148795 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b20cdf-8b8f-4d1f-b208-d4268f6b0b44 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:55.150217 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b20cdf-8b8f-4d1f-b208-d4268f6b0b44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:55.152630 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b20cdf-8b8f-4d1f-b208-d4268f6b0b44 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:55.168745 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2018/4052] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:51:55.172529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06705a8b-4e44-4cdb-ab25-3060965e70f3 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:55.189172 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06705a8b-4e44-4cdb-ab25-3060965e70f3 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:55.194717 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da1a92-de4d-405e-ac46-41739d2f63dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:55.195369 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da1a92-de4d-405e-ac46-41739d2f63dc admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:55.196171 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da1a92-de4d-405e-ac46-41739d2f63dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:55.196447 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da1a92-de4d-405e-ac46-41739d2f63dc admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:55.197111 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da1a92-de4d-405e-ac46-41739d2f63dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:55.198709 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da1a92-de4d-405e-ac46-41739d2f63dc admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:55.210722 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2035/4053] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:51:55.215552 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b20cdf-8b8f-4d1f-b208-d4268f6b0b44 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:55.244790 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b20cdf-8b8f-4d1f-b208-d4268f6b0b44 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:55.250219 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae3d49a-51a0-4e02-a472-aca4e55bb9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:55.251436 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3d49a-51a0-4e02-a472-aca4e55bb9e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:55.252296 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3d49a-51a0-4e02-a472-aca4e55bb9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:55.252673 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3d49a-51a0-4e02-a472-aca4e55bb9e5 admin admin] PATH_INFO: `/v3/projects/076eab09a21a4289a798225ef7249561/users/29bcd172ae43447db26ea08ae3f0c66e/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:55.272415 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae3d49a-51a0-4e02-a472-aca4e55bb9e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=076eab09a21a4289a798225ef7249561, user_id=29bcd172ae43447db26ea08ae3f0c66e, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:55.276244 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae3d49a-51a0-4e02-a472-aca4e55bb9e5 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:55.311997 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2019/4054] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:51:55 2022] PUT /identity/v3/projects/076eab09a21a4289a798225ef7249561/users/29bcd172ae43447db26ea08ae3f0c66e/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:55.324943 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ee0aa-5614-4065-a36d-189173c95d0e None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:55.324943 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ee0aa-5614-4065-a36d-189173c95d0e None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:55.324943 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ee0aa-5614-4065-a36d-189173c95d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:55.383222 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-f85ee0aa-5614-4065-a36d-189173c95d0e None None] MFA Rules not processed for user `29bcd172ae43447db26ea08ae3f0c66e`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:51:55.384870 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f85ee0aa-5614-4065-a36d-189173c95d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:55.486018 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2036/4055] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:51:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:51:55.499380 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae3d49a-51a0-4e02-a472-aca4e55bb9e5 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:55.502799 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9ae3d49a-51a0-4e02-a472-aca4e55bb9e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:55.589166 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae3d49a-51a0-4e02-a472-aca4e55bb9e5 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:55.598820 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115d8be-2757-4758-923a-51831d805181 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6b0f9835ed549cab91d684326be83fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:55.599852 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115d8be-2757-4758-923a-51831d805181 service glance] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:55.602808 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115d8be-2757-4758-923a-51831d805181 service glance] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:55.603226 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115d8be-2757-4758-923a-51831d805181 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:55.730730 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3115d8be-2757-4758-923a-51831d805181 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:55.734704 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3115d8be-2757-4758-923a-51831d805181 service glance] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:55.747288 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2020/4056] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:51:55 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:51:57.205122 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ee0aa-5614-4065-a36d-189173c95d0e None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:57.324391 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ee0aa-5614-4065-a36d-189173c95d0e None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:57.330914 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24687fc2-de97-4978-9d72-40388e32e1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:57.331954 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24687fc2-de97-4978-9d72-40388e32e1dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:57.332485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24687fc2-de97-4978-9d72-40388e32e1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:57.332861 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24687fc2-de97-4978-9d72-40388e32e1dd admin admin] PATH_INFO: `/v3/users/75310bc100b2481ca6642d2bd4b54680` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:57.334933 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24687fc2-de97-4978-9d72-40388e32e1dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=75310bc100b2481ca6642d2bd4b54680)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:57.338162 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24687fc2-de97-4978-9d72-40388e32e1dd admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:57.425295 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:57.433676 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-24687fc2-de97-4978-9d72-40388e32e1dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75310bc100b2481ca6642d2bd4b54680'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:57.437290 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-24687fc2-de97-4978-9d72-40388e32e1dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75310bc100b2481ca6642d2bd4b54680'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:57.475320 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-24687fc2-de97-4978-9d72-40388e32e1dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75310bc100b2481ca6642d2bd4b54680'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:57.491524 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-24687fc2-de97-4978-9d72-40388e32e1dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75310bc100b2481ca6642d2bd4b54680'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:57.506587 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-24687fc2-de97-4978-9d72-40388e32e1dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75310bc100b2481ca6642d2bd4b54680'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:57.518019 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2037/4057] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:51:57 2022] DELETE /identity/v3/users/75310bc100b2481ca6642d2bd4b54680 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:57.523274 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572c29c-0122-48ea-b7a3-17dcd983824f None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:57.524524 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572c29c-0122-48ea-b7a3-17dcd983824f None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:57.524524 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572c29c-0122-48ea-b7a3-17dcd983824f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:57.538682 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:57.560485 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-e572c29c-0122-48ea-b7a3-17dcd983824f None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:51:57.563338 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e572c29c-0122-48ea-b7a3-17dcd983824f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:57.701247 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2021/4058] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:51:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:51:57.738399 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24687fc2-de97-4978-9d72-40388e32e1dd admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:57.741914 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-24687fc2-de97-4978-9d72-40388e32e1dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:57.850307 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24687fc2-de97-4978-9d72-40388e32e1dd admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:57.857208 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3984603a-ee6d-43ac-8f81-6ad8c2a44ab4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:57.858557 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984603a-ee6d-43ac-8f81-6ad8c2a44ab4 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:57.859053 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984603a-ee6d-43ac-8f81-6ad8c2a44ab4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:57.859609 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984603a-ee6d-43ac-8f81-6ad8c2a44ab4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:57.876310 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3984603a-ee6d-43ac-8f81-6ad8c2a44ab4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:57.878189 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3984603a-ee6d-43ac-8f81-6ad8c2a44ab4 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:57.892164 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2038/4059] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:51:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:51:59.684287 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e572c29c-0122-48ea-b7a3-17dcd983824f None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:59.686504 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e572c29c-0122-48ea-b7a3-17dcd983824f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:59.765124 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e572c29c-0122-48ea-b7a3-17dcd983824f None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:59.793760 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c7f41f-baa5-4638-897b-b05ee951662e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:59.795496 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7f41f-baa5-4638-897b-b05ee951662e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:59.796133 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7f41f-baa5-4638-897b-b05ee951662e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:59.799403 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7f41f-baa5-4638-897b-b05ee951662e admin admin] PATH_INFO: `/v3/projects/b31c153ab25e425bb0d73dcc24d53104` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:59.803868 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c7f41f-baa5-4638-897b-b05ee951662e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b31c153ab25e425bb0d73dcc24d53104)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:59.809782 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c7f41f-baa5-4638-897b-b05ee951662e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:59.982397 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-26c7f41f-baa5-4638-897b-b05ee951662e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b31c153ab25e425bb0d73dcc24d53104', 'request_id': 'req-26c7f41f-baa5-4638-897b-b05ee951662e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:00.002403 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-26c7f41f-baa5-4638-897b-b05ee951662e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b31c153ab25e425bb0d73dcc24d53104', 'request_id': 'req-26c7f41f-baa5-4638-897b-b05ee951662e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:00.033191 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-26c7f41f-baa5-4638-897b-b05ee951662e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b31c153ab25e425bb0d73dcc24d53104', 'request_id': 'req-26c7f41f-baa5-4638-897b-b05ee951662e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:00.064222 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-26c7f41f-baa5-4638-897b-b05ee951662e admin admin] The token cache is being invalidate because project b31c153ab25e425bb0d73dcc24d53104 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:52:00.064732 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-26c7f41f-baa5-4638-897b-b05ee951662e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:00.068823 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-26c7f41f-baa5-4638-897b-b05ee951662e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:00.073914 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2022/4060] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:51:59 2022] DELETE /identity/v3/projects/b31c153ab25e425bb0d73dcc24d53104 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:52:00.084082 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3984603a-ee6d-43ac-8f81-6ad8c2a44ab4 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:00.115975 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3984603a-ee6d-43ac-8f81-6ad8c2a44ab4 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:00.290022 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb88b74-73f2-43d8-a018-2987072b1775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:00.291240 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb88b74-73f2-43d8-a018-2987072b1775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:00.296283 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb88b74-73f2-43d8-a018-2987072b1775 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:00.297025 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb88b74-73f2-43d8-a018-2987072b1775 admin admin] PATH_INFO: `/v3/users/29bcd172ae43447db26ea08ae3f0c66e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:00.306246 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb88b74-73f2-43d8-a018-2987072b1775 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29bcd172ae43447db26ea08ae3f0c66e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:00.310432 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb88b74-73f2-43d8-a018-2987072b1775 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:00.473243 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8cb88b74-73f2-43d8-a018-2987072b1775 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29bcd172ae43447db26ea08ae3f0c66e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:00.474109 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8cb88b74-73f2-43d8-a018-2987072b1775 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29bcd172ae43447db26ea08ae3f0c66e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:00.489023 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:00.490811 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8cb88b74-73f2-43d8-a018-2987072b1775 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29bcd172ae43447db26ea08ae3f0c66e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:00.502581 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8cb88b74-73f2-43d8-a018-2987072b1775 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29bcd172ae43447db26ea08ae3f0c66e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:00.514674 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8cb88b74-73f2-43d8-a018-2987072b1775 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29bcd172ae43447db26ea08ae3f0c66e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:00.528367 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2039/4061] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:52:00 2022] DELETE /identity/v3/users/29bcd172ae43447db26ea08ae3f0c66e => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:52:01.145862 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c7f41f-baa5-4638-897b-b05ee951662e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:01.149704 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-26c7f41f-baa5-4638-897b-b05ee951662e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:01.193461 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c7f41f-baa5-4638-897b-b05ee951662e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:01.332609 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73641f0f-6c3e-4811-a8fb-1d573d007087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:01.332977 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73641f0f-6c3e-4811-a8fb-1d573d007087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:01.333259 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73641f0f-6c3e-4811-a8fb-1d573d007087 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:01.333549 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73641f0f-6c3e-4811-a8fb-1d573d007087 admin admin] PATH_INFO: `/v3/projects/076eab09a21a4289a798225ef7249561` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:01.347530 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73641f0f-6c3e-4811-a8fb-1d573d007087 admin admin] RBAC: Authorizing `identity:delete_project(project_id=076eab09a21a4289a798225ef7249561)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:01.356550 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73641f0f-6c3e-4811-a8fb-1d573d007087 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:01.460963 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:01.507278 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-73641f0f-6c3e-4811-a8fb-1d573d007087 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '076eab09a21a4289a798225ef7249561', 'request_id': 'req-73641f0f-6c3e-4811-a8fb-1d573d007087'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:01.531778 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-73641f0f-6c3e-4811-a8fb-1d573d007087 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '076eab09a21a4289a798225ef7249561', 'request_id': 'req-73641f0f-6c3e-4811-a8fb-1d573d007087'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:01.551511 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-73641f0f-6c3e-4811-a8fb-1d573d007087 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '076eab09a21a4289a798225ef7249561', 'request_id': 'req-73641f0f-6c3e-4811-a8fb-1d573d007087'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:01.589419 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-73641f0f-6c3e-4811-a8fb-1d573d007087 admin admin] The token cache is being invalidate because project 076eab09a21a4289a798225ef7249561 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:52:01.589649 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-73641f0f-6c3e-4811-a8fb-1d573d007087 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:01.590299 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-73641f0f-6c3e-4811-a8fb-1d573d007087 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:01.595520 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2023/4062] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:52:01 2022] DELETE /identity/v3/projects/076eab09a21a4289a798225ef7249561 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:52:01.597679 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ade83-ca17-40de-b4a5-0bbfba922e17 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:01.598766 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ade83-ca17-40de-b4a5-0bbfba922e17 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:01.599245 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ade83-ca17-40de-b4a5-0bbfba922e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:01.646666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-896ade83-ca17-40de-b4a5-0bbfba922e17 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:01.650777 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-896ade83-ca17-40de-b4a5-0bbfba922e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:01.857365 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2040/4063] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:52:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:01.865270 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933522b1-50a5-4b3f-8d81-56e01470be7a None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:01.865600 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933522b1-50a5-4b3f-8d81-56e01470be7a None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:01.865838 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933522b1-50a5-4b3f-8d81-56e01470be7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:01.904457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-933522b1-50a5-4b3f-8d81-56e01470be7a None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:01.905704 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-933522b1-50a5-4b3f-8d81-56e01470be7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:01.943571 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2024/4064] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:52:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:01.950468 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ade83-ca17-40de-b4a5-0bbfba922e17 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:01.964098 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ade83-ca17-40de-b4a5-0bbfba922e17 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:01.982825 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcdedbc-b654-4f3e-823e-347833d52b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:01.986180 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcdedbc-b654-4f3e-823e-347833d52b7a admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:01.986917 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcdedbc-b654-4f3e-823e-347833d52b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:01.990216 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcdedbc-b654-4f3e-823e-347833d52b7a admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:01.991230 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcdedbc-b654-4f3e-823e-347833d52b7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:52:01.991699 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcdedbc-b654-4f3e-823e-347833d52b7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:02.009179 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcdedbc-b654-4f3e-823e-347833d52b7a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:02.033294 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2041/4065] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:52:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:52:02.037635 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933522b1-50a5-4b3f-8d81-56e01470be7a None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:02.048568 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933522b1-50a5-4b3f-8d81-56e01470be7a None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:02.055299 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88a5c1-77aa-48c9-b3f9-be8f265b08a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:02.056299 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88a5c1-77aa-48c9-b3f9-be8f265b08a2 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:02.056951 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88a5c1-77aa-48c9-b3f9-be8f265b08a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:02.057424 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88a5c1-77aa-48c9-b3f9-be8f265b08a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:02.058488 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88a5c1-77aa-48c9-b3f9-be8f265b08a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:02.060669 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88a5c1-77aa-48c9-b3f9-be8f265b08a2 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:02.099997 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2025/4066] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:52:02 2022] POST /identity/v3/projects => generated 399 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:52:02.104639 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcdedbc-b654-4f3e-823e-347833d52b7a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:02.115252 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcdedbc-b654-4f3e-823e-347833d52b7a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:02.243825 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9444a4-bc66-4eb5-a3c6-ed07569d954a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:02.244489 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9444a4-bc66-4eb5-a3c6-ed07569d954a admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:02.244908 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9444a4-bc66-4eb5-a3c6-ed07569d954a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:02.245189 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9444a4-bc66-4eb5-a3c6-ed07569d954a admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:02.245837 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9444a4-bc66-4eb5-a3c6-ed07569d954a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:02.247821 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9444a4-bc66-4eb5-a3c6-ed07569d954a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:02.280939 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2042/4067] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:52:02 2022] POST /identity/v3/users => generated 306 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:52:02.285499 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88a5c1-77aa-48c9-b3f9-be8f265b08a2 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:02.300156 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88a5c1-77aa-48c9-b3f9-be8f265b08a2 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:02.307855 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d7bba-9a21-41f5-b9bf-df19612fb903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:02.309106 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d7bba-9a21-41f5-b9bf-df19612fb903 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:02.309937 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d7bba-9a21-41f5-b9bf-df19612fb903 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:02.310371 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d7bba-9a21-41f5-b9bf-df19612fb903 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:02.324355 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d7bba-9a21-41f5-b9bf-df19612fb903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:02.326275 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d7bba-9a21-41f5-b9bf-df19612fb903 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:02.340041 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2026/4068] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:52:02 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:52:02.344003 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9444a4-bc66-4eb5-a3c6-ed07569d954a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:02.356883 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9444a4-bc66-4eb5-a3c6-ed07569d954a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:02.362821 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7d0c2-3a01-49e1-baa3-c09a05beba30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:02.363898 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7d0c2-3a01-49e1-baa3-c09a05beba30 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:02.364240 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7d0c2-3a01-49e1-baa3-c09a05beba30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:02.364578 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7d0c2-3a01-49e1-baa3-c09a05beba30 admin admin] PATH_INFO: `/v3/projects/44fcc5f1408f46868c8737cdad79bcea/users/cada4fbbf0b44bf794048e9a9bb1c1ea/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:02.410747 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7d0c2-3a01-49e1-baa3-c09a05beba30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44fcc5f1408f46868c8737cdad79bcea, user_id=cada4fbbf0b44bf794048e9a9bb1c1ea, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:02.425136 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7d0c2-3a01-49e1-baa3-c09a05beba30 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:02.467600 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2043/4069] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:52:02 2022] PUT /identity/v3/projects/44fcc5f1408f46868c8737cdad79bcea/users/cada4fbbf0b44bf794048e9a9bb1c1ea/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:52:02.469273 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d7bba-9a21-41f5-b9bf-df19612fb903 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:02.494164 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d7bba-9a21-41f5-b9bf-df19612fb903 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:02.619669 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e105b-2f16-43e9-acd4-d9efe725f147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:02.620211 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e105b-2f16-43e9-acd4-d9efe725f147 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:02.620487 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e105b-2f16-43e9-acd4-d9efe725f147 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:02.620758 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e105b-2f16-43e9-acd4-d9efe725f147 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:02.621405 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e105b-2f16-43e9-acd4-d9efe725f147 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:02.627442 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e105b-2f16-43e9-acd4-d9efe725f147 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:02.641931 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2027/4070] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:52:02 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:52:02.647445 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7d0c2-3a01-49e1-baa3-c09a05beba30 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:02.661804 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7d0c2-3a01-49e1-baa3-c09a05beba30 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:02.676610 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ea570-773a-4944-ad37-5743ca08fcca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:02.677775 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ea570-773a-4944-ad37-5743ca08fcca admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:02.678698 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ea570-773a-4944-ad37-5743ca08fcca admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:02.680559 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ea570-773a-4944-ad37-5743ca08fcca admin admin] PATH_INFO: `/v3/projects/44fcc5f1408f46868c8737cdad79bcea/users/cada4fbbf0b44bf794048e9a9bb1c1ea/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:02.685335 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ea570-773a-4944-ad37-5743ca08fcca admin admin] RBAC: Authorizing `identity:create_grant(project_id=44fcc5f1408f46868c8737cdad79bcea, user_id=cada4fbbf0b44bf794048e9a9bb1c1ea, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:02.689740 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ea570-773a-4944-ad37-5743ca08fcca admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:02.735116 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2044/4071] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:52:02 2022] PUT /identity/v3/projects/44fcc5f1408f46868c8737cdad79bcea/users/cada4fbbf0b44bf794048e9a9bb1c1ea/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:52:02.737355 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af254ce5-857b-44d3-8db3-16502835ed58 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:02.737667 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af254ce5-857b-44d3-8db3-16502835ed58 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:02.737946 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af254ce5-857b-44d3-8db3-16502835ed58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:02.787919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-af254ce5-857b-44d3-8db3-16502835ed58 None None] MFA Rules not processed for user `cada4fbbf0b44bf794048e9a9bb1c1ea`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:02.790167 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-af254ce5-857b-44d3-8db3-16502835ed58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:02.882107 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:02.929875 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2028/4072] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:52:02 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:02.935128 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ea570-773a-4944-ad37-5743ca08fcca admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:02.984553 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:DELETE=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:03.065381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ea570-773a-4944-ad37-5743ca08fcca admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:03.082228 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29ec67-7bab-4361-970e-d57aba13efac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:03.083100 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29ec67-7bab-4361-970e-d57aba13efac admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:03.084734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29ec67-7bab-4361-970e-d57aba13efac admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:03.085451 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29ec67-7bab-4361-970e-d57aba13efac admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:03.088052 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e29ec67-7bab-4361-970e-d57aba13efac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:03.091250 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e29ec67-7bab-4361-970e-d57aba13efac admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:03.156674 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2045/4073] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:52:02 2022] POST /identity/v3/projects => generated 397 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:52:03.161692 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af254ce5-857b-44d3-8db3-16502835ed58 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:03.177381 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af254ce5-857b-44d3-8db3-16502835ed58 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:03.358747 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53f38a-c428-431f-8202-5660eca213b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:03.359475 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53f38a-c428-431f-8202-5660eca213b9 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:03.363250 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53f38a-c428-431f-8202-5660eca213b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:03.364963 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53f38a-c428-431f-8202-5660eca213b9 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:03.369986 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53f38a-c428-431f-8202-5660eca213b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:03.373691 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53f38a-c428-431f-8202-5660eca213b9 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:03.476013 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2029/4074] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:52:03 2022] POST /identity/v3/users => generated 299 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:52:03.480513 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29ec67-7bab-4361-970e-d57aba13efac admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:03.503740 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29ec67-7bab-4361-970e-d57aba13efac admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:03.515829 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc5f3a-945a-46ba-9dfc-8244de08be00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:03.516479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc5f3a-945a-46ba-9dfc-8244de08be00 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:03.516838 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc5f3a-945a-46ba-9dfc-8244de08be00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:03.517169 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc5f3a-945a-46ba-9dfc-8244de08be00 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:03.518803 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cc5f3a-945a-46ba-9dfc-8244de08be00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:03.520499 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cc5f3a-945a-46ba-9dfc-8244de08be00 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:03.538424 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53f38a-c428-431f-8202-5660eca213b9 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:03.539981 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2046/4075] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:52:03.553783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53f38a-c428-431f-8202-5660eca213b9 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:03.564954 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a42ae37-8fbc-4555-9b2d-06c3e2a97375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:03.565770 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42ae37-8fbc-4555-9b2d-06c3e2a97375 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:03.566183 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42ae37-8fbc-4555-9b2d-06c3e2a97375 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:03.568062 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42ae37-8fbc-4555-9b2d-06c3e2a97375 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:03.568062 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a42ae37-8fbc-4555-9b2d-06c3e2a97375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:03.569733 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a42ae37-8fbc-4555-9b2d-06c3e2a97375 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:03.590322 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2030/4076] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:52:03.591432 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc5f3a-945a-46ba-9dfc-8244de08be00 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:03.606016 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc5f3a-945a-46ba-9dfc-8244de08be00 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:03.611387 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed982d4-e703-4bf0-b463-62c4ce07700d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:03.612281 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed982d4-e703-4bf0-b463-62c4ce07700d admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:03.612657 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed982d4-e703-4bf0-b463-62c4ce07700d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:03.613039 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed982d4-e703-4bf0-b463-62c4ce07700d admin admin] PATH_INFO: `/v3/projects/02fd7164926b4b58a396372dd48fa647/users/5b0ed1a267254696ad04183c4f5aba6c/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:03.639100 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed982d4-e703-4bf0-b463-62c4ce07700d admin admin] RBAC: Authorizing `identity:create_grant(project_id=02fd7164926b4b58a396372dd48fa647, user_id=5b0ed1a267254696ad04183c4f5aba6c, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:03.642342 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed982d4-e703-4bf0-b463-62c4ce07700d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:03.687951 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2047/4077] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:52:03 2022] PUT /identity/v3/projects/02fd7164926b4b58a396372dd48fa647/users/5b0ed1a267254696ad04183c4f5aba6c/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:52:03.707283 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9feb171-51c2-439c-ab59-695c463aa3e0 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:03.708982 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9feb171-51c2-439c-ab59-695c463aa3e0 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:03.709505 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9feb171-51c2-439c-ab59-695c463aa3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:03.767427 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-d9feb171-51c2-439c-ab59-695c463aa3e0 None None] MFA Rules not processed for user `5b0ed1a267254696ad04183c4f5aba6c`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:03.769597 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d9feb171-51c2-439c-ab59-695c463aa3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:03.905502 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2031/4078] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:52:03 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:03.922927 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed982d4-e703-4bf0-b463-62c4ce07700d admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:03.926397 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9ed982d4-e703-4bf0-b463-62c4ce07700d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:04.090612 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed982d4-e703-4bf0-b463-62c4ce07700d admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:04.102439 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719c305-ca03-446e-86fd-c03f8e4895f6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6b0f9835ed549cab91d684326be83fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:04.102439 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719c305-ca03-446e-86fd-c03f8e4895f6 service glance] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:04.102879 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719c305-ca03-446e-86fd-c03f8e4895f6 service glance] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:04.103324 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719c305-ca03-446e-86fd-c03f8e4895f6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:04.292013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1719c305-ca03-446e-86fd-c03f8e4895f6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:04.293504 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1719c305-ca03-446e-86fd-c03f8e4895f6 service glance] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:04.324020 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2048/4079] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:52:03 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:52:04.332337 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9feb171-51c2-439c-ab59-695c463aa3e0 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:04.333896 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d9feb171-51c2-439c-ab59-695c463aa3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:04.489288 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9feb171-51c2-439c-ab59-695c463aa3e0 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:04.516725 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f8122c-ee3f-48ab-9295-769d4f502500 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:04.517773 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8122c-ee3f-48ab-9295-769d4f502500 service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:04.518059 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8122c-ee3f-48ab-9295-769d4f502500 service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:04.518354 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8122c-ee3f-48ab-9295-769d4f502500 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:04.524381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719c305-ca03-446e-86fd-c03f8e4895f6 service glance] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:04.526170 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1719c305-ca03-446e-86fd-c03f8e4895f6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:04.534566 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-92f8122c-ee3f-48ab-9295-769d4f502500 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:04.566391 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f8122c-ee3f-48ab-9295-769d4f502500 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:04.569167 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f8122c-ee3f-48ab-9295-769d4f502500 service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:04.569739 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:04.575727 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:04.585002 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2032/4080] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:52:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:52:04.742502 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719c305-ca03-446e-86fd-c03f8e4895f6 service glance] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:04.766353 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80856fa0-6500-46ab-9919-3e2a0260eb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:04.766813 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80856fa0-6500-46ab-9919-3e2a0260eb57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:04.767306 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80856fa0-6500-46ab-9919-3e2a0260eb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:04.767731 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80856fa0-6500-46ab-9919-3e2a0260eb57 admin admin] PATH_INFO: `/v3/users/00dee611719b433284d4258833021ec6` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:04.769025 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80856fa0-6500-46ab-9919-3e2a0260eb57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00dee611719b433284d4258833021ec6)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:04.786493 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80856fa0-6500-46ab-9919-3e2a0260eb57 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:04.909442 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-80856fa0-6500-46ab-9919-3e2a0260eb57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00dee611719b433284d4258833021ec6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:04.910397 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-80856fa0-6500-46ab-9919-3e2a0260eb57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00dee611719b433284d4258833021ec6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:04.948203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-80856fa0-6500-46ab-9919-3e2a0260eb57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00dee611719b433284d4258833021ec6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:04.962730 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-80856fa0-6500-46ab-9919-3e2a0260eb57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00dee611719b433284d4258833021ec6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:04.977263 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-80856fa0-6500-46ab-9919-3e2a0260eb57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00dee611719b433284d4258833021ec6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:04.994382 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2049/4081] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:52:04 2022] DELETE /identity/v3/users/00dee611719b433284d4258833021ec6 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:52:05.174032 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f8122c-ee3f-48ab-9295-769d4f502500 service placement] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:05.186907 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f8122c-ee3f-48ab-9295-769d4f502500 service placement] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:05.276980 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b33f21f-bd98-42a1-871a-ee30ac146324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:05.278185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33f21f-bd98-42a1-871a-ee30ac146324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:05.278779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33f21f-bd98-42a1-871a-ee30ac146324 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:05.279237 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33f21f-bd98-42a1-871a-ee30ac146324 admin admin] PATH_INFO: `/v3/users/cada4fbbf0b44bf794048e9a9bb1c1ea` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:05.281379 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b33f21f-bd98-42a1-871a-ee30ac146324 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cada4fbbf0b44bf794048e9a9bb1c1ea)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:05.286764 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b33f21f-bd98-42a1-871a-ee30ac146324 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:05.363702 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80856fa0-6500-46ab-9919-3e2a0260eb57 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:05.365465 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-80856fa0-6500-46ab-9919-3e2a0260eb57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:05.415934 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80856fa0-6500-46ab-9919-3e2a0260eb57 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:05.420092 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6b33f21f-bd98-42a1-871a-ee30ac146324 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cada4fbbf0b44bf794048e9a9bb1c1ea'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:05.421145 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6b33f21f-bd98-42a1-871a-ee30ac146324 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cada4fbbf0b44bf794048e9a9bb1c1ea'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:05.432450 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363db9d4-fc1b-41e2-8eb0-82809a8aed6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:05.433157 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363db9d4-fc1b-41e2-8eb0-82809a8aed6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:05.433433 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363db9d4-fc1b-41e2-8eb0-82809a8aed6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:05.433716 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363db9d4-fc1b-41e2-8eb0-82809a8aed6a admin admin] PATH_INFO: `/v3/projects/befd8f594a954a1ea3ea172fafed14a3` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:05.437690 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363db9d4-fc1b-41e2-8eb0-82809a8aed6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=befd8f594a954a1ea3ea172fafed14a3)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:05.443931 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363db9d4-fc1b-41e2-8eb0-82809a8aed6a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:05.445100 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6b33f21f-bd98-42a1-871a-ee30ac146324 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cada4fbbf0b44bf794048e9a9bb1c1ea'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:05.468018 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6b33f21f-bd98-42a1-871a-ee30ac146324 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cada4fbbf0b44bf794048e9a9bb1c1ea'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:05.469107 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6b33f21f-bd98-42a1-871a-ee30ac146324 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cada4fbbf0b44bf794048e9a9bb1c1ea'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:05.524885 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2033/4082] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:52:05 2022] DELETE /identity/v3/users/cada4fbbf0b44bf794048e9a9bb1c1ea => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:52:05.529908 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf7c65-522e-4bbd-90dd-095fa8708ec1 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:05.530420 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf7c65-522e-4bbd-90dd-095fa8708ec1 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:05.530779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf7c65-522e-4bbd-90dd-095fa8708ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:05.553959 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-62cf7c65-522e-4bbd-90dd-095fa8708ec1 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:05.555964 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-62cf7c65-522e-4bbd-90dd-095fa8708ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:05.575708 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-363db9d4-fc1b-41e2-8eb0-82809a8aed6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'befd8f594a954a1ea3ea172fafed14a3', 'request_id': 'req-363db9d4-fc1b-41e2-8eb0-82809a8aed6a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:05.582451 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-363db9d4-fc1b-41e2-8eb0-82809a8aed6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'befd8f594a954a1ea3ea172fafed14a3', 'request_id': 'req-363db9d4-fc1b-41e2-8eb0-82809a8aed6a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:05.593177 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-363db9d4-fc1b-41e2-8eb0-82809a8aed6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'befd8f594a954a1ea3ea172fafed14a3', 'request_id': 'req-363db9d4-fc1b-41e2-8eb0-82809a8aed6a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:05.612027 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-363db9d4-fc1b-41e2-8eb0-82809a8aed6a admin admin] The token cache is being invalidate because project befd8f594a954a1ea3ea172fafed14a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:52:05.612357 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-363db9d4-fc1b-41e2-8eb0-82809a8aed6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:05.613048 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-363db9d4-fc1b-41e2-8eb0-82809a8aed6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:05.615089 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2050/4083] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:52:05 2022] DELETE /identity/v3/projects/befd8f594a954a1ea3ea172fafed14a3 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:52:05.620628 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c83b2f-ebd5-493d-99ee-ad1d3716a6cb None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:05.620991 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c83b2f-ebd5-493d-99ee-ad1d3716a6cb None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:05.621387 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c83b2f-ebd5-493d-99ee-ad1d3716a6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:05.646761 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2034/4084] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:52:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:05.652238 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-63c83b2f-ebd5-493d-99ee-ad1d3716a6cb None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:05.653564 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-63c83b2f-ebd5-493d-99ee-ad1d3716a6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:05.659883 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf7c65-522e-4bbd-90dd-095fa8708ec1 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:05.661304 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-62cf7c65-522e-4bbd-90dd-095fa8708ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:05.667171 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2051/4085] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:52:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:52:05.675067 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a76157-f3f9-4d99-9ea4-3fc3678f7b25 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:05.675686 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a76157-f3f9-4d99-9ea4-3fc3678f7b25 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:05.676764 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a76157-f3f9-4d99-9ea4-3fc3678f7b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:05.700143 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:05.703818 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-d3a76157-f3f9-4d99-9ea4-3fc3678f7b25 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:05.705174 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d3a76157-f3f9-4d99-9ea4-3fc3678f7b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:05.715381 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2052/4086] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:52:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:05.719601 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a76157-f3f9-4d99-9ea4-3fc3678f7b25 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:05.730086 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a76157-f3f9-4d99-9ea4-3fc3678f7b25 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:05.738738 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c68db-b545-4fc3-aefc-c958b65c0684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:05.741599 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c68db-b545-4fc3-aefc-c958b65c0684 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:05.742118 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c68db-b545-4fc3-aefc-c958b65c0684 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:05.742772 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c68db-b545-4fc3-aefc-c958b65c0684 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:05.744307 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48c68db-b545-4fc3-aefc-c958b65c0684 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:52:05.744835 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48c68db-b545-4fc3-aefc-c958b65c0684 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:05.747128 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48c68db-b545-4fc3-aefc-c958b65c0684 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:05.752485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:05.772416 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf7c65-522e-4bbd-90dd-095fa8708ec1 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:05.778884 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2053/4087] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:52:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:52:05.783477 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c68db-b545-4fc3-aefc-c958b65c0684 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:05.783657 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2111b-ed17-43d4-9db2-1931ce656736 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:05.784261 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2111b-ed17-43d4-9db2-1931ce656736 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:05.784470 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2111b-ed17-43d4-9db2-1931ce656736 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:05.784782 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2111b-ed17-43d4-9db2-1931ce656736 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:05.797525 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e2111b-ed17-43d4-9db2-1931ce656736 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:05.797901 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c68db-b545-4fc3-aefc-c958b65c0684 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:05.799320 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e2111b-ed17-43d4-9db2-1931ce656736 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:05.803863 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab8cbb-01bc-4ba9-aa68-78f9b460eb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:05.804961 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab8cbb-01bc-4ba9-aa68-78f9b460eb83 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:05.805245 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab8cbb-01bc-4ba9-aa68-78f9b460eb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:05.805522 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab8cbb-01bc-4ba9-aa68-78f9b460eb83 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:05.806329 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab8cbb-01bc-4ba9-aa68-78f9b460eb83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:05.808309 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab8cbb-01bc-4ba9-aa68-78f9b460eb83 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:05.811318 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2035/4088] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:52:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:52:05.851101 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2054/4089] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:52:05 2022] POST /identity/v3/projects => generated 387 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:52:05.856538 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2111b-ed17-43d4-9db2-1931ce656736 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:05.868786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2111b-ed17-43d4-9db2-1931ce656736 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:05.999867 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31272b49-8e87-42a4-a976-74dc03f64cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:06.000871 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31272b49-8e87-42a4-a976-74dc03f64cc0 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:06.001253 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31272b49-8e87-42a4-a976-74dc03f64cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:06.001606 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31272b49-8e87-42a4-a976-74dc03f64cc0 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:06.002262 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31272b49-8e87-42a4-a976-74dc03f64cc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:06.004745 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31272b49-8e87-42a4-a976-74dc03f64cc0 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:06.043526 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2036/4090] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:52:05 2022] POST /identity/v3/users => generated 294 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:52:06.051117 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab8cbb-01bc-4ba9-aa68-78f9b460eb83 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:06.063585 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab8cbb-01bc-4ba9-aa68-78f9b460eb83 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:06.069594 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5ef24-976e-4195-aedc-139b1a23f67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:06.069594 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5ef24-976e-4195-aedc-139b1a23f67c admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:06.070350 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5ef24-976e-4195-aedc-139b1a23f67c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:06.070771 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5ef24-976e-4195-aedc-139b1a23f67c admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:06.072028 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf5ef24-976e-4195-aedc-139b1a23f67c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:06.074360 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf5ef24-976e-4195-aedc-139b1a23f67c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:06.092008 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2055/4091] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:52:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:52:06.092796 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31272b49-8e87-42a4-a976-74dc03f64cc0 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:06.113708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31272b49-8e87-42a4-a976-74dc03f64cc0 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:06.137563 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc253abc-118c-4deb-bb2b-fe355788930a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:06.137563 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc253abc-118c-4deb-bb2b-fe355788930a admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:06.137563 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc253abc-118c-4deb-bb2b-fe355788930a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:06.137563 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc253abc-118c-4deb-bb2b-fe355788930a admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:06.137930 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc253abc-118c-4deb-bb2b-fe355788930a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:06.143792 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc253abc-118c-4deb-bb2b-fe355788930a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:06.166367 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5ef24-976e-4195-aedc-139b1a23f67c admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:06.174248 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2037/4092] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:52:06 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:52:06.179314 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5ef24-976e-4195-aedc-139b1a23f67c admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:06.186948 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a17059-a276-456c-8a3b-4eaf83a3fdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:06.188429 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a17059-a276-456c-8a3b-4eaf83a3fdff admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:06.189476 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a17059-a276-456c-8a3b-4eaf83a3fdff admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:06.190051 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a17059-a276-456c-8a3b-4eaf83a3fdff admin admin] PATH_INFO: `/v3/projects/6167c4b90db44255a54a9d702d087f9b/users/b5af3adb21364148ab7246a9dd76c64b/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:06.235361 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a17059-a276-456c-8a3b-4eaf83a3fdff admin admin] RBAC: Authorizing `identity:create_grant(project_id=6167c4b90db44255a54a9d702d087f9b, user_id=b5af3adb21364148ab7246a9dd76c64b, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:06.239182 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a17059-a276-456c-8a3b-4eaf83a3fdff admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:06.280032 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee417421-ae50-4368-8c82-0fe7713a14f2 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:06.281248 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee417421-ae50-4368-8c82-0fe7713a14f2 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:06.282163 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee417421-ae50-4368-8c82-0fe7713a14f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:06.304309 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2056/4093] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:52:06 2022] PUT /identity/v3/projects/6167c4b90db44255a54a9d702d087f9b/users/b5af3adb21364148ab7246a9dd76c64b/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:52:06.325881 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-ee417421-ae50-4368-8c82-0fe7713a14f2 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:06.328407 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ee417421-ae50-4368-8c82-0fe7713a14f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:06.450048 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2038/4094] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:52:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:06.462638 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a17059-a276-456c-8a3b-4eaf83a3fdff admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:06.464640 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e8a17059-a276-456c-8a3b-4eaf83a3fdff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:06.558677 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a17059-a276-456c-8a3b-4eaf83a3fdff admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:06.565362 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923883fd-314e-4038-abc9-193d09dead4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:06.566144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923883fd-314e-4038-abc9-193d09dead4c service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:06.566268 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923883fd-314e-4038-abc9-193d09dead4c service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:06.566475 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923883fd-314e-4038-abc9-193d09dead4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:06.587322 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923883fd-314e-4038-abc9-193d09dead4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:06.589034 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923883fd-314e-4038-abc9-193d09dead4c service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:06.600952 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2057/4095] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:52:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:52:06.680405 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee417421-ae50-4368-8c82-0fe7713a14f2 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:06.683270 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ee417421-ae50-4368-8c82-0fe7713a14f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:06.718295 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee417421-ae50-4368-8c82-0fe7713a14f2 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:06.731508 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af70748-5b03-48f8-b2a4-56b27e58251a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:06.733977 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af70748-5b03-48f8-b2a4-56b27e58251a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:06.734317 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af70748-5b03-48f8-b2a4-56b27e58251a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:06.734598 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af70748-5b03-48f8-b2a4-56b27e58251a admin admin] PATH_INFO: `/v3/projects/44fcc5f1408f46868c8737cdad79bcea` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:06.739109 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af70748-5b03-48f8-b2a4-56b27e58251a admin admin] RBAC: Authorizing `identity:delete_project(project_id=44fcc5f1408f46868c8737cdad79bcea)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:06.744471 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af70748-5b03-48f8-b2a4-56b27e58251a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:06.832687 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:06.868372 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8af70748-5b03-48f8-b2a4-56b27e58251a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44fcc5f1408f46868c8737cdad79bcea', 'request_id': 'req-8af70748-5b03-48f8-b2a4-56b27e58251a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:06.889936 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8af70748-5b03-48f8-b2a4-56b27e58251a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44fcc5f1408f46868c8737cdad79bcea', 'request_id': 'req-8af70748-5b03-48f8-b2a4-56b27e58251a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:06.896679 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8af70748-5b03-48f8-b2a4-56b27e58251a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44fcc5f1408f46868c8737cdad79bcea', 'request_id': 'req-8af70748-5b03-48f8-b2a4-56b27e58251a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:06.927136 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8af70748-5b03-48f8-b2a4-56b27e58251a admin admin] The token cache is being invalidate because project 44fcc5f1408f46868c8737cdad79bcea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:52:06.927488 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8af70748-5b03-48f8-b2a4-56b27e58251a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:06.935597 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8af70748-5b03-48f8-b2a4-56b27e58251a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:06.940817 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2039/4096] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:52:06 2022] DELETE /identity/v3/projects/44fcc5f1408f46868c8737cdad79bcea => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:52:06.942018 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923883fd-314e-4038-abc9-193d09dead4c service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:06.956353 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923883fd-314e-4038-abc9-193d09dead4c service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:07.126347 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21757787-f5d7-487d-ba90-ad48d5568f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:07.127017 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21757787-f5d7-487d-ba90-ad48d5568f36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:07.127324 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21757787-f5d7-487d-ba90-ad48d5568f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:07.127591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21757787-f5d7-487d-ba90-ad48d5568f36 admin admin] PATH_INFO: `/v3/users/5b0ed1a267254696ad04183c4f5aba6c` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:07.132578 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21757787-f5d7-487d-ba90-ad48d5568f36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b0ed1a267254696ad04183c4f5aba6c)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:07.137182 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21757787-f5d7-487d-ba90-ad48d5568f36 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:07.215759 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:07.220865 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-21757787-f5d7-487d-ba90-ad48d5568f36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b0ed1a267254696ad04183c4f5aba6c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:07.222021 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-21757787-f5d7-487d-ba90-ad48d5568f36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b0ed1a267254696ad04183c4f5aba6c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:07.247391 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-21757787-f5d7-487d-ba90-ad48d5568f36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b0ed1a267254696ad04183c4f5aba6c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:07.257531 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-21757787-f5d7-487d-ba90-ad48d5568f36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b0ed1a267254696ad04183c4f5aba6c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:07.269281 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-21757787-f5d7-487d-ba90-ad48d5568f36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b0ed1a267254696ad04183c4f5aba6c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:07.283052 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2058/4097] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:52:06 2022] DELETE /identity/v3/users/5b0ed1a267254696ad04183c4f5aba6c => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:52:07.960674 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b88b0-b5c9-4705-93b4-9692ad21d5ac None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:07.960674 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b88b0-b5c9-4705-93b4-9692ad21d5ac None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:07.961707 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b88b0-b5c9-4705-93b4-9692ad21d5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:07.984376 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-276b88b0-b5c9-4705-93b4-9692ad21d5ac None None] MFA Rules not processed for user `8ab128ff99e24153960e42b8897ac4f1`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:07.986469 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-276b88b0-b5c9-4705-93b4-9692ad21d5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:08.107281 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21757787-f5d7-487d-ba90-ad48d5568f36 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:08.110238 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-21757787-f5d7-487d-ba90-ad48d5568f36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:08.128848 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2040/4098] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:52:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:08.292296 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21757787-f5d7-487d-ba90-ad48d5568f36 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:08.297979 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80af9f-898c-47bf-97fa-ad9a3d898e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:08.298834 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80af9f-898c-47bf-97fa-ad9a3d898e34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:08.299250 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80af9f-898c-47bf-97fa-ad9a3d898e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:08.299625 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80af9f-898c-47bf-97fa-ad9a3d898e34 admin admin] PATH_INFO: `/v3/projects/02fd7164926b4b58a396372dd48fa647` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:08.300983 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc80af9f-898c-47bf-97fa-ad9a3d898e34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02fd7164926b4b58a396372dd48fa647)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:08.303340 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc80af9f-898c-47bf-97fa-ad9a3d898e34 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:08.396801 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-bc80af9f-898c-47bf-97fa-ad9a3d898e34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02fd7164926b4b58a396372dd48fa647', 'request_id': 'req-bc80af9f-898c-47bf-97fa-ad9a3d898e34'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:08.404886 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-bc80af9f-898c-47bf-97fa-ad9a3d898e34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02fd7164926b4b58a396372dd48fa647', 'request_id': 'req-bc80af9f-898c-47bf-97fa-ad9a3d898e34'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:08.419690 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-bc80af9f-898c-47bf-97fa-ad9a3d898e34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02fd7164926b4b58a396372dd48fa647', 'request_id': 'req-bc80af9f-898c-47bf-97fa-ad9a3d898e34'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:08.444366 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-bc80af9f-898c-47bf-97fa-ad9a3d898e34 admin admin] The token cache is being invalidate because project 02fd7164926b4b58a396372dd48fa647 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:52:08.445645 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-bc80af9f-898c-47bf-97fa-ad9a3d898e34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:08.448020 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-bc80af9f-898c-47bf-97fa-ad9a3d898e34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:08.450787 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2059/4099] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:52:08 2022] DELETE /identity/v3/projects/02fd7164926b4b58a396372dd48fa647 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:52:08.456852 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944f7f1-77b0-4e26-b3b1-668e43bdd952 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:08.462120 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944f7f1-77b0-4e26-b3b1-668e43bdd952 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:08.462819 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944f7f1-77b0-4e26-b3b1-668e43bdd952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:08.497326 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-8944f7f1-77b0-4e26-b3b1-668e43bdd952 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:08.498951 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8944f7f1-77b0-4e26-b3b1-668e43bdd952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:08.604861 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2041/4100] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:52:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:08.612315 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b278b83-5273-45fa-9237-0ef47a78891a None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:08.612744 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b278b83-5273-45fa-9237-0ef47a78891a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:08.613130 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b278b83-5273-45fa-9237-0ef47a78891a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:08.650510 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-9b278b83-5273-45fa-9237-0ef47a78891a None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:08.652666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9b278b83-5273-45fa-9237-0ef47a78891a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:08.674890 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2060/4101] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:52:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:08.679112 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944f7f1-77b0-4e26-b3b1-668e43bdd952 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:08.709505 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944f7f1-77b0-4e26-b3b1-668e43bdd952 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:08.715894 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d64663-9fd5-4e3a-89b5-e4cfa5ae6eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:08.715894 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d64663-9fd5-4e3a-89b5-e4cfa5ae6eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:08.715894 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d64663-9fd5-4e3a-89b5-e4cfa5ae6eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:08.715894 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d64663-9fd5-4e3a-89b5-e4cfa5ae6eb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:08.717177 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d64663-9fd5-4e3a-89b5-e4cfa5ae6eb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:52:08.718009 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d64663-9fd5-4e3a-89b5-e4cfa5ae6eb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:08.723898 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d64663-9fd5-4e3a-89b5-e4cfa5ae6eb2 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:08.760998 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2042/4102] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:52:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:52:08.765516 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b278b83-5273-45fa-9237-0ef47a78891a None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:08.780132 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b278b83-5273-45fa-9237-0ef47a78891a None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:08.808657 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a451d16-32dc-4182-94ec-4a5b4680f337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:08.813850 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a451d16-32dc-4182-94ec-4a5b4680f337 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:08.815637 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a451d16-32dc-4182-94ec-4a5b4680f337 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:08.816070 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a451d16-32dc-4182-94ec-4a5b4680f337 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:08.817798 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a451d16-32dc-4182-94ec-4a5b4680f337 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:08.822846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a451d16-32dc-4182-94ec-4a5b4680f337 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:08.908204 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2061/4103] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:52:08 2022] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:52:08.912412 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d64663-9fd5-4e3a-89b5-e4cfa5ae6eb2 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:08.934130 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d64663-9fd5-4e3a-89b5-e4cfa5ae6eb2 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:09.093901 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:09.121481 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85bd236-940c-46fe-8f61-585f19aa16f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:09.122475 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85bd236-940c-46fe-8f61-585f19aa16f6 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:09.123257 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85bd236-940c-46fe-8f61-585f19aa16f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:09.123572 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85bd236-940c-46fe-8f61-585f19aa16f6 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:09.124355 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85bd236-940c-46fe-8f61-585f19aa16f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:09.126421 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85bd236-940c-46fe-8f61-585f19aa16f6 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:09.191858 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2043/4104] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:52:08 2022] POST /identity/v3/users => generated 293 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:52:09.193699 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a451d16-32dc-4182-94ec-4a5b4680f337 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:09.208804 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a451d16-32dc-4182-94ec-4a5b4680f337 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:09.217844 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f220134-2315-4290-a67c-38c9b2037752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:09.218709 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f220134-2315-4290-a67c-38c9b2037752 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:09.219853 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f220134-2315-4290-a67c-38c9b2037752 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:09.219853 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f220134-2315-4290-a67c-38c9b2037752 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:09.220435 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f220134-2315-4290-a67c-38c9b2037752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:09.222276 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f220134-2315-4290-a67c-38c9b2037752 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:09.238088 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2062/4105] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:52:09.239345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85bd236-940c-46fe-8f61-585f19aa16f6 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:09.251929 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85bd236-940c-46fe-8f61-585f19aa16f6 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:09.257334 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76265bbc-908a-4e3a-ba95-39bd72a94d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:09.258670 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76265bbc-908a-4e3a-ba95-39bd72a94d8a admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:09.259461 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76265bbc-908a-4e3a-ba95-39bd72a94d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:09.259834 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76265bbc-908a-4e3a-ba95-39bd72a94d8a admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:09.260870 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76265bbc-908a-4e3a-ba95-39bd72a94d8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:09.262637 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76265bbc-908a-4e3a-ba95-39bd72a94d8a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:09.282975 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2044/4106] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:52:09.284585 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f220134-2315-4290-a67c-38c9b2037752 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:09.303857 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f220134-2315-4290-a67c-38c9b2037752 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:09.322868 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7aaf17-737f-41b7-9568-d78dc88de9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:09.323620 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7aaf17-737f-41b7-9568-d78dc88de9fe admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:09.323998 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7aaf17-737f-41b7-9568-d78dc88de9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:09.324656 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7aaf17-737f-41b7-9568-d78dc88de9fe admin admin] PATH_INFO: `/v3/projects/2af48ef2a56c43c2ac2cb819551b6e79/users/8151b25eada64bf9a09a09056ae036cc/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:09.339443 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:09.363897 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7aaf17-737f-41b7-9568-d78dc88de9fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=2af48ef2a56c43c2ac2cb819551b6e79, user_id=8151b25eada64bf9a09a09056ae036cc, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:09.368897 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7aaf17-737f-41b7-9568-d78dc88de9fe admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:09.400351 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead5630-e722-47a3-a7c0-7207643ddc94 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:09.400784 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead5630-e722-47a3-a7c0-7207643ddc94 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:09.401466 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead5630-e722-47a3-a7c0-7207643ddc94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:09.404333 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2063/4107] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:52:09 2022] PUT /identity/v3/projects/2af48ef2a56c43c2ac2cb819551b6e79/users/8151b25eada64bf9a09a09056ae036cc/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:52:09.439008 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-6ead5630-e722-47a3-a7c0-7207643ddc94 None None] MFA Rules not processed for user `8151b25eada64bf9a09a09056ae036cc`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:09.440878 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6ead5630-e722-47a3-a7c0-7207643ddc94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:09.557865 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2045/4108] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:52:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:09.565736 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7aaf17-737f-41b7-9568-d78dc88de9fe admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:09.568629 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6d7aaf17-737f-41b7-9568-d78dc88de9fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:09.731350 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7aaf17-737f-41b7-9568-d78dc88de9fe admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:09.738896 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654516ab-b441-4419-b04e-776d36a27c45 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6b0f9835ed549cab91d684326be83fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:09.743876 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654516ab-b441-4419-b04e-776d36a27c45 service glance] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:09.743876 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654516ab-b441-4419-b04e-776d36a27c45 service glance] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:09.743876 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654516ab-b441-4419-b04e-776d36a27c45 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:09.769974 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654516ab-b441-4419-b04e-776d36a27c45 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:09.771264 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654516ab-b441-4419-b04e-776d36a27c45 service glance] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:09.793534 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2064/4109] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:52:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:52:10.097773 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e609b0-07f8-484b-852f-47b2cef44dc2 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:10.098301 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e609b0-07f8-484b-852f-47b2cef44dc2 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:10.098494 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e609b0-07f8-484b-852f-47b2cef44dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:10.310167 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-94e609b0-07f8-484b-852f-47b2cef44dc2 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:10.311920 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-94e609b0-07f8-484b-852f-47b2cef44dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:10.453681 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2046/4110] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 15:52:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:10.538633 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654516ab-b441-4419-b04e-776d36a27c45 service glance] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:10.542445 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-654516ab-b441-4419-b04e-776d36a27c45 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:10.693201 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654516ab-b441-4419-b04e-776d36a27c45 service glance] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:10.720129 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c6720-d506-4728-89d0-194da75f17cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:10.722315 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c6720-d506-4728-89d0-194da75f17cc service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:10.723452 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c6720-d506-4728-89d0-194da75f17cc service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:10.723735 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c6720-d506-4728-89d0-194da75f17cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:10.763907 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23c6720-d506-4728-89d0-194da75f17cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:10.765708 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23c6720-d506-4728-89d0-194da75f17cc service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:10.788835 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2065/4111] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 15:52:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:52:11.666407 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc724e7-69a4-4c2e-ac14-6757f3d06d2f None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:11.666870 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc724e7-69a4-4c2e-ac14-6757f3d06d2f None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:11.666870 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc724e7-69a4-4c2e-ac14-6757f3d06d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:11.743421 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-3fc724e7-69a4-4c2e-ac14-6757f3d06d2f None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:11.745248 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3fc724e7-69a4-4c2e-ac14-6757f3d06d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:11.754430 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2047/4112] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 15:52:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:52:11.777112 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c6720-d506-4728-89d0-194da75f17cc service swift] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:11.796273 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c6720-d506-4728-89d0-194da75f17cc service swift] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:11.826958 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984cdcb-7e70-4a07-9ec5-dc55bd930125 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:11.827545 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984cdcb-7e70-4a07-9ec5-dc55bd930125 service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:11.827822 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984cdcb-7e70-4a07-9ec5-dc55bd930125 service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:11.828881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984cdcb-7e70-4a07-9ec5-dc55bd930125 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:11.847431 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d984cdcb-7e70-4a07-9ec5-dc55bd930125 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:11.849031 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d984cdcb-7e70-4a07-9ec5-dc55bd930125 service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:11.886753 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2066/4113] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 15:52:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:52:12.711739 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8fed2-8a2b-435b-aaae-842473f912db None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:12.712200 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8fed2-8a2b-435b-aaae-842473f912db None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:12.712354 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8fed2-8a2b-435b-aaae-842473f912db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:12.749163 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-f7d8fed2-8a2b-435b-aaae-842473f912db None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:12.750414 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f7d8fed2-8a2b-435b-aaae-842473f912db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:12.773192 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2048/4114] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 15:52:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:12.796375 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984cdcb-7e70-4a07-9ec5-dc55bd930125 service swift] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:12.813963 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984cdcb-7e70-4a07-9ec5-dc55bd930125 service swift] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:12.855294 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94464fe-37f7-4232-a173-d992ec96466c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:12.857850 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94464fe-37f7-4232-a173-d992ec96466c service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:12.859264 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94464fe-37f7-4232-a173-d992ec96466c service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:12.859714 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94464fe-37f7-4232-a173-d992ec96466c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:12.899688 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94464fe-37f7-4232-a173-d992ec96466c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:12.905600 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94464fe-37f7-4232-a173-d992ec96466c service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:12.930408 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2067/4115] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 15:52:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:52:13.318679 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f80dd-f856-4487-8d73-3077c31effc8 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:13.318964 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f80dd-f856-4487-8d73-3077c31effc8 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:13.319351 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f80dd-f856-4487-8d73-3077c31effc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:13.353518 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-c03f80dd-f856-4487-8d73-3077c31effc8 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:13.357061 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c03f80dd-f856-4487-8d73-3077c31effc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:13.380904 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2049/4116] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 15:52:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:13.396644 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94464fe-37f7-4232-a173-d992ec96466c service swift] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:13.413240 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94464fe-37f7-4232-a173-d992ec96466c service swift] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:13.422889 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e562d-69e8-42ca-beb8-a428411d4d99 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:13.424344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e562d-69e8-42ca-beb8-a428411d4d99 service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:13.424730 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e562d-69e8-42ca-beb8-a428411d4d99 service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:13.424951 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e562d-69e8-42ca-beb8-a428411d4d99 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:13.435524 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473e562d-69e8-42ca-beb8-a428411d4d99 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:13.438096 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473e562d-69e8-42ca-beb8-a428411d4d99 service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:13.461138 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2068/4117] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 15:52:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:52:14.157209 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb228fd-1077-4240-bb9f-8c7e7c970e6e None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:14.158760 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb228fd-1077-4240-bb9f-8c7e7c970e6e None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:14.159604 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb228fd-1077-4240-bb9f-8c7e7c970e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:14.205589 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-fbb228fd-1077-4240-bb9f-8c7e7c970e6e None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:14.227197 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-fbb228fd-1077-4240-bb9f-8c7e7c970e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:14.257467 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2050/4118] 10.222.0.83 () {58 vars in 967 bytes} [Mon Aug 29 15:52:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:14.268129 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e562d-69e8-42ca-beb8-a428411d4d99 service swift] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:14.301564 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e562d-69e8-42ca-beb8-a428411d4d99 service swift] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:14.332400 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390453e2-3ba9-4416-9ce3-7957e30ba345 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:14.334619 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390453e2-3ba9-4416-9ce3-7957e30ba345 service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:14.335497 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390453e2-3ba9-4416-9ce3-7957e30ba345 service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:14.337253 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390453e2-3ba9-4416-9ce3-7957e30ba345 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:14.367502 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390453e2-3ba9-4416-9ce3-7957e30ba345 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:14.372245 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390453e2-3ba9-4416-9ce3-7957e30ba345 service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:14.399987 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2069/4119] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 15:52:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:52:14.720138 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d911d-a53d-4755-891b-61b6ffbed5b3 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:14.720419 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d911d-a53d-4755-891b-61b6ffbed5b3 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:14.720934 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d911d-a53d-4755-891b-61b6ffbed5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:14.783128 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-735d911d-a53d-4755-891b-61b6ffbed5b3 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:14.784675 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-735d911d-a53d-4755-891b-61b6ffbed5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:14.806293 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2051/4120] 10.222.0.83 () {58 vars in 967 bytes} [Mon Aug 29 15:52:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:14.823351 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390453e2-3ba9-4416-9ce3-7957e30ba345 service swift] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:14.837414 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390453e2-3ba9-4416-9ce3-7957e30ba345 service swift] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:14.843646 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e52a30-cc0e-473e-bd05-f33b90b23a3c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:14.844736 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e52a30-cc0e-473e-bd05-f33b90b23a3c service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:14.845218 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e52a30-cc0e-473e-bd05-f33b90b23a3c service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:14.845656 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e52a30-cc0e-473e-bd05-f33b90b23a3c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:14.857333 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e52a30-cc0e-473e-bd05-f33b90b23a3c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:14.859529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e52a30-cc0e-473e-bd05-f33b90b23a3c service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:14.887613 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2070/4121] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 15:52:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:52:15.102931 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d911d-a53d-4755-891b-61b6ffbed5b3 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:15.177130 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:15.242464 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d911d-a53d-4755-891b-61b6ffbed5b3 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:15.252667 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4971389c-a8bf-49c9-a341-94b05d472776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:15.253385 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971389c-a8bf-49c9-a341-94b05d472776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:15.253664 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971389c-a8bf-49c9-a341-94b05d472776 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:15.254021 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971389c-a8bf-49c9-a341-94b05d472776 admin admin] PATH_INFO: `/v3/users/8151b25eada64bf9a09a09056ae036cc` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:15.257110 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4971389c-a8bf-49c9-a341-94b05d472776 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8151b25eada64bf9a09a09056ae036cc)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:15.259444 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4971389c-a8bf-49c9-a341-94b05d472776 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:15.379482 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4971389c-a8bf-49c9-a341-94b05d472776 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8151b25eada64bf9a09a09056ae036cc'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:15.380312 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4971389c-a8bf-49c9-a341-94b05d472776 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8151b25eada64bf9a09a09056ae036cc'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:15.390547 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4971389c-a8bf-49c9-a341-94b05d472776 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8151b25eada64bf9a09a09056ae036cc'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:15.399425 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4971389c-a8bf-49c9-a341-94b05d472776 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8151b25eada64bf9a09a09056ae036cc'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:15.400351 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4971389c-a8bf-49c9-a341-94b05d472776 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8151b25eada64bf9a09a09056ae036cc'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:15.451317 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2052/4122] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:52:15 2022] DELETE /identity/v3/users/8151b25eada64bf9a09a09056ae036cc => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:52:15.456512 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b7a04-8a5f-436d-bfd7-5de33ffc7fb6 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:15.457553 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b7a04-8a5f-436d-bfd7-5de33ffc7fb6 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:15.458013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b7a04-8a5f-436d-bfd7-5de33ffc7fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:15.471321 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:15.494719 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-133b7a04-8a5f-436d-bfd7-5de33ffc7fb6 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:15.496185 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-133b7a04-8a5f-436d-bfd7-5de33ffc7fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:15.631262 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2071/4123] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:52:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:15.654529 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4971389c-a8bf-49c9-a341-94b05d472776 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:15.656783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4971389c-a8bf-49c9-a341-94b05d472776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:15.752517 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4971389c-a8bf-49c9-a341-94b05d472776 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:15.761698 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d780d6-67d3-43db-8756-aacd017f51e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:15.762560 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d780d6-67d3-43db-8756-aacd017f51e2 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:15.763108 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d780d6-67d3-43db-8756-aacd017f51e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:15.763556 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d780d6-67d3-43db-8756-aacd017f51e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:15.782939 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d780d6-67d3-43db-8756-aacd017f51e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:15.784520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d780d6-67d3-43db-8756-aacd017f51e2 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:15.805789 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2053/4124] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:52:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:52:17.632216 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b7a04-8a5f-436d-bfd7-5de33ffc7fb6 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:17.634383 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-133b7a04-8a5f-436d-bfd7-5de33ffc7fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:17.802901 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b7a04-8a5f-436d-bfd7-5de33ffc7fb6 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:17.817065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94c8e8-328f-417b-81f3-6b185e23785f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:17.817918 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94c8e8-328f-417b-81f3-6b185e23785f service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:17.819233 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94c8e8-328f-417b-81f3-6b185e23785f service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:17.819593 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94c8e8-328f-417b-81f3-6b185e23785f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:17.825918 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4f94c8e8-328f-417b-81f3-6b185e23785f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:17.853572 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f94c8e8-328f-417b-81f3-6b185e23785f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:17.855704 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f94c8e8-328f-417b-81f3-6b185e23785f service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:17.903475 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2072/4125] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:52:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:52:17.993591 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d780d6-67d3-43db-8756-aacd017f51e2 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:17.996653 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-77d780d6-67d3-43db-8756-aacd017f51e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:18.073002 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d780d6-67d3-43db-8756-aacd017f51e2 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:18.080564 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b096ffa-e639-4c89-8981-b10426a23d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:18.081260 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b096ffa-e639-4c89-8981-b10426a23d0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:18.081539 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b096ffa-e639-4c89-8981-b10426a23d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:18.081815 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b096ffa-e639-4c89-8981-b10426a23d0a admin admin] PATH_INFO: `/v3/users/f5aa55b1030d49a7abf035fd56d8b9c2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:18.088154 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b096ffa-e639-4c89-8981-b10426a23d0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5aa55b1030d49a7abf035fd56d8b9c2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:18.090157 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b096ffa-e639-4c89-8981-b10426a23d0a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:18.219844 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:18.231862 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3b096ffa-e639-4c89-8981-b10426a23d0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5aa55b1030d49a7abf035fd56d8b9c2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:18.236077 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3b096ffa-e639-4c89-8981-b10426a23d0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5aa55b1030d49a7abf035fd56d8b9c2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:18.261497 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3b096ffa-e639-4c89-8981-b10426a23d0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5aa55b1030d49a7abf035fd56d8b9c2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:18.288036 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3b096ffa-e639-4c89-8981-b10426a23d0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5aa55b1030d49a7abf035fd56d8b9c2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:18.290414 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3b096ffa-e639-4c89-8981-b10426a23d0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5aa55b1030d49a7abf035fd56d8b9c2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:18.346051 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2054/4126] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:52:17 2022] DELETE /identity/v3/users/f5aa55b1030d49a7abf035fd56d8b9c2 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:52:18.815645 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94c8e8-328f-417b-81f3-6b185e23785f service placement] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:18.817617 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4f94c8e8-328f-417b-81f3-6b185e23785f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:18.834257 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94c8e8-328f-417b-81f3-6b185e23785f service placement] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:18.981104 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85f288-4814-4f78-9f6e-d402cf0034f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:18.981845 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85f288-4814-4f78-9f6e-d402cf0034f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:18.982328 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85f288-4814-4f78-9f6e-d402cf0034f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:18.983477 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85f288-4814-4f78-9f6e-d402cf0034f1 admin admin] PATH_INFO: `/v3/projects/2af48ef2a56c43c2ac2cb819551b6e79` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:18.985188 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a85f288-4814-4f78-9f6e-d402cf0034f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2af48ef2a56c43c2ac2cb819551b6e79)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:18.988194 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a85f288-4814-4f78-9f6e-d402cf0034f1 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:19.068381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:19.089585 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7a85f288-4814-4f78-9f6e-d402cf0034f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2af48ef2a56c43c2ac2cb819551b6e79', 'request_id': 'req-7a85f288-4814-4f78-9f6e-d402cf0034f1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:19.100069 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7a85f288-4814-4f78-9f6e-d402cf0034f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2af48ef2a56c43c2ac2cb819551b6e79', 'request_id': 'req-7a85f288-4814-4f78-9f6e-d402cf0034f1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:19.113124 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7a85f288-4814-4f78-9f6e-d402cf0034f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2af48ef2a56c43c2ac2cb819551b6e79', 'request_id': 'req-7a85f288-4814-4f78-9f6e-d402cf0034f1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:19.128813 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7a85f288-4814-4f78-9f6e-d402cf0034f1 admin admin] The token cache is being invalidate because project 2af48ef2a56c43c2ac2cb819551b6e79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:52:19.129669 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7a85f288-4814-4f78-9f6e-d402cf0034f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:19.130534 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7a85f288-4814-4f78-9f6e-d402cf0034f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:19.132651 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2073/4127] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:52:18 2022] DELETE /identity/v3/projects/2af48ef2a56c43c2ac2cb819551b6e79 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:52:19.137726 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a653e5-1843-46fd-9084-c1e1298737cd None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:19.138197 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a653e5-1843-46fd-9084-c1e1298737cd None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:19.138319 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a653e5-1843-46fd-9084-c1e1298737cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:19.179638 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-d8a653e5-1843-46fd-9084-c1e1298737cd None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:19.181039 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d8a653e5-1843-46fd-9084-c1e1298737cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:19.346444 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2055/4128] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:52:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:19.355090 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375a820-b2ed-4064-ab84-803abff0de32 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:19.355375 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375a820-b2ed-4064-ab84-803abff0de32 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:19.355652 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375a820-b2ed-4064-ab84-803abff0de32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:19.378724 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-9375a820-b2ed-4064-ab84-803abff0de32 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:19.379807 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9375a820-b2ed-4064-ab84-803abff0de32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:19.431509 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2074/4129] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:52:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:19.432622 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a653e5-1843-46fd-9084-c1e1298737cd None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:19.461362 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a653e5-1843-46fd-9084-c1e1298737cd None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:19.479161 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a084cf4-58dc-4d3f-a314-a30fd9c886c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:19.480021 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a084cf4-58dc-4d3f-a314-a30fd9c886c2 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:19.480462 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a084cf4-58dc-4d3f-a314-a30fd9c886c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:19.480970 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a084cf4-58dc-4d3f-a314-a30fd9c886c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:19.481878 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a084cf4-58dc-4d3f-a314-a30fd9c886c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:52:19.482398 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a084cf4-58dc-4d3f-a314-a30fd9c886c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:19.486772 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a084cf4-58dc-4d3f-a314-a30fd9c886c2 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:19.520248 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375a820-b2ed-4064-ab84-803abff0de32 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:19.528615 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2056/4130] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:52:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:52:19.533759 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375a820-b2ed-4064-ab84-803abff0de32 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:19.547663 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292cf85f-d879-48ad-8b6d-fb19ae2cd3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:19.547663 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292cf85f-d879-48ad-8b6d-fb19ae2cd3d9 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:19.547663 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292cf85f-d879-48ad-8b6d-fb19ae2cd3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:19.547991 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292cf85f-d879-48ad-8b6d-fb19ae2cd3d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:19.548612 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292cf85f-d879-48ad-8b6d-fb19ae2cd3d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:19.550610 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292cf85f-d879-48ad-8b6d-fb19ae2cd3d9 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:19.625116 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a084cf4-58dc-4d3f-a314-a30fd9c886c2 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:19.625570 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2075/4131] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:52:19 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:52:19.637585 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a084cf4-58dc-4d3f-a314-a30fd9c886c2 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:19.723353 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa209ee-755c-4420-9f11-a5a57a76f14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:19.724238 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa209ee-755c-4420-9f11-a5a57a76f14b admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:19.724677 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa209ee-755c-4420-9f11-a5a57a76f14b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:19.725096 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa209ee-755c-4420-9f11-a5a57a76f14b admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:19.725881 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa209ee-755c-4420-9f11-a5a57a76f14b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:19.729185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa209ee-755c-4420-9f11-a5a57a76f14b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:19.767603 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2057/4132] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:52:19 2022] POST /identity/v3/users => generated 287 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:52:19.772667 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292cf85f-d879-48ad-8b6d-fb19ae2cd3d9 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:19.788372 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292cf85f-d879-48ad-8b6d-fb19ae2cd3d9 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:19.795429 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7556eb6-fca0-4032-98ff-46532dd8abd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:19.796913 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7556eb6-fca0-4032-98ff-46532dd8abd2 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:19.797394 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7556eb6-fca0-4032-98ff-46532dd8abd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:19.797852 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7556eb6-fca0-4032-98ff-46532dd8abd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:19.798809 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7556eb6-fca0-4032-98ff-46532dd8abd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:19.800933 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7556eb6-fca0-4032-98ff-46532dd8abd2 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:19.836973 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2076/4133] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:52:19.839091 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa209ee-755c-4420-9f11-a5a57a76f14b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:19.860853 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa209ee-755c-4420-9f11-a5a57a76f14b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:19.875865 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78793fd-6019-4aba-9a73-319e0681d32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:19.876783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78793fd-6019-4aba-9a73-319e0681d32d admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:19.877169 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78793fd-6019-4aba-9a73-319e0681d32d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:19.896773 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78793fd-6019-4aba-9a73-319e0681d32d admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:19.897746 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78793fd-6019-4aba-9a73-319e0681d32d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:19.902449 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78793fd-6019-4aba-9a73-319e0681d32d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:19.942724 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2058/4134] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:52:19.947178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7556eb6-fca0-4032-98ff-46532dd8abd2 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:19.965893 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7556eb6-fca0-4032-98ff-46532dd8abd2 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:19.971946 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070418d8-4ad8-4702-91b0-17dad037419b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:19.973294 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070418d8-4ad8-4702-91b0-17dad037419b admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:19.974923 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070418d8-4ad8-4702-91b0-17dad037419b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:19.975516 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070418d8-4ad8-4702-91b0-17dad037419b admin admin] PATH_INFO: `/v3/projects/a013689c393b4c43935da2d75c5c1fd4/users/816d903ffca94aa7b604f180d647d394/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:20.002589 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070418d8-4ad8-4702-91b0-17dad037419b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a013689c393b4c43935da2d75c5c1fd4, user_id=816d903ffca94aa7b604f180d647d394, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:20.007146 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070418d8-4ad8-4702-91b0-17dad037419b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:20.032958 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2077/4135] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:52:19 2022] PUT /identity/v3/projects/a013689c393b4c43935da2d75c5c1fd4/users/816d903ffca94aa7b604f180d647d394/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:52:20.043391 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18008ec5-0074-4a81-ac3e-96693ac10bbd None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:20.043890 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18008ec5-0074-4a81-ac3e-96693ac10bbd None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:20.044318 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18008ec5-0074-4a81-ac3e-96693ac10bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:20.066017 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070418d8-4ad8-4702-91b0-17dad037419b admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:20.072079 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-070418d8-4ad8-4702-91b0-17dad037419b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:20.119713 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-18008ec5-0074-4a81-ac3e-96693ac10bbd None None] MFA Rules not processed for user `816d903ffca94aa7b604f180d647d394`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:20.120950 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-18008ec5-0074-4a81-ac3e-96693ac10bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:20.162741 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:20.268936 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070418d8-4ad8-4702-91b0-17dad037419b admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:20.288450 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6559ae-794e-46d2-abf6-06b29ccf1c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:20.291365 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6559ae-794e-46d2-abf6-06b29ccf1c23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:20.293117 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6559ae-794e-46d2-abf6-06b29ccf1c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:20.293926 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6559ae-794e-46d2-abf6-06b29ccf1c23 admin admin] PATH_INFO: `/v3/projects/65947505462641c1ac004cdacaa8317b` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:20.297879 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6559ae-794e-46d2-abf6-06b29ccf1c23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65947505462641c1ac004cdacaa8317b)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:20.302653 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6559ae-794e-46d2-abf6-06b29ccf1c23 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:20.323003 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2059/4136] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:52:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:20.339154 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18008ec5-0074-4a81-ac3e-96693ac10bbd None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:20.340890 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-18008ec5-0074-4a81-ac3e-96693ac10bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:20.393126 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0d6559ae-794e-46d2-abf6-06b29ccf1c23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65947505462641c1ac004cdacaa8317b', 'request_id': 'req-0d6559ae-794e-46d2-abf6-06b29ccf1c23'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:20.404531 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0d6559ae-794e-46d2-abf6-06b29ccf1c23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65947505462641c1ac004cdacaa8317b', 'request_id': 'req-0d6559ae-794e-46d2-abf6-06b29ccf1c23'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:20.410194 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:20.420514 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0d6559ae-794e-46d2-abf6-06b29ccf1c23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65947505462641c1ac004cdacaa8317b', 'request_id': 'req-0d6559ae-794e-46d2-abf6-06b29ccf1c23'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:20.439445 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18008ec5-0074-4a81-ac3e-96693ac10bbd None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:20.441723 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0d6559ae-794e-46d2-abf6-06b29ccf1c23 admin admin] The token cache is being invalidate because project 65947505462641c1ac004cdacaa8317b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:52:20.442294 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0d6559ae-794e-46d2-abf6-06b29ccf1c23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:20.444014 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0d6559ae-794e-46d2-abf6-06b29ccf1c23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:20.450695 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2078/4137] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:52:20 2022] DELETE /identity/v3/projects/65947505462641c1ac004cdacaa8317b => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:52:20.453886 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a92df0-c481-4ea4-bf97-354a4a7b79f6 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:20.454321 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a92df0-c481-4ea4-bf97-354a4a7b79f6 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:20.454691 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a92df0-c481-4ea4-bf97-354a4a7b79f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:20.482467 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-a3a92df0-c481-4ea4-bf97-354a4a7b79f6 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:20.484656 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a3a92df0-c481-4ea4-bf97-354a4a7b79f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:20.503723 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b9942-2b05-4e46-986c-837110ab8104 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6b0f9835ed549cab91d684326be83fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:20.507626 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b9942-2b05-4e46-986c-837110ab8104 service glance] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:20.507626 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b9942-2b05-4e46-986c-837110ab8104 service glance] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:20.507944 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b9942-2b05-4e46-986c-837110ab8104 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:20.510331 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6f5b9942-2b05-4e46-986c-837110ab8104 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:20.612338 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2079/4138] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:52:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:20.615518 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5b9942-2b05-4e46-986c-837110ab8104 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:20.617383 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5b9942-2b05-4e46-986c-837110ab8104 service glance] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:20.620211 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046946e-fd24-44d9-9e6d-b9255d327ba0 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:20.620644 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046946e-fd24-44d9-9e6d-b9255d327ba0 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:20.620925 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046946e-fd24-44d9-9e6d-b9255d327ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:20.634437 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2060/4139] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:52:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:52:20.731492 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-f046946e-fd24-44d9-9e6d-b9255d327ba0 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:20.732872 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f046946e-fd24-44d9-9e6d-b9255d327ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:20.769469 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2080/4140] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:52:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:52:20.775326 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b9942-2b05-4e46-986c-837110ab8104 service glance] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:20.784356 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f046946e-fd24-44d9-9e6d-b9255d327ba0 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:20.785781 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f046946e-fd24-44d9-9e6d-b9255d327ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:20.795956 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b9942-2b05-4e46-986c-837110ab8104 service glance] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:20.802211 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75057670-383f-49c6-bb67-727d7def7a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:20.803749 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75057670-383f-49c6-bb67-727d7def7a4a admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:20.804082 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f046946e-fd24-44d9-9e6d-b9255d327ba0 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:20.804670 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75057670-383f-49c6-bb67-727d7def7a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:20.805213 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75057670-383f-49c6-bb67-727d7def7a4a admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:20.806234 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75057670-383f-49c6-bb67-727d7def7a4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:52:20.807133 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75057670-383f-49c6-bb67-727d7def7a4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:20.810084 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75057670-383f-49c6-bb67-727d7def7a4a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:20.810284 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a0179-f9d6-4b55-84d0-cca266b943eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:20.811362 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a0179-f9d6-4b55-84d0-cca266b943eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:20.811712 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a0179-f9d6-4b55-84d0-cca266b943eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:20.812142 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a0179-f9d6-4b55-84d0-cca266b943eb admin admin] PATH_INFO: `/v3/users/816d903ffca94aa7b604f180d647d394` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:20.813658 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a0179-f9d6-4b55-84d0-cca266b943eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=816d903ffca94aa7b604f180d647d394)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:20.816905 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a0179-f9d6-4b55-84d0-cca266b943eb admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:20.832799 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2061/4141] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:52:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:52:20.838281 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75057670-383f-49c6-bb67-727d7def7a4a admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:20.856057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75057670-383f-49c6-bb67-727d7def7a4a admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:20.863966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be84f9c6-2804-45ea-9d65-79e64b3dbacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:20.866032 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84f9c6-2804-45ea-9d65-79e64b3dbacf admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:20.866533 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84f9c6-2804-45ea-9d65-79e64b3dbacf admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:20.867093 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84f9c6-2804-45ea-9d65-79e64b3dbacf admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:20.869658 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be84f9c6-2804-45ea-9d65-79e64b3dbacf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:20.871930 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be84f9c6-2804-45ea-9d65-79e64b3dbacf admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:20.889382 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:20.927621 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-351a0179-f9d6-4b55-84d0-cca266b943eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '816d903ffca94aa7b604f180d647d394'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:20.935364 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2062/4142] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:52:20 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:52:20.936662 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be84f9c6-2804-45ea-9d65-79e64b3dbacf admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:20.942043 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-351a0179-f9d6-4b55-84d0-cca266b943eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '816d903ffca94aa7b604f180d647d394'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:20.990948 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-351a0179-f9d6-4b55-84d0-cca266b943eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '816d903ffca94aa7b604f180d647d394'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:21.010967 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-351a0179-f9d6-4b55-84d0-cca266b943eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '816d903ffca94aa7b604f180d647d394'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:21.025454 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-351a0179-f9d6-4b55-84d0-cca266b943eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '816d903ffca94aa7b604f180d647d394'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:21.036995 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2081/4143] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:52:20 2022] DELETE /identity/v3/users/816d903ffca94aa7b604f180d647d394 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:52:21.042715 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec394124-0a0c-494d-8a6f-0bc43259b79c None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:21.043003 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec394124-0a0c-494d-8a6f-0bc43259b79c None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:21.043439 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec394124-0a0c-494d-8a6f-0bc43259b79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:21.074781 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be84f9c6-2804-45ea-9d65-79e64b3dbacf admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:21.104786 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-ec394124-0a0c-494d-8a6f-0bc43259b79c None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:21.111552 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ec394124-0a0c-494d-8a6f-0bc43259b79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:21.300076 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:21.307750 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8a571-5393-439c-ad33-ab7509bd287e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:21.309200 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8a571-5393-439c-ad33-ab7509bd287e admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:21.310292 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8a571-5393-439c-ad33-ab7509bd287e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:21.311384 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8a571-5393-439c-ad33-ab7509bd287e admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:21.322362 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef8a571-5393-439c-ad33-ab7509bd287e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:21.325691 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef8a571-5393-439c-ad33-ab7509bd287e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:21.344124 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2082/4144] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:52:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:21.344124 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e788f9-f2e2-4de3-a329-cdb64bbf6bc9 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:21.344124 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e788f9-f2e2-4de3-a329-cdb64bbf6bc9 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:21.344124 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e788f9-f2e2-4de3-a329-cdb64bbf6bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:21.372207 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2063/4145] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:52:20 2022] POST /identity/v3/users => generated 290 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:52:21.376920 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8a571-5393-439c-ad33-ab7509bd287e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:21.379909 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4ef8a571-5393-439c-ad33-ab7509bd287e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:21.408242 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8a571-5393-439c-ad33-ab7509bd287e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:21.414444 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-09e788f9-f2e2-4de3-a329-cdb64bbf6bc9 None None] MFA Rules not processed for user `b5af3adb21364148ab7246a9dd76c64b`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:21.417831 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-09e788f9-f2e2-4de3-a329-cdb64bbf6bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:21.421379 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac04b17-c313-4e5d-a2ad-ad26443ca06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:21.422012 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac04b17-c313-4e5d-a2ad-ad26443ca06a admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:21.422300 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac04b17-c313-4e5d-a2ad-ad26443ca06a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:21.422554 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac04b17-c313-4e5d-a2ad-ad26443ca06a admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:21.426149 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac04b17-c313-4e5d-a2ad-ad26443ca06a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:21.432573 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac04b17-c313-4e5d-a2ad-ad26443ca06a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:21.475160 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2064/4146] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:52:21.475160 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac04b17-c313-4e5d-a2ad-ad26443ca06a admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:21.479885 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-dac04b17-c313-4e5d-a2ad-ad26443ca06a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:21.653543 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2083/4147] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:52:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:21.655567 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e788f9-f2e2-4de3-a329-cdb64bbf6bc9 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:21.663201 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac04b17-c313-4e5d-a2ad-ad26443ca06a admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:21.677200 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25ff9e-7073-49b6-9778-f6bd5f8101bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:21.677857 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25ff9e-7073-49b6-9778-f6bd5f8101bf service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:21.678144 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25ff9e-7073-49b6-9778-f6bd5f8101bf service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:21.678416 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25ff9e-7073-49b6-9778-f6bd5f8101bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:21.692575 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e788f9-f2e2-4de3-a329-cdb64bbf6bc9 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:21.694662 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea25ff9e-7073-49b6-9778-f6bd5f8101bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:21.703105 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea25ff9e-7073-49b6-9778-f6bd5f8101bf service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:21.707973 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c843da-2e85-4388-8450-21d63233df5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:21.708622 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c843da-2e85-4388-8450-21d63233df5d admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:21.708897 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c843da-2e85-4388-8450-21d63233df5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:21.709164 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c843da-2e85-4388-8450-21d63233df5d admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:21.709819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c843da-2e85-4388-8450-21d63233df5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:21.712709 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c843da-2e85-4388-8450-21d63233df5d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:21.726683 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2065/4148] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:52:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:52:21.738489 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2084/4149] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:52:21.743542 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25ff9e-7073-49b6-9778-f6bd5f8101bf service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:21.756955 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25ff9e-7073-49b6-9778-f6bd5f8101bf service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:21.771888 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a01e2e-ccf4-41c8-95b6-03e0da08911c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:21.772657 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a01e2e-ccf4-41c8-95b6-03e0da08911c admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:21.772939 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a01e2e-ccf4-41c8-95b6-03e0da08911c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:21.773216 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a01e2e-ccf4-41c8-95b6-03e0da08911c admin admin] PATH_INFO: `/v3/projects/1d3e63fe33a948479fef57a282a550a4/users/fcd83e325cca4e2f86fcb3010138ace6/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:21.805975 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a01e2e-ccf4-41c8-95b6-03e0da08911c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d3e63fe33a948479fef57a282a550a4, user_id=fcd83e325cca4e2f86fcb3010138ace6, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:21.814241 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a01e2e-ccf4-41c8-95b6-03e0da08911c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:21.819204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:21.849910 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2066/4150] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:52:21 2022] PUT /identity/v3/projects/1d3e63fe33a948479fef57a282a550a4/users/fcd83e325cca4e2f86fcb3010138ace6/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:52:21.852583 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a3ed8-1289-4c23-aaad-3bd2f1d790e2 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:21.852911 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a3ed8-1289-4c23-aaad-3bd2f1d790e2 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:21.853369 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a3ed8-1289-4c23-aaad-3bd2f1d790e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:21.925748 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-7c4a3ed8-1289-4c23-aaad-3bd2f1d790e2 None None] MFA Rules not processed for user `fcd83e325cca4e2f86fcb3010138ace6`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:21.935626 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7c4a3ed8-1289-4c23-aaad-3bd2f1d790e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:22.104572 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2085/4151] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:52:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:52:22.120651 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30228532-fad7-4db1-ac22-e9699ade0392 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:22.120651 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30228532-fad7-4db1-ac22-e9699ade0392 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:22.121121 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30228532-fad7-4db1-ac22-e9699ade0392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:22.177512 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-30228532-fad7-4db1-ac22-e9699ade0392 None None] MFA Rules not processed for user `fcd83e325cca4e2f86fcb3010138ace6`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:22.179582 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-30228532-fad7-4db1-ac22-e9699ade0392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:22.201170 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2067/4152] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:52:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:22.217410 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a3ed8-1289-4c23-aaad-3bd2f1d790e2 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:22.219176 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7c4a3ed8-1289-4c23-aaad-3bd2f1d790e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:22.386210 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:22.395018 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a3ed8-1289-4c23-aaad-3bd2f1d790e2 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:22.405927 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd7ec6-134a-4111-aac7-2c6c2d0de106 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:22.406610 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd7ec6-134a-4111-aac7-2c6c2d0de106 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:22.406959 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd7ec6-134a-4111-aac7-2c6c2d0de106 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:22.407391 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd7ec6-134a-4111-aac7-2c6c2d0de106 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:22.431293 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fd7ec6-134a-4111-aac7-2c6c2d0de106 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:22.433474 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fd7ec6-134a-4111-aac7-2c6c2d0de106 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:22.447228 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2086/4153] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:52:22 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:52:23.888403 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30228532-fad7-4db1-ac22-e9699ade0392 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:23.891269 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-30228532-fad7-4db1-ac22-e9699ade0392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:24.089413 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30228532-fad7-4db1-ac22-e9699ade0392 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:24.103718 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfac97-0360-494c-ae65-967ed28a013e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:24.106271 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfac97-0360-494c-ae65-967ed28a013e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:24.108140 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfac97-0360-494c-ae65-967ed28a013e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:24.108661 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfac97-0360-494c-ae65-967ed28a013e admin admin] PATH_INFO: `/v3/projects/a013689c393b4c43935da2d75c5c1fd4` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:24.111269 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dfac97-0360-494c-ae65-967ed28a013e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a013689c393b4c43935da2d75c5c1fd4)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:24.119833 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dfac97-0360-494c-ae65-967ed28a013e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:24.227321 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f3dfac97-0360-494c-ae65-967ed28a013e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a013689c393b4c43935da2d75c5c1fd4', 'request_id': 'req-f3dfac97-0360-494c-ae65-967ed28a013e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:24.247737 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f3dfac97-0360-494c-ae65-967ed28a013e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a013689c393b4c43935da2d75c5c1fd4', 'request_id': 'req-f3dfac97-0360-494c-ae65-967ed28a013e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:24.266163 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f3dfac97-0360-494c-ae65-967ed28a013e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a013689c393b4c43935da2d75c5c1fd4', 'request_id': 'req-f3dfac97-0360-494c-ae65-967ed28a013e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:24.298452 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f3dfac97-0360-494c-ae65-967ed28a013e admin admin] The token cache is being invalidate because project a013689c393b4c43935da2d75c5c1fd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:52:24.300608 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f3dfac97-0360-494c-ae65-967ed28a013e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:24.301920 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f3dfac97-0360-494c-ae65-967ed28a013e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:24.308772 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2068/4154] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:52:23 2022] DELETE /identity/v3/projects/a013689c393b4c43935da2d75c5c1fd4 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:52:24.313985 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313514e5-1857-4c8e-a14b-221b6f72f59e None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:24.314564 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313514e5-1857-4c8e-a14b-221b6f72f59e None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:24.314564 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313514e5-1857-4c8e-a14b-221b6f72f59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:24.354664 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-313514e5-1857-4c8e-a14b-221b6f72f59e None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:24.357077 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-313514e5-1857-4c8e-a14b-221b6f72f59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:24.478671 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2087/4155] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:52:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:24.487677 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a8d4f-1a89-45a8-be7a-69fd3382ea3f None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:24.488420 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a8d4f-1a89-45a8-be7a-69fd3382ea3f None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:24.488799 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a8d4f-1a89-45a8-be7a-69fd3382ea3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:24.532608 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-3e6a8d4f-1a89-45a8-be7a-69fd3382ea3f None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:24.533956 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3e6a8d4f-1a89-45a8-be7a-69fd3382ea3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:24.556363 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2069/4156] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:52:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:24.560407 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313514e5-1857-4c8e-a14b-221b6f72f59e None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:24.579314 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313514e5-1857-4c8e-a14b-221b6f72f59e None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:24.590376 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3dac02-ae3a-4420-8d73-d0afe704c9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:24.591362 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3dac02-ae3a-4420-8d73-d0afe704c9dc admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:24.591780 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3dac02-ae3a-4420-8d73-d0afe704c9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:24.592159 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3dac02-ae3a-4420-8d73-d0afe704c9dc admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:24.594126 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3dac02-ae3a-4420-8d73-d0afe704c9dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:52:24.594692 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3dac02-ae3a-4420-8d73-d0afe704c9dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:24.598528 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3dac02-ae3a-4420-8d73-d0afe704c9dc admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:24.627584 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2088/4157] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:52:24.631733 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a8d4f-1a89-45a8-be7a-69fd3382ea3f None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:24.650207 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a8d4f-1a89-45a8-be7a-69fd3382ea3f None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:24.664339 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d94772-68a5-44e0-b005-aea8a036746f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:24.665143 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d94772-68a5-44e0-b005-aea8a036746f admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:24.665425 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d94772-68a5-44e0-b005-aea8a036746f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:24.666070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d94772-68a5-44e0-b005-aea8a036746f admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:24.666721 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d94772-68a5-44e0-b005-aea8a036746f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:24.668946 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d94772-68a5-44e0-b005-aea8a036746f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:24.749177 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2070/4158] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:52:24 2022] POST /identity/v3/projects => generated 387 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:52:24.750272 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3dac02-ae3a-4420-8d73-d0afe704c9dc admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:24.763650 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3dac02-ae3a-4420-8d73-d0afe704c9dc admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:24.922975 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509cdc06-f081-4083-b08d-48aad75a11a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:24.923745 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509cdc06-f081-4083-b08d-48aad75a11a0 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:24.924149 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509cdc06-f081-4083-b08d-48aad75a11a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:24.924522 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509cdc06-f081-4083-b08d-48aad75a11a0 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:24.925261 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509cdc06-f081-4083-b08d-48aad75a11a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:24.930771 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509cdc06-f081-4083-b08d-48aad75a11a0 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:24.976794 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2089/4159] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:52:24 2022] POST /identity/v3/users => generated 294 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:52:24.981785 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d94772-68a5-44e0-b005-aea8a036746f admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:25.025726 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d94772-68a5-44e0-b005-aea8a036746f admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:25.035885 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c720fd1-c915-49cd-8dd6-42b09f3e2a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:25.036741 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c720fd1-c915-49cd-8dd6-42b09f3e2a5e admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:25.037300 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c720fd1-c915-49cd-8dd6-42b09f3e2a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:25.037726 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c720fd1-c915-49cd-8dd6-42b09f3e2a5e admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:25.038537 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c720fd1-c915-49cd-8dd6-42b09f3e2a5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:25.041017 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c720fd1-c915-49cd-8dd6-42b09f3e2a5e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:25.082079 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2071/4160] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:52:25.082929 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509cdc06-f081-4083-b08d-48aad75a11a0 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:25.098802 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509cdc06-f081-4083-b08d-48aad75a11a0 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:25.139755 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab193eb-6200-418c-b67c-5f55df7e9793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:25.145224 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab193eb-6200-418c-b67c-5f55df7e9793 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:25.145549 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab193eb-6200-418c-b67c-5f55df7e9793 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:25.145834 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab193eb-6200-418c-b67c-5f55df7e9793 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:25.146539 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab193eb-6200-418c-b67c-5f55df7e9793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:25.148227 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab193eb-6200-418c-b67c-5f55df7e9793 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:25.193432 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2090/4161] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:52:25.194839 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c720fd1-c915-49cd-8dd6-42b09f3e2a5e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:25.210167 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c720fd1-c915-49cd-8dd6-42b09f3e2a5e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:25.225909 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f6714d-07e2-455d-bc19-c4f9adf49820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:25.227771 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6714d-07e2-455d-bc19-c4f9adf49820 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:25.228144 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6714d-07e2-455d-bc19-c4f9adf49820 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:25.228492 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6714d-07e2-455d-bc19-c4f9adf49820 admin admin] PATH_INFO: `/v3/projects/f33bcae207684a9f8f836a0460b8b72f/users/77c464ce17574849a244d3cf2df54dd2/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:25.270810 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f6714d-07e2-455d-bc19-c4f9adf49820 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f33bcae207684a9f8f836a0460b8b72f, user_id=77c464ce17574849a244d3cf2df54dd2, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:25.273296 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f6714d-07e2-455d-bc19-c4f9adf49820 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:25.309660 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2072/4162] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:52:25 2022] PUT /identity/v3/projects/f33bcae207684a9f8f836a0460b8b72f/users/77c464ce17574849a244d3cf2df54dd2/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:52:25.311605 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8069f99-b00c-4db3-bcf4-d96fe5650396 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:25.314035 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8069f99-b00c-4db3-bcf4-d96fe5650396 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:25.315142 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8069f99-b00c-4db3-bcf4-d96fe5650396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:25.368905 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-d8069f99-b00c-4db3-bcf4-d96fe5650396 None None] MFA Rules not processed for user `77c464ce17574849a244d3cf2df54dd2`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:25.370310 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d8069f99-b00c-4db3-bcf4-d96fe5650396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:25.439000 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:25.490686 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2091/4163] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:52:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:25.492254 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f6714d-07e2-455d-bc19-c4f9adf49820 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:25.530307 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:25.648618 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f6714d-07e2-455d-bc19-c4f9adf49820 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:25.662438 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17523c3-4ea4-49e9-bc44-e5aaa50b0654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:25.663426 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17523c3-4ea4-49e9-bc44-e5aaa50b0654 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:25.664303 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17523c3-4ea4-49e9-bc44-e5aaa50b0654 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:25.666149 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17523c3-4ea4-49e9-bc44-e5aaa50b0654 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:25.667131 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17523c3-4ea4-49e9-bc44-e5aaa50b0654 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:25.675823 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17523c3-4ea4-49e9-bc44-e5aaa50b0654 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:25.799165 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2073/4164] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:52:25 2022] POST /identity/v3/projects => generated 391 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:52:25.801694 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8069f99-b00c-4db3-bcf4-d96fe5650396 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:25.822199 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8069f99-b00c-4db3-bcf4-d96fe5650396 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:25.949436 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f049d55-2e83-4c47-8bdc-7c5969f1d348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:25.952283 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f049d55-2e83-4c47-8bdc-7c5969f1d348 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:25.952283 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f049d55-2e83-4c47-8bdc-7c5969f1d348 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:25.952534 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f049d55-2e83-4c47-8bdc-7c5969f1d348 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:25.953170 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f049d55-2e83-4c47-8bdc-7c5969f1d348 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:25.955979 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f049d55-2e83-4c47-8bdc-7c5969f1d348 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:26.011187 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2092/4165] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:52:25 2022] POST /identity/v3/users => generated 302 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:52:26.015204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17523c3-4ea4-49e9-bc44-e5aaa50b0654 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:26.048219 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17523c3-4ea4-49e9-bc44-e5aaa50b0654 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:26.066923 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9f032-8ea6-4877-bdce-dbc0d953fcb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:26.070587 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9f032-8ea6-4877-bdce-dbc0d953fcb3 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:26.071151 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9f032-8ea6-4877-bdce-dbc0d953fcb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:26.071596 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9f032-8ea6-4877-bdce-dbc0d953fcb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:26.072434 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a9f032-8ea6-4877-bdce-dbc0d953fcb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:26.074525 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a9f032-8ea6-4877-bdce-dbc0d953fcb3 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:26.099338 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2074/4166] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:52:26.104392 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f049d55-2e83-4c47-8bdc-7c5969f1d348 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:26.122258 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f049d55-2e83-4c47-8bdc-7c5969f1d348 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:26.131411 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c33daa-3fd2-444d-aa78-ada83aa9f403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:26.132561 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c33daa-3fd2-444d-aa78-ada83aa9f403 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:26.133157 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c33daa-3fd2-444d-aa78-ada83aa9f403 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:26.133969 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c33daa-3fd2-444d-aa78-ada83aa9f403 admin admin] PATH_INFO: `/v3/projects/0c8226e0b4534d2eaa6fcd902d31cb41/users/c5c51f0d44674283b8486f3314b56482/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:26.163807 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c33daa-3fd2-444d-aa78-ada83aa9f403 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c8226e0b4534d2eaa6fcd902d31cb41, user_id=c5c51f0d44674283b8486f3314b56482, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:26.168136 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c33daa-3fd2-444d-aa78-ada83aa9f403 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:26.190398 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9f032-8ea6-4877-bdce-dbc0d953fcb3 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:26.190605 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2093/4167] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:52:26 2022] PUT /identity/v3/projects/0c8226e0b4534d2eaa6fcd902d31cb41/users/c5c51f0d44674283b8486f3314b56482/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:52:26.206148 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9f032-8ea6-4877-bdce-dbc0d953fcb3 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:26.353189 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd53c80-d837-4d54-b811-0ce416fbdfc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:26.353830 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd53c80-d837-4d54-b811-0ce416fbdfc0 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:26.354098 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd53c80-d837-4d54-b811-0ce416fbdfc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:26.354369 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd53c80-d837-4d54-b811-0ce416fbdfc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:26.355017 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd53c80-d837-4d54-b811-0ce416fbdfc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:26.357967 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd53c80-d837-4d54-b811-0ce416fbdfc0 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:26.403561 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2075/4168] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:52:26.407713 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c33daa-3fd2-444d-aa78-ada83aa9f403 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:26.420542 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c33daa-3fd2-444d-aa78-ada83aa9f403 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:26.434649 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b1d41-361c-4c92-9e95-0020f0d83d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:26.435381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b1d41-361c-4c92-9e95-0020f0d83d9e admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:26.435647 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b1d41-361c-4c92-9e95-0020f0d83d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:26.435924 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b1d41-361c-4c92-9e95-0020f0d83d9e admin admin] PATH_INFO: `/v3/projects/0c8226e0b4534d2eaa6fcd902d31cb41/users/c5c51f0d44674283b8486f3314b56482/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:26.441416 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b1d41-361c-4c92-9e95-0020f0d83d9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c8226e0b4534d2eaa6fcd902d31cb41, user_id=c5c51f0d44674283b8486f3314b56482, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:26.447576 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b1d41-361c-4c92-9e95-0020f0d83d9e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:26.488368 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2094/4169] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:52:26 2022] PUT /identity/v3/projects/0c8226e0b4534d2eaa6fcd902d31cb41/users/c5c51f0d44674283b8486f3314b56482/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:52:26.500270 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2ec04-0634-403b-b27d-6b6005baf2a4 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:26.500877 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2ec04-0634-403b-b27d-6b6005baf2a4 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:26.501361 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2ec04-0634-403b-b27d-6b6005baf2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:26.572999 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-caa2ec04-0634-403b-b27d-6b6005baf2a4 None None] MFA Rules not processed for user `c5c51f0d44674283b8486f3314b56482`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:26.574558 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-caa2ec04-0634-403b-b27d-6b6005baf2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:26.766065 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2076/4170] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:52:26 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:26.785714 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b1d41-361c-4c92-9e95-0020f0d83d9e admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:26.788312 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a23b1d41-361c-4c92-9e95-0020f0d83d9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:26.873622 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b1d41-361c-4c92-9e95-0020f0d83d9e admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:26.878146 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11107416-15cc-4675-8649-f6d700d659f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:26.878766 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11107416-15cc-4675-8649-f6d700d659f4 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:26.879064 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11107416-15cc-4675-8649-f6d700d659f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:26.879339 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11107416-15cc-4675-8649-f6d700d659f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:26.969252 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:26.975808 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11107416-15cc-4675-8649-f6d700d659f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:26.978534 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11107416-15cc-4675-8649-f6d700d659f4 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:27.007633 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2095/4171] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:52:26 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:52:34.134236 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2ec04-0634-403b-b27d-6b6005baf2a4 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:34.154752 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2ec04-0634-403b-b27d-6b6005baf2a4 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:34.167541 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f690b9-c3c1-4a23-b3e4-6458ef8459ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:34.168185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f690b9-c3c1-4a23-b3e4-6458ef8459ab service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:34.168544 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f690b9-c3c1-4a23-b3e4-6458ef8459ab service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:34.168808 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f690b9-c3c1-4a23-b3e4-6458ef8459ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:34.184978 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f690b9-c3c1-4a23-b3e4-6458ef8459ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:34.186567 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f690b9-c3c1-4a23-b3e4-6458ef8459ab service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:34.199142 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:34.220742 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2077/4172] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:52:34 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:52:34.363124 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11107416-15cc-4675-8649-f6d700d659f4 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:34.370895 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-11107416-15cc-4675-8649-f6d700d659f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:34.522295 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11107416-15cc-4675-8649-f6d700d659f4 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:34.532525 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9b857-856e-4d30-a722-e9f971b5a3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:34.533786 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9b857-856e-4d30-a722-e9f971b5a3a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:34.534656 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9b857-856e-4d30-a722-e9f971b5a3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:34.535124 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9b857-856e-4d30-a722-e9f971b5a3a4 admin admin] PATH_INFO: `/v3/users/fcd83e325cca4e2f86fcb3010138ace6` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:34.537178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9b857-856e-4d30-a722-e9f971b5a3a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcd83e325cca4e2f86fcb3010138ace6)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:34.541015 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9b857-856e-4d30-a722-e9f971b5a3a4 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:34.618747 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-40e9b857-856e-4d30-a722-e9f971b5a3a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcd83e325cca4e2f86fcb3010138ace6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:34.619776 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-40e9b857-856e-4d30-a722-e9f971b5a3a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcd83e325cca4e2f86fcb3010138ace6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:34.636096 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-40e9b857-856e-4d30-a722-e9f971b5a3a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcd83e325cca4e2f86fcb3010138ace6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:34.653623 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-40e9b857-856e-4d30-a722-e9f971b5a3a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcd83e325cca4e2f86fcb3010138ace6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:34.689744 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-40e9b857-856e-4d30-a722-e9f971b5a3a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcd83e325cca4e2f86fcb3010138ace6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:34.712410 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2096/4173] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:52:34 2022] DELETE /identity/v3/users/fcd83e325cca4e2f86fcb3010138ace6 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:52:34.717819 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91333dd-4029-48dd-bdf6-13cc91678469 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:34.718411 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91333dd-4029-48dd-bdf6-13cc91678469 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:34.719393 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91333dd-4029-48dd-bdf6-13cc91678469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:34.760127 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a91333dd-4029-48dd-bdf6-13cc91678469 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:34.761703 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a91333dd-4029-48dd-bdf6-13cc91678469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:34.886453 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2078/4174] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:52:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:34.928677 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9b857-856e-4d30-a722-e9f971b5a3a4 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:34.933091 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-40e9b857-856e-4d30-a722-e9f971b5a3a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:35.098103 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9b857-856e-4d30-a722-e9f971b5a3a4 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:35.105166 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585af79-92fb-437e-80b7-3d84c6c562ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:35.106039 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585af79-92fb-437e-80b7-3d84c6c562ae service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:35.107206 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585af79-92fb-437e-80b7-3d84c6c562ae service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:35.107628 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585af79-92fb-437e-80b7-3d84c6c562ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:35.124797 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5585af79-92fb-437e-80b7-3d84c6c562ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:35.126438 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5585af79-92fb-437e-80b7-3d84c6c562ae service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:35.189852 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2097/4175] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:52:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:52:35.616961 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91333dd-4029-48dd-bdf6-13cc91678469 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:35.621745 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a91333dd-4029-48dd-bdf6-13cc91678469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:35.658423 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91333dd-4029-48dd-bdf6-13cc91678469 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:35.672709 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8469723-92c4-4c38-b54c-23bda6fc73a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:35.673733 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8469723-92c4-4c38-b54c-23bda6fc73a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:35.674376 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8469723-92c4-4c38-b54c-23bda6fc73a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:35.674750 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8469723-92c4-4c38-b54c-23bda6fc73a0 admin admin] PATH_INFO: `/v3/users/b5af3adb21364148ab7246a9dd76c64b` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:35.676880 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8469723-92c4-4c38-b54c-23bda6fc73a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5af3adb21364148ab7246a9dd76c64b)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:35.683254 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8469723-92c4-4c38-b54c-23bda6fc73a0 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:35.798973 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e8469723-92c4-4c38-b54c-23bda6fc73a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5af3adb21364148ab7246a9dd76c64b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:35.799930 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e8469723-92c4-4c38-b54c-23bda6fc73a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5af3adb21364148ab7246a9dd76c64b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:35.812143 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e8469723-92c4-4c38-b54c-23bda6fc73a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5af3adb21364148ab7246a9dd76c64b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:35.822362 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e8469723-92c4-4c38-b54c-23bda6fc73a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5af3adb21364148ab7246a9dd76c64b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:35.823274 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e8469723-92c4-4c38-b54c-23bda6fc73a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5af3adb21364148ab7246a9dd76c64b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:35.849674 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2079/4176] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:52:35 2022] DELETE /identity/v3/users/b5af3adb21364148ab7246a9dd76c64b => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:52:36.940497 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585af79-92fb-437e-80b7-3d84c6c562ae service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:36.958616 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585af79-92fb-437e-80b7-3d84c6c562ae service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:36.974108 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:37.066587 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142926c6-ba5f-4f2f-8014-544f1675e1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:37.067777 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142926c6-ba5f-4f2f-8014-544f1675e1b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:37.068276 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142926c6-ba5f-4f2f-8014-544f1675e1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:37.068795 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142926c6-ba5f-4f2f-8014-544f1675e1b3 admin admin] PATH_INFO: `/v3/projects/6167c4b90db44255a54a9d702d087f9b` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:37.070603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142926c6-ba5f-4f2f-8014-544f1675e1b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6167c4b90db44255a54a9d702d087f9b)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:37.073055 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142926c6-ba5f-4f2f-8014-544f1675e1b3 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:37.129445 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-142926c6-ba5f-4f2f-8014-544f1675e1b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6167c4b90db44255a54a9d702d087f9b', 'request_id': 'req-142926c6-ba5f-4f2f-8014-544f1675e1b3'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:37.139137 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-142926c6-ba5f-4f2f-8014-544f1675e1b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6167c4b90db44255a54a9d702d087f9b', 'request_id': 'req-142926c6-ba5f-4f2f-8014-544f1675e1b3'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:37.150383 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-142926c6-ba5f-4f2f-8014-544f1675e1b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6167c4b90db44255a54a9d702d087f9b', 'request_id': 'req-142926c6-ba5f-4f2f-8014-544f1675e1b3'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:37.177648 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-142926c6-ba5f-4f2f-8014-544f1675e1b3 admin admin] The token cache is being invalidate because project 6167c4b90db44255a54a9d702d087f9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:52:37.178534 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-142926c6-ba5f-4f2f-8014-544f1675e1b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:37.179518 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-142926c6-ba5f-4f2f-8014-544f1675e1b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:37.183049 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2098/4177] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:52:36 2022] DELETE /identity/v3/projects/6167c4b90db44255a54a9d702d087f9b => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:52:37.189125 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786d615-14f4-4470-a247-b545b27f4d2b None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:37.189680 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786d615-14f4-4470-a247-b545b27f4d2b None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:37.189879 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786d615-14f4-4470-a247-b545b27f4d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:37.219304 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-d786d615-14f4-4470-a247-b545b27f4d2b None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:37.219825 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d786d615-14f4-4470-a247-b545b27f4d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:37.295983 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142926c6-ba5f-4f2f-8014-544f1675e1b3 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:37.298396 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-142926c6-ba5f-4f2f-8014-544f1675e1b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:37.319556 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2080/4178] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:52:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:37.321825 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d554368-0ecd-467d-9cde-7bef6618d0a3 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:37.322221 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d554368-0ecd-467d-9cde-7bef6618d0a3 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:37.322593 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d554368-0ecd-467d-9cde-7bef6618d0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:37.373942 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-3d554368-0ecd-467d-9cde-7bef6618d0a3 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:37.375893 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3d554368-0ecd-467d-9cde-7bef6618d0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:37.394547 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2081/4179] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:52:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:37.399806 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d554368-0ecd-467d-9cde-7bef6618d0a3 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:37.412144 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:37.422016 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d554368-0ecd-467d-9cde-7bef6618d0a3 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:37.434985 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a68df0-7e66-428a-ac3b-6cefbc800678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:37.435798 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a68df0-7e66-428a-ac3b-6cefbc800678 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:37.436495 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a68df0-7e66-428a-ac3b-6cefbc800678 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:37.438008 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a68df0-7e66-428a-ac3b-6cefbc800678 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:37.439836 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a68df0-7e66-428a-ac3b-6cefbc800678 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:52:37.440731 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a68df0-7e66-428a-ac3b-6cefbc800678 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:37.443629 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a68df0-7e66-428a-ac3b-6cefbc800678 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:37.466178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142926c6-ba5f-4f2f-8014-544f1675e1b3 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:37.481312 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb96550-685a-460c-9880-b68d3f541062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:37.485553 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb96550-685a-460c-9880-b68d3f541062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:37.485553 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb96550-685a-460c-9880-b68d3f541062 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:37.485553 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb96550-685a-460c-9880-b68d3f541062 admin admin] PATH_INFO: `/v3/projects/1d3e63fe33a948479fef57a282a550a4` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:37.486066 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2082/4180] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:52:37.486309 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb96550-685a-460c-9880-b68d3f541062 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d3e63fe33a948479fef57a282a550a4)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:37.487306 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a68df0-7e66-428a-ac3b-6cefbc800678 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:37.489552 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb96550-685a-460c-9880-b68d3f541062 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:37.509610 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a68df0-7e66-428a-ac3b-6cefbc800678 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:37.532309 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aec77e-c87e-4c9c-9cbd-f5dceae0a6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:37.533924 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aec77e-c87e-4c9c-9cbd-f5dceae0a6d0 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:37.533924 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aec77e-c87e-4c9c-9cbd-f5dceae0a6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:37.533924 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aec77e-c87e-4c9c-9cbd-f5dceae0a6d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:37.538440 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aec77e-c87e-4c9c-9cbd-f5dceae0a6d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:37.543565 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aec77e-c87e-4c9c-9cbd-f5dceae0a6d0 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:37.615498 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2083/4181] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:52:37 2022] POST /identity/v3/projects => generated 377 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:52:37.617604 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:37.617794 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aec77e-c87e-4c9c-9cbd-f5dceae0a6d0 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:37.622197 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-feb96550-685a-460c-9880-b68d3f541062 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d3e63fe33a948479fef57a282a550a4', 'request_id': 'req-feb96550-685a-460c-9880-b68d3f541062'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:37.646315 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-feb96550-685a-460c-9880-b68d3f541062 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d3e63fe33a948479fef57a282a550a4', 'request_id': 'req-feb96550-685a-460c-9880-b68d3f541062'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:37.668253 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-feb96550-685a-460c-9880-b68d3f541062 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d3e63fe33a948479fef57a282a550a4', 'request_id': 'req-feb96550-685a-460c-9880-b68d3f541062'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:37.706785 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-feb96550-685a-460c-9880-b68d3f541062 admin admin] The token cache is being invalidate because project 1d3e63fe33a948479fef57a282a550a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:52:37.707050 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-feb96550-685a-460c-9880-b68d3f541062 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:37.711828 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-feb96550-685a-460c-9880-b68d3f541062 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:37.717318 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2099/4182] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:52:37 2022] DELETE /identity/v3/projects/1d3e63fe33a948479fef57a282a550a4 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:52:37.718864 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec8774-4769-4491-a977-b6916681da26 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:37.719181 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec8774-4769-4491-a977-b6916681da26 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:37.719464 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec8774-4769-4491-a977-b6916681da26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:37.769803 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aec77e-c87e-4c9c-9cbd-f5dceae0a6d0 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:37.777087 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e42783-0c8c-47d6-9111-3e044eabc405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:37.777725 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e42783-0c8c-47d6-9111-3e044eabc405 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:37.778284 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e42783-0c8c-47d6-9111-3e044eabc405 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:37.778732 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e42783-0c8c-47d6-9111-3e044eabc405 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:37.779673 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e42783-0c8c-47d6-9111-3e044eabc405 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:37.782537 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e42783-0c8c-47d6-9111-3e044eabc405 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:37.815379 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-23ec8774-4769-4491-a977-b6916681da26 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:37.817839 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-23ec8774-4769-4491-a977-b6916681da26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:37.832475 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2084/4183] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:52:37 2022] POST /identity/v3/users => generated 289 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:52:37.833966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e42783-0c8c-47d6-9111-3e044eabc405 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:37.837707 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-91e42783-0c8c-47d6-9111-3e044eabc405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:37.846434 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2100/4184] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:52:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:37.854072 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad653689-28d1-4752-94f6-7ec05a2646db None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:37.854424 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad653689-28d1-4752-94f6-7ec05a2646db None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:37.854855 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad653689-28d1-4752-94f6-7ec05a2646db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:37.890149 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e42783-0c8c-47d6-9111-3e044eabc405 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:37.922775 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c345a290-3ac2-4f90-b95a-8baabc1fc534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:37.922775 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345a290-3ac2-4f90-b95a-8baabc1fc534 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:37.923160 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345a290-3ac2-4f90-b95a-8baabc1fc534 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:37.923290 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345a290-3ac2-4f90-b95a-8baabc1fc534 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:37.923905 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c345a290-3ac2-4f90-b95a-8baabc1fc534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:37.925537 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c345a290-3ac2-4f90-b95a-8baabc1fc534 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:37.967736 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2085/4185] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:52:37.968993 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c345a290-3ac2-4f90-b95a-8baabc1fc534 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:37.996103 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c345a290-3ac2-4f90-b95a-8baabc1fc534 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:38.008219 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b4d7f-252d-4693-b66a-efbd6f6cb805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:38.009126 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b4d7f-252d-4693-b66a-efbd6f6cb805 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:38.009592 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b4d7f-252d-4693-b66a-efbd6f6cb805 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:38.009972 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b4d7f-252d-4693-b66a-efbd6f6cb805 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:38.010830 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3b4d7f-252d-4693-b66a-efbd6f6cb805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:38.012646 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3b4d7f-252d-4693-b66a-efbd6f6cb805 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:38.058789 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2086/4186] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:52:38.063563 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b4d7f-252d-4693-b66a-efbd6f6cb805 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:38.090652 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b4d7f-252d-4693-b66a-efbd6f6cb805 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:38.107350 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a285a-ab02-4895-8fdb-d7741edfc959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:38.108204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a285a-ab02-4895-8fdb-d7741edfc959 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:38.109499 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a285a-ab02-4895-8fdb-d7741edfc959 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:38.112001 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a285a-ab02-4895-8fdb-d7741edfc959 admin admin] PATH_INFO: `/v3/projects/c7ad457701f641bd963da9221fb04094/users/f554eb660c324a759d70b3b974e78db5/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:38.160647 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a285a-ab02-4895-8fdb-d7741edfc959 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7ad457701f641bd963da9221fb04094, user_id=f554eb660c324a759d70b3b974e78db5, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:38.167069 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a285a-ab02-4895-8fdb-d7741edfc959 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:38.190545 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-ad653689-28d1-4752-94f6-7ec05a2646db None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:38.192125 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ad653689-28d1-4752-94f6-7ec05a2646db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:38.207858 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2087/4187] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:52:38 2022] PUT /identity/v3/projects/c7ad457701f641bd963da9221fb04094/users/f554eb660c324a759d70b3b974e78db5/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:52:38.211549 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3dbf6-ad7e-466d-9bb7-e465447eabf3 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:38.211922 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3dbf6-ad7e-466d-9bb7-e465447eabf3 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:38.212316 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3dbf6-ad7e-466d-9bb7-e465447eabf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:38.298902 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-1fa3dbf6-ad7e-466d-9bb7-e465447eabf3 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:38.310254 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1fa3dbf6-ad7e-466d-9bb7-e465447eabf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:38.310472 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2101/4188] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:52:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 454 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:52:38.314008 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad653689-28d1-4752-94f6-7ec05a2646db None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:38.326291 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad653689-28d1-4752-94f6-7ec05a2646db None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:38.330718 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2088/4189] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:52:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:38.331836 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954cc2e-945c-41e5-8d07-2520d988de94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:38.332470 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954cc2e-945c-41e5-8d07-2520d988de94 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:38.332923 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954cc2e-945c-41e5-8d07-2520d988de94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:38.333189 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954cc2e-945c-41e5-8d07-2520d988de94 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:38.333853 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d954cc2e-945c-41e5-8d07-2520d988de94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:52:38.334158 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d954cc2e-945c-41e5-8d07-2520d988de94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:38.336415 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d954cc2e-945c-41e5-8d07-2520d988de94 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:38.354109 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2102/4190] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:52:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:52:38.355347 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3dbf6-ad7e-466d-9bb7-e465447eabf3 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:38.373935 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3dbf6-ad7e-466d-9bb7-e465447eabf3 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:38.381755 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc38c5cd-7835-445e-83c8-5b05aca7d948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:38.382666 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc38c5cd-7835-445e-83c8-5b05aca7d948 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:38.383491 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc38c5cd-7835-445e-83c8-5b05aca7d948 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:38.383784 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc38c5cd-7835-445e-83c8-5b05aca7d948 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:38.384499 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc38c5cd-7835-445e-83c8-5b05aca7d948 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:38.388708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc38c5cd-7835-445e-83c8-5b05aca7d948 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:38.447596 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2089/4191] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:52:38 2022] POST /identity/v3/projects => generated 383 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:52:38.451913 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954cc2e-945c-41e5-8d07-2520d988de94 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:38.487687 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954cc2e-945c-41e5-8d07-2520d988de94 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:38.510180 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc38c5cd-7835-445e-83c8-5b05aca7d948 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:38.512300 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-cc38c5cd-7835-445e-83c8-5b05aca7d948 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:38.622627 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:38.642785 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc38c5cd-7835-445e-83c8-5b05aca7d948 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:38.649988 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107161bc-0ba4-48ca-8878-b3551080ea19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:38.650819 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107161bc-0ba4-48ca-8878-b3551080ea19 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:38.651108 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107161bc-0ba4-48ca-8878-b3551080ea19 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:38.651446 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107161bc-0ba4-48ca-8878-b3551080ea19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:38.659168 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6618afcb-ba26-4b8b-8d32-9ebf80560a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:38.659831 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618afcb-ba26-4b8b-8d32-9ebf80560a08 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:38.660297 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618afcb-ba26-4b8b-8d32-9ebf80560a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:38.661454 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618afcb-ba26-4b8b-8d32-9ebf80560a08 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:38.662169 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6618afcb-ba26-4b8b-8d32-9ebf80560a08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:38.665254 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6618afcb-ba26-4b8b-8d32-9ebf80560a08 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:38.665383 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107161bc-0ba4-48ca-8878-b3551080ea19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:38.667047 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107161bc-0ba4-48ca-8878-b3551080ea19 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:38.685455 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2090/4192] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:52:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:52:38.705660 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107161bc-0ba4-48ca-8878-b3551080ea19 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:38.707961 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2103/4193] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:52:38 2022] POST /identity/v3/users => generated 292 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:52:38.721094 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107161bc-0ba4-48ca-8878-b3551080ea19 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:38.736437 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055dabe-ee55-4777-ab0f-9a37282b3d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:38.737086 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055dabe-ee55-4777-ab0f-9a37282b3d8f admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:38.737371 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055dabe-ee55-4777-ab0f-9a37282b3d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:38.737648 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055dabe-ee55-4777-ab0f-9a37282b3d8f admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:38.738576 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b055dabe-ee55-4777-ab0f-9a37282b3d8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:38.740270 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b055dabe-ee55-4777-ab0f-9a37282b3d8f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:38.774384 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2091/4194] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:52:38.779704 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6618afcb-ba26-4b8b-8d32-9ebf80560a08 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:38.793817 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6618afcb-ba26-4b8b-8d32-9ebf80560a08 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:38.801186 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e647c49-80bc-4387-b264-69b623b7195e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:38.802871 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e647c49-80bc-4387-b264-69b623b7195e admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:38.806983 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e647c49-80bc-4387-b264-69b623b7195e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:38.807370 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e647c49-80bc-4387-b264-69b623b7195e admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:38.809509 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e647c49-80bc-4387-b264-69b623b7195e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:38.811535 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e647c49-80bc-4387-b264-69b623b7195e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:38.843747 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2104/4195] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:52:38.845046 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055dabe-ee55-4777-ab0f-9a37282b3d8f admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:38.860767 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055dabe-ee55-4777-ab0f-9a37282b3d8f admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:38.866592 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78021ffe-1fbd-4aac-a5e3-a7a0ad4194bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:38.867513 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78021ffe-1fbd-4aac-a5e3-a7a0ad4194bc admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:38.867796 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78021ffe-1fbd-4aac-a5e3-a7a0ad4194bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:38.868071 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78021ffe-1fbd-4aac-a5e3-a7a0ad4194bc admin admin] PATH_INFO: `/v3/projects/04c4fb2330864b258b2e919220393bef/users/f7baa9210bfb4895a247d55cdfcf98a5/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:38.888029 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78021ffe-1fbd-4aac-a5e3-a7a0ad4194bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=04c4fb2330864b258b2e919220393bef, user_id=f7baa9210bfb4895a247d55cdfcf98a5, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:38.890890 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78021ffe-1fbd-4aac-a5e3-a7a0ad4194bc admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:38.916023 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2092/4196] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:52:38 2022] PUT /identity/v3/projects/04c4fb2330864b258b2e919220393bef/users/f7baa9210bfb4895a247d55cdfcf98a5/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:52:38.918275 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f32070-d4b9-4fdc-b308-02e94b657da3 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:38.918637 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f32070-d4b9-4fdc-b308-02e94b657da3 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:38.919547 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f32070-d4b9-4fdc-b308-02e94b657da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:38.957846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-00f32070-d4b9-4fdc-b308-02e94b657da3 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:38.959386 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-00f32070-d4b9-4fdc-b308-02e94b657da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:39.008109 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:39.059231 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2105/4197] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:52:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:39.115933 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78021ffe-1fbd-4aac-a5e3-a7a0ad4194bc admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:39.219216 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78021ffe-1fbd-4aac-a5e3-a7a0ad4194bc admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:39.223457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da97d7f-622f-4e08-b6fd-487bad9617ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:39.224203 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da97d7f-622f-4e08-b6fd-487bad9617ec service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:39.225047 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da97d7f-622f-4e08-b6fd-487bad9617ec service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:39.225389 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da97d7f-622f-4e08-b6fd-487bad9617ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:39.257436 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da97d7f-622f-4e08-b6fd-487bad9617ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:39.258536 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da97d7f-622f-4e08-b6fd-487bad9617ec service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:39.280250 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2093/4198] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:52:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:52:40.269813 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f32070-d4b9-4fdc-b308-02e94b657da3 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:40.272277 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-00f32070-d4b9-4fdc-b308-02e94b657da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:40.287279 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f32070-d4b9-4fdc-b308-02e94b657da3 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:40.299434 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41d1d5-3bdf-4556-99b0-94275c5e41e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:40.300361 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41d1d5-3bdf-4556-99b0-94275c5e41e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:40.300796 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41d1d5-3bdf-4556-99b0-94275c5e41e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:40.301221 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41d1d5-3bdf-4556-99b0-94275c5e41e6 admin admin] PATH_INFO: `/v3/users/a3e14fd42e5942199e28335124d59c75` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:40.302653 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41d1d5-3bdf-4556-99b0-94275c5e41e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3e14fd42e5942199e28335124d59c75)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:40.305835 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41d1d5-3bdf-4556-99b0-94275c5e41e6 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:40.400351 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5b41d1d5-3bdf-4556-99b0-94275c5e41e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3e14fd42e5942199e28335124d59c75'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:40.402159 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5b41d1d5-3bdf-4556-99b0-94275c5e41e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3e14fd42e5942199e28335124d59c75'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:40.420274 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5b41d1d5-3bdf-4556-99b0-94275c5e41e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3e14fd42e5942199e28335124d59c75'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:40.434043 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5b41d1d5-3bdf-4556-99b0-94275c5e41e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3e14fd42e5942199e28335124d59c75'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:40.442609 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5b41d1d5-3bdf-4556-99b0-94275c5e41e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3e14fd42e5942199e28335124d59c75'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:40.453635 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2106/4199] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:52:40 2022] DELETE /identity/v3/users/a3e14fd42e5942199e28335124d59c75 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:52:41.384870 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da97d7f-622f-4e08-b6fd-487bad9617ec service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:41.404013 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da97d7f-622f-4e08-b6fd-487bad9617ec service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:41.659971 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f0db9-4487-44c6-be07-38af39922f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:41.660927 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f0db9-4487-44c6-be07-38af39922f95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:41.661455 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f0db9-4487-44c6-be07-38af39922f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:41.661887 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f0db9-4487-44c6-be07-38af39922f95 admin admin] PATH_INFO: `/v3/projects/a8591065e9fa421b8e44767aa38fd84f` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:41.665682 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4f0db9-4487-44c6-be07-38af39922f95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8591065e9fa421b8e44767aa38fd84f)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:41.668461 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4f0db9-4487-44c6-be07-38af39922f95 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:41.826108 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-bd4f0db9-4487-44c6-be07-38af39922f95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8591065e9fa421b8e44767aa38fd84f', 'request_id': 'req-bd4f0db9-4487-44c6-be07-38af39922f95'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:41.835883 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:41.838704 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-bd4f0db9-4487-44c6-be07-38af39922f95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8591065e9fa421b8e44767aa38fd84f', 'request_id': 'req-bd4f0db9-4487-44c6-be07-38af39922f95'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:41.853788 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-bd4f0db9-4487-44c6-be07-38af39922f95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8591065e9fa421b8e44767aa38fd84f', 'request_id': 'req-bd4f0db9-4487-44c6-be07-38af39922f95'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:41.876709 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-bd4f0db9-4487-44c6-be07-38af39922f95 admin admin] The token cache is being invalidate because project a8591065e9fa421b8e44767aa38fd84f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:52:41.877380 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-bd4f0db9-4487-44c6-be07-38af39922f95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:41.879179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-bd4f0db9-4487-44c6-be07-38af39922f95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:41.884699 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2094/4200] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:52:41 2022] DELETE /identity/v3/projects/a8591065e9fa421b8e44767aa38fd84f => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:52:41.886255 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aae2bc-f10b-413b-a8f4-e26d0ad01484 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:41.886779 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aae2bc-f10b-413b-a8f4-e26d0ad01484 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:41.886779 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aae2bc-f10b-413b-a8f4-e26d0ad01484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:41.910120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-d4aae2bc-f10b-413b-a8f4-e26d0ad01484 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:41.911420 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d4aae2bc-f10b-413b-a8f4-e26d0ad01484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:42.051131 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2107/4201] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:52:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:52:42.051501 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b044a9b-04f9-4c23-a592-579802b6f392 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:42.052835 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b044a9b-04f9-4c23-a592-579802b6f392 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:42.053271 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b044a9b-04f9-4c23-a592-579802b6f392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:42.137152 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-3b044a9b-04f9-4c23-a592-579802b6f392 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:42.139117 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3b044a9b-04f9-4c23-a592-579802b6f392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:42.168125 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2095/4202] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:52:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:42.168429 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aae2bc-f10b-413b-a8f4-e26d0ad01484 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:42.190133 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aae2bc-f10b-413b-a8f4-e26d0ad01484 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:42.203107 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbe889-9b6d-4694-ad54-74405260dd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:42.205089 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbe889-9b6d-4694-ad54-74405260dd2a admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:42.206554 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbe889-9b6d-4694-ad54-74405260dd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:42.206945 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbe889-9b6d-4694-ad54-74405260dd2a admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:42.210306 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dbe889-9b6d-4694-ad54-74405260dd2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:52:42.210779 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dbe889-9b6d-4694-ad54-74405260dd2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:42.215544 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dbe889-9b6d-4694-ad54-74405260dd2a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:42.243846 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b044a9b-04f9-4c23-a592-579802b6f392 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:42.257406 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2108/4203] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:52:42.259071 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b044a9b-04f9-4c23-a592-579802b6f392 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:42.264992 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0be15c-9da6-44ee-b16f-7d40b658b7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:42.265737 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0be15c-9da6-44ee-b16f-7d40b658b7a5 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:42.266019 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0be15c-9da6-44ee-b16f-7d40b658b7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:42.267671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0be15c-9da6-44ee-b16f-7d40b658b7a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:42.267671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0be15c-9da6-44ee-b16f-7d40b658b7a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:42.269917 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0be15c-9da6-44ee-b16f-7d40b658b7a5 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:42.357787 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbe889-9b6d-4694-ad54-74405260dd2a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:42.371861 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2096/4204] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:52:42 2022] POST /identity/v3/projects => generated 375 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:52:42.377935 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbe889-9b6d-4694-ad54-74405260dd2a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:42.505825 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:42.582046 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc57749-195f-4727-bfdf-5eda5c7d181b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:42.582656 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc57749-195f-4727-bfdf-5eda5c7d181b admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:42.582941 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc57749-195f-4727-bfdf-5eda5c7d181b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:42.583387 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc57749-195f-4727-bfdf-5eda5c7d181b admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:42.586514 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc57749-195f-4727-bfdf-5eda5c7d181b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:42.588627 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc57749-195f-4727-bfdf-5eda5c7d181b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:42.639690 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0be15c-9da6-44ee-b16f-7d40b658b7a5 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:42.647168 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2109/4205] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:52:42 2022] POST /identity/v3/users => generated 288 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:52:42.656886 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0be15c-9da6-44ee-b16f-7d40b658b7a5 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:42.662612 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0984a-8c5f-49cd-8344-3f2f48cf4a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:42.663290 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0984a-8c5f-49cd-8344-3f2f48cf4a57 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:42.663568 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0984a-8c5f-49cd-8344-3f2f48cf4a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:42.663874 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0984a-8c5f-49cd-8344-3f2f48cf4a57 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:42.664671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab0984a-8c5f-49cd-8344-3f2f48cf4a57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:42.666798 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab0984a-8c5f-49cd-8344-3f2f48cf4a57 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:42.682797 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc57749-195f-4727-bfdf-5eda5c7d181b admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:42.689726 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2097/4206] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:52:42.696971 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc57749-195f-4727-bfdf-5eda5c7d181b admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:42.702422 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395afa58-4def-40ec-8eb3-05dcfdf0b70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:42.703207 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395afa58-4def-40ec-8eb3-05dcfdf0b70e admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:42.703558 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395afa58-4def-40ec-8eb3-05dcfdf0b70e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:42.703901 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395afa58-4def-40ec-8eb3-05dcfdf0b70e admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:42.704894 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395afa58-4def-40ec-8eb3-05dcfdf0b70e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:42.706860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395afa58-4def-40ec-8eb3-05dcfdf0b70e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:42.733381 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2110/4207] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:52:42.733701 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0984a-8c5f-49cd-8344-3f2f48cf4a57 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:42.759296 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0984a-8c5f-49cd-8344-3f2f48cf4a57 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:42.772677 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea4d0c-5262-49ee-9cc2-446d776fc512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:42.774261 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea4d0c-5262-49ee-9cc2-446d776fc512 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:42.774542 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea4d0c-5262-49ee-9cc2-446d776fc512 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:42.774818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea4d0c-5262-49ee-9cc2-446d776fc512 admin admin] PATH_INFO: `/v3/projects/d3085a72d4a644a2bfcc0109f0743127/users/9dda72ff55b246cea4bf5bc5e1e87c5f/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:42.817892 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea4d0c-5262-49ee-9cc2-446d776fc512 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3085a72d4a644a2bfcc0109f0743127, user_id=9dda72ff55b246cea4bf5bc5e1e87c5f, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:42.821967 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea4d0c-5262-49ee-9cc2-446d776fc512 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:42.863351 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2098/4208] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:52:42 2022] PUT /identity/v3/projects/d3085a72d4a644a2bfcc0109f0743127/users/9dda72ff55b246cea4bf5bc5e1e87c5f/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:52:42.869528 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6af5db-a268-43b1-ba1e-74cf6b6a0d4c None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:42.869901 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6af5db-a268-43b1-ba1e-74cf6b6a0d4c None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:42.870185 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6af5db-a268-43b1-ba1e-74cf6b6a0d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:42.909388 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-3e6af5db-a268-43b1-ba1e-74cf6b6a0d4c None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:42.910652 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3e6af5db-a268-43b1-ba1e-74cf6b6a0d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:43.008930 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea4d0c-5262-49ee-9cc2-446d776fc512 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:43.012818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-49ea4d0c-5262-49ee-9cc2-446d776fc512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:43.037753 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2111/4209] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:52:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:43.050469 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6af5db-a268-43b1-ba1e-74cf6b6a0d4c None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:43.053829 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3e6af5db-a268-43b1-ba1e-74cf6b6a0d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:43.159322 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea4d0c-5262-49ee-9cc2-446d776fc512 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:43.166072 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59d3f3-8b3e-4851-b6ae-ae83e3a2ef24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:43.167420 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59d3f3-8b3e-4851-b6ae-ae83e3a2ef24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:43.168332 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59d3f3-8b3e-4851-b6ae-ae83e3a2ef24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:43.168880 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59d3f3-8b3e-4851-b6ae-ae83e3a2ef24 admin admin] PATH_INFO: `/v3/users/77c464ce17574849a244d3cf2df54dd2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:43.170454 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e59d3f3-8b3e-4851-b6ae-ae83e3a2ef24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77c464ce17574849a244d3cf2df54dd2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:43.173060 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e59d3f3-8b3e-4851-b6ae-ae83e3a2ef24 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:43.205977 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6af5db-a268-43b1-ba1e-74cf6b6a0d4c None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:43.214914 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c27cbb-9ff4-48f6-9594-8bbffbe30de6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:43.216040 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c27cbb-9ff4-48f6-9594-8bbffbe30de6 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:43.216645 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c27cbb-9ff4-48f6-9594-8bbffbe30de6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:43.217077 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c27cbb-9ff4-48f6-9594-8bbffbe30de6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:43.235524 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c27cbb-9ff4-48f6-9594-8bbffbe30de6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:43.237299 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c27cbb-9ff4-48f6-9594-8bbffbe30de6 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:43.258673 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2112/4210] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:52:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:52:43.295259 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8e59d3f3-8b3e-4851-b6ae-ae83e3a2ef24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77c464ce17574849a244d3cf2df54dd2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:43.296631 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8e59d3f3-8b3e-4851-b6ae-ae83e3a2ef24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77c464ce17574849a244d3cf2df54dd2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:43.323171 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8e59d3f3-8b3e-4851-b6ae-ae83e3a2ef24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77c464ce17574849a244d3cf2df54dd2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:43.333987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8e59d3f3-8b3e-4851-b6ae-ae83e3a2ef24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77c464ce17574849a244d3cf2df54dd2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:43.335371 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8e59d3f3-8b3e-4851-b6ae-ae83e3a2ef24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77c464ce17574849a244d3cf2df54dd2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:43.365347 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=85,keystone:INSERT=4,keystone:DELETE=11 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:43.375721 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2099/4211] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:52:43 2022] DELETE /identity/v3/users/77c464ce17574849a244d3cf2df54dd2 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:52:43.377669 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604160a-4c60-4871-97b3-c8db250bdefc None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:43.378058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604160a-4c60-4871-97b3-c8db250bdefc None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:43.378564 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604160a-4c60-4871-97b3-c8db250bdefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:43.418334 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-6604160a-4c60-4871-97b3-c8db250bdefc None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:43.422153 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6604160a-4c60-4871-97b3-c8db250bdefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:43.562659 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:43.585005 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2113/4212] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:52:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:43.655858 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59d3f3-8b3e-4851-b6ae-ae83e3a2ef24 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:43.657433 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8e59d3f3-8b3e-4851-b6ae-ae83e3a2ef24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:43.863171 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59d3f3-8b3e-4851-b6ae-ae83e3a2ef24 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:43.867737 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a3edd9-35ea-4fce-aee5-00991ca63d83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:43.868679 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3edd9-35ea-4fce-aee5-00991ca63d83 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:43.869354 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3edd9-35ea-4fce-aee5-00991ca63d83 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:43.869843 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3edd9-35ea-4fce-aee5-00991ca63d83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:43.891290 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a3edd9-35ea-4fce-aee5-00991ca63d83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:43.894966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a3edd9-35ea-4fce-aee5-00991ca63d83 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:43.909995 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2100/4213] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:52:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:52:44.654033 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604160a-4c60-4871-97b3-c8db250bdefc None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:44.655706 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6604160a-4c60-4871-97b3-c8db250bdefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:44.675389 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604160a-4c60-4871-97b3-c8db250bdefc None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:44.690319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ef1f09-0972-4da3-b198-667981d7795a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:44.691211 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef1f09-0972-4da3-b198-667981d7795a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:44.691849 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef1f09-0972-4da3-b198-667981d7795a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:44.692385 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef1f09-0972-4da3-b198-667981d7795a admin admin] PATH_INFO: `/v3/projects/f33bcae207684a9f8f836a0460b8b72f` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:44.697146 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ef1f09-0972-4da3-b198-667981d7795a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f33bcae207684a9f8f836a0460b8b72f)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:44.699886 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ef1f09-0972-4da3-b198-667981d7795a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:44.815331 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-37ef1f09-0972-4da3-b198-667981d7795a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f33bcae207684a9f8f836a0460b8b72f', 'request_id': 'req-37ef1f09-0972-4da3-b198-667981d7795a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:44.825770 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-37ef1f09-0972-4da3-b198-667981d7795a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f33bcae207684a9f8f836a0460b8b72f', 'request_id': 'req-37ef1f09-0972-4da3-b198-667981d7795a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:44.837438 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-37ef1f09-0972-4da3-b198-667981d7795a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f33bcae207684a9f8f836a0460b8b72f', 'request_id': 'req-37ef1f09-0972-4da3-b198-667981d7795a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:44.858741 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-37ef1f09-0972-4da3-b198-667981d7795a admin admin] The token cache is being invalidate because project f33bcae207684a9f8f836a0460b8b72f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:52:44.859273 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-37ef1f09-0972-4da3-b198-667981d7795a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:44.861416 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-37ef1f09-0972-4da3-b198-667981d7795a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:44.866345 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2114/4214] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:52:44 2022] DELETE /identity/v3/projects/f33bcae207684a9f8f836a0460b8b72f => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:52:44.868290 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a3edd9-35ea-4fce-aee5-00991ca63d83 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:44.878769 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a3edd9-35ea-4fce-aee5-00991ca63d83 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:44.998780 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3e052-40df-4c6b-8e68-f47a55216875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:44.999789 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3e052-40df-4c6b-8e68-f47a55216875 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:45.000266 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3e052-40df-4c6b-8e68-f47a55216875 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:45.000733 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3e052-40df-4c6b-8e68-f47a55216875 admin admin] PATH_INFO: `/v3/users/c5c51f0d44674283b8486f3314b56482` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:45.002318 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e3e052-40df-4c6b-8e68-f47a55216875 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5c51f0d44674283b8486f3314b56482)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:45.004892 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e3e052-40df-4c6b-8e68-f47a55216875 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:45.093027 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-56e3e052-40df-4c6b-8e68-f47a55216875 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5c51f0d44674283b8486f3314b56482'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:45.094042 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-56e3e052-40df-4c6b-8e68-f47a55216875 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5c51f0d44674283b8486f3314b56482'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:45.104484 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-56e3e052-40df-4c6b-8e68-f47a55216875 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5c51f0d44674283b8486f3314b56482'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:45.114951 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-56e3e052-40df-4c6b-8e68-f47a55216875 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5c51f0d44674283b8486f3314b56482'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:45.116025 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-56e3e052-40df-4c6b-8e68-f47a55216875 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5c51f0d44674283b8486f3314b56482'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:45.145623 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2101/4215] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:52:44 2022] DELETE /identity/v3/users/c5c51f0d44674283b8486f3314b56482 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:52:46.407471 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ef1f09-0972-4da3-b198-667981d7795a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:46.414997 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-37ef1f09-0972-4da3-b198-667981d7795a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:46.445742 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ef1f09-0972-4da3-b198-667981d7795a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:46.617456 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20344bd-cbd7-4885-a806-9fd01db3eb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:46.618587 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20344bd-cbd7-4885-a806-9fd01db3eb3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:46.619109 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20344bd-cbd7-4885-a806-9fd01db3eb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:46.620738 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20344bd-cbd7-4885-a806-9fd01db3eb3c admin admin] PATH_INFO: `/v3/projects/0c8226e0b4534d2eaa6fcd902d31cb41` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:46.622409 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20344bd-cbd7-4885-a806-9fd01db3eb3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c8226e0b4534d2eaa6fcd902d31cb41)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:46.624703 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20344bd-cbd7-4885-a806-9fd01db3eb3c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:46.756997 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c20344bd-cbd7-4885-a806-9fd01db3eb3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c8226e0b4534d2eaa6fcd902d31cb41', 'request_id': 'req-c20344bd-cbd7-4885-a806-9fd01db3eb3c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:46.766249 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c20344bd-cbd7-4885-a806-9fd01db3eb3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c8226e0b4534d2eaa6fcd902d31cb41', 'request_id': 'req-c20344bd-cbd7-4885-a806-9fd01db3eb3c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:46.791972 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c20344bd-cbd7-4885-a806-9fd01db3eb3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c8226e0b4534d2eaa6fcd902d31cb41', 'request_id': 'req-c20344bd-cbd7-4885-a806-9fd01db3eb3c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:46.809520 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c20344bd-cbd7-4885-a806-9fd01db3eb3c admin admin] The token cache is being invalidate because project 0c8226e0b4534d2eaa6fcd902d31cb41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:52:46.810394 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c20344bd-cbd7-4885-a806-9fd01db3eb3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:46.811516 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c20344bd-cbd7-4885-a806-9fd01db3eb3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:46.813997 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2115/4216] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:52:46 2022] DELETE /identity/v3/projects/0c8226e0b4534d2eaa6fcd902d31cb41 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:52:46.818837 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f707e65-0e59-4608-992c-6fa01f5f2fb2 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:46.819374 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f707e65-0e59-4608-992c-6fa01f5f2fb2 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:46.819477 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f707e65-0e59-4608-992c-6fa01f5f2fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:46.858587 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-7f707e65-0e59-4608-992c-6fa01f5f2fb2 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:46.862880 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7f707e65-0e59-4608-992c-6fa01f5f2fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:46.899441 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:47.020008 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2102/4217] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:52:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:47.025050 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d52b54-775d-430e-97e5-9cb2eab5a344 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:47.027631 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d52b54-775d-430e-97e5-9cb2eab5a344 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:47.028163 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d52b54-775d-430e-97e5-9cb2eab5a344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:47.119301 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-59d52b54-775d-430e-97e5-9cb2eab5a344 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:47.124032 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-59d52b54-775d-430e-97e5-9cb2eab5a344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:47.140114 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2116/4218] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:52:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:47.141393 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f707e65-0e59-4608-992c-6fa01f5f2fb2 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:47.153258 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f707e65-0e59-4608-992c-6fa01f5f2fb2 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:47.177651 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bbf674-51e8-47be-8afb-e2c67725935d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:47.178350 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbf674-51e8-47be-8afb-e2c67725935d admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:47.178636 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbf674-51e8-47be-8afb-e2c67725935d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:47.178910 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbf674-51e8-47be-8afb-e2c67725935d admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:47.179907 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bbf674-51e8-47be-8afb-e2c67725935d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:52:47.180291 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bbf674-51e8-47be-8afb-e2c67725935d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:47.182794 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bbf674-51e8-47be-8afb-e2c67725935d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:47.212926 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2103/4219] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:52:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:52:47.217352 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d52b54-775d-430e-97e5-9cb2eab5a344 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:47.223631 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:47.232497 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d52b54-775d-430e-97e5-9cb2eab5a344 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:47.245040 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f7b13-7ff4-44ce-80ae-18f9f9ab4e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:47.245671 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f7b13-7ff4-44ce-80ae-18f9f9ab4e58 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:47.245963 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f7b13-7ff4-44ce-80ae-18f9f9ab4e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:47.246225 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f7b13-7ff4-44ce-80ae-18f9f9ab4e58 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:47.247371 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3f7b13-7ff4-44ce-80ae-18f9f9ab4e58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:47.255696 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3f7b13-7ff4-44ce-80ae-18f9f9ab4e58 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:47.330928 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2117/4220] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:52:47 2022] POST /identity/v3/projects => generated 381 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:52:47.335116 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bbf674-51e8-47be-8afb-e2c67725935d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:47.352431 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bbf674-51e8-47be-8afb-e2c67725935d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:47.510328 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbccdf8-c9cd-41ef-9097-c5af1393166d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:47.511104 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbccdf8-c9cd-41ef-9097-c5af1393166d admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:47.511465 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbccdf8-c9cd-41ef-9097-c5af1393166d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:47.511814 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbccdf8-c9cd-41ef-9097-c5af1393166d admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:47.512574 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbccdf8-c9cd-41ef-9097-c5af1393166d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:47.515463 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbccdf8-c9cd-41ef-9097-c5af1393166d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:47.586757 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2104/4221] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:52:47 2022] POST /identity/v3/users => generated 291 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:52:47.590747 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f7b13-7ff4-44ce-80ae-18f9f9ab4e58 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:47.611479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f7b13-7ff4-44ce-80ae-18f9f9ab4e58 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:47.624433 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40605ce7-4398-4088-983c-3e75b5b833df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:47.625089 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40605ce7-4398-4088-983c-3e75b5b833df admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:47.625517 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40605ce7-4398-4088-983c-3e75b5b833df admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:47.625798 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40605ce7-4398-4088-983c-3e75b5b833df admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:47.626477 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40605ce7-4398-4088-983c-3e75b5b833df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:47.628627 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40605ce7-4398-4088-983c-3e75b5b833df admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:47.660433 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2118/4222] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:52:47.662908 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbccdf8-c9cd-41ef-9097-c5af1393166d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:47.677817 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbccdf8-c9cd-41ef-9097-c5af1393166d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:47.689875 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf9cdc-91f7-4f03-ac01-9e6a7463b964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:47.690812 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf9cdc-91f7-4f03-ac01-9e6a7463b964 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:47.691312 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf9cdc-91f7-4f03-ac01-9e6a7463b964 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:47.692207 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf9cdc-91f7-4f03-ac01-9e6a7463b964 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:47.693053 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf9cdc-91f7-4f03-ac01-9e6a7463b964 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:47.696136 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf9cdc-91f7-4f03-ac01-9e6a7463b964 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:47.743771 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2105/4223] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:52:47.747605 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40605ce7-4398-4088-983c-3e75b5b833df admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:47.775459 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40605ce7-4398-4088-983c-3e75b5b833df admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:47.803850 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32baae42-ff6f-4a78-8804-70ffc264c69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:47.805104 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32baae42-ff6f-4a78-8804-70ffc264c69a admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:47.805391 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32baae42-ff6f-4a78-8804-70ffc264c69a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:47.805672 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32baae42-ff6f-4a78-8804-70ffc264c69a admin admin] PATH_INFO: `/v3/projects/e985f22ed4ef45699f67323ff4b79cbc/users/8997fb3e021342f0881f043eaf9a4ab5/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:47.864049 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32baae42-ff6f-4a78-8804-70ffc264c69a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e985f22ed4ef45699f67323ff4b79cbc, user_id=8997fb3e021342f0881f043eaf9a4ab5, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:47.868968 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32baae42-ff6f-4a78-8804-70ffc264c69a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:47.897835 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2119/4224] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:52:47 2022] PUT /identity/v3/projects/e985f22ed4ef45699f67323ff4b79cbc/users/8997fb3e021342f0881f043eaf9a4ab5/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:52:47.909085 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56116f-616d-4c60-bbd0-a8dbfa530c26 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:47.910114 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56116f-616d-4c60-bbd0-a8dbfa530c26 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:47.910764 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56116f-616d-4c60-bbd0-a8dbfa530c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:48.012750 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-8a56116f-616d-4c60-bbd0-a8dbfa530c26 None None] MFA Rules not processed for user `8997fb3e021342f0881f043eaf9a4ab5`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:48.015153 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8a56116f-616d-4c60-bbd0-a8dbfa530c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:48.191575 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2106/4225] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:52:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:48.196023 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32baae42-ff6f-4a78-8804-70ffc264c69a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:48.333559 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32baae42-ff6f-4a78-8804-70ffc264c69a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:48.344534 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35127de0-eac6-4e92-96f8-dec7afb87f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:48.346389 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35127de0-eac6-4e92-96f8-dec7afb87f16 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:48.346608 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35127de0-eac6-4e92-96f8-dec7afb87f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:48.346887 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35127de0-eac6-4e92-96f8-dec7afb87f16 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:48.348745 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35127de0-eac6-4e92-96f8-dec7afb87f16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:48.350711 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35127de0-eac6-4e92-96f8-dec7afb87f16 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:48.418173 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2120/4226] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:52:48 2022] POST /identity/v3/projects => generated 383 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:52:48.422105 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56116f-616d-4c60-bbd0-a8dbfa530c26 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:48.439359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56116f-616d-4c60-bbd0-a8dbfa530c26 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:48.479009 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:48.581236 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1cc69-231a-4707-9fea-da74a50dfa6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:48.583418 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1cc69-231a-4707-9fea-da74a50dfa6f admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:48.584146 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1cc69-231a-4707-9fea-da74a50dfa6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:48.586756 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1cc69-231a-4707-9fea-da74a50dfa6f admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:48.587504 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a1cc69-231a-4707-9fea-da74a50dfa6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:48.594101 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a1cc69-231a-4707-9fea-da74a50dfa6f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:48.657048 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2107/4227] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:52:48 2022] POST /identity/v3/users => generated 292 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:52:48.659412 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35127de0-eac6-4e92-96f8-dec7afb87f16 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:48.699587 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35127de0-eac6-4e92-96f8-dec7afb87f16 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:48.712319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969f744-3b20-4d40-9660-4e26f1e8ffdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:48.713045 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969f744-3b20-4d40-9660-4e26f1e8ffdc admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:48.713332 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969f744-3b20-4d40-9660-4e26f1e8ffdc admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:48.713607 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969f744-3b20-4d40-9660-4e26f1e8ffdc admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:48.714324 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2969f744-3b20-4d40-9660-4e26f1e8ffdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:48.716149 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2969f744-3b20-4d40-9660-4e26f1e8ffdc admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:48.756790 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1cc69-231a-4707-9fea-da74a50dfa6f admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:48.767067 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2121/4228] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:52:48.768344 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1cc69-231a-4707-9fea-da74a50dfa6f admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:48.786730 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06bd086-598e-45b6-af56-503c8e5439e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:48.788131 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06bd086-598e-45b6-af56-503c8e5439e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:48.788292 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06bd086-598e-45b6-af56-503c8e5439e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:48.788497 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06bd086-598e-45b6-af56-503c8e5439e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:48.789875 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06bd086-598e-45b6-af56-503c8e5439e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:48.791573 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06bd086-598e-45b6-af56-503c8e5439e2 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:48.828956 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2108/4229] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:52:48.832786 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969f744-3b20-4d40-9660-4e26f1e8ffdc admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:48.849365 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969f744-3b20-4d40-9660-4e26f1e8ffdc admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:48.863647 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066508fd-14b2-4111-960e-9d44d20b6bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:48.865747 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066508fd-14b2-4111-960e-9d44d20b6bb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:48.866039 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066508fd-14b2-4111-960e-9d44d20b6bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:48.866317 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066508fd-14b2-4111-960e-9d44d20b6bb2 admin admin] PATH_INFO: `/v3/projects/c6509cbe3b114f40bc00e86e934c495a/users/91fde932d5274fd19d07532c985ff77a/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:48.912101 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066508fd-14b2-4111-960e-9d44d20b6bb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6509cbe3b114f40bc00e86e934c495a, user_id=91fde932d5274fd19d07532c985ff77a, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:48.916300 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066508fd-14b2-4111-960e-9d44d20b6bb2 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:48.966574 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2122/4230] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:52:48 2022] PUT /identity/v3/projects/c6509cbe3b114f40bc00e86e934c495a/users/91fde932d5274fd19d07532c985ff77a/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:52:48.969052 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e0ad2-b437-4a73-8c1c-d893be2b151d None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:48.969534 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e0ad2-b437-4a73-8c1c-d893be2b151d None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:48.969936 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e0ad2-b437-4a73-8c1c-d893be2b151d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:49.044003 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-1c5e0ad2-b437-4a73-8c1c-d893be2b151d None None] MFA Rules not processed for user `91fde932d5274fd19d07532c985ff77a`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:49.046869 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1c5e0ad2-b437-4a73-8c1c-d893be2b151d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:49.167631 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2109/4231] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:52:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:49.173095 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066508fd-14b2-4111-960e-9d44d20b6bb2 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:49.330937 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:49.341899 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066508fd-14b2-4111-960e-9d44d20b6bb2 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:49.364858 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed95a764-9c30-4fad-af62-47c2c49c7d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:49.365806 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95a764-9c30-4fad-af62-47c2c49c7d11 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:49.365806 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95a764-9c30-4fad-af62-47c2c49c7d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:49.366042 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95a764-9c30-4fad-af62-47c2c49c7d11 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:49.366811 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed95a764-9c30-4fad-af62-47c2c49c7d11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:49.376286 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed95a764-9c30-4fad-af62-47c2c49c7d11 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:49.464962 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2123/4232] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:52:49 2022] POST /identity/v3/projects => generated 383 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:52:49.471061 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e0ad2-b437-4a73-8c1c-d893be2b151d None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:49.492480 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e0ad2-b437-4a73-8c1c-d893be2b151d None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:49.720580 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3b32b-3074-4e83-92ca-676789df9269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:49.721208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3b32b-3074-4e83-92ca-676789df9269 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:49.721494 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3b32b-3074-4e83-92ca-676789df9269 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:49.721773 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3b32b-3074-4e83-92ca-676789df9269 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:49.722428 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3b32b-3074-4e83-92ca-676789df9269 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:49.724435 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3b32b-3074-4e83-92ca-676789df9269 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:49.797295 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2110/4233] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:52:49 2022] POST /identity/v3/users => generated 298 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:52:49.801846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed95a764-9c30-4fad-af62-47c2c49c7d11 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:49.816131 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed95a764-9c30-4fad-af62-47c2c49c7d11 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:49.847932 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5108d-9c28-484e-beb0-6fcb7a73edd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:49.848586 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5108d-9c28-484e-beb0-6fcb7a73edd6 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:49.849019 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5108d-9c28-484e-beb0-6fcb7a73edd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:49.849302 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5108d-9c28-484e-beb0-6fcb7a73edd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:49.849978 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f5108d-9c28-484e-beb0-6fcb7a73edd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:49.855486 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f5108d-9c28-484e-beb0-6fcb7a73edd6 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:49.897688 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2124/4234] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:52:49.902182 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3b32b-3074-4e83-92ca-676789df9269 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:49.921041 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3b32b-3074-4e83-92ca-676789df9269 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:49.941561 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533e0f8-0c19-4bef-a00d-dbadad49e398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:49.948566 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533e0f8-0c19-4bef-a00d-dbadad49e398 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:49.948991 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533e0f8-0c19-4bef-a00d-dbadad49e398 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:49.962000 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533e0f8-0c19-4bef-a00d-dbadad49e398 admin admin] PATH_INFO: `/v3/projects/08c11855aecc48b1be582cd127b7fad5/users/ba5a1d4ec9314fc48ba09eddcd490f2a/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:49.998750 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:50.009486 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8533e0f8-0c19-4bef-a00d-dbadad49e398 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08c11855aecc48b1be582cd127b7fad5, user_id=ba5a1d4ec9314fc48ba09eddcd490f2a, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:50.018484 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8533e0f8-0c19-4bef-a00d-dbadad49e398 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:50.049845 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2111/4235] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:52:49 2022] PUT /identity/v3/projects/08c11855aecc48b1be582cd127b7fad5/users/ba5a1d4ec9314fc48ba09eddcd490f2a/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:52:50.053958 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5108d-9c28-484e-beb0-6fcb7a73edd6 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:50.070377 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5108d-9c28-484e-beb0-6fcb7a73edd6 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:50.228610 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1627e88-f5a5-4955-ad96-4b978b33ca64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:50.229256 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1627e88-f5a5-4955-ad96-4b978b33ca64 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:50.229537 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1627e88-f5a5-4955-ad96-4b978b33ca64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:50.229812 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1627e88-f5a5-4955-ad96-4b978b33ca64 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:50.230849 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1627e88-f5a5-4955-ad96-4b978b33ca64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:50.238117 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1627e88-f5a5-4955-ad96-4b978b33ca64 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:50.270059 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533e0f8-0c19-4bef-a00d-dbadad49e398 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:50.270707 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2125/4236] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:52:50.305057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533e0f8-0c19-4bef-a00d-dbadad49e398 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:50.334004 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160ee70-5649-4034-b1e5-5281a58bd9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:50.337671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160ee70-5649-4034-b1e5-5281a58bd9ec admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:50.337671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160ee70-5649-4034-b1e5-5281a58bd9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:50.337671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160ee70-5649-4034-b1e5-5281a58bd9ec admin admin] PATH_INFO: `/v3/projects/08c11855aecc48b1be582cd127b7fad5/users/ba5a1d4ec9314fc48ba09eddcd490f2a/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:50.343466 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9160ee70-5649-4034-b1e5-5281a58bd9ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=08c11855aecc48b1be582cd127b7fad5, user_id=ba5a1d4ec9314fc48ba09eddcd490f2a, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:50.346219 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9160ee70-5649-4034-b1e5-5281a58bd9ec admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:50.381023 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2112/4237] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:52:50 2022] PUT /identity/v3/projects/08c11855aecc48b1be582cd127b7fad5/users/ba5a1d4ec9314fc48ba09eddcd490f2a/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:52:50.392589 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e46702-8e0d-411e-a5f3-8ab8c98bbd75 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:50.392944 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e46702-8e0d-411e-a5f3-8ab8c98bbd75 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:50.393724 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e46702-8e0d-411e-a5f3-8ab8c98bbd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:50.458500 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-23e46702-8e0d-411e-a5f3-8ab8c98bbd75 None None] MFA Rules not processed for user `ba5a1d4ec9314fc48ba09eddcd490f2a`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:50.459818 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-23e46702-8e0d-411e-a5f3-8ab8c98bbd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:50.604515 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2126/4238] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:52:50 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:50.879310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160ee70-5649-4034-b1e5-5281a58bd9ec admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:50.882970 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9160ee70-5649-4034-b1e5-5281a58bd9ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:51.058062 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160ee70-5649-4034-b1e5-5281a58bd9ec admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:51.068692 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b409e745-079f-48dc-967a-13c34388fe2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:51.069326 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409e745-079f-48dc-967a-13c34388fe2c service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:51.069791 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409e745-079f-48dc-967a-13c34388fe2c service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:51.070783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409e745-079f-48dc-967a-13c34388fe2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:51.209998 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b409e745-079f-48dc-967a-13c34388fe2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:51.213979 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e46702-8e0d-411e-a5f3-8ab8c98bbd75 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:51.217153 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b409e745-079f-48dc-967a-13c34388fe2c service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:51.228196 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e46702-8e0d-411e-a5f3-8ab8c98bbd75 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:51.242245 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8265f-ea49-4edb-be7a-65152798d0db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:51.245065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8265f-ea49-4edb-be7a-65152798d0db service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:51.245418 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8265f-ea49-4edb-be7a-65152798d0db service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:51.245693 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8265f-ea49-4edb-be7a-65152798d0db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:51.253182 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-17e8265f-ea49-4edb-be7a-65152798d0db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:51.258100 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2113/4239] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:52:50 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:52:51.415940 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:51.544158 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e8265f-ea49-4edb-be7a-65152798d0db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:51.553099 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e8265f-ea49-4edb-be7a-65152798d0db service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:51.626079 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2127/4240] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:52:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:52:51.839669 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479aa85c-7331-4025-a67d-262a4af8e437 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:51.840563 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479aa85c-7331-4025-a67d-262a4af8e437 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:51.841141 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479aa85c-7331-4025-a67d-262a4af8e437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:51.885378 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-479aa85c-7331-4025-a67d-262a4af8e437 None None] MFA Rules not processed for user `71e0809663664b319388bcc890b6fdec`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:51.891568 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-479aa85c-7331-4025-a67d-262a4af8e437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:52.090311 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2114/4241] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:52:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:52:52.778583 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8265f-ea49-4edb-be7a-65152798d0db service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:52.781898 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-17e8265f-ea49-4edb-be7a-65152798d0db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:52.814930 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8265f-ea49-4edb-be7a-65152798d0db service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:52.852542 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8383cf37-6b6f-4d26-921a-983b1a6fdde0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:52.853457 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8383cf37-6b6f-4d26-921a-983b1a6fdde0 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:52.853943 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8383cf37-6b6f-4d26-921a-983b1a6fdde0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:52.854392 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8383cf37-6b6f-4d26-921a-983b1a6fdde0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:52.860915 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8383cf37-6b6f-4d26-921a-983b1a6fdde0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:52.934176 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8383cf37-6b6f-4d26-921a-983b1a6fdde0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:52.936009 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8383cf37-6b6f-4d26-921a-983b1a6fdde0 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:53.031722 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2128/4242] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:52:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:52:59.882957 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c3391-27b7-45ce-ba6b-cf5d332c7b8f None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:59.883583 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c3391-27b7-45ce-ba6b-cf5d332c7b8f None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:59.883890 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c3391-27b7-45ce-ba6b-cf5d332c7b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:59.967181 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-667c3391-27b7-45ce-ba6b-cf5d332c7b8f None None] MFA Rules not processed for user `9dda72ff55b246cea4bf5bc5e1e87c5f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:59.968740 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-667c3391-27b7-45ce-ba6b-cf5d332c7b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:00.015558 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:00.145321 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2115/4243] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:52:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:00.408161 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8383cf37-6b6f-4d26-921a-983b1a6fdde0 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:00.421791 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8383cf37-6b6f-4d26-921a-983b1a6fdde0 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:00.444262 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee6272-1d84-4304-9702-da2c83dd1f04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:00.446292 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee6272-1d84-4304-9702-da2c83dd1f04 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:00.446762 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee6272-1d84-4304-9702-da2c83dd1f04 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:00.453798 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee6272-1d84-4304-9702-da2c83dd1f04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:00.488323 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee6272-1d84-4304-9702-da2c83dd1f04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:00.492021 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee6272-1d84-4304-9702-da2c83dd1f04 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:00.509924 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2129/4244] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:53:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:53:04.047876 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c3391-27b7-45ce-ba6b-cf5d332c7b8f None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:04.064745 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c3391-27b7-45ce-ba6b-cf5d332c7b8f None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:04.075847 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f8f70-8e7a-40ca-8b65-b4a4d948fd22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:04.076675 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f8f70-8e7a-40ca-8b65-b4a4d948fd22 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:04.076786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f8f70-8e7a-40ca-8b65-b4a4d948fd22 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:04.077192 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f8f70-8e7a-40ca-8b65-b4a4d948fd22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:04.084149 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e02f8f70-8e7a-40ca-8b65-b4a4d948fd22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:04.116079 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02f8f70-8e7a-40ca-8b65-b4a4d948fd22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:04.118346 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02f8f70-8e7a-40ca-8b65-b4a4d948fd22 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:04.143962 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2116/4245] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:53:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:53:04.229014 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579d744-e80b-4e94-884d-53c29da3cc93 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:04.229892 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579d744-e80b-4e94-884d-53c29da3cc93 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:04.231201 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579d744-e80b-4e94-884d-53c29da3cc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:04.270526 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-1579d744-e80b-4e94-884d-53c29da3cc93 None None] MFA Rules not processed for user `f7baa9210bfb4895a247d55cdfcf98a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:04.272095 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1579d744-e80b-4e94-884d-53c29da3cc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:04.370657 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb17664-bcd6-4836-b30c-9e8451404cf4 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:04.371457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb17664-bcd6-4836-b30c-9e8451404cf4 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:04.371924 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb17664-bcd6-4836-b30c-9e8451404cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:04.376505 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2130/4246] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:53:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:04.427404 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-efb17664-bcd6-4836-b30c-9e8451404cf4 None None] MFA Rules not processed for user `f7baa9210bfb4895a247d55cdfcf98a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:04.441105 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-efb17664-bcd6-4836-b30c-9e8451404cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:04.471526 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2117/4247] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:53:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:53:04.493975 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579d744-e80b-4e94-884d-53c29da3cc93 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:04.495490 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1579d744-e80b-4e94-884d-53c29da3cc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:04.547159 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579d744-e80b-4e94-884d-53c29da3cc93 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:04.583811 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e13330-e565-445f-956f-5ce82396923c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:04.584456 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e13330-e565-445f-956f-5ce82396923c service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:04.584742 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e13330-e565-445f-956f-5ce82396923c service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:04.592379 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e13330-e565-445f-956f-5ce82396923c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:04.612697 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e13330-e565-445f-956f-5ce82396923c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:04.614650 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e13330-e565-445f-956f-5ce82396923c service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:04.641643 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2131/4248] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:53:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:53:04.769777 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cef18-05aa-4659-a114-4514aaa4013d None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:04.770137 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cef18-05aa-4659-a114-4514aaa4013d None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:04.770415 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cef18-05aa-4659-a114-4514aaa4013d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:04.831504 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-014cef18-05aa-4659-a114-4514aaa4013d None None] MFA Rules not processed for user `f554eb660c324a759d70b3b974e78db5`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:04.833598 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-014cef18-05aa-4659-a114-4514aaa4013d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:05.020965 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2118/4249] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:53:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:05.043265 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e13330-e565-445f-956f-5ce82396923c service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:05.045395 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-61e13330-e565-445f-956f-5ce82396923c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:05.084043 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e13330-e565-445f-956f-5ce82396923c service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:05.110686 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a06b51-20f7-4cb5-8276-ba162da3d757 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:05.112411 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a06b51-20f7-4cb5-8276-ba162da3d757 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:05.115570 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a06b51-20f7-4cb5-8276-ba162da3d757 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:05.115865 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a06b51-20f7-4cb5-8276-ba162da3d757 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:05.140626 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a06b51-20f7-4cb5-8276-ba162da3d757 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:05.142342 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a06b51-20f7-4cb5-8276-ba162da3d757 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:05.169372 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2132/4250] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:53:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:53:13.656646 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67551b3-0f5d-4675-a609-b3685bbc95df None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:13.657231 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67551b3-0f5d-4675-a609-b3685bbc95df None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:13.657231 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67551b3-0f5d-4675-a609-b3685bbc95df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:13.720074 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-e67551b3-0f5d-4675-a609-b3685bbc95df None None] MFA Rules not processed for user `9dda72ff55b246cea4bf5bc5e1e87c5f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:13.721270 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e67551b3-0f5d-4675-a609-b3685bbc95df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:13.729503 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2119/4251] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:53:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:15.156690 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=66 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:17.868168 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804c7cc-f611-4acb-a933-fc764fa8d988 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:17.868764 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804c7cc-f611-4acb-a933-fc764fa8d988 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:17.868764 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804c7cc-f611-4acb-a933-fc764fa8d988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:17.908889 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-5804c7cc-f611-4acb-a933-fc764fa8d988 None None] MFA Rules not processed for user `f554eb660c324a759d70b3b974e78db5`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:17.910152 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5804c7cc-f611-4acb-a933-fc764fa8d988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:17.943298 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2133/4252] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:53:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:20.283659 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67551b3-0f5d-4675-a609-b3685bbc95df None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:20.286407 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e67551b3-0f5d-4675-a609-b3685bbc95df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:20.535368 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804c7cc-f611-4acb-a933-fc764fa8d988 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:20.537415 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5804c7cc-f611-4acb-a933-fc764fa8d988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:20.626427 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67551b3-0f5d-4675-a609-b3685bbc95df None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:20.647085 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04b5a7-9d28-4181-bd02-f10cd35d7e3b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:20.648395 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04b5a7-9d28-4181-bd02-f10cd35d7e3b service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:20.648844 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04b5a7-9d28-4181-bd02-f10cd35d7e3b service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:20.649278 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04b5a7-9d28-4181-bd02-f10cd35d7e3b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:20.658431 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ee04b5a7-9d28-4181-bd02-f10cd35d7e3b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:20.706358 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04b5a7-9d28-4181-bd02-f10cd35d7e3b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:20.709292 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04b5a7-9d28-4181-bd02-f10cd35d7e3b service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:20.744374 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2120/4253] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:53:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:53:20.790801 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804c7cc-f611-4acb-a933-fc764fa8d988 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:20.800438 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a2a53-9903-4869-b0c9-9fd1845c7fed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:20.802035 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a2a53-9903-4869-b0c9-9fd1845c7fed service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:20.802480 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a2a53-9903-4869-b0c9-9fd1845c7fed service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:20.802925 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a2a53-9903-4869-b0c9-9fd1845c7fed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:20.825685 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429a2a53-9903-4869-b0c9-9fd1845c7fed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:20.827595 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429a2a53-9903-4869-b0c9-9fd1845c7fed service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:20.852587 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2134/4254] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:53:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:53:25.101493 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04b5a7-9d28-4181-bd02-f10cd35d7e3b service placement] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:25.103543 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ee04b5a7-9d28-4181-bd02-f10cd35d7e3b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:25.163059 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:25.281229 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04b5a7-9d28-4181-bd02-f10cd35d7e3b service placement] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:25.290583 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2be161-d045-4787-9cc5-da88e4ab34ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:25.291700 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2be161-d045-4787-9cc5-da88e4ab34ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:25.294747 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2be161-d045-4787-9cc5-da88e4ab34ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:25.295293 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2be161-d045-4787-9cc5-da88e4ab34ed admin admin] PATH_INFO: `/v3/users/d008ed466820477197b94d0c18f7eb1c` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:25.297005 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2be161-d045-4787-9cc5-da88e4ab34ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=d008ed466820477197b94d0c18f7eb1c)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:25.299368 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2be161-d045-4787-9cc5-da88e4ab34ed admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:25.410550 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ae2be161-d045-4787-9cc5-da88e4ab34ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd008ed466820477197b94d0c18f7eb1c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:25.411641 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ae2be161-d045-4787-9cc5-da88e4ab34ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd008ed466820477197b94d0c18f7eb1c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:25.425114 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ae2be161-d045-4787-9cc5-da88e4ab34ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd008ed466820477197b94d0c18f7eb1c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:25.441632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ae2be161-d045-4787-9cc5-da88e4ab34ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd008ed466820477197b94d0c18f7eb1c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:25.442781 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ae2be161-d045-4787-9cc5-da88e4ab34ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd008ed466820477197b94d0c18f7eb1c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:25.503143 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2121/4255] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:53:25 2022] DELETE /identity/v3/users/d008ed466820477197b94d0c18f7eb1c => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:26.910680 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a2a53-9903-4869-b0c9-9fd1845c7fed service placement] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:26.928288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a2a53-9903-4869-b0c9-9fd1845c7fed service placement] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:27.066166 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992daaf6-07d9-4f3b-9841-5770f90cd1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:27.067185 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992daaf6-07d9-4f3b-9841-5770f90cd1a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:27.067636 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992daaf6-07d9-4f3b-9841-5770f90cd1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:27.068066 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992daaf6-07d9-4f3b-9841-5770f90cd1a0 admin admin] PATH_INFO: `/v3/projects/6d1b9fcde555493f86ea437619efbea9` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:27.076626 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992daaf6-07d9-4f3b-9841-5770f90cd1a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d1b9fcde555493f86ea437619efbea9)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:27.081376 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992daaf6-07d9-4f3b-9841-5770f90cd1a0 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:27.184547 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-992daaf6-07d9-4f3b-9841-5770f90cd1a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d1b9fcde555493f86ea437619efbea9', 'request_id': 'req-992daaf6-07d9-4f3b-9841-5770f90cd1a0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:27.212892 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-992daaf6-07d9-4f3b-9841-5770f90cd1a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d1b9fcde555493f86ea437619efbea9', 'request_id': 'req-992daaf6-07d9-4f3b-9841-5770f90cd1a0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:27.227129 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-992daaf6-07d9-4f3b-9841-5770f90cd1a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d1b9fcde555493f86ea437619efbea9', 'request_id': 'req-992daaf6-07d9-4f3b-9841-5770f90cd1a0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:27.256031 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-992daaf6-07d9-4f3b-9841-5770f90cd1a0 admin admin] The token cache is being invalidate because project 6d1b9fcde555493f86ea437619efbea9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:53:27.256606 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-992daaf6-07d9-4f3b-9841-5770f90cd1a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:27.260168 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-992daaf6-07d9-4f3b-9841-5770f90cd1a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:27.262758 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2135/4256] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:53:26 2022] DELETE /identity/v3/projects/6d1b9fcde555493f86ea437619efbea9 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:27.270509 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f0978-e20e-40de-8dfc-1eadb80c47c8 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:27.271674 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f0978-e20e-40de-8dfc-1eadb80c47c8 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:27.272114 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f0978-e20e-40de-8dfc-1eadb80c47c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:27.322131 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-8f8f0978-e20e-40de-8dfc-1eadb80c47c8 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:27.326463 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8f8f0978-e20e-40de-8dfc-1eadb80c47c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:27.500369 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2122/4257] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:53:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:27.508939 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a1de5-74b3-494a-a350-78ed0424dfd5 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:27.509498 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a1de5-74b3-494a-a350-78ed0424dfd5 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:27.509961 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a1de5-74b3-494a-a350-78ed0424dfd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:27.543349 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-584a1de5-74b3-494a-a350-78ed0424dfd5 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:27.546598 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-584a1de5-74b3-494a-a350-78ed0424dfd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:27.567358 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2136/4258] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:53:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:27.573054 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f0978-e20e-40de-8dfc-1eadb80c47c8 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:27.602776 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f0978-e20e-40de-8dfc-1eadb80c47c8 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:27.613143 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c73b3-268a-42f7-83c3-35c875f9d9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:27.614083 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c73b3-268a-42f7-83c3-35c875f9d9b3 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:27.620640 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c73b3-268a-42f7-83c3-35c875f9d9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:27.621251 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c73b3-268a-42f7-83c3-35c875f9d9b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:27.622126 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1c73b3-268a-42f7-83c3-35c875f9d9b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:53:27.622625 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1c73b3-268a-42f7-83c3-35c875f9d9b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:27.624793 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1c73b3-268a-42f7-83c3-35c875f9d9b3 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:27.656336 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2123/4259] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:53:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:53:27.660748 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a1de5-74b3-494a-a350-78ed0424dfd5 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:27.677057 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a1de5-74b3-494a-a350-78ed0424dfd5 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:27.686700 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e0c52-1bfc-4fa7-8015-96d798caacf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:27.687451 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e0c52-1bfc-4fa7-8015-96d798caacf6 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:27.687791 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e0c52-1bfc-4fa7-8015-96d798caacf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:27.688165 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e0c52-1bfc-4fa7-8015-96d798caacf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:27.689470 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071e0c52-1bfc-4fa7-8015-96d798caacf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:27.691855 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071e0c52-1bfc-4fa7-8015-96d798caacf6 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:27.705984 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:27.796357 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2137/4260] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:53:27 2022] POST /identity/v3/projects => generated 377 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:53:27.796862 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c73b3-268a-42f7-83c3-35c875f9d9b3 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:27.810832 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c73b3-268a-42f7-83c3-35c875f9d9b3 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:27.859340 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:27.968979 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b39efe-82aa-405b-8ed2-293cd3a5daee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:27.969561 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b39efe-82aa-405b-8ed2-293cd3a5daee admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:27.969859 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b39efe-82aa-405b-8ed2-293cd3a5daee admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:27.970102 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b39efe-82aa-405b-8ed2-293cd3a5daee admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:27.970776 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b39efe-82aa-405b-8ed2-293cd3a5daee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:27.977919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b39efe-82aa-405b-8ed2-293cd3a5daee admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:28.048953 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2124/4261] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:53:27 2022] POST /identity/v3/users => generated 289 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:53:28.053199 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e0c52-1bfc-4fa7-8015-96d798caacf6 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:28.072260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e0c52-1bfc-4fa7-8015-96d798caacf6 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:28.094384 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5049f8f4-512b-49ea-b164-20c9bd59fcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:28.095016 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5049f8f4-512b-49ea-b164-20c9bd59fcac admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:28.095317 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5049f8f4-512b-49ea-b164-20c9bd59fcac admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:28.095589 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5049f8f4-512b-49ea-b164-20c9bd59fcac admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:28.096241 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5049f8f4-512b-49ea-b164-20c9bd59fcac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:28.098091 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5049f8f4-512b-49ea-b164-20c9bd59fcac admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:28.123849 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2138/4262] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:53:28 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:53:28.151641 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b39efe-82aa-405b-8ed2-293cd3a5daee admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:28.189957 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b39efe-82aa-405b-8ed2-293cd3a5daee admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:28.198398 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df31c3-e1f4-467c-bfa2-f590adf898cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:28.199531 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df31c3-e1f4-467c-bfa2-f590adf898cb admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:28.199830 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df31c3-e1f4-467c-bfa2-f590adf898cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:28.200107 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df31c3-e1f4-467c-bfa2-f590adf898cb admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:28.200769 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9df31c3-e1f4-467c-bfa2-f590adf898cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:28.202661 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9df31c3-e1f4-467c-bfa2-f590adf898cb admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:28.230528 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2125/4263] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:53:28 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:53:28.234813 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5049f8f4-512b-49ea-b164-20c9bd59fcac admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:28.251421 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5049f8f4-512b-49ea-b164-20c9bd59fcac admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:28.267912 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f418e9-3a60-41ab-bb28-79439d566031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:28.268766 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f418e9-3a60-41ab-bb28-79439d566031 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:28.269058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f418e9-3a60-41ab-bb28-79439d566031 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:28.269525 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f418e9-3a60-41ab-bb28-79439d566031 admin admin] PATH_INFO: `/v3/projects/773bdb58320742cd91d977a2dff19613/users/38624ce9529441aba32a3cb68205209f/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:28.306572 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f418e9-3a60-41ab-bb28-79439d566031 admin admin] RBAC: Authorizing `identity:create_grant(project_id=773bdb58320742cd91d977a2dff19613, user_id=38624ce9529441aba32a3cb68205209f, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:28.318523 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f418e9-3a60-41ab-bb28-79439d566031 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:28.360717 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2139/4264] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:53:28 2022] PUT /identity/v3/projects/773bdb58320742cd91d977a2dff19613/users/38624ce9529441aba32a3cb68205209f/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:28.365714 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000f3aa-11ee-4669-b3c8-ed2b8b99f892 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:28.367257 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000f3aa-11ee-4669-b3c8-ed2b8b99f892 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:28.367722 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000f3aa-11ee-4669-b3c8-ed2b8b99f892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:28.398971 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-8000f3aa-11ee-4669-b3c8-ed2b8b99f892 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:28.400811 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8000f3aa-11ee-4669-b3c8-ed2b8b99f892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:28.505025 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2126/4265] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:53:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:28.582023 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f418e9-3a60-41ab-bb28-79439d566031 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:28.584640 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-95f418e9-3a60-41ab-bb28-79439d566031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:28.682505 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f418e9-3a60-41ab-bb28-79439d566031 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:28.686985 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfeea1c-bbe2-4100-900c-a9039f68785c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:28.687933 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfeea1c-bbe2-4100-900c-a9039f68785c service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:28.688582 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfeea1c-bbe2-4100-900c-a9039f68785c service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:28.689031 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfeea1c-bbe2-4100-900c-a9039f68785c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:28.715925 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfeea1c-bbe2-4100-900c-a9039f68785c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:28.718413 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfeea1c-bbe2-4100-900c-a9039f68785c service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:28.736735 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2140/4266] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:53:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:53:29.762701 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000f3aa-11ee-4669-b3c8-ed2b8b99f892 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:29.788124 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000f3aa-11ee-4669-b3c8-ed2b8b99f892 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:29.799172 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab100a-fcd5-422d-8786-3d0251520ff3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:29.800429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab100a-fcd5-422d-8786-3d0251520ff3 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:29.800892 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab100a-fcd5-422d-8786-3d0251520ff3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:29.801309 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab100a-fcd5-422d-8786-3d0251520ff3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:29.809211 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-98ab100a-fcd5-422d-8786-3d0251520ff3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:30.057527 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab100a-fcd5-422d-8786-3d0251520ff3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:30.059339 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab100a-fcd5-422d-8786-3d0251520ff3 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:30.087496 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2127/4267] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:53:29 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:53:31.189799 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfeea1c-bbe2-4100-900c-a9039f68785c service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:31.191974 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-abfeea1c-bbe2-4100-900c-a9039f68785c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:31.365804 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfeea1c-bbe2-4100-900c-a9039f68785c service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:31.374430 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaeb45a-8925-44cb-b5e6-42b2ddb27103 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:31.375996 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaeb45a-8925-44cb-b5e6-42b2ddb27103 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:31.376631 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaeb45a-8925-44cb-b5e6-42b2ddb27103 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:31.377153 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaeb45a-8925-44cb-b5e6-42b2ddb27103 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:31.379468 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-caaeb45a-8925-44cb-b5e6-42b2ddb27103 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:31.399804 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaeb45a-8925-44cb-b5e6-42b2ddb27103 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:31.402577 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaeb45a-8925-44cb-b5e6-42b2ddb27103 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:31.418508 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2141/4268] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:53:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:53:37.022337 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab100a-fcd5-422d-8786-3d0251520ff3 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:37.024262 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-98ab100a-fcd5-422d-8786-3d0251520ff3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:37.043377 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab100a-fcd5-422d-8786-3d0251520ff3 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:37.063842 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aede86f-7ce3-45cc-8d61-bd0f8f7cc482 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:37.064491 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aede86f-7ce3-45cc-8d61-bd0f8f7cc482 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:37.064770 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aede86f-7ce3-45cc-8d61-bd0f8f7cc482 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:37.065043 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aede86f-7ce3-45cc-8d61-bd0f8f7cc482 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:37.067629 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8aede86f-7ce3-45cc-8d61-bd0f8f7cc482 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:37.082317 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aede86f-7ce3-45cc-8d61-bd0f8f7cc482 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:37.085132 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aede86f-7ce3-45cc-8d61-bd0f8f7cc482 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:37.098226 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2128/4269] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:53:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:53:39.524611 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaeb45a-8925-44cb-b5e6-42b2ddb27103 service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:39.540587 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaeb45a-8925-44cb-b5e6-42b2ddb27103 service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:39.559364 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98614d45-e81b-45b7-a6ec-1855470b1e0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:39.560034 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98614d45-e81b-45b7-a6ec-1855470b1e0b service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:39.560316 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98614d45-e81b-45b7-a6ec-1855470b1e0b service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:39.560589 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98614d45-e81b-45b7-a6ec-1855470b1e0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:39.562444 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-98614d45-e81b-45b7-a6ec-1855470b1e0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:39.606639 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:39.641879 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98614d45-e81b-45b7-a6ec-1855470b1e0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:39.643663 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98614d45-e81b-45b7-a6ec-1855470b1e0b service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:39.657374 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2142/4270] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:53:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:53:41.761977 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aede86f-7ce3-45cc-8d61-bd0f8f7cc482 service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:41.779666 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aede86f-7ce3-45cc-8d61-bd0f8f7cc482 service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:41.786131 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a48941-ece3-4e7b-96f2-037632f58fbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:41.786754 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a48941-ece3-4e7b-96f2-037632f58fbb service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:41.787530 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a48941-ece3-4e7b-96f2-037632f58fbb service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:41.791920 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a48941-ece3-4e7b-96f2-037632f58fbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:41.794948 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-94a48941-ece3-4e7b-96f2-037632f58fbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:41.845984 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:41.911889 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a48941-ece3-4e7b-96f2-037632f58fbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:41.914540 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a48941-ece3-4e7b-96f2-037632f58fbb service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:41.930385 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2129/4271] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:53:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:53:49.650933 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=11 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:50.828348 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98614d45-e81b-45b7-a6ec-1855470b1e0b service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:50.829862 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-98614d45-e81b-45b7-a6ec-1855470b1e0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:50.852373 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98614d45-e81b-45b7-a6ec-1855470b1e0b service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:50.858813 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f55b0-0f90-4c19-9c0b-e14965dd0c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:50.860082 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f55b0-0f90-4c19-9c0b-e14965dd0c2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:50.860422 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f55b0-0f90-4c19-9c0b-e14965dd0c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:50.860935 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f55b0-0f90-4c19-9c0b-e14965dd0c2e admin admin] PATH_INFO: `/v3/users/8ab128ff99e24153960e42b8897ac4f1` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:50.862579 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f55b0-0f90-4c19-9c0b-e14965dd0c2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ab128ff99e24153960e42b8897ac4f1)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:50.865677 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f55b0-0f90-4c19-9c0b-e14965dd0c2e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:50.940428 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7d9f55b0-0f90-4c19-9c0b-e14965dd0c2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ab128ff99e24153960e42b8897ac4f1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:50.941396 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7d9f55b0-0f90-4c19-9c0b-e14965dd0c2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ab128ff99e24153960e42b8897ac4f1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:50.977054 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7d9f55b0-0f90-4c19-9c0b-e14965dd0c2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ab128ff99e24153960e42b8897ac4f1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:50.995977 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7d9f55b0-0f90-4c19-9c0b-e14965dd0c2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ab128ff99e24153960e42b8897ac4f1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:51.012500 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7d9f55b0-0f90-4c19-9c0b-e14965dd0c2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ab128ff99e24153960e42b8897ac4f1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:51.027983 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2143/4272] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:53:50 2022] DELETE /identity/v3/users/8ab128ff99e24153960e42b8897ac4f1 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:51.843908 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ca6e3-ae01-46f2-849f-3408b6f0137c None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:51.844853 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ca6e3-ae01-46f2-849f-3408b6f0137c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:51.845125 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ca6e3-ae01-46f2-849f-3408b6f0137c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:51.917625 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-301ca6e3-ae01-46f2-849f-3408b6f0137c None None] MFA Rules not processed for user `38624ce9529441aba32a3cb68205209f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:51.919416 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-301ca6e3-ae01-46f2-849f-3408b6f0137c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:52.145729 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2130/4273] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:53:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:52.156175 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f55b0-0f90-4c19-9c0b-e14965dd0c2e admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:52.158631 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7d9f55b0-0f90-4c19-9c0b-e14965dd0c2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:52.244605 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ca6e3-ae01-46f2-849f-3408b6f0137c None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:52.246182 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-301ca6e3-ae01-46f2-849f-3408b6f0137c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:52.352247 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f55b0-0f90-4c19-9c0b-e14965dd0c2e admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:52.379881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549fe79a-8584-4d08-9f40-6b03cdd44ab5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:52.380528 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549fe79a-8584-4d08-9f40-6b03cdd44ab5 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:52.380815 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549fe79a-8584-4d08-9f40-6b03cdd44ab5 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:52.381085 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549fe79a-8584-4d08-9f40-6b03cdd44ab5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:52.384359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ca6e3-ae01-46f2-849f-3408b6f0137c None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:52.389495 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f66ca-ea39-4c9f-9a41-7fb1f031243f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:52.390415 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f66ca-ea39-4c9f-9a41-7fb1f031243f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:52.390872 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f66ca-ea39-4c9f-9a41-7fb1f031243f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:52.391323 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f66ca-ea39-4c9f-9a41-7fb1f031243f admin admin] PATH_INFO: `/v3/projects/bae88ae162c54e0f90d1465cb17cfbe1` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:52.392823 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62f66ca-ea39-4c9f-9a41-7fb1f031243f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bae88ae162c54e0f90d1465cb17cfbe1)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:52.395098 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62f66ca-ea39-4c9f-9a41-7fb1f031243f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:52.424037 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549fe79a-8584-4d08-9f40-6b03cdd44ab5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:52.425965 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549fe79a-8584-4d08-9f40-6b03cdd44ab5 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:52.440292 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2144/4274] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:53:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:53:52.493283 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e62f66ca-ea39-4c9f-9a41-7fb1f031243f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bae88ae162c54e0f90d1465cb17cfbe1', 'request_id': 'req-e62f66ca-ea39-4c9f-9a41-7fb1f031243f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:52.503843 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:52.507519 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e62f66ca-ea39-4c9f-9a41-7fb1f031243f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bae88ae162c54e0f90d1465cb17cfbe1', 'request_id': 'req-e62f66ca-ea39-4c9f-9a41-7fb1f031243f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:52.532764 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e62f66ca-ea39-4c9f-9a41-7fb1f031243f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bae88ae162c54e0f90d1465cb17cfbe1', 'request_id': 'req-e62f66ca-ea39-4c9f-9a41-7fb1f031243f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:52.548348 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e62f66ca-ea39-4c9f-9a41-7fb1f031243f admin admin] The token cache is being invalidate because project bae88ae162c54e0f90d1465cb17cfbe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:53:52.548610 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e62f66ca-ea39-4c9f-9a41-7fb1f031243f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:52.549242 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e62f66ca-ea39-4c9f-9a41-7fb1f031243f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:52.551149 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2131/4275] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:53:52 2022] DELETE /identity/v3/projects/bae88ae162c54e0f90d1465cb17cfbe1 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:52.556537 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3c1e0-8fa6-4a25-8841-78272644d3a9 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:52.557170 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3c1e0-8fa6-4a25-8841-78272644d3a9 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:52.557677 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3c1e0-8fa6-4a25-8841-78272644d3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:52.604667 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-82c3c1e0-8fa6-4a25-8841-78272644d3a9 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:52.610313 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-82c3c1e0-8fa6-4a25-8841-78272644d3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:52.762254 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:52.778976 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2145/4276] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:53:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:52.787479 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfb075-93d2-4399-87f8-81e64103c0da None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:52.787961 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfb075-93d2-4399-87f8-81e64103c0da None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:52.788879 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfb075-93d2-4399-87f8-81e64103c0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:52.832818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-13cfb075-93d2-4399-87f8-81e64103c0da None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:52.834209 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-13cfb075-93d2-4399-87f8-81e64103c0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:52.856338 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2132/4277] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:53:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:52.860760 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3c1e0-8fa6-4a25-8841-78272644d3a9 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:52.874968 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3c1e0-8fa6-4a25-8841-78272644d3a9 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:52.884530 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36407b4-09b7-4d44-ac51-435fe5236e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:52.885431 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36407b4-09b7-4d44-ac51-435fe5236e9f admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:52.886353 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36407b4-09b7-4d44-ac51-435fe5236e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:52.896740 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36407b4-09b7-4d44-ac51-435fe5236e9f admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:52.897678 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36407b4-09b7-4d44-ac51-435fe5236e9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:53:52.898088 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36407b4-09b7-4d44-ac51-435fe5236e9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:52.900272 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36407b4-09b7-4d44-ac51-435fe5236e9f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:52.921499 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2146/4278] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:53:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:53:52.925026 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfb075-93d2-4399-87f8-81e64103c0da None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:52.938789 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfb075-93d2-4399-87f8-81e64103c0da None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:52.947321 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326d864-85ce-4f83-b1f9-118cce401955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:52.948220 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326d864-85ce-4f83-b1f9-118cce401955 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:52.948499 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326d864-85ce-4f83-b1f9-118cce401955 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:52.948765 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326d864-85ce-4f83-b1f9-118cce401955 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:52.949414 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326d864-85ce-4f83-b1f9-118cce401955 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:52.951427 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326d864-85ce-4f83-b1f9-118cce401955 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:53.022097 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2133/4279] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:53:52 2022] POST /identity/v3/projects => generated 383 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:53:53.024405 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36407b4-09b7-4d44-ac51-435fe5236e9f admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:53.051535 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36407b4-09b7-4d44-ac51-435fe5236e9f admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:53.132801 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d00a6-6391-4b88-a88c-143e5bb3afc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:53.133443 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d00a6-6391-4b88-a88c-143e5bb3afc7 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:53.133727 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d00a6-6391-4b88-a88c-143e5bb3afc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:53.134589 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d00a6-6391-4b88-a88c-143e5bb3afc7 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:53.135304 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d00a6-6391-4b88-a88c-143e5bb3afc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:53.137278 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d00a6-6391-4b88-a88c-143e5bb3afc7 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:53.168982 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2147/4280] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:53:53 2022] POST /identity/v3/users => generated 292 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:53:53.174074 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326d864-85ce-4f83-b1f9-118cce401955 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:53.197340 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326d864-85ce-4f83-b1f9-118cce401955 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:53.234568 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08058c29-a17d-4f28-89df-1c53b92f3f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:53.242853 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08058c29-a17d-4f28-89df-1c53b92f3f96 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:53.243259 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08058c29-a17d-4f28-89df-1c53b92f3f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:53.244134 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08058c29-a17d-4f28-89df-1c53b92f3f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:53.245670 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08058c29-a17d-4f28-89df-1c53b92f3f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:53.250252 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08058c29-a17d-4f28-89df-1c53b92f3f96 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:53.276019 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2134/4281] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:53:53.280410 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d00a6-6391-4b88-a88c-143e5bb3afc7 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:53.298935 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d00a6-6391-4b88-a88c-143e5bb3afc7 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:53.319137 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763fe9c-5635-4aa9-8071-852d45e13bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:53.322150 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763fe9c-5635-4aa9-8071-852d45e13bfc admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:53.322480 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763fe9c-5635-4aa9-8071-852d45e13bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:53.322758 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763fe9c-5635-4aa9-8071-852d45e13bfc admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:53.323532 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d763fe9c-5635-4aa9-8071-852d45e13bfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:53.325233 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d763fe9c-5635-4aa9-8071-852d45e13bfc admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:53.382666 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2148/4282] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:53:53.387176 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08058c29-a17d-4f28-89df-1c53b92f3f96 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:53.416103 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08058c29-a17d-4f28-89df-1c53b92f3f96 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:53.433193 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c0a372-6dc7-4802-8b33-d1ec1d078f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:53.434014 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0a372-6dc7-4802-8b33-d1ec1d078f8b admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:53.434482 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0a372-6dc7-4802-8b33-d1ec1d078f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:53.434807 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0a372-6dc7-4802-8b33-d1ec1d078f8b admin admin] PATH_INFO: `/v3/projects/6d953872c1bd443aa26ee4f47626bdc9/users/8efa4be1bf974daf84fc5f64b4ca3155/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:53.487374 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c0a372-6dc7-4802-8b33-d1ec1d078f8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d953872c1bd443aa26ee4f47626bdc9, user_id=8efa4be1bf974daf84fc5f64b4ca3155, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:53.490511 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c0a372-6dc7-4802-8b33-d1ec1d078f8b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:53.523120 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2135/4283] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:53:53 2022] PUT /identity/v3/projects/6d953872c1bd443aa26ee4f47626bdc9/users/8efa4be1bf974daf84fc5f64b4ca3155/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:53.524984 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f134cb-1306-4a52-800b-a1f7dac3f5f1 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:53.525376 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f134cb-1306-4a52-800b-a1f7dac3f5f1 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:53.525750 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f134cb-1306-4a52-800b-a1f7dac3f5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:53.560532 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-f5f134cb-1306-4a52-800b-a1f7dac3f5f1 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:53.567839 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f5f134cb-1306-4a52-800b-a1f7dac3f5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:53.745436 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2149/4284] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:53:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:53.792125 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c0a372-6dc7-4802-8b33-d1ec1d078f8b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:53.795415 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c9c0a372-6dc7-4802-8b33-d1ec1d078f8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:53.949327 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c0a372-6dc7-4802-8b33-d1ec1d078f8b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:53.962693 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74bd0ee-7f8b-4161-a64f-9a87b7be9a66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:53.963369 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bd0ee-7f8b-4161-a64f-9a87b7be9a66 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:53.963653 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bd0ee-7f8b-4161-a64f-9a87b7be9a66 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:53.963981 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bd0ee-7f8b-4161-a64f-9a87b7be9a66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:53.989241 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74bd0ee-7f8b-4161-a64f-9a87b7be9a66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:53.990732 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74bd0ee-7f8b-4161-a64f-9a87b7be9a66 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:54.020079 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2136/4285] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:53:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:53:58.096080 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f134cb-1306-4a52-800b-a1f7dac3f5f1 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:58.097672 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f5f134cb-1306-4a52-800b-a1f7dac3f5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:58.115672 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f134cb-1306-4a52-800b-a1f7dac3f5f1 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:58.159191 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de6fb1-cab5-493d-9a47-7b10ee9cecb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:58.160787 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de6fb1-cab5-493d-9a47-7b10ee9cecb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:58.162690 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de6fb1-cab5-493d-9a47-7b10ee9cecb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:58.163298 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de6fb1-cab5-493d-9a47-7b10ee9cecb6 admin admin] PATH_INFO: `/v3/users/f7baa9210bfb4895a247d55cdfcf98a5` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:58.168129 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6de6fb1-cab5-493d-9a47-7b10ee9cecb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7baa9210bfb4895a247d55cdfcf98a5)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:58.171038 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6de6fb1-cab5-493d-9a47-7b10ee9cecb6 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:58.285130 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c6de6fb1-cab5-493d-9a47-7b10ee9cecb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7baa9210bfb4895a247d55cdfcf98a5'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:58.286973 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c6de6fb1-cab5-493d-9a47-7b10ee9cecb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7baa9210bfb4895a247d55cdfcf98a5'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:58.298381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:58.307830 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c6de6fb1-cab5-493d-9a47-7b10ee9cecb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7baa9210bfb4895a247d55cdfcf98a5'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:58.337470 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c6de6fb1-cab5-493d-9a47-7b10ee9cecb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7baa9210bfb4895a247d55cdfcf98a5'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:58.356558 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c6de6fb1-cab5-493d-9a47-7b10ee9cecb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7baa9210bfb4895a247d55cdfcf98a5'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:58.369924 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2150/4286] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:53:58 2022] DELETE /identity/v3/users/f7baa9210bfb4895a247d55cdfcf98a5 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:59.055430 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbed45-40bf-48aa-8b79-189e97cc9b87 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:59.056155 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbed45-40bf-48aa-8b79-189e97cc9b87 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:59.057110 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbed45-40bf-48aa-8b79-189e97cc9b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:59.099696 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-99dbed45-40bf-48aa-8b79-189e97cc9b87 None None] MFA Rules not processed for user `38624ce9529441aba32a3cb68205209f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:59.101696 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-99dbed45-40bf-48aa-8b79-189e97cc9b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:59.273521 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2137/4287] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:53:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:59.305332 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de6fb1-cab5-493d-9a47-7b10ee9cecb6 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:59.308531 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c6de6fb1-cab5-493d-9a47-7b10ee9cecb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:59.487887 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de6fb1-cab5-493d-9a47-7b10ee9cecb6 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:59.499299 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd39cb4-00d4-4de1-8554-09bc8ff2d53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:59.500818 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd39cb4-00d4-4de1-8554-09bc8ff2d53d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:59.501275 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd39cb4-00d4-4de1-8554-09bc8ff2d53d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:59.501621 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd39cb4-00d4-4de1-8554-09bc8ff2d53d admin admin] PATH_INFO: `/v3/projects/04c4fb2330864b258b2e919220393bef` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:59.502811 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd39cb4-00d4-4de1-8554-09bc8ff2d53d admin admin] RBAC: Authorizing `identity:delete_project(project_id=04c4fb2330864b258b2e919220393bef)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:59.509229 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd39cb4-00d4-4de1-8554-09bc8ff2d53d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:59.615068 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-bfd39cb4-00d4-4de1-8554-09bc8ff2d53d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04c4fb2330864b258b2e919220393bef', 'request_id': 'req-bfd39cb4-00d4-4de1-8554-09bc8ff2d53d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:59.627480 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-bfd39cb4-00d4-4de1-8554-09bc8ff2d53d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04c4fb2330864b258b2e919220393bef', 'request_id': 'req-bfd39cb4-00d4-4de1-8554-09bc8ff2d53d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:59.641274 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-bfd39cb4-00d4-4de1-8554-09bc8ff2d53d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04c4fb2330864b258b2e919220393bef', 'request_id': 'req-bfd39cb4-00d4-4de1-8554-09bc8ff2d53d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:59.692275 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-bfd39cb4-00d4-4de1-8554-09bc8ff2d53d admin admin] The token cache is being invalidate because project 04c4fb2330864b258b2e919220393bef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:53:59.692598 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-bfd39cb4-00d4-4de1-8554-09bc8ff2d53d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:59.695307 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-bfd39cb4-00d4-4de1-8554-09bc8ff2d53d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:59.698969 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2151/4288] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:53:59 2022] DELETE /identity/v3/projects/04c4fb2330864b258b2e919220393bef => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:59.708341 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab2a78-4f63-4e17-968a-9547626f212b None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:59.708562 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab2a78-4f63-4e17-968a-9547626f212b None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:59.708846 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab2a78-4f63-4e17-968a-9547626f212b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:59.739084 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-f9ab2a78-4f63-4e17-968a-9547626f212b None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:59.748533 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f9ab2a78-4f63-4e17-968a-9547626f212b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:59.784238 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:59.884101 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2138/4289] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:53:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:59.891945 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a774d63-0a30-4cd8-83bb-cbba8b13c7c1 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:59.892226 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a774d63-0a30-4cd8-83bb-cbba8b13c7c1 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:59.892954 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a774d63-0a30-4cd8-83bb-cbba8b13c7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:59.943514 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-7a774d63-0a30-4cd8-83bb-cbba8b13c7c1 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:59.946109 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7a774d63-0a30-4cd8-83bb-cbba8b13c7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:59.970615 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2152/4290] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:53:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:59.974976 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab2a78-4f63-4e17-968a-9547626f212b None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:59.999376 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab2a78-4f63-4e17-968a-9547626f212b None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:00.007340 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce52969-88b0-4d14-bb3c-c26362a1642a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:00.008179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce52969-88b0-4d14-bb3c-c26362a1642a admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:00.008617 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce52969-88b0-4d14-bb3c-c26362a1642a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:00.008996 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce52969-88b0-4d14-bb3c-c26362a1642a admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:00.014205 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce52969-88b0-4d14-bb3c-c26362a1642a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:54:00.014657 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce52969-88b0-4d14-bb3c-c26362a1642a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:00.016749 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce52969-88b0-4d14-bb3c-c26362a1642a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:00.041118 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2139/4291] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:53:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:54:00.045644 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a774d63-0a30-4cd8-83bb-cbba8b13c7c1 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:00.060501 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a774d63-0a30-4cd8-83bb-cbba8b13c7c1 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:00.077958 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f27265-f7e1-4ac5-93f9-4ffd07dc0a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:00.079005 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f27265-f7e1-4ac5-93f9-4ffd07dc0a05 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:00.079483 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f27265-f7e1-4ac5-93f9-4ffd07dc0a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:00.079938 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f27265-f7e1-4ac5-93f9-4ffd07dc0a05 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:00.081051 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f27265-f7e1-4ac5-93f9-4ffd07dc0a05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:00.083290 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f27265-f7e1-4ac5-93f9-4ffd07dc0a05 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:00.164330 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2153/4292] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:54:00 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:00.168966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce52969-88b0-4d14-bb3c-c26362a1642a admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:00.203420 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce52969-88b0-4d14-bb3c-c26362a1642a admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:00.379472 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1e94f-359c-419e-a939-5068ff8704c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:00.388943 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1e94f-359c-419e-a939-5068ff8704c3 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:00.389495 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1e94f-359c-419e-a939-5068ff8704c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:00.389971 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1e94f-359c-419e-a939-5068ff8704c3 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:00.390813 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a1e94f-359c-419e-a939-5068ff8704c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:00.399777 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a1e94f-359c-419e-a939-5068ff8704c3 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:00.466953 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2140/4293] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:54:00 2022] POST /identity/v3/users => generated 287 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:00.471863 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f27265-f7e1-4ac5-93f9-4ffd07dc0a05 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:00.485756 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f27265-f7e1-4ac5-93f9-4ffd07dc0a05 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:00.502680 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038b8a6-0207-4fb9-8a23-cf473334ba24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:00.503704 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038b8a6-0207-4fb9-8a23-cf473334ba24 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:00.504177 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038b8a6-0207-4fb9-8a23-cf473334ba24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:00.504685 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038b8a6-0207-4fb9-8a23-cf473334ba24 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:00.505748 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8038b8a6-0207-4fb9-8a23-cf473334ba24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:00.508703 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8038b8a6-0207-4fb9-8a23-cf473334ba24 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:00.530439 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2154/4294] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:54:00.534285 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1e94f-359c-419e-a939-5068ff8704c3 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:00.547835 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1e94f-359c-419e-a939-5068ff8704c3 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:00.554767 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31891c-f486-4e7d-a694-5b673b1188fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:00.556549 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31891c-f486-4e7d-a694-5b673b1188fe admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:00.557171 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31891c-f486-4e7d-a694-5b673b1188fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:00.557608 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31891c-f486-4e7d-a694-5b673b1188fe admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:00.558638 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31891c-f486-4e7d-a694-5b673b1188fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:00.569695 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31891c-f486-4e7d-a694-5b673b1188fe admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:00.609163 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2141/4295] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:54:00.610266 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038b8a6-0207-4fb9-8a23-cf473334ba24 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:00.627009 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038b8a6-0207-4fb9-8a23-cf473334ba24 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:00.637651 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f445ccf-ec23-482c-ac39-ba0d4408216f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:00.638675 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f445ccf-ec23-482c-ac39-ba0d4408216f admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:00.639144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f445ccf-ec23-482c-ac39-ba0d4408216f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:00.639576 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f445ccf-ec23-482c-ac39-ba0d4408216f admin admin] PATH_INFO: `/v3/projects/816e80fa0569433fbcaab1bc651d85ab/users/ecab6c31850d45dca4708740f8640024/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:00.672285 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f445ccf-ec23-482c-ac39-ba0d4408216f admin admin] RBAC: Authorizing `identity:create_grant(project_id=816e80fa0569433fbcaab1bc651d85ab, user_id=ecab6c31850d45dca4708740f8640024, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:00.677155 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f445ccf-ec23-482c-ac39-ba0d4408216f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:00.721700 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2155/4296] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:54:00 2022] PUT /identity/v3/projects/816e80fa0569433fbcaab1bc651d85ab/users/ecab6c31850d45dca4708740f8640024/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:00.723102 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebead9b8-b671-476d-bd7c-110c434f87b9 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:00.723576 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebead9b8-b671-476d-bd7c-110c434f87b9 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:00.724025 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebead9b8-b671-476d-bd7c-110c434f87b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:00.811441 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-ebead9b8-b671-476d-bd7c-110c434f87b9 None None] MFA Rules not processed for user `ecab6c31850d45dca4708740f8640024`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:00.814022 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ebead9b8-b671-476d-bd7c-110c434f87b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:01.061829 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2142/4297] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:54:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:54:01.072155 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c33c0-5b5d-4507-bdcb-341c657f2768 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:01.072446 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c33c0-5b5d-4507-bdcb-341c657f2768 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:01.072728 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c33c0-5b5d-4507-bdcb-341c657f2768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:01.082091 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:01.133812 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-e14c33c0-5b5d-4507-bdcb-341c657f2768 None None] MFA Rules not processed for user `ecab6c31850d45dca4708740f8640024`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:01.135658 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e14c33c0-5b5d-4507-bdcb-341c657f2768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:01.162296 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2156/4298] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:54:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:01.262786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebead9b8-b671-476d-bd7c-110c434f87b9 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:01.264669 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ebead9b8-b671-476d-bd7c-110c434f87b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:01.343152 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:01.496446 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebead9b8-b671-476d-bd7c-110c434f87b9 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:01.504871 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a52dac-1ca1-414b-b3a5-62812c48f939 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:01.505513 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a52dac-1ca1-414b-b3a5-62812c48f939 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:01.505788 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a52dac-1ca1-414b-b3a5-62812c48f939 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:01.506080 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a52dac-1ca1-414b-b3a5-62812c48f939 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:01.530679 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a52dac-1ca1-414b-b3a5-62812c48f939 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:01.532931 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a52dac-1ca1-414b-b3a5-62812c48f939 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:01.565397 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2143/4299] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:54:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:54:02.909714 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c33c0-5b5d-4507-bdcb-341c657f2768 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:02.914344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e14c33c0-5b5d-4507-bdcb-341c657f2768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:03.077452 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c33c0-5b5d-4507-bdcb-341c657f2768 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:03.088944 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd4578-9249-411c-961d-fd2596bc431d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:03.089598 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd4578-9249-411c-961d-fd2596bc431d service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:03.089894 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd4578-9249-411c-961d-fd2596bc431d service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:03.090135 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd4578-9249-411c-961d-fd2596bc431d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:03.095017 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a3dd4578-9249-411c-961d-fd2596bc431d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:03.265386 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dd4578-9249-411c-961d-fd2596bc431d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:03.267458 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dd4578-9249-411c-961d-fd2596bc431d service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:03.316740 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2157/4300] 10.222.0.83 () {60 vars in 1396 bytes} [Mon Aug 29 15:54:02 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3315 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:54:03.593562 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16115fb1-a318-45d5-b520-79539845d634 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:03.594062 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16115fb1-a318-45d5-b520-79539845d634 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:03.594185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16115fb1-a318-45d5-b520-79539845d634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:03.654103 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-16115fb1-a318-45d5-b520-79539845d634 None None] MFA Rules not processed for user `ecab6c31850d45dca4708740f8640024`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:03.659729 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-16115fb1-a318-45d5-b520-79539845d634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:03.695002 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2144/4301] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:54:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:05.048506 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd4578-9249-411c-961d-fd2596bc431d service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:05.069814 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd4578-9249-411c-961d-fd2596bc431d service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:05.086374 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6116c5f-56d2-4152-b513-0282e47ef028 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:05.087762 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6116c5f-56d2-4152-b513-0282e47ef028 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:05.088204 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6116c5f-56d2-4152-b513-0282e47ef028 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:05.088485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6116c5f-56d2-4152-b513-0282e47ef028 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:05.100360 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c6116c5f-56d2-4152-b513-0282e47ef028 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:05.141987 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6116c5f-56d2-4152-b513-0282e47ef028 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:05.143554 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6116c5f-56d2-4152-b513-0282e47ef028 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:05.176020 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2158/4302] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:54:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:54:05.305186 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16115fb1-a318-45d5-b520-79539845d634 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:05.307360 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-16115fb1-a318-45d5-b520-79539845d634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:05.471763 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16115fb1-a318-45d5-b520-79539845d634 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:05.477988 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b0eeec-1351-4746-a725-994492ed785b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:05.479258 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0eeec-1351-4746-a725-994492ed785b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:05.480083 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0eeec-1351-4746-a725-994492ed785b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:05.480551 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0eeec-1351-4746-a725-994492ed785b admin admin] PATH_INFO: `/v3/users/8997fb3e021342f0881f043eaf9a4ab5` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:05.482421 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b0eeec-1351-4746-a725-994492ed785b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8997fb3e021342f0881f043eaf9a4ab5)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:05.484940 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b0eeec-1351-4746-a725-994492ed785b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:05.574991 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-47b0eeec-1351-4746-a725-994492ed785b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8997fb3e021342f0881f043eaf9a4ab5'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:05.576055 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-47b0eeec-1351-4746-a725-994492ed785b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8997fb3e021342f0881f043eaf9a4ab5'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:05.598553 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-47b0eeec-1351-4746-a725-994492ed785b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8997fb3e021342f0881f043eaf9a4ab5'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:05.615074 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-47b0eeec-1351-4746-a725-994492ed785b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8997fb3e021342f0881f043eaf9a4ab5'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:05.623636 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-47b0eeec-1351-4746-a725-994492ed785b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8997fb3e021342f0881f043eaf9a4ab5'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:05.660490 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2145/4303] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:54:05 2022] DELETE /identity/v3/users/8997fb3e021342f0881f043eaf9a4ab5 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:05.662195 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b0753-e901-4d56-b2ac-57e609acc753 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:05.662590 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b0753-e901-4d56-b2ac-57e609acc753 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:05.663003 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b0753-e901-4d56-b2ac-57e609acc753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:05.704128 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-2e5b0753-e901-4d56-b2ac-57e609acc753 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:05.705660 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2e5b0753-e901-4d56-b2ac-57e609acc753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:05.844725 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2159/4304] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:54:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:05.870154 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b0eeec-1351-4746-a725-994492ed785b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:05.871747 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-47b0eeec-1351-4746-a725-994492ed785b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:05.982873 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:06.066663 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b0eeec-1351-4746-a725-994492ed785b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:06.079138 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026a982-fc7b-4590-aae2-d52c11b83ae2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:06.079842 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026a982-fc7b-4590-aae2-d52c11b83ae2 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:06.080122 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026a982-fc7b-4590-aae2-d52c11b83ae2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:06.080392 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026a982-fc7b-4590-aae2-d52c11b83ae2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:06.100022 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6026a982-fc7b-4590-aae2-d52c11b83ae2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:06.102036 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6026a982-fc7b-4590-aae2-d52c11b83ae2 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:06.131617 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2146/4305] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:54:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:54:07.602933 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b0753-e901-4d56-b2ac-57e609acc753 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:07.606384 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2e5b0753-e901-4d56-b2ac-57e609acc753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:07.626691 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b0753-e901-4d56-b2ac-57e609acc753 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:07.635664 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131e26c-1573-47dc-b3ec-6df475473ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:07.636271 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131e26c-1573-47dc-b3ec-6df475473ea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:07.636549 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131e26c-1573-47dc-b3ec-6df475473ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:07.636847 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131e26c-1573-47dc-b3ec-6df475473ea2 admin admin] PATH_INFO: `/v3/projects/e985f22ed4ef45699f67323ff4b79cbc` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:07.638015 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8131e26c-1573-47dc-b3ec-6df475473ea2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e985f22ed4ef45699f67323ff4b79cbc)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:07.640002 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8131e26c-1573-47dc-b3ec-6df475473ea2 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:07.676055 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:07.718649 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8131e26c-1573-47dc-b3ec-6df475473ea2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e985f22ed4ef45699f67323ff4b79cbc', 'request_id': 'req-8131e26c-1573-47dc-b3ec-6df475473ea2'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:07.726431 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8131e26c-1573-47dc-b3ec-6df475473ea2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e985f22ed4ef45699f67323ff4b79cbc', 'request_id': 'req-8131e26c-1573-47dc-b3ec-6df475473ea2'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:07.735636 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8131e26c-1573-47dc-b3ec-6df475473ea2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e985f22ed4ef45699f67323ff4b79cbc', 'request_id': 'req-8131e26c-1573-47dc-b3ec-6df475473ea2'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:07.751620 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8131e26c-1573-47dc-b3ec-6df475473ea2 admin admin] The token cache is being invalidate because project e985f22ed4ef45699f67323ff4b79cbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:07.751988 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8131e26c-1573-47dc-b3ec-6df475473ea2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:07.752647 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8131e26c-1573-47dc-b3ec-6df475473ea2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:07.754321 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2160/4306] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:54:07 2022] DELETE /identity/v3/projects/e985f22ed4ef45699f67323ff4b79cbc => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:07.758735 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026a982-fc7b-4590-aae2-d52c11b83ae2 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:07.768869 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026a982-fc7b-4590-aae2-d52c11b83ae2 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:07.841741 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29323b4-2205-4d32-8599-a4db07bc1ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:07.842562 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29323b4-2205-4d32-8599-a4db07bc1ddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:07.842843 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29323b4-2205-4d32-8599-a4db07bc1ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:07.843627 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29323b4-2205-4d32-8599-a4db07bc1ddd admin admin] PATH_INFO: `/v3/users/91fde932d5274fd19d07532c985ff77a` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:07.844726 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29323b4-2205-4d32-8599-a4db07bc1ddd admin admin] RBAC: Authorizing `identity:delete_user(user_id=91fde932d5274fd19d07532c985ff77a)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:07.847145 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29323b4-2205-4d32-8599-a4db07bc1ddd admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:07.922741 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e29323b4-2205-4d32-8599-a4db07bc1ddd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91fde932d5274fd19d07532c985ff77a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:07.923707 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e29323b4-2205-4d32-8599-a4db07bc1ddd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91fde932d5274fd19d07532c985ff77a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:07.935141 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e29323b4-2205-4d32-8599-a4db07bc1ddd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91fde932d5274fd19d07532c985ff77a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:07.951878 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e29323b4-2205-4d32-8599-a4db07bc1ddd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91fde932d5274fd19d07532c985ff77a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:07.952641 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e29323b4-2205-4d32-8599-a4db07bc1ddd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91fde932d5274fd19d07532c985ff77a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:07.981750 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2147/4307] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:54:07 2022] DELETE /identity/v3/users/91fde932d5274fd19d07532c985ff77a => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:54:09.161912 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee4f98-7c48-4fc0-8a89-38485f106c0d None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:09.162382 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee4f98-7c48-4fc0-8a89-38485f106c0d None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:09.162382 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee4f98-7c48-4fc0-8a89-38485f106c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:09.248705 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-c0ee4f98-7c48-4fc0-8a89-38485f106c0d None None] MFA Rules not processed for user `8efa4be1bf974daf84fc5f64b4ca3155`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:09.250395 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c0ee4f98-7c48-4fc0-8a89-38485f106c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:09.377096 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2161/4308] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:54:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:09.389632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386ce40-e569-4b44-8dee-a4b6e969d3df None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:09.390187 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386ce40-e569-4b44-8dee-a4b6e969d3df None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:09.390187 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386ce40-e569-4b44-8dee-a4b6e969d3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:09.414880 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-0386ce40-e569-4b44-8dee-a4b6e969d3df None None] MFA Rules not processed for user `8efa4be1bf974daf84fc5f64b4ca3155`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:09.416896 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0386ce40-e569-4b44-8dee-a4b6e969d3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:09.437190 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2148/4309] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:54:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:09.510598 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee4f98-7c48-4fc0-8a89-38485f106c0d None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:09.512491 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c0ee4f98-7c48-4fc0-8a89-38485f106c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:09.607004 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee4f98-7c48-4fc0-8a89-38485f106c0d None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:09.615281 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7743c-fe3e-43a3-a7a1-f6d16d04aed9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:09.615934 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7743c-fe3e-43a3-a7a1-f6d16d04aed9 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:09.616819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7743c-fe3e-43a3-a7a1-f6d16d04aed9 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:09.617246 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7743c-fe3e-43a3-a7a1-f6d16d04aed9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:09.631071 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d7743c-fe3e-43a3-a7a1-f6d16d04aed9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:09.633777 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d7743c-fe3e-43a3-a7a1-f6d16d04aed9 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:09.666017 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386ce40-e569-4b44-8dee-a4b6e969d3df None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:09.667907 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0386ce40-e569-4b44-8dee-a4b6e969d3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:09.679855 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2162/4310] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:54:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:54:09.800663 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:09.873383 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386ce40-e569-4b44-8dee-a4b6e969d3df None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:09.897632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2237ba-f737-4ef5-bb26-287aa2113faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:09.898310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2237ba-f737-4ef5-bb26-287aa2113faa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:09.898591 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2237ba-f737-4ef5-bb26-287aa2113faa admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:09.898886 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2237ba-f737-4ef5-bb26-287aa2113faa admin admin] PATH_INFO: `/v3/projects/c6509cbe3b114f40bc00e86e934c495a` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:09.900696 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2237ba-f737-4ef5-bb26-287aa2113faa admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6509cbe3b114f40bc00e86e934c495a)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:09.902714 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2237ba-f737-4ef5-bb26-287aa2113faa admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:10.017441 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-bc2237ba-f737-4ef5-bb26-287aa2113faa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6509cbe3b114f40bc00e86e934c495a', 'request_id': 'req-bc2237ba-f737-4ef5-bb26-287aa2113faa'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:10.034576 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-bc2237ba-f737-4ef5-bb26-287aa2113faa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6509cbe3b114f40bc00e86e934c495a', 'request_id': 'req-bc2237ba-f737-4ef5-bb26-287aa2113faa'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:10.043755 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-bc2237ba-f737-4ef5-bb26-287aa2113faa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6509cbe3b114f40bc00e86e934c495a', 'request_id': 'req-bc2237ba-f737-4ef5-bb26-287aa2113faa'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:10.073417 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-bc2237ba-f737-4ef5-bb26-287aa2113faa admin admin] The token cache is being invalidate because project c6509cbe3b114f40bc00e86e934c495a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:10.075553 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-bc2237ba-f737-4ef5-bb26-287aa2113faa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:10.094895 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-bc2237ba-f737-4ef5-bb26-287aa2113faa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:10.099527 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2149/4311] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:54:09 2022] DELETE /identity/v3/projects/c6509cbe3b114f40bc00e86e934c495a => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:10.104120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7743c-fe3e-43a3-a7a1-f6d16d04aed9 service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:10.128590 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7743c-fe3e-43a3-a7a1-f6d16d04aed9 service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:10.192948 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:10.293705 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40e61f-4ee6-4045-afa2-fc9ec1d43f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:10.294364 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40e61f-4ee6-4045-afa2-fc9ec1d43f60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:10.294641 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40e61f-4ee6-4045-afa2-fc9ec1d43f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:10.294942 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40e61f-4ee6-4045-afa2-fc9ec1d43f60 admin admin] PATH_INFO: `/v3/users/ba5a1d4ec9314fc48ba09eddcd490f2a` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:10.296123 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d40e61f-4ee6-4045-afa2-fc9ec1d43f60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba5a1d4ec9314fc48ba09eddcd490f2a)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:10.298253 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d40e61f-4ee6-4045-afa2-fc9ec1d43f60 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:10.391502 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3d40e61f-4ee6-4045-afa2-fc9ec1d43f60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba5a1d4ec9314fc48ba09eddcd490f2a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:10.392259 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3d40e61f-4ee6-4045-afa2-fc9ec1d43f60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba5a1d4ec9314fc48ba09eddcd490f2a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:10.421754 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3d40e61f-4ee6-4045-afa2-fc9ec1d43f60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba5a1d4ec9314fc48ba09eddcd490f2a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:10.437790 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3d40e61f-4ee6-4045-afa2-fc9ec1d43f60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba5a1d4ec9314fc48ba09eddcd490f2a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:10.449349 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3d40e61f-4ee6-4045-afa2-fc9ec1d43f60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba5a1d4ec9314fc48ba09eddcd490f2a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:10.458663 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2163/4312] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:54:10 2022] DELETE /identity/v3/users/ba5a1d4ec9314fc48ba09eddcd490f2a => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:10.522154 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2237ba-f737-4ef5-bb26-287aa2113faa admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:10.525214 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-bc2237ba-f737-4ef5-bb26-287aa2113faa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:10.605462 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2237ba-f737-4ef5-bb26-287aa2113faa admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:10.686881 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1a6e4-ad81-49f6-a46c-b36b5123faa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:10.687541 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1a6e4-ad81-49f6-a46c-b36b5123faa6 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:10.687823 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1a6e4-ad81-49f6-a46c-b36b5123faa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:10.688095 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1a6e4-ad81-49f6-a46c-b36b5123faa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:10.690409 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-99a1a6e4-ad81-49f6-a46c-b36b5123faa6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:10.705766 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a1a6e4-ad81-49f6-a46c-b36b5123faa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:10.707318 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a1a6e4-ad81-49f6-a46c-b36b5123faa6 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:10.720970 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2150/4313] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:54:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:54:11.684563 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40e61f-4ee6-4045-afa2-fc9ec1d43f60 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:11.687673 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3d40e61f-4ee6-4045-afa2-fc9ec1d43f60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:11.866975 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40e61f-4ee6-4045-afa2-fc9ec1d43f60 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:11.901448 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed1814-3a23-4ae8-abea-eb156cc26452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:11.902462 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed1814-3a23-4ae8-abea-eb156cc26452 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:11.902962 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed1814-3a23-4ae8-abea-eb156cc26452 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:11.904276 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed1814-3a23-4ae8-abea-eb156cc26452 admin admin] PATH_INFO: `/v3/projects/08c11855aecc48b1be582cd127b7fad5` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:11.907455 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed1814-3a23-4ae8-abea-eb156cc26452 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08c11855aecc48b1be582cd127b7fad5)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:11.911378 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed1814-3a23-4ae8-abea-eb156cc26452 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:12.045708 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:12.051443 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2aed1814-3a23-4ae8-abea-eb156cc26452 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08c11855aecc48b1be582cd127b7fad5', 'request_id': 'req-2aed1814-3a23-4ae8-abea-eb156cc26452'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:12.060115 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2aed1814-3a23-4ae8-abea-eb156cc26452 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08c11855aecc48b1be582cd127b7fad5', 'request_id': 'req-2aed1814-3a23-4ae8-abea-eb156cc26452'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:12.071678 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2aed1814-3a23-4ae8-abea-eb156cc26452 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08c11855aecc48b1be582cd127b7fad5', 'request_id': 'req-2aed1814-3a23-4ae8-abea-eb156cc26452'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:12.100193 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2aed1814-3a23-4ae8-abea-eb156cc26452 admin admin] The token cache is being invalidate because project 08c11855aecc48b1be582cd127b7fad5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:12.100727 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2aed1814-3a23-4ae8-abea-eb156cc26452 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:12.103407 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2aed1814-3a23-4ae8-abea-eb156cc26452 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:12.104119 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2164/4314] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:54:11 2022] DELETE /identity/v3/projects/08c11855aecc48b1be582cd127b7fad5 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:12.109267 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d8423-bfc2-45dd-b55d-f11ee5a54e90 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:12.109746 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d8423-bfc2-45dd-b55d-f11ee5a54e90 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:12.110231 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d8423-bfc2-45dd-b55d-f11ee5a54e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:12.155166 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-f41d8423-bfc2-45dd-b55d-f11ee5a54e90 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:12.156408 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f41d8423-bfc2-45dd-b55d-f11ee5a54e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:12.213395 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:12.365526 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2151/4315] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:54:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:12.374022 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201538a-6b40-4ce8-b894-50c5d824a8a0 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:12.374303 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201538a-6b40-4ce8-b894-50c5d824a8a0 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:12.374587 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201538a-6b40-4ce8-b894-50c5d824a8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:12.441078 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-2201538a-6b40-4ce8-b894-50c5d824a8a0 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:12.442322 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2201538a-6b40-4ce8-b894-50c5d824a8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:12.476727 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2165/4316] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:54:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:12.478247 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d8423-bfc2-45dd-b55d-f11ee5a54e90 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:12.497670 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d8423-bfc2-45dd-b55d-f11ee5a54e90 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:12.512459 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e9221-474b-4614-b79f-0c2e4d1e06aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:12.513930 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e9221-474b-4614-b79f-0c2e4d1e06aa admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:12.514208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e9221-474b-4614-b79f-0c2e4d1e06aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:12.514736 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e9221-474b-4614-b79f-0c2e4d1e06aa admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:12.515161 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e9221-474b-4614-b79f-0c2e4d1e06aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:54:12.515463 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e9221-474b-4614-b79f-0c2e4d1e06aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:12.524564 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e9221-474b-4614-b79f-0c2e4d1e06aa admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:12.541820 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2152/4317] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:54:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:54:12.543012 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2201538a-6b40-4ce8-b894-50c5d824a8a0 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:12.554657 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2201538a-6b40-4ce8-b894-50c5d824a8a0 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:12.560140 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed4ad6-d3d4-4be0-91b7-3eb538603b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:12.560774 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed4ad6-d3d4-4be0-91b7-3eb538603b9f admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:12.561264 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed4ad6-d3d4-4be0-91b7-3eb538603b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:12.561592 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed4ad6-d3d4-4be0-91b7-3eb538603b9f admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:12.562233 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ed4ad6-d3d4-4be0-91b7-3eb538603b9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:12.564249 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ed4ad6-d3d4-4be0-91b7-3eb538603b9f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:12.646884 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2166/4318] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:54:12 2022] POST /identity/v3/projects => generated 355 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:12.648814 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e9221-474b-4614-b79f-0c2e4d1e06aa admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:12.678177 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e9221-474b-4614-b79f-0c2e4d1e06aa admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:12.813603 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edd932-eae2-4276-ae82-9587616eeb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:12.814242 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edd932-eae2-4276-ae82-9587616eeb69 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:12.814518 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edd932-eae2-4276-ae82-9587616eeb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:12.815037 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edd932-eae2-4276-ae82-9587616eeb69 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:12.815871 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edd932-eae2-4276-ae82-9587616eeb69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:12.817981 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edd932-eae2-4276-ae82-9587616eeb69 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:12.849973 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2153/4319] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:54:12 2022] POST /identity/v3/users => generated 278 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:54:12.854333 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed4ad6-d3d4-4be0-91b7-3eb538603b9f admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:12.868848 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed4ad6-d3d4-4be0-91b7-3eb538603b9f admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:12.875259 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77789d-24e5-4ac1-a175-13bb0afc02f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:12.876013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77789d-24e5-4ac1-a175-13bb0afc02f9 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:12.876388 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77789d-24e5-4ac1-a175-13bb0afc02f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:12.876756 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77789d-24e5-4ac1-a175-13bb0afc02f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:12.878275 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77789d-24e5-4ac1-a175-13bb0afc02f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:12.880235 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77789d-24e5-4ac1-a175-13bb0afc02f9 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:12.920214 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2167/4320] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:54:12.923212 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edd932-eae2-4276-ae82-9587616eeb69 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:12.939045 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edd932-eae2-4276-ae82-9587616eeb69 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:12.955950 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a21db-f3d5-4d94-97ec-51eb10ec3060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:12.961020 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a21db-f3d5-4d94-97ec-51eb10ec3060 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:12.961837 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a21db-f3d5-4d94-97ec-51eb10ec3060 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:12.962617 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a21db-f3d5-4d94-97ec-51eb10ec3060 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:12.964458 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a21db-f3d5-4d94-97ec-51eb10ec3060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:12.969981 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a21db-f3d5-4d94-97ec-51eb10ec3060 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:13.000991 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2154/4321] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:54:13.003196 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77789d-24e5-4ac1-a175-13bb0afc02f9 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:13.018147 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77789d-24e5-4ac1-a175-13bb0afc02f9 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:13.029134 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d0b7bf-c802-4207-860c-f231f530efbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:13.030262 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0b7bf-c802-4207-860c-f231f530efbf admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:13.030754 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0b7bf-c802-4207-860c-f231f530efbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:13.031312 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0b7bf-c802-4207-860c-f231f530efbf admin admin] PATH_INFO: `/v3/projects/8eb0c5cece984faba48016c7fbeedf19/users/277d26eb0a344d9ca571f390f7276f85/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:13.050204 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d0b7bf-c802-4207-860c-f231f530efbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eb0c5cece984faba48016c7fbeedf19, user_id=277d26eb0a344d9ca571f390f7276f85, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:13.054049 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d0b7bf-c802-4207-860c-f231f530efbf admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:13.089981 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6be6c-065f-4acb-85b8-9196299b5ab7 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:13.090599 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6be6c-065f-4acb-85b8-9196299b5ab7 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:13.091132 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6be6c-065f-4acb-85b8-9196299b5ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:13.091710 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2168/4322] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:54:13 2022] PUT /identity/v3/projects/8eb0c5cece984faba48016c7fbeedf19/users/277d26eb0a344d9ca571f390f7276f85/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:13.146192 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a4e6be6c-065f-4acb-85b8-9196299b5ab7 None None] MFA Rules not processed for user `277d26eb0a344d9ca571f390f7276f85`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:13.148947 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a4e6be6c-065f-4acb-85b8-9196299b5ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:13.258235 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2155/4323] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:54:13 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:54:13.269948 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d0b7bf-c802-4207-860c-f231f530efbf admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:13.511710 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d0b7bf-c802-4207-860c-f231f530efbf admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:13.522619 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda874dd-8698-4375-9299-b29c4c7db410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:13.523588 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda874dd-8698-4375-9299-b29c4c7db410 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:13.523875 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda874dd-8698-4375-9299-b29c4c7db410 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:13.524220 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda874dd-8698-4375-9299-b29c4c7db410 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:13.524901 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda874dd-8698-4375-9299-b29c4c7db410 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:13.526886 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda874dd-8698-4375-9299-b29c4c7db410 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:13.580491 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2169/4324] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:54:13 2022] POST /identity/v3/projects => generated 357 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:13.584028 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6be6c-065f-4acb-85b8-9196299b5ab7 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:13.608532 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6be6c-065f-4acb-85b8-9196299b5ab7 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:13.678715 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:13.796775 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cbc7e5-e933-4d2f-982f-1f8c68de55bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:13.797418 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cbc7e5-e933-4d2f-982f-1f8c68de55bb admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:13.797694 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cbc7e5-e933-4d2f-982f-1f8c68de55bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:13.797962 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cbc7e5-e933-4d2f-982f-1f8c68de55bb admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:13.798608 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cbc7e5-e933-4d2f-982f-1f8c68de55bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:13.802547 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cbc7e5-e933-4d2f-982f-1f8c68de55bb admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:13.858366 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2156/4325] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:54:13 2022] POST /identity/v3/users => generated 285 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:13.861942 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda874dd-8698-4375-9299-b29c4c7db410 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:13.886560 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda874dd-8698-4375-9299-b29c4c7db410 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:13.902515 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc42bd-81b3-42a9-a4f3-18d21545abee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:13.903782 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc42bd-81b3-42a9-a4f3-18d21545abee admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:13.906606 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc42bd-81b3-42a9-a4f3-18d21545abee admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:13.907201 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc42bd-81b3-42a9-a4f3-18d21545abee admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:13.909879 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bc42bd-81b3-42a9-a4f3-18d21545abee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:13.912599 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bc42bd-81b3-42a9-a4f3-18d21545abee admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:13.942544 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2170/4326] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:54:13.947222 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cbc7e5-e933-4d2f-982f-1f8c68de55bb admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:13.973476 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cbc7e5-e933-4d2f-982f-1f8c68de55bb admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:13.985473 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24298af9-0311-40b5-bd6f-a0efd145f79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:13.986168 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24298af9-0311-40b5-bd6f-a0efd145f79f admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:13.986445 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24298af9-0311-40b5-bd6f-a0efd145f79f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:13.988857 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24298af9-0311-40b5-bd6f-a0efd145f79f admin admin] PATH_INFO: `/v3/projects/3f377761b00a4d9fa70d74a654afd692/users/07fa5ccdfee744e9a1aa39f9cec58db1/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:14.041208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24298af9-0311-40b5-bd6f-a0efd145f79f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f377761b00a4d9fa70d74a654afd692, user_id=07fa5ccdfee744e9a1aa39f9cec58db1, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:14.043887 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24298af9-0311-40b5-bd6f-a0efd145f79f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:14.082936 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2157/4327] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:54:13 2022] PUT /identity/v3/projects/3f377761b00a4d9fa70d74a654afd692/users/07fa5ccdfee744e9a1aa39f9cec58db1/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:14.088683 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc42bd-81b3-42a9-a4f3-18d21545abee admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:14.114057 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc42bd-81b3-42a9-a4f3-18d21545abee admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:14.216095 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:14.245623 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa58dd0-7885-42df-a5e0-08f022ef5729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:14.246325 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa58dd0-7885-42df-a5e0-08f022ef5729 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:14.246723 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa58dd0-7885-42df-a5e0-08f022ef5729 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:14.247798 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa58dd0-7885-42df-a5e0-08f022ef5729 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:14.248729 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa58dd0-7885-42df-a5e0-08f022ef5729 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:14.250580 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa58dd0-7885-42df-a5e0-08f022ef5729 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:14.291673 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2171/4328] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:54:14.295429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24298af9-0311-40b5-bd6f-a0efd145f79f admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:14.315868 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24298af9-0311-40b5-bd6f-a0efd145f79f admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:14.332744 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1e509-6778-4d8c-90e5-b093e51b33e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:14.333442 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1e509-6778-4d8c-90e5-b093e51b33e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:14.333717 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1e509-6778-4d8c-90e5-b093e51b33e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:14.334059 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1e509-6778-4d8c-90e5-b093e51b33e1 admin admin] PATH_INFO: `/v3/projects/3f377761b00a4d9fa70d74a654afd692/users/07fa5ccdfee744e9a1aa39f9cec58db1/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:14.339407 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c1e509-6778-4d8c-90e5-b093e51b33e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f377761b00a4d9fa70d74a654afd692, user_id=07fa5ccdfee744e9a1aa39f9cec58db1, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:14.342103 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c1e509-6778-4d8c-90e5-b093e51b33e1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:14.409364 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2158/4329] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:54:14 2022] PUT /identity/v3/projects/3f377761b00a4d9fa70d74a654afd692/users/07fa5ccdfee744e9a1aa39f9cec58db1/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:14.427507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56379169-b4dd-43bf-97a7-6bd7f7b694e3 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:14.427806 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56379169-b4dd-43bf-97a7-6bd7f7b694e3 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:14.428075 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56379169-b4dd-43bf-97a7-6bd7f7b694e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:14.489149 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-56379169-b4dd-43bf-97a7-6bd7f7b694e3 None None] MFA Rules not processed for user `07fa5ccdfee744e9a1aa39f9cec58db1`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:14.494758 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-56379169-b4dd-43bf-97a7-6bd7f7b694e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:14.685947 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2172/4330] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:54:14 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:14.691603 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1e509-6778-4d8c-90e5-b093e51b33e1 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:14.712247 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1e509-6778-4d8c-90e5-b093e51b33e1 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:14.722666 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a9572-8938-47d5-81c0-20ab3e2d6a43 tempest-QuotasTest-1384154979 tempest-QuotasTest-1384154979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fa5ccdfee744e9a1aa39f9cec58db1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f377761b00a4d9fa70d74a654afd692', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:14.723606 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a9572-8938-47d5-81c0-20ab3e2d6a43 tempest-QuotasTest-1384154979 tempest-QuotasTest-1384154979-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:14.724119 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a9572-8938-47d5-81c0-20ab3e2d6a43 tempest-QuotasTest-1384154979 tempest-QuotasTest-1384154979-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:14.724550 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a9572-8938-47d5-81c0-20ab3e2d6a43 tempest-QuotasTest-1384154979 tempest-QuotasTest-1384154979-project-admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:14.726017 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a9572-8938-47d5-81c0-20ab3e2d6a43 tempest-QuotasTest-1384154979 tempest-QuotasTest-1384154979-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:54:14.727564 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a9572-8938-47d5-81c0-20ab3e2d6a43 tempest-QuotasTest-1384154979 tempest-QuotasTest-1384154979-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:14.731615 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a9572-8938-47d5-81c0-20ab3e2d6a43 tempest-QuotasTest-1384154979 tempest-QuotasTest-1384154979-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:14.758517 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2159/4331] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:54:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:54:14.762491 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56379169-b4dd-43bf-97a7-6bd7f7b694e3 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:14.781711 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56379169-b4dd-43bf-97a7-6bd7f7b694e3 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:14.794242 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962ca25-a692-480f-a4ba-fd8e5ffaeaac tempest-QuotasTest-1384154979 tempest-QuotasTest-1384154979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fa5ccdfee744e9a1aa39f9cec58db1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f377761b00a4d9fa70d74a654afd692', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:14.794930 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962ca25-a692-480f-a4ba-fd8e5ffaeaac tempest-QuotasTest-1384154979 tempest-QuotasTest-1384154979-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:14.795241 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962ca25-a692-480f-a4ba-fd8e5ffaeaac tempest-QuotasTest-1384154979 tempest-QuotasTest-1384154979-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:14.795516 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962ca25-a692-480f-a4ba-fd8e5ffaeaac tempest-QuotasTest-1384154979 tempest-QuotasTest-1384154979-project-admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:14.796179 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9962ca25-a692-480f-a4ba-fd8e5ffaeaac tempest-QuotasTest-1384154979 tempest-QuotasTest-1384154979-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:14.799791 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9962ca25-a692-480f-a4ba-fd8e5ffaeaac tempest-QuotasTest-1384154979 tempest-QuotasTest-1384154979-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:14.863481 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2173/4332] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:54:14 2022] POST /identity/v3/projects => generated 349 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:54:14.867425 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a9572-8938-47d5-81c0-20ab3e2d6a43 tempest-QuotasTest-1384154979 tempest-QuotasTest-1384154979-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:14.890856 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a9572-8938-47d5-81c0-20ab3e2d6a43 tempest-QuotasTest-1384154979 tempest-QuotasTest-1384154979-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:15.084201 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86c632-47d6-4f67-bb02-fbc87da3708c tempest-QuotasTest-1384154979 tempest-QuotasTest-1384154979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fa5ccdfee744e9a1aa39f9cec58db1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f377761b00a4d9fa70d74a654afd692', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:15.086317 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86c632-47d6-4f67-bb02-fbc87da3708c tempest-QuotasTest-1384154979 tempest-QuotasTest-1384154979-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:15.089249 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86c632-47d6-4f67-bb02-fbc87da3708c tempest-QuotasTest-1384154979 tempest-QuotasTest-1384154979-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:15.089770 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86c632-47d6-4f67-bb02-fbc87da3708c tempest-QuotasTest-1384154979 tempest-QuotasTest-1384154979-project-admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:15.094387 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86c632-47d6-4f67-bb02-fbc87da3708c tempest-QuotasTest-1384154979 tempest-QuotasTest-1384154979-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:54:15.097701 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86c632-47d6-4f67-bb02-fbc87da3708c tempest-QuotasTest-1384154979 tempest-QuotasTest-1384154979-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:15.106909 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86c632-47d6-4f67-bb02-fbc87da3708c tempest-QuotasTest-1384154979 tempest-QuotasTest-1384154979-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:15.172015 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2160/4333] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:54:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:54:15.321624 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962ca25-a692-480f-a4ba-fd8e5ffaeaac tempest-QuotasTest-1384154979 tempest-QuotasTest-1384154979-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:15.323680 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9962ca25-a692-480f-a4ba-fd8e5ffaeaac tempest-QuotasTest-1384154979 tempest-QuotasTest-1384154979-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:15.565366 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962ca25-a692-480f-a4ba-fd8e5ffaeaac tempest-QuotasTest-1384154979 tempest-QuotasTest-1384154979-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:15.575545 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca20b62-2a08-4226-942d-99f632bacb95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:15.576193 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca20b62-2a08-4226-942d-99f632bacb95 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:15.576465 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca20b62-2a08-4226-942d-99f632bacb95 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:15.576734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca20b62-2a08-4226-942d-99f632bacb95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:15.606406 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca20b62-2a08-4226-942d-99f632bacb95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:15.607981 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca20b62-2a08-4226-942d-99f632bacb95 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:15.638020 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2174/4334] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:54:15 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:54:18.050876 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86c632-47d6-4f67-bb02-fbc87da3708c tempest-QuotasTest-1384154979 tempest-QuotasTest-1384154979-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:18.064464 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86c632-47d6-4f67-bb02-fbc87da3708c tempest-QuotasTest-1384154979 tempest-QuotasTest-1384154979-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:18.075901 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c166e3c2-0fcd-477a-a04f-9588dd134cab tempest-QuotasTest-1384154979 tempest-QuotasTest-1384154979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fa5ccdfee744e9a1aa39f9cec58db1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f377761b00a4d9fa70d74a654afd692', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:18.076580 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166e3c2-0fcd-477a-a04f-9588dd134cab tempest-QuotasTest-1384154979 tempest-QuotasTest-1384154979-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:18.076872 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166e3c2-0fcd-477a-a04f-9588dd134cab tempest-QuotasTest-1384154979 tempest-QuotasTest-1384154979-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:18.077259 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166e3c2-0fcd-477a-a04f-9588dd134cab tempest-QuotasTest-1384154979 tempest-QuotasTest-1384154979-project-admin] PATH_INFO: `/v3/projects/eb137333edd24aa581c00e25f257db0e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:18.079278 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c166e3c2-0fcd-477a-a04f-9588dd134cab tempest-QuotasTest-1384154979 tempest-QuotasTest-1384154979-project-admin] RBAC: Authorizing `identity:delete_project(project_id=eb137333edd24aa581c00e25f257db0e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:18.084655 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c166e3c2-0fcd-477a-a04f-9588dd134cab tempest-QuotasTest-1384154979 tempest-QuotasTest-1384154979-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:18.242405 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c166e3c2-0fcd-477a-a04f-9588dd134cab tempest-QuotasTest-1384154979 tempest-QuotasTest-1384154979-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb137333edd24aa581c00e25f257db0e', 'request_id': 'req-c166e3c2-0fcd-477a-a04f-9588dd134cab'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:18.248274 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:18.256136 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c166e3c2-0fcd-477a-a04f-9588dd134cab tempest-QuotasTest-1384154979 tempest-QuotasTest-1384154979-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb137333edd24aa581c00e25f257db0e', 'request_id': 'req-c166e3c2-0fcd-477a-a04f-9588dd134cab'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:18.274349 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c166e3c2-0fcd-477a-a04f-9588dd134cab tempest-QuotasTest-1384154979 tempest-QuotasTest-1384154979-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb137333edd24aa581c00e25f257db0e', 'request_id': 'req-c166e3c2-0fcd-477a-a04f-9588dd134cab'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:18.306926 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c166e3c2-0fcd-477a-a04f-9588dd134cab tempest-QuotasTest-1384154979 tempest-QuotasTest-1384154979-project-admin] The token cache is being invalidate because project eb137333edd24aa581c00e25f257db0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:18.307533 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c166e3c2-0fcd-477a-a04f-9588dd134cab tempest-QuotasTest-1384154979 tempest-QuotasTest-1384154979-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:18.309319 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c166e3c2-0fcd-477a-a04f-9588dd134cab tempest-QuotasTest-1384154979 tempest-QuotasTest-1384154979-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:18.314327 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2161/4335] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:54:18 2022] DELETE /identity/v3/projects/eb137333edd24aa581c00e25f257db0e => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:19.199199 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca20b62-2a08-4226-942d-99f632bacb95 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:19.336497 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:19.388336 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca20b62-2a08-4226-942d-99f632bacb95 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:19.578843 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e6ee1-77e7-4aeb-bf02-107a2ad03892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:19.579579 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e6ee1-77e7-4aeb-bf02-107a2ad03892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:19.580565 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e6ee1-77e7-4aeb-bf02-107a2ad03892 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:19.580876 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e6ee1-77e7-4aeb-bf02-107a2ad03892 admin admin] PATH_INFO: `/v3/users/277d26eb0a344d9ca571f390f7276f85` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:19.582117 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e6ee1-77e7-4aeb-bf02-107a2ad03892 admin admin] RBAC: Authorizing `identity:delete_user(user_id=277d26eb0a344d9ca571f390f7276f85)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:19.585186 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e6ee1-77e7-4aeb-bf02-107a2ad03892 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:19.711747 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-133e6ee1-77e7-4aeb-bf02-107a2ad03892 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '277d26eb0a344d9ca571f390f7276f85'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:19.717402 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-133e6ee1-77e7-4aeb-bf02-107a2ad03892 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '277d26eb0a344d9ca571f390f7276f85'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:19.773296 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-133e6ee1-77e7-4aeb-bf02-107a2ad03892 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '277d26eb0a344d9ca571f390f7276f85'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:19.792027 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-133e6ee1-77e7-4aeb-bf02-107a2ad03892 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '277d26eb0a344d9ca571f390f7276f85'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:19.819001 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-133e6ee1-77e7-4aeb-bf02-107a2ad03892 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '277d26eb0a344d9ca571f390f7276f85'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:19.844394 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2175/4336] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:54:19 2022] DELETE /identity/v3/users/277d26eb0a344d9ca571f390f7276f85 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:19.846117 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1a066-4df8-4ba3-a538-8a1916ba8296 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:19.846620 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1a066-4df8-4ba3-a538-8a1916ba8296 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:19.846729 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1a066-4df8-4ba3-a538-8a1916ba8296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:19.905552 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-fef1a066-4df8-4ba3-a538-8a1916ba8296 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:19.911852 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-fef1a066-4df8-4ba3-a538-8a1916ba8296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:20.079984 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2162/4337] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:54:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:54:20.109394 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e6ee1-77e7-4aeb-bf02-107a2ad03892 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:20.111923 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-133e6ee1-77e7-4aeb-bf02-107a2ad03892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:20.321409 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e6ee1-77e7-4aeb-bf02-107a2ad03892 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:20.326380 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c74a0e0-7df6-4001-9dff-6f80dabe8012 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:20.327559 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74a0e0-7df6-4001-9dff-6f80dabe8012 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:20.328212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74a0e0-7df6-4001-9dff-6f80dabe8012 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:20.328763 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74a0e0-7df6-4001-9dff-6f80dabe8012 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:20.358760 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c74a0e0-7df6-4001-9dff-6f80dabe8012 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:20.375216 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c74a0e0-7df6-4001-9dff-6f80dabe8012 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:20.396733 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2176/4338] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:54:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:54:22.068745 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1a066-4df8-4ba3-a538-8a1916ba8296 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:22.073589 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-fef1a066-4df8-4ba3-a538-8a1916ba8296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:22.117052 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1a066-4df8-4ba3-a538-8a1916ba8296 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:22.139953 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399bdd85-4980-40e1-a2fd-b2bebd01b40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:22.141086 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399bdd85-4980-40e1-a2fd-b2bebd01b40b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:22.143532 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399bdd85-4980-40e1-a2fd-b2bebd01b40b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:22.144054 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399bdd85-4980-40e1-a2fd-b2bebd01b40b admin admin] PATH_INFO: `/v3/projects/8eb0c5cece984faba48016c7fbeedf19` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:22.149864 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399bdd85-4980-40e1-a2fd-b2bebd01b40b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8eb0c5cece984faba48016c7fbeedf19)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:22.158290 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399bdd85-4980-40e1-a2fd-b2bebd01b40b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:22.305611 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-399bdd85-4980-40e1-a2fd-b2bebd01b40b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8eb0c5cece984faba48016c7fbeedf19', 'request_id': 'req-399bdd85-4980-40e1-a2fd-b2bebd01b40b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:22.313637 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-399bdd85-4980-40e1-a2fd-b2bebd01b40b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8eb0c5cece984faba48016c7fbeedf19', 'request_id': 'req-399bdd85-4980-40e1-a2fd-b2bebd01b40b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:22.321498 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-399bdd85-4980-40e1-a2fd-b2bebd01b40b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8eb0c5cece984faba48016c7fbeedf19', 'request_id': 'req-399bdd85-4980-40e1-a2fd-b2bebd01b40b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:22.340858 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-399bdd85-4980-40e1-a2fd-b2bebd01b40b admin admin] The token cache is being invalidate because project 8eb0c5cece984faba48016c7fbeedf19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:22.341507 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-399bdd85-4980-40e1-a2fd-b2bebd01b40b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:22.343880 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-399bdd85-4980-40e1-a2fd-b2bebd01b40b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:22.348334 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2163/4339] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:54:22 2022] DELETE /identity/v3/projects/8eb0c5cece984faba48016c7fbeedf19 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:22.353629 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c74a0e0-7df6-4001-9dff-6f80dabe8012 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:22.369398 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c74a0e0-7df6-4001-9dff-6f80dabe8012 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:22.391200 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:22.497753 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb0d36e-15cd-4d63-8a39-78403a62659d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:22.498987 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0d36e-15cd-4d63-8a39-78403a62659d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:22.500221 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0d36e-15cd-4d63-8a39-78403a62659d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:22.500707 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0d36e-15cd-4d63-8a39-78403a62659d admin admin] PATH_INFO: `/v3/users/07fa5ccdfee744e9a1aa39f9cec58db1` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:22.502840 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb0d36e-15cd-4d63-8a39-78403a62659d admin admin] RBAC: Authorizing `identity:delete_user(user_id=07fa5ccdfee744e9a1aa39f9cec58db1)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:22.505517 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb0d36e-15cd-4d63-8a39-78403a62659d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:22.583488 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6fb0d36e-15cd-4d63-8a39-78403a62659d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07fa5ccdfee744e9a1aa39f9cec58db1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:22.584311 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6fb0d36e-15cd-4d63-8a39-78403a62659d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07fa5ccdfee744e9a1aa39f9cec58db1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:22.603473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6fb0d36e-15cd-4d63-8a39-78403a62659d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07fa5ccdfee744e9a1aa39f9cec58db1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:22.614674 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6fb0d36e-15cd-4d63-8a39-78403a62659d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07fa5ccdfee744e9a1aa39f9cec58db1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:22.627133 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6fb0d36e-15cd-4d63-8a39-78403a62659d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07fa5ccdfee744e9a1aa39f9cec58db1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:22.636872 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2177/4340] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:54:22 2022] DELETE /identity/v3/users/07fa5ccdfee744e9a1aa39f9cec58db1 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:54:23.335214 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399bdd85-4980-40e1-a2fd-b2bebd01b40b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:23.336644 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-399bdd85-4980-40e1-a2fd-b2bebd01b40b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:23.363396 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399bdd85-4980-40e1-a2fd-b2bebd01b40b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:23.555338 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f255ebe-d824-4fdc-8178-5342b0e75915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:23.557286 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f255ebe-d824-4fdc-8178-5342b0e75915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:23.558131 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f255ebe-d824-4fdc-8178-5342b0e75915 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:23.560296 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f255ebe-d824-4fdc-8178-5342b0e75915 admin admin] PATH_INFO: `/v3/projects/3f377761b00a4d9fa70d74a654afd692` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:23.563944 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f255ebe-d824-4fdc-8178-5342b0e75915 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f377761b00a4d9fa70d74a654afd692)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:23.569824 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f255ebe-d824-4fdc-8178-5342b0e75915 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:23.577155 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:23.708416 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6f255ebe-d824-4fdc-8178-5342b0e75915 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f377761b00a4d9fa70d74a654afd692', 'request_id': 'req-6f255ebe-d824-4fdc-8178-5342b0e75915'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:23.722176 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6f255ebe-d824-4fdc-8178-5342b0e75915 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f377761b00a4d9fa70d74a654afd692', 'request_id': 'req-6f255ebe-d824-4fdc-8178-5342b0e75915'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:23.747403 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6f255ebe-d824-4fdc-8178-5342b0e75915 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f377761b00a4d9fa70d74a654afd692', 'request_id': 'req-6f255ebe-d824-4fdc-8178-5342b0e75915'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:23.789363 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6f255ebe-d824-4fdc-8178-5342b0e75915 admin admin] The token cache is being invalidate because project 3f377761b00a4d9fa70d74a654afd692 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:23.789653 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6f255ebe-d824-4fdc-8178-5342b0e75915 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:23.790591 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6f255ebe-d824-4fdc-8178-5342b0e75915 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:23.793520 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2164/4341] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:54:23 2022] DELETE /identity/v3/projects/3f377761b00a4d9fa70d74a654afd692 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:54:23.801555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403cfbd2-9dc5-4b0a-9053-04335297f4a7 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:23.802074 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403cfbd2-9dc5-4b0a-9053-04335297f4a7 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:23.802074 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403cfbd2-9dc5-4b0a-9053-04335297f4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:23.844420 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-403cfbd2-9dc5-4b0a-9053-04335297f4a7 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:23.849607 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-403cfbd2-9dc5-4b0a-9053-04335297f4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:24.035843 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2178/4342] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:54:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:24.042321 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bd2ee-e219-46f9-b1b1-902488bb9e60 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:24.042880 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bd2ee-e219-46f9-b1b1-902488bb9e60 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:24.043352 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bd2ee-e219-46f9-b1b1-902488bb9e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:24.093294 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-301bd2ee-e219-46f9-b1b1-902488bb9e60 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:24.096766 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-301bd2ee-e219-46f9-b1b1-902488bb9e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:24.122254 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2165/4343] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:54:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:24.124075 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403cfbd2-9dc5-4b0a-9053-04335297f4a7 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:24.166392 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403cfbd2-9dc5-4b0a-9053-04335297f4a7 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:24.176789 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c629b822-26d7-4deb-98f8-abb25b8a4bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:24.181982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629b822-26d7-4deb-98f8-abb25b8a4bdb admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:24.183915 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629b822-26d7-4deb-98f8-abb25b8a4bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:24.184924 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629b822-26d7-4deb-98f8-abb25b8a4bdb admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:24.185785 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c629b822-26d7-4deb-98f8-abb25b8a4bdb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:54:24.187174 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c629b822-26d7-4deb-98f8-abb25b8a4bdb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:24.193662 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c629b822-26d7-4deb-98f8-abb25b8a4bdb admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:24.224488 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2179/4344] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:54:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:54:24.230038 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301bd2ee-e219-46f9-b1b1-902488bb9e60 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:24.244104 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301bd2ee-e219-46f9-b1b1-902488bb9e60 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:24.261080 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8992bbc-ec97-47a9-b0e1-03b1e815967b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:24.261723 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8992bbc-ec97-47a9-b0e1-03b1e815967b admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:24.262000 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8992bbc-ec97-47a9-b0e1-03b1e815967b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:24.262266 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8992bbc-ec97-47a9-b0e1-03b1e815967b admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:24.263004 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8992bbc-ec97-47a9-b0e1-03b1e815967b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:24.265446 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8992bbc-ec97-47a9-b0e1-03b1e815967b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:24.336974 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2166/4345] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:54:24 2022] POST /identity/v3/projects => generated 395 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:24.337934 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c629b822-26d7-4deb-98f8-abb25b8a4bdb admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:24.352485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c629b822-26d7-4deb-98f8-abb25b8a4bdb admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:24.378404 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:24.445731 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7d8b0-4d31-49a3-81b4-492401f3b63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:24.446902 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7d8b0-4d31-49a3-81b4-492401f3b63e admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:24.447516 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7d8b0-4d31-49a3-81b4-492401f3b63e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:24.448153 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7d8b0-4d31-49a3-81b4-492401f3b63e admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:24.449160 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7d8b0-4d31-49a3-81b4-492401f3b63e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:24.452673 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7d8b0-4d31-49a3-81b4-492401f3b63e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:24.506232 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8992bbc-ec97-47a9-b0e1-03b1e815967b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:24.514153 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2180/4346] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:54:24 2022] POST /identity/v3/users => generated 298 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:24.520672 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8992bbc-ec97-47a9-b0e1-03b1e815967b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:24.534750 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf07dd83-3b47-48aa-b65f-5fb24ce47a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:24.535576 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07dd83-3b47-48aa-b65f-5fb24ce47a3e admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:24.535857 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07dd83-3b47-48aa-b65f-5fb24ce47a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:24.536127 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07dd83-3b47-48aa-b65f-5fb24ce47a3e admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:24.538651 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf07dd83-3b47-48aa-b65f-5fb24ce47a3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:24.543479 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf07dd83-3b47-48aa-b65f-5fb24ce47a3e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:24.572501 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2167/4347] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:54:24.574114 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7d8b0-4d31-49a3-81b4-492401f3b63e admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:24.586626 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7d8b0-4d31-49a3-81b4-492401f3b63e admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:24.604334 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff649ebf-4f65-4961-ad62-fc3082224ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:24.606844 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff649ebf-4f65-4961-ad62-fc3082224ecc admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:24.607329 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff649ebf-4f65-4961-ad62-fc3082224ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:24.608003 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff649ebf-4f65-4961-ad62-fc3082224ecc admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:24.609523 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff649ebf-4f65-4961-ad62-fc3082224ecc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:24.613052 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff649ebf-4f65-4961-ad62-fc3082224ecc admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:24.653361 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf07dd83-3b47-48aa-b65f-5fb24ce47a3e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:24.660351 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2181/4348] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:54:24.666327 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf07dd83-3b47-48aa-b65f-5fb24ce47a3e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:24.673891 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420a294-3011-4aa8-9b5a-cd1a4a00d9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:24.674864 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420a294-3011-4aa8-9b5a-cd1a4a00d9fb admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:24.675354 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420a294-3011-4aa8-9b5a-cd1a4a00d9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:24.675805 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420a294-3011-4aa8-9b5a-cd1a4a00d9fb admin admin] PATH_INFO: `/v3/projects/bdf0e25aaf9d410fbd13b4266e64ebe6/users/69c00bd48ee047608663b680b333e293/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:24.708552 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7420a294-3011-4aa8-9b5a-cd1a4a00d9fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdf0e25aaf9d410fbd13b4266e64ebe6, user_id=69c00bd48ee047608663b680b333e293, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:24.711695 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7420a294-3011-4aa8-9b5a-cd1a4a00d9fb admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:24.739748 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2168/4349] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:54:24 2022] PUT /identity/v3/projects/bdf0e25aaf9d410fbd13b4266e64ebe6/users/69c00bd48ee047608663b680b333e293/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:24.752684 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4fa8d1-bb9f-45a1-9df0-160d2b508c2b None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:24.752684 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4fa8d1-bb9f-45a1-9df0-160d2b508c2b None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:24.753011 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4fa8d1-bb9f-45a1-9df0-160d2b508c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:24.832550 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-ab4fa8d1-bb9f-45a1-9df0-160d2b508c2b None None] MFA Rules not processed for user `69c00bd48ee047608663b680b333e293`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:24.833977 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ab4fa8d1-bb9f-45a1-9df0-160d2b508c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:25.000358 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2182/4350] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:54:24 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:25.019945 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420a294-3011-4aa8-9b5a-cd1a4a00d9fb admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:25.021891 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7420a294-3011-4aa8-9b5a-cd1a4a00d9fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:25.167684 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420a294-3011-4aa8-9b5a-cd1a4a00d9fb admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:25.181650 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76f905-2642-4fb5-bc15-8d4f5154bd8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:25.183203 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76f905-2642-4fb5-bc15-8d4f5154bd8c service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:25.184234 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76f905-2642-4fb5-bc15-8d4f5154bd8c service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:25.184736 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76f905-2642-4fb5-bc15-8d4f5154bd8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:25.212816 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d76f905-2642-4fb5-bc15-8d4f5154bd8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:25.217140 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d76f905-2642-4fb5-bc15-8d4f5154bd8c service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:25.254412 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2169/4351] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:54:25 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:54:33.596210 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19bca35-7e74-4499-8b0c-86f5b08fa599 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:33.596789 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19bca35-7e74-4499-8b0c-86f5b08fa599 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:33.596789 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19bca35-7e74-4499-8b0c-86f5b08fa599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:33.620493 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-b19bca35-7e74-4499-8b0c-86f5b08fa599 None None] MFA Rules not processed for user `9dda72ff55b246cea4bf5bc5e1e87c5f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:33.621023 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b19bca35-7e74-4499-8b0c-86f5b08fa599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:33.720313 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2183/4352] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:54:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:35.233417 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=76,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:35.437179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afb46a-8078-4b24-b5a7-a379fc490733 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:35.437469 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afb46a-8078-4b24-b5a7-a379fc490733 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:35.437746 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afb46a-8078-4b24-b5a7-a379fc490733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:35.514885 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-c0afb46a-8078-4b24-b5a7-a379fc490733 None None] MFA Rules not processed for user `8efa4be1bf974daf84fc5f64b4ca3155`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:35.517266 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c0afb46a-8078-4b24-b5a7-a379fc490733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:35.716816 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2170/4353] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:54:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:36.962225 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19bca35-7e74-4499-8b0c-86f5b08fa599 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:37.003386 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19bca35-7e74-4499-8b0c-86f5b08fa599 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:37.035076 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb1f66-cccb-438f-a77f-a9326b000595 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:37.036125 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb1f66-cccb-438f-a77f-a9326b000595 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:37.036861 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb1f66-cccb-438f-a77f-a9326b000595 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:37.038131 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb1f66-cccb-438f-a77f-a9326b000595 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:37.045309 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-68bb1f66-cccb-438f-a77f-a9326b000595 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:37.097731 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb1f66-cccb-438f-a77f-a9326b000595 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:37.105556 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb1f66-cccb-438f-a77f-a9326b000595 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:37.143700 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2184/4354] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:54:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:54:45.688604 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=25 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:47.123244 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=88,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:54.909203 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0afb46a-8078-4b24-b5a7-a379fc490733 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:54.910864 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c0afb46a-8078-4b24-b5a7-a379fc490733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:55.014086 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0afb46a-8078-4b24-b5a7-a379fc490733 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:55.019343 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c696f-7099-469c-a725-05ee9745eba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:55.019999 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c696f-7099-469c-a725-05ee9745eba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:55.020281 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c696f-7099-469c-a725-05ee9745eba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:55.020550 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c696f-7099-469c-a725-05ee9745eba8 admin admin] PATH_INFO: `/v3/users/29bc3ad4c8e34addbb6ab1b8a41e86d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:55.023332 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76c696f-7099-469c-a725-05ee9745eba8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29bc3ad4c8e34addbb6ab1b8a41e86d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:55.027047 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76c696f-7099-469c-a725-05ee9745eba8 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:55.125518 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f76c696f-7099-469c-a725-05ee9745eba8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29bc3ad4c8e34addbb6ab1b8a41e86d2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:55.126932 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f76c696f-7099-469c-a725-05ee9745eba8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29bc3ad4c8e34addbb6ab1b8a41e86d2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:55.137700 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f76c696f-7099-469c-a725-05ee9745eba8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29bc3ad4c8e34addbb6ab1b8a41e86d2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:55.148597 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f76c696f-7099-469c-a725-05ee9745eba8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29bc3ad4c8e34addbb6ab1b8a41e86d2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:55.149406 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f76c696f-7099-469c-a725-05ee9745eba8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29bc3ad4c8e34addbb6ab1b8a41e86d2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:55.186010 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2171/4355] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:54:54 2022] DELETE /identity/v3/users/29bc3ad4c8e34addbb6ab1b8a41e86d2 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:55.187791 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1f2f8-92f5-48d1-92c5-ec0a78c2f47a None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:55.188695 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1f2f8-92f5-48d1-92c5-ec0a78c2f47a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:55.189138 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1f2f8-92f5-48d1-92c5-ec0a78c2f47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:55.234203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-b0a1f2f8-92f5-48d1-92c5-ec0a78c2f47a None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:55.235459 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b0a1f2f8-92f5-48d1-92c5-ec0a78c2f47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:55.305088 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2185/4356] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:54:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:55.318340 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c696f-7099-469c-a725-05ee9745eba8 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:55.320831 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f76c696f-7099-469c-a725-05ee9745eba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:55.382753 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c696f-7099-469c-a725-05ee9745eba8 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:55.387553 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800f4a3-8b99-43eb-9b67-c180f9bc1b54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:55.388261 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800f4a3-8b99-43eb-9b67-c180f9bc1b54 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:55.388616 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800f4a3-8b99-43eb-9b67-c180f9bc1b54 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:55.388953 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800f4a3-8b99-43eb-9b67-c180f9bc1b54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:55.401984 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2800f4a3-8b99-43eb-9b67-c180f9bc1b54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:55.403635 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2800f4a3-8b99-43eb-9b67-c180f9bc1b54 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:55.415678 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2172/4357] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:54:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:54:55.724800 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a1f2f8-92f5-48d1-92c5-ec0a78c2f47a None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:55.726552 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b0a1f2f8-92f5-48d1-92c5-ec0a78c2f47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:55.750667 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a1f2f8-92f5-48d1-92c5-ec0a78c2f47a None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:55.755919 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92531b14-cdca-4acc-8499-341a67b86b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:55.757788 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92531b14-cdca-4acc-8499-341a67b86b85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:55.758029 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92531b14-cdca-4acc-8499-341a67b86b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:55.758306 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92531b14-cdca-4acc-8499-341a67b86b85 admin admin] PATH_INFO: `/v3/projects/01cd135512284897b4ef1a9e923958bd` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:55.759604 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92531b14-cdca-4acc-8499-341a67b86b85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01cd135512284897b4ef1a9e923958bd)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:55.761677 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92531b14-cdca-4acc-8499-341a67b86b85 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:55.824146 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-92531b14-cdca-4acc-8499-341a67b86b85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01cd135512284897b4ef1a9e923958bd', 'request_id': 'req-92531b14-cdca-4acc-8499-341a67b86b85'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:55.830453 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-92531b14-cdca-4acc-8499-341a67b86b85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01cd135512284897b4ef1a9e923958bd', 'request_id': 'req-92531b14-cdca-4acc-8499-341a67b86b85'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:55.840731 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-92531b14-cdca-4acc-8499-341a67b86b85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01cd135512284897b4ef1a9e923958bd', 'request_id': 'req-92531b14-cdca-4acc-8499-341a67b86b85'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:55.854428 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-92531b14-cdca-4acc-8499-341a67b86b85 admin admin] The token cache is being invalidate because project 01cd135512284897b4ef1a9e923958bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:55.854694 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-92531b14-cdca-4acc-8499-341a67b86b85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:55.855416 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-92531b14-cdca-4acc-8499-341a67b86b85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:55.861725 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2186/4358] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:54:55 2022] DELETE /identity/v3/projects/01cd135512284897b4ef1a9e923958bd => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:55.863725 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125e76d-4efb-4469-b172-e79441e740d0 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:55.864024 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125e76d-4efb-4469-b172-e79441e740d0 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:55.865329 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125e76d-4efb-4469-b172-e79441e740d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:55.900107 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-b125e76d-4efb-4469-b172-e79441e740d0 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:55.901340 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b125e76d-4efb-4469-b172-e79441e740d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:55.956137 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:56.035280 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2173/4359] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:54:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:56.037770 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947847e9-1b30-484c-be5c-0114338368f7 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:56.037951 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947847e9-1b30-484c-be5c-0114338368f7 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:56.038329 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947847e9-1b30-484c-be5c-0114338368f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:56.059662 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-947847e9-1b30-484c-be5c-0114338368f7 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:56.060900 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-947847e9-1b30-484c-be5c-0114338368f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:56.070096 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2187/4360] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:54:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:56.076793 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125e76d-4efb-4469-b172-e79441e740d0 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:56.088668 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125e76d-4efb-4469-b172-e79441e740d0 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:56.096383 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b181326-2cae-4460-a294-e0120b4561f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:56.097239 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b181326-2cae-4460-a294-e0120b4561f0 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:56.097628 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b181326-2cae-4460-a294-e0120b4561f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:56.098171 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b181326-2cae-4460-a294-e0120b4561f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:56.099138 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b181326-2cae-4460-a294-e0120b4561f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:54:56.099678 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b181326-2cae-4460-a294-e0120b4561f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:56.102433 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b181326-2cae-4460-a294-e0120b4561f0 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:56.129855 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2174/4361] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:54:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:54:56.130515 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947847e9-1b30-484c-be5c-0114338368f7 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:56.148989 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947847e9-1b30-484c-be5c-0114338368f7 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:56.155780 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc25c27-bd70-4d14-bcd4-3803e2549ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:56.156498 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc25c27-bd70-4d14-bcd4-3803e2549ff5 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:56.156994 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc25c27-bd70-4d14-bcd4-3803e2549ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:56.157455 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc25c27-bd70-4d14-bcd4-3803e2549ff5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:56.158549 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc25c27-bd70-4d14-bcd4-3803e2549ff5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:56.166269 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc25c27-bd70-4d14-bcd4-3803e2549ff5 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:56.242839 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2188/4362] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:54:56 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:54:56.248978 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b181326-2cae-4460-a294-e0120b4561f0 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:56.264320 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b181326-2cae-4460-a294-e0120b4561f0 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:56.358296 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb3175-9965-4f39-8f1c-895ccc18a94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:56.358846 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb3175-9965-4f39-8f1c-895ccc18a94e admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:56.359170 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb3175-9965-4f39-8f1c-895ccc18a94e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:56.359445 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb3175-9965-4f39-8f1c-895ccc18a94e admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:56.363482 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb3175-9965-4f39-8f1c-895ccc18a94e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:56.365488 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb3175-9965-4f39-8f1c-895ccc18a94e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:56.411967 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2175/4363] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:54:56 2022] POST /identity/v3/users => generated 287 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:56.415980 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc25c27-bd70-4d14-bcd4-3803e2549ff5 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:56.430157 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc25c27-bd70-4d14-bcd4-3803e2549ff5 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:56.435381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353950be-0efd-4ff5-bdf1-c574dbc973a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:56.435998 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353950be-0efd-4ff5-bdf1-c574dbc973a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:56.436277 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353950be-0efd-4ff5-bdf1-c574dbc973a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:56.436543 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353950be-0efd-4ff5-bdf1-c574dbc973a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:56.437192 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353950be-0efd-4ff5-bdf1-c574dbc973a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:56.438862 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353950be-0efd-4ff5-bdf1-c574dbc973a9 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:56.453108 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2189/4364] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:54:56.454447 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb3175-9965-4f39-8f1c-895ccc18a94e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:56.466568 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb3175-9965-4f39-8f1c-895ccc18a94e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:56.472241 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dbdb6a-1565-4254-95e6-d2db4122b24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:56.472920 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dbdb6a-1565-4254-95e6-d2db4122b24c admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:56.473254 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dbdb6a-1565-4254-95e6-d2db4122b24c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:56.473630 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dbdb6a-1565-4254-95e6-d2db4122b24c admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:56.474356 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dbdb6a-1565-4254-95e6-d2db4122b24c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:56.476661 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dbdb6a-1565-4254-95e6-d2db4122b24c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:56.493256 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2176/4365] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:54:56.498196 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353950be-0efd-4ff5-bdf1-c574dbc973a9 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:56.523379 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353950be-0efd-4ff5-bdf1-c574dbc973a9 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:56.527803 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffeb9c-1ae0-40ee-9f7b-e27373757ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:56.528854 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffeb9c-1ae0-40ee-9f7b-e27373757ed7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:56.529319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffeb9c-1ae0-40ee-9f7b-e27373757ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:56.530024 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffeb9c-1ae0-40ee-9f7b-e27373757ed7 admin admin] PATH_INFO: `/v3/projects/f0ab86b2728e442997d0ff3bcdfa7eb0/users/705845e9fee249769ca4ee0f962422ca/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:56.557168 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbffeb9c-1ae0-40ee-9f7b-e27373757ed7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0ab86b2728e442997d0ff3bcdfa7eb0, user_id=705845e9fee249769ca4ee0f962422ca, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:56.561702 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbffeb9c-1ae0-40ee-9f7b-e27373757ed7 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:56.587698 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2190/4366] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:54:56 2022] PUT /identity/v3/projects/f0ab86b2728e442997d0ff3bcdfa7eb0/users/705845e9fee249769ca4ee0f962422ca/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:54:56.598162 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52caa1-62c5-41c7-89ab-565bc8086f95 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:56.598591 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52caa1-62c5-41c7-89ab-565bc8086f95 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:56.598966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52caa1-62c5-41c7-89ab-565bc8086f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:56.630909 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-5f52caa1-62c5-41c7-89ab-565bc8086f95 None None] MFA Rules not processed for user `705845e9fee249769ca4ee0f962422ca`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:56.633047 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5f52caa1-62c5-41c7-89ab-565bc8086f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:56.716996 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2177/4367] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:54:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:54:56.729431 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffeb9c-1ae0-40ee-9f7b-e27373757ed7 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:56.731420 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-dbffeb9c-1ae0-40ee-9f7b-e27373757ed7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:56.783173 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:56.859102 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffeb9c-1ae0-40ee-9f7b-e27373757ed7 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:56.865465 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57455c80-2334-4ba2-a237-5b807e9a4350 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:56.867140 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57455c80-2334-4ba2-a237-5b807e9a4350 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:56.867707 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57455c80-2334-4ba2-a237-5b807e9a4350 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:56.868508 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57455c80-2334-4ba2-a237-5b807e9a4350 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:56.881910 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57455c80-2334-4ba2-a237-5b807e9a4350 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:56.882608 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57455c80-2334-4ba2-a237-5b807e9a4350 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:56.894837 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2191/4368] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:54:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:55:02.062184 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52caa1-62c5-41c7-89ab-565bc8086f95 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:02.063937 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5f52caa1-62c5-41c7-89ab-565bc8086f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:02.140698 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:02.278934 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52caa1-62c5-41c7-89ab-565bc8086f95 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:02.284811 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1144a-1016-4a47-a869-d7ccb2f48777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:02.285474 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1144a-1016-4a47-a869-d7ccb2f48777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:02.285758 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1144a-1016-4a47-a869-d7ccb2f48777 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:02.286036 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1144a-1016-4a47-a869-d7ccb2f48777 admin admin] PATH_INFO: `/v3/users/69c00bd48ee047608663b680b333e293` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:02.287323 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc1144a-1016-4a47-a869-d7ccb2f48777 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69c00bd48ee047608663b680b333e293)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:02.289902 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc1144a-1016-4a47-a869-d7ccb2f48777 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:02.386594 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1fc1144a-1016-4a47-a869-d7ccb2f48777 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69c00bd48ee047608663b680b333e293'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:02.387342 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1fc1144a-1016-4a47-a869-d7ccb2f48777 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69c00bd48ee047608663b680b333e293'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:02.406441 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1fc1144a-1016-4a47-a869-d7ccb2f48777 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69c00bd48ee047608663b680b333e293'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:02.419808 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1fc1144a-1016-4a47-a869-d7ccb2f48777 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69c00bd48ee047608663b680b333e293'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:02.420605 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1fc1144a-1016-4a47-a869-d7ccb2f48777 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69c00bd48ee047608663b680b333e293'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:02.459401 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2178/4369] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:55:02 2022] DELETE /identity/v3/users/69c00bd48ee047608663b680b333e293 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:02.464048 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4da7c-c605-49b7-baa0-3268a48bd415 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:02.465034 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4da7c-c605-49b7-baa0-3268a48bd415 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:02.465329 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4da7c-c605-49b7-baa0-3268a48bd415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:02.510005 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-bec4da7c-c605-49b7-baa0-3268a48bd415 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:02.511642 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-bec4da7c-c605-49b7-baa0-3268a48bd415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:02.588320 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2192/4370] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:55:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:02.598088 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1144a-1016-4a47-a869-d7ccb2f48777 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:02.599188 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1fc1144a-1016-4a47-a869-d7ccb2f48777 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:02.684085 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1144a-1016-4a47-a869-d7ccb2f48777 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:02.688363 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903badc-5240-4cd5-9cde-da19e7635782 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:02.689183 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903badc-5240-4cd5-9cde-da19e7635782 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:02.689597 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903badc-5240-4cd5-9cde-da19e7635782 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:02.689870 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903badc-5240-4cd5-9cde-da19e7635782 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:02.701521 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2903badc-5240-4cd5-9cde-da19e7635782 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:02.702976 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2903badc-5240-4cd5-9cde-da19e7635782 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:02.718371 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2179/4371] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:55:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:55:03.239792 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4da7c-c605-49b7-baa0-3268a48bd415 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:03.241415 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-bec4da7c-c605-49b7-baa0-3268a48bd415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:03.254371 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4da7c-c605-49b7-baa0-3268a48bd415 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:03.260271 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a63b9b-8f9d-4eda-8ef7-53778d3e3612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:03.261123 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a63b9b-8f9d-4eda-8ef7-53778d3e3612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:03.261658 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a63b9b-8f9d-4eda-8ef7-53778d3e3612 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:03.261962 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a63b9b-8f9d-4eda-8ef7-53778d3e3612 admin admin] PATH_INFO: `/v3/projects/bdf0e25aaf9d410fbd13b4266e64ebe6` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:03.263270 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a63b9b-8f9d-4eda-8ef7-53778d3e3612 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdf0e25aaf9d410fbd13b4266e64ebe6)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:03.265222 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a63b9b-8f9d-4eda-8ef7-53778d3e3612 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:03.330502 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-27a63b9b-8f9d-4eda-8ef7-53778d3e3612 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdf0e25aaf9d410fbd13b4266e64ebe6', 'request_id': 'req-27a63b9b-8f9d-4eda-8ef7-53778d3e3612'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:03.337438 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-27a63b9b-8f9d-4eda-8ef7-53778d3e3612 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdf0e25aaf9d410fbd13b4266e64ebe6', 'request_id': 'req-27a63b9b-8f9d-4eda-8ef7-53778d3e3612'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:03.348137 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-27a63b9b-8f9d-4eda-8ef7-53778d3e3612 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdf0e25aaf9d410fbd13b4266e64ebe6', 'request_id': 'req-27a63b9b-8f9d-4eda-8ef7-53778d3e3612'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:03.365020 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-27a63b9b-8f9d-4eda-8ef7-53778d3e3612 admin admin] The token cache is being invalidate because project bdf0e25aaf9d410fbd13b4266e64ebe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:55:03.365420 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-27a63b9b-8f9d-4eda-8ef7-53778d3e3612 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:03.366411 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-27a63b9b-8f9d-4eda-8ef7-53778d3e3612 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:03.368817 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2193/4372] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:55:03 2022] DELETE /identity/v3/projects/bdf0e25aaf9d410fbd13b4266e64ebe6 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:03.375059 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7284b-4d49-4c19-9ac0-5b847f4315d9 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:03.375581 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7284b-4d49-4c19-9ac0-5b847f4315d9 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:03.375824 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7284b-4d49-4c19-9ac0-5b847f4315d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:03.398952 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-c8f7284b-4d49-4c19-9ac0-5b847f4315d9 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:03.400626 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c8f7284b-4d49-4c19-9ac0-5b847f4315d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:03.445586 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:03.485212 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2180/4373] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:55:03.487987 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3afb6-71df-405b-bb0c-90b6c96ced4a None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:03.488470 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3afb6-71df-405b-bb0c-90b6c96ced4a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:03.488794 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3afb6-71df-405b-bb0c-90b6c96ced4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:03.528892 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-d8a3afb6-71df-405b-bb0c-90b6c96ced4a None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:03.531919 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d8a3afb6-71df-405b-bb0c-90b6c96ced4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:03.556965 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2194/4374] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:03.558232 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7284b-4d49-4c19-9ac0-5b847f4315d9 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:03.569989 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7284b-4d49-4c19-9ac0-5b847f4315d9 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:03.588511 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007634f9-5b5a-437f-ac67-1766a8fcdb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:03.589153 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007634f9-5b5a-437f-ac67-1766a8fcdb84 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:03.589433 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007634f9-5b5a-437f-ac67-1766a8fcdb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:03.589708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007634f9-5b5a-437f-ac67-1766a8fcdb84 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:03.590472 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007634f9-5b5a-437f-ac67-1766a8fcdb84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:55:03.590781 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007634f9-5b5a-437f-ac67-1766a8fcdb84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:03.592553 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007634f9-5b5a-437f-ac67-1766a8fcdb84 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:03.613073 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2181/4375] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:55:03.614298 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3afb6-71df-405b-bb0c-90b6c96ced4a None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:03.629526 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3afb6-71df-405b-bb0c-90b6c96ced4a None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:03.641718 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65adbe47-e9e3-49c2-b79b-ab5ab60b2f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:03.642666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65adbe47-e9e3-49c2-b79b-ab5ab60b2f62 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:03.642947 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65adbe47-e9e3-49c2-b79b-ab5ab60b2f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:03.643246 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65adbe47-e9e3-49c2-b79b-ab5ab60b2f62 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:03.643894 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65adbe47-e9e3-49c2-b79b-ab5ab60b2f62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:03.652040 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65adbe47-e9e3-49c2-b79b-ab5ab60b2f62 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:03.707170 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2195/4376] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:55:03 2022] POST /identity/v3/projects => generated 361 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:03.711949 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007634f9-5b5a-437f-ac67-1766a8fcdb84 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:03.722519 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007634f9-5b5a-437f-ac67-1766a8fcdb84 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:03.816684 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325bc4a-25dd-44ab-8b68-830852253636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:03.817541 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325bc4a-25dd-44ab-8b68-830852253636 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:03.818000 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325bc4a-25dd-44ab-8b68-830852253636 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:03.818275 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325bc4a-25dd-44ab-8b68-830852253636 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:03.819826 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b325bc4a-25dd-44ab-8b68-830852253636 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:03.821821 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b325bc4a-25dd-44ab-8b68-830852253636 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:03.847840 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2182/4377] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:55:03 2022] POST /identity/v3/users => generated 281 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:03.851728 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65adbe47-e9e3-49c2-b79b-ab5ab60b2f62 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:03.862536 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65adbe47-e9e3-49c2-b79b-ab5ab60b2f62 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:03.868111 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7796cb-61b6-4645-a7ea-7c7acbb0c5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:03.868816 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7796cb-61b6-4645-a7ea-7c7acbb0c5db admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:03.869197 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7796cb-61b6-4645-a7ea-7c7acbb0c5db admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:03.869550 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7796cb-61b6-4645-a7ea-7c7acbb0c5db admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:03.870387 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7796cb-61b6-4645-a7ea-7c7acbb0c5db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:03.872122 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7796cb-61b6-4645-a7ea-7c7acbb0c5db admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:03.885027 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2196/4378] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:03.888214 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325bc4a-25dd-44ab-8b68-830852253636 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:03.900272 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325bc4a-25dd-44ab-8b68-830852253636 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:03.906293 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda6c6ff-a890-4be2-882a-36c07207a278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:03.906920 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6c6ff-a890-4be2-882a-36c07207a278 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:03.907359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6c6ff-a890-4be2-882a-36c07207a278 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:03.907636 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6c6ff-a890-4be2-882a-36c07207a278 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:03.908295 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda6c6ff-a890-4be2-882a-36c07207a278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:03.909908 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda6c6ff-a890-4be2-882a-36c07207a278 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:03.927574 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2183/4379] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:55:03.942711 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7796cb-61b6-4645-a7ea-7c7acbb0c5db admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:03.968201 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7796cb-61b6-4645-a7ea-7c7acbb0c5db admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:03.980013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74cfd17-e831-4e61-872f-765e675a2481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:03.980839 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74cfd17-e831-4e61-872f-765e675a2481 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:03.983153 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74cfd17-e831-4e61-872f-765e675a2481 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:03.983529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74cfd17-e831-4e61-872f-765e675a2481 admin admin] PATH_INFO: `/v3/projects/9ca8907c5d974aaba0dce4eee63e1984/users/0edd0924049f4e859670dabdd0bfe597/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:03.988279 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:04.017127 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74cfd17-e831-4e61-872f-765e675a2481 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ca8907c5d974aaba0dce4eee63e1984, user_id=0edd0924049f4e859670dabdd0bfe597, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:04.020120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74cfd17-e831-4e61-872f-765e675a2481 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:04.065118 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2197/4380] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:55:03 2022] PUT /identity/v3/projects/9ca8907c5d974aaba0dce4eee63e1984/users/0edd0924049f4e859670dabdd0bfe597/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:04.066981 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fde89f-76c3-4ad1-9217-5039b9751a51 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:04.067347 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fde89f-76c3-4ad1-9217-5039b9751a51 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:04.068366 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fde89f-76c3-4ad1-9217-5039b9751a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:04.106240 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-12fde89f-76c3-4ad1-9217-5039b9751a51 None None] MFA Rules not processed for user `0edd0924049f4e859670dabdd0bfe597`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:04.108453 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-12fde89f-76c3-4ad1-9217-5039b9751a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:04.261197 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2184/4381] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:55:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:55:04.270922 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74cfd17-e831-4e61-872f-765e675a2481 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:04.273885 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e74cfd17-e831-4e61-872f-765e675a2481 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:04.386768 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74cfd17-e831-4e61-872f-765e675a2481 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:04.390793 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a8dd5-100f-4ae1-80a5-b730c85acb49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:04.391598 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a8dd5-100f-4ae1-80a5-b730c85acb49 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:04.391980 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a8dd5-100f-4ae1-80a5-b730c85acb49 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:04.392314 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a8dd5-100f-4ae1-80a5-b730c85acb49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:04.415774 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a8dd5-100f-4ae1-80a5-b730c85acb49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:04.417561 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a8dd5-100f-4ae1-80a5-b730c85acb49 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:04.435226 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2198/4382] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:55:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:55:13.786739 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268d1a9-929a-4b3a-a299-638dacd99d1b None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:13.787716 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268d1a9-929a-4b3a-a299-638dacd99d1b None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:13.789073 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268d1a9-929a-4b3a-a299-638dacd99d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:13.804508 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a8dd5-100f-4ae1-80a5-b730c85acb49 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:13.806991 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-184a8dd5-100f-4ae1-80a5-b730c85acb49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:13.845410 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-d268d1a9-929a-4b3a-a299-638dacd99d1b None None] MFA Rules not processed for user `8efa4be1bf974daf84fc5f64b4ca3155`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:13.846742 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d268d1a9-929a-4b3a-a299-638dacd99d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:13.891121 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:13.910196 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a8dd5-100f-4ae1-80a5-b730c85acb49 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:13.916228 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c275929-cd9b-4236-9636-92ac3daa27ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:13.917041 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c275929-cd9b-4236-9636-92ac3daa27ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:13.917493 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c275929-cd9b-4236-9636-92ac3daa27ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:13.917965 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c275929-cd9b-4236-9636-92ac3daa27ea admin admin] PATH_INFO: `/v3/users/ecab6c31850d45dca4708740f8640024` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:13.919494 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c275929-cd9b-4236-9636-92ac3daa27ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecab6c31850d45dca4708740f8640024)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:13.922003 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c275929-cd9b-4236-9636-92ac3daa27ea admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:13.938951 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2185/4383] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:55:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:14.000454 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8c275929-cd9b-4236-9636-92ac3daa27ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecab6c31850d45dca4708740f8640024'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:14.001188 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8c275929-cd9b-4236-9636-92ac3daa27ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecab6c31850d45dca4708740f8640024'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:14.024283 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8c275929-cd9b-4236-9636-92ac3daa27ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecab6c31850d45dca4708740f8640024'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:14.042328 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8c275929-cd9b-4236-9636-92ac3daa27ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecab6c31850d45dca4708740f8640024'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:14.052185 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8c275929-cd9b-4236-9636-92ac3daa27ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecab6c31850d45dca4708740f8640024'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:14.064092 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2199/4384] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:55:13 2022] DELETE /identity/v3/users/ecab6c31850d45dca4708740f8640024 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:14.068360 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069dacb-5c01-42af-a553-1e3c0fd2d3cd None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:14.069606 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069dacb-5c01-42af-a553-1e3c0fd2d3cd None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:14.070335 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069dacb-5c01-42af-a553-1e3c0fd2d3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:14.101388 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-4069dacb-5c01-42af-a553-1e3c0fd2d3cd None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:14.110372 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4069dacb-5c01-42af-a553-1e3c0fd2d3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:14.269978 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2186/4385] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:55:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:55:14.306425 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c275929-cd9b-4236-9636-92ac3daa27ea admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:14.310596 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8c275929-cd9b-4236-9636-92ac3daa27ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:14.341549 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:14.454768 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c275929-cd9b-4236-9636-92ac3daa27ea admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:14.460169 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1723e-f0a1-4b6f-9715-50533c210388 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:14.460978 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1723e-f0a1-4b6f-9715-50533c210388 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:14.461356 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1723e-f0a1-4b6f-9715-50533c210388 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:14.462471 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1723e-f0a1-4b6f-9715-50533c210388 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:14.480527 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a1723e-f0a1-4b6f-9715-50533c210388 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:14.482473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a1723e-f0a1-4b6f-9715-50533c210388 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:14.498919 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2200/4386] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:55:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:55:15.515249 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4069dacb-5c01-42af-a553-1e3c0fd2d3cd None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:15.518025 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4069dacb-5c01-42af-a553-1e3c0fd2d3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:15.627069 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4069dacb-5c01-42af-a553-1e3c0fd2d3cd None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:15.684706 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf92ab-a656-4526-87e3-a78be48a61c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:15.707301 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf92ab-a656-4526-87e3-a78be48a61c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:15.708767 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf92ab-a656-4526-87e3-a78be48a61c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:15.709067 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf92ab-a656-4526-87e3-a78be48a61c5 admin admin] PATH_INFO: `/v3/projects/816e80fa0569433fbcaab1bc651d85ab` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:15.717165 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cf92ab-a656-4526-87e3-a78be48a61c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=816e80fa0569433fbcaab1bc651d85ab)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:15.729452 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cf92ab-a656-4526-87e3-a78be48a61c5 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:15.927943 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-82cf92ab-a656-4526-87e3-a78be48a61c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '816e80fa0569433fbcaab1bc651d85ab', 'request_id': 'req-82cf92ab-a656-4526-87e3-a78be48a61c5'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:15.963569 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-82cf92ab-a656-4526-87e3-a78be48a61c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '816e80fa0569433fbcaab1bc651d85ab', 'request_id': 'req-82cf92ab-a656-4526-87e3-a78be48a61c5'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:15.985331 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-82cf92ab-a656-4526-87e3-a78be48a61c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '816e80fa0569433fbcaab1bc651d85ab', 'request_id': 'req-82cf92ab-a656-4526-87e3-a78be48a61c5'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:16.085035 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-82cf92ab-a656-4526-87e3-a78be48a61c5 admin admin] The token cache is being invalidate because project 816e80fa0569433fbcaab1bc651d85ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:55:16.093926 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-82cf92ab-a656-4526-87e3-a78be48a61c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:16.095484 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-82cf92ab-a656-4526-87e3-a78be48a61c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:16.116722 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2187/4387] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:55:15 2022] DELETE /identity/v3/projects/816e80fa0569433fbcaab1bc651d85ab => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:16.119592 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212b502-e93d-4bd2-82ad-cc8ea348a97b None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:16.120092 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212b502-e93d-4bd2-82ad-cc8ea348a97b None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:16.120823 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212b502-e93d-4bd2-82ad-cc8ea348a97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:16.188841 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-e212b502-e93d-4bd2-82ad-cc8ea348a97b None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:16.205088 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e212b502-e93d-4bd2-82ad-cc8ea348a97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:16.348222 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2201/4388] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:55:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:55:16.348348 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e13f9-348b-4729-aab6-c2a3f9da9377 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:16.348712 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e13f9-348b-4729-aab6-c2a3f9da9377 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:16.349047 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e13f9-348b-4729-aab6-c2a3f9da9377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:16.427950 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-6e6e13f9-348b-4729-aab6-c2a3f9da9377 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:16.433519 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6e6e13f9-348b-4729-aab6-c2a3f9da9377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:16.459980 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2188/4389] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:55:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:16.471301 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212b502-e93d-4bd2-82ad-cc8ea348a97b None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:16.492889 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212b502-e93d-4bd2-82ad-cc8ea348a97b None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:16.517878 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9514d7-3fd2-48bd-9a84-4912975b4d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:16.521179 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9514d7-3fd2-48bd-9a84-4912975b4d44 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:16.522929 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9514d7-3fd2-48bd-9a84-4912975b4d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:16.523760 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9514d7-3fd2-48bd-9a84-4912975b4d44 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:16.525716 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9514d7-3fd2-48bd-9a84-4912975b4d44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:55:16.528058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9514d7-3fd2-48bd-9a84-4912975b4d44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:16.535332 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9514d7-3fd2-48bd-9a84-4912975b4d44 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:16.573639 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2202/4390] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:55:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:55:16.582488 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e13f9-348b-4729-aab6-c2a3f9da9377 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:16.598040 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e13f9-348b-4729-aab6-c2a3f9da9377 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:16.608420 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9d5b5-fb6c-429b-b4a7-dc7d9392567e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:16.609276 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9d5b5-fb6c-429b-b4a7-dc7d9392567e admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:16.612876 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9d5b5-fb6c-429b-b4a7-dc7d9392567e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:16.614014 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9d5b5-fb6c-429b-b4a7-dc7d9392567e admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:16.614907 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca9d5b5-fb6c-429b-b4a7-dc7d9392567e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:16.620484 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca9d5b5-fb6c-429b-b4a7-dc7d9392567e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:16.681806 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2189/4391] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:55:16 2022] POST /identity/v3/projects => generated 401 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:16.687371 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9514d7-3fd2-48bd-9a84-4912975b4d44 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:16.712229 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9514d7-3fd2-48bd-9a84-4912975b4d44 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:16.933436 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0f81e-7128-40e7-aa9a-49eb864e99c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:16.934073 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0f81e-7128-40e7-aa9a-49eb864e99c2 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:16.934354 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0f81e-7128-40e7-aa9a-49eb864e99c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:16.934631 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0f81e-7128-40e7-aa9a-49eb864e99c2 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:16.935319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b0f81e-7128-40e7-aa9a-49eb864e99c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:16.942414 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b0f81e-7128-40e7-aa9a-49eb864e99c2 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:17.006372 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2203/4392] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:55:16 2022] POST /identity/v3/users => generated 301 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:17.007962 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9d5b5-fb6c-429b-b4a7-dc7d9392567e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:17.045984 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9d5b5-fb6c-429b-b4a7-dc7d9392567e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:17.050871 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033853aa-cd3a-43b2-a141-39e084162e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:17.051738 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033853aa-cd3a-43b2-a141-39e084162e8e admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:17.052190 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033853aa-cd3a-43b2-a141-39e084162e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:17.052627 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033853aa-cd3a-43b2-a141-39e084162e8e admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:17.054867 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033853aa-cd3a-43b2-a141-39e084162e8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:17.056786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033853aa-cd3a-43b2-a141-39e084162e8e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:17.087414 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2190/4393] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:17.091451 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0f81e-7128-40e7-aa9a-49eb864e99c2 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:17.112334 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0f81e-7128-40e7-aa9a-49eb864e99c2 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:17.127855 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f3b9c-73f0-43eb-9c5b-c7614ca3fe32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:17.128469 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f3b9c-73f0-43eb-9c5b-c7614ca3fe32 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:17.132953 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f3b9c-73f0-43eb-9c5b-c7614ca3fe32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:17.133363 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f3b9c-73f0-43eb-9c5b-c7614ca3fe32 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:17.134082 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f3b9c-73f0-43eb-9c5b-c7614ca3fe32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:17.137460 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f3b9c-73f0-43eb-9c5b-c7614ca3fe32 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:17.169893 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2204/4394] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:17.170556 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033853aa-cd3a-43b2-a141-39e084162e8e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:17.198828 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033853aa-cd3a-43b2-a141-39e084162e8e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:17.225563 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5fd62d-c161-448f-bfc7-3bebbf5857b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:17.230752 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5fd62d-c161-448f-bfc7-3bebbf5857b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:17.230752 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5fd62d-c161-448f-bfc7-3bebbf5857b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:17.231375 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5fd62d-c161-448f-bfc7-3bebbf5857b8 admin admin] PATH_INFO: `/v3/projects/edb56bdb238841898899834ecd9441c1/users/078a87b57a134d91ad74adf6790ca231/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:17.297746 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5fd62d-c161-448f-bfc7-3bebbf5857b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edb56bdb238841898899834ecd9441c1, user_id=078a87b57a134d91ad74adf6790ca231, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:17.302416 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5fd62d-c161-448f-bfc7-3bebbf5857b8 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:17.329645 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:17.339444 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2191/4395] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:55:17 2022] PUT /identity/v3/projects/edb56bdb238841898899834ecd9441c1/users/078a87b57a134d91ad74adf6790ca231/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:17.351499 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064e829-42f3-42de-aae2-f29070cc1ee3 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:17.351956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064e829-42f3-42de-aae2-f29070cc1ee3 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:17.352359 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064e829-42f3-42de-aae2-f29070cc1ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:17.416557 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:17.435356 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-c064e829-42f3-42de-aae2-f29070cc1ee3 None None] MFA Rules not processed for user `078a87b57a134d91ad74adf6790ca231`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:17.440437 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c064e829-42f3-42de-aae2-f29070cc1ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:17.598659 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2205/4396] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:55:17 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:17.613492 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5fd62d-c161-448f-bfc7-3bebbf5857b8 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:17.738635 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5fd62d-c161-448f-bfc7-3bebbf5857b8 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:17.757203 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6a5ab-4d37-485b-a8ba-2734dfcc7293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:17.757885 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6a5ab-4d37-485b-a8ba-2734dfcc7293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:17.758330 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6a5ab-4d37-485b-a8ba-2734dfcc7293 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:17.758750 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6a5ab-4d37-485b-a8ba-2734dfcc7293 admin admin] PATH_INFO: `/v3/users/078a87b57a134d91ad74adf6790ca231` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:17.760246 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b6a5ab-4d37-485b-a8ba-2734dfcc7293 admin admin] RBAC: Authorizing `identity:delete_user(user_id=078a87b57a134d91ad74adf6790ca231)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:17.762988 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b6a5ab-4d37-485b-a8ba-2734dfcc7293 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:17.858472 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-62b6a5ab-4d37-485b-a8ba-2734dfcc7293 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '078a87b57a134d91ad74adf6790ca231'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:17.860896 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-62b6a5ab-4d37-485b-a8ba-2734dfcc7293 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '078a87b57a134d91ad74adf6790ca231'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:17.882444 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-62b6a5ab-4d37-485b-a8ba-2734dfcc7293 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '078a87b57a134d91ad74adf6790ca231'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:17.911544 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-62b6a5ab-4d37-485b-a8ba-2734dfcc7293 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '078a87b57a134d91ad74adf6790ca231'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:17.912969 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-62b6a5ab-4d37-485b-a8ba-2734dfcc7293 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '078a87b57a134d91ad74adf6790ca231'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:17.962230 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2192/4397] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:55:17 2022] DELETE /identity/v3/users/078a87b57a134d91ad74adf6790ca231 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:17.964334 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b66c35-c6c3-4442-b2ed-f0163c3f4017 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:17.965114 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b66c35-c6c3-4442-b2ed-f0163c3f4017 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:17.965501 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b66c35-c6c3-4442-b2ed-f0163c3f4017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:18.003437 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-b2b66c35-c6c3-4442-b2ed-f0163c3f4017 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:18.010257 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b2b66c35-c6c3-4442-b2ed-f0163c3f4017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:18.161382 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2206/4398] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:55:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:18.208774 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6a5ab-4d37-485b-a8ba-2734dfcc7293 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:18.211662 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-62b6a5ab-4d37-485b-a8ba-2734dfcc7293 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:18.283555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1cbd4a-0926-4d76-a2b0-17cf33030897 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:18.283907 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1cbd4a-0926-4d76-a2b0-17cf33030897 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:18.284125 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1cbd4a-0926-4d76-a2b0-17cf33030897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:18.330291 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-5f1cbd4a-0926-4d76-a2b0-17cf33030897 None None] MFA Rules not processed for user `8efa4be1bf974daf84fc5f64b4ca3155`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:18.335158 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5f1cbd4a-0926-4d76-a2b0-17cf33030897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:18.344746 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6a5ab-4d37-485b-a8ba-2734dfcc7293 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:18.349570 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad66450-6b33-4bd5-aeb2-1da404bb8a1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:18.351235 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad66450-6b33-4bd5-aeb2-1da404bb8a1c service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:18.351693 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad66450-6b33-4bd5-aeb2-1da404bb8a1c service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:18.352065 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad66450-6b33-4bd5-aeb2-1da404bb8a1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:18.374185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad66450-6b33-4bd5-aeb2-1da404bb8a1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:18.375927 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad66450-6b33-4bd5-aeb2-1da404bb8a1c service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:18.387755 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2193/4399] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:55:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:55:18.442528 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2207/4400] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:55:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:19.432690 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad66450-6b33-4bd5-aeb2-1da404bb8a1c service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:19.434931 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5ad66450-6b33-4bd5-aeb2-1da404bb8a1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:19.451639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad66450-6b33-4bd5-aeb2-1da404bb8a1c service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:19.471742 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a016507-b6d9-416c-a5e2-5e763f19c50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:19.473284 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a016507-b6d9-416c-a5e2-5e763f19c50d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:19.473584 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a016507-b6d9-416c-a5e2-5e763f19c50d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:19.474445 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a016507-b6d9-416c-a5e2-5e763f19c50d admin admin] PATH_INFO: `/v3/projects/edb56bdb238841898899834ecd9441c1` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:19.476677 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a016507-b6d9-416c-a5e2-5e763f19c50d admin admin] RBAC: Authorizing `identity:delete_project(project_id=edb56bdb238841898899834ecd9441c1)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:19.478625 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a016507-b6d9-416c-a5e2-5e763f19c50d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:19.498896 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:19.535315 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3a016507-b6d9-416c-a5e2-5e763f19c50d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edb56bdb238841898899834ecd9441c1', 'request_id': 'req-3a016507-b6d9-416c-a5e2-5e763f19c50d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:19.541904 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3a016507-b6d9-416c-a5e2-5e763f19c50d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edb56bdb238841898899834ecd9441c1', 'request_id': 'req-3a016507-b6d9-416c-a5e2-5e763f19c50d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:19.549220 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3a016507-b6d9-416c-a5e2-5e763f19c50d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edb56bdb238841898899834ecd9441c1', 'request_id': 'req-3a016507-b6d9-416c-a5e2-5e763f19c50d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:19.567272 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3a016507-b6d9-416c-a5e2-5e763f19c50d admin admin] The token cache is being invalidate because project edb56bdb238841898899834ecd9441c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:55:19.567563 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3a016507-b6d9-416c-a5e2-5e763f19c50d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:19.568310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3a016507-b6d9-416c-a5e2-5e763f19c50d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:19.570492 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2194/4401] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:55:19 2022] DELETE /identity/v3/projects/edb56bdb238841898899834ecd9441c1 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:19.576009 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f452109-b30f-4740-9495-d2e595ab8a0c None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:19.576467 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f452109-b30f-4740-9495-d2e595ab8a0c None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:19.576732 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f452109-b30f-4740-9495-d2e595ab8a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:19.597445 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-5f452109-b30f-4740-9495-d2e595ab8a0c None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:19.598689 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5f452109-b30f-4740-9495-d2e595ab8a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:19.648603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:19.666147 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2208/4402] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:19.675326 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13243451-d494-4812-8742-fdcd62e0a579 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:19.675549 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13243451-d494-4812-8742-fdcd62e0a579 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:19.675818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13243451-d494-4812-8742-fdcd62e0a579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:19.698934 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-13243451-d494-4812-8742-fdcd62e0a579 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:19.700183 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-13243451-d494-4812-8742-fdcd62e0a579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:19.708808 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2195/4403] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:19.713999 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f452109-b30f-4740-9495-d2e595ab8a0c None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:19.724372 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f452109-b30f-4740-9495-d2e595ab8a0c None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:19.729667 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0ab63-56e8-4571-ba66-7a18558e744a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:19.730410 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0ab63-56e8-4571-ba66-7a18558e744a admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:19.730749 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0ab63-56e8-4571-ba66-7a18558e744a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:19.731114 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0ab63-56e8-4571-ba66-7a18558e744a admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:19.732926 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc0ab63-56e8-4571-ba66-7a18558e744a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:55:19.732926 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc0ab63-56e8-4571-ba66-7a18558e744a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:19.733864 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc0ab63-56e8-4571-ba66-7a18558e744a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:19.749805 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2209/4404] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:55:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:55:19.750993 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13243451-d494-4812-8742-fdcd62e0a579 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:19.762513 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13243451-d494-4812-8742-fdcd62e0a579 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:19.767348 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b955e0-be2f-4e09-ab41-166d413f6c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:19.768252 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b955e0-be2f-4e09-ab41-166d413f6c49 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:19.768540 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b955e0-be2f-4e09-ab41-166d413f6c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:19.768808 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b955e0-be2f-4e09-ab41-166d413f6c49 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:19.769595 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b955e0-be2f-4e09-ab41-166d413f6c49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:19.771370 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b955e0-be2f-4e09-ab41-166d413f6c49 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:19.805994 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2196/4405] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:55:19 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:19.810487 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0ab63-56e8-4571-ba66-7a18558e744a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:19.825591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0ab63-56e8-4571-ba66-7a18558e744a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:19.899901 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd8a98-5a40-4469-a524-37452d14ae6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:19.900597 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd8a98-5a40-4469-a524-37452d14ae6a admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:19.900959 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd8a98-5a40-4469-a524-37452d14ae6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:19.901441 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd8a98-5a40-4469-a524-37452d14ae6a admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:19.902156 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dd8a98-5a40-4469-a524-37452d14ae6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:19.904192 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dd8a98-5a40-4469-a524-37452d14ae6a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:19.932190 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2210/4406] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:55:19 2022] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:19.933505 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b955e0-be2f-4e09-ab41-166d413f6c49 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:19.945796 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b955e0-be2f-4e09-ab41-166d413f6c49 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:19.951307 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1474e843-0888-4210-9ddd-dfcb79fa0261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:19.951835 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474e843-0888-4210-9ddd-dfcb79fa0261 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:19.952148 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474e843-0888-4210-9ddd-dfcb79fa0261 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:19.952363 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474e843-0888-4210-9ddd-dfcb79fa0261 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:19.953011 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1474e843-0888-4210-9ddd-dfcb79fa0261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:19.954776 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1474e843-0888-4210-9ddd-dfcb79fa0261 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:19.967823 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2197/4407] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:55:19.971804 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd8a98-5a40-4469-a524-37452d14ae6a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:19.985255 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd8a98-5a40-4469-a524-37452d14ae6a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:19.995495 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51cfacb-31e4-4061-9086-7d70ce7b386b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:19.996707 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51cfacb-31e4-4061-9086-7d70ce7b386b admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:19.997202 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51cfacb-31e4-4061-9086-7d70ce7b386b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:19.997702 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51cfacb-31e4-4061-9086-7d70ce7b386b admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:19.998974 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51cfacb-31e4-4061-9086-7d70ce7b386b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:20.001876 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51cfacb-31e4-4061-9086-7d70ce7b386b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:20.022833 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2211/4408] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:20.025647 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1474e843-0888-4210-9ddd-dfcb79fa0261 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:20.052790 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1474e843-0888-4210-9ddd-dfcb79fa0261 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:20.076222 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc49ff8-6123-483e-8f7a-38f1492fb41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:20.077664 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc49ff8-6123-483e-8f7a-38f1492fb41a admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:20.077944 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc49ff8-6123-483e-8f7a-38f1492fb41a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:20.078212 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc49ff8-6123-483e-8f7a-38f1492fb41a admin admin] PATH_INFO: `/v3/projects/b585ff61700d433e8b6c74e059537135/users/c1c8b71252e84112bb1fd0513cf49f69/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:20.096511 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc49ff8-6123-483e-8f7a-38f1492fb41a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b585ff61700d433e8b6c74e059537135, user_id=c1c8b71252e84112bb1fd0513cf49f69, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:20.099331 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc49ff8-6123-483e-8f7a-38f1492fb41a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:20.129579 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2198/4409] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:55:20 2022] PUT /identity/v3/projects/b585ff61700d433e8b6c74e059537135/users/c1c8b71252e84112bb1fd0513cf49f69/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:20.132039 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dff6e8-da8c-4e53-945e-3497c175f861 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:20.132390 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dff6e8-da8c-4e53-945e-3497c175f861 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:20.133092 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dff6e8-da8c-4e53-945e-3497c175f861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:20.201304 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-23dff6e8-da8c-4e53-945e-3497c175f861 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:20.202693 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-23dff6e8-da8c-4e53-945e-3497c175f861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:20.346188 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2212/4410] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:55:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:20.352025 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc49ff8-6123-483e-8f7a-38f1492fb41a admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:20.354824 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1fc49ff8-6123-483e-8f7a-38f1492fb41a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:20.437246 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc49ff8-6123-483e-8f7a-38f1492fb41a admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:20.442911 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4b41cb-31c9-49c0-9a45-75707ed67971 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:20.442911 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b41cb-31c9-49c0-9a45-75707ed67971 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:20.442911 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b41cb-31c9-49c0-9a45-75707ed67971 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:20.442911 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b41cb-31c9-49c0-9a45-75707ed67971 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:20.456708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4b41cb-31c9-49c0-9a45-75707ed67971 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:20.458902 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4b41cb-31c9-49c0-9a45-75707ed67971 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:20.483210 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2199/4411] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:55:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:55:21.392828 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403f0b0-a413-4123-8843-8a4467351e1f None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:21.393899 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403f0b0-a413-4123-8843-8a4467351e1f None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:21.394471 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403f0b0-a413-4123-8843-8a4467351e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:21.439742 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-0403f0b0-a413-4123-8843-8a4467351e1f None None] MFA Rules not processed for user `8efa4be1bf974daf84fc5f64b4ca3155`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:21.443758 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0403f0b0-a413-4123-8843-8a4467351e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:21.553477 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:21.568060 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2213/4412] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:55:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:22.432695 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09809e-d63e-4b3b-b6d4-edb7d49792fb None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:22.433282 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09809e-d63e-4b3b-b6d4-edb7d49792fb None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:22.433282 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09809e-d63e-4b3b-b6d4-edb7d49792fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:22.462608 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-2e09809e-d63e-4b3b-b6d4-edb7d49792fb None None] MFA Rules not processed for user `8efa4be1bf974daf84fc5f64b4ca3155`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:22.464473 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2e09809e-d63e-4b3b-b6d4-edb7d49792fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:22.474405 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2200/4413] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:55:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:23.918728 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9608ad-174c-4099-98e6-195de2c42534 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:23.919301 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9608ad-174c-4099-98e6-195de2c42534 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:23.919301 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9608ad-174c-4099-98e6-195de2c42534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:23.958256 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-ec9608ad-174c-4099-98e6-195de2c42534 None None] MFA Rules not processed for user `8efa4be1bf974daf84fc5f64b4ca3155`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:23.960898 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ec9608ad-174c-4099-98e6-195de2c42534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:23.981037 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2214/4414] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:55:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:25.404511 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef402eb-b832-49f2-9ee8-50d2bccf7d15 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:25.405625 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef402eb-b832-49f2-9ee8-50d2bccf7d15 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:25.407325 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef402eb-b832-49f2-9ee8-50d2bccf7d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:25.436670 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-aef402eb-b832-49f2-9ee8-50d2bccf7d15 None None] MFA Rules not processed for user `8efa4be1bf974daf84fc5f64b4ca3155`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:25.440095 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-aef402eb-b832-49f2-9ee8-50d2bccf7d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:25.500442 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2201/4415] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:55:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:26.901257 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf974b8e-f492-454f-accb-d90a17b3eb14 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:26.902133 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf974b8e-f492-454f-accb-d90a17b3eb14 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:26.902546 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf974b8e-f492-454f-accb-d90a17b3eb14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:26.951356 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-cf974b8e-f492-454f-accb-d90a17b3eb14 None None] MFA Rules not processed for user `8efa4be1bf974daf84fc5f64b4ca3155`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:26.953198 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-cf974b8e-f492-454f-accb-d90a17b3eb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:26.981944 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2215/4416] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:55:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:28.192356 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef402eb-b832-49f2-9ee8-50d2bccf7d15 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:28.195179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-aef402eb-b832-49f2-9ee8-50d2bccf7d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:28.220763 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef402eb-b832-49f2-9ee8-50d2bccf7d15 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:28.226438 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c1eab-97ca-4b56-9feb-8bc730d15d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:28.228209 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c1eab-97ca-4b56-9feb-8bc730d15d9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:28.228762 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c1eab-97ca-4b56-9feb-8bc730d15d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:28.229358 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c1eab-97ca-4b56-9feb-8bc730d15d9e admin admin] PATH_INFO: `/v3/users/9dda72ff55b246cea4bf5bc5e1e87c5f` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:28.231968 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c1eab-97ca-4b56-9feb-8bc730d15d9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dda72ff55b246cea4bf5bc5e1e87c5f)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:28.235508 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c1eab-97ca-4b56-9feb-8bc730d15d9e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:28.338397 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:28.377767 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-392c1eab-97ca-4b56-9feb-8bc730d15d9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dda72ff55b246cea4bf5bc5e1e87c5f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:28.378470 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-392c1eab-97ca-4b56-9feb-8bc730d15d9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dda72ff55b246cea4bf5bc5e1e87c5f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:28.391390 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-392c1eab-97ca-4b56-9feb-8bc730d15d9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dda72ff55b246cea4bf5bc5e1e87c5f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:28.431714 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-392c1eab-97ca-4b56-9feb-8bc730d15d9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dda72ff55b246cea4bf5bc5e1e87c5f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:28.433434 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-392c1eab-97ca-4b56-9feb-8bc730d15d9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dda72ff55b246cea4bf5bc5e1e87c5f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:28.494539 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2202/4417] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:55:28 2022] DELETE /identity/v3/users/9dda72ff55b246cea4bf5bc5e1e87c5f => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:28.785557 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70212ce0-0f4f-4223-ad17-c6126d7e6ee2 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:28.785986 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70212ce0-0f4f-4223-ad17-c6126d7e6ee2 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:28.786092 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70212ce0-0f4f-4223-ad17-c6126d7e6ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:28.824728 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-70212ce0-0f4f-4223-ad17-c6126d7e6ee2 None None] MFA Rules not processed for user `8efa4be1bf974daf84fc5f64b4ca3155`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:28.826137 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-70212ce0-0f4f-4223-ad17-c6126d7e6ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:29.008924 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2216/4418] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:55:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:29.340586 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c1eab-97ca-4b56-9feb-8bc730d15d9e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:29.349131 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-392c1eab-97ca-4b56-9feb-8bc730d15d9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:29.672106 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c1eab-97ca-4b56-9feb-8bc730d15d9e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:29.677269 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60faed48-3f00-4ae8-b735-53acea1e5d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:29.678641 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60faed48-3f00-4ae8-b735-53acea1e5d91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:29.679213 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60faed48-3f00-4ae8-b735-53acea1e5d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:29.679816 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60faed48-3f00-4ae8-b735-53acea1e5d91 admin admin] PATH_INFO: `/v3/projects/d3085a72d4a644a2bfcc0109f0743127` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:29.681813 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60faed48-3f00-4ae8-b735-53acea1e5d91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3085a72d4a644a2bfcc0109f0743127)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:29.684354 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60faed48-3f00-4ae8-b735-53acea1e5d91 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:29.791696 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-60faed48-3f00-4ae8-b735-53acea1e5d91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3085a72d4a644a2bfcc0109f0743127', 'request_id': 'req-60faed48-3f00-4ae8-b735-53acea1e5d91'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:29.802023 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-60faed48-3f00-4ae8-b735-53acea1e5d91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3085a72d4a644a2bfcc0109f0743127', 'request_id': 'req-60faed48-3f00-4ae8-b735-53acea1e5d91'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:29.817605 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-60faed48-3f00-4ae8-b735-53acea1e5d91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3085a72d4a644a2bfcc0109f0743127', 'request_id': 'req-60faed48-3f00-4ae8-b735-53acea1e5d91'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:29.843408 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-60faed48-3f00-4ae8-b735-53acea1e5d91 admin admin] The token cache is being invalidate because project d3085a72d4a644a2bfcc0109f0743127 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:55:29.844100 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-60faed48-3f00-4ae8-b735-53acea1e5d91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:29.845131 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-60faed48-3f00-4ae8-b735-53acea1e5d91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:29.847428 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2203/4419] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:55:29 2022] DELETE /identity/v3/projects/d3085a72d4a644a2bfcc0109f0743127 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:29.853268 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdbe1d-95c1-4787-99d5-21e87a8a3abf None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:29.854544 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdbe1d-95c1-4787-99d5-21e87a8a3abf None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:29.855040 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdbe1d-95c1-4787-99d5-21e87a8a3abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:29.885987 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-f7fdbe1d-95c1-4787-99d5-21e87a8a3abf None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:29.887526 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f7fdbe1d-95c1-4787-99d5-21e87a8a3abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:29.973446 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2217/4420] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:55:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:55:29.982476 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c00d5b-8bc5-4742-9019-aafcc878e45c None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:29.982769 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c00d5b-8bc5-4742-9019-aafcc878e45c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:29.983068 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c00d5b-8bc5-4742-9019-aafcc878e45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:30.034213 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fdbe1d-95c1-4787-99d5-21e87a8a3abf None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:30.036136 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f7fdbe1d-95c1-4787-99d5-21e87a8a3abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:30.048947 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-66c00d5b-8bc5-4742-9019-aafcc878e45c None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:30.050195 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-66c00d5b-8bc5-4742-9019-aafcc878e45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:30.071962 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2204/4421] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:55:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:30.074374 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689fe90-7675-45d2-829a-942ead3ca496 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:30.074818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689fe90-7675-45d2-829a-942ead3ca496 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:30.077763 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689fe90-7675-45d2-829a-942ead3ca496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:30.116168 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-1689fe90-7675-45d2-829a-942ead3ca496 None None] MFA Rules not processed for user `8efa4be1bf974daf84fc5f64b4ca3155`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:30.117430 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1689fe90-7675-45d2-829a-942ead3ca496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:30.152422 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fdbe1d-95c1-4787-99d5-21e87a8a3abf None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:30.164960 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3c092-39dd-4465-8bc9-6ccc20bc6d9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:30.165685 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3c092-39dd-4465-8bc9-6ccc20bc6d9b service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:30.165970 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3c092-39dd-4465-8bc9-6ccc20bc6d9b service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:30.166243 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3c092-39dd-4465-8bc9-6ccc20bc6d9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:30.168387 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:30.173279 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8cc3c092-39dd-4465-8bc9-6ccc20bc6d9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:30.230122 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3c092-39dd-4465-8bc9-6ccc20bc6d9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:30.233166 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3c092-39dd-4465-8bc9-6ccc20bc6d9b service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:30.249756 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2205/4422] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:55:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:30.255050 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689fe90-7675-45d2-829a-942ead3ca496 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:30.261414 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2218/4423] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:55:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:55:30.286596 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689fe90-7675-45d2-829a-942ead3ca496 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:30.300468 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16cd50f-4388-43f3-8d43-1a40238e49ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:30.301122 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16cd50f-4388-43f3-8d43-1a40238e49ef admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:30.301402 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16cd50f-4388-43f3-8d43-1a40238e49ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:30.301760 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16cd50f-4388-43f3-8d43-1a40238e49ef admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:30.304343 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16cd50f-4388-43f3-8d43-1a40238e49ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:55:30.304677 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16cd50f-4388-43f3-8d43-1a40238e49ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:30.309330 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16cd50f-4388-43f3-8d43-1a40238e49ef admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:30.347430 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2206/4424] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:55:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:55:30.349391 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3c092-39dd-4465-8bc9-6ccc20bc6d9b service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:30.376341 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3c092-39dd-4465-8bc9-6ccc20bc6d9b service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:30.384702 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57507d05-e41e-4cc1-bc91-2b61f1005076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:30.385335 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57507d05-e41e-4cc1-bc91-2b61f1005076 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:30.385757 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57507d05-e41e-4cc1-bc91-2b61f1005076 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:30.385890 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57507d05-e41e-4cc1-bc91-2b61f1005076 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:30.386517 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57507d05-e41e-4cc1-bc91-2b61f1005076 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:30.388509 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57507d05-e41e-4cc1-bc91-2b61f1005076 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:30.456121 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2219/4425] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:55:30 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:30.461035 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16cd50f-4388-43f3-8d43-1a40238e49ef admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:30.482721 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16cd50f-4388-43f3-8d43-1a40238e49ef admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:30.611333 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b59522-5a15-4519-b430-b32a041b90ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:30.611979 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b59522-5a15-4519-b430-b32a041b90ba admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:30.612260 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b59522-5a15-4519-b430-b32a041b90ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:30.612535 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b59522-5a15-4519-b430-b32a041b90ba admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:30.613194 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b59522-5a15-4519-b430-b32a041b90ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:30.615210 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b59522-5a15-4519-b430-b32a041b90ba admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:30.674034 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2207/4426] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:55:30 2022] POST /identity/v3/users => generated 289 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:30.678474 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57507d05-e41e-4cc1-bc91-2b61f1005076 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:30.707736 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:30.797687 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57507d05-e41e-4cc1-bc91-2b61f1005076 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:30.808598 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e2595-1304-48c2-82a4-49f0628bf329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:30.809239 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e2595-1304-48c2-82a4-49f0628bf329 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:30.809522 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e2595-1304-48c2-82a4-49f0628bf329 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:30.809802 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e2595-1304-48c2-82a4-49f0628bf329 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:30.810465 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177e2595-1304-48c2-82a4-49f0628bf329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:30.812130 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177e2595-1304-48c2-82a4-49f0628bf329 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:30.832219 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2220/4427] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:30.836992 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b59522-5a15-4519-b430-b32a041b90ba admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:30.900926 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b59522-5a15-4519-b430-b32a041b90ba admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:30.914812 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed35d1b-9fc3-4f33-907d-cc9af5f058c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:30.915501 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed35d1b-9fc3-4f33-907d-cc9af5f058c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:30.915834 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed35d1b-9fc3-4f33-907d-cc9af5f058c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:30.917688 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed35d1b-9fc3-4f33-907d-cc9af5f058c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:30.918404 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed35d1b-9fc3-4f33-907d-cc9af5f058c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:30.920518 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed35d1b-9fc3-4f33-907d-cc9af5f058c9 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:30.939374 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2208/4428] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:30.943083 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e2595-1304-48c2-82a4-49f0628bf329 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:30.959968 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e2595-1304-48c2-82a4-49f0628bf329 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:30.967627 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798557d7-8531-4a71-b3e3-33839e1d6314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:30.969176 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798557d7-8531-4a71-b3e3-33839e1d6314 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:30.969674 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798557d7-8531-4a71-b3e3-33839e1d6314 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:30.970140 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798557d7-8531-4a71-b3e3-33839e1d6314 admin admin] PATH_INFO: `/v3/projects/32dcc4d8d4a44d24bce81642e49a84ab/users/2cd0536429dd4c47b296b9645b6e0c48/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:30.998292 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798557d7-8531-4a71-b3e3-33839e1d6314 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32dcc4d8d4a44d24bce81642e49a84ab, user_id=2cd0536429dd4c47b296b9645b6e0c48, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:31.005752 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798557d7-8531-4a71-b3e3-33839e1d6314 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:31.028026 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2221/4429] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:55:30 2022] PUT /identity/v3/projects/32dcc4d8d4a44d24bce81642e49a84ab/users/2cd0536429dd4c47b296b9645b6e0c48/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:31.033461 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17a0cd-12aa-468f-b8d0-f6f65dcbe9a2 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:31.034204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17a0cd-12aa-468f-b8d0-f6f65dcbe9a2 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:31.034770 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17a0cd-12aa-468f-b8d0-f6f65dcbe9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:31.062777 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-5a17a0cd-12aa-468f-b8d0-f6f65dcbe9a2 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:31.064494 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5a17a0cd-12aa-468f-b8d0-f6f65dcbe9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:31.184710 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2209/4430] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:55:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:31.217295 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798557d7-8531-4a71-b3e3-33839e1d6314 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:31.297476 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798557d7-8531-4a71-b3e3-33839e1d6314 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:31.301651 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df657d74-33ee-4efb-bd1a-374fb707c7cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:31.302290 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df657d74-33ee-4efb-bd1a-374fb707c7cb service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:31.302573 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df657d74-33ee-4efb-bd1a-374fb707c7cb service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:31.303626 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df657d74-33ee-4efb-bd1a-374fb707c7cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:31.314589 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df657d74-33ee-4efb-bd1a-374fb707c7cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:31.316103 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df657d74-33ee-4efb-bd1a-374fb707c7cb service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:31.328971 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2222/4431] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:55:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:55:32.721693 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4288c-c176-46fd-949f-6d5bec520231 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:32.722231 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4288c-c176-46fd-949f-6d5bec520231 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:32.722496 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4288c-c176-46fd-949f-6d5bec520231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:32.787992 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:32.802170 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-1da4288c-c176-46fd-949f-6d5bec520231 None None] MFA Rules not processed for user `c1c8b71252e84112bb1fd0513cf49f69`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:32.804211 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1da4288c-c176-46fd-949f-6d5bec520231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:32.971058 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2210/4432] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:55:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:33.010501 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9303ba2-61d5-4f4c-bb0f-e76fad0bdf1b None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:33.011500 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9303ba2-61d5-4f4c-bb0f-e76fad0bdf1b None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:33.012583 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9303ba2-61d5-4f4c-bb0f-e76fad0bdf1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:33.016261 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da4288c-c176-46fd-949f-6d5bec520231 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:33.017671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1da4288c-c176-46fd-949f-6d5bec520231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:33.039319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-f9303ba2-61d5-4f4c-bb0f-e76fad0bdf1b None None] MFA Rules not processed for user `8efa4be1bf974daf84fc5f64b4ca3155`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:33.040764 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f9303ba2-61d5-4f4c-bb0f-e76fad0bdf1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:33.154664 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2223/4433] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:55:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:33.187866 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da4288c-c176-46fd-949f-6d5bec520231 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:33.196814 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51cee30-d5c9-40fe-9e3c-de43cdcde63b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:33.199175 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cee30-d5c9-40fe-9e3c-de43cdcde63b service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:33.199459 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cee30-d5c9-40fe-9e3c-de43cdcde63b service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:33.200413 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cee30-d5c9-40fe-9e3c-de43cdcde63b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:33.222732 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51cee30-d5c9-40fe-9e3c-de43cdcde63b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:33.230914 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51cee30-d5c9-40fe-9e3c-de43cdcde63b service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:33.259059 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2211/4434] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:55:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:55:37.105956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70941ae-5976-4201-82b8-c62b74eb2ee3 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:37.106474 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70941ae-5976-4201-82b8-c62b74eb2ee3 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:37.106474 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70941ae-5976-4201-82b8-c62b74eb2ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:37.141256 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-b70941ae-5976-4201-82b8-c62b74eb2ee3 None None] MFA Rules not processed for user `c1c8b71252e84112bb1fd0513cf49f69`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:37.142421 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b70941ae-5976-4201-82b8-c62b74eb2ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:37.152467 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2224/4435] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:55:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:42.238265 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11c9ea-4896-4bb9-8021-a5fb6a378010 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:42.238736 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11c9ea-4896-4bb9-8021-a5fb6a378010 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:42.238810 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11c9ea-4896-4bb9-8021-a5fb6a378010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:42.278215 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-7a11c9ea-4896-4bb9-8021-a5fb6a378010 None None] MFA Rules not processed for user `8efa4be1bf974daf84fc5f64b4ca3155`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:42.279521 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7a11c9ea-4896-4bb9-8021-a5fb6a378010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:42.301823 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2212/4436] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:55:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:43.358134 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8041a1-7345-481d-80b7-79cff9cf29a6 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:43.358652 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8041a1-7345-481d-80b7-79cff9cf29a6 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:43.358756 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8041a1-7345-481d-80b7-79cff9cf29a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:43.418802 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-7b8041a1-7345-481d-80b7-79cff9cf29a6 None None] MFA Rules not processed for user `2cd0536429dd4c47b296b9645b6e0c48`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:43.420465 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7b8041a1-7345-481d-80b7-79cff9cf29a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:43.503591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:43.555444 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2225/4437] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:55:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:43.558526 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11c9ea-4896-4bb9-8021-a5fb6a378010 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:43.574838 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11c9ea-4896-4bb9-8021-a5fb6a378010 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:43.579812 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0b4ab9-177f-4e22-a9b1-14c6cd273938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:43.580806 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b4ab9-177f-4e22-a9b1-14c6cd273938 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:43.581097 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b4ab9-177f-4e22-a9b1-14c6cd273938 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:43.581370 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b4ab9-177f-4e22-a9b1-14c6cd273938 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:43.582064 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0b4ab9-177f-4e22-a9b1-14c6cd273938 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:43.598170 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0b4ab9-177f-4e22-a9b1-14c6cd273938 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:43.630612 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3825d66-ea9b-4da9-950a-c8836b1158a3 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:43.631995 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3825d66-ea9b-4da9-950a-c8836b1158a3 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:43.632448 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3825d66-ea9b-4da9-950a-c8836b1158a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:43.686919 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-f3825d66-ea9b-4da9-950a-c8836b1158a3 None None] MFA Rules not processed for user `8efa4be1bf974daf84fc5f64b4ca3155`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:43.690639 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f3825d66-ea9b-4da9-950a-c8836b1158a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:43.701474 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2213/4438] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:55:43 2022] POST /identity/v3/projects => generated 377 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:43.702602 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0b4ab9-177f-4e22-a9b1-14c6cd273938 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:43.840320 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2226/4439] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:55:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:43.862060 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:43.917613 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0b4ab9-177f-4e22-a9b1-14c6cd273938 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:43.943297 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044f6be-f688-476a-a150-f3f79487fef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:43.945752 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044f6be-f688-476a-a150-f3f79487fef6 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:43.961567 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044f6be-f688-476a-a150-f3f79487fef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:43.961906 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044f6be-f688-476a-a150-f3f79487fef6 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:43.962812 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e044f6be-f688-476a-a150-f3f79487fef6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:43.997314 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e044f6be-f688-476a-a150-f3f79487fef6 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:44.066568 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2214/4440] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:55:43 2022] POST /identity/v3/users => generated 295 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:44.073195 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3825d66-ea9b-4da9-950a-c8836b1158a3 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:44.103856 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3825d66-ea9b-4da9-950a-c8836b1158a3 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:44.123488 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414382b-dc47-41a1-ac88-ff2ad533e046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:44.124197 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414382b-dc47-41a1-ac88-ff2ad533e046 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:44.124482 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414382b-dc47-41a1-ac88-ff2ad533e046 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:44.124761 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414382b-dc47-41a1-ac88-ff2ad533e046 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:44.125429 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e414382b-dc47-41a1-ac88-ff2ad533e046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:44.128341 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e414382b-dc47-41a1-ac88-ff2ad533e046 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:44.170932 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2227/4441] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:44.175198 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044f6be-f688-476a-a150-f3f79487fef6 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:44.193462 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044f6be-f688-476a-a150-f3f79487fef6 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:44.210805 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff42c8-1dbc-44a8-b853-2b8665b290c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:44.211580 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff42c8-1dbc-44a8-b853-2b8665b290c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:44.211865 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff42c8-1dbc-44a8-b853-2b8665b290c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:44.212140 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff42c8-1dbc-44a8-b853-2b8665b290c9 admin admin] PATH_INFO: `/v3/projects/aba152541e384db68acce6f207e77c18/users/af578f0b19294a96a5ec3217f5643f66/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:44.235543 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ff42c8-1dbc-44a8-b853-2b8665b290c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aba152541e384db68acce6f207e77c18, user_id=af578f0b19294a96a5ec3217f5643f66, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:44.238283 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ff42c8-1dbc-44a8-b853-2b8665b290c9 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:44.262216 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2215/4442] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:55:44 2022] PUT /identity/v3/projects/aba152541e384db68acce6f207e77c18/users/af578f0b19294a96a5ec3217f5643f66/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:44.262736 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414382b-dc47-41a1-ac88-ff2ad533e046 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:44.281105 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414382b-dc47-41a1-ac88-ff2ad533e046 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:44.425504 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e17f93a-fd03-4683-9d16-6ed913462bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:44.426719 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e17f93a-fd03-4683-9d16-6ed913462bcd admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:44.427186 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e17f93a-fd03-4683-9d16-6ed913462bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:44.427612 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e17f93a-fd03-4683-9d16-6ed913462bcd admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:44.429664 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e17f93a-fd03-4683-9d16-6ed913462bcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:44.431805 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e17f93a-fd03-4683-9d16-6ed913462bcd admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:44.446657 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2228/4443] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:55:44.447961 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff42c8-1dbc-44a8-b853-2b8665b290c9 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:44.461876 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff42c8-1dbc-44a8-b853-2b8665b290c9 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:44.471556 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e56a0a-0861-49a7-9f6c-143c61972b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:44.472252 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e56a0a-0861-49a7-9f6c-143c61972b31 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:44.472533 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e56a0a-0861-49a7-9f6c-143c61972b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:44.472809 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e56a0a-0861-49a7-9f6c-143c61972b31 admin admin] PATH_INFO: `/v3/projects/aba152541e384db68acce6f207e77c18/users/af578f0b19294a96a5ec3217f5643f66/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:44.476054 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e56a0a-0861-49a7-9f6c-143c61972b31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aba152541e384db68acce6f207e77c18, user_id=af578f0b19294a96a5ec3217f5643f66, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:44.478760 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e56a0a-0861-49a7-9f6c-143c61972b31 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:44.513993 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2216/4444] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:55:44 2022] PUT /identity/v3/projects/aba152541e384db68acce6f207e77c18/users/af578f0b19294a96a5ec3217f5643f66/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:46.388152 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e17f93a-fd03-4683-9d16-6ed913462bcd admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:46.389948 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3e17f93a-fd03-4683-9d16-6ed913462bcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:46.536160 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:46.593083 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e17f93a-fd03-4683-9d16-6ed913462bcd admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:46.754597 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2c48c-6bca-48c4-97a4-e90d44c6fdff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:46.757072 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2c48c-6bca-48c4-97a4-e90d44c6fdff service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:46.757836 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2c48c-6bca-48c4-97a4-e90d44c6fdff service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:46.758500 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2c48c-6bca-48c4-97a4-e90d44c6fdff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:46.761958 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6ca2c48c-6bca-48c4-97a4-e90d44c6fdff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:46.783892 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca2c48c-6bca-48c4-97a4-e90d44c6fdff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:46.785902 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca2c48c-6bca-48c4-97a4-e90d44c6fdff service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:46.823062 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2229/4445] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:55:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:55:54.504911 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=24,keystone:INSERT=5 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:55.391372 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e56a0a-0861-49a7-9f6c-143c61972b31 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:55.394573 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b2e56a0a-0861-49a7-9f6c-143c61972b31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:55.594179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e56a0a-0861-49a7-9f6c-143c61972b31 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:55.624640 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5c315-23ca-4a08-888a-85c51fac6feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:55.625514 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5c315-23ca-4a08-888a-85c51fac6feb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:55.626392 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5c315-23ca-4a08-888a-85c51fac6feb admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:55.628779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5c315-23ca-4a08-888a-85c51fac6feb admin admin] PATH_INFO: `/v3/users/71e0809663664b319388bcc890b6fdec` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:55.630140 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab5c315-23ca-4a08-888a-85c51fac6feb admin admin] RBAC: Authorizing `identity:delete_user(user_id=71e0809663664b319388bcc890b6fdec)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:55.635130 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab5c315-23ca-4a08-888a-85c51fac6feb admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:55.764085 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2ab5c315-23ca-4a08-888a-85c51fac6feb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71e0809663664b319388bcc890b6fdec'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:55.764835 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2ab5c315-23ca-4a08-888a-85c51fac6feb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71e0809663664b319388bcc890b6fdec'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:55.789423 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2ab5c315-23ca-4a08-888a-85c51fac6feb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71e0809663664b319388bcc890b6fdec'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:55.802475 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2ab5c315-23ca-4a08-888a-85c51fac6feb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71e0809663664b319388bcc890b6fdec'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:55.803840 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2ab5c315-23ca-4a08-888a-85c51fac6feb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71e0809663664b319388bcc890b6fdec'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:55.848931 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2217/4446] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:55:55 2022] DELETE /identity/v3/users/71e0809663664b319388bcc890b6fdec => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:56.804173 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=33 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:56.912537 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2c48c-6bca-48c4-97a4-e90d44c6fdff service placement] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:56.924223 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2c48c-6bca-48c4-97a4-e90d44c6fdff service placement] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:57.032616 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703296e9-7c91-4e1a-a45a-830718aff91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:57.033556 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703296e9-7c91-4e1a-a45a-830718aff91f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:57.033910 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703296e9-7c91-4e1a-a45a-830718aff91f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:57.034262 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703296e9-7c91-4e1a-a45a-830718aff91f admin admin] PATH_INFO: `/v3/projects/bb7c04ac8b544f4c89e51cf927bf6e25` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:57.036482 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703296e9-7c91-4e1a-a45a-830718aff91f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb7c04ac8b544f4c89e51cf927bf6e25)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:57.039240 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703296e9-7c91-4e1a-a45a-830718aff91f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:57.112064 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-703296e9-7c91-4e1a-a45a-830718aff91f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'request_id': 'req-703296e9-7c91-4e1a-a45a-830718aff91f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:57.121279 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-703296e9-7c91-4e1a-a45a-830718aff91f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'request_id': 'req-703296e9-7c91-4e1a-a45a-830718aff91f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:57.172424 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-703296e9-7c91-4e1a-a45a-830718aff91f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'request_id': 'req-703296e9-7c91-4e1a-a45a-830718aff91f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:57.191667 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-703296e9-7c91-4e1a-a45a-830718aff91f admin admin] The token cache is being invalidate because project bb7c04ac8b544f4c89e51cf927bf6e25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:55:57.191804 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-703296e9-7c91-4e1a-a45a-830718aff91f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:57.195380 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-703296e9-7c91-4e1a-a45a-830718aff91f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:57.199711 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2230/4447] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:55:56 2022] DELETE /identity/v3/projects/bb7c04ac8b544f4c89e51cf927bf6e25 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:57.203535 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5c315-23ca-4a08-888a-85c51fac6feb admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:57.205099 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2ab5c315-23ca-4a08-888a-85c51fac6feb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:57.227309 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5c315-23ca-4a08-888a-85c51fac6feb admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:57.379590 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2158fe-55c6-4bba-8787-0a433a487af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:57.380793 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2158fe-55c6-4bba-8787-0a433a487af1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:57.381670 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2158fe-55c6-4bba-8787-0a433a487af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:57.382289 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2158fe-55c6-4bba-8787-0a433a487af1 admin admin] PATH_INFO: `/v3/users/8400eaa8f2244744a7884877e577ad02` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:57.393413 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2158fe-55c6-4bba-8787-0a433a487af1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8400eaa8f2244744a7884877e577ad02)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:57.397029 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2158fe-55c6-4bba-8787-0a433a487af1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:57.454581 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:57.530122 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ed2158fe-55c6-4bba-8787-0a433a487af1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8400eaa8f2244744a7884877e577ad02'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:57.531088 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ed2158fe-55c6-4bba-8787-0a433a487af1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8400eaa8f2244744a7884877e577ad02'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:57.543365 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ed2158fe-55c6-4bba-8787-0a433a487af1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8400eaa8f2244744a7884877e577ad02'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:57.555963 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ed2158fe-55c6-4bba-8787-0a433a487af1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8400eaa8f2244744a7884877e577ad02'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:57.557584 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ed2158fe-55c6-4bba-8787-0a433a487af1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8400eaa8f2244744a7884877e577ad02'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:57.593755 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2218/4448] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:55:57 2022] DELETE /identity/v3/users/8400eaa8f2244744a7884877e577ad02 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:58.335872 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703296e9-7c91-4e1a-a45a-830718aff91f admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:58.337372 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-703296e9-7c91-4e1a-a45a-830718aff91f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:58.358174 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703296e9-7c91-4e1a-a45a-830718aff91f admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:58.518136 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f45cf2-af55-4847-b1f8-2462530aaad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:58.518786 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f45cf2-af55-4847-b1f8-2462530aaad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:58.519409 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f45cf2-af55-4847-b1f8-2462530aaad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:58.519507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f45cf2-af55-4847-b1f8-2462530aaad3 admin admin] PATH_INFO: `/v3/projects/71acbbe4b87e46f8bba366fc1b3de54a` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:58.522277 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f45cf2-af55-4847-b1f8-2462530aaad3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71acbbe4b87e46f8bba366fc1b3de54a)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:58.528498 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f45cf2-af55-4847-b1f8-2462530aaad3 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:58.594419 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:58.645068 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-84f45cf2-af55-4847-b1f8-2462530aaad3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71acbbe4b87e46f8bba366fc1b3de54a', 'request_id': 'req-84f45cf2-af55-4847-b1f8-2462530aaad3'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:58.674839 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-84f45cf2-af55-4847-b1f8-2462530aaad3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71acbbe4b87e46f8bba366fc1b3de54a', 'request_id': 'req-84f45cf2-af55-4847-b1f8-2462530aaad3'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:58.696313 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-84f45cf2-af55-4847-b1f8-2462530aaad3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71acbbe4b87e46f8bba366fc1b3de54a', 'request_id': 'req-84f45cf2-af55-4847-b1f8-2462530aaad3'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:58.749507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-84f45cf2-af55-4847-b1f8-2462530aaad3 admin admin] The token cache is being invalidate because project 71acbbe4b87e46f8bba366fc1b3de54a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:55:58.749812 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-84f45cf2-af55-4847-b1f8-2462530aaad3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:58.752106 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-84f45cf2-af55-4847-b1f8-2462530aaad3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:58.760716 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2231/4449] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:55:58 2022] DELETE /identity/v3/projects/71acbbe4b87e46f8bba366fc1b3de54a => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:58.762284 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf74ce4-db9b-4902-b3ab-da28efa3f6a9 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:58.762746 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf74ce4-db9b-4902-b3ab-da28efa3f6a9 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:58.762823 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf74ce4-db9b-4902-b3ab-da28efa3f6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:58.806464 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-1bf74ce4-db9b-4902-b3ab-da28efa3f6a9 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:58.807572 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1bf74ce4-db9b-4902-b3ab-da28efa3f6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:58.931944 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2219/4450] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:55:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:55:58.940013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bdfa9-81fe-44af-a517-1cc90ae15db4 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:58.941096 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bdfa9-81fe-44af-a517-1cc90ae15db4 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:58.941096 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bdfa9-81fe-44af-a517-1cc90ae15db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:58.985205 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-3c3bdfa9-81fe-44af-a517-1cc90ae15db4 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:58.986418 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3c3bdfa9-81fe-44af-a517-1cc90ae15db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:58.998098 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2232/4451] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:55:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:59.002372 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf74ce4-db9b-4902-b3ab-da28efa3f6a9 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:59.014470 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf74ce4-db9b-4902-b3ab-da28efa3f6a9 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:59.022610 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb384d9e-0eef-49b9-881d-4e84b30d8d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:59.023290 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb384d9e-0eef-49b9-881d-4e84b30d8d37 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:59.024018 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb384d9e-0eef-49b9-881d-4e84b30d8d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:59.024018 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb384d9e-0eef-49b9-881d-4e84b30d8d37 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:59.024500 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb384d9e-0eef-49b9-881d-4e84b30d8d37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:55:59.024803 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb384d9e-0eef-49b9-881d-4e84b30d8d37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:59.026430 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb384d9e-0eef-49b9-881d-4e84b30d8d37 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:59.045690 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3bdfa9-81fe-44af-a517-1cc90ae15db4 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:59.051630 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2220/4452] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:55:59.081978 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3bdfa9-81fe-44af-a517-1cc90ae15db4 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:59.087580 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d196270-7704-4613-847c-7a2708c1ac9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:59.088514 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d196270-7704-4613-847c-7a2708c1ac9d admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:59.088644 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d196270-7704-4613-847c-7a2708c1ac9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:59.088976 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d196270-7704-4613-847c-7a2708c1ac9d admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:59.089578 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d196270-7704-4613-847c-7a2708c1ac9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:59.091567 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d196270-7704-4613-847c-7a2708c1ac9d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:59.182865 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2233/4453] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:55:59 2022] POST /identity/v3/projects => generated 383 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:59.184843 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb384d9e-0eef-49b9-881d-4e84b30d8d37 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:59.203244 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb384d9e-0eef-49b9-881d-4e84b30d8d37 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:59.327646 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b756f9ce-c294-44d8-a7b3-92b9cb7cf120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:59.328862 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756f9ce-c294-44d8-a7b3-92b9cb7cf120 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:59.329752 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756f9ce-c294-44d8-a7b3-92b9cb7cf120 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:59.330283 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756f9ce-c294-44d8-a7b3-92b9cb7cf120 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:59.331278 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b756f9ce-c294-44d8-a7b3-92b9cb7cf120 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:59.337800 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b756f9ce-c294-44d8-a7b3-92b9cb7cf120 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:59.374667 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2221/4454] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:55:59 2022] POST /identity/v3/users => generated 292 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:59.375166 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d196270-7704-4613-847c-7a2708c1ac9d admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:59.389155 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d196270-7704-4613-847c-7a2708c1ac9d admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:59.415928 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a72d6c0-df81-4b27-b6c0-31bf60bd25cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:59.416921 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a72d6c0-df81-4b27-b6c0-31bf60bd25cb admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:59.417348 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a72d6c0-df81-4b27-b6c0-31bf60bd25cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:59.418440 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a72d6c0-df81-4b27-b6c0-31bf60bd25cb admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:59.422031 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a72d6c0-df81-4b27-b6c0-31bf60bd25cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:59.428530 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a72d6c0-df81-4b27-b6c0-31bf60bd25cb admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:59.454742 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2234/4455] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:55:59.459209 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b756f9ce-c294-44d8-a7b3-92b9cb7cf120 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:59.471416 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b756f9ce-c294-44d8-a7b3-92b9cb7cf120 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:59.478457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf86eb-c9cb-4115-84d6-eeb686aeaa4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:59.479180 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf86eb-c9cb-4115-84d6-eeb686aeaa4c admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:59.479464 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf86eb-c9cb-4115-84d6-eeb686aeaa4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:59.480370 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf86eb-c9cb-4115-84d6-eeb686aeaa4c admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:59.481705 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf86eb-c9cb-4115-84d6-eeb686aeaa4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:59.484631 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf86eb-c9cb-4115-84d6-eeb686aeaa4c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:59.486166 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:59.505907 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2222/4456] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:59.510366 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a72d6c0-df81-4b27-b6c0-31bf60bd25cb admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:59.525484 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a72d6c0-df81-4b27-b6c0-31bf60bd25cb admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:59.537836 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3762bfcb-b23e-48b4-9eec-283da680476d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:59.538528 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762bfcb-b23e-48b4-9eec-283da680476d admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:59.538803 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762bfcb-b23e-48b4-9eec-283da680476d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:59.539298 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762bfcb-b23e-48b4-9eec-283da680476d admin admin] PATH_INFO: `/v3/projects/127d2af276e74dad8b3f7cd93027954f/users/ef76ec0a3c064d1eba53fbdb4feaf889/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:59.557632 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3762bfcb-b23e-48b4-9eec-283da680476d admin admin] RBAC: Authorizing `identity:create_grant(project_id=127d2af276e74dad8b3f7cd93027954f, user_id=ef76ec0a3c064d1eba53fbdb4feaf889, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:59.560782 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3762bfcb-b23e-48b4-9eec-283da680476d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:59.589225 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2235/4457] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:55:59 2022] PUT /identity/v3/projects/127d2af276e74dad8b3f7cd93027954f/users/ef76ec0a3c064d1eba53fbdb4feaf889/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:55:59.592146 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ddb83-d65b-48e1-83f6-539798f6abbc None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:59.592953 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ddb83-d65b-48e1-83f6-539798f6abbc None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:59.593375 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ddb83-d65b-48e1-83f6-539798f6abbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:59.632599 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-5e8ddb83-d65b-48e1-83f6-539798f6abbc None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:59.634001 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5e8ddb83-d65b-48e1-83f6-539798f6abbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:59.759479 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2223/4458] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:55:59.798203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3762bfcb-b23e-48b4-9eec-283da680476d admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:59.800958 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3762bfcb-b23e-48b4-9eec-283da680476d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:59.942782 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3762bfcb-b23e-48b4-9eec-283da680476d admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:59.952705 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee3289-dcdf-4afb-ad63-edd72fcf953b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:59.953672 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee3289-dcdf-4afb-ad63-edd72fcf953b service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:59.954024 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee3289-dcdf-4afb-ad63-edd72fcf953b service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:59.954367 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee3289-dcdf-4afb-ad63-edd72fcf953b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:59.975481 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee3289-dcdf-4afb-ad63-edd72fcf953b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:59.977300 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee3289-dcdf-4afb-ad63-edd72fcf953b service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:59.990804 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2236/4459] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:55:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:56:03.148354 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a33ff7-f330-4cc0-87e7-b16bc33b1c4a None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:03.150141 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a33ff7-f330-4cc0-87e7-b16bc33b1c4a None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:03.151082 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a33ff7-f330-4cc0-87e7-b16bc33b1c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:03.263626 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-b8a33ff7-f330-4cc0-87e7-b16bc33b1c4a None None] MFA Rules not processed for user `af578f0b19294a96a5ec3217f5643f66`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:03.267854 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b8a33ff7-f330-4cc0-87e7-b16bc33b1c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:03.407834 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2224/4460] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:56:03 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:56:03.429655 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee3289-dcdf-4afb-ad63-edd72fcf953b service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:03.431166 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4dee3289-dcdf-4afb-ad63-edd72fcf953b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:03.622892 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:03.649225 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee3289-dcdf-4afb-ad63-edd72fcf953b service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:03.661387 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c6c694-3b3b-4354-9ab3-ccd38de3dc97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:03.663620 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c6c694-3b3b-4354-9ab3-ccd38de3dc97 service cinder] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:03.664635 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c6c694-3b3b-4354-9ab3-ccd38de3dc97 service cinder] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:03.665367 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c6c694-3b3b-4354-9ab3-ccd38de3dc97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:03.669630 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-53c6c694-3b3b-4354-9ab3-ccd38de3dc97 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:03.934997 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c6c694-3b3b-4354-9ab3-ccd38de3dc97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:03.936519 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c6c694-3b3b-4354-9ab3-ccd38de3dc97 service cinder] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:03.977137 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2237/4461] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:56:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:56:04.801693 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9124c-0dc8-4b71-9357-a94c3a4da9be None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:04.804584 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9124c-0dc8-4b71-9357-a94c3a4da9be None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:04.805118 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9124c-0dc8-4b71-9357-a94c3a4da9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:04.861187 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-b9e9124c-0dc8-4b71-9357-a94c3a4da9be None None] MFA Rules not processed for user `8efa4be1bf974daf84fc5f64b4ca3155`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:04.862748 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b9e9124c-0dc8-4b71-9357-a94c3a4da9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:05.044736 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2225/4462] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:56:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:56:05.907517 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c6c694-3b3b-4354-9ab3-ccd38de3dc97 service cinder] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:05.909495 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-53c6c694-3b3b-4354-9ab3-ccd38de3dc97 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:06.101133 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c6c694-3b3b-4354-9ab3-ccd38de3dc97 service cinder] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:06.124049 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae403cd7-eb2d-4fbf-bfae-91805d37cc53 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:06.124692 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae403cd7-eb2d-4fbf-bfae-91805d37cc53 service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:06.125028 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae403cd7-eb2d-4fbf-bfae-91805d37cc53 service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:06.125300 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae403cd7-eb2d-4fbf-bfae-91805d37cc53 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:06.132647 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ae403cd7-eb2d-4fbf-bfae-91805d37cc53 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:06.162515 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae403cd7-eb2d-4fbf-bfae-91805d37cc53 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:06.164481 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae403cd7-eb2d-4fbf-bfae-91805d37cc53 service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:06.192358 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2238/4463] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:56:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:56:14.292453 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7427daa-e187-4add-a055-f3ed82cec7ac None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:14.292915 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7427daa-e187-4add-a055-f3ed82cec7ac None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:14.293023 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7427daa-e187-4add-a055-f3ed82cec7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:14.347183 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-e7427daa-e187-4add-a055-f3ed82cec7ac None None] MFA Rules not processed for user `ef76ec0a3c064d1eba53fbdb4feaf889`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:14.348673 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e7427daa-e187-4add-a055-f3ed82cec7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:14.374001 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:14.558348 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2226/4464] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:56:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:56:14.562176 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae403cd7-eb2d-4fbf-bfae-91805d37cc53 service placement] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:14.581335 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae403cd7-eb2d-4fbf-bfae-91805d37cc53 service placement] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:14.588151 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e6105-b7a6-40d0-b11c-c1b70cebf1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:14.589011 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e6105-b7a6-40d0-b11c-c1b70cebf1bf admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:14.589298 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e6105-b7a6-40d0-b11c-c1b70cebf1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:14.589562 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e6105-b7a6-40d0-b11c-c1b70cebf1bf admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:14.590388 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e6105-b7a6-40d0-b11c-c1b70cebf1bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:14.592664 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e6105-b7a6-40d0-b11c-c1b70cebf1bf admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:14.643586 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2239/4465] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:56:14 2022] POST /identity/v3/projects => generated 383 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:56:14.645038 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7427daa-e187-4add-a055-f3ed82cec7ac None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:14.660447 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7427daa-e187-4add-a055-f3ed82cec7ac None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:14.806134 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74825ab4-950c-4921-bbc0-65cdb0f6cdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:14.809933 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74825ab4-950c-4921-bbc0-65cdb0f6cdf7 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:14.811771 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74825ab4-950c-4921-bbc0-65cdb0f6cdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:14.812535 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74825ab4-950c-4921-bbc0-65cdb0f6cdf7 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:14.814797 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74825ab4-950c-4921-bbc0-65cdb0f6cdf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:14.821531 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74825ab4-950c-4921-bbc0-65cdb0f6cdf7 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:14.888203 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2227/4466] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:56:14 2022] POST /identity/v3/users => generated 298 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:56:14.901215 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e6105-b7a6-40d0-b11c-c1b70cebf1bf admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:14.926367 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e6105-b7a6-40d0-b11c-c1b70cebf1bf admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:14.931691 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d935240-a977-4a1c-b542-f2b16f07393a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:14.932738 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d935240-a977-4a1c-b542-f2b16f07393a admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:14.933384 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d935240-a977-4a1c-b542-f2b16f07393a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:14.935479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d935240-a977-4a1c-b542-f2b16f07393a admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:14.936458 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d935240-a977-4a1c-b542-f2b16f07393a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:14.938310 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d935240-a977-4a1c-b542-f2b16f07393a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:14.954761 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2240/4467] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:56:14.958886 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74825ab4-950c-4921-bbc0-65cdb0f6cdf7 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:14.970789 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74825ab4-950c-4921-bbc0-65cdb0f6cdf7 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:14.977948 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10697752-93ac-4d5d-b48a-afcdbe526a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:14.979052 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10697752-93ac-4d5d-b48a-afcdbe526a28 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:14.979527 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10697752-93ac-4d5d-b48a-afcdbe526a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:14.979987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10697752-93ac-4d5d-b48a-afcdbe526a28 admin admin] PATH_INFO: `/v3/projects/7e93d82066684b429f959d60c75a2bd3/users/eebb2318fc6f422ba3fa39deb99c2294/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:15.003348 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10697752-93ac-4d5d-b48a-afcdbe526a28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e93d82066684b429f959d60c75a2bd3, user_id=eebb2318fc6f422ba3fa39deb99c2294, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:15.009955 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10697752-93ac-4d5d-b48a-afcdbe526a28 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:15.040362 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2228/4468] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:56:14 2022] PUT /identity/v3/projects/7e93d82066684b429f959d60c75a2bd3/users/eebb2318fc6f422ba3fa39deb99c2294/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:56:15.046573 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d935240-a977-4a1c-b542-f2b16f07393a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:15.070914 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d935240-a977-4a1c-b542-f2b16f07393a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:15.221559 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9d93d-987a-4e76-a7a9-65666520c85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:15.222123 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9d93d-987a-4e76-a7a9-65666520c85a admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:15.222463 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9d93d-987a-4e76-a7a9-65666520c85a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:15.222795 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9d93d-987a-4e76-a7a9-65666520c85a admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:15.225435 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f9d93d-987a-4e76-a7a9-65666520c85a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:15.230752 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f9d93d-987a-4e76-a7a9-65666520c85a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:15.233160 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:15.267373 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10697752-93ac-4d5d-b48a-afcdbe526a28 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:15.292520 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2241/4469] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:56:15.295985 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10697752-93ac-4d5d-b48a-afcdbe526a28 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:15.313647 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c9879-89dc-4996-a893-26c0b7eba6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:15.315369 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c9879-89dc-4996-a893-26c0b7eba6e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:15.315792 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c9879-89dc-4996-a893-26c0b7eba6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:15.316905 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c9879-89dc-4996-a893-26c0b7eba6e8 admin admin] PATH_INFO: `/v3/projects/7e93d82066684b429f959d60c75a2bd3/users/eebb2318fc6f422ba3fa39deb99c2294/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:15.333499 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c9879-89dc-4996-a893-26c0b7eba6e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e93d82066684b429f959d60c75a2bd3, user_id=eebb2318fc6f422ba3fa39deb99c2294, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:15.344094 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c9879-89dc-4996-a893-26c0b7eba6e8 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:15.374921 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2229/4470] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:56:15 2022] PUT /identity/v3/projects/7e93d82066684b429f959d60c75a2bd3/users/eebb2318fc6f422ba3fa39deb99c2294/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:56:22.033983 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95ea3d-0efe-4b13-89f2-af1e70b2d31a None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:22.040837 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95ea3d-0efe-4b13-89f2-af1e70b2d31a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:22.041602 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95ea3d-0efe-4b13-89f2-af1e70b2d31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:22.072958 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-aa95ea3d-0efe-4b13-89f2-af1e70b2d31a None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:22.074258 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-aa95ea3d-0efe-4b13-89f2-af1e70b2d31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:22.231154 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2242/4471] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 15:56:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:56:22.316583 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c9879-89dc-4996-a893-26c0b7eba6e8 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:22.319827 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b59c9879-89dc-4996-a893-26c0b7eba6e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:22.466216 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c9879-89dc-4996-a893-26c0b7eba6e8 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:22.482833 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49b360-0382-40b3-b463-b6794af5220e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:22.483816 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49b360-0382-40b3-b463-b6794af5220e service swift] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:22.484098 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49b360-0382-40b3-b463-b6794af5220e service swift] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:22.484367 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49b360-0382-40b3-b463-b6794af5220e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:22.506269 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d49b360-0382-40b3-b463-b6794af5220e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:22.508334 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d49b360-0382-40b3-b463-b6794af5220e service swift] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:22.513045 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:22.543180 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2230/4472] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 15:56:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:56:29.257312 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95ea3d-0efe-4b13-89f2-af1e70b2d31a None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:29.258804 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-aa95ea3d-0efe-4b13-89f2-af1e70b2d31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:29.744793 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95ea3d-0efe-4b13-89f2-af1e70b2d31a None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:29.754087 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf48a78-8ab6-45c7-975c-8d09f24fb430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:29.755335 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf48a78-8ab6-45c7-975c-8d09f24fb430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:29.756436 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf48a78-8ab6-45c7-975c-8d09f24fb430 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:29.757033 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf48a78-8ab6-45c7-975c-8d09f24fb430 admin admin] PATH_INFO: `/v3/users/38624ce9529441aba32a3cb68205209f` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:29.759494 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf48a78-8ab6-45c7-975c-8d09f24fb430 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38624ce9529441aba32a3cb68205209f)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:29.764161 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf48a78-8ab6-45c7-975c-8d09f24fb430 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:29.929837 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-dcf48a78-8ab6-45c7-975c-8d09f24fb430 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38624ce9529441aba32a3cb68205209f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:29.931923 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-dcf48a78-8ab6-45c7-975c-8d09f24fb430 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38624ce9529441aba32a3cb68205209f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:29.973259 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-dcf48a78-8ab6-45c7-975c-8d09f24fb430 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38624ce9529441aba32a3cb68205209f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:29.995461 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-dcf48a78-8ab6-45c7-975c-8d09f24fb430 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38624ce9529441aba32a3cb68205209f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:30.007233 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:30.033064 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-dcf48a78-8ab6-45c7-975c-8d09f24fb430 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38624ce9529441aba32a3cb68205209f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:30.071372 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2243/4473] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:56:29 2022] DELETE /identity/v3/users/38624ce9529441aba32a3cb68205209f => generated 0 bytes in 811 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:56:30.520461 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49b360-0382-40b3-b463-b6794af5220e service swift] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:30.541372 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49b360-0382-40b3-b463-b6794af5220e service swift] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:30.826967 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca958599-b8ee-4002-9d7d-89d1629587dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:30.828050 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca958599-b8ee-4002-9d7d-89d1629587dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:30.828484 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca958599-b8ee-4002-9d7d-89d1629587dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:30.828950 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca958599-b8ee-4002-9d7d-89d1629587dc admin admin] PATH_INFO: `/v3/projects/773bdb58320742cd91d977a2dff19613` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:30.832681 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca958599-b8ee-4002-9d7d-89d1629587dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=773bdb58320742cd91d977a2dff19613)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:30.850927 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca958599-b8ee-4002-9d7d-89d1629587dc admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:30.941946 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ca958599-b8ee-4002-9d7d-89d1629587dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '773bdb58320742cd91d977a2dff19613', 'request_id': 'req-ca958599-b8ee-4002-9d7d-89d1629587dc'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:30.996127 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ca958599-b8ee-4002-9d7d-89d1629587dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '773bdb58320742cd91d977a2dff19613', 'request_id': 'req-ca958599-b8ee-4002-9d7d-89d1629587dc'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:31.010103 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ca958599-b8ee-4002-9d7d-89d1629587dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '773bdb58320742cd91d977a2dff19613', 'request_id': 'req-ca958599-b8ee-4002-9d7d-89d1629587dc'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:31.050878 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ca958599-b8ee-4002-9d7d-89d1629587dc admin admin] The token cache is being invalidate because project 773bdb58320742cd91d977a2dff19613 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:56:31.051133 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ca958599-b8ee-4002-9d7d-89d1629587dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:31.054390 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ca958599-b8ee-4002-9d7d-89d1629587dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:31.059083 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2231/4474] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:56:30 2022] DELETE /identity/v3/projects/773bdb58320742cd91d977a2dff19613 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:56:31.067994 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14ac9c-90ed-486a-8c1f-905aa6d618df None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:31.069157 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14ac9c-90ed-486a-8c1f-905aa6d618df None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:31.069579 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14ac9c-90ed-486a-8c1f-905aa6d618df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:31.214763 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-eb14ac9c-90ed-486a-8c1f-905aa6d618df None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:31.221464 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-eb14ac9c-90ed-486a-8c1f-905aa6d618df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:31.516116 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2244/4475] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:56:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:56:31.529177 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329b0b4-3010-41d2-b308-af26a9a6c16d None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:31.529725 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329b0b4-3010-41d2-b308-af26a9a6c16d None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:31.529725 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329b0b4-3010-41d2-b308-af26a9a6c16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:31.590593 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-9329b0b4-3010-41d2-b308-af26a9a6c16d None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:31.592500 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9329b0b4-3010-41d2-b308-af26a9a6c16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:31.633240 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2232/4476] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:56:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:56:31.639302 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14ac9c-90ed-486a-8c1f-905aa6d618df None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:31.651583 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14ac9c-90ed-486a-8c1f-905aa6d618df None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:31.672907 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558611e8-3412-4b5c-8644-896930b9f8b8 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:31.673435 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558611e8-3412-4b5c-8644-896930b9f8b8 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:31.673967 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558611e8-3412-4b5c-8644-896930b9f8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:31.688044 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed6746-8920-44a3-bb11-b61f233018d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:31.688281 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed6746-8920-44a3-bb11-b61f233018d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:31.688382 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed6746-8920-44a3-bb11-b61f233018d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:31.688634 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed6746-8920-44a3-bb11-b61f233018d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:31.689300 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed6746-8920-44a3-bb11-b61f233018d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:56:31.689604 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed6746-8920-44a3-bb11-b61f233018d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:31.694797 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed6746-8920-44a3-bb11-b61f233018d1 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:31.758598 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2245/4477] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:56:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:56:31.760595 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed6746-8920-44a3-bb11-b61f233018d1 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:31.779615 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-558611e8-3412-4b5c-8644-896930b9f8b8 None None] MFA Rules not processed for user `eebb2318fc6f422ba3fa39deb99c2294`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:31.781057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-558611e8-3412-4b5c-8644-896930b9f8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:31.797268 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed6746-8920-44a3-bb11-b61f233018d1 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:31.811464 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf92b88-9da8-4f76-9036-3e437cdecffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:31.812104 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf92b88-9da8-4f76-9036-3e437cdecffd admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:31.812383 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf92b88-9da8-4f76-9036-3e437cdecffd admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:31.812655 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf92b88-9da8-4f76-9036-3e437cdecffd admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:31.816158 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf92b88-9da8-4f76-9036-3e437cdecffd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:31.824116 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf92b88-9da8-4f76-9036-3e437cdecffd admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:31.982320 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2246/4478] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:56:31 2022] POST /identity/v3/projects => generated 383 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:56:31.985509 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf92b88-9da8-4f76-9036-3e437cdecffd admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:32.234784 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2233/4479] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:56:31 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 563 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:56:32.251580 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558611e8-3412-4b5c-8644-896930b9f8b8 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:32.269436 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-558611e8-3412-4b5c-8644-896930b9f8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:32.317870 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf92b88-9da8-4f76-9036-3e437cdecffd admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:32.349992 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd7d7c8-8fe6-4010-86ba-197187b18765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:32.350760 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7d7c8-8fe6-4010-86ba-197187b18765 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:32.350910 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:32.351170 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7d7c8-8fe6-4010-86ba-197187b18765 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:32.351452 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7d7c8-8fe6-4010-86ba-197187b18765 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:32.351981 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd7d7c8-8fe6-4010-86ba-197187b18765 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:32.360552 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd7d7c8-8fe6-4010-86ba-197187b18765 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:32.436604 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2247/4480] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:56:31 2022] POST /identity/v3/users => generated 292 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:56:32.440768 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd7d7c8-8fe6-4010-86ba-197187b18765 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:32.476070 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd7d7c8-8fe6-4010-86ba-197187b18765 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:32.495888 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463bfa5-d67a-4a17-90ee-16f71004551b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:32.496433 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463bfa5-d67a-4a17-90ee-16f71004551b admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:32.496715 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463bfa5-d67a-4a17-90ee-16f71004551b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:32.496991 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463bfa5-d67a-4a17-90ee-16f71004551b admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:32.497725 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5463bfa5-d67a-4a17-90ee-16f71004551b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:32.503982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5463bfa5-d67a-4a17-90ee-16f71004551b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:32.540316 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2248/4481] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:56:32 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:56:32.541273 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463bfa5-d67a-4a17-90ee-16f71004551b admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:32.570911 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558611e8-3412-4b5c-8644-896930b9f8b8 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:32.572697 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463bfa5-d67a-4a17-90ee-16f71004551b admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:32.591479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712df0c-9974-494e-9393-e32c906b212e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:32.591984 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712df0c-9974-494e-9393-e32c906b212e admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:32.592268 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712df0c-9974-494e-9393-e32c906b212e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:32.592545 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712df0c-9974-494e-9393-e32c906b212e admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:32.593209 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5712df0c-9974-494e-9393-e32c906b212e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:32.594948 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5712df0c-9974-494e-9393-e32c906b212e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:32.656878 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2249/4482] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:56:32 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:56:32.658095 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712df0c-9974-494e-9393-e32c906b212e admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:32.672808 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:32.688280 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712df0c-9974-494e-9393-e32c906b212e admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:32.713427 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5760402-93c2-47cb-87bb-cf526be9a706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:32.713698 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5760402-93c2-47cb-87bb-cf526be9a706 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:32.713985 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5760402-93c2-47cb-87bb-cf526be9a706 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:32.714543 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5760402-93c2-47cb-87bb-cf526be9a706 admin admin] PATH_INFO: `/v3/projects/d4283ccfd2a54553896677a670e675f9/users/58ddd1273ce749e29578db36d61ca07a/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:32.745101 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16810cb-24b7-4cd9-ab3c-f5ae0c7e5d02 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6b0f9835ed549cab91d684326be83fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:32.747090 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16810cb-24b7-4cd9-ab3c-f5ae0c7e5d02 service glance] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:32.753178 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16810cb-24b7-4cd9-ab3c-f5ae0c7e5d02 service glance] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:32.753178 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16810cb-24b7-4cd9-ab3c-f5ae0c7e5d02 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:32.773937 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5760402-93c2-47cb-87bb-cf526be9a706 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4283ccfd2a54553896677a670e675f9, user_id=58ddd1273ce749e29578db36d61ca07a, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:32.778285 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5760402-93c2-47cb-87bb-cf526be9a706 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:32.808546 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2250/4483] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:56:32 2022] PUT /identity/v3/projects/d4283ccfd2a54553896677a670e675f9/users/58ddd1273ce749e29578db36d61ca07a/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:56:32.813353 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49220021-26f2-4a41-b863-63f63b068b42 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:32.813916 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49220021-26f2-4a41-b863-63f63b068b42 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:32.814405 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49220021-26f2-4a41-b863-63f63b068b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:32.856392 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-49220021-26f2-4a41-b863-63f63b068b42 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:32.861680 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-49220021-26f2-4a41-b863-63f63b068b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:32.915831 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16810cb-24b7-4cd9-ab3c-f5ae0c7e5d02 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:32.917500 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16810cb-24b7-4cd9-ab3c-f5ae0c7e5d02 service glance] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:32.932187 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2234/4484] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:56:32 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 685 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:56:33.034020 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2251/4485] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:56:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:56:33.079985 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16810cb-24b7-4cd9-ab3c-f5ae0c7e5d02 service glance] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:33.082050 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a16810cb-24b7-4cd9-ab3c-f5ae0c7e5d02 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:33.588441 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16810cb-24b7-4cd9-ab3c-f5ae0c7e5d02 service glance] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:33.650569 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:33.803510 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5264e54b-fe88-4aeb-92e7-48bf9b2e2ed4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:33.804069 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264e54b-fe88-4aeb-92e7-48bf9b2e2ed4 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:33.804345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264e54b-fe88-4aeb-92e7-48bf9b2e2ed4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:33.804612 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264e54b-fe88-4aeb-92e7-48bf9b2e2ed4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:33.845722 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5264e54b-fe88-4aeb-92e7-48bf9b2e2ed4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:33.855255 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5264e54b-fe88-4aeb-92e7-48bf9b2e2ed4 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:33.915450 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2235/4486] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:56:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 837 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:56:43.022965 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=35,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:43.892496 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=18 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:47.494451 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce67416-e46c-46a0-a60e-56f71b94f7a7 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:47.495406 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce67416-e46c-46a0-a60e-56f71b94f7a7 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:47.496732 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce67416-e46c-46a0-a60e-56f71b94f7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:47.566024 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-bce67416-e46c-46a0-a60e-56f71b94f7a7 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:47.572973 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-bce67416-e46c-46a0-a60e-56f71b94f7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:47.711483 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2252/4487] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 15:56:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 29 15:56:47.732134 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5264e54b-fe88-4aeb-92e7-48bf9b2e2ed4 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:47.734471 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5264e54b-fe88-4aeb-92e7-48bf9b2e2ed4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:47.909749 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5264e54b-fe88-4aeb-92e7-48bf9b2e2ed4 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:47.926617 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ed836-70d8-473c-88bd-941adf8d578a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:47.928591 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ed836-70d8-473c-88bd-941adf8d578a service swift] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:47.928888 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ed836-70d8-473c-88bd-941adf8d578a service swift] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:47.930244 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ed836-70d8-473c-88bd-941adf8d578a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:47.955361 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ed836-70d8-473c-88bd-941adf8d578a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:47.960340 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ed836-70d8-473c-88bd-941adf8d578a service swift] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:47.992793 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2236/4488] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 15:56:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 15:56:57.695718 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=29 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:57.973376 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=32 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:00.078071 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bfa824-7eed-4f9c-9c20-9b965860dde8 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:00.078885 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bfa824-7eed-4f9c-9c20-9b965860dde8 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:00.078885 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bfa824-7eed-4f9c-9c20-9b965860dde8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:00.184073 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-f0bfa824-7eed-4f9c-9c20-9b965860dde8 None None] MFA Rules not processed for user `58ddd1273ce749e29578db36d61ca07a`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:00.192307 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f0bfa824-7eed-4f9c-9c20-9b965860dde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:00.381679 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2253/4489] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:57:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:57:00.383629 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb33188-3934-47f5-98f7-7bf064cb75d2 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:00.387413 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb33188-3934-47f5-98f7-7bf064cb75d2 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:00.388997 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb33188-3934-47f5-98f7-7bf064cb75d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:00.445152 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-0cb33188-3934-47f5-98f7-7bf064cb75d2 None None] MFA Rules not processed for user `58ddd1273ce749e29578db36d61ca07a`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:00.450278 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0cb33188-3934-47f5-98f7-7bf064cb75d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:00.479975 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2237/4490] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:57:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:57:00.492349 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bfa824-7eed-4f9c-9c20-9b965860dde8 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:00.494381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f0bfa824-7eed-4f9c-9c20-9b965860dde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:00.735854 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bfa824-7eed-4f9c-9c20-9b965860dde8 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:00.752416 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d933409-97df-4f9e-a70c-7e83f8143239 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:00.753145 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d933409-97df-4f9e-a70c-7e83f8143239 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:00.753439 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d933409-97df-4f9e-a70c-7e83f8143239 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:00.753907 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d933409-97df-4f9e-a70c-7e83f8143239 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:00.780322 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d933409-97df-4f9e-a70c-7e83f8143239 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:00.790796 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d933409-97df-4f9e-a70c-7e83f8143239 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:00.821685 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2254/4491] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:57:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:57:01.916532 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fecd8-be72-4690-afa9-f26da8986892 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:01.918927 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fecd8-be72-4690-afa9-f26da8986892 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:01.919409 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fecd8-be72-4690-afa9-f26da8986892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:01.978749 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-f99fecd8-be72-4690-afa9-f26da8986892 None None] MFA Rules not processed for user `f554eb660c324a759d70b3b974e78db5`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:01.982050 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f99fecd8-be72-4690-afa9-f26da8986892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:02.115886 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2238/4492] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:57:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:57:04.244094 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d933409-97df-4f9e-a70c-7e83f8143239 service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:04.246251 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6d933409-97df-4f9e-a70c-7e83f8143239 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:04.417897 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d933409-97df-4f9e-a70c-7e83f8143239 service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:04.428697 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd9585-d8d8-4b0d-a445-a9b7b157ed55 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6b0f9835ed549cab91d684326be83fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:04.429779 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd9585-d8d8-4b0d-a445-a9b7b157ed55 service glance] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:04.431364 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd9585-d8d8-4b0d-a445-a9b7b157ed55 service glance] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:04.431889 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd9585-d8d8-4b0d-a445-a9b7b157ed55 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:04.434178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e8fd9585-d8d8-4b0d-a445-a9b7b157ed55 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:04.452774 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fd9585-d8d8-4b0d-a445-a9b7b157ed55 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:04.454517 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fd9585-d8d8-4b0d-a445-a9b7b157ed55 service glance] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:04.503208 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2255/4493] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:57:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:57:05.640348 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99fecd8-be72-4690-afa9-f26da8986892 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:05.641751 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f99fecd8-be72-4690-afa9-f26da8986892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:05.678114 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99fecd8-be72-4690-afa9-f26da8986892 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:05.695862 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0cda8-b176-4fee-83ae-ef8cb221bd6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:05.709802 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0cda8-b176-4fee-83ae-ef8cb221bd6f service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:05.710268 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0cda8-b176-4fee-83ae-ef8cb221bd6f service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:05.710683 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0cda8-b176-4fee-83ae-ef8cb221bd6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:05.717397 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-29c0cda8-b176-4fee-83ae-ef8cb221bd6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:05.746416 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c0cda8-b176-4fee-83ae-ef8cb221bd6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:05.755600 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c0cda8-b176-4fee-83ae-ef8cb221bd6f service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:05.792748 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2239/4494] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:57:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:57:06.158831 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd9585-d8d8-4b0d-a445-a9b7b157ed55 service glance] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:06.172929 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd9585-d8d8-4b0d-a445-a9b7b157ed55 service glance] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:06.182783 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95e87b-5f7d-47e4-91f7-cc7775384b6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:06.183871 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95e87b-5f7d-47e4-91f7-cc7775384b6a service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:06.184345 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95e87b-5f7d-47e4-91f7-cc7775384b6a service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:06.185011 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95e87b-5f7d-47e4-91f7-cc7775384b6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:06.187747 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8b95e87b-5f7d-47e4-91f7-cc7775384b6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:06.211558 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:06.224027 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b95e87b-5f7d-47e4-91f7-cc7775384b6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:06.228423 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b95e87b-5f7d-47e4-91f7-cc7775384b6a service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:06.255713 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2256/4495] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:57:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:57:14.432882 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0cda8-b176-4fee-83ae-ef8cb221bd6f service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:14.435138 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-29c0cda8-b176-4fee-83ae-ef8cb221bd6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:14.456373 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0cda8-b176-4fee-83ae-ef8cb221bd6f service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:14.466580 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c52f39-32b2-49d5-854f-9cf1dc20125e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:14.467320 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c52f39-32b2-49d5-854f-9cf1dc20125e service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:14.468237 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c52f39-32b2-49d5-854f-9cf1dc20125e service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:14.468769 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c52f39-32b2-49d5-854f-9cf1dc20125e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:14.472558 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-51c52f39-32b2-49d5-854f-9cf1dc20125e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:14.581546 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c52f39-32b2-49d5-854f-9cf1dc20125e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:14.583454 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c52f39-32b2-49d5-854f-9cf1dc20125e service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:14.603129 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2240/4496] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:57:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:57:16.250175 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:16.252899 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494e540-4c49-468a-b3fa-a6087a825d2e None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:16.253172 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494e540-4c49-468a-b3fa-a6087a825d2e None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:16.254407 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494e540-4c49-468a-b3fa-a6087a825d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:16.279316 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-3494e540-4c49-468a-b3fa-a6087a825d2e None None] MFA Rules not processed for user `2cd0536429dd4c47b296b9645b6e0c48`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:16.280965 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3494e540-4c49-468a-b3fa-a6087a825d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:16.363163 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2257/4497] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:57:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:57:16.374339 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493001b-3639-49a7-b055-2a5017a3e1e0 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:16.374863 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493001b-3639-49a7-b055-2a5017a3e1e0 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:16.374863 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493001b-3639-49a7-b055-2a5017a3e1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:16.395501 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-2493001b-3639-49a7-b055-2a5017a3e1e0 None None] MFA Rules not processed for user `2cd0536429dd4c47b296b9645b6e0c48`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:16.397126 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2493001b-3639-49a7-b055-2a5017a3e1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:16.405159 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2241/4498] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:57:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:57:16.762189 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182bae7-0467-4bcf-a2d2-2e921a003a79 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:16.763066 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182bae7-0467-4bcf-a2d2-2e921a003a79 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:16.763445 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182bae7-0467-4bcf-a2d2-2e921a003a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:16.788484 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-6182bae7-0467-4bcf-a2d2-2e921a003a79 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:16.790105 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6182bae7-0467-4bcf-a2d2-2e921a003a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:16.799802 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2258/4499] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 15:57:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:57:16.819399 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493001b-3639-49a7-b055-2a5017a3e1e0 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:16.834596 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493001b-3639-49a7-b055-2a5017a3e1e0 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:16.841029 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a5c5e-4ad3-4985-a9ec-b4fd20d1abb3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:16.841765 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a5c5e-4ad3-4985-a9ec-b4fd20d1abb3 service swift] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:16.842146 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a5c5e-4ad3-4985-a9ec-b4fd20d1abb3 service swift] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:16.842525 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a5c5e-4ad3-4985-a9ec-b4fd20d1abb3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:16.857368 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372a5c5e-4ad3-4985-a9ec-b4fd20d1abb3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:16.859156 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372a5c5e-4ad3-4985-a9ec-b4fd20d1abb3 service swift] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:16.892068 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2242/4500] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 15:57:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:57:17.430211 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb74fa-183c-42af-9cb0-210fb82d8b3a None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:17.430885 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb74fa-183c-42af-9cb0-210fb82d8b3a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:17.430981 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb74fa-183c-42af-9cb0-210fb82d8b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:17.468064 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-7bdb74fa-183c-42af-9cb0-210fb82d8b3a None None] MFA Rules not processed for user `ef76ec0a3c064d1eba53fbdb4feaf889`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:17.469344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7bdb74fa-183c-42af-9cb0-210fb82d8b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:17.483364 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a5c5e-4ad3-4985-a9ec-b4fd20d1abb3 service swift] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:17.490771 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-372a5c5e-4ad3-4985-a9ec-b4fd20d1abb3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:17.509386 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2259/4501] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:57:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:57:17.672326 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a5c5e-4ad3-4985-a9ec-b4fd20d1abb3 service swift] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:17.688568 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4966ccb-660a-4669-b516-873931490927 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:17.689506 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4966ccb-660a-4669-b516-873931490927 service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:17.689912 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4966ccb-660a-4669-b516-873931490927 service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:17.690350 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4966ccb-660a-4669-b516-873931490927 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:17.697462 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e4966ccb-660a-4669-b516-873931490927 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:17.722608 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:17.732701 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4966ccb-660a-4669-b516-873931490927 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:17.737535 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4966ccb-660a-4669-b516-873931490927 service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:17.760053 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2243/4502] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:57:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:57:21.012770 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb74fa-183c-42af-9cb0-210fb82d8b3a None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:21.057363 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb74fa-183c-42af-9cb0-210fb82d8b3a None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:21.075040 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7fec6a-94ea-4174-9fb7-1b527b467a37 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:21.075951 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fec6a-94ea-4174-9fb7-1b527b467a37 service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:21.079078 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fec6a-94ea-4174-9fb7-1b527b467a37 service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:21.079551 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fec6a-94ea-4174-9fb7-1b527b467a37 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:21.086878 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9f7fec6a-94ea-4174-9fb7-1b527b467a37 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:21.123979 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7fec6a-94ea-4174-9fb7-1b527b467a37 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:21.127533 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7fec6a-94ea-4174-9fb7-1b527b467a37 service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:21.159209 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2260/4503] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:57:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:57:21.336173 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4966ccb-660a-4669-b516-873931490927 service placement] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:21.343928 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e4966ccb-660a-4669-b516-873931490927 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:21.384975 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4966ccb-660a-4669-b516-873931490927 service placement] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:21.403400 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5286e-f36c-453a-909b-9302a566799e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:21.413812 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5286e-f36c-453a-909b-9302a566799e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:21.414100 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5286e-f36c-453a-909b-9302a566799e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:21.417633 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5286e-f36c-453a-909b-9302a566799e admin admin] PATH_INFO: `/v3/users/705845e9fee249769ca4ee0f962422ca` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:21.422343 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed5286e-f36c-453a-909b-9302a566799e admin admin] RBAC: Authorizing `identity:delete_user(user_id=705845e9fee249769ca4ee0f962422ca)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:21.425727 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed5286e-f36c-453a-909b-9302a566799e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:21.589920 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-bed5286e-f36c-453a-909b-9302a566799e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '705845e9fee249769ca4ee0f962422ca'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:21.594433 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-bed5286e-f36c-453a-909b-9302a566799e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '705845e9fee249769ca4ee0f962422ca'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:21.605955 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-bed5286e-f36c-453a-909b-9302a566799e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '705845e9fee249769ca4ee0f962422ca'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:21.618746 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-bed5286e-f36c-453a-909b-9302a566799e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '705845e9fee249769ca4ee0f962422ca'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:21.620570 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-bed5286e-f36c-453a-909b-9302a566799e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '705845e9fee249769ca4ee0f962422ca'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:21.651205 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2244/4504] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:57:21 2022] DELETE /identity/v3/users/705845e9fee249769ca4ee0f962422ca => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:57:21.655651 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab3003-e904-4f5b-ad60-78b06e12dcb9 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:21.656103 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab3003-e904-4f5b-ad60-78b06e12dcb9 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:21.657208 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab3003-e904-4f5b-ad60-78b06e12dcb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:21.687111 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-e5ab3003-e904-4f5b-ad60-78b06e12dcb9 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:21.688722 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e5ab3003-e904-4f5b-ad60-78b06e12dcb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:21.962408 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2261/4505] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:57:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:57:22.011794 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5286e-f36c-453a-909b-9302a566799e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:22.013481 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-bed5286e-f36c-453a-909b-9302a566799e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:22.202437 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5286e-f36c-453a-909b-9302a566799e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:22.209686 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42838151-039e-4e71-9867-0a169dacd179 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:22.210401 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42838151-039e-4e71-9867-0a169dacd179 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:22.210684 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42838151-039e-4e71-9867-0a169dacd179 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:22.210956 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42838151-039e-4e71-9867-0a169dacd179 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:22.222504 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42838151-039e-4e71-9867-0a169dacd179 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:22.224809 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42838151-039e-4e71-9867-0a169dacd179 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:22.249287 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2245/4506] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:57:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:57:23.312310 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab3003-e904-4f5b-ad60-78b06e12dcb9 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:23.315430 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e5ab3003-e904-4f5b-ad60-78b06e12dcb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:23.389956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab3003-e904-4f5b-ad60-78b06e12dcb9 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:23.430319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a0f829-d4be-4b6e-bb67-99d3af148542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:23.431281 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a0f829-d4be-4b6e-bb67-99d3af148542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:23.431983 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a0f829-d4be-4b6e-bb67-99d3af148542 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:23.432266 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a0f829-d4be-4b6e-bb67-99d3af148542 admin admin] PATH_INFO: `/v3/projects/f0ab86b2728e442997d0ff3bcdfa7eb0` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:23.434710 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a0f829-d4be-4b6e-bb67-99d3af148542 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0ab86b2728e442997d0ff3bcdfa7eb0)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:23.442332 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a0f829-d4be-4b6e-bb67-99d3af148542 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:23.674294 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-59a0f829-d4be-4b6e-bb67-99d3af148542 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0ab86b2728e442997d0ff3bcdfa7eb0', 'request_id': 'req-59a0f829-d4be-4b6e-bb67-99d3af148542'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:23.710947 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-59a0f829-d4be-4b6e-bb67-99d3af148542 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0ab86b2728e442997d0ff3bcdfa7eb0', 'request_id': 'req-59a0f829-d4be-4b6e-bb67-99d3af148542'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:23.727476 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-59a0f829-d4be-4b6e-bb67-99d3af148542 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0ab86b2728e442997d0ff3bcdfa7eb0', 'request_id': 'req-59a0f829-d4be-4b6e-bb67-99d3af148542'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:23.769724 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-59a0f829-d4be-4b6e-bb67-99d3af148542 admin admin] The token cache is being invalidate because project f0ab86b2728e442997d0ff3bcdfa7eb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:57:23.770023 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-59a0f829-d4be-4b6e-bb67-99d3af148542 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:23.774353 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-59a0f829-d4be-4b6e-bb67-99d3af148542 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:23.780557 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2262/4507] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:57:23 2022] DELETE /identity/v3/projects/f0ab86b2728e442997d0ff3bcdfa7eb0 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:57:23.785135 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ece96-4c88-49ea-827f-db7bc36480c0 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:23.785953 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ece96-4c88-49ea-827f-db7bc36480c0 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:23.785953 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ece96-4c88-49ea-827f-db7bc36480c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:23.837736 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-f98ece96-4c88-49ea-827f-db7bc36480c0 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:23.840452 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f98ece96-4c88-49ea-827f-db7bc36480c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:24.111264 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2246/4508] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:57:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:57:24.120429 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc8ce9-9c2f-49e1-ad34-6738f38b4b86 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:24.120967 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc8ce9-9c2f-49e1-ad34-6738f38b4b86 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:24.121479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc8ce9-9c2f-49e1-ad34-6738f38b4b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:24.142988 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:24.236979 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-dccc8ce9-9c2f-49e1-ad34-6738f38b4b86 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:24.238132 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-dccc8ce9-9c2f-49e1-ad34-6738f38b4b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:24.282389 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2263/4509] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:57:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:57:24.284664 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98ece96-4c88-49ea-827f-db7bc36480c0 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:24.317432 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98ece96-4c88-49ea-827f-db7bc36480c0 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:24.355350 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ec71d-1a3f-45b6-ba7d-33c7db309f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:24.358327 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ec71d-1a3f-45b6-ba7d-33c7db309f39 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:24.360162 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ec71d-1a3f-45b6-ba7d-33c7db309f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:24.361185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ec71d-1a3f-45b6-ba7d-33c7db309f39 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:24.363719 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ec71d-1a3f-45b6-ba7d-33c7db309f39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:57:24.368782 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ec71d-1a3f-45b6-ba7d-33c7db309f39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:24.386367 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ec71d-1a3f-45b6-ba7d-33c7db309f39 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:24.404780 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:24.447336 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2247/4510] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:57:24.449518 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc8ce9-9c2f-49e1-ad34-6738f38b4b86 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:24.461073 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc8ce9-9c2f-49e1-ad34-6738f38b4b86 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:24.533892 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e452538-c2fa-47ee-8225-18fd63a23001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:24.534549 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e452538-c2fa-47ee-8225-18fd63a23001 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:24.534923 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e452538-c2fa-47ee-8225-18fd63a23001 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:24.535130 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e452538-c2fa-47ee-8225-18fd63a23001 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:24.535775 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e452538-c2fa-47ee-8225-18fd63a23001 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:24.555579 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e452538-c2fa-47ee-8225-18fd63a23001 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:24.631697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1b90b-4842-4d34-b8b0-52feda91e68d None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:24.632221 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1b90b-4842-4d34-b8b0-52feda91e68d None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:24.632631 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1b90b-4842-4d34-b8b0-52feda91e68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:24.691592 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2264/4511] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:57:24 2022] POST /identity/v3/projects => generated 373 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:57:24.694754 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e452538-c2fa-47ee-8225-18fd63a23001 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:24.737997 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-ecc1b90b-4842-4d34-b8b0-52feda91e68d None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:24.739243 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ecc1b90b-4842-4d34-b8b0-52feda91e68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:24.950985 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e452538-c2fa-47ee-8225-18fd63a23001 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:24.957172 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8a531-743e-40a2-bd23-fefe6db246e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:24.958064 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8a531-743e-40a2-bd23-fefe6db246e5 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:24.959192 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8a531-743e-40a2-bd23-fefe6db246e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:24.959741 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8a531-743e-40a2-bd23-fefe6db246e5 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:24.960701 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f8a531-743e-40a2-bd23-fefe6db246e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:24.964149 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f8a531-743e-40a2-bd23-fefe6db246e5 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:25.027830 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2248/4512] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 15:57:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:57:25.030433 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2265/4513] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:57:24 2022] POST /identity/v3/users => generated 287 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:57:25.031292 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1b90b-4842-4d34-b8b0-52feda91e68d None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:25.070980 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1b90b-4842-4d34-b8b0-52feda91e68d None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:25.096038 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c990900c-da48-49b7-af0f-4ef3e716b4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:25.096850 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990900c-da48-49b7-af0f-4ef3e716b4a4 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:25.097331 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990900c-da48-49b7-af0f-4ef3e716b4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:25.097767 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990900c-da48-49b7-af0f-4ef3e716b4a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:25.099565 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c990900c-da48-49b7-af0f-4ef3e716b4a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:25.101513 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c990900c-da48-49b7-af0f-4ef3e716b4a4 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:25.125001 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2249/4514] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:57:25.128790 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8a531-743e-40a2-bd23-fefe6db246e5 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:25.144982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8a531-743e-40a2-bd23-fefe6db246e5 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:25.155296 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c990900c-da48-49b7-af0f-4ef3e716b4a4 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:25.159315 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c990900c-da48-49b7-af0f-4ef3e716b4a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:25.186835 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c4867-7df5-4b3a-838c-c7bcdb9e20c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:25.187566 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c4867-7df5-4b3a-838c-c7bcdb9e20c0 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:25.192232 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c4867-7df5-4b3a-838c-c7bcdb9e20c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:25.193277 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c4867-7df5-4b3a-838c-c7bcdb9e20c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:25.197141 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c4867-7df5-4b3a-838c-c7bcdb9e20c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:25.198970 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c4867-7df5-4b3a-838c-c7bcdb9e20c0 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:25.246739 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2266/4515] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:57:25.248282 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c4867-7df5-4b3a-838c-c7bcdb9e20c0 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:25.268489 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c4867-7df5-4b3a-838c-c7bcdb9e20c0 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:25.283828 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd554d8c-4eb4-4d07-9ec6-ea42b074b8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:25.284510 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd554d8c-4eb4-4d07-9ec6-ea42b074b8ed admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:25.284793 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd554d8c-4eb4-4d07-9ec6-ea42b074b8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:25.285049 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd554d8c-4eb4-4d07-9ec6-ea42b074b8ed admin admin] PATH_INFO: `/v3/projects/69ee2f781cc3421cae5fbfa840d832fc/users/a7b7e8438b7e42b48aa9b0485bd12a4c/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:25.315991 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd554d8c-4eb4-4d07-9ec6-ea42b074b8ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=69ee2f781cc3421cae5fbfa840d832fc, user_id=a7b7e8438b7e42b48aa9b0485bd12a4c, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:25.322022 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd554d8c-4eb4-4d07-9ec6-ea42b074b8ed admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:25.360637 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c990900c-da48-49b7-af0f-4ef3e716b4a4 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:25.365668 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2267/4516] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:57:25 2022] PUT /identity/v3/projects/69ee2f781cc3421cae5fbfa840d832fc/users/a7b7e8438b7e42b48aa9b0485bd12a4c/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:57:25.376853 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015a7a9-8fd0-4746-a0d7-c6b392932cac None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:25.377138 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015a7a9-8fd0-4746-a0d7-c6b392932cac None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:25.377530 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015a7a9-8fd0-4746-a0d7-c6b392932cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:25.483512 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-8015a7a9-8fd0-4746-a0d7-c6b392932cac None None] MFA Rules not processed for user `a7b7e8438b7e42b48aa9b0485bd12a4c`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:25.484855 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8015a7a9-8fd0-4746-a0d7-c6b392932cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:25.577419 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043037c-c512-435e-bd96-6458ca5f2514 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:25.578333 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043037c-c512-435e-bd96-6458ca5f2514 service swift] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:25.578597 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043037c-c512-435e-bd96-6458ca5f2514 service swift] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:25.578921 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043037c-c512-435e-bd96-6458ca5f2514 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:25.688738 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:25.785785 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043037c-c512-435e-bd96-6458ca5f2514 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:25.788484 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043037c-c512-435e-bd96-6458ca5f2514 service swift] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:25.811100 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2250/4517] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 15:57:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 656 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:57:25.818677 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2268/4518] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:57:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:57:25.901941 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043037c-c512-435e-bd96-6458ca5f2514 service swift] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:25.909112 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7043037c-c512-435e-bd96-6458ca5f2514 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:26.239196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043037c-c512-435e-bd96-6458ca5f2514 service swift] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:26.280585 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744104b-254b-4c38-8083-fca8284d5f46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:26.281247 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744104b-254b-4c38-8083-fca8284d5f46 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:26.281550 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744104b-254b-4c38-8083-fca8284d5f46 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:26.281824 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744104b-254b-4c38-8083-fca8284d5f46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:26.330916 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744104b-254b-4c38-8083-fca8284d5f46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:26.340380 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744104b-254b-4c38-8083-fca8284d5f46 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:26.395505 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2251/4519] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:57:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:57:35.803719 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=87,keystone:INSERT=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:36.367619 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=38 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:39.306048 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8015a7a9-8fd0-4746-a0d7-c6b392932cac None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:39.307938 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8015a7a9-8fd0-4746-a0d7-c6b392932cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:39.444005 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8015a7a9-8fd0-4746-a0d7-c6b392932cac None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:39.451016 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9529e7cf-69cb-4ad1-a8ed-07334e8f16fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:39.452412 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9529e7cf-69cb-4ad1-a8ed-07334e8f16fe service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:39.452842 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9529e7cf-69cb-4ad1-a8ed-07334e8f16fe service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:39.453256 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9529e7cf-69cb-4ad1-a8ed-07334e8f16fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:39.456979 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9529e7cf-69cb-4ad1-a8ed-07334e8f16fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:39.484382 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9529e7cf-69cb-4ad1-a8ed-07334e8f16fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:39.486411 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9529e7cf-69cb-4ad1-a8ed-07334e8f16fe service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:39.501123 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2269/4520] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:57:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:57:47.454916 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744104b-254b-4c38-8083-fca8284d5f46 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:47.558723 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744104b-254b-4c38-8083-fca8284d5f46 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:47.563762 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e4f73-e57b-46e1-a9db-792c1de5b6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:47.564430 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e4f73-e57b-46e1-a9db-792c1de5b6f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:47.564877 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e4f73-e57b-46e1-a9db-792c1de5b6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:47.565318 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e4f73-e57b-46e1-a9db-792c1de5b6f8 admin admin] PATH_INFO: `/v3/users/a7b7e8438b7e42b48aa9b0485bd12a4c` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:47.566977 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e4f73-e57b-46e1-a9db-792c1de5b6f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7b7e8438b7e42b48aa9b0485bd12a4c)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:47.570005 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e4f73-e57b-46e1-a9db-792c1de5b6f8 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:47.640489 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fe7e4f73-e57b-46e1-a9db-792c1de5b6f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7b7e8438b7e42b48aa9b0485bd12a4c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:47.641342 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fe7e4f73-e57b-46e1-a9db-792c1de5b6f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7b7e8438b7e42b48aa9b0485bd12a4c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:47.652617 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fe7e4f73-e57b-46e1-a9db-792c1de5b6f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7b7e8438b7e42b48aa9b0485bd12a4c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:47.663880 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fe7e4f73-e57b-46e1-a9db-792c1de5b6f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7b7e8438b7e42b48aa9b0485bd12a4c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:47.664590 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fe7e4f73-e57b-46e1-a9db-792c1de5b6f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7b7e8438b7e42b48aa9b0485bd12a4c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:47.697254 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2252/4521] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:57:47 2022] DELETE /identity/v3/users/a7b7e8438b7e42b48aa9b0485bd12a4c => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:57:47.698597 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9970c8a-5960-4a47-bede-57b847d798ce None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:47.699111 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9970c8a-5960-4a47-bede-57b847d798ce None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:47.699212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9970c8a-5960-4a47-bede-57b847d798ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:47.769622 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-a9970c8a-5960-4a47-bede-57b847d798ce None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:47.771598 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a9970c8a-5960-4a47-bede-57b847d798ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:47.859905 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2270/4522] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:57:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:57:47.870180 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e4f73-e57b-46e1-a9db-792c1de5b6f8 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:47.871767 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-fe7e4f73-e57b-46e1-a9db-792c1de5b6f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:47.953308 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e4f73-e57b-46e1-a9db-792c1de5b6f8 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:47.958609 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ddef72-894f-4c84-a296-c24398e247be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:47.960219 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddef72-894f-4c84-a296-c24398e247be service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:47.960504 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddef72-894f-4c84-a296-c24398e247be service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:47.960780 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddef72-894f-4c84-a296-c24398e247be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:47.971331 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ddef72-894f-4c84-a296-c24398e247be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:47.972779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ddef72-894f-4c84-a296-c24398e247be service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:47.983672 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2253/4523] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:57:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:57:48.231782 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9970c8a-5960-4a47-bede-57b847d798ce None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:48.236215 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a9970c8a-5960-4a47-bede-57b847d798ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:48.283119 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9970c8a-5960-4a47-bede-57b847d798ce None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:48.304918 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfff9ff-4c4d-4ee7-9db1-0a2c5fba0107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:48.320098 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfff9ff-4c4d-4ee7-9db1-0a2c5fba0107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:48.321013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfff9ff-4c4d-4ee7-9db1-0a2c5fba0107 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:48.323458 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfff9ff-4c4d-4ee7-9db1-0a2c5fba0107 admin admin] PATH_INFO: `/v3/projects/69ee2f781cc3421cae5fbfa840d832fc` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:48.325209 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfff9ff-4c4d-4ee7-9db1-0a2c5fba0107 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69ee2f781cc3421cae5fbfa840d832fc)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:48.327593 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfff9ff-4c4d-4ee7-9db1-0a2c5fba0107 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:48.399972 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7bfff9ff-4c4d-4ee7-9db1-0a2c5fba0107 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69ee2f781cc3421cae5fbfa840d832fc', 'request_id': 'req-7bfff9ff-4c4d-4ee7-9db1-0a2c5fba0107'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:48.407928 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7bfff9ff-4c4d-4ee7-9db1-0a2c5fba0107 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69ee2f781cc3421cae5fbfa840d832fc', 'request_id': 'req-7bfff9ff-4c4d-4ee7-9db1-0a2c5fba0107'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:48.421258 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7bfff9ff-4c4d-4ee7-9db1-0a2c5fba0107 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69ee2f781cc3421cae5fbfa840d832fc', 'request_id': 'req-7bfff9ff-4c4d-4ee7-9db1-0a2c5fba0107'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:48.450415 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7bfff9ff-4c4d-4ee7-9db1-0a2c5fba0107 admin admin] The token cache is being invalidate because project 69ee2f781cc3421cae5fbfa840d832fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:57:48.450750 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7bfff9ff-4c4d-4ee7-9db1-0a2c5fba0107 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:48.451561 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7bfff9ff-4c4d-4ee7-9db1-0a2c5fba0107 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:48.457620 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2271/4524] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:57:48 2022] DELETE /identity/v3/projects/69ee2f781cc3421cae5fbfa840d832fc => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:57:48.460897 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43331723-500d-4fed-b096-0f24bd61b8c2 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:48.461382 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43331723-500d-4fed-b096-0f24bd61b8c2 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:48.462175 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43331723-500d-4fed-b096-0f24bd61b8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:48.505417 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-43331723-500d-4fed-b096-0f24bd61b8c2 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:48.506722 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-43331723-500d-4fed-b096-0f24bd61b8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:48.534551 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:48.590578 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2254/4525] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:57:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:57:48.600381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46391b75-4dd3-41ca-bb93-27e1d8ca152c None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:48.600677 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46391b75-4dd3-41ca-bb93-27e1d8ca152c None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:48.600952 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46391b75-4dd3-41ca-bb93-27e1d8ca152c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:48.644008 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-46391b75-4dd3-41ca-bb93-27e1d8ca152c None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:48.645654 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-46391b75-4dd3-41ca-bb93-27e1d8ca152c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:48.655438 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2272/4526] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:57:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:57:48.659710 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43331723-500d-4fed-b096-0f24bd61b8c2 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:48.672615 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43331723-500d-4fed-b096-0f24bd61b8c2 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:48.678354 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d552a-9565-4ac6-8e87-2bae65e1f2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:48.678987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d552a-9565-4ac6-8e87-2bae65e1f2f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:48.679311 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d552a-9565-4ac6-8e87-2bae65e1f2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:48.679584 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d552a-9565-4ac6-8e87-2bae65e1f2f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:48.680243 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07d552a-9565-4ac6-8e87-2bae65e1f2f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:57:48.680598 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07d552a-9565-4ac6-8e87-2bae65e1f2f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:48.682312 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07d552a-9565-4ac6-8e87-2bae65e1f2f1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:48.698235 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2255/4527] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:57:48.701981 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46391b75-4dd3-41ca-bb93-27e1d8ca152c None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:48.707174 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:48.713771 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46391b75-4dd3-41ca-bb93-27e1d8ca152c None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:48.736728 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94d846-43d6-40dc-b48c-a1a19883f816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:48.742606 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94d846-43d6-40dc-b48c-a1a19883f816 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:48.743628 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94d846-43d6-40dc-b48c-a1a19883f816 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:48.745233 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94d846-43d6-40dc-b48c-a1a19883f816 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:48.746532 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94d846-43d6-40dc-b48c-a1a19883f816 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:48.752363 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94d846-43d6-40dc-b48c-a1a19883f816 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:48.836389 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2273/4528] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:57:48 2022] POST /identity/v3/projects => generated 357 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:57:48.840499 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d552a-9565-4ac6-8e87-2bae65e1f2f1 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:48.855293 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d552a-9565-4ac6-8e87-2bae65e1f2f1 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:48.956181 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be05ade-8d79-4486-8c1f-9f3582e36344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:48.956828 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be05ade-8d79-4486-8c1f-9f3582e36344 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:48.957112 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be05ade-8d79-4486-8c1f-9f3582e36344 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:48.957386 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be05ade-8d79-4486-8c1f-9f3582e36344 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:48.958568 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be05ade-8d79-4486-8c1f-9f3582e36344 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:48.961789 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be05ade-8d79-4486-8c1f-9f3582e36344 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:49.006311 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2256/4529] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:57:48 2022] POST /identity/v3/users => generated 279 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:57:49.009156 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94d846-43d6-40dc-b48c-a1a19883f816 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:49.043907 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94d846-43d6-40dc-b48c-a1a19883f816 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:49.063727 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a5fef8-04e0-41af-b7a0-2abcabecb876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:49.064683 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5fef8-04e0-41af-b7a0-2abcabecb876 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:49.065485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5fef8-04e0-41af-b7a0-2abcabecb876 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:49.066446 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5fef8-04e0-41af-b7a0-2abcabecb876 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:49.067166 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a5fef8-04e0-41af-b7a0-2abcabecb876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:49.071840 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a5fef8-04e0-41af-b7a0-2abcabecb876 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:49.088068 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2274/4530] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:57:49.091733 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be05ade-8d79-4486-8c1f-9f3582e36344 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:49.106192 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be05ade-8d79-4486-8c1f-9f3582e36344 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:49.111992 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15eed0-f806-45f5-a5bd-612844abc6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:49.113128 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15eed0-f806-45f5-a5bd-612844abc6b1 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:49.113633 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15eed0-f806-45f5-a5bd-612844abc6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:49.114704 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15eed0-f806-45f5-a5bd-612844abc6b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:49.116075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad15eed0-f806-45f5-a5bd-612844abc6b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:49.118191 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad15eed0-f806-45f5-a5bd-612844abc6b1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:49.135991 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2257/4531] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:57:49.137229 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a5fef8-04e0-41af-b7a0-2abcabecb876 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:49.150403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a5fef8-04e0-41af-b7a0-2abcabecb876 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:49.172066 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d2ce6-4fe9-4db3-bc2f-5b515cebdcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:49.172745 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d2ce6-4fe9-4db3-bc2f-5b515cebdcfe admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:49.173033 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d2ce6-4fe9-4db3-bc2f-5b515cebdcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:49.173849 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d2ce6-4fe9-4db3-bc2f-5b515cebdcfe admin admin] PATH_INFO: `/v3/projects/b49b3e124a8a40a2a8d318d9672256a3/users/472a7e8975694343aed932f0913b96dd/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:49.213434 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d2ce6-4fe9-4db3-bc2f-5b515cebdcfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=b49b3e124a8a40a2a8d318d9672256a3, user_id=472a7e8975694343aed932f0913b96dd, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:49.216158 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d2ce6-4fe9-4db3-bc2f-5b515cebdcfe admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:49.256464 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2275/4532] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:57:49 2022] PUT /identity/v3/projects/b49b3e124a8a40a2a8d318d9672256a3/users/472a7e8975694343aed932f0913b96dd/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:57:49.258262 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60c65a-d308-4a73-82d7-1028fe2a3d35 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:49.258742 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60c65a-d308-4a73-82d7-1028fe2a3d35 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:49.259053 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60c65a-d308-4a73-82d7-1028fe2a3d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:49.344908 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-ed60c65a-d308-4a73-82d7-1028fe2a3d35 None None] MFA Rules not processed for user `472a7e8975694343aed932f0913b96dd`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:49.346193 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ed60c65a-d308-4a73-82d7-1028fe2a3d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:49.466597 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2258/4533] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:57:49 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:57:49.467655 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d2ce6-4fe9-4db3-bc2f-5b515cebdcfe admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:49.577156 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d2ce6-4fe9-4db3-bc2f-5b515cebdcfe admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:49.584861 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906cf018-62a7-4173-93c6-3bc10ea806e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:49.586032 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906cf018-62a7-4173-93c6-3bc10ea806e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:49.586317 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906cf018-62a7-4173-93c6-3bc10ea806e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:49.586593 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906cf018-62a7-4173-93c6-3bc10ea806e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:49.587600 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906cf018-62a7-4173-93c6-3bc10ea806e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:49.591838 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906cf018-62a7-4173-93c6-3bc10ea806e7 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:49.632050 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2276/4534] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:57:49 2022] POST /identity/v3/projects => generated 355 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:57:49.635735 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60c65a-d308-4a73-82d7-1028fe2a3d35 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:49.648346 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60c65a-d308-4a73-82d7-1028fe2a3d35 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:49.662483 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:49.738075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d15e69-8c20-410b-b301-e44dbb5afcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:49.738708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d15e69-8c20-410b-b301-e44dbb5afcd6 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:49.738983 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d15e69-8c20-410b-b301-e44dbb5afcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:49.739313 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d15e69-8c20-410b-b301-e44dbb5afcd6 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:49.743132 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d15e69-8c20-410b-b301-e44dbb5afcd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:49.743132 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d15e69-8c20-410b-b301-e44dbb5afcd6 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:49.767602 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2259/4535] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:57:49 2022] POST /identity/v3/users => generated 284 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:57:49.772056 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906cf018-62a7-4173-93c6-3bc10ea806e7 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:49.812250 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906cf018-62a7-4173-93c6-3bc10ea806e7 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:49.819094 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c767d0-aa75-4f25-8c12-89bcc7ee9328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:49.819670 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c767d0-aa75-4f25-8c12-89bcc7ee9328 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:49.819947 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c767d0-aa75-4f25-8c12-89bcc7ee9328 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:49.820263 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c767d0-aa75-4f25-8c12-89bcc7ee9328 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:49.820926 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c767d0-aa75-4f25-8c12-89bcc7ee9328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:49.822622 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c767d0-aa75-4f25-8c12-89bcc7ee9328 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:49.846394 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2277/4536] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:57:49.851416 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d15e69-8c20-410b-b301-e44dbb5afcd6 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:49.866060 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d15e69-8c20-410b-b301-e44dbb5afcd6 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:49.881512 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89766c2c-bf74-40e1-85ef-5d50665215c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:49.882222 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89766c2c-bf74-40e1-85ef-5d50665215c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:49.882500 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89766c2c-bf74-40e1-85ef-5d50665215c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:49.882769 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89766c2c-bf74-40e1-85ef-5d50665215c6 admin admin] PATH_INFO: `/v3/projects/df2388e062ba432ba8e82c53e704d6ed/users/b48e1046b1aa4c45b8ae3b85f1ce67b9/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:49.923681 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89766c2c-bf74-40e1-85ef-5d50665215c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df2388e062ba432ba8e82c53e704d6ed, user_id=b48e1046b1aa4c45b8ae3b85f1ce67b9, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:49.926534 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89766c2c-bf74-40e1-85ef-5d50665215c6 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:49.953433 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2260/4537] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:57:49 2022] PUT /identity/v3/projects/df2388e062ba432ba8e82c53e704d6ed/users/b48e1046b1aa4c45b8ae3b85f1ce67b9/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:57:49.959210 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c767d0-aa75-4f25-8c12-89bcc7ee9328 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:49.971233 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c767d0-aa75-4f25-8c12-89bcc7ee9328 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:50.104232 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b547ddc-4e23-4ad9-84cf-3c68a2c7a005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:50.104902 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b547ddc-4e23-4ad9-84cf-3c68a2c7a005 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:50.105102 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b547ddc-4e23-4ad9-84cf-3c68a2c7a005 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:50.105372 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b547ddc-4e23-4ad9-84cf-3c68a2c7a005 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:50.106029 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b547ddc-4e23-4ad9-84cf-3c68a2c7a005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:50.118499 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b547ddc-4e23-4ad9-84cf-3c68a2c7a005 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:50.145041 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20daec-f4e0-4369-b8f6-6442ca13d361 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:50.145342 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20daec-f4e0-4369-b8f6-6442ca13d361 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:50.145937 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20daec-f4e0-4369-b8f6-6442ca13d361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:50.158118 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2278/4538] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:57:50.159362 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b547ddc-4e23-4ad9-84cf-3c68a2c7a005 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:50.185585 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-5f20daec-f4e0-4369-b8f6-6442ca13d361 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:50.187182 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5f20daec-f4e0-4369-b8f6-6442ca13d361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:50.195587 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b547ddc-4e23-4ad9-84cf-3c68a2c7a005 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:50.210119 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde55280-13c1-4da8-9fcf-4823a881fb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:50.210898 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde55280-13c1-4da8-9fcf-4823a881fb6e admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:50.211205 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde55280-13c1-4da8-9fcf-4823a881fb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:50.211479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde55280-13c1-4da8-9fcf-4823a881fb6e admin admin] PATH_INFO: `/v3/projects/df2388e062ba432ba8e82c53e704d6ed/users/b48e1046b1aa4c45b8ae3b85f1ce67b9/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:50.217508 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde55280-13c1-4da8-9fcf-4823a881fb6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=df2388e062ba432ba8e82c53e704d6ed, user_id=b48e1046b1aa4c45b8ae3b85f1ce67b9, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:50.230250 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde55280-13c1-4da8-9fcf-4823a881fb6e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:50.233009 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:50.258125 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2279/4539] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:57:50 2022] PUT /identity/v3/projects/df2388e062ba432ba8e82c53e704d6ed/users/b48e1046b1aa4c45b8ae3b85f1ce67b9/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:57:50.259758 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e7e5c-6d4e-4f96-9784-b881f5c408b4 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:50.260282 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e7e5c-6d4e-4f96-9784-b881f5c408b4 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:50.260282 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e7e5c-6d4e-4f96-9784-b881f5c408b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:50.296249 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-708e7e5c-6d4e-4f96-9784-b881f5c408b4 None None] MFA Rules not processed for user `b48e1046b1aa4c45b8ae3b85f1ce67b9`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:50.297477 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-708e7e5c-6d4e-4f96-9784-b881f5c408b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:50.376695 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2261/4540] 10.222.0.83 () {58 vars in 967 bytes} [Mon Aug 29 15:57:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:57:50.393062 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20daec-f4e0-4369-b8f6-6442ca13d361 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:50.394672 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5f20daec-f4e0-4369-b8f6-6442ca13d361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:50.438667 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2280/4541] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:57:50 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:57:50.448864 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e7e5c-6d4e-4f96-9784-b881f5c408b4 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:50.450674 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-708e7e5c-6d4e-4f96-9784-b881f5c408b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:50.608102 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20daec-f4e0-4369-b8f6-6442ca13d361 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:50.616158 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e7e5c-6d4e-4f96-9784-b881f5c408b4 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:50.626361 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bfafa8-3490-43ef-a5b9-5fbf9ad74ad7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:50.627781 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfafa8-3490-43ef-a5b9-5fbf9ad74ad7 service cinder] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:50.630671 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfafa8-3490-43ef-a5b9-5fbf9ad74ad7 service cinder] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:50.631084 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfafa8-3490-43ef-a5b9-5fbf9ad74ad7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:50.672447 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bfafa8-3490-43ef-a5b9-5fbf9ad74ad7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:50.675504 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bfafa8-3490-43ef-a5b9-5fbf9ad74ad7 service cinder] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:50.707334 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2281/4542] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:57:50 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:57:50.733476 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:50.862831 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2586d3-fa5f-4002-ab4a-70049598ea99 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:50.863627 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2586d3-fa5f-4002-ab4a-70049598ea99 service swift] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:50.864008 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2586d3-fa5f-4002-ab4a-70049598ea99 service swift] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:50.864780 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2586d3-fa5f-4002-ab4a-70049598ea99 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:50.935763 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bfafa8-3490-43ef-a5b9-5fbf9ad74ad7 service cinder] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:50.951626 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bfafa8-3490-43ef-a5b9-5fbf9ad74ad7 service cinder] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:50.963858 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16526e7-b021-4492-a7ce-e642296da357 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:50.964637 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16526e7-b021-4492-a7ce-e642296da357 service cinder] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:50.964949 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16526e7-b021-4492-a7ce-e642296da357 service cinder] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:50.965275 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16526e7-b021-4492-a7ce-e642296da357 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:50.975816 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2586d3-fa5f-4002-ab4a-70049598ea99 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:50.978290 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2586d3-fa5f-4002-ab4a-70049598ea99 service swift] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:50.994789 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2262/4543] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 15:57:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 15:57:51.082223 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16526e7-b021-4492-a7ce-e642296da357 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:51.084813 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16526e7-b021-4492-a7ce-e642296da357 service cinder] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:51.118503 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2282/4544] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:57:50 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:57:51.731325 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2586d3-fa5f-4002-ab4a-70049598ea99 service swift] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:51.732942 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ab2586d3-fa5f-4002-ab4a-70049598ea99 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:51.803149 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2586d3-fa5f-4002-ab4a-70049598ea99 service swift] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:51.806997 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daedf9f-f08b-45fc-8864-2fe469f29b7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:51.807677 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daedf9f-f08b-45fc-8864-2fe469f29b7c service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:51.808135 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daedf9f-f08b-45fc-8864-2fe469f29b7c service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:51.808411 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daedf9f-f08b-45fc-8864-2fe469f29b7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:51.810219 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9daedf9f-f08b-45fc-8864-2fe469f29b7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:51.899912 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daedf9f-f08b-45fc-8864-2fe469f29b7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:51.901283 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daedf9f-f08b-45fc-8864-2fe469f29b7c service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:51.915460 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2263/4545] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:57:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:57:52.508470 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16526e7-b021-4492-a7ce-e642296da357 service cinder] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:52.513076 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b16526e7-b021-4492-a7ce-e642296da357 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:52.536490 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16526e7-b021-4492-a7ce-e642296da357 service cinder] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:52.547921 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1663e8c-e4fa-49f9-aba0-adff580ff501 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:52.548567 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1663e8c-e4fa-49f9-aba0-adff580ff501 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:52.548964 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1663e8c-e4fa-49f9-aba0-adff580ff501 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:52.549262 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1663e8c-e4fa-49f9-aba0-adff580ff501 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:52.556938 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c1663e8c-e4fa-49f9-aba0-adff580ff501 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:52.576022 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1663e8c-e4fa-49f9-aba0-adff580ff501 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:52.577853 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1663e8c-e4fa-49f9-aba0-adff580ff501 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:52.592293 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2283/4546] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:57:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:58:00.717198 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daedf9f-f08b-45fc-8864-2fe469f29b7c service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:00.718690 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9daedf9f-f08b-45fc-8864-2fe469f29b7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:00.750633 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:00.879519 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daedf9f-f08b-45fc-8864-2fe469f29b7c service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:00.904409 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f66a4-dc3d-42a5-877c-91e4aea80a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:00.905278 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f66a4-dc3d-42a5-877c-91e4aea80a3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:00.905590 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f66a4-dc3d-42a5-877c-91e4aea80a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:00.906368 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f66a4-dc3d-42a5-877c-91e4aea80a3f admin admin] PATH_INFO: `/v3/users/0edd0924049f4e859670dabdd0bfe597` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:00.910282 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f66a4-dc3d-42a5-877c-91e4aea80a3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0edd0924049f4e859670dabdd0bfe597)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:00.912732 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f66a4-dc3d-42a5-877c-91e4aea80a3f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:01.009480 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ba9f66a4-dc3d-42a5-877c-91e4aea80a3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0edd0924049f4e859670dabdd0bfe597'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:01.010239 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ba9f66a4-dc3d-42a5-877c-91e4aea80a3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0edd0924049f4e859670dabdd0bfe597'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:01.032676 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ba9f66a4-dc3d-42a5-877c-91e4aea80a3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0edd0924049f4e859670dabdd0bfe597'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:01.050800 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ba9f66a4-dc3d-42a5-877c-91e4aea80a3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0edd0924049f4e859670dabdd0bfe597'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:01.052121 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ba9f66a4-dc3d-42a5-877c-91e4aea80a3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0edd0924049f4e859670dabdd0bfe597'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:01.101845 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2264/4547] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:58:00 2022] DELETE /identity/v3/users/0edd0924049f4e859670dabdd0bfe597 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:01.104824 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be03fa-5d07-44a0-8df3-6441927e4097 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:01.105853 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be03fa-5d07-44a0-8df3-6441927e4097 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:01.106380 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be03fa-5d07-44a0-8df3-6441927e4097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:01.124536 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:01.139844 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-f2be03fa-5d07-44a0-8df3-6441927e4097 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:01.143820 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f2be03fa-5d07-44a0-8df3-6441927e4097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:01.256584 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2284/4548] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:58:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:01.271082 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f66a4-dc3d-42a5-877c-91e4aea80a3f admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:01.273116 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ba9f66a4-dc3d-42a5-877c-91e4aea80a3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:01.363157 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f66a4-dc3d-42a5-877c-91e4aea80a3f admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:01.368108 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27050431-e9d8-42e2-8a1a-f6a567872c9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:01.368884 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27050431-e9d8-42e2-8a1a-f6a567872c9a service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:01.369222 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27050431-e9d8-42e2-8a1a-f6a567872c9a service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:01.369497 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27050431-e9d8-42e2-8a1a-f6a567872c9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:01.380758 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27050431-e9d8-42e2-8a1a-f6a567872c9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:01.382359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27050431-e9d8-42e2-8a1a-f6a567872c9a service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:01.393481 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2265/4549] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:58:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:58:02.083539 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dd019-ac1a-45f8-8827-ffe8a9bac650 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:02.084171 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dd019-ac1a-45f8-8827-ffe8a9bac650 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:02.084689 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dd019-ac1a-45f8-8827-ffe8a9bac650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:02.149001 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-cc6dd019-ac1a-45f8-8827-ffe8a9bac650 None None] MFA Rules not processed for user `c1c8b71252e84112bb1fd0513cf49f69`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:02.155164 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-cc6dd019-ac1a-45f8-8827-ffe8a9bac650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:02.304960 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2285/4550] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:58:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:02.781906 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27050431-e9d8-42e2-8a1a-f6a567872c9a service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:02.783920 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-27050431-e9d8-42e2-8a1a-f6a567872c9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:02.809107 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27050431-e9d8-42e2-8a1a-f6a567872c9a service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:02.859623 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2da4f-634c-40b7-95b0-5ad4f4bf4b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:02.865456 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2da4f-634c-40b7-95b0-5ad4f4bf4b38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:02.866319 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2da4f-634c-40b7-95b0-5ad4f4bf4b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:02.866634 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2da4f-634c-40b7-95b0-5ad4f4bf4b38 admin admin] PATH_INFO: `/v3/projects/9ca8907c5d974aaba0dce4eee63e1984` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:02.876719 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b2da4f-634c-40b7-95b0-5ad4f4bf4b38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ca8907c5d974aaba0dce4eee63e1984)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:02.881543 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b2da4f-634c-40b7-95b0-5ad4f4bf4b38 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:02.981842 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:03.019499 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-87b2da4f-634c-40b7-95b0-5ad4f4bf4b38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ca8907c5d974aaba0dce4eee63e1984', 'request_id': 'req-87b2da4f-634c-40b7-95b0-5ad4f4bf4b38'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:03.032233 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-87b2da4f-634c-40b7-95b0-5ad4f4bf4b38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ca8907c5d974aaba0dce4eee63e1984', 'request_id': 'req-87b2da4f-634c-40b7-95b0-5ad4f4bf4b38'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:03.048115 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-87b2da4f-634c-40b7-95b0-5ad4f4bf4b38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ca8907c5d974aaba0dce4eee63e1984', 'request_id': 'req-87b2da4f-634c-40b7-95b0-5ad4f4bf4b38'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:03.075817 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-87b2da4f-634c-40b7-95b0-5ad4f4bf4b38 admin admin] The token cache is being invalidate because project 9ca8907c5d974aaba0dce4eee63e1984 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:58:03.076133 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-87b2da4f-634c-40b7-95b0-5ad4f4bf4b38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:03.091144 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-87b2da4f-634c-40b7-95b0-5ad4f4bf4b38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:03.091144 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2266/4551] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:58:02 2022] DELETE /identity/v3/projects/9ca8907c5d974aaba0dce4eee63e1984 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:03.091458 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56e8e8-7aa5-47ea-ad58-8a443df9ed03 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:03.091458 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56e8e8-7aa5-47ea-ad58-8a443df9ed03 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:03.091458 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56e8e8-7aa5-47ea-ad58-8a443df9ed03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:03.146757 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-5b56e8e8-7aa5-47ea-ad58-8a443df9ed03 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:03.148442 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5b56e8e8-7aa5-47ea-ad58-8a443df9ed03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:03.236983 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2286/4552] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:58:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:03.245822 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c2eae-1740-4ecd-9c25-224495c15212 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:03.246911 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c2eae-1740-4ecd-9c25-224495c15212 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:03.246911 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c2eae-1740-4ecd-9c25-224495c15212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:03.315655 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-ab4c2eae-1740-4ecd-9c25-224495c15212 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:03.319336 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ab4c2eae-1740-4ecd-9c25-224495c15212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:03.354657 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b56e8e8-7aa5-47ea-ad58-8a443df9ed03 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:03.357525 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2267/4553] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:58:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:03.373830 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b56e8e8-7aa5-47ea-ad58-8a443df9ed03 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:03.404160 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ed907-401a-4f06-897d-b4791285da11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:03.404806 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ed907-401a-4f06-897d-b4791285da11 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:03.405091 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ed907-401a-4f06-897d-b4791285da11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:03.405368 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ed907-401a-4f06-897d-b4791285da11 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:03.411381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ed907-401a-4f06-897d-b4791285da11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:58:03.411819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ed907-401a-4f06-897d-b4791285da11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:03.427267 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ed907-401a-4f06-897d-b4791285da11 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:03.485626 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2287/4554] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:58:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:58:03.487595 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c2eae-1740-4ecd-9c25-224495c15212 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:03.504510 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c2eae-1740-4ecd-9c25-224495c15212 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:03.522811 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d287d7-128d-4bc0-b5b1-02d95a068370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:03.523477 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d287d7-128d-4bc0-b5b1-02d95a068370 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:03.523756 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d287d7-128d-4bc0-b5b1-02d95a068370 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:03.526624 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d287d7-128d-4bc0-b5b1-02d95a068370 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:03.528041 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d287d7-128d-4bc0-b5b1-02d95a068370 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:03.529520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d287d7-128d-4bc0-b5b1-02d95a068370 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:03.614583 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2268/4555] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:58:03 2022] POST /identity/v3/projects => generated 361 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:58:03.616936 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ed907-401a-4f06-897d-b4791285da11 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:03.633215 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ed907-401a-4f06-897d-b4791285da11 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:03.710296 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:03.753926 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01116017-b879-491f-8920-69efabfe62dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:03.756580 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01116017-b879-491f-8920-69efabfe62dd admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:03.757034 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01116017-b879-491f-8920-69efabfe62dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:03.757479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01116017-b879-491f-8920-69efabfe62dd admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:03.758596 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01116017-b879-491f-8920-69efabfe62dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:03.761569 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01116017-b879-491f-8920-69efabfe62dd admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:03.795318 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2288/4556] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:58:03 2022] POST /identity/v3/users => generated 281 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:58:03.796074 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d287d7-128d-4bc0-b5b1-02d95a068370 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:03.811087 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d287d7-128d-4bc0-b5b1-02d95a068370 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:03.824458 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3782b-75f9-44b7-8c9f-933b71b5e080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:03.825475 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3782b-75f9-44b7-8c9f-933b71b5e080 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:03.826072 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3782b-75f9-44b7-8c9f-933b71b5e080 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:03.827435 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3782b-75f9-44b7-8c9f-933b71b5e080 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:03.828492 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c3782b-75f9-44b7-8c9f-933b71b5e080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:03.830562 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c3782b-75f9-44b7-8c9f-933b71b5e080 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:03.852721 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2269/4557] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:58:03.857405 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01116017-b879-491f-8920-69efabfe62dd admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:03.869169 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01116017-b879-491f-8920-69efabfe62dd admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:03.874484 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f020d74-83b3-4f19-bce8-46a577dc0792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:03.875320 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f020d74-83b3-4f19-bce8-46a577dc0792 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:03.875666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f020d74-83b3-4f19-bce8-46a577dc0792 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:03.876003 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f020d74-83b3-4f19-bce8-46a577dc0792 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:03.876774 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f020d74-83b3-4f19-bce8-46a577dc0792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:03.878495 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f020d74-83b3-4f19-bce8-46a577dc0792 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:03.895609 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2289/4558] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:58:03.899922 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3782b-75f9-44b7-8c9f-933b71b5e080 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:03.911514 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3782b-75f9-44b7-8c9f-933b71b5e080 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:03.920567 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893cf27-fbec-44cc-9890-4c88daabbc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:03.921512 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893cf27-fbec-44cc-9890-4c88daabbc14 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:03.922006 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893cf27-fbec-44cc-9890-4c88daabbc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:03.922604 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893cf27-fbec-44cc-9890-4c88daabbc14 admin admin] PATH_INFO: `/v3/projects/96ab564303004f67809d6939804f1f8e/users/c2dfea28cd0d4aa5a5f923a9ba74601f/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:03.940851 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3893cf27-fbec-44cc-9890-4c88daabbc14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96ab564303004f67809d6939804f1f8e, user_id=c2dfea28cd0d4aa5a5f923a9ba74601f, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:03.944600 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3893cf27-fbec-44cc-9890-4c88daabbc14 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:03.962284 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2270/4559] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:58:03 2022] PUT /identity/v3/projects/96ab564303004f67809d6939804f1f8e/users/c2dfea28cd0d4aa5a5f923a9ba74601f/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:03.972879 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009f48b-aa14-40fe-8fdb-48d672ada3f6 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:03.973227 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009f48b-aa14-40fe-8fdb-48d672ada3f6 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:03.973471 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009f48b-aa14-40fe-8fdb-48d672ada3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:04.011106 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-e009f48b-aa14-40fe-8fdb-48d672ada3f6 None None] MFA Rules not processed for user `c2dfea28cd0d4aa5a5f923a9ba74601f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:04.013239 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e009f48b-aa14-40fe-8fdb-48d672ada3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:04.094741 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2290/4560] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:58:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:04.124525 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893cf27-fbec-44cc-9890-4c88daabbc14 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:04.126983 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3893cf27-fbec-44cc-9890-4c88daabbc14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:04.220076 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893cf27-fbec-44cc-9890-4c88daabbc14 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:04.226514 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98689001-76e2-47c6-8dd4-97c5c0446f4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:04.227519 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98689001-76e2-47c6-8dd4-97c5c0446f4d service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:04.227798 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98689001-76e2-47c6-8dd4-97c5c0446f4d service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:04.228193 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98689001-76e2-47c6-8dd4-97c5c0446f4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:04.239203 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98689001-76e2-47c6-8dd4-97c5c0446f4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:04.240855 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98689001-76e2-47c6-8dd4-97c5c0446f4d service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:04.256268 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2271/4561] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:58:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:58:06.221424 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdcf0c1-66c7-4298-872f-5562a7688aa4 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:06.222292 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdcf0c1-66c7-4298-872f-5562a7688aa4 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:06.222731 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdcf0c1-66c7-4298-872f-5562a7688aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:06.265039 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-6bdcf0c1-66c7-4298-872f-5562a7688aa4 None None] MFA Rules not processed for user `58ddd1273ce749e29578db36d61ca07a`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:06.267801 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6bdcf0c1-66c7-4298-872f-5562a7688aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:06.416988 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2291/4562] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:58:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:10.900216 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98689001-76e2-47c6-8dd4-97c5c0446f4d service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:10.901848 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-98689001-76e2-47c6-8dd4-97c5c0446f4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:11.014909 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:11.063392 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98689001-76e2-47c6-8dd4-97c5c0446f4d service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:11.074913 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d136780-4606-4d0e-81ed-75ef22d776f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:11.075577 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d136780-4606-4d0e-81ed-75ef22d776f5 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:11.075912 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d136780-4606-4d0e-81ed-75ef22d776f5 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:11.076197 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d136780-4606-4d0e-81ed-75ef22d776f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:11.078815 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6d136780-4606-4d0e-81ed-75ef22d776f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:11.164742 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d136780-4606-4d0e-81ed-75ef22d776f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:11.167207 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d136780-4606-4d0e-81ed-75ef22d776f5 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:11.195088 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2272/4563] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:58:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:58:12.380986 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdcf0c1-66c7-4298-872f-5562a7688aa4 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:12.397249 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdcf0c1-66c7-4298-872f-5562a7688aa4 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:12.410609 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4458be2-79aa-4731-ad14-ca1abacb5a13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:12.411612 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4458be2-79aa-4731-ad14-ca1abacb5a13 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:12.412310 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4458be2-79aa-4731-ad14-ca1abacb5a13 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:12.413077 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4458be2-79aa-4731-ad14-ca1abacb5a13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:12.415971 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e4458be2-79aa-4731-ad14-ca1abacb5a13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:12.434328 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4458be2-79aa-4731-ad14-ca1abacb5a13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:12.437016 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4458be2-79aa-4731-ad14-ca1abacb5a13 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:12.451514 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2292/4564] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:58:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:58:20.756607 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d136780-4606-4d0e-81ed-75ef22d776f5 service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:20.879315 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d136780-4606-4d0e-81ed-75ef22d776f5 service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:20.892439 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f145a-19ce-4357-87a4-18154015fa97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:20.894221 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f145a-19ce-4357-87a4-18154015fa97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:20.894696 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f145a-19ce-4357-87a4-18154015fa97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:20.895998 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f145a-19ce-4357-87a4-18154015fa97 admin admin] PATH_INFO: `/v3/users/c2dfea28cd0d4aa5a5f923a9ba74601f` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:20.912740 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381f145a-19ce-4357-87a4-18154015fa97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2dfea28cd0d4aa5a5f923a9ba74601f)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:20.917147 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381f145a-19ce-4357-87a4-18154015fa97 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:21.037211 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-381f145a-19ce-4357-87a4-18154015fa97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2dfea28cd0d4aa5a5f923a9ba74601f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:21.038272 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-381f145a-19ce-4357-87a4-18154015fa97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2dfea28cd0d4aa5a5f923a9ba74601f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:21.056557 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-381f145a-19ce-4357-87a4-18154015fa97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2dfea28cd0d4aa5a5f923a9ba74601f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:21.067905 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-381f145a-19ce-4357-87a4-18154015fa97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2dfea28cd0d4aa5a5f923a9ba74601f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:21.069874 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-381f145a-19ce-4357-87a4-18154015fa97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2dfea28cd0d4aa5a5f923a9ba74601f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:21.097664 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2273/4565] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:58:20 2022] DELETE /identity/v3/users/c2dfea28cd0d4aa5a5f923a9ba74601f => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:21.102998 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a2c37-6d23-4f0a-bf8b-6e91a263cb73 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:21.103508 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a2c37-6d23-4f0a-bf8b-6e91a263cb73 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:21.103618 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a2c37-6d23-4f0a-bf8b-6e91a263cb73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:21.136120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-c74a2c37-6d23-4f0a-bf8b-6e91a263cb73 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:21.137370 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c74a2c37-6d23-4f0a-bf8b-6e91a263cb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:21.256528 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:21.319423 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f145a-19ce-4357-87a4-18154015fa97 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:21.321314 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-381f145a-19ce-4357-87a4-18154015fa97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:21.350956 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2293/4566] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:58:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:21.352351 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a2c37-6d23-4f0a-bf8b-6e91a263cb73 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:21.355778 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c74a2c37-6d23-4f0a-bf8b-6e91a263cb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:21.375709 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:21.393291 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a2c37-6d23-4f0a-bf8b-6e91a263cb73 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:21.423059 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f11a7-0ee8-4324-9446-c841920b0a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:21.428733 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f11a7-0ee8-4324-9446-c841920b0a09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:21.429034 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f11a7-0ee8-4324-9446-c841920b0a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:21.429201 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f11a7-0ee8-4324-9446-c841920b0a09 admin admin] PATH_INFO: `/v3/users/472a7e8975694343aed932f0913b96dd` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:21.431881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f11a7-0ee8-4324-9446-c841920b0a09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=472a7e8975694343aed932f0913b96dd)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:21.437217 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f11a7-0ee8-4324-9446-c841920b0a09 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:21.549616 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f145a-19ce-4357-87a4-18154015fa97 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:21.559257 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01e402-d5dd-45a8-a594-8a3e1bf82048 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:21.560220 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01e402-d5dd-45a8-a594-8a3e1bf82048 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:21.560538 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01e402-d5dd-45a8-a594-8a3e1bf82048 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:21.560813 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01e402-d5dd-45a8-a594-8a3e1bf82048 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:21.572746 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-692f11a7-0ee8-4324-9446-c841920b0a09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '472a7e8975694343aed932f0913b96dd'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:21.573574 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-692f11a7-0ee8-4324-9446-c841920b0a09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '472a7e8975694343aed932f0913b96dd'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:21.595120 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd01e402-d5dd-45a8-a594-8a3e1bf82048 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:21.597039 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd01e402-d5dd-45a8-a594-8a3e1bf82048 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:21.609586 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-692f11a7-0ee8-4324-9446-c841920b0a09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '472a7e8975694343aed932f0913b96dd'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:21.642023 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-692f11a7-0ee8-4324-9446-c841920b0a09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '472a7e8975694343aed932f0913b96dd'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:21.645814 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2274/4567] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:58:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:58:21.662337 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-692f11a7-0ee8-4324-9446-c841920b0a09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '472a7e8975694343aed932f0913b96dd'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:21.683851 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a8060-a745-4933-99a6-f5fe7cef86e7 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:21.684044 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a8060-a745-4933-99a6-f5fe7cef86e7 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:21.684307 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a8060-a745-4933-99a6-f5fe7cef86e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:21.687008 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2294/4568] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:58:21 2022] DELETE /identity/v3/users/472a7e8975694343aed932f0913b96dd => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:21.709057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-835a8060-a745-4933-99a6-f5fe7cef86e7 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:21.710428 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-835a8060-a745-4933-99a6-f5fe7cef86e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:21.809795 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2275/4569] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:58:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:58:21.820616 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f11a7-0ee8-4324-9446-c841920b0a09 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:21.823655 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-692f11a7-0ee8-4324-9446-c841920b0a09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:21.975612 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f11a7-0ee8-4324-9446-c841920b0a09 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:21.987206 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef7c44a-64b3-45da-8f9c-93f5c64fabee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:21.987856 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7c44a-64b3-45da-8f9c-93f5c64fabee service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:21.988136 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7c44a-64b3-45da-8f9c-93f5c64fabee service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:21.988411 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7c44a-64b3-45da-8f9c-93f5c64fabee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:22.017317 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef7c44a-64b3-45da-8f9c-93f5c64fabee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:22.022806 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef7c44a-64b3-45da-8f9c-93f5c64fabee service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:22.062173 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2295/4570] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:58:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:58:22.183654 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a8060-a745-4933-99a6-f5fe7cef86e7 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:22.185178 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-835a8060-a745-4933-99a6-f5fe7cef86e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:22.209794 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a8060-a745-4933-99a6-f5fe7cef86e7 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:22.221767 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdbc58d-9f66-41d7-942d-99f8c441d7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:22.225139 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdbc58d-9f66-41d7-942d-99f8c441d7bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:22.225486 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdbc58d-9f66-41d7-942d-99f8c441d7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:22.225686 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdbc58d-9f66-41d7-942d-99f8c441d7bc admin admin] PATH_INFO: `/v3/projects/96ab564303004f67809d6939804f1f8e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:22.232585 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdbc58d-9f66-41d7-942d-99f8c441d7bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=96ab564303004f67809d6939804f1f8e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:22.236151 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdbc58d-9f66-41d7-942d-99f8c441d7bc admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:22.400578 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6bdbc58d-9f66-41d7-942d-99f8c441d7bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96ab564303004f67809d6939804f1f8e', 'request_id': 'req-6bdbc58d-9f66-41d7-942d-99f8c441d7bc'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:22.418032 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6bdbc58d-9f66-41d7-942d-99f8c441d7bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96ab564303004f67809d6939804f1f8e', 'request_id': 'req-6bdbc58d-9f66-41d7-942d-99f8c441d7bc'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:22.430697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6bdbc58d-9f66-41d7-942d-99f8c441d7bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96ab564303004f67809d6939804f1f8e', 'request_id': 'req-6bdbc58d-9f66-41d7-942d-99f8c441d7bc'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:22.465921 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6bdbc58d-9f66-41d7-942d-99f8c441d7bc admin admin] The token cache is being invalidate because project 96ab564303004f67809d6939804f1f8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:58:22.466180 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6bdbc58d-9f66-41d7-942d-99f8c441d7bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:22.466958 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6bdbc58d-9f66-41d7-942d-99f8c441d7bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:22.468861 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2276/4571] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:58:22 2022] DELETE /identity/v3/projects/96ab564303004f67809d6939804f1f8e => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:22.474271 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c52e4-becd-420f-9311-b81f8081b93d None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:22.476017 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c52e4-becd-420f-9311-b81f8081b93d None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:22.476017 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c52e4-becd-420f-9311-b81f8081b93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:22.522881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-d28c52e4-becd-420f-9311-b81f8081b93d None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:22.524279 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d28c52e4-becd-420f-9311-b81f8081b93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:22.590229 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:22.619646 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2296/4572] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:58:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:22.717843 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81be4b-de39-4234-9e46-d3523170d8c9 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:22.718125 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81be4b-de39-4234-9e46-d3523170d8c9 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:22.718402 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81be4b-de39-4234-9e46-d3523170d8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:22.748826 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-ce81be4b-de39-4234-9e46-d3523170d8c9 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:22.750357 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ce81be4b-de39-4234-9e46-d3523170d8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:22.763100 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2277/4573] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:58:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:22.765606 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28c52e4-becd-420f-9311-b81f8081b93d None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:22.778126 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28c52e4-becd-420f-9311-b81f8081b93d None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:22.784468 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4575dc8-6b52-45a0-b23e-51fb7ab139ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:22.785396 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4575dc8-6b52-45a0-b23e-51fb7ab139ae admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:22.785738 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4575dc8-6b52-45a0-b23e-51fb7ab139ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:22.786292 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4575dc8-6b52-45a0-b23e-51fb7ab139ae admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:22.787051 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4575dc8-6b52-45a0-b23e-51fb7ab139ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:58:22.787431 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4575dc8-6b52-45a0-b23e-51fb7ab139ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:22.789158 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4575dc8-6b52-45a0-b23e-51fb7ab139ae admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:22.807563 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2297/4574] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:58:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:58:22.814078 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81be4b-de39-4234-9e46-d3523170d8c9 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:22.825262 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81be4b-de39-4234-9e46-d3523170d8c9 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:22.838318 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b515e49-9254-4a7a-bced-355918cc5b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:22.838956 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b515e49-9254-4a7a-bced-355918cc5b51 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:22.839474 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b515e49-9254-4a7a-bced-355918cc5b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:22.839750 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b515e49-9254-4a7a-bced-355918cc5b51 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:22.840724 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b515e49-9254-4a7a-bced-355918cc5b51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:22.845197 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b515e49-9254-4a7a-bced-355918cc5b51 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:22.883934 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2278/4575] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:58:22 2022] POST /identity/v3/projects => generated 377 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:58:22.888223 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4575dc8-6b52-45a0-b23e-51fb7ab139ae admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:22.899122 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4575dc8-6b52-45a0-b23e-51fb7ab139ae admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:22.978017 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937fa6b-8305-44af-90be-80569dbf2779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:22.978851 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937fa6b-8305-44af-90be-80569dbf2779 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:22.979268 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937fa6b-8305-44af-90be-80569dbf2779 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:22.979663 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937fa6b-8305-44af-90be-80569dbf2779 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:22.980504 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3937fa6b-8305-44af-90be-80569dbf2779 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:22.983123 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3937fa6b-8305-44af-90be-80569dbf2779 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:23.008724 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2298/4576] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:58:22 2022] POST /identity/v3/users => generated 289 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:58:23.012457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b515e49-9254-4a7a-bced-355918cc5b51 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:23.024782 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b515e49-9254-4a7a-bced-355918cc5b51 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:23.030310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d3849a-af6c-4c8f-ae13-36ea4491ef16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:23.031101 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3849a-af6c-4c8f-ae13-36ea4491ef16 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:23.031453 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3849a-af6c-4c8f-ae13-36ea4491ef16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:23.031934 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3849a-af6c-4c8f-ae13-36ea4491ef16 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:23.032669 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d3849a-af6c-4c8f-ae13-36ea4491ef16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:23.034684 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d3849a-af6c-4c8f-ae13-36ea4491ef16 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:23.041541 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:23.048034 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2279/4577] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:58:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:58:23.052433 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937fa6b-8305-44af-90be-80569dbf2779 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:23.063929 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937fa6b-8305-44af-90be-80569dbf2779 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:23.070594 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47cc262-e03a-4d5c-bb28-d4fbb5d6dbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:23.071273 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cc262-e03a-4d5c-bb28-d4fbb5d6dbb3 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:23.071557 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cc262-e03a-4d5c-bb28-d4fbb5d6dbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:23.071827 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cc262-e03a-4d5c-bb28-d4fbb5d6dbb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:23.072480 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47cc262-e03a-4d5c-bb28-d4fbb5d6dbb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:23.074303 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47cc262-e03a-4d5c-bb28-d4fbb5d6dbb3 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:23.088638 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2299/4578] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:58:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:58:23.092636 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d3849a-af6c-4c8f-ae13-36ea4491ef16 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:23.115818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d3849a-af6c-4c8f-ae13-36ea4491ef16 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:23.122578 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fae781-9997-4be4-b4dd-7274ec18fa34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:23.123316 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fae781-9997-4be4-b4dd-7274ec18fa34 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:23.123815 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fae781-9997-4be4-b4dd-7274ec18fa34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:23.124073 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fae781-9997-4be4-b4dd-7274ec18fa34 admin admin] PATH_INFO: `/v3/projects/8311b6d303dd4cf7a9106852f3889924/users/b709bf53507c4b31ab8089b9ce5549d0/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:23.142696 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fae781-9997-4be4-b4dd-7274ec18fa34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8311b6d303dd4cf7a9106852f3889924, user_id=b709bf53507c4b31ab8089b9ce5549d0, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:23.145944 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fae781-9997-4be4-b4dd-7274ec18fa34 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:23.182446 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2280/4579] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:58:23 2022] PUT /identity/v3/projects/8311b6d303dd4cf7a9106852f3889924/users/b709bf53507c4b31ab8089b9ce5549d0/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:58:23.187200 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2f5ed-66b3-42eb-8994-c15f15eb8137 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:23.187511 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2f5ed-66b3-42eb-8994-c15f15eb8137 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:23.187969 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2f5ed-66b3-42eb-8994-c15f15eb8137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:23.253249 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-7bb2f5ed-66b3-42eb-8994-c15f15eb8137 None None] MFA Rules not processed for user `b709bf53507c4b31ab8089b9ce5549d0`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:23.255060 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7bb2f5ed-66b3-42eb-8994-c15f15eb8137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:23.336600 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2300/4580] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:58:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:23.374972 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fae781-9997-4be4-b4dd-7274ec18fa34 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:23.376871 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-21fae781-9997-4be4-b4dd-7274ec18fa34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:23.523938 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fae781-9997-4be4-b4dd-7274ec18fa34 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:23.535830 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42c941-245b-4f05-9d56-0797c77c84b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:23.536724 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42c941-245b-4f05-9d56-0797c77c84b4 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:23.537162 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42c941-245b-4f05-9d56-0797c77c84b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:23.537590 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42c941-245b-4f05-9d56-0797c77c84b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:23.565187 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b42c941-245b-4f05-9d56-0797c77c84b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:23.566645 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b42c941-245b-4f05-9d56-0797c77c84b4 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:23.585276 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2281/4581] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:58:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:58:23.609560 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2f5ed-66b3-42eb-8994-c15f15eb8137 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:23.691582 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:23.717273 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2f5ed-66b3-42eb-8994-c15f15eb8137 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:23.726183 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff74a1d-f19e-466a-b797-a4813b19817b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:23.728110 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff74a1d-f19e-466a-b797-a4813b19817b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:23.728908 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff74a1d-f19e-466a-b797-a4813b19817b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:23.729424 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff74a1d-f19e-466a-b797-a4813b19817b admin admin] PATH_INFO: `/v3/users/b709bf53507c4b31ab8089b9ce5549d0` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:23.734242 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff74a1d-f19e-466a-b797-a4813b19817b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b709bf53507c4b31ab8089b9ce5549d0)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:23.740304 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff74a1d-f19e-466a-b797-a4813b19817b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:23.759313 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42c941-245b-4f05-9d56-0797c77c84b4 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:23.760835 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4b42c941-245b-4f05-9d56-0797c77c84b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:23.808331 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42c941-245b-4f05-9d56-0797c77c84b4 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:23.814255 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d0e03-8feb-4cf1-84f7-dbe5738eac3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:23.815135 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d0e03-8feb-4cf1-84f7-dbe5738eac3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:23.815994 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d0e03-8feb-4cf1-84f7-dbe5738eac3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:23.822505 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d0e03-8feb-4cf1-84f7-dbe5738eac3d admin admin] PATH_INFO: `/v3/projects/b49b3e124a8a40a2a8d318d9672256a3` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:23.832100 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d0e03-8feb-4cf1-84f7-dbe5738eac3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b49b3e124a8a40a2a8d318d9672256a3)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:23.837277 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d0e03-8feb-4cf1-84f7-dbe5738eac3d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:23.842384 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-aff74a1d-f19e-466a-b797-a4813b19817b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b709bf53507c4b31ab8089b9ce5549d0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:23.845238 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-aff74a1d-f19e-466a-b797-a4813b19817b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b709bf53507c4b31ab8089b9ce5549d0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:23.878890 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-aff74a1d-f19e-466a-b797-a4813b19817b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b709bf53507c4b31ab8089b9ce5549d0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:23.906015 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-aff74a1d-f19e-466a-b797-a4813b19817b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b709bf53507c4b31ab8089b9ce5549d0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:23.919609 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-aff74a1d-f19e-466a-b797-a4813b19817b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b709bf53507c4b31ab8089b9ce5549d0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:23.940985 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2301/4582] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:58:23 2022] DELETE /identity/v3/users/b709bf53507c4b31ab8089b9ce5549d0 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:23.947328 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b651c56-d4ea-4ef1-89bd-945672e461c4 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:23.949905 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b651c56-d4ea-4ef1-89bd-945672e461c4 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:23.951927 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b651c56-d4ea-4ef1-89bd-945672e461c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:24.004440 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-809d0e03-8feb-4cf1-84f7-dbe5738eac3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b49b3e124a8a40a2a8d318d9672256a3', 'request_id': 'req-809d0e03-8feb-4cf1-84f7-dbe5738eac3d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:24.028184 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-809d0e03-8feb-4cf1-84f7-dbe5738eac3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b49b3e124a8a40a2a8d318d9672256a3', 'request_id': 'req-809d0e03-8feb-4cf1-84f7-dbe5738eac3d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:24.040202 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-7b651c56-d4ea-4ef1-89bd-945672e461c4 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:24.041593 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7b651c56-d4ea-4ef1-89bd-945672e461c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:24.046696 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-809d0e03-8feb-4cf1-84f7-dbe5738eac3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b49b3e124a8a40a2a8d318d9672256a3', 'request_id': 'req-809d0e03-8feb-4cf1-84f7-dbe5738eac3d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:24.070111 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-809d0e03-8feb-4cf1-84f7-dbe5738eac3d admin admin] The token cache is being invalidate because project b49b3e124a8a40a2a8d318d9672256a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:58:24.070414 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-809d0e03-8feb-4cf1-84f7-dbe5738eac3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:24.071115 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-809d0e03-8feb-4cf1-84f7-dbe5738eac3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:24.076531 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2282/4583] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:58:23 2022] DELETE /identity/v3/projects/b49b3e124a8a40a2a8d318d9672256a3 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:58:24.078241 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d0e03-8feb-4cf1-84f7-dbe5738eac3d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:24.084500 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-809d0e03-8feb-4cf1-84f7-dbe5738eac3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:24.152874 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2302/4584] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:58:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:24.160598 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d0e03-8feb-4cf1-84f7-dbe5738eac3d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:24.164711 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b651c56-d4ea-4ef1-89bd-945672e461c4 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:24.166654 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7b651c56-d4ea-4ef1-89bd-945672e461c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:24.166788 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53817c36-b4e7-4ba6-b7a0-463dbfdc7968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:24.167453 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53817c36-b4e7-4ba6-b7a0-463dbfdc7968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:24.167727 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53817c36-b4e7-4ba6-b7a0-463dbfdc7968 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:24.167995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53817c36-b4e7-4ba6-b7a0-463dbfdc7968 admin admin] PATH_INFO: `/v3/users/b48e1046b1aa4c45b8ae3b85f1ce67b9` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:24.169142 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53817c36-b4e7-4ba6-b7a0-463dbfdc7968 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b48e1046b1aa4c45b8ae3b85f1ce67b9)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:24.171112 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53817c36-b4e7-4ba6-b7a0-463dbfdc7968 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:24.173977 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:24.259577 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b651c56-d4ea-4ef1-89bd-945672e461c4 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:24.262799 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-53817c36-b4e7-4ba6-b7a0-463dbfdc7968 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b48e1046b1aa4c45b8ae3b85f1ce67b9'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:24.263444 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-53817c36-b4e7-4ba6-b7a0-463dbfdc7968 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b48e1046b1aa4c45b8ae3b85f1ce67b9'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:24.264478 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa6a41-476a-46b9-b70a-a264f4a82529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:24.265281 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa6a41-476a-46b9-b70a-a264f4a82529 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:24.265573 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa6a41-476a-46b9-b70a-a264f4a82529 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:24.265849 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa6a41-476a-46b9-b70a-a264f4a82529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:24.280549 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efa6a41-476a-46b9-b70a-a264f4a82529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:24.282190 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efa6a41-476a-46b9-b70a-a264f4a82529 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:24.285269 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-53817c36-b4e7-4ba6-b7a0-463dbfdc7968 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b48e1046b1aa4c45b8ae3b85f1ce67b9'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:24.297860 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-53817c36-b4e7-4ba6-b7a0-463dbfdc7968 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b48e1046b1aa4c45b8ae3b85f1ce67b9'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:24.298610 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-53817c36-b4e7-4ba6-b7a0-463dbfdc7968 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b48e1046b1aa4c45b8ae3b85f1ce67b9'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:24.313250 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2303/4585] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:58:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:58:24.347423 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2283/4586] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:58:24 2022] DELETE /identity/v3/users/b48e1046b1aa4c45b8ae3b85f1ce67b9 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:58:24.963996 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa6a41-476a-46b9-b70a-a264f4a82529 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:24.965547 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1efa6a41-476a-46b9-b70a-a264f4a82529 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:24.990233 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa6a41-476a-46b9-b70a-a264f4a82529 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:25.044796 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:25.159951 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814764b-fa3f-4de3-b02c-8109459dda59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:25.160933 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814764b-fa3f-4de3-b02c-8109459dda59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:25.161586 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814764b-fa3f-4de3-b02c-8109459dda59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:25.161938 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814764b-fa3f-4de3-b02c-8109459dda59 admin admin] PATH_INFO: `/v3/projects/8311b6d303dd4cf7a9106852f3889924` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:25.163779 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e814764b-fa3f-4de3-b02c-8109459dda59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8311b6d303dd4cf7a9106852f3889924)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:25.165941 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e814764b-fa3f-4de3-b02c-8109459dda59 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:25.174841 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53817c36-b4e7-4ba6-b7a0-463dbfdc7968 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:25.177046 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-53817c36-b4e7-4ba6-b7a0-463dbfdc7968 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:25.200379 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53817c36-b4e7-4ba6-b7a0-463dbfdc7968 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:25.216334 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b6a7a-17cc-48e4-9ea0-4b5ec04de2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:25.217636 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b6a7a-17cc-48e4-9ea0-4b5ec04de2ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:25.218954 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b6a7a-17cc-48e4-9ea0-4b5ec04de2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:25.219112 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b6a7a-17cc-48e4-9ea0-4b5ec04de2ea admin admin] PATH_INFO: `/v3/projects/df2388e062ba432ba8e82c53e704d6ed` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:25.224521 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b6a7a-17cc-48e4-9ea0-4b5ec04de2ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=df2388e062ba432ba8e82c53e704d6ed)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:25.227271 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b6a7a-17cc-48e4-9ea0-4b5ec04de2ea admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:25.291383 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e814764b-fa3f-4de3-b02c-8109459dda59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8311b6d303dd4cf7a9106852f3889924', 'request_id': 'req-e814764b-fa3f-4de3-b02c-8109459dda59'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:25.299051 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e814764b-fa3f-4de3-b02c-8109459dda59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8311b6d303dd4cf7a9106852f3889924', 'request_id': 'req-e814764b-fa3f-4de3-b02c-8109459dda59'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:25.320998 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e814764b-fa3f-4de3-b02c-8109459dda59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8311b6d303dd4cf7a9106852f3889924', 'request_id': 'req-e814764b-fa3f-4de3-b02c-8109459dda59'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:25.346262 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-905b6a7a-17cc-48e4-9ea0-4b5ec04de2ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df2388e062ba432ba8e82c53e704d6ed', 'request_id': 'req-905b6a7a-17cc-48e4-9ea0-4b5ec04de2ea'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:25.347294 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e814764b-fa3f-4de3-b02c-8109459dda59 admin admin] The token cache is being invalidate because project 8311b6d303dd4cf7a9106852f3889924 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:58:25.347698 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e814764b-fa3f-4de3-b02c-8109459dda59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:25.349261 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e814764b-fa3f-4de3-b02c-8109459dda59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:25.357310 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2304/4587] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:58:24 2022] DELETE /identity/v3/projects/8311b6d303dd4cf7a9106852f3889924 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:25.360457 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86eec6-0bbd-4673-bd4c-db20feaad668 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:25.360751 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86eec6-0bbd-4673-bd4c-db20feaad668 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:25.361026 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86eec6-0bbd-4673-bd4c-db20feaad668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:25.366551 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-905b6a7a-17cc-48e4-9ea0-4b5ec04de2ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df2388e062ba432ba8e82c53e704d6ed', 'request_id': 'req-905b6a7a-17cc-48e4-9ea0-4b5ec04de2ea'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:25.380732 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-905b6a7a-17cc-48e4-9ea0-4b5ec04de2ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df2388e062ba432ba8e82c53e704d6ed', 'request_id': 'req-905b6a7a-17cc-48e4-9ea0-4b5ec04de2ea'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:25.405048 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-ff86eec6-0bbd-4673-bd4c-db20feaad668 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:25.406231 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ff86eec6-0bbd-4673-bd4c-db20feaad668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:25.406532 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-905b6a7a-17cc-48e4-9ea0-4b5ec04de2ea admin admin] The token cache is being invalidate because project df2388e062ba432ba8e82c53e704d6ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:58:25.406858 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-905b6a7a-17cc-48e4-9ea0-4b5ec04de2ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:25.408989 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-905b6a7a-17cc-48e4-9ea0-4b5ec04de2ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:25.411076 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2284/4588] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:58:25 2022] DELETE /identity/v3/projects/df2388e062ba432ba8e82c53e704d6ed => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:25.417486 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8ce3b-5669-4b26-80b5-410fa6f71793 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:25.417777 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8ce3b-5669-4b26-80b5-410fa6f71793 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:25.418053 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8ce3b-5669-4b26-80b5-410fa6f71793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:25.466411 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-43c8ce3b-5669-4b26-80b5-410fa6f71793 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:25.467693 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-43c8ce3b-5669-4b26-80b5-410fa6f71793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:25.483261 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2305/4589] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:58:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:25.492202 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778a5d8-96bc-48d6-924e-5e4c11f67360 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:25.492486 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778a5d8-96bc-48d6-924e-5e4c11f67360 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:25.492767 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778a5d8-96bc-48d6-924e-5e4c11f67360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:25.526318 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-e778a5d8-96bc-48d6-924e-5e4c11f67360 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:25.529447 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e778a5d8-96bc-48d6-924e-5e4c11f67360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:25.543469 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2306/4590] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:58:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:25.544417 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778a5d8-96bc-48d6-924e-5e4c11f67360 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:25.554741 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778a5d8-96bc-48d6-924e-5e4c11f67360 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:25.565676 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583099ab-6d99-40ce-9ccd-ad4b5ec677f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:25.565676 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583099ab-6d99-40ce-9ccd-ad4b5ec677f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:25.565676 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583099ab-6d99-40ce-9ccd-ad4b5ec677f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:25.565676 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583099ab-6d99-40ce-9ccd-ad4b5ec677f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:25.566170 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583099ab-6d99-40ce-9ccd-ad4b5ec677f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:58:25.566170 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583099ab-6d99-40ce-9ccd-ad4b5ec677f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:25.566428 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583099ab-6d99-40ce-9ccd-ad4b5ec677f7 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:25.567707 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2285/4591] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:58:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:25.570142 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28a5b2-93c8-41ac-baf3-3d68f362e6b2 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:25.570590 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28a5b2-93c8-41ac-baf3-3d68f362e6b2 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:25.571502 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28a5b2-93c8-41ac-baf3-3d68f362e6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:25.584563 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:25.585719 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2307/4592] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:58:25.590142 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583099ab-6d99-40ce-9ccd-ad4b5ec677f7 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:25.600694 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583099ab-6d99-40ce-9ccd-ad4b5ec677f7 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:25.605565 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-1b28a5b2-93c8-41ac-baf3-3d68f362e6b2 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:25.606225 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c11db0-7642-4fb7-8292-ffb74f860646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:25.606922 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c11db0-7642-4fb7-8292-ffb74f860646 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:25.607301 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c11db0-7642-4fb7-8292-ffb74f860646 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:25.607643 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c11db0-7642-4fb7-8292-ffb74f860646 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:25.608366 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c11db0-7642-4fb7-8292-ffb74f860646 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:25.609039 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1b28a5b2-93c8-41ac-baf3-3d68f362e6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:25.610418 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c11db0-7642-4fb7-8292-ffb74f860646 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:25.623795 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2286/4593] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:58:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:25.626389 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28a5b2-93c8-41ac-baf3-3d68f362e6b2 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:25.637642 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28a5b2-93c8-41ac-baf3-3d68f362e6b2 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:25.643761 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e32965-48b0-44e0-9105-fc78fea2f6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:25.644506 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e32965-48b0-44e0-9105-fc78fea2f6c1 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:25.644857 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e32965-48b0-44e0-9105-fc78fea2f6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:25.645418 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e32965-48b0-44e0-9105-fc78fea2f6c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:25.646143 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e32965-48b0-44e0-9105-fc78fea2f6c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:58:25.646591 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e32965-48b0-44e0-9105-fc78fea2f6c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:25.648311 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e32965-48b0-44e0-9105-fc78fea2f6c1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:25.654150 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2308/4594] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:58:25 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:58:25.658188 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c11db0-7642-4fb7-8292-ffb74f860646 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:25.663769 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2287/4595] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:58:25.668174 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:25.668489 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e32965-48b0-44e0-9105-fc78fea2f6c1 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:25.686374 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e32965-48b0-44e0-9105-fc78fea2f6c1 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:25.768529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c11db0-7642-4fb7-8292-ffb74f860646 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:25.777031 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc57b3-2e20-49dd-8e19-41e6a8774256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:25.778048 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc57b3-2e20-49dd-8e19-41e6a8774256 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:25.778331 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc57b3-2e20-49dd-8e19-41e6a8774256 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:25.778560 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc57b3-2e20-49dd-8e19-41e6a8774256 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:25.779453 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc57b3-2e20-49dd-8e19-41e6a8774256 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:25.781804 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc57b3-2e20-49dd-8e19-41e6a8774256 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:25.791830 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e3d1a4-e606-449d-b6f5-dbc056861d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:25.792879 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3d1a4-e606-449d-b6f5-dbc056861d3c admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:25.793244 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3d1a4-e606-449d-b6f5-dbc056861d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:25.793720 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3d1a4-e606-449d-b6f5-dbc056861d3c admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:25.794598 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e3d1a4-e606-449d-b6f5-dbc056861d3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:25.797011 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e3d1a4-e606-449d-b6f5-dbc056861d3c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:25.810345 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2309/4596] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:58:25 2022] POST /identity/v3/users => generated 287 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:58:25.816094 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc57b3-2e20-49dd-8e19-41e6a8774256 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:25.830652 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc57b3-2e20-49dd-8e19-41e6a8774256 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:25.838741 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc56b8-87eb-46cb-a040-c697fb1a26c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:25.839632 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc56b8-87eb-46cb-a040-c697fb1a26c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:25.840095 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc56b8-87eb-46cb-a040-c697fb1a26c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:25.840534 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc56b8-87eb-46cb-a040-c697fb1a26c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:25.841447 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bc56b8-87eb-46cb-a040-c697fb1a26c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:25.843524 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bc56b8-87eb-46cb-a040-c697fb1a26c3 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:25.853583 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2288/4597] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:58:25 2022] POST /identity/v3/projects => generated 393 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:58:25.854960 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e3d1a4-e606-449d-b6f5-dbc056861d3c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:25.857677 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2310/4598] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:58:25.868184 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc56b8-87eb-46cb-a040-c697fb1a26c3 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:25.885574 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc56b8-87eb-46cb-a040-c697fb1a26c3 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:25.978207 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e3d1a4-e606-449d-b6f5-dbc056861d3c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:25.988598 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9976a2-8090-43d2-8683-54f64abfad29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:25.989365 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9976a2-8090-43d2-8683-54f64abfad29 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:25.989899 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9976a2-8090-43d2-8683-54f64abfad29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:25.990174 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9976a2-8090-43d2-8683-54f64abfad29 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:25.992210 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9976a2-8090-43d2-8683-54f64abfad29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:25.994562 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9976a2-8090-43d2-8683-54f64abfad29 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:26.022281 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2289/4599] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:58:25 2022] POST /identity/v3/users => generated 297 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:58:26.026804 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9976a2-8090-43d2-8683-54f64abfad29 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:26.042809 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378e00f-4954-4e61-b865-5c9c0d1b0281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:26.043722 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378e00f-4954-4e61-b865-5c9c0d1b0281 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:26.044101 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378e00f-4954-4e61-b865-5c9c0d1b0281 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:26.047454 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378e00f-4954-4e61-b865-5c9c0d1b0281 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:26.048467 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378e00f-4954-4e61-b865-5c9c0d1b0281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:26.052802 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9976a2-8090-43d2-8683-54f64abfad29 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:26.059745 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378e00f-4954-4e61-b865-5c9c0d1b0281 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:26.065467 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e7041-fb80-4971-992f-10a35e6eee86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:26.066095 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e7041-fb80-4971-992f-10a35e6eee86 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:26.066378 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e7041-fb80-4971-992f-10a35e6eee86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:26.066652 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e7041-fb80-4971-992f-10a35e6eee86 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:26.067874 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732e7041-fb80-4971-992f-10a35e6eee86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:26.069484 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732e7041-fb80-4971-992f-10a35e6eee86 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:26.093212 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2311/4600] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:58:26.094013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378e00f-4954-4e61-b865-5c9c0d1b0281 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:26.094939 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2290/4601] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:58:26.099779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e7041-fb80-4971-992f-10a35e6eee86 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:26.120123 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e7041-fb80-4971-992f-10a35e6eee86 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:26.127796 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac0d66-50b2-41b7-9ea1-aca94b5c204f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:26.128429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac0d66-50b2-41b7-9ea1-aca94b5c204f admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:26.128707 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac0d66-50b2-41b7-9ea1-aca94b5c204f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:26.128976 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac0d66-50b2-41b7-9ea1-aca94b5c204f admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:26.130162 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac0d66-50b2-41b7-9ea1-aca94b5c204f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:26.132338 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac0d66-50b2-41b7-9ea1-aca94b5c204f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:26.132504 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378e00f-4954-4e61-b865-5c9c0d1b0281 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:26.150012 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2291/4602] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:58:26.156276 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac0d66-50b2-41b7-9ea1-aca94b5c204f admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:26.161666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80bec0e-eb30-4f83-addb-e34e34dafbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:26.162490 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80bec0e-eb30-4f83-addb-e34e34dafbfc admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:26.162912 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80bec0e-eb30-4f83-addb-e34e34dafbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:26.163311 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80bec0e-eb30-4f83-addb-e34e34dafbfc admin admin] PATH_INFO: `/v3/projects/aba3f4aa1ff546f49fa31ae9114e1716/users/7e0455fa5b3b44c585787f6c5477b1c5/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:26.174554 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac0d66-50b2-41b7-9ea1-aca94b5c204f admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:26.184389 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e512c1-4a84-4a79-8c7b-b7ceb3697d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:26.185943 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e512c1-4a84-4a79-8c7b-b7ceb3697d1c admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:26.186423 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e512c1-4a84-4a79-8c7b-b7ceb3697d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:26.186940 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e512c1-4a84-4a79-8c7b-b7ceb3697d1c admin admin] PATH_INFO: `/v3/projects/05d04e496d8047ab8d8b35afaf3465e4/users/af7130e923cd42888264e7f724d8f8a4/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:26.197211 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80bec0e-eb30-4f83-addb-e34e34dafbfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=aba3f4aa1ff546f49fa31ae9114e1716, user_id=7e0455fa5b3b44c585787f6c5477b1c5, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:26.199980 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80bec0e-eb30-4f83-addb-e34e34dafbfc admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:26.236233 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e512c1-4a84-4a79-8c7b-b7ceb3697d1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=05d04e496d8047ab8d8b35afaf3465e4, user_id=af7130e923cd42888264e7f724d8f8a4, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:26.238030 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2312/4603] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:58:26 2022] PUT /identity/v3/projects/aba3f4aa1ff546f49fa31ae9114e1716/users/7e0455fa5b3b44c585787f6c5477b1c5/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:26.248336 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e512c1-4a84-4a79-8c7b-b7ceb3697d1c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:26.251625 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e7c91f-68f6-47ca-9399-a27a791fa3d2 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:26.251625 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e7c91f-68f6-47ca-9399-a27a791fa3d2 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:26.255237 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e7c91f-68f6-47ca-9399-a27a791fa3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:26.294666 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2292/4604] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:58:26 2022] PUT /identity/v3/projects/05d04e496d8047ab8d8b35afaf3465e4/users/af7130e923cd42888264e7f724d8f8a4/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:26.297063 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc06b3-e64b-4257-8884-c138d254d080 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:26.297352 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc06b3-e64b-4257-8884-c138d254d080 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:26.297625 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc06b3-e64b-4257-8884-c138d254d080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:26.321403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-95e7c91f-68f6-47ca-9399-a27a791fa3d2 None None] MFA Rules not processed for user `7e0455fa5b3b44c585787f6c5477b1c5`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:26.322619 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-95e7c91f-68f6-47ca-9399-a27a791fa3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:26.340866 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:26.347083 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-8ffc06b3-e64b-4257-8884-c138d254d080 None None] MFA Rules not processed for user `af7130e923cd42888264e7f724d8f8a4`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:26.349811 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8ffc06b3-e64b-4257-8884-c138d254d080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:26.412850 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:26.444992 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2293/4605] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:58:26 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:26.445715 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffc06b3-e64b-4257-8884-c138d254d080 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:26.461957 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2313/4606] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:58:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:26.466286 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e7c91f-68f6-47ca-9399-a27a791fa3d2 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:26.530432 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffc06b3-e64b-4257-8884-c138d254d080 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:26.541531 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6ceeb-846b-4025-8fbf-5a7a7a8e0e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:26.542183 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6ceeb-846b-4025-8fbf-5a7a7a8e0e08 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:26.542463 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6ceeb-846b-4025-8fbf-5a7a7a8e0e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:26.542842 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6ceeb-846b-4025-8fbf-5a7a7a8e0e08 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:26.543675 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad6ceeb-846b-4025-8fbf-5a7a7a8e0e08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:26.552502 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad6ceeb-846b-4025-8fbf-5a7a7a8e0e08 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:26.591111 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e7c91f-68f6-47ca-9399-a27a791fa3d2 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:26.609565 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4af55-b8d7-4b25-b719-b701d42d1f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:26.610604 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2294/4607] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:58:26 2022] POST /identity/v3/projects => generated 391 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:58:26.610733 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4af55-b8d7-4b25-b719-b701d42d1f29 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:26.611274 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4af55-b8d7-4b25-b719-b701d42d1f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:26.611556 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4af55-b8d7-4b25-b719-b701d42d1f29 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:26.613817 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae4af55-b8d7-4b25-b719-b701d42d1f29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:26.614608 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6ceeb-846b-4025-8fbf-5a7a7a8e0e08 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:26.634143 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae4af55-b8d7-4b25-b719-b701d42d1f29 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:26.695500 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2314/4608] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:58:26 2022] POST /identity/v3/projects => generated 371 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:58:26.702032 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4af55-b8d7-4b25-b719-b701d42d1f29 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:26.733423 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6ceeb-846b-4025-8fbf-5a7a7a8e0e08 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:26.788584 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4af55-b8d7-4b25-b719-b701d42d1f29 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:26.794816 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca46a04-e451-4879-a66c-044249f449d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:26.795663 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca46a04-e451-4879-a66c-044249f449d5 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:26.796240 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca46a04-e451-4879-a66c-044249f449d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:26.796540 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca46a04-e451-4879-a66c-044249f449d5 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:26.797394 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca46a04-e451-4879-a66c-044249f449d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:26.799746 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca46a04-e451-4879-a66c-044249f449d5 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:26.822173 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:26.848853 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2315/4609] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:58:26 2022] POST /identity/v3/users => generated 292 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:58:26.851218 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca46a04-e451-4879-a66c-044249f449d5 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:26.865968 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca46a04-e451-4879-a66c-044249f449d5 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:26.871754 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92c3b2-3032-4f51-9b97-e3a273ef2dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:26.872535 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dfdd50-f812-4d50-ae18-2082d6baaccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:26.874345 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92c3b2-3032-4f51-9b97-e3a273ef2dab admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:26.874468 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dfdd50-f812-4d50-ae18-2082d6baaccc admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:26.874933 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dfdd50-f812-4d50-ae18-2082d6baaccc admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:26.875296 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92c3b2-3032-4f51-9b97-e3a273ef2dab admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:26.875673 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dfdd50-f812-4d50-ae18-2082d6baaccc admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:26.876257 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92c3b2-3032-4f51-9b97-e3a273ef2dab admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:26.877462 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dfdd50-f812-4d50-ae18-2082d6baaccc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:26.878103 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f92c3b2-3032-4f51-9b97-e3a273ef2dab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:26.883919 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f92c3b2-3032-4f51-9b97-e3a273ef2dab admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:26.884882 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dfdd50-f812-4d50-ae18-2082d6baaccc admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:26.904951 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2316/4610] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:58:26.913095 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92c3b2-3032-4f51-9b97-e3a273ef2dab admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:26.925112 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92c3b2-3032-4f51-9b97-e3a273ef2dab admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:26.930873 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2295/4611] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:58:26 2022] POST /identity/v3/users => generated 302 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:58:26.932546 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dfdd50-f812-4d50-ae18-2082d6baaccc admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:26.939574 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536ba7e-0f4f-453b-8ffe-be9d205b1bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:26.940565 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536ba7e-0f4f-453b-8ffe-be9d205b1bcc admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:26.941149 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536ba7e-0f4f-453b-8ffe-be9d205b1bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:26.941425 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536ba7e-0f4f-453b-8ffe-be9d205b1bcc admin admin] PATH_INFO: `/v3/projects/36f4b2db20a34c558b0b9dbcfd6b1160/users/68297aad87834cd19359e69c5a6ab5fe/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:26.950430 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dfdd50-f812-4d50-ae18-2082d6baaccc admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:26.963192 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e286f5-2e88-4909-b706-ddd76c282493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:26.964187 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a536ba7e-0f4f-453b-8ffe-be9d205b1bcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=36f4b2db20a34c558b0b9dbcfd6b1160, user_id=68297aad87834cd19359e69c5a6ab5fe, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:26.965791 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e286f5-2e88-4909-b706-ddd76c282493 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:26.966679 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e286f5-2e88-4909-b706-ddd76c282493 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:26.968218 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e286f5-2e88-4909-b706-ddd76c282493 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:26.968597 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a536ba7e-0f4f-453b-8ffe-be9d205b1bcc admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:26.969448 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e286f5-2e88-4909-b706-ddd76c282493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:26.975836 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e286f5-2e88-4909-b706-ddd76c282493 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:26.999941 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2317/4612] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:58:26 2022] PUT /identity/v3/projects/36f4b2db20a34c558b0b9dbcfd6b1160/users/68297aad87834cd19359e69c5a6ab5fe/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:27.001462 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536ba7e-0f4f-453b-8ffe-be9d205b1bcc admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:27.001982 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2296/4613] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:58:27.006981 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e286f5-2e88-4909-b706-ddd76c282493 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:27.022517 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e286f5-2e88-4909-b706-ddd76c282493 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:27.039847 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:27.149676 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536ba7e-0f4f-453b-8ffe-be9d205b1bcc admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:27.160079 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac33a37-3fb3-4caa-bb52-cff531a63ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:27.160748 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac33a37-3fb3-4caa-bb52-cff531a63ae1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:27.162902 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac33a37-3fb3-4caa-bb52-cff531a63ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:27.163209 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac33a37-3fb3-4caa-bb52-cff531a63ae1 admin admin] PATH_INFO: `/v3/projects/246107ec543c41859f5ef7b714422cb1/users/348925a537d54b909b8ed38717a2635f/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:27.165103 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dfec57-4310-4631-a8e1-8a04275d6290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:27.165728 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfec57-4310-4631-a8e1-8a04275d6290 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:27.165999 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfec57-4310-4631-a8e1-8a04275d6290 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:27.166260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfec57-4310-4631-a8e1-8a04275d6290 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:27.166904 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dfec57-4310-4631-a8e1-8a04275d6290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:27.168541 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dfec57-4310-4631-a8e1-8a04275d6290 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:27.198330 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2318/4614] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:58:27.203884 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dfec57-4310-4631-a8e1-8a04275d6290 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:27.206301 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac33a37-3fb3-4caa-bb52-cff531a63ae1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=246107ec543c41859f5ef7b714422cb1, user_id=348925a537d54b909b8ed38717a2635f, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:27.215574 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac33a37-3fb3-4caa-bb52-cff531a63ae1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:27.226649 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dfec57-4310-4631-a8e1-8a04275d6290 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:27.236162 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32e726-b11e-4948-9dd6-bfb7d7b14f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:27.236935 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32e726-b11e-4948-9dd6-bfb7d7b14f74 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:27.237332 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32e726-b11e-4948-9dd6-bfb7d7b14f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:27.237758 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32e726-b11e-4948-9dd6-bfb7d7b14f74 admin admin] PATH_INFO: `/v3/projects/36f4b2db20a34c558b0b9dbcfd6b1160/users/68297aad87834cd19359e69c5a6ab5fe/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:27.240968 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f32e726-b11e-4948-9dd6-bfb7d7b14f74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36f4b2db20a34c558b0b9dbcfd6b1160, user_id=68297aad87834cd19359e69c5a6ab5fe, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:27.241976 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2297/4615] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:58:27 2022] PUT /identity/v3/projects/246107ec543c41859f5ef7b714422cb1/users/348925a537d54b909b8ed38717a2635f/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:58:27.242803 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac33a37-3fb3-4caa-bb52-cff531a63ae1 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:27.245404 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f32e726-b11e-4948-9dd6-bfb7d7b14f74 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:27.262444 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2319/4616] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:58:27 2022] PUT /identity/v3/projects/36f4b2db20a34c558b0b9dbcfd6b1160/users/68297aad87834cd19359e69c5a6ab5fe/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:27.276204 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0dbcc-8f29-41de-8ecd-1effe23e6bed None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:27.276804 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0dbcc-8f29-41de-8ecd-1effe23e6bed None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:27.277194 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0dbcc-8f29-41de-8ecd-1effe23e6bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:27.349061 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-27d0dbcc-8f29-41de-8ecd-1effe23e6bed None None] MFA Rules not processed for user `68297aad87834cd19359e69c5a6ab5fe`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:27.356274 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-27d0dbcc-8f29-41de-8ecd-1effe23e6bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:27.389566 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac33a37-3fb3-4caa-bb52-cff531a63ae1 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:27.482949 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:27.521881 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08cabbd-529f-46cb-9944-1703c7ecd802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:27.522764 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08cabbd-529f-46cb-9944-1703c7ecd802 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:27.522764 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08cabbd-529f-46cb-9944-1703c7ecd802 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:27.523176 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08cabbd-529f-46cb-9944-1703c7ecd802 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:27.523960 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08cabbd-529f-46cb-9944-1703c7ecd802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:27.525801 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08cabbd-529f-46cb-9944-1703c7ecd802 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:27.552344 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2298/4617] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:58:27.553642 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08cabbd-529f-46cb-9944-1703c7ecd802 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:27.555335 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2320/4618] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:58:27 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:27.567751 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d0dbcc-8f29-41de-8ecd-1effe23e6bed None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:27.569747 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-27d0dbcc-8f29-41de-8ecd-1effe23e6bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:27.586029 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08cabbd-529f-46cb-9944-1703c7ecd802 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:27.604361 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1098e8c8-bbf8-4a3f-90eb-2686f9c7c819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:27.604584 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098e8c8-bbf8-4a3f-90eb-2686f9c7c819 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:27.604866 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098e8c8-bbf8-4a3f-90eb-2686f9c7c819 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:27.605142 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098e8c8-bbf8-4a3f-90eb-2686f9c7c819 admin admin] PATH_INFO: `/v3/projects/246107ec543c41859f5ef7b714422cb1/users/348925a537d54b909b8ed38717a2635f/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:27.611205 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1098e8c8-bbf8-4a3f-90eb-2686f9c7c819 admin admin] RBAC: Authorizing `identity:create_grant(project_id=246107ec543c41859f5ef7b714422cb1, user_id=348925a537d54b909b8ed38717a2635f, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:27.615109 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1098e8c8-bbf8-4a3f-90eb-2686f9c7c819 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:27.644325 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2299/4619] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:58:27 2022] PUT /identity/v3/projects/246107ec543c41859f5ef7b714422cb1/users/348925a537d54b909b8ed38717a2635f/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:27.656797 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e97c3-d311-4f96-9328-39ea35e46235 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:27.657087 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e97c3-d311-4f96-9328-39ea35e46235 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:27.657367 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e97c3-d311-4f96-9328-39ea35e46235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:27.704086 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d0dbcc-8f29-41de-8ecd-1effe23e6bed None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:27.722107 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-e88e97c3-d311-4f96-9328-39ea35e46235 None None] MFA Rules not processed for user `348925a537d54b909b8ed38717a2635f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:27.724154 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e88e97c3-d311-4f96-9328-39ea35e46235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:27.814511 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:27.831116 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de025e17-48f4-43d8-9a62-aabbaea4d234 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:27.832271 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de025e17-48f4-43d8-9a62-aabbaea4d234 service cinder] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:27.833362 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de025e17-48f4-43d8-9a62-aabbaea4d234 service cinder] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:27.833651 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de025e17-48f4-43d8-9a62-aabbaea4d234 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:27.891564 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2300/4620] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:58:27 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:58:27.984416 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e97c3-d311-4f96-9328-39ea35e46235 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:27.986158 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e88e97c3-d311-4f96-9328-39ea35e46235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:28.013730 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e97c3-d311-4f96-9328-39ea35e46235 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:28.029575 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83976bda-f360-4f6e-9f27-f0e5bef55fd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:28.030230 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83976bda-f360-4f6e-9f27-f0e5bef55fd1 service cinder] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:28.030511 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83976bda-f360-4f6e-9f27-f0e5bef55fd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:28.030783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83976bda-f360-4f6e-9f27-f0e5bef55fd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:28.060285 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83976bda-f360-4f6e-9f27-f0e5bef55fd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:28.061596 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83976bda-f360-4f6e-9f27-f0e5bef55fd1 service cinder] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:28.071491 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de025e17-48f4-43d8-9a62-aabbaea4d234 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:28.073242 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de025e17-48f4-43d8-9a62-aabbaea4d234 service cinder] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:28.125412 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2301/4621] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:58:27 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:58:28.145762 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2321/4622] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:58:27 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:58:28.208945 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83976bda-f360-4f6e-9f27-f0e5bef55fd1 service cinder] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:28.220488 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83976bda-f360-4f6e-9f27-f0e5bef55fd1 service cinder] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:28.234485 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466ae87-74e0-4be7-829e-d7b5204461bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:28.235667 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466ae87-74e0-4be7-829e-d7b5204461bd service cinder] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:28.235858 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466ae87-74e0-4be7-829e-d7b5204461bd service cinder] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:28.236104 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466ae87-74e0-4be7-829e-d7b5204461bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:28.423338 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3466ae87-74e0-4be7-829e-d7b5204461bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:28.425126 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3466ae87-74e0-4be7-829e-d7b5204461bd service cinder] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:28.436649 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de025e17-48f4-43d8-9a62-aabbaea4d234 service cinder] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:28.445379 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2302/4623] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:58:28 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:58:28.446791 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de025e17-48f4-43d8-9a62-aabbaea4d234 service cinder] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:28.463454 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372ff9a-b2cf-4feb-9344-dc4702defe40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:28.464099 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372ff9a-b2cf-4feb-9344-dc4702defe40 service cinder] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:28.464370 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372ff9a-b2cf-4feb-9344-dc4702defe40 service cinder] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:28.464642 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372ff9a-b2cf-4feb-9344-dc4702defe40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:28.639090 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372ff9a-b2cf-4feb-9344-dc4702defe40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:28.640669 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372ff9a-b2cf-4feb-9344-dc4702defe40 service cinder] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:28.675197 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2322/4624] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:58:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:58:31.443934 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466ae87-74e0-4be7-829e-d7b5204461bd service cinder] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:31.445673 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3466ae87-74e0-4be7-829e-d7b5204461bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:31.526755 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:31.570186 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466ae87-74e0-4be7-829e-d7b5204461bd service cinder] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:31.580711 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268789f-635a-4faa-9988-0fb36d8ad6b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:31.581498 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268789f-635a-4faa-9988-0fb36d8ad6b9 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:31.581782 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268789f-635a-4faa-9988-0fb36d8ad6b9 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:31.582057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268789f-635a-4faa-9988-0fb36d8ad6b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:31.584199 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c268789f-635a-4faa-9988-0fb36d8ad6b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:31.605836 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c268789f-635a-4faa-9988-0fb36d8ad6b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:31.607195 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c268789f-635a-4faa-9988-0fb36d8ad6b9 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:31.636357 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2303/4625] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:58:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:58:35.898257 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372ff9a-b2cf-4feb-9344-dc4702defe40 service cinder] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:36.017409 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372ff9a-b2cf-4feb-9344-dc4702defe40 service cinder] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:36.022937 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17e9e9-3359-4c0c-bdf7-0f95cef3de13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:36.024578 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17e9e9-3359-4c0c-bdf7-0f95cef3de13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:36.025101 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17e9e9-3359-4c0c-bdf7-0f95cef3de13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:36.025601 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17e9e9-3359-4c0c-bdf7-0f95cef3de13 admin admin] PATH_INFO: `/v3/users/af7130e923cd42888264e7f724d8f8a4` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:36.027100 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f17e9e9-3359-4c0c-bdf7-0f95cef3de13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af7130e923cd42888264e7f724d8f8a4)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:36.029272 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f17e9e9-3359-4c0c-bdf7-0f95cef3de13 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:36.091214 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:36.102335 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8f17e9e9-3359-4c0c-bdf7-0f95cef3de13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af7130e923cd42888264e7f724d8f8a4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:36.103203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8f17e9e9-3359-4c0c-bdf7-0f95cef3de13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af7130e923cd42888264e7f724d8f8a4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:36.118965 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8f17e9e9-3359-4c0c-bdf7-0f95cef3de13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af7130e923cd42888264e7f724d8f8a4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:36.127868 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8f17e9e9-3359-4c0c-bdf7-0f95cef3de13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af7130e923cd42888264e7f724d8f8a4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:36.136422 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8f17e9e9-3359-4c0c-bdf7-0f95cef3de13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af7130e923cd42888264e7f724d8f8a4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:36.142925 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2323/4626] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:58:35 2022] DELETE /identity/v3/users/af7130e923cd42888264e7f724d8f8a4 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:36.149144 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08fbb9f-d4d3-4aa3-9d65-b33b13ef1f0d None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:36.149671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08fbb9f-d4d3-4aa3-9d65-b33b13ef1f0d None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:36.149908 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08fbb9f-d4d3-4aa3-9d65-b33b13ef1f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:36.170917 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-b08fbb9f-d4d3-4aa3-9d65-b33b13ef1f0d None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:36.172358 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b08fbb9f-d4d3-4aa3-9d65-b33b13ef1f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:36.252571 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2304/4627] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:58:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:58:36.265885 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17e9e9-3359-4c0c-bdf7-0f95cef3de13 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:36.267796 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8f17e9e9-3359-4c0c-bdf7-0f95cef3de13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:36.401448 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17e9e9-3359-4c0c-bdf7-0f95cef3de13 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:36.408846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2015a32-fb6a-4578-92be-69a6f3ab0749 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:36.410185 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2015a32-fb6a-4578-92be-69a6f3ab0749 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:36.411192 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2015a32-fb6a-4578-92be-69a6f3ab0749 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:36.411711 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2015a32-fb6a-4578-92be-69a6f3ab0749 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:36.423861 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2015a32-fb6a-4578-92be-69a6f3ab0749 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:36.426029 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2015a32-fb6a-4578-92be-69a6f3ab0749 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:36.443811 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2324/4628] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:58:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:58:36.894179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08fbb9f-d4d3-4aa3-9d65-b33b13ef1f0d None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:36.896329 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b08fbb9f-d4d3-4aa3-9d65-b33b13ef1f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:36.921167 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08fbb9f-d4d3-4aa3-9d65-b33b13ef1f0d None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:36.930940 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f73737-b668-415f-a4fd-23fc68013c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:36.930940 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f73737-b668-415f-a4fd-23fc68013c3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:36.930940 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f73737-b668-415f-a4fd-23fc68013c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:36.930940 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f73737-b668-415f-a4fd-23fc68013c3a admin admin] PATH_INFO: `/v3/projects/05d04e496d8047ab8d8b35afaf3465e4` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:36.934008 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f73737-b668-415f-a4fd-23fc68013c3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=05d04e496d8047ab8d8b35afaf3465e4)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:36.936497 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f73737-b668-415f-a4fd-23fc68013c3a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:37.014534 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-17f73737-b668-415f-a4fd-23fc68013c3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05d04e496d8047ab8d8b35afaf3465e4', 'request_id': 'req-17f73737-b668-415f-a4fd-23fc68013c3a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:37.026165 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-17f73737-b668-415f-a4fd-23fc68013c3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05d04e496d8047ab8d8b35afaf3465e4', 'request_id': 'req-17f73737-b668-415f-a4fd-23fc68013c3a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:37.040027 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-17f73737-b668-415f-a4fd-23fc68013c3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05d04e496d8047ab8d8b35afaf3465e4', 'request_id': 'req-17f73737-b668-415f-a4fd-23fc68013c3a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:37.061252 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-17f73737-b668-415f-a4fd-23fc68013c3a admin admin] The token cache is being invalidate because project 05d04e496d8047ab8d8b35afaf3465e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:58:37.061252 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-17f73737-b668-415f-a4fd-23fc68013c3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:37.061697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-17f73737-b668-415f-a4fd-23fc68013c3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:37.066046 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2305/4629] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:58:36 2022] DELETE /identity/v3/projects/05d04e496d8047ab8d8b35afaf3465e4 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:37.067840 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2015a32-fb6a-4578-92be-69a6f3ab0749 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:37.085036 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2015a32-fb6a-4578-92be-69a6f3ab0749 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:37.240018 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d1f565-b058-4486-b921-f47e00480e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:37.241033 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1f565-b058-4486-b921-f47e00480e83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:37.241473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1f565-b058-4486-b921-f47e00480e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:37.241801 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1f565-b058-4486-b921-f47e00480e83 admin admin] PATH_INFO: `/v3/users/348925a537d54b909b8ed38717a2635f` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:37.243584 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d1f565-b058-4486-b921-f47e00480e83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=348925a537d54b909b8ed38717a2635f)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:37.248024 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d1f565-b058-4486-b921-f47e00480e83 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:37.352410 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-28d1f565-b058-4486-b921-f47e00480e83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '348925a537d54b909b8ed38717a2635f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:37.353500 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-28d1f565-b058-4486-b921-f47e00480e83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '348925a537d54b909b8ed38717a2635f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:37.381215 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:37.388091 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-28d1f565-b058-4486-b921-f47e00480e83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '348925a537d54b909b8ed38717a2635f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:37.399359 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-28d1f565-b058-4486-b921-f47e00480e83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '348925a537d54b909b8ed38717a2635f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:37.409936 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-28d1f565-b058-4486-b921-f47e00480e83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '348925a537d54b909b8ed38717a2635f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:37.418883 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2325/4630] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:58:37 2022] DELETE /identity/v3/users/348925a537d54b909b8ed38717a2635f => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:37.967327 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f73737-b668-415f-a4fd-23fc68013c3a admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:37.971309 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-17f73737-b668-415f-a4fd-23fc68013c3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:38.006435 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f73737-b668-415f-a4fd-23fc68013c3a admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:38.133740 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:38.190867 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acae0e54-5f90-4ec7-a6b4-fe002f464e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:38.191587 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae0e54-5f90-4ec7-a6b4-fe002f464e29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:38.192605 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae0e54-5f90-4ec7-a6b4-fe002f464e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:38.193113 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae0e54-5f90-4ec7-a6b4-fe002f464e29 admin admin] PATH_INFO: `/v3/projects/246107ec543c41859f5ef7b714422cb1` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:38.202853 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acae0e54-5f90-4ec7-a6b4-fe002f464e29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=246107ec543c41859f5ef7b714422cb1)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:38.209657 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acae0e54-5f90-4ec7-a6b4-fe002f464e29 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:38.319083 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-acae0e54-5f90-4ec7-a6b4-fe002f464e29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '246107ec543c41859f5ef7b714422cb1', 'request_id': 'req-acae0e54-5f90-4ec7-a6b4-fe002f464e29'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:38.334038 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-acae0e54-5f90-4ec7-a6b4-fe002f464e29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '246107ec543c41859f5ef7b714422cb1', 'request_id': 'req-acae0e54-5f90-4ec7-a6b4-fe002f464e29'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:38.343046 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-acae0e54-5f90-4ec7-a6b4-fe002f464e29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '246107ec543c41859f5ef7b714422cb1', 'request_id': 'req-acae0e54-5f90-4ec7-a6b4-fe002f464e29'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:38.373347 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-acae0e54-5f90-4ec7-a6b4-fe002f464e29 admin admin] The token cache is being invalidate because project 246107ec543c41859f5ef7b714422cb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:58:38.373650 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-acae0e54-5f90-4ec7-a6b4-fe002f464e29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:38.375623 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-acae0e54-5f90-4ec7-a6b4-fe002f464e29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:38.381083 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2306/4631] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:58:37 2022] DELETE /identity/v3/projects/246107ec543c41859f5ef7b714422cb1 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:38.385653 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a238d2-d23a-48ed-afc0-a12955484929 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:38.386760 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a238d2-d23a-48ed-afc0-a12955484929 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:38.387251 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a238d2-d23a-48ed-afc0-a12955484929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:38.451192 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-c2a238d2-d23a-48ed-afc0-a12955484929 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:38.458403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c2a238d2-d23a-48ed-afc0-a12955484929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:38.587517 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2326/4632] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:58:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:38.596160 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211a950-2798-4399-840e-b47a730ecea0 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:38.596493 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211a950-2798-4399-840e-b47a730ecea0 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:38.596830 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211a950-2798-4399-840e-b47a730ecea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:38.642104 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-0211a950-2798-4399-840e-b47a730ecea0 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:38.643660 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0211a950-2798-4399-840e-b47a730ecea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:38.653338 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2307/4633] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:58:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:38.658008 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a238d2-d23a-48ed-afc0-a12955484929 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:38.672164 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a238d2-d23a-48ed-afc0-a12955484929 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:38.687423 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f218dbb8-501a-415c-a0f8-ca51bc74f288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:38.688382 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218dbb8-501a-415c-a0f8-ca51bc74f288 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:38.688767 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218dbb8-501a-415c-a0f8-ca51bc74f288 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:38.689144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218dbb8-501a-415c-a0f8-ca51bc74f288 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:38.690039 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f218dbb8-501a-415c-a0f8-ca51bc74f288 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:58:38.691559 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f218dbb8-501a-415c-a0f8-ca51bc74f288 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:38.697495 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f218dbb8-501a-415c-a0f8-ca51bc74f288 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:38.738080 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2327/4634] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:58:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:58:38.740665 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211a950-2798-4399-840e-b47a730ecea0 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:38.774385 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211a950-2798-4399-840e-b47a730ecea0 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:38.779568 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d53d0b-e5a7-4687-b050-5c7b82b4f969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:38.780190 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d53d0b-e5a7-4687-b050-5c7b82b4f969 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:38.780469 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d53d0b-e5a7-4687-b050-5c7b82b4f969 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:38.780741 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d53d0b-e5a7-4687-b050-5c7b82b4f969 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:38.781563 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d53d0b-e5a7-4687-b050-5c7b82b4f969 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:38.783478 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d53d0b-e5a7-4687-b050-5c7b82b4f969 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:38.842605 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f218dbb8-501a-415c-a0f8-ca51bc74f288 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:38.852222 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2308/4635] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:58:38 2022] POST /identity/v3/projects => generated 401 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:58:38.856361 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f218dbb8-501a-415c-a0f8-ca51bc74f288 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:39.025103 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49147ed-f933-4042-bf63-2983a4d20671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:39.026015 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49147ed-f933-4042-bf63-2983a4d20671 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:39.026540 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49147ed-f933-4042-bf63-2983a4d20671 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:39.026821 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49147ed-f933-4042-bf63-2983a4d20671 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:39.027910 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49147ed-f933-4042-bf63-2983a4d20671 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:39.029876 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49147ed-f933-4042-bf63-2983a4d20671 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:39.093007 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2328/4636] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:58:38 2022] POST /identity/v3/users => generated 301 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:58:39.097455 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d53d0b-e5a7-4687-b050-5c7b82b4f969 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:39.111562 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d53d0b-e5a7-4687-b050-5c7b82b4f969 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:39.126616 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c85fb2-6279-4d0d-a2f6-918e93fb7147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:39.127281 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c85fb2-6279-4d0d-a2f6-918e93fb7147 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:39.127559 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c85fb2-6279-4d0d-a2f6-918e93fb7147 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:39.127824 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c85fb2-6279-4d0d-a2f6-918e93fb7147 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:39.128649 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c85fb2-6279-4d0d-a2f6-918e93fb7147 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:39.133353 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c85fb2-6279-4d0d-a2f6-918e93fb7147 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:39.162778 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49147ed-f933-4042-bf63-2983a4d20671 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:39.166780 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2309/4637] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:58:39.179680 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49147ed-f933-4042-bf63-2983a4d20671 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:39.193775 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d81833f-1a7f-4f61-b352-151891658c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:39.195105 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81833f-1a7f-4f61-b352-151891658c9b admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:39.195944 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81833f-1a7f-4f61-b352-151891658c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:39.195944 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81833f-1a7f-4f61-b352-151891658c9b admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:39.196368 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d81833f-1a7f-4f61-b352-151891658c9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:39.202250 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d81833f-1a7f-4f61-b352-151891658c9b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:39.231793 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2329/4638] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:58:39.233365 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c85fb2-6279-4d0d-a2f6-918e93fb7147 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:39.245495 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c85fb2-6279-4d0d-a2f6-918e93fb7147 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:39.267613 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6c18d-6b9e-43bf-a832-555b7a39cffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:39.268312 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6c18d-6b9e-43bf-a832-555b7a39cffc admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:39.268601 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6c18d-6b9e-43bf-a832-555b7a39cffc admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:39.268876 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6c18d-6b9e-43bf-a832-555b7a39cffc admin admin] PATH_INFO: `/v3/projects/3b596707117d466d89d39148978ab92b/users/441d469cd5e34c279d784399fca2db9e/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:39.291449 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea6c18d-6b9e-43bf-a832-555b7a39cffc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b596707117d466d89d39148978ab92b, user_id=441d469cd5e34c279d784399fca2db9e, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:39.294570 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea6c18d-6b9e-43bf-a832-555b7a39cffc admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:39.310060 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2310/4639] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:58:39 2022] PUT /identity/v3/projects/3b596707117d466d89d39148978ab92b/users/441d469cd5e34c279d784399fca2db9e/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:39.322169 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4517121b-8b9c-4cae-a29b-7a0396cda512 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:39.322641 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4517121b-8b9c-4cae-a29b-7a0396cda512 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:39.322790 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4517121b-8b9c-4cae-a29b-7a0396cda512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:39.349724 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6c18d-6b9e-43bf-a832-555b7a39cffc admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:39.352530 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7ea6c18d-6b9e-43bf-a832-555b7a39cffc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:39.366261 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-4517121b-8b9c-4cae-a29b-7a0396cda512 None None] MFA Rules not processed for user `441d469cd5e34c279d784399fca2db9e`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:39.369250 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4517121b-8b9c-4cae-a29b-7a0396cda512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:39.407212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:39.457330 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2330/4640] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:58:39 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:39.458271 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4517121b-8b9c-4cae-a29b-7a0396cda512 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:39.467322 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6c18d-6b9e-43bf-a832-555b7a39cffc admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:39.471124 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4517121b-8b9c-4cae-a29b-7a0396cda512 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:39.472663 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7575857d-1bad-4890-b5be-40454c9d183d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:39.474620 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7575857d-1bad-4890-b5be-40454c9d183d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:39.474987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7575857d-1bad-4890-b5be-40454c9d183d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:39.475447 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7575857d-1bad-4890-b5be-40454c9d183d admin admin] PATH_INFO: `/v3/users/8efa4be1bf974daf84fc5f64b4ca3155` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:39.476684 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7575857d-1bad-4890-b5be-40454c9d183d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8efa4be1bf974daf84fc5f64b4ca3155)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:39.477695 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32fca3-4a30-4f96-81d0-270b522f38a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:39.478366 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32fca3-4a30-4f96-81d0-270b522f38a5 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:39.478652 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32fca3-4a30-4f96-81d0-270b522f38a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:39.478924 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32fca3-4a30-4f96-81d0-270b522f38a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:39.479053 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7575857d-1bad-4890-b5be-40454c9d183d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:39.479679 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce32fca3-4a30-4f96-81d0-270b522f38a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:39.481607 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce32fca3-4a30-4f96-81d0-270b522f38a5 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:39.496625 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:39.524019 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2331/4641] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:58:39 2022] POST /identity/v3/projects => generated 397 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:58:39.528238 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32fca3-4a30-4f96-81d0-270b522f38a5 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:39.540334 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7575857d-1bad-4890-b5be-40454c9d183d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8efa4be1bf974daf84fc5f64b4ca3155'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:39.541220 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7575857d-1bad-4890-b5be-40454c9d183d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8efa4be1bf974daf84fc5f64b4ca3155'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:39.555786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7575857d-1bad-4890-b5be-40454c9d183d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8efa4be1bf974daf84fc5f64b4ca3155'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:39.563872 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7575857d-1bad-4890-b5be-40454c9d183d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8efa4be1bf974daf84fc5f64b4ca3155'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:39.564653 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7575857d-1bad-4890-b5be-40454c9d183d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8efa4be1bf974daf84fc5f64b4ca3155'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:39.611772 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2311/4642] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:58:39 2022] DELETE /identity/v3/users/8efa4be1bf974daf84fc5f64b4ca3155 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:39.663263 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32fca3-4a30-4f96-81d0-270b522f38a5 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:39.779140 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c5fd0-b18a-4481-baed-c71615ad0e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:39.779834 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c5fd0-b18a-4481-baed-c71615ad0e85 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:39.780126 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c5fd0-b18a-4481-baed-c71615ad0e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:39.780399 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c5fd0-b18a-4481-baed-c71615ad0e85 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:39.781044 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c5fd0-b18a-4481-baed-c71615ad0e85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:39.783014 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c5fd0-b18a-4481-baed-c71615ad0e85 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:39.830236 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2332/4643] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:58:39 2022] POST /identity/v3/users => generated 305 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:58:39.834987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7575857d-1bad-4890-b5be-40454c9d183d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:39.836545 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7575857d-1bad-4890-b5be-40454c9d183d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:39.852183 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7575857d-1bad-4890-b5be-40454c9d183d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:39.858343 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9cc37c-c411-4fbf-b22f-97d498199366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:39.859368 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9cc37c-c411-4fbf-b22f-97d498199366 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:39.859831 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9cc37c-c411-4fbf-b22f-97d498199366 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:39.860410 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9cc37c-c411-4fbf-b22f-97d498199366 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:39.861253 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9cc37c-c411-4fbf-b22f-97d498199366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:39.863268 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9cc37c-c411-4fbf-b22f-97d498199366 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:39.877897 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2312/4644] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:58:39.882286 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c5fd0-b18a-4481-baed-c71615ad0e85 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:39.894380 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c5fd0-b18a-4481-baed-c71615ad0e85 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:39.901767 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccfcf47-8547-46a9-8da4-dc8df382f8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:39.902631 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccfcf47-8547-46a9-8da4-dc8df382f8a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:39.903040 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccfcf47-8547-46a9-8da4-dc8df382f8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:39.903601 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccfcf47-8547-46a9-8da4-dc8df382f8a0 admin admin] PATH_INFO: `/v3/projects/96536b23de0b4fd5859f40a1be2c248f/users/a8ab80b3ee994b469f0cfe1147d85223/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:39.929161 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccfcf47-8547-46a9-8da4-dc8df382f8a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96536b23de0b4fd5859f40a1be2c248f, user_id=a8ab80b3ee994b469f0cfe1147d85223, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:39.934082 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccfcf47-8547-46a9-8da4-dc8df382f8a0 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:39.957281 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2333/4645] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:58:39 2022] PUT /identity/v3/projects/96536b23de0b4fd5859f40a1be2c248f/users/a8ab80b3ee994b469f0cfe1147d85223/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:39.962070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9cc37c-c411-4fbf-b22f-97d498199366 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:39.977532 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9cc37c-c411-4fbf-b22f-97d498199366 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:39.984025 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccfcf47-8547-46a9-8da4-dc8df382f8a0 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:39.986119 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-cccfcf47-8547-46a9-8da4-dc8df382f8a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:40.035313 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:40.095254 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cadf9df-b164-414e-8d3e-bfcc4158302f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:40.095888 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cadf9df-b164-414e-8d3e-bfcc4158302f admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:40.096167 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cadf9df-b164-414e-8d3e-bfcc4158302f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:40.096436 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cadf9df-b164-414e-8d3e-bfcc4158302f admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:40.097084 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cadf9df-b164-414e-8d3e-bfcc4158302f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:40.100713 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cadf9df-b164-414e-8d3e-bfcc4158302f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:40.104602 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccfcf47-8547-46a9-8da4-dc8df382f8a0 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:40.111653 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623fd4d-08fb-4c77-bc1d-e182ea20d135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:40.112230 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623fd4d-08fb-4c77-bc1d-e182ea20d135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:40.112511 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623fd4d-08fb-4c77-bc1d-e182ea20d135 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:40.112792 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623fd4d-08fb-4c77-bc1d-e182ea20d135 admin admin] PATH_INFO: `/v3/projects/6d953872c1bd443aa26ee4f47626bdc9` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:40.115262 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b623fd4d-08fb-4c77-bc1d-e182ea20d135 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d953872c1bd443aa26ee4f47626bdc9)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:40.115947 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2313/4646] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:58:40.117999 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b623fd4d-08fb-4c77-bc1d-e182ea20d135 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:40.121402 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cadf9df-b164-414e-8d3e-bfcc4158302f admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:40.135683 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cadf9df-b164-414e-8d3e-bfcc4158302f admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:40.140721 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1e3fb-a485-4e21-a5c3-1ca3f303f316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:40.141396 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1e3fb-a485-4e21-a5c3-1ca3f303f316 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:40.141675 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1e3fb-a485-4e21-a5c3-1ca3f303f316 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:40.141950 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1e3fb-a485-4e21-a5c3-1ca3f303f316 admin admin] PATH_INFO: `/v3/projects/96536b23de0b4fd5859f40a1be2c248f/users/a8ab80b3ee994b469f0cfe1147d85223/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:40.144111 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b1e3fb-a485-4e21-a5c3-1ca3f303f316 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96536b23de0b4fd5859f40a1be2c248f, user_id=a8ab80b3ee994b469f0cfe1147d85223, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:40.147824 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b1e3fb-a485-4e21-a5c3-1ca3f303f316 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:40.162680 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2314/4647] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:58:40 2022] PUT /identity/v3/projects/96536b23de0b4fd5859f40a1be2c248f/users/a8ab80b3ee994b469f0cfe1147d85223/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:40.181649 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b623fd4d-08fb-4c77-bc1d-e182ea20d135 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d953872c1bd443aa26ee4f47626bdc9', 'request_id': 'req-b623fd4d-08fb-4c77-bc1d-e182ea20d135'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:40.189258 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b623fd4d-08fb-4c77-bc1d-e182ea20d135 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d953872c1bd443aa26ee4f47626bdc9', 'request_id': 'req-b623fd4d-08fb-4c77-bc1d-e182ea20d135'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:40.201152 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b623fd4d-08fb-4c77-bc1d-e182ea20d135 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d953872c1bd443aa26ee4f47626bdc9', 'request_id': 'req-b623fd4d-08fb-4c77-bc1d-e182ea20d135'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:40.217205 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b623fd4d-08fb-4c77-bc1d-e182ea20d135 admin admin] The token cache is being invalidate because project 6d953872c1bd443aa26ee4f47626bdc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:58:40.217596 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b623fd4d-08fb-4c77-bc1d-e182ea20d135 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:40.218429 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b623fd4d-08fb-4c77-bc1d-e182ea20d135 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:40.220530 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2334/4648] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:58:39 2022] DELETE /identity/v3/projects/6d953872c1bd443aa26ee4f47626bdc9 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:58:40.226420 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f76197-cf92-4344-ab60-9d1b377e1dec None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:40.226967 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f76197-cf92-4344-ab60-9d1b377e1dec None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:40.227444 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f76197-cf92-4344-ab60-9d1b377e1dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:40.249212 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a5f76197-cf92-4344-ab60-9d1b377e1dec None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:40.250603 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a5f76197-cf92-4344-ab60-9d1b377e1dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:40.263505 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2ac2a-7788-4104-a0fd-fa96327047c1 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:40.263957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2ac2a-7788-4104-a0fd-fa96327047c1 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:40.264381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2ac2a-7788-4104-a0fd-fa96327047c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:40.308870 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-6fd2ac2a-7788-4104-a0fd-fa96327047c1 None None] MFA Rules not processed for user `a8ab80b3ee994b469f0cfe1147d85223`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:40.310184 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6fd2ac2a-7788-4104-a0fd-fa96327047c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:40.337018 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2315/4649] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:58:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:40.339289 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef56ed-8d85-4488-a5ba-768a4219f4a9 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:40.339590 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef56ed-8d85-4488-a5ba-768a4219f4a9 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:40.339871 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef56ed-8d85-4488-a5ba-768a4219f4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:40.355437 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:40.373750 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-bcef56ed-8d85-4488-a5ba-768a4219f4a9 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:40.376666 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-bcef56ed-8d85-4488-a5ba-768a4219f4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:40.393577 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2316/4650] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:58:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:40.394576 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef56ed-8d85-4488-a5ba-768a4219f4a9 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:40.406195 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef56ed-8d85-4488-a5ba-768a4219f4a9 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:40.413923 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2335/4651] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:58:40 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:58:40.415714 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e453877-1d90-4f87-a7b5-72700dcd3d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:40.416209 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e453877-1d90-4f87-a7b5-72700dcd3d69 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:40.416486 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e453877-1d90-4f87-a7b5-72700dcd3d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:40.416762 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e453877-1d90-4f87-a7b5-72700dcd3d69 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:40.417445 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e453877-1d90-4f87-a7b5-72700dcd3d69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:58:40.417915 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e453877-1d90-4f87-a7b5-72700dcd3d69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:40.419750 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e453877-1d90-4f87-a7b5-72700dcd3d69 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:40.422099 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2ac2a-7788-4104-a0fd-fa96327047c1 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:40.424328 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6fd2ac2a-7788-4104-a0fd-fa96327047c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:40.437609 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2317/4652] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:58:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:58:40.438574 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e453877-1d90-4f87-a7b5-72700dcd3d69 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:40.449506 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e453877-1d90-4f87-a7b5-72700dcd3d69 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:40.455186 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a618fd-c28b-4ff1-8705-fe9449204788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:40.455983 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a618fd-c28b-4ff1-8705-fe9449204788 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:40.456410 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a618fd-c28b-4ff1-8705-fe9449204788 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:40.456934 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a618fd-c28b-4ff1-8705-fe9449204788 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:40.457775 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a618fd-c28b-4ff1-8705-fe9449204788 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:40.460031 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a618fd-c28b-4ff1-8705-fe9449204788 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:40.492241 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:40.502262 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2318/4653] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:58:40 2022] POST /identity/v3/projects => generated 365 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:58:40.504019 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a618fd-c28b-4ff1-8705-fe9449204788 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:40.517183 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2ac2a-7788-4104-a0fd-fa96327047c1 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:40.586775 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33919f-46ed-4c5c-9f96-2bfc62a325f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:40.587404 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33919f-46ed-4c5c-9f96-2bfc62a325f8 service cinder] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:40.587820 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33919f-46ed-4c5c-9f96-2bfc62a325f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:40.588091 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33919f-46ed-4c5c-9f96-2bfc62a325f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:40.594094 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a618fd-c28b-4ff1-8705-fe9449204788 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:40.600072 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04d839d-d517-4313-9a07-95ba661fbfee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:40.600723 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d839d-d517-4313-9a07-95ba661fbfee admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:40.601079 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d839d-d517-4313-9a07-95ba661fbfee admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:40.601428 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d839d-d517-4313-9a07-95ba661fbfee admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:40.602140 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04d839d-d517-4313-9a07-95ba661fbfee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:40.604490 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04d839d-d517-4313-9a07-95ba661fbfee admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:40.634070 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2319/4654] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:58:40 2022] POST /identity/v3/users => generated 283 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:58:40.635492 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04d839d-d517-4313-9a07-95ba661fbfee admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:40.652154 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04d839d-d517-4313-9a07-95ba661fbfee admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:40.657816 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5853741-cb99-4014-b671-137ec90440ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:40.658903 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5853741-cb99-4014-b671-137ec90440ee admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:40.659218 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5853741-cb99-4014-b671-137ec90440ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:40.659745 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5853741-cb99-4014-b671-137ec90440ee admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:40.660398 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5853741-cb99-4014-b671-137ec90440ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:40.662904 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5853741-cb99-4014-b671-137ec90440ee admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:40.679466 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2320/4655] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:58:40 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:58:40.680880 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5853741-cb99-4014-b671-137ec90440ee admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:40.687365 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef33919f-46ed-4c5c-9f96-2bfc62a325f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:40.688891 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef33919f-46ed-4c5c-9f96-2bfc62a325f8 service cinder] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:40.694775 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5853741-cb99-4014-b671-137ec90440ee admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:40.708592 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca814e4-982b-4621-844b-c6ed96c73bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:40.709607 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca814e4-982b-4621-844b-c6ed96c73bdd admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:40.710226 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca814e4-982b-4621-844b-c6ed96c73bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:40.710879 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca814e4-982b-4621-844b-c6ed96c73bdd admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:40.711859 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca814e4-982b-4621-844b-c6ed96c73bdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:40.714734 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca814e4-982b-4621-844b-c6ed96c73bdd admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:40.714878 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2336/4656] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:58:40 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:58:40.727850 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2321/4657] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:58:40 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:58:40.748828 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33919f-46ed-4c5c-9f96-2bfc62a325f8 service cinder] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:40.766956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33919f-46ed-4c5c-9f96-2bfc62a325f8 service cinder] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:40.773918 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b2cf8-83e1-4aa6-bfbe-d28ce6c73a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:40.774621 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b2cf8-83e1-4aa6-bfbe-d28ce6c73a88 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:40.774883 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b2cf8-83e1-4aa6-bfbe-d28ce6c73a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:40.775202 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b2cf8-83e1-4aa6-bfbe-d28ce6c73a88 admin admin] PATH_INFO: `/v3/projects/68419214521d4cc787505520266101e5/users/b1e69a0881324bfdb952dd32952847d3/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:40.795742 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b2cf8-83e1-4aa6-bfbe-d28ce6c73a88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68419214521d4cc787505520266101e5, user_id=b1e69a0881324bfdb952dd32952847d3, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:40.799086 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b2cf8-83e1-4aa6-bfbe-d28ce6c73a88 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:40.811143 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca814e4-982b-4621-844b-c6ed96c73bdd admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:40.815916 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2337/4658] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:58:40 2022] PUT /identity/v3/projects/68419214521d4cc787505520266101e5/users/b1e69a0881324bfdb952dd32952847d3/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:40.826482 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7759048-2a24-4359-9c87-bb941ada606f None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:40.826982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7759048-2a24-4359-9c87-bb941ada606f None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:40.827530 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7759048-2a24-4359-9c87-bb941ada606f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:40.827993 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca814e4-982b-4621-844b-c6ed96c73bdd admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:40.858764 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-b7759048-2a24-4359-9c87-bb941ada606f None None] MFA Rules not processed for user `b1e69a0881324bfdb952dd32952847d3`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:40.860055 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b7759048-2a24-4359-9c87-bb941ada606f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:40.886674 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d9e4ed-cbba-4197-b4d4-bc5cf8077fa9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:40.887326 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9e4ed-cbba-4197-b4d4-bc5cf8077fa9 service cinder] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:40.887676 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9e4ed-cbba-4197-b4d4-bc5cf8077fa9 service cinder] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:40.888077 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9e4ed-cbba-4197-b4d4-bc5cf8077fa9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:40.890218 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f6d9e4ed-cbba-4197-b4d4-bc5cf8077fa9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:40.941898 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2338/4659] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:58:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:58:40.945309 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:40.956647 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7759048-2a24-4359-9c87-bb941ada606f None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:40.958721 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b7759048-2a24-4359-9c87-bb941ada606f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:40.963640 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d9e4ed-cbba-4197-b4d4-bc5cf8077fa9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:40.965441 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d9e4ed-cbba-4197-b4d4-bc5cf8077fa9 service cinder] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:40.970546 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:40.976476 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2322/4660] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:58:40 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:58:41.079874 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7759048-2a24-4359-9c87-bb941ada606f None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:41.092111 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b43f4-3c85-4022-befa-a41d6140f074 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:41.093119 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b43f4-3c85-4022-befa-a41d6140f074 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:41.093581 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b43f4-3c85-4022-befa-a41d6140f074 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:41.094110 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b43f4-3c85-4022-befa-a41d6140f074 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:41.104696 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b43f4-3c85-4022-befa-a41d6140f074 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:41.109781 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b43f4-3c85-4022-befa-a41d6140f074 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:41.140010 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2339/4661] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:58:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:58:41.157801 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b3711-42de-475a-b337-762dde6d9e53 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:41.158397 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b3711-42de-475a-b337-762dde6d9e53 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:41.158966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b3711-42de-475a-b337-762dde6d9e53 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:41.161036 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2323/4662] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 15:58:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:58:41.171588 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b43f4-3c85-4022-befa-a41d6140f074 service nova] Authenticating service token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:58:41.185301 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b43f4-3c85-4022-befa-a41d6140f074 service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:41.195337 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b43f4-3c85-4022-befa-a41d6140f074 service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:41.202750 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919ce08-6f1f-4aa9-bee2-8fa0900e855d tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1e69a0881324bfdb952dd32952847d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68419214521d4cc787505520266101e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:41.203463 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919ce08-6f1f-4aa9-bee2-8fa0900e855d tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:41.203750 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919ce08-6f1f-4aa9-bee2-8fa0900e855d tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:41.204236 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919ce08-6f1f-4aa9-bee2-8fa0900e855d tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] PATH_INFO: `/v3/projects/68419214521d4cc787505520266101e5` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:41.205546 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b919ce08-6f1f-4aa9-bee2-8fa0900e855d tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] RBAC: Authorizing `identity:get_project(project_id=68419214521d4cc787505520266101e5)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:41.208657 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b919ce08-6f1f-4aa9-bee2-8fa0900e855d tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:41.210852 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2340/4663] 10.222.0.83 () {58 vars in 1443 bytes} [Mon Aug 29 15:58:41 2022] GET /identity/v3/projects/68419214521d4cc787505520266101e5 => generated 365 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:58:41.249823 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d5fcb-43b5-4b12-ac08-57e79849bb17 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:41.250322 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d5fcb-43b5-4b12-ac08-57e79849bb17 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:41.250793 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d5fcb-43b5-4b12-ac08-57e79849bb17 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:41.252559 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2324/4664] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 15:58:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:58:41.258601 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919ce08-6f1f-4aa9-bee2-8fa0900e855d tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] Authenticating service token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:58:41.277301 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919ce08-6f1f-4aa9-bee2-8fa0900e855d tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:41.287778 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919ce08-6f1f-4aa9-bee2-8fa0900e855d tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:41.296541 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084cc335-39c2-4fda-ace3-0fcaf6f995a0 tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1e69a0881324bfdb952dd32952847d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68419214521d4cc787505520266101e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:41.298290 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084cc335-39c2-4fda-ace3-0fcaf6f995a0 tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:41.298290 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084cc335-39c2-4fda-ace3-0fcaf6f995a0 tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:41.298290 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084cc335-39c2-4fda-ace3-0fcaf6f995a0 tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] PATH_INFO: `/v3/projects/68419214521d4cc787505520266101e5` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:41.300856 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084cc335-39c2-4fda-ace3-0fcaf6f995a0 tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] RBAC: Authorizing `identity:get_project(project_id=68419214521d4cc787505520266101e5)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:41.305165 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084cc335-39c2-4fda-ace3-0fcaf6f995a0 tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:41.305165 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2341/4665] 10.222.0.83 () {58 vars in 1443 bytes} [Mon Aug 29 15:58:41 2022] GET /identity/v3/projects/68419214521d4cc787505520266101e5 => generated 365 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:58:41.355358 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249b256-bf87-4a15-8ef1-bce9e1c8177b None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:41.355673 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249b256-bf87-4a15-8ef1-bce9e1c8177b None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:41.355937 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249b256-bf87-4a15-8ef1-bce9e1c8177b None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:41.357342 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2325/4666] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 15:58:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:58:41.362742 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084cc335-39c2-4fda-ace3-0fcaf6f995a0 tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] Authenticating service token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:58:41.365573 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-084cc335-39c2-4fda-ace3-0fcaf6f995a0 tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:41.394728 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084cc335-39c2-4fda-ace3-0fcaf6f995a0 tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:41.404688 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084cc335-39c2-4fda-ace3-0fcaf6f995a0 tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:41.411675 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f455b-fda2-487a-a476-9d30b86d0a4e tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1e69a0881324bfdb952dd32952847d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68419214521d4cc787505520266101e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:41.413802 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f455b-fda2-487a-a476-9d30b86d0a4e tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:41.413802 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f455b-fda2-487a-a476-9d30b86d0a4e tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:41.413802 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f455b-fda2-487a-a476-9d30b86d0a4e tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] PATH_INFO: `/v3/projects/68419214521d4cc787505520266101e5` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:41.415807 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4f455b-fda2-487a-a476-9d30b86d0a4e tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] RBAC: Authorizing `identity:get_project(project_id=68419214521d4cc787505520266101e5)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:41.417668 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4f455b-fda2-487a-a476-9d30b86d0a4e tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:41.419828 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2342/4667] 10.222.0.83 () {58 vars in 1443 bytes} [Mon Aug 29 15:58:41 2022] GET /identity/v3/projects/68419214521d4cc787505520266101e5 => generated 365 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:58:41.500968 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a995b-05ff-452a-b689-d544101949c0 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:41.501233 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a995b-05ff-452a-b689-d544101949c0 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:41.501498 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a995b-05ff-452a-b689-d544101949c0 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:41.502911 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2326/4668] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 15:58:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:58:41.510693 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f455b-fda2-487a-a476-9d30b86d0a4e tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] Authenticating service token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:58:41.526604 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f455b-fda2-487a-a476-9d30b86d0a4e tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:41.536916 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f455b-fda2-487a-a476-9d30b86d0a4e tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:41.542937 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5ba58-98d4-447a-935a-65275fc904e8 tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1e69a0881324bfdb952dd32952847d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68419214521d4cc787505520266101e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:41.543721 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5ba58-98d4-447a-935a-65275fc904e8 tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:41.544018 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5ba58-98d4-447a-935a-65275fc904e8 tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:41.544281 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5ba58-98d4-447a-935a-65275fc904e8 tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] PATH_INFO: `/v3/projects/68419214521d4cc787505520266101e5` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:41.545478 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e5ba58-98d4-447a-935a-65275fc904e8 tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] RBAC: Authorizing `identity:get_project(project_id=68419214521d4cc787505520266101e5)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:41.547311 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e5ba58-98d4-447a-935a-65275fc904e8 tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:41.549145 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2343/4669] 10.222.0.83 () {58 vars in 1443 bytes} [Mon Aug 29 15:58:41 2022] GET /identity/v3/projects/68419214521d4cc787505520266101e5 => generated 365 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:58:41.594930 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6d5cd-b7ed-4b9f-aee4-60609f9d60ae None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:41.599400 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6d5cd-b7ed-4b9f-aee4-60609f9d60ae None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:41.600149 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6d5cd-b7ed-4b9f-aee4-60609f9d60ae None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:41.605542 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2327/4670] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 15:58:41 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:58:41.616335 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5ba58-98d4-447a-935a-65275fc904e8 tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] Authenticating service token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:58:41.638667 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5ba58-98d4-447a-935a-65275fc904e8 tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:41.672732 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5ba58-98d4-447a-935a-65275fc904e8 tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:41.678391 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd0c049-cdc0-4b0e-86b7-801733528dcc tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1e69a0881324bfdb952dd32952847d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68419214521d4cc787505520266101e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:41.679152 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0c049-cdc0-4b0e-86b7-801733528dcc tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:41.679507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0c049-cdc0-4b0e-86b7-801733528dcc tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:41.679832 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0c049-cdc0-4b0e-86b7-801733528dcc tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] PATH_INFO: `/v3/projects/68419214521d4cc787505520266101e5` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:41.681318 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd0c049-cdc0-4b0e-86b7-801733528dcc tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] RBAC: Authorizing `identity:get_project(project_id=68419214521d4cc787505520266101e5)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:41.691380 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd0c049-cdc0-4b0e-86b7-801733528dcc tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:41.700617 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2344/4671] 10.222.0.83 () {58 vars in 1443 bytes} [Mon Aug 29 15:58:41 2022] GET /identity/v3/projects/68419214521d4cc787505520266101e5 => generated 365 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:58:41.756265 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6d5cd-b7ed-4b9f-aee4-60609f9d60ae None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:41.863248 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6d5cd-b7ed-4b9f-aee4-60609f9d60ae None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:41.869501 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a63949-80ea-45e0-b692-778d207dd728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:41.870546 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a63949-80ea-45e0-b692-778d207dd728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:41.871081 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a63949-80ea-45e0-b692-778d207dd728 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:41.871465 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a63949-80ea-45e0-b692-778d207dd728 admin admin] PATH_INFO: `/v3/users/b1e69a0881324bfdb952dd32952847d3` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:41.873341 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a63949-80ea-45e0-b692-778d207dd728 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1e69a0881324bfdb952dd32952847d3)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:41.875686 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a63949-80ea-45e0-b692-778d207dd728 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:41.960494 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c2a63949-80ea-45e0-b692-778d207dd728 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1e69a0881324bfdb952dd32952847d3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:41.961181 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c2a63949-80ea-45e0-b692-778d207dd728 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1e69a0881324bfdb952dd32952847d3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:41.970918 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c2a63949-80ea-45e0-b692-778d207dd728 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1e69a0881324bfdb952dd32952847d3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:41.990092 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c2a63949-80ea-45e0-b692-778d207dd728 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1e69a0881324bfdb952dd32952847d3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:41.991075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c2a63949-80ea-45e0-b692-778d207dd728 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1e69a0881324bfdb952dd32952847d3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:42.021947 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2328/4672] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:58:41 2022] DELETE /identity/v3/users/b1e69a0881324bfdb952dd32952847d3 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:42.027165 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c8fad-07b6-4bc7-b6b0-825fdd3a484a None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:42.027999 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c8fad-07b6-4bc7-b6b0-825fdd3a484a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:42.027999 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c8fad-07b6-4bc7-b6b0-825fdd3a484a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:42.048228 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-428c8fad-07b6-4bc7-b6b0-825fdd3a484a None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:42.050820 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-428c8fad-07b6-4bc7-b6b0-825fdd3a484a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:42.125626 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2345/4673] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:58:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:58:42.135467 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a63949-80ea-45e0-b692-778d207dd728 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:42.137478 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c2a63949-80ea-45e0-b692-778d207dd728 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:42.238357 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a63949-80ea-45e0-b692-778d207dd728 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:42.245727 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b807820-3bf6-4377-ace6-2ab8e8d59246 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:42.251447 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b807820-3bf6-4377-ace6-2ab8e8d59246 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:42.251752 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b807820-3bf6-4377-ace6-2ab8e8d59246 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:42.251996 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b807820-3bf6-4377-ace6-2ab8e8d59246 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:42.276015 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b807820-3bf6-4377-ace6-2ab8e8d59246 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:42.278171 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b807820-3bf6-4377-ace6-2ab8e8d59246 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:42.323669 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2329/4674] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:58:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:58:42.736194 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c8fad-07b6-4bc7-b6b0-825fdd3a484a None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:42.742226 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-428c8fad-07b6-4bc7-b6b0-825fdd3a484a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:42.757194 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c8fad-07b6-4bc7-b6b0-825fdd3a484a None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:42.767592 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3275f22-c9da-485a-aeff-52e18ed6d96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:42.769317 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3275f22-c9da-485a-aeff-52e18ed6d96e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:42.769930 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3275f22-c9da-485a-aeff-52e18ed6d96e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:42.770420 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3275f22-c9da-485a-aeff-52e18ed6d96e admin admin] PATH_INFO: `/v3/projects/68419214521d4cc787505520266101e5` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:42.772187 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3275f22-c9da-485a-aeff-52e18ed6d96e admin admin] RBAC: Authorizing `identity:delete_project(project_id=68419214521d4cc787505520266101e5)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:42.776639 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3275f22-c9da-485a-aeff-52e18ed6d96e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:42.873027 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:42.878421 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c3275f22-c9da-485a-aeff-52e18ed6d96e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68419214521d4cc787505520266101e5', 'request_id': 'req-c3275f22-c9da-485a-aeff-52e18ed6d96e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:42.886836 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c3275f22-c9da-485a-aeff-52e18ed6d96e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68419214521d4cc787505520266101e5', 'request_id': 'req-c3275f22-c9da-485a-aeff-52e18ed6d96e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:42.899968 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c3275f22-c9da-485a-aeff-52e18ed6d96e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68419214521d4cc787505520266101e5', 'request_id': 'req-c3275f22-c9da-485a-aeff-52e18ed6d96e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:42.944876 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c3275f22-c9da-485a-aeff-52e18ed6d96e admin admin] The token cache is being invalidate because project 68419214521d4cc787505520266101e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:58:42.945089 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c3275f22-c9da-485a-aeff-52e18ed6d96e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:42.953901 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c3275f22-c9da-485a-aeff-52e18ed6d96e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:42.963244 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2346/4675] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:58:42 2022] DELETE /identity/v3/projects/68419214521d4cc787505520266101e5 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:42.970923 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fced09c-c5b6-42bf-b077-58fb59556fbe None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:42.971248 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fced09c-c5b6-42bf-b077-58fb59556fbe None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:42.971522 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fced09c-c5b6-42bf-b077-58fb59556fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:43.006231 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:43.015791 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-2fced09c-c5b6-42bf-b077-58fb59556fbe None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:43.018312 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2fced09c-c5b6-42bf-b077-58fb59556fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:43.130919 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2330/4676] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:58:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:43.140449 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486168a8-2acb-4b8a-919d-4973a8605be4 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:43.140736 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486168a8-2acb-4b8a-919d-4973a8605be4 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:43.141012 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486168a8-2acb-4b8a-919d-4973a8605be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:43.179325 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-486168a8-2acb-4b8a-919d-4973a8605be4 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:43.180562 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-486168a8-2acb-4b8a-919d-4973a8605be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:43.193944 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2347/4677] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:58:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:43.204696 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fced09c-c5b6-42bf-b077-58fb59556fbe None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:43.222134 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fced09c-c5b6-42bf-b077-58fb59556fbe None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:43.229273 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed00a72-4395-4c03-b698-7e72c17db77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:43.231179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed00a72-4395-4c03-b698-7e72c17db77c admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:43.232091 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed00a72-4395-4c03-b698-7e72c17db77c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:43.232091 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed00a72-4395-4c03-b698-7e72c17db77c admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:43.233012 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed00a72-4395-4c03-b698-7e72c17db77c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:58:43.233526 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed00a72-4395-4c03-b698-7e72c17db77c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:43.235497 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed00a72-4395-4c03-b698-7e72c17db77c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:43.253352 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2331/4678] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:58:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:58:43.257650 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486168a8-2acb-4b8a-919d-4973a8605be4 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:43.267351 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486168a8-2acb-4b8a-919d-4973a8605be4 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:43.273916 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f46bde5-a09d-4ce7-8654-ce360146a343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:43.274539 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46bde5-a09d-4ce7-8654-ce360146a343 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:43.274818 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46bde5-a09d-4ce7-8654-ce360146a343 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:43.275224 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46bde5-a09d-4ce7-8654-ce360146a343 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:43.275760 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f46bde5-a09d-4ce7-8654-ce360146a343 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:43.278322 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f46bde5-a09d-4ce7-8654-ce360146a343 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:43.332219 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2348/4679] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:58:43 2022] POST /identity/v3/projects => generated 359 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:58:43.340392 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed00a72-4395-4c03-b698-7e72c17db77c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:43.353086 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed00a72-4395-4c03-b698-7e72c17db77c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:43.480356 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7ccde3-9488-4a55-bbfc-26dcf62d8bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:43.482532 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ccde3-9488-4a55-bbfc-26dcf62d8bc4 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:43.482532 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ccde3-9488-4a55-bbfc-26dcf62d8bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:43.482532 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ccde3-9488-4a55-bbfc-26dcf62d8bc4 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:43.482532 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7ccde3-9488-4a55-bbfc-26dcf62d8bc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:43.484660 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7ccde3-9488-4a55-bbfc-26dcf62d8bc4 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:43.510464 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2332/4680] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:58:43 2022] POST /identity/v3/users => generated 280 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:58:43.514259 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f46bde5-a09d-4ce7-8654-ce360146a343 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:43.532877 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f46bde5-a09d-4ce7-8654-ce360146a343 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:43.539554 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65feccd-a83f-4789-9953-0d1a1380fe69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:43.540336 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65feccd-a83f-4789-9953-0d1a1380fe69 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:43.540756 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65feccd-a83f-4789-9953-0d1a1380fe69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:43.541167 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65feccd-a83f-4789-9953-0d1a1380fe69 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:43.541994 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65feccd-a83f-4789-9953-0d1a1380fe69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:43.544361 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65feccd-a83f-4789-9953-0d1a1380fe69 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:43.556053 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2349/4681] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:58:43 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:58:43.560156 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7ccde3-9488-4a55-bbfc-26dcf62d8bc4 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:43.577312 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7ccde3-9488-4a55-bbfc-26dcf62d8bc4 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:43.584293 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec50858-e857-4598-825f-f02b55a80848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:43.586876 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec50858-e857-4598-825f-f02b55a80848 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:43.587408 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec50858-e857-4598-825f-f02b55a80848 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:43.587886 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec50858-e857-4598-825f-f02b55a80848 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:43.588758 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec50858-e857-4598-825f-f02b55a80848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:43.590846 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec50858-e857-4598-825f-f02b55a80848 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:43.622832 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65feccd-a83f-4789-9953-0d1a1380fe69 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:43.627230 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2333/4682] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:58:43 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:58:43.644244 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65feccd-a83f-4789-9953-0d1a1380fe69 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:43.650786 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd9355-6671-4bfb-88a3-41ea74ea2f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:43.651507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd9355-6671-4bfb-88a3-41ea74ea2f5e admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:43.651790 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd9355-6671-4bfb-88a3-41ea74ea2f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:43.652065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd9355-6671-4bfb-88a3-41ea74ea2f5e admin admin] PATH_INFO: `/v3/projects/d39e42ed34f74ff2a9bdd9adcd02b77f/users/32c9479074f14402a99e364de05592d5/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:43.682924 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd9355-6671-4bfb-88a3-41ea74ea2f5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d39e42ed34f74ff2a9bdd9adcd02b77f, user_id=32c9479074f14402a99e364de05592d5, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:43.688677 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd9355-6671-4bfb-88a3-41ea74ea2f5e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:43.710928 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2350/4683] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:58:43 2022] PUT /identity/v3/projects/d39e42ed34f74ff2a9bdd9adcd02b77f/users/32c9479074f14402a99e364de05592d5/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:43.724401 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93599a70-06a2-45f5-a5f9-0b615a7a4ad9 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:43.724707 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93599a70-06a2-45f5-a5f9-0b615a7a4ad9 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:43.724956 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93599a70-06a2-45f5-a5f9-0b615a7a4ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:43.773801 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-93599a70-06a2-45f5-a5f9-0b615a7a4ad9 None None] MFA Rules not processed for user `32c9479074f14402a99e364de05592d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:43.774971 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-93599a70-06a2-45f5-a5f9-0b615a7a4ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:43.894803 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2334/4684] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:58:43 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:43.940670 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd9355-6671-4bfb-88a3-41ea74ea2f5e admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:44.094603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd9355-6671-4bfb-88a3-41ea74ea2f5e admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:44.102678 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f78802-83f5-49c1-b882-2cf1d220d733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:44.103379 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f78802-83f5-49c1-b882-2cf1d220d733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:44.103658 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f78802-83f5-49c1-b882-2cf1d220d733 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:44.103933 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f78802-83f5-49c1-b882-2cf1d220d733 admin admin] PATH_INFO: `/v3/users/32c9479074f14402a99e364de05592d5` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:44.105111 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f78802-83f5-49c1-b882-2cf1d220d733 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32c9479074f14402a99e364de05592d5)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:44.107121 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f78802-83f5-49c1-b882-2cf1d220d733 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:44.200130 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e6f78802-83f5-49c1-b882-2cf1d220d733 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32c9479074f14402a99e364de05592d5'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:44.201096 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e6f78802-83f5-49c1-b882-2cf1d220d733 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32c9479074f14402a99e364de05592d5'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:44.217949 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e6f78802-83f5-49c1-b882-2cf1d220d733 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32c9479074f14402a99e364de05592d5'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:44.249583 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e6f78802-83f5-49c1-b882-2cf1d220d733 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32c9479074f14402a99e364de05592d5'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:44.254641 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:DELETE=14,keystone:SELECT=82,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:44.281413 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e6f78802-83f5-49c1-b882-2cf1d220d733 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32c9479074f14402a99e364de05592d5'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:44.316733 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7602774-ed28-4fb5-91bf-f26a3ac5bc78 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:44.317611 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7602774-ed28-4fb5-91bf-f26a3ac5bc78 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:44.317611 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7602774-ed28-4fb5-91bf-f26a3ac5bc78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:44.349578 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2351/4685] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:58:43 2022] DELETE /identity/v3/users/32c9479074f14402a99e364de05592d5 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:44.351283 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:44.380745 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-e7602774-ed28-4fb5-91bf-f26a3ac5bc78 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:44.381955 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e7602774-ed28-4fb5-91bf-f26a3ac5bc78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:44.524910 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2335/4686] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:58:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:44.536876 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f78802-83f5-49c1-b882-2cf1d220d733 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:44.538705 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e6f78802-83f5-49c1-b882-2cf1d220d733 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:44.662603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f78802-83f5-49c1-b882-2cf1d220d733 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:44.670429 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53ba4b-36c1-4a19-a73a-412397494b5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:44.671095 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53ba4b-36c1-4a19-a73a-412397494b5b service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:44.671382 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53ba4b-36c1-4a19-a73a-412397494b5b service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:44.671657 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53ba4b-36c1-4a19-a73a-412397494b5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:44.689865 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b53ba4b-36c1-4a19-a73a-412397494b5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:44.691771 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b53ba4b-36c1-4a19-a73a-412397494b5b service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:44.712391 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2352/4687] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:58:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:58:45.249419 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7602774-ed28-4fb5-91bf-f26a3ac5bc78 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:45.262162 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e7602774-ed28-4fb5-91bf-f26a3ac5bc78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:45.298215 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7602774-ed28-4fb5-91bf-f26a3ac5bc78 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:45.326936 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d56bb5-e1a9-4f6d-b68d-3bb277b32b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:45.328830 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d56bb5-e1a9-4f6d-b68d-3bb277b32b45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:45.329334 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d56bb5-e1a9-4f6d-b68d-3bb277b32b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:45.329797 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d56bb5-e1a9-4f6d-b68d-3bb277b32b45 admin admin] PATH_INFO: `/v3/projects/d39e42ed34f74ff2a9bdd9adcd02b77f` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:45.331398 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d56bb5-e1a9-4f6d-b68d-3bb277b32b45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d39e42ed34f74ff2a9bdd9adcd02b77f)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:45.340382 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d56bb5-e1a9-4f6d-b68d-3bb277b32b45 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:45.467236 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-05d56bb5-e1a9-4f6d-b68d-3bb277b32b45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd39e42ed34f74ff2a9bdd9adcd02b77f', 'request_id': 'req-05d56bb5-e1a9-4f6d-b68d-3bb277b32b45'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:45.478875 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-05d56bb5-e1a9-4f6d-b68d-3bb277b32b45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd39e42ed34f74ff2a9bdd9adcd02b77f', 'request_id': 'req-05d56bb5-e1a9-4f6d-b68d-3bb277b32b45'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:45.488225 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-05d56bb5-e1a9-4f6d-b68d-3bb277b32b45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd39e42ed34f74ff2a9bdd9adcd02b77f', 'request_id': 'req-05d56bb5-e1a9-4f6d-b68d-3bb277b32b45'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:45.513955 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-05d56bb5-e1a9-4f6d-b68d-3bb277b32b45 admin admin] The token cache is being invalidate because project d39e42ed34f74ff2a9bdd9adcd02b77f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:58:45.514259 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-05d56bb5-e1a9-4f6d-b68d-3bb277b32b45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:45.515051 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-05d56bb5-e1a9-4f6d-b68d-3bb277b32b45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:45.516647 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2336/4688] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:58:45 2022] DELETE /identity/v3/projects/d39e42ed34f74ff2a9bdd9adcd02b77f => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:45.522816 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee53364-d2f5-42e1-9b03-efbaf29e3c2f None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:45.525507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee53364-d2f5-42e1-9b03-efbaf29e3c2f None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:45.525507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee53364-d2f5-42e1-9b03-efbaf29e3c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:45.564819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-dee53364-d2f5-42e1-9b03-efbaf29e3c2f None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:45.568601 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-dee53364-d2f5-42e1-9b03-efbaf29e3c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:45.719593 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2353/4689] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:58:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:45.727835 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab9b48-ca33-46b4-b02d-6c0f8326b246 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:45.728192 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab9b48-ca33-46b4-b02d-6c0f8326b246 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:45.728473 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab9b48-ca33-46b4-b02d-6c0f8326b246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:45.756909 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-baab9b48-ca33-46b4-b02d-6c0f8326b246 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:45.758649 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-baab9b48-ca33-46b4-b02d-6c0f8326b246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:45.768068 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2337/4690] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:58:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:45.772523 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee53364-d2f5-42e1-9b03-efbaf29e3c2f None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:45.784068 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee53364-d2f5-42e1-9b03-efbaf29e3c2f None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:45.789739 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802022a-ab71-489d-950c-9573b153b82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:45.790562 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802022a-ab71-489d-950c-9573b153b82c admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:45.791219 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802022a-ab71-489d-950c-9573b153b82c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:45.792459 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802022a-ab71-489d-950c-9573b153b82c admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:45.795114 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3802022a-ab71-489d-950c-9573b153b82c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:58:45.795504 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3802022a-ab71-489d-950c-9573b153b82c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:45.797296 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3802022a-ab71-489d-950c-9573b153b82c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:45.858928 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2354/4691] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:58:45.862912 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab9b48-ca33-46b4-b02d-6c0f8326b246 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:45.892753 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab9b48-ca33-46b4-b02d-6c0f8326b246 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:45.911626 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3df1eb-026a-4321-aa3c-c159fe3040a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:45.912308 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3df1eb-026a-4321-aa3c-c159fe3040a8 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:45.912537 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3df1eb-026a-4321-aa3c-c159fe3040a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:45.912815 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3df1eb-026a-4321-aa3c-c159fe3040a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:45.916653 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3df1eb-026a-4321-aa3c-c159fe3040a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:45.922842 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3df1eb-026a-4321-aa3c-c159fe3040a8 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:45.977049 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2338/4692] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:58:45 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:58:45.978212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802022a-ab71-489d-950c-9573b153b82c admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:45.989694 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802022a-ab71-489d-950c-9573b153b82c admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:46.122266 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9057101b-3393-48d7-b359-4c2d31cf8908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:46.123136 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057101b-3393-48d7-b359-4c2d31cf8908 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:46.123136 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057101b-3393-48d7-b359-4c2d31cf8908 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:46.124466 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057101b-3393-48d7-b359-4c2d31cf8908 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:46.124466 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9057101b-3393-48d7-b359-4c2d31cf8908 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:46.126120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9057101b-3393-48d7-b359-4c2d31cf8908 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:46.220645 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2355/4693] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:58:45 2022] POST /identity/v3/users => generated 287 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:58:46.225997 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3df1eb-026a-4321-aa3c-c159fe3040a8 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:46.240885 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3df1eb-026a-4321-aa3c-c159fe3040a8 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:46.256843 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381828c9-fe78-4197-bfe8-6aaaa0e0bd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:46.257806 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381828c9-fe78-4197-bfe8-6aaaa0e0bd91 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:46.261098 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381828c9-fe78-4197-bfe8-6aaaa0e0bd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:46.261826 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381828c9-fe78-4197-bfe8-6aaaa0e0bd91 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:46.262706 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381828c9-fe78-4197-bfe8-6aaaa0e0bd91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:46.266174 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381828c9-fe78-4197-bfe8-6aaaa0e0bd91 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:46.304209 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2339/4694] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:58:46.305798 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9057101b-3393-48d7-b359-4c2d31cf8908 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:46.324841 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9057101b-3393-48d7-b359-4c2d31cf8908 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:46.346509 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60921d9a-0690-4c0e-a014-6db6de83ab12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:46.353056 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60921d9a-0690-4c0e-a014-6db6de83ab12 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:46.356324 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60921d9a-0690-4c0e-a014-6db6de83ab12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:46.358343 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60921d9a-0690-4c0e-a014-6db6de83ab12 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:46.363102 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60921d9a-0690-4c0e-a014-6db6de83ab12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:46.367770 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60921d9a-0690-4c0e-a014-6db6de83ab12 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:46.385023 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:46.404985 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2356/4695] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:58:46.405314 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381828c9-fe78-4197-bfe8-6aaaa0e0bd91 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:46.426106 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381828c9-fe78-4197-bfe8-6aaaa0e0bd91 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:46.433238 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22bfc4e-3f9a-4b2a-a0b8-fc9ae5077b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:46.433928 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bfc4e-3f9a-4b2a-a0b8-fc9ae5077b85 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:46.434244 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bfc4e-3f9a-4b2a-a0b8-fc9ae5077b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:46.434566 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bfc4e-3f9a-4b2a-a0b8-fc9ae5077b85 admin admin] PATH_INFO: `/v3/projects/6457a1c666bc4e0eb583236aa037f19c/users/1652b1d8c5904360a71f2f65a7b0feda/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:46.490972 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22bfc4e-3f9a-4b2a-a0b8-fc9ae5077b85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6457a1c666bc4e0eb583236aa037f19c, user_id=1652b1d8c5904360a71f2f65a7b0feda, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:46.498181 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22bfc4e-3f9a-4b2a-a0b8-fc9ae5077b85 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:46.531071 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2340/4696] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:58:46 2022] PUT /identity/v3/projects/6457a1c666bc4e0eb583236aa037f19c/users/1652b1d8c5904360a71f2f65a7b0feda/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:58:46.538570 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd382866-8bb7-482c-b1a6-0f39fbc93eae None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:46.539082 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd382866-8bb7-482c-b1a6-0f39fbc93eae None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:46.539364 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd382866-8bb7-482c-b1a6-0f39fbc93eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:46.575501 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-cd382866-8bb7-482c-b1a6-0f39fbc93eae None None] MFA Rules not processed for user `1652b1d8c5904360a71f2f65a7b0feda`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:46.577210 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-cd382866-8bb7-482c-b1a6-0f39fbc93eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:46.687061 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2357/4697] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:58:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:58:46.714971 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22bfc4e-3f9a-4b2a-a0b8-fc9ae5077b85 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:46.729257 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d22bfc4e-3f9a-4b2a-a0b8-fc9ae5077b85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:46.789156 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:46.901049 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22bfc4e-3f9a-4b2a-a0b8-fc9ae5077b85 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:46.912354 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56758050-505d-43b6-9558-a659c55d4909 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:46.913139 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56758050-505d-43b6-9558-a659c55d4909 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:46.914241 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56758050-505d-43b6-9558-a659c55d4909 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:46.914241 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56758050-505d-43b6-9558-a659c55d4909 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:46.925191 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56758050-505d-43b6-9558-a659c55d4909 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:46.927423 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56758050-505d-43b6-9558-a659c55d4909 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:46.937758 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2341/4698] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:58:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:58:48.033060 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd382866-8bb7-482c-b1a6-0f39fbc93eae None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:48.056136 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd382866-8bb7-482c-b1a6-0f39fbc93eae None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:48.070793 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc64c1-ab8d-45f7-b703-d8e60c45338c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:48.071769 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc64c1-ab8d-45f7-b703-d8e60c45338c service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:48.072235 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc64c1-ab8d-45f7-b703-d8e60c45338c service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:48.072687 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc64c1-ab8d-45f7-b703-d8e60c45338c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:48.078807 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5dcc64c1-ab8d-45f7-b703-d8e60c45338c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:48.103813 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc64c1-ab8d-45f7-b703-d8e60c45338c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:48.105714 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc64c1-ab8d-45f7-b703-d8e60c45338c service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:48.130203 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2358/4699] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:58:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:58:48.422142 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56758050-505d-43b6-9558-a659c55d4909 service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:48.424464 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-56758050-505d-43b6-9558-a659c55d4909 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:48.617417 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56758050-505d-43b6-9558-a659c55d4909 service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:48.625842 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62c89a-e1dc-4a72-8f4b-f59f0ed8cde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:48.628765 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62c89a-e1dc-4a72-8f4b-f59f0ed8cde3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:48.629087 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62c89a-e1dc-4a72-8f4b-f59f0ed8cde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:48.629890 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62c89a-e1dc-4a72-8f4b-f59f0ed8cde3 admin admin] PATH_INFO: `/v3/users/441d469cd5e34c279d784399fca2db9e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:48.647602 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62c89a-e1dc-4a72-8f4b-f59f0ed8cde3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=441d469cd5e34c279d784399fca2db9e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:48.655206 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62c89a-e1dc-4a72-8f4b-f59f0ed8cde3 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:48.828024 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2c62c89a-e1dc-4a72-8f4b-f59f0ed8cde3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '441d469cd5e34c279d784399fca2db9e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:48.830654 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2c62c89a-e1dc-4a72-8f4b-f59f0ed8cde3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '441d469cd5e34c279d784399fca2db9e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:48.859937 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2c62c89a-e1dc-4a72-8f4b-f59f0ed8cde3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '441d469cd5e34c279d784399fca2db9e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:48.878236 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2c62c89a-e1dc-4a72-8f4b-f59f0ed8cde3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '441d469cd5e34c279d784399fca2db9e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:48.880056 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2c62c89a-e1dc-4a72-8f4b-f59f0ed8cde3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '441d469cd5e34c279d784399fca2db9e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:48.923856 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2342/4700] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:58:48 2022] DELETE /identity/v3/users/441d469cd5e34c279d784399fca2db9e => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:48.928683 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc32197-6d3b-4004-aaec-dee4795cd028 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:48.929232 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc32197-6d3b-4004-aaec-dee4795cd028 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:48.929690 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc32197-6d3b-4004-aaec-dee4795cd028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:48.996475 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-7bc32197-6d3b-4004-aaec-dee4795cd028 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:48.998130 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7bc32197-6d3b-4004-aaec-dee4795cd028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:49.128007 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2359/4701] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:58:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:49.249910 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62c89a-e1dc-4a72-8f4b-f59f0ed8cde3 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:49.251401 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2c62c89a-e1dc-4a72-8f4b-f59f0ed8cde3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:49.323170 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:49.423305 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62c89a-e1dc-4a72-8f4b-f59f0ed8cde3 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:49.432695 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4298608f-3438-4ab6-87df-7f7cc14a8eba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:49.433364 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298608f-3438-4ab6-87df-7f7cc14a8eba service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:49.433645 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298608f-3438-4ab6-87df-7f7cc14a8eba service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:49.433916 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298608f-3438-4ab6-87df-7f7cc14a8eba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:49.461722 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4298608f-3438-4ab6-87df-7f7cc14a8eba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:49.463367 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4298608f-3438-4ab6-87df-7f7cc14a8eba service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:49.485063 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2343/4702] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:58:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:58:49.981572 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc32197-6d3b-4004-aaec-dee4795cd028 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:49.983616 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7bc32197-6d3b-4004-aaec-dee4795cd028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:50.013636 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc32197-6d3b-4004-aaec-dee4795cd028 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:50.028091 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa94bd-9c1e-4fa0-b5f9-426745e45e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:50.029199 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa94bd-9c1e-4fa0-b5f9-426745e45e8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:50.031007 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa94bd-9c1e-4fa0-b5f9-426745e45e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:50.031933 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa94bd-9c1e-4fa0-b5f9-426745e45e8f admin admin] PATH_INFO: `/v3/projects/3b596707117d466d89d39148978ab92b` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:50.034370 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caa94bd-9c1e-4fa0-b5f9-426745e45e8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b596707117d466d89d39148978ab92b)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:50.037679 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caa94bd-9c1e-4fa0-b5f9-426745e45e8f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:50.163629 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6caa94bd-9c1e-4fa0-b5f9-426745e45e8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b596707117d466d89d39148978ab92b', 'request_id': 'req-6caa94bd-9c1e-4fa0-b5f9-426745e45e8f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:50.181151 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6caa94bd-9c1e-4fa0-b5f9-426745e45e8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b596707117d466d89d39148978ab92b', 'request_id': 'req-6caa94bd-9c1e-4fa0-b5f9-426745e45e8f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:50.195878 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6caa94bd-9c1e-4fa0-b5f9-426745e45e8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b596707117d466d89d39148978ab92b', 'request_id': 'req-6caa94bd-9c1e-4fa0-b5f9-426745e45e8f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:50.205783 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:50.213676 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6caa94bd-9c1e-4fa0-b5f9-426745e45e8f admin admin] The token cache is being invalidate because project 3b596707117d466d89d39148978ab92b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:58:50.214181 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6caa94bd-9c1e-4fa0-b5f9-426745e45e8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:50.215199 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6caa94bd-9c1e-4fa0-b5f9-426745e45e8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:50.217587 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2360/4703] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:58:49 2022] DELETE /identity/v3/projects/3b596707117d466d89d39148978ab92b => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:50.222697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4298608f-3438-4ab6-87df-7f7cc14a8eba service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:50.236879 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4298608f-3438-4ab6-87df-7f7cc14a8eba service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:50.329914 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ace713-a545-4003-8335-ebeefef63006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:50.330988 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ace713-a545-4003-8335-ebeefef63006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:50.331578 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ace713-a545-4003-8335-ebeefef63006 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:50.332134 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ace713-a545-4003-8335-ebeefef63006 admin admin] PATH_INFO: `/v3/users/a8ab80b3ee994b469f0cfe1147d85223` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:50.334155 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ace713-a545-4003-8335-ebeefef63006 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8ab80b3ee994b469f0cfe1147d85223)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:50.336993 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ace713-a545-4003-8335-ebeefef63006 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:50.444529 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-23ace713-a545-4003-8335-ebeefef63006 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8ab80b3ee994b469f0cfe1147d85223'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:50.445493 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-23ace713-a545-4003-8335-ebeefef63006 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8ab80b3ee994b469f0cfe1147d85223'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:50.471163 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-23ace713-a545-4003-8335-ebeefef63006 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8ab80b3ee994b469f0cfe1147d85223'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:50.482878 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-23ace713-a545-4003-8335-ebeefef63006 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8ab80b3ee994b469f0cfe1147d85223'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:50.484787 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-23ace713-a545-4003-8335-ebeefef63006 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8ab80b3ee994b469f0cfe1147d85223'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:50.542426 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2344/4704] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:58:50 2022] DELETE /identity/v3/users/a8ab80b3ee994b469f0cfe1147d85223 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:51.067571 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa94bd-9c1e-4fa0-b5f9-426745e45e8f admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:51.069582 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6caa94bd-9c1e-4fa0-b5f9-426745e45e8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:51.095144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa94bd-9c1e-4fa0-b5f9-426745e45e8f admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:51.185422 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7393d74-5cbd-493d-949b-2272e1f01bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:51.186481 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7393d74-5cbd-493d-949b-2272e1f01bac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:51.186787 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7393d74-5cbd-493d-949b-2272e1f01bac admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:51.187080 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7393d74-5cbd-493d-949b-2272e1f01bac admin admin] PATH_INFO: `/v3/projects/96536b23de0b4fd5859f40a1be2c248f` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:51.188451 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7393d74-5cbd-493d-949b-2272e1f01bac admin admin] RBAC: Authorizing `identity:delete_project(project_id=96536b23de0b4fd5859f40a1be2c248f)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:51.191746 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7393d74-5cbd-493d-949b-2272e1f01bac admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:51.275135 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f7393d74-5cbd-493d-949b-2272e1f01bac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96536b23de0b4fd5859f40a1be2c248f', 'request_id': 'req-f7393d74-5cbd-493d-949b-2272e1f01bac'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:51.282812 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f7393d74-5cbd-493d-949b-2272e1f01bac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96536b23de0b4fd5859f40a1be2c248f', 'request_id': 'req-f7393d74-5cbd-493d-949b-2272e1f01bac'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:51.295441 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f7393d74-5cbd-493d-949b-2272e1f01bac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96536b23de0b4fd5859f40a1be2c248f', 'request_id': 'req-f7393d74-5cbd-493d-949b-2272e1f01bac'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:51.310921 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f7393d74-5cbd-493d-949b-2272e1f01bac admin admin] The token cache is being invalidate because project 96536b23de0b4fd5859f40a1be2c248f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:58:51.311249 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f7393d74-5cbd-493d-949b-2272e1f01bac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:51.312085 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f7393d74-5cbd-493d-949b-2272e1f01bac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:51.317135 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2361/4705] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:58:51 2022] DELETE /identity/v3/projects/96536b23de0b4fd5859f40a1be2c248f => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:51.319666 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2fa3f-383c-4ed3-8068-fe03ef15dd85 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:51.319985 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2fa3f-383c-4ed3-8068-fe03ef15dd85 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:51.321334 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2fa3f-383c-4ed3-8068-fe03ef15dd85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:51.346605 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-1fa2fa3f-383c-4ed3-8068-fe03ef15dd85 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:51.350812 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1fa2fa3f-383c-4ed3-8068-fe03ef15dd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:51.405894 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:51.432443 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2345/4706] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:58:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:51.439740 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c3e59-42c7-4250-b790-af22cd4e5c1b None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:51.441183 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c3e59-42c7-4250-b790-af22cd4e5c1b None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:51.441547 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c3e59-42c7-4250-b790-af22cd4e5c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:51.495436 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-806c3e59-42c7-4250-b790-af22cd4e5c1b None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:51.497375 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-806c3e59-42c7-4250-b790-af22cd4e5c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:51.522648 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2362/4707] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:58:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:51.526984 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2fa3f-383c-4ed3-8068-fe03ef15dd85 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:51.539246 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2fa3f-383c-4ed3-8068-fe03ef15dd85 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:51.545136 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c4693-ce9a-4db7-9493-df475498ca29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:51.546123 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c4693-ce9a-4db7-9493-df475498ca29 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:51.546600 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c4693-ce9a-4db7-9493-df475498ca29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:51.547128 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c4693-ce9a-4db7-9493-df475498ca29 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:51.548006 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c4693-ce9a-4db7-9493-df475498ca29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:58:51.548501 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c4693-ce9a-4db7-9493-df475498ca29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:51.550808 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c4693-ce9a-4db7-9493-df475498ca29 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:51.572383 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c3e59-42c7-4250-b790-af22cd4e5c1b None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:51.577599 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2346/4708] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:58:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:58:51.585851 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c3e59-42c7-4250-b790-af22cd4e5c1b None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:51.591057 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a17d39-29f4-46d0-b985-debdd05a8eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:51.592141 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a17d39-29f4-46d0-b985-debdd05a8eba admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:51.592626 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a17d39-29f4-46d0-b985-debdd05a8eba admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:51.593118 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a17d39-29f4-46d0-b985-debdd05a8eba admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:51.594167 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a17d39-29f4-46d0-b985-debdd05a8eba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:51.597006 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a17d39-29f4-46d0-b985-debdd05a8eba admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:51.642056 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2363/4709] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:58:51 2022] POST /identity/v3/projects => generated 383 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:58:51.646122 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c4693-ce9a-4db7-9493-df475498ca29 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:51.661463 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c4693-ce9a-4db7-9493-df475498ca29 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:51.768557 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8484de3-595a-4313-bfa2-8d836375b441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:51.769949 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8484de3-595a-4313-bfa2-8d836375b441 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:51.772060 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8484de3-595a-4313-bfa2-8d836375b441 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:51.772490 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8484de3-595a-4313-bfa2-8d836375b441 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:51.773804 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8484de3-595a-4313-bfa2-8d836375b441 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:51.776169 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8484de3-595a-4313-bfa2-8d836375b441 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:51.828828 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2347/4710] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:58:51 2022] POST /identity/v3/users => generated 292 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:58:51.830246 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a17d39-29f4-46d0-b985-debdd05a8eba admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:51.845482 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a17d39-29f4-46d0-b985-debdd05a8eba admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:51.854522 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a533d4d-3a76-4ad6-85a3-6d55c5df087b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:51.855390 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a533d4d-3a76-4ad6-85a3-6d55c5df087b admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:51.855801 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a533d4d-3a76-4ad6-85a3-6d55c5df087b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:51.856272 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a533d4d-3a76-4ad6-85a3-6d55c5df087b admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:51.870435 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a533d4d-3a76-4ad6-85a3-6d55c5df087b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:51.870435 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a533d4d-3a76-4ad6-85a3-6d55c5df087b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:51.897688 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2364/4711] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:58:51 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:58:51.902044 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8484de3-595a-4313-bfa2-8d836375b441 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:51.922301 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8484de3-595a-4313-bfa2-8d836375b441 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:51.928883 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053c1ec-f57d-4171-a32a-9229e07a2cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:51.929864 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053c1ec-f57d-4171-a32a-9229e07a2cfe admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:51.930500 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053c1ec-f57d-4171-a32a-9229e07a2cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:51.930965 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053c1ec-f57d-4171-a32a-9229e07a2cfe admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:51.931942 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0053c1ec-f57d-4171-a32a-9229e07a2cfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:51.934117 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0053c1ec-f57d-4171-a32a-9229e07a2cfe admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:51.952060 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2348/4712] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:58:51 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:58:51.956341 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a533d4d-3a76-4ad6-85a3-6d55c5df087b admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:51.971051 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a533d4d-3a76-4ad6-85a3-6d55c5df087b admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:51.981738 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ed9f9-7183-4022-923b-35aa4ec8557a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:51.984717 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ed9f9-7183-4022-923b-35aa4ec8557a admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:51.987846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ed9f9-7183-4022-923b-35aa4ec8557a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:51.988318 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ed9f9-7183-4022-923b-35aa4ec8557a admin admin] PATH_INFO: `/v3/projects/0051c77c6aa24a2393125d793fb64968/users/6d2ebd03fc0841b99e1deebbaab7a0fe/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:52.028102 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ed9f9-7183-4022-923b-35aa4ec8557a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0051c77c6aa24a2393125d793fb64968, user_id=6d2ebd03fc0841b99e1deebbaab7a0fe, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:52.030844 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ed9f9-7183-4022-923b-35aa4ec8557a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:52.065814 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2365/4713] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:58:51 2022] PUT /identity/v3/projects/0051c77c6aa24a2393125d793fb64968/users/6d2ebd03fc0841b99e1deebbaab7a0fe/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:52.067836 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ebf90a-132f-494b-8835-2739b9dee363 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:52.068122 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ebf90a-132f-494b-8835-2739b9dee363 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:52.068536 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ebf90a-132f-494b-8835-2739b9dee363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:52.128268 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-f6ebf90a-132f-494b-8835-2739b9dee363 None None] MFA Rules not processed for user `6d2ebd03fc0841b99e1deebbaab7a0fe`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:52.130610 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f6ebf90a-132f-494b-8835-2739b9dee363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:52.251455 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2349/4714] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:58:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:52.252567 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ed9f9-7183-4022-923b-35aa4ec8557a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:52.285816 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:52.367482 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ed9f9-7183-4022-923b-35aa4ec8557a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:52.384399 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6665598b-e5d9-42e4-ae5e-6a9ecb08626b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:52.385288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665598b-e5d9-42e4-ae5e-6a9ecb08626b admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:52.385717 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665598b-e5d9-42e4-ae5e-6a9ecb08626b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:52.386136 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665598b-e5d9-42e4-ae5e-6a9ecb08626b admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:52.386931 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6665598b-e5d9-42e4-ae5e-6a9ecb08626b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:52.389048 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6665598b-e5d9-42e4-ae5e-6a9ecb08626b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:52.446685 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ebf90a-132f-494b-8835-2739b9dee363 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:52.458217 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2366/4715] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:58:52 2022] POST /identity/v3/projects => generated 383 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:58:52.460053 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ebf90a-132f-494b-8835-2739b9dee363 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:52.515366 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:52.554742 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dea2e1-ed51-4fc4-b7d1-f27e20853634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:52.556551 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dea2e1-ed51-4fc4-b7d1-f27e20853634 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:52.556984 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dea2e1-ed51-4fc4-b7d1-f27e20853634 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:52.557413 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dea2e1-ed51-4fc4-b7d1-f27e20853634 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:52.559641 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dea2e1-ed51-4fc4-b7d1-f27e20853634 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:52.561809 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dea2e1-ed51-4fc4-b7d1-f27e20853634 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:52.603910 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2350/4716] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:58:52 2022] POST /identity/v3/users => generated 298 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:58:52.607652 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6665598b-e5d9-42e4-ae5e-6a9ecb08626b admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:52.628354 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6665598b-e5d9-42e4-ae5e-6a9ecb08626b admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:52.646021 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2ec6e-0ce8-454a-a599-ac437bf60fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:52.646764 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2ec6e-0ce8-454a-a599-ac437bf60fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:52.647093 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2ec6e-0ce8-454a-a599-ac437bf60fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:52.647339 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2ec6e-0ce8-454a-a599-ac437bf60fc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:52.653975 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb2ec6e-0ce8-454a-a599-ac437bf60fc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:52.657756 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb2ec6e-0ce8-454a-a599-ac437bf60fc5 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:52.688887 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2367/4717] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:58:52.690767 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dea2e1-ed51-4fc4-b7d1-f27e20853634 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:52.703368 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dea2e1-ed51-4fc4-b7d1-f27e20853634 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:52.720378 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b40bb1-ec6f-4494-95ab-4cb5a9382e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:52.721265 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b40bb1-ec6f-4494-95ab-4cb5a9382e6f admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:52.721699 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b40bb1-ec6f-4494-95ab-4cb5a9382e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:52.722832 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b40bb1-ec6f-4494-95ab-4cb5a9382e6f admin admin] PATH_INFO: `/v3/projects/854c8f5e9e0a473287b449085fa7b948/users/24a58cb4624f43e5a346638cb05d2fe5/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:52.760993 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b40bb1-ec6f-4494-95ab-4cb5a9382e6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=854c8f5e9e0a473287b449085fa7b948, user_id=24a58cb4624f43e5a346638cb05d2fe5, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:52.765178 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b40bb1-ec6f-4494-95ab-4cb5a9382e6f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:52.820237 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2351/4718] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:58:52 2022] PUT /identity/v3/projects/854c8f5e9e0a473287b449085fa7b948/users/24a58cb4624f43e5a346638cb05d2fe5/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:52.824339 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2ec6e-0ce8-454a-a599-ac437bf60fc5 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:52.859621 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2ec6e-0ce8-454a-a599-ac437bf60fc5 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:53.028555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1515461-753b-42a5-97b5-614c384b8d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:53.029204 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1515461-753b-42a5-97b5-614c384b8d56 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:53.029483 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1515461-753b-42a5-97b5-614c384b8d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:53.029932 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1515461-753b-42a5-97b5-614c384b8d56 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:53.031001 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1515461-753b-42a5-97b5-614c384b8d56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:53.032725 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1515461-753b-42a5-97b5-614c384b8d56 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:53.063436 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2368/4719] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:58:53.068116 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b40bb1-ec6f-4494-95ab-4cb5a9382e6f admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:53.093813 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b40bb1-ec6f-4494-95ab-4cb5a9382e6f admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:53.104643 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e9ad3-1ef5-44da-ae90-1f08795f4a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:53.105497 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e9ad3-1ef5-44da-ae90-1f08795f4a90 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:53.105781 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e9ad3-1ef5-44da-ae90-1f08795f4a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:53.106058 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e9ad3-1ef5-44da-ae90-1f08795f4a90 admin admin] PATH_INFO: `/v3/projects/854c8f5e9e0a473287b449085fa7b948/users/24a58cb4624f43e5a346638cb05d2fe5/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:53.108932 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e9ad3-1ef5-44da-ae90-1f08795f4a90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=854c8f5e9e0a473287b449085fa7b948, user_id=24a58cb4624f43e5a346638cb05d2fe5, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:53.111878 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e9ad3-1ef5-44da-ae90-1f08795f4a90 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:53.142641 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2352/4720] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:58:53 2022] PUT /identity/v3/projects/854c8f5e9e0a473287b449085fa7b948/users/24a58cb4624f43e5a346638cb05d2fe5/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:53.145277 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e1f63-50c1-4d74-8a74-e8c9eb8a9e12 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:53.145669 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e1f63-50c1-4d74-8a74-e8c9eb8a9e12 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:53.145977 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e1f63-50c1-4d74-8a74-e8c9eb8a9e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:53.218178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-c42e1f63-50c1-4d74-8a74-e8c9eb8a9e12 None None] MFA Rules not processed for user `24a58cb4624f43e5a346638cb05d2fe5`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:53.227548 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c42e1f63-50c1-4d74-8a74-e8c9eb8a9e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:53.422567 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2369/4721] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:58:53 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:58:53.431346 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e9ad3-1ef5-44da-ae90-1f08795f4a90 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:53.433451 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-799e9ad3-1ef5-44da-ae90-1f08795f4a90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:53.578018 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e9ad3-1ef5-44da-ae90-1f08795f4a90 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:53.588730 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554da232-ac8a-4c16-9b14-01305349e122 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:53.589364 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554da232-ac8a-4c16-9b14-01305349e122 service cinder] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:53.589640 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554da232-ac8a-4c16-9b14-01305349e122 service cinder] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:53.589941 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554da232-ac8a-4c16-9b14-01305349e122 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:53.602335 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554da232-ac8a-4c16-9b14-01305349e122 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:53.604254 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554da232-ac8a-4c16-9b14-01305349e122 service cinder] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:53.615916 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2353/4722] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:58:53 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:58:53.804261 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e1f63-50c1-4d74-8a74-e8c9eb8a9e12 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:53.815675 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e1f63-50c1-4d74-8a74-e8c9eb8a9e12 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:53.820451 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f415f4-9491-4a0a-8e99-b26881aa4e82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:53.821085 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f415f4-9491-4a0a-8e99-b26881aa4e82 service cinder] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:53.821363 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f415f4-9491-4a0a-8e99-b26881aa4e82 service cinder] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:53.821631 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f415f4-9491-4a0a-8e99-b26881aa4e82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:53.841840 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:53.888076 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f415f4-9491-4a0a-8e99-b26881aa4e82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:53.889540 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f415f4-9491-4a0a-8e99-b26881aa4e82 service cinder] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:53.913016 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2370/4723] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:58:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:58:54.256874 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554da232-ac8a-4c16-9b14-01305349e122 service cinder] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:54.257763 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-554da232-ac8a-4c16-9b14-01305349e122 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:54.364481 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554da232-ac8a-4c16-9b14-01305349e122 service cinder] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:54.370630 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02e53d-8de0-4394-bad3-5f7d2ab34c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:54.371624 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02e53d-8de0-4394-bad3-5f7d2ab34c6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:54.372328 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02e53d-8de0-4394-bad3-5f7d2ab34c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:54.372900 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02e53d-8de0-4394-bad3-5f7d2ab34c6a admin admin] PATH_INFO: `/v3/users/1652b1d8c5904360a71f2f65a7b0feda` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:54.374407 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c02e53d-8de0-4394-bad3-5f7d2ab34c6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1652b1d8c5904360a71f2f65a7b0feda)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:54.377092 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c02e53d-8de0-4394-bad3-5f7d2ab34c6a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:54.491104 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:54.500416 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5c02e53d-8de0-4394-bad3-5f7d2ab34c6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1652b1d8c5904360a71f2f65a7b0feda'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:54.501209 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5c02e53d-8de0-4394-bad3-5f7d2ab34c6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1652b1d8c5904360a71f2f65a7b0feda'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:54.537095 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5c02e53d-8de0-4394-bad3-5f7d2ab34c6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1652b1d8c5904360a71f2f65a7b0feda'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:54.545608 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5c02e53d-8de0-4394-bad3-5f7d2ab34c6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1652b1d8c5904360a71f2f65a7b0feda'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:54.546358 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5c02e53d-8de0-4394-bad3-5f7d2ab34c6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1652b1d8c5904360a71f2f65a7b0feda'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:54.573843 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2354/4724] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:58:54 2022] DELETE /identity/v3/users/1652b1d8c5904360a71f2f65a7b0feda => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:54.576120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be0b90-7ee6-49e1-8c99-53db5aaf6faa None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:54.576619 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be0b90-7ee6-49e1-8c99-53db5aaf6faa None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:54.576812 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be0b90-7ee6-49e1-8c99-53db5aaf6faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:54.632275 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-52be0b90-7ee6-49e1-8c99-53db5aaf6faa None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:54.635095 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-52be0b90-7ee6-49e1-8c99-53db5aaf6faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:54.826511 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2371/4725] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:58:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:58:54.837816 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02e53d-8de0-4394-bad3-5f7d2ab34c6a admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:54.839466 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5c02e53d-8de0-4394-bad3-5f7d2ab34c6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:55.009302 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02e53d-8de0-4394-bad3-5f7d2ab34c6a admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:55.013898 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13752853-35e4-47b4-af19-74b005831220 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:55.014522 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13752853-35e4-47b4-af19-74b005831220 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:55.014795 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13752853-35e4-47b4-af19-74b005831220 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:55.017744 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13752853-35e4-47b4-af19-74b005831220 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:55.048708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13752853-35e4-47b4-af19-74b005831220 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:55.052310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13752853-35e4-47b4-af19-74b005831220 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:55.084320 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2355/4726] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:58:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:58:55.616030 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be0b90-7ee6-49e1-8c99-53db5aaf6faa None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:55.624560 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-52be0b90-7ee6-49e1-8c99-53db5aaf6faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:55.685535 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be0b90-7ee6-49e1-8c99-53db5aaf6faa None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:55.704285 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f5d425-698c-48de-8e62-3887afa9e03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:55.705082 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5d425-698c-48de-8e62-3887afa9e03c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:55.705512 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5d425-698c-48de-8e62-3887afa9e03c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:55.706013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5d425-698c-48de-8e62-3887afa9e03c admin admin] PATH_INFO: `/v3/projects/6457a1c666bc4e0eb583236aa037f19c` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:55.721295 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f5d425-698c-48de-8e62-3887afa9e03c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6457a1c666bc4e0eb583236aa037f19c)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:55.728337 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f5d425-698c-48de-8e62-3887afa9e03c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:55.806968 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c6f5d425-698c-48de-8e62-3887afa9e03c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6457a1c666bc4e0eb583236aa037f19c', 'request_id': 'req-c6f5d425-698c-48de-8e62-3887afa9e03c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:55.815342 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c6f5d425-698c-48de-8e62-3887afa9e03c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6457a1c666bc4e0eb583236aa037f19c', 'request_id': 'req-c6f5d425-698c-48de-8e62-3887afa9e03c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:55.828275 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c6f5d425-698c-48de-8e62-3887afa9e03c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6457a1c666bc4e0eb583236aa037f19c', 'request_id': 'req-c6f5d425-698c-48de-8e62-3887afa9e03c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:55.867810 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c6f5d425-698c-48de-8e62-3887afa9e03c admin admin] The token cache is being invalidate because project 6457a1c666bc4e0eb583236aa037f19c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:58:55.868437 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c6f5d425-698c-48de-8e62-3887afa9e03c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:55.870522 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c6f5d425-698c-48de-8e62-3887afa9e03c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:55.886882 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2372/4727] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:58:55 2022] DELETE /identity/v3/projects/6457a1c666bc4e0eb583236aa037f19c => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:55.893807 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48174c0a-39fc-4162-a3f3-bb767a016d6c None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:55.894618 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48174c0a-39fc-4162-a3f3-bb767a016d6c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:55.895625 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48174c0a-39fc-4162-a3f3-bb767a016d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:55.933480 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-48174c0a-39fc-4162-a3f3-bb767a016d6c None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:55.934706 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-48174c0a-39fc-4162-a3f3-bb767a016d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:56.059112 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2356/4728] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:58:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:58:56.063982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352916f5-e358-4877-bb99-228d5b33b7a7 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:56.064481 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352916f5-e358-4877-bb99-228d5b33b7a7 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:56.064762 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352916f5-e358-4877-bb99-228d5b33b7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:56.109216 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-352916f5-e358-4877-bb99-228d5b33b7a7 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:56.112400 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-352916f5-e358-4877-bb99-228d5b33b7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:56.139679 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2373/4729] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:58:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:56.143199 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48174c0a-39fc-4162-a3f3-bb767a016d6c None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:56.168798 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48174c0a-39fc-4162-a3f3-bb767a016d6c None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:56.185469 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77cb5f-2f63-44c5-9ea2-b4661622ece8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:56.186232 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77cb5f-2f63-44c5-9ea2-b4661622ece8 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:56.186718 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77cb5f-2f63-44c5-9ea2-b4661622ece8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:56.187179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77cb5f-2f63-44c5-9ea2-b4661622ece8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:56.188310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77cb5f-2f63-44c5-9ea2-b4661622ece8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:58:56.188916 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77cb5f-2f63-44c5-9ea2-b4661622ece8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:56.190823 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77cb5f-2f63-44c5-9ea2-b4661622ece8 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:56.217682 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2357/4730] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:58:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:58:56.218138 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352916f5-e358-4877-bb99-228d5b33b7a7 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:56.229287 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352916f5-e358-4877-bb99-228d5b33b7a7 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:56.234562 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c175d536-3404-427b-9313-c16a60d95507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:56.235487 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175d536-3404-427b-9313-c16a60d95507 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:56.236129 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175d536-3404-427b-9313-c16a60d95507 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:56.236634 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175d536-3404-427b-9313-c16a60d95507 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:56.237507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c175d536-3404-427b-9313-c16a60d95507 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:56.240725 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c175d536-3404-427b-9313-c16a60d95507 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:56.293758 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2374/4731] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:58:56 2022] POST /identity/v3/projects => generated 387 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:58:56.297682 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77cb5f-2f63-44c5-9ea2-b4661622ece8 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:56.309184 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77cb5f-2f63-44c5-9ea2-b4661622ece8 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:56.372016 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:56.400717 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658ec63-6456-4b38-9e19-d48a19475e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:56.401548 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658ec63-6456-4b38-9e19-d48a19475e27 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:56.401987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658ec63-6456-4b38-9e19-d48a19475e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:56.402417 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658ec63-6456-4b38-9e19-d48a19475e27 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:56.403419 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8658ec63-6456-4b38-9e19-d48a19475e27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:56.406863 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8658ec63-6456-4b38-9e19-d48a19475e27 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:56.449236 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2358/4732] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:58:56 2022] POST /identity/v3/users => generated 294 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:58:56.449958 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c175d536-3404-427b-9313-c16a60d95507 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:56.465057 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c175d536-3404-427b-9313-c16a60d95507 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:56.471633 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9cddb-10f1-4c43-a1af-217ad2132afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:56.472605 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9cddb-10f1-4c43-a1af-217ad2132afb admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:56.474246 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9cddb-10f1-4c43-a1af-217ad2132afb admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:56.474790 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9cddb-10f1-4c43-a1af-217ad2132afb admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:56.475717 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f9cddb-10f1-4c43-a1af-217ad2132afb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:56.477570 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f9cddb-10f1-4c43-a1af-217ad2132afb admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:56.497650 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658ec63-6456-4b38-9e19-d48a19475e27 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:56.507532 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2375/4733] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:58:56 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:58:56.513108 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658ec63-6456-4b38-9e19-d48a19475e27 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:56.527255 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a236256-f49b-49b5-a39e-e34c003785e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:56.528097 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a236256-f49b-49b5-a39e-e34c003785e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:56.528447 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a236256-f49b-49b5-a39e-e34c003785e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:56.528832 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a236256-f49b-49b5-a39e-e34c003785e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:56.529624 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a236256-f49b-49b5-a39e-e34c003785e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:56.532744 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a236256-f49b-49b5-a39e-e34c003785e2 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:56.548425 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2359/4734] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:58:56 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:58:56.554263 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9cddb-10f1-4c43-a1af-217ad2132afb admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:56.560578 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:56.568390 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9cddb-10f1-4c43-a1af-217ad2132afb admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:56.579479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc333a5-93a5-47f1-9b2c-9f0b511919ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:56.580946 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc333a5-93a5-47f1-9b2c-9f0b511919ae admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:56.581484 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc333a5-93a5-47f1-9b2c-9f0b511919ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:56.583187 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc333a5-93a5-47f1-9b2c-9f0b511919ae admin admin] PATH_INFO: `/v3/projects/199f1893f64943dcb9a855cb60355a0f/users/48dbfae5957a4af19f5154ccf7ad391f/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:56.603477 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc333a5-93a5-47f1-9b2c-9f0b511919ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=199f1893f64943dcb9a855cb60355a0f, user_id=48dbfae5957a4af19f5154ccf7ad391f, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:56.609032 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc333a5-93a5-47f1-9b2c-9f0b511919ae admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:56.629442 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2376/4735] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:58:56 2022] PUT /identity/v3/projects/199f1893f64943dcb9a855cb60355a0f/users/48dbfae5957a4af19f5154ccf7ad391f/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:58:56.640788 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72aab69-8f65-4c30-bfcc-ec63c12b4c4c None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:56.641145 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72aab69-8f65-4c30-bfcc-ec63c12b4c4c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:56.641362 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72aab69-8f65-4c30-bfcc-ec63c12b4c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:56.690003 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-b72aab69-8f65-4c30-bfcc-ec63c12b4c4c None None] MFA Rules not processed for user `48dbfae5957a4af19f5154ccf7ad391f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:56.691263 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b72aab69-8f65-4c30-bfcc-ec63c12b4c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:56.796481 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2360/4736] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:58:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:56.798773 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc333a5-93a5-47f1-9b2c-9f0b511919ae admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:56.893497 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc333a5-93a5-47f1-9b2c-9f0b511919ae admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:56.899943 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8db85-bc94-4160-b710-d3fbac75970d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:56.913499 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8db85-bc94-4160-b710-d3fbac75970d admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:56.915529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8db85-bc94-4160-b710-d3fbac75970d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:56.916060 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8db85-bc94-4160-b710-d3fbac75970d admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:56.917146 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca8db85-bc94-4160-b710-d3fbac75970d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:56.925547 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca8db85-bc94-4160-b710-d3fbac75970d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:56.982716 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2377/4737] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:58:56 2022] POST /identity/v3/projects => generated 389 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:58:56.986779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72aab69-8f65-4c30-bfcc-ec63c12b4c4c None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:57.002529 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72aab69-8f65-4c30-bfcc-ec63c12b4c4c None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:57.104612 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0457436-a74a-41ef-91d7-b8ac141d6f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:57.105258 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0457436-a74a-41ef-91d7-b8ac141d6f08 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:57.105577 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0457436-a74a-41ef-91d7-b8ac141d6f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:57.105922 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0457436-a74a-41ef-91d7-b8ac141d6f08 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:57.106639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0457436-a74a-41ef-91d7-b8ac141d6f08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:57.109491 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0457436-a74a-41ef-91d7-b8ac141d6f08 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:57.140608 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2361/4738] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:58:56 2022] POST /identity/v3/users => generated 301 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:58:57.144396 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8db85-bc94-4160-b710-d3fbac75970d admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:57.163952 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8db85-bc94-4160-b710-d3fbac75970d admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:57.170043 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a71ae6a-9d34-401b-b304-0a8dc06f6f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:57.171251 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71ae6a-9d34-401b-b304-0a8dc06f6f79 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:57.171729 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71ae6a-9d34-401b-b304-0a8dc06f6f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:57.172074 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71ae6a-9d34-401b-b304-0a8dc06f6f79 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:57.172948 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a71ae6a-9d34-401b-b304-0a8dc06f6f79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:57.175386 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a71ae6a-9d34-401b-b304-0a8dc06f6f79 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:57.189712 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2378/4739] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:58:57.194828 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0457436-a74a-41ef-91d7-b8ac141d6f08 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:57.209810 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0457436-a74a-41ef-91d7-b8ac141d6f08 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:57.215954 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b225b-99c0-43d5-85b7-793301c1215b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:57.216697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b225b-99c0-43d5-85b7-793301c1215b admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:57.217075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b225b-99c0-43d5-85b7-793301c1215b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:57.217414 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b225b-99c0-43d5-85b7-793301c1215b admin admin] PATH_INFO: `/v3/projects/47ab1561bc7a4a3c9fbe444e3ba89643/users/a34a9901aded4facaa768a9811644b6f/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:57.249913 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b225b-99c0-43d5-85b7-793301c1215b admin admin] RBAC: Authorizing `identity:create_grant(project_id=47ab1561bc7a4a3c9fbe444e3ba89643, user_id=a34a9901aded4facaa768a9811644b6f, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:57.255159 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b225b-99c0-43d5-85b7-793301c1215b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:57.275231 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2362/4740] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:58:57 2022] PUT /identity/v3/projects/47ab1561bc7a4a3c9fbe444e3ba89643/users/a34a9901aded4facaa768a9811644b6f/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:57.283876 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a71ae6a-9d34-401b-b304-0a8dc06f6f79 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:57.296810 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a71ae6a-9d34-401b-b304-0a8dc06f6f79 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:57.373807 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80bd13-aafb-42dc-bf13-fa2a94e37857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:57.374554 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80bd13-aafb-42dc-bf13-fa2a94e37857 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:57.374897 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80bd13-aafb-42dc-bf13-fa2a94e37857 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:57.375290 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80bd13-aafb-42dc-bf13-fa2a94e37857 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:57.376254 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80bd13-aafb-42dc-bf13-fa2a94e37857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:57.378435 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80bd13-aafb-42dc-bf13-fa2a94e37857 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:57.396028 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2379/4741] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:58:57.401657 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b225b-99c0-43d5-85b7-793301c1215b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:57.416241 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b225b-99c0-43d5-85b7-793301c1215b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:57.421551 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6354379-67e7-49ec-803f-eeb807a52cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:57.422245 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6354379-67e7-49ec-803f-eeb807a52cac admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:57.422522 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6354379-67e7-49ec-803f-eeb807a52cac admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:57.422793 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6354379-67e7-49ec-803f-eeb807a52cac admin admin] PATH_INFO: `/v3/projects/47ab1561bc7a4a3c9fbe444e3ba89643/users/a34a9901aded4facaa768a9811644b6f/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:57.425657 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6354379-67e7-49ec-803f-eeb807a52cac admin admin] RBAC: Authorizing `identity:create_grant(project_id=47ab1561bc7a4a3c9fbe444e3ba89643, user_id=a34a9901aded4facaa768a9811644b6f, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:57.430996 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6354379-67e7-49ec-803f-eeb807a52cac admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:57.458866 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2363/4742] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:58:57 2022] PUT /identity/v3/projects/47ab1561bc7a4a3c9fbe444e3ba89643/users/a34a9901aded4facaa768a9811644b6f/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:57.461290 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c8a1d-9457-4c98-8ded-de9c839ed86f None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:57.461591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c8a1d-9457-4c98-8ded-de9c839ed86f None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:57.461915 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c8a1d-9457-4c98-8ded-de9c839ed86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:57.499604 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-319c8a1d-9457-4c98-8ded-de9c839ed86f None None] MFA Rules not processed for user `a34a9901aded4facaa768a9811644b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:57.500818 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-319c8a1d-9457-4c98-8ded-de9c839ed86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:57.551463 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:57.589364 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2380/4743] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:58:57 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:57.591075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6354379-67e7-49ec-803f-eeb807a52cac admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:57.606670 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6354379-67e7-49ec-803f-eeb807a52cac admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:57.612981 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e7efdc-5756-40a9-a443-a48ecff7b511 tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34a9901aded4facaa768a9811644b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47ab1561bc7a4a3c9fbe444e3ba89643', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:57.614248 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7efdc-5756-40a9-a443-a48ecff7b511 tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:57.614762 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7efdc-5756-40a9-a443-a48ecff7b511 tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:57.615285 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7efdc-5756-40a9-a443-a48ecff7b511 tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] PATH_INFO: `/v3/projects/199f1893f64943dcb9a855cb60355a0f` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:57.616986 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e7efdc-5756-40a9-a443-a48ecff7b511 tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] RBAC: Authorizing `identity:get_project(project_id=199f1893f64943dcb9a855cb60355a0f)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:57.620063 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e7efdc-5756-40a9-a443-a48ecff7b511 tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:57.627659 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c8a1d-9457-4c98-8ded-de9c839ed86f None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:57.635458 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2364/4744] 10.222.0.83 () {58 vars in 1230 bytes} [Mon Aug 29 15:58:57 2022] GET /identity/v3/projects/199f1893f64943dcb9a855cb60355a0f => generated 387 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:58:57.641263 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c8a1d-9457-4c98-8ded-de9c839ed86f None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:57.650382 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2695024-4eb8-44f4-a6c4-9ae2b316b51e tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34a9901aded4facaa768a9811644b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47ab1561bc7a4a3c9fbe444e3ba89643', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:57.651836 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2695024-4eb8-44f4-a6c4-9ae2b316b51e tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:57.652534 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2695024-4eb8-44f4-a6c4-9ae2b316b51e tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:57.653025 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2695024-4eb8-44f4-a6c4-9ae2b316b51e tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:57.653936 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2695024-4eb8-44f4-a6c4-9ae2b316b51e tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:57.656289 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2695024-4eb8-44f4-a6c4-9ae2b316b51e tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:57.729916 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e7efdc-5756-40a9-a443-a48ecff7b511 tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:57.738964 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:57.743702 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2381/4745] 10.222.0.83 () {60 vars in 1152 bytes} [Mon Aug 29 15:58:57 2022] POST /identity/v3/projects => generated 338 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:58:57.751106 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e7efdc-5756-40a9-a443-a48ecff7b511 tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:57.869942 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa4c8f-e852-441a-b4ce-260344708db7 tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34a9901aded4facaa768a9811644b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47ab1561bc7a4a3c9fbe444e3ba89643', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:57.870579 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa4c8f-e852-441a-b4ce-260344708db7 tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:57.870862 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa4c8f-e852-441a-b4ce-260344708db7 tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:57.871172 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa4c8f-e852-441a-b4ce-260344708db7 tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:57.871831 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fa4c8f-e852-441a-b4ce-260344708db7 tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:57.872859 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-e4fa4c8f-e852-441a-b4ce-260344708db7 tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:58:57.872859 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 15:58:57.872859 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 15:58:57.874251 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fa4c8f-e852-441a-b4ce-260344708db7 tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:57.909255 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2695024-4eb8-44f4-a6c4-9ae2b316b51e tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:57.913385 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2365/4746] 10.222.0.83 () {58 vars in 1131 bytes} [Mon Aug 29 15:58:57 2022] GET /identity/v3/projects => generated 7674 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:58:57.925802 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2695024-4eb8-44f4-a6c4-9ae2b316b51e tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:57.933419 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf59cbd-0c03-45e8-9eb8-dd3fc75959b3 tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34a9901aded4facaa768a9811644b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47ab1561bc7a4a3c9fbe444e3ba89643', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:57.934185 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf59cbd-0c03-45e8-9eb8-dd3fc75959b3 tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:57.934481 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf59cbd-0c03-45e8-9eb8-dd3fc75959b3 tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:57.934836 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf59cbd-0c03-45e8-9eb8-dd3fc75959b3 tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] PATH_INFO: `/v3/projects/199f1893f64943dcb9a855cb60355a0f` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:57.936056 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf59cbd-0c03-45e8-9eb8-dd3fc75959b3 tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] RBAC: Authorizing `identity:get_project(project_id=199f1893f64943dcb9a855cb60355a0f)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:57.938348 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf59cbd-0c03-45e8-9eb8-dd3fc75959b3 tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:57.945873 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2382/4747] 10.222.0.83 () {58 vars in 1230 bytes} [Mon Aug 29 15:58:57 2022] GET /identity/v3/projects/199f1893f64943dcb9a855cb60355a0f => generated 387 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:58:57.946480 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa4c8f-e852-441a-b4ce-260344708db7 tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:57.959365 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa4c8f-e852-441a-b4ce-260344708db7 tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:57.965385 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1b829-1329-4b59-8c17-6079f3675c50 tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34a9901aded4facaa768a9811644b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47ab1561bc7a4a3c9fbe444e3ba89643', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:57.965975 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1b829-1329-4b59-8c17-6079f3675c50 tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:57.966251 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1b829-1329-4b59-8c17-6079f3675c50 tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:57.966520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1b829-1329-4b59-8c17-6079f3675c50 tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] PATH_INFO: `/v3/projects/5072c842705749488e06184a5199aeeb` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:57.967932 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c1b829-1329-4b59-8c17-6079f3675c50 tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] RBAC: Authorizing `identity:get_project(project_id=5072c842705749488e06184a5199aeeb)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:57.970063 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c1b829-1329-4b59-8c17-6079f3675c50 tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:57.972155 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2366/4748] 10.222.0.83 () {58 vars in 1230 bytes} [Mon Aug 29 15:58:57 2022] GET /identity/v3/projects/5072c842705749488e06184a5199aeeb => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:58:57.978386 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf59cbd-0c03-45e8-9eb8-dd3fc75959b3 tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:57.990681 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf59cbd-0c03-45e8-9eb8-dd3fc75959b3 tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:57.996411 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab0c86-18b5-4674-83cf-ce5367d44676 tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34a9901aded4facaa768a9811644b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47ab1561bc7a4a3c9fbe444e3ba89643', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:57.997238 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab0c86-18b5-4674-83cf-ce5367d44676 tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:57.997528 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab0c86-18b5-4674-83cf-ce5367d44676 tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:57.997804 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab0c86-18b5-4674-83cf-ce5367d44676 tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:57.998632 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ab0c86-18b5-4674-83cf-ce5367d44676 tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:58.000683 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ab0c86-18b5-4674-83cf-ce5367d44676 tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:58.046652 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1b829-1329-4b59-8c17-6079f3675c50 tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:58.047145 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2383/4749] 10.222.0.83 () {58 vars in 1131 bytes} [Mon Aug 29 15:58:57 2022] GET /identity/v3/projects => generated 7674 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:58:58.067185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1b829-1329-4b59-8c17-6079f3675c50 tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:58.074742 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c55aa1-13f5-4583-9cad-1a4540e7b0cb tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34a9901aded4facaa768a9811644b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47ab1561bc7a4a3c9fbe444e3ba89643', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:58.075593 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c55aa1-13f5-4583-9cad-1a4540e7b0cb tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:58.075913 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c55aa1-13f5-4583-9cad-1a4540e7b0cb tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:58.076145 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c55aa1-13f5-4583-9cad-1a4540e7b0cb tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:58.076827 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c55aa1-13f5-4583-9cad-1a4540e7b0cb tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:58:58.077134 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c55aa1-13f5-4583-9cad-1a4540e7b0cb tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:58.079901 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c55aa1-13f5-4583-9cad-1a4540e7b0cb tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:58.114656 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2367/4750] 10.222.0.83 () {58 vars in 1166 bytes} [Mon Aug 29 15:58:58 2022] GET /identity/v3/projects?domain_id=default => generated 7343 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:58:58.115607 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab0c86-18b5-4674-83cf-ce5367d44676 tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:58.126242 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab0c86-18b5-4674-83cf-ce5367d44676 tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:58.132956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fedcdf5-dab4-4928-a76a-3dc541335dcc tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34a9901aded4facaa768a9811644b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47ab1561bc7a4a3c9fbe444e3ba89643', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:58.133823 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedcdf5-dab4-4928-a76a-3dc541335dcc tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:58.134311 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedcdf5-dab4-4928-a76a-3dc541335dcc tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:58.134966 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedcdf5-dab4-4928-a76a-3dc541335dcc tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:58.135833 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fedcdf5-dab4-4928-a76a-3dc541335dcc tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:58.138885 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fedcdf5-dab4-4928-a76a-3dc541335dcc tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:58.167962 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2384/4751] 10.222.0.83 () {58 vars in 1131 bytes} [Mon Aug 29 15:58:58 2022] GET /identity/v3/projects => generated 7674 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:58:58.172680 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c55aa1-13f5-4583-9cad-1a4540e7b0cb tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:58.185551 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c55aa1-13f5-4583-9cad-1a4540e7b0cb tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:58.193488 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a25fb-f590-402e-af27-1b9410812d9b tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34a9901aded4facaa768a9811644b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47ab1561bc7a4a3c9fbe444e3ba89643', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:58.194409 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a25fb-f590-402e-af27-1b9410812d9b tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:58.194894 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a25fb-f590-402e-af27-1b9410812d9b tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:58.195385 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a25fb-f590-402e-af27-1b9410812d9b tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:58.196242 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a25fb-f590-402e-af27-1b9410812d9b tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:58:58.196757 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a25fb-f590-402e-af27-1b9410812d9b tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:58.198832 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a25fb-f590-402e-af27-1b9410812d9b tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:58.221545 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2368/4752] 10.222.0.83 () {58 vars in 1166 bytes} [Mon Aug 29 15:58:58 2022] GET /identity/v3/projects?domain_id=default => generated 7343 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:58:58.229451 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fedcdf5-dab4-4928-a76a-3dc541335dcc tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:58.246894 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fedcdf5-dab4-4928-a76a-3dc541335dcc tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:58.253417 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9057cc-ab76-45bf-8662-2795de11156a tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34a9901aded4facaa768a9811644b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47ab1561bc7a4a3c9fbe444e3ba89643', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:58.254213 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9057cc-ab76-45bf-8662-2795de11156a tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:58.256668 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9057cc-ab76-45bf-8662-2795de11156a tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:58.257173 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9057cc-ab76-45bf-8662-2795de11156a tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:58.257972 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9057cc-ab76-45bf-8662-2795de11156a tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:58.260467 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9057cc-ab76-45bf-8662-2795de11156a tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:58.295098 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2385/4753] 10.222.0.83 () {58 vars in 1131 bytes} [Mon Aug 29 15:58:58 2022] GET /identity/v3/projects => generated 7674 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:58:58.299992 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a25fb-f590-402e-af27-1b9410812d9b tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:58.317719 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a25fb-f590-402e-af27-1b9410812d9b tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:58.331702 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2731d61-9a98-41b6-ae5b-74e5d1af3ddc tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34a9901aded4facaa768a9811644b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47ab1561bc7a4a3c9fbe444e3ba89643', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:58.333434 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2731d61-9a98-41b6-ae5b-74e5d1af3ddc tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:58.334269 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2731d61-9a98-41b6-ae5b-74e5d1af3ddc tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:58.335295 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2731d61-9a98-41b6-ae5b-74e5d1af3ddc tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:58.336719 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2731d61-9a98-41b6-ae5b-74e5d1af3ddc tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-654678283) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:58:58.337781 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2731d61-9a98-41b6-ae5b-74e5d1af3ddc tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:58.342011 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2731d61-9a98-41b6-ae5b-74e5d1af3ddc tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:58.376768 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2369/4754] 10.222.0.83 () {58 vars in 1230 bytes} [Mon Aug 29 15:58:58 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-654678283 => generated 534 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:58:58.378323 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9057cc-ab76-45bf-8662-2795de11156a tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:58.391200 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9057cc-ab76-45bf-8662-2795de11156a tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:58.398251 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e678a-6fb5-4e3f-b21e-829b87b1500d tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34a9901aded4facaa768a9811644b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47ab1561bc7a4a3c9fbe444e3ba89643', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:58.400047 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e678a-6fb5-4e3f-b21e-829b87b1500d tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:58.400432 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e678a-6fb5-4e3f-b21e-829b87b1500d tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:58.400779 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e678a-6fb5-4e3f-b21e-829b87b1500d tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] PATH_INFO: `/v3/projects/5072c842705749488e06184a5199aeeb` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:58.402967 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2e678a-6fb5-4e3f-b21e-829b87b1500d tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5072c842705749488e06184a5199aeeb)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:58.404968 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2e678a-6fb5-4e3f-b21e-829b87b1500d tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:58.494144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9f2e678a-6fb5-4e3f-b21e-829b87b1500d tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5072c842705749488e06184a5199aeeb', 'request_id': 'req-9f2e678a-6fb5-4e3f-b21e-829b87b1500d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:58.503559 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9f2e678a-6fb5-4e3f-b21e-829b87b1500d tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5072c842705749488e06184a5199aeeb', 'request_id': 'req-9f2e678a-6fb5-4e3f-b21e-829b87b1500d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:58.519325 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9f2e678a-6fb5-4e3f-b21e-829b87b1500d tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5072c842705749488e06184a5199aeeb', 'request_id': 'req-9f2e678a-6fb5-4e3f-b21e-829b87b1500d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:58.539957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9f2e678a-6fb5-4e3f-b21e-829b87b1500d tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] The token cache is being invalidate because project 5072c842705749488e06184a5199aeeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:58:58.540320 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9f2e678a-6fb5-4e3f-b21e-829b87b1500d tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:58.540974 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9f2e678a-6fb5-4e3f-b21e-829b87b1500d tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:58.542558 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2386/4755] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:58:58 2022] DELETE /identity/v3/projects/5072c842705749488e06184a5199aeeb => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:58.547341 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2731d61-9a98-41b6-ae5b-74e5d1af3ddc tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:58.549530 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a2731d61-9a98-41b6-ae5b-74e5d1af3ddc tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:58.670970 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2731d61-9a98-41b6-ae5b-74e5d1af3ddc tempest-ListProjectsStaticTestJSON-1608600539 tempest-ListProjectsStaticTestJSON-1608600539-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:58.794511 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9b76b-b9ff-4a8b-a7c8-631f0b51fcea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:58.795214 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9b76b-b9ff-4a8b-a7c8-631f0b51fcea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:58.795500 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9b76b-b9ff-4a8b-a7c8-631f0b51fcea admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:58.795776 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9b76b-b9ff-4a8b-a7c8-631f0b51fcea admin admin] PATH_INFO: `/v3/users/48dbfae5957a4af19f5154ccf7ad391f` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:58.798225 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa9b76b-b9ff-4a8b-a7c8-631f0b51fcea admin admin] RBAC: Authorizing `identity:delete_user(user_id=48dbfae5957a4af19f5154ccf7ad391f)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:58.800523 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa9b76b-b9ff-4a8b-a7c8-631f0b51fcea admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:58.804575 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:58.882826 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3fa9b76b-b9ff-4a8b-a7c8-631f0b51fcea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48dbfae5957a4af19f5154ccf7ad391f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:58.883738 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3fa9b76b-b9ff-4a8b-a7c8-631f0b51fcea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48dbfae5957a4af19f5154ccf7ad391f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:58.895706 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3fa9b76b-b9ff-4a8b-a7c8-631f0b51fcea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48dbfae5957a4af19f5154ccf7ad391f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:58.909254 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3fa9b76b-b9ff-4a8b-a7c8-631f0b51fcea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48dbfae5957a4af19f5154ccf7ad391f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:58.912063 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3fa9b76b-b9ff-4a8b-a7c8-631f0b51fcea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48dbfae5957a4af19f5154ccf7ad391f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:58.956211 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2370/4756] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:58:58 2022] DELETE /identity/v3/users/48dbfae5957a4af19f5154ccf7ad391f => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:58.956460 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6ed3b-1306-4911-b0d7-6302b177a433 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:58.956922 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6ed3b-1306-4911-b0d7-6302b177a433 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:58.957194 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6ed3b-1306-4911-b0d7-6302b177a433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:58.998895 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-ccc6ed3b-1306-4911-b0d7-6302b177a433 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:59.000612 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ccc6ed3b-1306-4911-b0d7-6302b177a433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:59.100963 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:59.159139 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2387/4757] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:58:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:59.174925 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9b76b-b9ff-4a8b-a7c8-631f0b51fcea admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:59.177880 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3fa9b76b-b9ff-4a8b-a7c8-631f0b51fcea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:59.333958 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9b76b-b9ff-4a8b-a7c8-631f0b51fcea admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:59.341008 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef09b0d3-c398-425b-9102-66c1d4469323 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:59.341771 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09b0d3-c398-425b-9102-66c1d4469323 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:59.342055 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09b0d3-c398-425b-9102-66c1d4469323 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:59.342329 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09b0d3-c398-425b-9102-66c1d4469323 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:59.364921 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef09b0d3-c398-425b-9102-66c1d4469323 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:59.367017 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef09b0d3-c398-425b-9102-66c1d4469323 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:59.385012 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2371/4758] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:58:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:58:59.938517 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6ed3b-1306-4911-b0d7-6302b177a433 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:59.940240 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ccc6ed3b-1306-4911-b0d7-6302b177a433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:59.965057 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6ed3b-1306-4911-b0d7-6302b177a433 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:59.975831 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0350eec-c313-4927-a303-00fe68df3576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:59.976585 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0350eec-c313-4927-a303-00fe68df3576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:59.977195 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0350eec-c313-4927-a303-00fe68df3576 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:59.977630 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0350eec-c313-4927-a303-00fe68df3576 admin admin] PATH_INFO: `/v3/projects/199f1893f64943dcb9a855cb60355a0f` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:59.979796 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0350eec-c313-4927-a303-00fe68df3576 admin admin] RBAC: Authorizing `identity:delete_project(project_id=199f1893f64943dcb9a855cb60355a0f)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:59.989678 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0350eec-c313-4927-a303-00fe68df3576 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:00.047696 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b0350eec-c313-4927-a303-00fe68df3576 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '199f1893f64943dcb9a855cb60355a0f', 'request_id': 'req-b0350eec-c313-4927-a303-00fe68df3576'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:00.057486 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b0350eec-c313-4927-a303-00fe68df3576 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '199f1893f64943dcb9a855cb60355a0f', 'request_id': 'req-b0350eec-c313-4927-a303-00fe68df3576'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:00.069399 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b0350eec-c313-4927-a303-00fe68df3576 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '199f1893f64943dcb9a855cb60355a0f', 'request_id': 'req-b0350eec-c313-4927-a303-00fe68df3576'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:00.089185 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b0350eec-c313-4927-a303-00fe68df3576 admin admin] The token cache is being invalidate because project 199f1893f64943dcb9a855cb60355a0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:00.089746 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b0350eec-c313-4927-a303-00fe68df3576 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:00.090778 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b0350eec-c313-4927-a303-00fe68df3576 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:00.093542 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2388/4759] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:58:59 2022] DELETE /identity/v3/projects/199f1893f64943dcb9a855cb60355a0f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:00.096885 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef09b0d3-c398-425b-9102-66c1d4469323 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:00.111099 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef09b0d3-c398-425b-9102-66c1d4469323 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:00.190824 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0350eec-c313-4927-a303-00fe68df3576 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:00.193514 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b0350eec-c313-4927-a303-00fe68df3576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:00.255806 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c8d9d-995a-435c-9e15-1418bd805b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:00.256662 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c8d9d-995a-435c-9e15-1418bd805b09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:00.257755 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c8d9d-995a-435c-9e15-1418bd805b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:00.258743 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c8d9d-995a-435c-9e15-1418bd805b09 admin admin] PATH_INFO: `/v3/users/a34a9901aded4facaa768a9811644b6f` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:00.260461 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c8d9d-995a-435c-9e15-1418bd805b09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a34a9901aded4facaa768a9811644b6f)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:00.263547 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c8d9d-995a-435c-9e15-1418bd805b09 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:00.310332 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:00.324688 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0350eec-c313-4927-a303-00fe68df3576 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:00.332126 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c551bd-312d-4dec-89b7-fd7c12c01940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:00.332866 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c551bd-312d-4dec-89b7-fd7c12c01940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:00.333175 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c551bd-312d-4dec-89b7-fd7c12c01940 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:00.333452 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c551bd-312d-4dec-89b7-fd7c12c01940 admin admin] PATH_INFO: `/v3/users/6d2ebd03fc0841b99e1deebbaab7a0fe` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:00.334682 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c551bd-312d-4dec-89b7-fd7c12c01940 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d2ebd03fc0841b99e1deebbaab7a0fe)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:00.337162 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c551bd-312d-4dec-89b7-fd7c12c01940 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:00.352243 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-621c8d9d-995a-435c-9e15-1418bd805b09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a34a9901aded4facaa768a9811644b6f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:00.354235 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-621c8d9d-995a-435c-9e15-1418bd805b09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a34a9901aded4facaa768a9811644b6f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:00.381147 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-621c8d9d-995a-435c-9e15-1418bd805b09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a34a9901aded4facaa768a9811644b6f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:00.396614 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-621c8d9d-995a-435c-9e15-1418bd805b09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a34a9901aded4facaa768a9811644b6f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:00.398109 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-621c8d9d-995a-435c-9e15-1418bd805b09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a34a9901aded4facaa768a9811644b6f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:00.423587 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a2c551bd-312d-4dec-89b7-fd7c12c01940 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d2ebd03fc0841b99e1deebbaab7a0fe'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:00.424436 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a2c551bd-312d-4dec-89b7-fd7c12c01940 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d2ebd03fc0841b99e1deebbaab7a0fe'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:00.429844 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2372/4760] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:00 2022] DELETE /identity/v3/users/a34a9901aded4facaa768a9811644b6f => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:00.447551 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a2c551bd-312d-4dec-89b7-fd7c12c01940 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d2ebd03fc0841b99e1deebbaab7a0fe'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:00.463348 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a2c551bd-312d-4dec-89b7-fd7c12c01940 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d2ebd03fc0841b99e1deebbaab7a0fe'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:00.475612 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:00.481162 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a2c551bd-312d-4dec-89b7-fd7c12c01940 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d2ebd03fc0841b99e1deebbaab7a0fe'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:00.492260 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2389/4761] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:00 2022] DELETE /identity/v3/users/6d2ebd03fc0841b99e1deebbaab7a0fe => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:59:00.496808 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510d32a-024c-4908-ae2f-2b68da5f5856 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:00.497100 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510d32a-024c-4908-ae2f-2b68da5f5856 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:00.497382 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510d32a-024c-4908-ae2f-2b68da5f5856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:00.530026 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-8510d32a-024c-4908-ae2f-2b68da5f5856 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:00.531367 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8510d32a-024c-4908-ae2f-2b68da5f5856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:00.660625 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2373/4762] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:00.670882 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c551bd-312d-4dec-89b7-fd7c12c01940 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:00.672782 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a2c551bd-312d-4dec-89b7-fd7c12c01940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:00.769988 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c551bd-312d-4dec-89b7-fd7c12c01940 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:00.775343 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6972eba-ca89-4d82-ba44-93f8f150d1b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:00.776943 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6972eba-ca89-4d82-ba44-93f8f150d1b6 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:00.776943 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6972eba-ca89-4d82-ba44-93f8f150d1b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:00.776943 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6972eba-ca89-4d82-ba44-93f8f150d1b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:00.787774 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6972eba-ca89-4d82-ba44-93f8f150d1b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:00.789371 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6972eba-ca89-4d82-ba44-93f8f150d1b6 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:00.813590 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2390/4763] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:59:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:59:00.992116 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510d32a-024c-4908-ae2f-2b68da5f5856 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:00.994042 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8510d32a-024c-4908-ae2f-2b68da5f5856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:01.012044 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510d32a-024c-4908-ae2f-2b68da5f5856 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:01.026871 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbebed-cb97-4c8b-9c63-55b8bf451199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:01.027737 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbebed-cb97-4c8b-9c63-55b8bf451199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:01.030013 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbebed-cb97-4c8b-9c63-55b8bf451199 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:01.030342 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbebed-cb97-4c8b-9c63-55b8bf451199 admin admin] PATH_INFO: `/v3/projects/47ab1561bc7a4a3c9fbe444e3ba89643` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:01.031939 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbbebed-cb97-4c8b-9c63-55b8bf451199 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47ab1561bc7a4a3c9fbe444e3ba89643)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:01.050639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbbebed-cb97-4c8b-9c63-55b8bf451199 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:01.186931 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-dfbbebed-cb97-4c8b-9c63-55b8bf451199 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47ab1561bc7a4a3c9fbe444e3ba89643', 'request_id': 'req-dfbbebed-cb97-4c8b-9c63-55b8bf451199'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:01.206924 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-dfbbebed-cb97-4c8b-9c63-55b8bf451199 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47ab1561bc7a4a3c9fbe444e3ba89643', 'request_id': 'req-dfbbebed-cb97-4c8b-9c63-55b8bf451199'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:01.220113 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-dfbbebed-cb97-4c8b-9c63-55b8bf451199 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47ab1561bc7a4a3c9fbe444e3ba89643', 'request_id': 'req-dfbbebed-cb97-4c8b-9c63-55b8bf451199'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:01.251749 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-dfbbebed-cb97-4c8b-9c63-55b8bf451199 admin admin] The token cache is being invalidate because project 47ab1561bc7a4a3c9fbe444e3ba89643 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:01.252042 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-dfbbebed-cb97-4c8b-9c63-55b8bf451199 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:01.263539 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-dfbbebed-cb97-4c8b-9c63-55b8bf451199 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:01.268743 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2374/4764] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:59:00 2022] DELETE /identity/v3/projects/47ab1561bc7a4a3c9fbe444e3ba89643 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:01.272156 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63306f-1345-4450-9232-53877371f916 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:01.272612 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63306f-1345-4450-9232-53877371f916 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:01.272913 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63306f-1345-4450-9232-53877371f916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:01.346908 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-ff63306f-1345-4450-9232-53877371f916 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:01.359680 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ff63306f-1345-4450-9232-53877371f916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:01.478039 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbebed-cb97-4c8b-9c63-55b8bf451199 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:01.479921 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-dfbbebed-cb97-4c8b-9c63-55b8bf451199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:01.561707 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:01.579954 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2391/4765] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:01.589186 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d37af6-840a-4a91-8193-f73ee3b45ff9 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:01.589511 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d37af6-840a-4a91-8193-f73ee3b45ff9 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:01.589750 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d37af6-840a-4a91-8193-f73ee3b45ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:01.616335 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-b0d37af6-840a-4a91-8193-f73ee3b45ff9 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:01.617805 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b0d37af6-840a-4a91-8193-f73ee3b45ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:01.651161 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbebed-cb97-4c8b-9c63-55b8bf451199 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:01.661885 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42dcf7-b5c1-4cce-b6bd-745b1dc21764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:01.662763 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42dcf7-b5c1-4cce-b6bd-745b1dc21764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:01.663128 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42dcf7-b5c1-4cce-b6bd-745b1dc21764 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:01.663412 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42dcf7-b5c1-4cce-b6bd-745b1dc21764 admin admin] PATH_INFO: `/v3/projects/0051c77c6aa24a2393125d793fb64968` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:01.670410 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2392/4766] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:59:01.671703 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc42dcf7-b5c1-4cce-b6bd-745b1dc21764 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0051c77c6aa24a2393125d793fb64968)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:01.673850 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc42dcf7-b5c1-4cce-b6bd-745b1dc21764 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:01.680068 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d37af6-840a-4a91-8193-f73ee3b45ff9 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:01.718148 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d37af6-840a-4a91-8193-f73ee3b45ff9 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:01.739172 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd3a2a-8bda-4545-ac75-ac750addb853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:01.741966 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd3a2a-8bda-4545-ac75-ac750addb853 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:01.743733 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd3a2a-8bda-4545-ac75-ac750addb853 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:01.744483 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd3a2a-8bda-4545-ac75-ac750addb853 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:01.746727 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dd3a2a-8bda-4545-ac75-ac750addb853 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:59:01.746946 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dd3a2a-8bda-4545-ac75-ac750addb853 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:01.753646 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dd3a2a-8bda-4545-ac75-ac750addb853 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:01.788979 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-bc42dcf7-b5c1-4cce-b6bd-745b1dc21764 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0051c77c6aa24a2393125d793fb64968', 'request_id': 'req-bc42dcf7-b5c1-4cce-b6bd-745b1dc21764'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:01.792919 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2393/4767] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:59:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:59:01.797253 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd3a2a-8bda-4545-ac75-ac750addb853 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:01.817811 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd3a2a-8bda-4545-ac75-ac750addb853 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:01.829795 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-bc42dcf7-b5c1-4cce-b6bd-745b1dc21764 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0051c77c6aa24a2393125d793fb64968', 'request_id': 'req-bc42dcf7-b5c1-4cce-b6bd-745b1dc21764'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:01.837785 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-bc42dcf7-b5c1-4cce-b6bd-745b1dc21764 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0051c77c6aa24a2393125d793fb64968', 'request_id': 'req-bc42dcf7-b5c1-4cce-b6bd-745b1dc21764'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:01.864754 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-bc42dcf7-b5c1-4cce-b6bd-745b1dc21764 admin admin] The token cache is being invalidate because project 0051c77c6aa24a2393125d793fb64968 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:01.864996 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-bc42dcf7-b5c1-4cce-b6bd-745b1dc21764 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:01.869693 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-bc42dcf7-b5c1-4cce-b6bd-745b1dc21764 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:01.871657 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2375/4768] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:59:01 2022] DELETE /identity/v3/projects/0051c77c6aa24a2393125d793fb64968 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:59:01.875310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42dcf7-b5c1-4cce-b6bd-745b1dc21764 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:01.876726 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-bc42dcf7-b5c1-4cce-b6bd-745b1dc21764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:02.007873 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42dcf7-b5c1-4cce-b6bd-745b1dc21764 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:02.017986 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9bdb55-b4a6-429e-828e-9f80ba6abbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:02.018588 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bdb55-b4a6-429e-828e-9f80ba6abbcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:02.018874 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bdb55-b4a6-429e-828e-9f80ba6abbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:02.019237 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bdb55-b4a6-429e-828e-9f80ba6abbcb admin admin] PATH_INFO: `/v3/users/24a58cb4624f43e5a346638cb05d2fe5` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:02.022124 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9bdb55-b4a6-429e-828e-9f80ba6abbcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=24a58cb4624f43e5a346638cb05d2fe5)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:02.024933 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9bdb55-b4a6-429e-828e-9f80ba6abbcb admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:02.067885 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a575835-da2f-49c1-bd91-6d768ef7dea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:02.072347 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a575835-da2f-49c1-bd91-6d768ef7dea1 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:02.073180 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a575835-da2f-49c1-bd91-6d768ef7dea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:02.078764 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a575835-da2f-49c1-bd91-6d768ef7dea1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:02.079181 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a575835-da2f-49c1-bd91-6d768ef7dea1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:02.081152 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a575835-da2f-49c1-bd91-6d768ef7dea1 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:02.096207 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0a9bdb55-b4a6-429e-828e-9f80ba6abbcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24a58cb4624f43e5a346638cb05d2fe5'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:02.098723 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0a9bdb55-b4a6-429e-828e-9f80ba6abbcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24a58cb4624f43e5a346638cb05d2fe5'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:02.112362 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0a9bdb55-b4a6-429e-828e-9f80ba6abbcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24a58cb4624f43e5a346638cb05d2fe5'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:02.122413 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:02.128506 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0a9bdb55-b4a6-429e-828e-9f80ba6abbcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24a58cb4624f43e5a346638cb05d2fe5'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:02.129587 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0a9bdb55-b4a6-429e-828e-9f80ba6abbcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24a58cb4624f43e5a346638cb05d2fe5'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:02.155683 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2394/4769] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:59:01 2022] POST /identity/v3/projects => generated 365 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:59:02.156972 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a575835-da2f-49c1-bd91-6d768ef7dea1 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:02.165219 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4a575835-da2f-49c1-bd91-6d768ef7dea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:02.173147 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2376/4770] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:01 2022] DELETE /identity/v3/users/24a58cb4624f43e5a346638cb05d2fe5 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:59:02.176046 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:02.271695 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a575835-da2f-49c1-bd91-6d768ef7dea1 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:02.400747 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed249b-be47-497f-902f-4d0d4386fa57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:02.402238 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed249b-be47-497f-902f-4d0d4386fa57 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:02.402527 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed249b-be47-497f-902f-4d0d4386fa57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:02.402812 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed249b-be47-497f-902f-4d0d4386fa57 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:02.404233 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed249b-be47-497f-902f-4d0d4386fa57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:02.407074 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed249b-be47-497f-902f-4d0d4386fa57 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:02.436535 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2395/4771] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:59:02 2022] POST /identity/v3/users => generated 283 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:02.439962 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9bdb55-b4a6-429e-828e-9f80ba6abbcb admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:02.452238 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9bdb55-b4a6-429e-828e-9f80ba6abbcb admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:02.459678 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54643ca8-4b26-4f44-948d-05eef2a7303c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:02.461435 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54643ca8-4b26-4f44-948d-05eef2a7303c admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:02.461975 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54643ca8-4b26-4f44-948d-05eef2a7303c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:02.462435 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54643ca8-4b26-4f44-948d-05eef2a7303c admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:02.463591 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54643ca8-4b26-4f44-948d-05eef2a7303c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:02.465709 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54643ca8-4b26-4f44-948d-05eef2a7303c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:02.481463 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2377/4772] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:02.485114 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed249b-be47-497f-902f-4d0d4386fa57 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:02.499422 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed249b-be47-497f-902f-4d0d4386fa57 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:02.506792 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87433c7a-6967-48f2-bd18-0616842736c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:02.507720 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87433c7a-6967-48f2-bd18-0616842736c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:02.508248 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87433c7a-6967-48f2-bd18-0616842736c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:02.508738 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87433c7a-6967-48f2-bd18-0616842736c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:02.509580 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87433c7a-6967-48f2-bd18-0616842736c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:02.513054 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87433c7a-6967-48f2-bd18-0616842736c3 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:02.527533 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2396/4773] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:02.531436 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54643ca8-4b26-4f44-948d-05eef2a7303c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:02.544944 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54643ca8-4b26-4f44-948d-05eef2a7303c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:02.551006 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12e746-2a84-4805-9cc9-a89165bd4efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:02.552894 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12e746-2a84-4805-9cc9-a89165bd4efa admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:02.553367 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12e746-2a84-4805-9cc9-a89165bd4efa admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:02.553725 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12e746-2a84-4805-9cc9-a89165bd4efa admin admin] PATH_INFO: `/v3/projects/7b34a02b7d2348588e61f0a157ada7bf/users/0958f3e0398a49e5aaa192b283b0f5a0/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:02.611056 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec12e746-2a84-4805-9cc9-a89165bd4efa admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b34a02b7d2348588e61f0a157ada7bf, user_id=0958f3e0398a49e5aaa192b283b0f5a0, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:02.615166 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec12e746-2a84-4805-9cc9-a89165bd4efa admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:02.637194 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2378/4774] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:02 2022] PUT /identity/v3/projects/7b34a02b7d2348588e61f0a157ada7bf/users/0958f3e0398a49e5aaa192b283b0f5a0/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:02.648221 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c79d9e-c4dd-415e-90f0-8f249639b0aa None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:02.654029 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c79d9e-c4dd-415e-90f0-8f249639b0aa None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:02.654525 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c79d9e-c4dd-415e-90f0-8f249639b0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:02.700504 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-15c79d9e-c4dd-415e-90f0-8f249639b0aa None None] MFA Rules not processed for user `0958f3e0398a49e5aaa192b283b0f5a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:02.702058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-15c79d9e-c4dd-415e-90f0-8f249639b0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:02.802012 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2397/4775] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:02.807059 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12e746-2a84-4805-9cc9-a89165bd4efa admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:02.907671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12e746-2a84-4805-9cc9-a89165bd4efa admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:02.914773 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1999bb-3d47-4283-aa1a-d05257d6a457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:02.915819 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1999bb-3d47-4283-aa1a-d05257d6a457 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:02.916314 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1999bb-3d47-4283-aa1a-d05257d6a457 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:02.916945 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1999bb-3d47-4283-aa1a-d05257d6a457 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:02.917920 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1999bb-3d47-4283-aa1a-d05257d6a457 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:02.920495 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1999bb-3d47-4283-aa1a-d05257d6a457 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:02.960376 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2379/4776] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:59:02 2022] POST /identity/v3/projects => generated 367 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:59:02.964263 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c79d9e-c4dd-415e-90f0-8f249639b0aa None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:02.980736 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c79d9e-c4dd-415e-90f0-8f249639b0aa None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:03.016008 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:03.116170 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c066d6-58e0-46e0-8a5f-1464a091794b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:03.116800 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c066d6-58e0-46e0-8a5f-1464a091794b admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:03.117085 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c066d6-58e0-46e0-8a5f-1464a091794b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:03.117356 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c066d6-58e0-46e0-8a5f-1464a091794b admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:03.118501 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c066d6-58e0-46e0-8a5f-1464a091794b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:03.120583 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c066d6-58e0-46e0-8a5f-1464a091794b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:03.197545 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2398/4777] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:59:02 2022] POST /identity/v3/users => generated 290 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:03.199840 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1999bb-3d47-4283-aa1a-d05257d6a457 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:03.214665 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1999bb-3d47-4283-aa1a-d05257d6a457 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:03.224799 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3db949-c4e1-46f1-9115-f20f0a394e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:03.225686 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3db949-c4e1-46f1-9115-f20f0a394e26 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:03.227367 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3db949-c4e1-46f1-9115-f20f0a394e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:03.227807 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3db949-c4e1-46f1-9115-f20f0a394e26 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:03.228639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3db949-c4e1-46f1-9115-f20f0a394e26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:03.236294 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3db949-c4e1-46f1-9115-f20f0a394e26 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:03.264186 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c066d6-58e0-46e0-8a5f-1464a091794b admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:03.274920 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2380/4778] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:03 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:03.279203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c066d6-58e0-46e0-8a5f-1464a091794b admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:03.284202 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0be42-8c58-492c-8b36-8cbd6f29e358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:03.285322 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0be42-8c58-492c-8b36-8cbd6f29e358 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:03.286513 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0be42-8c58-492c-8b36-8cbd6f29e358 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:03.287169 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0be42-8c58-492c-8b36-8cbd6f29e358 admin admin] PATH_INFO: `/v3/projects/34deb745228142859d01953adc57cf53/users/29cdb74e68e94e40999737a93161c713/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:03.310245 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f0be42-8c58-492c-8b36-8cbd6f29e358 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34deb745228142859d01953adc57cf53, user_id=29cdb74e68e94e40999737a93161c713, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:03.313233 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f0be42-8c58-492c-8b36-8cbd6f29e358 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:03.351636 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2399/4779] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:03 2022] PUT /identity/v3/projects/34deb745228142859d01953adc57cf53/users/29cdb74e68e94e40999737a93161c713/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:59:03.355919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3db949-c4e1-46f1-9115-f20f0a394e26 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:03.367212 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3db949-c4e1-46f1-9115-f20f0a394e26 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:03.448346 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0be42-8c58-492c-8b36-8cbd6f29e358 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:03.450337 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e3f0be42-8c58-492c-8b36-8cbd6f29e358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:03.491541 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c7760-2074-423b-91e8-3400c6850406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:03.493320 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c7760-2074-423b-91e8-3400c6850406 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:03.493607 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c7760-2074-423b-91e8-3400c6850406 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:03.493880 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c7760-2074-423b-91e8-3400c6850406 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:03.495963 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284c7760-2074-423b-91e8-3400c6850406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:03.499754 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284c7760-2074-423b-91e8-3400c6850406 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:03.523040 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2381/4780] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:03 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:03.527359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c7760-2074-423b-91e8-3400c6850406 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:03.543337 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c7760-2074-423b-91e8-3400c6850406 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:03.555726 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7396b75f-7db3-4963-914e-afe3c76e52ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:03.556447 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396b75f-7db3-4963-914e-afe3c76e52ab admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:03.556773 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396b75f-7db3-4963-914e-afe3c76e52ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:03.557057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396b75f-7db3-4963-914e-afe3c76e52ab admin admin] PATH_INFO: `/v3/projects/34deb745228142859d01953adc57cf53/users/29cdb74e68e94e40999737a93161c713/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:03.559443 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7396b75f-7db3-4963-914e-afe3c76e52ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=34deb745228142859d01953adc57cf53, user_id=29cdb74e68e94e40999737a93161c713, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:03.564864 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7396b75f-7db3-4963-914e-afe3c76e52ab admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:03.572676 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:03.587744 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2382/4781] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:03 2022] PUT /identity/v3/projects/34deb745228142859d01953adc57cf53/users/29cdb74e68e94e40999737a93161c713/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:03.601025 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd41faf-e695-44b7-8847-037c0a581d24 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:03.601375 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd41faf-e695-44b7-8847-037c0a581d24 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:03.603437 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd41faf-e695-44b7-8847-037c0a581d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:03.611642 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0be42-8c58-492c-8b36-8cbd6f29e358 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:03.690316 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-7fd41faf-e695-44b7-8847-037c0a581d24 None None] MFA Rules not processed for user `29cdb74e68e94e40999737a93161c713`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:03.691526 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7fd41faf-e695-44b7-8847-037c0a581d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:03.745779 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ff8df-e945-4ea4-8d14-2620a63afa42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:03.746706 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ff8df-e945-4ea4-8d14-2620a63afa42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:03.747550 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ff8df-e945-4ea4-8d14-2620a63afa42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:03.747550 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ff8df-e945-4ea4-8d14-2620a63afa42 admin admin] PATH_INFO: `/v3/projects/854c8f5e9e0a473287b449085fa7b948` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:03.748664 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ff8df-e945-4ea4-8d14-2620a63afa42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=854c8f5e9e0a473287b449085fa7b948)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:03.750755 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ff8df-e945-4ea4-8d14-2620a63afa42 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:03.811834 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:03.838012 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-084ff8df-e945-4ea4-8d14-2620a63afa42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '854c8f5e9e0a473287b449085fa7b948', 'request_id': 'req-084ff8df-e945-4ea4-8d14-2620a63afa42'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:03.842311 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-084ff8df-e945-4ea4-8d14-2620a63afa42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '854c8f5e9e0a473287b449085fa7b948', 'request_id': 'req-084ff8df-e945-4ea4-8d14-2620a63afa42'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:03.870898 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-084ff8df-e945-4ea4-8d14-2620a63afa42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '854c8f5e9e0a473287b449085fa7b948', 'request_id': 'req-084ff8df-e945-4ea4-8d14-2620a63afa42'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:03.885818 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-084ff8df-e945-4ea4-8d14-2620a63afa42 admin admin] The token cache is being invalidate because project 854c8f5e9e0a473287b449085fa7b948 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:03.886124 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-084ff8df-e945-4ea4-8d14-2620a63afa42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:03.886856 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-084ff8df-e945-4ea4-8d14-2620a63afa42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:03.888386 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2400/4782] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:59:03 2022] DELETE /identity/v3/projects/854c8f5e9e0a473287b449085fa7b948 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:59:03.889778 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ff8df-e945-4ea4-8d14-2620a63afa42 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:03.891912 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2383/4783] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:03 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:03.893645 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e368dc-8ac9-4fc3-b492-3b3ca4ed3eda None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:03.893930 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e368dc-8ac9-4fc3-b492-3b3ca4ed3eda None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:03.894325 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e368dc-8ac9-4fc3-b492-3b3ca4ed3eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:03.896679 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-084ff8df-e945-4ea4-8d14-2620a63afa42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:03.921342 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-f1e368dc-8ac9-4fc3-b492-3b3ca4ed3eda None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:03.923322 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f1e368dc-8ac9-4fc3-b492-3b3ca4ed3eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:04.007860 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2384/4784] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:04.019190 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ff8df-e945-4ea4-8d14-2620a63afa42 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:04.024789 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2422213-1441-4692-bfc1-d5cf3a2ee7fa None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:04.026265 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2422213-1441-4692-bfc1-d5cf3a2ee7fa None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:04.026563 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b9778-65eb-4ea4-95b6-2be2b099322b tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29cdb74e68e94e40999737a93161c713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34deb745228142859d01953adc57cf53', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:04.026696 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2422213-1441-4692-bfc1-d5cf3a2ee7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:04.027397 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b9778-65eb-4ea4-95b6-2be2b099322b tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:04.027689 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b9778-65eb-4ea4-95b6-2be2b099322b tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:04.028609 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b9778-65eb-4ea4-95b6-2be2b099322b tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] PATH_INFO: `/v3/regions` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:04.028772 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134b9778-65eb-4ea4-95b6-2be2b099322b tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:04.030472 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-134b9778-65eb-4ea4-95b6-2be2b099322b tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:59:04.030472 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 15:59:04.030472 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 15:59:04.031556 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134b9778-65eb-4ea4-95b6-2be2b099322b tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:04.083795 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2401/4785] 10.222.0.83 () {60 vars in 1149 bytes} [Mon Aug 29 15:59:03 2022] POST /identity/v3/regions => generated 224 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:04.085528 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b9778-65eb-4ea4-95b6-2be2b099322b tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:04.099691 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a2422213-1441-4692-bfc1-d5cf3a2ee7fa None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:04.104599 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a2422213-1441-4692-bfc1-d5cf3a2ee7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:04.128770 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b9778-65eb-4ea4-95b6-2be2b099322b tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:04.140351 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fea47e-f6b8-4d90-a5f8-e7e07258c544 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29cdb74e68e94e40999737a93161c713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34deb745228142859d01953adc57cf53', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:04.140990 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fea47e-f6b8-4d90-a5f8-e7e07258c544 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:04.141276 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fea47e-f6b8-4d90-a5f8-e7e07258c544 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:04.141659 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fea47e-f6b8-4d90-a5f8-e7e07258c544 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] PATH_INFO: `/v3/regions` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:04.142460 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fea47e-f6b8-4d90-a5f8-e7e07258c544 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:04.143920 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2385/4786] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:04.147393 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fea47e-f6b8-4d90-a5f8-e7e07258c544 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:04.149666 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2422213-1441-4692-bfc1-d5cf3a2ee7fa None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:04.186460 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2402/4787] 10.222.0.83 () {60 vars in 1149 bytes} [Mon Aug 29 15:59:04 2022] POST /identity/v3/regions => generated 223 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:04.190454 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fea47e-f6b8-4d90-a5f8-e7e07258c544 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:04.217101 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2422213-1441-4692-bfc1-d5cf3a2ee7fa None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:04.236524 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fea47e-f6b8-4d90-a5f8-e7e07258c544 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:04.247664 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568c96ee-0add-41b3-b2dc-711a68679798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:04.248619 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c96ee-0add-41b3-b2dc-711a68679798 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:04.249134 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c96ee-0add-41b3-b2dc-711a68679798 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:04.249775 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c96ee-0add-41b3-b2dc-711a68679798 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:04.251148 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568c96ee-0add-41b3-b2dc-711a68679798 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:59:04.251672 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568c96ee-0add-41b3-b2dc-711a68679798 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:04.251804 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3284642-b792-4d2e-b9c5-867a1018387c tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29cdb74e68e94e40999737a93161c713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34deb745228142859d01953adc57cf53', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:04.252433 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3284642-b792-4d2e-b9c5-867a1018387c tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:04.252715 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3284642-b792-4d2e-b9c5-867a1018387c tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:04.252989 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3284642-b792-4d2e-b9c5-867a1018387c tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] PATH_INFO: `/v3/regions/15e865a5-7f08-47b4-ac7b-a540f8ea25ef` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:04.253657 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3284642-b792-4d2e-b9c5-867a1018387c tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] RBAC: Authorizing `identity:create_region(region_id=15e865a5-7f08-47b4-ac7b-a540f8ea25ef)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:04.255507 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568c96ee-0add-41b3-b2dc-711a68679798 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:04.263614 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3284642-b792-4d2e-b9c5-867a1018387c tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:04.289256 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2386/4788] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:59:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:59:04.291591 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568c96ee-0add-41b3-b2dc-711a68679798 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:04.314475 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568c96ee-0add-41b3-b2dc-711a68679798 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:04.322508 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29e6f1-afd1-4e96-961a-365be85a0279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:04.323196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29e6f1-afd1-4e96-961a-365be85a0279 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:04.323477 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29e6f1-afd1-4e96-961a-365be85a0279 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:04.323790 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29e6f1-afd1-4e96-961a-365be85a0279 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:04.324429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a29e6f1-afd1-4e96-961a-365be85a0279 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:04.327444 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a29e6f1-afd1-4e96-961a-365be85a0279 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:04.339249 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2403/4789] 10.222.0.83 () {60 vars in 1259 bytes} [Mon Aug 29 15:59:04 2022] PUT /identity/v3/regions/15e865a5-7f08-47b4-ac7b-a540f8ea25ef => generated 232 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:04.341628 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3284642-b792-4d2e-b9c5-867a1018387c tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:04.380804 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2387/4790] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:59:04 2022] POST /identity/v3/projects => generated 387 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:04.386367 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29e6f1-afd1-4e96-961a-365be85a0279 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:04.402521 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3284642-b792-4d2e-b9c5-867a1018387c tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:04.427278 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:04.487417 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:04.514954 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29e6f1-afd1-4e96-961a-365be85a0279 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:04.533186 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dccc89-c101-44ca-bfb6-4b1b94f410a7 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29cdb74e68e94e40999737a93161c713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34deb745228142859d01953adc57cf53', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:04.533819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dccc89-c101-44ca-bfb6-4b1b94f410a7 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:04.534704 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dccc89-c101-44ca-bfb6-4b1b94f410a7 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:04.535250 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dccc89-c101-44ca-bfb6-4b1b94f410a7 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] PATH_INFO: `/v3/regions/15e865a5-7f08-47b4-ac7b-a540f8ea25ef` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:04.536008 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dccc89-c101-44ca-bfb6-4b1b94f410a7 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] RBAC: Authorizing `identity:delete_region(region_id=15e865a5-7f08-47b4-ac7b-a540f8ea25ef)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:04.537330 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-c2dccc89-c101-44ca-bfb6-4b1b94f410a7 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:59:04.537330 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 15:59:04.537330 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 15:59:04.538495 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dccc89-c101-44ca-bfb6-4b1b94f410a7 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:04.549192 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6115bd4a-3e0d-4568-ba75-866a1bfaada7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:04.550199 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115bd4a-3e0d-4568-ba75-866a1bfaada7 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:04.550542 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115bd4a-3e0d-4568-ba75-866a1bfaada7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:04.550917 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115bd4a-3e0d-4568-ba75-866a1bfaada7 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:04.551889 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6115bd4a-3e0d-4568-ba75-866a1bfaada7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:04.568186 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6115bd4a-3e0d-4568-ba75-866a1bfaada7 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:04.581826 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2404/4791] 10.222.0.83 () {58 vars in 1242 bytes} [Mon Aug 29 15:59:04 2022] DELETE /identity/v3/regions/15e865a5-7f08-47b4-ac7b-a540f8ea25ef => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:04.600792 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dccc89-c101-44ca-bfb6-4b1b94f410a7 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:04.634732 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2388/4792] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:59:04 2022] POST /identity/v3/users => generated 294 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:04.635336 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dccc89-c101-44ca-bfb6-4b1b94f410a7 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:04.638451 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6115bd4a-3e0d-4568-ba75-866a1bfaada7 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:04.673914 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fabdb8f-a4fa-41eb-bf93-66d01b8dc77f tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29cdb74e68e94e40999737a93161c713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34deb745228142859d01953adc57cf53', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:04.674416 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabdb8f-a4fa-41eb-bf93-66d01b8dc77f tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:04.674700 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabdb8f-a4fa-41eb-bf93-66d01b8dc77f tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:04.674972 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabdb8f-a4fa-41eb-bf93-66d01b8dc77f tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] PATH_INFO: `/v3/regions` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:04.675674 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fabdb8f-a4fa-41eb-bf93-66d01b8dc77f tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:04.678042 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fabdb8f-a4fa-41eb-bf93-66d01b8dc77f tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:04.684669 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6115bd4a-3e0d-4568-ba75-866a1bfaada7 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:04.728152 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d1180d-db32-417e-aa2e-3975b46f7dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:04.732938 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1180d-db32-417e-aa2e-3975b46f7dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:04.733379 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1180d-db32-417e-aa2e-3975b46f7dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:04.734501 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1180d-db32-417e-aa2e-3975b46f7dd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:04.736083 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d1180d-db32-417e-aa2e-3975b46f7dd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:04.737567 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2405/4793] 10.222.0.83 () {60 vars in 1150 bytes} [Mon Aug 29 15:59:04 2022] POST /identity/v3/regions => generated 254 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:04.738758 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d1180d-db32-417e-aa2e-3975b46f7dd9 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:04.742694 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fabdb8f-a4fa-41eb-bf93-66d01b8dc77f tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:04.773707 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2389/4794] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:04 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:59:04.783138 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d1180d-db32-417e-aa2e-3975b46f7dd9 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:04.809255 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d1180d-db32-417e-aa2e-3975b46f7dd9 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:04.817942 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fabdb8f-a4fa-41eb-bf93-66d01b8dc77f tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:04.828427 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8994ee-9043-4e50-aa8c-44cb81a19f92 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29cdb74e68e94e40999737a93161c713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34deb745228142859d01953adc57cf53', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:04.829026 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a9629-1e6c-494c-a173-0f6d027df46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:04.829886 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8994ee-9043-4e50-aa8c-44cb81a19f92 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:04.831396 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a9629-1e6c-494c-a173-0f6d027df46e admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:04.831876 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a9629-1e6c-494c-a173-0f6d027df46e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:04.832152 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a9629-1e6c-494c-a173-0f6d027df46e admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:04.832265 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8994ee-9043-4e50-aa8c-44cb81a19f92 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:04.833639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a9629-1e6c-494c-a173-0f6d027df46e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:04.834187 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8994ee-9043-4e50-aa8c-44cb81a19f92 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] PATH_INFO: `/v3/regions/7343214db08845e6890cf9ce50d86051` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:04.835064 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8994ee-9043-4e50-aa8c-44cb81a19f92 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] RBAC: Authorizing `identity:update_region(region_id=7343214db08845e6890cf9ce50d86051)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:04.836124 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a9629-1e6c-494c-a173-0f6d027df46e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:04.840699 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-8e8994ee-9043-4e50-aa8c-44cb81a19f92 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:59:04.840699 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 15:59:04.840699 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 15:59:04.841701 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8994ee-9043-4e50-aa8c-44cb81a19f92 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:04.851089 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2390/4795] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:04 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:04.855378 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a9629-1e6c-494c-a173-0f6d027df46e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:04.870049 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a9629-1e6c-494c-a173-0f6d027df46e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:04.875507 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2406/4796] 10.222.0.83 () {60 vars in 1250 bytes} [Mon Aug 29 15:59:04 2022] PATCH /identity/v3/regions/7343214db08845e6890cf9ce50d86051 => generated 253 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:59:04.883107 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8994ee-9043-4e50-aa8c-44cb81a19f92 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:04.894270 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3315be-66fc-4d8d-8f6a-afb715822ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:04.896154 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3315be-66fc-4d8d-8f6a-afb715822ab0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:04.896595 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3315be-66fc-4d8d-8f6a-afb715822ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:04.897789 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3315be-66fc-4d8d-8f6a-afb715822ab0 admin admin] PATH_INFO: `/v3/projects/958cefc26436471698e346c0fb0d3526/users/f5f564c8abdc4c6bb337a2ee4c146127/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:04.921934 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3315be-66fc-4d8d-8f6a-afb715822ab0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=958cefc26436471698e346c0fb0d3526, user_id=f5f564c8abdc4c6bb337a2ee4c146127, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:04.924887 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3315be-66fc-4d8d-8f6a-afb715822ab0 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:04.941793 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8994ee-9043-4e50-aa8c-44cb81a19f92 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:04.954281 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2391/4797] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:04 2022] PUT /identity/v3/projects/958cefc26436471698e346c0fb0d3526/users/f5f564c8abdc4c6bb337a2ee4c146127/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:04.967115 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befb313-d455-41d5-b138-55029fdce266 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:04.967115 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befb313-d455-41d5-b138-55029fdce266 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:04.967363 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befb313-d455-41d5-b138-55029fdce266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:05.020731 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-3befb313-d455-41d5-b138-55029fdce266 None None] MFA Rules not processed for user `f5f564c8abdc4c6bb337a2ee4c146127`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:05.021949 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3befb313-d455-41d5-b138-55029fdce266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:05.114342 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e162d-ccd2-40c0-81ad-ed54ad7bc261 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29cdb74e68e94e40999737a93161c713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34deb745228142859d01953adc57cf53', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:05.115384 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e162d-ccd2-40c0-81ad-ed54ad7bc261 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:05.116033 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e162d-ccd2-40c0-81ad-ed54ad7bc261 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:05.116275 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e162d-ccd2-40c0-81ad-ed54ad7bc261 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] PATH_INFO: `/v3/regions/7343214db08845e6890cf9ce50d86051` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:05.116969 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e162d-ccd2-40c0-81ad-ed54ad7bc261 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] RBAC: Authorizing `identity:get_region(region_id=7343214db08845e6890cf9ce50d86051)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:05.120363 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e162d-ccd2-40c0-81ad-ed54ad7bc261 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:05.138930 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2407/4798] 10.222.0.83 () {58 vars in 1227 bytes} [Mon Aug 29 15:59:04 2022] GET /identity/v3/regions/7343214db08845e6890cf9ce50d86051 => generated 253 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:59:05.144080 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e162d-ccd2-40c0-81ad-ed54ad7bc261 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:05.177421 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e162d-ccd2-40c0-81ad-ed54ad7bc261 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:05.191972 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5efc9c7-4123-4d84-a6a0-766deaac5c12 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29cdb74e68e94e40999737a93161c713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34deb745228142859d01953adc57cf53', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:05.192814 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5efc9c7-4123-4d84-a6a0-766deaac5c12 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:05.193165 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5efc9c7-4123-4d84-a6a0-766deaac5c12 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:05.193463 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5efc9c7-4123-4d84-a6a0-766deaac5c12 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] PATH_INFO: `/v3/regions/7343214db08845e6890cf9ce50d86051` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:05.194073 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5efc9c7-4123-4d84-a6a0-766deaac5c12 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] RBAC: Authorizing `identity:delete_region(region_id=7343214db08845e6890cf9ce50d86051)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:05.197724 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5efc9c7-4123-4d84-a6a0-766deaac5c12 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:05.242029 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2408/4799] 10.222.0.83 () {58 vars in 1230 bytes} [Mon Aug 29 15:59:05 2022] DELETE /identity/v3/regions/7343214db08845e6890cf9ce50d86051 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:05.246723 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5efc9c7-4123-4d84-a6a0-766deaac5c12 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:05.263188 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2392/4800] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:05.264222 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3befb313-d455-41d5-b138-55029fdce266 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:05.300463 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5efc9c7-4123-4d84-a6a0-766deaac5c12 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:05.303892 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:05.317497 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a3ec9-6bd0-4c1f-94cc-f004e8fae89f tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29cdb74e68e94e40999737a93161c713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34deb745228142859d01953adc57cf53', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:05.318229 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a3ec9-6bd0-4c1f-94cc-f004e8fae89f tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:05.318513 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a3ec9-6bd0-4c1f-94cc-f004e8fae89f tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:05.318790 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a3ec9-6bd0-4c1f-94cc-f004e8fae89f tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] PATH_INFO: `/v3/regions` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:05.319509 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a3ec9-6bd0-4c1f-94cc-f004e8fae89f tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:05.320814 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a3ec9-6bd0-4c1f-94cc-f004e8fae89f tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:05.332760 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2409/4801] 10.222.0.83 () {58 vars in 1128 bytes} [Mon Aug 29 15:59:05 2022] GET /identity/v3/regions => generated 669 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:59:05.339883 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a3ec9-6bd0-4c1f-94cc-f004e8fae89f tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:05.363500 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a3ec9-6bd0-4c1f-94cc-f004e8fae89f tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:05.383222 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb7102-6999-47b6-be23-4fd8321f2ebc tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29cdb74e68e94e40999737a93161c713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34deb745228142859d01953adc57cf53', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:05.387485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb7102-6999-47b6-be23-4fd8321f2ebc tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:05.387801 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb7102-6999-47b6-be23-4fd8321f2ebc tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:05.388069 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb7102-6999-47b6-be23-4fd8321f2ebc tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] PATH_INFO: `/v3/regions/7343214db08845e6890cf9ce50d86051` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:05.388692 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb7102-6999-47b6-be23-4fd8321f2ebc tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] RBAC: Authorizing `identity:delete_region(region_id=7343214db08845e6890cf9ce50d86051)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:05.390329 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb7102-6999-47b6-be23-4fd8321f2ebc tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:05.391736 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3befb313-d455-41d5-b138-55029fdce266 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:05.419615 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-b2cb7102-6999-47b6-be23-4fd8321f2ebc tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] Could not find region: 7343214db08845e6890cf9ce50d86051.: keystone.exception.RegionNotFound: Could not find region: 7343214db08845e6890cf9ce50d86051. Aug 29 15:59:05.419615 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:59:05.419615 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 129, in delete_region Aug 29 15:59:05.419615 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ret = self.driver.delete_region(region_id) Aug 29 15:59:05.419615 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 152, in delete_region Aug 29 15:59:05.419615 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ref = self._get_region(session, region_id) Aug 29 15:59:05.419615 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 103, in _get_region Aug 29 15:59:05.419615 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Aug 29 15:59:05.419615 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 7343214db08845e6890cf9ce50d86051. Aug 29 15:59:05.419615 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:59:05.419615 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:59:05.419615 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:59:05.419615 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:59:05.419615 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:59:05.419615 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:59:05.419615 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:59:05.420616 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:59:05.420616 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:59:05.420616 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:59:05.420616 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:59:05.420616 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:59:05.420616 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:59:05.420616 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:59:05.420616 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/regions.py", line 92, in delete Aug 29 15:59:05.420616 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return PROVIDERS.catalog_api.delete_region( Aug 29 15:59:05.420616 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:59:05.420616 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:59:05.420616 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 135, in delete_region Aug 29 15:59:05.420616 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Aug 29 15:59:05.420616 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 7343214db08845e6890cf9ce50d86051. Aug 29 15:59:05.420616 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:59:05.420616 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2410/4802] 10.222.0.83 () {58 vars in 1230 bytes} [Mon Aug 29 15:59:05 2022] DELETE /identity/v3/regions/7343214db08845e6890cf9ce50d86051 => generated 112 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 15:59:05.424924 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb7102-6999-47b6-be23-4fd8321f2ebc tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:05.429713 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b73a82-535c-4c3c-9e6b-0b0e591a4935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:05.430513 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b73a82-535c-4c3c-9e6b-0b0e591a4935 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:05.430925 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b73a82-535c-4c3c-9e6b-0b0e591a4935 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:05.431254 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b73a82-535c-4c3c-9e6b-0b0e591a4935 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:05.432435 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b73a82-535c-4c3c-9e6b-0b0e591a4935 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:05.434657 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b73a82-535c-4c3c-9e6b-0b0e591a4935 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:05.438764 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb7102-6999-47b6-be23-4fd8321f2ebc tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:05.445903 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1691def-2e93-4b94-9253-af8933df85ee tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29cdb74e68e94e40999737a93161c713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34deb745228142859d01953adc57cf53', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:05.446604 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1691def-2e93-4b94-9253-af8933df85ee tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:05.447201 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1691def-2e93-4b94-9253-af8933df85ee tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:05.447555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1691def-2e93-4b94-9253-af8933df85ee tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] PATH_INFO: `/v3/regions` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:05.448375 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1691def-2e93-4b94-9253-af8933df85ee tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:05.449733 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1691def-2e93-4b94-9253-af8933df85ee tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:05.464050 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2411/4803] 10.222.0.83 () {58 vars in 1128 bytes} [Mon Aug 29 15:59:05 2022] GET /identity/v3/regions => generated 669 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:59:05.469163 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1691def-2e93-4b94-9253-af8933df85ee tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:05.485544 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1691def-2e93-4b94-9253-af8933df85ee tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:05.495147 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2393/4804] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:59:05 2022] POST /identity/v3/projects => generated 385 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:05.496106 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b73a82-535c-4c3c-9e6b-0b0e591a4935 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:05.505370 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c576ac7f-f095-4ee5-acc1-4038fc9fc423 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29cdb74e68e94e40999737a93161c713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34deb745228142859d01953adc57cf53', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:05.506281 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576ac7f-f095-4ee5-acc1-4038fc9fc423 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:05.506579 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576ac7f-f095-4ee5-acc1-4038fc9fc423 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:05.506873 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576ac7f-f095-4ee5-acc1-4038fc9fc423 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] PATH_INFO: `/v3/regions` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:05.507532 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c576ac7f-f095-4ee5-acc1-4038fc9fc423 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:05.510508 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c576ac7f-f095-4ee5-acc1-4038fc9fc423 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:05.524229 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:05.558072 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2412/4805] 10.222.0.83 () {60 vars in 1150 bytes} [Mon Aug 29 15:59:05 2022] POST /identity/v3/regions => generated 252 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:05.564185 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c576ac7f-f095-4ee5-acc1-4038fc9fc423 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:05.604254 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c576ac7f-f095-4ee5-acc1-4038fc9fc423 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:05.632620 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b73a82-535c-4c3c-9e6b-0b0e591a4935 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:05.664591 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed013fa0-e3d1-4507-a2da-1f0d332c21c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:05.665220 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed013fa0-e3d1-4507-a2da-1f0d332c21c2 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:05.665499 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed013fa0-e3d1-4507-a2da-1f0d332c21c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:05.668234 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed013fa0-e3d1-4507-a2da-1f0d332c21c2 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:05.668901 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed013fa0-e3d1-4507-a2da-1f0d332c21c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:05.670852 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed013fa0-e3d1-4507-a2da-1f0d332c21c2 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:05.715159 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2394/4806] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:59:05 2022] POST /identity/v3/users => generated 299 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:05.720704 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed013fa0-e3d1-4507-a2da-1f0d332c21c2 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:05.733484 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca531ac0-b343-4c27-8670-6306cae050ea tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29cdb74e68e94e40999737a93161c713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34deb745228142859d01953adc57cf53', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:05.734269 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca531ac0-b343-4c27-8670-6306cae050ea tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:05.734560 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca531ac0-b343-4c27-8670-6306cae050ea tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:05.734845 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca531ac0-b343-4c27-8670-6306cae050ea tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] PATH_INFO: `/v3/regions` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:05.736827 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca531ac0-b343-4c27-8670-6306cae050ea tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] RBAC: Adding query filter params (parent_region_id=c04a01fa61184d659d6a2ca2d9f51442) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:59:05.737146 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca531ac0-b343-4c27-8670-6306cae050ea tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:05.739944 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca531ac0-b343-4c27-8670-6306cae050ea tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:05.743401 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed013fa0-e3d1-4507-a2da-1f0d332c21c2 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:05.753608 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2413/4807] 10.222.0.83 () {58 vars in 1227 bytes} [Mon Aug 29 15:59:05 2022] GET /identity/v3/regions?parent_region_id=c04a01fa61184d659d6a2ca2d9f51442 => generated 398 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:59:05.754668 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca531ac0-b343-4c27-8670-6306cae050ea tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:05.758047 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e70f1-af7a-451c-a10a-a8ec538b2ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:05.758679 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e70f1-af7a-451c-a10a-a8ec538b2ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:05.758960 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e70f1-af7a-451c-a10a-a8ec538b2ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:05.759260 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e70f1-af7a-451c-a10a-a8ec538b2ba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:05.760054 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e70f1-af7a-451c-a10a-a8ec538b2ba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:05.764870 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e70f1-af7a-451c-a10a-a8ec538b2ba1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:05.771040 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca531ac0-b343-4c27-8670-6306cae050ea tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:05.777001 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b25f9-2281-428e-9b21-e47729cd8230 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29cdb74e68e94e40999737a93161c713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34deb745228142859d01953adc57cf53', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:05.778131 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b25f9-2281-428e-9b21-e47729cd8230 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:05.778131 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b25f9-2281-428e-9b21-e47729cd8230 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:05.778455 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b25f9-2281-428e-9b21-e47729cd8230 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] PATH_INFO: `/v3/regions/1911e1e829c84fe388eaee8e2657b600` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:05.778929 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b25f9-2281-428e-9b21-e47729cd8230 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] RBAC: Authorizing `identity:delete_region(region_id=1911e1e829c84fe388eaee8e2657b600)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:05.780667 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2395/4808] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:05.783820 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b25f9-2281-428e-9b21-e47729cd8230 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:05.784900 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e70f1-af7a-451c-a10a-a8ec538b2ba1 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:05.799632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e70f1-af7a-451c-a10a-a8ec538b2ba1 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:05.806740 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f307b-8dc2-4cf8-a600-c44ead2bcb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:05.816036 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f307b-8dc2-4cf8-a600-c44ead2bcb64 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:05.817647 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f307b-8dc2-4cf8-a600-c44ead2bcb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:05.818503 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f307b-8dc2-4cf8-a600-c44ead2bcb64 admin admin] PATH_INFO: `/v3/projects/6b8fb4925e294891ad20d9d1b2cfd889/users/615c7ccab6474e9ca6de1fbc5e31eff2/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:05.823438 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2414/4809] 10.222.0.83 () {58 vars in 1230 bytes} [Mon Aug 29 15:59:05 2022] DELETE /identity/v3/regions/1911e1e829c84fe388eaee8e2657b600 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:05.827681 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b25f9-2281-428e-9b21-e47729cd8230 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:05.841595 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f307b-8dc2-4cf8-a600-c44ead2bcb64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b8fb4925e294891ad20d9d1b2cfd889, user_id=615c7ccab6474e9ca6de1fbc5e31eff2, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:05.844708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f307b-8dc2-4cf8-a600-c44ead2bcb64 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:05.865851 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b25f9-2281-428e-9b21-e47729cd8230 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:05.872854 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2396/4810] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:05 2022] PUT /identity/v3/projects/6b8fb4925e294891ad20d9d1b2cfd889/users/615c7ccab6474e9ca6de1fbc5e31eff2/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:05.878615 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f307b-8dc2-4cf8-a600-c44ead2bcb64 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:05.985149 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:06.013337 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2b14c-e545-4f6b-be0f-92ed538aafcb tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29cdb74e68e94e40999737a93161c713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34deb745228142859d01953adc57cf53', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:06.014155 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2b14c-e545-4f6b-be0f-92ed538aafcb tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:06.014439 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2b14c-e545-4f6b-be0f-92ed538aafcb tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:06.014718 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2b14c-e545-4f6b-be0f-92ed538aafcb tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] PATH_INFO: `/v3/regions/7916011d11dc461fb009b2cb10f78f43` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:06.016297 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f307b-8dc2-4cf8-a600-c44ead2bcb64 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:06.028126 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab2b14c-e545-4f6b-be0f-92ed538aafcb tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] RBAC: Authorizing `identity:delete_region(region_id=7916011d11dc461fb009b2cb10f78f43)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:06.030672 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab2b14c-e545-4f6b-be0f-92ed538aafcb tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:06.041793 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27b3ba-4316-482f-b5c4-d025c5c96026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:06.042416 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27b3ba-4316-482f-b5c4-d025c5c96026 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:06.042700 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27b3ba-4316-482f-b5c4-d025c5c96026 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:06.042975 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27b3ba-4316-482f-b5c4-d025c5c96026 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:06.043925 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a27b3ba-4316-482f-b5c4-d025c5c96026 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:06.045276 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a27b3ba-4316-482f-b5c4-d025c5c96026 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:06.060617 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2397/4811] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:06.065413 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2415/4812] 10.222.0.83 () {58 vars in 1230 bytes} [Mon Aug 29 15:59:05 2022] DELETE /identity/v3/regions/7916011d11dc461fb009b2cb10f78f43 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:06.072137 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27b3ba-4316-482f-b5c4-d025c5c96026 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:06.077936 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2b14c-e545-4f6b-be0f-92ed538aafcb tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:06.086068 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27b3ba-4316-482f-b5c4-d025c5c96026 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:06.106016 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d05d4-f3ad-4eb4-91a0-8a4ff4f564e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:06.106702 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d05d4-f3ad-4eb4-91a0-8a4ff4f564e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:06.106985 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d05d4-f3ad-4eb4-91a0-8a4ff4f564e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:06.107427 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d05d4-f3ad-4eb4-91a0-8a4ff4f564e7 admin admin] PATH_INFO: `/v3/projects/6b8fb4925e294891ad20d9d1b2cfd889/users/615c7ccab6474e9ca6de1fbc5e31eff2/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:06.109804 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8d05d4-f3ad-4eb4-91a0-8a4ff4f564e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b8fb4925e294891ad20d9d1b2cfd889, user_id=615c7ccab6474e9ca6de1fbc5e31eff2, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:06.114553 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8d05d4-f3ad-4eb4-91a0-8a4ff4f564e7 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:06.122473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2b14c-e545-4f6b-be0f-92ed538aafcb tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:06.132166 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2398/4813] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:06 2022] PUT /identity/v3/projects/6b8fb4925e294891ad20d9d1b2cfd889/users/615c7ccab6474e9ca6de1fbc5e31eff2/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:06.143508 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9fdb6-e061-4ef6-87c8-f5ec7bf0720a None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:06.143786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9fdb6-e061-4ef6-87c8-f5ec7bf0720a None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:06.144077 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9fdb6-e061-4ef6-87c8-f5ec7bf0720a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:06.151569 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:06.187278 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-84f9fdb6-e061-4ef6-87c8-f5ec7bf0720a None None] MFA Rules not processed for user `615c7ccab6474e9ca6de1fbc5e31eff2`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:06.189118 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-84f9fdb6-e061-4ef6-87c8-f5ec7bf0720a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:06.247256 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dab31d-cfec-48f7-a4bd-5886b55348a5 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29cdb74e68e94e40999737a93161c713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34deb745228142859d01953adc57cf53', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:06.248428 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dab31d-cfec-48f7-a4bd-5886b55348a5 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:06.248572 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dab31d-cfec-48f7-a4bd-5886b55348a5 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:06.248876 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dab31d-cfec-48f7-a4bd-5886b55348a5 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] PATH_INFO: `/v3/regions/c04a01fa61184d659d6a2ca2d9f51442` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:06.249671 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dab31d-cfec-48f7-a4bd-5886b55348a5 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] RBAC: Authorizing `identity:delete_region(region_id=c04a01fa61184d659d6a2ca2d9f51442)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:06.251851 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dab31d-cfec-48f7-a4bd-5886b55348a5 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:06.275164 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2416/4814] 10.222.0.83 () {58 vars in 1230 bytes} [Mon Aug 29 15:59:06 2022] DELETE /identity/v3/regions/c04a01fa61184d659d6a2ca2d9f51442 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:06.278916 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2399/4815] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:06 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:06.283753 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dab31d-cfec-48f7-a4bd-5886b55348a5 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:06.285692 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f5dab31d-cfec-48f7-a4bd-5886b55348a5 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:06.293594 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9fdb6-e061-4ef6-87c8-f5ec7bf0720a None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:06.295287 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-84f9fdb6-e061-4ef6-87c8-f5ec7bf0720a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:06.371805 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dab31d-cfec-48f7-a4bd-5886b55348a5 tempest-RegionsTestJSON-2059590958 tempest-RegionsTestJSON-2059590958-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:06.377021 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9fdb6-e061-4ef6-87c8-f5ec7bf0720a None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:06.380037 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2bd4c-7523-4083-be55-a19e42b3758c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:06.380391 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2bd4c-7523-4083-be55-a19e42b3758c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:06.380680 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2bd4c-7523-4083-be55-a19e42b3758c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:06.381020 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2bd4c-7523-4083-be55-a19e42b3758c admin admin] PATH_INFO: `/v3/users/0958f3e0398a49e5aaa192b283b0f5a0` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:06.382338 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc2bd4c-7523-4083-be55-a19e42b3758c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0958f3e0398a49e5aaa192b283b0f5a0)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:06.384341 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc2bd4c-7523-4083-be55-a19e42b3758c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:06.394363 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32285954-439b-4ad6-9137-ea75f25ad316 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:06.395315 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32285954-439b-4ad6-9137-ea75f25ad316 service cinder] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:06.395655 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32285954-439b-4ad6-9137-ea75f25ad316 service cinder] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:06.395986 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32285954-439b-4ad6-9137-ea75f25ad316 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:06.405492 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32285954-439b-4ad6-9137-ea75f25ad316 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:06.407347 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32285954-439b-4ad6-9137-ea75f25ad316 service cinder] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:06.440525 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2400/4816] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:59:06 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:59:06.463332 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1bc2bd4c-7523-4083-be55-a19e42b3758c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0958f3e0398a49e5aaa192b283b0f5a0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:06.464009 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1bc2bd4c-7523-4083-be55-a19e42b3758c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0958f3e0398a49e5aaa192b283b0f5a0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:06.478830 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1bc2bd4c-7523-4083-be55-a19e42b3758c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0958f3e0398a49e5aaa192b283b0f5a0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:06.504665 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1bc2bd4c-7523-4083-be55-a19e42b3758c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0958f3e0398a49e5aaa192b283b0f5a0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:06.532531 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1bc2bd4c-7523-4083-be55-a19e42b3758c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0958f3e0398a49e5aaa192b283b0f5a0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:06.552499 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2417/4817] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:06 2022] DELETE /identity/v3/users/0958f3e0398a49e5aaa192b283b0f5a0 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:06.557580 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247e7a2-0d84-4f2d-8965-123ce9731c47 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:06.557864 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247e7a2-0d84-4f2d-8965-123ce9731c47 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:06.558137 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247e7a2-0d84-4f2d-8965-123ce9731c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:06.591148 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-6247e7a2-0d84-4f2d-8965-123ce9731c47 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:06.592697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6247e7a2-0d84-4f2d-8965-123ce9731c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:06.599887 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:06.694765 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2401/4818] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:06.705211 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2bd4c-7523-4083-be55-a19e42b3758c admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:06.706716 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1bc2bd4c-7523-4083-be55-a19e42b3758c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:06.737572 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:06.845796 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2bd4c-7523-4083-be55-a19e42b3758c admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:06.850654 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4cf2e4-4a75-4797-8e91-e73d145996bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:06.851700 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4cf2e4-4a75-4797-8e91-e73d145996bf service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:06.851700 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4cf2e4-4a75-4797-8e91-e73d145996bf service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:06.852245 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4cf2e4-4a75-4797-8e91-e73d145996bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:06.868339 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4cf2e4-4a75-4797-8e91-e73d145996bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:06.872125 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4cf2e4-4a75-4797-8e91-e73d145996bf service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:06.894703 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2418/4819] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:59:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:59:07.410223 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6247e7a2-0d84-4f2d-8965-123ce9731c47 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:07.412298 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6247e7a2-0d84-4f2d-8965-123ce9731c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:07.429554 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6247e7a2-0d84-4f2d-8965-123ce9731c47 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:07.435263 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362266c-e636-4f39-b865-042af4b1f1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:07.435966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362266c-e636-4f39-b865-042af4b1f1d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:07.436251 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362266c-e636-4f39-b865-042af4b1f1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:07.436524 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362266c-e636-4f39-b865-042af4b1f1d5 admin admin] PATH_INFO: `/v3/users/f5f564c8abdc4c6bb337a2ee4c146127` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:07.437691 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7362266c-e636-4f39-b865-042af4b1f1d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5f564c8abdc4c6bb337a2ee4c146127)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:07.440510 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7362266c-e636-4f39-b865-042af4b1f1d5 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:07.501134 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7362266c-e636-4f39-b865-042af4b1f1d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5f564c8abdc4c6bb337a2ee4c146127'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:07.501827 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7362266c-e636-4f39-b865-042af4b1f1d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5f564c8abdc4c6bb337a2ee4c146127'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:07.506533 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4cf2e4-4a75-4797-8e91-e73d145996bf service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:07.507968 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3a4cf2e4-4a75-4797-8e91-e73d145996bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:07.523229 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7362266c-e636-4f39-b865-042af4b1f1d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5f564c8abdc4c6bb337a2ee4c146127'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:07.527066 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4cf2e4-4a75-4797-8e91-e73d145996bf service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:07.532075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7362266c-e636-4f39-b865-042af4b1f1d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5f564c8abdc4c6bb337a2ee4c146127'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:07.532240 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b1d0c-05b6-4116-8954-c58d20a892aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:07.532841 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7362266c-e636-4f39-b865-042af4b1f1d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5f564c8abdc4c6bb337a2ee4c146127'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:07.532959 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b1d0c-05b6-4116-8954-c58d20a892aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:07.533418 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b1d0c-05b6-4116-8954-c58d20a892aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:07.533522 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b1d0c-05b6-4116-8954-c58d20a892aa admin admin] PATH_INFO: `/v3/projects/7b34a02b7d2348588e61f0a157ada7bf` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:07.534615 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6b1d0c-05b6-4116-8954-c58d20a892aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b34a02b7d2348588e61f0a157ada7bf)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:07.537180 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6b1d0c-05b6-4116-8954-c58d20a892aa admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:07.565654 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2402/4820] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:07 2022] DELETE /identity/v3/users/f5f564c8abdc4c6bb337a2ee4c146127 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:07.571319 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d6c12-d513-4325-aa1a-203a9619acfd None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:07.571635 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d6c12-d513-4325-aa1a-203a9619acfd None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:07.572622 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d6c12-d513-4325-aa1a-203a9619acfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:07.594095 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-4b3d6c12-d513-4325-aa1a-203a9619acfd None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:07.595471 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4b3d6c12-d513-4325-aa1a-203a9619acfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:07.602637 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6e6b1d0c-05b6-4116-8954-c58d20a892aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b34a02b7d2348588e61f0a157ada7bf', 'request_id': 'req-6e6b1d0c-05b6-4116-8954-c58d20a892aa'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:07.609427 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6e6b1d0c-05b6-4116-8954-c58d20a892aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b34a02b7d2348588e61f0a157ada7bf', 'request_id': 'req-6e6b1d0c-05b6-4116-8954-c58d20a892aa'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:07.623670 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6e6b1d0c-05b6-4116-8954-c58d20a892aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b34a02b7d2348588e61f0a157ada7bf', 'request_id': 'req-6e6b1d0c-05b6-4116-8954-c58d20a892aa'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:07.641865 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6e6b1d0c-05b6-4116-8954-c58d20a892aa admin admin] The token cache is being invalidate because project 7b34a02b7d2348588e61f0a157ada7bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:07.642347 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6e6b1d0c-05b6-4116-8954-c58d20a892aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:07.643258 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6e6b1d0c-05b6-4116-8954-c58d20a892aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:07.647110 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2419/4821] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:59:07 2022] DELETE /identity/v3/projects/7b34a02b7d2348588e61f0a157ada7bf => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:59:07.649585 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b1d0c-05b6-4116-8954-c58d20a892aa admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:07.656063 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6e6b1d0c-05b6-4116-8954-c58d20a892aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:07.717265 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2403/4822] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:59:07.729732 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d6c12-d513-4325-aa1a-203a9619acfd None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:07.734211 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4b3d6c12-d513-4325-aa1a-203a9619acfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:07.817684 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:07.834694 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b1d0c-05b6-4116-8954-c58d20a892aa admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:07.845003 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db28e69a-e333-411f-b903-68d8eab86c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:07.845962 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28e69a-e333-411f-b903-68d8eab86c63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:07.846429 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28e69a-e333-411f-b903-68d8eab86c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:07.846852 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28e69a-e333-411f-b903-68d8eab86c63 admin admin] PATH_INFO: `/v3/users/29cdb74e68e94e40999737a93161c713` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:07.848650 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db28e69a-e333-411f-b903-68d8eab86c63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29cdb74e68e94e40999737a93161c713)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:07.851358 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db28e69a-e333-411f-b903-68d8eab86c63 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:07.869696 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d6c12-d513-4325-aa1a-203a9619acfd None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:07.875618 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93710328-1f81-4786-b3c5-db9a66dc76dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:07.876512 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93710328-1f81-4786-b3c5-db9a66dc76dd service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:07.877063 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93710328-1f81-4786-b3c5-db9a66dc76dd service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:07.877288 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93710328-1f81-4786-b3c5-db9a66dc76dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:07.889069 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93710328-1f81-4786-b3c5-db9a66dc76dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:07.890608 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93710328-1f81-4786-b3c5-db9a66dc76dd service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:07.902967 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2404/4823] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:59:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:59:07.915225 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:07.923289 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-db28e69a-e333-411f-b903-68d8eab86c63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29cdb74e68e94e40999737a93161c713'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:07.925299 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-db28e69a-e333-411f-b903-68d8eab86c63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29cdb74e68e94e40999737a93161c713'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:07.990640 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-db28e69a-e333-411f-b903-68d8eab86c63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29cdb74e68e94e40999737a93161c713'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:08.010563 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-db28e69a-e333-411f-b903-68d8eab86c63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29cdb74e68e94e40999737a93161c713'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:08.027916 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-db28e69a-e333-411f-b903-68d8eab86c63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29cdb74e68e94e40999737a93161c713'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:08.041748 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2420/4824] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:07 2022] DELETE /identity/v3/users/29cdb74e68e94e40999737a93161c713 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:09.186978 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93710328-1f81-4786-b3c5-db9a66dc76dd service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:09.189048 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-93710328-1f81-4786-b3c5-db9a66dc76dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:09.206348 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93710328-1f81-4786-b3c5-db9a66dc76dd service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:09.289603 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e62cc7-c357-417b-abf6-cb2f35052f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:09.290502 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e62cc7-c357-417b-abf6-cb2f35052f5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:09.290786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e62cc7-c357-417b-abf6-cb2f35052f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:09.291092 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e62cc7-c357-417b-abf6-cb2f35052f5c admin admin] PATH_INFO: `/v3/projects/958cefc26436471698e346c0fb0d3526` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:09.292810 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e62cc7-c357-417b-abf6-cb2f35052f5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=958cefc26436471698e346c0fb0d3526)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:09.294739 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e62cc7-c357-417b-abf6-cb2f35052f5c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:09.362330 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e9e62cc7-c357-417b-abf6-cb2f35052f5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '958cefc26436471698e346c0fb0d3526', 'request_id': 'req-e9e62cc7-c357-417b-abf6-cb2f35052f5c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:09.370956 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e9e62cc7-c357-417b-abf6-cb2f35052f5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '958cefc26436471698e346c0fb0d3526', 'request_id': 'req-e9e62cc7-c357-417b-abf6-cb2f35052f5c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:09.378748 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e9e62cc7-c357-417b-abf6-cb2f35052f5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '958cefc26436471698e346c0fb0d3526', 'request_id': 'req-e9e62cc7-c357-417b-abf6-cb2f35052f5c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:09.396413 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e9e62cc7-c357-417b-abf6-cb2f35052f5c admin admin] The token cache is being invalidate because project 958cefc26436471698e346c0fb0d3526 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:09.396413 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e9e62cc7-c357-417b-abf6-cb2f35052f5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:09.397000 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e9e62cc7-c357-417b-abf6-cb2f35052f5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:09.398676 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2405/4825] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:59:09 2022] DELETE /identity/v3/projects/958cefc26436471698e346c0fb0d3526 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:09.402526 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db28e69a-e333-411f-b903-68d8eab86c63 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:09.404161 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-db28e69a-e333-411f-b903-68d8eab86c63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:09.418850 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db28e69a-e333-411f-b903-68d8eab86c63 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:09.483995 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a6d612-5f05-4c53-9ac5-e80f7ae593d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:09.484799 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6d612-5f05-4c53-9ac5-e80f7ae593d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:09.485089 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6d612-5f05-4c53-9ac5-e80f7ae593d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:09.485391 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6d612-5f05-4c53-9ac5-e80f7ae593d6 admin admin] PATH_INFO: `/v3/users/615c7ccab6474e9ca6de1fbc5e31eff2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:09.487407 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a6d612-5f05-4c53-9ac5-e80f7ae593d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=615c7ccab6474e9ca6de1fbc5e31eff2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:09.490146 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a6d612-5f05-4c53-9ac5-e80f7ae593d6 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:09.548075 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f5a6d612-5f05-4c53-9ac5-e80f7ae593d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '615c7ccab6474e9ca6de1fbc5e31eff2'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:09.548742 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f5a6d612-5f05-4c53-9ac5-e80f7ae593d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '615c7ccab6474e9ca6de1fbc5e31eff2'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:09.586551 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f5a6d612-5f05-4c53-9ac5-e80f7ae593d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '615c7ccab6474e9ca6de1fbc5e31eff2'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:09.615663 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f5a6d612-5f05-4c53-9ac5-e80f7ae593d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '615c7ccab6474e9ca6de1fbc5e31eff2'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:09.644384 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f5a6d612-5f05-4c53-9ac5-e80f7ae593d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '615c7ccab6474e9ca6de1fbc5e31eff2'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:09.654626 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2421/4826] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:09 2022] DELETE /identity/v3/users/615c7ccab6474e9ca6de1fbc5e31eff2 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:59:09.717023 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e62cc7-c357-417b-abf6-cb2f35052f5c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:09.718535 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e9e62cc7-c357-417b-abf6-cb2f35052f5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:09.747212 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e62cc7-c357-417b-abf6-cb2f35052f5c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:09.846372 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:09.858744 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57676824-3858-437b-b7ca-be0d15bba4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:09.859870 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57676824-3858-437b-b7ca-be0d15bba4d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:09.860228 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57676824-3858-437b-b7ca-be0d15bba4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:09.860511 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57676824-3858-437b-b7ca-be0d15bba4d6 admin admin] PATH_INFO: `/v3/projects/34deb745228142859d01953adc57cf53` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:09.864365 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57676824-3858-437b-b7ca-be0d15bba4d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34deb745228142859d01953adc57cf53)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:09.866797 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57676824-3858-437b-b7ca-be0d15bba4d6 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:09.954191 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-57676824-3858-437b-b7ca-be0d15bba4d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34deb745228142859d01953adc57cf53', 'request_id': 'req-57676824-3858-437b-b7ca-be0d15bba4d6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:09.965543 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-57676824-3858-437b-b7ca-be0d15bba4d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34deb745228142859d01953adc57cf53', 'request_id': 'req-57676824-3858-437b-b7ca-be0d15bba4d6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:09.980026 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-57676824-3858-437b-b7ca-be0d15bba4d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34deb745228142859d01953adc57cf53', 'request_id': 'req-57676824-3858-437b-b7ca-be0d15bba4d6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:09.996112 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-57676824-3858-437b-b7ca-be0d15bba4d6 admin admin] The token cache is being invalidate because project 34deb745228142859d01953adc57cf53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:09.996525 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-57676824-3858-437b-b7ca-be0d15bba4d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:09.997247 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-57676824-3858-437b-b7ca-be0d15bba4d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:10.002190 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2406/4827] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:59:09 2022] DELETE /identity/v3/projects/34deb745228142859d01953adc57cf53 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:10.003962 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378f535-44ac-43f0-ba7c-90546d1e36d7 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:10.004446 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378f535-44ac-43f0-ba7c-90546d1e36d7 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:10.004828 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378f535-44ac-43f0-ba7c-90546d1e36d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:10.029087 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-5378f535-44ac-43f0-ba7c-90546d1e36d7 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:10.030467 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5378f535-44ac-43f0-ba7c-90546d1e36d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:10.073283 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:10.117652 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2422/4828] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:10.123272 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57676824-3858-437b-b7ca-be0d15bba4d6 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:10.125096 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-57676824-3858-437b-b7ca-be0d15bba4d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:10.125488 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caecd95-26ae-4290-a8a8-34b11b4c879e None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:10.125863 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caecd95-26ae-4290-a8a8-34b11b4c879e None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:10.126210 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caecd95-26ae-4290-a8a8-34b11b4c879e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:10.138664 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57676824-3858-437b-b7ca-be0d15bba4d6 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:10.152912 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-3caecd95-26ae-4290-a8a8-34b11b4c879e None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:10.154410 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3caecd95-26ae-4290-a8a8-34b11b4c879e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:10.163595 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070bd0da-eadd-4445-a224-7696497f2263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:10.164337 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bd0da-eadd-4445-a224-7696497f2263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:10.164623 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bd0da-eadd-4445-a224-7696497f2263 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:10.164900 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bd0da-eadd-4445-a224-7696497f2263 admin admin] PATH_INFO: `/v3/projects/6b8fb4925e294891ad20d9d1b2cfd889` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:10.165070 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2423/4829] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:59:10.168612 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070bd0da-eadd-4445-a224-7696497f2263 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b8fb4925e294891ad20d9d1b2cfd889)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:10.169894 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caecd95-26ae-4290-a8a8-34b11b4c879e None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:10.170569 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070bd0da-eadd-4445-a224-7696497f2263 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:10.193616 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caecd95-26ae-4290-a8a8-34b11b4c879e None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:10.200191 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d80d37-67bd-4ecb-b7fc-427e6bc00b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:10.200484 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d80d37-67bd-4ecb-b7fc-427e6bc00b05 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:10.200786 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d80d37-67bd-4ecb-b7fc-427e6bc00b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:10.201067 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d80d37-67bd-4ecb-b7fc-427e6bc00b05 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:10.201949 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d80d37-67bd-4ecb-b7fc-427e6bc00b05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:59:10.202341 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d80d37-67bd-4ecb-b7fc-427e6bc00b05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:10.204419 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d80d37-67bd-4ecb-b7fc-427e6bc00b05 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:10.225254 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2424/4830] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:59:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:59:10.230077 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d80d37-67bd-4ecb-b7fc-427e6bc00b05 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:10.248093 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d80d37-67bd-4ecb-b7fc-427e6bc00b05 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:10.248269 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-070bd0da-eadd-4445-a224-7696497f2263 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b8fb4925e294891ad20d9d1b2cfd889', 'request_id': 'req-070bd0da-eadd-4445-a224-7696497f2263'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:10.255930 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-070bd0da-eadd-4445-a224-7696497f2263 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b8fb4925e294891ad20d9d1b2cfd889', 'request_id': 'req-070bd0da-eadd-4445-a224-7696497f2263'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:10.263581 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-070bd0da-eadd-4445-a224-7696497f2263 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b8fb4925e294891ad20d9d1b2cfd889', 'request_id': 'req-070bd0da-eadd-4445-a224-7696497f2263'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:10.284528 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-070bd0da-eadd-4445-a224-7696497f2263 admin admin] The token cache is being invalidate because project 6b8fb4925e294891ad20d9d1b2cfd889 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:10.284967 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-070bd0da-eadd-4445-a224-7696497f2263 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:10.286995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-070bd0da-eadd-4445-a224-7696497f2263 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:10.292153 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2407/4831] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:59:10 2022] DELETE /identity/v3/projects/6b8fb4925e294891ad20d9d1b2cfd889 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:10.294460 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7643ca2-377b-4e2f-9c9e-f2f10525fb3e None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:10.294827 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7643ca2-377b-4e2f-9c9e-f2f10525fb3e None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:10.295210 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7643ca2-377b-4e2f-9c9e-f2f10525fb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:10.327548 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-d7643ca2-377b-4e2f-9c9e-f2f10525fb3e None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:10.329696 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d7643ca2-377b-4e2f-9c9e-f2f10525fb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:10.344346 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66f489-ea26-4a2a-8cdc-36cedcedff32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:10.345103 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66f489-ea26-4a2a-8cdc-36cedcedff32 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:10.345394 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66f489-ea26-4a2a-8cdc-36cedcedff32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:10.345674 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66f489-ea26-4a2a-8cdc-36cedcedff32 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:10.346430 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec66f489-ea26-4a2a-8cdc-36cedcedff32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:10.350830 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec66f489-ea26-4a2a-8cdc-36cedcedff32 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:10.442904 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2425/4832] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:59:10 2022] POST /identity/v3/projects => generated 373 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:10.446237 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66f489-ea26-4a2a-8cdc-36cedcedff32 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:10.450211 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ec66f489-ea26-4a2a-8cdc-36cedcedff32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:10.477561 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2408/4833] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:10.490041 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805e703-6424-4a0b-8e59-7715e423b310 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:10.490264 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805e703-6424-4a0b-8e59-7715e423b310 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:10.490507 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805e703-6424-4a0b-8e59-7715e423b310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:10.528402 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-6805e703-6424-4a0b-8e59-7715e423b310 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:10.530887 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6805e703-6424-4a0b-8e59-7715e423b310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:10.548157 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:10.562373 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66f489-ea26-4a2a-8cdc-36cedcedff32 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:10.570253 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0db12-5c3d-4a04-ad6d-fdc843261a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:10.571888 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0db12-5c3d-4a04-ad6d-fdc843261a36 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:10.572168 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0db12-5c3d-4a04-ad6d-fdc843261a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:10.574092 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0db12-5c3d-4a04-ad6d-fdc843261a36 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:10.574763 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc0db12-5c3d-4a04-ad6d-fdc843261a36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:10.577087 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc0db12-5c3d-4a04-ad6d-fdc843261a36 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:10.627842 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2426/4834] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:59:10 2022] POST /identity/v3/users => generated 287 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:10.634665 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0db12-5c3d-4a04-ad6d-fdc843261a36 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:10.635580 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2409/4835] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:59:10.636746 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805e703-6424-4a0b-8e59-7715e423b310 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:10.648757 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805e703-6424-4a0b-8e59-7715e423b310 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:10.654350 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faebfa6-afea-47f4-90cb-c2c554f55c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:10.655937 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faebfa6-afea-47f4-90cb-c2c554f55c85 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:10.656460 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faebfa6-afea-47f4-90cb-c2c554f55c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:10.656942 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faebfa6-afea-47f4-90cb-c2c554f55c85 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:10.658360 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faebfa6-afea-47f4-90cb-c2c554f55c85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:59:10.659275 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faebfa6-afea-47f4-90cb-c2c554f55c85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:10.662188 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faebfa6-afea-47f4-90cb-c2c554f55c85 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:10.676693 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0db12-5c3d-4a04-ad6d-fdc843261a36 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:10.685767 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2410/4836] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:59:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:59:10.687171 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faebfa6-afea-47f4-90cb-c2c554f55c85 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:10.689310 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed897ac8-52ce-4eba-b24b-3d70024a4ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:10.689942 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed897ac8-52ce-4eba-b24b-3d70024a4ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:10.690220 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed897ac8-52ce-4eba-b24b-3d70024a4ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:10.690498 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed897ac8-52ce-4eba-b24b-3d70024a4ce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:10.691187 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed897ac8-52ce-4eba-b24b-3d70024a4ce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:10.700503 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed897ac8-52ce-4eba-b24b-3d70024a4ce6 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:10.704498 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faebfa6-afea-47f4-90cb-c2c554f55c85 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:10.712697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b3101-89a8-4c98-9ca2-ada61babd1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:10.713504 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b3101-89a8-4c98-9ca2-ada61babd1a4 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:10.713932 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b3101-89a8-4c98-9ca2-ada61babd1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:10.714307 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b3101-89a8-4c98-9ca2-ada61babd1a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:10.715082 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b3101-89a8-4c98-9ca2-ada61babd1a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:10.717434 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b3101-89a8-4c98-9ca2-ada61babd1a4 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:10.721459 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2427/4837] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:10 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:10.725638 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed897ac8-52ce-4eba-b24b-3d70024a4ce6 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:10.738092 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed897ac8-52ce-4eba-b24b-3d70024a4ce6 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:10.749774 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e192a-1cdf-4a02-917b-6ade66fad064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:10.750341 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e192a-1cdf-4a02-917b-6ade66fad064 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:10.750754 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e192a-1cdf-4a02-917b-6ade66fad064 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:10.751248 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e192a-1cdf-4a02-917b-6ade66fad064 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:10.752469 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718e192a-1cdf-4a02-917b-6ade66fad064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:10.755813 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718e192a-1cdf-4a02-917b-6ade66fad064 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:10.773634 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2411/4838] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:59:10 2022] POST /identity/v3/projects => generated 371 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:10.777779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b3101-89a8-4c98-9ca2-ada61babd1a4 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:10.792048 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2428/4839] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:10 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:10.797686 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e192a-1cdf-4a02-917b-6ade66fad064 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:10.824674 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e192a-1cdf-4a02-917b-6ade66fad064 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:10.837110 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:10.887803 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b3101-89a8-4c98-9ca2-ada61babd1a4 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:10.896714 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39c244-d9c3-476e-9219-4b96f2dbc523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:10.897062 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39c244-d9c3-476e-9219-4b96f2dbc523 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:10.897518 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39c244-d9c3-476e-9219-4b96f2dbc523 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:10.897799 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39c244-d9c3-476e-9219-4b96f2dbc523 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:10.898444 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be39c244-d9c3-476e-9219-4b96f2dbc523 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:10.901226 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be39c244-d9c3-476e-9219-4b96f2dbc523 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:10.913857 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1089872-f923-452e-a704-97d0b4f19ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:10.914681 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1089872-f923-452e-a704-97d0b4f19ee1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:10.914908 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1089872-f923-452e-a704-97d0b4f19ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:10.919210 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1089872-f923-452e-a704-97d0b4f19ee1 admin admin] PATH_INFO: `/v3/projects/0f77cb1c1c064a91a136ff9a18562363/users/2acd31b300e74d43a03bdbc1da8f9a47/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:10.948390 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2412/4840] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:59:10 2022] POST /identity/v3/users => generated 286 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:59:10.950008 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39c244-d9c3-476e-9219-4b96f2dbc523 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:10.954345 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1089872-f923-452e-a704-97d0b4f19ee1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f77cb1c1c064a91a136ff9a18562363, user_id=2acd31b300e74d43a03bdbc1da8f9a47, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:10.957062 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1089872-f923-452e-a704-97d0b4f19ee1 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:10.974591 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39c244-d9c3-476e-9219-4b96f2dbc523 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:10.985883 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2429/4841] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:10 2022] PUT /identity/v3/projects/0f77cb1c1c064a91a136ff9a18562363/users/2acd31b300e74d43a03bdbc1da8f9a47/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:10.996875 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2653ef0-8546-4ead-83ec-e1048ed8dc30 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:10.997178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2653ef0-8546-4ead-83ec-e1048ed8dc30 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:10.997455 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2653ef0-8546-4ead-83ec-e1048ed8dc30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:11.064331 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-a2653ef0-8546-4ead-83ec-e1048ed8dc30 None None] MFA Rules not processed for user `2acd31b300e74d43a03bdbc1da8f9a47`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:11.066028 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a2653ef0-8546-4ead-83ec-e1048ed8dc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:11.117947 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea7af3-e58c-4737-b119-d24fc12694f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:11.119240 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea7af3-e58c-4737-b119-d24fc12694f8 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:11.119240 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea7af3-e58c-4737-b119-d24fc12694f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:11.121215 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea7af3-e58c-4737-b119-d24fc12694f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:11.121977 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea7af3-e58c-4737-b119-d24fc12694f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:11.127703 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea7af3-e58c-4737-b119-d24fc12694f8 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:11.157327 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2413/4842] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:10 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:11.161928 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea7af3-e58c-4737-b119-d24fc12694f8 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:11.175010 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:11.186223 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea7af3-e58c-4737-b119-d24fc12694f8 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:11.203629 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb32019-fe92-49ea-8a37-7017f2cbf770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:11.204396 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb32019-fe92-49ea-8a37-7017f2cbf770 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:11.204778 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb32019-fe92-49ea-8a37-7017f2cbf770 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:11.205155 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb32019-fe92-49ea-8a37-7017f2cbf770 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:11.206099 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb32019-fe92-49ea-8a37-7017f2cbf770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:11.207959 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb32019-fe92-49ea-8a37-7017f2cbf770 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:11.210444 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2430/4843] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:11.215691 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2653ef0-8546-4ead-83ec-e1048ed8dc30 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:11.227061 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2414/4844] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:11.231538 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb32019-fe92-49ea-8a37-7017f2cbf770 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:11.233453 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2653ef0-8546-4ead-83ec-e1048ed8dc30 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:11.240808 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75157136-3e71-4d64-9d49-5d8d270b50d7 tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2acd31b300e74d43a03bdbc1da8f9a47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f77cb1c1c064a91a136ff9a18562363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:11.241831 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75157136-3e71-4d64-9d49-5d8d270b50d7 tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:11.242178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75157136-3e71-4d64-9d49-5d8d270b50d7 tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:11.242516 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75157136-3e71-4d64-9d49-5d8d270b50d7 tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] PATH_INFO: `/v3/users/2acd31b300e74d43a03bdbc1da8f9a47/password` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:11.243432 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb32019-fe92-49ea-8a37-7017f2cbf770 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:11.249317 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb36bfe8-aeb7-4ee9-9e5f-8927979499bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:11.250185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36bfe8-aeb7-4ee9-9e5f-8927979499bd admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:11.250743 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36bfe8-aeb7-4ee9-9e5f-8927979499bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:11.251189 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36bfe8-aeb7-4ee9-9e5f-8927979499bd admin admin] PATH_INFO: `/v3/projects/dafa4e08d2ea4279a3fde5bc1a7669d0/users/afcf02d997e146caa206dce027e15db1/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:11.288869 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb36bfe8-aeb7-4ee9-9e5f-8927979499bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=dafa4e08d2ea4279a3fde5bc1a7669d0, user_id=afcf02d997e146caa206dce027e15db1, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:11.291652 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb36bfe8-aeb7-4ee9-9e5f-8927979499bd admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:11.320603 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2415/4845] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:11 2022] PUT /identity/v3/projects/dafa4e08d2ea4279a3fde5bc1a7669d0/users/afcf02d997e146caa206dce027e15db1/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:59:11.322023 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4033ee-fdc7-4712-8cf8-35232bab1cbd None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:11.322314 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4033ee-fdc7-4712-8cf8-35232bab1cbd None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:11.322557 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-75157136-3e71-4d64-9d49-5d8d270b50d7 tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2acd31b300e74d43a03bdbc1da8f9a47'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:11.322682 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4033ee-fdc7-4712-8cf8-35232bab1cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:11.341348 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2431/4846] 10.222.0.83 () {60 vars in 1269 bytes} [Mon Aug 29 15:59:11 2022] POST /identity/v3/users/2acd31b300e74d43a03bdbc1da8f9a47/password => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:11.365603 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-9d4033ee-fdc7-4712-8cf8-35232bab1cbd None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:11.367524 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9d4033ee-fdc7-4712-8cf8-35232bab1cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:11.485616 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2416/4847] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:11.507408 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75157136-3e71-4d64-9d49-5d8d270b50d7 tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:11.510071 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-75157136-3e71-4d64-9d49-5d8d270b50d7 tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:11.590029 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:11.595951 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75157136-3e71-4d64-9d49-5d8d270b50d7 tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:11.659194 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886cd0cb-d128-4eb9-8468-c6ec9d352583 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:11.659842 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886cd0cb-d128-4eb9-8468-c6ec9d352583 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:11.661260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886cd0cb-d128-4eb9-8468-c6ec9d352583 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:11.661841 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886cd0cb-d128-4eb9-8468-c6ec9d352583 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:11.677634 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886cd0cb-d128-4eb9-8468-c6ec9d352583 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:11.679172 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886cd0cb-d128-4eb9-8468-c6ec9d352583 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:11.690597 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2432/4848] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:59:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:59:12.147665 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4033ee-fdc7-4712-8cf8-35232bab1cbd None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:12.168419 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4033ee-fdc7-4712-8cf8-35232bab1cbd None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:12.179234 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa911b02-9745-4de3-8252-7150d3344be0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:12.181119 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa911b02-9745-4de3-8252-7150d3344be0 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:12.182682 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa911b02-9745-4de3-8252-7150d3344be0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:12.183507 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa911b02-9745-4de3-8252-7150d3344be0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:12.187718 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-aa911b02-9745-4de3-8252-7150d3344be0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:12.220354 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa911b02-9745-4de3-8252-7150d3344be0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:12.222390 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa911b02-9745-4de3-8252-7150d3344be0 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:12.256799 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2417/4849] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:59:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:59:12.345994 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34df6f0-c56e-4fba-9895-0528be07bbd0 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:12.346285 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34df6f0-c56e-4fba-9895-0528be07bbd0 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:12.346562 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34df6f0-c56e-4fba-9895-0528be07bbd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:12.382003 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-f34df6f0-c56e-4fba-9895-0528be07bbd0 None None] MFA Rules not processed for user `2acd31b300e74d43a03bdbc1da8f9a47`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:12.383252 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f34df6f0-c56e-4fba-9895-0528be07bbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:12.390575 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2433/4850] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:12 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:59:12.392304 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca26e3-865e-499f-a380-d466b1c3815b None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:12.392592 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca26e3-865e-499f-a380-d466b1c3815b None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:12.392868 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca26e3-865e-499f-a380-d466b1c3815b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:12.418566 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-f3ca26e3-865e-499f-a380-d466b1c3815b None None] MFA Rules not processed for user `2acd31b300e74d43a03bdbc1da8f9a47`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:12.420044 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f3ca26e3-865e-499f-a380-d466b1c3815b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:12.496937 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2418/4851] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:12.500934 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34df6f0-c56e-4fba-9895-0528be07bbd0 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:12.519254 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34df6f0-c56e-4fba-9895-0528be07bbd0 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:12.527220 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08689b42-fed1-4a1e-88c9-710fd36bd1d1 tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2acd31b300e74d43a03bdbc1da8f9a47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f77cb1c1c064a91a136ff9a18562363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:12.528650 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08689b42-fed1-4a1e-88c9-710fd36bd1d1 tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:12.529093 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08689b42-fed1-4a1e-88c9-710fd36bd1d1 tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:12.529520 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08689b42-fed1-4a1e-88c9-710fd36bd1d1 tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] PATH_INFO: `/v3/users/2acd31b300e74d43a03bdbc1da8f9a47/password` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:12.663771 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-08689b42-fed1-4a1e-88c9-710fd36bd1d1 tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Aug 29 15:59:12.663771 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:59:12.663771 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:59:12.663771 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:59:12.663771 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:59:12.663771 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:59:12.663771 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:59:12.663771 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:59:12.663771 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:59:12.663771 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:59:12.663771 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:59:12.663771 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:59:12.663771 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 29 15:59:12.664734 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 29 15:59:12.664734 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Aug 29 15:59:12.664734 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Aug 29 15:59:12.664734 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:59:12.664734 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:59:12.664734 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:59:12.664734 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:59:12.664734 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Aug 29 15:59:12.664734 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Aug 29 15:59:12.664734 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Aug 29 15:59:12.664734 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Aug 29 15:59:12.664734 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Aug 29 15:59:12.664734 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Aug 29 15:59:12.664734 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Aug 29 15:59:12.664734 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:59:12.669793 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2434/4852] 10.222.0.83 () {60 vars in 1269 bytes} [Mon Aug 29 15:59:12 2022] POST /identity/v3/users/2acd31b300e74d43a03bdbc1da8f9a47/password => generated 188 bytes in 170 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Aug 29 15:59:12.669920 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca26e3-865e-499f-a380-d466b1c3815b None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:12.694164 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca26e3-865e-499f-a380-d466b1c3815b None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:12.739828 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaecf17-f304-4258-a2ae-2a3fe229f78a tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2acd31b300e74d43a03bdbc1da8f9a47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f77cb1c1c064a91a136ff9a18562363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:12.740686 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaecf17-f304-4258-a2ae-2a3fe229f78a tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:12.741106 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaecf17-f304-4258-a2ae-2a3fe229f78a tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:12.741515 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaecf17-f304-4258-a2ae-2a3fe229f78a tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] PATH_INFO: `/v3/users/2acd31b300e74d43a03bdbc1da8f9a47/password` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:12.752014 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3caa9-3c5a-495d-89e0-bed874272dcc None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:12.755115 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3caa9-3c5a-495d-89e0-bed874272dcc None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:12.755115 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3caa9-3c5a-495d-89e0-bed874272dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:12.846882 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-2aaecf17-f304-4258-a2ae-2a3fe229f78a tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Aug 29 15:59:12.846882 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:59:12.846882 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:59:12.846882 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:59:12.846882 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:59:12.846882 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:59:12.846882 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:59:12.846882 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:59:12.846882 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:59:12.846882 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:59:12.846882 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:59:12.846882 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:59:12.846882 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 29 15:59:12.848906 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 29 15:59:12.848906 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Aug 29 15:59:12.848906 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Aug 29 15:59:12.848906 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:59:12.848906 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:59:12.848906 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:59:12.848906 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:59:12.848906 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Aug 29 15:59:12.848906 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Aug 29 15:59:12.848906 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Aug 29 15:59:12.848906 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Aug 29 15:59:12.848906 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Aug 29 15:59:12.848906 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Aug 29 15:59:12.848906 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Aug 29 15:59:12.848906 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 15:59:12.861259 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-caa3caa9-3c5a-495d-89e0-bed874272dcc None None] MFA Rules not processed for user `afcf02d997e146caa206dce027e15db1`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:12.862504 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-caa3caa9-3c5a-495d-89e0-bed874272dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:12.864667 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2419/4853] 10.222.0.83 () {60 vars in 1269 bytes} [Mon Aug 29 15:59:12 2022] POST /identity/v3/users/2acd31b300e74d43a03bdbc1da8f9a47/password => generated 188 bytes in 191 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 29 15:59:12.865864 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaecf17-f304-4258-a2ae-2a3fe229f78a tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:12.883380 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaecf17-f304-4258-a2ae-2a3fe229f78a tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:12.913411 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814da5c-43f0-428c-a657-e74ef697bfb5 tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2acd31b300e74d43a03bdbc1da8f9a47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f77cb1c1c064a91a136ff9a18562363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:12.913411 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814da5c-43f0-428c-a657-e74ef697bfb5 tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:12.913411 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814da5c-43f0-428c-a657-e74ef697bfb5 tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:12.913646 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814da5c-43f0-428c-a657-e74ef697bfb5 tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] PATH_INFO: `/v3/users/2acd31b300e74d43a03bdbc1da8f9a47/password` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:12.999283 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b814da5c-43f0-428c-a657-e74ef697bfb5 tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2acd31b300e74d43a03bdbc1da8f9a47'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:13.026518 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2420/4854] 10.222.0.83 () {60 vars in 1269 bytes} [Mon Aug 29 15:59:12 2022] POST /identity/v3/users/2acd31b300e74d43a03bdbc1da8f9a47/password => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:13.042516 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2435/4855] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:13.046623 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814da5c-43f0-428c-a657-e74ef697bfb5 tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:13.060835 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:13.067340 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814da5c-43f0-428c-a657-e74ef697bfb5 tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:13.083431 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f8c1a-2827-463e-99e3-ad3e77b6d7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:13.083431 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f8c1a-2827-463e-99e3-ad3e77b6d7b2 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:13.083431 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f8c1a-2827-463e-99e3-ad3e77b6d7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:13.083431 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f8c1a-2827-463e-99e3-ad3e77b6d7b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:13.083874 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f8c1a-2827-463e-99e3-ad3e77b6d7b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:13.086340 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f8c1a-2827-463e-99e3-ad3e77b6d7b2 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:13.143058 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2421/4856] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:59:13 2022] POST /identity/v3/projects => generated 371 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:13.145365 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3caa9-3c5a-495d-89e0-bed874272dcc None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:13.165552 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3caa9-3c5a-495d-89e0-bed874272dcc None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:13.301931 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c164e97-92f4-4f6b-b57c-106a400a6797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:13.302625 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c164e97-92f4-4f6b-b57c-106a400a6797 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:13.302896 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c164e97-92f4-4f6b-b57c-106a400a6797 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:13.303192 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c164e97-92f4-4f6b-b57c-106a400a6797 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:13.303842 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c164e97-92f4-4f6b-b57c-106a400a6797 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:13.306010 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c164e97-92f4-4f6b-b57c-106a400a6797 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:13.357135 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2436/4857] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:59:13 2022] POST /identity/v3/users => generated 292 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:13.359321 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:13.361421 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f8c1a-2827-463e-99e3-ad3e77b6d7b2 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:13.378696 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f8c1a-2827-463e-99e3-ad3e77b6d7b2 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:13.394884 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ae6a9-a205-4185-8f63-c7e8992523ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:13.396087 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ae6a9-a205-4185-8f63-c7e8992523ea admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:13.396795 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ae6a9-a205-4185-8f63-c7e8992523ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:13.397242 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ae6a9-a205-4185-8f63-c7e8992523ea admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:13.398059 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932ae6a9-a205-4185-8f63-c7e8992523ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:13.399892 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932ae6a9-a205-4185-8f63-c7e8992523ea admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:13.427622 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2422/4858] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:13.431359 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c164e97-92f4-4f6b-b57c-106a400a6797 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:13.451333 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c164e97-92f4-4f6b-b57c-106a400a6797 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:13.458870 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362ea65-b0f3-4675-bd95-db1b93a598ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:13.459811 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362ea65-b0f3-4675-bd95-db1b93a598ac admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:13.460245 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362ea65-b0f3-4675-bd95-db1b93a598ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:13.460696 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362ea65-b0f3-4675-bd95-db1b93a598ac admin admin] PATH_INFO: `/v3/projects/32bdc9e57ff947d6a16bfd25f40fc96c/users/d3401b3bbe0f4fc2a1faec415f83b7d6/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:13.502913 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0362ea65-b0f3-4675-bd95-db1b93a598ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=32bdc9e57ff947d6a16bfd25f40fc96c, user_id=d3401b3bbe0f4fc2a1faec415f83b7d6, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:13.506468 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0362ea65-b0f3-4675-bd95-db1b93a598ac admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:13.537262 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2437/4859] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:13 2022] PUT /identity/v3/projects/32bdc9e57ff947d6a16bfd25f40fc96c/users/d3401b3bbe0f4fc2a1faec415f83b7d6/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:13.541066 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ae6a9-a205-4185-8f63-c7e8992523ea admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:13.561792 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ae6a9-a205-4185-8f63-c7e8992523ea admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:13.689964 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c2266-3b55-4cc3-94ff-8acd5055a4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:13.690844 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c2266-3b55-4cc3-94ff-8acd5055a4de admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:13.691454 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c2266-3b55-4cc3-94ff-8acd5055a4de admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:13.692582 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c2266-3b55-4cc3-94ff-8acd5055a4de admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:13.693661 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26c2266-3b55-4cc3-94ff-8acd5055a4de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:13.695468 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26c2266-3b55-4cc3-94ff-8acd5055a4de admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:13.732957 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2423/4860] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:13.737198 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362ea65-b0f3-4675-bd95-db1b93a598ac admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:13.758585 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362ea65-b0f3-4675-bd95-db1b93a598ac admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:13.763710 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba3656-6862-4965-a28f-05a6128e0904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:13.764466 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba3656-6862-4965-a28f-05a6128e0904 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:13.765635 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba3656-6862-4965-a28f-05a6128e0904 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:13.765635 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba3656-6862-4965-a28f-05a6128e0904 admin admin] PATH_INFO: `/v3/projects/32bdc9e57ff947d6a16bfd25f40fc96c/users/d3401b3bbe0f4fc2a1faec415f83b7d6/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:13.767376 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba3656-6862-4965-a28f-05a6128e0904 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32bdc9e57ff947d6a16bfd25f40fc96c, user_id=d3401b3bbe0f4fc2a1faec415f83b7d6, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:13.770754 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba3656-6862-4965-a28f-05a6128e0904 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:13.783120 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2438/4861] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:13 2022] PUT /identity/v3/projects/32bdc9e57ff947d6a16bfd25f40fc96c/users/d3401b3bbe0f4fc2a1faec415f83b7d6/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:14.030102 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbb359-4719-421b-860f-63b4d4cfd627 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:14.030641 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbb359-4719-421b-860f-63b4d4cfd627 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:14.031099 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbb359-4719-421b-860f-63b4d4cfd627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:14.068516 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-85cbb359-4719-421b-860f-63b4d4cfd627 None None] MFA Rules not processed for user `2acd31b300e74d43a03bdbc1da8f9a47`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:14.070087 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-85cbb359-4719-421b-860f-63b4d4cfd627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:14.087334 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2424/4862] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:14 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:59:14.093368 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f89b2-d094-4054-98e6-a77cd7f74375 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:14.093652 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f89b2-d094-4054-98e6-a77cd7f74375 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:14.093924 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f89b2-d094-4054-98e6-a77cd7f74375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:14.138519 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-2e8f89b2-d094-4054-98e6-a77cd7f74375 None None] MFA Rules not processed for user `2acd31b300e74d43a03bdbc1da8f9a47`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:14.144199 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2e8f89b2-d094-4054-98e6-a77cd7f74375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:14.382257 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2439/4863] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:14.386162 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cbb359-4719-421b-860f-63b4d4cfd627 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:14.400426 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cbb359-4719-421b-860f-63b4d4cfd627 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:14.405197 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09317957-2eb5-4a7e-bdf5-4c4df1f6c089 tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2acd31b300e74d43a03bdbc1da8f9a47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f77cb1c1c064a91a136ff9a18562363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:14.406070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09317957-2eb5-4a7e-bdf5-4c4df1f6c089 tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:14.407189 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09317957-2eb5-4a7e-bdf5-4c4df1f6c089 tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:14.407628 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09317957-2eb5-4a7e-bdf5-4c4df1f6c089 tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] PATH_INFO: `/v3/users/2acd31b300e74d43a03bdbc1da8f9a47/password` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:14.466759 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-09317957-2eb5-4a7e-bdf5-4c4df1f6c089 tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2acd31b300e74d43a03bdbc1da8f9a47'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:14.489732 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2425/4864] 10.222.0.83 () {60 vars in 1269 bytes} [Mon Aug 29 15:59:14 2022] POST /identity/v3/users/2acd31b300e74d43a03bdbc1da8f9a47/password => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:15.094772 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde0426-39c8-4dca-ac9e-f3abdb532384 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:15.095358 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde0426-39c8-4dca-ac9e-f3abdb532384 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:15.095470 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde0426-39c8-4dca-ac9e-f3abdb532384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:15.174351 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-ecde0426-39c8-4dca-ac9e-f3abdb532384 None None] MFA Rules not processed for user `d3401b3bbe0f4fc2a1faec415f83b7d6`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:15.175643 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ecde0426-39c8-4dca-ac9e-f3abdb532384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:15.394405 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2440/4865] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:15 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:15.396657 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0f600-fdec-4705-a8dc-705c2784cde4 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:15.397526 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0f600-fdec-4705-a8dc-705c2784cde4 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:15.397979 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0f600-fdec-4705-a8dc-705c2784cde4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:15.430071 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-0cd0f600-fdec-4705-a8dc-705c2784cde4 None None] MFA Rules not processed for user `afcf02d997e146caa206dce027e15db1`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:15.431565 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0cd0f600-fdec-4705-a8dc-705c2784cde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:15.495497 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf7d43-aa1b-484e-8cdc-55784c360c4a None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:15.495784 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf7d43-aa1b-484e-8cdc-55784c360c4a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:15.496067 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf7d43-aa1b-484e-8cdc-55784c360c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:15.539872 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-ffcf7d43-aa1b-484e-8cdc-55784c360c4a None None] MFA Rules not processed for user `2acd31b300e74d43a03bdbc1da8f9a47`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:15.541129 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ffcf7d43-aa1b-484e-8cdc-55784c360c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:15.549975 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2441/4866] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:15 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 15:59:15.555471 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbade53d-e1f3-4cf6-b3e2-daf7e94be618 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:15.555757 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbade53d-e1f3-4cf6-b3e2-daf7e94be618 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:15.556037 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbade53d-e1f3-4cf6-b3e2-daf7e94be618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:15.583501 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2426/4867] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:15.590034 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-bbade53d-e1f3-4cf6-b3e2-daf7e94be618 None None] MFA Rules not processed for user `2acd31b300e74d43a03bdbc1da8f9a47`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:15.591577 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-bbade53d-e1f3-4cf6-b3e2-daf7e94be618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:15.592783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd0f600-fdec-4705-a8dc-705c2784cde4 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:15.593909 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0cd0f600-fdec-4705-a8dc-705c2784cde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:15.622027 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2442/4868] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:15.625895 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbade53d-e1f3-4cf6-b3e2-daf7e94be618 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:15.643118 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbade53d-e1f3-4cf6-b3e2-daf7e94be618 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:15.648268 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:15.656218 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922db04-263d-49e5-af0c-40c0fe1cc3eb tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2acd31b300e74d43a03bdbc1da8f9a47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f77cb1c1c064a91a136ff9a18562363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:15.661549 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922db04-263d-49e5-af0c-40c0fe1cc3eb tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:15.664369 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922db04-263d-49e5-af0c-40c0fe1cc3eb tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:15.669273 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922db04-263d-49e5-af0c-40c0fe1cc3eb tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] PATH_INFO: `/v3/users/2acd31b300e74d43a03bdbc1da8f9a47/password` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:15.757493 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e922db04-263d-49e5-af0c-40c0fe1cc3eb tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2acd31b300e74d43a03bdbc1da8f9a47'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:15.760801 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd0f600-fdec-4705-a8dc-705c2784cde4 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:15.766879 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c62b38-b174-45a1-8eae-c682769926b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:15.767539 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c62b38-b174-45a1-8eae-c682769926b4 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:15.767843 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c62b38-b174-45a1-8eae-c682769926b4 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:15.768085 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c62b38-b174-45a1-8eae-c682769926b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:15.778287 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c62b38-b174-45a1-8eae-c682769926b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:15.780097 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c62b38-b174-45a1-8eae-c682769926b4 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:15.791098 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2427/4869] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:59:15 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:59:15.792204 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2443/4870] 10.222.0.83 () {60 vars in 1269 bytes} [Mon Aug 29 15:59:15 2022] POST /identity/v3/users/2acd31b300e74d43a03bdbc1da8f9a47/password => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:16.095648 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c62b38-b174-45a1-8eae-c682769926b4 service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:16.097250 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d9c62b38-b174-45a1-8eae-c682769926b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:16.185067 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c62b38-b174-45a1-8eae-c682769926b4 service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:16.189878 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5d7c2-f2ed-4473-9502-e41996b68c83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:16.190567 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5d7c2-f2ed-4473-9502-e41996b68c83 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:16.190851 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5d7c2-f2ed-4473-9502-e41996b68c83 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:16.191185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5d7c2-f2ed-4473-9502-e41996b68c83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:16.194591 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-40b5d7c2-f2ed-4473-9502-e41996b68c83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:16.207970 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b5d7c2-f2ed-4473-9502-e41996b68c83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:16.209600 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b5d7c2-f2ed-4473-9502-e41996b68c83 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:16.220767 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2428/4871] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:59:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:59:16.802396 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957165a-48c7-4db4-9d1b-7f71809da3fd None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:16.802933 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957165a-48c7-4db4-9d1b-7f71809da3fd None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:16.803100 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957165a-48c7-4db4-9d1b-7f71809da3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:16.822486 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5d7c2-f2ed-4473-9502-e41996b68c83 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:16.823960 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-40b5d7c2-f2ed-4473-9502-e41996b68c83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:16.829881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:UPDATE=1,keystone:DELETE=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:16.891512 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-7957165a-48c7-4db4-9d1b-7f71809da3fd None None] MFA Rules not processed for user `2acd31b300e74d43a03bdbc1da8f9a47`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:16.897582 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7957165a-48c7-4db4-9d1b-7f71809da3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:16.920982 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2444/4872] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:16 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:59:16.923165 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a738f08-bd02-4967-b59e-5e96193c8bd4 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:16.923668 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a738f08-bd02-4967-b59e-5e96193c8bd4 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:16.924307 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a738f08-bd02-4967-b59e-5e96193c8bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:16.970228 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-1a738f08-bd02-4967-b59e-5e96193c8bd4 None None] MFA Rules not processed for user `2acd31b300e74d43a03bdbc1da8f9a47`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:16.971970 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1a738f08-bd02-4967-b59e-5e96193c8bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:16.991960 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2445/4873] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:59:16.996832 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a738f08-bd02-4967-b59e-5e96193c8bd4 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:17.006269 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5d7c2-f2ed-4473-9502-e41996b68c83 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:17.019960 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1fb3a9-4ffa-41c2-89fb-295197703658 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:17.019960 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1fb3a9-4ffa-41c2-89fb-295197703658 service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:17.019960 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1fb3a9-4ffa-41c2-89fb-295197703658 service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:17.019960 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1fb3a9-4ffa-41c2-89fb-295197703658 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:17.024982 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3f1fb3a9-4ffa-41c2-89fb-295197703658 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:17.029089 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a738f08-bd02-4967-b59e-5e96193c8bd4 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:17.038583 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d348ab-ef45-4bf0-943a-dee38cc9230c tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2acd31b300e74d43a03bdbc1da8f9a47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f77cb1c1c064a91a136ff9a18562363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:17.039449 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d348ab-ef45-4bf0-943a-dee38cc9230c tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:17.045023 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d348ab-ef45-4bf0-943a-dee38cc9230c tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:17.045716 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d348ab-ef45-4bf0-943a-dee38cc9230c tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] PATH_INFO: `/v3/users/2acd31b300e74d43a03bdbc1da8f9a47/password` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:17.077965 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1fb3a9-4ffa-41c2-89fb-295197703658 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:17.079649 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1fb3a9-4ffa-41c2-89fb-295197703658 service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:17.100828 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2429/4874] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:59:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:59:17.151563 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-08d348ab-ef45-4bf0-943a-dee38cc9230c tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2acd31b300e74d43a03bdbc1da8f9a47'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:17.165673 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2446/4875] 10.222.0.83 () {60 vars in 1269 bytes} [Mon Aug 29 15:59:16 2022] POST /identity/v3/users/2acd31b300e74d43a03bdbc1da8f9a47/password => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:18.170408 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef6ed8-fbb4-48be-9656-60674b5e19a4 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:18.171813 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef6ed8-fbb4-48be-9656-60674b5e19a4 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:18.172277 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef6ed8-fbb4-48be-9656-60674b5e19a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:18.209210 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-f1ef6ed8-fbb4-48be-9656-60674b5e19a4 None None] MFA Rules not processed for user `2acd31b300e74d43a03bdbc1da8f9a47`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:18.210937 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f1ef6ed8-fbb4-48be-9656-60674b5e19a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:18.217430 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2430/4876] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:18 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:59:19.221451 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00266d80-e9ac-4823-9897-b6730d3320b1 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:19.225102 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00266d80-e9ac-4823-9897-b6730d3320b1 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:19.225629 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00266d80-e9ac-4823-9897-b6730d3320b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:19.288195 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-00266d80-e9ac-4823-9897-b6730d3320b1 None None] MFA Rules not processed for user `2acd31b300e74d43a03bdbc1da8f9a47`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:19.289802 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-00266d80-e9ac-4823-9897-b6730d3320b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:19.298790 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2447/4877] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:19.309327 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfabc87-d308-4438-bc75-f10e32163ecf None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:19.309893 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfabc87-d308-4438-bc75-f10e32163ecf None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:19.310033 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfabc87-d308-4438-bc75-f10e32163ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:19.340451 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-1cfabc87-d308-4438-bc75-f10e32163ecf None None] MFA Rules not processed for user `2acd31b300e74d43a03bdbc1da8f9a47`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:19.341654 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1cfabc87-d308-4438-bc75-f10e32163ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:19.349792 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2431/4878] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:19 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:59:19.350430 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e8bcd-c907-4670-ba85-bfa36157e20c None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:19.350782 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e8bcd-c907-4670-ba85-bfa36157e20c None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:19.351260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e8bcd-c907-4670-ba85-bfa36157e20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:19.434555 n-d-836830-13 devstack@keystone.service[82148]: WARNING keystone.server.flask.application [None req-cc9e8bcd-c907-4670-ba85-bfa36157e20c None None] Authorization failed. The request you have made requires authentication. from 10.222.0.83: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 29 15:59:19.436461 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2448/4879] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:19 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 87 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 29 15:59:19.442220 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98e81c-a2a5-4031-a907-4d1fb353febf None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:19.442826 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98e81c-a2a5-4031-a907-4d1fb353febf None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:19.444506 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98e81c-a2a5-4031-a907-4d1fb353febf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:19.498708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:19.511073 n-d-836830-13 devstack@keystone.service[82149]: WARNING keystone.server.flask.application [None req-2a98e81c-a2a5-4031-a907-4d1fb353febf None None] Authorization failed. The request you have made requires authentication. from 10.222.0.83: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 29 15:59:19.521433 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2157051-6311-4f63-9f11-6c5ecf4c1a3e None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:19.523167 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2157051-6311-4f63-9f11-6c5ecf4c1a3e None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:19.523645 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2157051-6311-4f63-9f11-6c5ecf4c1a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:19.531386 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2432/4880] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:19 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 90 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 29 15:59:19.563443 n-d-836830-13 devstack@keystone.service[82148]: WARNING keystone.server.flask.application [None req-b2157051-6311-4f63-9f11-6c5ecf4c1a3e None None] Authorization failed. The request you have made requires authentication. from 10.222.0.83: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 29 15:59:19.565538 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2449/4881] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:19 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 46 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 29 15:59:20.464900 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f002f-8f10-4949-a74b-97ab9a8e575c None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:20.465357 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f002f-8f10-4949-a74b-97ab9a8e575c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:20.465444 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f002f-8f10-4949-a74b-97ab9a8e575c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:20.489807 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-b35f002f-8f10-4949-a74b-97ab9a8e575c None None] MFA Rules not processed for user `58ddd1273ce749e29578db36d61ca07a`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:20.491215 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b35f002f-8f10-4949-a74b-97ab9a8e575c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:20.595796 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2433/4882] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:28.375189 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2157051-6311-4f63-9f11-6c5ecf4c1a3e None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:28.399925 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2157051-6311-4f63-9f11-6c5ecf4c1a3e None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:28.404035 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd2f51-aca0-4406-b3a7-2d28bc7195c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:28.404663 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd2f51-aca0-4406-b3a7-2d28bc7195c2 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:28.404942 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd2f51-aca0-4406-b3a7-2d28bc7195c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:28.405212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd2f51-aca0-4406-b3a7-2d28bc7195c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:28.415985 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4acd2f51-aca0-4406-b3a7-2d28bc7195c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:28.547666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acd2f51-aca0-4406-b3a7-2d28bc7195c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:28.549167 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acd2f51-aca0-4406-b3a7-2d28bc7195c2 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:28.579768 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2450/4883] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:59:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:59:30.579310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=30 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:30.581429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b0890-fb3e-47ec-a72b-1af03dedecb9 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:30.581928 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b0890-fb3e-47ec-a72b-1af03dedecb9 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:30.583219 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b0890-fb3e-47ec-a72b-1af03dedecb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:30.660888 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-184b0890-fb3e-47ec-a72b-1af03dedecb9 None None] MFA Rules not processed for user `2acd31b300e74d43a03bdbc1da8f9a47`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:30.666073 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-184b0890-fb3e-47ec-a72b-1af03dedecb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:30.675700 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2434/4884] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:30 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:59:30.678592 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd2f51-aca0-4406-b3a7-2d28bc7195c2 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:30.704066 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd2f51-aca0-4406-b3a7-2d28bc7195c2 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:30.720943 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae3d50-3aed-4516-9b05-39e105842da1 tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2acd31b300e74d43a03bdbc1da8f9a47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f77cb1c1c064a91a136ff9a18562363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:30.722172 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae3d50-3aed-4516-9b05-39e105842da1 tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:30.722765 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae3d50-3aed-4516-9b05-39e105842da1 tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:30.732022 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae3d50-3aed-4516-9b05-39e105842da1 tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] PATH_INFO: `/v3/users/2acd31b300e74d43a03bdbc1da8f9a47/password` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:30.880100 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-96ae3d50-3aed-4516-9b05-39e105842da1 tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2acd31b300e74d43a03bdbc1da8f9a47'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:30.903003 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2451/4885] 10.222.0.83 () {60 vars in 1269 bytes} [Mon Aug 29 15:59:30 2022] POST /identity/v3/users/2acd31b300e74d43a03bdbc1da8f9a47/password => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:31.910471 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5a911-4c9d-4082-8e57-f2deb4ad1cb7 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:31.911707 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5a911-4c9d-4082-8e57-f2deb4ad1cb7 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:31.912186 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5a911-4c9d-4082-8e57-f2deb4ad1cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:31.943537 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a4b5a911-4c9d-4082-8e57-f2deb4ad1cb7 None None] MFA Rules not processed for user `2acd31b300e74d43a03bdbc1da8f9a47`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:31.945130 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a4b5a911-4c9d-4082-8e57-f2deb4ad1cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:31.960904 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2435/4886] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:31 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:59:31.964097 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4d5bd-27a7-4874-9b66-8344087c0295 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:31.964622 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4d5bd-27a7-4874-9b66-8344087c0295 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:31.964850 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4d5bd-27a7-4874-9b66-8344087c0295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:32.022725 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-98b4d5bd-27a7-4874-9b66-8344087c0295 None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Aug 29 15:59:32.022725 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:59:32.022725 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:59:32.022725 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:59:32.022725 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:59:32.022725 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:59:32.022725 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:59:32.022725 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:59:32.022725 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:59:32.022725 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:59:32.022725 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:59:32.022725 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:59:32.022725 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 29 15:59:32.022725 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 29 15:59:32.022725 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 29 15:59:32.022725 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 29 15:59:32.024129 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 185, in authenticate_for_token Aug 29 15:59:32.024129 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application authenticate(auth_info, auth_context) Aug 29 15:59:32.024129 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 152, in authenticate Aug 29 15:59:32.024129 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = method.authenticate(auth_info.get_method_data(method_name)) Aug 29 15:59:32.024129 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 42, in authenticate Aug 29 15:59:32.024129 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application token = self._get_token_ref(auth_payload) Aug 29 15:59:32.024129 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 36, in _get_token_ref Aug 29 15:59:32.024129 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return PROVIDERS.token_provider_api.validate_token(token_id) Aug 29 15:59:32.024129 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:59:32.024129 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:59:32.024129 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Aug 29 15:59:32.024129 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Aug 29 15:59:32.024129 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Aug 29 15:59:32.024129 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self.check_revocation(token) Aug 29 15:59:32.024129 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:59:32.024129 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:59:32.025317 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Aug 29 15:59:32.025317 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Aug 29 15:59:32.025317 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:59:32.025317 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:59:32.025317 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Aug 29 15:59:32.025317 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Aug 29 15:59:32.025317 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:59:32.025317 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:59:32.025317 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Aug 29 15:59:32.025317 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Aug 29 15:59:32.025317 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Aug 29 15:59:32.025317 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 15:59:32.030984 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2452/4887] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:31 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:59:32.032605 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cebc1-76c7-4957-9b8b-e74b8ab30845 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:32.032990 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cebc1-76c7-4957-9b8b-e74b8ab30845 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:32.033416 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cebc1-76c7-4957-9b8b-e74b8ab30845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:32.139709 n-d-836830-13 devstack@keystone.service[82149]: WARNING keystone.server.flask.application [None req-263cebc1-76c7-4957-9b8b-e74b8ab30845 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.83: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 29 15:59:32.141916 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2436/4888] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:32 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 111 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Aug 29 15:59:32.147594 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98e89e-6af7-4f64-b159-95e19e6530eb None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:32.147880 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98e89e-6af7-4f64-b159-95e19e6530eb None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:32.148163 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98e89e-6af7-4f64-b159-95e19e6530eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:32.219166 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-cd98e89e-6af7-4f64-b159-95e19e6530eb None None] MFA Rules not processed for user `2acd31b300e74d43a03bdbc1da8f9a47`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:32.220409 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-cd98e89e-6af7-4f64-b159-95e19e6530eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:32.235539 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2453/4889] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:32.239996 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cebc1-76c7-4957-9b8b-e74b8ab30845 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:32.265409 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cebc1-76c7-4957-9b8b-e74b8ab30845 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:32.283697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c1d52-80a0-4491-a8cf-ddc46bb8e2bb tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2acd31b300e74d43a03bdbc1da8f9a47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f77cb1c1c064a91a136ff9a18562363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:32.284377 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c1d52-80a0-4491-a8cf-ddc46bb8e2bb tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:32.284665 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c1d52-80a0-4491-a8cf-ddc46bb8e2bb tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:32.286340 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c1d52-80a0-4491-a8cf-ddc46bb8e2bb tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] PATH_INFO: `/v3/users/2acd31b300e74d43a03bdbc1da8f9a47/password` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:32.429322 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3c6c1d52-80a0-4491-a8cf-ddc46bb8e2bb tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2acd31b300e74d43a03bdbc1da8f9a47'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:32.443315 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2437/4890] 10.222.0.83 () {60 vars in 1269 bytes} [Mon Aug 29 15:59:32 2022] POST /identity/v3/users/2acd31b300e74d43a03bdbc1da8f9a47/password => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:59:33.449424 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ed408-08c7-4979-bc5d-e6c425e50d89 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:33.450479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ed408-08c7-4979-bc5d-e6c425e50d89 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:33.450761 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ed408-08c7-4979-bc5d-e6c425e50d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:33.497958 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-418ed408-08c7-4979-bc5d-e6c425e50d89 None None] MFA Rules not processed for user `2acd31b300e74d43a03bdbc1da8f9a47`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:33.499893 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-418ed408-08c7-4979-bc5d-e6c425e50d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:33.503863 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2454/4891] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:33 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:59:33.509814 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44f2ee-342b-4b6f-9a42-1c0787104a73 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:33.510341 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44f2ee-342b-4b6f-9a42-1c0787104a73 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:33.510440 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44f2ee-342b-4b6f-9a42-1c0787104a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:33.567228 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-ad44f2ee-342b-4b6f-9a42-1c0787104a73 None None] MFA Rules not processed for user `2acd31b300e74d43a03bdbc1da8f9a47`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:33.568820 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ad44f2ee-342b-4b6f-9a42-1c0787104a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:33.580944 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2438/4892] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:33.581925 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ed408-08c7-4979-bc5d-e6c425e50d89 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:33.597198 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ed408-08c7-4979-bc5d-e6c425e50d89 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:33.607988 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbaf70-6d41-4a45-bf63-2c18c2713a90 tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2acd31b300e74d43a03bdbc1da8f9a47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f77cb1c1c064a91a136ff9a18562363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:33.609823 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbaf70-6d41-4a45-bf63-2c18c2713a90 tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:33.610117 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbaf70-6d41-4a45-bf63-2c18c2713a90 tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:33.610445 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbaf70-6d41-4a45-bf63-2c18c2713a90 tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] PATH_INFO: `/v3/users/2acd31b300e74d43a03bdbc1da8f9a47/password` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:33.623085 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=88,keystone:UPDATE=4,keystone:INSERT=4,keystone:DELETE=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:33.688792 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7cfbaf70-6d41-4a45-bf63-2c18c2713a90 tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2acd31b300e74d43a03bdbc1da8f9a47'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:33.726044 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2455/4893] 10.222.0.83 () {60 vars in 1269 bytes} [Mon Aug 29 15:59:33 2022] POST /identity/v3/users/2acd31b300e74d43a03bdbc1da8f9a47/password => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:59:34.124672 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad44f2ee-342b-4b6f-9a42-1c0787104a73 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:34.126094 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ad44f2ee-342b-4b6f-9a42-1c0787104a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:34.287684 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad44f2ee-342b-4b6f-9a42-1c0787104a73 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:34.292781 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b11f0e-f200-4081-a0ea-037fbe8ded0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:34.293449 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b11f0e-f200-4081-a0ea-037fbe8ded0a service cinder] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:34.293733 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b11f0e-f200-4081-a0ea-037fbe8ded0a service cinder] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:34.294017 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b11f0e-f200-4081-a0ea-037fbe8ded0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:34.307143 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b11f0e-f200-4081-a0ea-037fbe8ded0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:34.308584 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b11f0e-f200-4081-a0ea-037fbe8ded0a service cinder] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:34.320913 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2439/4894] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:59:34 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:59:34.614843 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbaf70-6d41-4a45-bf63-2c18c2713a90 tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:34.618916 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7cfbaf70-6d41-4a45-bf63-2c18c2713a90 tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:34.665608 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbaf70-6d41-4a45-bf63-2c18c2713a90 tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:34.688765 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb859489-fb71-4f7f-abeb-4b989d01010e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:34.690755 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb859489-fb71-4f7f-abeb-4b989d01010e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:34.691416 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb859489-fb71-4f7f-abeb-4b989d01010e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:34.692577 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb859489-fb71-4f7f-abeb-4b989d01010e admin admin] PATH_INFO: `/v3/users/f554eb660c324a759d70b3b974e78db5` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:34.704078 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb859489-fb71-4f7f-abeb-4b989d01010e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f554eb660c324a759d70b3b974e78db5)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:34.709996 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb859489-fb71-4f7f-abeb-4b989d01010e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:34.732137 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644c418-d685-4efe-bf2f-2cacd684821f None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:34.732968 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644c418-d685-4efe-bf2f-2cacd684821f None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:34.733244 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644c418-d685-4efe-bf2f-2cacd684821f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:34.794655 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a644c418-d685-4efe-bf2f-2cacd684821f None None] MFA Rules not processed for user `2acd31b300e74d43a03bdbc1da8f9a47`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:34.798760 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a644c418-d685-4efe-bf2f-2cacd684821f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:34.811177 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2440/4895] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:34 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:59:34.817389 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7dc13-697b-4742-99c6-d69e81367745 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:34.818696 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7dc13-697b-4742-99c6-d69e81367745 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:34.819852 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7dc13-697b-4742-99c6-d69e81367745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:34.830267 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-cb859489-fb71-4f7f-abeb-4b989d01010e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f554eb660c324a759d70b3b974e78db5'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:34.833209 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-cb859489-fb71-4f7f-abeb-4b989d01010e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f554eb660c324a759d70b3b974e78db5'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:34.855176 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-cb859489-fb71-4f7f-abeb-4b989d01010e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f554eb660c324a759d70b3b974e78db5'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:34.871138 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-cb859489-fb71-4f7f-abeb-4b989d01010e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f554eb660c324a759d70b3b974e78db5'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:34.886523 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-cb859489-fb71-4f7f-abeb-4b989d01010e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f554eb660c324a759d70b3b974e78db5'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:34.891209 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-10d7dc13-697b-4742-99c6-d69e81367745 None None] MFA Rules not processed for user `2acd31b300e74d43a03bdbc1da8f9a47`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:34.896760 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-10d7dc13-697b-4742-99c6-d69e81367745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:34.903202 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2456/4896] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:34 2022] DELETE /identity/v3/users/f554eb660c324a759d70b3b974e78db5 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:35.033997 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2441/4897] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:35.038944 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb859489-fb71-4f7f-abeb-4b989d01010e admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:35.059603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb859489-fb71-4f7f-abeb-4b989d01010e admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:35.065390 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a246a73-2194-455a-8248-ffa74c13c4c5 tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2acd31b300e74d43a03bdbc1da8f9a47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f77cb1c1c064a91a136ff9a18562363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:35.066381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a246a73-2194-455a-8248-ffa74c13c4c5 tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:35.067611 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a246a73-2194-455a-8248-ffa74c13c4c5 tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:35.068098 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a246a73-2194-455a-8248-ffa74c13c4c5 tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] PATH_INFO: `/v3/users/2acd31b300e74d43a03bdbc1da8f9a47/password` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:35.184549 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4a246a73-2194-455a-8248-ffa74c13c4c5 tempest-IdentityV3UsersTest-246310070 tempest-IdentityV3UsersTest-246310070-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2acd31b300e74d43a03bdbc1da8f9a47'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:35.206743 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2457/4898] 10.222.0.83 () {60 vars in 1269 bytes} [Mon Aug 29 15:59:35 2022] POST /identity/v3/users/2acd31b300e74d43a03bdbc1da8f9a47/password => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:35.425380 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7dc13-697b-4742-99c6-d69e81367745 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:35.427323 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-10d7dc13-697b-4742-99c6-d69e81367745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:35.449201 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=93,keystone:UPDATE=3,keystone:INSERT=2,keystone:DELETE=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:35.550131 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7dc13-697b-4742-99c6-d69e81367745 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:35.567686 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4773b21-773a-410f-91cd-e8810a6625dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:35.568532 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4773b21-773a-410f-91cd-e8810a6625dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:35.569020 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4773b21-773a-410f-91cd-e8810a6625dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:35.569428 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4773b21-773a-410f-91cd-e8810a6625dd admin admin] PATH_INFO: `/v3/projects/c7ad457701f641bd963da9221fb04094` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:35.570770 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4773b21-773a-410f-91cd-e8810a6625dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7ad457701f641bd963da9221fb04094)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:35.574829 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4773b21-773a-410f-91cd-e8810a6625dd admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:35.659312 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f4773b21-773a-410f-91cd-e8810a6625dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7ad457701f641bd963da9221fb04094', 'request_id': 'req-f4773b21-773a-410f-91cd-e8810a6625dd'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:35.668271 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f4773b21-773a-410f-91cd-e8810a6625dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7ad457701f641bd963da9221fb04094', 'request_id': 'req-f4773b21-773a-410f-91cd-e8810a6625dd'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:35.682359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f4773b21-773a-410f-91cd-e8810a6625dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7ad457701f641bd963da9221fb04094', 'request_id': 'req-f4773b21-773a-410f-91cd-e8810a6625dd'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:35.708257 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f4773b21-773a-410f-91cd-e8810a6625dd admin admin] The token cache is being invalidate because project c7ad457701f641bd963da9221fb04094 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:35.708662 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f4773b21-773a-410f-91cd-e8810a6625dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:35.709719 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f4773b21-773a-410f-91cd-e8810a6625dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:35.720886 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2442/4899] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:59:35 2022] DELETE /identity/v3/projects/c7ad457701f641bd963da9221fb04094 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:35.726707 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3a1c7-6f3a-4cb4-a5ec-6b35b4df6543 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:35.727203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3a1c7-6f3a-4cb4-a5ec-6b35b4df6543 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:35.727376 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3a1c7-6f3a-4cb4-a5ec-6b35b4df6543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:35.774514 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-fea3a1c7-6f3a-4cb4-a5ec-6b35b4df6543 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:35.777362 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-fea3a1c7-6f3a-4cb4-a5ec-6b35b4df6543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:35.866538 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd0e66-56ca-4085-92d2-dfddf195665e None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:35.867497 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd0e66-56ca-4085-92d2-dfddf195665e None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:35.868318 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd0e66-56ca-4085-92d2-dfddf195665e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:35.903350 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-f5dd0e66-56ca-4085-92d2-dfddf195665e None None] MFA Rules not processed for user `c1c8b71252e84112bb1fd0513cf49f69`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:35.906137 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f5dd0e66-56ca-4085-92d2-dfddf195665e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:35.916651 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2458/4900] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:35.918189 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b337f6-1b6b-47f7-9d75-5d3015578321 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:35.918478 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b337f6-1b6b-47f7-9d75-5d3015578321 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:35.918931 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b337f6-1b6b-47f7-9d75-5d3015578321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:35.942529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-14b337f6-1b6b-47f7-9d75-5d3015578321 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:35.944484 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-14b337f6-1b6b-47f7-9d75-5d3015578321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:35.961165 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2459/4901] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:35.962349 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b337f6-1b6b-47f7-9d75-5d3015578321 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:35.968462 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=79,keystone:UPDATE=2,keystone:INSERT=5,keystone:DELETE=14 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:35.974684 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b337f6-1b6b-47f7-9d75-5d3015578321 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:35.985731 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51b0d1-5866-4253-9d70-18c599994ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:35.986192 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51b0d1-5866-4253-9d70-18c599994ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:35.986478 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51b0d1-5866-4253-9d70-18c599994ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:35.986724 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51b0d1-5866-4253-9d70-18c599994ba3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:35.987533 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e51b0d1-5866-4253-9d70-18c599994ba3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:59:35.990438 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e51b0d1-5866-4253-9d70-18c599994ba3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:35.991838 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e51b0d1-5866-4253-9d70-18c599994ba3 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:36.012073 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2460/4902] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:59:36.016619 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51b0d1-5866-4253-9d70-18c599994ba3 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:36.044761 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51b0d1-5866-4253-9d70-18c599994ba3 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:36.045513 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2443/4903] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:36.055881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507b070-0c2d-4ad1-9b65-f1258d02012b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:36.057134 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507b070-0c2d-4ad1-9b65-f1258d02012b admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:36.057404 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507b070-0c2d-4ad1-9b65-f1258d02012b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:36.057604 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507b070-0c2d-4ad1-9b65-f1258d02012b admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:36.058299 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1507b070-0c2d-4ad1-9b65-f1258d02012b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:36.061492 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1507b070-0c2d-4ad1-9b65-f1258d02012b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:36.119444 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2461/4904] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:59:36 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:36.120104 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd0e66-56ca-4085-92d2-dfddf195665e None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:36.148824 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd0e66-56ca-4085-92d2-dfddf195665e None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:36.210454 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59262af-f26b-411e-9761-51f7916c7b86 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:36.210949 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59262af-f26b-411e-9761-51f7916c7b86 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:36.211400 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59262af-f26b-411e-9761-51f7916c7b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:36.225476 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:36.260484 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-d59262af-f26b-411e-9761-51f7916c7b86 None None] MFA Rules not processed for user `2acd31b300e74d43a03bdbc1da8f9a47`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:36.261477 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ebdeb3-34a3-4255-ac6b-fef540d71775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:36.261825 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d59262af-f26b-411e-9761-51f7916c7b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:36.264283 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebdeb3-34a3-4255-ac6b-fef540d71775 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:36.264885 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebdeb3-34a3-4255-ac6b-fef540d71775 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:36.268247 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebdeb3-34a3-4255-ac6b-fef540d71775 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:36.268871 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2462/4905] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:36 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 15:59:36.280659 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ebdeb3-34a3-4255-ac6b-fef540d71775 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:36.288583 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ebdeb3-34a3-4255-ac6b-fef540d71775 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:36.326568 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2444/4906] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:59:36 2022] POST /identity/v3/users => generated 292 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:36.330883 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59262af-f26b-411e-9761-51f7916c7b86 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:36.350917 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59262af-f26b-411e-9761-51f7916c7b86 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:36.363847 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca24754d-e2df-4ccb-ab3e-14df7c1edb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:36.364781 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24754d-e2df-4ccb-ab3e-14df7c1edb0a admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:36.365415 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24754d-e2df-4ccb-ab3e-14df7c1edb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:36.365707 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24754d-e2df-4ccb-ab3e-14df7c1edb0a admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:36.366468 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca24754d-e2df-4ccb-ab3e-14df7c1edb0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:36.368362 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca24754d-e2df-4ccb-ab3e-14df7c1edb0a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:36.385791 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2463/4907] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:36.392107 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ebdeb3-34a3-4255-ac6b-fef540d71775 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:36.407364 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ebdeb3-34a3-4255-ac6b-fef540d71775 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:36.414747 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c3fee-6648-453c-9fd5-12604dc808dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:36.416481 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c3fee-6648-453c-9fd5-12604dc808dc admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:36.417245 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c3fee-6648-453c-9fd5-12604dc808dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:36.417703 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c3fee-6648-453c-9fd5-12604dc808dc admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:36.418968 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3c3fee-6648-453c-9fd5-12604dc808dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:36.420959 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3c3fee-6648-453c-9fd5-12604dc808dc admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:36.436391 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2445/4908] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:59:36.440824 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca24754d-e2df-4ccb-ab3e-14df7c1edb0a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:36.456475 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca24754d-e2df-4ccb-ab3e-14df7c1edb0a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:36.474460 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f9dc5-0658-4f82-82f1-d5621f83fedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:36.474460 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f9dc5-0658-4f82-82f1-d5621f83fedc admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:36.474460 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f9dc5-0658-4f82-82f1-d5621f83fedc admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:36.474460 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f9dc5-0658-4f82-82f1-d5621f83fedc admin admin] PATH_INFO: `/v3/projects/67467b6a2bc44a7f98c525cc7c8d3c15/users/1452d6fd4a0e4905bf4faaea119e03b1/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:36.515577 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f9dc5-0658-4f82-82f1-d5621f83fedc admin admin] RBAC: Authorizing `identity:create_grant(project_id=67467b6a2bc44a7f98c525cc7c8d3c15, user_id=1452d6fd4a0e4905bf4faaea119e03b1, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:36.518555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f9dc5-0658-4f82-82f1-d5621f83fedc admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:36.545440 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2464/4909] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:36 2022] PUT /identity/v3/projects/67467b6a2bc44a7f98c525cc7c8d3c15/users/1452d6fd4a0e4905bf4faaea119e03b1/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:36.559205 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e147b7e-6a2d-479f-95f9-33d1fc53266e None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:36.559499 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e147b7e-6a2d-479f-95f9-33d1fc53266e None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:36.559782 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e147b7e-6a2d-479f-95f9-33d1fc53266e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:36.613164 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-1e147b7e-6a2d-479f-95f9-33d1fc53266e None None] MFA Rules not processed for user `1452d6fd4a0e4905bf4faaea119e03b1`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:36.615230 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1e147b7e-6a2d-479f-95f9-33d1fc53266e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:36.762551 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2446/4910] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:36.775686 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f9dc5-0658-4f82-82f1-d5621f83fedc admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:36.777489 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b12f9dc5-0658-4f82-82f1-d5621f83fedc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:36.887702 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f9dc5-0658-4f82-82f1-d5621f83fedc admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:36.894020 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c07de-1af3-481f-9b2b-ba8b28697de7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:36.895792 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c07de-1af3-481f-9b2b-ba8b28697de7 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:36.896078 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c07de-1af3-481f-9b2b-ba8b28697de7 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:36.896634 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c07de-1af3-481f-9b2b-ba8b28697de7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:36.906907 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c07de-1af3-481f-9b2b-ba8b28697de7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:36.909322 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c07de-1af3-481f-9b2b-ba8b28697de7 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:36.923965 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2465/4911] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:59:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:59:37.274763 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c48da-cded-41f6-ac9f-fdda9397dd3e None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:37.275410 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c48da-cded-41f6-ac9f-fdda9397dd3e None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:37.275410 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c48da-cded-41f6-ac9f-fdda9397dd3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:37.315305 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-cb0c48da-cded-41f6-ac9f-fdda9397dd3e None None] MFA Rules not processed for user `2acd31b300e74d43a03bdbc1da8f9a47`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:37.316717 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-cb0c48da-cded-41f6-ac9f-fdda9397dd3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:37.494145 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2447/4912] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:37.503711 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c07de-1af3-481f-9b2b-ba8b28697de7 service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:37.506320 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f78c07de-1af3-481f-9b2b-ba8b28697de7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:37.604806 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c07de-1af3-481f-9b2b-ba8b28697de7 service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:37.617659 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3158634-38c0-4185-8331-3039224445da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:37.618922 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3158634-38c0-4185-8331-3039224445da admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:37.619531 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3158634-38c0-4185-8331-3039224445da admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:37.620089 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3158634-38c0-4185-8331-3039224445da admin admin] PATH_INFO: `/v3/users/2acd31b300e74d43a03bdbc1da8f9a47` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:37.621896 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3158634-38c0-4185-8331-3039224445da admin admin] RBAC: Authorizing `identity:delete_user(user_id=2acd31b300e74d43a03bdbc1da8f9a47)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:37.624416 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3158634-38c0-4185-8331-3039224445da admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:37.668960 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:37.761027 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f3158634-38c0-4185-8331-3039224445da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2acd31b300e74d43a03bdbc1da8f9a47'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:37.761918 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f3158634-38c0-4185-8331-3039224445da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2acd31b300e74d43a03bdbc1da8f9a47'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:37.794467 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f3158634-38c0-4185-8331-3039224445da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2acd31b300e74d43a03bdbc1da8f9a47'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:37.808236 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f3158634-38c0-4185-8331-3039224445da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2acd31b300e74d43a03bdbc1da8f9a47'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:37.828230 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f3158634-38c0-4185-8331-3039224445da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2acd31b300e74d43a03bdbc1da8f9a47'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:37.848115 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2466/4913] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:37 2022] DELETE /identity/v3/users/2acd31b300e74d43a03bdbc1da8f9a47 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:37.849899 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541459a-9d14-4a41-ae8a-2972727c0a2e None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:37.850195 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541459a-9d14-4a41-ae8a-2972727c0a2e None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:37.850699 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541459a-9d14-4a41-ae8a-2972727c0a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:37.885110 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-d541459a-9d14-4a41-ae8a-2972727c0a2e None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:37.887462 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d541459a-9d14-4a41-ae8a-2972727c0a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:38.062485 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:38.105256 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2448/4914] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:38.141151 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3158634-38c0-4185-8331-3039224445da admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:38.142568 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f3158634-38c0-4185-8331-3039224445da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:38.326932 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3158634-38c0-4185-8331-3039224445da admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:38.338741 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0825e6d-2546-4e52-89a8-fb54f9567d8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:38.340876 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0825e6d-2546-4e52-89a8-fb54f9567d8a service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:38.341990 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0825e6d-2546-4e52-89a8-fb54f9567d8a service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:38.343760 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0825e6d-2546-4e52-89a8-fb54f9567d8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:38.380084 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0825e6d-2546-4e52-89a8-fb54f9567d8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:38.382421 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0825e6d-2546-4e52-89a8-fb54f9567d8a service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:38.399633 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2467/4915] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:59:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:59:39.215724 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541459a-9d14-4a41-ae8a-2972727c0a2e None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:39.217343 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d541459a-9d14-4a41-ae8a-2972727c0a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:39.249308 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541459a-9d14-4a41-ae8a-2972727c0a2e None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:39.292356 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5006d3-c325-4530-b6f6-8034a0021fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:39.293089 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5006d3-c325-4530-b6f6-8034a0021fca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:39.298138 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5006d3-c325-4530-b6f6-8034a0021fca admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:39.298975 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5006d3-c325-4530-b6f6-8034a0021fca admin admin] PATH_INFO: `/v3/projects/0f77cb1c1c064a91a136ff9a18562363` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:39.301253 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5006d3-c325-4530-b6f6-8034a0021fca admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f77cb1c1c064a91a136ff9a18562363)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:39.307294 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5006d3-c325-4530-b6f6-8034a0021fca admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:39.505466 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ea5006d3-c325-4530-b6f6-8034a0021fca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f77cb1c1c064a91a136ff9a18562363', 'request_id': 'req-ea5006d3-c325-4530-b6f6-8034a0021fca'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:39.537286 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ea5006d3-c325-4530-b6f6-8034a0021fca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f77cb1c1c064a91a136ff9a18562363', 'request_id': 'req-ea5006d3-c325-4530-b6f6-8034a0021fca'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:39.554900 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ea5006d3-c325-4530-b6f6-8034a0021fca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f77cb1c1c064a91a136ff9a18562363', 'request_id': 'req-ea5006d3-c325-4530-b6f6-8034a0021fca'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:39.591086 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ea5006d3-c325-4530-b6f6-8034a0021fca admin admin] The token cache is being invalidate because project 0f77cb1c1c064a91a136ff9a18562363 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:39.601661 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ea5006d3-c325-4530-b6f6-8034a0021fca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:39.605962 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ea5006d3-c325-4530-b6f6-8034a0021fca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:39.619178 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2449/4916] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:59:39 2022] DELETE /identity/v3/projects/0f77cb1c1c064a91a136ff9a18562363 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:39.621831 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a291bc-5ab8-4b64-8977-2bb2ca1d447d None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:39.622313 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a291bc-5ab8-4b64-8977-2bb2ca1d447d None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:39.622538 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a291bc-5ab8-4b64-8977-2bb2ca1d447d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:39.683308 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-e9a291bc-5ab8-4b64-8977-2bb2ca1d447d None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:39.685445 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e9a291bc-5ab8-4b64-8977-2bb2ca1d447d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:39.882278 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2468/4917] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:39.882662 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff4daa-d0b0-44e3-ab46-f783a9fe74cd None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:39.882982 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff4daa-d0b0-44e3-ab46-f783a9fe74cd None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:39.883301 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff4daa-d0b0-44e3-ab46-f783a9fe74cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:39.946601 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-0bff4daa-d0b0-44e3-ab46-f783a9fe74cd None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:39.950223 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0bff4daa-d0b0-44e3-ab46-f783a9fe74cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:39.982979 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2450/4918] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:39.989195 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a291bc-5ab8-4b64-8977-2bb2ca1d447d None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:40.010533 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a291bc-5ab8-4b64-8977-2bb2ca1d447d None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:40.022997 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda8c3c-d648-44ff-9bfc-8d2e1d1ad6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:40.025762 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda8c3c-d648-44ff-9bfc-8d2e1d1ad6ea admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:40.026524 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda8c3c-d648-44ff-9bfc-8d2e1d1ad6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:40.028773 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda8c3c-d648-44ff-9bfc-8d2e1d1ad6ea admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:40.029921 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda8c3c-d648-44ff-9bfc-8d2e1d1ad6ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:59:40.030256 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda8c3c-d648-44ff-9bfc-8d2e1d1ad6ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:40.034521 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda8c3c-d648-44ff-9bfc-8d2e1d1ad6ea admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:40.068199 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2469/4919] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:59:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:59:40.073345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff4daa-d0b0-44e3-ab46-f783a9fe74cd None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:40.089761 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff4daa-d0b0-44e3-ab46-f783a9fe74cd None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:40.100778 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f19a11-8cf7-4748-b2a2-4e1bf02fcb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:40.101660 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f19a11-8cf7-4748-b2a2-4e1bf02fcb71 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:40.102658 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f19a11-8cf7-4748-b2a2-4e1bf02fcb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:40.103352 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f19a11-8cf7-4748-b2a2-4e1bf02fcb71 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:40.104385 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f19a11-8cf7-4748-b2a2-4e1bf02fcb71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:40.106068 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f19a11-8cf7-4748-b2a2-4e1bf02fcb71 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:40.156728 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2451/4920] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:59:40 2022] POST /identity/v3/projects => generated 397 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:40.160610 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda8c3c-d648-44ff-9bfc-8d2e1d1ad6ea admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:40.176507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda8c3c-d648-44ff-9bfc-8d2e1d1ad6ea admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:40.213012 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:40.324564 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e3e85-2259-45cc-a0d3-89c87ce52e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:40.328106 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e3e85-2259-45cc-a0d3-89c87ce52e6f admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:40.328534 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e3e85-2259-45cc-a0d3-89c87ce52e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:40.330025 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e3e85-2259-45cc-a0d3-89c87ce52e6f admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:40.330845 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e3e85-2259-45cc-a0d3-89c87ce52e6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:40.336372 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e3e85-2259-45cc-a0d3-89c87ce52e6f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:40.395384 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2470/4921] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:59:40 2022] POST /identity/v3/users => generated 305 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:40.396856 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f19a11-8cf7-4748-b2a2-4e1bf02fcb71 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:40.429301 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f19a11-8cf7-4748-b2a2-4e1bf02fcb71 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:40.443711 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9462551-8e3e-4aef-877b-0cde5148015b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:40.445747 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9462551-8e3e-4aef-877b-0cde5148015b admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:40.446283 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9462551-8e3e-4aef-877b-0cde5148015b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:40.447303 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9462551-8e3e-4aef-877b-0cde5148015b admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:40.449371 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9462551-8e3e-4aef-877b-0cde5148015b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:40.454464 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9462551-8e3e-4aef-877b-0cde5148015b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:40.487658 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2452/4922] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:40 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:40.494837 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e3e85-2259-45cc-a0d3-89c87ce52e6f admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:40.517617 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e3e85-2259-45cc-a0d3-89c87ce52e6f admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:40.523015 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab707e7-8917-4313-93ed-001f1edcce30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:40.523723 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab707e7-8917-4313-93ed-001f1edcce30 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:40.524264 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab707e7-8917-4313-93ed-001f1edcce30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:40.524414 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab707e7-8917-4313-93ed-001f1edcce30 admin admin] PATH_INFO: `/v3/projects/092d11a5c32e49789772cfd33476ba40/users/30241e2ef4134861b3adde208e2618b2/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:40.543386 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab707e7-8917-4313-93ed-001f1edcce30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=092d11a5c32e49789772cfd33476ba40, user_id=30241e2ef4134861b3adde208e2618b2, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:40.546148 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab707e7-8917-4313-93ed-001f1edcce30 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:40.570348 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2471/4923] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:40 2022] PUT /identity/v3/projects/092d11a5c32e49789772cfd33476ba40/users/30241e2ef4134861b3adde208e2618b2/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:40.574331 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9462551-8e3e-4aef-877b-0cde5148015b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:40.590302 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9462551-8e3e-4aef-877b-0cde5148015b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:40.773705 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca212b35-4a37-4d89-9e1c-9696860f78c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:40.774592 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca212b35-4a37-4d89-9e1c-9696860f78c2 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:40.775206 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca212b35-4a37-4d89-9e1c-9696860f78c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:40.775633 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca212b35-4a37-4d89-9e1c-9696860f78c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:40.776462 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca212b35-4a37-4d89-9e1c-9696860f78c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:40.779606 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca212b35-4a37-4d89-9e1c-9696860f78c2 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:40.806288 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2453/4924] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:40 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:40.808774 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab707e7-8917-4313-93ed-001f1edcce30 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:40.821036 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab707e7-8917-4313-93ed-001f1edcce30 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:40.840657 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a444386-1b85-41cb-8a25-87d2f0397fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:40.841853 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a444386-1b85-41cb-8a25-87d2f0397fa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:40.842451 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a444386-1b85-41cb-8a25-87d2f0397fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:40.842932 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a444386-1b85-41cb-8a25-87d2f0397fa8 admin admin] PATH_INFO: `/v3/projects/092d11a5c32e49789772cfd33476ba40/users/30241e2ef4134861b3adde208e2618b2/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:40.845984 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a444386-1b85-41cb-8a25-87d2f0397fa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=092d11a5c32e49789772cfd33476ba40, user_id=30241e2ef4134861b3adde208e2618b2, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:40.852264 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a444386-1b85-41cb-8a25-87d2f0397fa8 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:40.886428 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2472/4925] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:40 2022] PUT /identity/v3/projects/092d11a5c32e49789772cfd33476ba40/users/30241e2ef4134861b3adde208e2618b2/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:59:40.899825 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098e089-1f0d-421a-b709-90f838e01747 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:40.900464 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098e089-1f0d-421a-b709-90f838e01747 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:40.901281 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098e089-1f0d-421a-b709-90f838e01747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:40.947909 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-8098e089-1f0d-421a-b709-90f838e01747 None None] MFA Rules not processed for user `30241e2ef4134861b3adde208e2618b2`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:40.949557 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8098e089-1f0d-421a-b709-90f838e01747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:40.988268 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:41.188660 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2454/4926] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:40 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:41.189825 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a444386-1b85-41cb-8a25-87d2f0397fa8 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:41.396228 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a444386-1b85-41cb-8a25-87d2f0397fa8 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:41.418554 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2da8a-313c-472f-adca-1c81304ef561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:41.419603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2da8a-313c-472f-adca-1c81304ef561 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:41.420081 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2da8a-313c-472f-adca-1c81304ef561 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:41.420479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2da8a-313c-472f-adca-1c81304ef561 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:41.423369 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d2da8a-313c-472f-adca-1c81304ef561 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:41.429091 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d2da8a-313c-472f-adca-1c81304ef561 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:41.485929 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2473/4927] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:59:41 2022] POST /identity/v3/projects => generated 397 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:41.489486 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098e089-1f0d-421a-b709-90f838e01747 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:41.521773 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098e089-1f0d-421a-b709-90f838e01747 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:41.695896 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6723bd4-5e6a-41af-867e-d6780e80ee2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:41.697230 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6723bd4-5e6a-41af-867e-d6780e80ee2a admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:41.697697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6723bd4-5e6a-41af-867e-d6780e80ee2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:41.698269 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6723bd4-5e6a-41af-867e-d6780e80ee2a admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:41.699217 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6723bd4-5e6a-41af-867e-d6780e80ee2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:41.702941 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6723bd4-5e6a-41af-867e-d6780e80ee2a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:41.735672 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2455/4928] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:59:41 2022] POST /identity/v3/users => generated 299 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:41.740419 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2da8a-313c-472f-adca-1c81304ef561 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:41.771598 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2da8a-313c-472f-adca-1c81304ef561 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:41.783914 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c9aa1-42de-4eed-acff-ea297cf10cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:41.784628 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c9aa1-42de-4eed-acff-ea297cf10cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:41.785011 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c9aa1-42de-4eed-acff-ea297cf10cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:41.786128 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c9aa1-42de-4eed-acff-ea297cf10cc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:41.786855 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c9aa1-42de-4eed-acff-ea297cf10cc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:41.788589 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c9aa1-42de-4eed-acff-ea297cf10cc2 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:41.807572 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2474/4929] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:59:41.808899 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6723bd4-5e6a-41af-867e-d6780e80ee2a admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:41.835204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6723bd4-5e6a-41af-867e-d6780e80ee2a admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:41.857092 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c6c17b-9e1f-473a-8382-c05aaf5363e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:41.860736 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6c17b-9e1f-473a-8382-c05aaf5363e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:41.860736 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6c17b-9e1f-473a-8382-c05aaf5363e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:41.861121 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6c17b-9e1f-473a-8382-c05aaf5363e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:41.864694 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c6c17b-9e1f-473a-8382-c05aaf5363e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:41.868351 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c6c17b-9e1f-473a-8382-c05aaf5363e4 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:41.899512 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2456/4930] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:41.901015 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c9aa1-42de-4eed-acff-ea297cf10cc2 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:41.919885 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c9aa1-42de-4eed-acff-ea297cf10cc2 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:41.936015 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a38fb-88c1-4ef3-aee8-2c45fa7698de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:41.936960 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a38fb-88c1-4ef3-aee8-2c45fa7698de admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:41.937541 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a38fb-88c1-4ef3-aee8-2c45fa7698de admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:41.938072 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a38fb-88c1-4ef3-aee8-2c45fa7698de admin admin] PATH_INFO: `/v3/projects/807eb36d2ac548a9a42f90132f4bdeb4/users/8d6017ce80fc4755ae2f9b0553b0154a/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:41.975873 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a38fb-88c1-4ef3-aee8-2c45fa7698de admin admin] RBAC: Authorizing `identity:create_grant(project_id=807eb36d2ac548a9a42f90132f4bdeb4, user_id=8d6017ce80fc4755ae2f9b0553b0154a, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:41.982607 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a38fb-88c1-4ef3-aee8-2c45fa7698de admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:42.033979 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2475/4931] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:41 2022] PUT /identity/v3/projects/807eb36d2ac548a9a42f90132f4bdeb4/users/8d6017ce80fc4755ae2f9b0553b0154a/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:59:42.046329 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b382cd-2d70-43fe-96de-d30410a43f7c None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:42.046759 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b382cd-2d70-43fe-96de-d30410a43f7c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:42.047277 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b382cd-2d70-43fe-96de-d30410a43f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:42.157634 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-b0b382cd-2d70-43fe-96de-d30410a43f7c None None] MFA Rules not processed for user `8d6017ce80fc4755ae2f9b0553b0154a`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:42.163842 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b0b382cd-2d70-43fe-96de-d30410a43f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:42.349255 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2457/4932] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:42 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:42.362403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a38fb-88c1-4ef3-aee8-2c45fa7698de admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:42.365112 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-780a38fb-88c1-4ef3-aee8-2c45fa7698de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:42.453552 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:42.554489 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a38fb-88c1-4ef3-aee8-2c45fa7698de admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:42.565445 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d5bb2-c31f-41e4-90b9-7ddfc2b04e75 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6b0f9835ed549cab91d684326be83fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:42.566354 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d5bb2-c31f-41e4-90b9-7ddfc2b04e75 service glance] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:42.567476 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d5bb2-c31f-41e4-90b9-7ddfc2b04e75 service glance] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:42.567879 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d5bb2-c31f-41e4-90b9-7ddfc2b04e75 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:42.702036 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650d5bb2-c31f-41e4-90b9-7ddfc2b04e75 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:42.710079 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650d5bb2-c31f-41e4-90b9-7ddfc2b04e75 service glance] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:42.737079 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2476/4933] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:59:42 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:59:43.612445 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b382cd-2d70-43fe-96de-d30410a43f7c None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:43.660247 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:43.826523 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b382cd-2d70-43fe-96de-d30410a43f7c None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:43.840741 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30951a41-ddb2-4e6c-9b0f-6db33c5c30ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:43.842705 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30951a41-ddb2-4e6c-9b0f-6db33c5c30ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:43.842705 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30951a41-ddb2-4e6c-9b0f-6db33c5c30ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:43.842705 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30951a41-ddb2-4e6c-9b0f-6db33c5c30ba admin admin] PATH_INFO: `/v3/users/30241e2ef4134861b3adde208e2618b2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:43.843718 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30951a41-ddb2-4e6c-9b0f-6db33c5c30ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=30241e2ef4134861b3adde208e2618b2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:43.849381 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30951a41-ddb2-4e6c-9b0f-6db33c5c30ba admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:43.995610 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-30951a41-ddb2-4e6c-9b0f-6db33c5c30ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30241e2ef4134861b3adde208e2618b2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:43.996850 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-30951a41-ddb2-4e6c-9b0f-6db33c5c30ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30241e2ef4134861b3adde208e2618b2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:44.010716 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-30951a41-ddb2-4e6c-9b0f-6db33c5c30ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30241e2ef4134861b3adde208e2618b2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:44.025374 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-30951a41-ddb2-4e6c-9b0f-6db33c5c30ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30241e2ef4134861b3adde208e2618b2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:44.027853 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-30951a41-ddb2-4e6c-9b0f-6db33c5c30ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30241e2ef4134861b3adde208e2618b2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:44.079601 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2458/4934] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:43 2022] DELETE /identity/v3/users/30241e2ef4134861b3adde208e2618b2 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:44.084127 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09685ba-ae10-467b-b8c5-0ede121fb3f3 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:44.084673 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09685ba-ae10-467b-b8c5-0ede121fb3f3 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:44.084673 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09685ba-ae10-467b-b8c5-0ede121fb3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:44.125433 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-b09685ba-ae10-467b-b8c5-0ede121fb3f3 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:44.125433 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b09685ba-ae10-467b-b8c5-0ede121fb3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:44.314863 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2477/4935] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:44.316441 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30951a41-ddb2-4e6c-9b0f-6db33c5c30ba admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:44.322409 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-30951a41-ddb2-4e6c-9b0f-6db33c5c30ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:44.492110 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30951a41-ddb2-4e6c-9b0f-6db33c5c30ba admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:44.498429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f727a-84e8-4920-81bd-e7c0e73983fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:44.499393 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f727a-84e8-4920-81bd-e7c0e73983fb service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:44.500520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f727a-84e8-4920-81bd-e7c0e73983fb service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:44.503569 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f727a-84e8-4920-81bd-e7c0e73983fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:44.538352 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87f727a-84e8-4920-81bd-e7c0e73983fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:44.541066 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87f727a-84e8-4920-81bd-e7c0e73983fb service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:44.590674 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2459/4936] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:59:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:59:45.221765 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09685ba-ae10-467b-b8c5-0ede121fb3f3 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:45.223406 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b09685ba-ae10-467b-b8c5-0ede121fb3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:45.247066 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09685ba-ae10-467b-b8c5-0ede121fb3f3 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:45.258018 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bcc6cd-80ca-4ba9-a4e5-6b621c558f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:45.258677 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bcc6cd-80ca-4ba9-a4e5-6b621c558f4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:45.258958 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bcc6cd-80ca-4ba9-a4e5-6b621c558f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:45.259261 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bcc6cd-80ca-4ba9-a4e5-6b621c558f4e admin admin] PATH_INFO: `/v3/projects/092d11a5c32e49789772cfd33476ba40` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:45.263833 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bcc6cd-80ca-4ba9-a4e5-6b621c558f4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=092d11a5c32e49789772cfd33476ba40)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:45.272746 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bcc6cd-80ca-4ba9-a4e5-6b621c558f4e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:45.439960 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-48bcc6cd-80ca-4ba9-a4e5-6b621c558f4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '092d11a5c32e49789772cfd33476ba40', 'request_id': 'req-48bcc6cd-80ca-4ba9-a4e5-6b621c558f4e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:45.466472 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-48bcc6cd-80ca-4ba9-a4e5-6b621c558f4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '092d11a5c32e49789772cfd33476ba40', 'request_id': 'req-48bcc6cd-80ca-4ba9-a4e5-6b621c558f4e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:45.475722 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:45.479707 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-48bcc6cd-80ca-4ba9-a4e5-6b621c558f4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '092d11a5c32e49789772cfd33476ba40', 'request_id': 'req-48bcc6cd-80ca-4ba9-a4e5-6b621c558f4e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:45.505455 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-48bcc6cd-80ca-4ba9-a4e5-6b621c558f4e admin admin] The token cache is being invalidate because project 092d11a5c32e49789772cfd33476ba40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:45.506402 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-48bcc6cd-80ca-4ba9-a4e5-6b621c558f4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:45.508841 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-48bcc6cd-80ca-4ba9-a4e5-6b621c558f4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:45.513952 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2478/4937] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:59:45 2022] DELETE /identity/v3/projects/092d11a5c32e49789772cfd33476ba40 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:45.520846 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f727a-84e8-4920-81bd-e7c0e73983fb service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:45.545271 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f727a-84e8-4920-81bd-e7c0e73983fb service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:45.756578 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:45.817273 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e9d845-0a93-4d15-8b48-e5a9946292e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:45.818604 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9d845-0a93-4d15-8b48-e5a9946292e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:45.819977 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9d845-0a93-4d15-8b48-e5a9946292e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:45.821714 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9d845-0a93-4d15-8b48-e5a9946292e4 admin admin] PATH_INFO: `/v3/users/8d6017ce80fc4755ae2f9b0553b0154a` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:45.829983 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e9d845-0a93-4d15-8b48-e5a9946292e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d6017ce80fc4755ae2f9b0553b0154a)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:45.836370 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e9d845-0a93-4d15-8b48-e5a9946292e4 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:45.972708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a0e9d845-0a93-4d15-8b48-e5a9946292e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d6017ce80fc4755ae2f9b0553b0154a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:45.973464 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a0e9d845-0a93-4d15-8b48-e5a9946292e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d6017ce80fc4755ae2f9b0553b0154a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:45.984678 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a0e9d845-0a93-4d15-8b48-e5a9946292e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d6017ce80fc4755ae2f9b0553b0154a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:45.997694 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a0e9d845-0a93-4d15-8b48-e5a9946292e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d6017ce80fc4755ae2f9b0553b0154a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:45.998809 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a0e9d845-0a93-4d15-8b48-e5a9946292e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d6017ce80fc4755ae2f9b0553b0154a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:46.030898 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2460/4938] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:45 2022] DELETE /identity/v3/users/8d6017ce80fc4755ae2f9b0553b0154a => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:46.630590 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bcc6cd-80ca-4ba9-a4e5-6b621c558f4e admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:46.637902 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-48bcc6cd-80ca-4ba9-a4e5-6b621c558f4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:46.670478 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bcc6cd-80ca-4ba9-a4e5-6b621c558f4e admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:46.826184 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e4ae5b-b0be-4c24-a550-f874232282c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:46.826643 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4ae5b-b0be-4c24-a550-f874232282c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:46.826996 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4ae5b-b0be-4c24-a550-f874232282c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:46.827596 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4ae5b-b0be-4c24-a550-f874232282c6 admin admin] PATH_INFO: `/v3/projects/807eb36d2ac548a9a42f90132f4bdeb4` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:46.829076 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e4ae5b-b0be-4c24-a550-f874232282c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=807eb36d2ac548a9a42f90132f4bdeb4)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:46.840945 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e4ae5b-b0be-4c24-a550-f874232282c6 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:46.965672 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-59e4ae5b-b0be-4c24-a550-f874232282c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '807eb36d2ac548a9a42f90132f4bdeb4', 'request_id': 'req-59e4ae5b-b0be-4c24-a550-f874232282c6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:46.977032 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-59e4ae5b-b0be-4c24-a550-f874232282c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '807eb36d2ac548a9a42f90132f4bdeb4', 'request_id': 'req-59e4ae5b-b0be-4c24-a550-f874232282c6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:47.004817 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-59e4ae5b-b0be-4c24-a550-f874232282c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '807eb36d2ac548a9a42f90132f4bdeb4', 'request_id': 'req-59e4ae5b-b0be-4c24-a550-f874232282c6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:47.019797 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-59e4ae5b-b0be-4c24-a550-f874232282c6 admin admin] The token cache is being invalidate because project 807eb36d2ac548a9a42f90132f4bdeb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:47.021819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-59e4ae5b-b0be-4c24-a550-f874232282c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:47.022710 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-59e4ae5b-b0be-4c24-a550-f874232282c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:47.029204 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2479/4939] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:59:46 2022] DELETE /identity/v3/projects/807eb36d2ac548a9a42f90132f4bdeb4 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:47.030694 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd4add-4f87-4777-808e-2aa08b723ec2 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:47.031319 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd4add-4f87-4777-808e-2aa08b723ec2 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:47.031418 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd4add-4f87-4777-808e-2aa08b723ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:47.079456 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-52dd4add-4f87-4777-808e-2aa08b723ec2 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:47.080589 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-52dd4add-4f87-4777-808e-2aa08b723ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:47.193989 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2461/4940] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:59:47.297509 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46e755-45c6-493a-a3a9-72e6e9d2929a None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:47.297952 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46e755-45c6-493a-a3a9-72e6e9d2929a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:47.298325 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46e755-45c6-493a-a3a9-72e6e9d2929a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:47.333314 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-cc46e755-45c6-493a-a3a9-72e6e9d2929a None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:47.334588 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-cc46e755-45c6-493a-a3a9-72e6e9d2929a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:47.364503 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2480/4941] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:47.369624 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd4add-4f87-4777-808e-2aa08b723ec2 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:47.382156 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd4add-4f87-4777-808e-2aa08b723ec2 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:47.389186 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d300e-2587-4d4f-9f51-67a18f3db790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:47.389966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d300e-2587-4d4f-9f51-67a18f3db790 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:47.392055 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d300e-2587-4d4f-9f51-67a18f3db790 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:47.392447 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d300e-2587-4d4f-9f51-67a18f3db790 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:47.393318 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d300e-2587-4d4f-9f51-67a18f3db790 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:59:47.393994 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d300e-2587-4d4f-9f51-67a18f3db790 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:47.396965 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d300e-2587-4d4f-9f51-67a18f3db790 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:47.421827 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2462/4942] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:59:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:59:47.423325 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46e755-45c6-493a-a3a9-72e6e9d2929a None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:47.440989 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46e755-45c6-493a-a3a9-72e6e9d2929a None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:47.447508 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5064bb5-9534-499e-a6a7-d2509187cbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:47.448581 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5064bb5-9534-499e-a6a7-d2509187cbe6 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:47.449073 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5064bb5-9534-499e-a6a7-d2509187cbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:47.449554 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5064bb5-9534-499e-a6a7-d2509187cbe6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:47.450418 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5064bb5-9534-499e-a6a7-d2509187cbe6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:47.452611 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5064bb5-9534-499e-a6a7-d2509187cbe6 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:47.498298 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d300e-2587-4d4f-9f51-67a18f3db790 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:47.500240 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2481/4943] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:59:47 2022] POST /identity/v3/projects => generated 373 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:47.515066 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d300e-2587-4d4f-9f51-67a18f3db790 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:47.604328 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:47.625312 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3fc791-9d42-43b5-b43a-0b341fb0055d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:47.632289 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fc791-9d42-43b5-b43a-0b341fb0055d admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:47.635450 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fc791-9d42-43b5-b43a-0b341fb0055d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:47.636020 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fc791-9d42-43b5-b43a-0b341fb0055d admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:47.637262 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3fc791-9d42-43b5-b43a-0b341fb0055d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:47.643319 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3fc791-9d42-43b5-b43a-0b341fb0055d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:47.703177 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5064bb5-9534-499e-a6a7-d2509187cbe6 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:47.723955 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2463/4944] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:59:47 2022] POST /identity/v3/users => generated 287 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:47.730830 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5064bb5-9534-499e-a6a7-d2509187cbe6 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:47.735959 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b328b22-63a0-4017-826f-6676ceb9d2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:47.739616 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b328b22-63a0-4017-826f-6676ceb9d2b7 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:47.740191 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b328b22-63a0-4017-826f-6676ceb9d2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:47.740670 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b328b22-63a0-4017-826f-6676ceb9d2b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:47.741431 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b328b22-63a0-4017-826f-6676ceb9d2b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:47.743165 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b328b22-63a0-4017-826f-6676ceb9d2b7 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:47.759419 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2482/4945] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:47 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:47.765411 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3fc791-9d42-43b5-b43a-0b341fb0055d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:47.801165 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3fc791-9d42-43b5-b43a-0b341fb0055d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:47.812809 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f57ad-18f4-455b-820a-bd0ec26a262d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:47.813814 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f57ad-18f4-455b-820a-bd0ec26a262d admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:47.814089 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f57ad-18f4-455b-820a-bd0ec26a262d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:47.814377 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f57ad-18f4-455b-820a-bd0ec26a262d admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:47.815456 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f57ad-18f4-455b-820a-bd0ec26a262d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:47.817792 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f57ad-18f4-455b-820a-bd0ec26a262d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:47.832608 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2464/4946] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:47 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:47.836991 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b328b22-63a0-4017-826f-6676ceb9d2b7 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:47.850510 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b328b22-63a0-4017-826f-6676ceb9d2b7 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:47.867446 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a570da-71df-47ff-8703-7076b90a4b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:47.868619 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a570da-71df-47ff-8703-7076b90a4b75 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:47.869267 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a570da-71df-47ff-8703-7076b90a4b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:47.869690 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a570da-71df-47ff-8703-7076b90a4b75 admin admin] PATH_INFO: `/v3/projects/e699b1cdcc51497da334983f84d624f2/users/cb19e91a38384cec80fae9ab170c78a3/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:47.917326 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a570da-71df-47ff-8703-7076b90a4b75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e699b1cdcc51497da334983f84d624f2, user_id=cb19e91a38384cec80fae9ab170c78a3, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:47.924737 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a570da-71df-47ff-8703-7076b90a4b75 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:47.976226 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2483/4947] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:47 2022] PUT /identity/v3/projects/e699b1cdcc51497da334983f84d624f2/users/cb19e91a38384cec80fae9ab170c78a3/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:47.979693 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7874b1bd-0064-48ff-bd02-78675256db48 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:47.979928 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7874b1bd-0064-48ff-bd02-78675256db48 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:47.980191 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7874b1bd-0064-48ff-bd02-78675256db48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:48.025833 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-7874b1bd-0064-48ff-bd02-78675256db48 None None] MFA Rules not processed for user `cb19e91a38384cec80fae9ab170c78a3`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:48.028192 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7874b1bd-0064-48ff-bd02-78675256db48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:48.157386 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2465/4948] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:48.179875 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a570da-71df-47ff-8703-7076b90a4b75 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:48.181701 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-13a570da-71df-47ff-8703-7076b90a4b75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:48.223270 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:48.350094 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a570da-71df-47ff-8703-7076b90a4b75 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:48.364316 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa35dbe-1b0b-4f5f-8c79-21123c5b48f3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6b0f9835ed549cab91d684326be83fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:48.366190 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa35dbe-1b0b-4f5f-8c79-21123c5b48f3 service glance] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:48.366453 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa35dbe-1b0b-4f5f-8c79-21123c5b48f3 service glance] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:48.366731 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa35dbe-1b0b-4f5f-8c79-21123c5b48f3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:48.401968 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa35dbe-1b0b-4f5f-8c79-21123c5b48f3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:48.404979 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa35dbe-1b0b-4f5f-8c79-21123c5b48f3 service glance] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:48.433876 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2484/4949] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:59:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:59:48.508170 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7874b1bd-0064-48ff-bd02-78675256db48 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:48.509847 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7874b1bd-0064-48ff-bd02-78675256db48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:48.709666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c64fe-ea62-458c-85a7-14decf00944c None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:48.710113 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c64fe-ea62-458c-85a7-14decf00944c None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:48.710113 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c64fe-ea62-458c-85a7-14decf00944c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:48.739277 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7874b1bd-0064-48ff-bd02-78675256db48 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:48.748474 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a675b942-1131-4765-91d1-92f6f3eeca02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:48.750197 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675b942-1131-4765-91d1-92f6f3eeca02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:48.751450 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675b942-1131-4765-91d1-92f6f3eeca02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:48.752585 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675b942-1131-4765-91d1-92f6f3eeca02 admin admin] PATH_INFO: `/v3/users/7e0455fa5b3b44c585787f6c5477b1c5` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:48.756204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a675b942-1131-4765-91d1-92f6f3eeca02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e0455fa5b3b44c585787f6c5477b1c5)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:48.760774 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a675b942-1131-4765-91d1-92f6f3eeca02 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:48.826732 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-489c64fe-ea62-458c-85a7-14decf00944c None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:48.829351 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-489c64fe-ea62-458c-85a7-14decf00944c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:48.865821 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a675b942-1131-4765-91d1-92f6f3eeca02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e0455fa5b3b44c585787f6c5477b1c5'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:48.866945 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a675b942-1131-4765-91d1-92f6f3eeca02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e0455fa5b3b44c585787f6c5477b1c5'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:48.881439 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a675b942-1131-4765-91d1-92f6f3eeca02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e0455fa5b3b44c585787f6c5477b1c5'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:48.896486 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a675b942-1131-4765-91d1-92f6f3eeca02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e0455fa5b3b44c585787f6c5477b1c5'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:48.897459 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a675b942-1131-4765-91d1-92f6f3eeca02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e0455fa5b3b44c585787f6c5477b1c5'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:48.900478 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:48.930742 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2466/4950] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:48 2022] DELETE /identity/v3/users/7e0455fa5b3b44c585787f6c5477b1c5 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:48.936219 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec2dfe-0920-4cfb-a2af-efda7eb443bb None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:48.936850 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec2dfe-0920-4cfb-a2af-efda7eb443bb None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:48.937555 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec2dfe-0920-4cfb-a2af-efda7eb443bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:49.008219 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-34ec2dfe-0920-4cfb-a2af-efda7eb443bb None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:49.012705 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-34ec2dfe-0920-4cfb-a2af-efda7eb443bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:49.029794 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2485/4951] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 15:59:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:49.139878 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c64fe-ea62-458c-85a7-14decf00944c None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:49.142408 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-489c64fe-ea62-458c-85a7-14decf00944c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:49.243469 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2467/4952] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:59:49.274112 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec2dfe-0920-4cfb-a2af-efda7eb443bb None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:49.275941 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-34ec2dfe-0920-4cfb-a2af-efda7eb443bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:49.422399 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c64fe-ea62-458c-85a7-14decf00944c None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:49.438821 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:49.446942 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec2dfe-0920-4cfb-a2af-efda7eb443bb None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:49.455069 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923ff59-baed-495e-b365-cd33df2f7740 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:49.455634 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923ff59-baed-495e-b365-cd33df2f7740 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:49.456108 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923ff59-baed-495e-b365-cd33df2f7740 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:49.456663 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923ff59-baed-495e-b365-cd33df2f7740 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:49.470655 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923ff59-baed-495e-b365-cd33df2f7740 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:49.472123 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923ff59-baed-495e-b365-cd33df2f7740 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:49.488524 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2468/4953] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:59:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:59:49.567639 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f58f2-5128-4822-b414-7e366dd61ef2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:49.569764 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f58f2-5128-4822-b414-7e366dd61ef2 service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:49.572179 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f58f2-5128-4822-b414-7e366dd61ef2 service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:49.572708 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f58f2-5128-4822-b414-7e366dd61ef2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:49.720367 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f58f2-5128-4822-b414-7e366dd61ef2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:49.722001 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f58f2-5128-4822-b414-7e366dd61ef2 service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:49.755401 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2486/4954] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 15:59:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 612 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 15:59:50.343615 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923ff59-baed-495e-b365-cd33df2f7740 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:50.345174 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0923ff59-baed-495e-b365-cd33df2f7740 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:50.373184 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda859e-2de2-4d36-92d6-35aea0ef2a0d None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:50.373474 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda859e-2de2-4d36-92d6-35aea0ef2a0d None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:50.374392 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda859e-2de2-4d36-92d6-35aea0ef2a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:50.398153 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923ff59-baed-495e-b365-cd33df2f7740 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:50.404784 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-5cda859e-2de2-4d36-92d6-35aea0ef2a0d None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:50.406399 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5cda859e-2de2-4d36-92d6-35aea0ef2a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:50.414815 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b87ea-5b71-4bac-b6e5-225ed8ab098d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:50.415936 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b87ea-5b71-4bac-b6e5-225ed8ab098d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:50.417342 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b87ea-5b71-4bac-b6e5-225ed8ab098d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:50.418360 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b87ea-5b71-4bac-b6e5-225ed8ab098d admin admin] PATH_INFO: `/v3/projects/aba3f4aa1ff546f49fa31ae9114e1716` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:50.423298 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b87ea-5b71-4bac-b6e5-225ed8ab098d admin admin] RBAC: Authorizing `identity:delete_project(project_id=aba3f4aa1ff546f49fa31ae9114e1716)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:50.427730 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2487/4955] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 15:59:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:59:50.429466 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b87ea-5b71-4bac-b6e5-225ed8ab098d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:50.447719 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda859e-2de2-4d36-92d6-35aea0ef2a0d None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:50.485624 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda859e-2de2-4d36-92d6-35aea0ef2a0d None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:50.505626 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99fe89-4da7-43e8-967b-b8e6ef064107 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:50.506087 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99fe89-4da7-43e8-967b-b8e6ef064107 service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:50.507279 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99fe89-4da7-43e8-967b-b8e6ef064107 service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:50.510294 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99fe89-4da7-43e8-967b-b8e6ef064107 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:50.554483 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab99fe89-4da7-43e8-967b-b8e6ef064107 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:50.559744 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab99fe89-4da7-43e8-967b-b8e6ef064107 service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:50.593453 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2488/4956] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 15:59:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 15:59:50.633895 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-cd7b87ea-5b71-4bac-b6e5-225ed8ab098d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aba3f4aa1ff546f49fa31ae9114e1716', 'request_id': 'req-cd7b87ea-5b71-4bac-b6e5-225ed8ab098d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:50.655536 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-cd7b87ea-5b71-4bac-b6e5-225ed8ab098d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aba3f4aa1ff546f49fa31ae9114e1716', 'request_id': 'req-cd7b87ea-5b71-4bac-b6e5-225ed8ab098d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:50.666162 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-cd7b87ea-5b71-4bac-b6e5-225ed8ab098d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aba3f4aa1ff546f49fa31ae9114e1716', 'request_id': 'req-cd7b87ea-5b71-4bac-b6e5-225ed8ab098d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:50.695709 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-cd7b87ea-5b71-4bac-b6e5-225ed8ab098d admin admin] The token cache is being invalidate because project aba3f4aa1ff546f49fa31ae9114e1716 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:50.696126 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-cd7b87ea-5b71-4bac-b6e5-225ed8ab098d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:50.697471 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-cd7b87ea-5b71-4bac-b6e5-225ed8ab098d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:50.712781 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2469/4957] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:59:50 2022] DELETE /identity/v3/projects/aba3f4aa1ff546f49fa31ae9114e1716 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:50.713508 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99fe89-4da7-43e8-967b-b8e6ef064107 service swift] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:50.730226 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99fe89-4da7-43e8-967b-b8e6ef064107 service swift] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:50.838642 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0548b41-0947-4740-960e-5b9dc43d31a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:50.839523 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0548b41-0947-4740-960e-5b9dc43d31a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:50.839908 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0548b41-0947-4740-960e-5b9dc43d31a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:50.840270 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0548b41-0947-4740-960e-5b9dc43d31a3 admin admin] PATH_INFO: `/v3/users/68297aad87834cd19359e69c5a6ab5fe` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:50.841721 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0548b41-0947-4740-960e-5b9dc43d31a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68297aad87834cd19359e69c5a6ab5fe)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:50.844420 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0548b41-0947-4740-960e-5b9dc43d31a3 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:50.933172 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:50.968617 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b0548b41-0947-4740-960e-5b9dc43d31a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68297aad87834cd19359e69c5a6ab5fe'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:50.971155 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b0548b41-0947-4740-960e-5b9dc43d31a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68297aad87834cd19359e69c5a6ab5fe'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:50.989989 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b0548b41-0947-4740-960e-5b9dc43d31a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68297aad87834cd19359e69c5a6ab5fe'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:50.999607 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b0548b41-0947-4740-960e-5b9dc43d31a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68297aad87834cd19359e69c5a6ab5fe'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:51.018860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b0548b41-0947-4740-960e-5b9dc43d31a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68297aad87834cd19359e69c5a6ab5fe'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:51.029887 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2489/4958] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:50 2022] DELETE /identity/v3/users/68297aad87834cd19359e69c5a6ab5fe => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:51.102576 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8e023-dac7-4aef-a56e-93fd3855bd9d None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:51.103410 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8e023-dac7-4aef-a56e-93fd3855bd9d None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:51.103867 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8e023-dac7-4aef-a56e-93fd3855bd9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:51.146839 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:51.165851 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-b6d8e023-dac7-4aef-a56e-93fd3855bd9d None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:51.171366 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b6d8e023-dac7-4aef-a56e-93fd3855bd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:51.289882 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2470/4959] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 15:59:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:51.304021 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0548b41-0947-4740-960e-5b9dc43d31a3 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:51.306353 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b0548b41-0947-4740-960e-5b9dc43d31a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:51.415059 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0548b41-0947-4740-960e-5b9dc43d31a3 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:51.423227 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd7cb8f-c185-4234-aed1-faacf5f4b608 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:51.423985 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7cb8f-c185-4234-aed1-faacf5f4b608 service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:51.424386 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7cb8f-c185-4234-aed1-faacf5f4b608 service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:51.424765 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7cb8f-c185-4234-aed1-faacf5f4b608 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:51.437242 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd7cb8f-c185-4234-aed1-faacf5f4b608 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:51.453933 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd7cb8f-c185-4234-aed1-faacf5f4b608 service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:51.471183 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2490/4960] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 15:59:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 15:59:51.879733 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8e023-dac7-4aef-a56e-93fd3855bd9d None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:51.883972 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b6d8e023-dac7-4aef-a56e-93fd3855bd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:52.081069 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df00bbf-41fb-4ade-9695-14ee1b68e4d5 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:52.081069 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df00bbf-41fb-4ade-9695-14ee1b68e4d5 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:52.081623 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df00bbf-41fb-4ade-9695-14ee1b68e4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:52.106110 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8e023-dac7-4aef-a56e-93fd3855bd9d None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:52.107381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-8df00bbf-41fb-4ade-9695-14ee1b68e4d5 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:52.108851 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8df00bbf-41fb-4ade-9695-14ee1b68e4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:52.111986 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6972eda7-3624-44d4-a453-7ca98b67463a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:52.112757 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972eda7-3624-44d4-a453-7ca98b67463a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:52.113357 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972eda7-3624-44d4-a453-7ca98b67463a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:52.113722 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972eda7-3624-44d4-a453-7ca98b67463a admin admin] PATH_INFO: `/v3/projects/36f4b2db20a34c558b0b9dbcfd6b1160` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:52.115472 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6972eda7-3624-44d4-a453-7ca98b67463a admin admin] RBAC: Authorizing `identity:delete_project(project_id=36f4b2db20a34c558b0b9dbcfd6b1160)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:52.117882 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6972eda7-3624-44d4-a453-7ca98b67463a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:52.118678 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2491/4961] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 15:59:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:59:52.133261 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df00bbf-41fb-4ade-9695-14ee1b68e4d5 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:52.152803 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df00bbf-41fb-4ade-9695-14ee1b68e4d5 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:52.162500 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f185040-e637-43d8-bea6-22748a1a5b83 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:52.163228 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f185040-e637-43d8-bea6-22748a1a5b83 service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:52.163504 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f185040-e637-43d8-bea6-22748a1a5b83 service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:52.163774 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f185040-e637-43d8-bea6-22748a1a5b83 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:52.178687 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f185040-e637-43d8-bea6-22748a1a5b83 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:52.180595 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f185040-e637-43d8-bea6-22748a1a5b83 service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:52.194749 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2492/4962] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 15:59:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 15:59:52.201175 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6972eda7-3624-44d4-a453-7ca98b67463a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36f4b2db20a34c558b0b9dbcfd6b1160', 'request_id': 'req-6972eda7-3624-44d4-a453-7ca98b67463a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:52.208306 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6972eda7-3624-44d4-a453-7ca98b67463a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36f4b2db20a34c558b0b9dbcfd6b1160', 'request_id': 'req-6972eda7-3624-44d4-a453-7ca98b67463a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:52.220813 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6972eda7-3624-44d4-a453-7ca98b67463a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36f4b2db20a34c558b0b9dbcfd6b1160', 'request_id': 'req-6972eda7-3624-44d4-a453-7ca98b67463a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:52.248286 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6972eda7-3624-44d4-a453-7ca98b67463a admin admin] The token cache is being invalidate because project 36f4b2db20a34c558b0b9dbcfd6b1160 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:52.248830 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6972eda7-3624-44d4-a453-7ca98b67463a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:52.250426 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6972eda7-3624-44d4-a453-7ca98b67463a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:52.253217 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2471/4963] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:59:51 2022] DELETE /identity/v3/projects/36f4b2db20a34c558b0b9dbcfd6b1160 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:52.259901 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485c7a8-be0b-4c68-b8d0-a563a243e00a None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:52.260216 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485c7a8-be0b-4c68-b8d0-a563a243e00a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:52.260495 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485c7a8-be0b-4c68-b8d0-a563a243e00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:52.331523 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-f485c7a8-be0b-4c68-b8d0-a563a243e00a None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:52.336064 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f485c7a8-be0b-4c68-b8d0-a563a243e00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:52.472009 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2493/4964] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:52.480889 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9920b1-7d60-4059-961a-94e123e4a27d None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:52.481655 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9920b1-7d60-4059-961a-94e123e4a27d None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:52.482961 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9920b1-7d60-4059-961a-94e123e4a27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:52.528920 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-fa9920b1-7d60-4059-961a-94e123e4a27d None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:52.529737 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-fa9920b1-7d60-4059-961a-94e123e4a27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:52.553161 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485c7a8-be0b-4c68-b8d0-a563a243e00a None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:52.553414 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2472/4965] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:52.575631 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485c7a8-be0b-4c68-b8d0-a563a243e00a None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:52.592726 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f53589-9209-416f-af2c-a2d0f4fcae8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:52.593575 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f53589-9209-416f-af2c-a2d0f4fcae8e admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:52.593715 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f53589-9209-416f-af2c-a2d0f4fcae8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:52.593980 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f53589-9209-416f-af2c-a2d0f4fcae8e admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:52.598137 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f53589-9209-416f-af2c-a2d0f4fcae8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:59:52.598528 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f53589-9209-416f-af2c-a2d0f4fcae8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:52.601200 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f53589-9209-416f-af2c-a2d0f4fcae8e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:52.634740 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2494/4966] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:59:52.635887 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9920b1-7d60-4059-961a-94e123e4a27d None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:52.651148 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9920b1-7d60-4059-961a-94e123e4a27d None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:52.671732 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b47fab-aaac-4ef1-a852-c2994772a4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:52.672598 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b47fab-aaac-4ef1-a852-c2994772a4b8 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:52.673766 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b47fab-aaac-4ef1-a852-c2994772a4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:52.674165 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b47fab-aaac-4ef1-a852-c2994772a4b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:52.674897 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b47fab-aaac-4ef1-a852-c2994772a4b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:52.677850 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b47fab-aaac-4ef1-a852-c2994772a4b8 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:52.722744 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102eddf-bf93-43b0-bfcf-ac35fb15a64e None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:52.723205 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102eddf-bf93-43b0-bfcf-ac35fb15a64e None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:52.723346 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102eddf-bf93-43b0-bfcf-ac35fb15a64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:52.760047 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2473/4967] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:59:52 2022] POST /identity/v3/projects => generated 379 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:52.761079 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b47fab-aaac-4ef1-a852-c2994772a4b8 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:52.772281 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-d102eddf-bf93-43b0-bfcf-ac35fb15a64e None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:52.774426 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d102eddf-bf93-43b0-bfcf-ac35fb15a64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:52.786943 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:52.791614 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:52.903542 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b47fab-aaac-4ef1-a852-c2994772a4b8 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:52.916697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102840b-4cf5-4a46-aefc-9f37f4d7536d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:52.918383 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102840b-4cf5-4a46-aefc-9f37f4d7536d admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:52.918867 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102840b-4cf5-4a46-aefc-9f37f4d7536d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:52.919361 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102840b-4cf5-4a46-aefc-9f37f4d7536d admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:52.920286 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b102840b-4cf5-4a46-aefc-9f37f4d7536d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:52.921131 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2495/4968] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 15:59:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:59:52.931202 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b102840b-4cf5-4a46-aefc-9f37f4d7536d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:52.936607 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102eddf-bf93-43b0-bfcf-ac35fb15a64e None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:52.938046 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d102eddf-bf93-43b0-bfcf-ac35fb15a64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:52.960572 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2474/4969] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:59:52 2022] POST /identity/v3/users => generated 290 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:59:52.964019 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102840b-4cf5-4a46-aefc-9f37f4d7536d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:52.984184 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102840b-4cf5-4a46-aefc-9f37f4d7536d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:53.001673 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ce8da-e7fb-4a69-89b5-638c0f3e7871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:53.006982 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ce8da-e7fb-4a69-89b5-638c0f3e7871 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:53.009112 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ce8da-e7fb-4a69-89b5-638c0f3e7871 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:53.011050 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ce8da-e7fb-4a69-89b5-638c0f3e7871 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:53.019363 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278ce8da-e7fb-4a69-89b5-638c0f3e7871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:53.024569 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278ce8da-e7fb-4a69-89b5-638c0f3e7871 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:53.057783 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2475/4970] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:52 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:53.072071 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ce8da-e7fb-4a69-89b5-638c0f3e7871 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:53.126355 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ce8da-e7fb-4a69-89b5-638c0f3e7871 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:53.141531 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64178127-97fb-4a75-b1f4-ab79f296dbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:53.142167 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64178127-97fb-4a75-b1f4-ab79f296dbcc admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:53.142789 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64178127-97fb-4a75-b1f4-ab79f296dbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:53.148381 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64178127-97fb-4a75-b1f4-ab79f296dbcc admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:53.149207 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64178127-97fb-4a75-b1f4-ab79f296dbcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:53.150860 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64178127-97fb-4a75-b1f4-ab79f296dbcc admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:53.165677 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102eddf-bf93-43b0-bfcf-ac35fb15a64e None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:53.171452 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2476/4971] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:53.175438 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64178127-97fb-4a75-b1f4-ab79f296dbcc admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:53.181619 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba5ce5-5369-42cb-a339-0d663177a1ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:53.182521 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba5ce5-5369-42cb-a339-0d663177a1ae service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:53.183010 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba5ce5-5369-42cb-a339-0d663177a1ae service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:53.183619 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba5ce5-5369-42cb-a339-0d663177a1ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:53.200577 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64178127-97fb-4a75-b1f4-ab79f296dbcc admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:53.205638 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6ffb9-4e7c-4490-80f0-4828c3041c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:53.206325 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6ffb9-4e7c-4490-80f0-4828c3041c5c admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:53.207787 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6ffb9-4e7c-4490-80f0-4828c3041c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:53.208110 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6ffb9-4e7c-4490-80f0-4828c3041c5c admin admin] PATH_INFO: `/v3/projects/257a58993141492f9b19c5257f3bc315/users/c1644cc2e23b4ffbbffcd7547c2052a1/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:53.222006 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba5ce5-5369-42cb-a339-0d663177a1ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:53.224973 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba5ce5-5369-42cb-a339-0d663177a1ae service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:53.225701 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef6ffb9-4e7c-4490-80f0-4828c3041c5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=257a58993141492f9b19c5257f3bc315, user_id=c1644cc2e23b4ffbbffcd7547c2052a1, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:53.229425 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef6ffb9-4e7c-4490-80f0-4828c3041c5c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:53.247495 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2496/4972] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 15:59:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:59:53.269143 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2477/4973] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:53 2022] PUT /identity/v3/projects/257a58993141492f9b19c5257f3bc315/users/c1644cc2e23b4ffbbffcd7547c2052a1/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:53.283418 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcaf1c-3e33-4cbb-95c6-7af28a04ba8c None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:53.284310 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcaf1c-3e33-4cbb-95c6-7af28a04ba8c None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:53.285277 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcaf1c-3e33-4cbb-95c6-7af28a04ba8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:53.338360 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-e5bcaf1c-3e33-4cbb-95c6-7af28a04ba8c None None] MFA Rules not processed for user `c1644cc2e23b4ffbbffcd7547c2052a1`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:53.339700 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e5bcaf1c-3e33-4cbb-95c6-7af28a04ba8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:53.486214 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2497/4974] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:53.491512 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6ffb9-4e7c-4490-80f0-4828c3041c5c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:53.703193 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6ffb9-4e7c-4490-80f0-4828c3041c5c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:53.733771 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d6472-67f3-4511-a982-d60de0ece0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:53.734652 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d6472-67f3-4511-a982-d60de0ece0bb admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:53.734921 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d6472-67f3-4511-a982-d60de0ece0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:53.735383 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d6472-67f3-4511-a982-d60de0ece0bb admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:53.739005 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d6472-67f3-4511-a982-d60de0ece0bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:53.743314 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d6472-67f3-4511-a982-d60de0ece0bb admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:53.756276 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb3ce8-58e6-4ecc-87e9-dcba374c94dd None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:53.756559 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb3ce8-58e6-4ecc-87e9-dcba374c94dd None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:53.756899 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb3ce8-58e6-4ecc-87e9-dcba374c94dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:53.806316 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-dfcb3ce8-58e6-4ecc-87e9-dcba374c94dd None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:53.816793 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-dfcb3ce8-58e6-4ecc-87e9-dcba374c94dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:53.837686 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2478/4975] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:59:53 2022] POST /identity/v3/projects => generated 377 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:59:53.838671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d6472-67f3-4511-a982-d60de0ece0bb admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:53.931632 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:53.948527 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:53.981925 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2498/4976] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 15:59:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:54.008282 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d6472-67f3-4511-a982-d60de0ece0bb admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:54.015718 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcb3ce8-58e6-4ecc-87e9-dcba374c94dd None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:54.026300 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245bd0b6-bdd6-4711-9a81-500e8ba35ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:54.026937 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245bd0b6-bdd6-4711-9a81-500e8ba35ef7 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:54.032525 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245bd0b6-bdd6-4711-9a81-500e8ba35ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:54.033101 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245bd0b6-bdd6-4711-9a81-500e8ba35ef7 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:54.033487 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245bd0b6-bdd6-4711-9a81-500e8ba35ef7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:54.040813 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245bd0b6-bdd6-4711-9a81-500e8ba35ef7 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:54.099207 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2479/4977] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:59:53 2022] POST /identity/v3/users => generated 295 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:54.102791 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245bd0b6-bdd6-4711-9a81-500e8ba35ef7 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:54.130425 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245bd0b6-bdd6-4711-9a81-500e8ba35ef7 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:54.139341 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae2efc-efe4-401b-ac5b-af55604a554c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:54.139972 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae2efc-efe4-401b-ac5b-af55604a554c admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:54.140253 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae2efc-efe4-401b-ac5b-af55604a554c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:54.140523 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae2efc-efe4-401b-ac5b-af55604a554c admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:54.141179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae2efc-efe4-401b-ac5b-af55604a554c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:54.142806 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae2efc-efe4-401b-ac5b-af55604a554c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:54.193308 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2480/4978] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:54 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:54.195704 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae2efc-efe4-401b-ac5b-af55604a554c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:54.245364 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae2efc-efe4-401b-ac5b-af55604a554c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:54.248556 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcb3ce8-58e6-4ecc-87e9-dcba374c94dd None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:54.258875 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143d27a-9758-4eb3-ae3a-8f403afcdfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:54.260422 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143d27a-9758-4eb3-ae3a-8f403afcdfef admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:54.260941 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143d27a-9758-4eb3-ae3a-8f403afcdfef admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:54.261404 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143d27a-9758-4eb3-ae3a-8f403afcdfef admin admin] PATH_INFO: `/v3/projects/5ae9b4d21f9d465ab328d3b193ae96f7/users/bab816e3b66340e29236f37add40650c/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:54.308982 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6143d27a-9758-4eb3-ae3a-8f403afcdfef admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ae9b4d21f9d465ab328d3b193ae96f7, user_id=bab816e3b66340e29236f37add40650c, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:54.311731 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6143d27a-9758-4eb3-ae3a-8f403afcdfef admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:54.345070 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2481/4979] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:54 2022] PUT /identity/v3/projects/5ae9b4d21f9d465ab328d3b193ae96f7/users/bab816e3b66340e29236f37add40650c/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:54.349600 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143d27a-9758-4eb3-ae3a-8f403afcdfef admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:54.361761 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6143d27a-9758-4eb3-ae3a-8f403afcdfef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:54.450880 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9aba10-f07b-406c-bf50-f9a3e5c60385 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:54.451558 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9aba10-f07b-406c-bf50-f9a3e5c60385 service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:54.451981 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9aba10-f07b-406c-bf50-f9a3e5c60385 service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:54.452258 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9aba10-f07b-406c-bf50-f9a3e5c60385 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:54.610229 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143d27a-9758-4eb3-ae3a-8f403afcdfef admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:54.629171 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7471aa-07c3-44ae-aeeb-738b7bc39113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:54.633520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7471aa-07c3-44ae-aeeb-738b7bc39113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:54.633866 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7471aa-07c3-44ae-aeeb-738b7bc39113 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:54.634145 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7471aa-07c3-44ae-aeeb-738b7bc39113 admin admin] PATH_INFO: `/v3/users/1452d6fd4a0e4905bf4faaea119e03b1` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:54.641632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7471aa-07c3-44ae-aeeb-738b7bc39113 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1452d6fd4a0e4905bf4faaea119e03b1)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:54.652925 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7471aa-07c3-44ae-aeeb-738b7bc39113 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:54.725875 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9aba10-f07b-406c-bf50-f9a3e5c60385 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:54.727531 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9aba10-f07b-406c-bf50-f9a3e5c60385 service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:54.776481 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2499/4980] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 15:59:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 763 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:59:54.780692 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9aba10-f07b-406c-bf50-f9a3e5c60385 service swift] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:54.844724 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9aba10-f07b-406c-bf50-f9a3e5c60385 service swift] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:54.881463 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcae7c9-cd26-47ab-934d-5d1cf6bb8c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:54.884579 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcae7c9-cd26-47ab-934d-5d1cf6bb8c79 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:54.884886 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcae7c9-cd26-47ab-934d-5d1cf6bb8c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:54.885151 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcae7c9-cd26-47ab-934d-5d1cf6bb8c79 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:54.888067 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcae7c9-cd26-47ab-934d-5d1cf6bb8c79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:54.918577 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcae7c9-cd26-47ab-934d-5d1cf6bb8c79 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:54.922075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ed7471aa-07c3-44ae-aeeb-738b7bc39113 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1452d6fd4a0e4905bf4faaea119e03b1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:54.923943 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ed7471aa-07c3-44ae-aeeb-738b7bc39113 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1452d6fd4a0e4905bf4faaea119e03b1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:54.945846 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ed7471aa-07c3-44ae-aeeb-738b7bc39113 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1452d6fd4a0e4905bf4faaea119e03b1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:54.970751 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ed7471aa-07c3-44ae-aeeb-738b7bc39113 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1452d6fd4a0e4905bf4faaea119e03b1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:54.971840 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2500/4981] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:54 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:54.978916 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcae7c9-cd26-47ab-934d-5d1cf6bb8c79 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:54.984324 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ed7471aa-07c3-44ae-aeeb-738b7bc39113 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1452d6fd4a0e4905bf4faaea119e03b1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:54.987579 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5dcae7c9-cd26-47ab-934d-5d1cf6bb8c79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:55.072601 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcae7c9-cd26-47ab-934d-5d1cf6bb8c79 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:55.093675 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2482/4982] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:54 2022] DELETE /identity/v3/users/1452d6fd4a0e4905bf4faaea119e03b1 => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:55.097024 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7471aa-07c3-44ae-aeeb-738b7bc39113 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:55.102764 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ed7471aa-07c3-44ae-aeeb-738b7bc39113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:55.119167 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:55.150079 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:55.184177 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56de3eb-f2e8-4d6e-83d9-8367f777f143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:55.185755 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56de3eb-f2e8-4d6e-83d9-8367f777f143 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:55.186192 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56de3eb-f2e8-4d6e-83d9-8367f777f143 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:55.186849 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56de3eb-f2e8-4d6e-83d9-8367f777f143 admin admin] PATH_INFO: `/v3/users/58ddd1273ce749e29578db36d61ca07a` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:55.188375 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56de3eb-f2e8-4d6e-83d9-8367f777f143 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58ddd1273ce749e29578db36d61ca07a)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:55.192175 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56de3eb-f2e8-4d6e-83d9-8367f777f143 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:55.282875 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7471aa-07c3-44ae-aeeb-738b7bc39113 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:55.323403 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435b543-2ccb-4cf0-a0f4-7a638ec3be83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:55.324406 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435b543-2ccb-4cf0-a0f4-7a638ec3be83 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:55.324715 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435b543-2ccb-4cf0-a0f4-7a638ec3be83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:55.326757 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435b543-2ccb-4cf0-a0f4-7a638ec3be83 admin admin] PATH_INFO: `/v3/projects/5ae9b4d21f9d465ab328d3b193ae96f7/users/bab816e3b66340e29236f37add40650c/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:55.354016 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8435b543-2ccb-4cf0-a0f4-7a638ec3be83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ae9b4d21f9d465ab328d3b193ae96f7, user_id=bab816e3b66340e29236f37add40650c, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:55.372891 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8435b543-2ccb-4cf0-a0f4-7a638ec3be83 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:55.403393 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f56de3eb-f2e8-4d6e-83d9-8367f777f143 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58ddd1273ce749e29578db36d61ca07a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:55.404766 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f56de3eb-f2e8-4d6e-83d9-8367f777f143 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58ddd1273ce749e29578db36d61ca07a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:55.408407 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2483/4983] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:55 2022] PUT /identity/v3/projects/5ae9b4d21f9d465ab328d3b193ae96f7/users/bab816e3b66340e29236f37add40650c/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:55.410576 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6388e4-8981-403d-a42f-97bd7d113de8 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:55.411866 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6388e4-8981-403d-a42f-97bd7d113de8 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:55.412563 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6388e4-8981-403d-a42f-97bd7d113de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:55.453994 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f56de3eb-f2e8-4d6e-83d9-8367f777f143 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58ddd1273ce749e29578db36d61ca07a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:55.470621 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-1b6388e4-8981-403d-a42f-97bd7d113de8 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:55.473847 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1b6388e4-8981-403d-a42f-97bd7d113de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:55.482053 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f56de3eb-f2e8-4d6e-83d9-8367f777f143 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58ddd1273ce749e29578db36d61ca07a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:55.496981 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f56de3eb-f2e8-4d6e-83d9-8367f777f143 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58ddd1273ce749e29578db36d61ca07a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:55.509688 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2501/4984] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:54 2022] DELETE /identity/v3/users/58ddd1273ce749e29578db36d61ca07a => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:55.511198 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1756fe0-b8a6-4442-92f4-418a2ca9480b None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:55.511678 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1756fe0-b8a6-4442-92f4-418a2ca9480b None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:55.512141 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1756fe0-b8a6-4442-92f4-418a2ca9480b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:55.599272 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-d1756fe0-b8a6-4442-92f4-418a2ca9480b None None] MFA Rules not processed for user `bab816e3b66340e29236f37add40650c`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:55.600524 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d1756fe0-b8a6-4442-92f4-418a2ca9480b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:55.604543 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2484/4985] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:55.638801 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6388e4-8981-403d-a42f-97bd7d113de8 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:55.640272 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1b6388e4-8981-403d-a42f-97bd7d113de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:55.710237 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2502/4986] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:55 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:55.725328 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1756fe0-b8a6-4442-92f4-418a2ca9480b None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:55.727813 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d1756fe0-b8a6-4442-92f4-418a2ca9480b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:55.772615 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:55.806470 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6388e4-8981-403d-a42f-97bd7d113de8 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:55.895630 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e6781-5f0d-455f-b640-74170d7250e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:55.898204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e6781-5f0d-455f-b640-74170d7250e4 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:55.898670 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e6781-5f0d-455f-b640-74170d7250e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:55.899189 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e6781-5f0d-455f-b640-74170d7250e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:55.911781 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1756fe0-b8a6-4442-92f4-418a2ca9480b None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:55.917228 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1f688-41d9-4525-bd7a-610681ba6d9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:55.918300 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1f688-41d9-4525-bd7a-610681ba6d9f service cinder] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:55.918654 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1f688-41d9-4525-bd7a-610681ba6d9f service cinder] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:55.918899 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1f688-41d9-4525-bd7a-610681ba6d9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:55.922263 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ece1f688-41d9-4525-bd7a-610681ba6d9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:55.928996 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:56.061295 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece1f688-41d9-4525-bd7a-610681ba6d9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:56.063111 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece1f688-41d9-4525-bd7a-610681ba6d9f service cinder] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:56.069394 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e6781-5f0d-455f-b640-74170d7250e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:56.071994 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e6781-5f0d-455f-b640-74170d7250e4 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:56.077922 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2503/4987] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:59:55 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:59:56.078618 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1f688-41d9-4525-bd7a-610681ba6d9f service cinder] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:56.092663 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ece1f688-41d9-4525-bd7a-610681ba6d9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:56.113588 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2485/4988] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:59:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:59:56.118811 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1f688-41d9-4525-bd7a-610681ba6d9f service cinder] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:56.134315 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a36270-e6b7-4a39-bf65-eb4a6e3ae6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:56.134978 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a36270-e6b7-4a39-bf65-eb4a6e3ae6ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:56.135298 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a36270-e6b7-4a39-bf65-eb4a6e3ae6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:56.135574 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a36270-e6b7-4a39-bf65-eb4a6e3ae6ef admin admin] PATH_INFO: `/v3/projects/d4283ccfd2a54553896677a670e675f9` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:56.136764 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a36270-e6b7-4a39-bf65-eb4a6e3ae6ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4283ccfd2a54553896677a670e675f9)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:56.138711 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a36270-e6b7-4a39-bf65-eb4a6e3ae6ef admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:56.215715 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-03a36270-e6b7-4a39-bf65-eb4a6e3ae6ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4283ccfd2a54553896677a670e675f9', 'request_id': 'req-03a36270-e6b7-4a39-bf65-eb4a6e3ae6ef'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:56.225396 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-03a36270-e6b7-4a39-bf65-eb4a6e3ae6ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4283ccfd2a54553896677a670e675f9', 'request_id': 'req-03a36270-e6b7-4a39-bf65-eb4a6e3ae6ef'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:56.235143 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-03a36270-e6b7-4a39-bf65-eb4a6e3ae6ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4283ccfd2a54553896677a670e675f9', 'request_id': 'req-03a36270-e6b7-4a39-bf65-eb4a6e3ae6ef'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:56.250669 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-03a36270-e6b7-4a39-bf65-eb4a6e3ae6ef admin admin] The token cache is being invalidate because project d4283ccfd2a54553896677a670e675f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:56.251098 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-03a36270-e6b7-4a39-bf65-eb4a6e3ae6ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:56.251781 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-03a36270-e6b7-4a39-bf65-eb4a6e3ae6ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:56.254408 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2504/4989] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:59:56 2022] DELETE /identity/v3/projects/d4283ccfd2a54553896677a670e675f9 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:56.260417 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae808a-39d0-4524-b013-79a8e6dc9856 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:56.260821 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae808a-39d0-4524-b013-79a8e6dc9856 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:56.261431 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae808a-39d0-4524-b013-79a8e6dc9856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:56.305932 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-26ae808a-39d0-4524-b013-79a8e6dc9856 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:56.309909 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-26ae808a-39d0-4524-b013-79a8e6dc9856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:56.507104 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2486/4990] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:56.514830 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b3f07-7e25-4952-94e8-a1ee447981ff None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:56.515331 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b3f07-7e25-4952-94e8-a1ee447981ff None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:56.515544 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b3f07-7e25-4952-94e8-a1ee447981ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:56.562514 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-009b3f07-7e25-4952-94e8-a1ee447981ff None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:56.566513 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-009b3f07-7e25-4952-94e8-a1ee447981ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:56.582513 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae808a-39d0-4524-b013-79a8e6dc9856 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:56.584176 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-26ae808a-39d0-4524-b013-79a8e6dc9856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:56.608251 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae808a-39d0-4524-b013-79a8e6dc9856 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:56.608456 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2505/4991] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:56.611334 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b3f07-7e25-4952-94e8-a1ee447981ff None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:56.617881 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f0d18-8a95-40c2-83b1-c8d8b52f31c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:56.629224 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f0d18-8a95-40c2-83b1-c8d8b52f31c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:56.629789 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f0d18-8a95-40c2-83b1-c8d8b52f31c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:56.637961 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b3f07-7e25-4952-94e8-a1ee447981ff None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:56.638278 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f0d18-8a95-40c2-83b1-c8d8b52f31c7 admin admin] PATH_INFO: `/v3/projects/67467b6a2bc44a7f98c525cc7c8d3c15` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:56.641669 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f0d18-8a95-40c2-83b1-c8d8b52f31c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67467b6a2bc44a7f98c525cc7c8d3c15)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:56.643758 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f0d18-8a95-40c2-83b1-c8d8b52f31c7 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:56.655488 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff3e86-8309-4e33-b055-f429378fa893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:56.656161 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff3e86-8309-4e33-b055-f429378fa893 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:56.656434 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff3e86-8309-4e33-b055-f429378fa893 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:56.657120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff3e86-8309-4e33-b055-f429378fa893 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:56.658511 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff3e86-8309-4e33-b055-f429378fa893 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:59:56.658698 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff3e86-8309-4e33-b055-f429378fa893 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:56.662376 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff3e86-8309-4e33-b055-f429378fa893 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:56.687960 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2506/4992] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:59:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:59:56.693304 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfc4bb-c4b8-4e60-9a06-a061076660f2 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:56.693678 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfc4bb-c4b8-4e60-9a06-a061076660f2 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:56.694113 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfc4bb-c4b8-4e60-9a06-a061076660f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:56.772396 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-a3dfc4bb-c4b8-4e60-9a06-a061076660f2 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:56.777173 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a3dfc4bb-c4b8-4e60-9a06-a061076660f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:56.817327 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-181f0d18-8a95-40c2-83b1-c8d8b52f31c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67467b6a2bc44a7f98c525cc7c8d3c15', 'request_id': 'req-181f0d18-8a95-40c2-83b1-c8d8b52f31c7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:56.836859 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:56.837968 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-181f0d18-8a95-40c2-83b1-c8d8b52f31c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67467b6a2bc44a7f98c525cc7c8d3c15', 'request_id': 'req-181f0d18-8a95-40c2-83b1-c8d8b52f31c7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:56.853102 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-181f0d18-8a95-40c2-83b1-c8d8b52f31c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67467b6a2bc44a7f98c525cc7c8d3c15', 'request_id': 'req-181f0d18-8a95-40c2-83b1-c8d8b52f31c7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:56.880231 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2507/4993] 10.222.0.83 () {58 vars in 967 bytes} [Mon Aug 29 15:59:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:56.882175 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dfc4bb-c4b8-4e60-9a06-a061076660f2 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:56.896240 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-181f0d18-8a95-40c2-83b1-c8d8b52f31c7 admin admin] The token cache is being invalidate because project 67467b6a2bc44a7f98c525cc7c8d3c15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:56.896528 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-181f0d18-8a95-40c2-83b1-c8d8b52f31c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:56.900801 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-181f0d18-8a95-40c2-83b1-c8d8b52f31c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:56.903562 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2487/4994] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:59:56 2022] DELETE /identity/v3/projects/67467b6a2bc44a7f98c525cc7c8d3c15 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:59:56.904963 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f0d18-8a95-40c2-83b1-c8d8b52f31c7 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:56.906532 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-181f0d18-8a95-40c2-83b1-c8d8b52f31c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:57.013025 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:57.059369 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dfc4bb-c4b8-4e60-9a06-a061076660f2 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:57.070467 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f0d18-8a95-40c2-83b1-c8d8b52f31c7 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:57.075012 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246b927-480c-4cef-9369-30758732ef1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:57.075925 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246b927-480c-4cef-9369-30758732ef1a admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:57.076377 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246b927-480c-4cef-9369-30758732ef1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:57.077092 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246b927-480c-4cef-9369-30758732ef1a admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:57.078660 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c246b927-480c-4cef-9369-30758732ef1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:57.086455 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c246b927-480c-4cef-9369-30758732ef1a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:57.089095 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61336c4d-892a-496d-93d2-9b19a14e5b32 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:57.089752 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61336c4d-892a-496d-93d2-9b19a14e5b32 service swift] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:57.090034 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61336c4d-892a-496d-93d2-9b19a14e5b32 service swift] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:57.090305 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61336c4d-892a-496d-93d2-9b19a14e5b32 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:57.092420 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-61336c4d-892a-496d-93d2-9b19a14e5b32 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:57.134103 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2508/4995] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:59:56 2022] POST /identity/v3/projects => generated 389 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:57.136072 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83ad4d-36e0-4b38-ad44-d693462fe7bd None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:57.136539 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83ad4d-36e0-4b38-ad44-d693462fe7bd None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:57.137045 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83ad4d-36e0-4b38-ad44-d693462fe7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:57.138653 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61336c4d-892a-496d-93d2-9b19a14e5b32 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:57.140365 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61336c4d-892a-496d-93d2-9b19a14e5b32 service swift] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:57.164111 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-cc83ad4d-36e0-4b38-ad44-d693462fe7bd None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:57.166212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-cc83ad4d-36e0-4b38-ad44-d693462fe7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:57.178995 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2488/4996] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 15:59:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:59:57.179938 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61336c4d-892a-496d-93d2-9b19a14e5b32 service swift] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:57.181943 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-61336c4d-892a-496d-93d2-9b19a14e5b32 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:57.210289 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61336c4d-892a-496d-93d2-9b19a14e5b32 service swift] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:57.305489 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2509/4997] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:57.314027 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76740a2-d14d-4af4-84ad-74660d1c64da None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:57.314338 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76740a2-d14d-4af4-84ad-74660d1c64da None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:57.314606 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76740a2-d14d-4af4-84ad-74660d1c64da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:57.373750 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce491b85-bef6-44af-88f0-f94bcb2d63ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:57.374666 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce491b85-bef6-44af-88f0-f94bcb2d63ed admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:57.375141 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce491b85-bef6-44af-88f0-f94bcb2d63ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:57.375587 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce491b85-bef6-44af-88f0-f94bcb2d63ed admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:57.376401 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce491b85-bef6-44af-88f0-f94bcb2d63ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:57.380999 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce491b85-bef6-44af-88f0-f94bcb2d63ed admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:57.393510 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-a76740a2-d14d-4af4-84ad-74660d1c64da None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:57.394951 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a76740a2-d14d-4af4-84ad-74660d1c64da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:57.429586 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2510/4998] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:59:57.432760 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76740a2-d14d-4af4-84ad-74660d1c64da None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:57.451775 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2489/4999] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:59:57 2022] POST /identity/v3/users => generated 295 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:57.465792 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce491b85-bef6-44af-88f0-f94bcb2d63ed admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:57.466527 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76740a2-d14d-4af4-84ad-74660d1c64da None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:57.479443 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb27c55-2117-4551-a297-003d02711910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:57.480836 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb27c55-2117-4551-a297-003d02711910 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:57.481169 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb27c55-2117-4551-a297-003d02711910 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:57.481445 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb27c55-2117-4551-a297-003d02711910 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:57.482123 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb27c55-2117-4551-a297-003d02711910 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:59:57.482410 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb27c55-2117-4551-a297-003d02711910 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:57.486022 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb27c55-2117-4551-a297-003d02711910 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:57.490033 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce491b85-bef6-44af-88f0-f94bcb2d63ed admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:57.509282 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e044844-1d1f-41d1-a157-88a910c86e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:57.509912 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e044844-1d1f-41d1-a157-88a910c86e51 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:57.510194 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e044844-1d1f-41d1-a157-88a910c86e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:57.510467 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e044844-1d1f-41d1-a157-88a910c86e51 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:57.511732 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e044844-1d1f-41d1-a157-88a910c86e51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:57.513398 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e044844-1d1f-41d1-a157-88a910c86e51 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:57.527780 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2511/5000] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 15:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:59:57.529328 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c17024-90c8-4b42-bd2f-55a669b7b779 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:57.529675 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c17024-90c8-4b42-bd2f-55a669b7b779 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:57.530017 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c17024-90c8-4b42-bd2f-55a669b7b779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:57.542853 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2490/5001] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:57.543828 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e044844-1d1f-41d1-a157-88a910c86e51 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:57.554106 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-13c17024-90c8-4b42-bd2f-55a669b7b779 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:57.555527 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-13c17024-90c8-4b42-bd2f-55a669b7b779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:57.558865 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e044844-1d1f-41d1-a157-88a910c86e51 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:57.569840 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34ff12-1144-42b4-a49d-abc09756619b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:57.570556 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34ff12-1144-42b4-a49d-abc09756619b admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:57.570833 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34ff12-1144-42b4-a49d-abc09756619b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:57.571140 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34ff12-1144-42b4-a49d-abc09756619b admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:57.571941 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f34ff12-1144-42b4-a49d-abc09756619b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:57.574189 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f34ff12-1144-42b4-a49d-abc09756619b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:57.606499 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:57.625963 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2512/5002] 10.222.0.83 () {58 vars in 967 bytes} [Mon Aug 29 15:59:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:57.626836 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c17024-90c8-4b42-bd2f-55a669b7b779 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:57.645467 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2491/5003] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:59:57 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:57.647460 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34ff12-1144-42b4-a49d-abc09756619b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:57.647811 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c17024-90c8-4b42-bd2f-55a669b7b779 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:57.723584 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a8d1e-1c64-45a0-a8ee-030d87173ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:57.724438 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a8d1e-1c64-45a0-a8ee-030d87173ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:57.724657 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a8d1e-1c64-45a0-a8ee-030d87173ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:57.724916 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a8d1e-1c64-45a0-a8ee-030d87173ac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:57.725728 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a8d1e-1c64-45a0-a8ee-030d87173ac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:57.728017 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a8d1e-1c64-45a0-a8ee-030d87173ac3 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:57.744084 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2513/5004] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:57.745645 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a8d1e-1c64-45a0-a8ee-030d87173ac3 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:57.758557 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a8d1e-1c64-45a0-a8ee-030d87173ac3 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:57.759345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34ff12-1144-42b4-a49d-abc09756619b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:57.764420 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176aba35-2fc5-4f17-bdf3-493758572a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:57.765205 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176aba35-2fc5-4f17-bdf3-493758572a65 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:57.765485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176aba35-2fc5-4f17-bdf3-493758572a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:57.765756 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176aba35-2fc5-4f17-bdf3-493758572a65 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:57.766357 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8c6c3-99f8-4f5c-aa08-4b75b6fa2e57 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:57.766555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176aba35-2fc5-4f17-bdf3-493758572a65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:57.767541 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8c6c3-99f8-4f5c-aa08-4b75b6fa2e57 service swift] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:57.768162 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8c6c3-99f8-4f5c-aa08-4b75b6fa2e57 service swift] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:57.768629 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8c6c3-99f8-4f5c-aa08-4b75b6fa2e57 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:57.768804 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176aba35-2fc5-4f17-bdf3-493758572a65 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:57.806072 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2514/5005] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:59:57 2022] POST /identity/v3/users => generated 287 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:57.807415 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176aba35-2fc5-4f17-bdf3-493758572a65 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:57.817453 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:57.820241 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176aba35-2fc5-4f17-bdf3-493758572a65 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:57.825528 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460bd2a-a61c-4de7-bb2e-9a65f2b2da82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:57.826203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460bd2a-a61c-4de7-bb2e-9a65f2b2da82 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:57.826484 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460bd2a-a61c-4de7-bb2e-9a65f2b2da82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:57.827048 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460bd2a-a61c-4de7-bb2e-9a65f2b2da82 admin admin] PATH_INFO: `/v3/projects/5b02f0c534c9462c9de0e6fab11cea27/users/e460fd09b56f4c47a46062a41fc89bbf/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:57.864835 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c8c6c3-99f8-4f5c-aa08-4b75b6fa2e57 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:57.868937 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1460bd2a-a61c-4de7-bb2e-9a65f2b2da82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b02f0c534c9462c9de0e6fab11cea27, user_id=e460fd09b56f4c47a46062a41fc89bbf, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:57.871851 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c8c6c3-99f8-4f5c-aa08-4b75b6fa2e57 service swift] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:57.875989 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1460bd2a-a61c-4de7-bb2e-9a65f2b2da82 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:57.895963 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2492/5006] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 15:59:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:59:57.897064 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8c6c3-99f8-4f5c-aa08-4b75b6fa2e57 service swift] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:57.904346 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2515/5007] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:57 2022] PUT /identity/v3/projects/5b02f0c534c9462c9de0e6fab11cea27/users/e460fd09b56f4c47a46062a41fc89bbf/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:57.913441 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ac10c-8483-43cf-aaf8-37be0418378b None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:57.913901 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ac10c-8483-43cf-aaf8-37be0418378b None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:57.914767 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ac10c-8483-43cf-aaf8-37be0418378b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:57.925235 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8c6c3-99f8-4f5c-aa08-4b75b6fa2e57 service swift] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:57.964704 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-952ac10c-8483-43cf-aaf8-37be0418378b None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:57.981391 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-952ac10c-8483-43cf-aaf8-37be0418378b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:58.097330 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a4d0b6-b141-4818-8f0f-af56026b5eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:58.100269 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4d0b6-b141-4818-8f0f-af56026b5eae admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:58.101471 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4d0b6-b141-4818-8f0f-af56026b5eae admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:58.103214 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4d0b6-b141-4818-8f0f-af56026b5eae admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:58.104739 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a4d0b6-b141-4818-8f0f-af56026b5eae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:58.109676 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a4d0b6-b141-4818-8f0f-af56026b5eae admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:58.141834 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2493/5008] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:58.146823 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a4d0b6-b141-4818-8f0f-af56026b5eae admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:58.169437 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a4d0b6-b141-4818-8f0f-af56026b5eae admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:58.185054 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599cb99-ff7c-4991-b670-c8d8368adee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:58.188675 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599cb99-ff7c-4991-b670-c8d8368adee8 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:58.189126 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599cb99-ff7c-4991-b670-c8d8368adee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:58.189256 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599cb99-ff7c-4991-b670-c8d8368adee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:58.189904 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a599cb99-ff7c-4991-b670-c8d8368adee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:58.199329 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a599cb99-ff7c-4991-b670-c8d8368adee8 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:58.228809 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2516/5009] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:59:58.230408 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43bf438-691e-43d8-9ec0-834b2721927a None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:58.231058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43bf438-691e-43d8-9ec0-834b2721927a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:58.231518 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43bf438-691e-43d8-9ec0-834b2721927a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:58.246362 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2494/5010] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:58.248125 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599cb99-ff7c-4991-b670-c8d8368adee8 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:58.257386 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a599cb99-ff7c-4991-b670-c8d8368adee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:58.308441 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-b43bf438-691e-43d8-9ec0-834b2721927a None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:58.309653 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b43bf438-691e-43d8-9ec0-834b2721927a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:58.401447 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599cb99-ff7c-4991-b670-c8d8368adee8 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:58.410410 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541d0a2-1d77-4bfa-b680-2091a54028aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:58.412544 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541d0a2-1d77-4bfa-b680-2091a54028aa service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:58.413097 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541d0a2-1d77-4bfa-b680-2091a54028aa service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:58.413813 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541d0a2-1d77-4bfa-b680-2091a54028aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:58.420639 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:58.438088 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6541d0a2-1d77-4bfa-b680-2091a54028aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:58.440141 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6541d0a2-1d77-4bfa-b680-2091a54028aa service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:58.450669 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2517/5011] 10.222.0.83 () {58 vars in 967 bytes} [Mon Aug 29 15:59:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:58.451643 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43bf438-691e-43d8-9ec0-834b2721927a None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:58.471582 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2495/5012] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:59:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:59:58.473859 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541d0a2-1d77-4bfa-b680-2091a54028aa service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:58.495649 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43bf438-691e-43d8-9ec0-834b2721927a None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:58.516125 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e138af-c399-443e-b15a-1cce7675bbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:58.524172 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e138af-c399-443e-b15a-1cce7675bbdf admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:58.525445 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e138af-c399-443e-b15a-1cce7675bbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:58.527553 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e138af-c399-443e-b15a-1cce7675bbdf admin admin] PATH_INFO: `/v3/projects/ecbf2e1e974e4e4b903768ebcfeb2806/users/a20debe98479456a9063e197ca0bb22e/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:58.586303 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e138af-c399-443e-b15a-1cce7675bbdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecbf2e1e974e4e4b903768ebcfeb2806, user_id=a20debe98479456a9063e197ca0bb22e, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:58.593850 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e138af-c399-443e-b15a-1cce7675bbdf admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:58.622728 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:58.634592 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2518/5013] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:58 2022] PUT /identity/v3/projects/ecbf2e1e974e4e4b903768ebcfeb2806/users/a20debe98479456a9063e197ca0bb22e/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:58.637112 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87b96b-00ad-40bc-a849-2c58ff8a4837 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:58.637407 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87b96b-00ad-40bc-a849-2c58ff8a4837 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:58.637685 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87b96b-00ad-40bc-a849-2c58ff8a4837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:58.653062 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541d0a2-1d77-4bfa-b680-2091a54028aa service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:58.723068 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-ee87b96b-00ad-40bc-a849-2c58ff8a4837 None None] MFA Rules not processed for user `a20debe98479456a9063e197ca0bb22e`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:58.725833 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ee87b96b-00ad-40bc-a849-2c58ff8a4837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:58.830276 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac896a90-6fd5-44d6-9ce0-fb6ee56cde02 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:58.830915 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac896a90-6fd5-44d6-9ce0-fb6ee56cde02 service swift] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:58.831249 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac896a90-6fd5-44d6-9ce0-fb6ee56cde02 service swift] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:58.831523 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac896a90-6fd5-44d6-9ce0-fb6ee56cde02 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:58.901168 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2519/5014] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 15:59:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:59:58.905192 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee87b96b-00ad-40bc-a849-2c58ff8a4837 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:58.977829 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac896a90-6fd5-44d6-9ce0-fb6ee56cde02 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:58.979688 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac896a90-6fd5-44d6-9ce0-fb6ee56cde02 service swift] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:58.992985 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2496/5015] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 15:59:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:59:59.205402 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee87b96b-00ad-40bc-a849-2c58ff8a4837 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:59.215036 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b68a0-ab89-47aa-bd8c-74bf73fc677c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:59.215798 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b68a0-ab89-47aa-bd8c-74bf73fc677c admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:59.216148 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b68a0-ab89-47aa-bd8c-74bf73fc677c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:59.216483 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b68a0-ab89-47aa-bd8c-74bf73fc677c admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:59.217209 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756b68a0-ab89-47aa-bd8c-74bf73fc677c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:59.219458 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756b68a0-ab89-47aa-bd8c-74bf73fc677c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:59.243858 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e321edf-7bc9-4cec-9fbc-81ce3c0c03ae None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:59.244407 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e321edf-7bc9-4cec-9fbc-81ce3c0c03ae None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:59.244407 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e321edf-7bc9-4cec-9fbc-81ce3c0c03ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:59.283550 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2520/5016] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 15:59:58 2022] POST /identity/v3/projects => generated 371 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:59.283550 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b68a0-ab89-47aa-bd8c-74bf73fc677c admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:59.291474 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-4e321edf-7bc9-4cec-9fbc-81ce3c0c03ae None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:59.293535 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4e321edf-7bc9-4cec-9fbc-81ce3c0c03ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:59.389742 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:59.406583 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2497/5017] 10.222.0.83 () {58 vars in 967 bytes} [Mon Aug 29 15:59:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:59.408283 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e321edf-7bc9-4cec-9fbc-81ce3c0c03ae None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:59.412298 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4e321edf-7bc9-4cec-9fbc-81ce3c0c03ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:59.450294 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b68a0-ab89-47aa-bd8c-74bf73fc677c admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:59.470809 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de32ee-fb2f-413d-b4a2-5eae78547e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:59.475267 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de32ee-fb2f-413d-b4a2-5eae78547e0c admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:59.475599 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de32ee-fb2f-413d-b4a2-5eae78547e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:59.476009 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de32ee-fb2f-413d-b4a2-5eae78547e0c admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:59.477562 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6de32ee-fb2f-413d-b4a2-5eae78547e0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:59.482312 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6de32ee-fb2f-413d-b4a2-5eae78547e0c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:59.531374 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2521/5018] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 15:59:59 2022] POST /identity/v3/users => generated 292 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:59.532304 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de32ee-fb2f-413d-b4a2-5eae78547e0c admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:59.557745 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:59.596221 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e321edf-7bc9-4cec-9fbc-81ce3c0c03ae None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:59.604160 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8373cb9-7a7b-4bfe-aaf1-3d2b0fc113a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:59.604801 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8373cb9-7a7b-4bfe-aaf1-3d2b0fc113a7 service cinder] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:59.605079 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8373cb9-7a7b-4bfe-aaf1-3d2b0fc113a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:59.605359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8373cb9-7a7b-4bfe-aaf1-3d2b0fc113a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:59.610024 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a8373cb9-7a7b-4bfe-aaf1-3d2b0fc113a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:59.690096 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de32ee-fb2f-413d-b4a2-5eae78547e0c admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:59.708393 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9da035-6972-4d9c-9449-473221f4c39f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:59.710450 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9da035-6972-4d9c-9449-473221f4c39f service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:59.710918 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9da035-6972-4d9c-9449-473221f4c39f service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:59.712150 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9da035-6972-4d9c-9449-473221f4c39f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:59.730438 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9da035-6972-4d9c-9449-473221f4c39f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:59.733399 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9da035-6972-4d9c-9449-473221f4c39f service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:59.752069 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2522/5019] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 15:59:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:59:59.752952 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9da035-6972-4d9c-9449-473221f4c39f service swift] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:59.765632 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9da035-6972-4d9c-9449-473221f4c39f service swift] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:59.772614 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e06bc0e-7efd-4438-8008-e425b9c53797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:59.773489 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06bc0e-7efd-4438-8008-e425b9c53797 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:59.774123 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06bc0e-7efd-4438-8008-e425b9c53797 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:59.775236 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06bc0e-7efd-4438-8008-e425b9c53797 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:59.775942 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e06bc0e-7efd-4438-8008-e425b9c53797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:59.776285 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8373cb9-7a7b-4bfe-aaf1-3d2b0fc113a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:59.777737 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e06bc0e-7efd-4438-8008-e425b9c53797 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:59.778775 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8373cb9-7a7b-4bfe-aaf1-3d2b0fc113a7 service cinder] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:59.798766 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2523/5020] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:59 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:59.800786 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e06bc0e-7efd-4438-8008-e425b9c53797 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:59.815269 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e06bc0e-7efd-4438-8008-e425b9c53797 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:59.823141 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fefde6-71ac-4f14-a37f-eb75ac0aafb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:59.824270 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fefde6-71ac-4f14-a37f-eb75ac0aafb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:59.824605 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fefde6-71ac-4f14-a37f-eb75ac0aafb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:59.825070 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fefde6-71ac-4f14-a37f-eb75ac0aafb5 admin admin] PATH_INFO: `/v3/projects/d485e73df78745ee98568f6b6c8b7467/users/f1342bb1824742b5b3e04e09e74f0c25/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:59.826895 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2498/5021] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 15:59:59 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:59:59.861766 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fefde6-71ac-4f14-a37f-eb75ac0aafb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d485e73df78745ee98568f6b6c8b7467, user_id=f1342bb1824742b5b3e04e09e74f0c25, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:59.866648 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fefde6-71ac-4f14-a37f-eb75ac0aafb5 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:59.914920 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2524/5022] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:59 2022] PUT /identity/v3/projects/d485e73df78745ee98568f6b6c8b7467/users/f1342bb1824742b5b3e04e09e74f0c25/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:59.919890 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8373cb9-7a7b-4bfe-aaf1-3d2b0fc113a7 service cinder] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:59.939046 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8373cb9-7a7b-4bfe-aaf1-3d2b0fc113a7 service cinder] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:00.067057 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13c856-13b1-4290-b8a1-7757ab3dcc6f None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:00.067631 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13c856-13b1-4290-b8a1-7757ab3dcc6f None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:00.067862 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13c856-13b1-4290-b8a1-7757ab3dcc6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:00.094936 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de72365-f63f-4c8d-8788-93cdb251bc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:00.095947 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de72365-f63f-4c8d-8788-93cdb251bc05 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:00.096231 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de72365-f63f-4c8d-8788-93cdb251bc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:00.096509 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de72365-f63f-4c8d-8788-93cdb251bc05 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:00.097179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de72365-f63f-4c8d-8788-93cdb251bc05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:00.099427 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de72365-f63f-4c8d-8788-93cdb251bc05 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:00.105207 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-2c13c856-13b1-4290-b8a1-7757ab3dcc6f None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:00.108861 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2c13c856-13b1-4290-b8a1-7757ab3dcc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:00.132420 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2499/5023] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:59 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:00:00.134717 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de72365-f63f-4c8d-8788-93cdb251bc05 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:00.164564 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de72365-f63f-4c8d-8788-93cdb251bc05 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:00.178120 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e0702-d5f2-4493-a506-b44b81655e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:00.178824 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e0702-d5f2-4493-a506-b44b81655e4d admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:00.179132 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e0702-d5f2-4493-a506-b44b81655e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:00.181041 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e0702-d5f2-4493-a506-b44b81655e4d admin admin] PATH_INFO: `/v3/projects/d485e73df78745ee98568f6b6c8b7467/users/f1342bb1824742b5b3e04e09e74f0c25/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:00.184810 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e0702-d5f2-4493-a506-b44b81655e4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d485e73df78745ee98568f6b6c8b7467, user_id=f1342bb1824742b5b3e04e09e74f0c25, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:00.194637 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e0702-d5f2-4493-a506-b44b81655e4d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:00.232051 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2500/5024] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:00:00 2022] PUT /identity/v3/projects/d485e73df78745ee98568f6b6c8b7467/users/f1342bb1824742b5b3e04e09e74f0c25/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:00.266363 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2525/5025] 10.222.0.83 () {58 vars in 967 bytes} [Mon Aug 29 16:00:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 29 16:00:00.286535 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e0702-d5f2-4493-a506-b44b81655e4d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:00.327209 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b3034-6c22-4c6a-ad9c-adc25a248c0f None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:00.328100 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b3034-6c22-4c6a-ad9c-adc25a248c0f None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:00.328580 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b3034-6c22-4c6a-ad9c-adc25a248c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:00.413489 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-df6b3034-6c22-4c6a-ad9c-adc25a248c0f None None] MFA Rules not processed for user `f1342bb1824742b5b3e04e09e74f0c25`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:00.418441 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-df6b3034-6c22-4c6a-ad9c-adc25a248c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:00.481967 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:00.520239 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e0702-d5f2-4493-a506-b44b81655e4d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:00.536741 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e763cb8-1299-41a5-9627-c4c67d7c147b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:00.544320 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e763cb8-1299-41a5-9627-c4c67d7c147b service swift] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:00.547916 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e763cb8-1299-41a5-9627-c4c67d7c147b service swift] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:00.551816 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e763cb8-1299-41a5-9627-c4c67d7c147b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:00.618017 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:00.656848 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2526/5026] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:00 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:00:00.661411 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b3034-6c22-4c6a-ad9c-adc25a248c0f None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:00.697382 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b3034-6c22-4c6a-ad9c-adc25a248c0f None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:00.737292 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37283fdd-9378-47df-b1da-fd7c834db097 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1342bb1824742b5b3e04e09e74f0c25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd485e73df78745ee98568f6b6c8b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:00.738305 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37283fdd-9378-47df-b1da-fd7c834db097 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:00.738748 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37283fdd-9378-47df-b1da-fd7c834db097 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:00.739334 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37283fdd-9378-47df-b1da-fd7c834db097 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:00.744122 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e763cb8-1299-41a5-9627-c4c67d7c147b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:00.747227 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e763cb8-1299-41a5-9627-c4c67d7c147b service swift] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:00.749806 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37283fdd-9378-47df-b1da-fd7c834db097 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:00.754231 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37283fdd-9378-47df-b1da-fd7c834db097 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:00.771922 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2501/5027] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 16:00:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:00:00.818691 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e763cb8-1299-41a5-9627-c4c67d7c147b service swift] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:00.819248 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2527/5028] 10.222.0.83 () {60 vars in 1149 bytes} [Mon Aug 29 16:00:00 2022] POST /identity/v3/domains => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:00.841765 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e763cb8-1299-41a5-9627-c4c67d7c147b service swift] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:01.082986 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca225fe-ff84-4a85-9e7f-0a80dd7d1d2d tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1342bb1824742b5b3e04e09e74f0c25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd485e73df78745ee98568f6b6c8b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:01.083872 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca225fe-ff84-4a85-9e7f-0a80dd7d1d2d tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:01.084429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca225fe-ff84-4a85-9e7f-0a80dd7d1d2d tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:01.085198 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca225fe-ff84-4a85-9e7f-0a80dd7d1d2d tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:01.087461 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca225fe-ff84-4a85-9e7f-0a80dd7d1d2d tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:01.089560 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca225fe-ff84-4a85-9e7f-0a80dd7d1d2d tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:01.104908 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d097427-0570-4b73-959f-87f6f72b6203 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:01.105247 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d097427-0570-4b73-959f-87f6f72b6203 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:01.105534 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d097427-0570-4b73-959f-87f6f72b6203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:01.133247 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-1d097427-0570-4b73-959f-87f6f72b6203 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:01.135987 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1d097427-0570-4b73-959f-87f6f72b6203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:01.233125 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2502/5029] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:00:00 2022] POST /identity/v3/projects => generated 403 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:01.237333 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca225fe-ff84-4a85-9e7f-0a80dd7d1d2d tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:01.331945 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2528/5030] 10.222.0.83 () {58 vars in 967 bytes} [Mon Aug 29 16:00:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:00:01.349957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d097427-0570-4b73-959f-87f6f72b6203 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:01.512571 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca225fe-ff84-4a85-9e7f-0a80dd7d1d2d tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:01.533138 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b8e2b-ce61-4839-b71c-1e89e23dbb45 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1342bb1824742b5b3e04e09e74f0c25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd485e73df78745ee98568f6b6c8b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:01.533138 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b8e2b-ce61-4839-b71c-1e89e23dbb45 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:01.537820 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b8e2b-ce61-4839-b71c-1e89e23dbb45 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:01.538584 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b8e2b-ce61-4839-b71c-1e89e23dbb45 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] PATH_INFO: `/v3/groups` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:01.539338 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517b8e2b-ce61-4839-b71c-1e89e23dbb45 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:01.549186 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517b8e2b-ce61-4839-b71c-1e89e23dbb45 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:01.603897 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2503/5031] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:00:01 2022] POST /identity/v3/groups => generated 301 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:01.608326 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b8e2b-ce61-4839-b71c-1e89e23dbb45 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:01.663742 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b8e2b-ce61-4839-b71c-1e89e23dbb45 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:01.687358 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac60bc0f-b302-4b18-8f64-db62d1026859 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1342bb1824742b5b3e04e09e74f0c25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd485e73df78745ee98568f6b6c8b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:01.688275 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60bc0f-b302-4b18-8f64-db62d1026859 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:01.688695 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60bc0f-b302-4b18-8f64-db62d1026859 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:01.688975 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60bc0f-b302-4b18-8f64-db62d1026859 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:01.691687 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac60bc0f-b302-4b18-8f64-db62d1026859 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:01.691966 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d097427-0570-4b73-959f-87f6f72b6203 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:01.700404 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac60bc0f-b302-4b18-8f64-db62d1026859 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:01.789030 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2504/5032] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:00:01 2022] POST /identity/v3/users => generated 445 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:01.793437 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac60bc0f-b302-4b18-8f64-db62d1026859 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:01.812880 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac60bc0f-b302-4b18-8f64-db62d1026859 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:01.821920 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4e877-2470-44bb-99d6-61c55e636222 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1342bb1824742b5b3e04e09e74f0c25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd485e73df78745ee98568f6b6c8b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:01.822817 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4e877-2470-44bb-99d6-61c55e636222 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:01.823898 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4e877-2470-44bb-99d6-61c55e636222 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:01.824343 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4e877-2470-44bb-99d6-61c55e636222 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:01.825512 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f4e877-2470-44bb-99d6-61c55e636222 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:01.827806 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-c9f4e877-2470-44bb-99d6-61c55e636222 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:00:01.827806 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 16:00:01.827806 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 16:00:01.829350 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f4e877-2470-44bb-99d6-61c55e636222 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:01.866471 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:01.883927 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2505/5033] 10.222.0.83 () {60 vars in 1143 bytes} [Mon Aug 29 16:00:01 2022] POST /identity/v3/roles => generated 240 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:01.888410 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4e877-2470-44bb-99d6-61c55e636222 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:01.899536 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:01.920737 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4e877-2470-44bb-99d6-61c55e636222 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:01.930717 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d76507d-5cb7-45bd-904d-6767d5861aa8 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1342bb1824742b5b3e04e09e74f0c25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd485e73df78745ee98568f6b6c8b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:01.931712 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76507d-5cb7-45bd-904d-6767d5861aa8 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:01.931997 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76507d-5cb7-45bd-904d-6767d5861aa8 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:01.932276 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76507d-5cb7-45bd-904d-6767d5861aa8 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/a9daaa80af3a4d0b968dfb715541bb3e/groups/162069dd3d2342b396b363ebfbc1ac55/roles/bef00e9d8013484ba68189694f021163/inherited_to_projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:01.947229 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d76507d-5cb7-45bd-904d-6767d5861aa8 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a9daaa80af3a4d0b968dfb715541bb3e, group_id=162069dd3d2342b396b363ebfbc1ac55, role_id=bef00e9d8013484ba68189694f021163)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:01.952272 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382c80d-0f4c-4c58-92c0-1a24378aa7d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:01.952966 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382c80d-0f4c-4c58-92c0-1a24378aa7d4 service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:01.953243 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382c80d-0f4c-4c58-92c0-1a24378aa7d4 service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:01.953514 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382c80d-0f4c-4c58-92c0-1a24378aa7d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:01.954216 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d76507d-5cb7-45bd-904d-6767d5861aa8 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:02.022581 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2506/5034] 10.222.0.83 () {60 vars in 1585 bytes} [Mon Aug 29 16:00:01 2022] PUT /identity/v3/OS-INHERIT/projects/a9daaa80af3a4d0b968dfb715541bb3e/groups/162069dd3d2342b396b363ebfbc1ac55/roles/bef00e9d8013484ba68189694f021163/inherited_to_projects => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:02.027270 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d76507d-5cb7-45bd-904d-6767d5861aa8 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:02.156839 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3382c80d-0f4c-4c58-92c0-1a24378aa7d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:02.161980 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3382c80d-0f4c-4c58-92c0-1a24378aa7d4 service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:02.190098 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2529/5035] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 16:00:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 842 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:00:02.223573 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d76507d-5cb7-45bd-904d-6767d5861aa8 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:02.246888 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e38f0d-0e54-4ce2-a437-c59cc31c76e6 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1342bb1824742b5b3e04e09e74f0c25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd485e73df78745ee98568f6b6c8b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:02.247526 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e38f0d-0e54-4ce2-a437-c59cc31c76e6 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:02.247767 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e38f0d-0e54-4ce2-a437-c59cc31c76e6 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:02.248046 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e38f0d-0e54-4ce2-a437-c59cc31c76e6 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/a9daaa80af3a4d0b968dfb715541bb3e/groups/162069dd3d2342b396b363ebfbc1ac55/roles/bef00e9d8013484ba68189694f021163/inherited_to_projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:02.255642 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e38f0d-0e54-4ce2-a437-c59cc31c76e6 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorizing `identity:check_grant(project_id=a9daaa80af3a4d0b968dfb715541bb3e, group_id=162069dd3d2342b396b363ebfbc1ac55, role_id=bef00e9d8013484ba68189694f021163)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:02.259305 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-67e38f0d-0e54-4ce2-a437-c59cc31c76e6 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:00:02.259305 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 16:00:02.259305 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 16:00:02.261301 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e38f0d-0e54-4ce2-a437-c59cc31c76e6 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:02.284401 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2507/5036] 10.222.0.83 () {58 vars in 1567 bytes} [Mon Aug 29 16:00:02 2022] HEAD /identity/v3/OS-INHERIT/projects/a9daaa80af3a4d0b968dfb715541bb3e/groups/162069dd3d2342b396b363ebfbc1ac55/roles/bef00e9d8013484ba68189694f021163/inherited_to_projects => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:02.289368 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382c80d-0f4c-4c58-92c0-1a24378aa7d4 service swift] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:02.319592 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382c80d-0f4c-4c58-92c0-1a24378aa7d4 service swift] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:02.347046 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970efa5-d812-4709-af15-8f5a7a1c9940 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1342bb1824742b5b3e04e09e74f0c25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd485e73df78745ee98568f6b6c8b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:02.352484 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970efa5-d812-4709-af15-8f5a7a1c9940 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:02.352865 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970efa5-d812-4709-af15-8f5a7a1c9940 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:02.353067 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970efa5-d812-4709-af15-8f5a7a1c9940 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/a9daaa80af3a4d0b968dfb715541bb3e/groups/162069dd3d2342b396b363ebfbc1ac55/roles/bef00e9d8013484ba68189694f021163/inherited_to_projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:02.368994 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b970efa5-d812-4709-af15-8f5a7a1c9940 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=a9daaa80af3a4d0b968dfb715541bb3e, group_id=162069dd3d2342b396b363ebfbc1ac55, role_id=bef00e9d8013484ba68189694f021163)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:02.383313 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-b970efa5-d812-4709-af15-8f5a7a1c9940 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:00:02.383313 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 16:00:02.383313 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 16:00:02.393285 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b970efa5-d812-4709-af15-8f5a7a1c9940 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:02.421534 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b970efa5-d812-4709-af15-8f5a7a1c9940 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invalidating the token cache because role bef00e9d8013484ba68189694f021163 was removed from group 162069dd3d2342b396b363ebfbc1ac55 on project a9daaa80af3a4d0b968dfb715541bb3e. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:02.422231 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b970efa5-d812-4709-af15-8f5a7a1c9940 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:02.425686 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b970efa5-d812-4709-af15-8f5a7a1c9940 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:02.458396 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2530/5037] 10.222.0.83 () {58 vars in 1569 bytes} [Mon Aug 29 16:00:02 2022] DELETE /identity/v3/OS-INHERIT/projects/a9daaa80af3a4d0b968dfb715541bb3e/groups/162069dd3d2342b396b363ebfbc1ac55/roles/bef00e9d8013484ba68189694f021163/inherited_to_projects => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:02.462770 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e38f0d-0e54-4ce2-a437-c59cc31c76e6 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:02.466133 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-67e38f0d-0e54-4ce2-a437-c59cc31c76e6 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:02.507856 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970efa5-d812-4709-af15-8f5a7a1c9940 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:02.509227 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b970efa5-d812-4709-af15-8f5a7a1c9940 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:02.516639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e38f0d-0e54-4ce2-a437-c59cc31c76e6 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:02.684862 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594839ed-b055-4d84-83b4-b3b6bab07445 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1342bb1824742b5b3e04e09e74f0c25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd485e73df78745ee98568f6b6c8b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:02.685522 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594839ed-b055-4d84-83b4-b3b6bab07445 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:02.685801 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594839ed-b055-4d84-83b4-b3b6bab07445 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:02.686076 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594839ed-b055-4d84-83b4-b3b6bab07445 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] PATH_INFO: `/v3/roles/bef00e9d8013484ba68189694f021163` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:02.689213 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594839ed-b055-4d84-83b4-b3b6bab07445 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorizing `identity:delete_role(role_id=bef00e9d8013484ba68189694f021163)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:02.692042 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-594839ed-b055-4d84-83b4-b3b6bab07445 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:00:02.692042 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 16:00:02.692042 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 16:00:02.693167 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970efa5-d812-4709-af15-8f5a7a1c9940 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:02.693304 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594839ed-b055-4d84-83b4-b3b6bab07445 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:02.714019 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ce17d-0ab1-46b0-a1db-3ecb375b94a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:02.714503 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ce17d-0ab1-46b0-a1db-3ecb375b94a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:02.714791 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ce17d-0ab1-46b0-a1db-3ecb375b94a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:02.715090 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ce17d-0ab1-46b0-a1db-3ecb375b94a6 admin admin] PATH_INFO: `/v3/users/cb19e91a38384cec80fae9ab170c78a3` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:02.723294 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ce17d-0ab1-46b0-a1db-3ecb375b94a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb19e91a38384cec80fae9ab170c78a3)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:02.728446 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ce17d-0ab1-46b0-a1db-3ecb375b94a6 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:02.855653 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-794ce17d-0ab1-46b0-a1db-3ecb375b94a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb19e91a38384cec80fae9ab170c78a3'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:02.859952 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-794ce17d-0ab1-46b0-a1db-3ecb375b94a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb19e91a38384cec80fae9ab170c78a3'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:02.878054 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-594839ed-b055-4d84-83b4-b3b6bab07445 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invalidating the token cache because role bef00e9d8013484ba68189694f021163 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:02.879158 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-594839ed-b055-4d84-83b4-b3b6bab07445 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:02.885316 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-594839ed-b055-4d84-83b4-b3b6bab07445 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:02.891488 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2508/5038] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:00:02 2022] DELETE /identity/v3/roles/bef00e9d8013484ba68189694f021163 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:02.896930 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594839ed-b055-4d84-83b4-b3b6bab07445 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:02.898766 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-594839ed-b055-4d84-83b4-b3b6bab07445 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:02.908888 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-794ce17d-0ab1-46b0-a1db-3ecb375b94a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb19e91a38384cec80fae9ab170c78a3'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:02.932593 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-794ce17d-0ab1-46b0-a1db-3ecb375b94a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb19e91a38384cec80fae9ab170c78a3'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:02.945671 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:02.961016 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-794ce17d-0ab1-46b0-a1db-3ecb375b94a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb19e91a38384cec80fae9ab170c78a3'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:02.991440 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2531/5039] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:00:02 2022] DELETE /identity/v3/users/cb19e91a38384cec80fae9ab170c78a3 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:02.995520 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a7c72-129f-4113-a1af-417589259e69 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:02.995813 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a7c72-129f-4113-a1af-417589259e69 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:02.996092 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a7c72-129f-4113-a1af-417589259e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:03.069101 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-d23a7c72-129f-4113-a1af-417589259e69 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:03.070375 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d23a7c72-129f-4113-a1af-417589259e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:03.093974 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:03.162574 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594839ed-b055-4d84-83b4-b3b6bab07445 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:03.308537 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2532/5040] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:03.318814 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23a7c72-129f-4113-a1af-417589259e69 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:03.320891 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d23a7c72-129f-4113-a1af-417589259e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:03.346653 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc2b16-5e4f-493a-9024-1ac43c151504 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1342bb1824742b5b3e04e09e74f0c25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd485e73df78745ee98568f6b6c8b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:03.352203 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc2b16-5e4f-493a-9024-1ac43c151504 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:03.352609 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc2b16-5e4f-493a-9024-1ac43c151504 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:03.353082 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc2b16-5e4f-493a-9024-1ac43c151504 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:03.354457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bc2b16-5e4f-493a-9024-1ac43c151504 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:03.359358 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bc2b16-5e4f-493a-9024-1ac43c151504 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:03.399978 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2509/5041] 10.222.0.83 () {60 vars in 1143 bytes} [Mon Aug 29 16:00:02 2022] POST /identity/v3/roles => generated 240 bytes in 500 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:00:03.401342 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc2b16-5e4f-493a-9024-1ac43c151504 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:03.403401 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-70bc2b16-5e4f-493a-9024-1ac43c151504 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:03.435888 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc2b16-5e4f-493a-9024-1ac43c151504 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:03.459554 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62619673-aa94-4196-b483-8ce8dc032eb7 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1342bb1824742b5b3e04e09e74f0c25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd485e73df78745ee98568f6b6c8b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:03.461425 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62619673-aa94-4196-b483-8ce8dc032eb7 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:03.461924 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62619673-aa94-4196-b483-8ce8dc032eb7 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:03.462552 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62619673-aa94-4196-b483-8ce8dc032eb7 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/a9daaa80af3a4d0b968dfb715541bb3e/users/953d39d52686434b804cc20c02f7a2fc/roles/6de9adea1a00429a98fe90fe2dd7a5da/inherited_to_projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:03.510391 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62619673-aa94-4196-b483-8ce8dc032eb7 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a9daaa80af3a4d0b968dfb715541bb3e, user_id=953d39d52686434b804cc20c02f7a2fc, role_id=6de9adea1a00429a98fe90fe2dd7a5da)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:03.514733 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62619673-aa94-4196-b483-8ce8dc032eb7 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:03.541914 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2510/5042] 10.222.0.83 () {60 vars in 1582 bytes} [Mon Aug 29 16:00:03 2022] PUT /identity/v3/OS-INHERIT/projects/a9daaa80af3a4d0b968dfb715541bb3e/users/953d39d52686434b804cc20c02f7a2fc/roles/6de9adea1a00429a98fe90fe2dd7a5da/inherited_to_projects => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:03.545862 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23a7c72-129f-4113-a1af-417589259e69 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:03.557373 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62619673-aa94-4196-b483-8ce8dc032eb7 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:03.736786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62619673-aa94-4196-b483-8ce8dc032eb7 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:03.749708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a9bd6-2a2b-45dd-9437-4cd9dba2b552 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1342bb1824742b5b3e04e09e74f0c25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd485e73df78745ee98568f6b6c8b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:03.752767 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a9bd6-2a2b-45dd-9437-4cd9dba2b552 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:03.753174 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a9bd6-2a2b-45dd-9437-4cd9dba2b552 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:03.755691 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a9bd6-2a2b-45dd-9437-4cd9dba2b552 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/a9daaa80af3a4d0b968dfb715541bb3e/users/953d39d52686434b804cc20c02f7a2fc/roles/6de9adea1a00429a98fe90fe2dd7a5da/inherited_to_projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:03.761277 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855a9bd6-2a2b-45dd-9437-4cd9dba2b552 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorizing `identity:check_grant(project_id=a9daaa80af3a4d0b968dfb715541bb3e, user_id=953d39d52686434b804cc20c02f7a2fc, role_id=6de9adea1a00429a98fe90fe2dd7a5da)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:03.763335 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca156d7-74b7-4e96-aa66-2a5a2af47086 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:03.765035 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca156d7-74b7-4e96-aa66-2a5a2af47086 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:03.765887 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca156d7-74b7-4e96-aa66-2a5a2af47086 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:03.766195 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca156d7-74b7-4e96-aa66-2a5a2af47086 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:03.768833 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855a9bd6-2a2b-45dd-9437-4cd9dba2b552 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:03.791722 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2511/5043] 10.222.0.83 () {58 vars in 1564 bytes} [Mon Aug 29 16:00:03 2022] HEAD /identity/v3/OS-INHERIT/projects/a9daaa80af3a4d0b968dfb715541bb3e/users/953d39d52686434b804cc20c02f7a2fc/roles/6de9adea1a00429a98fe90fe2dd7a5da/inherited_to_projects => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:03.793828 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a9bd6-2a2b-45dd-9437-4cd9dba2b552 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:03.831193 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a9bd6-2a2b-45dd-9437-4cd9dba2b552 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:03.852900 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e1fac-82cf-4a94-b1ca-65789a877bca tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1342bb1824742b5b3e04e09e74f0c25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd485e73df78745ee98568f6b6c8b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:03.856616 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e1fac-82cf-4a94-b1ca-65789a877bca tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:03.858354 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e1fac-82cf-4a94-b1ca-65789a877bca tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:03.859332 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e1fac-82cf-4a94-b1ca-65789a877bca tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/a9daaa80af3a4d0b968dfb715541bb3e/users/953d39d52686434b804cc20c02f7a2fc/roles/6de9adea1a00429a98fe90fe2dd7a5da/inherited_to_projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:03.868241 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e1fac-82cf-4a94-b1ca-65789a877bca tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=a9daaa80af3a4d0b968dfb715541bb3e, user_id=953d39d52686434b804cc20c02f7a2fc, role_id=6de9adea1a00429a98fe90fe2dd7a5da)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:03.872407 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-b99e1fac-82cf-4a94-b1ca-65789a877bca tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:00:03.872407 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 16:00:03.872407 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 16:00:03.880575 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e1fac-82cf-4a94-b1ca-65789a877bca tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:03.900790 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b99e1fac-82cf-4a94-b1ca-65789a877bca tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invalidating the token cache because role 6de9adea1a00429a98fe90fe2dd7a5da was removed from user 953d39d52686434b804cc20c02f7a2fc on project a9daaa80af3a4d0b968dfb715541bb3e. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:03.901882 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b99e1fac-82cf-4a94-b1ca-65789a877bca tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:03.904320 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b99e1fac-82cf-4a94-b1ca-65789a877bca tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:03.959124 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2512/5044] 10.222.0.83 () {58 vars in 1566 bytes} [Mon Aug 29 16:00:03 2022] DELETE /identity/v3/OS-INHERIT/projects/a9daaa80af3a4d0b968dfb715541bb3e/users/953d39d52686434b804cc20c02f7a2fc/roles/6de9adea1a00429a98fe90fe2dd7a5da/inherited_to_projects => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:03.963651 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e1fac-82cf-4a94-b1ca-65789a877bca tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:03.965230 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b99e1fac-82cf-4a94-b1ca-65789a877bca tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:03.993425 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca156d7-74b7-4e96-aa66-2a5a2af47086 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:04.016548 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca156d7-74b7-4e96-aa66-2a5a2af47086 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:04.030615 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:04.048007 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2533/5045] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:00:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 730 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:00:04.135545 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:04.213075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e1fac-82cf-4a94-b1ca-65789a877bca tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:04.238486 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28192c7-122f-4625-aa1a-f6513e83326e tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1342bb1824742b5b3e04e09e74f0c25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd485e73df78745ee98568f6b6c8b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:04.239171 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28192c7-122f-4625-aa1a-f6513e83326e tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:04.239456 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28192c7-122f-4625-aa1a-f6513e83326e tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:04.239731 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28192c7-122f-4625-aa1a-f6513e83326e tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] PATH_INFO: `/v3/roles/6de9adea1a00429a98fe90fe2dd7a5da` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:04.256065 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28192c7-122f-4625-aa1a-f6513e83326e tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorizing `identity:delete_role(role_id=6de9adea1a00429a98fe90fe2dd7a5da)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:04.257675 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28192c7-122f-4625-aa1a-f6513e83326e tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:04.399639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c28192c7-122f-4625-aa1a-f6513e83326e tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invalidating the token cache because role 6de9adea1a00429a98fe90fe2dd7a5da has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:04.399938 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c28192c7-122f-4625-aa1a-f6513e83326e tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:04.412016 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c28192c7-122f-4625-aa1a-f6513e83326e tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:04.417676 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2513/5046] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:00:03 2022] DELETE /identity/v3/roles/6de9adea1a00429a98fe90fe2dd7a5da => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:04.422941 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca156d7-74b7-4e96-aa66-2a5a2af47086 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:04.443130 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca156d7-74b7-4e96-aa66-2a5a2af47086 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:04.604339 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8c6fc-bf72-4b6a-94b0-80e1af04983c tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1342bb1824742b5b3e04e09e74f0c25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd485e73df78745ee98568f6b6c8b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:04.605132 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8c6fc-bf72-4b6a-94b0-80e1af04983c tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:04.606671 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8c6fc-bf72-4b6a-94b0-80e1af04983c tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:04.607055 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8c6fc-bf72-4b6a-94b0-80e1af04983c tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:04.608447 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c8c6fc-bf72-4b6a-94b0-80e1af04983c tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:04.611128 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-37c8c6fc-bf72-4b6a-94b0-80e1af04983c tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:00:04.611128 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 16:00:04.611128 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 16:00:04.614707 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c8c6fc-bf72-4b6a-94b0-80e1af04983c tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:04.660086 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2534/5047] 10.222.0.83 () {60 vars in 1143 bytes} [Mon Aug 29 16:00:04 2022] POST /identity/v3/roles => generated 240 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:04.661606 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28192c7-122f-4625-aa1a-f6513e83326e tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:04.663224 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c28192c7-122f-4625-aa1a-f6513e83326e tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:04.701498 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28192c7-122f-4625-aa1a-f6513e83326e tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:04.715207 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5d1c8-9feb-4c7f-b1ac-ada6df920ec9 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1342bb1824742b5b3e04e09e74f0c25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd485e73df78745ee98568f6b6c8b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:04.715920 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5d1c8-9feb-4c7f-b1ac-ada6df920ec9 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:04.716201 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5d1c8-9feb-4c7f-b1ac-ada6df920ec9 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:04.717212 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5d1c8-9feb-4c7f-b1ac-ada6df920ec9 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/057b3e5bb65c443a909604cac56b2bb4/groups/162069dd3d2342b396b363ebfbc1ac55/roles/4bc6a50d76954298bf0de8ce1ec2adde/inherited_to_projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:04.721608 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac5d1c8-9feb-4c7f-b1ac-ada6df920ec9 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=057b3e5bb65c443a909604cac56b2bb4, group_id=162069dd3d2342b396b363ebfbc1ac55, role_id=4bc6a50d76954298bf0de8ce1ec2adde)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:04.724788 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac5d1c8-9feb-4c7f-b1ac-ada6df920ec9 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:04.768131 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2514/5048] 10.222.0.83 () {60 vars in 1582 bytes} [Mon Aug 29 16:00:04 2022] PUT /identity/v3/OS-INHERIT/domains/057b3e5bb65c443a909604cac56b2bb4/groups/162069dd3d2342b396b363ebfbc1ac55/roles/4bc6a50d76954298bf0de8ce1ec2adde/inherited_to_projects => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:04.773066 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8c6fc-bf72-4b6a-94b0-80e1af04983c tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:04.792626 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8c6fc-bf72-4b6a-94b0-80e1af04983c tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:04.914509 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5d1c8-9feb-4c7f-b1ac-ada6df920ec9 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:04.916616 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-fac5d1c8-9feb-4c7f-b1ac-ada6df920ec9 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:04.970229 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da09c14-fc6d-4af1-bf08-22bd90be95f2 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1342bb1824742b5b3e04e09e74f0c25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd485e73df78745ee98568f6b6c8b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:04.971417 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da09c14-fc6d-4af1-bf08-22bd90be95f2 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:04.971738 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da09c14-fc6d-4af1-bf08-22bd90be95f2 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:04.972068 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da09c14-fc6d-4af1-bf08-22bd90be95f2 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/057b3e5bb65c443a909604cac56b2bb4/groups/162069dd3d2342b396b363ebfbc1ac55/roles/inherited_to_projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:04.979202 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da09c14-fc6d-4af1-bf08-22bd90be95f2 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=057b3e5bb65c443a909604cac56b2bb4, group_id=162069dd3d2342b396b363ebfbc1ac55)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:04.980667 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-5da09c14-fc6d-4af1-bf08-22bd90be95f2 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:00:04.980667 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 16:00:04.980667 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 16:00:04.988146 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da09c14-fc6d-4af1-bf08-22bd90be95f2 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:05.033514 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2535/5049] 10.222.0.83 () {58 vars in 1464 bytes} [Mon Aug 29 16:00:04 2022] GET /identity/v3/OS-INHERIT/domains/057b3e5bb65c443a909604cac56b2bb4/groups/162069dd3d2342b396b363ebfbc1ac55/roles/inherited_to_projects => generated 448 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:00:05.034122 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da09c14-fc6d-4af1-bf08-22bd90be95f2 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:05.048617 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da09c14-fc6d-4af1-bf08-22bd90be95f2 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:05.054571 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121cecab-0aee-41e5-9e73-049e84de8c37 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1342bb1824742b5b3e04e09e74f0c25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd485e73df78745ee98568f6b6c8b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:05.055838 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121cecab-0aee-41e5-9e73-049e84de8c37 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:05.056131 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121cecab-0aee-41e5-9e73-049e84de8c37 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:05.056417 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121cecab-0aee-41e5-9e73-049e84de8c37 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/057b3e5bb65c443a909604cac56b2bb4/groups/162069dd3d2342b396b363ebfbc1ac55/roles/4bc6a50d76954298bf0de8ce1ec2adde/inherited_to_projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:05.058702 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121cecab-0aee-41e5-9e73-049e84de8c37 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=057b3e5bb65c443a909604cac56b2bb4, group_id=162069dd3d2342b396b363ebfbc1ac55, role_id=4bc6a50d76954298bf0de8ce1ec2adde)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:05.059808 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-121cecab-0aee-41e5-9e73-049e84de8c37 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:00:05.059808 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 16:00:05.059808 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 16:00:05.061947 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121cecab-0aee-41e5-9e73-049e84de8c37 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:05.074186 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2536/5050] 10.222.0.83 () {58 vars in 1564 bytes} [Mon Aug 29 16:00:05 2022] HEAD /identity/v3/OS-INHERIT/domains/057b3e5bb65c443a909604cac56b2bb4/groups/162069dd3d2342b396b363ebfbc1ac55/roles/4bc6a50d76954298bf0de8ce1ec2adde/inherited_to_projects => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:05.075377 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121cecab-0aee-41e5-9e73-049e84de8c37 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:05.096487 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121cecab-0aee-41e5-9e73-049e84de8c37 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:05.108555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428b19b-2379-4706-818d-58eeb6fb9799 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1342bb1824742b5b3e04e09e74f0c25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd485e73df78745ee98568f6b6c8b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:05.109292 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428b19b-2379-4706-818d-58eeb6fb9799 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:05.109699 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428b19b-2379-4706-818d-58eeb6fb9799 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:05.109983 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428b19b-2379-4706-818d-58eeb6fb9799 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/057b3e5bb65c443a909604cac56b2bb4/groups/162069dd3d2342b396b363ebfbc1ac55/roles/4bc6a50d76954298bf0de8ce1ec2adde/inherited_to_projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:05.112693 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5428b19b-2379-4706-818d-58eeb6fb9799 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=057b3e5bb65c443a909604cac56b2bb4, group_id=162069dd3d2342b396b363ebfbc1ac55, role_id=4bc6a50d76954298bf0de8ce1ec2adde)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:05.116326 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5d1c8-9feb-4c7f-b1ac-ada6df920ec9 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:05.116682 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5428b19b-2379-4706-818d-58eeb6fb9799 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:05.130763 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4808914-5e48-4d6f-b019-14ad74239674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:05.131743 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4808914-5e48-4d6f-b019-14ad74239674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:05.132190 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4808914-5e48-4d6f-b019-14ad74239674 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:05.132627 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4808914-5e48-4d6f-b019-14ad74239674 admin admin] PATH_INFO: `/v3/projects/e699b1cdcc51497da334983f84d624f2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:05.135052 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4808914-5e48-4d6f-b019-14ad74239674 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e699b1cdcc51497da334983f84d624f2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:05.135249 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5428b19b-2379-4706-818d-58eeb6fb9799 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invalidating the token cache because role 4bc6a50d76954298bf0de8ce1ec2adde was removed from group 162069dd3d2342b396b363ebfbc1ac55 on domain 057b3e5bb65c443a909604cac56b2bb4. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:05.135560 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5428b19b-2379-4706-818d-58eeb6fb9799 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:05.136295 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5428b19b-2379-4706-818d-58eeb6fb9799 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:05.139276 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4808914-5e48-4d6f-b019-14ad74239674 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:05.165399 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2537/5051] 10.222.0.83 () {58 vars in 1566 bytes} [Mon Aug 29 16:00:05 2022] DELETE /identity/v3/OS-INHERIT/domains/057b3e5bb65c443a909604cac56b2bb4/groups/162069dd3d2342b396b363ebfbc1ac55/roles/4bc6a50d76954298bf0de8ce1ec2adde/inherited_to_projects => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:05.170280 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428b19b-2379-4706-818d-58eeb6fb9799 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:05.177801 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5428b19b-2379-4706-818d-58eeb6fb9799 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:05.276140 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d4808914-5e48-4d6f-b019-14ad74239674 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e699b1cdcc51497da334983f84d624f2', 'request_id': 'req-d4808914-5e48-4d6f-b019-14ad74239674'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:05.290847 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d4808914-5e48-4d6f-b019-14ad74239674 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e699b1cdcc51497da334983f84d624f2', 'request_id': 'req-d4808914-5e48-4d6f-b019-14ad74239674'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:05.307706 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d4808914-5e48-4d6f-b019-14ad74239674 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e699b1cdcc51497da334983f84d624f2', 'request_id': 'req-d4808914-5e48-4d6f-b019-14ad74239674'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:05.331635 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d4808914-5e48-4d6f-b019-14ad74239674 admin admin] The token cache is being invalidate because project e699b1cdcc51497da334983f84d624f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:05.331935 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d4808914-5e48-4d6f-b019-14ad74239674 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:05.333096 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d4808914-5e48-4d6f-b019-14ad74239674 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:05.337224 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2515/5052] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:00:04 2022] DELETE /identity/v3/projects/e699b1cdcc51497da334983f84d624f2 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:00:05.342563 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1535be-d812-4af0-8a0f-d41739f7a55f None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:05.342753 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1535be-d812-4af0-8a0f-d41739f7a55f None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:05.343159 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1535be-d812-4af0-8a0f-d41739f7a55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:05.411270 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-3c1535be-d812-4af0-8a0f-d41739f7a55f None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:05.425567 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3c1535be-d812-4af0-8a0f-d41739f7a55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:05.430628 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428b19b-2379-4706-818d-58eeb6fb9799 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:05.444667 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:05.469741 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:05.561311 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2516/5053] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:05.567968 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34971af-29bc-4e50-a3bd-fd965f86fbbe None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:05.568263 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34971af-29bc-4e50-a3bd-fd965f86fbbe None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:05.568963 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34971af-29bc-4e50-a3bd-fd965f86fbbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:05.594576 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33f920-687f-41c1-b1bc-819eecd6da6b tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1342bb1824742b5b3e04e09e74f0c25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd485e73df78745ee98568f6b6c8b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:05.595770 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33f920-687f-41c1-b1bc-819eecd6da6b tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:05.599458 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33f920-687f-41c1-b1bc-819eecd6da6b tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:05.599743 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33f920-687f-41c1-b1bc-819eecd6da6b tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] PATH_INFO: `/v3/roles/4bc6a50d76954298bf0de8ce1ec2adde` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:05.601943 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c33f920-687f-41c1-b1bc-819eecd6da6b tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4bc6a50d76954298bf0de8ce1ec2adde)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:05.602986 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-0c33f920-687f-41c1-b1bc-819eecd6da6b tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:00:05.602986 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 16:00:05.602986 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 16:00:05.607845 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c33f920-687f-41c1-b1bc-819eecd6da6b tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:05.641362 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-c34971af-29bc-4e50-a3bd-fd965f86fbbe None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:05.642508 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c34971af-29bc-4e50-a3bd-fd965f86fbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:05.653117 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2517/5054] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:05.656821 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34971af-29bc-4e50-a3bd-fd965f86fbbe None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:05.671782 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34971af-29bc-4e50-a3bd-fd965f86fbbe None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:05.685237 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a75e71-c566-486d-a988-c28a23a2625b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:05.685974 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a75e71-c566-486d-a988-c28a23a2625b admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:05.686326 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a75e71-c566-486d-a988-c28a23a2625b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:05.687060 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a75e71-c566-486d-a988-c28a23a2625b admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:05.688542 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a75e71-c566-486d-a988-c28a23a2625b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:00:05.689072 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a75e71-c566-486d-a988-c28a23a2625b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:05.693649 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a75e71-c566-486d-a988-c28a23a2625b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:05.709526 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0c33f920-687f-41c1-b1bc-819eecd6da6b tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invalidating the token cache because role 4bc6a50d76954298bf0de8ce1ec2adde has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:05.709979 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0c33f920-687f-41c1-b1bc-819eecd6da6b tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:05.711307 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0c33f920-687f-41c1-b1bc-819eecd6da6b tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:05.721099 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2538/5055] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:00:05 2022] DELETE /identity/v3/roles/4bc6a50d76954298bf0de8ce1ec2adde => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:05.723005 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33f920-687f-41c1-b1bc-819eecd6da6b tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:05.724665 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0c33f920-687f-41c1-b1bc-819eecd6da6b tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:05.729095 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2518/5056] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:00:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:00:05.731006 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a75e71-c566-486d-a988-c28a23a2625b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:05.733743 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-47a75e71-c566-486d-a988-c28a23a2625b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:05.782324 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a75e71-c566-486d-a988-c28a23a2625b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:05.863750 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33f920-687f-41c1-b1bc-819eecd6da6b tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:05.875320 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9a170-a234-4a43-a171-9d7e4a1ba3e4 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1342bb1824742b5b3e04e09e74f0c25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd485e73df78745ee98568f6b6c8b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:05.875974 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9a170-a234-4a43-a171-9d7e4a1ba3e4 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:05.876311 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9a170-a234-4a43-a171-9d7e4a1ba3e4 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:05.876591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9a170-a234-4a43-a171-9d7e4a1ba3e4 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:05.877354 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b9a170-a234-4a43-a171-9d7e4a1ba3e4 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:05.883547 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b9a170-a234-4a43-a171-9d7e4a1ba3e4 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:05.920505 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2539/5057] 10.222.0.83 () {60 vars in 1143 bytes} [Mon Aug 29 16:00:05 2022] POST /identity/v3/roles => generated 240 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:05.921679 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9a170-a234-4a43-a171-9d7e4a1ba3e4 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:05.957142 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c37ae1-541d-435b-b00c-6f63dbbc0b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:05.957838 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9a170-a234-4a43-a171-9d7e4a1ba3e4 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:05.958291 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c37ae1-541d-435b-b00c-6f63dbbc0b43 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:05.958742 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c37ae1-541d-435b-b00c-6f63dbbc0b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:05.959638 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c37ae1-541d-435b-b00c-6f63dbbc0b43 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:05.960088 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c37ae1-541d-435b-b00c-6f63dbbc0b43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:05.962622 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c37ae1-541d-435b-b00c-6f63dbbc0b43 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:05.979319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be5642-b6f8-403a-8b95-2111199959d0 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1342bb1824742b5b3e04e09e74f0c25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd485e73df78745ee98568f6b6c8b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:05.980104 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be5642-b6f8-403a-8b95-2111199959d0 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:05.980389 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be5642-b6f8-403a-8b95-2111199959d0 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:05.980673 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be5642-b6f8-403a-8b95-2111199959d0 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/057b3e5bb65c443a909604cac56b2bb4/users/953d39d52686434b804cc20c02f7a2fc/roles/2aee27f8647846d796b5249e8ce2a9cb/inherited_to_projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:05.987129 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54be5642-b6f8-403a-8b95-2111199959d0 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=057b3e5bb65c443a909604cac56b2bb4, user_id=953d39d52686434b804cc20c02f7a2fc, role_id=2aee27f8647846d796b5249e8ce2a9cb)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:05.992971 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54be5642-b6f8-403a-8b95-2111199959d0 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:06.014105 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2519/5058] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:00:05 2022] POST /identity/v3/projects => generated 363 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:00:06.015908 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c37ae1-541d-435b-b00c-6f63dbbc0b43 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:06.030730 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2540/5059] 10.222.0.83 () {60 vars in 1579 bytes} [Mon Aug 29 16:00:05 2022] PUT /identity/v3/OS-INHERIT/domains/057b3e5bb65c443a909604cac56b2bb4/users/953d39d52686434b804cc20c02f7a2fc/roles/2aee27f8647846d796b5249e8ce2a9cb/inherited_to_projects => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:06.032558 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be5642-b6f8-403a-8b95-2111199959d0 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:06.141507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:06.149552 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c37ae1-541d-435b-b00c-6f63dbbc0b43 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:06.157597 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fcc143-52fb-48c8-a930-94cc9651a5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:06.158228 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fcc143-52fb-48c8-a930-94cc9651a5d5 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:06.158614 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fcc143-52fb-48c8-a930-94cc9651a5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:06.158897 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fcc143-52fb-48c8-a930-94cc9651a5d5 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:06.162698 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fcc143-52fb-48c8-a930-94cc9651a5d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:06.165036 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fcc143-52fb-48c8-a930-94cc9651a5d5 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:06.182371 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be5642-b6f8-403a-8b95-2111199959d0 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:06.226515 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2520/5060] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:00:06 2022] POST /identity/v3/users => generated 282 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:06.227455 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fcc143-52fb-48c8-a930-94cc9651a5d5 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:06.240837 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fcc143-52fb-48c8-a930-94cc9651a5d5 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:06.252705 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe3b84-73d6-4b60-a89b-339e26efe832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:06.253330 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe3b84-73d6-4b60-a89b-339e26efe832 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:06.253618 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe3b84-73d6-4b60-a89b-339e26efe832 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:06.253935 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe3b84-73d6-4b60-a89b-339e26efe832 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:06.254680 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe3b84-73d6-4b60-a89b-339e26efe832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:06.256316 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe3b84-73d6-4b60-a89b-339e26efe832 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:06.263561 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e7cba-8539-41fa-b8b9-3ca238b90e10 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1342bb1824742b5b3e04e09e74f0c25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd485e73df78745ee98568f6b6c8b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:06.264352 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e7cba-8539-41fa-b8b9-3ca238b90e10 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:06.264639 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e7cba-8539-41fa-b8b9-3ca238b90e10 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:06.264917 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e7cba-8539-41fa-b8b9-3ca238b90e10 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/057b3e5bb65c443a909604cac56b2bb4/users/953d39d52686434b804cc20c02f7a2fc/roles/inherited_to_projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:06.266678 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e7cba-8539-41fa-b8b9-3ca238b90e10 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=057b3e5bb65c443a909604cac56b2bb4, user_id=953d39d52686434b804cc20c02f7a2fc)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:06.270073 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e7cba-8539-41fa-b8b9-3ca238b90e10 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:06.288161 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2521/5061] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:00:06 2022] GET /identity/v3/roles => generated 1651 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:00:06.288364 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2541/5062] 10.222.0.83 () {58 vars in 1461 bytes} [Mon Aug 29 16:00:06 2022] GET /identity/v3/OS-INHERIT/domains/057b3e5bb65c443a909604cac56b2bb4/users/953d39d52686434b804cc20c02f7a2fc/roles/inherited_to_projects => generated 447 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:00:06.289109 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe3b84-73d6-4b60-a89b-339e26efe832 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:06.289328 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e7cba-8539-41fa-b8b9-3ca238b90e10 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:06.302327 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e7cba-8539-41fa-b8b9-3ca238b90e10 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:06.309028 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3d141-355e-45a0-b1ac-22f62bffc563 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1342bb1824742b5b3e04e09e74f0c25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd485e73df78745ee98568f6b6c8b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:06.309770 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3d141-355e-45a0-b1ac-22f62bffc563 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:06.310055 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3d141-355e-45a0-b1ac-22f62bffc563 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:06.310474 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3d141-355e-45a0-b1ac-22f62bffc563 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/057b3e5bb65c443a909604cac56b2bb4/users/953d39d52686434b804cc20c02f7a2fc/roles/2aee27f8647846d796b5249e8ce2a9cb/inherited_to_projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:06.311657 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe3b84-73d6-4b60-a89b-339e26efe832 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:06.313343 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb3d141-355e-45a0-b1ac-22f62bffc563 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=057b3e5bb65c443a909604cac56b2bb4, user_id=953d39d52686434b804cc20c02f7a2fc, role_id=2aee27f8647846d796b5249e8ce2a9cb)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:06.316933 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb3d141-355e-45a0-b1ac-22f62bffc563 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:06.327370 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2542/5063] 10.222.0.83 () {58 vars in 1561 bytes} [Mon Aug 29 16:00:06 2022] HEAD /identity/v3/OS-INHERIT/domains/057b3e5bb65c443a909604cac56b2bb4/users/953d39d52686434b804cc20c02f7a2fc/roles/2aee27f8647846d796b5249e8ce2a9cb/inherited_to_projects => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:06.328293 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3d141-355e-45a0-b1ac-22f62bffc563 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:06.330815 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab36ec2-d3e5-4c0b-868f-a8b22e87fba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:06.332099 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab36ec2-d3e5-4c0b-868f-a8b22e87fba9 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:06.332401 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab36ec2-d3e5-4c0b-868f-a8b22e87fba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:06.332742 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab36ec2-d3e5-4c0b-868f-a8b22e87fba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:06.333449 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab36ec2-d3e5-4c0b-868f-a8b22e87fba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:06.335083 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab36ec2-d3e5-4c0b-868f-a8b22e87fba9 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:06.339935 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3d141-355e-45a0-b1ac-22f62bffc563 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:06.341529 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:06.348156 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec784584-b7d5-4d45-b2af-e2b0441d2550 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1342bb1824742b5b3e04e09e74f0c25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd485e73df78745ee98568f6b6c8b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:06.348855 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec784584-b7d5-4d45-b2af-e2b0441d2550 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:06.350703 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec784584-b7d5-4d45-b2af-e2b0441d2550 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:06.351581 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec784584-b7d5-4d45-b2af-e2b0441d2550 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/057b3e5bb65c443a909604cac56b2bb4/users/953d39d52686434b804cc20c02f7a2fc/roles/2aee27f8647846d796b5249e8ce2a9cb/inherited_to_projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:06.356050 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec784584-b7d5-4d45-b2af-e2b0441d2550 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=057b3e5bb65c443a909604cac56b2bb4, user_id=953d39d52686434b804cc20c02f7a2fc, role_id=2aee27f8647846d796b5249e8ce2a9cb)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:06.362403 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2522/5064] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:00:06 2022] GET /identity/v3/roles => generated 1651 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:00:06.364481 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec784584-b7d5-4d45-b2af-e2b0441d2550 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:06.370376 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab36ec2-d3e5-4c0b-868f-a8b22e87fba9 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:06.370848 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ec784584-b7d5-4d45-b2af-e2b0441d2550 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invalidating the token cache because role 2aee27f8647846d796b5249e8ce2a9cb was removed from user 953d39d52686434b804cc20c02f7a2fc on domain 057b3e5bb65c443a909604cac56b2bb4. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:06.371404 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ec784584-b7d5-4d45-b2af-e2b0441d2550 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:06.372465 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ec784584-b7d5-4d45-b2af-e2b0441d2550 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:06.396826 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab36ec2-d3e5-4c0b-868f-a8b22e87fba9 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:06.400743 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2543/5065] 10.222.0.83 () {58 vars in 1563 bytes} [Mon Aug 29 16:00:06 2022] DELETE /identity/v3/OS-INHERIT/domains/057b3e5bb65c443a909604cac56b2bb4/users/953d39d52686434b804cc20c02f7a2fc/roles/2aee27f8647846d796b5249e8ce2a9cb/inherited_to_projects => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:06.402674 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec784584-b7d5-4d45-b2af-e2b0441d2550 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:06.405713 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ec784584-b7d5-4d45-b2af-e2b0441d2550 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:06.522576 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046fc0b-ac07-479d-87c2-30e5f55a0570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:06.523647 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046fc0b-ac07-479d-87c2-30e5f55a0570 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:06.524227 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046fc0b-ac07-479d-87c2-30e5f55a0570 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:06.524507 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046fc0b-ac07-479d-87c2-30e5f55a0570 admin admin] PATH_INFO: `/v3/projects/0173dc7b6f834d59a64b0dfeb92fd722/users/8825ae8ecb0944d79b43debc60be1a95/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:06.545099 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046fc0b-ac07-479d-87c2-30e5f55a0570 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0173dc7b6f834d59a64b0dfeb92fd722, user_id=8825ae8ecb0944d79b43debc60be1a95, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:06.547935 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046fc0b-ac07-479d-87c2-30e5f55a0570 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:06.571058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec784584-b7d5-4d45-b2af-e2b0441d2550 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:06.577402 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2523/5066] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:00:06 2022] PUT /identity/v3/projects/0173dc7b6f834d59a64b0dfeb92fd722/users/8825ae8ecb0944d79b43debc60be1a95/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:06.590084 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e37e89-1151-499f-bd6f-d2baf6ab2f4d None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:06.590372 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e37e89-1151-499f-bd6f-d2baf6ab2f4d None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:06.590630 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e37e89-1151-499f-bd6f-d2baf6ab2f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:06.630866 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-e3e37e89-1151-499f-bd6f-d2baf6ab2f4d None None] MFA Rules not processed for user `8825ae8ecb0944d79b43debc60be1a95`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:06.632662 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e3e37e89-1151-499f-bd6f-d2baf6ab2f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:06.726988 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0813dc-cec4-4e8b-81b3-1db418cf1c02 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1342bb1824742b5b3e04e09e74f0c25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd485e73df78745ee98568f6b6c8b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:06.727675 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0813dc-cec4-4e8b-81b3-1db418cf1c02 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:06.727956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0813dc-cec4-4e8b-81b3-1db418cf1c02 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:06.728225 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0813dc-cec4-4e8b-81b3-1db418cf1c02 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] PATH_INFO: `/v3/roles/2aee27f8647846d796b5249e8ce2a9cb` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:06.747338 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0813dc-cec4-4e8b-81b3-1db418cf1c02 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2aee27f8647846d796b5249e8ce2a9cb)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:06.748984 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0813dc-cec4-4e8b-81b3-1db418cf1c02 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:06.758734 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2524/5067] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:06.762951 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e37e89-1151-499f-bd6f-d2baf6ab2f4d None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:06.764654 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e3e37e89-1151-499f-bd6f-d2baf6ab2f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:06.773956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:06.815471 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ee0813dc-cec4-4e8b-81b3-1db418cf1c02 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invalidating the token cache because role 2aee27f8647846d796b5249e8ce2a9cb has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:06.815765 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ee0813dc-cec4-4e8b-81b3-1db418cf1c02 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:06.818753 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ee0813dc-cec4-4e8b-81b3-1db418cf1c02 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:06.821295 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2544/5068] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:00:06 2022] DELETE /identity/v3/roles/2aee27f8647846d796b5249e8ce2a9cb => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:06.828730 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0813dc-cec4-4e8b-81b3-1db418cf1c02 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:06.830186 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ee0813dc-cec4-4e8b-81b3-1db418cf1c02 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:06.933718 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e37e89-1151-499f-bd6f-d2baf6ab2f4d None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:06.965535 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:06.973195 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0813dc-cec4-4e8b-81b3-1db418cf1c02 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:06.983875 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febecc0a-af4a-42cc-a60c-18691be1d989 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1342bb1824742b5b3e04e09e74f0c25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd485e73df78745ee98568f6b6c8b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:06.984520 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febecc0a-af4a-42cc-a60c-18691be1d989 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:06.984794 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febecc0a-af4a-42cc-a60c-18691be1d989 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:06.985074 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febecc0a-af4a-42cc-a60c-18691be1d989 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:06.985761 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febecc0a-af4a-42cc-a60c-18691be1d989 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:06.987923 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febecc0a-af4a-42cc-a60c-18691be1d989 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:07.030385 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2545/5069] 10.222.0.83 () {60 vars in 1143 bytes} [Mon Aug 29 16:00:06 2022] POST /identity/v3/roles => generated 239 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:07.033628 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febecc0a-af4a-42cc-a60c-18691be1d989 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:07.056669 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febecc0a-af4a-42cc-a60c-18691be1d989 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:07.069078 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0a8b6-b9fe-4972-91d8-0af1fd8314e5 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1342bb1824742b5b3e04e09e74f0c25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd485e73df78745ee98568f6b6c8b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:07.069793 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0a8b6-b9fe-4972-91d8-0af1fd8314e5 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:07.070108 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0a8b6-b9fe-4972-91d8-0af1fd8314e5 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:07.070365 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0a8b6-b9fe-4972-91d8-0af1fd8314e5 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:07.070985 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a0a8b6-b9fe-4972-91d8-0af1fd8314e5 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:07.072948 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a0a8b6-b9fe-4972-91d8-0af1fd8314e5 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:07.115767 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26285139-5724-4ea3-8ef0-ca889cad16b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:07.118891 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26285139-5724-4ea3-8ef0-ca889cad16b7 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:07.119985 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26285139-5724-4ea3-8ef0-ca889cad16b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:07.121506 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26285139-5724-4ea3-8ef0-ca889cad16b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:07.123391 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26285139-5724-4ea3-8ef0-ca889cad16b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:07.126434 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26285139-5724-4ea3-8ef0-ca889cad16b7 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:07.156721 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2546/5070] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:00:07 2022] POST /identity/v3/projects => generated 409 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:00:07.161637 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0a8b6-b9fe-4972-91d8-0af1fd8314e5 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:07.229970 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2525/5071] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:00:06 2022] POST /identity/v3/projects => generated 365 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:07.231302 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26285139-5724-4ea3-8ef0-ca889cad16b7 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:07.238828 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-26285139-5724-4ea3-8ef0-ca889cad16b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:07.315355 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0a8b6-b9fe-4972-91d8-0af1fd8314e5 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:07.409107 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:07.432100 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7b50d-fc4d-4ed9-86a9-12323fbcb6ad tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1342bb1824742b5b3e04e09e74f0c25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd485e73df78745ee98568f6b6c8b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:07.433850 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7b50d-fc4d-4ed9-86a9-12323fbcb6ad tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:07.434988 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7b50d-fc4d-4ed9-86a9-12323fbcb6ad tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:07.435479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7b50d-fc4d-4ed9-86a9-12323fbcb6ad tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/057b3e5bb65c443a909604cac56b2bb4/users/953d39d52686434b804cc20c02f7a2fc/roles/664cb52c14794354813c8fb78b4869c3/inherited_to_projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:07.439742 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e7b50d-fc4d-4ed9-86a9-12323fbcb6ad tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=057b3e5bb65c443a909604cac56b2bb4, user_id=953d39d52686434b804cc20c02f7a2fc, role_id=664cb52c14794354813c8fb78b4869c3)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:07.443264 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26285139-5724-4ea3-8ef0-ca889cad16b7 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:07.443538 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e7b50d-fc4d-4ed9-86a9-12323fbcb6ad tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:07.454461 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955f4e8-308f-49d6-99d0-2a50d369c853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:07.456460 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955f4e8-308f-49d6-99d0-2a50d369c853 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:07.458372 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955f4e8-308f-49d6-99d0-2a50d369c853 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:07.459677 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955f4e8-308f-49d6-99d0-2a50d369c853 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:07.460822 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955f4e8-308f-49d6-99d0-2a50d369c853 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:07.466150 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955f4e8-308f-49d6-99d0-2a50d369c853 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:07.476167 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2547/5072] 10.222.0.83 () {60 vars in 1579 bytes} [Mon Aug 29 16:00:07 2022] PUT /identity/v3/OS-INHERIT/domains/057b3e5bb65c443a909604cac56b2bb4/users/953d39d52686434b804cc20c02f7a2fc/roles/664cb52c14794354813c8fb78b4869c3/inherited_to_projects => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:07.480468 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7b50d-fc4d-4ed9-86a9-12323fbcb6ad tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:07.527927 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2526/5073] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:00:07 2022] POST /identity/v3/users => generated 289 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:07.532169 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955f4e8-308f-49d6-99d0-2a50d369c853 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:07.557913 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955f4e8-308f-49d6-99d0-2a50d369c853 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:07.652073 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7b50d-fc4d-4ed9-86a9-12323fbcb6ad tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:07.667772 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2851c4-62ad-4708-afae-430d00e37476 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1342bb1824742b5b3e04e09e74f0c25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd485e73df78745ee98568f6b6c8b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:07.668426 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2851c4-62ad-4708-afae-430d00e37476 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:07.668710 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2851c4-62ad-4708-afae-430d00e37476 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:07.668987 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2851c4-62ad-4708-afae-430d00e37476 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:07.670583 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2851c4-62ad-4708-afae-430d00e37476 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Adding query filter params (scope.project.id=a9daaa80af3a4d0b968dfb715541bb3e, user.id=953d39d52686434b804cc20c02f7a2fc) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:00:07.671100 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2851c4-62ad-4708-afae-430d00e37476 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:07.673631 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-ac2851c4-62ad-4708-afae-430d00e37476 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:00:07.673631 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 16:00:07.673631 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 16:00:07.676450 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2851c4-62ad-4708-afae-430d00e37476 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:07.702750 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ff20f-1d5a-4fa3-a93d-3f7b6c68908c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:07.703405 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ff20f-1d5a-4fa3-a93d-3f7b6c68908c admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:07.703641 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ff20f-1d5a-4fa3-a93d-3f7b6c68908c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:07.703895 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ff20f-1d5a-4fa3-a93d-3f7b6c68908c admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:07.704943 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ff20f-1d5a-4fa3-a93d-3f7b6c68908c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:07.707609 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ff20f-1d5a-4fa3-a93d-3f7b6c68908c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:07.724937 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2527/5074] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:00:07 2022] GET /identity/v3/roles => generated 1650 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:00:07.727991 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ff20f-1d5a-4fa3-a93d-3f7b6c68908c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:07.752900 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ff20f-1d5a-4fa3-a93d-3f7b6c68908c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:07.769267 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371fb35-54b2-4976-8cf0-9b969c548b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:07.770528 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371fb35-54b2-4976-8cf0-9b969c548b66 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:07.770929 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371fb35-54b2-4976-8cf0-9b969c548b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:07.771228 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371fb35-54b2-4976-8cf0-9b969c548b66 admin admin] PATH_INFO: `/v3/projects/5bf488c4ee4249378dc9f2f18b1be7ff/users/eed8d15ef96140fa834bd27cd6e9cc0d/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:07.793709 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2548/5075] 10.222.0.83 () {58 vars in 1356 bytes} [Mon Aug 29 16:00:07 2022] GET /identity/v3/role_assignments?scope.project.id=a9daaa80af3a4d0b968dfb715541bb3e&user.id=953d39d52686434b804cc20c02f7a2fc&effective => generated 648 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:00:07.797494 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2851c4-62ad-4708-afae-430d00e37476 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:07.812866 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371fb35-54b2-4976-8cf0-9b969c548b66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bf488c4ee4249378dc9f2f18b1be7ff, user_id=eed8d15ef96140fa834bd27cd6e9cc0d, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:07.815598 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371fb35-54b2-4976-8cf0-9b969c548b66 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:07.821841 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2851c4-62ad-4708-afae-430d00e37476 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:07.830548 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed4e83-4821-42cc-ac67-eb32e9654cc6 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1342bb1824742b5b3e04e09e74f0c25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd485e73df78745ee98568f6b6c8b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:07.832179 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed4e83-4821-42cc-ac67-eb32e9654cc6 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:07.832637 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed4e83-4821-42cc-ac67-eb32e9654cc6 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:07.834559 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed4e83-4821-42cc-ac67-eb32e9654cc6 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:07.835805 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed4e83-4821-42cc-ac67-eb32e9654cc6 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Adding query filter params (scope.project.id=cb01d831a16f448a8b4644c74b5051d6, user.id=953d39d52686434b804cc20c02f7a2fc) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:00:07.836123 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed4e83-4821-42cc-ac67-eb32e9654cc6 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:07.840875 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed4e83-4821-42cc-ac67-eb32e9654cc6 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:07.844572 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2528/5076] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:00:07 2022] PUT /identity/v3/projects/5bf488c4ee4249378dc9f2f18b1be7ff/users/eed8d15ef96140fa834bd27cd6e9cc0d/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:07.849783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371fb35-54b2-4976-8cf0-9b969c548b66 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:07.863372 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:08.013973 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2549/5077] 10.222.0.83 () {58 vars in 1356 bytes} [Mon Aug 29 16:00:07 2022] GET /identity/v3/role_assignments?scope.project.id=cb01d831a16f448a8b4644c74b5051d6&user.id=953d39d52686434b804cc20c02f7a2fc&effective => generated 648 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:00:08.017026 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371fb35-54b2-4976-8cf0-9b969c548b66 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:08.017907 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed4e83-4821-42cc-ac67-eb32e9654cc6 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:08.032146 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed4e83-4821-42cc-ac67-eb32e9654cc6 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:08.033483 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f35887-5dd3-4f87-9849-fa0e14430a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:08.034335 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f35887-5dd3-4f87-9849-fa0e14430a77 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:08.034859 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f35887-5dd3-4f87-9849-fa0e14430a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:08.035845 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f35887-5dd3-4f87-9849-fa0e14430a77 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:08.036963 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f35887-5dd3-4f87-9849-fa0e14430a77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:08.038910 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f35887-5dd3-4f87-9849-fa0e14430a77 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:08.068119 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2529/5078] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:00:07 2022] GET /identity/v3/roles => generated 1650 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:00:08.069341 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f35887-5dd3-4f87-9849-fa0e14430a77 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:08.095737 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f35887-5dd3-4f87-9849-fa0e14430a77 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:08.116190 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f517949-9fa9-46e2-bd0f-22f0cb80e887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:08.118095 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f517949-9fa9-46e2-bd0f-22f0cb80e887 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:08.118649 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f517949-9fa9-46e2-bd0f-22f0cb80e887 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:08.119050 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f517949-9fa9-46e2-bd0f-22f0cb80e887 admin admin] PATH_INFO: `/v3/projects/5bf488c4ee4249378dc9f2f18b1be7ff/users/eed8d15ef96140fa834bd27cd6e9cc0d/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:08.126981 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f517949-9fa9-46e2-bd0f-22f0cb80e887 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bf488c4ee4249378dc9f2f18b1be7ff, user_id=eed8d15ef96140fa834bd27cd6e9cc0d, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:08.130943 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f517949-9fa9-46e2-bd0f-22f0cb80e887 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:08.158416 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2530/5079] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:00:08 2022] PUT /identity/v3/projects/5bf488c4ee4249378dc9f2f18b1be7ff/users/eed8d15ef96140fa834bd27cd6e9cc0d/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:08.170332 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65684cf-ddb2-48fb-951e-68066ab5ab7f None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:08.171190 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65684cf-ddb2-48fb-951e-68066ab5ab7f None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:08.171574 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65684cf-ddb2-48fb-951e-68066ab5ab7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:08.218884 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:08.236946 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a65684cf-ddb2-48fb-951e-68066ab5ab7f None None] MFA Rules not processed for user `eed8d15ef96140fa834bd27cd6e9cc0d`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:08.238359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a65684cf-ddb2-48fb-951e-68066ab5ab7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:08.282501 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a0793-10f2-4edb-97bc-ab63a46b970e tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1342bb1824742b5b3e04e09e74f0c25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd485e73df78745ee98568f6b6c8b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:08.283235 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a0793-10f2-4edb-97bc-ab63a46b970e tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:08.283527 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a0793-10f2-4edb-97bc-ab63a46b970e tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:08.283790 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a0793-10f2-4edb-97bc-ab63a46b970e tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/057b3e5bb65c443a909604cac56b2bb4/users/953d39d52686434b804cc20c02f7a2fc/roles/664cb52c14794354813c8fb78b4869c3/inherited_to_projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:08.295980 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a0793-10f2-4edb-97bc-ab63a46b970e tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=057b3e5bb65c443a909604cac56b2bb4, user_id=953d39d52686434b804cc20c02f7a2fc, role_id=664cb52c14794354813c8fb78b4869c3)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:08.298699 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a0793-10f2-4edb-97bc-ab63a46b970e tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:08.333152 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a34a0793-10f2-4edb-97bc-ab63a46b970e tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invalidating the token cache because role 664cb52c14794354813c8fb78b4869c3 was removed from user 953d39d52686434b804cc20c02f7a2fc on domain 057b3e5bb65c443a909604cac56b2bb4. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:08.333456 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a34a0793-10f2-4edb-97bc-ab63a46b970e tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:08.336052 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a34a0793-10f2-4edb-97bc-ab63a46b970e tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:08.370037 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2550/5080] 10.222.0.83 () {58 vars in 1563 bytes} [Mon Aug 29 16:00:08 2022] DELETE /identity/v3/OS-INHERIT/domains/057b3e5bb65c443a909604cac56b2bb4/users/953d39d52686434b804cc20c02f7a2fc/roles/664cb52c14794354813c8fb78b4869c3/inherited_to_projects => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:08.374846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a0793-10f2-4edb-97bc-ab63a46b970e tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:08.382770 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a34a0793-10f2-4edb-97bc-ab63a46b970e tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:08.512035 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2531/5081] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:08 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:08.528406 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65684cf-ddb2-48fb-951e-68066ab5ab7f None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:08.531986 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a65684cf-ddb2-48fb-951e-68066ab5ab7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:08.654575 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a0793-10f2-4edb-97bc-ab63a46b970e tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:08.692819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85a338-c3d6-4a14-b57c-2b476c475b9c tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1342bb1824742b5b3e04e09e74f0c25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd485e73df78745ee98568f6b6c8b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:08.693459 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85a338-c3d6-4a14-b57c-2b476c475b9c tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:08.693748 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85a338-c3d6-4a14-b57c-2b476c475b9c tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:08.694171 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85a338-c3d6-4a14-b57c-2b476c475b9c tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:08.694914 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a85a338-c3d6-4a14-b57c-2b476c475b9c tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Adding query filter params (scope.project.id=a9daaa80af3a4d0b968dfb715541bb3e, user.id=953d39d52686434b804cc20c02f7a2fc) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:00:08.695250 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a85a338-c3d6-4a14-b57c-2b476c475b9c tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:08.714870 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a85a338-c3d6-4a14-b57c-2b476c475b9c tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:08.746861 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65684cf-ddb2-48fb-951e-68066ab5ab7f None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:08.845674 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:08.900687 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2551/5082] 10.222.0.83 () {58 vars in 1356 bytes} [Mon Aug 29 16:00:08 2022] GET /identity/v3/role_assignments?scope.project.id=a9daaa80af3a4d0b968dfb715541bb3e&user.id=953d39d52686434b804cc20c02f7a2fc&effective => generated 228 bytes in 527 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:00:08.901652 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85a338-c3d6-4a14-b57c-2b476c475b9c tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:08.927783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5534487e-9968-42b2-81a5-41573e6a42a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:08.928573 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534487e-9968-42b2-81a5-41573e6a42a6 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:08.928962 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534487e-9968-42b2-81a5-41573e6a42a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:08.929356 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534487e-9968-42b2-81a5-41573e6a42a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:08.950442 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85a338-c3d6-4a14-b57c-2b476c475b9c tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:08.974739 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec67dfd-6b8b-4df6-a3e6-d008325f35f9 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1342bb1824742b5b3e04e09e74f0c25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd485e73df78745ee98568f6b6c8b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:08.975395 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec67dfd-6b8b-4df6-a3e6-d008325f35f9 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:08.975674 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec67dfd-6b8b-4df6-a3e6-d008325f35f9 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:08.975948 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec67dfd-6b8b-4df6-a3e6-d008325f35f9 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:08.976685 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec67dfd-6b8b-4df6-a3e6-d008325f35f9 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Adding query filter params (scope.project.id=cb01d831a16f448a8b4644c74b5051d6, user.id=953d39d52686434b804cc20c02f7a2fc) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:00:08.976991 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec67dfd-6b8b-4df6-a3e6-d008325f35f9 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:08.978864 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec67dfd-6b8b-4df6-a3e6-d008325f35f9 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:09.133555 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2552/5083] 10.222.0.83 () {58 vars in 1356 bytes} [Mon Aug 29 16:00:08 2022] GET /identity/v3/role_assignments?scope.project.id=cb01d831a16f448a8b4644c74b5051d6&user.id=953d39d52686434b804cc20c02f7a2fc&effective => generated 228 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:00:09.134821 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec67dfd-6b8b-4df6-a3e6-d008325f35f9 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:09.151267 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5534487e-9968-42b2-81a5-41573e6a42a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:09.152958 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5534487e-9968-42b2-81a5-41573e6a42a6 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:09.157289 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec67dfd-6b8b-4df6-a3e6-d008325f35f9 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:09.172062 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3b789-982f-4654-8db3-46e515be1490 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1342bb1824742b5b3e04e09e74f0c25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd485e73df78745ee98568f6b6c8b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:09.172542 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2532/5084] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:00:08 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 645 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:00:09.173930 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3b789-982f-4654-8db3-46e515be1490 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:09.174221 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3b789-982f-4654-8db3-46e515be1490 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:09.174494 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3b789-982f-4654-8db3-46e515be1490 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] PATH_INFO: `/v3/projects/cb01d831a16f448a8b4644c74b5051d6` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:09.177404 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c3b789-982f-4654-8db3-46e515be1490 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cb01d831a16f448a8b4644c74b5051d6)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:09.178644 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c3b789-982f-4654-8db3-46e515be1490 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:09.330679 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:09.344883 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e2fb8-8d2d-4f75-ae8e-f7facb328ff7 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:09.345357 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e2fb8-8d2d-4f75-ae8e-f7facb328ff7 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:09.345828 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e2fb8-8d2d-4f75-ae8e-f7facb328ff7 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:09.348382 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2533/5085] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 16:00:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 16:00:09.349495 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b4c3b789-982f-4654-8db3-46e515be1490 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb01d831a16f448a8b4644c74b5051d6', 'request_id': 'req-b4c3b789-982f-4654-8db3-46e515be1490'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:09.356119 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eaa88a-3702-43a0-bb30-97b1ff6a7333 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:09.356916 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eaa88a-3702-43a0-bb30-97b1ff6a7333 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:09.357469 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eaa88a-3702-43a0-bb30-97b1ff6a7333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:09.400173 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b4c3b789-982f-4654-8db3-46e515be1490 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb01d831a16f448a8b4644c74b5051d6', 'request_id': 'req-b4c3b789-982f-4654-8db3-46e515be1490'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:09.426024 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-00eaa88a-3702-43a0-bb30-97b1ff6a7333 None None] MFA Rules not processed for user `9a84bb38f6454574897120223b8fc140`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:09.427669 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b4c3b789-982f-4654-8db3-46e515be1490 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb01d831a16f448a8b4644c74b5051d6', 'request_id': 'req-b4c3b789-982f-4654-8db3-46e515be1490'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:09.429767 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-00eaa88a-3702-43a0-bb30-97b1ff6a7333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:09.487996 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b4c3b789-982f-4654-8db3-46e515be1490 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] The token cache is being invalidate because project cb01d831a16f448a8b4644c74b5051d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:09.488519 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b4c3b789-982f-4654-8db3-46e515be1490 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:09.497158 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b4c3b789-982f-4654-8db3-46e515be1490 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:09.509334 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2553/5086] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:00:09 2022] DELETE /identity/v3/projects/cb01d831a16f448a8b4644c74b5051d6 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:09.518309 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3b789-982f-4654-8db3-46e515be1490 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:09.530117 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b4c3b789-982f-4654-8db3-46e515be1490 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:09.631619 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2534/5087] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 16:00:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:00:09.712450 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eaa88a-3702-43a0-bb30-97b1ff6a7333 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:09.714982 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-00eaa88a-3702-43a0-bb30-97b1ff6a7333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:09.733093 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eaa88a-3702-43a0-bb30-97b1ff6a7333 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:09.751898 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197b714-edd4-4f9e-83d9-bbfc432f8671 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:09.752825 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197b714-edd4-4f9e-83d9-bbfc432f8671 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:09.753624 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197b714-edd4-4f9e-83d9-bbfc432f8671 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:09.754251 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197b714-edd4-4f9e-83d9-bbfc432f8671 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:09.774128 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6197b714-edd4-4f9e-83d9-bbfc432f8671 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:09.776171 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6197b714-edd4-4f9e-83d9-bbfc432f8671 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:09.794202 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2535/5088] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:00:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:00:09.964081 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3b789-982f-4654-8db3-46e515be1490 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:10.010259 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550027db-474f-44e0-a2d2-d0c8f186a7b2 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1342bb1824742b5b3e04e09e74f0c25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd485e73df78745ee98568f6b6c8b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:10.010259 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550027db-474f-44e0-a2d2-d0c8f186a7b2 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:10.010259 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550027db-474f-44e0-a2d2-d0c8f186a7b2 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:10.010730 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550027db-474f-44e0-a2d2-d0c8f186a7b2 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] PATH_INFO: `/v3/roles/664cb52c14794354813c8fb78b4869c3` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:10.037011 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550027db-474f-44e0-a2d2-d0c8f186a7b2 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorizing `identity:delete_role(role_id=664cb52c14794354813c8fb78b4869c3)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:10.039705 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550027db-474f-44e0-a2d2-d0c8f186a7b2 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:10.179596 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-550027db-474f-44e0-a2d2-d0c8f186a7b2 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invalidating the token cache because role 664cb52c14794354813c8fb78b4869c3 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:10.179859 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-550027db-474f-44e0-a2d2-d0c8f186a7b2 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:10.180686 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-550027db-474f-44e0-a2d2-d0c8f186a7b2 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:10.197549 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2554/5089] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:00:09 2022] DELETE /identity/v3/roles/664cb52c14794354813c8fb78b4869c3 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:10.199727 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197b714-edd4-4f9e-83d9-bbfc432f8671 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:10.220145 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197b714-edd4-4f9e-83d9-bbfc432f8671 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:10.407113 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124eb0db-6bfd-4efb-b7c1-927e25899052 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1342bb1824742b5b3e04e09e74f0c25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd485e73df78745ee98568f6b6c8b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:10.407764 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124eb0db-6bfd-4efb-b7c1-927e25899052 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:10.408050 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124eb0db-6bfd-4efb-b7c1-927e25899052 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:10.408381 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124eb0db-6bfd-4efb-b7c1-927e25899052 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:10.409124 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124eb0db-6bfd-4efb-b7c1-927e25899052 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:10.411930 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124eb0db-6bfd-4efb-b7c1-927e25899052 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:10.417226 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:10.437174 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2536/5090] 10.222.0.83 () {60 vars in 1143 bytes} [Mon Aug 29 16:00:10 2022] POST /identity/v3/roles => generated 239 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:10.438240 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550027db-474f-44e0-a2d2-d0c8f186a7b2 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:10.439800 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-550027db-474f-44e0-a2d2-d0c8f186a7b2 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:10.471143 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550027db-474f-44e0-a2d2-d0c8f186a7b2 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:10.494556 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10f508-ee11-41b0-8c6f-46edc8ee5591 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1342bb1824742b5b3e04e09e74f0c25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd485e73df78745ee98568f6b6c8b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:10.495281 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10f508-ee11-41b0-8c6f-46edc8ee5591 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:10.495572 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10f508-ee11-41b0-8c6f-46edc8ee5591 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:10.495874 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10f508-ee11-41b0-8c6f-46edc8ee5591 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:10.496560 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10f508-ee11-41b0-8c6f-46edc8ee5591 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:10.498554 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10f508-ee11-41b0-8c6f-46edc8ee5591 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:10.590922 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2555/5091] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:00:10 2022] POST /identity/v3/projects => generated 409 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:00:10.592641 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124eb0db-6bfd-4efb-b7c1-927e25899052 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:10.608980 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124eb0db-6bfd-4efb-b7c1-927e25899052 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:10.753795 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b58f2-30de-4abd-a0a3-c65d2f0d6ff3 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1342bb1824742b5b3e04e09e74f0c25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd485e73df78745ee98568f6b6c8b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:10.754625 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b58f2-30de-4abd-a0a3-c65d2f0d6ff3 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:10.754912 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b58f2-30de-4abd-a0a3-c65d2f0d6ff3 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:10.755238 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b58f2-30de-4abd-a0a3-c65d2f0d6ff3 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/a9daaa80af3a4d0b968dfb715541bb3e/users/953d39d52686434b804cc20c02f7a2fc/roles/70d29f4d244c4fdabf4524e7e169a350/inherited_to_projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:10.763107 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b58f2-30de-4abd-a0a3-c65d2f0d6ff3 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a9daaa80af3a4d0b968dfb715541bb3e, user_id=953d39d52686434b804cc20c02f7a2fc, role_id=70d29f4d244c4fdabf4524e7e169a350)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:10.778928 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b58f2-30de-4abd-a0a3-c65d2f0d6ff3 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:10.825314 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2537/5092] 10.222.0.83 () {60 vars in 1582 bytes} [Mon Aug 29 16:00:10 2022] PUT /identity/v3/OS-INHERIT/projects/a9daaa80af3a4d0b968dfb715541bb3e/users/953d39d52686434b804cc20c02f7a2fc/roles/70d29f4d244c4fdabf4524e7e169a350/inherited_to_projects => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:10.830082 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10f508-ee11-41b0-8c6f-46edc8ee5591 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:10.846500 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10f508-ee11-41b0-8c6f-46edc8ee5591 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:10.992829 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fbd810-de8a-4658-8455-ddaf4f0df7bd tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1342bb1824742b5b3e04e09e74f0c25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd485e73df78745ee98568f6b6c8b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:10.993480 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fbd810-de8a-4658-8455-ddaf4f0df7bd tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:10.993758 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fbd810-de8a-4658-8455-ddaf4f0df7bd tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:10.994028 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fbd810-de8a-4658-8455-ddaf4f0df7bd tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:10.994781 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fbd810-de8a-4658-8455-ddaf4f0df7bd tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Adding query filter params (scope.project.id=7019e7a1b18142d0b67bdd707e2bc11a, user.id=953d39d52686434b804cc20c02f7a2fc) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:00:10.995127 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fbd810-de8a-4658-8455-ddaf4f0df7bd tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:10.997097 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fbd810-de8a-4658-8455-ddaf4f0df7bd tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:11.030444 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:11.159132 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2556/5093] 10.222.0.83 () {58 vars in 1356 bytes} [Mon Aug 29 16:00:10 2022] GET /identity/v3/role_assignments?scope.project.id=7019e7a1b18142d0b67bdd707e2bc11a&user.id=953d39d52686434b804cc20c02f7a2fc&effective => generated 649 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:00:11.161344 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b58f2-30de-4abd-a0a3-c65d2f0d6ff3 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:11.185579 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b58f2-30de-4abd-a0a3-c65d2f0d6ff3 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:11.212289 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f0578-b0b1-4d6c-9c62-f1ccac84b532 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1342bb1824742b5b3e04e09e74f0c25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd485e73df78745ee98568f6b6c8b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:11.213058 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f0578-b0b1-4d6c-9c62-f1ccac84b532 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:11.213408 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f0578-b0b1-4d6c-9c62-f1ccac84b532 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:11.213759 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f0578-b0b1-4d6c-9c62-f1ccac84b532 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/a9daaa80af3a4d0b968dfb715541bb3e/users/953d39d52686434b804cc20c02f7a2fc/roles/70d29f4d244c4fdabf4524e7e169a350/inherited_to_projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:11.229539 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f0578-b0b1-4d6c-9c62-f1ccac84b532 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=a9daaa80af3a4d0b968dfb715541bb3e, user_id=953d39d52686434b804cc20c02f7a2fc, role_id=70d29f4d244c4fdabf4524e7e169a350)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:11.236970 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f0578-b0b1-4d6c-9c62-f1ccac84b532 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:11.262384 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-419f0578-b0b1-4d6c-9c62-f1ccac84b532 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invalidating the token cache because role 70d29f4d244c4fdabf4524e7e169a350 was removed from user 953d39d52686434b804cc20c02f7a2fc on project a9daaa80af3a4d0b968dfb715541bb3e. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:11.263362 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-419f0578-b0b1-4d6c-9c62-f1ccac84b532 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:11.267172 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-419f0578-b0b1-4d6c-9c62-f1ccac84b532 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:11.292980 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2538/5094] 10.222.0.83 () {58 vars in 1566 bytes} [Mon Aug 29 16:00:11 2022] DELETE /identity/v3/OS-INHERIT/projects/a9daaa80af3a4d0b968dfb715541bb3e/users/953d39d52686434b804cc20c02f7a2fc/roles/70d29f4d244c4fdabf4524e7e169a350/inherited_to_projects => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:11.299260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fbd810-de8a-4658-8455-ddaf4f0df7bd tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:11.306155 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-86fbd810-de8a-4658-8455-ddaf4f0df7bd tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:11.328483 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fbd810-de8a-4658-8455-ddaf4f0df7bd tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:11.620906 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fad9cf-19cd-41eb-a3d1-7b21b4edbea3 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1342bb1824742b5b3e04e09e74f0c25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd485e73df78745ee98568f6b6c8b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:11.621952 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fad9cf-19cd-41eb-a3d1-7b21b4edbea3 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:11.622336 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fad9cf-19cd-41eb-a3d1-7b21b4edbea3 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:11.622999 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fad9cf-19cd-41eb-a3d1-7b21b4edbea3 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:11.627632 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fad9cf-19cd-41eb-a3d1-7b21b4edbea3 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Adding query filter params (scope.project.id=7019e7a1b18142d0b67bdd707e2bc11a, user.id=953d39d52686434b804cc20c02f7a2fc) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:00:11.628446 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fad9cf-19cd-41eb-a3d1-7b21b4edbea3 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:11.632113 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fad9cf-19cd-41eb-a3d1-7b21b4edbea3 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:11.775468 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2557/5095] 10.222.0.83 () {58 vars in 1356 bytes} [Mon Aug 29 16:00:11 2022] GET /identity/v3/role_assignments?scope.project.id=7019e7a1b18142d0b67bdd707e2bc11a&user.id=953d39d52686434b804cc20c02f7a2fc&effective => generated 228 bytes in 477 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:00:11.779798 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f0578-b0b1-4d6c-9c62-f1ccac84b532 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:11.801113 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f0578-b0b1-4d6c-9c62-f1ccac84b532 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:11.810678 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13227d-245c-436d-9456-5f1d112d724b tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1342bb1824742b5b3e04e09e74f0c25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd485e73df78745ee98568f6b6c8b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:11.811388 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13227d-245c-436d-9456-5f1d112d724b tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:11.811672 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13227d-245c-436d-9456-5f1d112d724b tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:11.811949 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13227d-245c-436d-9456-5f1d112d724b tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] PATH_INFO: `/v3/projects/7019e7a1b18142d0b67bdd707e2bc11a` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:11.813876 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a13227d-245c-436d-9456-5f1d112d724b tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7019e7a1b18142d0b67bdd707e2bc11a)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:11.816670 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a13227d-245c-436d-9456-5f1d112d724b tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:11.899009 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9a13227d-245c-436d-9456-5f1d112d724b tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7019e7a1b18142d0b67bdd707e2bc11a', 'request_id': 'req-9a13227d-245c-436d-9456-5f1d112d724b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:11.906721 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9a13227d-245c-436d-9456-5f1d112d724b tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7019e7a1b18142d0b67bdd707e2bc11a', 'request_id': 'req-9a13227d-245c-436d-9456-5f1d112d724b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:11.916889 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9a13227d-245c-436d-9456-5f1d112d724b tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7019e7a1b18142d0b67bdd707e2bc11a', 'request_id': 'req-9a13227d-245c-436d-9456-5f1d112d724b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:11.949660 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9a13227d-245c-436d-9456-5f1d112d724b tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] The token cache is being invalidate because project 7019e7a1b18142d0b67bdd707e2bc11a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:11.950080 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9a13227d-245c-436d-9456-5f1d112d724b tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:11.951056 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9a13227d-245c-436d-9456-5f1d112d724b tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:11.955203 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2539/5096] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:00:11 2022] DELETE /identity/v3/projects/7019e7a1b18142d0b67bdd707e2bc11a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:11.959803 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fad9cf-19cd-41eb-a3d1-7b21b4edbea3 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:11.962217 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-48fad9cf-19cd-41eb-a3d1-7b21b4edbea3 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:11.987409 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fad9cf-19cd-41eb-a3d1-7b21b4edbea3 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:12.136178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe923ed6-1c43-4454-9011-be771703fca6 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1342bb1824742b5b3e04e09e74f0c25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd485e73df78745ee98568f6b6c8b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:12.137379 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe923ed6-1c43-4454-9011-be771703fca6 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:12.137379 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe923ed6-1c43-4454-9011-be771703fca6 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:12.137582 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe923ed6-1c43-4454-9011-be771703fca6 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] PATH_INFO: `/v3/roles/70d29f4d244c4fdabf4524e7e169a350` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:12.139764 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe923ed6-1c43-4454-9011-be771703fca6 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorizing `identity:delete_role(role_id=70d29f4d244c4fdabf4524e7e169a350)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:12.141427 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe923ed6-1c43-4454-9011-be771703fca6 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:12.173765 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:12.242019 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fe923ed6-1c43-4454-9011-be771703fca6 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invalidating the token cache because role 70d29f4d244c4fdabf4524e7e169a350 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:12.242419 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fe923ed6-1c43-4454-9011-be771703fca6 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:12.243327 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fe923ed6-1c43-4454-9011-be771703fca6 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:12.247659 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2558/5097] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:00:11 2022] DELETE /identity/v3/roles/70d29f4d244c4fdabf4524e7e169a350 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:12.252300 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13227d-245c-436d-9456-5f1d112d724b tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:12.264374 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13227d-245c-436d-9456-5f1d112d724b tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:12.354342 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:12.374729 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146e222-d91f-4330-b251-2cb08e6786f8 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1342bb1824742b5b3e04e09e74f0c25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd485e73df78745ee98568f6b6c8b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:12.375581 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146e222-d91f-4330-b251-2cb08e6786f8 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:12.375758 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146e222-d91f-4330-b251-2cb08e6786f8 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:12.375970 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146e222-d91f-4330-b251-2cb08e6786f8 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] PATH_INFO: `/v3/users/953d39d52686434b804cc20c02f7a2fc` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:12.385029 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146e222-d91f-4330-b251-2cb08e6786f8 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorizing `identity:delete_user(user_id=953d39d52686434b804cc20c02f7a2fc)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:12.387056 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146e222-d91f-4330-b251-2cb08e6786f8 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:12.588405 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9146e222-d91f-4330-b251-2cb08e6786f8 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '953d39d52686434b804cc20c02f7a2fc'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:12.589116 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9146e222-d91f-4330-b251-2cb08e6786f8 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '953d39d52686434b804cc20c02f7a2fc'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:12.594214 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dca7b3-0542-49b3-b51f-de118c3eaeb9 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:12.594504 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dca7b3-0542-49b3-b51f-de118c3eaeb9 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:12.594794 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dca7b3-0542-49b3-b51f-de118c3eaeb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:12.620589 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9146e222-d91f-4330-b251-2cb08e6786f8 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '953d39d52686434b804cc20c02f7a2fc'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:12.643435 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-67dca7b3-0542-49b3-b51f-de118c3eaeb9 None None] MFA Rules not processed for user `e460fd09b56f4c47a46062a41fc89bbf`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:12.645647 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-67dca7b3-0542-49b3-b51f-de118c3eaeb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:12.646174 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9146e222-d91f-4330-b251-2cb08e6786f8 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '953d39d52686434b804cc20c02f7a2fc'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:12.647140 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9146e222-d91f-4330-b251-2cb08e6786f8 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '953d39d52686434b804cc20c02f7a2fc'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:12.684857 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2540/5098] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:00:12 2022] DELETE /identity/v3/users/953d39d52686434b804cc20c02f7a2fc => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:12.688666 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146e222-d91f-4330-b251-2cb08e6786f8 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:12.690313 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9146e222-d91f-4330-b251-2cb08e6786f8 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:12.839529 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2559/5099] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:12 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:12.845125 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4dfaaf-5720-49c7-97f5-35f98890c1e4 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:12.845416 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4dfaaf-5720-49c7-97f5-35f98890c1e4 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:12.849640 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4dfaaf-5720-49c7-97f5-35f98890c1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:12.935858 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-4f4dfaaf-5720-49c7-97f5-35f98890c1e4 None None] MFA Rules not processed for user `e460fd09b56f4c47a46062a41fc89bbf`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:12.950321 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4f4dfaaf-5720-49c7-97f5-35f98890c1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:12.980679 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146e222-d91f-4330-b251-2cb08e6786f8 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:12.996388 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cbfe76-9aac-4df0-91c5-eb03133155c1 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1342bb1824742b5b3e04e09e74f0c25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd485e73df78745ee98568f6b6c8b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:12.997108 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbfe76-9aac-4df0-91c5-eb03133155c1 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:12.997226 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbfe76-9aac-4df0-91c5-eb03133155c1 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:12.997493 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbfe76-9aac-4df0-91c5-eb03133155c1 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] PATH_INFO: `/v3/groups/162069dd3d2342b396b363ebfbc1ac55` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:13.004788 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cbfe76-9aac-4df0-91c5-eb03133155c1 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorizing `identity:delete_group(group_id=162069dd3d2342b396b363ebfbc1ac55)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:13.006846 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cbfe76-9aac-4df0-91c5-eb03133155c1 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:13.148700 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2560/5100] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:12 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:13.149689 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4dfaaf-5720-49c7-97f5-35f98890c1e4 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:13.152989 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4f4dfaaf-5720-49c7-97f5-35f98890c1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:13.159376 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2541/5101] 10.222.0.83 () {58 vars in 1227 bytes} [Mon Aug 29 16:00:12 2022] DELETE /identity/v3/groups/162069dd3d2342b396b363ebfbc1ac55 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:00:13.163987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cbfe76-9aac-4df0-91c5-eb03133155c1 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:13.268144 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:13.351351 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cbfe76-9aac-4df0-91c5-eb03133155c1 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:13.365991 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39391d5-6515-4a3c-923a-f9d6a4b20ae3 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1342bb1824742b5b3e04e09e74f0c25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd485e73df78745ee98568f6b6c8b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:13.366882 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39391d5-6515-4a3c-923a-f9d6a4b20ae3 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:13.367218 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39391d5-6515-4a3c-923a-f9d6a4b20ae3 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:13.367502 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39391d5-6515-4a3c-923a-f9d6a4b20ae3 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] PATH_INFO: `/v3/projects/a9daaa80af3a4d0b968dfb715541bb3e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:13.372046 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39391d5-6515-4a3c-923a-f9d6a4b20ae3 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a9daaa80af3a4d0b968dfb715541bb3e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:13.377288 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39391d5-6515-4a3c-923a-f9d6a4b20ae3 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:13.397521 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4dfaaf-5720-49c7-97f5-35f98890c1e4 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:13.433477 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:13.480126 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d39391d5-6515-4a3c-923a-f9d6a4b20ae3 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9daaa80af3a4d0b968dfb715541bb3e', 'request_id': 'req-d39391d5-6515-4a3c-923a-f9d6a4b20ae3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:13.493939 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d39391d5-6515-4a3c-923a-f9d6a4b20ae3 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9daaa80af3a4d0b968dfb715541bb3e', 'request_id': 'req-d39391d5-6515-4a3c-923a-f9d6a4b20ae3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:13.506899 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d39391d5-6515-4a3c-923a-f9d6a4b20ae3 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9daaa80af3a4d0b968dfb715541bb3e', 'request_id': 'req-d39391d5-6515-4a3c-923a-f9d6a4b20ae3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:13.523644 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf68bcb-eed9-47f7-9554-93ee167223c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:13.524271 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf68bcb-eed9-47f7-9554-93ee167223c8 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:13.524550 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf68bcb-eed9-47f7-9554-93ee167223c8 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:13.525004 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf68bcb-eed9-47f7-9554-93ee167223c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:13.536014 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d39391d5-6515-4a3c-923a-f9d6a4b20ae3 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] The token cache is being invalidate because project a9daaa80af3a4d0b968dfb715541bb3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:13.536591 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d39391d5-6515-4a3c-923a-f9d6a4b20ae3 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:13.538911 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d39391d5-6515-4a3c-923a-f9d6a4b20ae3 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:13.549883 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2542/5102] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:00:13 2022] DELETE /identity/v3/projects/a9daaa80af3a4d0b968dfb715541bb3e => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:13.551507 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39391d5-6515-4a3c-923a-f9d6a4b20ae3 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:13.552966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d39391d5-6515-4a3c-923a-f9d6a4b20ae3 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:13.664844 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf68bcb-eed9-47f7-9554-93ee167223c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:13.668170 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf68bcb-eed9-47f7-9554-93ee167223c8 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:13.684947 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39391d5-6515-4a3c-923a-f9d6a4b20ae3 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:13.693736 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2561/5103] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:00:13 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:00:13.696610 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688902d4-093b-4779-80a2-2948fc042262 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1342bb1824742b5b3e04e09e74f0c25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd485e73df78745ee98568f6b6c8b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:13.697156 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688902d4-093b-4779-80a2-2948fc042262 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:13.697965 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688902d4-093b-4779-80a2-2948fc042262 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:13.698252 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688902d4-093b-4779-80a2-2948fc042262 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] PATH_INFO: `/v3/domains/057b3e5bb65c443a909604cac56b2bb4` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:13.714065 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688902d4-093b-4779-80a2-2948fc042262 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=057b3e5bb65c443a909604cac56b2bb4)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:13.719469 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688902d4-093b-4779-80a2-2948fc042262 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:13.763076 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-688902d4-093b-4779-80a2-2948fc042262 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '057b3e5bb65c443a909604cac56b2bb4'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:13.764147 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-688902d4-093b-4779-80a2-2948fc042262 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '057b3e5bb65c443a909604cac56b2bb4'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:13.820095 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-688902d4-093b-4779-80a2-2948fc042262 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '057b3e5bb65c443a909604cac56b2bb4'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:13.820845 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-688902d4-093b-4779-80a2-2948fc042262 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '057b3e5bb65c443a909604cac56b2bb4'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:13.829204 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2543/5104] 10.222.0.83 () {60 vars in 1249 bytes} [Mon Aug 29 16:00:13 2022] PATCH /identity/v3/domains/057b3e5bb65c443a909604cac56b2bb4 => generated 276 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:00:13.833801 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf68bcb-eed9-47f7-9554-93ee167223c8 service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:13.849490 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf68bcb-eed9-47f7-9554-93ee167223c8 service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:13.935802 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706e021-1818-4fa0-8288-73534c4e490d tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1342bb1824742b5b3e04e09e74f0c25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd485e73df78745ee98568f6b6c8b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:13.938596 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706e021-1818-4fa0-8288-73534c4e490d tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:13.939087 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706e021-1818-4fa0-8288-73534c4e490d tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:13.939342 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706e021-1818-4fa0-8288-73534c4e490d tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] PATH_INFO: `/v3/domains/057b3e5bb65c443a909604cac56b2bb4` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:13.953224 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706e021-1818-4fa0-8288-73534c4e490d tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=057b3e5bb65c443a909604cac56b2bb4)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:13.955095 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706e021-1818-4fa0-8288-73534c4e490d tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:13.990133 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c706e021-1818-4fa0-8288-73534c4e490d tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '057b3e5bb65c443a909604cac56b2bb4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:13.993990 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c706e021-1818-4fa0-8288-73534c4e490d tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '057b3e5bb65c443a909604cac56b2bb4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:14.024932 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:14.061843 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c706e021-1818-4fa0-8288-73534c4e490d tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '057b3e5bb65c443a909604cac56b2bb4', 'request_id': 'req-c706e021-1818-4fa0-8288-73534c4e490d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:14.070145 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c706e021-1818-4fa0-8288-73534c4e490d tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '057b3e5bb65c443a909604cac56b2bb4', 'request_id': 'req-c706e021-1818-4fa0-8288-73534c4e490d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:14.084255 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c706e021-1818-4fa0-8288-73534c4e490d tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '057b3e5bb65c443a909604cac56b2bb4', 'request_id': 'req-c706e021-1818-4fa0-8288-73534c4e490d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:14.099475 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c706e021-1818-4fa0-8288-73534c4e490d tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] The token cache is being invalidate because project 057b3e5bb65c443a909604cac56b2bb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:14.099961 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c706e021-1818-4fa0-8288-73534c4e490d tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:14.100741 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c706e021-1818-4fa0-8288-73534c4e490d tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:14.118116 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c706e021-1818-4fa0-8288-73534c4e490d tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '057b3e5bb65c443a909604cac56b2bb4', 'request_id': 'req-c706e021-1818-4fa0-8288-73534c4e490d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:14.124180 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c706e021-1818-4fa0-8288-73534c4e490d tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '057b3e5bb65c443a909604cac56b2bb4', 'request_id': 'req-c706e021-1818-4fa0-8288-73534c4e490d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:14.124990 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c706e021-1818-4fa0-8288-73534c4e490d tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '057b3e5bb65c443a909604cac56b2bb4', 'request_id': 'req-c706e021-1818-4fa0-8288-73534c4e490d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:14.153618 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2562/5105] 10.222.0.83 () {58 vars in 1230 bytes} [Mon Aug 29 16:00:13 2022] DELETE /identity/v3/domains/057b3e5bb65c443a909604cac56b2bb4 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:14.157694 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688902d4-093b-4779-80a2-2948fc042262 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:14.161371 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-688902d4-093b-4779-80a2-2948fc042262 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:14.188962 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706e021-1818-4fa0-8288-73534c4e490d tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:14.191983 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c706e021-1818-4fa0-8288-73534c4e490d tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:14.256995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:14.295013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706e021-1818-4fa0-8288-73534c4e490d tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:14.299284 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285f2f5-4b7c-4fcd-a235-8ef7472bb962 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:14.300032 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285f2f5-4b7c-4fcd-a235-8ef7472bb962 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:14.301155 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285f2f5-4b7c-4fcd-a235-8ef7472bb962 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:14.301656 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285f2f5-4b7c-4fcd-a235-8ef7472bb962 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:14.304654 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c285f2f5-4b7c-4fcd-a235-8ef7472bb962 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:14.378085 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688902d4-093b-4779-80a2-2948fc042262 tempest-InheritsV3TestJSON-157741294 tempest-InheritsV3TestJSON-157741294-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:14.452576 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c285f2f5-4b7c-4fcd-a235-8ef7472bb962 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:14.455065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c285f2f5-4b7c-4fcd-a235-8ef7472bb962 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:14.496562 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2563/5106] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:00:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:00:14.555417 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4379f7-8e76-448b-a313-595be978101f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:14.556196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4379f7-8e76-448b-a313-595be978101f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:14.556481 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4379f7-8e76-448b-a313-595be978101f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:14.556754 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4379f7-8e76-448b-a313-595be978101f admin admin] PATH_INFO: `/v3/users/a20debe98479456a9063e197ca0bb22e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:14.560917 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4379f7-8e76-448b-a313-595be978101f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a20debe98479456a9063e197ca0bb22e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:14.563195 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4379f7-8e76-448b-a313-595be978101f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:14.674792 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4d4379f7-8e76-448b-a313-595be978101f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a20debe98479456a9063e197ca0bb22e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:14.675627 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4d4379f7-8e76-448b-a313-595be978101f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a20debe98479456a9063e197ca0bb22e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:14.691599 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4d4379f7-8e76-448b-a313-595be978101f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a20debe98479456a9063e197ca0bb22e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:14.735931 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4d4379f7-8e76-448b-a313-595be978101f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a20debe98479456a9063e197ca0bb22e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:14.736706 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4d4379f7-8e76-448b-a313-595be978101f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a20debe98479456a9063e197ca0bb22e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:14.828877 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2544/5107] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:00:14 2022] DELETE /identity/v3/users/a20debe98479456a9063e197ca0bb22e => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:14.835097 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22dba37-1f0e-4bb4-a30a-d1a222286155 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:14.835695 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22dba37-1f0e-4bb4-a30a-d1a222286155 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:14.836061 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22dba37-1f0e-4bb4-a30a-d1a222286155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:14.885588 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-e22dba37-1f0e-4bb4-a30a-d1a222286155 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:14.889025 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e22dba37-1f0e-4bb4-a30a-d1a222286155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:14.992303 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:15.046179 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2564/5108] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:15.054949 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4379f7-8e76-448b-a313-595be978101f admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:15.056743 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4d4379f7-8e76-448b-a313-595be978101f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:15.216655 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4379f7-8e76-448b-a313-595be978101f admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:15.225948 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc352ce1-68e1-48d4-88cc-e7b3156ff673 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:15.226690 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc352ce1-68e1-48d4-88cc-e7b3156ff673 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:15.227013 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc352ce1-68e1-48d4-88cc-e7b3156ff673 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:15.227448 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc352ce1-68e1-48d4-88cc-e7b3156ff673 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:15.254338 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc352ce1-68e1-48d4-88cc-e7b3156ff673 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:15.258035 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc352ce1-68e1-48d4-88cc-e7b3156ff673 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:15.268089 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:15.284186 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2545/5109] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:00:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:00:16.766972 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22dba37-1f0e-4bb4-a30a-d1a222286155 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:16.769092 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e22dba37-1f0e-4bb4-a30a-d1a222286155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:16.830339 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22dba37-1f0e-4bb4-a30a-d1a222286155 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:16.903007 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb85b2-429e-4a7d-bf86-20f46efd84bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:16.903588 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb85b2-429e-4a7d-bf86-20f46efd84bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:16.903858 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb85b2-429e-4a7d-bf86-20f46efd84bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:16.904147 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb85b2-429e-4a7d-bf86-20f46efd84bc admin admin] PATH_INFO: `/v3/projects/ecbf2e1e974e4e4b903768ebcfeb2806` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:16.929491 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc352ce1-68e1-48d4-88cc-e7b3156ff673 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:16.933291 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-fc352ce1-68e1-48d4-88cc-e7b3156ff673 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:16.944043 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb85b2-429e-4a7d-bf86-20f46efd84bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecbf2e1e974e4e4b903768ebcfeb2806)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:16.946150 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb85b2-429e-4a7d-bf86-20f46efd84bc admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:16.974312 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc352ce1-68e1-48d4-88cc-e7b3156ff673 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:16.993896 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb1621-3bdf-43fd-b360-a60cdddaf108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:16.995392 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb1621-3bdf-43fd-b360-a60cdddaf108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:16.998487 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb1621-3bdf-43fd-b360-a60cdddaf108 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:16.999010 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb1621-3bdf-43fd-b360-a60cdddaf108 admin admin] PATH_INFO: `/v3/users/8825ae8ecb0944d79b43debc60be1a95` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:17.002661 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb1621-3bdf-43fd-b360-a60cdddaf108 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8825ae8ecb0944d79b43debc60be1a95)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:17.007346 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb1621-3bdf-43fd-b360-a60cdddaf108 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:17.136483 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fefb1621-3bdf-43fd-b360-a60cdddaf108 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8825ae8ecb0944d79b43debc60be1a95'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:17.138872 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fefb1621-3bdf-43fd-b360-a60cdddaf108 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8825ae8ecb0944d79b43debc60be1a95'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:17.158913 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fefb1621-3bdf-43fd-b360-a60cdddaf108 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8825ae8ecb0944d79b43debc60be1a95'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:17.162140 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0aeb85b2-429e-4a7d-bf86-20f46efd84bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecbf2e1e974e4e4b903768ebcfeb2806', 'request_id': 'req-0aeb85b2-429e-4a7d-bf86-20f46efd84bc'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:17.176930 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fefb1621-3bdf-43fd-b360-a60cdddaf108 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8825ae8ecb0944d79b43debc60be1a95'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:17.179696 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fefb1621-3bdf-43fd-b360-a60cdddaf108 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8825ae8ecb0944d79b43debc60be1a95'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:17.195964 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0aeb85b2-429e-4a7d-bf86-20f46efd84bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecbf2e1e974e4e4b903768ebcfeb2806', 'request_id': 'req-0aeb85b2-429e-4a7d-bf86-20f46efd84bc'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:17.219540 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0aeb85b2-429e-4a7d-bf86-20f46efd84bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecbf2e1e974e4e4b903768ebcfeb2806', 'request_id': 'req-0aeb85b2-429e-4a7d-bf86-20f46efd84bc'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:17.239569 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0aeb85b2-429e-4a7d-bf86-20f46efd84bc admin admin] The token cache is being invalidate because project ecbf2e1e974e4e4b903768ebcfeb2806 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:17.239884 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0aeb85b2-429e-4a7d-bf86-20f46efd84bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:17.241418 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0aeb85b2-429e-4a7d-bf86-20f46efd84bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:17.246419 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2565/5110] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:00:16 2022] DELETE /identity/v3/projects/ecbf2e1e974e4e4b903768ebcfeb2806 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:17.247962 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb85b2-429e-4a7d-bf86-20f46efd84bc admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:17.250314 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2546/5111] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:00:16 2022] DELETE /identity/v3/users/8825ae8ecb0944d79b43debc60be1a95 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:17.251682 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0aeb85b2-429e-4a7d-bf86-20f46efd84bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:17.259801 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb1621-3bdf-43fd-b360-a60cdddaf108 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:17.264423 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-fefb1621-3bdf-43fd-b360-a60cdddaf108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:17.408606 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb85b2-429e-4a7d-bf86-20f46efd84bc admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:17.478924 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb1621-3bdf-43fd-b360-a60cdddaf108 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:17.493467 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b706d9-dc10-4994-a10e-7670183f7f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:17.496406 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b706d9-dc10-4994-a10e-7670183f7f8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:17.497987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b706d9-dc10-4994-a10e-7670183f7f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:17.499590 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b706d9-dc10-4994-a10e-7670183f7f8b admin admin] PATH_INFO: `/v3/users/f1342bb1824742b5b3e04e09e74f0c25` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:17.503338 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b706d9-dc10-4994-a10e-7670183f7f8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1342bb1824742b5b3e04e09e74f0c25)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:17.509195 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b706d9-dc10-4994-a10e-7670183f7f8b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:17.588512 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03128348-3f51-4668-a2a1-dadb9bd751cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:17.592306 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03128348-3f51-4668-a2a1-dadb9bd751cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:17.602949 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03128348-3f51-4668-a2a1-dadb9bd751cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:17.605201 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03128348-3f51-4668-a2a1-dadb9bd751cb admin admin] PATH_INFO: `/v3/users/c1644cc2e23b4ffbbffcd7547c2052a1` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:17.633123 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03128348-3f51-4668-a2a1-dadb9bd751cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1644cc2e23b4ffbbffcd7547c2052a1)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:17.647588 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03128348-3f51-4668-a2a1-dadb9bd751cb admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:17.675893 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c8b706d9-dc10-4994-a10e-7670183f7f8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1342bb1824742b5b3e04e09e74f0c25'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:17.677203 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c8b706d9-dc10-4994-a10e-7670183f7f8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1342bb1824742b5b3e04e09e74f0c25'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:17.710520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c8b706d9-dc10-4994-a10e-7670183f7f8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1342bb1824742b5b3e04e09e74f0c25'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:17.747345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c8b706d9-dc10-4994-a10e-7670183f7f8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1342bb1824742b5b3e04e09e74f0c25'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:17.748611 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c8b706d9-dc10-4994-a10e-7670183f7f8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1342bb1824742b5b3e04e09e74f0c25'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:17.751622 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:17.777288 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:17.825758 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2547/5112] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:00:17 2022] DELETE /identity/v3/users/f1342bb1824742b5b3e04e09e74f0c25 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:17.851706 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ed743-e651-40aa-a115-1f745a8858dd None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:17.852059 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ed743-e651-40aa-a115-1f745a8858dd None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:17.852320 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ed743-e651-40aa-a115-1f745a8858dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:17.854509 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-03128348-3f51-4668-a2a1-dadb9bd751cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1644cc2e23b4ffbbffcd7547c2052a1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:17.857363 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-03128348-3f51-4668-a2a1-dadb9bd751cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1644cc2e23b4ffbbffcd7547c2052a1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:17.893120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-03128348-3f51-4668-a2a1-dadb9bd751cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1644cc2e23b4ffbbffcd7547c2052a1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:17.919307 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-03128348-3f51-4668-a2a1-dadb9bd751cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1644cc2e23b4ffbbffcd7547c2052a1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:17.925870 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-ed6ed743-e651-40aa-a115-1f745a8858dd None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:17.928570 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ed6ed743-e651-40aa-a115-1f745a8858dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:17.953855 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-03128348-3f51-4668-a2a1-dadb9bd751cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1644cc2e23b4ffbbffcd7547c2052a1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:17.984342 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2566/5113] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:00:17 2022] DELETE /identity/v3/users/c1644cc2e23b4ffbbffcd7547c2052a1 => generated 0 bytes in 737 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:17.992675 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162b732-b31d-413f-b650-b7102c90fecf None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:17.994596 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162b732-b31d-413f-b650-b7102c90fecf None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:17.996060 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162b732-b31d-413f-b650-b7102c90fecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:18.095276 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-d162b732-b31d-413f-b650-b7102c90fecf None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:18.101792 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d162b732-b31d-413f-b650-b7102c90fecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:18.183745 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2548/5114] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:18.199955 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ed743-e651-40aa-a115-1f745a8858dd None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:18.202060 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ed6ed743-e651-40aa-a115-1f745a8858dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:18.391942 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ed743-e651-40aa-a115-1f745a8858dd None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:18.508018 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2567/5115] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 520 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:18.522557 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162b732-b31d-413f-b650-b7102c90fecf None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:18.623341 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ce8f0-9baa-424b-b628-da608971fbde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:18.624069 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ce8f0-9baa-424b-b628-da608971fbde service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:18.626590 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ce8f0-9baa-424b-b628-da608971fbde service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:18.627138 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ce8f0-9baa-424b-b628-da608971fbde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:18.652425 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25ce8f0-9baa-424b-b628-da608971fbde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:18.653971 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25ce8f0-9baa-424b-b628-da608971fbde service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:18.709995 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2549/5116] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:00:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:00:18.785950 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162b732-b31d-413f-b650-b7102c90fecf None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:18.790455 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a9e4f-9410-4973-8f98-c307b3c24907 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:18.792555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a9e4f-9410-4973-8f98-c307b3c24907 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:18.793076 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a9e4f-9410-4973-8f98-c307b3c24907 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:18.793599 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a9e4f-9410-4973-8f98-c307b3c24907 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:18.806744 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a9e4f-9410-4973-8f98-c307b3c24907 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:18.814250 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a9e4f-9410-4973-8f98-c307b3c24907 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:18.847707 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2568/5117] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:00:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:00:18.908299 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ce8f0-9baa-424b-b628-da608971fbde service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:18.910566 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e25ce8f0-9baa-424b-b628-da608971fbde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:19.005741 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ce8f0-9baa-424b-b628-da608971fbde service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:19.046190 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab0ebc-c135-4793-9c6d-f67b4966cc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:19.053243 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab0ebc-c135-4793-9c6d-f67b4966cc0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:19.063174 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab0ebc-c135-4793-9c6d-f67b4966cc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:19.066941 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab0ebc-c135-4793-9c6d-f67b4966cc0f admin admin] PATH_INFO: `/v3/projects/d485e73df78745ee98568f6b6c8b7467` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:19.081501 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ab0ebc-c135-4793-9c6d-f67b4966cc0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d485e73df78745ee98568f6b6c8b7467)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:19.093891 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ab0ebc-c135-4793-9c6d-f67b4966cc0f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:19.303632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:19.315203 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-85ab0ebc-c135-4793-9c6d-f67b4966cc0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd485e73df78745ee98568f6b6c8b7467', 'request_id': 'req-85ab0ebc-c135-4793-9c6d-f67b4966cc0f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:19.352150 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-85ab0ebc-c135-4793-9c6d-f67b4966cc0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd485e73df78745ee98568f6b6c8b7467', 'request_id': 'req-85ab0ebc-c135-4793-9c6d-f67b4966cc0f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:19.379075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-85ab0ebc-c135-4793-9c6d-f67b4966cc0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd485e73df78745ee98568f6b6c8b7467', 'request_id': 'req-85ab0ebc-c135-4793-9c6d-f67b4966cc0f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:19.432512 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-85ab0ebc-c135-4793-9c6d-f67b4966cc0f admin admin] The token cache is being invalidate because project d485e73df78745ee98568f6b6c8b7467 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:19.434240 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-85ab0ebc-c135-4793-9c6d-f67b4966cc0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:19.437137 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-85ab0ebc-c135-4793-9c6d-f67b4966cc0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:19.450123 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2550/5118] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:00:18 2022] DELETE /identity/v3/projects/d485e73df78745ee98568f6b6c8b7467 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:19.451834 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193acf5-aece-43a1-8c76-8ae3f6dddfc7 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:19.452296 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193acf5-aece-43a1-8c76-8ae3f6dddfc7 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:19.452508 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193acf5-aece-43a1-8c76-8ae3f6dddfc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:19.520065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-e193acf5-aece-43a1-8c76-8ae3f6dddfc7 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:19.525481 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e193acf5-aece-43a1-8c76-8ae3f6dddfc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:19.642414 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:19.722366 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2569/5119] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:19.732613 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11590d9d-08cc-4a80-abd1-08a8fedfef73 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:19.732892 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11590d9d-08cc-4a80-abd1-08a8fedfef73 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:19.733172 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11590d9d-08cc-4a80-abd1-08a8fedfef73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:19.803699 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-11590d9d-08cc-4a80-abd1-08a8fedfef73 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:19.804949 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-11590d9d-08cc-4a80-abd1-08a8fedfef73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:19.838286 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2551/5120] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:19.844203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193acf5-aece-43a1-8c76-8ae3f6dddfc7 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:19.861915 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193acf5-aece-43a1-8c76-8ae3f6dddfc7 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:19.890860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986fc92-9b36-43f1-98a9-4374d91b7eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:19.891539 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986fc92-9b36-43f1-98a9-4374d91b7eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:19.891822 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986fc92-9b36-43f1-98a9-4374d91b7eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:19.892094 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986fc92-9b36-43f1-98a9-4374d91b7eb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:19.895114 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b986fc92-9b36-43f1-98a9-4374d91b7eb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:00:19.895697 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b986fc92-9b36-43f1-98a9-4374d91b7eb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:19.900993 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b986fc92-9b36-43f1-98a9-4374d91b7eb5 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:19.934511 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2570/5121] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:00:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:00:19.939457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11590d9d-08cc-4a80-abd1-08a8fedfef73 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:19.958631 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11590d9d-08cc-4a80-abd1-08a8fedfef73 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:19.976067 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325ac5d-38bc-4027-ab8d-becf28e49c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:19.977304 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325ac5d-38bc-4027-ab8d-becf28e49c19 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:19.977742 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325ac5d-38bc-4027-ab8d-becf28e49c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:19.978282 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325ac5d-38bc-4027-ab8d-becf28e49c19 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:19.979204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d325ac5d-38bc-4027-ab8d-becf28e49c19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:19.982211 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d325ac5d-38bc-4027-ab8d-becf28e49c19 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:20.057548 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2552/5122] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:00:19 2022] POST /identity/v3/projects => generated 397 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:20.062533 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986fc92-9b36-43f1-98a9-4374d91b7eb5 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:20.079368 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986fc92-9b36-43f1-98a9-4374d91b7eb5 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:20.163911 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138223c-523e-4e8e-8ff6-faff5f42d810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:20.165013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138223c-523e-4e8e-8ff6-faff5f42d810 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:20.165455 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138223c-523e-4e8e-8ff6-faff5f42d810 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:20.165884 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138223c-523e-4e8e-8ff6-faff5f42d810 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:20.166949 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2138223c-523e-4e8e-8ff6-faff5f42d810 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:20.169837 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2138223c-523e-4e8e-8ff6-faff5f42d810 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:20.234346 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2571/5123] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:00:20 2022] POST /identity/v3/users => generated 299 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:20.234881 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325ac5d-38bc-4027-ab8d-becf28e49c19 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:20.251643 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325ac5d-38bc-4027-ab8d-becf28e49c19 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:20.274623 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53268e64-c136-4cbb-8688-9fa018574e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:20.275535 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53268e64-c136-4cbb-8688-9fa018574e22 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:20.276388 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53268e64-c136-4cbb-8688-9fa018574e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:20.276790 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53268e64-c136-4cbb-8688-9fa018574e22 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:20.277688 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53268e64-c136-4cbb-8688-9fa018574e22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:20.282043 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53268e64-c136-4cbb-8688-9fa018574e22 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:20.303260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138223c-523e-4e8e-8ff6-faff5f42d810 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:20.304099 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2553/5124] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:00:20.316920 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138223c-523e-4e8e-8ff6-faff5f42d810 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:20.336854 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980ae0e-c9a4-414c-8d48-b4254e1ba19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:20.337568 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980ae0e-c9a4-414c-8d48-b4254e1ba19c admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:20.337913 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980ae0e-c9a4-414c-8d48-b4254e1ba19c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:20.340121 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980ae0e-c9a4-414c-8d48-b4254e1ba19c admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:20.341910 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980ae0e-c9a4-414c-8d48-b4254e1ba19c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:20.343324 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980ae0e-c9a4-414c-8d48-b4254e1ba19c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:20.403080 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2572/5125] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:00:20.406121 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53268e64-c136-4cbb-8688-9fa018574e22 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:20.420029 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53268e64-c136-4cbb-8688-9fa018574e22 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:20.425448 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef065d-7530-408f-8124-6b7e26538c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:20.426030 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef065d-7530-408f-8124-6b7e26538c6e admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:20.426306 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef065d-7530-408f-8124-6b7e26538c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:20.426730 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef065d-7530-408f-8124-6b7e26538c6e admin admin] PATH_INFO: `/v3/projects/c72ae2d3d7bc44979be93520ca9f8716/users/36b24962151447878f2c3949645ec13d/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:20.457624 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef065d-7530-408f-8124-6b7e26538c6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c72ae2d3d7bc44979be93520ca9f8716, user_id=36b24962151447878f2c3949645ec13d, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:20.461248 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef065d-7530-408f-8124-6b7e26538c6e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:20.496662 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2554/5126] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:00:20 2022] PUT /identity/v3/projects/c72ae2d3d7bc44979be93520ca9f8716/users/36b24962151447878f2c3949645ec13d/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:20.500458 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364cfad-e4e3-4b57-94ed-7b9093c5c2c4 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:20.500926 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364cfad-e4e3-4b57-94ed-7b9093c5c2c4 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:20.501354 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364cfad-e4e3-4b57-94ed-7b9093c5c2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:20.568422 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-4364cfad-e4e3-4b57-94ed-7b9093c5c2c4 None None] MFA Rules not processed for user `36b24962151447878f2c3949645ec13d`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:20.570021 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4364cfad-e4e3-4b57-94ed-7b9093c5c2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:20.666992 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2573/5127] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:20 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:20.668554 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef065d-7530-408f-8124-6b7e26538c6e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:20.860424 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4364cfad-e4e3-4b57-94ed-7b9093c5c2c4 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:20.863692 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4364cfad-e4e3-4b57-94ed-7b9093c5c2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:20.875304 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef065d-7530-408f-8124-6b7e26538c6e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:20.887338 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72060c5-02ed-4d5f-b490-5255c9adb6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:20.887968 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72060c5-02ed-4d5f-b490-5255c9adb6fa admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:20.888252 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72060c5-02ed-4d5f-b490-5255c9adb6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:20.888523 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72060c5-02ed-4d5f-b490-5255c9adb6fa admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:20.889181 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72060c5-02ed-4d5f-b490-5255c9adb6fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:20.891135 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72060c5-02ed-4d5f-b490-5255c9adb6fa admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:20.892446 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4364cfad-e4e3-4b57-94ed-7b9093c5c2c4 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:20.910607 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf1a57-57c0-47c4-bc1d-87b504641848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:20.912218 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf1a57-57c0-47c4-bc1d-87b504641848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:20.912692 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf1a57-57c0-47c4-bc1d-87b504641848 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:20.913190 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf1a57-57c0-47c4-bc1d-87b504641848 admin admin] PATH_INFO: `/v3/projects/257a58993141492f9b19c5257f3bc315` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:20.917188 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bf1a57-57c0-47c4-bc1d-87b504641848 admin admin] RBAC: Authorizing `identity:delete_project(project_id=257a58993141492f9b19c5257f3bc315)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:20.921183 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bf1a57-57c0-47c4-bc1d-87b504641848 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:20.945721 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2555/5128] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:00:20 2022] POST /identity/v3/projects => generated 397 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:20.949464 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72060c5-02ed-4d5f-b490-5255c9adb6fa admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:20.985245 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:21.010023 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-49bf1a57-57c0-47c4-bc1d-87b504641848 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '257a58993141492f9b19c5257f3bc315', 'request_id': 'req-49bf1a57-57c0-47c4-bc1d-87b504641848'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:21.017843 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-49bf1a57-57c0-47c4-bc1d-87b504641848 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '257a58993141492f9b19c5257f3bc315', 'request_id': 'req-49bf1a57-57c0-47c4-bc1d-87b504641848'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:21.028058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-49bf1a57-57c0-47c4-bc1d-87b504641848 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '257a58993141492f9b19c5257f3bc315', 'request_id': 'req-49bf1a57-57c0-47c4-bc1d-87b504641848'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:21.061503 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-49bf1a57-57c0-47c4-bc1d-87b504641848 admin admin] The token cache is being invalidate because project 257a58993141492f9b19c5257f3bc315 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:21.062000 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-49bf1a57-57c0-47c4-bc1d-87b504641848 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:21.077322 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-49bf1a57-57c0-47c4-bc1d-87b504641848 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:21.082933 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2574/5129] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:00:20 2022] DELETE /identity/v3/projects/257a58993141492f9b19c5257f3bc315 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:21.086577 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf1a57-57c0-47c4-bc1d-87b504641848 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:21.090320 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-49bf1a57-57c0-47c4-bc1d-87b504641848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:21.115671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:21.132845 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72060c5-02ed-4d5f-b490-5255c9adb6fa admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:21.275170 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf1a57-57c0-47c4-bc1d-87b504641848 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:21.283432 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cbdc05-e1ce-4265-9db8-797a322facf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:21.284541 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbdc05-e1ce-4265-9db8-797a322facf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:21.285688 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbdc05-e1ce-4265-9db8-797a322facf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:21.285688 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbdc05-e1ce-4265-9db8-797a322facf0 admin admin] PATH_INFO: `/v3/users/bab816e3b66340e29236f37add40650c` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:21.286856 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cbdc05-e1ce-4265-9db8-797a322facf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bab816e3b66340e29236f37add40650c)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:21.289113 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cbdc05-e1ce-4265-9db8-797a322facf0 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:21.299477 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ca216-e35e-4405-bd3a-5fef4653fda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:21.302011 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ca216-e35e-4405-bd3a-5fef4653fda4 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:21.302913 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ca216-e35e-4405-bd3a-5fef4653fda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:21.305759 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ca216-e35e-4405-bd3a-5fef4653fda4 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:21.307820 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ca216-e35e-4405-bd3a-5fef4653fda4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:21.312813 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ca216-e35e-4405-bd3a-5fef4653fda4 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:21.378719 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2556/5130] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:00:20 2022] POST /identity/v3/users => generated 305 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:00:21.385697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ca216-e35e-4405-bd3a-5fef4653fda4 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:21.390895 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-59cbdc05-e1ce-4265-9db8-797a322facf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bab816e3b66340e29236f37add40650c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:21.391218 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2c5ca216-e35e-4405-bd3a-5fef4653fda4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:21.392022 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-59cbdc05-e1ce-4265-9db8-797a322facf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bab816e3b66340e29236f37add40650c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:21.414152 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ca216-e35e-4405-bd3a-5fef4653fda4 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:21.418464 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-59cbdc05-e1ce-4265-9db8-797a322facf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bab816e3b66340e29236f37add40650c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:21.424850 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b54fd-6068-4090-a971-174755ce938a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:21.426796 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b54fd-6068-4090-a971-174755ce938a admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:21.427444 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b54fd-6068-4090-a971-174755ce938a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:21.427444 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b54fd-6068-4090-a971-174755ce938a admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:21.428925 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7b54fd-6068-4090-a971-174755ce938a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:21.430184 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7b54fd-6068-4090-a971-174755ce938a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:21.432090 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-59cbdc05-e1ce-4265-9db8-797a322facf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bab816e3b66340e29236f37add40650c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:21.445109 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2557/5131] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:00:21.446421 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-59cbdc05-e1ce-4265-9db8-797a322facf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bab816e3b66340e29236f37add40650c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:21.449934 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b54fd-6068-4090-a971-174755ce938a admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:21.455235 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5e7b54fd-6068-4090-a971-174755ce938a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:21.455885 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2575/5132] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:00:21 2022] DELETE /identity/v3/users/bab816e3b66340e29236f37add40650c => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:00:21.483620 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b54fd-6068-4090-a971-174755ce938a admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:21.501149 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e821f19-887d-4783-896b-a2e3d3845f47 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:21.502118 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e821f19-887d-4783-896b-a2e3d3845f47 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:21.502648 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e821f19-887d-4783-896b-a2e3d3845f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:21.527619 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-2e821f19-887d-4783-896b-a2e3d3845f47 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:21.529089 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2e821f19-887d-4783-896b-a2e3d3845f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:21.574484 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61947cbe-d8ad-4b4a-8a58-8ff8ba20408a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:21.575202 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61947cbe-d8ad-4b4a-8a58-8ff8ba20408a admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:21.575624 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61947cbe-d8ad-4b4a-8a58-8ff8ba20408a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:21.575902 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61947cbe-d8ad-4b4a-8a58-8ff8ba20408a admin admin] PATH_INFO: `/v3/projects/7054d38eed6b407f9c9e0303e6b075e1/users/a65ed27115a5472fa843fed141aa5e27/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:21.584554 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:21.593705 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61947cbe-d8ad-4b4a-8a58-8ff8ba20408a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7054d38eed6b407f9c9e0303e6b075e1, user_id=a65ed27115a5472fa843fed141aa5e27, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:21.596717 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61947cbe-d8ad-4b4a-8a58-8ff8ba20408a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:21.619613 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2558/5133] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:00:21 2022] PUT /identity/v3/projects/7054d38eed6b407f9c9e0303e6b075e1/users/a65ed27115a5472fa843fed141aa5e27/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:21.621543 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61947cbe-d8ad-4b4a-8a58-8ff8ba20408a admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:21.633732 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2576/5134] 10.222.0.83 () {58 vars in 967 bytes} [Mon Aug 29 16:00:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:00:21.649028 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e821f19-887d-4783-896b-a2e3d3845f47 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:21.651473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2e821f19-887d-4783-896b-a2e3d3845f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:21.716147 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61947cbe-d8ad-4b4a-8a58-8ff8ba20408a admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:21.724611 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544b01d-2893-4fc5-87e3-77e11c7f3aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:21.725306 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544b01d-2893-4fc5-87e3-77e11c7f3aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:21.725585 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544b01d-2893-4fc5-87e3-77e11c7f3aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:21.725858 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544b01d-2893-4fc5-87e3-77e11c7f3aa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:21.726568 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d544b01d-2893-4fc5-87e3-77e11c7f3aa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:21.728323 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d544b01d-2893-4fc5-87e3-77e11c7f3aa4 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:21.731689 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:21.744580 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2559/5135] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:00:21.745616 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544b01d-2893-4fc5-87e3-77e11c7f3aa4 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:21.750460 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d544b01d-2893-4fc5-87e3-77e11c7f3aa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:21.780415 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544b01d-2893-4fc5-87e3-77e11c7f3aa4 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:21.799191 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f6c9c-d6f2-476f-ab93-c8005e083fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:21.800710 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f6c9c-d6f2-476f-ab93-c8005e083fa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:21.801633 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f6c9c-d6f2-476f-ab93-c8005e083fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:21.802330 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f6c9c-d6f2-476f-ab93-c8005e083fa5 admin admin] PATH_INFO: `/v3/projects/0173dc7b6f834d59a64b0dfeb92fd722` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:21.804123 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34f6c9c-d6f2-476f-ab93-c8005e083fa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0173dc7b6f834d59a64b0dfeb92fd722)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:21.807069 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34f6c9c-d6f2-476f-ab93-c8005e083fa5 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:21.820199 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e821f19-887d-4783-896b-a2e3d3845f47 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:21.892739 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c34f6c9c-d6f2-476f-ab93-c8005e083fa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0173dc7b6f834d59a64b0dfeb92fd722', 'request_id': 'req-c34f6c9c-d6f2-476f-ab93-c8005e083fa5'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:21.902369 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c34f6c9c-d6f2-476f-ab93-c8005e083fa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0173dc7b6f834d59a64b0dfeb92fd722', 'request_id': 'req-c34f6c9c-d6f2-476f-ab93-c8005e083fa5'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:21.914194 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec47698-de0a-4edc-a126-bf1f3d8c3441 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:21.914840 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec47698-de0a-4edc-a126-bf1f3d8c3441 service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:21.915154 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec47698-de0a-4edc-a126-bf1f3d8c3441 service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:21.916028 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c34f6c9c-d6f2-476f-ab93-c8005e083fa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0173dc7b6f834d59a64b0dfeb92fd722', 'request_id': 'req-c34f6c9c-d6f2-476f-ab93-c8005e083fa5'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:21.917413 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec47698-de0a-4edc-a126-bf1f3d8c3441 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:21.945928 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c34f6c9c-d6f2-476f-ab93-c8005e083fa5 admin admin] The token cache is being invalidate because project 0173dc7b6f834d59a64b0dfeb92fd722 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:21.947432 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c34f6c9c-d6f2-476f-ab93-c8005e083fa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:21.948518 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c34f6c9c-d6f2-476f-ab93-c8005e083fa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:21.950535 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2560/5136] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:00:21 2022] DELETE /identity/v3/projects/0173dc7b6f834d59a64b0dfeb92fd722 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:21.951573 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f6c9c-d6f2-476f-ab93-c8005e083fa5 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:21.954222 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c34f6c9c-d6f2-476f-ab93-c8005e083fa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:22.060438 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec47698-de0a-4edc-a126-bf1f3d8c3441 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:22.062251 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec47698-de0a-4edc-a126-bf1f3d8c3441 service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:22.072781 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f6c9c-d6f2-476f-ab93-c8005e083fa5 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:22.080406 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2577/5137] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 16:00:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 16:00:22.082171 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec47698-de0a-4edc-a126-bf1f3d8c3441 service swift] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:22.087508 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc31a19-40f2-4389-b02d-e57a62012bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:22.088836 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc31a19-40f2-4389-b02d-e57a62012bcf admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:22.089305 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc31a19-40f2-4389-b02d-e57a62012bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:22.089757 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc31a19-40f2-4389-b02d-e57a62012bcf admin admin] PATH_INFO: `/v3/projects/7054d38eed6b407f9c9e0303e6b075e1/users/a65ed27115a5472fa843fed141aa5e27/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:22.096320 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc31a19-40f2-4389-b02d-e57a62012bcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7054d38eed6b407f9c9e0303e6b075e1, user_id=a65ed27115a5472fa843fed141aa5e27, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:22.099780 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc31a19-40f2-4389-b02d-e57a62012bcf admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:22.100857 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec47698-de0a-4edc-a126-bf1f3d8c3441 service swift] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:22.108074 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0fa759-ce47-44a4-b18c-6bb8ac7404f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:22.108953 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fa759-ce47-44a4-b18c-6bb8ac7404f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:22.109246 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fa759-ce47-44a4-b18c-6bb8ac7404f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:22.109525 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fa759-ce47-44a4-b18c-6bb8ac7404f3 admin admin] PATH_INFO: `/v3/users/eed8d15ef96140fa834bd27cd6e9cc0d` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:22.110827 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0fa759-ce47-44a4-b18c-6bb8ac7404f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eed8d15ef96140fa834bd27cd6e9cc0d)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:22.114556 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0fa759-ce47-44a4-b18c-6bb8ac7404f3 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:22.129743 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2561/5138] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:00:21 2022] PUT /identity/v3/projects/7054d38eed6b407f9c9e0303e6b075e1/users/a65ed27115a5472fa843fed141aa5e27/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:22.142737 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b7d31-42db-45e7-9115-02471d7e34e1 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:22.143580 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b7d31-42db-45e7-9115-02471d7e34e1 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:22.144068 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b7d31-42db-45e7-9115-02471d7e34e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:22.171650 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:22.245983 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-727b7d31-42db-45e7-9115-02471d7e34e1 None None] MFA Rules not processed for user `a65ed27115a5472fa843fed141aa5e27`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:22.246277 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5b0fa759-ce47-44a4-b18c-6bb8ac7404f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eed8d15ef96140fa834bd27cd6e9cc0d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:22.246837 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5b0fa759-ce47-44a4-b18c-6bb8ac7404f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eed8d15ef96140fa834bd27cd6e9cc0d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:22.251469 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-727b7d31-42db-45e7-9115-02471d7e34e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:22.274197 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5b0fa759-ce47-44a4-b18c-6bb8ac7404f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eed8d15ef96140fa834bd27cd6e9cc0d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:22.292252 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5b0fa759-ce47-44a4-b18c-6bb8ac7404f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eed8d15ef96140fa834bd27cd6e9cc0d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:22.311006 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5b0fa759-ce47-44a4-b18c-6bb8ac7404f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eed8d15ef96140fa834bd27cd6e9cc0d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:22.340460 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2578/5139] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:00:22 2022] DELETE /identity/v3/users/eed8d15ef96140fa834bd27cd6e9cc0d => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:22.341378 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0fa759-ce47-44a4-b18c-6bb8ac7404f3 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:22.345861 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5b0fa759-ce47-44a4-b18c-6bb8ac7404f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:22.460049 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:22.496384 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2562/5140] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:22 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:22.499977 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b7d31-42db-45e7-9115-02471d7e34e1 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:22.504760 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-727b7d31-42db-45e7-9115-02471d7e34e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:22.594608 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0fa759-ce47-44a4-b18c-6bb8ac7404f3 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:22.614807 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c0c19-3024-414f-add4-2bf685c2699a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:22.615527 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c0c19-3024-414f-add4-2bf685c2699a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:22.615813 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c0c19-3024-414f-add4-2bf685c2699a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:22.616094 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c0c19-3024-414f-add4-2bf685c2699a admin admin] PATH_INFO: `/v3/projects/5ae9b4d21f9d465ab328d3b193ae96f7` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:22.623926 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c0c19-3024-414f-add4-2bf685c2699a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ae9b4d21f9d465ab328d3b193ae96f7)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:22.625906 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c0c19-3024-414f-add4-2bf685c2699a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:22.660239 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b7d31-42db-45e7-9115-02471d7e34e1 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:22.743367 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e57c0c19-3024-414f-add4-2bf685c2699a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ae9b4d21f9d465ab328d3b193ae96f7', 'request_id': 'req-e57c0c19-3024-414f-add4-2bf685c2699a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:22.767848 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e57c0c19-3024-414f-add4-2bf685c2699a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ae9b4d21f9d465ab328d3b193ae96f7', 'request_id': 'req-e57c0c19-3024-414f-add4-2bf685c2699a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:22.798530 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e57c0c19-3024-414f-add4-2bf685c2699a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ae9b4d21f9d465ab328d3b193ae96f7', 'request_id': 'req-e57c0c19-3024-414f-add4-2bf685c2699a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:22.824186 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e57c0c19-3024-414f-add4-2bf685c2699a admin admin] The token cache is being invalidate because project 5ae9b4d21f9d465ab328d3b193ae96f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:22.824506 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e57c0c19-3024-414f-add4-2bf685c2699a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:22.825249 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e57c0c19-3024-414f-add4-2bf685c2699a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:22.827218 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2579/5141] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:00:22 2022] DELETE /identity/v3/projects/5ae9b4d21f9d465ab328d3b193ae96f7 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:22.833955 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af53f9-c32f-4df2-bf80-835894d95792 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:22.834245 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af53f9-c32f-4df2-bf80-835894d95792 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:22.834523 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af53f9-c32f-4df2-bf80-835894d95792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:22.848379 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd3080-3a4a-4682-91c6-3b8bebc2a1b7 tempest-ProjectsNegativeStaticTestJSON-2038132492 tempest-ProjectsNegativeStaticTestJSON-2038132492-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b24962151447878f2c3949645ec13d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72ae2d3d7bc44979be93520ca9f8716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:22.849049 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd3080-3a4a-4682-91c6-3b8bebc2a1b7 tempest-ProjectsNegativeStaticTestJSON-2038132492 tempest-ProjectsNegativeStaticTestJSON-2038132492-project] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:22.849340 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd3080-3a4a-4682-91c6-3b8bebc2a1b7 tempest-ProjectsNegativeStaticTestJSON-2038132492 tempest-ProjectsNegativeStaticTestJSON-2038132492-project] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:22.849621 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd3080-3a4a-4682-91c6-3b8bebc2a1b7 tempest-ProjectsNegativeStaticTestJSON-2038132492 tempest-ProjectsNegativeStaticTestJSON-2038132492-project] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:22.850258 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd3080-3a4a-4682-91c6-3b8bebc2a1b7 tempest-ProjectsNegativeStaticTestJSON-2038132492 tempest-ProjectsNegativeStaticTestJSON-2038132492-project] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:22.871128 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-86cd3080-3a4a-4682-91c6-3b8bebc2a1b7 tempest-ProjectsNegativeStaticTestJSON-2038132492 tempest-ProjectsNegativeStaticTestJSON-2038132492-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Aug 29 16:00:22.871128 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:00:22.871128 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:00:22.871128 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:00:22.871128 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:00:22.871128 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:00:22.871128 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:00:22.871128 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:00:22.871128 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:00:22.871128 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:00:22.871128 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:00:22.871128 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:00:22.871128 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 162, in post Aug 29 16:00:22.871128 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Aug 29 16:00:22.872229 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Aug 29 16:00:22.872229 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application enforcer_obj._enforce( Aug 29 16:00:22.872229 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Aug 29 16:00:22.872229 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Aug 29 16:00:22.872229 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 16:00:22.872229 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Aug 29 16:00:22.872229 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Aug 29 16:00:22.872229 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:00:22.880302 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-b3af53f9-c32f-4df2-bf80-835894d95792 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:22.881558 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b3af53f9-c32f-4df2-bf80-835894d95792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:22.883272 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2563/5142] 10.222.0.83 () {60 vars in 1152 bytes} [Mon Aug 29 16:00:22 2022] POST /identity/v3/projects => generated 136 bytes in 385 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 29 16:00:22.887408 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd3080-3a4a-4682-91c6-3b8bebc2a1b7 tempest-ProjectsNegativeStaticTestJSON-2038132492 tempest-ProjectsNegativeStaticTestJSON-2038132492-project] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:22.889279 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-86cd3080-3a4a-4682-91c6-3b8bebc2a1b7 tempest-ProjectsNegativeStaticTestJSON-2038132492 tempest-ProjectsNegativeStaticTestJSON-2038132492-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:22.959295 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:23.019576 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd3080-3a4a-4682-91c6-3b8bebc2a1b7 tempest-ProjectsNegativeStaticTestJSON-2038132492 tempest-ProjectsNegativeStaticTestJSON-2038132492-project] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:23.060194 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2580/5143] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:23.063132 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af53f9-c32f-4df2-bf80-835894d95792 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:23.067136 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b3af53f9-c32f-4df2-bf80-835894d95792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:23.096499 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af53f9-c32f-4df2-bf80-835894d95792 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:23.112962 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f1914-e4b1-4161-89d3-cffd73c8349f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:23.114728 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f1914-e4b1-4161-89d3-cffd73c8349f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:23.115512 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f1914-e4b1-4161-89d3-cffd73c8349f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:23.116904 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f1914-e4b1-4161-89d3-cffd73c8349f admin admin] PATH_INFO: `/v3/projects/5bf488c4ee4249378dc9f2f18b1be7ff` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:23.121572 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83f1914-e4b1-4161-89d3-cffd73c8349f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bf488c4ee4249378dc9f2f18b1be7ff)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:23.131001 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83f1914-e4b1-4161-89d3-cffd73c8349f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:23.142026 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb321a-a527-4497-82c2-4bfcab5acd31 tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a65ed27115a5472fa843fed141aa5e27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7054d38eed6b407f9c9e0303e6b075e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:23.142750 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb321a-a527-4497-82c2-4bfcab5acd31 tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:23.143133 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb321a-a527-4497-82c2-4bfcab5acd31 tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:23.143472 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb321a-a527-4497-82c2-4bfcab5acd31 tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:23.147796 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb321a-a527-4497-82c2-4bfcab5acd31 tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:23.150305 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb321a-a527-4497-82c2-4bfcab5acd31 tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:23.180544 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-afcb321a-a527-4497-82c2-4bfcab5acd31 tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] Invalid input for field 'name': '' is too short Aug 29 16:00:23.180544 n-d-836830-13 devstack@keystone.service[82149]: Failed validating 'minLength' in schema['properties']['name']: Aug 29 16:00:23.180544 n-d-836830-13 devstack@keystone.service[82149]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 29 16:00:23.180544 n-d-836830-13 devstack@keystone.service[82149]: On instance['name']: Aug 29 16:00:23.180544 n-d-836830-13 devstack@keystone.service[82149]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Aug 29 16:00:23.180544 n-d-836830-13 devstack@keystone.service[82149]: Failed validating 'minLength' in schema['properties']['name']: Aug 29 16:00:23.180544 n-d-836830-13 devstack@keystone.service[82149]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 29 16:00:23.180544 n-d-836830-13 devstack@keystone.service[82149]: On instance['name']: Aug 29 16:00:23.180544 n-d-836830-13 devstack@keystone.service[82149]: '' Aug 29 16:00:23.180544 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:00:23.180544 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 29 16:00:23.180544 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 29 16:00:23.180544 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 16:00:23.180544 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise error Aug 29 16:00:23.180544 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Aug 29 16:00:23.180544 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:00:23.180544 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Aug 29 16:00:23.180544 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 29 16:00:23.180544 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:00:23.180544 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application On instance['name']: Aug 29 16:00:23.180544 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application '' Aug 29 16:00:23.180544 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:00:23.180544 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 16:00:23.182121 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:00:23.182121 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:00:23.182121 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:00:23.182121 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:00:23.182121 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:00:23.182121 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:00:23.182121 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:00:23.182121 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:00:23.182121 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:00:23.182121 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:00:23.182121 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:00:23.182121 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:00:23.182121 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Aug 29 16:00:23.182121 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Aug 29 16:00:23.182121 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 29 16:00:23.182121 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 29 16:00:23.182121 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 29 16:00:23.183804 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 29 16:00:23.183804 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Aug 29 16:00:23.183804 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:00:23.183804 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Aug 29 16:00:23.183804 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 29 16:00:23.183804 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:00:23.183804 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application On instance['name']: Aug 29 16:00:23.183804 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application '' Aug 29 16:00:23.183804 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:00:23.194405 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2564/5144] 10.222.0.83 () {60 vars in 1152 bytes} [Mon Aug 29 16:00:22 2022] POST /identity/v3/projects => generated 283 bytes in 307 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Aug 29 16:00:23.201713 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42922b9e-7c0b-4094-8353-ca48d5296866 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:23.202289 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42922b9e-7c0b-4094-8353-ca48d5296866 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:23.203086 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42922b9e-7c0b-4094-8353-ca48d5296866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:23.246123 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-42922b9e-7c0b-4094-8353-ca48d5296866 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:23.248339 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-42922b9e-7c0b-4094-8353-ca48d5296866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:23.257838 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:23.259953 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f83f1914-e4b1-4161-89d3-cffd73c8349f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bf488c4ee4249378dc9f2f18b1be7ff', 'request_id': 'req-f83f1914-e4b1-4161-89d3-cffd73c8349f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:23.279473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f83f1914-e4b1-4161-89d3-cffd73c8349f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bf488c4ee4249378dc9f2f18b1be7ff', 'request_id': 'req-f83f1914-e4b1-4161-89d3-cffd73c8349f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:23.293060 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f83f1914-e4b1-4161-89d3-cffd73c8349f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bf488c4ee4249378dc9f2f18b1be7ff', 'request_id': 'req-f83f1914-e4b1-4161-89d3-cffd73c8349f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:23.311370 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f83f1914-e4b1-4161-89d3-cffd73c8349f admin admin] The token cache is being invalidate because project 5bf488c4ee4249378dc9f2f18b1be7ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:23.311888 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f83f1914-e4b1-4161-89d3-cffd73c8349f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:23.313353 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f83f1914-e4b1-4161-89d3-cffd73c8349f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:23.315758 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2581/5145] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:00:23 2022] DELETE /identity/v3/projects/5bf488c4ee4249378dc9f2f18b1be7ff => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:23.316731 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f1914-e4b1-4161-89d3-cffd73c8349f admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:23.318300 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f83f1914-e4b1-4161-89d3-cffd73c8349f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:23.377682 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2565/5146] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:23.380412 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc537f26-5dae-4b00-8674-62ac5e7dadeb None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:23.381019 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc537f26-5dae-4b00-8674-62ac5e7dadeb None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:23.381452 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc537f26-5dae-4b00-8674-62ac5e7dadeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:23.406415 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-bc537f26-5dae-4b00-8674-62ac5e7dadeb None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:23.407814 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-bc537f26-5dae-4b00-8674-62ac5e7dadeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:23.426531 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2566/5147] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:23.427558 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc537f26-5dae-4b00-8674-62ac5e7dadeb None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:23.439226 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc537f26-5dae-4b00-8674-62ac5e7dadeb None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:23.445756 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e76329-a76c-405b-9f7d-86a4383b9379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:23.447148 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e76329-a76c-405b-9f7d-86a4383b9379 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:23.447528 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e76329-a76c-405b-9f7d-86a4383b9379 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:23.447898 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e76329-a76c-405b-9f7d-86a4383b9379 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:23.448754 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e76329-a76c-405b-9f7d-86a4383b9379 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:00:23.449159 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e76329-a76c-405b-9f7d-86a4383b9379 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:23.451053 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e76329-a76c-405b-9f7d-86a4383b9379 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:23.467514 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2567/5148] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:00:23.469204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90e055-07bd-4f5b-aee5-16c17b0442cf None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:23.469588 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90e055-07bd-4f5b-aee5-16c17b0442cf None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:23.469965 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90e055-07bd-4f5b-aee5-16c17b0442cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:23.494254 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-9f90e055-07bd-4f5b-aee5-16c17b0442cf None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:23.495704 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9f90e055-07bd-4f5b-aee5-16c17b0442cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:23.500775 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f1914-e4b1-4161-89d3-cffd73c8349f admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:23.510105 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2568/5149] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:23.514676 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90e055-07bd-4f5b-aee5-16c17b0442cf None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:23.527621 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f528267-327d-483c-ae10-acd4af35e34d tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a65ed27115a5472fa843fed141aa5e27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7054d38eed6b407f9c9e0303e6b075e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:23.529140 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f528267-327d-483c-ae10-acd4af35e34d tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:23.532512 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90e055-07bd-4f5b-aee5-16c17b0442cf None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:23.540069 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f528267-327d-483c-ae10-acd4af35e34d tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:23.540773 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f528267-327d-483c-ae10-acd4af35e34d tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:23.542224 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f528267-327d-483c-ae10-acd4af35e34d tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:23.544481 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f528267-327d-483c-ae10-acd4af35e34d tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:23.548594 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ad48f-762f-4ebf-b67c-45ef933f1316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:23.549314 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ad48f-762f-4ebf-b67c-45ef933f1316 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:23.549596 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ad48f-762f-4ebf-b67c-45ef933f1316 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:23.550361 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ad48f-762f-4ebf-b67c-45ef933f1316 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:23.551191 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28ad48f-762f-4ebf-b67c-45ef933f1316 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:23.553116 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28ad48f-762f-4ebf-b67c-45ef933f1316 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:23.555360 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-8f528267-327d-483c-ae10-acd4af35e34d tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 16:00:23.555360 n-d-836830-13 devstack@keystone.service[82148]: Failed validating 'maxLength' in schema['properties']['name']: Aug 29 16:00:23.555360 n-d-836830-13 devstack@keystone.service[82148]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 29 16:00:23.555360 n-d-836830-13 devstack@keystone.service[82148]: On instance['name']: Aug 29 16:00:23.555360 n-d-836830-13 devstack@keystone.service[82148]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 16:00:23.555360 n-d-836830-13 devstack@keystone.service[82148]: Failed validating 'maxLength' in schema['properties']['name']: Aug 29 16:00:23.555360 n-d-836830-13 devstack@keystone.service[82148]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 29 16:00:23.555360 n-d-836830-13 devstack@keystone.service[82148]: On instance['name']: Aug 29 16:00:23.555360 n-d-836830-13 devstack@keystone.service[82148]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 29 16:00:23.555360 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:00:23.555360 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 29 16:00:23.555360 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 29 16:00:23.555360 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 16:00:23.555360 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise error Aug 29 16:00:23.555360 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 16:00:23.555360 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:00:23.555360 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Aug 29 16:00:23.555360 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 29 16:00:23.556578 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:00:23.556578 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application On instance['name']: Aug 29 16:00:23.556578 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 29 16:00:23.556578 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:00:23.556578 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 16:00:23.556578 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:00:23.556578 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:00:23.556578 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:00:23.556578 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:00:23.556578 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:00:23.556578 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:00:23.556578 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:00:23.556578 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:00:23.556578 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:00:23.556578 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:00:23.556578 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:00:23.556578 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:00:23.556578 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Aug 29 16:00:23.557812 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Aug 29 16:00:23.557812 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 29 16:00:23.557812 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 29 16:00:23.557812 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 29 16:00:23.557812 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 29 16:00:23.557812 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 16:00:23.557812 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:00:23.557812 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Aug 29 16:00:23.557812 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 29 16:00:23.557812 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:00:23.557812 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application On instance['name']: Aug 29 16:00:23.557812 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 29 16:00:23.557812 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:00:23.562728 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2582/5150] 10.222.0.83 () {60 vars in 1152 bytes} [Mon Aug 29 16:00:23 2022] POST /identity/v3/projects => generated 412 bytes in 246 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 29 16:00:23.564098 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f528267-327d-483c-ae10-acd4af35e34d tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:23.584454 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f528267-327d-483c-ae10-acd4af35e34d tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:23.592189 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfce820-525e-4ebc-9d77-aecdba006600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:23.595290 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfce820-525e-4ebc-9d77-aecdba006600 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:23.596366 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfce820-525e-4ebc-9d77-aecdba006600 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:23.597383 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfce820-525e-4ebc-9d77-aecdba006600 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:23.598320 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfce820-525e-4ebc-9d77-aecdba006600 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:00:23.599149 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfce820-525e-4ebc-9d77-aecdba006600 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:23.601169 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfce820-525e-4ebc-9d77-aecdba006600 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:23.622839 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2583/5151] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:00:23.625049 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfce820-525e-4ebc-9d77-aecdba006600 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:23.639262 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfce820-525e-4ebc-9d77-aecdba006600 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:23.646516 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2569/5152] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:00:23 2022] POST /identity/v3/projects => generated 371 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:23.649173 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ad48f-762f-4ebf-b67c-45ef933f1316 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:23.739633 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:23.787569 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec84176-6e7c-4041-8b55-463b475b811c tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a65ed27115a5472fa843fed141aa5e27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7054d38eed6b407f9c9e0303e6b075e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:23.788239 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec84176-6e7c-4041-8b55-463b475b811c tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:23.788525 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec84176-6e7c-4041-8b55-463b475b811c tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:23.788807 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec84176-6e7c-4041-8b55-463b475b811c tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] PATH_INFO: `/v3/projects/cdae79b44c67460e93ff90489d3ca531` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:23.792626 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ad48f-762f-4ebf-b67c-45ef933f1316 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:23.806109 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca24fe-33d2-486f-ae3f-63e286ad3a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:23.806998 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca24fe-33d2-486f-ae3f-63e286ad3a0a admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:23.807310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca24fe-33d2-486f-ae3f-63e286ad3a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:23.807580 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca24fe-33d2-486f-ae3f-63e286ad3a0a admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:23.807895 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec84176-6e7c-4041-8b55-463b475b811c tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cdae79b44c67460e93ff90489d3ca531)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:23.808222 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca24fe-33d2-486f-ae3f-63e286ad3a0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:23.809841 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec84176-6e7c-4041-8b55-463b475b811c tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:23.816317 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca24fe-33d2-486f-ae3f-63e286ad3a0a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:23.835093 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-bec84176-6e7c-4041-8b55-463b475b811c tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] Could not find project: cdae79b44c67460e93ff90489d3ca531.: keystone.exception.ProjectNotFound: Could not find project: cdae79b44c67460e93ff90489d3ca531. Aug 29 16:00:23.835093 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:00:23.835093 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:00:23.835093 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:00:23.835093 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:00:23.835093 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:00:23.835093 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:00:23.835093 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:00:23.835093 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:00:23.835093 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:00:23.835093 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:00:23.835093 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:00:23.835093 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Aug 29 16:00:23.835093 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Aug 29 16:00:23.836299 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:00:23.836299 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:00:23.836299 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Aug 29 16:00:23.836299 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Aug 29 16:00:23.836299 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 16:00:23.836299 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 16:00:23.836299 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 16:00:23.836299 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 16:00:23.836299 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: cdae79b44c67460e93ff90489d3ca531. Aug 29 16:00:23.836299 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:00:23.840595 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2584/5153] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:00:23 2022] DELETE /identity/v3/projects/cdae79b44c67460e93ff90489d3ca531 => generated 113 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 16:00:23.841434 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec84176-6e7c-4041-8b55-463b475b811c tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:23.858414 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec84176-6e7c-4041-8b55-463b475b811c tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:23.863454 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb079955-bb4d-40ff-9108-2d0a35ef1ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:23.864561 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb079955-bb4d-40ff-9108-2d0a35ef1ef4 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:23.864853 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb079955-bb4d-40ff-9108-2d0a35ef1ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:23.865127 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb079955-bb4d-40ff-9108-2d0a35ef1ef4 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:23.865831 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb079955-bb4d-40ff-9108-2d0a35ef1ef4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:23.867943 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb079955-bb4d-40ff-9108-2d0a35ef1ef4 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:23.895624 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2570/5154] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:00:23 2022] POST /identity/v3/projects => generated 393 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:23.895624 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca24fe-33d2-486f-ae3f-63e286ad3a0a admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:23.897970 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a7ca24fe-33d2-486f-ae3f-63e286ad3a0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:23.934113 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2585/5155] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:00:23 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:23.936777 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb079955-bb4d-40ff-9108-2d0a35ef1ef4 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:23.952499 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb079955-bb4d-40ff-9108-2d0a35ef1ef4 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:24.027328 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:24.044004 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c914627-2c12-408e-8ced-7bd2666234c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:24.046612 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca24fe-33d2-486f-ae3f-63e286ad3a0a admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:24.048128 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c914627-2c12-408e-8ced-7bd2666234c8 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:24.048502 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c914627-2c12-408e-8ced-7bd2666234c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:24.049240 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c914627-2c12-408e-8ced-7bd2666234c8 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:24.051190 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c914627-2c12-408e-8ced-7bd2666234c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:24.054487 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c914627-2c12-408e-8ced-7bd2666234c8 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:24.056906 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf9a07-547f-4445-a0e5-325e7c548121 tempest-ProjectsNegativeStaticTestJSON-2038132492 tempest-ProjectsNegativeStaticTestJSON-2038132492-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b24962151447878f2c3949645ec13d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72ae2d3d7bc44979be93520ca9f8716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:24.057807 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf9a07-547f-4445-a0e5-325e7c548121 tempest-ProjectsNegativeStaticTestJSON-2038132492 tempest-ProjectsNegativeStaticTestJSON-2038132492-project] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:24.058276 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf9a07-547f-4445-a0e5-325e7c548121 tempest-ProjectsNegativeStaticTestJSON-2038132492 tempest-ProjectsNegativeStaticTestJSON-2038132492-project] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:24.059645 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf9a07-547f-4445-a0e5-325e7c548121 tempest-ProjectsNegativeStaticTestJSON-2038132492 tempest-ProjectsNegativeStaticTestJSON-2038132492-project] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:24.060516 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf9a07-547f-4445-a0e5-325e7c548121 tempest-ProjectsNegativeStaticTestJSON-2038132492 tempest-ProjectsNegativeStaticTestJSON-2038132492-project] RBAC: Authorizing `identity:list_projects()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:24.071146 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-6edf9a07-547f-4445-a0e5-325e7c548121 tempest-ProjectsNegativeStaticTestJSON-2038132492 tempest-ProjectsNegativeStaticTestJSON-2038132492-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Aug 29 16:00:24.071146 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:00:24.071146 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:00:24.071146 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:00:24.071146 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:00:24.071146 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:00:24.071146 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:00:24.071146 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:00:24.071146 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:00:24.071146 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:00:24.071146 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:00:24.071146 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:00:24.071146 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 153, in get Aug 29 16:00:24.071146 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._list_projects() Aug 29 16:00:24.072325 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 120, in _list_projects Aug 29 16:00:24.072325 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:list_projects', Aug 29 16:00:24.072325 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Aug 29 16:00:24.072325 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application enforcer_obj._enforce( Aug 29 16:00:24.072325 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Aug 29 16:00:24.072325 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Aug 29 16:00:24.072325 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 16:00:24.072325 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Aug 29 16:00:24.072325 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Aug 29 16:00:24.072325 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:00:24.075522 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2571/5156] 10.222.0.83 () {58 vars in 1131 bytes} [Mon Aug 29 16:00:23 2022] GET /identity/v3/projects => generated 135 bytes in 184 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 29 16:00:24.076821 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf9a07-547f-4445-a0e5-325e7c548121 tempest-ProjectsNegativeStaticTestJSON-2038132492 tempest-ProjectsNegativeStaticTestJSON-2038132492-project] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:24.087591 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2586/5157] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:00:23 2022] POST /identity/v3/users => generated 297 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:24.088666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c914627-2c12-408e-8ced-7bd2666234c8 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:24.096439 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf9a07-547f-4445-a0e5-325e7c548121 tempest-ProjectsNegativeStaticTestJSON-2038132492 tempest-ProjectsNegativeStaticTestJSON-2038132492-project] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:24.102929 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b0496-fbc0-4bc4-b457-a694a32993cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:24.103877 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b0496-fbc0-4bc4-b457-a694a32993cc admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:24.104385 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b0496-fbc0-4bc4-b457-a694a32993cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:24.105133 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b0496-fbc0-4bc4-b457-a694a32993cc admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:24.106179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b0496-fbc0-4bc4-b457-a694a32993cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:24.108152 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b0496-fbc0-4bc4-b457-a694a32993cc admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:24.123401 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2572/5158] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:00:24.124674 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b0496-fbc0-4bc4-b457-a694a32993cc admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:24.140258 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b0496-fbc0-4bc4-b457-a694a32993cc admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:24.147645 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185e5a8-782c-43ec-9197-6e6236c30783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:24.148589 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185e5a8-782c-43ec-9197-6e6236c30783 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:24.149155 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185e5a8-782c-43ec-9197-6e6236c30783 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:24.149594 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185e5a8-782c-43ec-9197-6e6236c30783 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:24.150382 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1185e5a8-782c-43ec-9197-6e6236c30783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:24.152857 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1185e5a8-782c-43ec-9197-6e6236c30783 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:24.167387 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2573/5159] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:00:24.168995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185e5a8-782c-43ec-9197-6e6236c30783 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:24.184772 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185e5a8-782c-43ec-9197-6e6236c30783 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:24.195525 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f9bc90-03da-4d79-9e91-0ecd36d16a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:24.196880 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9bc90-03da-4d79-9e91-0ecd36d16a47 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:24.197986 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9bc90-03da-4d79-9e91-0ecd36d16a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:24.198980 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9bc90-03da-4d79-9e91-0ecd36d16a47 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:24.200933 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f9bc90-03da-4d79-9e91-0ecd36d16a47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:24.203722 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f9bc90-03da-4d79-9e91-0ecd36d16a47 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:24.209788 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c914627-2c12-408e-8ced-7bd2666234c8 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:24.224915 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b00706-28ad-48a1-bff1-9e82a498503b tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a65ed27115a5472fa843fed141aa5e27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7054d38eed6b407f9c9e0303e6b075e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:24.225563 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b00706-28ad-48a1-bff1-9e82a498503b tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:24.225856 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b00706-28ad-48a1-bff1-9e82a498503b tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:24.226139 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b00706-28ad-48a1-bff1-9e82a498503b tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:24.229279 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b00706-28ad-48a1-bff1-9e82a498503b tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:24.231442 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b00706-28ad-48a1-bff1-9e82a498503b tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:24.233191 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2574/5160] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:00:24.234258 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f9bc90-03da-4d79-9e91-0ecd36d16a47 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:24.247899 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f9bc90-03da-4d79-9e91-0ecd36d16a47 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:24.256030 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0596132-1e4a-4f48-ad3b-24adee7ca445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:24.256794 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0596132-1e4a-4f48-ad3b-24adee7ca445 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:24.257202 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0596132-1e4a-4f48-ad3b-24adee7ca445 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:24.257593 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0596132-1e4a-4f48-ad3b-24adee7ca445 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:24.258500 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0596132-1e4a-4f48-ad3b-24adee7ca445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:24.260163 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0596132-1e4a-4f48-ad3b-24adee7ca445 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:24.275518 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2575/5161] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:00:24.276499 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0596132-1e4a-4f48-ad3b-24adee7ca445 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:24.290301 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0596132-1e4a-4f48-ad3b-24adee7ca445 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:24.294893 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2587/5162] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:00:24 2022] POST /identity/v3/projects => generated 358 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:24.299770 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b00706-28ad-48a1-bff1-9e82a498503b tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:24.346366 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:24.402304 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9382fe-7b30-4d64-a4ba-f70ffd6fe644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:24.403169 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9382fe-7b30-4d64-a4ba-f70ffd6fe644 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:24.404052 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9382fe-7b30-4d64-a4ba-f70ffd6fe644 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:24.404052 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9382fe-7b30-4d64-a4ba-f70ffd6fe644 admin admin] PATH_INFO: `/v3/projects/217e797be459419998367ef1e6ef7c53/users/36b64ddf330f48cfa83f006f7a14f544/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:24.409228 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b00706-28ad-48a1-bff1-9e82a498503b tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:24.415892 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f412a-739b-45af-8b31-1a7590bf7cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:24.416767 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f412a-739b-45af-8b31-1a7590bf7cb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:24.417400 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f412a-739b-45af-8b31-1a7590bf7cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:24.417830 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f412a-739b-45af-8b31-1a7590bf7cb4 admin admin] PATH_INFO: `/v3/projects/3a66e65080b74b1993dc4cd80e231fe8/users/645603f75ac74919b27b8cb938e460ed/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:24.436649 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f412a-739b-45af-8b31-1a7590bf7cb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a66e65080b74b1993dc4cd80e231fe8, user_id=645603f75ac74919b27b8cb938e460ed, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:24.440303 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f412a-739b-45af-8b31-1a7590bf7cb4 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:24.448406 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9382fe-7b30-4d64-a4ba-f70ffd6fe644 admin admin] RBAC: Authorizing `identity:create_grant(project_id=217e797be459419998367ef1e6ef7c53, user_id=36b64ddf330f48cfa83f006f7a14f544, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:24.456531 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9382fe-7b30-4d64-a4ba-f70ffd6fe644 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:24.470873 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2588/5163] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:00:24 2022] PUT /identity/v3/projects/3a66e65080b74b1993dc4cd80e231fe8/users/645603f75ac74919b27b8cb938e460ed/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:24.470873 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f412a-739b-45af-8b31-1a7590bf7cb4 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:24.495111 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2576/5164] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:00:24 2022] PUT /identity/v3/projects/217e797be459419998367ef1e6ef7c53/users/36b64ddf330f48cfa83f006f7a14f544/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:24.495111 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503176e-ae0d-42d7-ae45-e24bb077616b None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:24.495111 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503176e-ae0d-42d7-ae45-e24bb077616b None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:24.495111 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503176e-ae0d-42d7-ae45-e24bb077616b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:24.543122 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-2503176e-ae0d-42d7-ae45-e24bb077616b None None] MFA Rules not processed for user `645603f75ac74919b27b8cb938e460ed`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:24.558943 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2503176e-ae0d-42d7-ae45-e24bb077616b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:24.575234 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f412a-739b-45af-8b31-1a7590bf7cb4 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:24.661180 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2577/5165] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:24.662988 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815df43-9ec3-4178-b990-09dff97aa396 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:24.663301 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815df43-9ec3-4178-b990-09dff97aa396 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:24.663574 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815df43-9ec3-4178-b990-09dff97aa396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:24.700680 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a11938-a76e-4760-992a-594ceae28885 tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a65ed27115a5472fa843fed141aa5e27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7054d38eed6b407f9c9e0303e6b075e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:24.701332 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a11938-a76e-4760-992a-594ceae28885 tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:24.701619 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a11938-a76e-4760-992a-594ceae28885 tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:24.701895 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a11938-a76e-4760-992a-594ceae28885 tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:24.702947 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a11938-a76e-4760-992a-594ceae28885 tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:24.712879 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a11938-a76e-4760-992a-594ceae28885 tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:24.729827 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-c815df43-9ec3-4178-b990-09dff97aa396 None None] MFA Rules not processed for user `36b64ddf330f48cfa83f006f7a14f544`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:24.731195 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c815df43-9ec3-4178-b990-09dff97aa396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:24.752528 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.sql.core [None req-b5a11938-a76e-4760-992a-594ceae28885 tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-1427855527' for key 'project.ixu_project_name_domain_id'") Aug 29 16:00:24.752528 n-d-836830-13 devstack@keystone.service[82148]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 29 16:00:24.752528 n-d-836830-13 devstack@keystone.service[82148]: [parameters: {'id': '921098ae94134e728a80d8015c60ca50', 'name': 'tempest-project-dup-1427855527', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 29 16:00:24.752528 n-d-836830-13 devstack@keystone.service[82148]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82148) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 16:00:24.755877 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:24.765716 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-b5a11938-a76e-4760-992a-594ceae28885 tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1427855527, project id 921098ae94134e728a80d8015c60ca50.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1427855527, project id 921098ae94134e728a80d8015c60ca50. Aug 29 16:00:24.765716 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:00:24.765716 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 16:00:24.765716 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 16:00:24.765716 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 16:00:24.765716 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 16:00:24.765716 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 16:00:24.765716 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 16:00:24.765716 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 16:00:24.765716 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application conn.query(q) Aug 29 16:00:24.765716 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 16:00:24.765716 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 16:00:24.766737 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 16:00:24.766737 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application result.read() Aug 29 16:00:24.766737 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 16:00:24.766737 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 16:00:24.766737 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 16:00:24.766737 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 16:00:24.766737 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 16:00:24.766737 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 16:00:24.766737 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 16:00:24.766737 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 16:00:24.766737 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-tempest-project-dup-1427855527' for key 'project.ixu_project_name_domain_id'") Aug 29 16:00:24.766737 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:00:24.766737 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 16:00:24.766737 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:00:24.766737 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:00:24.766737 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 16:00:24.766737 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 16:00:24.768161 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 29 16:00:24.768161 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 29 16:00:24.768161 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 16:00:24.768161 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application next(self.gen) Aug 29 16:00:24.768161 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 16:00:24.768161 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application yield resource Aug 29 16:00:24.768161 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 16:00:24.768161 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application next(self.gen) Aug 29 16:00:24.768161 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 16:00:24.768161 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 16:00:24.768161 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 16:00:24.768161 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 16:00:24.768161 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 16:00:24.768161 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise self.value Aug 29 16:00:24.768161 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 16:00:24.768161 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 16:00:24.768161 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 16:00:24.768161 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application session.commit() Aug 29 16:00:24.770372 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 16:00:24.770372 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 16:00:24.770372 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 16:00:24.770372 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 16:00:24.770372 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 16:00:24.770372 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self.session.flush() Aug 29 16:00:24.770372 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 16:00:24.770372 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 16:00:24.770372 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 16:00:24.770372 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 16:00:24.770372 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 16:00:24.770372 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application compat.raise_( Aug 29 16:00:24.770372 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 16:00:24.770372 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception Aug 29 16:00:24.770372 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 16:00:24.770372 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 16:00:24.770372 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 16:00:24.771797 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 16:00:24.771797 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 16:00:24.771797 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 16:00:24.771797 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 16:00:24.771797 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 16:00:24.771797 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 29 16:00:24.771797 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 29 16:00:24.771797 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 16:00:24.771797 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 16:00:24.771797 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 16:00:24.771797 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 16:00:24.771797 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 16:00:24.771797 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 16:00:24.771797 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 16:00:24.771797 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 16:00:24.771797 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 16:00:24.773508 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 16:00:24.773508 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 16:00:24.773508 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception Aug 29 16:00:24.773508 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 16:00:24.773508 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 16:00:24.773508 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 16:00:24.773508 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 16:00:24.773508 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 16:00:24.773508 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 16:00:24.773508 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 16:00:24.773508 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application conn.query(q) Aug 29 16:00:24.773508 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 16:00:24.773508 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 16:00:24.773508 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 16:00:24.773508 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application result.read() Aug 29 16:00:24.773508 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 16:00:24.773508 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 16:00:24.777660 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 16:00:24.777660 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 16:00:24.777660 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 16:00:24.777660 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 16:00:24.777660 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 16:00:24.777660 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 16:00:24.777660 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-1427855527' for key 'project.ixu_project_name_domain_id'") Aug 29 16:00:24.777660 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 29 16:00:24.777660 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [parameters: {'id': '921098ae94134e728a80d8015c60ca50', 'name': 'tempest-project-dup-1427855527', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 29 16:00:24.777660 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 16:00:24.777660 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:00:24.777660 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 16:00:24.777660 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:00:24.777660 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:00:24.777660 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 29 16:00:24.778912 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 29 16:00:24.778912 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 16:00:24.778912 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 16:00:24.778912 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-project-dup-1427855527 at domain ID default. Aug 29 16:00:24.778912 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:00:24.778912 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 16:00:24.778912 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:00:24.778912 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:00:24.778912 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:00:24.778912 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:00:24.778912 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:00:24.778912 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:00:24.778912 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:00:24.778912 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:00:24.778912 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:00:24.778912 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:00:24.778912 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:00:24.780201 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:00:24.780201 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 29 16:00:24.780201 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 29 16:00:24.780201 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:00:24.780201 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:00:24.780201 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 29 16:00:24.780201 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 29 16:00:24.780201 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1427855527, project id 921098ae94134e728a80d8015c60ca50. Aug 29 16:00:24.780201 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:00:24.783068 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2589/5166] 10.222.0.83 () {60 vars in 1152 bytes} [Mon Aug 29 16:00:24 2022] POST /identity/v3/projects => generated 285 bytes in 319 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 29 16:00:24.783068 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a11938-a76e-4760-992a-594ceae28885 tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:24.854451 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:24.874148 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a11938-a76e-4760-992a-594ceae28885 tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:24.878217 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2578/5167] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:24.880280 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c815df43-9ec3-4178-b990-09dff97aa396 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:24.880838 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf5566-7f3a-4dd5-a4f1-373f901f1bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:24.881639 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf5566-7f3a-4dd5-a4f1-373f901f1bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:24.882097 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf5566-7f3a-4dd5-a4f1-373f901f1bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:24.882521 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf5566-7f3a-4dd5-a4f1-373f901f1bc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:24.892425 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf5566-7f3a-4dd5-a4f1-373f901f1bc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:24.895093 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c815df43-9ec3-4178-b990-09dff97aa396 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:24.896513 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf5566-7f3a-4dd5-a4f1-373f901f1bc1 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:24.913028 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5325318d-e616-4d35-8d86-2a3c3798ac85 tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a65ed27115a5472fa843fed141aa5e27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7054d38eed6b407f9c9e0303e6b075e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:24.913977 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5325318d-e616-4d35-8d86-2a3c3798ac85 tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:24.913977 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5325318d-e616-4d35-8d86-2a3c3798ac85 tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:24.914169 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5325318d-e616-4d35-8d86-2a3c3798ac85 tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] PATH_INFO: `/v3/projects/928e437b628d438f82359c00625a0a18` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:24.915814 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5325318d-e616-4d35-8d86-2a3c3798ac85 tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] RBAC: Authorizing `identity:delete_project(project_id=928e437b628d438f82359c00625a0a18)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:24.924210 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5325318d-e616-4d35-8d86-2a3c3798ac85 tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:24.944149 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2590/5168] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:00:24 2022] POST /identity/v3/projects => generated 391 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:24.945173 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf5566-7f3a-4dd5-a4f1-373f901f1bc1 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:24.947319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-95cf5566-7f3a-4dd5-a4f1-373f901f1bc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:24.999229 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5325318d-e616-4d35-8d86-2a3c3798ac85 tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '928e437b628d438f82359c00625a0a18', 'request_id': 'req-5325318d-e616-4d35-8d86-2a3c3798ac85'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:25.007244 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5325318d-e616-4d35-8d86-2a3c3798ac85 tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '928e437b628d438f82359c00625a0a18', 'request_id': 'req-5325318d-e616-4d35-8d86-2a3c3798ac85'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:25.015539 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5325318d-e616-4d35-8d86-2a3c3798ac85 tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '928e437b628d438f82359c00625a0a18', 'request_id': 'req-5325318d-e616-4d35-8d86-2a3c3798ac85'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:25.033299 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5325318d-e616-4d35-8d86-2a3c3798ac85 tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] The token cache is being invalidate because project 928e437b628d438f82359c00625a0a18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:25.034311 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5325318d-e616-4d35-8d86-2a3c3798ac85 tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:25.035229 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5325318d-e616-4d35-8d86-2a3c3798ac85 tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:25.042040 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2579/5169] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:00:24 2022] DELETE /identity/v3/projects/928e437b628d438f82359c00625a0a18 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:25.043310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5325318d-e616-4d35-8d86-2a3c3798ac85 tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:25.045824 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5325318d-e616-4d35-8d86-2a3c3798ac85 tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:25.070773 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf5566-7f3a-4dd5-a4f1-373f901f1bc1 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:25.157983 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5325318d-e616-4d35-8d86-2a3c3798ac85 tempest-ProjectsNegativeStaticTestJSON-1743950067 tempest-ProjectsNegativeStaticTestJSON-1743950067-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:25.169240 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bf17e-33ec-4278-8a56-1760ab066b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:25.169976 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bf17e-33ec-4278-8a56-1760ab066b7d admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:25.170251 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bf17e-33ec-4278-8a56-1760ab066b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:25.170371 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d585365-402d-4b5c-b82e-1b22bf40fe79 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6b0f9835ed549cab91d684326be83fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:25.170530 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bf17e-33ec-4278-8a56-1760ab066b7d admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:25.171284 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d585365-402d-4b5c-b82e-1b22bf40fe79 service glance] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:25.171409 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455bf17e-33ec-4278-8a56-1760ab066b7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:25.171564 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d585365-402d-4b5c-b82e-1b22bf40fe79 service glance] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:25.171941 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d585365-402d-4b5c-b82e-1b22bf40fe79 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:25.175087 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0d585365-402d-4b5c-b82e-1b22bf40fe79 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:25.175818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455bf17e-33ec-4278-8a56-1760ab066b7d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:25.216392 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2580/5170] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:00:25 2022] POST /identity/v3/users => generated 302 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:25.218349 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bf17e-33ec-4278-8a56-1760ab066b7d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:25.221619 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-455bf17e-33ec-4278-8a56-1760ab066b7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:25.239090 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bf17e-33ec-4278-8a56-1760ab066b7d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:25.247404 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da37d73-260a-4573-a18f-3fc06d2974a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:25.248457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da37d73-260a-4573-a18f-3fc06d2974a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:25.248745 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da37d73-260a-4573-a18f-3fc06d2974a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:25.249561 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da37d73-260a-4573-a18f-3fc06d2974a2 admin admin] PATH_INFO: `/v3/users/36b24962151447878f2c3949645ec13d` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:25.250903 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da37d73-260a-4573-a18f-3fc06d2974a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36b24962151447878f2c3949645ec13d)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:25.254396 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da37d73-260a-4573-a18f-3fc06d2974a2 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:25.284853 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:25.336894 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8da37d73-260a-4573-a18f-3fc06d2974a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36b24962151447878f2c3949645ec13d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:25.337728 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8da37d73-260a-4573-a18f-3fc06d2974a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36b24962151447878f2c3949645ec13d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:25.354683 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8da37d73-260a-4573-a18f-3fc06d2974a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36b24962151447878f2c3949645ec13d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:25.366880 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8da37d73-260a-4573-a18f-3fc06d2974a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36b24962151447878f2c3949645ec13d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:25.367946 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8da37d73-260a-4573-a18f-3fc06d2974a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36b24962151447878f2c3949645ec13d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:25.388620 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d585365-402d-4b5c-b82e-1b22bf40fe79 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:25.390268 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d585365-402d-4b5c-b82e-1b22bf40fe79 service glance] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:25.417606 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2591/5171] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:00:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:00:25.419495 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2581/5172] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:00:25 2022] DELETE /identity/v3/users/36b24962151447878f2c3949645ec13d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:25.420539 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d585365-402d-4b5c-b82e-1b22bf40fe79 service glance] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:25.426248 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82965ba-f7e3-46dc-9714-8af8d5a05f3d None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:25.426606 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82965ba-f7e3-46dc-9714-8af8d5a05f3d None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:25.427911 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82965ba-f7e3-46dc-9714-8af8d5a05f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:25.443367 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d585365-402d-4b5c-b82e-1b22bf40fe79 service glance] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:25.478674 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-e82965ba-f7e3-46dc-9714-8af8d5a05f3d None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:25.480430 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e82965ba-f7e3-46dc-9714-8af8d5a05f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:25.564713 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:25.585295 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2582/5173] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:25.586936 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82965ba-f7e3-46dc-9714-8af8d5a05f3d None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:25.588502 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e82965ba-f7e3-46dc-9714-8af8d5a05f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:25.600136 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8568c50-3338-4bcd-90bb-1005e469ad29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:25.600768 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8568c50-3338-4bcd-90bb-1005e469ad29 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:25.601166 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8568c50-3338-4bcd-90bb-1005e469ad29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:25.601448 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8568c50-3338-4bcd-90bb-1005e469ad29 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:25.602860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8568c50-3338-4bcd-90bb-1005e469ad29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:25.604526 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8568c50-3338-4bcd-90bb-1005e469ad29 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:25.629285 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2592/5174] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:00:25.633473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8568c50-3338-4bcd-90bb-1005e469ad29 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:25.640272 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c8568c50-3338-4bcd-90bb-1005e469ad29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:25.668795 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8568c50-3338-4bcd-90bb-1005e469ad29 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:25.677969 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82965ba-f7e3-46dc-9714-8af8d5a05f3d None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:25.682784 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13a53e-1893-4860-b5ba-5271c9564447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:25.683014 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf71b5-034f-416a-8931-266417b2992f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:25.683572 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13a53e-1893-4860-b5ba-5271c9564447 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:25.684164 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf71b5-034f-416a-8931-266417b2992f service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:25.684330 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13a53e-1893-4860-b5ba-5271c9564447 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:25.684451 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf71b5-034f-416a-8931-266417b2992f service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:25.684587 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13a53e-1893-4860-b5ba-5271c9564447 admin admin] PATH_INFO: `/v3/projects/664075d614754d0aa2e181f9be901fe7/users/781d0780cdf247738ff74fa706535541/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:25.684855 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf71b5-034f-416a-8931-266417b2992f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:25.704521 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf71b5-034f-416a-8931-266417b2992f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:25.706871 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf71b5-034f-416a-8931-266417b2992f service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:25.718522 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b13a53e-1893-4860-b5ba-5271c9564447 admin admin] RBAC: Authorizing `identity:create_grant(project_id=664075d614754d0aa2e181f9be901fe7, user_id=781d0780cdf247738ff74fa706535541, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:25.719368 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2583/5175] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:00:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:00:25.721897 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b13a53e-1893-4860-b5ba-5271c9564447 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:25.751082 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2593/5176] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:00:25 2022] PUT /identity/v3/projects/664075d614754d0aa2e181f9be901fe7/users/781d0780cdf247738ff74fa706535541/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:25.759526 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf71b5-034f-416a-8931-266417b2992f service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:25.787419 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf71b5-034f-416a-8931-266417b2992f service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:25.999666 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:26.077613 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d556369-4b05-4d06-b186-19da02c005a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:26.080308 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d556369-4b05-4d06-b186-19da02c005a6 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:26.080308 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d556369-4b05-4d06-b186-19da02c005a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:26.080674 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d556369-4b05-4d06-b186-19da02c005a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:26.089483 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d556369-4b05-4d06-b186-19da02c005a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:26.101744 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d556369-4b05-4d06-b186-19da02c005a6 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:26.140006 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13a53e-1893-4860-b5ba-5271c9564447 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:26.147216 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2584/5177] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:00:26.169625 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13a53e-1893-4860-b5ba-5271c9564447 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:26.188929 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2fb5b7-1ca7-4c38-a465-c25162946605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:26.189477 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fb5b7-1ca7-4c38-a465-c25162946605 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:26.189894 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fb5b7-1ca7-4c38-a465-c25162946605 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:26.190133 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fb5b7-1ca7-4c38-a465-c25162946605 admin admin] PATH_INFO: `/v3/projects/664075d614754d0aa2e181f9be901fe7/users/781d0780cdf247738ff74fa706535541/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:26.195705 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2fb5b7-1ca7-4c38-a465-c25162946605 admin admin] RBAC: Authorizing `identity:create_grant(project_id=664075d614754d0aa2e181f9be901fe7, user_id=781d0780cdf247738ff74fa706535541, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:26.198405 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2fb5b7-1ca7-4c38-a465-c25162946605 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:26.242767 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2594/5178] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:00:26 2022] PUT /identity/v3/projects/664075d614754d0aa2e181f9be901fe7/users/781d0780cdf247738ff74fa706535541/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:26.247741 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045351d-c5dc-48ed-8e20-6a4c22c1d7e3 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:26.248577 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045351d-c5dc-48ed-8e20-6a4c22c1d7e3 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:26.249102 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045351d-c5dc-48ed-8e20-6a4c22c1d7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:26.327008 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-3045351d-c5dc-48ed-8e20-6a4c22c1d7e3 None None] MFA Rules not processed for user `781d0780cdf247738ff74fa706535541`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:26.341230 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3045351d-c5dc-48ed-8e20-6a4c22c1d7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:26.559745 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2585/5179] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:26 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:26.621230 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2fb5b7-1ca7-4c38-a465-c25162946605 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:26.764966 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2fb5b7-1ca7-4c38-a465-c25162946605 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:26.780743 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd8d67-9d06-454d-937f-2ed693c1b0ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:26.786106 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd8d67-9d06-454d-937f-2ed693c1b0ee service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:26.788385 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd8d67-9d06-454d-937f-2ed693c1b0ee service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:26.789388 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd8d67-9d06-454d-937f-2ed693c1b0ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:26.797223 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045351d-c5dc-48ed-8e20-6a4c22c1d7e3 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:26.799683 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3045351d-c5dc-48ed-8e20-6a4c22c1d7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:26.856059 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd8d67-9d06-454d-937f-2ed693c1b0ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:26.857553 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd8d67-9d06-454d-937f-2ed693c1b0ee service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:26.904470 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2595/5180] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:00:26 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:00:27.000175 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045351d-c5dc-48ed-8e20-6a4c22c1d7e3 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:27.011811 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f230b649-5b26-4f81-a0b2-6dd22673f809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:27.012773 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230b649-5b26-4f81-a0b2-6dd22673f809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:27.013211 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230b649-5b26-4f81-a0b2-6dd22673f809 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:27.013648 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230b649-5b26-4f81-a0b2-6dd22673f809 admin admin] PATH_INFO: `/v3/projects/c72ae2d3d7bc44979be93520ca9f8716` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:27.015057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f230b649-5b26-4f81-a0b2-6dd22673f809 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c72ae2d3d7bc44979be93520ca9f8716)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:27.017185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f230b649-5b26-4f81-a0b2-6dd22673f809 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:27.086575 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f230b649-5b26-4f81-a0b2-6dd22673f809 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c72ae2d3d7bc44979be93520ca9f8716', 'request_id': 'req-f230b649-5b26-4f81-a0b2-6dd22673f809'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:27.094604 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f230b649-5b26-4f81-a0b2-6dd22673f809 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c72ae2d3d7bc44979be93520ca9f8716', 'request_id': 'req-f230b649-5b26-4f81-a0b2-6dd22673f809'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:27.105220 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f230b649-5b26-4f81-a0b2-6dd22673f809 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c72ae2d3d7bc44979be93520ca9f8716', 'request_id': 'req-f230b649-5b26-4f81-a0b2-6dd22673f809'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:27.109418 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:27.145708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f230b649-5b26-4f81-a0b2-6dd22673f809 admin admin] The token cache is being invalidate because project c72ae2d3d7bc44979be93520ca9f8716 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:27.146465 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f230b649-5b26-4f81-a0b2-6dd22673f809 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:27.147445 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f230b649-5b26-4f81-a0b2-6dd22673f809 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:27.150953 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2586/5181] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:00:26 2022] DELETE /identity/v3/projects/c72ae2d3d7bc44979be93520ca9f8716 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:27.154703 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd8d67-9d06-454d-937f-2ed693c1b0ee service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:27.175449 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd8d67-9d06-454d-937f-2ed693c1b0ee service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:27.397353 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc64dfe-99d2-405e-9ec4-a2356991afe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:27.398011 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc64dfe-99d2-405e-9ec4-a2356991afe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:27.398286 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc64dfe-99d2-405e-9ec4-a2356991afe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:27.398557 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc64dfe-99d2-405e-9ec4-a2356991afe4 admin admin] PATH_INFO: `/v3/users/a65ed27115a5472fa843fed141aa5e27` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:27.403216 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc64dfe-99d2-405e-9ec4-a2356991afe4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a65ed27115a5472fa843fed141aa5e27)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:27.405403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc64dfe-99d2-405e-9ec4-a2356991afe4 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:27.602613 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5fc64dfe-99d2-405e-9ec4-a2356991afe4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a65ed27115a5472fa843fed141aa5e27'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:27.606762 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5fc64dfe-99d2-405e-9ec4-a2356991afe4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a65ed27115a5472fa843fed141aa5e27'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:27.622927 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:27.658918 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5fc64dfe-99d2-405e-9ec4-a2356991afe4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a65ed27115a5472fa843fed141aa5e27'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:27.685188 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5fc64dfe-99d2-405e-9ec4-a2356991afe4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a65ed27115a5472fa843fed141aa5e27'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:27.719697 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5fc64dfe-99d2-405e-9ec4-a2356991afe4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a65ed27115a5472fa843fed141aa5e27'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:27.737427 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2596/5182] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:00:27 2022] DELETE /identity/v3/users/a65ed27115a5472fa843fed141aa5e27 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:29.231137 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f230b649-5b26-4f81-a0b2-6dd22673f809 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:29.232699 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f230b649-5b26-4f81-a0b2-6dd22673f809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:29.251233 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f230b649-5b26-4f81-a0b2-6dd22673f809 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:29.370797 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe47ab-1bbd-43e7-bde6-49d182b557e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:29.371959 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe47ab-1bbd-43e7-bde6-49d182b557e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:29.372846 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe47ab-1bbd-43e7-bde6-49d182b557e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:29.373201 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe47ab-1bbd-43e7-bde6-49d182b557e2 admin admin] PATH_INFO: `/v3/projects/7054d38eed6b407f9c9e0303e6b075e1` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:29.376274 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe47ab-1bbd-43e7-bde6-49d182b557e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7054d38eed6b407f9c9e0303e6b075e1)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:29.380535 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe47ab-1bbd-43e7-bde6-49d182b557e2 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:29.477016 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5afe47ab-1bbd-43e7-bde6-49d182b557e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7054d38eed6b407f9c9e0303e6b075e1', 'request_id': 'req-5afe47ab-1bbd-43e7-bde6-49d182b557e2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:29.487257 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5afe47ab-1bbd-43e7-bde6-49d182b557e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7054d38eed6b407f9c9e0303e6b075e1', 'request_id': 'req-5afe47ab-1bbd-43e7-bde6-49d182b557e2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:29.497683 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5afe47ab-1bbd-43e7-bde6-49d182b557e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7054d38eed6b407f9c9e0303e6b075e1', 'request_id': 'req-5afe47ab-1bbd-43e7-bde6-49d182b557e2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:29.514762 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5afe47ab-1bbd-43e7-bde6-49d182b557e2 admin admin] The token cache is being invalidate because project 7054d38eed6b407f9c9e0303e6b075e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:29.515161 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5afe47ab-1bbd-43e7-bde6-49d182b557e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:29.515906 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5afe47ab-1bbd-43e7-bde6-49d182b557e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:29.519088 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2587/5183] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:00:29 2022] DELETE /identity/v3/projects/7054d38eed6b407f9c9e0303e6b075e1 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:29.523636 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe732b-e702-4c26-bf07-181163eac120 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:29.524163 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe732b-e702-4c26-bf07-181163eac120 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:29.524511 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe732b-e702-4c26-bf07-181163eac120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:29.576012 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-e1fe732b-e702-4c26-bf07-181163eac120 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:29.579420 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e1fe732b-e702-4c26-bf07-181163eac120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:29.787355 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa00727-b72d-418e-b2c9-9c7154724d69 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:29.787746 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2597/5184] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:29.788102 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa00727-b72d-418e-b2c9-9c7154724d69 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:29.788452 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa00727-b72d-418e-b2c9-9c7154724d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:29.848710 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-caa00727-b72d-418e-b2c9-9c7154724d69 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:29.850055 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-caa00727-b72d-418e-b2c9-9c7154724d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:29.882803 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2588/5185] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:00:29.887471 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe732b-e702-4c26-bf07-181163eac120 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:29.903238 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe732b-e702-4c26-bf07-181163eac120 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:29.922040 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d6496-9269-47d9-8926-c9a69640e50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:29.922774 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d6496-9269-47d9-8926-c9a69640e50b admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:29.923080 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d6496-9269-47d9-8926-c9a69640e50b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:29.923484 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d6496-9269-47d9-8926-c9a69640e50b admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:29.924169 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421d6496-9269-47d9-8926-c9a69640e50b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:00:29.924526 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421d6496-9269-47d9-8926-c9a69640e50b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:29.931350 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421d6496-9269-47d9-8926-c9a69640e50b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:29.978793 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2598/5186] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:00:29.979308 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa00727-b72d-418e-b2c9-9c7154724d69 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:29.990368 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa00727-b72d-418e-b2c9-9c7154724d69 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:30.009584 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009dce6-3804-442b-90be-a2fab1def606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:30.010231 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009dce6-3804-442b-90be-a2fab1def606 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:30.010505 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009dce6-3804-442b-90be-a2fab1def606 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:30.010771 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009dce6-3804-442b-90be-a2fab1def606 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:30.011435 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8009dce6-3804-442b-90be-a2fab1def606 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:30.013340 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8009dce6-3804-442b-90be-a2fab1def606 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:30.079215 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2589/5187] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:00:29 2022] POST /identity/v3/projects => generated 365 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:30.083930 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d6496-9269-47d9-8926-c9a69640e50b admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:30.096455 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d6496-9269-47d9-8926-c9a69640e50b admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:30.270616 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86fbb2-f4c7-4420-8fab-f04cc0a2b32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:30.273746 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86fbb2-f4c7-4420-8fab-f04cc0a2b32b admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:30.277359 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86fbb2-f4c7-4420-8fab-f04cc0a2b32b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:30.279819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86fbb2-f4c7-4420-8fab-f04cc0a2b32b admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:30.280370 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd86fbb2-f4c7-4420-8fab-f04cc0a2b32b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:30.283386 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd86fbb2-f4c7-4420-8fab-f04cc0a2b32b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:30.325195 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2599/5188] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:00:30 2022] POST /identity/v3/users => generated 283 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:30.326257 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009dce6-3804-442b-90be-a2fab1def606 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:30.342762 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009dce6-3804-442b-90be-a2fab1def606 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:30.369206 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48445d-c427-4aaa-b36f-38a03870c0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:30.370331 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48445d-c427-4aaa-b36f-38a03870c0f9 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:30.370827 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48445d-c427-4aaa-b36f-38a03870c0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:30.370966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48445d-c427-4aaa-b36f-38a03870c0f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:30.371661 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a48445d-c427-4aaa-b36f-38a03870c0f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:30.373672 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a48445d-c427-4aaa-b36f-38a03870c0f9 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:30.394221 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2590/5189] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:00:30.398631 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86fbb2-f4c7-4420-8fab-f04cc0a2b32b admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:30.414299 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86fbb2-f4c7-4420-8fab-f04cc0a2b32b admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:30.427866 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe4f38e-578f-48d9-afbd-68a05914f883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:30.429620 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4f38e-578f-48d9-afbd-68a05914f883 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:30.429912 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4f38e-578f-48d9-afbd-68a05914f883 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:30.430173 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4f38e-578f-48d9-afbd-68a05914f883 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:30.430838 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe4f38e-578f-48d9-afbd-68a05914f883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:30.432960 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe4f38e-578f-48d9-afbd-68a05914f883 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:30.457539 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2600/5190] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:00:30.461976 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48445d-c427-4aaa-b36f-38a03870c0f9 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:30.489166 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48445d-c427-4aaa-b36f-38a03870c0f9 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:30.494021 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae4cac-79b1-4076-ba76-5d3f240a24f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:30.494747 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae4cac-79b1-4076-ba76-5d3f240a24f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:30.495058 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae4cac-79b1-4076-ba76-5d3f240a24f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:30.495487 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae4cac-79b1-4076-ba76-5d3f240a24f7 admin admin] PATH_INFO: `/v3/projects/882a1e7063354d6fa4a800cec776e375/users/ee3b7fc25c144c4e94b640b1ba6ec66e/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:30.516212 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae4cac-79b1-4076-ba76-5d3f240a24f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=882a1e7063354d6fa4a800cec776e375, user_id=ee3b7fc25c144c4e94b640b1ba6ec66e, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:30.519741 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae4cac-79b1-4076-ba76-5d3f240a24f7 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:30.546179 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2591/5191] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:00:30 2022] PUT /identity/v3/projects/882a1e7063354d6fa4a800cec776e375/users/ee3b7fc25c144c4e94b640b1ba6ec66e/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:30.560425 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399de04-f0d4-4be7-8540-13738c3ba409 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:30.561006 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399de04-f0d4-4be7-8540-13738c3ba409 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:30.561112 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399de04-f0d4-4be7-8540-13738c3ba409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:30.615930 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-f399de04-f0d4-4be7-8540-13738c3ba409 None None] MFA Rules not processed for user `ee3b7fc25c144c4e94b640b1ba6ec66e`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:30.617359 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f399de04-f0d4-4be7-8540-13738c3ba409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:30.653416 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:30.724558 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae4cac-79b1-4076-ba76-5d3f240a24f7 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:30.737039 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2601/5192] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:30.753324 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:30.845142 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae4cac-79b1-4076-ba76-5d3f240a24f7 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:30.853502 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95efb3df-2305-4974-bfc0-19637fa3c290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:30.854118 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efb3df-2305-4974-bfc0-19637fa3c290 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:30.854394 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efb3df-2305-4974-bfc0-19637fa3c290 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:30.856694 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efb3df-2305-4974-bfc0-19637fa3c290 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:30.858273 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95efb3df-2305-4974-bfc0-19637fa3c290 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:30.861132 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95efb3df-2305-4974-bfc0-19637fa3c290 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:30.908123 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2592/5193] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:00:30 2022] POST /identity/v3/projects => generated 365 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:30.914673 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399de04-f0d4-4be7-8540-13738c3ba409 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:30.938278 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399de04-f0d4-4be7-8540-13738c3ba409 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:31.091675 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60594c-f1ef-483c-9908-e545b11fabea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:31.092567 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60594c-f1ef-483c-9908-e545b11fabea admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:31.093060 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60594c-f1ef-483c-9908-e545b11fabea admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:31.093547 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60594c-f1ef-483c-9908-e545b11fabea admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:31.094385 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b60594c-f1ef-483c-9908-e545b11fabea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:31.098930 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b60594c-f1ef-483c-9908-e545b11fabea admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:31.143739 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95efb3df-2305-4974-bfc0-19637fa3c290 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:31.153662 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2602/5194] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:00:30 2022] POST /identity/v3/users => generated 289 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:31.156317 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95efb3df-2305-4974-bfc0-19637fa3c290 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:31.162951 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2ad2c-1323-43fb-98ca-2e0769844a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:31.163755 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2ad2c-1323-43fb-98ca-2e0769844a3c admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:31.164035 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2ad2c-1323-43fb-98ca-2e0769844a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:31.164464 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2ad2c-1323-43fb-98ca-2e0769844a3c admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:31.165124 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd2ad2c-1323-43fb-98ca-2e0769844a3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:31.167572 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd2ad2c-1323-43fb-98ca-2e0769844a3c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:31.187920 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60594c-f1ef-483c-9908-e545b11fabea admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:31.196360 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2593/5195] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:00:31.200394 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60594c-f1ef-483c-9908-e545b11fabea admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:31.212125 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f812d4-e739-4e02-93b7-f526d4e69a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:31.213175 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f812d4-e739-4e02-93b7-f526d4e69a71 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:31.214574 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f812d4-e739-4e02-93b7-f526d4e69a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:31.214869 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f812d4-e739-4e02-93b7-f526d4e69a71 admin admin] PATH_INFO: `/v3/projects/0db158bbe55847168ebaa35365f93a0b/users/56bfcb14818d4ea093b0b3e43aa640f7/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:31.246010 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f812d4-e739-4e02-93b7-f526d4e69a71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0db158bbe55847168ebaa35365f93a0b, user_id=56bfcb14818d4ea093b0b3e43aa640f7, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:31.249285 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f812d4-e739-4e02-93b7-f526d4e69a71 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:31.276771 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2ad2c-1323-43fb-98ca-2e0769844a3c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:31.277201 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2603/5196] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:00:31 2022] PUT /identity/v3/projects/0db158bbe55847168ebaa35365f93a0b/users/56bfcb14818d4ea093b0b3e43aa640f7/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:31.293458 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2ad2c-1323-43fb-98ca-2e0769844a3c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:31.383983 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0970fb5-271f-4097-9207-44679c5caf1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:31.384787 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0970fb5-271f-4097-9207-44679c5caf1b admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:31.385066 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0970fb5-271f-4097-9207-44679c5caf1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:31.385613 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0970fb5-271f-4097-9207-44679c5caf1b admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:31.386701 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0970fb5-271f-4097-9207-44679c5caf1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:31.388910 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0970fb5-271f-4097-9207-44679c5caf1b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:31.403693 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2594/5197] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:00:31.408895 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f812d4-e739-4e02-93b7-f526d4e69a71 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:31.427339 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f812d4-e739-4e02-93b7-f526d4e69a71 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:31.434855 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a6ed4-5d35-41fd-9c84-7a9b17222c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:31.435551 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a6ed4-5d35-41fd-9c84-7a9b17222c34 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:31.435829 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a6ed4-5d35-41fd-9c84-7a9b17222c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:31.436101 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a6ed4-5d35-41fd-9c84-7a9b17222c34 admin admin] PATH_INFO: `/v3/projects/0db158bbe55847168ebaa35365f93a0b/users/56bfcb14818d4ea093b0b3e43aa640f7/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:31.443434 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67a6ed4-5d35-41fd-9c84-7a9b17222c34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0db158bbe55847168ebaa35365f93a0b, user_id=56bfcb14818d4ea093b0b3e43aa640f7, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:31.449717 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67a6ed4-5d35-41fd-9c84-7a9b17222c34 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:31.466740 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2604/5198] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:00:31 2022] PUT /identity/v3/projects/0db158bbe55847168ebaa35365f93a0b/users/56bfcb14818d4ea093b0b3e43aa640f7/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:31.480074 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48e6ce-63b3-4583-9dfc-558a9274f8c6 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:31.480993 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48e6ce-63b3-4583-9dfc-558a9274f8c6 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:31.481791 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48e6ce-63b3-4583-9dfc-558a9274f8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:31.554747 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-2f48e6ce-63b3-4583-9dfc-558a9274f8c6 None None] MFA Rules not processed for user `56bfcb14818d4ea093b0b3e43aa640f7`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:31.556182 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2f48e6ce-63b3-4583-9dfc-558a9274f8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:31.687874 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2595/5199] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:31 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:31.694164 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a6ed4-5d35-41fd-9c84-7a9b17222c34 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:31.713685 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a6ed4-5d35-41fd-9c84-7a9b17222c34 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:31.718401 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6f9180-3e79-4c2a-b599-34df56615049 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bfcb14818d4ea093b0b3e43aa640f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0db158bbe55847168ebaa35365f93a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:31.719046 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f9180-3e79-4c2a-b599-34df56615049 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:31.719381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f9180-3e79-4c2a-b599-34df56615049 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:31.719662 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f9180-3e79-4c2a-b599-34df56615049 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:31.720306 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6f9180-3e79-4c2a-b599-34df56615049 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:31.722493 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6f9180-3e79-4c2a-b599-34df56615049 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:31.787721 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2605/5200] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:00:31 2022] POST /identity/v3/projects => generated 360 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:31.789673 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48e6ce-63b3-4583-9dfc-558a9274f8c6 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:31.805332 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48e6ce-63b3-4583-9dfc-558a9274f8c6 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:31.836821 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:31.977335 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b1c848-efcd-48bf-be86-b0d15efbbf3d tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bfcb14818d4ea093b0b3e43aa640f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0db158bbe55847168ebaa35365f93a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:31.977972 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1c848-efcd-48bf-be86-b0d15efbbf3d tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:31.978258 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1c848-efcd-48bf-be86-b0d15efbbf3d tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:31.978536 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1c848-efcd-48bf-be86-b0d15efbbf3d tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:31.979259 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b1c848-efcd-48bf-be86-b0d15efbbf3d tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:31.981337 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b1c848-efcd-48bf-be86-b0d15efbbf3d tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:32.020902 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2596/5201] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:00:31 2022] POST /identity/v3/users => generated 373 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:32.029872 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6f9180-3e79-4c2a-b599-34df56615049 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:32.046894 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b1c848-efcd-48bf-be86-b0d15efbbf3d tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:32.050783 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6f9180-3e79-4c2a-b599-34df56615049 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:32.051361 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a6b1c848-efcd-48bf-be86-b0d15efbbf3d tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:32.089710 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20f141-5f3d-4466-a57b-216658b41cdf tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bfcb14818d4ea093b0b3e43aa640f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0db158bbe55847168ebaa35365f93a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:32.090778 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20f141-5f3d-4466-a57b-216658b41cdf tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:32.091314 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20f141-5f3d-4466-a57b-216658b41cdf tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:32.091830 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20f141-5f3d-4466-a57b-216658b41cdf tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] PATH_INFO: `/v3/users/85c0d1c437514dbfbb8f1fe14bdda513` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:32.119729 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b20f141-5f3d-4466-a57b-216658b41cdf tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorizing `identity:get_user(user_id=85c0d1c437514dbfbb8f1fe14bdda513)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:32.122413 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b20f141-5f3d-4466-a57b-216658b41cdf tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:32.126143 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2606/5202] 10.222.0.83 () {58 vars in 1221 bytes} [Mon Aug 29 16:00:32 2022] GET /identity/v3/users/85c0d1c437514dbfbb8f1fe14bdda513 => generated 373 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:00:32.134552 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20f141-5f3d-4466-a57b-216658b41cdf tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:32.164393 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b1c848-efcd-48bf-be86-b0d15efbbf3d tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:32.170350 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20f141-5f3d-4466-a57b-216658b41cdf tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:32.173482 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b818f1-5a63-471d-bc9c-cee76fa9b1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:32.174162 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b818f1-5a63-471d-bc9c-cee76fa9b1b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:32.174446 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b818f1-5a63-471d-bc9c-cee76fa9b1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:32.174722 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b818f1-5a63-471d-bc9c-cee76fa9b1b2 admin admin] PATH_INFO: `/v3/users/645603f75ac74919b27b8cb938e460ed` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:32.178130 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4681d-4ac1-4ea8-963e-bdfe5dbddd63 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bfcb14818d4ea093b0b3e43aa640f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0db158bbe55847168ebaa35365f93a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:32.179195 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4681d-4ac1-4ea8-963e-bdfe5dbddd63 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:32.179720 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4681d-4ac1-4ea8-963e-bdfe5dbddd63 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:32.180209 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4681d-4ac1-4ea8-963e-bdfe5dbddd63 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] PATH_INFO: `/v3/users/85c0d1c437514dbfbb8f1fe14bdda513` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:32.181146 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b818f1-5a63-471d-bc9c-cee76fa9b1b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=645603f75ac74919b27b8cb938e460ed)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:32.182668 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4681d-4ac1-4ea8-963e-bdfe5dbddd63 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorizing `identity:delete_user(user_id=85c0d1c437514dbfbb8f1fe14bdda513)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:32.183939 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b818f1-5a63-471d-bc9c-cee76fa9b1b2 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:32.185897 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4681d-4ac1-4ea8-963e-bdfe5dbddd63 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:32.250379 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:INSERT=6,keystone:DELETE=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:32.265042 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d0b818f1-5a63-471d-bc9c-cee76fa9b1b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '645603f75ac74919b27b8cb938e460ed'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:32.265938 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d0b818f1-5a63-471d-bc9c-cee76fa9b1b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '645603f75ac74919b27b8cb938e460ed'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:32.273389 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-35b4681d-4ac1-4ea8-963e-bdfe5dbddd63 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85c0d1c437514dbfbb8f1fe14bdda513'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:32.278480 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-35b4681d-4ac1-4ea8-963e-bdfe5dbddd63 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85c0d1c437514dbfbb8f1fe14bdda513'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:32.284159 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d0b818f1-5a63-471d-bc9c-cee76fa9b1b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '645603f75ac74919b27b8cb938e460ed'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:32.296353 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d0b818f1-5a63-471d-bc9c-cee76fa9b1b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '645603f75ac74919b27b8cb938e460ed'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:32.297587 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d0b818f1-5a63-471d-bc9c-cee76fa9b1b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '645603f75ac74919b27b8cb938e460ed'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:32.306542 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-35b4681d-4ac1-4ea8-963e-bdfe5dbddd63 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85c0d1c437514dbfbb8f1fe14bdda513'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:32.320780 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-35b4681d-4ac1-4ea8-963e-bdfe5dbddd63 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85c0d1c437514dbfbb8f1fe14bdda513'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:32.339905 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-35b4681d-4ac1-4ea8-963e-bdfe5dbddd63 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85c0d1c437514dbfbb8f1fe14bdda513'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:32.357967 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2607/5203] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:00:32 2022] DELETE /identity/v3/users/85c0d1c437514dbfbb8f1fe14bdda513 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:32.361973 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4681d-4ac1-4ea8-963e-bdfe5dbddd63 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:32.364696 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-35b4681d-4ac1-4ea8-963e-bdfe5dbddd63 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:32.399655 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2597/5204] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:00:32 2022] DELETE /identity/v3/users/645603f75ac74919b27b8cb938e460ed => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:32.406506 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd42d50-1551-43c2-b82e-b4b65bf8f919 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:32.406786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd42d50-1551-43c2-b82e-b4b65bf8f919 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:32.411583 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd42d50-1551-43c2-b82e-b4b65bf8f919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:32.504631 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-3dd42d50-1551-43c2-b82e-b4b65bf8f919 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:32.505876 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3dd42d50-1551-43c2-b82e-b4b65bf8f919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:32.532596 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4681d-4ac1-4ea8-963e-bdfe5dbddd63 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:32.580108 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:32.713302 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be0bc8-bf01-4387-801f-c8da47d6212e tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bfcb14818d4ea093b0b3e43aa640f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0db158bbe55847168ebaa35365f93a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:32.714136 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be0bc8-bf01-4387-801f-c8da47d6212e tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:32.714294 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be0bc8-bf01-4387-801f-c8da47d6212e tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:32.714462 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be0bc8-bf01-4387-801f-c8da47d6212e tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] PATH_INFO: `/v3/projects/d8da66820ba8471ea697455521c40c58` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:32.717211 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be0bc8-bf01-4387-801f-c8da47d6212e tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d8da66820ba8471ea697455521c40c58)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:32.724640 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2598/5205] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:32.724849 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be0bc8-bf01-4387-801f-c8da47d6212e tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:32.777458 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd42d50-1551-43c2-b82e-b4b65bf8f919 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:32.779359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3dd42d50-1551-43c2-b82e-b4b65bf8f919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:32.888343 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-88be0bc8-bf01-4387-801f-c8da47d6212e tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8da66820ba8471ea697455521c40c58', 'request_id': 'req-88be0bc8-bf01-4387-801f-c8da47d6212e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:32.904911 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-88be0bc8-bf01-4387-801f-c8da47d6212e tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8da66820ba8471ea697455521c40c58', 'request_id': 'req-88be0bc8-bf01-4387-801f-c8da47d6212e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:32.907777 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:32.921543 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-88be0bc8-bf01-4387-801f-c8da47d6212e tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8da66820ba8471ea697455521c40c58', 'request_id': 'req-88be0bc8-bf01-4387-801f-c8da47d6212e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:32.944785 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-88be0bc8-bf01-4387-801f-c8da47d6212e tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] The token cache is being invalidate because project d8da66820ba8471ea697455521c40c58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:32.945087 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-88be0bc8-bf01-4387-801f-c8da47d6212e tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:32.946112 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd42d50-1551-43c2-b82e-b4b65bf8f919 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:32.946253 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-88be0bc8-bf01-4387-801f-c8da47d6212e tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:32.949957 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2608/5206] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:00:32 2022] DELETE /identity/v3/projects/d8da66820ba8471ea697455521c40c58 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:00:32.957474 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be0bc8-bf01-4387-801f-c8da47d6212e tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:32.959612 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-88be0bc8-bf01-4387-801f-c8da47d6212e tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:33.115472 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be0bc8-bf01-4387-801f-c8da47d6212e tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:33.124514 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858f048-68b0-42f9-a147-faff7c64faeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:33.126345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858f048-68b0-42f9-a147-faff7c64faeb service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:33.126632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858f048-68b0-42f9-a147-faff7c64faeb service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:33.126905 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858f048-68b0-42f9-a147-faff7c64faeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:33.131666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631006b7-5c09-426d-8eab-0db3957e13cc tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bfcb14818d4ea093b0b3e43aa640f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0db158bbe55847168ebaa35365f93a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:33.132044 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4858f048-68b0-42f9-a147-faff7c64faeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:33.132214 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631006b7-5c09-426d-8eab-0db3957e13cc tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:33.132510 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631006b7-5c09-426d-8eab-0db3957e13cc tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:33.132789 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631006b7-5c09-426d-8eab-0db3957e13cc tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:33.133443 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631006b7-5c09-426d-8eab-0db3957e13cc tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:33.141701 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631006b7-5c09-426d-8eab-0db3957e13cc tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:33.193023 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2609/5207] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:00:32 2022] POST /identity/v3/projects => generated 360 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:00:33.197592 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631006b7-5c09-426d-8eab-0db3957e13cc tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:33.345826 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4858f048-68b0-42f9-a147-faff7c64faeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:33.348682 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4858f048-68b0-42f9-a147-faff7c64faeb service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:33.373477 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2599/5208] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:00:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:00:33.374822 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631006b7-5c09-426d-8eab-0db3957e13cc tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:33.402610 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2de93b-d415-4397-b99c-d730bf3ef46b tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bfcb14818d4ea093b0b3e43aa640f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0db158bbe55847168ebaa35365f93a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:33.403284 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2de93b-d415-4397-b99c-d730bf3ef46b tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:33.403574 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2de93b-d415-4397-b99c-d730bf3ef46b tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:33.403856 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2de93b-d415-4397-b99c-d730bf3ef46b tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:33.404527 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2de93b-d415-4397-b99c-d730bf3ef46b tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:33.406641 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2de93b-d415-4397-b99c-d730bf3ef46b tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:33.522686 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858f048-68b0-42f9-a147-faff7c64faeb service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:33.525631 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2610/5209] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:00:33 2022] POST /identity/v3/users => generated 417 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:00:33.540243 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858f048-68b0-42f9-a147-faff7c64faeb service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:33.549413 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019e712-95a1-48f1-944b-59fd71843449 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bfcb14818d4ea093b0b3e43aa640f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0db158bbe55847168ebaa35365f93a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:33.550486 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019e712-95a1-48f1-944b-59fd71843449 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:33.551095 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019e712-95a1-48f1-944b-59fd71843449 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:33.551559 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019e712-95a1-48f1-944b-59fd71843449 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:33.552393 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5019e712-95a1-48f1-944b-59fd71843449 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:33.554949 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5019e712-95a1-48f1-944b-59fd71843449 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:33.580874 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2600/5210] 10.222.0.83 () {60 vars in 1143 bytes} [Mon Aug 29 16:00:33 2022] POST /identity/v3/roles => generated 239 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:00:33.585927 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2de93b-d415-4397-b99c-d730bf3ef46b tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:33.603386 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2de93b-d415-4397-b99c-d730bf3ef46b tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:33.616641 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8974a2-a969-4b75-99fb-b4ec922d8b97 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bfcb14818d4ea093b0b3e43aa640f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0db158bbe55847168ebaa35365f93a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:33.617306 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8974a2-a969-4b75-99fb-b4ec922d8b97 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:33.617595 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8974a2-a969-4b75-99fb-b4ec922d8b97 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:33.617876 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8974a2-a969-4b75-99fb-b4ec922d8b97 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] PATH_INFO: `/v3/users/d8318d7900854b3e8c981d90cecd33e0` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:33.646188 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8974a2-a969-4b75-99fb-b4ec922d8b97 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorizing `identity:get_user(user_id=d8318d7900854b3e8c981d90cecd33e0)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:33.648433 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8974a2-a969-4b75-99fb-b4ec922d8b97 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:33.650528 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2611/5211] 10.222.0.83 () {58 vars in 1221 bytes} [Mon Aug 29 16:00:33 2022] GET /identity/v3/users/d8318d7900854b3e8c981d90cecd33e0 => generated 417 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:00:33.654908 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019e712-95a1-48f1-944b-59fd71843449 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:33.672920 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019e712-95a1-48f1-944b-59fd71843449 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:33.679973 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a38f2b-e812-43b3-80cf-20cf9804555d tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bfcb14818d4ea093b0b3e43aa640f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0db158bbe55847168ebaa35365f93a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:33.681376 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a38f2b-e812-43b3-80cf-20cf9804555d tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:33.681657 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a38f2b-e812-43b3-80cf-20cf9804555d tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:33.681939 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a38f2b-e812-43b3-80cf-20cf9804555d tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] PATH_INFO: `/v3/roles/784bfdb6dd42409bb063c9e656fee5b8` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:33.683709 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a38f2b-e812-43b3-80cf-20cf9804555d tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorizing `identity:get_role(role_id=784bfdb6dd42409bb063c9e656fee5b8)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:33.685792 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-10a38f2b-e812-43b3-80cf-20cf9804555d tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:00:33.685792 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 16:00:33.685792 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 16:00:33.687190 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a38f2b-e812-43b3-80cf-20cf9804555d tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:33.692839 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2601/5212] 10.222.0.83 () {58 vars in 1221 bytes} [Mon Aug 29 16:00:33 2022] GET /identity/v3/roles/784bfdb6dd42409bb063c9e656fee5b8 => generated 239 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:00:33.692951 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8974a2-a969-4b75-99fb-b4ec922d8b97 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:33.714656 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8974a2-a969-4b75-99fb-b4ec922d8b97 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:33.732232 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c904a4-04b6-49d8-9b14-6028499b33ad tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bfcb14818d4ea093b0b3e43aa640f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0db158bbe55847168ebaa35365f93a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:33.733584 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c904a4-04b6-49d8-9b14-6028499b33ad tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:33.735648 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c904a4-04b6-49d8-9b14-6028499b33ad tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:33.736460 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c904a4-04b6-49d8-9b14-6028499b33ad tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:33.738932 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c904a4-04b6-49d8-9b14-6028499b33ad tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:33.744204 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c904a4-04b6-49d8-9b14-6028499b33ad tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:33.820757 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2612/5213] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:00:33 2022] POST /identity/v3/projects => generated 360 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:00:33.825141 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a38f2b-e812-43b3-80cf-20cf9804555d tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:33.845919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a38f2b-e812-43b3-80cf-20cf9804555d tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:33.858969 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:33.996075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c415b-50ea-452d-b565-4695721fb540 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bfcb14818d4ea093b0b3e43aa640f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0db158bbe55847168ebaa35365f93a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:33.997979 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c415b-50ea-452d-b565-4695721fb540 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:33.998773 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c415b-50ea-452d-b565-4695721fb540 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:33.999763 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c415b-50ea-452d-b565-4695721fb540 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] PATH_INFO: `/v3/projects/58ba269cbe8243699fa38ac4d4d1a816` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:34.003141 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54c415b-50ea-452d-b565-4695721fb540 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorizing `identity:get_project(project_id=58ba269cbe8243699fa38ac4d4d1a816)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:34.006805 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54c415b-50ea-452d-b565-4695721fb540 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:34.016844 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c904a4-04b6-49d8-9b14-6028499b33ad tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:34.024471 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2602/5214] 10.222.0.83 () {58 vars in 1230 bytes} [Mon Aug 29 16:00:33 2022] GET /identity/v3/projects/58ba269cbe8243699fa38ac4d4d1a816 => generated 360 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:00:34.052820 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c904a4-04b6-49d8-9b14-6028499b33ad tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:34.065316 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052dc3c-3236-4332-bf41-92d2e9e4acc1 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bfcb14818d4ea093b0b3e43aa640f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0db158bbe55847168ebaa35365f93a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:34.066647 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052dc3c-3236-4332-bf41-92d2e9e4acc1 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:34.067177 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052dc3c-3236-4332-bf41-92d2e9e4acc1 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:34.068290 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052dc3c-3236-4332-bf41-92d2e9e4acc1 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] PATH_INFO: `/v3/projects/58ba269cbe8243699fa38ac4d4d1a816/users/d8318d7900854b3e8c981d90cecd33e0/roles/784bfdb6dd42409bb063c9e656fee5b8` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:34.071637 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e052dc3c-3236-4332-bf41-92d2e9e4acc1 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorizing `identity:create_grant(project_id=58ba269cbe8243699fa38ac4d4d1a816, user_id=d8318d7900854b3e8c981d90cecd33e0, role_id=784bfdb6dd42409bb063c9e656fee5b8)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:34.081574 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e052dc3c-3236-4332-bf41-92d2e9e4acc1 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:34.108851 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2613/5215] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:00:34 2022] PUT /identity/v3/projects/58ba269cbe8243699fa38ac4d4d1a816/users/d8318d7900854b3e8c981d90cecd33e0/roles/784bfdb6dd42409bb063c9e656fee5b8 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:34.113489 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c415b-50ea-452d-b565-4695721fb540 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:34.144338 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c415b-50ea-452d-b565-4695721fb540 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:34.165330 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052dc3c-3236-4332-bf41-92d2e9e4acc1 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:34.167471 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e052dc3c-3236-4332-bf41-92d2e9e4acc1 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:34.222942 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:DELETE=1,keystone:SELECT=93,keystone:INSERT=6 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:34.309878 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd1b40-0e4f-40e4-af0c-3eb110d47024 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bfcb14818d4ea093b0b3e43aa640f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0db158bbe55847168ebaa35365f93a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:34.310513 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd1b40-0e4f-40e4-af0c-3eb110d47024 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:34.312674 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd1b40-0e4f-40e4-af0c-3eb110d47024 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:34.312960 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd1b40-0e4f-40e4-af0c-3eb110d47024 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:34.314473 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd1b40-0e4f-40e4-af0c-3eb110d47024 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:34.328879 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd1b40-0e4f-40e4-af0c-3eb110d47024 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:34.361699 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052dc3c-3236-4332-bf41-92d2e9e4acc1 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:34.376978 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8701dcea-2368-42af-a91b-12aadbcac197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:34.380475 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701dcea-2368-42af-a91b-12aadbcac197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:34.380818 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701dcea-2368-42af-a91b-12aadbcac197 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:34.381082 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701dcea-2368-42af-a91b-12aadbcac197 admin admin] PATH_INFO: `/v3/projects/3a66e65080b74b1993dc4cd80e231fe8` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:34.384143 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8701dcea-2368-42af-a91b-12aadbcac197 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a66e65080b74b1993dc4cd80e231fe8)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:34.388274 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8701dcea-2368-42af-a91b-12aadbcac197 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:34.411170 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2603/5216] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:00:34 2022] POST /identity/v3/projects => generated 359 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:00:34.412860 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd1b40-0e4f-40e4-af0c-3eb110d47024 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:34.419342 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-33dd1b40-0e4f-40e4-af0c-3eb110d47024 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:34.473660 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8701dcea-2368-42af-a91b-12aadbcac197 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a66e65080b74b1993dc4cd80e231fe8', 'request_id': 'req-8701dcea-2368-42af-a91b-12aadbcac197'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:34.483401 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8701dcea-2368-42af-a91b-12aadbcac197 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a66e65080b74b1993dc4cd80e231fe8', 'request_id': 'req-8701dcea-2368-42af-a91b-12aadbcac197'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:34.497611 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8701dcea-2368-42af-a91b-12aadbcac197 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a66e65080b74b1993dc4cd80e231fe8', 'request_id': 'req-8701dcea-2368-42af-a91b-12aadbcac197'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:34.514381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8701dcea-2368-42af-a91b-12aadbcac197 admin admin] The token cache is being invalidate because project 3a66e65080b74b1993dc4cd80e231fe8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:34.514652 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8701dcea-2368-42af-a91b-12aadbcac197 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:34.515331 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8701dcea-2368-42af-a91b-12aadbcac197 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:34.518290 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2614/5217] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:00:34 2022] DELETE /identity/v3/projects/3a66e65080b74b1993dc4cd80e231fe8 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:00:34.518836 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd1b40-0e4f-40e4-af0c-3eb110d47024 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:34.519843 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8701dcea-2368-42af-a91b-12aadbcac197 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:34.521340 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8701dcea-2368-42af-a91b-12aadbcac197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:34.599854 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:34.622461 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae0e51-92e6-4279-aab9-b0e734795a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:34.625416 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae0e51-92e6-4279-aab9-b0e734795a05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:34.625889 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae0e51-92e6-4279-aab9-b0e734795a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:34.626440 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae0e51-92e6-4279-aab9-b0e734795a05 admin admin] PATH_INFO: `/v3/users/afcf02d997e146caa206dce027e15db1` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:34.629354 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eae0e51-92e6-4279-aab9-b0e734795a05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afcf02d997e146caa206dce027e15db1)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:34.634021 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eae0e51-92e6-4279-aab9-b0e734795a05 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:34.683697 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8701dcea-2368-42af-a91b-12aadbcac197 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:34.693123 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b98cea-2f28-47d6-8242-679823fd8252 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bfcb14818d4ea093b0b3e43aa640f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0db158bbe55847168ebaa35365f93a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:34.693788 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b98cea-2f28-47d6-8242-679823fd8252 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:34.694133 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b98cea-2f28-47d6-8242-679823fd8252 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:34.694404 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b98cea-2f28-47d6-8242-679823fd8252 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] PATH_INFO: `/v3/projects/aafe9c9abcc0470b811dba1f866df737` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:34.695661 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b98cea-2f28-47d6-8242-679823fd8252 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorizing `identity:get_project(project_id=aafe9c9abcc0470b811dba1f866df737)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:34.698105 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b98cea-2f28-47d6-8242-679823fd8252 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:34.700209 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2615/5218] 10.222.0.83 () {58 vars in 1230 bytes} [Mon Aug 29 16:00:34 2022] GET /identity/v3/projects/aafe9c9abcc0470b811dba1f866df737 => generated 359 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:00:34.701069 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b98cea-2f28-47d6-8242-679823fd8252 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:34.704067 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-72b98cea-2f28-47d6-8242-679823fd8252 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:34.715057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8eae0e51-92e6-4279-aab9-b0e734795a05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afcf02d997e146caa206dce027e15db1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:34.716117 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8eae0e51-92e6-4279-aab9-b0e734795a05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afcf02d997e146caa206dce027e15db1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:34.724567 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b98cea-2f28-47d6-8242-679823fd8252 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:34.735168 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8eae0e51-92e6-4279-aab9-b0e734795a05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afcf02d997e146caa206dce027e15db1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:34.746133 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd37673-78fd-4fcd-b8b8-a536ed73f79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:34.746133 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd37673-78fd-4fcd-b8b8-a536ed73f79e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:34.746133 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd37673-78fd-4fcd-b8b8-a536ed73f79e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:34.746133 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd37673-78fd-4fcd-b8b8-a536ed73f79e admin admin] PATH_INFO: `/v3/users/781d0780cdf247738ff74fa706535541` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:34.746666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd37673-78fd-4fcd-b8b8-a536ed73f79e admin admin] RBAC: Authorizing `identity:delete_user(user_id=781d0780cdf247738ff74fa706535541)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:34.748173 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd37673-78fd-4fcd-b8b8-a536ed73f79e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:34.767976 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8eae0e51-92e6-4279-aab9-b0e734795a05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afcf02d997e146caa206dce027e15db1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:34.769707 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8eae0e51-92e6-4279-aab9-b0e734795a05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afcf02d997e146caa206dce027e15db1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:34.797856 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2604/5219] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:00:34 2022] DELETE /identity/v3/users/afcf02d997e146caa206dce027e15db1 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:00:34.798692 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae0e51-92e6-4279-aab9-b0e734795a05 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:34.812487 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8eae0e51-92e6-4279-aab9-b0e734795a05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:34.849312 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:34.866197 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2cd37673-78fd-4fcd-b8b8-a536ed73f79e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '781d0780cdf247738ff74fa706535541'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:34.867309 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2cd37673-78fd-4fcd-b8b8-a536ed73f79e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '781d0780cdf247738ff74fa706535541'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:34.897212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2cd37673-78fd-4fcd-b8b8-a536ed73f79e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '781d0780cdf247738ff74fa706535541'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:34.916215 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2cd37673-78fd-4fcd-b8b8-a536ed73f79e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '781d0780cdf247738ff74fa706535541'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:34.929888 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2cd37673-78fd-4fcd-b8b8-a536ed73f79e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '781d0780cdf247738ff74fa706535541'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:34.949397 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2616/5220] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:00:34 2022] DELETE /identity/v3/users/781d0780cdf247738ff74fa706535541 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:35.039866 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae0e51-92e6-4279-aab9-b0e734795a05 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:35.122253 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb56b17-4b63-491e-b2f3-43d5d9283284 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bfcb14818d4ea093b0b3e43aa640f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0db158bbe55847168ebaa35365f93a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:35.122253 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb56b17-4b63-491e-b2f3-43d5d9283284 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:35.122253 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb56b17-4b63-491e-b2f3-43d5d9283284 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:35.122702 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb56b17-4b63-491e-b2f3-43d5d9283284 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] PATH_INFO: `/v3/projects/aafe9c9abcc0470b811dba1f866df737/users/d8318d7900854b3e8c981d90cecd33e0/roles/784bfdb6dd42409bb063c9e656fee5b8` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:35.127075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb56b17-4b63-491e-b2f3-43d5d9283284 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorizing `identity:create_grant(project_id=aafe9c9abcc0470b811dba1f866df737, user_id=d8318d7900854b3e8c981d90cecd33e0, role_id=784bfdb6dd42409bb063c9e656fee5b8)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:35.130661 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb56b17-4b63-491e-b2f3-43d5d9283284 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:35.152695 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2605/5221] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:00:34 2022] PUT /identity/v3/projects/aafe9c9abcc0470b811dba1f866df737/users/d8318d7900854b3e8c981d90cecd33e0/roles/784bfdb6dd42409bb063c9e656fee5b8 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:35.154029 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd37673-78fd-4fcd-b8b8-a536ed73f79e admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:35.157492 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2cd37673-78fd-4fcd-b8b8-a536ed73f79e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:35.177173 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd37673-78fd-4fcd-b8b8-a536ed73f79e admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:35.252895 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4421e67-baae-4e5e-982b-bb4e21b3ed1c tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bfcb14818d4ea093b0b3e43aa640f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0db158bbe55847168ebaa35365f93a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:35.253566 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4421e67-baae-4e5e-982b-bb4e21b3ed1c tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:35.253887 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4421e67-baae-4e5e-982b-bb4e21b3ed1c tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:35.255144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4421e67-baae-4e5e-982b-bb4e21b3ed1c tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] PATH_INFO: `/v3/users/d8318d7900854b3e8c981d90cecd33e0/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:35.256574 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4421e67-baae-4e5e-982b-bb4e21b3ed1c tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=d8318d7900854b3e8c981d90cecd33e0)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:35.258907 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4421e67-baae-4e5e-982b-bb4e21b3ed1c tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:35.345695 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2617/5222] 10.222.0.83 () {58 vars in 1248 bytes} [Mon Aug 29 16:00:35 2022] GET /identity/v3/users/d8318d7900854b3e8c981d90cecd33e0/projects => generated 843 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:00:35.349278 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb56b17-4b63-491e-b2f3-43d5d9283284 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:35.383083 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb56b17-4b63-491e-b2f3-43d5d9283284 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:35.398907 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aea33b-224b-43ac-a5e9-cf5ed62f37df tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bfcb14818d4ea093b0b3e43aa640f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0db158bbe55847168ebaa35365f93a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:35.400015 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aea33b-224b-43ac-a5e9-cf5ed62f37df tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:35.403271 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aea33b-224b-43ac-a5e9-cf5ed62f37df tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:35.405699 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aea33b-224b-43ac-a5e9-cf5ed62f37df tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] PATH_INFO: `/v3/projects/aafe9c9abcc0470b811dba1f866df737` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:35.411654 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aea33b-224b-43ac-a5e9-cf5ed62f37df tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorizing `identity:delete_project(project_id=aafe9c9abcc0470b811dba1f866df737)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:35.416408 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aea33b-224b-43ac-a5e9-cf5ed62f37df tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:35.420802 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:35.526202 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f1aea33b-224b-43ac-a5e9-cf5ed62f37df tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aafe9c9abcc0470b811dba1f866df737', 'request_id': 'req-f1aea33b-224b-43ac-a5e9-cf5ed62f37df'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:35.528067 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4421e67-baae-4e5e-982b-bb4e21b3ed1c tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:35.531183 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a4421e67-baae-4e5e-982b-bb4e21b3ed1c tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:35.544941 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f1aea33b-224b-43ac-a5e9-cf5ed62f37df tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aafe9c9abcc0470b811dba1f866df737', 'request_id': 'req-f1aea33b-224b-43ac-a5e9-cf5ed62f37df'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:35.561213 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f1aea33b-224b-43ac-a5e9-cf5ed62f37df tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aafe9c9abcc0470b811dba1f866df737', 'request_id': 'req-f1aea33b-224b-43ac-a5e9-cf5ed62f37df'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:35.585171 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f1aea33b-224b-43ac-a5e9-cf5ed62f37df tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] The token cache is being invalidate because project aafe9c9abcc0470b811dba1f866df737 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:35.585171 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f1aea33b-224b-43ac-a5e9-cf5ed62f37df tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:35.585971 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f1aea33b-224b-43ac-a5e9-cf5ed62f37df tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:35.587880 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2606/5223] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:00:35 2022] DELETE /identity/v3/projects/aafe9c9abcc0470b811dba1f866df737 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:35.588756 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aea33b-224b-43ac-a5e9-cf5ed62f37df tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:35.592999 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f1aea33b-224b-43ac-a5e9-cf5ed62f37df tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:35.683182 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4421e67-baae-4e5e-982b-bb4e21b3ed1c tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:35.733950 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aea33b-224b-43ac-a5e9-cf5ed62f37df tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:35.743068 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a32df8-8e8b-4cf9-b2bb-05bb9418f439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:35.743068 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a32df8-8e8b-4cf9-b2bb-05bb9418f439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:35.743068 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a32df8-8e8b-4cf9-b2bb-05bb9418f439 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:35.743068 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a32df8-8e8b-4cf9-b2bb-05bb9418f439 admin admin] PATH_INFO: `/v3/projects/664075d614754d0aa2e181f9be901fe7` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:35.744833 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a32df8-8e8b-4cf9-b2bb-05bb9418f439 admin admin] RBAC: Authorizing `identity:delete_project(project_id=664075d614754d0aa2e181f9be901fe7)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:35.746813 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a32df8-8e8b-4cf9-b2bb-05bb9418f439 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:35.749954 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:35.798310 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc369e40-36fc-4133-ac96-1885d11e3a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:35.799062 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc369e40-36fc-4133-ac96-1885d11e3a95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:35.799604 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc369e40-36fc-4133-ac96-1885d11e3a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:35.800935 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc369e40-36fc-4133-ac96-1885d11e3a95 admin admin] PATH_INFO: `/v3/projects/dafa4e08d2ea4279a3fde5bc1a7669d0` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:35.802622 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc369e40-36fc-4133-ac96-1885d11e3a95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dafa4e08d2ea4279a3fde5bc1a7669d0)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:35.805355 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc369e40-36fc-4133-ac96-1885d11e3a95 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:35.842623 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-20a32df8-8e8b-4cf9-b2bb-05bb9418f439 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '664075d614754d0aa2e181f9be901fe7', 'request_id': 'req-20a32df8-8e8b-4cf9-b2bb-05bb9418f439'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:35.857225 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-20a32df8-8e8b-4cf9-b2bb-05bb9418f439 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '664075d614754d0aa2e181f9be901fe7', 'request_id': 'req-20a32df8-8e8b-4cf9-b2bb-05bb9418f439'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:35.869421 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-20a32df8-8e8b-4cf9-b2bb-05bb9418f439 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '664075d614754d0aa2e181f9be901fe7', 'request_id': 'req-20a32df8-8e8b-4cf9-b2bb-05bb9418f439'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:35.895436 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-20a32df8-8e8b-4cf9-b2bb-05bb9418f439 admin admin] The token cache is being invalidate because project 664075d614754d0aa2e181f9be901fe7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:35.895682 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-20a32df8-8e8b-4cf9-b2bb-05bb9418f439 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:35.897366 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-20a32df8-8e8b-4cf9-b2bb-05bb9418f439 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:35.901458 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2607/5224] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:00:35 2022] DELETE /identity/v3/projects/664075d614754d0aa2e181f9be901fe7 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:35.902335 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a32df8-8e8b-4cf9-b2bb-05bb9418f439 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:35.904543 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-20a32df8-8e8b-4cf9-b2bb-05bb9418f439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:35.911772 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fc369e40-36fc-4133-ac96-1885d11e3a95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dafa4e08d2ea4279a3fde5bc1a7669d0', 'request_id': 'req-fc369e40-36fc-4133-ac96-1885d11e3a95'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:35.930003 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fc369e40-36fc-4133-ac96-1885d11e3a95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dafa4e08d2ea4279a3fde5bc1a7669d0', 'request_id': 'req-fc369e40-36fc-4133-ac96-1885d11e3a95'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:35.946922 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fc369e40-36fc-4133-ac96-1885d11e3a95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dafa4e08d2ea4279a3fde5bc1a7669d0', 'request_id': 'req-fc369e40-36fc-4133-ac96-1885d11e3a95'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:35.963467 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:35.969778 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fc369e40-36fc-4133-ac96-1885d11e3a95 admin admin] The token cache is being invalidate because project dafa4e08d2ea4279a3fde5bc1a7669d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:35.970311 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fc369e40-36fc-4133-ac96-1885d11e3a95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:35.971491 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fc369e40-36fc-4133-ac96-1885d11e3a95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:35.975959 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2618/5225] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:00:35 2022] DELETE /identity/v3/projects/dafa4e08d2ea4279a3fde5bc1a7669d0 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:35.977922 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8319a6f2-191c-43ac-93d8-89e39c82d276 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:35.978383 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8319a6f2-191c-43ac-93d8-89e39c82d276 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:35.979084 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8319a6f2-191c-43ac-93d8-89e39c82d276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:36.011714 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-8319a6f2-191c-43ac-93d8-89e39c82d276 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:36.013882 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8319a6f2-191c-43ac-93d8-89e39c82d276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:36.038836 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a32df8-8e8b-4cf9-b2bb-05bb9418f439 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:36.139487 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ab045-ae46-43f1-a5fd-e2a145e18841 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bfcb14818d4ea093b0b3e43aa640f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0db158bbe55847168ebaa35365f93a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:36.140303 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ab045-ae46-43f1-a5fd-e2a145e18841 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:36.140811 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ab045-ae46-43f1-a5fd-e2a145e18841 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:36.141165 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ab045-ae46-43f1-a5fd-e2a145e18841 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] PATH_INFO: `/v3/projects/58ba269cbe8243699fa38ac4d4d1a816` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:36.142630 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ab045-ae46-43f1-a5fd-e2a145e18841 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorizing `identity:delete_project(project_id=58ba269cbe8243699fa38ac4d4d1a816)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:36.145336 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ab045-ae46-43f1-a5fd-e2a145e18841 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:36.177238 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2619/5226] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:36.183491 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8319a6f2-191c-43ac-93d8-89e39c82d276 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:36.189855 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8319a6f2-191c-43ac-93d8-89e39c82d276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:36.210123 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8319a6f2-191c-43ac-93d8-89e39c82d276 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:36.217724 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c3efc7-e25c-43e5-9649-b1a61599b757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:36.218703 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c3efc7-e25c-43e5-9649-b1a61599b757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:36.219005 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c3efc7-e25c-43e5-9649-b1a61599b757 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:36.219299 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c3efc7-e25c-43e5-9649-b1a61599b757 admin admin] PATH_INFO: `/v3/users/d3401b3bbe0f4fc2a1faec415f83b7d6` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:36.220637 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c3efc7-e25c-43e5-9649-b1a61599b757 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3401b3bbe0f4fc2a1faec415f83b7d6)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:36.223952 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c3efc7-e25c-43e5-9649-b1a61599b757 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:36.248783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d53ab045-ae46-43f1-a5fd-e2a145e18841 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58ba269cbe8243699fa38ac4d4d1a816', 'request_id': 'req-d53ab045-ae46-43f1-a5fd-e2a145e18841'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:36.262855 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d53ab045-ae46-43f1-a5fd-e2a145e18841 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58ba269cbe8243699fa38ac4d4d1a816', 'request_id': 'req-d53ab045-ae46-43f1-a5fd-e2a145e18841'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:36.273661 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d53ab045-ae46-43f1-a5fd-e2a145e18841 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58ba269cbe8243699fa38ac4d4d1a816', 'request_id': 'req-d53ab045-ae46-43f1-a5fd-e2a145e18841'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:36.297472 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d53ab045-ae46-43f1-a5fd-e2a145e18841 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] The token cache is being invalidate because project 58ba269cbe8243699fa38ac4d4d1a816 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:36.298224 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d53ab045-ae46-43f1-a5fd-e2a145e18841 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:36.299218 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d53ab045-ae46-43f1-a5fd-e2a145e18841 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:36.306590 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2608/5227] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:00:35 2022] DELETE /identity/v3/projects/58ba269cbe8243699fa38ac4d4d1a816 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:36.308845 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42586e-c280-41ee-9f99-071278916fc4 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:36.310016 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42586e-c280-41ee-9f99-071278916fc4 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:36.310403 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42586e-c280-41ee-9f99-071278916fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:36.310644 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-84c3efc7-e25c-43e5-9649-b1a61599b757 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3401b3bbe0f4fc2a1faec415f83b7d6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:36.312206 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-84c3efc7-e25c-43e5-9649-b1a61599b757 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3401b3bbe0f4fc2a1faec415f83b7d6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:36.336355 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:36.341525 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-84c3efc7-e25c-43e5-9649-b1a61599b757 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3401b3bbe0f4fc2a1faec415f83b7d6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:36.343892 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-2d42586e-c280-41ee-9f99-071278916fc4 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:36.346041 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2d42586e-c280-41ee-9f99-071278916fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:36.356411 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-84c3efc7-e25c-43e5-9649-b1a61599b757 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3401b3bbe0f4fc2a1faec415f83b7d6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:36.368748 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-84c3efc7-e25c-43e5-9649-b1a61599b757 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3401b3bbe0f4fc2a1faec415f83b7d6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:36.379201 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2620/5228] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:00:36 2022] DELETE /identity/v3/users/d3401b3bbe0f4fc2a1faec415f83b7d6 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:36.380222 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c3efc7-e25c-43e5-9649-b1a61599b757 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:36.382060 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-84c3efc7-e25c-43e5-9649-b1a61599b757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:36.551072 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:36.558577 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c3efc7-e25c-43e5-9649-b1a61599b757 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:36.581679 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94369ceb-f102-49c3-835e-5e5d1f3759bb tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bfcb14818d4ea093b0b3e43aa640f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0db158bbe55847168ebaa35365f93a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:36.582136 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94369ceb-f102-49c3-835e-5e5d1f3759bb tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:36.582429 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94369ceb-f102-49c3-835e-5e5d1f3759bb tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:36.583851 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94369ceb-f102-49c3-835e-5e5d1f3759bb tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] PATH_INFO: `/v3/roles/784bfdb6dd42409bb063c9e656fee5b8` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:36.586343 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94369ceb-f102-49c3-835e-5e5d1f3759bb tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorizing `identity:delete_role(role_id=784bfdb6dd42409bb063c9e656fee5b8)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:36.588139 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94369ceb-f102-49c3-835e-5e5d1f3759bb tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:36.591366 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2609/5229] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:36.592970 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d42586e-c280-41ee-9f99-071278916fc4 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:36.622402 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d42586e-c280-41ee-9f99-071278916fc4 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:36.682361 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-94369ceb-f102-49c3-835e-5e5d1f3759bb tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invalidating the token cache because role 784bfdb6dd42409bb063c9e656fee5b8 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:36.682802 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-94369ceb-f102-49c3-835e-5e5d1f3759bb tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:36.684301 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-94369ceb-f102-49c3-835e-5e5d1f3759bb tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:36.693092 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2621/5230] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:00:36 2022] DELETE /identity/v3/roles/784bfdb6dd42409bb063c9e656fee5b8 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:36.697305 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94369ceb-f102-49c3-835e-5e5d1f3759bb tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:36.709762 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-94369ceb-f102-49c3-835e-5e5d1f3759bb tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:36.870576 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd18f4-e7aa-4728-85dc-cc4f6942ad48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:36.871712 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd18f4-e7aa-4728-85dc-cc4f6942ad48 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:36.872115 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd18f4-e7aa-4728-85dc-cc4f6942ad48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:36.872490 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd18f4-e7aa-4728-85dc-cc4f6942ad48 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:36.873639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dd18f4-e7aa-4728-85dc-cc4f6942ad48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:00:36.874042 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dd18f4-e7aa-4728-85dc-cc4f6942ad48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:36.880626 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dd18f4-e7aa-4728-85dc-cc4f6942ad48 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:36.925843 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94369ceb-f102-49c3-835e-5e5d1f3759bb tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:36.931052 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2610/5231] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:00:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:00:36.935212 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd18f4-e7aa-4728-85dc-cc4f6942ad48 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:36.945298 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-15dd18f4-e7aa-4728-85dc-cc4f6942ad48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:36.973766 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01483aa-5bc6-4799-a384-2f8dff372e91 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bfcb14818d4ea093b0b3e43aa640f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0db158bbe55847168ebaa35365f93a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:36.974661 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd18f4-e7aa-4728-85dc-cc4f6942ad48 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:36.975554 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01483aa-5bc6-4799-a384-2f8dff372e91 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:36.976002 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01483aa-5bc6-4799-a384-2f8dff372e91 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:36.976440 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01483aa-5bc6-4799-a384-2f8dff372e91 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] PATH_INFO: `/v3/users/d8318d7900854b3e8c981d90cecd33e0` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:36.984183 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01483aa-5bc6-4799-a384-2f8dff372e91 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d8318d7900854b3e8c981d90cecd33e0)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:36.986561 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01483aa-5bc6-4799-a384-2f8dff372e91 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:37.068683 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:37.073610 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b01483aa-5bc6-4799-a384-2f8dff372e91 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8318d7900854b3e8c981d90cecd33e0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:37.079511 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b01483aa-5bc6-4799-a384-2f8dff372e91 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8318d7900854b3e8c981d90cecd33e0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:37.098218 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b01483aa-5bc6-4799-a384-2f8dff372e91 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8318d7900854b3e8c981d90cecd33e0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:37.110699 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b01483aa-5bc6-4799-a384-2f8dff372e91 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8318d7900854b3e8c981d90cecd33e0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:37.122432 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b01483aa-5bc6-4799-a384-2f8dff372e91 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8318d7900854b3e8c981d90cecd33e0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:37.131923 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2622/5232] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:00:36 2022] DELETE /identity/v3/users/d8318d7900854b3e8c981d90cecd33e0 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:00:37.136236 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01483aa-5bc6-4799-a384-2f8dff372e91 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:37.137898 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b01483aa-5bc6-4799-a384-2f8dff372e91 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:37.180787 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd211c5-c953-47d1-802c-6fe888666c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:37.181869 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd211c5-c953-47d1-802c-6fe888666c86 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:37.182309 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd211c5-c953-47d1-802c-6fe888666c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:37.182752 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd211c5-c953-47d1-802c-6fe888666c86 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:37.183621 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd211c5-c953-47d1-802c-6fe888666c86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:37.186070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd211c5-c953-47d1-802c-6fe888666c86 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:37.272169 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2611/5233] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:00:36 2022] POST /identity/v3/projects => generated 373 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:37.274045 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd211c5-c953-47d1-802c-6fe888666c86 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:37.279342 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9fd211c5-c953-47d1-802c-6fe888666c86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:37.351392 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01483aa-5bc6-4799-a384-2f8dff372e91 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:37.451656 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd211c5-c953-47d1-802c-6fe888666c86 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:37.459057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a637545-483a-4218-b7ca-45734a149c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:37.460585 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a637545-483a-4218-b7ca-45734a149c7a admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:37.461022 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a637545-483a-4218-b7ca-45734a149c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:37.462755 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a637545-483a-4218-b7ca-45734a149c7a admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:37.463558 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a637545-483a-4218-b7ca-45734a149c7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:37.467183 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a637545-483a-4218-b7ca-45734a149c7a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:37.481485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9855900-ec29-4e5a-abc0-75f8e84f8502 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bfcb14818d4ea093b0b3e43aa640f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0db158bbe55847168ebaa35365f93a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:37.482990 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9855900-ec29-4e5a-abc0-75f8e84f8502 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:37.483611 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9855900-ec29-4e5a-abc0-75f8e84f8502 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:37.484201 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9855900-ec29-4e5a-abc0-75f8e84f8502 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] PATH_INFO: `/v3/projects/5be164fb1dd54c08aabd7bd92e2087d1` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:37.487016 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9855900-ec29-4e5a-abc0-75f8e84f8502 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5be164fb1dd54c08aabd7bd92e2087d1)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:37.495287 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9855900-ec29-4e5a-abc0-75f8e84f8502 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:37.511334 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2612/5234] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:00:37 2022] POST /identity/v3/users => generated 287 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:00:37.512469 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a637545-483a-4218-b7ca-45734a149c7a admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:37.533914 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a637545-483a-4218-b7ca-45734a149c7a admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:37.540997 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eaa460-37c2-4319-8b3e-e585babae45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:37.544934 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eaa460-37c2-4319-8b3e-e585babae45f admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:37.545528 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eaa460-37c2-4319-8b3e-e585babae45f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:37.545978 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eaa460-37c2-4319-8b3e-e585babae45f admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:37.546840 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eaa460-37c2-4319-8b3e-e585babae45f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:37.549407 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eaa460-37c2-4319-8b3e-e585babae45f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:37.552352 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:37.570237 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2613/5235] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:00:37.576918 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eaa460-37c2-4319-8b3e-e585babae45f admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:37.605752 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eaa460-37c2-4319-8b3e-e585babae45f admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:37.626247 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c9855900-ec29-4e5a-abc0-75f8e84f8502 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5be164fb1dd54c08aabd7bd92e2087d1', 'request_id': 'req-c9855900-ec29-4e5a-abc0-75f8e84f8502'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:37.643226 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c9855900-ec29-4e5a-abc0-75f8e84f8502 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5be164fb1dd54c08aabd7bd92e2087d1', 'request_id': 'req-c9855900-ec29-4e5a-abc0-75f8e84f8502'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:37.666453 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c9855900-ec29-4e5a-abc0-75f8e84f8502 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5be164fb1dd54c08aabd7bd92e2087d1', 'request_id': 'req-c9855900-ec29-4e5a-abc0-75f8e84f8502'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:37.690120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:37.704767 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c9855900-ec29-4e5a-abc0-75f8e84f8502 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] The token cache is being invalidate because project 5be164fb1dd54c08aabd7bd92e2087d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:37.705078 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c9855900-ec29-4e5a-abc0-75f8e84f8502 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:37.711663 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c9855900-ec29-4e5a-abc0-75f8e84f8502 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:37.724245 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2623/5236] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:00:37 2022] DELETE /identity/v3/projects/5be164fb1dd54c08aabd7bd92e2087d1 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:00:37.727178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9855900-ec29-4e5a-abc0-75f8e84f8502 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:37.729855 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c9855900-ec29-4e5a-abc0-75f8e84f8502 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:37.764704 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28020645-07f8-4f0f-b5ed-6a1a098a53e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:37.765330 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28020645-07f8-4f0f-b5ed-6a1a098a53e0 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:37.765608 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28020645-07f8-4f0f-b5ed-6a1a098a53e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:37.765878 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28020645-07f8-4f0f-b5ed-6a1a098a53e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:37.766523 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28020645-07f8-4f0f-b5ed-6a1a098a53e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:37.768179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28020645-07f8-4f0f-b5ed-6a1a098a53e0 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:37.808861 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2614/5237] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:00:37.809836 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28020645-07f8-4f0f-b5ed-6a1a098a53e0 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:37.820387 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-28020645-07f8-4f0f-b5ed-6a1a098a53e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:37.856682 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28020645-07f8-4f0f-b5ed-6a1a098a53e0 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:37.865368 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27b0a3-8f9b-4d2d-a2e4-9c294c8eed61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:37.866308 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27b0a3-8f9b-4d2d-a2e4-9c294c8eed61 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:37.866778 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27b0a3-8f9b-4d2d-a2e4-9c294c8eed61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:37.867335 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27b0a3-8f9b-4d2d-a2e4-9c294c8eed61 admin admin] PATH_INFO: `/v3/projects/d5eae700a1cb498c85d08d401d5e4661/users/b9e0923858d346d987a4a7e95e941ac0/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:37.907443 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb27b0a3-8f9b-4d2d-a2e4-9c294c8eed61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5eae700a1cb498c85d08d401d5e4661, user_id=b9e0923858d346d987a4a7e95e941ac0, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:37.911973 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb27b0a3-8f9b-4d2d-a2e4-9c294c8eed61 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:37.940973 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2615/5238] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:00:37 2022] PUT /identity/v3/projects/d5eae700a1cb498c85d08d401d5e4661/users/b9e0923858d346d987a4a7e95e941ac0/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:37.940973 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27b0a3-8f9b-4d2d-a2e4-9c294c8eed61 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:37.940973 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-fb27b0a3-8f9b-4d2d-a2e4-9c294c8eed61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:37.966213 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9855900-ec29-4e5a-abc0-75f8e84f8502 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:38.051046 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27b0a3-8f9b-4d2d-a2e4-9c294c8eed61 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:38.057930 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa20d6-af32-4d4f-9a19-30bf5a1824b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:38.058584 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa20d6-af32-4d4f-9a19-30bf5a1824b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:38.058864 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa20d6-af32-4d4f-9a19-30bf5a1824b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:38.059174 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa20d6-af32-4d4f-9a19-30bf5a1824b4 admin admin] PATH_INFO: `/v3/projects/32bdc9e57ff947d6a16bfd25f40fc96c` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:38.060329 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa20d6-af32-4d4f-9a19-30bf5a1824b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32bdc9e57ff947d6a16bfd25f40fc96c)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:38.064037 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa20d6-af32-4d4f-9a19-30bf5a1824b4 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:38.106209 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac9e56-8bc0-4dae-b9f8-742b6393dcb6 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bfcb14818d4ea093b0b3e43aa640f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0db158bbe55847168ebaa35365f93a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:38.116652 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac9e56-8bc0-4dae-b9f8-742b6393dcb6 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:38.117054 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac9e56-8bc0-4dae-b9f8-742b6393dcb6 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:38.117244 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac9e56-8bc0-4dae-b9f8-742b6393dcb6 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] PATH_INFO: `/v3/users/ee3b7fc25c144c4e94b640b1ba6ec66e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:38.118949 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ac9e56-8bc0-4dae-b9f8-742b6393dcb6 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorizing `identity:update_user(user_id=ee3b7fc25c144c4e94b640b1ba6ec66e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:38.120129 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-d8ac9e56-8bc0-4dae-b9f8-742b6393dcb6 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:00:38.120129 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 16:00:38.120129 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 16:00:38.122497 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ac9e56-8bc0-4dae-b9f8-742b6393dcb6 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:38.169444 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-abfa20d6-af32-4d4f-9a19-30bf5a1824b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32bdc9e57ff947d6a16bfd25f40fc96c', 'request_id': 'req-abfa20d6-af32-4d4f-9a19-30bf5a1824b4'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:38.180021 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d8ac9e56-8bc0-4dae-b9f8-742b6393dcb6 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'ee3b7fc25c144c4e94b640b1ba6ec66e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:38.190502 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-abfa20d6-af32-4d4f-9a19-30bf5a1824b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32bdc9e57ff947d6a16bfd25f40fc96c', 'request_id': 'req-abfa20d6-af32-4d4f-9a19-30bf5a1824b4'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:38.195971 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d8ac9e56-8bc0-4dae-b9f8-742b6393dcb6 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invalidating the token cache because user ee3b7fc25c144c4e94b640b1ba6ec66e was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:38.196543 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d8ac9e56-8bc0-4dae-b9f8-742b6393dcb6 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:38.197467 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d8ac9e56-8bc0-4dae-b9f8-742b6393dcb6 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:38.200040 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2624/5239] 10.222.0.83 () {60 vars in 1243 bytes} [Mon Aug 29 16:00:37 2022] PATCH /identity/v3/users/ee3b7fc25c144c4e94b640b1ba6ec66e => generated 296 bytes in 475 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:00:38.204150 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953ed42-54d4-419e-9e01-ac74fb9376db None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:38.204776 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953ed42-54d4-419e-9e01-ac74fb9376db None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:38.205274 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953ed42-54d4-419e-9e01-ac74fb9376db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:38.213157 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-abfa20d6-af32-4d4f-9a19-30bf5a1824b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32bdc9e57ff947d6a16bfd25f40fc96c', 'request_id': 'req-abfa20d6-af32-4d4f-9a19-30bf5a1824b4'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:38.228095 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:38.236398 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-abfa20d6-af32-4d4f-9a19-30bf5a1824b4 admin admin] The token cache is being invalidate because project 32bdc9e57ff947d6a16bfd25f40fc96c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:38.236733 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-abfa20d6-af32-4d4f-9a19-30bf5a1824b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:38.244392 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-abfa20d6-af32-4d4f-9a19-30bf5a1824b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:38.250439 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2616/5240] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:00:37 2022] DELETE /identity/v3/projects/32bdc9e57ff947d6a16bfd25f40fc96c => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:38.250439 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2a48f-d323-4d41-8eab-6bc6c82cb3e9 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:38.250439 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2a48f-d323-4d41-8eab-6bc6c82cb3e9 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:38.250439 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2a48f-d323-4d41-8eab-6bc6c82cb3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:38.257971 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-3953ed42-54d4-419e-9e01-ac74fb9376db None None] MFA Rules not processed for user `b9e0923858d346d987a4a7e95e941ac0`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:38.259238 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3953ed42-54d4-419e-9e01-ac74fb9376db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:38.313744 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-3dc2a48f-d323-4d41-8eab-6bc6c82cb3e9 None None] MFA Rules not processed for user `ee3b7fc25c144c4e94b640b1ba6ec66e`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:38.314973 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3dc2a48f-d323-4d41-8eab-6bc6c82cb3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:38.327325 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2617/5241] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:38 2022] POST /identity/v3/auth/tokens => generated 348 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 16:00:38.328615 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff25bab-7158-4b92-8b9b-2f3d18cd2fd4 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:38.328901 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff25bab-7158-4b92-8b9b-2f3d18cd2fd4 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:38.329185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff25bab-7158-4b92-8b9b-2f3d18cd2fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:38.375183 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-7ff25bab-7158-4b92-8b9b-2f3d18cd2fd4 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:38.376492 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7ff25bab-7158-4b92-8b9b-2f3d18cd2fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:38.406929 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2625/5242] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:38.408597 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953ed42-54d4-419e-9e01-ac74fb9376db None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:38.424125 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3953ed42-54d4-419e-9e01-ac74fb9376db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:38.460248 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:38.489349 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2618/5243] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:38.490214 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff25bab-7158-4b92-8b9b-2f3d18cd2fd4 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:38.492020 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7ff25bab-7158-4b92-8b9b-2f3d18cd2fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:38.568973 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953ed42-54d4-419e-9e01-ac74fb9376db None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:38.576548 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cabde2-e300-40d8-b69d-a9ba89f42ebd tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bfcb14818d4ea093b0b3e43aa640f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0db158bbe55847168ebaa35365f93a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:38.577849 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cabde2-e300-40d8-b69d-a9ba89f42ebd tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:38.578185 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cabde2-e300-40d8-b69d-a9ba89f42ebd tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:38.579380 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cabde2-e300-40d8-b69d-a9ba89f42ebd tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] PATH_INFO: `/v3/users/ee3b7fc25c144c4e94b640b1ba6ec66e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:38.581978 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cabde2-e300-40d8-b69d-a9ba89f42ebd tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorizing `identity:update_user(user_id=ee3b7fc25c144c4e94b640b1ba6ec66e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:38.585293 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cabde2-e300-40d8-b69d-a9ba89f42ebd tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:38.612015 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff25bab-7158-4b92-8b9b-2f3d18cd2fd4 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:38.621432 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e50a7-ad4d-4687-bd48-2428f2b23d74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:38.623895 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e50a7-ad4d-4687-bd48-2428f2b23d74 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:38.624460 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e50a7-ad4d-4687-bd48-2428f2b23d74 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:38.624742 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e50a7-ad4d-4687-bd48-2428f2b23d74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:38.637715 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e50a7-ad4d-4687-bd48-2428f2b23d74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:38.639319 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e50a7-ad4d-4687-bd48-2428f2b23d74 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:38.647346 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e4cabde2-e300-40d8-b69d-a9ba89f42ebd tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'ee3b7fc25c144c4e94b640b1ba6ec66e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:38.652082 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2619/5244] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:00:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:00:38.653671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea5c86-6876-4103-bbc6-6013a8e1713e None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:38.653962 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea5c86-6876-4103-bbc6-6013a8e1713e None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:38.654430 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea5c86-6876-4103-bbc6-6013a8e1713e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:38.688481 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-d0ea5c86-6876-4103-bbc6-6013a8e1713e None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:38.689960 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d0ea5c86-6876-4103-bbc6-6013a8e1713e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:38.693241 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e4cabde2-e300-40d8-b69d-a9ba89f42ebd tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invalidating the token cache because user ee3b7fc25c144c4e94b640b1ba6ec66e was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:38.693544 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e4cabde2-e300-40d8-b69d-a9ba89f42ebd tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:38.694374 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e4cabde2-e300-40d8-b69d-a9ba89f42ebd tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:38.700463 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2626/5245] 10.222.0.83 () {60 vars in 1243 bytes} [Mon Aug 29 16:00:38 2022] PATCH /identity/v3/users/ee3b7fc25c144c4e94b640b1ba6ec66e => generated 296 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:00:38.703108 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2620/5246] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:38.704846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cabde2-e300-40d8-b69d-a9ba89f42ebd tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:38.708534 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e4cabde2-e300-40d8-b69d-a9ba89f42ebd tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:38.709371 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea5c86-6876-4103-bbc6-6013a8e1713e None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:38.738641 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cabde2-e300-40d8-b69d-a9ba89f42ebd tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:38.747947 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6793a-e9ce-44f1-bf3a-f3b3fb52a38f tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bfcb14818d4ea093b0b3e43aa640f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0db158bbe55847168ebaa35365f93a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:38.748744 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea5c86-6876-4103-bbc6-6013a8e1713e None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:38.748881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6793a-e9ce-44f1-bf3a-f3b3fb52a38f tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:38.748881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6793a-e9ce-44f1-bf3a-f3b3fb52a38f tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:38.749038 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6793a-e9ce-44f1-bf3a-f3b3fb52a38f tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] PATH_INFO: `/v3/users/ee3b7fc25c144c4e94b640b1ba6ec66e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:38.771176 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3389bee-c020-4ec6-a4ac-e7f8aee0f0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:38.771816 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3389bee-c020-4ec6-a4ac-e7f8aee0f0ad admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:38.772094 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3389bee-c020-4ec6-a4ac-e7f8aee0f0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:38.772363 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3389bee-c020-4ec6-a4ac-e7f8aee0f0ad admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:38.773022 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3389bee-c020-4ec6-a4ac-e7f8aee0f0ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:00:38.773328 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3389bee-c020-4ec6-a4ac-e7f8aee0f0ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:38.774198 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee6793a-e9ce-44f1-bf3a-f3b3fb52a38f tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorizing `identity:update_user(user_id=ee3b7fc25c144c4e94b640b1ba6ec66e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:38.777124 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee6793a-e9ce-44f1-bf3a-f3b3fb52a38f tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:38.785896 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3389bee-c020-4ec6-a4ac-e7f8aee0f0ad admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:38.825667 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2621/5247] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:00:38.829901 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3389bee-c020-4ec6-a4ac-e7f8aee0f0ad admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:38.876995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3389bee-c020-4ec6-a4ac-e7f8aee0f0ad admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:38.897744 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d135a-7416-48e8-853e-514ba3bfb831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:38.898403 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d135a-7416-48e8-853e-514ba3bfb831 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:38.899010 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d135a-7416-48e8-853e-514ba3bfb831 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:38.899010 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d135a-7416-48e8-853e-514ba3bfb831 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:38.899595 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d135a-7416-48e8-853e-514ba3bfb831 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:38.906861 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4ee6793a-e9ce-44f1-bf3a-f3b3fb52a38f tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'ee3b7fc25c144c4e94b640b1ba6ec66e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:38.914760 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d135a-7416-48e8-853e-514ba3bfb831 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:38.933795 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4ee6793a-e9ce-44f1-bf3a-f3b3fb52a38f tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invalidating the token cache because user ee3b7fc25c144c4e94b640b1ba6ec66e was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:38.933795 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4ee6793a-e9ce-44f1-bf3a-f3b3fb52a38f tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:38.937390 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4ee6793a-e9ce-44f1-bf3a-f3b3fb52a38f tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:38.940128 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2627/5248] 10.222.0.83 () {60 vars in 1243 bytes} [Mon Aug 29 16:00:38 2022] PATCH /identity/v3/users/ee3b7fc25c144c4e94b640b1ba6ec66e => generated 296 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:00:38.944986 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b71aa9-792d-4b72-93ae-6a4328c6157c None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:38.945175 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b71aa9-792d-4b72-93ae-6a4328c6157c None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:38.945416 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b71aa9-792d-4b72-93ae-6a4328c6157c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:39.016310 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2622/5249] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:00:38 2022] POST /identity/v3/projects => generated 383 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:39.020475 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d135a-7416-48e8-853e-514ba3bfb831 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:39.031163 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e88d135a-7416-48e8-853e-514ba3bfb831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:39.079232 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-b6b71aa9-792d-4b72-93ae-6a4328c6157c None None] MFA Rules not processed for user `ee3b7fc25c144c4e94b640b1ba6ec66e`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:39.082337 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b6b71aa9-792d-4b72-93ae-6a4328c6157c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:39.100899 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2628/5250] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:38 2022] POST /identity/v3/auth/tokens => generated 348 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 16:00:39.111343 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b71aa9-792d-4b72-93ae-6a4328c6157c None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:39.115462 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b6b71aa9-792d-4b72-93ae-6a4328c6157c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:39.231261 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:39.276025 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d135a-7416-48e8-853e-514ba3bfb831 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:39.289347 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8f72f-89de-4e3f-9a2f-1ef5af54aff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:39.293636 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8f72f-89de-4e3f-9a2f-1ef5af54aff4 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:39.293636 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8f72f-89de-4e3f-9a2f-1ef5af54aff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:39.293636 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8f72f-89de-4e3f-9a2f-1ef5af54aff4 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:39.293636 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d8f72f-89de-4e3f-9a2f-1ef5af54aff4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:39.297457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d8f72f-89de-4e3f-9a2f-1ef5af54aff4 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:39.325532 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b71aa9-792d-4b72-93ae-6a4328c6157c None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:39.341629 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26fd23-fa17-42a5-8fb1-1504417aeed0 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bfcb14818d4ea093b0b3e43aa640f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0db158bbe55847168ebaa35365f93a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:39.343060 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26fd23-fa17-42a5-8fb1-1504417aeed0 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:39.346565 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26fd23-fa17-42a5-8fb1-1504417aeed0 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:39.346565 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26fd23-fa17-42a5-8fb1-1504417aeed0 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] PATH_INFO: `/v3/users/ee3b7fc25c144c4e94b640b1ba6ec66e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:39.348137 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26fd23-fa17-42a5-8fb1-1504417aeed0 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorizing `identity:update_user(user_id=ee3b7fc25c144c4e94b640b1ba6ec66e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:39.349089 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2623/5251] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:00:39 2022] POST /identity/v3/users => generated 292 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:39.353435 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26fd23-fa17-42a5-8fb1-1504417aeed0 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:39.356529 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8f72f-89de-4e3f-9a2f-1ef5af54aff4 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:39.385003 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8f72f-89de-4e3f-9a2f-1ef5af54aff4 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:39.396377 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39a252-b830-4471-8d35-29363b67f73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:39.397031 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39a252-b830-4471-8d35-29363b67f73c admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:39.397390 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39a252-b830-4471-8d35-29363b67f73c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:39.397666 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39a252-b830-4471-8d35-29363b67f73c admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:39.398425 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d39a252-b830-4471-8d35-29363b67f73c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:39.401079 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d39a252-b830-4471-8d35-29363b67f73c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:39.418017 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2624/5252] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:00:39 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:00:39.422120 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39a252-b830-4471-8d35-29363b67f73c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:39.450913 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3c26fd23-fa17-42a5-8fb1-1504417aeed0 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'ee3b7fc25c144c4e94b640b1ba6ec66e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:39.453209 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39a252-b830-4471-8d35-29363b67f73c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:39.466191 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3c26fd23-fa17-42a5-8fb1-1504417aeed0 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invalidating the token cache because user ee3b7fc25c144c4e94b640b1ba6ec66e was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:39.466191 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3c26fd23-fa17-42a5-8fb1-1504417aeed0 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:39.468427 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4742b-00df-497a-81a5-18527157f53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:39.468930 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3c26fd23-fa17-42a5-8fb1-1504417aeed0 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:39.471297 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4742b-00df-497a-81a5-18527157f53d admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:39.472336 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4742b-00df-497a-81a5-18527157f53d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:39.473059 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4742b-00df-497a-81a5-18527157f53d admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:39.481381 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da4742b-00df-497a-81a5-18527157f53d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:39.482348 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2629/5253] 10.222.0.83 () {60 vars in 1243 bytes} [Mon Aug 29 16:00:39 2022] PATCH /identity/v3/users/ee3b7fc25c144c4e94b640b1ba6ec66e => generated 296 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:00:39.482442 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da4742b-00df-497a-81a5-18527157f53d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:39.482552 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26fd23-fa17-42a5-8fb1-1504417aeed0 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:39.484093 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3c26fd23-fa17-42a5-8fb1-1504417aeed0 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:39.502832 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=86,keystone:UPDATE=3,keystone:INSERT=6,keystone:DELETE=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:39.514824 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2625/5254] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:00:39 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:00:39.514931 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26fd23-fa17-42a5-8fb1-1504417aeed0 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:39.516692 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4742b-00df-497a-81a5-18527157f53d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:39.520340 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4da4742b-00df-497a-81a5-18527157f53d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:39.525833 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7309f9-7850-4f54-be42-191cadfa6912 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bfcb14818d4ea093b0b3e43aa640f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0db158bbe55847168ebaa35365f93a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:39.526895 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7309f9-7850-4f54-be42-191cadfa6912 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:39.527714 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7309f9-7850-4f54-be42-191cadfa6912 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:39.528203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7309f9-7850-4f54-be42-191cadfa6912 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:39.529026 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7309f9-7850-4f54-be42-191cadfa6912 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:39.533761 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7309f9-7850-4f54-be42-191cadfa6912 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:39.538657 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4742b-00df-497a-81a5-18527157f53d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:39.548539 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca4850-fe49-40e6-9b5c-9bff16242f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:39.549564 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca4850-fe49-40e6-9b5c-9bff16242f47 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:39.550262 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca4850-fe49-40e6-9b5c-9bff16242f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:39.550895 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca4850-fe49-40e6-9b5c-9bff16242f47 admin admin] PATH_INFO: `/v3/projects/b0c2fe968e254c3b90095c31ae1faf2d/users/90c0c0f8860541c0a54484d06e5fb475/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:39.576540 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca4850-fe49-40e6-9b5c-9bff16242f47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0c2fe968e254c3b90095c31ae1faf2d, user_id=90c0c0f8860541c0a54484d06e5fb475, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:39.580755 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2630/5255] 10.222.0.83 () {60 vars in 1143 bytes} [Mon Aug 29 16:00:39 2022] POST /identity/v3/users => generated 265 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:39.582466 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7309f9-7850-4f54-be42-191cadfa6912 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:39.583765 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca4850-fe49-40e6-9b5c-9bff16242f47 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:39.595865 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7309f9-7850-4f54-be42-191cadfa6912 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:39.605239 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b588c86-80bd-439d-8d07-9c9fb852a9f6 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bfcb14818d4ea093b0b3e43aa640f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0db158bbe55847168ebaa35365f93a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:39.605239 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b588c86-80bd-439d-8d07-9c9fb852a9f6 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:39.605239 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b588c86-80bd-439d-8d07-9c9fb852a9f6 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:39.605587 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b588c86-80bd-439d-8d07-9c9fb852a9f6 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] PATH_INFO: `/v3/users/d2b0059720a146ef80e59a6fbea47be8/password` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:39.625710 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2626/5256] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:00:39 2022] PUT /identity/v3/projects/b0c2fe968e254c3b90095c31ae1faf2d/users/90c0c0f8860541c0a54484d06e5fb475/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:39.636839 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f856a0-6caa-4f60-b05a-6eb7d84432e2 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:39.637665 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f856a0-6caa-4f60-b05a-6eb7d84432e2 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:39.638164 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f856a0-6caa-4f60-b05a-6eb7d84432e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:39.677626 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-68f856a0-6caa-4f60-b05a-6eb7d84432e2 None None] MFA Rules not processed for user `90c0c0f8860541c0a54484d06e5fb475`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:39.680591 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-68f856a0-6caa-4f60-b05a-6eb7d84432e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:39.742539 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5b588c86-80bd-439d-8d07-9c9fb852a9f6 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd2b0059720a146ef80e59a6fbea47be8'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:39.761160 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2631/5257] 10.222.0.83 () {60 vars in 1269 bytes} [Mon Aug 29 16:00:39 2022] POST /identity/v3/users/d2b0059720a146ef80e59a6fbea47be8/password => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:39.815473 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2627/5258] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:39.817855 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b588c86-80bd-439d-8d07-9c9fb852a9f6 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:39.831534 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b588c86-80bd-439d-8d07-9c9fb852a9f6 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:39.915970 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f856a0-6caa-4f60-b05a-6eb7d84432e2 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:39.917782 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-68f856a0-6caa-4f60-b05a-6eb7d84432e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:39.919378 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94338432-309b-400e-8e40-598365b2465d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:39.920075 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94338432-309b-400e-8e40-598365b2465d admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:39.920424 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94338432-309b-400e-8e40-598365b2465d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:39.920762 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94338432-309b-400e-8e40-598365b2465d admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:39.921411 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94338432-309b-400e-8e40-598365b2465d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:39.926560 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94338432-309b-400e-8e40-598365b2465d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:39.941410 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f856a0-6caa-4f60-b05a-6eb7d84432e2 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:39.947344 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc8fcf-31f5-42cb-ad47-0f387e9e83dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:39.948451 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc8fcf-31f5-42cb-ad47-0f387e9e83dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:39.948765 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc8fcf-31f5-42cb-ad47-0f387e9e83dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:39.949276 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc8fcf-31f5-42cb-ad47-0f387e9e83dc admin admin] PATH_INFO: `/v3/users/b9e0923858d346d987a4a7e95e941ac0` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:39.950514 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dc8fcf-31f5-42cb-ad47-0f387e9e83dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9e0923858d346d987a4a7e95e941ac0)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:39.952732 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dc8fcf-31f5-42cb-ad47-0f387e9e83dc admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:39.965764 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2632/5259] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:00:39 2022] POST /identity/v3/projects => generated 381 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:39.969465 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94338432-309b-400e-8e40-598365b2465d admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:40.043891 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-91dc8fcf-31f5-42cb-ad47-0f387e9e83dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9e0923858d346d987a4a7e95e941ac0'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:40.044567 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-91dc8fcf-31f5-42cb-ad47-0f387e9e83dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9e0923858d346d987a4a7e95e941ac0'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:40.059378 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-91dc8fcf-31f5-42cb-ad47-0f387e9e83dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9e0923858d346d987a4a7e95e941ac0'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:40.069374 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-91dc8fcf-31f5-42cb-ad47-0f387e9e83dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9e0923858d346d987a4a7e95e941ac0'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:40.070238 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-91dc8fcf-31f5-42cb-ad47-0f387e9e83dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9e0923858d346d987a4a7e95e941ac0'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:40.076677 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=86,keystone:INSERT=5,keystone:DELETE=9 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:40.086871 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94338432-309b-400e-8e40-598365b2465d admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:40.096051 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45da3e-1e85-4ddc-abc4-af8f6fb01542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:40.097305 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45da3e-1e85-4ddc-abc4-af8f6fb01542 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:40.100750 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45da3e-1e85-4ddc-abc4-af8f6fb01542 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:40.100969 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2628/5260] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:00:39 2022] DELETE /identity/v3/users/b9e0923858d346d987a4a7e95e941ac0 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:40.101079 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45da3e-1e85-4ddc-abc4-af8f6fb01542 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:40.101079 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45da3e-1e85-4ddc-abc4-af8f6fb01542 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:40.101249 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45da3e-1e85-4ddc-abc4-af8f6fb01542 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:40.102402 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b16876d-6b33-4e14-9f8c-4e5ba04754a7 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:40.103264 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b16876d-6b33-4e14-9f8c-4e5ba04754a7 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:40.104323 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b16876d-6b33-4e14-9f8c-4e5ba04754a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:40.127202 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-3b16876d-6b33-4e14-9f8c-4e5ba04754a7 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:40.128828 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3b16876d-6b33-4e14-9f8c-4e5ba04754a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:40.133732 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2633/5261] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:00:39 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:40.139930 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45da3e-1e85-4ddc-abc4-af8f6fb01542 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:40.142725 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6e45da3e-1e85-4ddc-abc4-af8f6fb01542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:40.162000 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45da3e-1e85-4ddc-abc4-af8f6fb01542 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:40.172227 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:INSERT=9,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:40.214853 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2629/5262] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:40.226199 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b16876d-6b33-4e14-9f8c-4e5ba04754a7 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:40.228076 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3b16876d-6b33-4e14-9f8c-4e5ba04754a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:40.254540 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e40eb-2d01-480f-8ecd-a40eff36b8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:40.255290 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e40eb-2d01-480f-8ecd-a40eff36b8ba admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:40.255615 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e40eb-2d01-480f-8ecd-a40eff36b8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:40.255924 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e40eb-2d01-480f-8ecd-a40eff36b8ba admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:40.256606 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1e40eb-2d01-480f-8ecd-a40eff36b8ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:40.258273 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1e40eb-2d01-480f-8ecd-a40eff36b8ba admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:40.270949 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2634/5263] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:00:40.275480 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e40eb-2d01-480f-8ecd-a40eff36b8ba admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:40.288542 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e40eb-2d01-480f-8ecd-a40eff36b8ba admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:40.294013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c6aab-5b16-4a7c-9b2c-b66f666dcec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:40.295000 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c6aab-5b16-4a7c-9b2c-b66f666dcec3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:40.295451 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c6aab-5b16-4a7c-9b2c-b66f666dcec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:40.295798 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c6aab-5b16-4a7c-9b2c-b66f666dcec3 admin admin] PATH_INFO: `/v3/projects/9c2901cd59214ec9888bcc63958724e6/users/8d7af0e706944637a6fa3e44da7069e6/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:40.318252 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b16876d-6b33-4e14-9f8c-4e5ba04754a7 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:40.318578 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c6aab-5b16-4a7c-9b2c-b66f666dcec3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c2901cd59214ec9888bcc63958724e6, user_id=8d7af0e706944637a6fa3e44da7069e6, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:40.321612 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c6aab-5b16-4a7c-9b2c-b66f666dcec3 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:40.325379 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b87576-145a-4c30-a1f4-280163232b37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:40.326170 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b87576-145a-4c30-a1f4-280163232b37 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:40.326419 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b87576-145a-4c30-a1f4-280163232b37 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:40.327176 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b87576-145a-4c30-a1f4-280163232b37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:40.340333 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2635/5264] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:00:40 2022] PUT /identity/v3/projects/9c2901cd59214ec9888bcc63958724e6/users/8d7af0e706944637a6fa3e44da7069e6/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:40.340568 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b87576-145a-4c30-a1f4-280163232b37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:40.341940 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b87576-145a-4c30-a1f4-280163232b37 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:40.344054 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c6aab-5b16-4a7c-9b2c-b66f666dcec3 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:40.358749 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2630/5265] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:00:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:00:40.434267 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c6aab-5b16-4a7c-9b2c-b66f666dcec3 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:40.443689 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ad36f-5e70-4a75-a96e-75a4f89be65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:40.444510 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ad36f-5e70-4a75-a96e-75a4f89be65f admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:40.444792 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ad36f-5e70-4a75-a96e-75a4f89be65f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:40.445060 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ad36f-5e70-4a75-a96e-75a4f89be65f admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:40.445733 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ad36f-5e70-4a75-a96e-75a4f89be65f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:40.447450 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ad36f-5e70-4a75-a96e-75a4f89be65f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:40.462294 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2636/5266] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:00:40.463457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b87576-145a-4c30-a1f4-280163232b37 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:40.474892 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b87576-145a-4c30-a1f4-280163232b37 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:40.482736 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2993ef0f-1d8b-4d93-a33c-de473f13262e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:40.483711 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993ef0f-1d8b-4d93-a33c-de473f13262e admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:40.483950 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993ef0f-1d8b-4d93-a33c-de473f13262e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:40.484281 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993ef0f-1d8b-4d93-a33c-de473f13262e admin admin] PATH_INFO: `/v3/projects/9c2901cd59214ec9888bcc63958724e6/users/8d7af0e706944637a6fa3e44da7069e6/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:40.487749 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2993ef0f-1d8b-4d93-a33c-de473f13262e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c2901cd59214ec9888bcc63958724e6, user_id=8d7af0e706944637a6fa3e44da7069e6, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:40.491708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2993ef0f-1d8b-4d93-a33c-de473f13262e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:40.513643 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2631/5267] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:00:40 2022] PUT /identity/v3/projects/9c2901cd59214ec9888bcc63958724e6/users/8d7af0e706944637a6fa3e44da7069e6/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:00:40.515726 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082074a-3f84-4b9d-b8b6-cc433da2a77c None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:40.517391 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082074a-3f84-4b9d-b8b6-cc433da2a77c None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:40.517683 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082074a-3f84-4b9d-b8b6-cc433da2a77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:40.561584 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-1082074a-3f84-4b9d-b8b6-cc433da2a77c None None] MFA Rules not processed for user `8d7af0e706944637a6fa3e44da7069e6`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:40.563053 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1082074a-3f84-4b9d-b8b6-cc433da2a77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:40.642902 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2637/5268] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:40 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:40.654713 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2993ef0f-1d8b-4d93-a33c-de473f13262e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:40.656531 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2993ef0f-1d8b-4d93-a33c-de473f13262e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:40.741965 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2993ef0f-1d8b-4d93-a33c-de473f13262e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:40.745992 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153973d-3073-465b-b3f0-9b068c1505e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:40.747146 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153973d-3073-465b-b3f0-9b068c1505e6 service cinder] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:40.747425 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153973d-3073-465b-b3f0-9b068c1505e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:40.747694 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153973d-3073-465b-b3f0-9b068c1505e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:40.749503 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b153973d-3073-465b-b3f0-9b068c1505e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:40.765059 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc9fd6-713d-44f1-b3b6-f88e34005f07 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:40.765349 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc9fd6-713d-44f1-b3b6-f88e34005f07 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:40.765631 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc9fd6-713d-44f1-b3b6-f88e34005f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:40.780016 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:40.805772 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-b2dc9fd6-713d-44f1-b3b6-f88e34005f07 None None] MFA Rules not processed for user `d2b0059720a146ef80e59a6fbea47be8`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:40.807332 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b2dc9fd6-713d-44f1-b3b6-f88e34005f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:40.812112 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:40.812299 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2638/5269] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:40 2022] POST /identity/v3/auth/tokens => generated 330 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 16:00:40.817875 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc9fd6-713d-44f1-b3b6-f88e34005f07 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:40.819488 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b2dc9fd6-713d-44f1-b3b6-f88e34005f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:40.884411 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b153973d-3073-465b-b3f0-9b068c1505e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:40.886445 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b153973d-3073-465b-b3f0-9b068c1505e6 service cinder] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:40.900858 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2632/5270] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:00:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:00:40.950235 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc9fd6-713d-44f1-b3b6-f88e34005f07 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:40.960547 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb1c4c-862c-4759-8093-78cf952c15d3 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bfcb14818d4ea093b0b3e43aa640f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0db158bbe55847168ebaa35365f93a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:40.961680 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb1c4c-862c-4759-8093-78cf952c15d3 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:40.962065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb1c4c-862c-4759-8093-78cf952c15d3 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:40.962294 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb1c4c-862c-4759-8093-78cf952c15d3 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:40.974514 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bb1c4c-862c-4759-8093-78cf952c15d3 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:40.974514 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bb1c4c-862c-4759-8093-78cf952c15d3 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:40.975445 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153973d-3073-465b-b3f0-9b068c1505e6 service cinder] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:40.976951 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b153973d-3073-465b-b3f0-9b068c1505e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:40.988313 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2639/5271] 10.222.0.83 () {56 vars in 1263 bytes} [Mon Aug 29 16:00:40 2022] GET /identity/v3/auth/tokens => generated 330 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 16:00:40.999200 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb1c4c-862c-4759-8093-78cf952c15d3 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:41.028996 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb1c4c-862c-4759-8093-78cf952c15d3 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:41.035813 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83217e5c-8582-49b2-a636-526c537fe3af tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bfcb14818d4ea093b0b3e43aa640f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0db158bbe55847168ebaa35365f93a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:41.036796 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83217e5c-8582-49b2-a636-526c537fe3af tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:41.037375 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83217e5c-8582-49b2-a636-526c537fe3af tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:41.037649 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83217e5c-8582-49b2-a636-526c537fe3af tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] PATH_INFO: `/v3/users/d2b0059720a146ef80e59a6fbea47be8` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:41.039676 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83217e5c-8582-49b2-a636-526c537fe3af tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d2b0059720a146ef80e59a6fbea47be8)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:41.044098 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83217e5c-8582-49b2-a636-526c537fe3af tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:41.100487 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153973d-3073-465b-b3f0-9b068c1505e6 service cinder] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:41.110556 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f3c9b-a7ce-44c8-a546-3424aa6ff106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:41.111321 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f3c9b-a7ce-44c8-a546-3424aa6ff106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:41.111606 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f3c9b-a7ce-44c8-a546-3424aa6ff106 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:41.112748 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f3c9b-a7ce-44c8-a546-3424aa6ff106 admin admin] PATH_INFO: `/v3/projects/d5eae700a1cb498c85d08d401d5e4661` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:41.113994 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37f3c9b-a7ce-44c8-a546-3424aa6ff106 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5eae700a1cb498c85d08d401d5e4661)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:41.116481 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37f3c9b-a7ce-44c8-a546-3424aa6ff106 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:41.191789 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-83217e5c-8582-49b2-a636-526c537fe3af tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2b0059720a146ef80e59a6fbea47be8'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:41.192660 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-83217e5c-8582-49b2-a636-526c537fe3af tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2b0059720a146ef80e59a6fbea47be8'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:41.219671 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-83217e5c-8582-49b2-a636-526c537fe3af tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2b0059720a146ef80e59a6fbea47be8'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:41.226457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f37f3c9b-a7ce-44c8-a546-3424aa6ff106 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5eae700a1cb498c85d08d401d5e4661', 'request_id': 'req-f37f3c9b-a7ce-44c8-a546-3424aa6ff106'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:41.241723 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f37f3c9b-a7ce-44c8-a546-3424aa6ff106 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5eae700a1cb498c85d08d401d5e4661', 'request_id': 'req-f37f3c9b-a7ce-44c8-a546-3424aa6ff106'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:41.250257 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-83217e5c-8582-49b2-a636-526c537fe3af tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2b0059720a146ef80e59a6fbea47be8'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:41.258142 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f37f3c9b-a7ce-44c8-a546-3424aa6ff106 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5eae700a1cb498c85d08d401d5e4661', 'request_id': 'req-f37f3c9b-a7ce-44c8-a546-3424aa6ff106'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:41.272427 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-83217e5c-8582-49b2-a636-526c537fe3af tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2b0059720a146ef80e59a6fbea47be8'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:41.303803 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2640/5272] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:00:40 2022] DELETE /identity/v3/users/d2b0059720a146ef80e59a6fbea47be8 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:41.305652 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83217e5c-8582-49b2-a636-526c537fe3af tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:41.308344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-83217e5c-8582-49b2-a636-526c537fe3af tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:41.310794 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f37f3c9b-a7ce-44c8-a546-3424aa6ff106 admin admin] The token cache is being invalidate because project d5eae700a1cb498c85d08d401d5e4661 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:41.311149 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f37f3c9b-a7ce-44c8-a546-3424aa6ff106 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:41.312261 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f37f3c9b-a7ce-44c8-a546-3424aa6ff106 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:41.316759 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2633/5273] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:00:40 2022] DELETE /identity/v3/projects/d5eae700a1cb498c85d08d401d5e4661 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:41.324328 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a82db-0f70-4f19-a2b4-de6321737686 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:41.324817 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a82db-0f70-4f19-a2b4-de6321737686 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:41.325190 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a82db-0f70-4f19-a2b4-de6321737686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:41.353572 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-3e7a82db-0f70-4f19-a2b4-de6321737686 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:41.355195 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3e7a82db-0f70-4f19-a2b4-de6321737686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:41.477141 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83217e5c-8582-49b2-a636-526c537fe3af tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:41.504256 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990bd98c-6379-4c25-9388-6894f2ba3d36 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bfcb14818d4ea093b0b3e43aa640f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0db158bbe55847168ebaa35365f93a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:41.505159 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990bd98c-6379-4c25-9388-6894f2ba3d36 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:41.505450 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990bd98c-6379-4c25-9388-6894f2ba3d36 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:41.505774 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990bd98c-6379-4c25-9388-6894f2ba3d36 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:41.506441 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990bd98c-6379-4c25-9388-6894f2ba3d36 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:41.508369 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990bd98c-6379-4c25-9388-6894f2ba3d36 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:41.530377 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:41.544749 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2634/5274] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:41.557369 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587b3b3-b49f-493d-a6d2-20d5fec819b9 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:41.557782 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587b3b3-b49f-493d-a6d2-20d5fec819b9 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:41.558298 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587b3b3-b49f-493d-a6d2-20d5fec819b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:41.567484 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2641/5275] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:00:41 2022] POST /identity/v3/users => generated 364 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:41.574350 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:41.575262 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990bd98c-6379-4c25-9388-6894f2ba3d36 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:41.584888 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-990bd98c-6379-4c25-9388-6894f2ba3d36 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:41.597984 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-2587b3b3-b49f-493d-a6d2-20d5fec819b9 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:41.599275 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2587b3b3-b49f-493d-a6d2-20d5fec819b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:41.615527 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990bd98c-6379-4c25-9388-6894f2ba3d36 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:41.619077 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2635/5276] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:41.625864 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2587b3b3-b49f-493d-a6d2-20d5fec819b9 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:41.630272 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45345846-fe72-4a5a-8831-7b32cd9a6ff9 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bfcb14818d4ea093b0b3e43aa640f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0db158bbe55847168ebaa35365f93a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:41.631047 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45345846-fe72-4a5a-8831-7b32cd9a6ff9 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:41.631379 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45345846-fe72-4a5a-8831-7b32cd9a6ff9 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:41.631654 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45345846-fe72-4a5a-8831-7b32cd9a6ff9 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:41.632671 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45345846-fe72-4a5a-8831-7b32cd9a6ff9 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:41.634873 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45345846-fe72-4a5a-8831-7b32cd9a6ff9 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:41.648746 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2587b3b3-b49f-493d-a6d2-20d5fec819b9 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:41.660113 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65377339-6e87-4a8a-a713-1390412aafab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:41.661013 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65377339-6e87-4a8a-a713-1390412aafab admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:41.662275 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65377339-6e87-4a8a-a713-1390412aafab admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:41.662688 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65377339-6e87-4a8a-a713-1390412aafab admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:41.663669 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65377339-6e87-4a8a-a713-1390412aafab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:00:41.664085 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65377339-6e87-4a8a-a713-1390412aafab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:41.666853 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65377339-6e87-4a8a-a713-1390412aafab admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:41.687892 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2636/5277] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:00:41.694029 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65377339-6e87-4a8a-a713-1390412aafab admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:41.701633 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2642/5278] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:00:41 2022] POST /identity/v3/projects => generated 360 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:41.703820 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45345846-fe72-4a5a-8831-7b32cd9a6ff9 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:41.719726 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65377339-6e87-4a8a-a713-1390412aafab admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:41.812379 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45345846-fe72-4a5a-8831-7b32cd9a6ff9 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:41.817850 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92697165-681b-4fae-b52a-17b5eb4e4054 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bfcb14818d4ea093b0b3e43aa640f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0db158bbe55847168ebaa35365f93a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:41.818499 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92697165-681b-4fae-b52a-17b5eb4e4054 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:41.818786 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92697165-681b-4fae-b52a-17b5eb4e4054 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:41.819092 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92697165-681b-4fae-b52a-17b5eb4e4054 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] PATH_INFO: `/v3/users/bd722cb1eb514bdd99e59e2bc5b86c30` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:41.819202 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d83874-4947-4ace-a47b-f08c82296dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:41.819717 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d83874-4947-4ace-a47b-f08c82296dd7 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:41.819997 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d83874-4947-4ace-a47b-f08c82296dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:41.820329 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d83874-4947-4ace-a47b-f08c82296dd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:41.821028 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d83874-4947-4ace-a47b-f08c82296dd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:41.824375 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d83874-4947-4ace-a47b-f08c82296dd7 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:41.840109 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92697165-681b-4fae-b52a-17b5eb4e4054 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorizing `identity:update_user(user_id=bd722cb1eb514bdd99e59e2bc5b86c30)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:41.846890 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92697165-681b-4fae-b52a-17b5eb4e4054 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:41.868164 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2637/5279] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:00:41 2022] POST /identity/v3/projects => generated 389 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:41.872342 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d83874-4947-4ace-a47b-f08c82296dd7 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:41.919146 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2643/5280] 10.222.0.83 () {60 vars in 1244 bytes} [Mon Aug 29 16:00:41 2022] PATCH /identity/v3/users/bd722cb1eb514bdd99e59e2bc5b86c30 => generated 524 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:00:41.923678 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92697165-681b-4fae-b52a-17b5eb4e4054 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:41.936492 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92697165-681b-4fae-b52a-17b5eb4e4054 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:41.971190 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d83874-4947-4ace-a47b-f08c82296dd7 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:41.982702 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1dc777-5863-4dda-bc29-fd2a8e07bc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:41.983429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1dc777-5863-4dda-bc29-fd2a8e07bc68 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:41.983782 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1dc777-5863-4dda-bc29-fd2a8e07bc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:41.985030 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1dc777-5863-4dda-bc29-fd2a8e07bc68 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:41.986280 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1dc777-5863-4dda-bc29-fd2a8e07bc68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:41.995907 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1dc777-5863-4dda-bc29-fd2a8e07bc68 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:42.075957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfa2db6-909f-48ad-acd9-84c03e1f7d38 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bfcb14818d4ea093b0b3e43aa640f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0db158bbe55847168ebaa35365f93a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:42.077777 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa2db6-909f-48ad-acd9-84c03e1f7d38 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:42.078083 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa2db6-909f-48ad-acd9-84c03e1f7d38 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:42.078349 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa2db6-909f-48ad-acd9-84c03e1f7d38 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] PATH_INFO: `/v3/users/bd722cb1eb514bdd99e59e2bc5b86c30` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:42.095080 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2638/5281] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:00:41 2022] POST /identity/v3/users => generated 295 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:42.099573 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1dc777-5863-4dda-bc29-fd2a8e07bc68 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:42.119988 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1dc777-5863-4dda-bc29-fd2a8e07bc68 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:42.120280 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfa2db6-909f-48ad-acd9-84c03e1f7d38 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorizing `identity:get_user(user_id=bd722cb1eb514bdd99e59e2bc5b86c30)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:42.125688 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfa2db6-909f-48ad-acd9-84c03e1f7d38 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:42.131300 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2644/5282] 10.222.0.83 () {58 vars in 1221 bytes} [Mon Aug 29 16:00:41 2022] GET /identity/v3/users/bd722cb1eb514bdd99e59e2bc5b86c30 => generated 390 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:00:42.132233 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfa2db6-909f-48ad-acd9-84c03e1f7d38 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:42.135744 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4896043e-2e92-4aa7-bc39-447221ab1423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:42.136376 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896043e-2e92-4aa7-bc39-447221ab1423 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:42.136659 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896043e-2e92-4aa7-bc39-447221ab1423 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:42.136937 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896043e-2e92-4aa7-bc39-447221ab1423 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:42.137595 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4896043e-2e92-4aa7-bc39-447221ab1423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:42.139232 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4896043e-2e92-4aa7-bc39-447221ab1423 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:42.158385 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2639/5283] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:00:42.159950 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4896043e-2e92-4aa7-bc39-447221ab1423 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:42.162167 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfa2db6-909f-48ad-acd9-84c03e1f7d38 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:42.173467 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4896043e-2e92-4aa7-bc39-447221ab1423 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:42.177841 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23dbdf6-4ca4-41a7-9cbd-48762cb2ac72 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bfcb14818d4ea093b0b3e43aa640f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0db158bbe55847168ebaa35365f93a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:42.178777 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23dbdf6-4ca4-41a7-9cbd-48762cb2ac72 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:42.180001 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23dbdf6-4ca4-41a7-9cbd-48762cb2ac72 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:42.181124 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23dbdf6-4ca4-41a7-9cbd-48762cb2ac72 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] PATH_INFO: `/v3/projects/11985c103bc04b0687f6995faf7fe1b8` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:42.181636 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d8b9c-8223-4d6c-ae8a-07e89220c6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:42.182836 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d8b9c-8223-4d6c-ae8a-07e89220c6ce admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:42.183255 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d8b9c-8223-4d6c-ae8a-07e89220c6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:42.183604 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d8b9c-8223-4d6c-ae8a-07e89220c6ce admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:42.184321 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d8b9c-8223-4d6c-ae8a-07e89220c6ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:42.185382 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23dbdf6-4ca4-41a7-9cbd-48762cb2ac72 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorizing `identity:delete_project(project_id=11985c103bc04b0687f6995faf7fe1b8)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:42.187427 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d8b9c-8223-4d6c-ae8a-07e89220c6ce admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:42.189288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23dbdf6-4ca4-41a7-9cbd-48762cb2ac72 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:42.223412 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2640/5284] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:00:42.228535 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d8b9c-8223-4d6c-ae8a-07e89220c6ce admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:42.249575 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d8b9c-8223-4d6c-ae8a-07e89220c6ce admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:42.262652 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:INSERT=3,keystone:SELECT=93,keystone:UPDATE=2,keystone:DELETE=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:42.264345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5304b3-9c11-40b9-9986-dc717b372297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:42.265659 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5304b3-9c11-40b9-9986-dc717b372297 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:42.265947 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5304b3-9c11-40b9-9986-dc717b372297 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:42.266386 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5304b3-9c11-40b9-9986-dc717b372297 admin admin] PATH_INFO: `/v3/projects/7b72e66e47d7446da9139e40c2487835/users/dc6ef913ffed44cd9bef664437b0c4ab/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:42.290485 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5304b3-9c11-40b9-9986-dc717b372297 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b72e66e47d7446da9139e40c2487835, user_id=dc6ef913ffed44cd9bef664437b0c4ab, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:42.294814 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5304b3-9c11-40b9-9986-dc717b372297 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:42.313973 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a23dbdf6-4ca4-41a7-9cbd-48762cb2ac72 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11985c103bc04b0687f6995faf7fe1b8', 'request_id': 'req-a23dbdf6-4ca4-41a7-9cbd-48762cb2ac72'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:42.324980 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2641/5285] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:00:42 2022] PUT /identity/v3/projects/7b72e66e47d7446da9139e40c2487835/users/dc6ef913ffed44cd9bef664437b0c4ab/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:42.327608 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a23dbdf6-4ca4-41a7-9cbd-48762cb2ac72 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11985c103bc04b0687f6995faf7fe1b8', 'request_id': 'req-a23dbdf6-4ca4-41a7-9cbd-48762cb2ac72'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:42.327804 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ff64d-a5b0-4127-88e9-b93ad3f327d9 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:42.328091 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ff64d-a5b0-4127-88e9-b93ad3f327d9 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:42.329161 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ff64d-a5b0-4127-88e9-b93ad3f327d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:42.358336 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:42.359412 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a23dbdf6-4ca4-41a7-9cbd-48762cb2ac72 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11985c103bc04b0687f6995faf7fe1b8', 'request_id': 'req-a23dbdf6-4ca4-41a7-9cbd-48762cb2ac72'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:42.374138 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-d71ff64d-a5b0-4127-88e9-b93ad3f327d9 None None] MFA Rules not processed for user `dc6ef913ffed44cd9bef664437b0c4ab`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:42.376188 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d71ff64d-a5b0-4127-88e9-b93ad3f327d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:42.394467 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a23dbdf6-4ca4-41a7-9cbd-48762cb2ac72 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] The token cache is being invalidate because project 11985c103bc04b0687f6995faf7fe1b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:42.395372 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a23dbdf6-4ca4-41a7-9cbd-48762cb2ac72 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:42.398213 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a23dbdf6-4ca4-41a7-9cbd-48762cb2ac72 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:42.406883 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2645/5286] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:00:42 2022] DELETE /identity/v3/projects/11985c103bc04b0687f6995faf7fe1b8 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:42.408552 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23dbdf6-4ca4-41a7-9cbd-48762cb2ac72 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:42.412490 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a23dbdf6-4ca4-41a7-9cbd-48762cb2ac72 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:42.521651 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2642/5287] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:42 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:42.530616 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ff64d-a5b0-4127-88e9-b93ad3f327d9 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:42.532454 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d71ff64d-a5b0-4127-88e9-b93ad3f327d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:42.562555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23dbdf6-4ca4-41a7-9cbd-48762cb2ac72 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:42.668162 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ff64d-a5b0-4127-88e9-b93ad3f327d9 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:42.672292 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c8b8c9-e5c5-4751-a378-9b3fc9a6549f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:42.673016 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8b8c9-e5c5-4751-a378-9b3fc9a6549f service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:42.673373 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8b8c9-e5c5-4751-a378-9b3fc9a6549f service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:42.673717 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8b8c9-e5c5-4751-a378-9b3fc9a6549f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:42.693520 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79fda70-4f10-4af4-bdc0-565e296bf843 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bfcb14818d4ea093b0b3e43aa640f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0db158bbe55847168ebaa35365f93a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:42.694180 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fda70-4f10-4af4-bdc0-565e296bf843 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:42.694467 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fda70-4f10-4af4-bdc0-565e296bf843 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:42.694743 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fda70-4f10-4af4-bdc0-565e296bf843 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] PATH_INFO: `/v3/users/bd722cb1eb514bdd99e59e2bc5b86c30` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:42.694927 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c8b8c9-e5c5-4751-a378-9b3fc9a6549f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:42.696501 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c8b8c9-e5c5-4751-a378-9b3fc9a6549f service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:42.698572 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79fda70-4f10-4af4-bdc0-565e296bf843 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorizing `identity:delete_user(user_id=bd722cb1eb514bdd99e59e2bc5b86c30)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:42.702178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79fda70-4f10-4af4-bdc0-565e296bf843 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:42.731900 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2643/5288] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:00:42 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:00:42.828648 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c79fda70-4f10-4af4-bdc0-565e296bf843 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd722cb1eb514bdd99e59e2bc5b86c30'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:42.831451 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c79fda70-4f10-4af4-bdc0-565e296bf843 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd722cb1eb514bdd99e59e2bc5b86c30'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:42.929647 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c79fda70-4f10-4af4-bdc0-565e296bf843 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd722cb1eb514bdd99e59e2bc5b86c30'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:42.939194 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:42.966732 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c79fda70-4f10-4af4-bdc0-565e296bf843 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd722cb1eb514bdd99e59e2bc5b86c30'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:42.993171 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c79fda70-4f10-4af4-bdc0-565e296bf843 tempest-UsersV3TestJSON-110195216 tempest-UsersV3TestJSON-110195216-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd722cb1eb514bdd99e59e2bc5b86c30'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:43.021163 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c8b8c9-e5c5-4751-a378-9b3fc9a6549f service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:43.022859 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-95c8b8c9-e5c5-4751-a378-9b3fc9a6549f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:43.024350 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2646/5289] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:00:42 2022] DELETE /identity/v3/users/bd722cb1eb514bdd99e59e2bc5b86c30 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:43.163376 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c8b8c9-e5c5-4751-a378-9b3fc9a6549f service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:43.277802 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:43.304102 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1236e-2156-49ff-957a-92056ea61dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:43.304668 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1236e-2156-49ff-957a-92056ea61dcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:43.304944 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1236e-2156-49ff-957a-92056ea61dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:43.305215 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1236e-2156-49ff-957a-92056ea61dcb admin admin] PATH_INFO: `/v3/users/ee3b7fc25c144c4e94b640b1ba6ec66e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:43.329169 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1236e-2156-49ff-957a-92056ea61dcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee3b7fc25c144c4e94b640b1ba6ec66e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:43.332664 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1236e-2156-49ff-957a-92056ea61dcb admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:43.427610 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0be1236e-2156-49ff-957a-92056ea61dcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee3b7fc25c144c4e94b640b1ba6ec66e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:43.428447 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0be1236e-2156-49ff-957a-92056ea61dcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee3b7fc25c144c4e94b640b1ba6ec66e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:43.444213 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0be1236e-2156-49ff-957a-92056ea61dcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee3b7fc25c144c4e94b640b1ba6ec66e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:43.454187 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0be1236e-2156-49ff-957a-92056ea61dcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee3b7fc25c144c4e94b640b1ba6ec66e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:43.455099 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0be1236e-2156-49ff-957a-92056ea61dcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee3b7fc25c144c4e94b640b1ba6ec66e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:43.496028 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2644/5290] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:00:43 2022] DELETE /identity/v3/users/ee3b7fc25c144c4e94b640b1ba6ec66e => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:43.497815 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9c69f-6929-4d96-b1ea-d8313d729dc9 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:43.498297 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9c69f-6929-4d96-b1ea-d8313d729dc9 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:43.498430 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9c69f-6929-4d96-b1ea-d8313d729dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:43.542019 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-34c9c69f-6929-4d96-b1ea-d8313d729dc9 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:43.546421 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-34c9c69f-6929-4d96-b1ea-d8313d729dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:43.652840 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2647/5291] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:00:43.663123 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1236e-2156-49ff-957a-92056ea61dcb admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:43.664831 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0be1236e-2156-49ff-957a-92056ea61dcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:43.774604 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1236e-2156-49ff-957a-92056ea61dcb admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:43.779425 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f08ee4-e79d-4d12-8d08-986d1cb8ffc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:43.780591 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f08ee4-e79d-4d12-8d08-986d1cb8ffc0 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:43.780921 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f08ee4-e79d-4d12-8d08-986d1cb8ffc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:43.781294 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f08ee4-e79d-4d12-8d08-986d1cb8ffc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:43.794945 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f08ee4-e79d-4d12-8d08-986d1cb8ffc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:43.797717 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f08ee4-e79d-4d12-8d08-986d1cb8ffc0 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:43.815116 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2645/5292] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:00:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:00:44.403017 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9c69f-6929-4d96-b1ea-d8313d729dc9 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:44.404574 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-34c9c69f-6929-4d96-b1ea-d8313d729dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:44.424991 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9c69f-6929-4d96-b1ea-d8313d729dc9 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:44.448282 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e1651-e8bf-4871-b6ef-f69ab03ec6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:44.449051 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e1651-e8bf-4871-b6ef-f69ab03ec6ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:44.449433 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e1651-e8bf-4871-b6ef-f69ab03ec6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:44.449810 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e1651-e8bf-4871-b6ef-f69ab03ec6ad admin admin] PATH_INFO: `/v3/projects/882a1e7063354d6fa4a800cec776e375` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:44.451416 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e1651-e8bf-4871-b6ef-f69ab03ec6ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=882a1e7063354d6fa4a800cec776e375)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:44.454587 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e1651-e8bf-4871-b6ef-f69ab03ec6ad admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:44.571812 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6a2e1651-e8bf-4871-b6ef-f69ab03ec6ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '882a1e7063354d6fa4a800cec776e375', 'request_id': 'req-6a2e1651-e8bf-4871-b6ef-f69ab03ec6ad'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:44.579510 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6a2e1651-e8bf-4871-b6ef-f69ab03ec6ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '882a1e7063354d6fa4a800cec776e375', 'request_id': 'req-6a2e1651-e8bf-4871-b6ef-f69ab03ec6ad'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:44.591740 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6a2e1651-e8bf-4871-b6ef-f69ab03ec6ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '882a1e7063354d6fa4a800cec776e375', 'request_id': 'req-6a2e1651-e8bf-4871-b6ef-f69ab03ec6ad'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:44.611191 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6a2e1651-e8bf-4871-b6ef-f69ab03ec6ad admin admin] The token cache is being invalidate because project 882a1e7063354d6fa4a800cec776e375 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:44.611523 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6a2e1651-e8bf-4871-b6ef-f69ab03ec6ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:44.614568 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6a2e1651-e8bf-4871-b6ef-f69ab03ec6ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:44.616913 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2648/5293] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:00:44 2022] DELETE /identity/v3/projects/882a1e7063354d6fa4a800cec776e375 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:44.620766 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f08ee4-e79d-4d12-8d08-986d1cb8ffc0 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:44.637022 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f08ee4-e79d-4d12-8d08-986d1cb8ffc0 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:44.716879 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16bfd1-0730-4499-b252-9423fe566c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:44.717625 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16bfd1-0730-4499-b252-9423fe566c5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:44.717978 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16bfd1-0730-4499-b252-9423fe566c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:44.718317 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16bfd1-0730-4499-b252-9423fe566c5c admin admin] PATH_INFO: `/v3/users/56bfcb14818d4ea093b0b3e43aa640f7` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:44.721350 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f16bfd1-0730-4499-b252-9423fe566c5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=56bfcb14818d4ea093b0b3e43aa640f7)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:44.723996 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f16bfd1-0730-4499-b252-9423fe566c5c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:44.728402 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:44.806344 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6f16bfd1-0730-4499-b252-9423fe566c5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56bfcb14818d4ea093b0b3e43aa640f7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:44.807982 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6f16bfd1-0730-4499-b252-9423fe566c5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56bfcb14818d4ea093b0b3e43aa640f7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:44.820066 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6f16bfd1-0730-4499-b252-9423fe566c5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56bfcb14818d4ea093b0b3e43aa640f7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:44.834398 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6f16bfd1-0730-4499-b252-9423fe566c5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56bfcb14818d4ea093b0b3e43aa640f7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:44.835468 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6f16bfd1-0730-4499-b252-9423fe566c5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56bfcb14818d4ea093b0b3e43aa640f7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:44.865312 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2646/5294] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:00:44 2022] DELETE /identity/v3/users/56bfcb14818d4ea093b0b3e43aa640f7 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:46.203358 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e1651-e8bf-4871-b6ef-f69ab03ec6ad admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:46.208710 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6a2e1651-e8bf-4871-b6ef-f69ab03ec6ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:46.242564 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e1651-e8bf-4871-b6ef-f69ab03ec6ad admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:46.416027 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc634b-c66f-4a31-87f1-3d9edbbcd3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:46.416631 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc634b-c66f-4a31-87f1-3d9edbbcd3b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:46.416910 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc634b-c66f-4a31-87f1-3d9edbbcd3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:46.417179 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc634b-c66f-4a31-87f1-3d9edbbcd3b1 admin admin] PATH_INFO: `/v3/projects/0db158bbe55847168ebaa35365f93a0b` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:46.418754 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc634b-c66f-4a31-87f1-3d9edbbcd3b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0db158bbe55847168ebaa35365f93a0b)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:46.420984 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc634b-c66f-4a31-87f1-3d9edbbcd3b1 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:46.437859 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:46.536247 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-78dc634b-c66f-4a31-87f1-3d9edbbcd3b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0db158bbe55847168ebaa35365f93a0b', 'request_id': 'req-78dc634b-c66f-4a31-87f1-3d9edbbcd3b1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:46.555340 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-78dc634b-c66f-4a31-87f1-3d9edbbcd3b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0db158bbe55847168ebaa35365f93a0b', 'request_id': 'req-78dc634b-c66f-4a31-87f1-3d9edbbcd3b1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:46.571226 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-78dc634b-c66f-4a31-87f1-3d9edbbcd3b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0db158bbe55847168ebaa35365f93a0b', 'request_id': 'req-78dc634b-c66f-4a31-87f1-3d9edbbcd3b1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:46.658730 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-78dc634b-c66f-4a31-87f1-3d9edbbcd3b1 admin admin] The token cache is being invalidate because project 0db158bbe55847168ebaa35365f93a0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:46.660399 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-78dc634b-c66f-4a31-87f1-3d9edbbcd3b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:46.663556 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-78dc634b-c66f-4a31-87f1-3d9edbbcd3b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:46.678887 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40cc0ed-c67f-4443-a28b-074192b63350 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:46.679454 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40cc0ed-c67f-4443-a28b-074192b63350 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:46.679553 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2649/5295] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:00:46 2022] DELETE /identity/v3/projects/0db158bbe55847168ebaa35365f93a0b => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:46.679653 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40cc0ed-c67f-4443-a28b-074192b63350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:46.765440 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-d40cc0ed-c67f-4443-a28b-074192b63350 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:46.775487 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d40cc0ed-c67f-4443-a28b-074192b63350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:46.823693 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc634b-c66f-4a31-87f1-3d9edbbcd3b1 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:46.826593 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-78dc634b-c66f-4a31-87f1-3d9edbbcd3b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:47.056307 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2647/5296] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:47.065348 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf23dd8-b8c2-484d-aed1-d8f4f15a4ea9 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:47.066461 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf23dd8-b8c2-484d-aed1-d8f4f15a4ea9 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:47.066996 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf23dd8-b8c2-484d-aed1-d8f4f15a4ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:47.128805 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc634b-c66f-4a31-87f1-3d9edbbcd3b1 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:47.130076 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-fbf23dd8-b8c2-484d-aed1-d8f4f15a4ea9 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:47.132639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-fbf23dd8-b8c2-484d-aed1-d8f4f15a4ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:47.145175 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1bb51d-f5fd-4294-b38e-3255f42e9287 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:47.146324 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1bb51d-f5fd-4294-b38e-3255f42e9287 service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:47.146881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1bb51d-f5fd-4294-b38e-3255f42e9287 service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:47.147196 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1bb51d-f5fd-4294-b38e-3255f42e9287 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:47.150214 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2e1bb51d-f5fd-4294-b38e-3255f42e9287 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:47.168649 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2648/5297] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:47.172487 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf23dd8-b8c2-484d-aed1-d8f4f15a4ea9 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:47.184432 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1bb51d-f5fd-4294-b38e-3255f42e9287 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:47.188039 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1bb51d-f5fd-4294-b38e-3255f42e9287 service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:47.190903 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf23dd8-b8c2-484d-aed1-d8f4f15a4ea9 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:47.234319 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ed570-2a0b-4cc5-96cb-a5431561c790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:47.236482 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ed570-2a0b-4cc5-96cb-a5431561c790 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:47.236765 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ed570-2a0b-4cc5-96cb-a5431561c790 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:47.240503 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2650/5298] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:00:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:00:47.241884 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ed570-2a0b-4cc5-96cb-a5431561c790 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:47.242829 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ed570-2a0b-4cc5-96cb-a5431561c790 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:00:47.244160 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ed570-2a0b-4cc5-96cb-a5431561c790 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:47.247114 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ed570-2a0b-4cc5-96cb-a5431561c790 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:47.290400 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2649/5299] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:00:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:00:47.291623 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1bb51d-f5fd-4294-b38e-3255f42e9287 service placement] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:47.309743 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1bb51d-f5fd-4294-b38e-3255f42e9287 service placement] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:47.329046 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e20c3b-f263-405d-8a03-98eadf2f9ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:47.330165 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e20c3b-f263-405d-8a03-98eadf2f9ce9 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:47.330165 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e20c3b-f263-405d-8a03-98eadf2f9ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:47.330472 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e20c3b-f263-405d-8a03-98eadf2f9ce9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:47.341811 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e20c3b-f263-405d-8a03-98eadf2f9ce9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:47.350523 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e20c3b-f263-405d-8a03-98eadf2f9ce9 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:47.460828 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2651/5300] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:00:47 2022] POST /identity/v3/projects => generated 371 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:47.462148 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ed570-2a0b-4cc5-96cb-a5431561c790 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:47.492791 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ed570-2a0b-4cc5-96cb-a5431561c790 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:47.654428 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b8ed9-fd10-49db-b0fb-a2f11fbc7f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:47.655075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b8ed9-fd10-49db-b0fb-a2f11fbc7f27 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:47.655356 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b8ed9-fd10-49db-b0fb-a2f11fbc7f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:47.655627 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b8ed9-fd10-49db-b0fb-a2f11fbc7f27 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:47.656286 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b8ed9-fd10-49db-b0fb-a2f11fbc7f27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:47.658262 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b8ed9-fd10-49db-b0fb-a2f11fbc7f27 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:47.682464 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:47.713836 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2650/5301] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:00:47 2022] POST /identity/v3/users => generated 286 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:00:47.718261 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e20c3b-f263-405d-8a03-98eadf2f9ce9 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:47.744934 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e20c3b-f263-405d-8a03-98eadf2f9ce9 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:47.763380 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de15ec-80bc-4861-a29c-374c1b7c05e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:47.764188 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de15ec-80bc-4861-a29c-374c1b7c05e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:47.765935 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de15ec-80bc-4861-a29c-374c1b7c05e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:47.766466 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de15ec-80bc-4861-a29c-374c1b7c05e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:47.769926 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7de15ec-80bc-4861-a29c-374c1b7c05e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:47.786932 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7de15ec-80bc-4861-a29c-374c1b7c05e9 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:47.811151 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2652/5302] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:00:47.814889 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b8ed9-fd10-49db-b0fb-a2f11fbc7f27 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:47.840929 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b8ed9-fd10-49db-b0fb-a2f11fbc7f27 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:47.873758 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631e627-48a8-4d5c-967f-b3811709bdd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:47.874404 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631e627-48a8-4d5c-967f-b3811709bdd5 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:47.874689 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631e627-48a8-4d5c-967f-b3811709bdd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:47.874967 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631e627-48a8-4d5c-967f-b3811709bdd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:47.875655 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7631e627-48a8-4d5c-967f-b3811709bdd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:47.877275 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7631e627-48a8-4d5c-967f-b3811709bdd5 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:47.923800 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2651/5303] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:00:47.929252 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de15ec-80bc-4861-a29c-374c1b7c05e9 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:47.949882 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de15ec-80bc-4861-a29c-374c1b7c05e9 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:47.981687 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a3e225-af6d-4598-999e-bcf943c16d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:47.985934 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3e225-af6d-4598-999e-bcf943c16d65 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:47.987324 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3e225-af6d-4598-999e-bcf943c16d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:47.987616 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3e225-af6d-4598-999e-bcf943c16d65 admin admin] PATH_INFO: `/v3/projects/874e942cfac74a56b678e2d729ec1c08/users/56f24324a47a4a5c825ba0d6cb051dcb/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:47.998266 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631e627-48a8-4d5c-967f-b3811709bdd5 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:48.006061 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7631e627-48a8-4d5c-967f-b3811709bdd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:48.038180 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631e627-48a8-4d5c-967f-b3811709bdd5 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:48.044836 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a3e225-af6d-4598-999e-bcf943c16d65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=874e942cfac74a56b678e2d729ec1c08, user_id=56f24324a47a4a5c825ba0d6cb051dcb, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:48.054695 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a3e225-af6d-4598-999e-bcf943c16d65 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:48.065085 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275f7b3-5b3f-4c28-a955-fe166c6cf3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:48.066374 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275f7b3-5b3f-4c28-a955-fe166c6cf3d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:48.066667 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275f7b3-5b3f-4c28-a955-fe166c6cf3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:48.066945 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275f7b3-5b3f-4c28-a955-fe166c6cf3d1 admin admin] PATH_INFO: `/v3/users/ef76ec0a3c064d1eba53fbdb4feaf889` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:48.068340 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c275f7b3-5b3f-4c28-a955-fe166c6cf3d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef76ec0a3c064d1eba53fbdb4feaf889)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:48.070297 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c275f7b3-5b3f-4c28-a955-fe166c6cf3d1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:48.107040 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2653/5304] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:00:47 2022] PUT /identity/v3/projects/874e942cfac74a56b678e2d729ec1c08/users/56f24324a47a4a5c825ba0d6cb051dcb/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:48.110694 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c53f5-6ce2-4170-b674-a69ef44c2072 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:48.111210 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c53f5-6ce2-4170-b674-a69ef44c2072 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:48.111559 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c53f5-6ce2-4170-b674-a69ef44c2072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:48.197495 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c275f7b3-5b3f-4c28-a955-fe166c6cf3d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef76ec0a3c064d1eba53fbdb4feaf889'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:48.198200 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c275f7b3-5b3f-4c28-a955-fe166c6cf3d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef76ec0a3c064d1eba53fbdb4feaf889'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:48.211709 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-560c53f5-6ce2-4170-b674-a69ef44c2072 None None] MFA Rules not processed for user `56f24324a47a4a5c825ba0d6cb051dcb`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:48.219237 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c275f7b3-5b3f-4c28-a955-fe166c6cf3d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef76ec0a3c064d1eba53fbdb4feaf889'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:48.219475 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-560c53f5-6ce2-4170-b674-a69ef44c2072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:48.228880 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c275f7b3-5b3f-4c28-a955-fe166c6cf3d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef76ec0a3c064d1eba53fbdb4feaf889'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:48.229632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c275f7b3-5b3f-4c28-a955-fe166c6cf3d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef76ec0a3c064d1eba53fbdb4feaf889'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:48.260033 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2652/5305] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:00:47 2022] DELETE /identity/v3/users/ef76ec0a3c064d1eba53fbdb4feaf889 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:00:48.283746 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:48.398734 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2654/5306] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:00:48.400067 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275f7b3-5b3f-4c28-a955-fe166c6cf3d1 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:48.517026 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275f7b3-5b3f-4c28-a955-fe166c6cf3d1 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:48.524071 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055da8ee-7b25-41af-af2c-19a077d0ca2e tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56f24324a47a4a5c825ba0d6cb051dcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874e942cfac74a56b678e2d729ec1c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:48.526094 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055da8ee-7b25-41af-af2c-19a077d0ca2e tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:48.526485 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055da8ee-7b25-41af-af2c-19a077d0ca2e tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:48.526865 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055da8ee-7b25-41af-af2c-19a077d0ca2e tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] PATH_INFO: `/v3/users/56f24324a47a4a5c825ba0d6cb051dcb/credentials/OS-EC2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:48.527652 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055da8ee-7b25-41af-af2c-19a077d0ca2e tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=56f24324a47a4a5c825ba0d6cb051dcb)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:48.529316 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055da8ee-7b25-41af-af2c-19a077d0ca2e tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:48.566171 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2653/5307] 10.222.0.83 () {60 vars in 1299 bytes} [Mon Aug 29 16:00:48 2022] POST /identity/v3/users/56f24324a47a4a5c825ba0d6cb051dcb/credentials/OS-EC2 => generated 367 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:48.567877 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c53f5-6ce2-4170-b674-a69ef44c2072 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:48.577690 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c53f5-6ce2-4170-b674-a69ef44c2072 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:48.583084 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b9e582-b764-45e9-9f20-b062f3fbad4d tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56f24324a47a4a5c825ba0d6cb051dcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874e942cfac74a56b678e2d729ec1c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:48.583841 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9e582-b764-45e9-9f20-b062f3fbad4d tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:48.584142 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9e582-b764-45e9-9f20-b062f3fbad4d tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:48.584468 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9e582-b764-45e9-9f20-b062f3fbad4d tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] PATH_INFO: `/v3/users/56f24324a47a4a5c825ba0d6cb051dcb/credentials/OS-EC2/8416a3c960d04f00bb25d8fc5834a865` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:48.587746 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b9e582-b764-45e9-9f20-b062f3fbad4d tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=56f24324a47a4a5c825ba0d6cb051dcb, credential_id=8416a3c960d04f00bb25d8fc5834a865)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:48.590039 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b9e582-b764-45e9-9f20-b062f3fbad4d tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:48.651079 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2655/5308] 10.222.0.83 () {58 vars in 1380 bytes} [Mon Aug 29 16:00:48 2022] DELETE /identity/v3/users/56f24324a47a4a5c825ba0d6cb051dcb/credentials/OS-EC2/8416a3c960d04f00bb25d8fc5834a865 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:48.652050 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055da8ee-7b25-41af-af2c-19a077d0ca2e tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:48.666471 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055da8ee-7b25-41af-af2c-19a077d0ca2e tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:48.678965 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae91192c-8971-480d-b105-05ba321f7c7a tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56f24324a47a4a5c825ba0d6cb051dcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874e942cfac74a56b678e2d729ec1c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:48.679675 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91192c-8971-480d-b105-05ba321f7c7a tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:48.680006 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91192c-8971-480d-b105-05ba321f7c7a tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:48.680223 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91192c-8971-480d-b105-05ba321f7c7a tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] PATH_INFO: `/v3/users/56f24324a47a4a5c825ba0d6cb051dcb/credentials/OS-EC2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:48.680883 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae91192c-8971-480d-b105-05ba321f7c7a tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=56f24324a47a4a5c825ba0d6cb051dcb)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:48.682673 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae91192c-8971-480d-b105-05ba321f7c7a tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:48.721164 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b9e582-b764-45e9-9f20-b062f3fbad4d tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:48.722022 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2654/5309] 10.222.0.83 () {60 vars in 1299 bytes} [Mon Aug 29 16:00:48 2022] POST /identity/v3/users/56f24324a47a4a5c825ba0d6cb051dcb/credentials/OS-EC2 => generated 367 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:00:48.737891 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b9e582-b764-45e9-9f20-b062f3fbad4d tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:48.750801 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819eacf1-ef29-4ccd-a7db-907c6688ac2b tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56f24324a47a4a5c825ba0d6cb051dcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874e942cfac74a56b678e2d729ec1c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:48.751517 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819eacf1-ef29-4ccd-a7db-907c6688ac2b tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:48.751802 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819eacf1-ef29-4ccd-a7db-907c6688ac2b tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:48.752095 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819eacf1-ef29-4ccd-a7db-907c6688ac2b tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] PATH_INFO: `/v3/users/56f24324a47a4a5c825ba0d6cb051dcb/credentials/OS-EC2/140ad6adf7d94ce898a7c6f2f758bd5c` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:48.758312 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819eacf1-ef29-4ccd-a7db-907c6688ac2b tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=56f24324a47a4a5c825ba0d6cb051dcb, credential_id=140ad6adf7d94ce898a7c6f2f758bd5c)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:48.759869 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819eacf1-ef29-4ccd-a7db-907c6688ac2b tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:48.799199 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2656/5310] 10.222.0.83 () {58 vars in 1380 bytes} [Mon Aug 29 16:00:48 2022] DELETE /identity/v3/users/56f24324a47a4a5c825ba0d6cb051dcb/credentials/OS-EC2/140ad6adf7d94ce898a7c6f2f758bd5c => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:48.802937 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae91192c-8971-480d-b105-05ba321f7c7a tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:48.816605 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae91192c-8971-480d-b105-05ba321f7c7a tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:48.825715 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f792d2-4035-4f3d-b73e-3251d8be2f75 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56f24324a47a4a5c825ba0d6cb051dcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874e942cfac74a56b678e2d729ec1c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:48.826396 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f792d2-4035-4f3d-b73e-3251d8be2f75 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:48.826659 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f792d2-4035-4f3d-b73e-3251d8be2f75 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:48.827841 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f792d2-4035-4f3d-b73e-3251d8be2f75 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] PATH_INFO: `/v3/users/56f24324a47a4a5c825ba0d6cb051dcb/credentials/OS-EC2/140ad6adf7d94ce898a7c6f2f758bd5c` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:48.880533 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-a6f792d2-4035-4f3d-b73e-3251d8be2f75 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] Could not find credential: 164e50e198e10802f96cb3f4a1446ba9afb21d676f31eab847cc1aad3128e64a.: keystone.exception.CredentialNotFound: Could not find credential: 164e50e198e10802f96cb3f4a1446ba9afb21d676f31eab847cc1aad3128e64a. Aug 29 16:00:48.880533 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:00:48.880533 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:00:48.880533 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:00:48.880533 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:00:48.880533 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:00:48.880533 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:00:48.880533 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:00:48.880533 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:00:48.880533 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:00:48.880533 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:00:48.880533 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:00:48.880533 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 426, in get Aug 29 16:00:48.880533 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Aug 29 16:00:48.881593 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 29 16:00:48.881593 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 29 16:00:48.881593 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 119, in _build_enforcer_target_data_owner_and_user_id_match Aug 29 16:00:48.881593 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref['credential'] = PROVIDERS.credential_api.get_credential( Aug 29 16:00:48.881593 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:00:48.881593 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:00:48.881593 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 119, in get_credential Aug 29 16:00:48.881593 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application credential = self._get_credential(credential_id) Aug 29 16:00:48.881593 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 16:00:48.881593 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 16:00:48.881593 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 16:00:48.881593 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 16:00:48.881593 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 16:00:48.881593 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 16:00:48.881593 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 16:00:48.881593 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 16:00:48.882628 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 16:00:48.882628 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 16:00:48.882628 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 16:00:48.882628 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 16:00:48.882628 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 16:00:48.882628 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 16:00:48.882628 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 124, in _get_credential Aug 29 16:00:48.882628 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_credential(credential_id) Aug 29 16:00:48.882628 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 88, in get_credential Aug 29 16:00:48.882628 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_credential(session, credential_id).to_dict() Aug 29 16:00:48.882628 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 83, in _get_credential Aug 29 16:00:48.882628 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.CredentialNotFound(credential_id=credential_id) Aug 29 16:00:48.882628 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.CredentialNotFound: Could not find credential: 164e50e198e10802f96cb3f4a1446ba9afb21d676f31eab847cc1aad3128e64a. Aug 29 16:00:48.882628 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:00:48.892187 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2655/5311] 10.222.0.83 () {58 vars in 1377 bytes} [Mon Aug 29 16:00:48 2022] GET /identity/v3/users/56f24324a47a4a5c825ba0d6cb051dcb/credentials/OS-EC2/140ad6adf7d94ce898a7c6f2f758bd5c => generated 148 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 29 16:00:48.892400 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819eacf1-ef29-4ccd-a7db-907c6688ac2b tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:48.916319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819eacf1-ef29-4ccd-a7db-907c6688ac2b tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:48.931188 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6289eac-baed-43a3-a53f-47da9a9fded8 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56f24324a47a4a5c825ba0d6cb051dcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874e942cfac74a56b678e2d729ec1c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:48.931860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6289eac-baed-43a3-a53f-47da9a9fded8 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:48.932144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6289eac-baed-43a3-a53f-47da9a9fded8 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:48.940624 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6289eac-baed-43a3-a53f-47da9a9fded8 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] PATH_INFO: `/v3/users/56f24324a47a4a5c825ba0d6cb051dcb/credentials/OS-EC2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:48.941486 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6289eac-baed-43a3-a53f-47da9a9fded8 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=56f24324a47a4a5c825ba0d6cb051dcb)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:48.943057 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6289eac-baed-43a3-a53f-47da9a9fded8 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:48.985171 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f792d2-4035-4f3d-b73e-3251d8be2f75 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:48.985414 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2657/5312] 10.222.0.83 () {60 vars in 1299 bytes} [Mon Aug 29 16:00:48 2022] POST /identity/v3/users/56f24324a47a4a5c825ba0d6cb051dcb/credentials/OS-EC2 => generated 367 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:49.012553 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f792d2-4035-4f3d-b73e-3251d8be2f75 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:49.033777 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127460d-7169-45d8-9b1b-0cdcb929eee9 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56f24324a47a4a5c825ba0d6cb051dcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874e942cfac74a56b678e2d729ec1c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:49.035219 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127460d-7169-45d8-9b1b-0cdcb929eee9 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:49.035676 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127460d-7169-45d8-9b1b-0cdcb929eee9 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:49.036116 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127460d-7169-45d8-9b1b-0cdcb929eee9 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] PATH_INFO: `/v3/users/56f24324a47a4a5c825ba0d6cb051dcb/credentials/OS-EC2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:49.037152 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e127460d-7169-45d8-9b1b-0cdcb929eee9 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=56f24324a47a4a5c825ba0d6cb051dcb)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:49.038812 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e127460d-7169-45d8-9b1b-0cdcb929eee9 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:49.064469 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2656/5313] 10.222.0.83 () {60 vars in 1299 bytes} [Mon Aug 29 16:00:48 2022] POST /identity/v3/users/56f24324a47a4a5c825ba0d6cb051dcb/credentials/OS-EC2 => generated 367 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:49.065928 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6289eac-baed-43a3-a53f-47da9a9fded8 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:49.076298 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6289eac-baed-43a3-a53f-47da9a9fded8 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:49.082363 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79909c-7ea8-4dc7-97b0-82801e9e0221 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56f24324a47a4a5c825ba0d6cb051dcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874e942cfac74a56b678e2d729ec1c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:49.083291 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79909c-7ea8-4dc7-97b0-82801e9e0221 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:49.083637 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79909c-7ea8-4dc7-97b0-82801e9e0221 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:49.083979 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79909c-7ea8-4dc7-97b0-82801e9e0221 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] PATH_INFO: `/v3/users/56f24324a47a4a5c825ba0d6cb051dcb/credentials/OS-EC2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:49.084645 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab79909c-7ea8-4dc7-97b0-82801e9e0221 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=56f24324a47a4a5c825ba0d6cb051dcb)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:49.086358 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab79909c-7ea8-4dc7-97b0-82801e9e0221 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:49.110151 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127460d-7169-45d8-9b1b-0cdcb929eee9 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:49.110719 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2658/5314] 10.222.0.83 () {58 vars in 1278 bytes} [Mon Aug 29 16:00:49 2022] GET /identity/v3/users/56f24324a47a4a5c825ba0d6cb051dcb/credentials/OS-EC2 => generated 865 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:00:49.124188 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127460d-7169-45d8-9b1b-0cdcb929eee9 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:49.136162 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fef9fe-43a1-4671-a7ac-b12e2a9aa38e tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56f24324a47a4a5c825ba0d6cb051dcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874e942cfac74a56b678e2d729ec1c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:49.137260 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fef9fe-43a1-4671-a7ac-b12e2a9aa38e tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:49.139423 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fef9fe-43a1-4671-a7ac-b12e2a9aa38e tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:49.140172 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fef9fe-43a1-4671-a7ac-b12e2a9aa38e tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] PATH_INFO: `/v3/users/56f24324a47a4a5c825ba0d6cb051dcb/credentials/OS-EC2/570fbc4cdb4a4c729d6d4caa7bf74068` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:49.146449 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fef9fe-43a1-4671-a7ac-b12e2a9aa38e tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=56f24324a47a4a5c825ba0d6cb051dcb, credential_id=570fbc4cdb4a4c729d6d4caa7bf74068)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:49.150171 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fef9fe-43a1-4671-a7ac-b12e2a9aa38e tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:49.151616 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79909c-7ea8-4dc7-97b0-82801e9e0221 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:49.153919 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ab79909c-7ea8-4dc7-97b0-82801e9e0221 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:49.208734 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:INSERT=6,keystone:SELECT=83,keystone:DELETE=11 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:49.214632 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2657/5315] 10.222.0.83 () {58 vars in 1380 bytes} [Mon Aug 29 16:00:49 2022] DELETE /identity/v3/users/56f24324a47a4a5c825ba0d6cb051dcb/credentials/OS-EC2/570fbc4cdb4a4c729d6d4caa7bf74068 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:49.218941 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fef9fe-43a1-4671-a7ac-b12e2a9aa38e tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:49.257456 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fef9fe-43a1-4671-a7ac-b12e2a9aa38e tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:49.281826 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e950a-5678-4509-bb6d-a08e61fd2745 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56f24324a47a4a5c825ba0d6cb051dcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874e942cfac74a56b678e2d729ec1c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:49.292547 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e950a-5678-4509-bb6d-a08e61fd2745 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:49.300248 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e950a-5678-4509-bb6d-a08e61fd2745 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:49.301917 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e950a-5678-4509-bb6d-a08e61fd2745 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] PATH_INFO: `/v3/users/56f24324a47a4a5c825ba0d6cb051dcb/credentials/OS-EC2/c20182ddba194fd8a03f68b0c61c2a68` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:49.311603 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e950a-5678-4509-bb6d-a08e61fd2745 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=56f24324a47a4a5c825ba0d6cb051dcb, credential_id=c20182ddba194fd8a03f68b0c61c2a68)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:49.319657 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e950a-5678-4509-bb6d-a08e61fd2745 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:49.376665 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79909c-7ea8-4dc7-97b0-82801e9e0221 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:49.386475 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2658/5316] 10.222.0.83 () {58 vars in 1380 bytes} [Mon Aug 29 16:00:49 2022] DELETE /identity/v3/users/56f24324a47a4a5c825ba0d6cb051dcb/credentials/OS-EC2/c20182ddba194fd8a03f68b0c61c2a68 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:49.396126 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e950a-5678-4509-bb6d-a08e61fd2745 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:49.399898 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b20e2-6956-45cc-8a1a-c8dc399e2828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:49.401226 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b20e2-6956-45cc-8a1a-c8dc399e2828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:49.404985 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b20e2-6956-45cc-8a1a-c8dc399e2828 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:49.405482 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b20e2-6956-45cc-8a1a-c8dc399e2828 admin admin] PATH_INFO: `/v3/projects/127d2af276e74dad8b3f7cd93027954f` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:49.407911 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3b20e2-6956-45cc-8a1a-c8dc399e2828 admin admin] RBAC: Authorizing `identity:delete_project(project_id=127d2af276e74dad8b3f7cd93027954f)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:49.412444 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3b20e2-6956-45cc-8a1a-c8dc399e2828 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:49.423414 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e950a-5678-4509-bb6d-a08e61fd2745 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:49.435697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f02963-c754-4462-99c1-be6a3a0bcfa3 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56f24324a47a4a5c825ba0d6cb051dcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874e942cfac74a56b678e2d729ec1c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:49.438900 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f02963-c754-4462-99c1-be6a3a0bcfa3 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:49.441514 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f02963-c754-4462-99c1-be6a3a0bcfa3 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:49.441927 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f02963-c754-4462-99c1-be6a3a0bcfa3 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] PATH_INFO: `/v3/users/56f24324a47a4a5c825ba0d6cb051dcb/credentials/OS-EC2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:49.444690 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f02963-c754-4462-99c1-be6a3a0bcfa3 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=56f24324a47a4a5c825ba0d6cb051dcb)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:49.454808 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f02963-c754-4462-99c1-be6a3a0bcfa3 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:49.504213 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2659/5317] 10.222.0.83 () {60 vars in 1299 bytes} [Mon Aug 29 16:00:49 2022] POST /identity/v3/users/56f24324a47a4a5c825ba0d6cb051dcb/credentials/OS-EC2 => generated 367 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:00:49.511887 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f02963-c754-4462-99c1-be6a3a0bcfa3 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:49.517597 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0a3b20e2-6956-45cc-8a1a-c8dc399e2828 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '127d2af276e74dad8b3f7cd93027954f', 'request_id': 'req-0a3b20e2-6956-45cc-8a1a-c8dc399e2828'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:49.531473 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f02963-c754-4462-99c1-be6a3a0bcfa3 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:49.540165 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0a3b20e2-6956-45cc-8a1a-c8dc399e2828 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '127d2af276e74dad8b3f7cd93027954f', 'request_id': 'req-0a3b20e2-6956-45cc-8a1a-c8dc399e2828'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:49.570332 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0a3b20e2-6956-45cc-8a1a-c8dc399e2828 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '127d2af276e74dad8b3f7cd93027954f', 'request_id': 'req-0a3b20e2-6956-45cc-8a1a-c8dc399e2828'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:49.574029 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:49.610769 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0a3b20e2-6956-45cc-8a1a-c8dc399e2828 admin admin] The token cache is being invalidate because project 127d2af276e74dad8b3f7cd93027954f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:49.611122 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0a3b20e2-6956-45cc-8a1a-c8dc399e2828 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:49.612380 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0a3b20e2-6956-45cc-8a1a-c8dc399e2828 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:49.619448 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2659/5318] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:00:49 2022] DELETE /identity/v3/projects/127d2af276e74dad8b3f7cd93027954f => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:49.625764 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b20e2-6956-45cc-8a1a-c8dc399e2828 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:49.629646 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0a3b20e2-6956-45cc-8a1a-c8dc399e2828 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:49.723133 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44b316-9138-420d-be37-0ce8f461cb24 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56f24324a47a4a5c825ba0d6cb051dcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874e942cfac74a56b678e2d729ec1c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:49.729068 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44b316-9138-420d-be37-0ce8f461cb24 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:49.729733 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44b316-9138-420d-be37-0ce8f461cb24 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:49.730505 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44b316-9138-420d-be37-0ce8f461cb24 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] PATH_INFO: `/v3/users/56f24324a47a4a5c825ba0d6cb051dcb/credentials/OS-EC2/05ba3f90d7554eff9be86cfcbcd756a4` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:49.732777 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de44b316-9138-420d-be37-0ce8f461cb24 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=56f24324a47a4a5c825ba0d6cb051dcb, credential_id=05ba3f90d7554eff9be86cfcbcd756a4)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:49.737228 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de44b316-9138-420d-be37-0ce8f461cb24 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:49.746078 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2660/5319] 10.222.0.83 () {58 vars in 1377 bytes} [Mon Aug 29 16:00:49 2022] GET /identity/v3/users/56f24324a47a4a5c825ba0d6cb051dcb/credentials/OS-EC2/05ba3f90d7554eff9be86cfcbcd756a4 => generated 367 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:00:49.749334 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44b316-9138-420d-be37-0ce8f461cb24 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:49.753493 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-de44b316-9138-420d-be37-0ce8f461cb24 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:49.780040 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44b316-9138-420d-be37-0ce8f461cb24 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:49.795542 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6cde41-3027-4bbf-ad7f-6b8e3106abe9 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56f24324a47a4a5c825ba0d6cb051dcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874e942cfac74a56b678e2d729ec1c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:49.800325 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cde41-3027-4bbf-ad7f-6b8e3106abe9 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:49.800325 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cde41-3027-4bbf-ad7f-6b8e3106abe9 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:49.801691 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cde41-3027-4bbf-ad7f-6b8e3106abe9 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] PATH_INFO: `/v3/users/56f24324a47a4a5c825ba0d6cb051dcb/credentials/OS-EC2/05ba3f90d7554eff9be86cfcbcd756a4` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:49.809407 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6cde41-3027-4bbf-ad7f-6b8e3106abe9 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=56f24324a47a4a5c825ba0d6cb051dcb, credential_id=05ba3f90d7554eff9be86cfcbcd756a4)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:49.818114 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6cde41-3027-4bbf-ad7f-6b8e3106abe9 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:49.876846 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2661/5320] 10.222.0.83 () {58 vars in 1380 bytes} [Mon Aug 29 16:00:49 2022] DELETE /identity/v3/users/56f24324a47a4a5c825ba0d6cb051dcb/credentials/OS-EC2/05ba3f90d7554eff9be86cfcbcd756a4 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:49.880427 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6cde41-3027-4bbf-ad7f-6b8e3106abe9 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:49.887123 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1b6cde41-3027-4bbf-ad7f-6b8e3106abe9 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:49.889689 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b20e2-6956-45cc-8a1a-c8dc399e2828 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:49.903090 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339614e4-b2c1-4d95-b5df-59bea8d33a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:49.903927 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339614e4-b2c1-4d95-b5df-59bea8d33a0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:49.904314 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339614e4-b2c1-4d95-b5df-59bea8d33a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:49.904717 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339614e4-b2c1-4d95-b5df-59bea8d33a0f admin admin] PATH_INFO: `/v3/users/eebb2318fc6f422ba3fa39deb99c2294` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:49.906563 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339614e4-b2c1-4d95-b5df-59bea8d33a0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=eebb2318fc6f422ba3fa39deb99c2294)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:49.914521 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339614e4-b2c1-4d95-b5df-59bea8d33a0f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:49.921241 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6cde41-3027-4bbf-ad7f-6b8e3106abe9 tempest-EC2CredentialsTest-867322382 tempest-EC2CredentialsTest-867322382-project] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:49.941045 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2fb24-a3de-4357-9a2e-ed668fcd16c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:49.945685 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2fb24-a3de-4357-9a2e-ed668fcd16c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:49.947314 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2fb24-a3de-4357-9a2e-ed668fcd16c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:49.947747 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2fb24-a3de-4357-9a2e-ed668fcd16c1 admin admin] PATH_INFO: `/v3/users/56f24324a47a4a5c825ba0d6cb051dcb` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:49.950979 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f2fb24-a3de-4357-9a2e-ed668fcd16c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56f24324a47a4a5c825ba0d6cb051dcb)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:49.960101 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f2fb24-a3de-4357-9a2e-ed668fcd16c1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:50.080299 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-339614e4-b2c1-4d95-b5df-59bea8d33a0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eebb2318fc6f422ba3fa39deb99c2294'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:50.090484 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-339614e4-b2c1-4d95-b5df-59bea8d33a0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eebb2318fc6f422ba3fa39deb99c2294'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:50.110319 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d6f2fb24-a3de-4357-9a2e-ed668fcd16c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56f24324a47a4a5c825ba0d6cb051dcb'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:50.111360 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d6f2fb24-a3de-4357-9a2e-ed668fcd16c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56f24324a47a4a5c825ba0d6cb051dcb'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:50.130858 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-339614e4-b2c1-4d95-b5df-59bea8d33a0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eebb2318fc6f422ba3fa39deb99c2294'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:50.157320 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d6f2fb24-a3de-4357-9a2e-ed668fcd16c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56f24324a47a4a5c825ba0d6cb051dcb'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:50.170023 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-339614e4-b2c1-4d95-b5df-59bea8d33a0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eebb2318fc6f422ba3fa39deb99c2294'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:50.179305 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d6f2fb24-a3de-4357-9a2e-ed668fcd16c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56f24324a47a4a5c825ba0d6cb051dcb'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:50.192368 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d6f2fb24-a3de-4357-9a2e-ed668fcd16c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56f24324a47a4a5c825ba0d6cb051dcb'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:50.212245 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-339614e4-b2c1-4d95-b5df-59bea8d33a0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eebb2318fc6f422ba3fa39deb99c2294'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:50.244385 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2660/5321] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:00:49 2022] DELETE /identity/v3/users/eebb2318fc6f422ba3fa39deb99c2294 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:50.263381 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2662/5322] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:00:49 2022] DELETE /identity/v3/users/56f24324a47a4a5c825ba0d6cb051dcb => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:50.268433 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eabd1b-19c0-473e-a203-1b8564d5d105 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:50.269041 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eabd1b-19c0-473e-a203-1b8564d5d105 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:50.269479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eabd1b-19c0-473e-a203-1b8564d5d105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:50.307613 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-a3eabd1b-19c0-473e-a203-1b8564d5d105 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:50.309995 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a3eabd1b-19c0-473e-a203-1b8564d5d105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:50.469370 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2661/5323] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:50.492036 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2fb24-a3de-4357-9a2e-ed668fcd16c1 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:50.494081 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d6f2fb24-a3de-4357-9a2e-ed668fcd16c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:50.585806 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eabd1b-19c0-473e-a203-1b8564d5d105 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:50.587398 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a3eabd1b-19c0-473e-a203-1b8564d5d105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:50.613798 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eabd1b-19c0-473e-a203-1b8564d5d105 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:50.616980 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:50.628899 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814734a-8417-459a-ac36-fb54eb5f75ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:50.629534 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814734a-8417-459a-ac36-fb54eb5f75ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:50.629828 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814734a-8417-459a-ac36-fb54eb5f75ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:50.630135 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814734a-8417-459a-ac36-fb54eb5f75ea admin admin] PATH_INFO: `/v3/projects/7e93d82066684b429f959d60c75a2bd3` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:50.631763 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3814734a-8417-459a-ac36-fb54eb5f75ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e93d82066684b429f959d60c75a2bd3)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:50.633748 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3814734a-8417-459a-ac36-fb54eb5f75ea admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:50.655879 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:50.659576 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2fb24-a3de-4357-9a2e-ed668fcd16c1 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:50.670432 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d052b68-eddb-49ff-8caf-258db24ac079 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:50.671710 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d052b68-eddb-49ff-8caf-258db24ac079 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:50.672385 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d052b68-eddb-49ff-8caf-258db24ac079 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:50.672726 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d052b68-eddb-49ff-8caf-258db24ac079 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:50.689122 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d052b68-eddb-49ff-8caf-258db24ac079 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:50.691395 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d052b68-eddb-49ff-8caf-258db24ac079 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:50.710050 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2663/5324] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:00:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:00:50.734689 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3814734a-8417-459a-ac36-fb54eb5f75ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e93d82066684b429f959d60c75a2bd3', 'request_id': 'req-3814734a-8417-459a-ac36-fb54eb5f75ea'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:50.742779 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3814734a-8417-459a-ac36-fb54eb5f75ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e93d82066684b429f959d60c75a2bd3', 'request_id': 'req-3814734a-8417-459a-ac36-fb54eb5f75ea'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:50.758052 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3814734a-8417-459a-ac36-fb54eb5f75ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e93d82066684b429f959d60c75a2bd3', 'request_id': 'req-3814734a-8417-459a-ac36-fb54eb5f75ea'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:50.773926 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3814734a-8417-459a-ac36-fb54eb5f75ea admin admin] The token cache is being invalidate because project 7e93d82066684b429f959d60c75a2bd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:50.774306 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3814734a-8417-459a-ac36-fb54eb5f75ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:50.774903 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3814734a-8417-459a-ac36-fb54eb5f75ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:50.776890 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2662/5325] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:00:50 2022] DELETE /identity/v3/projects/7e93d82066684b429f959d60c75a2bd3 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:50.784022 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36506c-23d1-455a-a14a-05f52aa701f2 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:50.784022 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36506c-23d1-455a-a14a-05f52aa701f2 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:50.784487 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36506c-23d1-455a-a14a-05f52aa701f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:50.845335 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-7b36506c-23d1-455a-a14a-05f52aa701f2 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:50.851391 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7b36506c-23d1-455a-a14a-05f52aa701f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:51.004896 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2664/5326] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:51.012773 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd056953-021f-4d61-8aed-f2ee0b0f9586 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:51.013109 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd056953-021f-4d61-8aed-f2ee0b0f9586 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:51.013385 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd056953-021f-4d61-8aed-f2ee0b0f9586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:51.073658 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-dd056953-021f-4d61-8aed-f2ee0b0f9586 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:51.077832 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-dd056953-021f-4d61-8aed-f2ee0b0f9586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:51.098512 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2663/5327] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:51.106893 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36506c-23d1-455a-a14a-05f52aa701f2 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:51.119680 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36506c-23d1-455a-a14a-05f52aa701f2 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:51.166704 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62218c-5e0c-4226-bbb2-780fcf87d23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:51.167382 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62218c-5e0c-4226-bbb2-780fcf87d23e admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:51.167784 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62218c-5e0c-4226-bbb2-780fcf87d23e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:51.168095 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62218c-5e0c-4226-bbb2-780fcf87d23e admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:51.169025 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62218c-5e0c-4226-bbb2-780fcf87d23e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:00:51.169334 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62218c-5e0c-4226-bbb2-780fcf87d23e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:51.171292 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62218c-5e0c-4226-bbb2-780fcf87d23e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:51.198652 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2665/5328] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:00:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:00:51.201386 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd056953-021f-4d61-8aed-f2ee0b0f9586 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:51.217393 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd056953-021f-4d61-8aed-f2ee0b0f9586 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:51.227653 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe6de4-100d-4512-b2c8-09814607a37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:51.228502 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe6de4-100d-4512-b2c8-09814607a37c admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:51.228939 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe6de4-100d-4512-b2c8-09814607a37c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:51.232074 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe6de4-100d-4512-b2c8-09814607a37c admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:51.232975 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe6de4-100d-4512-b2c8-09814607a37c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:51.240581 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe6de4-100d-4512-b2c8-09814607a37c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:51.300595 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2664/5329] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:00:51 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:51.304905 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62218c-5e0c-4226-bbb2-780fcf87d23e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:51.321198 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62218c-5e0c-4226-bbb2-780fcf87d23e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:51.402580 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d80a2c-945b-472f-bbe5-974d968f816a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:51.403598 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d80a2c-945b-472f-bbe5-974d968f816a admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:51.404086 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d80a2c-945b-472f-bbe5-974d968f816a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:51.404711 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d80a2c-945b-472f-bbe5-974d968f816a admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:51.405854 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d80a2c-945b-472f-bbe5-974d968f816a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:51.408677 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d80a2c-945b-472f-bbe5-974d968f816a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:51.444847 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2666/5330] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:00:51 2022] POST /identity/v3/users => generated 291 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:51.450217 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe6de4-100d-4512-b2c8-09814607a37c admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:51.465834 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe6de4-100d-4512-b2c8-09814607a37c admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:51.472992 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398487e-ebb6-425d-aec5-4876f67231e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:51.474382 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398487e-ebb6-425d-aec5-4876f67231e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:51.474819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398487e-ebb6-425d-aec5-4876f67231e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:51.475286 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398487e-ebb6-425d-aec5-4876f67231e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:51.476115 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b398487e-ebb6-425d-aec5-4876f67231e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:51.478584 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b398487e-ebb6-425d-aec5-4876f67231e6 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:51.494466 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2665/5331] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:00:51.498707 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d80a2c-945b-472f-bbe5-974d968f816a admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:51.516756 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d80a2c-945b-472f-bbe5-974d968f816a admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:51.527738 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db50d6-ac33-415f-888f-ffab82675cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:51.534971 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db50d6-ac33-415f-888f-ffab82675cc6 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:51.535550 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db50d6-ac33-415f-888f-ffab82675cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:51.535995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db50d6-ac33-415f-888f-ffab82675cc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:51.537144 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db50d6-ac33-415f-888f-ffab82675cc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:51.540057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db50d6-ac33-415f-888f-ffab82675cc6 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:51.558030 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2667/5332] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:00:51.563215 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398487e-ebb6-425d-aec5-4876f67231e6 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:51.597051 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398487e-ebb6-425d-aec5-4876f67231e6 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:51.610650 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d067faa-56d0-44c5-8b53-e5a138b9a3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:51.611623 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d067faa-56d0-44c5-8b53-e5a138b9a3c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:51.612374 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d067faa-56d0-44c5-8b53-e5a138b9a3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:51.612915 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d067faa-56d0-44c5-8b53-e5a138b9a3c4 admin admin] PATH_INFO: `/v3/projects/380e64930bc44fa0b1204f3acd328537/users/9ee1a19085a04426be20de4023ef1a9b/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:51.651834 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d067faa-56d0-44c5-8b53-e5a138b9a3c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=380e64930bc44fa0b1204f3acd328537, user_id=9ee1a19085a04426be20de4023ef1a9b, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:51.655783 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d067faa-56d0-44c5-8b53-e5a138b9a3c4 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:51.672416 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db50d6-ac33-415f-888f-ffab82675cc6 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:51.674377 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-38db50d6-ac33-415f-888f-ffab82675cc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:51.696361 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2666/5333] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:00:51 2022] PUT /identity/v3/projects/380e64930bc44fa0b1204f3acd328537/users/9ee1a19085a04426be20de4023ef1a9b/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:51.703231 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d9295-205e-476a-93a2-f98b005db492 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:51.703768 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d9295-205e-476a-93a2-f98b005db492 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:51.724513 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d9295-205e-476a-93a2-f98b005db492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:51.727432 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db50d6-ac33-415f-888f-ffab82675cc6 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:51.759925 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-ae6d9295-205e-476a-93a2-f98b005db492 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:51.761175 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ae6d9295-205e-476a-93a2-f98b005db492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:51.864024 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:51.908585 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02735e32-5a06-4b5b-96db-97eb3ba65fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:51.909899 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02735e32-5a06-4b5b-96db-97eb3ba65fe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:51.913021 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02735e32-5a06-4b5b-96db-97eb3ba65fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:51.914101 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02735e32-5a06-4b5b-96db-97eb3ba65fe9 admin admin] PATH_INFO: `/v3/projects/874e942cfac74a56b678e2d729ec1c08` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:51.917226 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02735e32-5a06-4b5b-96db-97eb3ba65fe9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=874e942cfac74a56b678e2d729ec1c08)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:51.935097 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02735e32-5a06-4b5b-96db-97eb3ba65fe9 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:51.951937 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2667/5334] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:51.967969 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d9295-205e-476a-93a2-f98b005db492 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:51.969399 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ae6d9295-205e-476a-93a2-f98b005db492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:52.086678 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-02735e32-5a06-4b5b-96db-97eb3ba65fe9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '874e942cfac74a56b678e2d729ec1c08', 'request_id': 'req-02735e32-5a06-4b5b-96db-97eb3ba65fe9'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:52.097087 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:52.101788 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-02735e32-5a06-4b5b-96db-97eb3ba65fe9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '874e942cfac74a56b678e2d729ec1c08', 'request_id': 'req-02735e32-5a06-4b5b-96db-97eb3ba65fe9'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:52.109201 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-02735e32-5a06-4b5b-96db-97eb3ba65fe9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '874e942cfac74a56b678e2d729ec1c08', 'request_id': 'req-02735e32-5a06-4b5b-96db-97eb3ba65fe9'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:52.146069 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-02735e32-5a06-4b5b-96db-97eb3ba65fe9 admin admin] The token cache is being invalidate because project 874e942cfac74a56b678e2d729ec1c08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:52.146662 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-02735e32-5a06-4b5b-96db-97eb3ba65fe9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:52.147561 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-02735e32-5a06-4b5b-96db-97eb3ba65fe9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:52.151669 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2668/5335] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:00:51 2022] DELETE /identity/v3/projects/874e942cfac74a56b678e2d729ec1c08 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:52.152178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d9295-205e-476a-93a2-f98b005db492 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:52.156454 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d3244-b08b-4b79-9913-b426f2f97a80 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:52.157002 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d3244-b08b-4b79-9913-b426f2f97a80 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:52.157437 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d3244-b08b-4b79-9913-b426f2f97a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:52.196992 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-1c4d3244-b08b-4b79-9913-b426f2f97a80 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:52.198524 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1c4d3244-b08b-4b79-9913-b426f2f97a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:52.256998 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3455fb2-6490-4f29-8b60-2b0898c80947 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:52.257903 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3455fb2-6490-4f29-8b60-2b0898c80947 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:52.259270 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3455fb2-6490-4f29-8b60-2b0898c80947 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:52.259737 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3455fb2-6490-4f29-8b60-2b0898c80947 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:52.262479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f3455fb2-6490-4f29-8b60-2b0898c80947 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:52.366898 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2669/5336] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:00:52.379814 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5f304-bef8-4153-b619-1594c1bc2c61 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:52.380259 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5f304-bef8-4153-b619-1594c1bc2c61 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:52.380558 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5f304-bef8-4153-b619-1594c1bc2c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:52.407068 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a5a5f304-bef8-4153-b619-1594c1bc2c61 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:52.408457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a5a5f304-bef8-4153-b619-1594c1bc2c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:52.417662 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3455fb2-6490-4f29-8b60-2b0898c80947 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:52.419182 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2670/5337] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:52.419475 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3455fb2-6490-4f29-8b60-2b0898c80947 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:52.423224 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5f304-bef8-4153-b619-1594c1bc2c61 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:52.434221 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2668/5338] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:00:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:00:52.437057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5f304-bef8-4153-b619-1594c1bc2c61 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:52.443462 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dcbf9a-5c1a-4fae-8d93-a5882ac13ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:52.445269 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dcbf9a-5c1a-4fae-8d93-a5882ac13ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:52.445711 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dcbf9a-5c1a-4fae-8d93-a5882ac13ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:52.446148 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dcbf9a-5c1a-4fae-8d93-a5882ac13ad9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:52.447123 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dcbf9a-5c1a-4fae-8d93-a5882ac13ad9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:00:52.447440 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dcbf9a-5c1a-4fae-8d93-a5882ac13ad9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:52.449622 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dcbf9a-5c1a-4fae-8d93-a5882ac13ad9 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:52.471622 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2671/5339] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:00:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:00:52.473081 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3455fb2-6490-4f29-8b60-2b0898c80947 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:52.491297 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3455fb2-6490-4f29-8b60-2b0898c80947 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:52.500422 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6a27f-a81f-4a58-ace7-3cb330b9e3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:52.501181 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6a27f-a81f-4a58-ace7-3cb330b9e3cf admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:52.501551 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6a27f-a81f-4a58-ace7-3cb330b9e3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:52.501944 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6a27f-a81f-4a58-ace7-3cb330b9e3cf admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:52.503373 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c6a27f-a81f-4a58-ace7-3cb330b9e3cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:52.506567 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c6a27f-a81f-4a58-ace7-3cb330b9e3cf admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:52.546574 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2669/5340] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:00:52 2022] POST /identity/v3/projects => generated 361 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:52.551260 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dcbf9a-5c1a-4fae-8d93-a5882ac13ad9 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:52.572213 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dcbf9a-5c1a-4fae-8d93-a5882ac13ad9 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:52.640013 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:52.656017 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878de91-b6c3-41d9-b295-ea185c30ce1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:52.657140 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878de91-b6c3-41d9-b295-ea185c30ce1c admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:52.657611 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878de91-b6c3-41d9-b295-ea185c30ce1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:52.658413 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878de91-b6c3-41d9-b295-ea185c30ce1c admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:52.660143 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7878de91-b6c3-41d9-b295-ea185c30ce1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:52.662789 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7878de91-b6c3-41d9-b295-ea185c30ce1c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:52.697750 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2672/5341] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:00:52 2022] POST /identity/v3/users => generated 281 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:52.708597 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6a27f-a81f-4a58-ace7-3cb330b9e3cf admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:52.724445 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6a27f-a81f-4a58-ace7-3cb330b9e3cf admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:52.732327 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b46f5-7f5b-4727-a05c-10fc1a5132b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:52.733097 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b46f5-7f5b-4727-a05c-10fc1a5132b5 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:52.733749 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b46f5-7f5b-4727-a05c-10fc1a5132b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:52.734600 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b46f5-7f5b-4727-a05c-10fc1a5132b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:52.735574 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88b46f5-7f5b-4727-a05c-10fc1a5132b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:52.738337 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88b46f5-7f5b-4727-a05c-10fc1a5132b5 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:52.767205 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2670/5342] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:00:52.770939 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878de91-b6c3-41d9-b295-ea185c30ce1c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:52.782447 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878de91-b6c3-41d9-b295-ea185c30ce1c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:52.789636 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a73cac7-d871-4077-b040-208835b7013f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:52.790496 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73cac7-d871-4077-b040-208835b7013f admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:52.790781 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73cac7-d871-4077-b040-208835b7013f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:52.791088 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73cac7-d871-4077-b040-208835b7013f admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:52.791954 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a73cac7-d871-4077-b040-208835b7013f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:52.793513 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a73cac7-d871-4077-b040-208835b7013f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:52.812036 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2673/5343] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:00:52.816671 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b46f5-7f5b-4727-a05c-10fc1a5132b5 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:52.829846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b46f5-7f5b-4727-a05c-10fc1a5132b5 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:52.838981 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6bed22-22fa-4bf8-a92e-42efc127b43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:52.840942 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bed22-22fa-4bf8-a92e-42efc127b43b admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:52.841254 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bed22-22fa-4bf8-a92e-42efc127b43b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:52.841890 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bed22-22fa-4bf8-a92e-42efc127b43b admin admin] PATH_INFO: `/v3/projects/eaa352a25e444af9a66ee1c75e962cd0/users/de744ac22a534771989ff80dad08029e/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:52.863957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6bed22-22fa-4bf8-a92e-42efc127b43b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaa352a25e444af9a66ee1c75e962cd0, user_id=de744ac22a534771989ff80dad08029e, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:52.867146 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6bed22-22fa-4bf8-a92e-42efc127b43b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:52.885910 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2671/5344] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:00:52 2022] PUT /identity/v3/projects/eaa352a25e444af9a66ee1c75e962cd0/users/de744ac22a534771989ff80dad08029e/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:52.896648 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32041a2f-42c2-44c6-add1-fbd242ccbc6f None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:52.897202 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32041a2f-42c2-44c6-add1-fbd242ccbc6f None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:52.897202 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32041a2f-42c2-44c6-add1-fbd242ccbc6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:52.975981 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-32041a2f-42c2-44c6-add1-fbd242ccbc6f None None] MFA Rules not processed for user `de744ac22a534771989ff80dad08029e`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:52.977565 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-32041a2f-42c2-44c6-add1-fbd242ccbc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:53.114714 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2674/5345] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:53.119899 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64765e-be90-493f-ba85-da4ea54b1cee None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:53.120193 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64765e-be90-493f-ba85-da4ea54b1cee None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:53.120473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64765e-be90-493f-ba85-da4ea54b1cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:53.142590 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-9b64765e-be90-493f-ba85-da4ea54b1cee None None] MFA Rules not processed for user `de744ac22a534771989ff80dad08029e`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:53.144684 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9b64765e-be90-493f-ba85-da4ea54b1cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:53.150383 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2672/5346] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:53 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 16:00:53.157470 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775f39e-f406-4422-9dae-5abf60563f8c None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:53.157762 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775f39e-f406-4422-9dae-5abf60563f8c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:53.158683 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775f39e-f406-4422-9dae-5abf60563f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:53.200316 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-8775f39e-f406-4422-9dae-5abf60563f8c None None] MFA Rules not processed for user `de744ac22a534771989ff80dad08029e`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:53.201272 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8775f39e-f406-4422-9dae-5abf60563f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:53.214968 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2675/5347] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:53 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 16:00:53.219953 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64765e-be90-493f-ba85-da4ea54b1cee None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:53.239086 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64765e-be90-493f-ba85-da4ea54b1cee None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:53.246243 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec0fd8-79b3-4852-a97e-43b631977c2a tempest-TokensV3Test-1719703768 tempest-TokensV3Test-1719703768-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de744ac22a534771989ff80dad08029e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eaa352a25e444af9a66ee1c75e962cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:53.246908 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec0fd8-79b3-4852-a97e-43b631977c2a tempest-TokensV3Test-1719703768 tempest-TokensV3Test-1719703768-project] REQUEST_METHOD: `HEAD` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:53.249591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec0fd8-79b3-4852-a97e-43b631977c2a tempest-TokensV3Test-1719703768 tempest-TokensV3Test-1719703768-project] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:53.249830 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec0fd8-79b3-4852-a97e-43b631977c2a tempest-TokensV3Test-1719703768 tempest-TokensV3Test-1719703768-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:53.266280 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec0fd8-79b3-4852-a97e-43b631977c2a tempest-TokensV3Test-1719703768 tempest-TokensV3Test-1719703768-project] RBAC: Authorizing `identity:check_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:53.267999 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec0fd8-79b3-4852-a97e-43b631977c2a tempest-TokensV3Test-1719703768 tempest-TokensV3Test-1719703768-project] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:53.289079 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2673/5348] 10.222.0.83 () {56 vars in 1264 bytes} [Mon Aug 29 16:00:53 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 358 bytes (0 switches on core 0) Aug 29 16:00:53.290255 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8775f39e-f406-4422-9dae-5abf60563f8c None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:53.303855 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8775f39e-f406-4422-9dae-5abf60563f8c None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:53.308957 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188f902-45e9-446c-9205-83f5320a3a50 tempest-TokensV3Test-1719703768 tempest-TokensV3Test-1719703768-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de744ac22a534771989ff80dad08029e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eaa352a25e444af9a66ee1c75e962cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:53.309956 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188f902-45e9-446c-9205-83f5320a3a50 tempest-TokensV3Test-1719703768 tempest-TokensV3Test-1719703768-project] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:53.310241 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188f902-45e9-446c-9205-83f5320a3a50 tempest-TokensV3Test-1719703768 tempest-TokensV3Test-1719703768-project] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:53.310517 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188f902-45e9-446c-9205-83f5320a3a50 tempest-TokensV3Test-1719703768 tempest-TokensV3Test-1719703768-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:53.318676 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188f902-45e9-446c-9205-83f5320a3a50 tempest-TokensV3Test-1719703768 tempest-TokensV3Test-1719703768-project] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:53.334509 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188f902-45e9-446c-9205-83f5320a3a50 tempest-TokensV3Test-1719703768 tempest-TokensV3Test-1719703768-project] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:53.347682 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2676/5349] 10.222.0.83 () {56 vars in 1263 bytes} [Mon Aug 29 16:00:53 2022] GET /identity/v3/auth/tokens => generated 346 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 16:00:53.348608 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec0fd8-79b3-4852-a97e-43b631977c2a tempest-TokensV3Test-1719703768 tempest-TokensV3Test-1719703768-project] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:53.360497 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec0fd8-79b3-4852-a97e-43b631977c2a tempest-TokensV3Test-1719703768 tempest-TokensV3Test-1719703768-project] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:53.367003 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e376f-b049-480a-9ae6-29b2a6006b2b tempest-TokensV3Test-1719703768 tempest-TokensV3Test-1719703768-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de744ac22a534771989ff80dad08029e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eaa352a25e444af9a66ee1c75e962cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:53.368560 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e376f-b049-480a-9ae6-29b2a6006b2b tempest-TokensV3Test-1719703768 tempest-TokensV3Test-1719703768-project] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:53.369542 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e376f-b049-480a-9ae6-29b2a6006b2b tempest-TokensV3Test-1719703768 tempest-TokensV3Test-1719703768-project] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:53.370068 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e376f-b049-480a-9ae6-29b2a6006b2b tempest-TokensV3Test-1719703768 tempest-TokensV3Test-1719703768-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:53.400478 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2e376f-b049-480a-9ae6-29b2a6006b2b tempest-TokensV3Test-1719703768 tempest-TokensV3Test-1719703768-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:53.402314 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2e376f-b049-480a-9ae6-29b2a6006b2b tempest-TokensV3Test-1719703768 tempest-TokensV3Test-1719703768-project] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:53.447218 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188f902-45e9-446c-9205-83f5320a3a50 tempest-TokensV3Test-1719703768 tempest-TokensV3Test-1719703768-project] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:53.448041 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2674/5350] 10.222.0.83 () {56 vars in 1266 bytes} [Mon Aug 29 16:00:53 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:00:53.459379 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188f902-45e9-446c-9205-83f5320a3a50 tempest-TokensV3Test-1719703768 tempest-TokensV3Test-1719703768-project] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:53.464064 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac371fad-8c67-4f89-963b-e4b957e605f7 tempest-TokensV3Test-1719703768 tempest-TokensV3Test-1719703768-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de744ac22a534771989ff80dad08029e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eaa352a25e444af9a66ee1c75e962cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:53.464880 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac371fad-8c67-4f89-963b-e4b957e605f7 tempest-TokensV3Test-1719703768 tempest-TokensV3Test-1719703768-project] REQUEST_METHOD: `HEAD` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:53.465316 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac371fad-8c67-4f89-963b-e4b957e605f7 tempest-TokensV3Test-1719703768 tempest-TokensV3Test-1719703768-project] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:53.465742 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac371fad-8c67-4f89-963b-e4b957e605f7 tempest-TokensV3Test-1719703768 tempest-TokensV3Test-1719703768-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:53.477589 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ac371fad-8c67-4f89-963b-e4b957e605f7 tempest-TokensV3Test-1719703768 tempest-TokensV3Test-1719703768-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:53.495046 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-ac371fad-8c67-4f89-963b-e4b957e605f7 tempest-TokensV3Test-1719703768 tempest-TokensV3Test-1719703768-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Aug 29 16:00:53.495046 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:00:53.495046 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:00:53.495046 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:00:53.495046 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:00:53.495046 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:00:53.495046 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:00:53.495046 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:00:53.495046 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:00:53.495046 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:00:53.495046 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:00:53.495046 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:00:53.495046 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 283, in get Aug 29 16:00:53.495046 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:check_token') Aug 29 16:00:53.495046 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Aug 29 16:00:53.496261 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Aug 29 16:00:53.496261 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Aug 29 16:00:53.496261 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Aug 29 16:00:53.496261 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:00:53.496261 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:00:53.496261 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Aug 29 16:00:53.496261 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Aug 29 16:00:53.496261 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Aug 29 16:00:53.496261 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self.check_revocation(token) Aug 29 16:00:53.496261 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:00:53.496261 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:00:53.496261 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Aug 29 16:00:53.496261 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Aug 29 16:00:53.496261 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:00:53.496261 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:00:53.496261 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Aug 29 16:00:53.496261 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Aug 29 16:00:53.497534 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:00:53.497534 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:00:53.497534 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Aug 29 16:00:53.497534 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Aug 29 16:00:53.497534 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Aug 29 16:00:53.497534 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:00:53.505183 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969816d9-e184-4601-aa1e-5446289fbc62 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:53.505745 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969816d9-e184-4601-aa1e-5446289fbc62 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:53.505745 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969816d9-e184-4601-aa1e-5446289fbc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:53.508442 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2677/5351] 10.222.0.83 () {56 vars in 1264 bytes} [Mon Aug 29 16:00:53 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (0 switches on core 0) Aug 29 16:00:53.513492 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:53.531591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-969816d9-e184-4601-aa1e-5446289fbc62 None None] MFA Rules not processed for user `de744ac22a534771989ff80dad08029e`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:53.533013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-969816d9-e184-4601-aa1e-5446289fbc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:53.538171 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2675/5352] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:53 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 16:00:53.542406 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac371fad-8c67-4f89-963b-e4b957e605f7 tempest-TokensV3Test-1719703768 tempest-TokensV3Test-1719703768-project] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:53.553327 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac371fad-8c67-4f89-963b-e4b957e605f7 tempest-TokensV3Test-1719703768 tempest-TokensV3Test-1719703768-project] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:53.558106 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38242c4-441e-4714-9110-d8c43e460d76 tempest-TokensV3Test-1719703768 tempest-TokensV3Test-1719703768-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de744ac22a534771989ff80dad08029e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eaa352a25e444af9a66ee1c75e962cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:53.558794 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38242c4-441e-4714-9110-d8c43e460d76 tempest-TokensV3Test-1719703768 tempest-TokensV3Test-1719703768-project] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:53.559124 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38242c4-441e-4714-9110-d8c43e460d76 tempest-TokensV3Test-1719703768 tempest-TokensV3Test-1719703768-project] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:53.559396 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38242c4-441e-4714-9110-d8c43e460d76 tempest-TokensV3Test-1719703768 tempest-TokensV3Test-1719703768-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:53.567647 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38242c4-441e-4714-9110-d8c43e460d76 tempest-TokensV3Test-1719703768 tempest-TokensV3Test-1719703768-project] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:53.569446 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38242c4-441e-4714-9110-d8c43e460d76 tempest-TokensV3Test-1719703768 tempest-TokensV3Test-1719703768-project] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:53.582096 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969816d9-e184-4601-aa1e-5446289fbc62 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:53.583983 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2678/5353] 10.222.0.83 () {56 vars in 1263 bytes} [Mon Aug 29 16:00:53 2022] GET /identity/v3/auth/tokens => generated 346 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:53.597176 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969816d9-e184-4601-aa1e-5446289fbc62 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:53.602479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8214db10-1b78-4853-8e95-369549d8378e tempest-TokensV3Test-1719703768 tempest-TokensV3Test-1719703768-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de744ac22a534771989ff80dad08029e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eaa352a25e444af9a66ee1c75e962cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:53.603419 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214db10-1b78-4853-8e95-369549d8378e tempest-TokensV3Test-1719703768 tempest-TokensV3Test-1719703768-project] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:53.604041 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214db10-1b78-4853-8e95-369549d8378e tempest-TokensV3Test-1719703768 tempest-TokensV3Test-1719703768-project] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:53.604564 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214db10-1b78-4853-8e95-369549d8378e tempest-TokensV3Test-1719703768 tempest-TokensV3Test-1719703768-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:53.614404 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8214db10-1b78-4853-8e95-369549d8378e tempest-TokensV3Test-1719703768 tempest-TokensV3Test-1719703768-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:53.616748 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8214db10-1b78-4853-8e95-369549d8378e tempest-TokensV3Test-1719703768 tempest-TokensV3Test-1719703768-project] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:53.640959 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2676/5354] 10.222.0.83 () {56 vars in 1266 bytes} [Mon Aug 29 16:00:53 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:00:53.645386 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38242c4-441e-4714-9110-d8c43e460d76 tempest-TokensV3Test-1719703768 tempest-TokensV3Test-1719703768-project] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:53.657273 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38242c4-441e-4714-9110-d8c43e460d76 tempest-TokensV3Test-1719703768 tempest-TokensV3Test-1719703768-project] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:53.669221 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9027e1c-ab27-4b99-8976-271c4067d447 tempest-TokensV3Test-1719703768 tempest-TokensV3Test-1719703768-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de744ac22a534771989ff80dad08029e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eaa352a25e444af9a66ee1c75e962cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:53.669863 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9027e1c-ab27-4b99-8976-271c4067d447 tempest-TokensV3Test-1719703768 tempest-TokensV3Test-1719703768-project] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:53.670144 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9027e1c-ab27-4b99-8976-271c4067d447 tempest-TokensV3Test-1719703768 tempest-TokensV3Test-1719703768-project] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:53.670970 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9027e1c-ab27-4b99-8976-271c4067d447 tempest-TokensV3Test-1719703768 tempest-TokensV3Test-1719703768-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:53.676898 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b9027e1c-ab27-4b99-8976-271c4067d447 tempest-TokensV3Test-1719703768 tempest-TokensV3Test-1719703768-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:53.713992 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-b9027e1c-ab27-4b99-8976-271c4067d447 tempest-TokensV3Test-1719703768 tempest-TokensV3Test-1719703768-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Aug 29 16:00:53.713992 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:00:53.713992 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:00:53.713992 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:00:53.713992 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:00:53.713992 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:00:53.713992 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:00:53.713992 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:00:53.713992 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:00:53.713992 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:00:53.713992 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:00:53.713992 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:00:53.713992 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Aug 29 16:00:53.713992 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Aug 29 16:00:53.713992 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Aug 29 16:00:53.714988 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Aug 29 16:00:53.714988 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Aug 29 16:00:53.714988 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Aug 29 16:00:53.714988 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:00:53.714988 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:00:53.714988 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Aug 29 16:00:53.714988 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Aug 29 16:00:53.714988 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Aug 29 16:00:53.714988 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self.check_revocation(token) Aug 29 16:00:53.714988 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:00:53.714988 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:00:53.714988 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Aug 29 16:00:53.714988 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Aug 29 16:00:53.714988 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:00:53.714988 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:00:53.714988 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Aug 29 16:00:53.714988 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Aug 29 16:00:53.716045 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:00:53.716045 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:00:53.716045 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Aug 29 16:00:53.716045 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Aug 29 16:00:53.716045 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Aug 29 16:00:53.716045 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:00:53.716045 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2679/5355] 10.222.0.83 () {56 vars in 1263 bytes} [Mon Aug 29 16:00:53 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 16:00:53.724234 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8214db10-1b78-4853-8e95-369549d8378e tempest-TokensV3Test-1719703768 tempest-TokensV3Test-1719703768-project] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:53.854452 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8214db10-1b78-4853-8e95-369549d8378e tempest-TokensV3Test-1719703768 tempest-TokensV3Test-1719703768-project] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:53.860279 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba683407-6f0c-4a08-aa97-3d009b17b414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:53.860954 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba683407-6f0c-4a08-aa97-3d009b17b414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:53.861237 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba683407-6f0c-4a08-aa97-3d009b17b414 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:53.861515 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba683407-6f0c-4a08-aa97-3d009b17b414 admin admin] PATH_INFO: `/v3/users/de744ac22a534771989ff80dad08029e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:53.864126 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba683407-6f0c-4a08-aa97-3d009b17b414 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de744ac22a534771989ff80dad08029e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:53.866752 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba683407-6f0c-4a08-aa97-3d009b17b414 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:53.944227 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ba683407-6f0c-4a08-aa97-3d009b17b414 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de744ac22a534771989ff80dad08029e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:53.945144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ba683407-6f0c-4a08-aa97-3d009b17b414 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de744ac22a534771989ff80dad08029e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:53.964239 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ba683407-6f0c-4a08-aa97-3d009b17b414 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de744ac22a534771989ff80dad08029e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:53.975042 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ba683407-6f0c-4a08-aa97-3d009b17b414 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de744ac22a534771989ff80dad08029e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:53.986443 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ba683407-6f0c-4a08-aa97-3d009b17b414 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de744ac22a534771989ff80dad08029e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:53.995458 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2677/5356] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:00:53 2022] DELETE /identity/v3/users/de744ac22a534771989ff80dad08029e => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:54.000019 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e5823-f0e6-4697-9453-56a90cffda41 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:54.000985 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e5823-f0e6-4697-9453-56a90cffda41 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:54.001722 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e5823-f0e6-4697-9453-56a90cffda41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:54.034635 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-f68e5823-f0e6-4697-9453-56a90cffda41 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:54.036155 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f68e5823-f0e6-4697-9453-56a90cffda41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:54.119040 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2680/5357] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:54.128949 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba683407-6f0c-4a08-aa97-3d009b17b414 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:54.131076 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ba683407-6f0c-4a08-aa97-3d009b17b414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:54.228816 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba683407-6f0c-4a08-aa97-3d009b17b414 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:54.233599 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b2dd0f-b4a1-4d37-9c07-7bbc9ae2d359 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:54.234223 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2dd0f-b4a1-4d37-9c07-7bbc9ae2d359 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:54.234504 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2dd0f-b4a1-4d37-9c07-7bbc9ae2d359 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:54.234778 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2dd0f-b4a1-4d37-9c07-7bbc9ae2d359 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:54.250402 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b2dd0f-b4a1-4d37-9c07-7bbc9ae2d359 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:54.253214 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b2dd0f-b4a1-4d37-9c07-7bbc9ae2d359 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:54.261949 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:54.270768 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2678/5358] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:00:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:00:55.438932 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e5823-f0e6-4697-9453-56a90cffda41 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:55.442129 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f68e5823-f0e6-4697-9453-56a90cffda41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:55.470645 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e5823-f0e6-4697-9453-56a90cffda41 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:55.485377 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91ce95d-216d-4cfa-8357-e160447e7de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:55.486568 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ce95d-216d-4cfa-8357-e160447e7de1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:55.487687 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ce95d-216d-4cfa-8357-e160447e7de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:55.488273 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ce95d-216d-4cfa-8357-e160447e7de1 admin admin] PATH_INFO: `/v3/projects/eaa352a25e444af9a66ee1c75e962cd0` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:55.491664 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91ce95d-216d-4cfa-8357-e160447e7de1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaa352a25e444af9a66ee1c75e962cd0)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:55.497602 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91ce95d-216d-4cfa-8357-e160447e7de1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:55.518559 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:55.631846 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a91ce95d-216d-4cfa-8357-e160447e7de1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaa352a25e444af9a66ee1c75e962cd0', 'request_id': 'req-a91ce95d-216d-4cfa-8357-e160447e7de1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:55.648367 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a91ce95d-216d-4cfa-8357-e160447e7de1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaa352a25e444af9a66ee1c75e962cd0', 'request_id': 'req-a91ce95d-216d-4cfa-8357-e160447e7de1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:55.665057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a91ce95d-216d-4cfa-8357-e160447e7de1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaa352a25e444af9a66ee1c75e962cd0', 'request_id': 'req-a91ce95d-216d-4cfa-8357-e160447e7de1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:55.691411 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a91ce95d-216d-4cfa-8357-e160447e7de1 admin admin] The token cache is being invalidate because project eaa352a25e444af9a66ee1c75e962cd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:55.691714 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a91ce95d-216d-4cfa-8357-e160447e7de1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:55.692507 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a91ce95d-216d-4cfa-8357-e160447e7de1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:55.699340 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2681/5359] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:00:55 2022] DELETE /identity/v3/projects/eaa352a25e444af9a66ee1c75e962cd0 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:55.709260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f477f7-6bee-4666-b89b-069d0e5802aa None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:55.709260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f477f7-6bee-4666-b89b-069d0e5802aa None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:55.709771 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f477f7-6bee-4666-b89b-069d0e5802aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:55.771787 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-b5f477f7-6bee-4666-b89b-069d0e5802aa None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:55.771787 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b5f477f7-6bee-4666-b89b-069d0e5802aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:56.038446 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2679/5360] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:56.046285 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41432ec2-dc79-4f51-bd3b-9a3b46fd079c None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:56.046597 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41432ec2-dc79-4f51-bd3b-9a3b46fd079c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:56.046856 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41432ec2-dc79-4f51-bd3b-9a3b46fd079c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:56.140441 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-41432ec2-dc79-4f51-bd3b-9a3b46fd079c None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:56.144619 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-41432ec2-dc79-4f51-bd3b-9a3b46fd079c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:56.181359 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2682/5361] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:56.186257 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f477f7-6bee-4666-b89b-069d0e5802aa None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:56.225870 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f477f7-6bee-4666-b89b-069d0e5802aa None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:56.246497 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a23787-ad08-44c4-b63b-4a0a65366fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:56.249187 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a23787-ad08-44c4-b63b-4a0a65366fcd admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:56.250796 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a23787-ad08-44c4-b63b-4a0a65366fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:56.251344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a23787-ad08-44c4-b63b-4a0a65366fcd admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:56.254588 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a23787-ad08-44c4-b63b-4a0a65366fcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:00:56.256527 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a23787-ad08-44c4-b63b-4a0a65366fcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:56.261213 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a23787-ad08-44c4-b63b-4a0a65366fcd admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:56.351880 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2680/5362] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:00:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:00:56.353249 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41432ec2-dc79-4f51-bd3b-9a3b46fd079c None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:56.416166 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41432ec2-dc79-4f51-bd3b-9a3b46fd079c None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:56.452040 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a93b6-3fc2-4993-b8f6-d4ee2d30445d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:56.459974 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a93b6-3fc2-4993-b8f6-d4ee2d30445d admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:56.460715 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a93b6-3fc2-4993-b8f6-d4ee2d30445d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:56.461734 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a93b6-3fc2-4993-b8f6-d4ee2d30445d admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:56.462604 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3a93b6-3fc2-4993-b8f6-d4ee2d30445d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:56.474855 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3a93b6-3fc2-4993-b8f6-d4ee2d30445d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:56.616789 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2683/5363] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:00:56 2022] POST /identity/v3/projects => generated 369 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:56.617070 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a23787-ad08-44c4-b63b-4a0a65366fcd admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:56.670512 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a23787-ad08-44c4-b63b-4a0a65366fcd admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:56.956801 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86eabb-02f0-41f5-b565-8fb6f23a0ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:56.957942 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86eabb-02f0-41f5-b565-8fb6f23a0ce9 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:56.958363 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86eabb-02f0-41f5-b565-8fb6f23a0ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:56.958721 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86eabb-02f0-41f5-b565-8fb6f23a0ce9 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:56.965079 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c86eabb-02f0-41f5-b565-8fb6f23a0ce9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:56.970405 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c86eabb-02f0-41f5-b565-8fb6f23a0ce9 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:57.037752 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2681/5364] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:00:56 2022] POST /identity/v3/users => generated 285 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:00:57.041598 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a93b6-3fc2-4993-b8f6-d4ee2d30445d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:57.061286 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a93b6-3fc2-4993-b8f6-d4ee2d30445d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:57.088528 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb0b2b-96a6-4e76-86a6-c871531a5a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:57.092096 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb0b2b-96a6-4e76-86a6-c871531a5a2c admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:57.093301 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb0b2b-96a6-4e76-86a6-c871531a5a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:57.093632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb0b2b-96a6-4e76-86a6-c871531a5a2c admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:57.095605 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb0b2b-96a6-4e76-86a6-c871531a5a2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:57.098661 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb0b2b-96a6-4e76-86a6-c871531a5a2c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:57.119620 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2684/5365] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:00:57 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:00:57.124015 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86eabb-02f0-41f5-b565-8fb6f23a0ce9 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:57.139579 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86eabb-02f0-41f5-b565-8fb6f23a0ce9 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:57.152968 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9738d-71ec-4185-b279-180423aebec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:57.153713 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9738d-71ec-4185-b279-180423aebec9 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:57.154091 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9738d-71ec-4185-b279-180423aebec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:57.154432 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9738d-71ec-4185-b279-180423aebec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:57.155226 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c9738d-71ec-4185-b279-180423aebec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:57.157612 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c9738d-71ec-4185-b279-180423aebec9 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:57.180383 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2682/5366] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:00:57 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:00:57.184395 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb0b2b-96a6-4e76-86a6-c871531a5a2c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:57.198362 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb0b2b-96a6-4e76-86a6-c871531a5a2c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:57.233586 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9409f-515c-4e2c-8cb7-c37bdd1977b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:57.239846 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9409f-515c-4e2c-8cb7-c37bdd1977b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:57.240133 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9409f-515c-4e2c-8cb7-c37bdd1977b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:57.240409 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9409f-515c-4e2c-8cb7-c37bdd1977b3 admin admin] PATH_INFO: `/v3/projects/b1c96f29c8064178bf2cefe2131092de/users/c85a3a783937463b96f01d0a1003d3c3/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:57.294887 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd9409f-515c-4e2c-8cb7-c37bdd1977b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1c96f29c8064178bf2cefe2131092de, user_id=c85a3a783937463b96f01d0a1003d3c3, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:57.297690 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd9409f-515c-4e2c-8cb7-c37bdd1977b3 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:57.338598 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2685/5367] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:00:57 2022] PUT /identity/v3/projects/b1c96f29c8064178bf2cefe2131092de/users/c85a3a783937463b96f01d0a1003d3c3/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:00:57.341613 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8c246-0b24-49e7-af8d-6b3e5de3bd08 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:57.341980 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8c246-0b24-49e7-af8d-6b3e5de3bd08 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:57.342333 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8c246-0b24-49e7-af8d-6b3e5de3bd08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:57.386691 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-cdb8c246-0b24-49e7-af8d-6b3e5de3bd08 None None] MFA Rules not processed for user `c85a3a783937463b96f01d0a1003d3c3`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:57.388538 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-cdb8c246-0b24-49e7-af8d-6b3e5de3bd08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:57.486893 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:57.507877 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2683/5368] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:00:57.512711 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9409f-515c-4e2c-8cb7-c37bdd1977b3 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:57.664573 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9409f-515c-4e2c-8cb7-c37bdd1977b3 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:57.680447 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bacfd4d-a0bb-4593-aa68-e3b5134cb909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:57.681589 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacfd4d-a0bb-4593-aa68-e3b5134cb909 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:57.681917 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacfd4d-a0bb-4593-aa68-e3b5134cb909 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:57.682192 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacfd4d-a0bb-4593-aa68-e3b5134cb909 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:57.682842 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bacfd4d-a0bb-4593-aa68-e3b5134cb909 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:57.688070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bacfd4d-a0bb-4593-aa68-e3b5134cb909 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:57.781094 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2686/5369] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:00:57 2022] POST /identity/v3/projects => generated 367 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:57.786166 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8c246-0b24-49e7-af8d-6b3e5de3bd08 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:57.804743 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8c246-0b24-49e7-af8d-6b3e5de3bd08 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:57.916924 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e44f7-5bc2-4595-8cef-e88f23a9869d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:57.917684 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e44f7-5bc2-4595-8cef-e88f23a9869d admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:57.918093 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e44f7-5bc2-4595-8cef-e88f23a9869d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:57.918470 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e44f7-5bc2-4595-8cef-e88f23a9869d admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:57.919268 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4e44f7-5bc2-4595-8cef-e88f23a9869d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:57.921441 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4e44f7-5bc2-4595-8cef-e88f23a9869d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:57.959814 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2684/5370] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:00:57 2022] POST /identity/v3/users => generated 290 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:00:57.961660 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bacfd4d-a0bb-4593-aa68-e3b5134cb909 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:57.979995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bacfd4d-a0bb-4593-aa68-e3b5134cb909 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:58.007445 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd7418-f553-4353-889e-deac8f35bc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:58.008783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd7418-f553-4353-889e-deac8f35bc92 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:58.009177 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd7418-f553-4353-889e-deac8f35bc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:58.009565 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd7418-f553-4353-889e-deac8f35bc92 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:58.010459 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bd7418-f553-4353-889e-deac8f35bc92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:58.012358 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bd7418-f553-4353-889e-deac8f35bc92 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:58.047121 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2687/5371] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:00:57 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:00:58.049988 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e44f7-5bc2-4595-8cef-e88f23a9869d admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:58.075419 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e44f7-5bc2-4595-8cef-e88f23a9869d admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:58.099871 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb730cf7-3444-488d-8126-5e6be3bfc7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:58.100576 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb730cf7-3444-488d-8126-5e6be3bfc7ba admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:58.101036 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb730cf7-3444-488d-8126-5e6be3bfc7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:58.101322 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb730cf7-3444-488d-8126-5e6be3bfc7ba admin admin] PATH_INFO: `/v3/projects/f6ab7c24ba804115af4e568801558c40/users/e5f5cffa50e94b21896061a7bd3ff2f4/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:58.129841 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb730cf7-3444-488d-8126-5e6be3bfc7ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6ab7c24ba804115af4e568801558c40, user_id=e5f5cffa50e94b21896061a7bd3ff2f4, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:58.133048 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb730cf7-3444-488d-8126-5e6be3bfc7ba admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:58.171473 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2685/5372] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:00:58 2022] PUT /identity/v3/projects/f6ab7c24ba804115af4e568801558c40/users/e5f5cffa50e94b21896061a7bd3ff2f4/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:58.176012 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd7418-f553-4353-889e-deac8f35bc92 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:58.187323 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd7418-f553-4353-889e-deac8f35bc92 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:58.196902 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:58.284666 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204de622-37db-4cd5-b088-837da604f128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:58.285351 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204de622-37db-4cd5-b088-837da604f128 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:58.285635 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204de622-37db-4cd5-b088-837da604f128 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:58.285905 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204de622-37db-4cd5-b088-837da604f128 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:58.286559 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204de622-37db-4cd5-b088-837da604f128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:58.288476 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204de622-37db-4cd5-b088-837da604f128 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:58.301376 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2688/5373] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:00:58 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:00:58.305964 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb730cf7-3444-488d-8126-5e6be3bfc7ba admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:58.318446 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb730cf7-3444-488d-8126-5e6be3bfc7ba admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:58.325398 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89d81a-4e39-49cb-b50b-3f7c1fb491ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:58.326657 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89d81a-4e39-49cb-b50b-3f7c1fb491ce admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:58.328739 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89d81a-4e39-49cb-b50b-3f7c1fb491ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:58.329930 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89d81a-4e39-49cb-b50b-3f7c1fb491ce admin admin] PATH_INFO: `/v3/projects/f6ab7c24ba804115af4e568801558c40/users/e5f5cffa50e94b21896061a7bd3ff2f4/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:58.333237 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a89d81a-4e39-49cb-b50b-3f7c1fb491ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6ab7c24ba804115af4e568801558c40, user_id=e5f5cffa50e94b21896061a7bd3ff2f4, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:58.338944 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a89d81a-4e39-49cb-b50b-3f7c1fb491ce admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:58.363635 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2686/5374] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:00:58 2022] PUT /identity/v3/projects/f6ab7c24ba804115af4e568801558c40/users/e5f5cffa50e94b21896061a7bd3ff2f4/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:58.377545 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95bfbe-1e93-4cb7-a371-3d48c33758a8 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:58.377545 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95bfbe-1e93-4cb7-a371-3d48c33758a8 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:58.377545 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95bfbe-1e93-4cb7-a371-3d48c33758a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:58.430122 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-2a95bfbe-1e93-4cb7-a371-3d48c33758a8 None None] MFA Rules not processed for user `e5f5cffa50e94b21896061a7bd3ff2f4`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:58.431503 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2a95bfbe-1e93-4cb7-a371-3d48c33758a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:58.569941 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2689/5375] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:00:58 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:58.611324 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89d81a-4e39-49cb-b50b-3f7c1fb491ce admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:58.613300 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3a89d81a-4e39-49cb-b50b-3f7c1fb491ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:58.715659 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89d81a-4e39-49cb-b50b-3f7c1fb491ce admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:58.721299 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ccb15d-165a-4d1d-8a0b-a3a7ac599ed4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:58.722172 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccb15d-165a-4d1d-8a0b-a3a7ac599ed4 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:58.722644 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccb15d-165a-4d1d-8a0b-a3a7ac599ed4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:58.723117 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccb15d-165a-4d1d-8a0b-a3a7ac599ed4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:58.736970 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ccb15d-165a-4d1d-8a0b-a3a7ac599ed4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:58.748072 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ccb15d-165a-4d1d-8a0b-a3a7ac599ed4 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:58.777811 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2687/5376] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:00:58 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:00:59.284645 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95bfbe-1e93-4cb7-a371-3d48c33758a8 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:59.286163 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2a95bfbe-1e93-4cb7-a371-3d48c33758a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:59.448429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95bfbe-1e93-4cb7-a371-3d48c33758a8 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:59.458447 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d109da9-dbb7-47d6-81e6-405405d1fd75 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:59.459117 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d109da9-dbb7-47d6-81e6-405405d1fd75 service swift] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:59.459603 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d109da9-dbb7-47d6-81e6-405405d1fd75 service swift] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:59.459883 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d109da9-dbb7-47d6-81e6-405405d1fd75 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:59.462219 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5d109da9-dbb7-47d6-81e6-405405d1fd75 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:59.509275 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:59.560984 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d109da9-dbb7-47d6-81e6-405405d1fd75 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:59.564438 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d109da9-dbb7-47d6-81e6-405405d1fd75 service swift] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:59.579933 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2690/5377] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 16:00:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:01:02.804583 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ccb15d-165a-4d1d-8a0b-a3a7ac599ed4 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:02.987682 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:03.016259 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ccb15d-165a-4d1d-8a0b-a3a7ac599ed4 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:03.023925 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf86b2-8a0e-4392-ac59-bc4a619f8737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:03.024594 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf86b2-8a0e-4392-ac59-bc4a619f8737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:03.024878 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf86b2-8a0e-4392-ac59-bc4a619f8737 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:03.025157 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf86b2-8a0e-4392-ac59-bc4a619f8737 admin admin] PATH_INFO: `/v3/users/c85a3a783937463b96f01d0a1003d3c3` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:03.032429 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adf86b2-8a0e-4392-ac59-bc4a619f8737 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c85a3a783937463b96f01d0a1003d3c3)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:03.035898 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adf86b2-8a0e-4392-ac59-bc4a619f8737 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:03.156286 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8adf86b2-8a0e-4392-ac59-bc4a619f8737 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c85a3a783937463b96f01d0a1003d3c3'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:03.163941 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8adf86b2-8a0e-4392-ac59-bc4a619f8737 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c85a3a783937463b96f01d0a1003d3c3'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:03.206773 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8adf86b2-8a0e-4392-ac59-bc4a619f8737 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c85a3a783937463b96f01d0a1003d3c3'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:03.231551 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8adf86b2-8a0e-4392-ac59-bc4a619f8737 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c85a3a783937463b96f01d0a1003d3c3'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:03.249808 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8adf86b2-8a0e-4392-ac59-bc4a619f8737 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c85a3a783937463b96f01d0a1003d3c3'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:03.274028 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2688/5378] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:01:02 2022] DELETE /identity/v3/users/c85a3a783937463b96f01d0a1003d3c3 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:03.278411 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3411d3f-6306-4f78-a10e-421216dd74a5 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:03.292547 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3411d3f-6306-4f78-a10e-421216dd74a5 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:03.293056 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3411d3f-6306-4f78-a10e-421216dd74a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:03.373473 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-d3411d3f-6306-4f78-a10e-421216dd74a5 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:03.374740 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d3411d3f-6306-4f78-a10e-421216dd74a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:03.531660 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2691/5379] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:01:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:01:03.684120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf86b2-8a0e-4392-ac59-bc4a619f8737 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:03.692908 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8adf86b2-8a0e-4392-ac59-bc4a619f8737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:03.810771 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf86b2-8a0e-4392-ac59-bc4a619f8737 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:03.816387 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4914e2ba-c3bf-41a2-8735-ff4dbf936ae7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:03.817116 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914e2ba-c3bf-41a2-8735-ff4dbf936ae7 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:03.817397 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914e2ba-c3bf-41a2-8735-ff4dbf936ae7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:03.817668 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914e2ba-c3bf-41a2-8735-ff4dbf936ae7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:03.830397 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4914e2ba-c3bf-41a2-8735-ff4dbf936ae7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:03.834834 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4914e2ba-c3bf-41a2-8735-ff4dbf936ae7 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:03.862819 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2689/5380] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:01:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:01:06.168297 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3411d3f-6306-4f78-a10e-421216dd74a5 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:06.169843 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d3411d3f-6306-4f78-a10e-421216dd74a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:06.213278 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3411d3f-6306-4f78-a10e-421216dd74a5 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:06.231140 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3fb42-b5cb-4b60-85bc-c7e7a57b52eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:06.237770 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3fb42-b5cb-4b60-85bc-c7e7a57b52eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:06.238527 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3fb42-b5cb-4b60-85bc-c7e7a57b52eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:06.238791 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3fb42-b5cb-4b60-85bc-c7e7a57b52eb admin admin] PATH_INFO: `/v3/projects/b1c96f29c8064178bf2cefe2131092de` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:06.242618 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3fb42-b5cb-4b60-85bc-c7e7a57b52eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1c96f29c8064178bf2cefe2131092de)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:06.250738 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3fb42-b5cb-4b60-85bc-c7e7a57b52eb admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:06.370774 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-29f3fb42-b5cb-4b60-85bc-c7e7a57b52eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1c96f29c8064178bf2cefe2131092de', 'request_id': 'req-29f3fb42-b5cb-4b60-85bc-c7e7a57b52eb'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:06.401982 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-29f3fb42-b5cb-4b60-85bc-c7e7a57b52eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1c96f29c8064178bf2cefe2131092de', 'request_id': 'req-29f3fb42-b5cb-4b60-85bc-c7e7a57b52eb'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:06.428864 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-29f3fb42-b5cb-4b60-85bc-c7e7a57b52eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1c96f29c8064178bf2cefe2131092de', 'request_id': 'req-29f3fb42-b5cb-4b60-85bc-c7e7a57b52eb'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:06.454746 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-29f3fb42-b5cb-4b60-85bc-c7e7a57b52eb admin admin] The token cache is being invalidate because project b1c96f29c8064178bf2cefe2131092de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:01:06.455613 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-29f3fb42-b5cb-4b60-85bc-c7e7a57b52eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:06.456897 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-29f3fb42-b5cb-4b60-85bc-c7e7a57b52eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:06.458898 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2692/5381] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:01:06 2022] DELETE /identity/v3/projects/b1c96f29c8064178bf2cefe2131092de => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:06.463108 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4914e2ba-c3bf-41a2-8735-ff4dbf936ae7 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:06.478376 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4914e2ba-c3bf-41a2-8735-ff4dbf936ae7 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:06.564283 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03182a76-bf09-41fd-88ce-04005adac875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:06.566282 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03182a76-bf09-41fd-88ce-04005adac875 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:06.566870 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03182a76-bf09-41fd-88ce-04005adac875 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:06.567357 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03182a76-bf09-41fd-88ce-04005adac875 admin admin] PATH_INFO: `/v3/users/e5f5cffa50e94b21896061a7bd3ff2f4` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:06.569725 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03182a76-bf09-41fd-88ce-04005adac875 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5f5cffa50e94b21896061a7bd3ff2f4)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:06.571888 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03182a76-bf09-41fd-88ce-04005adac875 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:06.606148 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:06.684132 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-03182a76-bf09-41fd-88ce-04005adac875 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5f5cffa50e94b21896061a7bd3ff2f4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:06.685609 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-03182a76-bf09-41fd-88ce-04005adac875 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5f5cffa50e94b21896061a7bd3ff2f4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:06.724794 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-03182a76-bf09-41fd-88ce-04005adac875 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5f5cffa50e94b21896061a7bd3ff2f4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:06.750673 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-03182a76-bf09-41fd-88ce-04005adac875 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5f5cffa50e94b21896061a7bd3ff2f4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:06.761193 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-03182a76-bf09-41fd-88ce-04005adac875 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5f5cffa50e94b21896061a7bd3ff2f4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:06.772208 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2690/5382] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:01:06 2022] DELETE /identity/v3/users/e5f5cffa50e94b21896061a7bd3ff2f4 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:07.677615 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3fb42-b5cb-4b60-85bc-c7e7a57b52eb admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:07.683127 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-29f3fb42-b5cb-4b60-85bc-c7e7a57b52eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:07.704145 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3fb42-b5cb-4b60-85bc-c7e7a57b52eb admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:07.769521 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:07.803816 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc60f07-a516-4078-be66-6303f982cd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:07.804496 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc60f07-a516-4078-be66-6303f982cd46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:07.804769 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc60f07-a516-4078-be66-6303f982cd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:07.805042 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc60f07-a516-4078-be66-6303f982cd46 admin admin] PATH_INFO: `/v3/users/e460fd09b56f4c47a46062a41fc89bbf` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:07.807716 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc60f07-a516-4078-be66-6303f982cd46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e460fd09b56f4c47a46062a41fc89bbf)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:07.810009 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc60f07-a516-4078-be66-6303f982cd46 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:07.966415 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3cc60f07-a516-4078-be66-6303f982cd46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e460fd09b56f4c47a46062a41fc89bbf'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:07.968652 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3cc60f07-a516-4078-be66-6303f982cd46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e460fd09b56f4c47a46062a41fc89bbf'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:07.983126 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3cc60f07-a516-4078-be66-6303f982cd46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e460fd09b56f4c47a46062a41fc89bbf'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:07.995526 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3cc60f07-a516-4078-be66-6303f982cd46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e460fd09b56f4c47a46062a41fc89bbf'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:07.996435 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3cc60f07-a516-4078-be66-6303f982cd46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e460fd09b56f4c47a46062a41fc89bbf'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:08.024198 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2693/5383] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:01:07 2022] DELETE /identity/v3/users/e460fd09b56f4c47a46062a41fc89bbf => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:08.508528 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03182a76-bf09-41fd-88ce-04005adac875 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:08.516956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-03182a76-bf09-41fd-88ce-04005adac875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:08.544536 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03182a76-bf09-41fd-88ce-04005adac875 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:08.687518 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a0f6b-8552-4c00-8fd3-2dabff7e3f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:08.688493 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a0f6b-8552-4c00-8fd3-2dabff7e3f8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:08.688950 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a0f6b-8552-4c00-8fd3-2dabff7e3f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:08.689397 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a0f6b-8552-4c00-8fd3-2dabff7e3f8c admin admin] PATH_INFO: `/v3/projects/f6ab7c24ba804115af4e568801558c40` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:08.691790 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264a0f6b-8552-4c00-8fd3-2dabff7e3f8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6ab7c24ba804115af4e568801558c40)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:08.694293 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264a0f6b-8552-4c00-8fd3-2dabff7e3f8c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:08.832187 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-264a0f6b-8552-4c00-8fd3-2dabff7e3f8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6ab7c24ba804115af4e568801558c40', 'request_id': 'req-264a0f6b-8552-4c00-8fd3-2dabff7e3f8c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:08.855252 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-264a0f6b-8552-4c00-8fd3-2dabff7e3f8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6ab7c24ba804115af4e568801558c40', 'request_id': 'req-264a0f6b-8552-4c00-8fd3-2dabff7e3f8c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:08.884515 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-264a0f6b-8552-4c00-8fd3-2dabff7e3f8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6ab7c24ba804115af4e568801558c40', 'request_id': 'req-264a0f6b-8552-4c00-8fd3-2dabff7e3f8c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:08.901752 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-264a0f6b-8552-4c00-8fd3-2dabff7e3f8c admin admin] The token cache is being invalidate because project f6ab7c24ba804115af4e568801558c40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:01:08.902344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-264a0f6b-8552-4c00-8fd3-2dabff7e3f8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:08.903095 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-264a0f6b-8552-4c00-8fd3-2dabff7e3f8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:08.908633 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2691/5384] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:01:08 2022] DELETE /identity/v3/projects/f6ab7c24ba804115af4e568801558c40 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:08.910733 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a6c03-230e-4967-ad36-b536cd970cd8 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:08.911264 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a6c03-230e-4967-ad36-b536cd970cd8 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:08.911389 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a6c03-230e-4967-ad36-b536cd970cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:08.939125 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a0f6b-8552-4c00-8fd3-2dabff7e3f8c admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:08.942115 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-264a0f6b-8552-4c00-8fd3-2dabff7e3f8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:08.956406 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-9d4a6c03-230e-4967-ad36-b536cd970cd8 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:08.957648 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9d4a6c03-230e-4967-ad36-b536cd970cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:09.022544 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:09.083308 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2694/5385] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:01:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:09.092600 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab01f50-2254-4906-a6f9-a5a0e7a8217c None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:09.093221 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab01f50-2254-4906-a6f9-a5a0e7a8217c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:09.093820 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab01f50-2254-4906-a6f9-a5a0e7a8217c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:09.186354 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-8ab01f50-2254-4906-a6f9-a5a0e7a8217c None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:09.190298 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8ab01f50-2254-4906-a6f9-a5a0e7a8217c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:09.215409 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2695/5386] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:01:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:09.218167 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab01f50-2254-4906-a6f9-a5a0e7a8217c None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:09.220557 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a0f6b-8552-4c00-8fd3-2dabff7e3f8c admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:09.226634 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133f879-a8b7-4712-b858-bf7b5579eaf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:09.227848 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133f879-a8b7-4712-b858-bf7b5579eaf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:09.228261 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133f879-a8b7-4712-b858-bf7b5579eaf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:09.228753 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133f879-a8b7-4712-b858-bf7b5579eaf5 admin admin] PATH_INFO: `/v3/projects/5b02f0c534c9462c9de0e6fab11cea27` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:09.229417 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab01f50-2254-4906-a6f9-a5a0e7a8217c None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:09.230529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b133f879-a8b7-4712-b858-bf7b5579eaf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b02f0c534c9462c9de0e6fab11cea27)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:09.232739 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b133f879-a8b7-4712-b858-bf7b5579eaf5 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:09.234635 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b37c9ff-267c-4917-ad12-d2dd12b43cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:09.235298 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37c9ff-267c-4917-ad12-d2dd12b43cdf admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:09.235582 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37c9ff-267c-4917-ad12-d2dd12b43cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:09.235983 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37c9ff-267c-4917-ad12-d2dd12b43cdf admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:09.236502 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b37c9ff-267c-4917-ad12-d2dd12b43cdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:01:09.236837 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b37c9ff-267c-4917-ad12-d2dd12b43cdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:09.238893 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b37c9ff-267c-4917-ad12-d2dd12b43cdf admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:09.254310 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2696/5387] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:01:09.258570 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b37c9ff-267c-4917-ad12-d2dd12b43cdf admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:09.271614 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b37c9ff-267c-4917-ad12-d2dd12b43cdf admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:09.276995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9416e90-8614-4553-b209-331114ec9031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:09.278222 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9416e90-8614-4553-b209-331114ec9031 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:09.278564 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9416e90-8614-4553-b209-331114ec9031 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:09.278844 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9416e90-8614-4553-b209-331114ec9031 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:09.279519 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9416e90-8614-4553-b209-331114ec9031 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:09.282530 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9416e90-8614-4553-b209-331114ec9031 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:09.342301 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2697/5388] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:01:09 2022] POST /identity/v3/projects => generated 399 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:01:09.345625 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a604e-97d6-4bd3-aa7f-ccd285dbecca None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:09.345922 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a604e-97d6-4bd3-aa7f-ccd285dbecca None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:09.346905 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a604e-97d6-4bd3-aa7f-ccd285dbecca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:09.363795 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b133f879-a8b7-4712-b858-bf7b5579eaf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b02f0c534c9462c9de0e6fab11cea27', 'request_id': 'req-b133f879-a8b7-4712-b858-bf7b5579eaf5'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:09.376585 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b133f879-a8b7-4712-b858-bf7b5579eaf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b02f0c534c9462c9de0e6fab11cea27', 'request_id': 'req-b133f879-a8b7-4712-b858-bf7b5579eaf5'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:09.396065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b133f879-a8b7-4712-b858-bf7b5579eaf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b02f0c534c9462c9de0e6fab11cea27', 'request_id': 'req-b133f879-a8b7-4712-b858-bf7b5579eaf5'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:09.417449 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b133f879-a8b7-4712-b858-bf7b5579eaf5 admin admin] The token cache is being invalidate because project 5b02f0c534c9462c9de0e6fab11cea27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:01:09.417916 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b133f879-a8b7-4712-b858-bf7b5579eaf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:09.422178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b133f879-a8b7-4712-b858-bf7b5579eaf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:09.424870 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2692/5389] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:01:08 2022] DELETE /identity/v3/projects/5b02f0c534c9462c9de0e6fab11cea27 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:09.425793 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133f879-a8b7-4712-b858-bf7b5579eaf5 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:09.426283 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-da3a604e-97d6-4bd3-aa7f-ccd285dbecca None None] MFA Rules not processed for user `9ee1a19085a04426be20de4023ef1a9b`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:09.427932 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-da3a604e-97d6-4bd3-aa7f-ccd285dbecca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:09.432301 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b133f879-a8b7-4712-b858-bf7b5579eaf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:09.538132 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:09.607334 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133f879-a8b7-4712-b858-bf7b5579eaf5 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:09.684338 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2698/5390] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:01:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:09.695567 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70db7a-509d-42f3-be21-5a5c2246961f None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:09.695855 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70db7a-509d-42f3-be21-5a5c2246961f None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:09.696185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70db7a-509d-42f3-be21-5a5c2246961f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:09.738250 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fba399-c67e-45d5-8613-8c0e75f6673a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:09.749302 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fba399-c67e-45d5-8613-8c0e75f6673a admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:09.750510 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fba399-c67e-45d5-8613-8c0e75f6673a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:09.750958 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fba399-c67e-45d5-8613-8c0e75f6673a admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:09.752140 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-9e70db7a-509d-42f3-be21-5a5c2246961f None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:09.753820 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fba399-c67e-45d5-8613-8c0e75f6673a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:09.755392 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9e70db7a-509d-42f3-be21-5a5c2246961f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:09.759986 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fba399-c67e-45d5-8613-8c0e75f6673a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:09.773232 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:09.777084 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2699/5391] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:01:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:09.778692 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94884b49-44cd-4279-9481-94796b00b43f None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:09.779106 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94884b49-44cd-4279-9481-94796b00b43f None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:09.779506 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94884b49-44cd-4279-9481-94796b00b43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:09.808515 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2693/5392] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:01:09 2022] POST /identity/v3/users => generated 300 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:01:09.814534 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e3b23-f7c7-48c1-91d6-d628c8e714f5 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:09.816003 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e3b23-f7c7-48c1-91d6-d628c8e714f5 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:09.818660 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e3b23-f7c7-48c1-91d6-d628c8e714f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:09.839741 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-94884b49-44cd-4279-9481-94796b00b43f None None] MFA Rules not processed for user `9ee1a19085a04426be20de4023ef1a9b`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:09.841150 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-94884b49-44cd-4279-9481-94796b00b43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:09.865827 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-0d4e3b23-f7c7-48c1-91d6-d628c8e714f5 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:09.871046 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2700/5393] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:01:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:09.872796 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0d4e3b23-f7c7-48c1-91d6-d628c8e714f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:09.874068 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94884b49-44cd-4279-9481-94796b00b43f None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:09.920442 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2694/5394] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:01:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:09.921486 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e3b23-f7c7-48c1-91d6-d628c8e714f5 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:09.929571 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0d4e3b23-f7c7-48c1-91d6-d628c8e714f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:09.931086 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94884b49-44cd-4279-9481-94796b00b43f None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:09.942461 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a0879-4113-4810-9f4a-12d0842fd323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:09.944472 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a0879-4113-4810-9f4a-12d0842fd323 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:09.944857 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a0879-4113-4810-9f4a-12d0842fd323 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:09.945229 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a0879-4113-4810-9f4a-12d0842fd323 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:09.948616 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0a0879-4113-4810-9f4a-12d0842fd323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:09.950309 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0a0879-4113-4810-9f4a-12d0842fd323 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:09.972021 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2701/5395] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:01:09.978833 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a0879-4113-4810-9f4a-12d0842fd323 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:10.021345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a0879-4113-4810-9f4a-12d0842fd323 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:10.053588 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53173b59-d270-45a7-876e-499a51403557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:10.054364 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53173b59-d270-45a7-876e-499a51403557 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:10.054746 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53173b59-d270-45a7-876e-499a51403557 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:10.055170 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53173b59-d270-45a7-876e-499a51403557 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:10.055972 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53173b59-d270-45a7-876e-499a51403557 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:01:10.056375 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53173b59-d270-45a7-876e-499a51403557 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:10.058181 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53173b59-d270-45a7-876e-499a51403557 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:10.106476 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2702/5396] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:01:10.107765 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53173b59-d270-45a7-876e-499a51403557 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:10.136511 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53173b59-d270-45a7-876e-499a51403557 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:10.160479 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c5ed4-3109-4111-84bb-ec0d0e1f727e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:10.161539 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c5ed4-3109-4111-84bb-ec0d0e1f727e admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:10.162326 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c5ed4-3109-4111-84bb-ec0d0e1f727e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:10.162814 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c5ed4-3109-4111-84bb-ec0d0e1f727e admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:10.163869 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c5ed4-3109-4111-84bb-ec0d0e1f727e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:10.165908 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c5ed4-3109-4111-84bb-ec0d0e1f727e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:10.183678 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2703/5397] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:01:10.185543 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c5ed4-3109-4111-84bb-ec0d0e1f727e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:10.204363 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c5ed4-3109-4111-84bb-ec0d0e1f727e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:10.213098 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600a07d4-8e06-480c-a7f1-991ff6bf5850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:10.214828 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e3b23-f7c7-48c1-91d6-d628c8e714f5 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:10.215734 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a07d4-8e06-480c-a7f1-991ff6bf5850 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:10.216256 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a07d4-8e06-480c-a7f1-991ff6bf5850 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:10.216748 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a07d4-8e06-480c-a7f1-991ff6bf5850 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:10.217604 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600a07d4-8e06-480c-a7f1-991ff6bf5850 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:10.220025 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600a07d4-8e06-480c-a7f1-991ff6bf5850 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:10.227516 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3eec5-80ab-4fd1-b4cb-61b7deada84a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:10.228203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3eec5-80ab-4fd1-b4cb-61b7deada84a service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:10.228490 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3eec5-80ab-4fd1-b4cb-61b7deada84a service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:10.230455 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3eec5-80ab-4fd1-b4cb-61b7deada84a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:10.257193 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3eec5-80ab-4fd1-b4cb-61b7deada84a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:10.260708 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3eec5-80ab-4fd1-b4cb-61b7deada84a service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:10.291771 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2695/5398] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:01:09 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:01:10.292707 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3eec5-80ab-4fd1-b4cb-61b7deada84a service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:10.306647 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2704/5399] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:01:10 2022] POST /identity/v3/projects => generated 391 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:01:10.310735 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600a07d4-8e06-480c-a7f1-991ff6bf5850 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:10.324880 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3eec5-80ab-4fd1-b4cb-61b7deada84a service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:10.471793 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600a07d4-8e06-480c-a7f1-991ff6bf5850 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:10.478487 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724603d-a257-45af-8965-a803daa1dd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:10.479439 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724603d-a257-45af-8965-a803daa1dd98 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:10.479883 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724603d-a257-45af-8965-a803daa1dd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:10.480516 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724603d-a257-45af-8965-a803daa1dd98 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:10.481401 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2724603d-a257-45af-8965-a803daa1dd98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:10.483976 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2724603d-a257-45af-8965-a803daa1dd98 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:10.517998 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21684508-1906-4dd6-acb0-a3e8a8b8b306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:10.519771 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21684508-1906-4dd6-acb0-a3e8a8b8b306 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:10.519771 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21684508-1906-4dd6-acb0-a3e8a8b8b306 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:10.522191 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2705/5400] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:01:10 2022] POST /identity/v3/users => generated 296 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:01:10.527335 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724603d-a257-45af-8965-a803daa1dd98 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:10.529047 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21684508-1906-4dd6-acb0-a3e8a8b8b306 admin admin] PATH_INFO: `/v3/projects/af6a0bfb90644b128e315e232d2160aa/users/5607e123ec6a407f97498ee37dc0c309/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:10.567460 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21684508-1906-4dd6-acb0-a3e8a8b8b306 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af6a0bfb90644b128e315e232d2160aa, user_id=5607e123ec6a407f97498ee37dc0c309, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:10.573005 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724603d-a257-45af-8965-a803daa1dd98 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:10.573149 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21684508-1906-4dd6-acb0-a3e8a8b8b306 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:10.594670 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f0535-9e58-49b0-a666-1da36e4d8616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:10.597461 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f0535-9e58-49b0-a666-1da36e4d8616 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:10.601024 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f0535-9e58-49b0-a666-1da36e4d8616 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:10.601489 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f0535-9e58-49b0-a666-1da36e4d8616 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:10.603981 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f0535-9e58-49b0-a666-1da36e4d8616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:10.609070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f0535-9e58-49b0-a666-1da36e4d8616 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:10.609595 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2696/5401] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:01:10 2022] PUT /identity/v3/projects/af6a0bfb90644b128e315e232d2160aa/users/5607e123ec6a407f97498ee37dc0c309/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:10.620429 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc721b0-c359-4db0-9853-9c6d1f3466f4 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:10.620580 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc721b0-c359-4db0-9853-9c6d1f3466f4 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:10.620840 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc721b0-c359-4db0-9853-9c6d1f3466f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:10.641382 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2706/5402] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:01:10.664116 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f0535-9e58-49b0-a666-1da36e4d8616 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:10.749749 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f0535-9e58-49b0-a666-1da36e4d8616 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:10.754066 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-afc721b0-c359-4db0-9853-9c6d1f3466f4 None None] MFA Rules not processed for user `5607e123ec6a407f97498ee37dc0c309`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:10.755430 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-afc721b0-c359-4db0-9853-9c6d1f3466f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:10.824627 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:10.862818 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2697/5403] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:01:10 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:01:10.870957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc721b0-c359-4db0-9853-9c6d1f3466f4 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:10.871585 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:10.998380 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc721b0-c359-4db0-9853-9c6d1f3466f4 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:11.006356 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a487ca2-f57a-4dc8-ad7c-73aa3d8bb63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:11.006997 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a487ca2-f57a-4dc8-ad7c-73aa3d8bb63c admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:11.008897 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a487ca2-f57a-4dc8-ad7c-73aa3d8bb63c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:11.009177 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a487ca2-f57a-4dc8-ad7c-73aa3d8bb63c admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:11.016719 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23908775-cc14-4f1e-a2b5-2344b9615346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:11.017638 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23908775-cc14-4f1e-a2b5-2344b9615346 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:11.018839 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23908775-cc14-4f1e-a2b5-2344b9615346 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:11.019242 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23908775-cc14-4f1e-a2b5-2344b9615346 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:11.026798 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a487ca2-f57a-4dc8-ad7c-73aa3d8bb63c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:11.029348 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a487ca2-f57a-4dc8-ad7c-73aa3d8bb63c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:11.033601 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23908775-cc14-4f1e-a2b5-2344b9615346 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:11.041189 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23908775-cc14-4f1e-a2b5-2344b9615346 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:11.064313 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2707/5404] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:01:11.077015 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a487ca2-f57a-4dc8-ad7c-73aa3d8bb63c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:11.100280 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a487ca2-f57a-4dc8-ad7c-73aa3d8bb63c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:11.130169 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e2687-a67f-44cd-8b18-de7efbf7c9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:11.131128 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e2687-a67f-44cd-8b18-de7efbf7c9e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:11.131391 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e2687-a67f-44cd-8b18-de7efbf7c9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:11.131730 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e2687-a67f-44cd-8b18-de7efbf7c9e0 admin admin] PATH_INFO: `/v3/projects/eb9fe4b710cb46779f13a142f1301567/users/dcd426ac002048bf9db072739a81c2e4/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:11.138013 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2698/5405] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:01:10 2022] POST /identity/v3/projects => generated 399 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:01:11.138950 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23908775-cc14-4f1e-a2b5-2344b9615346 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:11.160922 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69e2687-a67f-44cd-8b18-de7efbf7c9e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb9fe4b710cb46779f13a142f1301567, user_id=dcd426ac002048bf9db072739a81c2e4, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:11.164808 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69e2687-a67f-44cd-8b18-de7efbf7c9e0 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:11.206060 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2708/5406] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:01:11 2022] PUT /identity/v3/projects/eb9fe4b710cb46779f13a142f1301567/users/dcd426ac002048bf9db072739a81c2e4/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:11.209662 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cef6eb-1306-4927-9eb7-032887e990ee None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:11.210251 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cef6eb-1306-4927-9eb7-032887e990ee None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:11.210694 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cef6eb-1306-4927-9eb7-032887e990ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:11.246143 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-16cef6eb-1306-4927-9eb7-032887e990ee None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:11.247900 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-16cef6eb-1306-4927-9eb7-032887e990ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:11.322208 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23908775-cc14-4f1e-a2b5-2344b9615346 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:11.333634 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2709/5407] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:01:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:11.341104 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c4cba-d087-4a6f-9474-00c8b4155aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:11.341752 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c4cba-d087-4a6f-9474-00c8b4155aa6 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:11.342040 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c4cba-d087-4a6f-9474-00c8b4155aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:11.342297 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c4cba-d087-4a6f-9474-00c8b4155aa6 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:11.343518 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c4cba-d087-4a6f-9474-00c8b4155aa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:11.346122 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cef6eb-1306-4927-9eb7-032887e990ee None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:11.349765 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-16cef6eb-1306-4927-9eb7-032887e990ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:11.351469 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c4cba-d087-4a6f-9474-00c8b4155aa6 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:11.412951 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2699/5408] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:01:11 2022] POST /identity/v3/users => generated 306 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:01:11.416672 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c4cba-d087-4a6f-9474-00c8b4155aa6 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:11.422963 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b46c4cba-d087-4a6f-9474-00c8b4155aa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:11.450756 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cef6eb-1306-4927-9eb7-032887e990ee None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:11.470216 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4155732-78fd-47e8-9df8-23baf4ce88cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:11.472332 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4155732-78fd-47e8-9df8-23baf4ce88cc service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:11.473271 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4155732-78fd-47e8-9df8-23baf4ce88cc service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:11.473953 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4155732-78fd-47e8-9df8-23baf4ce88cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:11.505144 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4155732-78fd-47e8-9df8-23baf4ce88cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:11.510523 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4155732-78fd-47e8-9df8-23baf4ce88cc service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:11.550879 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2710/5409] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:01:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:01:11.553188 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4155732-78fd-47e8-9df8-23baf4ce88cc service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:11.555541 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c4cba-d087-4a6f-9474-00c8b4155aa6 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:11.565669 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e318959-eb50-40d1-9e4d-9ccc43f27ca8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:11.566307 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e318959-eb50-40d1-9e4d-9ccc43f27ca8 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:11.566582 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e318959-eb50-40d1-9e4d-9ccc43f27ca8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:11.566854 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e318959-eb50-40d1-9e4d-9ccc43f27ca8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:11.572883 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7e318959-eb50-40d1-9e4d-9ccc43f27ca8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:11.593718 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e318959-eb50-40d1-9e4d-9ccc43f27ca8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:11.595282 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e318959-eb50-40d1-9e4d-9ccc43f27ca8 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:11.595880 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4155732-78fd-47e8-9df8-23baf4ce88cc service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:11.605912 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:11.620456 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2700/5410] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:01:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:01:11.625058 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44dffaf-d31b-40b0-9e0c-91b476b8afab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:11.626988 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44dffaf-d31b-40b0-9e0c-91b476b8afab admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:11.629011 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44dffaf-d31b-40b0-9e0c-91b476b8afab admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:11.630107 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44dffaf-d31b-40b0-9e0c-91b476b8afab admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:11.631293 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44dffaf-d31b-40b0-9e0c-91b476b8afab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:11.644169 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44dffaf-d31b-40b0-9e0c-91b476b8afab admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:11.694333 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2711/5411] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:01:11.698657 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e318959-eb50-40d1-9e4d-9ccc43f27ca8 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:11.718995 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e318959-eb50-40d1-9e4d-9ccc43f27ca8 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:11.735711 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72726f99-dcb2-4967-bcd5-9f697af76ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:11.736089 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44dffaf-d31b-40b0-9e0c-91b476b8afab admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:11.736527 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72726f99-dcb2-4967-bcd5-9f697af76ae4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:11.737608 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72726f99-dcb2-4967-bcd5-9f697af76ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:11.737895 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72726f99-dcb2-4967-bcd5-9f697af76ae4 admin admin] PATH_INFO: `/v3/projects/4a6f0a916be648be98980a5e1eceabda/users/434f81d897704db5a25126395f420ae3/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:11.739284 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c44dffaf-d31b-40b0-9e0c-91b476b8afab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:11.763211 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44dffaf-d31b-40b0-9e0c-91b476b8afab admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:11.774619 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72726f99-dcb2-4967-bcd5-9f697af76ae4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a6f0a916be648be98980a5e1eceabda, user_id=434f81d897704db5a25126395f420ae3, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:11.776348 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e53411-6932-4f2a-bb8e-0aa9c241ac6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:11.777208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e53411-6932-4f2a-bb8e-0aa9c241ac6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:11.777336 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72726f99-dcb2-4967-bcd5-9f697af76ae4 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:11.777760 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e53411-6932-4f2a-bb8e-0aa9c241ac6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:11.778195 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e53411-6932-4f2a-bb8e-0aa9c241ac6e admin admin] PATH_INFO: `/v3/users/dc6ef913ffed44cd9bef664437b0c4ab` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:11.779606 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e53411-6932-4f2a-bb8e-0aa9c241ac6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc6ef913ffed44cd9bef664437b0c4ab)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:11.781741 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e53411-6932-4f2a-bb8e-0aa9c241ac6e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:11.828615 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2701/5412] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:01:11 2022] PUT /identity/v3/projects/4a6f0a916be648be98980a5e1eceabda/users/434f81d897704db5a25126395f420ae3/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:11.830203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72726f99-dcb2-4967-bcd5-9f697af76ae4 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:11.880187 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:11.920801 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-28e53411-6932-4f2a-bb8e-0aa9c241ac6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc6ef913ffed44cd9bef664437b0c4ab'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:11.921530 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-28e53411-6932-4f2a-bb8e-0aa9c241ac6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc6ef913ffed44cd9bef664437b0c4ab'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:11.959763 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-28e53411-6932-4f2a-bb8e-0aa9c241ac6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc6ef913ffed44cd9bef664437b0c4ab'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:11.972507 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-28e53411-6932-4f2a-bb8e-0aa9c241ac6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc6ef913ffed44cd9bef664437b0c4ab'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:11.973674 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-28e53411-6932-4f2a-bb8e-0aa9c241ac6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc6ef913ffed44cd9bef664437b0c4ab'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:12.028677 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2712/5413] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:01:11 2022] DELETE /identity/v3/users/dc6ef913ffed44cd9bef664437b0c4ab => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:01:12.034710 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d5554-50a5-4fe2-9b77-deb2b4c05c84 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:12.035176 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d5554-50a5-4fe2-9b77-deb2b4c05c84 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:12.035469 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d5554-50a5-4fe2-9b77-deb2b4c05c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:12.084107 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-ad6d5554-50a5-4fe2-9b77-deb2b4c05c84 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:12.085329 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ad6d5554-50a5-4fe2-9b77-deb2b4c05c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:12.159392 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72726f99-dcb2-4967-bcd5-9f697af76ae4 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:12.244246 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2713/5414] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:01:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:01:12.294761 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d5554-50a5-4fe2-9b77-deb2b4c05c84 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:12.296317 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ad6d5554-50a5-4fe2-9b77-deb2b4c05c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:12.397900 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353b1da-b3c8-4c86-854d-17a6c8eb0296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:12.399158 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353b1da-b3c8-4c86-854d-17a6c8eb0296 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:12.399634 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353b1da-b3c8-4c86-854d-17a6c8eb0296 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:12.400590 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353b1da-b3c8-4c86-854d-17a6c8eb0296 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:12.401254 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4353b1da-b3c8-4c86-854d-17a6c8eb0296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:12.404344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4353b1da-b3c8-4c86-854d-17a6c8eb0296 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:12.467454 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2702/5415] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 638 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:01:12.469337 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353b1da-b3c8-4c86-854d-17a6c8eb0296 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:12.472190 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d5554-50a5-4fe2-9b77-deb2b4c05c84 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:12.477011 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4353b1da-b3c8-4c86-854d-17a6c8eb0296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:12.485253 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f2c3e-a645-4b8f-b541-b82ac52d2359 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:12.485901 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f2c3e-a645-4b8f-b541-b82ac52d2359 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:12.486185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f2c3e-a645-4b8f-b541-b82ac52d2359 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:12.486459 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f2c3e-a645-4b8f-b541-b82ac52d2359 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:12.514703 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353b1da-b3c8-4c86-854d-17a6c8eb0296 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:12.527637 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f2c3e-a645-4b8f-b541-b82ac52d2359 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:12.532079 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f2c3e-a645-4b8f-b541-b82ac52d2359 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:12.537443 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2960e52-aeb2-44f2-a7f9-83d08881802f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:12.538010 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2960e52-aeb2-44f2-a7f9-83d08881802f admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:12.538286 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2960e52-aeb2-44f2-a7f9-83d08881802f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:12.543476 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2960e52-aeb2-44f2-a7f9-83d08881802f admin admin] PATH_INFO: `/v3/projects/4a6f0a916be648be98980a5e1eceabda/users/434f81d897704db5a25126395f420ae3/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:12.548867 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2960e52-aeb2-44f2-a7f9-83d08881802f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a6f0a916be648be98980a5e1eceabda, user_id=434f81d897704db5a25126395f420ae3, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:12.561190 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2960e52-aeb2-44f2-a7f9-83d08881802f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:12.564000 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2714/5416] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:01:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:01:12.600957 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2703/5417] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:01:12 2022] PUT /identity/v3/projects/4a6f0a916be648be98980a5e1eceabda/users/434f81d897704db5a25126395f420ae3/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:12.603395 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc3f49-77ee-4fd5-b257-c079ba93dde7 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:12.603763 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc3f49-77ee-4fd5-b257-c079ba93dde7 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:12.604105 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc3f49-77ee-4fd5-b257-c079ba93dde7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:12.671568 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-4ecc3f49-77ee-4fd5-b257-c079ba93dde7 None None] MFA Rules not processed for user `434f81d897704db5a25126395f420ae3`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:12.673682 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4ecc3f49-77ee-4fd5-b257-c079ba93dde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:12.845438 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:13.026859 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2715/5418] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:01:12 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:13.044802 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2960e52-aeb2-44f2-a7f9-83d08881802f admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:13.046791 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e2960e52-aeb2-44f2-a7f9-83d08881802f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:13.253865 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2960e52-aeb2-44f2-a7f9-83d08881802f admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:13.258108 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b50d3-a7a5-43a9-ac07-361b3b8d020c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:13.258851 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b50d3-a7a5-43a9-ac07-361b3b8d020c service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:13.259273 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b50d3-a7a5-43a9-ac07-361b3b8d020c service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:13.259940 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b50d3-a7a5-43a9-ac07-361b3b8d020c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:13.261500 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4b3b50d3-a7a5-43a9-ac07-361b3b8d020c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:13.301074 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:13.403670 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b50d3-a7a5-43a9-ac07-361b3b8d020c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:13.405502 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b50d3-a7a5-43a9-ac07-361b3b8d020c service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:13.427701 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2704/5419] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:01:13 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:01:13.643532 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc3f49-77ee-4fd5-b257-c079ba93dde7 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:13.646769 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4ecc3f49-77ee-4fd5-b257-c079ba93dde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:13.953924 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc3f49-77ee-4fd5-b257-c079ba93dde7 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:13.973472 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d0adf-b8a2-4f7a-9d98-bb2f2a77e506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:13.974317 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d0adf-b8a2-4f7a-9d98-bb2f2a77e506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:13.974598 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d0adf-b8a2-4f7a-9d98-bb2f2a77e506 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:13.974863 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d0adf-b8a2-4f7a-9d98-bb2f2a77e506 admin admin] PATH_INFO: `/v3/projects/7b72e66e47d7446da9139e40c2487835` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:13.980346 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d0adf-b8a2-4f7a-9d98-bb2f2a77e506 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b72e66e47d7446da9139e40c2487835)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:13.985203 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d0adf-b8a2-4f7a-9d98-bb2f2a77e506 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:14.162983 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b50d3-a7a5-43a9-ac07-361b3b8d020c service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:14.164630 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4b3b50d3-a7a5-43a9-ac07-361b3b8d020c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:14.175823 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-358d0adf-b8a2-4f7a-9d98-bb2f2a77e506 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b72e66e47d7446da9139e40c2487835', 'request_id': 'req-358d0adf-b8a2-4f7a-9d98-bb2f2a77e506'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:14.189214 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-358d0adf-b8a2-4f7a-9d98-bb2f2a77e506 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b72e66e47d7446da9139e40c2487835', 'request_id': 'req-358d0adf-b8a2-4f7a-9d98-bb2f2a77e506'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:14.203840 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-358d0adf-b8a2-4f7a-9d98-bb2f2a77e506 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b72e66e47d7446da9139e40c2487835', 'request_id': 'req-358d0adf-b8a2-4f7a-9d98-bb2f2a77e506'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:14.236490 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-358d0adf-b8a2-4f7a-9d98-bb2f2a77e506 admin admin] The token cache is being invalidate because project 7b72e66e47d7446da9139e40c2487835 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:01:14.237462 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-358d0adf-b8a2-4f7a-9d98-bb2f2a77e506 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:14.238531 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-358d0adf-b8a2-4f7a-9d98-bb2f2a77e506 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:14.240157 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2716/5420] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:01:13 2022] DELETE /identity/v3/projects/7b72e66e47d7446da9139e40c2487835 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:14.250807 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582932a0-62a5-4b81-b60a-a99c8042a6b8 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:14.251470 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582932a0-62a5-4b81-b60a-a99c8042a6b8 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:14.254673 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582932a0-62a5-4b81-b60a-a99c8042a6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:14.288546 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-582932a0-62a5-4b81-b60a-a99c8042a6b8 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:14.290947 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-582932a0-62a5-4b81-b60a-a99c8042a6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:14.457157 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b50d3-a7a5-43a9-ac07-361b3b8d020c service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:14.492795 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2717/5421] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:14.494897 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039129c5-4a51-4900-97de-c4d215ceb7f0 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:14.495374 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039129c5-4a51-4900-97de-c4d215ceb7f0 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:14.503994 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039129c5-4a51-4900-97de-c4d215ceb7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:14.541715 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:14.566348 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-039129c5-4a51-4900-97de-c4d215ceb7f0 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:14.566348 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-039129c5-4a51-4900-97de-c4d215ceb7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:14.643723 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2718/5422] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:14.646421 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039129c5-4a51-4900-97de-c4d215ceb7f0 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:14.650163 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054e1e7-c3f3-4987-8164-8c8a1d2cb1c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:14.652122 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054e1e7-c3f3-4987-8164-8c8a1d2cb1c6 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:14.654717 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054e1e7-c3f3-4987-8164-8c8a1d2cb1c6 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:14.663214 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054e1e7-c3f3-4987-8164-8c8a1d2cb1c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:14.666023 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a054e1e7-c3f3-4987-8164-8c8a1d2cb1c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:14.679101 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039129c5-4a51-4900-97de-c4d215ceb7f0 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:14.704172 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950bd6ee-19e1-4837-b4a1-606fe1c07a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:14.715362 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950bd6ee-19e1-4837-b4a1-606fe1c07a77 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:14.763446 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950bd6ee-19e1-4837-b4a1-606fe1c07a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:14.763811 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950bd6ee-19e1-4837-b4a1-606fe1c07a77 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:14.764451 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950bd6ee-19e1-4837-b4a1-606fe1c07a77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:01:14.764763 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950bd6ee-19e1-4837-b4a1-606fe1c07a77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:14.778709 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950bd6ee-19e1-4837-b4a1-606fe1c07a77 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:14.832154 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2719/5423] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:01:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:01:14.834061 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:14.835495 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950bd6ee-19e1-4837-b4a1-606fe1c07a77 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:14.846942 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054e1e7-c3f3-4987-8164-8c8a1d2cb1c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:14.849253 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054e1e7-c3f3-4987-8164-8c8a1d2cb1c6 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:14.867572 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950bd6ee-19e1-4837-b4a1-606fe1c07a77 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:14.885617 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e904192-25d7-48c7-81c4-7492ab9355ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:14.886266 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e904192-25d7-48c7-81c4-7492ab9355ef admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:14.886550 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e904192-25d7-48c7-81c4-7492ab9355ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:14.886897 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e904192-25d7-48c7-81c4-7492ab9355ef admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:14.894522 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2705/5424] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:01:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 732 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:01:14.907198 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054e1e7-c3f3-4987-8164-8c8a1d2cb1c6 service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:14.915507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a054e1e7-c3f3-4987-8164-8c8a1d2cb1c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:14.915765 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e904192-25d7-48c7-81c4-7492ab9355ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:14.921968 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e904192-25d7-48c7-81c4-7492ab9355ef admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:14.969239 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054e1e7-c3f3-4987-8164-8c8a1d2cb1c6 service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:14.995066 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9489bb6-2569-4d0b-9c26-14f8733dc1aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:14.996347 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9489bb6-2569-4d0b-9c26-14f8733dc1aa service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:14.996624 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9489bb6-2569-4d0b-9c26-14f8733dc1aa service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:14.999394 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9489bb6-2569-4d0b-9c26-14f8733dc1aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:14.999597 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c9489bb6-2569-4d0b-9c26-14f8733dc1aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:15.025546 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2720/5425] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:01:14 2022] POST /identity/v3/projects => generated 383 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:01:15.026266 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e904192-25d7-48c7-81c4-7492ab9355ef admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:15.032552 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7e904192-25d7-48c7-81c4-7492ab9355ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:15.203590 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e904192-25d7-48c7-81c4-7492ab9355ef admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:15.235810 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d88b8-8e31-4666-b82e-b480de80951b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:15.237329 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d88b8-8e31-4666-b82e-b480de80951b service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:15.237838 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d88b8-8e31-4666-b82e-b480de80951b service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:15.239287 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d88b8-8e31-4666-b82e-b480de80951b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:15.246221 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-778d88b8-8e31-4666-b82e-b480de80951b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:15.272728 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9489bb6-2569-4d0b-9c26-14f8733dc1aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:15.278078 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d88b8-8e31-4666-b82e-b480de80951b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:15.279945 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9489bb6-2569-4d0b-9c26-14f8733dc1aa service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:15.280292 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d88b8-8e31-4666-b82e-b480de80951b service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:15.297009 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2721/5426] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:01:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:01:15.299833 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d88b8-8e31-4666-b82e-b480de80951b service placement] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:15.349192 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2706/5427] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:01:14 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:01:15.497145 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d88b8-8e31-4666-b82e-b480de80951b service placement] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:15.511254 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a69a3-372c-42a9-99aa-db5084ea2f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:15.512104 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a69a3-372c-42a9-99aa-db5084ea2f95 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:15.512570 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a69a3-372c-42a9-99aa-db5084ea2f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:15.513217 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a69a3-372c-42a9-99aa-db5084ea2f95 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:15.519876 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a69a3-372c-42a9-99aa-db5084ea2f95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:15.525125 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a69a3-372c-42a9-99aa-db5084ea2f95 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:15.602162 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2722/5428] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:01:15 2022] POST /identity/v3/users => generated 292 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:01:15.606141 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9489bb6-2569-4d0b-9c26-14f8733dc1aa service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:15.638347 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9489bb6-2569-4d0b-9c26-14f8733dc1aa service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:15.650883 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3912b8b-6d1b-4ea4-b267-25b66158fe42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:15.652064 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3912b8b-6d1b-4ea4-b267-25b66158fe42 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:15.652563 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3912b8b-6d1b-4ea4-b267-25b66158fe42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:15.653037 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3912b8b-6d1b-4ea4-b267-25b66158fe42 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:15.653950 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3912b8b-6d1b-4ea4-b267-25b66158fe42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:15.657374 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3912b8b-6d1b-4ea4-b267-25b66158fe42 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:15.687759 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2707/5429] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:01:15.692623 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a69a3-372c-42a9-99aa-db5084ea2f95 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:15.709621 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a69a3-372c-42a9-99aa-db5084ea2f95 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:15.731609 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b98d87-ab97-4e10-85ba-6fa3e956b760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:15.732594 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b98d87-ab97-4e10-85ba-6fa3e956b760 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:15.733544 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b98d87-ab97-4e10-85ba-6fa3e956b760 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:15.734219 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b98d87-ab97-4e10-85ba-6fa3e956b760 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:15.735357 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b98d87-ab97-4e10-85ba-6fa3e956b760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:15.740081 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b98d87-ab97-4e10-85ba-6fa3e956b760 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:15.783420 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2723/5430] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:01:15.788008 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3912b8b-6d1b-4ea4-b267-25b66158fe42 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:15.812988 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3912b8b-6d1b-4ea4-b267-25b66158fe42 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:15.828403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5950eff-c45b-41dc-bcce-2aeba6ba55a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:15.829873 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5950eff-c45b-41dc-bcce-2aeba6ba55a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:15.830870 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5950eff-c45b-41dc-bcce-2aeba6ba55a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:15.831206 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5950eff-c45b-41dc-bcce-2aeba6ba55a4 admin admin] PATH_INFO: `/v3/projects/7260083d5eba4837bef21d3634e58d35/users/61b509fb6e07477c8b7bf6799b85eced/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:15.884720 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5950eff-c45b-41dc-bcce-2aeba6ba55a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7260083d5eba4837bef21d3634e58d35, user_id=61b509fb6e07477c8b7bf6799b85eced, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:15.893527 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5950eff-c45b-41dc-bcce-2aeba6ba55a4 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:15.932797 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2708/5431] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:01:15 2022] PUT /identity/v3/projects/7260083d5eba4837bef21d3634e58d35/users/61b509fb6e07477c8b7bf6799b85eced/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:01:15.944848 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ae21b-85d9-4837-8d61-9255b06c15f4 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:15.945348 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ae21b-85d9-4837-8d61-9255b06c15f4 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:15.945723 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ae21b-85d9-4837-8d61-9255b06c15f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:16.030848 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a83ae21b-85d9-4837-8d61-9255b06c15f4 None None] MFA Rules not processed for user `61b509fb6e07477c8b7bf6799b85eced`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:16.033721 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a83ae21b-85d9-4837-8d61-9255b06c15f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:16.101013 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:16.241695 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2724/5432] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:01:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:16.271010 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5950eff-c45b-41dc-bcce-2aeba6ba55a4 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:16.273598 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e5950eff-c45b-41dc-bcce-2aeba6ba55a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:16.448162 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5950eff-c45b-41dc-bcce-2aeba6ba55a4 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:16.454195 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64800e6-b422-4652-a0ac-f9dc22e83a9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:16.455294 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64800e6-b422-4652-a0ac-f9dc22e83a9c service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:16.456643 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64800e6-b422-4652-a0ac-f9dc22e83a9c service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:16.457193 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64800e6-b422-4652-a0ac-f9dc22e83a9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:16.480626 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64800e6-b422-4652-a0ac-f9dc22e83a9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:16.484754 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64800e6-b422-4652-a0ac-f9dc22e83a9c service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:16.502090 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2709/5433] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:01:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:01:25.135863 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55f002-efb2-459a-a2e6-dbf02e59a87c None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:25.136868 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55f002-efb2-459a-a2e6-dbf02e59a87c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:25.137392 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55f002-efb2-459a-a2e6-dbf02e59a87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:25.181829 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-4c55f002-efb2-459a-a2e6-dbf02e59a87c None None] MFA Rules not processed for user `dcd426ac002048bf9db072739a81c2e4`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:25.184270 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4c55f002-efb2-459a-a2e6-dbf02e59a87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:25.417396 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2725/5434] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:01:25 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:25.427737 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be407c8-0ab5-4989-809a-ab468a6d63d8 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:25.428747 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be407c8-0ab5-4989-809a-ab468a6d63d8 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:25.429284 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be407c8-0ab5-4989-809a-ab468a6d63d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:25.466395 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-4be407c8-0ab5-4989-809a-ab468a6d63d8 None None] MFA Rules not processed for user `dcd426ac002048bf9db072739a81c2e4`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:25.467575 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4be407c8-0ab5-4989-809a-ab468a6d63d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:25.488422 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2710/5435] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:01:25 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:25.499385 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55f002-efb2-459a-a2e6-dbf02e59a87c None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:25.609732 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55f002-efb2-459a-a2e6-dbf02e59a87c None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:25.615953 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f639389a-f659-4a41-aa8e-0efcc871478b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:25.616798 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639389a-f659-4a41-aa8e-0efcc871478b service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:25.617185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639389a-f659-4a41-aa8e-0efcc871478b service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:25.617567 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639389a-f659-4a41-aa8e-0efcc871478b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:25.626641 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f639389a-f659-4a41-aa8e-0efcc871478b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:25.629118 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f639389a-f659-4a41-aa8e-0efcc871478b service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:25.696794 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2726/5436] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:01:25 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:01:27.588083 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425043b-b520-410c-af40-1d3b3b716bc8 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:27.588910 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425043b-b520-410c-af40-1d3b3b716bc8 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:27.590126 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425043b-b520-410c-af40-1d3b3b716bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:27.656455 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-5425043b-b520-410c-af40-1d3b3b716bc8 None None] MFA Rules not processed for user `dcd426ac002048bf9db072739a81c2e4`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:27.663313 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5425043b-b520-410c-af40-1d3b3b716bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:27.686177 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2711/5437] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:01:27 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:33.074119 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f639389a-f659-4a41-aa8e-0efcc871478b service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:33.078680 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f639389a-f659-4a41-aa8e-0efcc871478b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:33.257639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:33.376216 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f639389a-f659-4a41-aa8e-0efcc871478b service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:33.406862 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21790f4-7245-4520-ba28-bb506b063a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:33.407609 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21790f4-7245-4520-ba28-bb506b063a69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:33.407890 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21790f4-7245-4520-ba28-bb506b063a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:33.409078 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21790f4-7245-4520-ba28-bb506b063a69 admin admin] PATH_INFO: `/v3/users/36b64ddf330f48cfa83f006f7a14f544` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:33.412392 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21790f4-7245-4520-ba28-bb506b063a69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36b64ddf330f48cfa83f006f7a14f544)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:33.414369 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21790f4-7245-4520-ba28-bb506b063a69 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:33.528587 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c21790f4-7245-4520-ba28-bb506b063a69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36b64ddf330f48cfa83f006f7a14f544'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:33.529300 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c21790f4-7245-4520-ba28-bb506b063a69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36b64ddf330f48cfa83f006f7a14f544'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:33.548073 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c21790f4-7245-4520-ba28-bb506b063a69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36b64ddf330f48cfa83f006f7a14f544'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:33.558417 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c21790f4-7245-4520-ba28-bb506b063a69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36b64ddf330f48cfa83f006f7a14f544'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:33.572778 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c21790f4-7245-4520-ba28-bb506b063a69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36b64ddf330f48cfa83f006f7a14f544'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:33.678522 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2727/5438] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:01:33 2022] DELETE /identity/v3/users/36b64ddf330f48cfa83f006f7a14f544 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:33.684784 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7ad96-ff66-44f9-8892-3463beed1726 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:33.686019 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7ad96-ff66-44f9-8892-3463beed1726 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:33.686609 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7ad96-ff66-44f9-8892-3463beed1726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:33.722926 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-18d7ad96-ff66-44f9-8892-3463beed1726 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:33.724452 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-18d7ad96-ff66-44f9-8892-3463beed1726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:33.866921 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:33.937219 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2712/5439] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:01:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:33.988199 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21790f4-7245-4520-ba28-bb506b063a69 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:33.990772 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c21790f4-7245-4520-ba28-bb506b063a69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:34.207883 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21790f4-7245-4520-ba28-bb506b063a69 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:34.212376 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558375f-d3e1-40f6-810d-0d45a04d8013 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:34.213178 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558375f-d3e1-40f6-810d-0d45a04d8013 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:34.213689 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558375f-d3e1-40f6-810d-0d45a04d8013 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:34.214068 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558375f-d3e1-40f6-810d-0d45a04d8013 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:34.232657 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7558375f-d3e1-40f6-810d-0d45a04d8013 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:34.234579 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7558375f-d3e1-40f6-810d-0d45a04d8013 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:34.266689 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2728/5440] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:01:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:01:35.920043 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7ad96-ff66-44f9-8892-3463beed1726 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:35.924330 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-18d7ad96-ff66-44f9-8892-3463beed1726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:35.957794 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7ad96-ff66-44f9-8892-3463beed1726 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:35.978194 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c3cf8-05cf-4e6b-8795-ed06710cb749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:35.978868 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c3cf8-05cf-4e6b-8795-ed06710cb749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:35.979200 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c3cf8-05cf-4e6b-8795-ed06710cb749 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:35.979476 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c3cf8-05cf-4e6b-8795-ed06710cb749 admin admin] PATH_INFO: `/v3/projects/217e797be459419998367ef1e6ef7c53` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:35.983820 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c3cf8-05cf-4e6b-8795-ed06710cb749 admin admin] RBAC: Authorizing `identity:delete_project(project_id=217e797be459419998367ef1e6ef7c53)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:35.988933 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c3cf8-05cf-4e6b-8795-ed06710cb749 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:36.128111 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-618c3cf8-05cf-4e6b-8795-ed06710cb749 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '217e797be459419998367ef1e6ef7c53', 'request_id': 'req-618c3cf8-05cf-4e6b-8795-ed06710cb749'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:36.160009 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-618c3cf8-05cf-4e6b-8795-ed06710cb749 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '217e797be459419998367ef1e6ef7c53', 'request_id': 'req-618c3cf8-05cf-4e6b-8795-ed06710cb749'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:36.176321 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-618c3cf8-05cf-4e6b-8795-ed06710cb749 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '217e797be459419998367ef1e6ef7c53', 'request_id': 'req-618c3cf8-05cf-4e6b-8795-ed06710cb749'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:36.221656 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-618c3cf8-05cf-4e6b-8795-ed06710cb749 admin admin] The token cache is being invalidate because project 217e797be459419998367ef1e6ef7c53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:01:36.222360 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-618c3cf8-05cf-4e6b-8795-ed06710cb749 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:36.223355 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-618c3cf8-05cf-4e6b-8795-ed06710cb749 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:36.245604 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2713/5441] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:01:35 2022] DELETE /identity/v3/projects/217e797be459419998367ef1e6ef7c53 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:36.250446 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b8779-1e27-4878-8fee-d96d18c6ef0e None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:36.254083 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b8779-1e27-4878-8fee-d96d18c6ef0e None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:36.254739 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b8779-1e27-4878-8fee-d96d18c6ef0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:36.290788 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-c78b8779-1e27-4878-8fee-d96d18c6ef0e None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:36.293420 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c78b8779-1e27-4878-8fee-d96d18c6ef0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:36.448789 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:36.478284 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2729/5442] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:01:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:36.485294 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed0a20-b6a8-4c02-8d8a-cd844c5f5ae3 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:36.485796 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed0a20-b6a8-4c02-8d8a-cd844c5f5ae3 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:36.486140 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed0a20-b6a8-4c02-8d8a-cd844c5f5ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:36.547492 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-f8ed0a20-b6a8-4c02-8d8a-cd844c5f5ae3 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:36.551470 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f8ed0a20-b6a8-4c02-8d8a-cd844c5f5ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:36.622880 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2714/5443] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:01:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:36.627850 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b8779-1e27-4878-8fee-d96d18c6ef0e None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:36.656860 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b8779-1e27-4878-8fee-d96d18c6ef0e None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:36.676877 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d901177b-366f-4112-b25d-dbd23645673e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:36.677525 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901177b-366f-4112-b25d-dbd23645673e admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:36.677806 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901177b-366f-4112-b25d-dbd23645673e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:36.678171 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901177b-366f-4112-b25d-dbd23645673e admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:36.679115 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d901177b-366f-4112-b25d-dbd23645673e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:01:36.679424 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d901177b-366f-4112-b25d-dbd23645673e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:36.681077 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d901177b-366f-4112-b25d-dbd23645673e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:36.724085 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2730/5444] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:01:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:01:36.728759 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed0a20-b6a8-4c02-8d8a-cd844c5f5ae3 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:36.795396 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed0a20-b6a8-4c02-8d8a-cd844c5f5ae3 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:36.825560 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88816b42-4cc3-44da-a71d-fe925255646a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:36.826047 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88816b42-4cc3-44da-a71d-fe925255646a admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:36.826328 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88816b42-4cc3-44da-a71d-fe925255646a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:36.826596 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88816b42-4cc3-44da-a71d-fe925255646a admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:36.827373 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88816b42-4cc3-44da-a71d-fe925255646a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:36.834011 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88816b42-4cc3-44da-a71d-fe925255646a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:36.911802 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2715/5445] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:01:36 2022] POST /identity/v3/projects => generated 383 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:01:36.915014 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d901177b-366f-4112-b25d-dbd23645673e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:36.950881 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d901177b-366f-4112-b25d-dbd23645673e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:37.161669 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204b469-4c1b-44aa-8c99-aee5ba673b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:37.162110 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204b469-4c1b-44aa-8c99-aee5ba673b8f admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:37.162650 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204b469-4c1b-44aa-8c99-aee5ba673b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:37.162924 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204b469-4c1b-44aa-8c99-aee5ba673b8f admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:37.163672 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f204b469-4c1b-44aa-8c99-aee5ba673b8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:37.165645 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f204b469-4c1b-44aa-8c99-aee5ba673b8f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:37.233446 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2731/5446] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:01:36 2022] POST /identity/v3/users => generated 292 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:01:37.235771 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88816b42-4cc3-44da-a71d-fe925255646a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:37.250973 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88816b42-4cc3-44da-a71d-fe925255646a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:37.266638 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd66ca-1945-4e41-9e70-ace4bc5a6fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:37.275668 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd66ca-1945-4e41-9e70-ace4bc5a6fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:37.276424 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd66ca-1945-4e41-9e70-ace4bc5a6fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:37.277668 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd66ca-1945-4e41-9e70-ace4bc5a6fd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:37.280177 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd66ca-1945-4e41-9e70-ace4bc5a6fd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:37.284058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd66ca-1945-4e41-9e70-ace4bc5a6fd8 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:37.312773 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2716/5447] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:01:37.317630 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204b469-4c1b-44aa-8c99-aee5ba673b8f admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:37.333338 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204b469-4c1b-44aa-8c99-aee5ba673b8f admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:37.348487 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037024ce-6c2c-4f1e-bb34-00032cb5d001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:37.350218 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037024ce-6c2c-4f1e-bb34-00032cb5d001 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:37.350721 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037024ce-6c2c-4f1e-bb34-00032cb5d001 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:37.351273 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037024ce-6c2c-4f1e-bb34-00032cb5d001 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:37.352229 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037024ce-6c2c-4f1e-bb34-00032cb5d001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:37.354885 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037024ce-6c2c-4f1e-bb34-00032cb5d001 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:37.379552 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2732/5448] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:01:37.383576 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd66ca-1945-4e41-9e70-ace4bc5a6fd8 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:37.401433 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd66ca-1945-4e41-9e70-ace4bc5a6fd8 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:37.424830 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f3996-8839-473a-877a-75b3ae06e8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:37.425533 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f3996-8839-473a-877a-75b3ae06e8ae admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:37.425817 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f3996-8839-473a-877a-75b3ae06e8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:37.426096 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f3996-8839-473a-877a-75b3ae06e8ae admin admin] PATH_INFO: `/v3/projects/315f3de5e40e4a0ca12713b37c555371/users/e9cd9c0bd017459cb630823a39e8bd17/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:37.489162 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f3996-8839-473a-877a-75b3ae06e8ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=315f3de5e40e4a0ca12713b37c555371, user_id=e9cd9c0bd017459cb630823a39e8bd17, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:37.508947 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f3996-8839-473a-877a-75b3ae06e8ae admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:37.540006 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2717/5449] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:01:37 2022] PUT /identity/v3/projects/315f3de5e40e4a0ca12713b37c555371/users/e9cd9c0bd017459cb630823a39e8bd17/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:37.544971 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ebe6d-0556-49a6-aff8-8f0db2916f19 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:37.545389 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ebe6d-0556-49a6-aff8-8f0db2916f19 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:37.545768 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ebe6d-0556-49a6-aff8-8f0db2916f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:37.575922 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-b61ebe6d-0556-49a6-aff8-8f0db2916f19 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:37.577354 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b61ebe6d-0556-49a6-aff8-8f0db2916f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:37.737883 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2733/5450] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:01:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:37.817202 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f3996-8839-473a-877a-75b3ae06e8ae admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:37.819058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e10f3996-8839-473a-877a-75b3ae06e8ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:37.965444 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f3996-8839-473a-877a-75b3ae06e8ae admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:37.982302 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71757dd8-cc01-461d-ae65-34f077aa5a47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:37.983545 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71757dd8-cc01-461d-ae65-34f077aa5a47 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:37.983981 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71757dd8-cc01-461d-ae65-34f077aa5a47 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:37.984412 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71757dd8-cc01-461d-ae65-34f077aa5a47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:38.022747 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71757dd8-cc01-461d-ae65-34f077aa5a47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:38.025142 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71757dd8-cc01-461d-ae65-34f077aa5a47 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:38.056050 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2718/5451] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:01:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:01:40.668596 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58fbc4-6d1a-4483-97e2-2bdf0ae9f9a6 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:40.669143 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58fbc4-6d1a-4483-97e2-2bdf0ae9f9a6 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:40.669143 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58fbc4-6d1a-4483-97e2-2bdf0ae9f9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:40.702256 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-4e58fbc4-6d1a-4483-97e2-2bdf0ae9f9a6 None None] MFA Rules not processed for user `e9cd9c0bd017459cb630823a39e8bd17`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:40.703608 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4e58fbc4-6d1a-4483-97e2-2bdf0ae9f9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:40.775872 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:40.794568 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2734/5452] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:01:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:40.807701 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71757dd8-cc01-461d-ae65-34f077aa5a47 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:40.810451 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-71757dd8-cc01-461d-ae65-34f077aa5a47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:40.818419 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:40.901315 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71757dd8-cc01-461d-ae65-34f077aa5a47 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:40.905804 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ffe71-765b-453c-b558-ab7c08ae548e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:40.906769 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ffe71-765b-453c-b558-ab7c08ae548e service cinder] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:40.907243 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ffe71-765b-453c-b558-ab7c08ae548e service cinder] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:40.907698 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ffe71-765b-453c-b558-ab7c08ae548e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:40.918291 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ffe71-765b-453c-b558-ab7c08ae548e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:40.920138 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ffe71-765b-453c-b558-ab7c08ae548e service cinder] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:40.943344 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2719/5453] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:01:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:01:45.857167 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e58fbc4-6d1a-4483-97e2-2bdf0ae9f9a6 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:45.859454 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4e58fbc4-6d1a-4483-97e2-2bdf0ae9f9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:45.914943 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e58fbc4-6d1a-4483-97e2-2bdf0ae9f9a6 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:45.925978 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a76ce-4fd7-4a3f-987a-c5a04f2a5180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:45.927814 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a76ce-4fd7-4a3f-987a-c5a04f2a5180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:45.931713 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a76ce-4fd7-4a3f-987a-c5a04f2a5180 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:45.936571 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a76ce-4fd7-4a3f-987a-c5a04f2a5180 admin admin] PATH_INFO: `/v3/users/5607e123ec6a407f97498ee37dc0c309` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:45.940721 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909a76ce-4fd7-4a3f-987a-c5a04f2a5180 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5607e123ec6a407f97498ee37dc0c309)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:45.951140 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909a76ce-4fd7-4a3f-987a-c5a04f2a5180 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:46.137375 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-909a76ce-4fd7-4a3f-987a-c5a04f2a5180 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5607e123ec6a407f97498ee37dc0c309'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:46.138091 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-909a76ce-4fd7-4a3f-987a-c5a04f2a5180 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5607e123ec6a407f97498ee37dc0c309'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:46.163708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-909a76ce-4fd7-4a3f-987a-c5a04f2a5180 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5607e123ec6a407f97498ee37dc0c309'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:46.182212 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-909a76ce-4fd7-4a3f-987a-c5a04f2a5180 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5607e123ec6a407f97498ee37dc0c309'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:46.183867 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-909a76ce-4fd7-4a3f-987a-c5a04f2a5180 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5607e123ec6a407f97498ee37dc0c309'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:46.230942 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2735/5454] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:01:45 2022] DELETE /identity/v3/users/5607e123ec6a407f97498ee37dc0c309 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:46.237272 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b6bd8-6969-4d4c-8c95-06271c74c0b5 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:46.237997 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b6bd8-6969-4d4c-8c95-06271c74c0b5 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:46.237997 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b6bd8-6969-4d4c-8c95-06271c74c0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:46.301330 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-c08b6bd8-6969-4d4c-8c95-06271c74c0b5 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:46.302658 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c08b6bd8-6969-4d4c-8c95-06271c74c0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:46.521996 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2720/5455] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:46.565190 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a76ce-4fd7-4a3f-987a-c5a04f2a5180 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:46.567150 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-909a76ce-4fd7-4a3f-987a-c5a04f2a5180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:46.852532 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a76ce-4fd7-4a3f-987a-c5a04f2a5180 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:46.864861 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836c720-060e-4ffe-9b0b-b248d1df376b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:46.865366 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836c720-060e-4ffe-9b0b-b248d1df376b service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:46.865366 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836c720-060e-4ffe-9b0b-b248d1df376b service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:46.865599 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836c720-060e-4ffe-9b0b-b248d1df376b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:46.910820 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836c720-060e-4ffe-9b0b-b248d1df376b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:46.912625 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836c720-060e-4ffe-9b0b-b248d1df376b service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:46.972321 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2736/5456] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:01:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:01:47.810386 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08b6bd8-6969-4d4c-8c95-06271c74c0b5 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:47.815309 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c08b6bd8-6969-4d4c-8c95-06271c74c0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:47.873053 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08b6bd8-6969-4d4c-8c95-06271c74c0b5 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:47.900488 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a7c254-d429-4949-bf1c-1d232b2085f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:47.910850 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7c254-d429-4949-bf1c-1d232b2085f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:47.911522 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7c254-d429-4949-bf1c-1d232b2085f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:47.911915 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7c254-d429-4949-bf1c-1d232b2085f1 admin admin] PATH_INFO: `/v3/projects/af6a0bfb90644b128e315e232d2160aa` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:47.915450 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a7c254-d429-4949-bf1c-1d232b2085f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af6a0bfb90644b128e315e232d2160aa)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:47.921321 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a7c254-d429-4949-bf1c-1d232b2085f1 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:48.054189 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b5a7c254-d429-4949-bf1c-1d232b2085f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af6a0bfb90644b128e315e232d2160aa', 'request_id': 'req-b5a7c254-d429-4949-bf1c-1d232b2085f1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:48.072048 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b5a7c254-d429-4949-bf1c-1d232b2085f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af6a0bfb90644b128e315e232d2160aa', 'request_id': 'req-b5a7c254-d429-4949-bf1c-1d232b2085f1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:48.099415 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b5a7c254-d429-4949-bf1c-1d232b2085f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af6a0bfb90644b128e315e232d2160aa', 'request_id': 'req-b5a7c254-d429-4949-bf1c-1d232b2085f1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:48.147418 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b5a7c254-d429-4949-bf1c-1d232b2085f1 admin admin] The token cache is being invalidate because project af6a0bfb90644b128e315e232d2160aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:01:48.148568 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b5a7c254-d429-4949-bf1c-1d232b2085f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:48.150681 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b5a7c254-d429-4949-bf1c-1d232b2085f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:48.162858 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2721/5457] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:01:47 2022] DELETE /identity/v3/projects/af6a0bfb90644b128e315e232d2160aa => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:48.165207 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836c720-060e-4ffe-9b0b-b248d1df376b service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:48.184925 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836c720-060e-4ffe-9b0b-b248d1df376b service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:48.410857 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a131d10-aa2c-478c-ba3b-56d731922e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:48.411568 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a131d10-aa2c-478c-ba3b-56d731922e10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:48.416865 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a131d10-aa2c-478c-ba3b-56d731922e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:48.417211 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a131d10-aa2c-478c-ba3b-56d731922e10 admin admin] PATH_INFO: `/v3/users/434f81d897704db5a25126395f420ae3` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:48.427498 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a131d10-aa2c-478c-ba3b-56d731922e10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=434f81d897704db5a25126395f420ae3)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:48.430560 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a131d10-aa2c-478c-ba3b-56d731922e10 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:48.500761 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:48.652250 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8a131d10-aa2c-478c-ba3b-56d731922e10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '434f81d897704db5a25126395f420ae3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:48.653410 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8a131d10-aa2c-478c-ba3b-56d731922e10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '434f81d897704db5a25126395f420ae3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:48.682018 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8a131d10-aa2c-478c-ba3b-56d731922e10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '434f81d897704db5a25126395f420ae3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:48.705886 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8a131d10-aa2c-478c-ba3b-56d731922e10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '434f81d897704db5a25126395f420ae3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:48.706679 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8a131d10-aa2c-478c-ba3b-56d731922e10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '434f81d897704db5a25126395f420ae3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:48.765153 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2737/5458] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:01:48 2022] DELETE /identity/v3/users/434f81d897704db5a25126395f420ae3 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:49.574675 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a7c254-d429-4949-bf1c-1d232b2085f1 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:49.576153 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b5a7c254-d429-4949-bf1c-1d232b2085f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:49.607665 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a7c254-d429-4949-bf1c-1d232b2085f1 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:49.752230 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:49.868807 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a3493-ce45-44cc-9311-2729dcc9ec22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:49.870062 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a3493-ce45-44cc-9311-2729dcc9ec22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:49.871890 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a3493-ce45-44cc-9311-2729dcc9ec22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:49.872360 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a3493-ce45-44cc-9311-2729dcc9ec22 admin admin] PATH_INFO: `/v3/projects/4a6f0a916be648be98980a5e1eceabda` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:49.873883 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a3493-ce45-44cc-9311-2729dcc9ec22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a6f0a916be648be98980a5e1eceabda)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:49.876388 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a3493-ce45-44cc-9311-2729dcc9ec22 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:49.949161 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f48a3493-ce45-44cc-9311-2729dcc9ec22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a6f0a916be648be98980a5e1eceabda', 'request_id': 'req-f48a3493-ce45-44cc-9311-2729dcc9ec22'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:49.958798 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f48a3493-ce45-44cc-9311-2729dcc9ec22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a6f0a916be648be98980a5e1eceabda', 'request_id': 'req-f48a3493-ce45-44cc-9311-2729dcc9ec22'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:49.970315 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f48a3493-ce45-44cc-9311-2729dcc9ec22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a6f0a916be648be98980a5e1eceabda', 'request_id': 'req-f48a3493-ce45-44cc-9311-2729dcc9ec22'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:49.999805 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f48a3493-ce45-44cc-9311-2729dcc9ec22 admin admin] The token cache is being invalidate because project 4a6f0a916be648be98980a5e1eceabda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:01:50.000185 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f48a3493-ce45-44cc-9311-2729dcc9ec22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:50.001033 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f48a3493-ce45-44cc-9311-2729dcc9ec22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:50.005090 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2722/5459] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:01:49 2022] DELETE /identity/v3/projects/4a6f0a916be648be98980a5e1eceabda => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:50.009340 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7baef-b17d-4e9e-8cb8-b95fa2e8ddb8 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:50.010149 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7baef-b17d-4e9e-8cb8-b95fa2e8ddb8 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:50.010593 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7baef-b17d-4e9e-8cb8-b95fa2e8ddb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:50.067432 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a0d7baef-b17d-4e9e-8cb8-b95fa2e8ddb8 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:50.068681 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a0d7baef-b17d-4e9e-8cb8-b95fa2e8ddb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:50.258315 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2738/5460] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:01:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:50.267943 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e4285-05fc-49f3-9cb6-31cd72d515bd None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:50.273058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e4285-05fc-49f3-9cb6-31cd72d515bd None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:50.280437 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e4285-05fc-49f3-9cb6-31cd72d515bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:50.343914 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-6a0e4285-05fc-49f3-9cb6-31cd72d515bd None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:50.345343 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6a0e4285-05fc-49f3-9cb6-31cd72d515bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:50.381390 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2723/5461] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:01:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:50.385294 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7baef-b17d-4e9e-8cb8-b95fa2e8ddb8 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:50.403742 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7baef-b17d-4e9e-8cb8-b95fa2e8ddb8 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:50.411903 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af7054-95c8-4b92-8c43-86002b59f653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:50.412947 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af7054-95c8-4b92-8c43-86002b59f653 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:50.413332 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af7054-95c8-4b92-8c43-86002b59f653 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:50.413712 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af7054-95c8-4b92-8c43-86002b59f653 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:50.414565 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af7054-95c8-4b92-8c43-86002b59f653 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:01:50.415391 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af7054-95c8-4b92-8c43-86002b59f653 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:50.416774 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af7054-95c8-4b92-8c43-86002b59f653 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:50.432350 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2739/5462] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:01:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:01:50.436392 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e4285-05fc-49f3-9cb6-31cd72d515bd None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:50.460888 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e4285-05fc-49f3-9cb6-31cd72d515bd None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:50.467584 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec935139-2403-49a5-964f-f7c012a04882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:50.468481 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec935139-2403-49a5-964f-f7c012a04882 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:50.468774 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec935139-2403-49a5-964f-f7c012a04882 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:50.469052 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec935139-2403-49a5-964f-f7c012a04882 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:50.470029 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec935139-2403-49a5-964f-f7c012a04882 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:50.472150 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec935139-2403-49a5-964f-f7c012a04882 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:50.510063 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2724/5463] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:01:50 2022] POST /identity/v3/projects => generated 369 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:01:50.531457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af7054-95c8-4b92-8c43-86002b59f653 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:50.544146 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af7054-95c8-4b92-8c43-86002b59f653 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:50.650257 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543019e-199c-48e3-98ed-ffecb47dd8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:50.651223 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543019e-199c-48e3-98ed-ffecb47dd8f0 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:50.651575 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543019e-199c-48e3-98ed-ffecb47dd8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:50.651976 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543019e-199c-48e3-98ed-ffecb47dd8f0 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:50.652762 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3543019e-199c-48e3-98ed-ffecb47dd8f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:50.654856 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3543019e-199c-48e3-98ed-ffecb47dd8f0 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:50.709239 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2740/5464] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:01:50 2022] POST /identity/v3/users => generated 285 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:01:50.713861 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec935139-2403-49a5-964f-f7c012a04882 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:50.732250 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec935139-2403-49a5-964f-f7c012a04882 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:50.740065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b91a07-8ef9-4a89-95fe-12bfb13e98ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:50.741133 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b91a07-8ef9-4a89-95fe-12bfb13e98ac admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:50.741574 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b91a07-8ef9-4a89-95fe-12bfb13e98ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:50.742013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b91a07-8ef9-4a89-95fe-12bfb13e98ac admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:50.742849 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b91a07-8ef9-4a89-95fe-12bfb13e98ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:50.745056 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b91a07-8ef9-4a89-95fe-12bfb13e98ac admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:50.780350 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2725/5465] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:01:50.784738 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543019e-199c-48e3-98ed-ffecb47dd8f0 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:50.792119 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:50.797402 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543019e-199c-48e3-98ed-ffecb47dd8f0 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:50.819049 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd5bd9-790e-4efe-a8ee-a9f1a8d5e470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:50.819689 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd5bd9-790e-4efe-a8ee-a9f1a8d5e470 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:50.819970 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd5bd9-790e-4efe-a8ee-a9f1a8d5e470 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:50.820239 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd5bd9-790e-4efe-a8ee-a9f1a8d5e470 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:50.821499 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd5bd9-790e-4efe-a8ee-a9f1a8d5e470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:50.823211 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd5bd9-790e-4efe-a8ee-a9f1a8d5e470 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:50.850198 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b91a07-8ef9-4a89-95fe-12bfb13e98ac admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:50.864902 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2741/5466] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:01:50.875622 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b91a07-8ef9-4a89-95fe-12bfb13e98ac admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:50.906116 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197b491-aaca-4914-aa78-66b4be4edf82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:50.906116 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197b491-aaca-4914-aa78-66b4be4edf82 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:50.906116 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197b491-aaca-4914-aa78-66b4be4edf82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:50.906116 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197b491-aaca-4914-aa78-66b4be4edf82 admin admin] PATH_INFO: `/v3/projects/33948bb268514d44a301f2564d961c76/users/622bffc5c64741c9b7f92ce93ba0fb5f/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:50.947108 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4197b491-aaca-4914-aa78-66b4be4edf82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33948bb268514d44a301f2564d961c76, user_id=622bffc5c64741c9b7f92ce93ba0fb5f, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:50.949855 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4197b491-aaca-4914-aa78-66b4be4edf82 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:50.973820 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2726/5467] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:01:50 2022] PUT /identity/v3/projects/33948bb268514d44a301f2564d961c76/users/622bffc5c64741c9b7f92ce93ba0fb5f/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:50.984095 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e64b2fb-28e7-40d2-b574-c0c7738e23a6 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:50.984372 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e64b2fb-28e7-40d2-b574-c0c7738e23a6 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:50.984669 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e64b2fb-28e7-40d2-b574-c0c7738e23a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:51.044071 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-0e64b2fb-28e7-40d2-b574-c0c7738e23a6 None None] MFA Rules not processed for user `622bffc5c64741c9b7f92ce93ba0fb5f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:51.045659 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0e64b2fb-28e7-40d2-b574-c0c7738e23a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:51.194409 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2742/5468] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:01:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:51.198744 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197b491-aaca-4914-aa78-66b4be4edf82 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:51.336596 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:51.347719 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197b491-aaca-4914-aa78-66b4be4edf82 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:51.361972 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e3c3d-ddac-4563-a79d-acd48cc7e717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:51.363371 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e3c3d-ddac-4563-a79d-acd48cc7e717 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:51.363665 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e3c3d-ddac-4563-a79d-acd48cc7e717 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:51.363992 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e3c3d-ddac-4563-a79d-acd48cc7e717 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:51.364648 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e3c3d-ddac-4563-a79d-acd48cc7e717 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:51.368851 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e3c3d-ddac-4563-a79d-acd48cc7e717 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:51.432080 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2727/5469] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:01:51 2022] POST /identity/v3/projects => generated 369 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:01:51.436259 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e64b2fb-28e7-40d2-b574-c0c7738e23a6 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:51.454220 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e64b2fb-28e7-40d2-b574-c0c7738e23a6 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:51.590737 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412dc9b9-ea84-4762-9643-36cb72b44157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:51.593233 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412dc9b9-ea84-4762-9643-36cb72b44157 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:51.593639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412dc9b9-ea84-4762-9643-36cb72b44157 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:51.594081 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412dc9b9-ea84-4762-9643-36cb72b44157 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:51.596178 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412dc9b9-ea84-4762-9643-36cb72b44157 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:51.606071 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412dc9b9-ea84-4762-9643-36cb72b44157 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:51.663961 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2743/5470] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:01:51 2022] POST /identity/v3/users => generated 291 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:01:51.666562 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e3c3d-ddac-4563-a79d-acd48cc7e717 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:51.684061 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e3c3d-ddac-4563-a79d-acd48cc7e717 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:51.697116 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78bc70-ae2a-418c-864f-0323ebd22706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:51.698631 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78bc70-ae2a-418c-864f-0323ebd22706 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:51.699195 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78bc70-ae2a-418c-864f-0323ebd22706 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:51.699702 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78bc70-ae2a-418c-864f-0323ebd22706 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:51.700896 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e78bc70-ae2a-418c-864f-0323ebd22706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:51.703577 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e78bc70-ae2a-418c-864f-0323ebd22706 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:51.734138 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2728/5471] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:01:51.740449 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412dc9b9-ea84-4762-9643-36cb72b44157 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:51.750941 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412dc9b9-ea84-4762-9643-36cb72b44157 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:51.769134 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374832d-643b-49e9-9c58-1a70b2dd1ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:51.769800 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374832d-643b-49e9-9c58-1a70b2dd1ffd admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:51.770079 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374832d-643b-49e9-9c58-1a70b2dd1ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:51.770354 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374832d-643b-49e9-9c58-1a70b2dd1ffd admin admin] PATH_INFO: `/v3/projects/f6631c44c1f348778743cd8a969a09d8/users/b352f19b3d734e3591c19e11d9d5e06c/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:51.823680 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374832d-643b-49e9-9c58-1a70b2dd1ffd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6631c44c1f348778743cd8a969a09d8, user_id=b352f19b3d734e3591c19e11d9d5e06c, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:51.826415 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374832d-643b-49e9-9c58-1a70b2dd1ffd admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:51.869306 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2744/5472] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:01:51 2022] PUT /identity/v3/projects/f6631c44c1f348778743cd8a969a09d8/users/b352f19b3d734e3591c19e11d9d5e06c/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:51.873839 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78bc70-ae2a-418c-864f-0323ebd22706 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:51.891398 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78bc70-ae2a-418c-864f-0323ebd22706 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:52.022805 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f631292-a8d2-4d29-868f-8c9391cad59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:52.023725 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f631292-a8d2-4d29-868f-8c9391cad59d admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:52.024017 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f631292-a8d2-4d29-868f-8c9391cad59d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:52.024298 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f631292-a8d2-4d29-868f-8c9391cad59d admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:52.025535 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f631292-a8d2-4d29-868f-8c9391cad59d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:52.029086 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f631292-a8d2-4d29-868f-8c9391cad59d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:52.072543 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2729/5473] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:01:52.078347 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374832d-643b-49e9-9c58-1a70b2dd1ffd admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:52.097903 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374832d-643b-49e9-9c58-1a70b2dd1ffd admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:52.114878 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e539483-87fe-451c-b3ed-1fa494229317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:52.115994 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e539483-87fe-451c-b3ed-1fa494229317 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:52.116618 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e539483-87fe-451c-b3ed-1fa494229317 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:52.117111 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e539483-87fe-451c-b3ed-1fa494229317 admin admin] PATH_INFO: `/v3/projects/f6631c44c1f348778743cd8a969a09d8/users/b352f19b3d734e3591c19e11d9d5e06c/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:52.123192 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e539483-87fe-451c-b3ed-1fa494229317 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6631c44c1f348778743cd8a969a09d8, user_id=b352f19b3d734e3591c19e11d9d5e06c, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:52.126196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e539483-87fe-451c-b3ed-1fa494229317 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:52.163987 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2745/5474] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:01:52 2022] PUT /identity/v3/projects/f6631c44c1f348778743cd8a969a09d8/users/b352f19b3d734e3591c19e11d9d5e06c/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:52.176347 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607c18b-2502-4cff-9a6a-e833e1040071 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:52.176820 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607c18b-2502-4cff-9a6a-e833e1040071 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:52.177225 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607c18b-2502-4cff-9a6a-e833e1040071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:52.241781 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-a607c18b-2502-4cff-9a6a-e833e1040071 None None] MFA Rules not processed for user `b352f19b3d734e3591c19e11d9d5e06c`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:52.247497 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a607c18b-2502-4cff-9a6a-e833e1040071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:52.426379 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2730/5475] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:01:52 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:52.505993 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e539483-87fe-451c-b3ed-1fa494229317 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:52.520259 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9e539483-87fe-451c-b3ed-1fa494229317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:52.710483 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:52.755855 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e539483-87fe-451c-b3ed-1fa494229317 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:52.764491 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711dd1e9-a9a6-449f-9a25-f386cba12541 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:52.765129 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711dd1e9-a9a6-449f-9a25-f386cba12541 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:52.765407 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711dd1e9-a9a6-449f-9a25-f386cba12541 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:52.765671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711dd1e9-a9a6-449f-9a25-f386cba12541 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:52.784813 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711dd1e9-a9a6-449f-9a25-f386cba12541 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:52.786287 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711dd1e9-a9a6-449f-9a25-f386cba12541 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:52.811964 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2746/5476] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:01:52 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:01:55.411478 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a607c18b-2502-4cff-9a6a-e833e1040071 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:55.414925 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a607c18b-2502-4cff-9a6a-e833e1040071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:55.677708 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:55.734109 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a607c18b-2502-4cff-9a6a-e833e1040071 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:55.759998 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e81444-b643-4bf7-9297-0975a0c0f24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:55.761118 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e81444-b643-4bf7-9297-0975a0c0f24c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:55.761409 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e81444-b643-4bf7-9297-0975a0c0f24c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:55.761905 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e81444-b643-4bf7-9297-0975a0c0f24c admin admin] PATH_INFO: `/v3/users/9ee1a19085a04426be20de4023ef1a9b` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:55.766756 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e81444-b643-4bf7-9297-0975a0c0f24c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ee1a19085a04426be20de4023ef1a9b)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:55.772920 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e81444-b643-4bf7-9297-0975a0c0f24c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:55.935314 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f4e81444-b643-4bf7-9297-0975a0c0f24c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ee1a19085a04426be20de4023ef1a9b'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:55.939152 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f4e81444-b643-4bf7-9297-0975a0c0f24c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ee1a19085a04426be20de4023ef1a9b'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:55.987225 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f4e81444-b643-4bf7-9297-0975a0c0f24c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ee1a19085a04426be20de4023ef1a9b'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:56.016815 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f4e81444-b643-4bf7-9297-0975a0c0f24c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ee1a19085a04426be20de4023ef1a9b'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:56.057537 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f4e81444-b643-4bf7-9297-0975a0c0f24c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ee1a19085a04426be20de4023ef1a9b'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:56.086395 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2731/5477] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:01:55 2022] DELETE /identity/v3/users/9ee1a19085a04426be20de4023ef1a9b => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:56.721858 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711dd1e9-a9a6-449f-9a25-f386cba12541 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:56.742081 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711dd1e9-a9a6-449f-9a25-f386cba12541 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:57.053244 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd1b90-df1e-420e-b4d2-c278886ef762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:57.053852 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd1b90-df1e-420e-b4d2-c278886ef762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:57.054606 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd1b90-df1e-420e-b4d2-c278886ef762 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:57.054606 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd1b90-df1e-420e-b4d2-c278886ef762 admin admin] PATH_INFO: `/v3/projects/380e64930bc44fa0b1204f3acd328537` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:57.055686 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd1b90-df1e-420e-b4d2-c278886ef762 admin admin] RBAC: Authorizing `identity:delete_project(project_id=380e64930bc44fa0b1204f3acd328537)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:57.057630 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd1b90-df1e-420e-b4d2-c278886ef762 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:57.339313 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d2dd1b90-df1e-420e-b4d2-c278886ef762 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '380e64930bc44fa0b1204f3acd328537', 'request_id': 'req-d2dd1b90-df1e-420e-b4d2-c278886ef762'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:57.378470 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d2dd1b90-df1e-420e-b4d2-c278886ef762 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '380e64930bc44fa0b1204f3acd328537', 'request_id': 'req-d2dd1b90-df1e-420e-b4d2-c278886ef762'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:57.413304 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d2dd1b90-df1e-420e-b4d2-c278886ef762 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '380e64930bc44fa0b1204f3acd328537', 'request_id': 'req-d2dd1b90-df1e-420e-b4d2-c278886ef762'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:57.469007 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d2dd1b90-df1e-420e-b4d2-c278886ef762 admin admin] The token cache is being invalidate because project 380e64930bc44fa0b1204f3acd328537 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:01:57.469314 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d2dd1b90-df1e-420e-b4d2-c278886ef762 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:57.474117 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d2dd1b90-df1e-420e-b4d2-c278886ef762 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:57.489433 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2747/5478] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:01:56 2022] DELETE /identity/v3/projects/380e64930bc44fa0b1204f3acd328537 => generated 0 bytes in 765 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:01:57.493083 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab6b28-377c-4397-8d9d-68fbbbf82167 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:57.493562 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab6b28-377c-4397-8d9d-68fbbbf82167 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:57.493650 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab6b28-377c-4397-8d9d-68fbbbf82167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:57.567390 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-83ab6b28-377c-4397-8d9d-68fbbbf82167 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:57.584708 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-83ab6b28-377c-4397-8d9d-68fbbbf82167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:57.937313 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2732/5479] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:01:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:57.938876 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf61615-31b8-490b-aca2-f0b7167f1ad8 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:57.940783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf61615-31b8-490b-aca2-f0b7167f1ad8 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:57.941264 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf61615-31b8-490b-aca2-f0b7167f1ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:57.998162 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-edf61615-31b8-490b-aca2-f0b7167f1ad8 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:58.000096 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-edf61615-31b8-490b-aca2-f0b7167f1ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:58.024245 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2748/5480] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:01:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:01:58.033762 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab6b28-377c-4397-8d9d-68fbbbf82167 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:58.071993 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab6b28-377c-4397-8d9d-68fbbbf82167 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:58.107889 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992c91d-8a92-44ed-b10f-fd24536c314c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:58.108548 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992c91d-8a92-44ed-b10f-fd24536c314c admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:58.108828 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992c91d-8a92-44ed-b10f-fd24536c314c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:58.109107 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992c91d-8a92-44ed-b10f-fd24536c314c admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:58.109787 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9992c91d-8a92-44ed-b10f-fd24536c314c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:01:58.110100 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9992c91d-8a92-44ed-b10f-fd24536c314c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:58.113513 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9992c91d-8a92-44ed-b10f-fd24536c314c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:58.145675 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2733/5481] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:01:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:01:58.150660 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf61615-31b8-490b-aca2-f0b7167f1ad8 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:58.161201 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf61615-31b8-490b-aca2-f0b7167f1ad8 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:58.178948 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452343d5-df12-4877-a0e0-5e9bf5967a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:58.179562 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452343d5-df12-4877-a0e0-5e9bf5967a3f admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:58.179841 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452343d5-df12-4877-a0e0-5e9bf5967a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:58.180114 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452343d5-df12-4877-a0e0-5e9bf5967a3f admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:58.180768 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452343d5-df12-4877-a0e0-5e9bf5967a3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:58.182700 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452343d5-df12-4877-a0e0-5e9bf5967a3f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:58.260388 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2749/5482] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:01:58 2022] POST /identity/v3/projects => generated 381 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:01:58.265042 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992c91d-8a92-44ed-b10f-fd24536c314c admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:58.283399 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992c91d-8a92-44ed-b10f-fd24536c314c admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:58.471111 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9312b-f646-48cf-84db-30bd108c622f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:58.473852 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9312b-f646-48cf-84db-30bd108c622f admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:58.475733 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9312b-f646-48cf-84db-30bd108c622f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:58.476015 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9312b-f646-48cf-84db-30bd108c622f admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:58.477945 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad9312b-f646-48cf-84db-30bd108c622f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:58.479970 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad9312b-f646-48cf-84db-30bd108c622f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:58.502962 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:58.540673 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2734/5483] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:01:58 2022] POST /identity/v3/users => generated 291 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:01:58.541951 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452343d5-df12-4877-a0e0-5e9bf5967a3f admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:58.574747 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452343d5-df12-4877-a0e0-5e9bf5967a3f admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:58.600208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a485831-bb23-4b07-a2bb-aaa63d4d5320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:58.601204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a485831-bb23-4b07-a2bb-aaa63d4d5320 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:58.601705 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a485831-bb23-4b07-a2bb-aaa63d4d5320 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:58.602208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a485831-bb23-4b07-a2bb-aaa63d4d5320 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:58.603155 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a485831-bb23-4b07-a2bb-aaa63d4d5320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:58.605039 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a485831-bb23-4b07-a2bb-aaa63d4d5320 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:58.632115 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2750/5484] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:01:58.636785 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9312b-f646-48cf-84db-30bd108c622f admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:58.653978 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9312b-f646-48cf-84db-30bd108c622f admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:58.672226 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7762b-7913-43d4-b3e5-d5fa306a41dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:58.672895 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7762b-7913-43d4-b3e5-d5fa306a41dc admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:58.674845 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7762b-7913-43d4-b3e5-d5fa306a41dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:58.675250 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7762b-7913-43d4-b3e5-d5fa306a41dc admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:58.675997 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb7762b-7913-43d4-b3e5-d5fa306a41dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:58.682124 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb7762b-7913-43d4-b3e5-d5fa306a41dc admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:58.723162 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2735/5485] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:01:58.727851 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a485831-bb23-4b07-a2bb-aaa63d4d5320 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:58.746058 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a485831-bb23-4b07-a2bb-aaa63d4d5320 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:58.759522 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0fa01-f2cd-4a71-9dd3-618274d556b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:58.766360 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0fa01-f2cd-4a71-9dd3-618274d556b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:58.772025 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0fa01-f2cd-4a71-9dd3-618274d556b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:58.772823 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0fa01-f2cd-4a71-9dd3-618274d556b1 admin admin] PATH_INFO: `/v3/projects/f2a9bdf4db614d63911914129a0b3f38/users/f70663a0bcf94deb882b0a63c27f3957/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:58.835818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf0fa01-f2cd-4a71-9dd3-618274d556b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2a9bdf4db614d63911914129a0b3f38, user_id=f70663a0bcf94deb882b0a63c27f3957, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:58.846865 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf0fa01-f2cd-4a71-9dd3-618274d556b1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:58.879514 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2751/5486] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:01:58 2022] PUT /identity/v3/projects/f2a9bdf4db614d63911914129a0b3f38/users/f70663a0bcf94deb882b0a63c27f3957/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:58.891138 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197ecae-7eed-405f-9e4f-bb82a715d1fd None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:58.891425 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197ecae-7eed-405f-9e4f-bb82a715d1fd None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:58.891708 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197ecae-7eed-405f-9e4f-bb82a715d1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:58.950536 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-c197ecae-7eed-405f-9e4f-bb82a715d1fd None None] MFA Rules not processed for user `f70663a0bcf94deb882b0a63c27f3957`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:58.952209 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c197ecae-7eed-405f-9e4f-bb82a715d1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:59.090734 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2736/5487] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:01:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:01:59.103416 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0fa01-f2cd-4a71-9dd3-618274d556b1 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:59.105303 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-edf0fa01-f2cd-4a71-9dd3-618274d556b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:59.116317 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:59.591522 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0fa01-f2cd-4a71-9dd3-618274d556b1 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:59.603185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5909c88-b782-44ee-8ee4-e7c804eeb69c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:59.603869 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5909c88-b782-44ee-8ee4-e7c804eeb69c service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:59.604169 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5909c88-b782-44ee-8ee4-e7c804eeb69c service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:59.604473 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5909c88-b782-44ee-8ee4-e7c804eeb69c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:59.628218 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5909c88-b782-44ee-8ee4-e7c804eeb69c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:59.631303 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5909c88-b782-44ee-8ee4-e7c804eeb69c service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:59.678262 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2752/5488] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:01:59 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:01:59.829006 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197ecae-7eed-405f-9e4f-bb82a715d1fd None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:00.061329 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197ecae-7eed-405f-9e4f-bb82a715d1fd None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:00.078479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db3cc8-8f7c-4144-b8fa-47b08912920e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:00.079453 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db3cc8-8f7c-4144-b8fa-47b08912920e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:00.079867 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db3cc8-8f7c-4144-b8fa-47b08912920e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:00.080237 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db3cc8-8f7c-4144-b8fa-47b08912920e admin admin] PATH_INFO: `/v3/users/f70663a0bcf94deb882b0a63c27f3957` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:00.084927 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db3cc8-8f7c-4144-b8fa-47b08912920e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f70663a0bcf94deb882b0a63c27f3957)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:00.090574 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db3cc8-8f7c-4144-b8fa-47b08912920e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:00.253917 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f0db3cc8-8f7c-4144-b8fa-47b08912920e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f70663a0bcf94deb882b0a63c27f3957'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:00.256984 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f0db3cc8-8f7c-4144-b8fa-47b08912920e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f70663a0bcf94deb882b0a63c27f3957'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:00.326485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f0db3cc8-8f7c-4144-b8fa-47b08912920e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f70663a0bcf94deb882b0a63c27f3957'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:00.345529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:00.353941 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f0db3cc8-8f7c-4144-b8fa-47b08912920e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f70663a0bcf94deb882b0a63c27f3957'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:00.396393 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f0db3cc8-8f7c-4144-b8fa-47b08912920e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f70663a0bcf94deb882b0a63c27f3957'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:00.426373 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2737/5489] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:01:59 2022] DELETE /identity/v3/users/f70663a0bcf94deb882b0a63c27f3957 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:02:00.435132 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471eb07-328e-4b7e-b851-07d092ad2224 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:00.436776 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471eb07-328e-4b7e-b851-07d092ad2224 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:00.437406 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471eb07-328e-4b7e-b851-07d092ad2224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:00.483352 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-c471eb07-328e-4b7e-b851-07d092ad2224 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:02:00.487738 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c471eb07-328e-4b7e-b851-07d092ad2224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:00.765908 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2753/5490] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:02:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:02:00.824684 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db3cc8-8f7c-4144-b8fa-47b08912920e admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:00.826460 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f0db3cc8-8f7c-4144-b8fa-47b08912920e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:01.103269 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db3cc8-8f7c-4144-b8fa-47b08912920e admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:01.125960 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c11984-1c79-4cee-a48f-e50e1c419714 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:01.134238 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c11984-1c79-4cee-a48f-e50e1c419714 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:01.134586 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c11984-1c79-4cee-a48f-e50e1c419714 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:01.134870 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c11984-1c79-4cee-a48f-e50e1c419714 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:01.172864 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c11984-1c79-4cee-a48f-e50e1c419714 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:01.175843 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c11984-1c79-4cee-a48f-e50e1c419714 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:01.212220 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2738/5491] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:02:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:02:02.446520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471eb07-328e-4b7e-b851-07d092ad2224 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:02.447990 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c471eb07-328e-4b7e-b851-07d092ad2224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:02.465559 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471eb07-328e-4b7e-b851-07d092ad2224 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:02.478528 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40526b3-3518-4698-86fa-a288ec078f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:02.480448 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40526b3-3518-4698-86fa-a288ec078f4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:02.480758 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40526b3-3518-4698-86fa-a288ec078f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:02.481033 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40526b3-3518-4698-86fa-a288ec078f4e admin admin] PATH_INFO: `/v3/projects/f2a9bdf4db614d63911914129a0b3f38` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:02.486461 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40526b3-3518-4698-86fa-a288ec078f4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2a9bdf4db614d63911914129a0b3f38)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:02.513488 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40526b3-3518-4698-86fa-a288ec078f4e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:02.632570 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c40526b3-3518-4698-86fa-a288ec078f4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2a9bdf4db614d63911914129a0b3f38', 'request_id': 'req-c40526b3-3518-4698-86fa-a288ec078f4e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:02.643580 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c40526b3-3518-4698-86fa-a288ec078f4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2a9bdf4db614d63911914129a0b3f38', 'request_id': 'req-c40526b3-3518-4698-86fa-a288ec078f4e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:02.652290 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c40526b3-3518-4698-86fa-a288ec078f4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2a9bdf4db614d63911914129a0b3f38', 'request_id': 'req-c40526b3-3518-4698-86fa-a288ec078f4e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:02.690180 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c40526b3-3518-4698-86fa-a288ec078f4e admin admin] The token cache is being invalidate because project f2a9bdf4db614d63911914129a0b3f38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:02:02.690836 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c40526b3-3518-4698-86fa-a288ec078f4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:02.694889 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c40526b3-3518-4698-86fa-a288ec078f4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:02.696721 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2754/5492] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:02:02 2022] DELETE /identity/v3/projects/f2a9bdf4db614d63911914129a0b3f38 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:02:02.701747 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef0e8e-314b-46d4-bb06-c77c2d6920d5 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:02.702688 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef0e8e-314b-46d4-bb06-c77c2d6920d5 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:02.703176 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef0e8e-314b-46d4-bb06-c77c2d6920d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:02.746999 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-02ef0e8e-314b-46d4-bb06-c77c2d6920d5 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:02:02.748513 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-02ef0e8e-314b-46d4-bb06-c77c2d6920d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:02.853122 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2739/5493] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:02:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:02:02.853344 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce3301-50e6-4570-b5e7-0acde98812c5 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:02.853590 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce3301-50e6-4570-b5e7-0acde98812c5 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:02.853874 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce3301-50e6-4570-b5e7-0acde98812c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:02.884084 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-84ce3301-50e6-4570-b5e7-0acde98812c5 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:02:02.886454 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-84ce3301-50e6-4570-b5e7-0acde98812c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:02.905712 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2755/5494] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:02:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:02:02.910478 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef0e8e-314b-46d4-bb06-c77c2d6920d5 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:02.926721 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef0e8e-314b-46d4-bb06-c77c2d6920d5 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:02.940126 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f160e-1d4e-48e7-a196-bea6060fb2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:02.942779 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f160e-1d4e-48e7-a196-bea6060fb2c0 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:02.946417 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f160e-1d4e-48e7-a196-bea6060fb2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:02.947053 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f160e-1d4e-48e7-a196-bea6060fb2c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:02.948736 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5f160e-1d4e-48e7-a196-bea6060fb2c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:02:02.949288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5f160e-1d4e-48e7-a196-bea6060fb2c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:02.957361 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5f160e-1d4e-48e7-a196-bea6060fb2c0 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:02.990761 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2740/5495] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:02:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:02:02.995175 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce3301-50e6-4570-b5e7-0acde98812c5 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:03.005996 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce3301-50e6-4570-b5e7-0acde98812c5 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:03.020583 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04ab40-cc36-4da8-a5c9-590cdb1ad7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:03.021355 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04ab40-cc36-4da8-a5c9-590cdb1ad7e1 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:03.021734 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04ab40-cc36-4da8-a5c9-590cdb1ad7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:03.022130 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04ab40-cc36-4da8-a5c9-590cdb1ad7e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:03.024257 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04ab40-cc36-4da8-a5c9-590cdb1ad7e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:03.028908 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04ab40-cc36-4da8-a5c9-590cdb1ad7e1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:03.047760 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:03.107903 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2756/5496] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:02:02 2022] POST /identity/v3/projects => generated 359 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:02:03.113137 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f160e-1d4e-48e7-a196-bea6060fb2c0 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:03.133372 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f160e-1d4e-48e7-a196-bea6060fb2c0 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:03.227877 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde1c5a-7ddf-436a-8b97-284a7e8f1dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:03.228951 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde1c5a-7ddf-436a-8b97-284a7e8f1dcb admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:03.229338 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde1c5a-7ddf-436a-8b97-284a7e8f1dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:03.229866 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde1c5a-7ddf-436a-8b97-284a7e8f1dcb admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:03.230743 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde1c5a-7ddf-436a-8b97-284a7e8f1dcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:03.233113 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde1c5a-7ddf-436a-8b97-284a7e8f1dcb admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:03.264712 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2741/5497] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:02:03 2022] POST /identity/v3/users => generated 280 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:02:03.270259 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04ab40-cc36-4da8-a5c9-590cdb1ad7e1 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:03.288389 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04ab40-cc36-4da8-a5c9-590cdb1ad7e1 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:03.295685 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9360dea-96cc-46ad-8045-f5079d14b8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:03.296615 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9360dea-96cc-46ad-8045-f5079d14b8bc admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:03.296901 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9360dea-96cc-46ad-8045-f5079d14b8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:03.297240 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9360dea-96cc-46ad-8045-f5079d14b8bc admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:03.298003 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9360dea-96cc-46ad-8045-f5079d14b8bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:03.301167 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9360dea-96cc-46ad-8045-f5079d14b8bc admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:03.321319 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2757/5498] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:02:03.325321 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde1c5a-7ddf-436a-8b97-284a7e8f1dcb admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:03.341513 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde1c5a-7ddf-436a-8b97-284a7e8f1dcb admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:03.358859 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055442f-e9ae-4863-ae59-6a1b5b091648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:03.359758 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055442f-e9ae-4863-ae59-6a1b5b091648 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:03.360208 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055442f-e9ae-4863-ae59-6a1b5b091648 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:03.360634 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055442f-e9ae-4863-ae59-6a1b5b091648 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:03.362882 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a055442f-e9ae-4863-ae59-6a1b5b091648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:03.365175 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a055442f-e9ae-4863-ae59-6a1b5b091648 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:03.367659 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:03.388604 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9360dea-96cc-46ad-8045-f5079d14b8bc admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:03.396706 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2742/5499] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:02:03.402528 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9360dea-96cc-46ad-8045-f5079d14b8bc admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:03.409211 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27025f-30ed-4439-89b8-1b73cc85ec27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:03.411061 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27025f-30ed-4439-89b8-1b73cc85ec27 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:03.411061 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27025f-30ed-4439-89b8-1b73cc85ec27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:03.411061 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27025f-30ed-4439-89b8-1b73cc85ec27 admin admin] PATH_INFO: `/v3/projects/a40b2e9220ab47bb9124b9343b644477/users/60c19898c4594769a04e372255695995/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:03.441568 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27025f-30ed-4439-89b8-1b73cc85ec27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a40b2e9220ab47bb9124b9343b644477, user_id=60c19898c4594769a04e372255695995, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:03.445242 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27025f-30ed-4439-89b8-1b73cc85ec27 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:03.467979 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2758/5500] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:02:03 2022] PUT /identity/v3/projects/a40b2e9220ab47bb9124b9343b644477/users/60c19898c4594769a04e372255695995/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:02:03.481234 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911767e8-16dc-4bc6-88f5-38ac7b90a5cd None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:03.481630 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911767e8-16dc-4bc6-88f5-38ac7b90a5cd None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:03.482114 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911767e8-16dc-4bc6-88f5-38ac7b90a5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:03.526710 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-911767e8-16dc-4bc6-88f5-38ac7b90a5cd None None] MFA Rules not processed for user `60c19898c4594769a04e372255695995`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:02:03.528196 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-911767e8-16dc-4bc6-88f5-38ac7b90a5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:03.643149 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2743/5501] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:02:03 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:02:03.652036 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27025f-30ed-4439-89b8-1b73cc85ec27 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:03.654280 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4e27025f-30ed-4439-89b8-1b73cc85ec27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:03.763134 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27025f-30ed-4439-89b8-1b73cc85ec27 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:03.770283 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef21d0-7da8-4ec2-a6ce-c975cdcc7234 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:03.771119 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef21d0-7da8-4ec2-a6ce-c975cdcc7234 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:03.771501 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef21d0-7da8-4ec2-a6ce-c975cdcc7234 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:03.771872 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef21d0-7da8-4ec2-a6ce-c975cdcc7234 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:03.782380 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef21d0-7da8-4ec2-a6ce-c975cdcc7234 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:03.784932 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef21d0-7da8-4ec2-a6ce-c975cdcc7234 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:03.807468 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2759/5502] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:02:03 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:02:03.851436 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911767e8-16dc-4bc6-88f5-38ac7b90a5cd None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:03.985556 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911767e8-16dc-4bc6-88f5-38ac7b90a5cd None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:03.999959 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a665c-54a4-4c13-8bb3-1231476913f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:04.000821 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a665c-54a4-4c13-8bb3-1231476913f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:04.001221 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a665c-54a4-4c13-8bb3-1231476913f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:04.002486 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a665c-54a4-4c13-8bb3-1231476913f7 admin admin] PATH_INFO: `/v3/users/60c19898c4594769a04e372255695995` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:04.005251 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a665c-54a4-4c13-8bb3-1231476913f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60c19898c4594769a04e372255695995)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:04.008075 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a665c-54a4-4c13-8bb3-1231476913f7 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:04.075549 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-876a665c-54a4-4c13-8bb3-1231476913f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60c19898c4594769a04e372255695995'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:04.076257 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-876a665c-54a4-4c13-8bb3-1231476913f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60c19898c4594769a04e372255695995'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:04.091319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-876a665c-54a4-4c13-8bb3-1231476913f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60c19898c4594769a04e372255695995'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:04.101157 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-876a665c-54a4-4c13-8bb3-1231476913f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60c19898c4594769a04e372255695995'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:04.110313 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-876a665c-54a4-4c13-8bb3-1231476913f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60c19898c4594769a04e372255695995'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:04.127044 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2744/5503] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:02:03 2022] DELETE /identity/v3/users/60c19898c4594769a04e372255695995 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:02:04.132141 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a583ab-d564-452f-acbe-47085f7b0a10 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:04.132629 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a583ab-d564-452f-acbe-47085f7b0a10 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:04.132982 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a583ab-d564-452f-acbe-47085f7b0a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:04.161196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a1a583ab-d564-452f-acbe-47085f7b0a10 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:02:04.162753 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a1a583ab-d564-452f-acbe-47085f7b0a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:04.245841 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2760/5504] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:02:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:02:04.254944 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a665c-54a4-4c13-8bb3-1231476913f7 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:04.256430 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-876a665c-54a4-4c13-8bb3-1231476913f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:04.266252 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:04.342913 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a665c-54a4-4c13-8bb3-1231476913f7 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:04.347106 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d76e26-35c7-44f3-adf5-a919e2712258 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:04.348027 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d76e26-35c7-44f3-adf5-a919e2712258 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:04.348617 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d76e26-35c7-44f3-adf5-a919e2712258 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:04.348762 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d76e26-35c7-44f3-adf5-a919e2712258 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:04.363283 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d76e26-35c7-44f3-adf5-a919e2712258 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:04.364898 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d76e26-35c7-44f3-adf5-a919e2712258 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:04.387386 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2745/5505] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:02:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:02:04.711943 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a583ab-d564-452f-acbe-47085f7b0a10 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:04.714138 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a1a583ab-d564-452f-acbe-47085f7b0a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:04.800199 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:04.833128 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a583ab-d564-452f-acbe-47085f7b0a10 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:04.839123 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165d589-0dd8-4a5c-a111-39e1084eb22e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:04.840129 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165d589-0dd8-4a5c-a111-39e1084eb22e service cinder] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:04.840833 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165d589-0dd8-4a5c-a111-39e1084eb22e service cinder] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:04.841263 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165d589-0dd8-4a5c-a111-39e1084eb22e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:04.843493 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2165d589-0dd8-4a5c-a111-39e1084eb22e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:04.940356 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2165d589-0dd8-4a5c-a111-39e1084eb22e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:04.942721 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2165d589-0dd8-4a5c-a111-39e1084eb22e service cinder] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:04.960318 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2761/5506] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:02:04 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:02:05.100413 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d76e26-35c7-44f3-adf5-a919e2712258 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:05.101896 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c6d76e26-35c7-44f3-adf5-a919e2712258 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:05.131603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d76e26-35c7-44f3-adf5-a919e2712258 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:05.147855 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749ffaa-5b3a-41ba-8eb1-fe557f9b5254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:05.149254 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749ffaa-5b3a-41ba-8eb1-fe557f9b5254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:05.149803 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749ffaa-5b3a-41ba-8eb1-fe557f9b5254 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:05.150807 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749ffaa-5b3a-41ba-8eb1-fe557f9b5254 admin admin] PATH_INFO: `/v3/projects/a40b2e9220ab47bb9124b9343b644477` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:05.154492 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749ffaa-5b3a-41ba-8eb1-fe557f9b5254 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a40b2e9220ab47bb9124b9343b644477)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:05.158314 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749ffaa-5b3a-41ba-8eb1-fe557f9b5254 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:05.200445 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165d589-0dd8-4a5c-a111-39e1084eb22e service cinder] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:05.202600 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2165d589-0dd8-4a5c-a111-39e1084eb22e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:05.224490 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165d589-0dd8-4a5c-a111-39e1084eb22e service cinder] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:05.251129 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0749ffaa-5b3a-41ba-8eb1-fe557f9b5254 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a40b2e9220ab47bb9124b9343b644477', 'request_id': 'req-0749ffaa-5b3a-41ba-8eb1-fe557f9b5254'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:05.260559 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0749ffaa-5b3a-41ba-8eb1-fe557f9b5254 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a40b2e9220ab47bb9124b9343b644477', 'request_id': 'req-0749ffaa-5b3a-41ba-8eb1-fe557f9b5254'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:05.271411 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0749ffaa-5b3a-41ba-8eb1-fe557f9b5254 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a40b2e9220ab47bb9124b9343b644477', 'request_id': 'req-0749ffaa-5b3a-41ba-8eb1-fe557f9b5254'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:05.297993 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0749ffaa-5b3a-41ba-8eb1-fe557f9b5254 admin admin] The token cache is being invalidate because project a40b2e9220ab47bb9124b9343b644477 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:02:05.298243 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57666e-a4bc-4792-abbe-a80135447e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:05.298430 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0749ffaa-5b3a-41ba-8eb1-fe557f9b5254 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:05.299188 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57666e-a4bc-4792-abbe-a80135447e34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:05.299580 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57666e-a4bc-4792-abbe-a80135447e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:05.299945 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57666e-a4bc-4792-abbe-a80135447e34 admin admin] PATH_INFO: `/v3/users/61b509fb6e07477c8b7bf6799b85eced` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:05.301125 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0749ffaa-5b3a-41ba-8eb1-fe557f9b5254 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:05.301608 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff57666e-a4bc-4792-abbe-a80135447e34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61b509fb6e07477c8b7bf6799b85eced)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:05.303954 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff57666e-a4bc-4792-abbe-a80135447e34 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:05.304173 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2746/5507] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:02:05 2022] DELETE /identity/v3/projects/a40b2e9220ab47bb9124b9343b644477 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:02:05.308617 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2fe1f-c40d-4d6f-8d17-945553e43254 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:05.308901 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2fe1f-c40d-4d6f-8d17-945553e43254 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:05.309181 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2fe1f-c40d-4d6f-8d17-945553e43254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:05.356212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-3ce2fe1f-c40d-4d6f-8d17-945553e43254 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:02:05.386507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3ce2fe1f-c40d-4d6f-8d17-945553e43254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:05.420476 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ff57666e-a4bc-4792-abbe-a80135447e34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61b509fb6e07477c8b7bf6799b85eced'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:05.421257 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ff57666e-a4bc-4792-abbe-a80135447e34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61b509fb6e07477c8b7bf6799b85eced'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:05.427617 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2747/5508] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:02:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:02:05.431319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8c16f-cb06-46c0-bf1a-2db0ba793e15 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:05.433321 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8c16f-cb06-46c0-bf1a-2db0ba793e15 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:05.433598 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8c16f-cb06-46c0-bf1a-2db0ba793e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:05.436914 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ff57666e-a4bc-4792-abbe-a80135447e34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61b509fb6e07477c8b7bf6799b85eced'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:05.452591 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ff57666e-a4bc-4792-abbe-a80135447e34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61b509fb6e07477c8b7bf6799b85eced'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:05.453505 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ff57666e-a4bc-4792-abbe-a80135447e34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61b509fb6e07477c8b7bf6799b85eced'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:05.493313 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-59d8c16f-cb06-46c0-bf1a-2db0ba793e15 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:02:05.496832 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-59d8c16f-cb06-46c0-bf1a-2db0ba793e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:05.500680 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2762/5509] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:02:05 2022] DELETE /identity/v3/users/61b509fb6e07477c8b7bf6799b85eced => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:02:05.505963 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a4f7a-0c30-4f3f-aee0-28220b020b28 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:05.506630 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a4f7a-0c30-4f3f-aee0-28220b020b28 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:05.506979 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a4f7a-0c30-4f3f-aee0-28220b020b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:05.534939 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:05.551920 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-f23a4f7a-0c30-4f3f-aee0-28220b020b28 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:02:05.553184 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f23a4f7a-0c30-4f3f-aee0-28220b020b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:05.665029 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2748/5510] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:02:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:02:05.669125 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d8c16f-cb06-46c0-bf1a-2db0ba793e15 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:05.681199 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d8c16f-cb06-46c0-bf1a-2db0ba793e15 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:05.687847 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2763/5511] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:02:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:02:05.725268 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54741de-c0bc-4e89-9aac-54ff54e295a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:05.726370 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54741de-c0bc-4e89-9aac-54ff54e295a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:05.726653 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54741de-c0bc-4e89-9aac-54ff54e295a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:05.726919 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54741de-c0bc-4e89-9aac-54ff54e295a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:05.729853 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54741de-c0bc-4e89-9aac-54ff54e295a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:02:05.730187 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54741de-c0bc-4e89-9aac-54ff54e295a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:05.731902 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54741de-c0bc-4e89-9aac-54ff54e295a2 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:05.749962 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a4f7a-0c30-4f3f-aee0-28220b020b28 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:05.752053 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f23a4f7a-0c30-4f3f-aee0-28220b020b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:05.770150 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2749/5512] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:02:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:02:05.771420 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54741de-c0bc-4e89-9aac-54ff54e295a2 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:05.812970 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54741de-c0bc-4e89-9aac-54ff54e295a2 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:05.827680 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6debd02-8f2d-4ac9-806b-383027055e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:05.837606 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6debd02-8f2d-4ac9-806b-383027055e11 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:05.841670 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6debd02-8f2d-4ac9-806b-383027055e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:05.842293 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6debd02-8f2d-4ac9-806b-383027055e11 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:05.845887 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6debd02-8f2d-4ac9-806b-383027055e11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:05.850379 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6debd02-8f2d-4ac9-806b-383027055e11 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:05.872706 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:05.876237 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a4f7a-0c30-4f3f-aee0-28220b020b28 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:05.886482 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f84a8-9e8d-4390-b6d2-718786128e37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:05.886722 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f84a8-9e8d-4390-b6d2-718786128e37 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:05.886825 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f84a8-9e8d-4390-b6d2-718786128e37 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:05.887702 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f84a8-9e8d-4390-b6d2-718786128e37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:05.910501 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f84a8-9e8d-4390-b6d2-718786128e37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:05.912288 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f84a8-9e8d-4390-b6d2-718786128e37 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:05.918950 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2750/5513] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:02:05 2022] POST /identity/v3/projects => generated 399 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:02:05.923905 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6debd02-8f2d-4ac9-806b-383027055e11 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:05.929916 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2764/5514] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:02:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:02:06.037192 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6debd02-8f2d-4ac9-806b-383027055e11 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:06.043484 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89386fcc-2d6d-40a8-b584-271a7345afd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:06.044113 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89386fcc-2d6d-40a8-b584-271a7345afd3 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:06.044387 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89386fcc-2d6d-40a8-b584-271a7345afd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:06.048874 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89386fcc-2d6d-40a8-b584-271a7345afd3 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:06.049814 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89386fcc-2d6d-40a8-b584-271a7345afd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:06.051946 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89386fcc-2d6d-40a8-b584-271a7345afd3 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:06.089251 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2751/5515] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:02:05 2022] POST /identity/v3/users => generated 300 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:02:06.093058 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f84a8-9e8d-4390-b6d2-718786128e37 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:06.106278 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f84a8-9e8d-4390-b6d2-718786128e37 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:06.114074 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217692da-a6a2-4393-bf8c-74f465adbb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:06.114852 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217692da-a6a2-4393-bf8c-74f465adbb9c admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:06.115244 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217692da-a6a2-4393-bf8c-74f465adbb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:06.115593 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217692da-a6a2-4393-bf8c-74f465adbb9c admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:06.117515 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217692da-a6a2-4393-bf8c-74f465adbb9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:06.119750 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217692da-a6a2-4393-bf8c-74f465adbb9c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:06.135169 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2765/5516] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:02:06.140525 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89386fcc-2d6d-40a8-b584-271a7345afd3 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:06.157769 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89386fcc-2d6d-40a8-b584-271a7345afd3 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:06.167214 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3798f27-51b2-4f8a-9447-546988cfda56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:06.167951 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3798f27-51b2-4f8a-9447-546988cfda56 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:06.168242 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3798f27-51b2-4f8a-9447-546988cfda56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:06.169302 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3798f27-51b2-4f8a-9447-546988cfda56 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:06.169937 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3798f27-51b2-4f8a-9447-546988cfda56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:06.171954 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3798f27-51b2-4f8a-9447-546988cfda56 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:06.189809 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2752/5517] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:02:06.194105 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217692da-a6a2-4393-bf8c-74f465adbb9c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:06.210188 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217692da-a6a2-4393-bf8c-74f465adbb9c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:06.227776 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2428a0a2-88e2-42f7-9f5b-8f2969f59cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:06.228940 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428a0a2-88e2-42f7-9f5b-8f2969f59cc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:06.229248 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428a0a2-88e2-42f7-9f5b-8f2969f59cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:06.229531 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428a0a2-88e2-42f7-9f5b-8f2969f59cc3 admin admin] PATH_INFO: `/v3/projects/f7d03c12309544fd8cf7870748a3ea30/users/ad48c13a52614472ae2025f02bcd2cb8/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:06.254281 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2428a0a2-88e2-42f7-9f5b-8f2969f59cc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7d03c12309544fd8cf7870748a3ea30, user_id=ad48c13a52614472ae2025f02bcd2cb8, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:06.258199 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2428a0a2-88e2-42f7-9f5b-8f2969f59cc3 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:06.289527 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2766/5518] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:02:06 2022] PUT /identity/v3/projects/f7d03c12309544fd8cf7870748a3ea30/users/ad48c13a52614472ae2025f02bcd2cb8/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:02:06.294587 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94746d7f-09f2-424b-b1cf-b9ebddd96e5f None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:06.295184 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94746d7f-09f2-424b-b1cf-b9ebddd96e5f None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:06.295710 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94746d7f-09f2-424b-b1cf-b9ebddd96e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:06.319172 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-94746d7f-09f2-424b-b1cf-b9ebddd96e5f None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:02:06.321367 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-94746d7f-09f2-424b-b1cf-b9ebddd96e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:06.364234 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf6627-f8f3-4964-9eea-5fe45b3fff01 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:06.364519 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf6627-f8f3-4964-9eea-5fe45b3fff01 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:06.364829 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf6627-f8f3-4964-9eea-5fe45b3fff01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:06.408698 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-f3cf6627-f8f3-4964-9eea-5fe45b3fff01 None None] MFA Rules not processed for user `c1c8b71252e84112bb1fd0513cf49f69`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:02:06.410232 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f3cf6627-f8f3-4964-9eea-5fe45b3fff01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:06.415824 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2753/5519] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:02:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:02:06.426174 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94746d7f-09f2-424b-b1cf-b9ebddd96e5f None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:06.546540 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2767/5520] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:02:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:02:06.547632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf6627-f8f3-4964-9eea-5fe45b3fff01 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:06.552662 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f3cf6627-f8f3-4964-9eea-5fe45b3fff01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:06.565288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94746d7f-09f2-424b-b1cf-b9ebddd96e5f None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:06.583062 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072df47-7eee-48e6-a47c-c4c5accd51d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:06.583534 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf6627-f8f3-4964-9eea-5fe45b3fff01 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:06.584406 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072df47-7eee-48e6-a47c-c4c5accd51d7 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:06.584693 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072df47-7eee-48e6-a47c-c4c5accd51d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:06.589702 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072df47-7eee-48e6-a47c-c4c5accd51d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:06.603493 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce51574-79cd-4879-a062-bc7e2650215e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:06.604172 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce51574-79cd-4879-a062-bc7e2650215e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:06.604453 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce51574-79cd-4879-a062-bc7e2650215e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:06.604728 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce51574-79cd-4879-a062-bc7e2650215e admin admin] PATH_INFO: `/v3/projects/7260083d5eba4837bef21d3634e58d35` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:06.606008 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce51574-79cd-4879-a062-bc7e2650215e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7260083d5eba4837bef21d3634e58d35)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:06.608211 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce51574-79cd-4879-a062-bc7e2650215e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:06.624505 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072df47-7eee-48e6-a47c-c4c5accd51d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:06.629225 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:06.631284 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072df47-7eee-48e6-a47c-c4c5accd51d7 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:06.656009 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2754/5521] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:02:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:02:06.708743 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8ce51574-79cd-4879-a062-bc7e2650215e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7260083d5eba4837bef21d3634e58d35', 'request_id': 'req-8ce51574-79cd-4879-a062-bc7e2650215e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:06.722951 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8ce51574-79cd-4879-a062-bc7e2650215e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7260083d5eba4837bef21d3634e58d35', 'request_id': 'req-8ce51574-79cd-4879-a062-bc7e2650215e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:06.731596 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8ce51574-79cd-4879-a062-bc7e2650215e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7260083d5eba4837bef21d3634e58d35', 'request_id': 'req-8ce51574-79cd-4879-a062-bc7e2650215e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:06.756519 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8ce51574-79cd-4879-a062-bc7e2650215e admin admin] The token cache is being invalidate because project 7260083d5eba4837bef21d3634e58d35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:02:06.757173 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8ce51574-79cd-4879-a062-bc7e2650215e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:06.765962 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8ce51574-79cd-4879-a062-bc7e2650215e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:06.767930 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2768/5522] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:02:06 2022] DELETE /identity/v3/projects/7260083d5eba4837bef21d3634e58d35 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:02:06.773066 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5482ac7-0c85-402e-9dff-926d799c5d55 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:06.773344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5482ac7-0c85-402e-9dff-926d799c5d55 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:06.773619 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5482ac7-0c85-402e-9dff-926d799c5d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:06.808612 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-e5482ac7-0c85-402e-9dff-926d799c5d55 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:02:06.811082 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e5482ac7-0c85-402e-9dff-926d799c5d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:06.822577 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:06.986810 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e8309-fec2-48d0-bb95-c5461fd6d625 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:06.987194 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e8309-fec2-48d0-bb95-c5461fd6d625 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:06.987327 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2755/5523] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:02:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:02:06.987424 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e8309-fec2-48d0-bb95-c5461fd6d625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:07.020738 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-ea6e8309-fec2-48d0-bb95-c5461fd6d625 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:02:07.021977 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ea6e8309-fec2-48d0-bb95-c5461fd6d625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:07.046885 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2769/5524] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:02:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:02:07.048960 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5482ac7-0c85-402e-9dff-926d799c5d55 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:07.069344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5482ac7-0c85-402e-9dff-926d799c5d55 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:07.090565 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031bdb02-c360-4393-9472-4bac82a87506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:07.091230 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bdb02-c360-4393-9472-4bac82a87506 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:07.091515 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bdb02-c360-4393-9472-4bac82a87506 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:07.091794 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bdb02-c360-4393-9472-4bac82a87506 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:07.092467 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031bdb02-c360-4393-9472-4bac82a87506 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:02:07.092774 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031bdb02-c360-4393-9472-4bac82a87506 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:07.094415 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031bdb02-c360-4393-9472-4bac82a87506 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:07.130355 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2756/5525] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:02:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:02:07.131593 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e8309-fec2-48d0-bb95-c5461fd6d625 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:07.147199 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e8309-fec2-48d0-bb95-c5461fd6d625 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:07.156830 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b7035-cef9-4963-ab44-caf03c5d9264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:07.157480 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b7035-cef9-4963-ab44-caf03c5d9264 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:07.158443 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b7035-cef9-4963-ab44-caf03c5d9264 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:07.158732 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b7035-cef9-4963-ab44-caf03c5d9264 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:07.159406 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037b7035-cef9-4963-ab44-caf03c5d9264 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:07.161343 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037b7035-cef9-4963-ab44-caf03c5d9264 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:07.221146 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2770/5526] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:02:07 2022] POST /identity/v3/projects => generated 369 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:02:07.222348 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031bdb02-c360-4393-9472-4bac82a87506 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:07.245369 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031bdb02-c360-4393-9472-4bac82a87506 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:07.390309 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2fb06a-5d99-4e70-aaf7-2cf149e8dfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:07.391121 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fb06a-5d99-4e70-aaf7-2cf149e8dfaf admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:07.391384 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fb06a-5d99-4e70-aaf7-2cf149e8dfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:07.391982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fb06a-5d99-4e70-aaf7-2cf149e8dfaf admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:07.392386 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2fb06a-5d99-4e70-aaf7-2cf149e8dfaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:07.396759 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2fb06a-5d99-4e70-aaf7-2cf149e8dfaf admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:07.447585 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2757/5527] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:02:07 2022] POST /identity/v3/users => generated 285 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:02:07.448416 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b7035-cef9-4963-ab44-caf03c5d9264 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:07.463970 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b7035-cef9-4963-ab44-caf03c5d9264 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:07.502353 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9d5f1-9f14-41d3-834b-4c01eca53b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:07.503521 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9d5f1-9f14-41d3-834b-4c01eca53b1b admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:07.503890 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9d5f1-9f14-41d3-834b-4c01eca53b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:07.504197 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9d5f1-9f14-41d3-834b-4c01eca53b1b admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:07.504923 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d9d5f1-9f14-41d3-834b-4c01eca53b1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:07.512977 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d9d5f1-9f14-41d3-834b-4c01eca53b1b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:07.549755 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2771/5528] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:02:07 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:02:07.551870 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2fb06a-5d99-4e70-aaf7-2cf149e8dfaf admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:07.566015 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2fb06a-5d99-4e70-aaf7-2cf149e8dfaf admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:07.580797 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd21836-0732-44b7-95e2-e4990b388703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:07.581542 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd21836-0732-44b7-95e2-e4990b388703 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:07.582462 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd21836-0732-44b7-95e2-e4990b388703 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:07.582821 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd21836-0732-44b7-95e2-e4990b388703 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:07.584301 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd21836-0732-44b7-95e2-e4990b388703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:07.587054 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd21836-0732-44b7-95e2-e4990b388703 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:07.625995 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2758/5529] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:02:07 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:02:07.627801 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9d5f1-9f14-41d3-834b-4c01eca53b1b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:07.662155 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9d5f1-9f14-41d3-834b-4c01eca53b1b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:07.698778 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dccc548-8dbc-4673-98bb-5700efa3b75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:07.699526 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dccc548-8dbc-4673-98bb-5700efa3b75a admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:07.699800 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dccc548-8dbc-4673-98bb-5700efa3b75a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:07.700082 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dccc548-8dbc-4673-98bb-5700efa3b75a admin admin] PATH_INFO: `/v3/projects/6bfc20c9cf2b44f8a985e1aa174c66bd/users/e24588a36f1549fda72bdc1c29334bfc/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:07.732509 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dccc548-8dbc-4673-98bb-5700efa3b75a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bfc20c9cf2b44f8a985e1aa174c66bd, user_id=e24588a36f1549fda72bdc1c29334bfc, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:07.735172 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dccc548-8dbc-4673-98bb-5700efa3b75a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:07.762926 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2772/5530] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:02:07 2022] PUT /identity/v3/projects/6bfc20c9cf2b44f8a985e1aa174c66bd/users/e24588a36f1549fda72bdc1c29334bfc/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:02:07.776342 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003acdcb-6026-4158-a825-3e669a9f6789 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:07.776752 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003acdcb-6026-4158-a825-3e669a9f6789 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:07.777130 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003acdcb-6026-4158-a825-3e669a9f6789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:07.809999 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-003acdcb-6026-4158-a825-3e669a9f6789 None None] MFA Rules not processed for user `e24588a36f1549fda72bdc1c29334bfc`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:02:07.811600 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-003acdcb-6026-4158-a825-3e669a9f6789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:07.973299 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2759/5531] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:02:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:02:07.984272 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dccc548-8dbc-4673-98bb-5700efa3b75a admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:07.987587 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6dccc548-8dbc-4673-98bb-5700efa3b75a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:08.132344 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dccc548-8dbc-4673-98bb-5700efa3b75a admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:08.149755 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b78142-06e9-4fe8-8882-b167bfe271b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:08.150475 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b78142-06e9-4fe8-8882-b167bfe271b1 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:08.150752 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b78142-06e9-4fe8-8882-b167bfe271b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:08.151038 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b78142-06e9-4fe8-8882-b167bfe271b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:08.166656 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b78142-06e9-4fe8-8882-b167bfe271b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:08.169550 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b78142-06e9-4fe8-8882-b167bfe271b1 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:08.182853 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2773/5532] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:02:07 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:02:11.066825 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003acdcb-6026-4158-a825-3e669a9f6789 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:11.076445 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-003acdcb-6026-4158-a825-3e669a9f6789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:11.097568 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:11.273712 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003acdcb-6026-4158-a825-3e669a9f6789 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:11.286955 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53d5f5-3d3b-4446-9ba7-02b654c66a28 tempest-RoutersAdminTest-1880719172 tempest-RoutersAdminTest-1880719172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b352f19b3d734e3591c19e11d9d5e06c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6631c44c1f348778743cd8a969a09d8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:11.288386 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53d5f5-3d3b-4446-9ba7-02b654c66a28 tempest-RoutersAdminTest-1880719172 tempest-RoutersAdminTest-1880719172-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:11.288866 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53d5f5-3d3b-4446-9ba7-02b654c66a28 tempest-RoutersAdminTest-1880719172 tempest-RoutersAdminTest-1880719172-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:11.289307 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53d5f5-3d3b-4446-9ba7-02b654c66a28 tempest-RoutersAdminTest-1880719172 tempest-RoutersAdminTest-1880719172-project-admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:11.290209 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f53d5f5-3d3b-4446-9ba7-02b654c66a28 tempest-RoutersAdminTest-1880719172 tempest-RoutersAdminTest-1880719172-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:02:11.290697 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f53d5f5-3d3b-4446-9ba7-02b654c66a28 tempest-RoutersAdminTest-1880719172 tempest-RoutersAdminTest-1880719172-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:11.300041 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f53d5f5-3d3b-4446-9ba7-02b654c66a28 tempest-RoutersAdminTest-1880719172 tempest-RoutersAdminTest-1880719172-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:11.361832 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2760/5533] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:02:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:02:11.369841 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b78142-06e9-4fe8-8882-b167bfe271b1 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:11.391362 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b78142-06e9-4fe8-8882-b167bfe271b1 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:11.414234 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e2abd-a23c-4273-aa60-39a656d0567b tempest-RoutersAdminTest-1880719172 tempest-RoutersAdminTest-1880719172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b352f19b3d734e3591c19e11d9d5e06c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6631c44c1f348778743cd8a969a09d8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:11.415252 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e2abd-a23c-4273-aa60-39a656d0567b tempest-RoutersAdminTest-1880719172 tempest-RoutersAdminTest-1880719172-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:11.417163 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e2abd-a23c-4273-aa60-39a656d0567b tempest-RoutersAdminTest-1880719172 tempest-RoutersAdminTest-1880719172-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:11.417607 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e2abd-a23c-4273-aa60-39a656d0567b tempest-RoutersAdminTest-1880719172 tempest-RoutersAdminTest-1880719172-project-admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:11.420728 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e2abd-a23c-4273-aa60-39a656d0567b tempest-RoutersAdminTest-1880719172 tempest-RoutersAdminTest-1880719172-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:11.427444 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e2abd-a23c-4273-aa60-39a656d0567b tempest-RoutersAdminTest-1880719172 tempest-RoutersAdminTest-1880719172-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:11.508967 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2774/5534] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:02:11 2022] POST /identity/v3/projects => generated 347 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:02:11.513047 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53d5f5-3d3b-4446-9ba7-02b654c66a28 tempest-RoutersAdminTest-1880719172 tempest-RoutersAdminTest-1880719172-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:11.541038 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53d5f5-3d3b-4446-9ba7-02b654c66a28 tempest-RoutersAdminTest-1880719172 tempest-RoutersAdminTest-1880719172-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:11.736578 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f41b4b-9892-4484-b5cf-9a9c639019bb tempest-RoutersAdminTest-1880719172 tempest-RoutersAdminTest-1880719172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b352f19b3d734e3591c19e11d9d5e06c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6631c44c1f348778743cd8a969a09d8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:11.737253 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f41b4b-9892-4484-b5cf-9a9c639019bb tempest-RoutersAdminTest-1880719172 tempest-RoutersAdminTest-1880719172-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:11.737688 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f41b4b-9892-4484-b5cf-9a9c639019bb tempest-RoutersAdminTest-1880719172 tempest-RoutersAdminTest-1880719172-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:11.737969 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f41b4b-9892-4484-b5cf-9a9c639019bb tempest-RoutersAdminTest-1880719172 tempest-RoutersAdminTest-1880719172-project-admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:11.738668 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f41b4b-9892-4484-b5cf-9a9c639019bb tempest-RoutersAdminTest-1880719172 tempest-RoutersAdminTest-1880719172-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:02:11.738978 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f41b4b-9892-4484-b5cf-9a9c639019bb tempest-RoutersAdminTest-1880719172 tempest-RoutersAdminTest-1880719172-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:11.751192 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f41b4b-9892-4484-b5cf-9a9c639019bb tempest-RoutersAdminTest-1880719172 tempest-RoutersAdminTest-1880719172-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:11.785481 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2761/5535] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:02:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:02:11.926880 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e2abd-a23c-4273-aa60-39a656d0567b tempest-RoutersAdminTest-1880719172 tempest-RoutersAdminTest-1880719172-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:11.928837 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-636e2abd-a23c-4273-aa60-39a656d0567b tempest-RoutersAdminTest-1880719172 tempest-RoutersAdminTest-1880719172-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:11.975393 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:12.099222 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e2abd-a23c-4273-aa60-39a656d0567b tempest-RoutersAdminTest-1880719172 tempest-RoutersAdminTest-1880719172-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:12.112115 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c3af2-1436-4f6f-b02e-e456ddc4a807 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:12.113204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c3af2-1436-4f6f-b02e-e456ddc4a807 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:12.113712 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c3af2-1436-4f6f-b02e-e456ddc4a807 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:12.114204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c3af2-1436-4f6f-b02e-e456ddc4a807 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:12.119922 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-063c3af2-1436-4f6f-b02e-e456ddc4a807 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:12.330340 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063c3af2-1436-4f6f-b02e-e456ddc4a807 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:12.332399 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063c3af2-1436-4f6f-b02e-e456ddc4a807 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:12.410534 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2775/5536] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:02:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:02:13.191856 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f41b4b-9892-4484-b5cf-9a9c639019bb tempest-RoutersAdminTest-1880719172 tempest-RoutersAdminTest-1880719172-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:13.206770 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f41b4b-9892-4484-b5cf-9a9c639019bb tempest-RoutersAdminTest-1880719172 tempest-RoutersAdminTest-1880719172-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:13.213267 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337cb890-e488-413b-92e9-0f2895b76e1a tempest-RoutersAdminTest-1880719172 tempest-RoutersAdminTest-1880719172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b352f19b3d734e3591c19e11d9d5e06c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6631c44c1f348778743cd8a969a09d8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:13.214935 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337cb890-e488-413b-92e9-0f2895b76e1a tempest-RoutersAdminTest-1880719172 tempest-RoutersAdminTest-1880719172-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:13.215547 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337cb890-e488-413b-92e9-0f2895b76e1a tempest-RoutersAdminTest-1880719172 tempest-RoutersAdminTest-1880719172-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:13.215993 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337cb890-e488-413b-92e9-0f2895b76e1a tempest-RoutersAdminTest-1880719172 tempest-RoutersAdminTest-1880719172-project-admin] PATH_INFO: `/v3/projects/30d01a3df8304bc78480ff17ae85c75e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:13.217540 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337cb890-e488-413b-92e9-0f2895b76e1a tempest-RoutersAdminTest-1880719172 tempest-RoutersAdminTest-1880719172-project-admin] RBAC: Authorizing `identity:delete_project(project_id=30d01a3df8304bc78480ff17ae85c75e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:13.219776 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337cb890-e488-413b-92e9-0f2895b76e1a tempest-RoutersAdminTest-1880719172 tempest-RoutersAdminTest-1880719172-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:13.285851 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-337cb890-e488-413b-92e9-0f2895b76e1a tempest-RoutersAdminTest-1880719172 tempest-RoutersAdminTest-1880719172-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30d01a3df8304bc78480ff17ae85c75e', 'request_id': 'req-337cb890-e488-413b-92e9-0f2895b76e1a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:13.295463 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-337cb890-e488-413b-92e9-0f2895b76e1a tempest-RoutersAdminTest-1880719172 tempest-RoutersAdminTest-1880719172-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30d01a3df8304bc78480ff17ae85c75e', 'request_id': 'req-337cb890-e488-413b-92e9-0f2895b76e1a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:13.304814 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-337cb890-e488-413b-92e9-0f2895b76e1a tempest-RoutersAdminTest-1880719172 tempest-RoutersAdminTest-1880719172-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30d01a3df8304bc78480ff17ae85c75e', 'request_id': 'req-337cb890-e488-413b-92e9-0f2895b76e1a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:13.321263 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-337cb890-e488-413b-92e9-0f2895b76e1a tempest-RoutersAdminTest-1880719172 tempest-RoutersAdminTest-1880719172-project-admin] The token cache is being invalidate because project 30d01a3df8304bc78480ff17ae85c75e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:02:13.321831 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-337cb890-e488-413b-92e9-0f2895b76e1a tempest-RoutersAdminTest-1880719172 tempest-RoutersAdminTest-1880719172-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:13.323965 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-337cb890-e488-413b-92e9-0f2895b76e1a tempest-RoutersAdminTest-1880719172 tempest-RoutersAdminTest-1880719172-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:13.337285 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2762/5537] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:02:13 2022] DELETE /identity/v3/projects/30d01a3df8304bc78480ff17ae85c75e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:02:13.338337 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c3af2-1436-4f6f-b02e-e456ddc4a807 service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:13.452056 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c3af2-1436-4f6f-b02e-e456ddc4a807 service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:13.522332 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ccad8-e40d-477c-91a1-4b7c47a244bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:13.523357 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ccad8-e40d-477c-91a1-4b7c47a244bf service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:13.523802 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ccad8-e40d-477c-91a1-4b7c47a244bf service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:13.524428 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ccad8-e40d-477c-91a1-4b7c47a244bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:13.528218 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f93ccad8-e40d-477c-91a1-4b7c47a244bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:13.547578 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:13.633259 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ccad8-e40d-477c-91a1-4b7c47a244bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:13.634887 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ccad8-e40d-477c-91a1-4b7c47a244bf service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:13.655539 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337cb890-e488-413b-92e9-0f2895b76e1a tempest-RoutersAdminTest-1880719172 tempest-RoutersAdminTest-1880719172-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:13.656954 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-337cb890-e488-413b-92e9-0f2895b76e1a tempest-RoutersAdminTest-1880719172 tempest-RoutersAdminTest-1880719172-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:13.669498 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2776/5538] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:02:13 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:02:13.718755 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:13.838823 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337cb890-e488-413b-92e9-0f2895b76e1a tempest-RoutersAdminTest-1880719172 tempest-RoutersAdminTest-1880719172-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:13.854507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd39e83-83c3-475d-8140-3fc0abdf8791 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:13.855307 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd39e83-83c3-475d-8140-3fc0abdf8791 service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:13.855696 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd39e83-83c3-475d-8140-3fc0abdf8791 service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:13.856080 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd39e83-83c3-475d-8140-3fc0abdf8791 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:13.862161 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0cd39e83-83c3-475d-8140-3fc0abdf8791 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:13.977012 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd39e83-83c3-475d-8140-3fc0abdf8791 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:13.978749 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd39e83-83c3-475d-8140-3fc0abdf8791 service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:13.995215 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2763/5539] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 16:02:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 16:02:20.859193 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba1d40-60d2-43ef-a25e-d3b7be23d15a None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:20.859701 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba1d40-60d2-43ef-a25e-d3b7be23d15a None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:20.859804 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba1d40-60d2-43ef-a25e-d3b7be23d15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:20.922736 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-90ba1d40-60d2-43ef-a25e-d3b7be23d15a None None] MFA Rules not processed for user `ad48c13a52614472ae2025f02bcd2cb8`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:02:20.924667 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-90ba1d40-60d2-43ef-a25e-d3b7be23d15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:21.083476 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2777/5540] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:02:20 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:02:21.362221 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3b387-661a-4905-a891-44e20b7c6b94 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:21.362221 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3b387-661a-4905-a891-44e20b7c6b94 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:21.362221 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3b387-661a-4905-a891-44e20b7c6b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:21.362221 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-3ce3b387-661a-4905-a891-44e20b7c6b94 None None] MFA Rules not processed for user `ad48c13a52614472ae2025f02bcd2cb8`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:02:21.362221 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3ce3b387-661a-4905-a891-44e20b7c6b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:21.362221 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2764/5541] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:02:21 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:02:21.714504 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba1d40-60d2-43ef-a25e-d3b7be23d15a None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:21.715971 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-90ba1d40-60d2-43ef-a25e-d3b7be23d15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:21.925205 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba1d40-60d2-43ef-a25e-d3b7be23d15a None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:21.933866 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc4c44-8f12-4111-b113-44acf5e12711 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:21.934849 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc4c44-8f12-4111-b113-44acf5e12711 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:21.935359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc4c44-8f12-4111-b113-44acf5e12711 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:21.935955 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc4c44-8f12-4111-b113-44acf5e12711 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:21.949369 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcc4c44-8f12-4111-b113-44acf5e12711 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:21.951972 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcc4c44-8f12-4111-b113-44acf5e12711 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:21.970608 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2778/5542] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:02:21 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:02:31.243266 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=49 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:31.963459 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=86 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:45.298920 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3b387-661a-4905-a891-44e20b7c6b94 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:45.301181 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3ce3b387-661a-4905-a891-44e20b7c6b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:45.502981 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3b387-661a-4905-a891-44e20b7c6b94 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:45.517096 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea08bac-2ff6-4f41-93e1-3c2ed097cf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:45.518204 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea08bac-2ff6-4f41-93e1-3c2ed097cf72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:45.518655 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea08bac-2ff6-4f41-93e1-3c2ed097cf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:45.519116 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea08bac-2ff6-4f41-93e1-3c2ed097cf72 admin admin] PATH_INFO: `/v3/users/e24588a36f1549fda72bdc1c29334bfc` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:45.520732 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea08bac-2ff6-4f41-93e1-3c2ed097cf72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e24588a36f1549fda72bdc1c29334bfc)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:45.522876 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea08bac-2ff6-4f41-93e1-3c2ed097cf72 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:45.620397 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-bea08bac-2ff6-4f41-93e1-3c2ed097cf72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e24588a36f1549fda72bdc1c29334bfc'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:45.620397 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-bea08bac-2ff6-4f41-93e1-3c2ed097cf72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e24588a36f1549fda72bdc1c29334bfc'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:45.634419 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-bea08bac-2ff6-4f41-93e1-3c2ed097cf72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e24588a36f1549fda72bdc1c29334bfc'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:45.645910 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-bea08bac-2ff6-4f41-93e1-3c2ed097cf72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e24588a36f1549fda72bdc1c29334bfc'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:45.654753 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-bea08bac-2ff6-4f41-93e1-3c2ed097cf72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e24588a36f1549fda72bdc1c29334bfc'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:45.666309 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2765/5543] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:02:45 2022] DELETE /identity/v3/users/e24588a36f1549fda72bdc1c29334bfc => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:02:45.667490 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37390eb6-d57e-4469-ac2b-314970f33fd0 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:45.668051 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37390eb6-d57e-4469-ac2b-314970f33fd0 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:45.668206 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37390eb6-d57e-4469-ac2b-314970f33fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:45.692859 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-37390eb6-d57e-4469-ac2b-314970f33fd0 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:02:45.694469 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-37390eb6-d57e-4469-ac2b-314970f33fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:45.803258 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2779/5544] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:02:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:02:45.812686 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea08bac-2ff6-4f41-93e1-3c2ed097cf72 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:45.814877 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-bea08bac-2ff6-4f41-93e1-3c2ed097cf72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:45.967340 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea08bac-2ff6-4f41-93e1-3c2ed097cf72 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:45.971658 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64472715-0fee-4923-8972-18ddad51c2e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:45.972278 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64472715-0fee-4923-8972-18ddad51c2e7 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:45.972764 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64472715-0fee-4923-8972-18ddad51c2e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:45.973410 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64472715-0fee-4923-8972-18ddad51c2e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:45.985556 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64472715-0fee-4923-8972-18ddad51c2e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:45.987088 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64472715-0fee-4923-8972-18ddad51c2e7 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:45.999852 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2766/5545] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:02:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:02:46.349026 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37390eb6-d57e-4469-ac2b-314970f33fd0 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:46.351327 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-37390eb6-d57e-4469-ac2b-314970f33fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:46.378841 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37390eb6-d57e-4469-ac2b-314970f33fd0 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:46.394721 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023621f-8837-4765-bbaa-80272004e6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:46.397364 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023621f-8837-4765-bbaa-80272004e6c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:46.399284 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023621f-8837-4765-bbaa-80272004e6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:46.401133 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023621f-8837-4765-bbaa-80272004e6c8 admin admin] PATH_INFO: `/v3/projects/6bfc20c9cf2b44f8a985e1aa174c66bd` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:46.406465 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f023621f-8837-4765-bbaa-80272004e6c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bfc20c9cf2b44f8a985e1aa174c66bd)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:46.412486 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f023621f-8837-4765-bbaa-80272004e6c8 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:46.550456 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f023621f-8837-4765-bbaa-80272004e6c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bfc20c9cf2b44f8a985e1aa174c66bd', 'request_id': 'req-f023621f-8837-4765-bbaa-80272004e6c8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:46.571823 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f023621f-8837-4765-bbaa-80272004e6c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bfc20c9cf2b44f8a985e1aa174c66bd', 'request_id': 'req-f023621f-8837-4765-bbaa-80272004e6c8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:46.582990 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f023621f-8837-4765-bbaa-80272004e6c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bfc20c9cf2b44f8a985e1aa174c66bd', 'request_id': 'req-f023621f-8837-4765-bbaa-80272004e6c8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:46.604294 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f023621f-8837-4765-bbaa-80272004e6c8 admin admin] The token cache is being invalidate because project 6bfc20c9cf2b44f8a985e1aa174c66bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:02:46.604759 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f023621f-8837-4765-bbaa-80272004e6c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:46.605401 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f023621f-8837-4765-bbaa-80272004e6c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:46.613068 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2780/5546] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:02:46 2022] DELETE /identity/v3/projects/6bfc20c9cf2b44f8a985e1aa174c66bd => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:02:46.614964 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76810c-fdb5-4bc3-8956-a464503c18ab None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:46.615591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76810c-fdb5-4bc3-8956-a464503c18ab None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:46.615591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76810c-fdb5-4bc3-8956-a464503c18ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:46.683892 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-ea76810c-fdb5-4bc3-8956-a464503c18ab None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:02:46.688008 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ea76810c-fdb5-4bc3-8956-a464503c18ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:46.758199 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:46.879757 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2767/5547] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:02:46.883438 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9bc78-06de-4af7-8d09-47fcfb22f584 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:46.883950 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9bc78-06de-4af7-8d09-47fcfb22f584 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:46.884070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9bc78-06de-4af7-8d09-47fcfb22f584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:46.912734 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-59e9bc78-06de-4af7-8d09-47fcfb22f584 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:02:46.931946 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-59e9bc78-06de-4af7-8d09-47fcfb22f584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:46.951811 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2781/5548] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:02:46.953589 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76810c-fdb5-4bc3-8956-a464503c18ab None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:46.969039 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76810c-fdb5-4bc3-8956-a464503c18ab None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:46.979764 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f490d-0956-4918-8220-7403f3909517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:46.980412 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f490d-0956-4918-8220-7403f3909517 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:46.980699 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f490d-0956-4918-8220-7403f3909517 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:46.980977 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f490d-0956-4918-8220-7403f3909517 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:46.981762 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56f490d-0956-4918-8220-7403f3909517 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:02:46.982077 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56f490d-0956-4918-8220-7403f3909517 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:46.983758 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56f490d-0956-4918-8220-7403f3909517 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:47.019665 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2768/5549] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:02:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:02:47.021608 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e9bc78-06de-4af7-8d09-47fcfb22f584 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:47.031627 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e9bc78-06de-4af7-8d09-47fcfb22f584 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:47.037291 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311924cc-69cd-4570-a070-7f1ca328ae94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:47.037956 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311924cc-69cd-4570-a070-7f1ca328ae94 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:47.038543 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311924cc-69cd-4570-a070-7f1ca328ae94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:47.038809 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311924cc-69cd-4570-a070-7f1ca328ae94 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:47.040211 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311924cc-69cd-4570-a070-7f1ca328ae94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:47.042194 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311924cc-69cd-4570-a070-7f1ca328ae94 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:47.088725 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2782/5550] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:02:47 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:02:47.092963 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f490d-0956-4918-8220-7403f3909517 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:47.104373 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f490d-0956-4918-8220-7403f3909517 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:47.196605 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a34c82-39db-4b5f-946d-e232f2a6eb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:47.197413 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a34c82-39db-4b5f-946d-e232f2a6eb8c admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:47.197695 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a34c82-39db-4b5f-946d-e232f2a6eb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:47.197971 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a34c82-39db-4b5f-946d-e232f2a6eb8c admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:47.198837 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a34c82-39db-4b5f-946d-e232f2a6eb8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:47.200865 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a34c82-39db-4b5f-946d-e232f2a6eb8c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:47.247411 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2769/5551] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:02:47 2022] POST /identity/v3/users => generated 293 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:02:47.249273 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311924cc-69cd-4570-a070-7f1ca328ae94 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:47.262631 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311924cc-69cd-4570-a070-7f1ca328ae94 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:47.268325 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe362b-c986-4a1c-aaf7-9d06579330ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:47.269300 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe362b-c986-4a1c-aaf7-9d06579330ae admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:47.269824 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe362b-c986-4a1c-aaf7-9d06579330ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:47.270332 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe362b-c986-4a1c-aaf7-9d06579330ae admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:47.271249 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbe362b-c986-4a1c-aaf7-9d06579330ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:47.287848 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbe362b-c986-4a1c-aaf7-9d06579330ae admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:47.326052 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2783/5552] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:02:47.327346 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a34c82-39db-4b5f-946d-e232f2a6eb8c admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:47.353272 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a34c82-39db-4b5f-946d-e232f2a6eb8c admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:47.379397 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44131538-7cac-4a43-9bf3-a51567359cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:47.380039 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44131538-7cac-4a43-9bf3-a51567359cdd admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:47.380396 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44131538-7cac-4a43-9bf3-a51567359cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:47.380730 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44131538-7cac-4a43-9bf3-a51567359cdd admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:47.382360 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44131538-7cac-4a43-9bf3-a51567359cdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:47.384930 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44131538-7cac-4a43-9bf3-a51567359cdd admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:47.409990 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2770/5553] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:02:47.411376 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe362b-c986-4a1c-aaf7-9d06579330ae admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:47.426070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe362b-c986-4a1c-aaf7-9d06579330ae admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:47.431315 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb8e9e-6d15-4edd-a0da-ee596e220db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:47.432239 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb8e9e-6d15-4edd-a0da-ee596e220db2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:47.432850 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb8e9e-6d15-4edd-a0da-ee596e220db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:47.433419 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb8e9e-6d15-4edd-a0da-ee596e220db2 admin admin] PATH_INFO: `/v3/projects/b33c4d3df1924affab86f0ef783cdeb4/users/0310cfcd45d244299aba39e4f39f199e/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:47.455055 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bb8e9e-6d15-4edd-a0da-ee596e220db2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b33c4d3df1924affab86f0ef783cdeb4, user_id=0310cfcd45d244299aba39e4f39f199e, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:47.459194 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bb8e9e-6d15-4edd-a0da-ee596e220db2 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:47.492535 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2784/5554] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:02:47 2022] PUT /identity/v3/projects/b33c4d3df1924affab86f0ef783cdeb4/users/0310cfcd45d244299aba39e4f39f199e/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:02:47.504050 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47899cf2-ab4b-4238-8711-0f4ce9c4c348 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:47.504288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47899cf2-ab4b-4238-8711-0f4ce9c4c348 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:47.504680 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47899cf2-ab4b-4238-8711-0f4ce9c4c348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:47.560772 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-47899cf2-ab4b-4238-8711-0f4ce9c4c348 None None] MFA Rules not processed for user `0310cfcd45d244299aba39e4f39f199e`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:02:47.562402 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-47899cf2-ab4b-4238-8711-0f4ce9c4c348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:47.648889 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2771/5555] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:02:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:02:47.664024 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb8e9e-6d15-4edd-a0da-ee596e220db2 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:47.669973 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e6bb8e9e-6d15-4edd-a0da-ee596e220db2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:47.709869 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:47.765768 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb8e9e-6d15-4edd-a0da-ee596e220db2 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:47.770622 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4f19f-d1f5-405d-8d2b-02efdc0ce065 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:47.771269 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4f19f-d1f5-405d-8d2b-02efdc0ce065 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:47.771556 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4f19f-d1f5-405d-8d2b-02efdc0ce065 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:47.771819 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4f19f-d1f5-405d-8d2b-02efdc0ce065 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:47.783156 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4f19f-d1f5-405d-8d2b-02efdc0ce065 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:47.784782 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4f19f-d1f5-405d-8d2b-02efdc0ce065 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:47.796173 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2785/5556] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:02:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:02:51.963386 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47899cf2-ab4b-4238-8711-0f4ce9c4c348 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:51.964829 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-47899cf2-ab4b-4238-8711-0f4ce9c4c348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:51.981986 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47899cf2-ab4b-4238-8711-0f4ce9c4c348 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:51.989119 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad2e12-49ca-4ca4-bab2-461d5dfb0427 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:51.990233 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad2e12-49ca-4ca4-bab2-461d5dfb0427 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:51.995835 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad2e12-49ca-4ca4-bab2-461d5dfb0427 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:51.996586 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad2e12-49ca-4ca4-bab2-461d5dfb0427 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:52.001107 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5cad2e12-49ca-4ca4-bab2-461d5dfb0427 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:52.022559 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:52.118691 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cad2e12-49ca-4ca4-bab2-461d5dfb0427 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:52.120845 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cad2e12-49ca-4ca4-bab2-461d5dfb0427 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:52.136491 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2772/5557] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:02:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:02:53.398014 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4f19f-d1f5-405d-8d2b-02efdc0ce065 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:53.423534 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4f19f-d1f5-405d-8d2b-02efdc0ce065 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:53.440238 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c4f6c7-ce01-4797-a76c-1c445679cd14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:53.444778 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4f6c7-ce01-4797-a76c-1c445679cd14 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:53.445064 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4f6c7-ce01-4797-a76c-1c445679cd14 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:53.445338 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4f6c7-ce01-4797-a76c-1c445679cd14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:53.450018 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c4c4f6c7-ce01-4797-a76c-1c445679cd14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:53.471134 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c4f6c7-ce01-4797-a76c-1c445679cd14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:53.473037 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c4f6c7-ce01-4797-a76c-1c445679cd14 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:53.508710 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2786/5558] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:02:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:02:58.395704 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad2e12-49ca-4ca4-bab2-461d5dfb0427 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:58.397715 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5cad2e12-49ca-4ca4-bab2-461d5dfb0427 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:58.432080 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c4f6c7-ce01-4797-a76c-1c445679cd14 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:58.434064 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c4c4f6c7-ce01-4797-a76c-1c445679cd14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:58.520316 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad2e12-49ca-4ca4-bab2-461d5dfb0427 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:58.543232 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe01110-c3f5-402a-bee1-7f545a6619a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:58.543892 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe01110-c3f5-402a-bee1-7f545a6619a4 service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:58.544171 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe01110-c3f5-402a-bee1-7f545a6619a4 service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:58.544441 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe01110-c3f5-402a-bee1-7f545a6619a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:58.571776 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6fe01110-c3f5-402a-bee1-7f545a6619a4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:58.620007 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe01110-c3f5-402a-bee1-7f545a6619a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:58.622145 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe01110-c3f5-402a-bee1-7f545a6619a4 service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:58.674125 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c4f6c7-ce01-4797-a76c-1c445679cd14 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:58.686036 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2773/5559] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:02:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:02:58.698495 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c0118-da44-444f-9ea0-5e2edfe4cd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:58.699380 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c0118-da44-444f-9ea0-5e2edfe4cd28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:58.699706 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c0118-da44-444f-9ea0-5e2edfe4cd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:58.700326 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c0118-da44-444f-9ea0-5e2edfe4cd28 admin admin] PATH_INFO: `/v3/users/ad48c13a52614472ae2025f02bcd2cb8` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:58.703562 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c0118-da44-444f-9ea0-5e2edfe4cd28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad48c13a52614472ae2025f02bcd2cb8)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:58.706989 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c0118-da44-444f-9ea0-5e2edfe4cd28 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:59.068683 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e28c0118-da44-444f-9ea0-5e2edfe4cd28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad48c13a52614472ae2025f02bcd2cb8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:59.069523 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e28c0118-da44-444f-9ea0-5e2edfe4cd28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad48c13a52614472ae2025f02bcd2cb8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:59.083676 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e28c0118-da44-444f-9ea0-5e2edfe4cd28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad48c13a52614472ae2025f02bcd2cb8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:59.098324 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e28c0118-da44-444f-9ea0-5e2edfe4cd28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad48c13a52614472ae2025f02bcd2cb8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:59.099979 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e28c0118-da44-444f-9ea0-5e2edfe4cd28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad48c13a52614472ae2025f02bcd2cb8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:59.146780 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2787/5560] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:02:58 2022] DELETE /identity/v3/users/ad48c13a52614472ae2025f02bcd2cb8 => generated 0 bytes in 716 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:03:00.343271 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe01110-c3f5-402a-bee1-7f545a6619a4 service placement] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:00.364895 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe01110-c3f5-402a-bee1-7f545a6619a4 service placement] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:00.536703 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e442e-548b-4810-97cd-1f683c28b721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:00.538047 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e442e-548b-4810-97cd-1f683c28b721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:00.539816 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e442e-548b-4810-97cd-1f683c28b721 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:00.541468 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e442e-548b-4810-97cd-1f683c28b721 admin admin] PATH_INFO: `/v3/projects/f7d03c12309544fd8cf7870748a3ea30` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:00.544849 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97e442e-548b-4810-97cd-1f683c28b721 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7d03c12309544fd8cf7870748a3ea30)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:00.549480 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97e442e-548b-4810-97cd-1f683c28b721 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:00.715954 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:00.742186 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f97e442e-548b-4810-97cd-1f683c28b721 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7d03c12309544fd8cf7870748a3ea30', 'request_id': 'req-f97e442e-548b-4810-97cd-1f683c28b721'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:00.775607 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f97e442e-548b-4810-97cd-1f683c28b721 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7d03c12309544fd8cf7870748a3ea30', 'request_id': 'req-f97e442e-548b-4810-97cd-1f683c28b721'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:00.792782 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f97e442e-548b-4810-97cd-1f683c28b721 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7d03c12309544fd8cf7870748a3ea30', 'request_id': 'req-f97e442e-548b-4810-97cd-1f683c28b721'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:00.832952 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f97e442e-548b-4810-97cd-1f683c28b721 admin admin] The token cache is being invalidate because project f7d03c12309544fd8cf7870748a3ea30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:03:00.833729 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f97e442e-548b-4810-97cd-1f683c28b721 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:00.835564 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f97e442e-548b-4810-97cd-1f683c28b721 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:00.844004 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2774/5561] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:03:00 2022] DELETE /identity/v3/projects/f7d03c12309544fd8cf7870748a3ea30 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:03:00.847297 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15506ba1-4c6b-4be3-b92e-504c456b4158 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:00.847830 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15506ba1-4c6b-4be3-b92e-504c456b4158 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:00.847830 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15506ba1-4c6b-4be3-b92e-504c456b4158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:00.919186 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-15506ba1-4c6b-4be3-b92e-504c456b4158 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:03:00.926555 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-15506ba1-4c6b-4be3-b92e-504c456b4158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:01.025165 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e442e-548b-4810-97cd-1f683c28b721 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:01.026848 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f97e442e-548b-4810-97cd-1f683c28b721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:01.031200 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:01.206721 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2788/5562] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:03:01.208414 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1877ec-6350-4d8e-923d-b6de960b7ccd None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:01.208768 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1877ec-6350-4d8e-923d-b6de960b7ccd None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:01.209102 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1877ec-6350-4d8e-923d-b6de960b7ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:01.261841 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-2a1877ec-6350-4d8e-923d-b6de960b7ccd None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:03:01.265698 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2a1877ec-6350-4d8e-923d-b6de960b7ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:01.306397 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2789/5563] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:03:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:03:01.308634 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1877ec-6350-4d8e-923d-b6de960b7ccd None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:01.318551 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e442e-548b-4810-97cd-1f683c28b721 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:01.336827 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1877ec-6350-4d8e-923d-b6de960b7ccd None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:01.341327 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f3a55-2733-45ed-8513-38eddd46dcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:01.341961 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f3a55-2733-45ed-8513-38eddd46dcf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:01.342254 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f3a55-2733-45ed-8513-38eddd46dcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:01.342549 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f3a55-2733-45ed-8513-38eddd46dcf2 admin admin] PATH_INFO: `/v3/users/0310cfcd45d244299aba39e4f39f199e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:01.346039 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950f3a55-2733-45ed-8513-38eddd46dcf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0310cfcd45d244299aba39e4f39f199e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:01.348053 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950f3a55-2733-45ed-8513-38eddd46dcf2 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:01.355112 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfc4330-008b-48a1-ad4b-4d15ba989f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:01.355883 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc4330-008b-48a1-ad4b-4d15ba989f6b admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:01.356164 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc4330-008b-48a1-ad4b-4d15ba989f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:01.356431 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc4330-008b-48a1-ad4b-4d15ba989f6b admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:01.362206 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfc4330-008b-48a1-ad4b-4d15ba989f6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:03:01.362739 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfc4330-008b-48a1-ad4b-4d15ba989f6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:01.364841 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfc4330-008b-48a1-ad4b-4d15ba989f6b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:01.431390 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2790/5564] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:03:01.434952 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfc4330-008b-48a1-ad4b-4d15ba989f6b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:01.464860 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfc4330-008b-48a1-ad4b-4d15ba989f6b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:01.471860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-950f3a55-2733-45ed-8513-38eddd46dcf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0310cfcd45d244299aba39e4f39f199e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:01.472605 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-950f3a55-2733-45ed-8513-38eddd46dcf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0310cfcd45d244299aba39e4f39f199e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:01.474041 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb4bfb-e22e-44da-9ce5-7486b6b9f41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:01.474879 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb4bfb-e22e-44da-9ce5-7486b6b9f41c admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:01.475356 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb4bfb-e22e-44da-9ce5-7486b6b9f41c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:01.475957 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb4bfb-e22e-44da-9ce5-7486b6b9f41c admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:01.476755 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb4bfb-e22e-44da-9ce5-7486b6b9f41c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:01.478863 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb4bfb-e22e-44da-9ce5-7486b6b9f41c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:01.489509 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-950f3a55-2733-45ed-8513-38eddd46dcf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0310cfcd45d244299aba39e4f39f199e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:01.502560 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-950f3a55-2733-45ed-8513-38eddd46dcf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0310cfcd45d244299aba39e4f39f199e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:01.527060 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2791/5565] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:03:01 2022] POST /identity/v3/projects => generated 379 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:03:01.527060 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb4bfb-e22e-44da-9ce5-7486b6b9f41c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:01.527419 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-950f3a55-2733-45ed-8513-38eddd46dcf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0310cfcd45d244299aba39e4f39f199e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:01.527535 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b8eb4bfb-e22e-44da-9ce5-7486b6b9f41c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:01.531175 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2775/5566] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:03:01 2022] DELETE /identity/v3/users/0310cfcd45d244299aba39e4f39f199e => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:03:01.533457 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f3a55-2733-45ed-8513-38eddd46dcf2 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:01.535478 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-950f3a55-2733-45ed-8513-38eddd46dcf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:01.601312 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:01.629579 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f3a55-2733-45ed-8513-38eddd46dcf2 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:01.630467 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb4bfb-e22e-44da-9ce5-7486b6b9f41c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:01.639172 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd59019-db70-49e3-b84e-c299a79b76d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:01.639963 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd59019-db70-49e3-b84e-c299a79b76d0 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:01.640335 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd59019-db70-49e3-b84e-c299a79b76d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:01.640700 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd59019-db70-49e3-b84e-c299a79b76d0 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:01.642133 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd59019-db70-49e3-b84e-c299a79b76d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:01.648327 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd59019-db70-49e3-b84e-c299a79b76d0 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:01.710907 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2776/5567] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:03:01 2022] POST /identity/v3/users => generated 290 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:03:01.711913 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaec80a-3fcb-4c37-9231-d97c840cb92a None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:01.712220 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaec80a-3fcb-4c37-9231-d97c840cb92a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:01.712982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaec80a-3fcb-4c37-9231-d97c840cb92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:01.759054 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-5aaec80a-3fcb-4c37-9231-d97c840cb92a None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:03:01.778255 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5aaec80a-3fcb-4c37-9231-d97c840cb92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:01.794190 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c49c82-299e-4e4e-b302-66622b707597 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:01.794831 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c49c82-299e-4e4e-b302-66622b707597 service swift] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:01.795137 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c49c82-299e-4e4e-b302-66622b707597 service swift] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:01.795416 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c49c82-299e-4e4e-b302-66622b707597 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:01.797592 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2777/5568] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:03:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:03:01.798651 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaec80a-3fcb-4c37-9231-d97c840cb92a None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:01.805970 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-24c49c82-299e-4e4e-b302-66622b707597 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:01.822398 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaec80a-3fcb-4c37-9231-d97c840cb92a None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:01.829956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed237348-efa9-4f9a-b542-b53e0f515276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:01.830901 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed237348-efa9-4f9a-b542-b53e0f515276 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:01.831234 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed237348-efa9-4f9a-b542-b53e0f515276 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:01.831540 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed237348-efa9-4f9a-b542-b53e0f515276 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:01.832222 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed237348-efa9-4f9a-b542-b53e0f515276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:01.833919 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed237348-efa9-4f9a-b542-b53e0f515276 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:01.846840 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2778/5569] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:03:01.847522 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed237348-efa9-4f9a-b542-b53e0f515276 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:01.849945 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ed237348-efa9-4f9a-b542-b53e0f515276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:01.882663 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:01.950073 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed237348-efa9-4f9a-b542-b53e0f515276 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:01.956198 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c49c82-299e-4e4e-b302-66622b707597 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:01.956401 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381da15-6b51-4d6f-b0d1-823e18f2cf71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:01.956986 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381da15-6b51-4d6f-b0d1-823e18f2cf71 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:01.957263 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381da15-6b51-4d6f-b0d1-823e18f2cf71 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:01.957533 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381da15-6b51-4d6f-b0d1-823e18f2cf71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:01.958917 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c49c82-299e-4e4e-b302-66622b707597 service swift] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:01.970778 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4381da15-6b51-4d6f-b0d1-823e18f2cf71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:01.972333 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4381da15-6b51-4d6f-b0d1-823e18f2cf71 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:01.981693 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2792/5570] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 16:03:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 734 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:03:01.982724 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c49c82-299e-4e4e-b302-66622b707597 service swift] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:01.995262 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2779/5571] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:03:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:03:01.995467 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c49c82-299e-4e4e-b302-66622b707597 service swift] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:02.000354 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d3160-2c1f-4a3e-b8bb-5c00ec3cff18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:02.001914 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d3160-2c1f-4a3e-b8bb-5c00ec3cff18 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:02.003077 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d3160-2c1f-4a3e-b8bb-5c00ec3cff18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:02.003546 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d3160-2c1f-4a3e-b8bb-5c00ec3cff18 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:02.004769 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527d3160-2c1f-4a3e-b8bb-5c00ec3cff18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:02.006840 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527d3160-2c1f-4a3e-b8bb-5c00ec3cff18 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:02.024534 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2793/5572] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:03:02.025540 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381da15-6b51-4d6f-b0d1-823e18f2cf71 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:02.036977 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381da15-6b51-4d6f-b0d1-823e18f2cf71 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:02.051577 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d53b3-954b-4229-8aed-41b3225fbc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:02.052263 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d53b3-954b-4229-8aed-41b3225fbc80 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:02.052591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d53b3-954b-4229-8aed-41b3225fbc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:02.052800 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d53b3-954b-4229-8aed-41b3225fbc80 admin admin] PATH_INFO: `/v3/projects/8cf22730fb014345a7ed2aeb866bbe61/users/f075974a803f46eda667db6d754453ba/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:02.090078 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813d53b3-954b-4229-8aed-41b3225fbc80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cf22730fb014345a7ed2aeb866bbe61, user_id=f075974a803f46eda667db6d754453ba, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:02.092898 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813d53b3-954b-4229-8aed-41b3225fbc80 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:02.123711 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2780/5573] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:03:02 2022] PUT /identity/v3/projects/8cf22730fb014345a7ed2aeb866bbe61/users/f075974a803f46eda667db6d754453ba/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:03:02.129462 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b5b95-b601-4674-95d4-11d154330812 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:02.129756 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b5b95-b601-4674-95d4-11d154330812 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:02.130026 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b5b95-b601-4674-95d4-11d154330812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:02.165098 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-e06b5b95-b601-4674-95d4-11d154330812 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:03:02.166468 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e06b5b95-b601-4674-95d4-11d154330812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:02.308648 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2794/5574] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:03:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:03:02.323410 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d53b3-954b-4229-8aed-41b3225fbc80 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:02.471395 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d53b3-954b-4229-8aed-41b3225fbc80 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:02.481584 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8eed2f-cd6e-476a-9865-0af6f7cf4d2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:02.483361 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8eed2f-cd6e-476a-9865-0af6f7cf4d2d service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:02.483656 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8eed2f-cd6e-476a-9865-0af6f7cf4d2d service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:02.484091 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8eed2f-cd6e-476a-9865-0af6f7cf4d2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:02.508282 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8eed2f-cd6e-476a-9865-0af6f7cf4d2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:02.509861 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8eed2f-cd6e-476a-9865-0af6f7cf4d2d service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:02.535517 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2781/5575] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:03:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:03:02.588923 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b5b95-b601-4674-95d4-11d154330812 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:02.590823 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e06b5b95-b601-4674-95d4-11d154330812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:02.632499 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b5b95-b601-4674-95d4-11d154330812 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:02.653787 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19bfa2f-76aa-4c56-a62e-77b201c090e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:02.654512 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bfa2f-76aa-4c56-a62e-77b201c090e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:02.654791 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bfa2f-76aa-4c56-a62e-77b201c090e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:02.655167 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bfa2f-76aa-4c56-a62e-77b201c090e3 admin admin] PATH_INFO: `/v3/projects/b33c4d3df1924affab86f0ef783cdeb4` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:02.661659 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19bfa2f-76aa-4c56-a62e-77b201c090e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b33c4d3df1924affab86f0ef783cdeb4)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:02.691409 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19bfa2f-76aa-4c56-a62e-77b201c090e3 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:02.810138 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e19bfa2f-76aa-4c56-a62e-77b201c090e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b33c4d3df1924affab86f0ef783cdeb4', 'request_id': 'req-e19bfa2f-76aa-4c56-a62e-77b201c090e3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:02.818301 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e19bfa2f-76aa-4c56-a62e-77b201c090e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b33c4d3df1924affab86f0ef783cdeb4', 'request_id': 'req-e19bfa2f-76aa-4c56-a62e-77b201c090e3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:02.828509 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e19bfa2f-76aa-4c56-a62e-77b201c090e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b33c4d3df1924affab86f0ef783cdeb4', 'request_id': 'req-e19bfa2f-76aa-4c56-a62e-77b201c090e3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:02.848883 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e19bfa2f-76aa-4c56-a62e-77b201c090e3 admin admin] The token cache is being invalidate because project b33c4d3df1924affab86f0ef783cdeb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:03:02.849367 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e19bfa2f-76aa-4c56-a62e-77b201c090e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:02.850260 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e19bfa2f-76aa-4c56-a62e-77b201c090e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:02.856106 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2795/5576] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:03:02 2022] DELETE /identity/v3/projects/b33c4d3df1924affab86f0ef783cdeb4 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:03:02.857470 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d8023-9082-4003-8723-788ee61ae65d None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:02.857762 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d8023-9082-4003-8723-788ee61ae65d None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:02.858035 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d8023-9082-4003-8723-788ee61ae65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:02.900638 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-5f4d8023-9082-4003-8723-788ee61ae65d None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:03:02.903934 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5f4d8023-9082-4003-8723-788ee61ae65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:02.988995 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:03.078454 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2782/5577] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:03:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:03:03.090460 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d3c2d-affc-4989-903a-74c800c51696 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:03.090943 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d3c2d-affc-4989-903a-74c800c51696 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:03.091334 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d3c2d-affc-4989-903a-74c800c51696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:03.129588 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-7c6d3c2d-affc-4989-903a-74c800c51696 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:03:03.131086 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7c6d3c2d-affc-4989-903a-74c800c51696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:03.152807 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d8023-9082-4003-8723-788ee61ae65d None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:03.153964 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2796/5578] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:03:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:03:03.170240 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d8023-9082-4003-8723-788ee61ae65d None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:03.182585 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0be74c-c230-4c33-9ece-d82fcf631460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:03.185455 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0be74c-c230-4c33-9ece-d82fcf631460 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:03.185820 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0be74c-c230-4c33-9ece-d82fcf631460 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:03.186392 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0be74c-c230-4c33-9ece-d82fcf631460 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:03.189147 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0be74c-c230-4c33-9ece-d82fcf631460 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:03:03.190177 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0be74c-c230-4c33-9ece-d82fcf631460 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:03.197212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0be74c-c230-4c33-9ece-d82fcf631460 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:03.226728 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2783/5579] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:03:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:03:03.231257 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d3c2d-affc-4989-903a-74c800c51696 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:03.249531 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d3c2d-affc-4989-903a-74c800c51696 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:03.258566 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce1932-9160-437e-91d9-3d414c235d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:03.259500 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce1932-9160-437e-91d9-3d414c235d3f admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:03.259899 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce1932-9160-437e-91d9-3d414c235d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:03.260550 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce1932-9160-437e-91d9-3d414c235d3f admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:03.261677 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce1932-9160-437e-91d9-3d414c235d3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:03.264938 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce1932-9160-437e-91d9-3d414c235d3f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:03.305823 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2797/5580] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:03:03 2022] POST /identity/v3/projects => generated 381 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:03:03.309832 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0be74c-c230-4c33-9ece-d82fcf631460 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:03.325352 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0be74c-c230-4c33-9ece-d82fcf631460 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:03.418881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4186c63-fc12-48da-8682-ccb7469cf85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:03.419899 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4186c63-fc12-48da-8682-ccb7469cf85c admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:03.420443 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4186c63-fc12-48da-8682-ccb7469cf85c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:03.420864 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4186c63-fc12-48da-8682-ccb7469cf85c admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:03.421860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4186c63-fc12-48da-8682-ccb7469cf85c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:03.426350 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4186c63-fc12-48da-8682-ccb7469cf85c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:03.487503 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2784/5581] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:03:03 2022] POST /identity/v3/users => generated 291 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:03:03.491705 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce1932-9160-437e-91d9-3d414c235d3f admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:03.517172 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce1932-9160-437e-91d9-3d414c235d3f admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:03.539281 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0296c-5130-4eca-81d4-4026435d23e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:03.540963 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0296c-5130-4eca-81d4-4026435d23e8 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:03.541572 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0296c-5130-4eca-81d4-4026435d23e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:03.542117 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0296c-5130-4eca-81d4-4026435d23e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:03.544744 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0296c-5130-4eca-81d4-4026435d23e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:03.546379 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0296c-5130-4eca-81d4-4026435d23e8 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:03.566566 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:03.574488 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2798/5582] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:03:03.576941 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4186c63-fc12-48da-8682-ccb7469cf85c admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:03.593702 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4186c63-fc12-48da-8682-ccb7469cf85c admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:03.610696 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d89107-4ce3-4714-b942-82ae74627a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:03.616043 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d89107-4ce3-4714-b942-82ae74627a95 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:03.616686 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d89107-4ce3-4714-b942-82ae74627a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:03.631250 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d89107-4ce3-4714-b942-82ae74627a95 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:03.637396 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d89107-4ce3-4714-b942-82ae74627a95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:03.643217 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d89107-4ce3-4714-b942-82ae74627a95 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:03.700232 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2785/5583] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:03:03.714295 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0296c-5130-4eca-81d4-4026435d23e8 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:03.727589 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0296c-5130-4eca-81d4-4026435d23e8 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:03.759389 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93408fd7-4fdd-4af0-add3-b0381a9dbe3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:03.761533 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93408fd7-4fdd-4af0-add3-b0381a9dbe3d admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:03.762095 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93408fd7-4fdd-4af0-add3-b0381a9dbe3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:03.762718 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93408fd7-4fdd-4af0-add3-b0381a9dbe3d admin admin] PATH_INFO: `/v3/projects/9705493734ca4b25a8bf943dbef9892e/users/590351ba651441a4b9338212de8b27c2/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:03.798378 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93408fd7-4fdd-4af0-add3-b0381a9dbe3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9705493734ca4b25a8bf943dbef9892e, user_id=590351ba651441a4b9338212de8b27c2, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:03.803640 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93408fd7-4fdd-4af0-add3-b0381a9dbe3d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:03.841564 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397807e-abdc-49ef-ad7f-b195925bd897 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:03.841850 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397807e-abdc-49ef-ad7f-b195925bd897 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:03.842352 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397807e-abdc-49ef-ad7f-b195925bd897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:03.849496 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2799/5584] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:03:03 2022] PUT /identity/v3/projects/9705493734ca4b25a8bf943dbef9892e/users/590351ba651441a4b9338212de8b27c2/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:03:03.884432 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-b397807e-abdc-49ef-ad7f-b195925bd897 None None] MFA Rules not processed for user `590351ba651441a4b9338212de8b27c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:03:03.886622 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b397807e-abdc-49ef-ad7f-b195925bd897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:04.015892 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2786/5585] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:03:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:03:04.022169 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93408fd7-4fdd-4af0-add3-b0381a9dbe3d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:04.166437 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93408fd7-4fdd-4af0-add3-b0381a9dbe3d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:04.183768 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e7f5a-aea3-4d61-a0cf-35fe6945e0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:04.184568 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e7f5a-aea3-4d61-a0cf-35fe6945e0e8 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:04.185097 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e7f5a-aea3-4d61-a0cf-35fe6945e0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:04.185976 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e7f5a-aea3-4d61-a0cf-35fe6945e0e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:04.186876 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e7f5a-aea3-4d61-a0cf-35fe6945e0e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:04.190280 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e7f5a-aea3-4d61-a0cf-35fe6945e0e8 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:04.261697 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2800/5586] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:03:04 2022] POST /identity/v3/projects => generated 379 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:03:04.265683 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b397807e-abdc-49ef-ad7f-b195925bd897 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:04.283834 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b397807e-abdc-49ef-ad7f-b195925bd897 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:04.357243 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:04.426823 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283be5d1-d270-4137-a68e-65cae560118d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:04.428246 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283be5d1-d270-4137-a68e-65cae560118d admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:04.428753 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283be5d1-d270-4137-a68e-65cae560118d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:04.429189 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283be5d1-d270-4137-a68e-65cae560118d admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:04.430613 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283be5d1-d270-4137-a68e-65cae560118d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:04.435507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283be5d1-d270-4137-a68e-65cae560118d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:04.489978 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2787/5587] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:03:04 2022] POST /identity/v3/users => generated 296 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:03:04.494182 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e7f5a-aea3-4d61-a0cf-35fe6945e0e8 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:04.510541 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e7f5a-aea3-4d61-a0cf-35fe6945e0e8 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:04.524454 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f7eee0-9935-4ff2-a462-8e5a3e4258da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:04.525824 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7eee0-9935-4ff2-a462-8e5a3e4258da admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:04.526215 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7eee0-9935-4ff2-a462-8e5a3e4258da admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:04.526375 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7eee0-9935-4ff2-a462-8e5a3e4258da admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:04.527251 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f7eee0-9935-4ff2-a462-8e5a3e4258da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:04.528764 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f7eee0-9935-4ff2-a462-8e5a3e4258da admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:04.563636 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2801/5588] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:03:04.565239 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283be5d1-d270-4137-a68e-65cae560118d admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:04.582168 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283be5d1-d270-4137-a68e-65cae560118d admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:04.595803 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850ba17-72c4-42aa-80da-3e0638e8e09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:04.596677 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850ba17-72c4-42aa-80da-3e0638e8e09c admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:04.596956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850ba17-72c4-42aa-80da-3e0638e8e09c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:04.597577 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850ba17-72c4-42aa-80da-3e0638e8e09c admin admin] PATH_INFO: `/v3/projects/5d0a319387474a528728ebed2789252e/users/66d695f152df4db4bfa03fee84faeafe/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:04.631363 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9850ba17-72c4-42aa-80da-3e0638e8e09c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d0a319387474a528728ebed2789252e, user_id=66d695f152df4db4bfa03fee84faeafe, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:04.634236 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9850ba17-72c4-42aa-80da-3e0638e8e09c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:04.671683 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2788/5589] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:03:04 2022] PUT /identity/v3/projects/5d0a319387474a528728ebed2789252e/users/66d695f152df4db4bfa03fee84faeafe/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:03:04.673049 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f7eee0-9935-4ff2-a462-8e5a3e4258da admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:04.687383 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f7eee0-9935-4ff2-a462-8e5a3e4258da admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:04.912533 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61fa4df-afd2-4eb6-b201-08b169c161fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:04.914748 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fa4df-afd2-4eb6-b201-08b169c161fc admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:04.915757 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fa4df-afd2-4eb6-b201-08b169c161fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:04.916438 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fa4df-afd2-4eb6-b201-08b169c161fc admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:04.917220 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61fa4df-afd2-4eb6-b201-08b169c161fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:04.919106 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61fa4df-afd2-4eb6-b201-08b169c161fc admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:04.937922 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850ba17-72c4-42aa-80da-3e0638e8e09c admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:04.953665 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2802/5590] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:03:04.963836 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850ba17-72c4-42aa-80da-3e0638e8e09c admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:04.970414 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc6c3d8-79a2-4662-a298-e0a1baa08f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:04.972033 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6c3d8-79a2-4662-a298-e0a1baa08f08 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:04.973815 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6c3d8-79a2-4662-a298-e0a1baa08f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:04.974790 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6c3d8-79a2-4662-a298-e0a1baa08f08 admin admin] PATH_INFO: `/v3/projects/5d0a319387474a528728ebed2789252e/users/66d695f152df4db4bfa03fee84faeafe/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:04.977284 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc6c3d8-79a2-4662-a298-e0a1baa08f08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d0a319387474a528728ebed2789252e, user_id=66d695f152df4db4bfa03fee84faeafe, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:04.980613 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc6c3d8-79a2-4662-a298-e0a1baa08f08 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:05.008638 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028f791-9d15-4675-a181-92b9805a2003 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:05.008924 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028f791-9d15-4675-a181-92b9805a2003 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:05.009201 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028f791-9d15-4675-a181-92b9805a2003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:05.012335 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2789/5591] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:03:04 2022] PUT /identity/v3/projects/5d0a319387474a528728ebed2789252e/users/66d695f152df4db4bfa03fee84faeafe/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:03:05.092074 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-5028f791-9d15-4675-a181-92b9805a2003 None None] MFA Rules not processed for user `66d695f152df4db4bfa03fee84faeafe`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:03:05.093325 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5028f791-9d15-4675-a181-92b9805a2003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:05.199931 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:05.289099 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2803/5592] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:03:05 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:03:05.307685 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc6c3d8-79a2-4662-a298-e0a1baa08f08 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:05.311009 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0dc6c3d8-79a2-4662-a298-e0a1baa08f08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:05.488383 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc6c3d8-79a2-4662-a298-e0a1baa08f08 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:05.495849 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba36689-10f9-4a6e-8d1a-098f9734f343 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:05.497195 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba36689-10f9-4a6e-8d1a-098f9734f343 service cinder] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:05.497796 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba36689-10f9-4a6e-8d1a-098f9734f343 service cinder] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:05.498283 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba36689-10f9-4a6e-8d1a-098f9734f343 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:05.510033 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba36689-10f9-4a6e-8d1a-098f9734f343 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:05.512707 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba36689-10f9-4a6e-8d1a-098f9734f343 service cinder] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:05.529604 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2790/5593] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:03:05 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:03:06.081948 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3c8b9-3484-41f9-9dce-2d2863c75185 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:06.082694 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3c8b9-3484-41f9-9dce-2d2863c75185 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:06.083286 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3c8b9-3484-41f9-9dce-2d2863c75185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:06.126241 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-08c3c8b9-3484-41f9-9dce-2d2863c75185 None None] MFA Rules not processed for user `dcd426ac002048bf9db072739a81c2e4`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:03:06.127996 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-08c3c8b9-3484-41f9-9dce-2d2863c75185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:06.287991 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2804/5594] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:03:06 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:03:06.323288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba36689-10f9-4a6e-8d1a-098f9734f343 service cinder] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:06.347218 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba36689-10f9-4a6e-8d1a-098f9734f343 service cinder] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:06.379780 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ac132-a8f9-4e5f-8483-d62ce0f7feef tempest-VolumeQuotaClassesTest-759574936 tempest-VolumeQuotaClassesTest-759574936-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66d695f152df4db4bfa03fee84faeafe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d0a319387474a528728ebed2789252e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:06.382117 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ac132-a8f9-4e5f-8483-d62ce0f7feef tempest-VolumeQuotaClassesTest-759574936 tempest-VolumeQuotaClassesTest-759574936-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:06.382606 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ac132-a8f9-4e5f-8483-d62ce0f7feef tempest-VolumeQuotaClassesTest-759574936 tempest-VolumeQuotaClassesTest-759574936-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:06.383131 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ac132-a8f9-4e5f-8483-d62ce0f7feef tempest-VolumeQuotaClassesTest-759574936 tempest-VolumeQuotaClassesTest-759574936-project-admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:06.386927 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ac132-a8f9-4e5f-8483-d62ce0f7feef tempest-VolumeQuotaClassesTest-759574936 tempest-VolumeQuotaClassesTest-759574936-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:03:06.387689 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ac132-a8f9-4e5f-8483-d62ce0f7feef tempest-VolumeQuotaClassesTest-759574936 tempest-VolumeQuotaClassesTest-759574936-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:06.389587 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ac132-a8f9-4e5f-8483-d62ce0f7feef tempest-VolumeQuotaClassesTest-759574936 tempest-VolumeQuotaClassesTest-759574936-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:06.450038 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2791/5595] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:03:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:03:06.452867 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3c8b9-3484-41f9-9dce-2d2863c75185 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:06.468286 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3c8b9-3484-41f9-9dce-2d2863c75185 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:06.484415 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc8af25-e021-4b6a-bac6-dadd8b4866fb tempest-VolumeQuotaClassesTest-759574936 tempest-VolumeQuotaClassesTest-759574936-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66d695f152df4db4bfa03fee84faeafe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d0a319387474a528728ebed2789252e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:06.485148 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8af25-e021-4b6a-bac6-dadd8b4866fb tempest-VolumeQuotaClassesTest-759574936 tempest-VolumeQuotaClassesTest-759574936-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:06.485493 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8af25-e021-4b6a-bac6-dadd8b4866fb tempest-VolumeQuotaClassesTest-759574936 tempest-VolumeQuotaClassesTest-759574936-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:06.485878 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8af25-e021-4b6a-bac6-dadd8b4866fb tempest-VolumeQuotaClassesTest-759574936 tempest-VolumeQuotaClassesTest-759574936-project-admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:06.486612 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc8af25-e021-4b6a-bac6-dadd8b4866fb tempest-VolumeQuotaClassesTest-759574936 tempest-VolumeQuotaClassesTest-759574936-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:06.488769 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc8af25-e021-4b6a-bac6-dadd8b4866fb tempest-VolumeQuotaClassesTest-759574936 tempest-VolumeQuotaClassesTest-759574936-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:06.552966 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2805/5596] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:03:06 2022] POST /identity/v3/projects => generated 354 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:03:06.556937 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ac132-a8f9-4e5f-8483-d62ce0f7feef tempest-VolumeQuotaClassesTest-759574936 tempest-VolumeQuotaClassesTest-759574936-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:06.571747 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ac132-a8f9-4e5f-8483-d62ce0f7feef tempest-VolumeQuotaClassesTest-759574936 tempest-VolumeQuotaClassesTest-759574936-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:06.712882 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdefac6-92bf-4b41-9692-5f63c6e3e9f7 tempest-VolumeQuotaClassesTest-759574936 tempest-VolumeQuotaClassesTest-759574936-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66d695f152df4db4bfa03fee84faeafe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d0a319387474a528728ebed2789252e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:06.713611 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdefac6-92bf-4b41-9692-5f63c6e3e9f7 tempest-VolumeQuotaClassesTest-759574936 tempest-VolumeQuotaClassesTest-759574936-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:06.713797 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdefac6-92bf-4b41-9692-5f63c6e3e9f7 tempest-VolumeQuotaClassesTest-759574936 tempest-VolumeQuotaClassesTest-759574936-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:06.714547 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdefac6-92bf-4b41-9692-5f63c6e3e9f7 tempest-VolumeQuotaClassesTest-759574936 tempest-VolumeQuotaClassesTest-759574936-project-admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:06.715415 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdefac6-92bf-4b41-9692-5f63c6e3e9f7 tempest-VolumeQuotaClassesTest-759574936 tempest-VolumeQuotaClassesTest-759574936-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:03:06.715891 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdefac6-92bf-4b41-9692-5f63c6e3e9f7 tempest-VolumeQuotaClassesTest-759574936 tempest-VolumeQuotaClassesTest-759574936-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:06.717534 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdefac6-92bf-4b41-9692-5f63c6e3e9f7 tempest-VolumeQuotaClassesTest-759574936 tempest-VolumeQuotaClassesTest-759574936-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:06.756886 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2792/5597] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:03:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:03:06.836822 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc8af25-e021-4b6a-bac6-dadd8b4866fb tempest-VolumeQuotaClassesTest-759574936 tempest-VolumeQuotaClassesTest-759574936-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:06.857954 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc8af25-e021-4b6a-bac6-dadd8b4866fb tempest-VolumeQuotaClassesTest-759574936 tempest-VolumeQuotaClassesTest-759574936-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:06.866602 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19742d68-51b7-4b4e-8f4b-f5bd59eb4bc4 tempest-VolumeQuotaClassesTest-759574936 tempest-VolumeQuotaClassesTest-759574936-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66d695f152df4db4bfa03fee84faeafe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d0a319387474a528728ebed2789252e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:06.868773 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19742d68-51b7-4b4e-8f4b-f5bd59eb4bc4 tempest-VolumeQuotaClassesTest-759574936 tempest-VolumeQuotaClassesTest-759574936-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:06.869273 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19742d68-51b7-4b4e-8f4b-f5bd59eb4bc4 tempest-VolumeQuotaClassesTest-759574936 tempest-VolumeQuotaClassesTest-759574936-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:06.870163 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19742d68-51b7-4b4e-8f4b-f5bd59eb4bc4 tempest-VolumeQuotaClassesTest-759574936 tempest-VolumeQuotaClassesTest-759574936-project-admin] PATH_INFO: `/v3/projects/3957dd3fb05a4c459d964b0980a74f05` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:06.872146 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19742d68-51b7-4b4e-8f4b-f5bd59eb4bc4 tempest-VolumeQuotaClassesTest-759574936 tempest-VolumeQuotaClassesTest-759574936-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3957dd3fb05a4c459d964b0980a74f05)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:06.875557 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19742d68-51b7-4b4e-8f4b-f5bd59eb4bc4 tempest-VolumeQuotaClassesTest-759574936 tempest-VolumeQuotaClassesTest-759574936-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:06.976667 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-19742d68-51b7-4b4e-8f4b-f5bd59eb4bc4 tempest-VolumeQuotaClassesTest-759574936 tempest-VolumeQuotaClassesTest-759574936-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3957dd3fb05a4c459d964b0980a74f05', 'request_id': 'req-19742d68-51b7-4b4e-8f4b-f5bd59eb4bc4'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:06.992454 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-19742d68-51b7-4b4e-8f4b-f5bd59eb4bc4 tempest-VolumeQuotaClassesTest-759574936 tempest-VolumeQuotaClassesTest-759574936-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3957dd3fb05a4c459d964b0980a74f05', 'request_id': 'req-19742d68-51b7-4b4e-8f4b-f5bd59eb4bc4'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:07.013002 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-19742d68-51b7-4b4e-8f4b-f5bd59eb4bc4 tempest-VolumeQuotaClassesTest-759574936 tempest-VolumeQuotaClassesTest-759574936-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3957dd3fb05a4c459d964b0980a74f05', 'request_id': 'req-19742d68-51b7-4b4e-8f4b-f5bd59eb4bc4'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:07.062314 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-19742d68-51b7-4b4e-8f4b-f5bd59eb4bc4 tempest-VolumeQuotaClassesTest-759574936 tempest-VolumeQuotaClassesTest-759574936-project-admin] The token cache is being invalidate because project 3957dd3fb05a4c459d964b0980a74f05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:03:07.062645 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-19742d68-51b7-4b4e-8f4b-f5bd59eb4bc4 tempest-VolumeQuotaClassesTest-759574936 tempest-VolumeQuotaClassesTest-759574936-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:07.064017 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-19742d68-51b7-4b4e-8f4b-f5bd59eb4bc4 tempest-VolumeQuotaClassesTest-759574936 tempest-VolumeQuotaClassesTest-759574936-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:07.066070 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2806/5598] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:03:06 2022] DELETE /identity/v3/projects/3957dd3fb05a4c459d964b0980a74f05 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:03:07.549906 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdefac6-92bf-4b41-9692-5f63c6e3e9f7 tempest-VolumeQuotaClassesTest-759574936 tempest-VolumeQuotaClassesTest-759574936-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:07.551922 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-fcdefac6-92bf-4b41-9692-5f63c6e3e9f7 tempest-VolumeQuotaClassesTest-759574936 tempest-VolumeQuotaClassesTest-759574936-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:07.566293 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:07.756595 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdefac6-92bf-4b41-9692-5f63c6e3e9f7 tempest-VolumeQuotaClassesTest-759574936 tempest-VolumeQuotaClassesTest-759574936-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:07.845990 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba201f-0754-4226-b04f-8a838d33baac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:07.846657 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba201f-0754-4226-b04f-8a838d33baac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:07.847103 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba201f-0754-4226-b04f-8a838d33baac admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:07.847688 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba201f-0754-4226-b04f-8a838d33baac admin admin] PATH_INFO: `/v3/users/590351ba651441a4b9338212de8b27c2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:07.852664 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ba201f-0754-4226-b04f-8a838d33baac admin admin] RBAC: Authorizing `identity:delete_user(user_id=590351ba651441a4b9338212de8b27c2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:07.855335 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ba201f-0754-4226-b04f-8a838d33baac admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:07.947973 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e1ba201f-0754-4226-b04f-8a838d33baac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '590351ba651441a4b9338212de8b27c2'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:07.949220 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e1ba201f-0754-4226-b04f-8a838d33baac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '590351ba651441a4b9338212de8b27c2'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:07.979357 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e1ba201f-0754-4226-b04f-8a838d33baac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '590351ba651441a4b9338212de8b27c2'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:07.993570 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e1ba201f-0754-4226-b04f-8a838d33baac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '590351ba651441a4b9338212de8b27c2'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:08.050799 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e1ba201f-0754-4226-b04f-8a838d33baac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '590351ba651441a4b9338212de8b27c2'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:08.076878 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2793/5599] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:03:07 2022] DELETE /identity/v3/users/590351ba651441a4b9338212de8b27c2 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:03:08.079105 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d48e1-5d5b-48ac-867c-7614039f60f1 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:08.079608 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d48e1-5d5b-48ac-867c-7614039f60f1 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:08.079876 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d48e1-5d5b-48ac-867c-7614039f60f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:08.165176 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-731d48e1-5d5b-48ac-867c-7614039f60f1 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:03:08.166405 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-731d48e1-5d5b-48ac-867c-7614039f60f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:08.252861 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:08.346859 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2807/5600] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:03:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:03:08.405120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba201f-0754-4226-b04f-8a838d33baac admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:08.408732 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e1ba201f-0754-4226-b04f-8a838d33baac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:08.526263 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:08.584203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba201f-0754-4226-b04f-8a838d33baac admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:08.597304 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a71bae-14ff-463b-8320-bf265047ccda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:08.598258 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a71bae-14ff-463b-8320-bf265047ccda service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:08.598703 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a71bae-14ff-463b-8320-bf265047ccda service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:08.599171 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a71bae-14ff-463b-8320-bf265047ccda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:08.621346 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a71bae-14ff-463b-8320-bf265047ccda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:08.622938 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a71bae-14ff-463b-8320-bf265047ccda service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:08.649147 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2794/5601] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:03:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:03:10.540325 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d48e1-5d5b-48ac-867c-7614039f60f1 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:10.541772 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-731d48e1-5d5b-48ac-867c-7614039f60f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:10.568840 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d48e1-5d5b-48ac-867c-7614039f60f1 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:10.575937 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34099a-da07-4519-87bc-1e5ca6a1c74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:10.576960 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34099a-da07-4519-87bc-1e5ca6a1c74f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:10.577432 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34099a-da07-4519-87bc-1e5ca6a1c74f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:10.577960 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34099a-da07-4519-87bc-1e5ca6a1c74f admin admin] PATH_INFO: `/v3/projects/9705493734ca4b25a8bf943dbef9892e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:10.580327 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34099a-da07-4519-87bc-1e5ca6a1c74f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9705493734ca4b25a8bf943dbef9892e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:10.582643 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34099a-da07-4519-87bc-1e5ca6a1c74f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:10.689639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6c34099a-da07-4519-87bc-1e5ca6a1c74f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9705493734ca4b25a8bf943dbef9892e', 'request_id': 'req-6c34099a-da07-4519-87bc-1e5ca6a1c74f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:10.697664 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6c34099a-da07-4519-87bc-1e5ca6a1c74f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9705493734ca4b25a8bf943dbef9892e', 'request_id': 'req-6c34099a-da07-4519-87bc-1e5ca6a1c74f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:10.712332 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6c34099a-da07-4519-87bc-1e5ca6a1c74f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9705493734ca4b25a8bf943dbef9892e', 'request_id': 'req-6c34099a-da07-4519-87bc-1e5ca6a1c74f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:10.740097 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6c34099a-da07-4519-87bc-1e5ca6a1c74f admin admin] The token cache is being invalidate because project 9705493734ca4b25a8bf943dbef9892e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:03:10.740608 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6c34099a-da07-4519-87bc-1e5ca6a1c74f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:10.741268 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6c34099a-da07-4519-87bc-1e5ca6a1c74f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:10.743192 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2808/5602] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:03:10 2022] DELETE /identity/v3/projects/9705493734ca4b25a8bf943dbef9892e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:03:10.756922 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a71bae-14ff-463b-8320-bf265047ccda service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:10.784103 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a71bae-14ff-463b-8320-bf265047ccda service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:11.135937 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3371f-55ba-421e-b836-faeee7872ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:11.137574 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3371f-55ba-421e-b836-faeee7872ce3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:11.139869 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3371f-55ba-421e-b836-faeee7872ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:11.140411 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3371f-55ba-421e-b836-faeee7872ce3 admin admin] PATH_INFO: `/v3/users/66d695f152df4db4bfa03fee84faeafe` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:11.142545 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b3371f-55ba-421e-b836-faeee7872ce3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66d695f152df4db4bfa03fee84faeafe)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:11.148085 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b3371f-55ba-421e-b836-faeee7872ce3 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:11.267970 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-93b3371f-55ba-421e-b836-faeee7872ce3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66d695f152df4db4bfa03fee84faeafe'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:11.268676 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-93b3371f-55ba-421e-b836-faeee7872ce3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66d695f152df4db4bfa03fee84faeafe'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:11.290193 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-93b3371f-55ba-421e-b836-faeee7872ce3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66d695f152df4db4bfa03fee84faeafe'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:11.307458 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-93b3371f-55ba-421e-b836-faeee7872ce3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66d695f152df4db4bfa03fee84faeafe'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:11.318973 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-93b3371f-55ba-421e-b836-faeee7872ce3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66d695f152df4db4bfa03fee84faeafe'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:11.330286 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2795/5603] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:03:10 2022] DELETE /identity/v3/users/66d695f152df4db4bfa03fee84faeafe => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:03:13.188676 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34099a-da07-4519-87bc-1e5ca6a1c74f admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:13.190117 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6c34099a-da07-4519-87bc-1e5ca6a1c74f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:13.349540 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3371f-55ba-421e-b836-faeee7872ce3 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:13.351234 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-93b3371f-55ba-421e-b836-faeee7872ce3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:13.366457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34099a-da07-4519-87bc-1e5ca6a1c74f admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:13.474949 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b37780-ec33-42b9-b1ad-03c46ebe7253 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:13.476601 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b37780-ec33-42b9-b1ad-03c46ebe7253 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:13.478158 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b37780-ec33-42b9-b1ad-03c46ebe7253 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:13.478640 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b37780-ec33-42b9-b1ad-03c46ebe7253 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:13.484115 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-03b37780-ec33-42b9-b1ad-03c46ebe7253 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:13.499226 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:13.502271 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b37780-ec33-42b9-b1ad-03c46ebe7253 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:13.505254 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b37780-ec33-42b9-b1ad-03c46ebe7253 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:13.515314 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3371f-55ba-421e-b836-faeee7872ce3 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:13.526946 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb273c8d-61cf-4838-8a45-c5175e93971f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:13.527739 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb273c8d-61cf-4838-8a45-c5175e93971f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:13.528135 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb273c8d-61cf-4838-8a45-c5175e93971f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:13.528507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb273c8d-61cf-4838-8a45-c5175e93971f admin admin] PATH_INFO: `/v3/projects/5d0a319387474a528728ebed2789252e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:13.529749 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb273c8d-61cf-4838-8a45-c5175e93971f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d0a319387474a528728ebed2789252e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:13.532285 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb273c8d-61cf-4838-8a45-c5175e93971f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:13.534171 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2809/5604] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:03:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:03:13.625959 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-bb273c8d-61cf-4838-8a45-c5175e93971f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d0a319387474a528728ebed2789252e', 'request_id': 'req-bb273c8d-61cf-4838-8a45-c5175e93971f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:13.638294 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-bb273c8d-61cf-4838-8a45-c5175e93971f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d0a319387474a528728ebed2789252e', 'request_id': 'req-bb273c8d-61cf-4838-8a45-c5175e93971f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:13.654576 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-bb273c8d-61cf-4838-8a45-c5175e93971f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d0a319387474a528728ebed2789252e', 'request_id': 'req-bb273c8d-61cf-4838-8a45-c5175e93971f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:13.683704 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-bb273c8d-61cf-4838-8a45-c5175e93971f admin admin] The token cache is being invalidate because project 5d0a319387474a528728ebed2789252e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:03:13.686608 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-bb273c8d-61cf-4838-8a45-c5175e93971f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:13.688855 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-bb273c8d-61cf-4838-8a45-c5175e93971f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:13.697023 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2796/5605] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:03:13 2022] DELETE /identity/v3/projects/5d0a319387474a528728ebed2789252e => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:03:13.711375 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df77a7-2b17-4a8c-877c-91fb34414a22 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:13.712498 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df77a7-2b17-4a8c-877c-91fb34414a22 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:13.712937 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df77a7-2b17-4a8c-877c-91fb34414a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:13.757123 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-c8df77a7-2b17-4a8c-877c-91fb34414a22 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:03:13.760062 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c8df77a7-2b17-4a8c-877c-91fb34414a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:13.793911 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:13.912856 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2810/5606] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:03:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:03:13.915525 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37dc79e-674a-40de-8754-00a4c0cf22e6 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:13.916094 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37dc79e-674a-40de-8754-00a4c0cf22e6 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:13.916589 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37dc79e-674a-40de-8754-00a4c0cf22e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:13.965761 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-e37dc79e-674a-40de-8754-00a4c0cf22e6 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:03:13.967008 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e37dc79e-674a-40de-8754-00a4c0cf22e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:13.987728 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2797/5607] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:03:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:03:13.992507 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df77a7-2b17-4a8c-877c-91fb34414a22 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:14.010820 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df77a7-2b17-4a8c-877c-91fb34414a22 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:14.034907 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46c064-5665-4fdc-beae-0ead4c135bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:14.035872 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46c064-5665-4fdc-beae-0ead4c135bfc admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:14.036151 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46c064-5665-4fdc-beae-0ead4c135bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:14.037862 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46c064-5665-4fdc-beae-0ead4c135bfc admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:14.039253 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46c064-5665-4fdc-beae-0ead4c135bfc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:03:14.040928 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46c064-5665-4fdc-beae-0ead4c135bfc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:14.048939 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46c064-5665-4fdc-beae-0ead4c135bfc admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:14.084220 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37dc79e-674a-40de-8754-00a4c0cf22e6 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:14.089337 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2811/5608] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:03:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:03:14.097944 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37dc79e-674a-40de-8754-00a4c0cf22e6 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:14.115943 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd00d961-878a-4771-9223-e04e373a2463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:14.119145 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00d961-878a-4771-9223-e04e373a2463 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:14.121230 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00d961-878a-4771-9223-e04e373a2463 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:14.122078 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00d961-878a-4771-9223-e04e373a2463 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:14.124188 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd00d961-878a-4771-9223-e04e373a2463 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:14.139577 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd00d961-878a-4771-9223-e04e373a2463 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:14.252023 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2798/5609] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:03:14 2022] POST /identity/v3/projects => generated 371 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:03:14.259862 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46c064-5665-4fdc-beae-0ead4c135bfc admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:14.284544 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46c064-5665-4fdc-beae-0ead4c135bfc admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:14.472382 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f3743-8d8f-4d53-8313-d705e2c1f7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:14.475140 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f3743-8d8f-4d53-8313-d705e2c1f7a1 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:14.477455 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f3743-8d8f-4d53-8313-d705e2c1f7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:14.478091 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f3743-8d8f-4d53-8313-d705e2c1f7a1 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:14.478915 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f3743-8d8f-4d53-8313-d705e2c1f7a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:14.481177 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f3743-8d8f-4d53-8313-d705e2c1f7a1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:14.530832 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2812/5610] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:03:14 2022] POST /identity/v3/users => generated 286 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:03:14.535341 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd00d961-878a-4771-9223-e04e373a2463 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:14.551871 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd00d961-878a-4771-9223-e04e373a2463 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:14.568724 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb1eb5-a1dd-4804-b1ae-ac6eeaa6ca8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:14.569656 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb1eb5-a1dd-4804-b1ae-ac6eeaa6ca8a admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:14.570291 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb1eb5-a1dd-4804-b1ae-ac6eeaa6ca8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:14.570857 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb1eb5-a1dd-4804-b1ae-ac6eeaa6ca8a admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:14.571710 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb1eb5-a1dd-4804-b1ae-ac6eeaa6ca8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:14.573492 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb1eb5-a1dd-4804-b1ae-ac6eeaa6ca8a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:14.607267 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f3743-8d8f-4d53-8313-d705e2c1f7a1 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:14.614837 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2799/5611] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:03:14 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:03:14.619448 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f3743-8d8f-4d53-8313-d705e2c1f7a1 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:14.630460 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9eadd-5926-409e-b5ae-b9ee2492b4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:14.632059 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9eadd-5926-409e-b5ae-b9ee2492b4cc admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:14.632497 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9eadd-5926-409e-b5ae-b9ee2492b4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:14.632995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9eadd-5926-409e-b5ae-b9ee2492b4cc admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:14.636961 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd9eadd-5926-409e-b5ae-b9ee2492b4cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:14.639181 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd9eadd-5926-409e-b5ae-b9ee2492b4cc admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:14.671351 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2813/5612] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:03:14 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:03:14.675966 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb1eb5-a1dd-4804-b1ae-ac6eeaa6ca8a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:14.692999 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb1eb5-a1dd-4804-b1ae-ac6eeaa6ca8a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:14.706496 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00599c-4f53-4918-a4cb-b6393558833a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:14.707500 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00599c-4f53-4918-a4cb-b6393558833a admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:14.707963 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00599c-4f53-4918-a4cb-b6393558833a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:14.708390 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00599c-4f53-4918-a4cb-b6393558833a admin admin] PATH_INFO: `/v3/projects/7b030d2ed8d04f36b9bcbc11ea9444cc/users/db39077a24644094a4c119e2e83269f7/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:14.818071 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e00599c-4f53-4918-a4cb-b6393558833a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b030d2ed8d04f36b9bcbc11ea9444cc, user_id=db39077a24644094a4c119e2e83269f7, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:14.825087 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e00599c-4f53-4918-a4cb-b6393558833a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:14.868248 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2800/5613] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:03:14 2022] PUT /identity/v3/projects/7b030d2ed8d04f36b9bcbc11ea9444cc/users/db39077a24644094a4c119e2e83269f7/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:03:14.879474 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2cd2aa-47a9-4d62-87d6-665187a4fd7d None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:14.880128 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2cd2aa-47a9-4d62-87d6-665187a4fd7d None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:14.880457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2cd2aa-47a9-4d62-87d6-665187a4fd7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:14.971478 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-9d2cd2aa-47a9-4d62-87d6-665187a4fd7d None None] MFA Rules not processed for user `db39077a24644094a4c119e2e83269f7`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:03:14.973327 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9d2cd2aa-47a9-4d62-87d6-665187a4fd7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:15.197779 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2814/5614] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:03:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:03:15.210467 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00599c-4f53-4918-a4cb-b6393558833a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:15.213017 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6e00599c-4f53-4918-a4cb-b6393558833a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:15.346254 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00599c-4f53-4918-a4cb-b6393558833a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:15.364001 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81e593-21b8-422d-9ade-c08850dc93aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:15.364646 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81e593-21b8-422d-9ade-c08850dc93aa service cinder] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:15.364930 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81e593-21b8-422d-9ade-c08850dc93aa service cinder] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:15.365210 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81e593-21b8-422d-9ade-c08850dc93aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:15.380557 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe81e593-21b8-422d-9ade-c08850dc93aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:15.382176 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe81e593-21b8-422d-9ade-c08850dc93aa service cinder] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:15.416766 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2801/5615] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:03:15 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:03:15.442570 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2cd2aa-47a9-4d62-87d6-665187a4fd7d None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:15.494710 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:15.604212 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2cd2aa-47a9-4d62-87d6-665187a4fd7d None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:15.620121 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5285fdc6-1b05-4b05-8324-8a6b6440de07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:15.620793 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285fdc6-1b05-4b05-8324-8a6b6440de07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:15.621072 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285fdc6-1b05-4b05-8324-8a6b6440de07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:15.621346 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285fdc6-1b05-4b05-8324-8a6b6440de07 admin admin] PATH_INFO: `/v3/users/db39077a24644094a4c119e2e83269f7` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:15.622537 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5285fdc6-1b05-4b05-8324-8a6b6440de07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db39077a24644094a4c119e2e83269f7)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:15.624514 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5285fdc6-1b05-4b05-8324-8a6b6440de07 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:15.767711 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5285fdc6-1b05-4b05-8324-8a6b6440de07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db39077a24644094a4c119e2e83269f7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:15.779322 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5285fdc6-1b05-4b05-8324-8a6b6440de07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db39077a24644094a4c119e2e83269f7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:15.800742 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5285fdc6-1b05-4b05-8324-8a6b6440de07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db39077a24644094a4c119e2e83269f7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:15.816794 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5285fdc6-1b05-4b05-8324-8a6b6440de07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db39077a24644094a4c119e2e83269f7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:15.818550 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5285fdc6-1b05-4b05-8324-8a6b6440de07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db39077a24644094a4c119e2e83269f7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:15.866983 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2815/5616] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:03:15 2022] DELETE /identity/v3/users/db39077a24644094a4c119e2e83269f7 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:03:15.872152 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165920c-f323-498f-9a61-fa10b7d4c5d8 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:15.872681 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165920c-f323-498f-9a61-fa10b7d4c5d8 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:15.872949 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165920c-f323-498f-9a61-fa10b7d4c5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:15.941002 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-f165920c-f323-498f-9a61-fa10b7d4c5d8 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:03:15.942251 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f165920c-f323-498f-9a61-fa10b7d4c5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:15.996394 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:16.105040 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2802/5617] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:03:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:03:16.183563 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5285fdc6-1b05-4b05-8324-8a6b6440de07 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:16.185815 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5285fdc6-1b05-4b05-8324-8a6b6440de07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:16.359212 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5285fdc6-1b05-4b05-8324-8a6b6440de07 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:16.363756 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af77de3-0e7a-4c1c-8a30-768d095950fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:16.364508 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af77de3-0e7a-4c1c-8a30-768d095950fe service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:16.364792 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af77de3-0e7a-4c1c-8a30-768d095950fe service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:16.365067 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af77de3-0e7a-4c1c-8a30-768d095950fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:16.376747 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af77de3-0e7a-4c1c-8a30-768d095950fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:16.378510 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af77de3-0e7a-4c1c-8a30-768d095950fe service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:16.393414 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2816/5618] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:03:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:03:17.314434 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165920c-f323-498f-9a61-fa10b7d4c5d8 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:17.316175 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f165920c-f323-498f-9a61-fa10b7d4c5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:17.338176 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165920c-f323-498f-9a61-fa10b7d4c5d8 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:17.359984 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdddce4-e834-4235-a3b9-c1d2eeca1a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:17.361101 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdddce4-e834-4235-a3b9-c1d2eeca1a8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:17.361679 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdddce4-e834-4235-a3b9-c1d2eeca1a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:17.362439 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdddce4-e834-4235-a3b9-c1d2eeca1a8c admin admin] PATH_INFO: `/v3/projects/7b030d2ed8d04f36b9bcbc11ea9444cc` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:17.364010 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdddce4-e834-4235-a3b9-c1d2eeca1a8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b030d2ed8d04f36b9bcbc11ea9444cc)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:17.366193 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdddce4-e834-4235-a3b9-c1d2eeca1a8c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:17.462373 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2cdddce4-e834-4235-a3b9-c1d2eeca1a8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b030d2ed8d04f36b9bcbc11ea9444cc', 'request_id': 'req-2cdddce4-e834-4235-a3b9-c1d2eeca1a8c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:17.469944 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2cdddce4-e834-4235-a3b9-c1d2eeca1a8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b030d2ed8d04f36b9bcbc11ea9444cc', 'request_id': 'req-2cdddce4-e834-4235-a3b9-c1d2eeca1a8c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:17.485518 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2cdddce4-e834-4235-a3b9-c1d2eeca1a8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b030d2ed8d04f36b9bcbc11ea9444cc', 'request_id': 'req-2cdddce4-e834-4235-a3b9-c1d2eeca1a8c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:17.506826 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2cdddce4-e834-4235-a3b9-c1d2eeca1a8c admin admin] The token cache is being invalidate because project 7b030d2ed8d04f36b9bcbc11ea9444cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:03:17.507489 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2cdddce4-e834-4235-a3b9-c1d2eeca1a8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:17.509120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2cdddce4-e834-4235-a3b9-c1d2eeca1a8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:17.511951 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2803/5619] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:03:17 2022] DELETE /identity/v3/projects/7b030d2ed8d04f36b9bcbc11ea9444cc => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:03:17.518529 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a345ec3-266a-4ce0-aede-9527bccfd065 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:17.518529 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a345ec3-266a-4ce0-aede-9527bccfd065 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:17.518529 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a345ec3-266a-4ce0-aede-9527bccfd065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:17.557831 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-2a345ec3-266a-4ce0-aede-9527bccfd065 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:03:17.559053 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2a345ec3-266a-4ce0-aede-9527bccfd065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:17.641827 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:17.786390 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec088c75-2263-4d57-a300-859c126af238 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:17.786628 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2817/5620] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:03:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:03:17.787270 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec088c75-2263-4d57-a300-859c126af238 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:17.787732 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec088c75-2263-4d57-a300-859c126af238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:17.861964 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-ec088c75-2263-4d57-a300-859c126af238 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:03:17.863444 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ec088c75-2263-4d57-a300-859c126af238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:17.893274 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2804/5621] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:03:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:03:17.898570 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a345ec3-266a-4ce0-aede-9527bccfd065 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:17.931776 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a345ec3-266a-4ce0-aede-9527bccfd065 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:17.945299 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9ed0e-97fa-4696-a7dc-9c9637c649cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:17.946332 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9ed0e-97fa-4696-a7dc-9c9637c649cb admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:17.948920 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9ed0e-97fa-4696-a7dc-9c9637c649cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:17.949689 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9ed0e-97fa-4696-a7dc-9c9637c649cb admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:17.952085 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a9ed0e-97fa-4696-a7dc-9c9637c649cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:03:17.955127 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a9ed0e-97fa-4696-a7dc-9c9637c649cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:17.965835 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a9ed0e-97fa-4696-a7dc-9c9637c649cb admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:17.991294 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2818/5622] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:03:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:03:17.995801 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec088c75-2263-4d57-a300-859c126af238 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:18.010516 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec088c75-2263-4d57-a300-859c126af238 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:18.027651 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329cc97-3f03-4f5c-ab0f-d981eaf73a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:18.028287 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329cc97-3f03-4f5c-ab0f-d981eaf73a2b admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:18.028566 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329cc97-3f03-4f5c-ab0f-d981eaf73a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:18.028828 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329cc97-3f03-4f5c-ab0f-d981eaf73a2b admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:18.029479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2329cc97-3f03-4f5c-ab0f-d981eaf73a2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:18.032146 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2329cc97-3f03-4f5c-ab0f-d981eaf73a2b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:18.119333 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2805/5623] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:03:17 2022] POST /identity/v3/projects => generated 393 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:03:18.125583 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9ed0e-97fa-4696-a7dc-9c9637c649cb admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:18.160704 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9ed0e-97fa-4696-a7dc-9c9637c649cb admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:18.309141 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d6444-48fa-40db-9a63-43dadbdd9c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:18.310082 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d6444-48fa-40db-9a63-43dadbdd9c1e admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:18.310425 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d6444-48fa-40db-9a63-43dadbdd9c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:18.311050 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d6444-48fa-40db-9a63-43dadbdd9c1e admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:18.311794 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85d6444-48fa-40db-9a63-43dadbdd9c1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:18.316929 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85d6444-48fa-40db-9a63-43dadbdd9c1e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:18.372908 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2819/5624] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:03:18 2022] POST /identity/v3/users => generated 297 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:03:18.377004 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329cc97-3f03-4f5c-ab0f-d981eaf73a2b admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:18.394699 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329cc97-3f03-4f5c-ab0f-d981eaf73a2b admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:18.412449 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d884a82-4137-4cb8-9724-a0a0363da2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:18.413452 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d884a82-4137-4cb8-9724-a0a0363da2f0 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:18.414156 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d884a82-4137-4cb8-9724-a0a0363da2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:18.414522 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d884a82-4137-4cb8-9724-a0a0363da2f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:18.416268 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d884a82-4137-4cb8-9724-a0a0363da2f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:18.442104 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d884a82-4137-4cb8-9724-a0a0363da2f0 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:18.479475 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2806/5625] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:03:18 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:03:18.483875 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d6444-48fa-40db-9a63-43dadbdd9c1e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:18.499727 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d6444-48fa-40db-9a63-43dadbdd9c1e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:18.515929 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4d789-1d8e-42e6-b658-a5f82c488ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:18.519982 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4d789-1d8e-42e6-b658-a5f82c488ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:18.520557 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4d789-1d8e-42e6-b658-a5f82c488ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:18.520557 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4d789-1d8e-42e6-b658-a5f82c488ae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:18.521942 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d4d789-1d8e-42e6-b658-a5f82c488ae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:18.528953 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d4d789-1d8e-42e6-b658-a5f82c488ae9 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:18.580591 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2820/5626] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:03:18 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:03:18.586623 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d884a82-4137-4cb8-9724-a0a0363da2f0 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:18.617371 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d884a82-4137-4cb8-9724-a0a0363da2f0 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:18.628701 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21774f5e-0a22-4e4b-833c-3e7616192b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:18.629392 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21774f5e-0a22-4e4b-833c-3e7616192b82 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:18.629670 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21774f5e-0a22-4e4b-833c-3e7616192b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:18.629939 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21774f5e-0a22-4e4b-833c-3e7616192b82 admin admin] PATH_INFO: `/v3/projects/18bd3c1e18644293a3cc974c300efd06/users/e1ce5d3d668743d5b8843936f77c0150/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:18.668602 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21774f5e-0a22-4e4b-833c-3e7616192b82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18bd3c1e18644293a3cc974c300efd06, user_id=e1ce5d3d668743d5b8843936f77c0150, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:18.672727 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21774f5e-0a22-4e4b-833c-3e7616192b82 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:18.711203 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2807/5627] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:03:18 2022] PUT /identity/v3/projects/18bd3c1e18644293a3cc974c300efd06/users/e1ce5d3d668743d5b8843936f77c0150/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:03:18.733462 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633bc9ac-2989-4b8f-8973-c80bef7b00f8 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:18.733944 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633bc9ac-2989-4b8f-8973-c80bef7b00f8 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:18.734387 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633bc9ac-2989-4b8f-8973-c80bef7b00f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:18.827968 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-633bc9ac-2989-4b8f-8973-c80bef7b00f8 None None] MFA Rules not processed for user `e1ce5d3d668743d5b8843936f77c0150`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:03:18.831493 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-633bc9ac-2989-4b8f-8973-c80bef7b00f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:19.043199 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2821/5628] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:03:18 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:03:19.048352 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21774f5e-0a22-4e4b-833c-3e7616192b82 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:19.151832 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:19.179194 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21774f5e-0a22-4e4b-833c-3e7616192b82 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:19.206410 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd0f82-ebb6-4a59-ad65-6c44a60410a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:19.207256 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd0f82-ebb6-4a59-ad65-6c44a60410a6 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:19.207577 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd0f82-ebb6-4a59-ad65-6c44a60410a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:19.207948 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd0f82-ebb6-4a59-ad65-6c44a60410a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:19.210376 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd0f82-ebb6-4a59-ad65-6c44a60410a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:19.214361 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd0f82-ebb6-4a59-ad65-6c44a60410a6 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:19.328250 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2808/5629] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:03:19 2022] POST /identity/v3/projects => generated 393 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:03:19.332585 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633bc9ac-2989-4b8f-8973-c80bef7b00f8 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:19.349031 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633bc9ac-2989-4b8f-8973-c80bef7b00f8 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:19.415596 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:19.486400 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd0f82-ebb6-4a59-ad65-6c44a60410a6 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:19.488296 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-17fd0f82-ebb6-4a59-ad65-6c44a60410a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:19.551847 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c333e0-081c-455a-a485-5593d1f20861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:19.554319 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c333e0-081c-455a-a485-5593d1f20861 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:19.554745 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c333e0-081c-455a-a485-5593d1f20861 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:19.556270 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c333e0-081c-455a-a485-5593d1f20861 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:19.557128 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c333e0-081c-455a-a485-5593d1f20861 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:19.563876 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c333e0-081c-455a-a485-5593d1f20861 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:19.650702 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2822/5630] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:03:19 2022] POST /identity/v3/users => generated 303 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:03:19.656981 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c333e0-081c-455a-a485-5593d1f20861 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:19.710117 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c333e0-081c-455a-a485-5593d1f20861 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:19.715944 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd0f82-ebb6-4a59-ad65-6c44a60410a6 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:19.727389 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db7397-93b0-49fe-a45a-3abdcc310b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:19.728305 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db7397-93b0-49fe-a45a-3abdcc310b5d admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:19.728826 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db7397-93b0-49fe-a45a-3abdcc310b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:19.729335 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db7397-93b0-49fe-a45a-3abdcc310b5d admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:19.730216 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39db7397-93b0-49fe-a45a-3abdcc310b5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:19.735449 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39db7397-93b0-49fe-a45a-3abdcc310b5d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:19.771354 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1ebe2-2339-4cb7-b06e-e656e29cce4c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:19.772388 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1ebe2-2339-4cb7-b06e-e656e29cce4c service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:19.775431 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1ebe2-2339-4cb7-b06e-e656e29cce4c service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:19.775937 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1ebe2-2339-4cb7-b06e-e656e29cce4c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:19.778867 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2823/5631] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:03:19.783398 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-68f1ebe2-2339-4cb7-b06e-e656e29cce4c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:19.786328 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22f921-576e-42ac-a202-183452b0fdd4 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:19.786849 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22f921-576e-42ac-a202-183452b0fdd4 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:19.787527 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22f921-576e-42ac-a202-183452b0fdd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:19.837578 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f1ebe2-2339-4cb7-b06e-e656e29cce4c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:19.844698 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-2d22f921-576e-42ac-a202-183452b0fdd4 None None] MFA Rules not processed for user `f075974a803f46eda667db6d754453ba`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:03:19.847429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2d22f921-576e-42ac-a202-183452b0fdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:19.851252 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f1ebe2-2339-4cb7-b06e-e656e29cce4c service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:19.877238 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2809/5632] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:03:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:03:19.878065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1ebe2-2339-4cb7-b06e-e656e29cce4c service placement] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:19.926366 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1ebe2-2339-4cb7-b06e-e656e29cce4c service placement] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:19.943784 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffbbb7b-0b03-44a5-a3b2-bbacf6e12b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:19.944718 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbbb7b-0b03-44a5-a3b2-bbacf6e12b10 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:19.945179 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbbb7b-0b03-44a5-a3b2-bbacf6e12b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:19.945747 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbbb7b-0b03-44a5-a3b2-bbacf6e12b10 admin admin] PATH_INFO: `/v3/projects/4555b1319975418da819b6e0eefb32cf/users/eaf0b86011214b97b4f024c97dba2422/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:19.977683 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2824/5633] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:03:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:03:19.995614 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d22f921-576e-42ac-a202-183452b0fdd4 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:19.997867 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2d22f921-576e-42ac-a202-183452b0fdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:20.020102 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffbbb7b-0b03-44a5-a3b2-bbacf6e12b10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4555b1319975418da819b6e0eefb32cf, user_id=eaf0b86011214b97b4f024c97dba2422, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:20.022982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffbbb7b-0b03-44a5-a3b2-bbacf6e12b10 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:20.052770 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2810/5634] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:03:19 2022] PUT /identity/v3/projects/4555b1319975418da819b6e0eefb32cf/users/eaf0b86011214b97b4f024c97dba2422/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:03:20.056833 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffbbb7b-0b03-44a5-a3b2-bbacf6e12b10 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:20.190835 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffbbb7b-0b03-44a5-a3b2-bbacf6e12b10 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:20.208354 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40d449-fb25-4d62-a3ec-c8f4ff07c14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:20.208993 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40d449-fb25-4d62-a3ec-c8f4ff07c14e admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:20.209287 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40d449-fb25-4d62-a3ec-c8f4ff07c14e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:20.209652 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40d449-fb25-4d62-a3ec-c8f4ff07c14e admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:20.210313 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40d449-fb25-4d62-a3ec-c8f4ff07c14e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:20.212000 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40d449-fb25-4d62-a3ec-c8f4ff07c14e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:20.247457 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2811/5635] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:03:20.251873 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40d449-fb25-4d62-a3ec-c8f4ff07c14e admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:20.265241 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d22f921-576e-42ac-a202-183452b0fdd4 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:20.281790 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40d449-fb25-4d62-a3ec-c8f4ff07c14e admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:20.306836 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8353a56a-b9e5-4d5a-acae-7187a77970b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:20.308637 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353a56a-b9e5-4d5a-acae-7187a77970b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:20.309451 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353a56a-b9e5-4d5a-acae-7187a77970b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:20.309984 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353a56a-b9e5-4d5a-acae-7187a77970b1 admin admin] PATH_INFO: `/v3/projects/4555b1319975418da819b6e0eefb32cf/users/eaf0b86011214b97b4f024c97dba2422/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:20.330571 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8353a56a-b9e5-4d5a-acae-7187a77970b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4555b1319975418da819b6e0eefb32cf, user_id=eaf0b86011214b97b4f024c97dba2422, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:20.339559 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8353a56a-b9e5-4d5a-acae-7187a77970b1 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:20.373867 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:20.388768 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2812/5636] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:03:20 2022] PUT /identity/v3/projects/4555b1319975418da819b6e0eefb32cf/users/eaf0b86011214b97b4f024c97dba2422/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:03:20.399856 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450abf56-d03e-4e50-ac43-34e49fba174b None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:20.400242 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450abf56-d03e-4e50-ac43-34e49fba174b None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:20.400704 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450abf56-d03e-4e50-ac43-34e49fba174b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:20.446659 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64a588-17c8-486c-8639-f457ae2547fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:20.447329 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64a588-17c8-486c-8639-f457ae2547fa service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:20.447612 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64a588-17c8-486c-8639-f457ae2547fa service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:20.447883 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64a588-17c8-486c-8639-f457ae2547fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:20.464918 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-450abf56-d03e-4e50-ac43-34e49fba174b None None] MFA Rules not processed for user `eaf0b86011214b97b4f024c97dba2422`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:03:20.466952 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-450abf56-d03e-4e50-ac43-34e49fba174b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:20.480265 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:20.585322 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee64a588-17c8-486c-8639-f457ae2547fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:20.589744 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee64a588-17c8-486c-8639-f457ae2547fa service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:20.613995 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2825/5637] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:03:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:03:20.633251 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2813/5638] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:03:20 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:03:20.755452 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64a588-17c8-486c-8639-f457ae2547fa service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:20.776964 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64a588-17c8-486c-8639-f457ae2547fa service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:20.903965 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a8355-fe72-432d-b8c1-47d5e6e54bbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:20.904609 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a8355-fe72-432d-b8c1-47d5e6e54bbc service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:20.904890 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a8355-fe72-432d-b8c1-47d5e6e54bbc service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:20.905175 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a8355-fe72-432d-b8c1-47d5e6e54bbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:21.077310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a8355-fe72-432d-b8c1-47d5e6e54bbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:21.079775 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a8355-fe72-432d-b8c1-47d5e6e54bbc service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:21.120215 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2826/5639] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:03:20 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:03:22.667576 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450abf56-d03e-4e50-ac43-34e49fba174b None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:22.669737 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-450abf56-d03e-4e50-ac43-34e49fba174b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:22.852308 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450abf56-d03e-4e50-ac43-34e49fba174b None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:22.882597 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb6e45-9524-4563-b5a2-fa36cf45f14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:22.883724 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb6e45-9524-4563-b5a2-fa36cf45f14b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:22.887743 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb6e45-9524-4563-b5a2-fa36cf45f14b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:22.888320 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb6e45-9524-4563-b5a2-fa36cf45f14b admin admin] PATH_INFO: `/v3/users/622bffc5c64741c9b7f92ce93ba0fb5f` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:22.890421 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eb6e45-9524-4563-b5a2-fa36cf45f14b admin admin] RBAC: Authorizing `identity:delete_user(user_id=622bffc5c64741c9b7f92ce93ba0fb5f)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:22.893215 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eb6e45-9524-4563-b5a2-fa36cf45f14b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:23.008781 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-62eb6e45-9524-4563-b5a2-fa36cf45f14b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '622bffc5c64741c9b7f92ce93ba0fb5f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:23.010284 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-62eb6e45-9524-4563-b5a2-fa36cf45f14b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '622bffc5c64741c9b7f92ce93ba0fb5f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:23.037217 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-62eb6e45-9524-4563-b5a2-fa36cf45f14b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '622bffc5c64741c9b7f92ce93ba0fb5f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:23.080307 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-62eb6e45-9524-4563-b5a2-fa36cf45f14b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '622bffc5c64741c9b7f92ce93ba0fb5f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:23.090577 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-62eb6e45-9524-4563-b5a2-fa36cf45f14b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '622bffc5c64741c9b7f92ce93ba0fb5f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:23.116140 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2814/5640] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:03:22 2022] DELETE /identity/v3/users/622bffc5c64741c9b7f92ce93ba0fb5f => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:03:23.120169 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede24261-c335-4db5-81f1-8fee01de8012 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:23.120629 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede24261-c335-4db5-81f1-8fee01de8012 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:23.120629 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede24261-c335-4db5-81f1-8fee01de8012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:23.151152 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-ede24261-c335-4db5-81f1-8fee01de8012 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:03:23.153606 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ede24261-c335-4db5-81f1-8fee01de8012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:23.192847 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:23.347839 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2827/5641] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:03:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:03:23.381540 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb6e45-9524-4563-b5a2-fa36cf45f14b admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:23.387582 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-62eb6e45-9524-4563-b5a2-fa36cf45f14b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:23.486960 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:23.577510 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb6e45-9524-4563-b5a2-fa36cf45f14b admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:23.589151 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995a858-ca3c-4abf-8baa-0055f05ceb06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:23.592313 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995a858-ca3c-4abf-8baa-0055f05ceb06 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:23.593997 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995a858-ca3c-4abf-8baa-0055f05ceb06 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:23.597101 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995a858-ca3c-4abf-8baa-0055f05ceb06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:23.624273 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995a858-ca3c-4abf-8baa-0055f05ceb06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:23.628155 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995a858-ca3c-4abf-8baa-0055f05ceb06 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:23.661452 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2815/5642] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:03:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:03:24.533287 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c32d2a-7968-4054-8513-2346389a3a44 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:24.534229 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c32d2a-7968-4054-8513-2346389a3a44 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:24.534710 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c32d2a-7968-4054-8513-2346389a3a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:24.573567 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-98c32d2a-7968-4054-8513-2346389a3a44 None None] MFA Rules not processed for user `e9cd9c0bd017459cb630823a39e8bd17`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:03:24.574803 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-98c32d2a-7968-4054-8513-2346389a3a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:24.706744 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2828/5643] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:03:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:03:24.934975 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04323bcf-440d-4b5a-b351-01def7a78a86 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:24.935981 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04323bcf-440d-4b5a-b351-01def7a78a86 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:24.936507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04323bcf-440d-4b5a-b351-01def7a78a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:24.974248 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-04323bcf-440d-4b5a-b351-01def7a78a86 None None] MFA Rules not processed for user `f075974a803f46eda667db6d754453ba`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:03:24.978823 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-04323bcf-440d-4b5a-b351-01def7a78a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:25.148987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c32d2a-7968-4054-8513-2346389a3a44 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:25.150545 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-98c32d2a-7968-4054-8513-2346389a3a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:25.191762 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2816/5644] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:03:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:03:25.200845 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c32d2a-7968-4054-8513-2346389a3a44 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:25.209845 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36589eb-dc00-4f13-a209-583c33baf23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:25.212076 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36589eb-dc00-4f13-a209-583c33baf23f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:25.212532 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36589eb-dc00-4f13-a209-583c33baf23f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:25.213003 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36589eb-dc00-4f13-a209-583c33baf23f admin admin] PATH_INFO: `/v3/projects/33948bb268514d44a301f2564d961c76` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:25.214573 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36589eb-dc00-4f13-a209-583c33baf23f admin admin] RBAC: Authorizing `identity:delete_project(project_id=33948bb268514d44a301f2564d961c76)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:25.217185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36589eb-dc00-4f13-a209-583c33baf23f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:25.302466 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c36589eb-dc00-4f13-a209-583c33baf23f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33948bb268514d44a301f2564d961c76', 'request_id': 'req-c36589eb-dc00-4f13-a209-583c33baf23f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:25.314580 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c36589eb-dc00-4f13-a209-583c33baf23f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33948bb268514d44a301f2564d961c76', 'request_id': 'req-c36589eb-dc00-4f13-a209-583c33baf23f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:25.328123 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c36589eb-dc00-4f13-a209-583c33baf23f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33948bb268514d44a301f2564d961c76', 'request_id': 'req-c36589eb-dc00-4f13-a209-583c33baf23f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:25.373582 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c36589eb-dc00-4f13-a209-583c33baf23f admin admin] The token cache is being invalidate because project 33948bb268514d44a301f2564d961c76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:03:25.374102 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c36589eb-dc00-4f13-a209-583c33baf23f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:25.375730 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c36589eb-dc00-4f13-a209-583c33baf23f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:25.378495 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2829/5645] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:03:25 2022] DELETE /identity/v3/projects/33948bb268514d44a301f2564d961c76 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:03:25.382438 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04323bcf-440d-4b5a-b351-01def7a78a86 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:25.395725 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04323bcf-440d-4b5a-b351-01def7a78a86 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:25.467824 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885ff1e-c966-47e0-8baf-efc02f7eaa9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:25.469675 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885ff1e-c966-47e0-8baf-efc02f7eaa9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:25.470936 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885ff1e-c966-47e0-8baf-efc02f7eaa9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:25.471538 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885ff1e-c966-47e0-8baf-efc02f7eaa9a admin admin] PATH_INFO: `/v3/users/b352f19b3d734e3591c19e11d9d5e06c` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:25.472999 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9885ff1e-c966-47e0-8baf-efc02f7eaa9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b352f19b3d734e3591c19e11d9d5e06c)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:25.475643 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9885ff1e-c966-47e0-8baf-efc02f7eaa9a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:25.574178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9885ff1e-c966-47e0-8baf-efc02f7eaa9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b352f19b3d734e3591c19e11d9d5e06c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:25.575614 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9885ff1e-c966-47e0-8baf-efc02f7eaa9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b352f19b3d734e3591c19e11d9d5e06c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:25.605403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9885ff1e-c966-47e0-8baf-efc02f7eaa9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b352f19b3d734e3591c19e11d9d5e06c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:25.628166 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9885ff1e-c966-47e0-8baf-efc02f7eaa9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b352f19b3d734e3591c19e11d9d5e06c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:25.629807 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:25.646755 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9885ff1e-c966-47e0-8baf-efc02f7eaa9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b352f19b3d734e3591c19e11d9d5e06c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:25.666268 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2817/5646] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:03:25 2022] DELETE /identity/v3/users/b352f19b3d734e3591c19e11d9d5e06c => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:03:26.501026 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36589eb-dc00-4f13-a209-583c33baf23f admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:26.502732 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c36589eb-dc00-4f13-a209-583c33baf23f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:26.522548 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36589eb-dc00-4f13-a209-583c33baf23f admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:26.676090 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:26.714376 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c78d3-bed1-4d2b-98db-0481cdc1c3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:26.715068 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c78d3-bed1-4d2b-98db-0481cdc1c3dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:26.715398 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c78d3-bed1-4d2b-98db-0481cdc1c3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:26.715673 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c78d3-bed1-4d2b-98db-0481cdc1c3dc admin admin] PATH_INFO: `/v3/projects/f6631c44c1f348778743cd8a969a09d8` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:26.718393 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85c78d3-bed1-4d2b-98db-0481cdc1c3dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6631c44c1f348778743cd8a969a09d8)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:26.721203 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85c78d3-bed1-4d2b-98db-0481cdc1c3dc admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:26.831392 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e85c78d3-bed1-4d2b-98db-0481cdc1c3dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6631c44c1f348778743cd8a969a09d8', 'request_id': 'req-e85c78d3-bed1-4d2b-98db-0481cdc1c3dc'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:26.845323 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e85c78d3-bed1-4d2b-98db-0481cdc1c3dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6631c44c1f348778743cd8a969a09d8', 'request_id': 'req-e85c78d3-bed1-4d2b-98db-0481cdc1c3dc'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:26.863363 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e85c78d3-bed1-4d2b-98db-0481cdc1c3dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6631c44c1f348778743cd8a969a09d8', 'request_id': 'req-e85c78d3-bed1-4d2b-98db-0481cdc1c3dc'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:26.885910 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e85c78d3-bed1-4d2b-98db-0481cdc1c3dc admin admin] The token cache is being invalidate because project f6631c44c1f348778743cd8a969a09d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:03:26.886213 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e85c78d3-bed1-4d2b-98db-0481cdc1c3dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:26.889209 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e85c78d3-bed1-4d2b-98db-0481cdc1c3dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:26.892825 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2830/5647] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:03:26 2022] DELETE /identity/v3/projects/f6631c44c1f348778743cd8a969a09d8 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:03:26.897470 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450b43d-b281-41cb-91ee-47540cb78275 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:26.897936 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450b43d-b281-41cb-91ee-47540cb78275 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:26.898031 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450b43d-b281-41cb-91ee-47540cb78275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:26.935838 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-7450b43d-b281-41cb-91ee-47540cb78275 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:03:26.937179 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7450b43d-b281-41cb-91ee-47540cb78275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:27.235288 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2818/5648] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:03:27.242124 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b43b5-29f9-4210-9f78-defa5e5c4767 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:27.243188 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b43b5-29f9-4210-9f78-defa5e5c4767 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:27.243916 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b43b5-29f9-4210-9f78-defa5e5c4767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:27.285686 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-143b43b5-29f9-4210-9f78-defa5e5c4767 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:03:27.288244 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-143b43b5-29f9-4210-9f78-defa5e5c4767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:27.321758 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2831/5649] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:03:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:03:27.327589 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450b43d-b281-41cb-91ee-47540cb78275 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:27.346083 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450b43d-b281-41cb-91ee-47540cb78275 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:27.356273 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c211c8a7-3661-4294-8f07-53fd85349629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:27.356987 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211c8a7-3661-4294-8f07-53fd85349629 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:27.357272 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211c8a7-3661-4294-8f07-53fd85349629 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:27.357548 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211c8a7-3661-4294-8f07-53fd85349629 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:27.359276 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c211c8a7-3661-4294-8f07-53fd85349629 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:03:27.361228 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c211c8a7-3661-4294-8f07-53fd85349629 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:27.366556 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c211c8a7-3661-4294-8f07-53fd85349629 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:27.405752 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2819/5650] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:03:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:03:27.411082 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b43b5-29f9-4210-9f78-defa5e5c4767 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:27.456358 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b43b5-29f9-4210-9f78-defa5e5c4767 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:27.473570 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034ac19-451f-47bc-8900-7dec8548a423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:27.474208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034ac19-451f-47bc-8900-7dec8548a423 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:27.474489 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034ac19-451f-47bc-8900-7dec8548a423 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:27.474760 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034ac19-451f-47bc-8900-7dec8548a423 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:27.475662 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034ac19-451f-47bc-8900-7dec8548a423 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:27.478242 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034ac19-451f-47bc-8900-7dec8548a423 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:27.586116 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2832/5651] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:03:27 2022] POST /identity/v3/projects => generated 385 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:03:27.589890 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c211c8a7-3661-4294-8f07-53fd85349629 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:27.606822 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c211c8a7-3661-4294-8f07-53fd85349629 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:27.824543 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff15d0-7847-4943-986f-c4e48e192f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:27.825453 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff15d0-7847-4943-986f-c4e48e192f27 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:27.825983 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff15d0-7847-4943-986f-c4e48e192f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:27.826649 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff15d0-7847-4943-986f-c4e48e192f27 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:27.830095 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff15d0-7847-4943-986f-c4e48e192f27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:27.832347 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff15d0-7847-4943-986f-c4e48e192f27 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:27.883237 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034ac19-451f-47bc-8900-7dec8548a423 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:27.888031 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2820/5652] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:03:27 2022] POST /identity/v3/users => generated 293 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:03:27.905522 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034ac19-451f-47bc-8900-7dec8548a423 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:27.921243 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e1f3fa-7d09-4e81-95e8-fc38c0dc4e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:27.922507 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1f3fa-7d09-4e81-95e8-fc38c0dc4e06 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:27.923017 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1f3fa-7d09-4e81-95e8-fc38c0dc4e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:27.923757 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1f3fa-7d09-4e81-95e8-fc38c0dc4e06 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:27.924671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e1f3fa-7d09-4e81-95e8-fc38c0dc4e06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:27.926540 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e1f3fa-7d09-4e81-95e8-fc38c0dc4e06 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:27.956284 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2833/5653] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:03:27.960292 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff15d0-7847-4943-986f-c4e48e192f27 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:27.972371 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff15d0-7847-4943-986f-c4e48e192f27 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:28.001748 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee58751f-419c-490c-ab92-69e3df37b5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:28.002443 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58751f-419c-490c-ab92-69e3df37b5bd admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:28.002733 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58751f-419c-490c-ab92-69e3df37b5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:28.003006 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58751f-419c-490c-ab92-69e3df37b5bd admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:28.007131 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee58751f-419c-490c-ab92-69e3df37b5bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:28.011908 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee58751f-419c-490c-ab92-69e3df37b5bd admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:28.063748 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2821/5654] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:03:28.067910 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e1f3fa-7d09-4e81-95e8-fc38c0dc4e06 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:28.083675 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e1f3fa-7d09-4e81-95e8-fc38c0dc4e06 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:28.112383 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d2292a-ffd1-4a07-b2b9-f72434faa882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:28.113305 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2292a-ffd1-4a07-b2b9-f72434faa882 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:28.113686 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2292a-ffd1-4a07-b2b9-f72434faa882 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:28.114060 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2292a-ffd1-4a07-b2b9-f72434faa882 admin admin] PATH_INFO: `/v3/projects/4c5978fabd9c4a959ccc32f831777859/users/60c9fc28eef84899a323b784899fb35e/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:28.202131 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d2292a-ffd1-4a07-b2b9-f72434faa882 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c5978fabd9c4a959ccc32f831777859, user_id=60c9fc28eef84899a323b784899fb35e, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:28.206630 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d2292a-ffd1-4a07-b2b9-f72434faa882 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:28.262592 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2834/5655] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:03:28 2022] PUT /identity/v3/projects/4c5978fabd9c4a959ccc32f831777859/users/60c9fc28eef84899a323b784899fb35e/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:03:28.274286 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691ea33-2504-4802-b8ce-4811ed08eb75 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:28.274875 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691ea33-2504-4802-b8ce-4811ed08eb75 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:28.275371 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691ea33-2504-4802-b8ce-4811ed08eb75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:28.370765 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-2691ea33-2504-4802-b8ce-4811ed08eb75 None None] MFA Rules not processed for user `60c9fc28eef84899a323b784899fb35e`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:03:28.372076 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2691ea33-2504-4802-b8ce-4811ed08eb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:28.562208 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:28.636145 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2822/5656] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:03:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:03:28.666331 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d2292a-ffd1-4a07-b2b9-f72434faa882 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:28.670473 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d1d2292a-ffd1-4a07-b2b9-f72434faa882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:28.825489 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d2292a-ffd1-4a07-b2b9-f72434faa882 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:28.841632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27791e01-4728-4dbe-847d-933dc1df0ae6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:28.842567 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27791e01-4728-4dbe-847d-933dc1df0ae6 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:28.843045 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27791e01-4728-4dbe-847d-933dc1df0ae6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:28.843501 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27791e01-4728-4dbe-847d-933dc1df0ae6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:28.865627 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27791e01-4728-4dbe-847d-933dc1df0ae6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:28.867118 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27791e01-4728-4dbe-847d-933dc1df0ae6 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:28.895654 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2835/5657] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:03:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:03:30.291676 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2691ea33-2504-4802-b8ce-4811ed08eb75 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:30.304265 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2691ea33-2504-4802-b8ce-4811ed08eb75 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:30.319083 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf59d90c-351d-4b50-95d0-c41dbfbc9de1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:30.319722 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59d90c-351d-4b50-95d0-c41dbfbc9de1 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:30.320044 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59d90c-351d-4b50-95d0-c41dbfbc9de1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:30.320319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59d90c-351d-4b50-95d0-c41dbfbc9de1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:30.322217 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-bf59d90c-351d-4b50-95d0-c41dbfbc9de1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:30.482301 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf59d90c-351d-4b50-95d0-c41dbfbc9de1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:30.483850 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf59d90c-351d-4b50-95d0-c41dbfbc9de1 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:30.511436 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2823/5658] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:03:30 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:03:32.178962 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27791e01-4728-4dbe-847d-933dc1df0ae6 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:32.181096 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-27791e01-4728-4dbe-847d-933dc1df0ae6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:32.207515 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:32.344928 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27791e01-4728-4dbe-847d-933dc1df0ae6 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:32.352716 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6885e8-38de-4f20-80c3-03d609123e8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:32.353573 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6885e8-38de-4f20-80c3-03d609123e8a service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:32.354035 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6885e8-38de-4f20-80c3-03d609123e8a service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:32.354482 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6885e8-38de-4f20-80c3-03d609123e8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:32.356473 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ef6885e8-38de-4f20-80c3-03d609123e8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:32.376806 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6885e8-38de-4f20-80c3-03d609123e8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:32.381563 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6885e8-38de-4f20-80c3-03d609123e8a service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:32.427403 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2836/5659] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:03:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:03:40.496388 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=37 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:41.279436 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf59d90c-351d-4b50-95d0-c41dbfbc9de1 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:41.418271 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf59d90c-351d-4b50-95d0-c41dbfbc9de1 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:41.431732 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c324a-d131-47ab-934a-e382ab1bcc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:41.432643 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c324a-d131-47ab-934a-e382ab1bcc0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:41.436116 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c324a-d131-47ab-934a-e382ab1bcc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:41.436646 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c324a-d131-47ab-934a-e382ab1bcc0a admin admin] PATH_INFO: `/v3/users/60c9fc28eef84899a323b784899fb35e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:41.441010 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3c324a-d131-47ab-934a-e382ab1bcc0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=60c9fc28eef84899a323b784899fb35e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:41.443053 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3c324a-d131-47ab-934a-e382ab1bcc0a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:41.565788 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5a3c324a-d131-47ab-934a-e382ab1bcc0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60c9fc28eef84899a323b784899fb35e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:41.566540 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5a3c324a-d131-47ab-934a-e382ab1bcc0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60c9fc28eef84899a323b784899fb35e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:41.597986 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5a3c324a-d131-47ab-934a-e382ab1bcc0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60c9fc28eef84899a323b784899fb35e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:41.619632 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5a3c324a-d131-47ab-934a-e382ab1bcc0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60c9fc28eef84899a323b784899fb35e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:41.637166 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5a3c324a-d131-47ab-934a-e382ab1bcc0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60c9fc28eef84899a323b784899fb35e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:41.657835 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2824/5660] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:03:41 2022] DELETE /identity/v3/users/60c9fc28eef84899a323b784899fb35e => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:03:41.658080 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a204dd-9834-469d-9d83-9e64e5e22e34 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:41.658080 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a204dd-9834-469d-9d83-9e64e5e22e34 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:41.658080 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a204dd-9834-469d-9d83-9e64e5e22e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:41.679176 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-f4a204dd-9834-469d-9d83-9e64e5e22e34 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:03:41.680551 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f4a204dd-9834-469d-9d83-9e64e5e22e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:41.888527 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2837/5661] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:03:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:03:41.899332 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c324a-d131-47ab-934a-e382ab1bcc0a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:41.900934 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5a3c324a-d131-47ab-934a-e382ab1bcc0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:42.049827 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c324a-d131-47ab-934a-e382ab1bcc0a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:42.054334 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b895fc7-ab92-4996-8c90-59e600012166 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:42.055303 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b895fc7-ab92-4996-8c90-59e600012166 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:42.056026 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b895fc7-ab92-4996-8c90-59e600012166 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:42.056539 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b895fc7-ab92-4996-8c90-59e600012166 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:42.069325 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b895fc7-ab92-4996-8c90-59e600012166 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:42.071859 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b895fc7-ab92-4996-8c90-59e600012166 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:42.085647 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2825/5662] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:03:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:03:43.305825 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a204dd-9834-469d-9d83-9e64e5e22e34 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:43.307343 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f4a204dd-9834-469d-9d83-9e64e5e22e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:43.322672 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a204dd-9834-469d-9d83-9e64e5e22e34 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:43.329178 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91caf08-078f-4345-ad7e-035970ecb8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:43.330122 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91caf08-078f-4345-ad7e-035970ecb8f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:43.330563 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91caf08-078f-4345-ad7e-035970ecb8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:43.331669 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91caf08-078f-4345-ad7e-035970ecb8f2 admin admin] PATH_INFO: `/v3/projects/4c5978fabd9c4a959ccc32f831777859` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:43.333396 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91caf08-078f-4345-ad7e-035970ecb8f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c5978fabd9c4a959ccc32f831777859)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:43.335625 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91caf08-078f-4345-ad7e-035970ecb8f2 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:43.444384 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c91caf08-078f-4345-ad7e-035970ecb8f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c5978fabd9c4a959ccc32f831777859', 'request_id': 'req-c91caf08-078f-4345-ad7e-035970ecb8f2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:43.453119 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c91caf08-078f-4345-ad7e-035970ecb8f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c5978fabd9c4a959ccc32f831777859', 'request_id': 'req-c91caf08-078f-4345-ad7e-035970ecb8f2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:43.463649 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c91caf08-078f-4345-ad7e-035970ecb8f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c5978fabd9c4a959ccc32f831777859', 'request_id': 'req-c91caf08-078f-4345-ad7e-035970ecb8f2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:43.493361 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c91caf08-078f-4345-ad7e-035970ecb8f2 admin admin] The token cache is being invalidate because project 4c5978fabd9c4a959ccc32f831777859 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:03:43.493789 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c91caf08-078f-4345-ad7e-035970ecb8f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:43.494807 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c91caf08-078f-4345-ad7e-035970ecb8f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:43.497427 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2838/5663] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:03:43 2022] DELETE /identity/v3/projects/4c5978fabd9c4a959ccc32f831777859 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:03:43.504194 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ab44a-792a-4d8f-ae03-de344a3155ea None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:43.504714 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ab44a-792a-4d8f-ae03-de344a3155ea None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:43.504714 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ab44a-792a-4d8f-ae03-de344a3155ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:43.534583 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-598ab44a-792a-4d8f-ae03-de344a3155ea None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:03:43.535867 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-598ab44a-792a-4d8f-ae03-de344a3155ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:43.563884 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:43.626849 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2826/5664] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:03:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:03:43.627818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6912b-506b-41ef-b60d-4e16d55dd5fc None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:43.628113 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6912b-506b-41ef-b60d-4e16d55dd5fc None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:43.628393 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6912b-506b-41ef-b60d-4e16d55dd5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:43.653659 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-cea6912b-506b-41ef-b60d-4e16d55dd5fc None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:03:43.654984 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-cea6912b-506b-41ef-b60d-4e16d55dd5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:43.668967 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2839/5665] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:03:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:03:43.673572 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ab44a-792a-4d8f-ae03-de344a3155ea None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:43.684673 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ab44a-792a-4d8f-ae03-de344a3155ea None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:43.691835 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530016f0-64de-473b-ac18-e20faa50bb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:43.692801 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530016f0-64de-473b-ac18-e20faa50bb73 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:43.693303 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530016f0-64de-473b-ac18-e20faa50bb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:43.693812 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530016f0-64de-473b-ac18-e20faa50bb73 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:43.694708 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530016f0-64de-473b-ac18-e20faa50bb73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:03:43.695371 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530016f0-64de-473b-ac18-e20faa50bb73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:43.698316 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530016f0-64de-473b-ac18-e20faa50bb73 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:43.727079 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2827/5666] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:03:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:03:43.728886 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6912b-506b-41ef-b60d-4e16d55dd5fc None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:43.741543 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6912b-506b-41ef-b60d-4e16d55dd5fc None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:43.748354 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54954227-72f6-42ba-aca6-cd9f912905a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:43.748980 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54954227-72f6-42ba-aca6-cd9f912905a4 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:43.749254 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54954227-72f6-42ba-aca6-cd9f912905a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:43.749503 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54954227-72f6-42ba-aca6-cd9f912905a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:43.750680 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54954227-72f6-42ba-aca6-cd9f912905a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:43.753324 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54954227-72f6-42ba-aca6-cd9f912905a4 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:43.767534 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:43.780706 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7635f-a4a4-47a1-aba3-df353e0ae905 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:43.780961 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7635f-a4a4-47a1-aba3-df353e0ae905 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:43.781145 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7635f-a4a4-47a1-aba3-df353e0ae905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:43.821724 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2840/5667] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:03:43 2022] POST /identity/v3/projects => generated 381 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:03:43.822902 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54954227-72f6-42ba-aca6-cd9f912905a4 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:43.863319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-b8a7635f-a4a4-47a1-aba3-df353e0ae905 None None] MFA Rules not processed for user `e1ce5d3d668743d5b8843936f77c0150`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:03:43.867877 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b8a7635f-a4a4-47a1-aba3-df353e0ae905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:44.008202 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54954227-72f6-42ba-aca6-cd9f912905a4 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:44.030449 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f6354-8533-4ac4-b2a4-86eeaea6c97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:44.031756 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f6354-8533-4ac4-b2a4-86eeaea6c97b admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:44.033249 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f6354-8533-4ac4-b2a4-86eeaea6c97b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:44.033249 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f6354-8533-4ac4-b2a4-86eeaea6c97b admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:44.036658 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f6354-8533-4ac4-b2a4-86eeaea6c97b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:44.038841 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f6354-8533-4ac4-b2a4-86eeaea6c97b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:44.054312 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2828/5668] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:03:43 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:03:44.112697 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2841/5669] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:03:43 2022] POST /identity/v3/users => generated 291 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:03:44.117477 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7635f-a4a4-47a1-aba3-df353e0ae905 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:44.134682 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7635f-a4a4-47a1-aba3-df353e0ae905 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:44.142300 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560c2cd-9042-4c03-ad6c-2ba35326c3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:44.143357 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560c2cd-9042-4c03-ad6c-2ba35326c3b7 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:44.143922 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560c2cd-9042-4c03-ad6c-2ba35326c3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:44.144835 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560c2cd-9042-4c03-ad6c-2ba35326c3b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:44.145742 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9560c2cd-9042-4c03-ad6c-2ba35326c3b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:44.148048 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9560c2cd-9042-4c03-ad6c-2ba35326c3b7 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:44.161948 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2829/5670] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:03:44 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:03:44.166307 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f6354-8533-4ac4-b2a4-86eeaea6c97b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:44.185488 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f6354-8533-4ac4-b2a4-86eeaea6c97b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:44.194934 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b045ec4d-175d-45ef-941c-12d4a6a15881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:44.197663 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045ec4d-175d-45ef-941c-12d4a6a15881 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:44.198019 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045ec4d-175d-45ef-941c-12d4a6a15881 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:44.198835 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045ec4d-175d-45ef-941c-12d4a6a15881 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:44.203177 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b045ec4d-175d-45ef-941c-12d4a6a15881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:44.207389 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b045ec4d-175d-45ef-941c-12d4a6a15881 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:44.237335 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2842/5671] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:03:44 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:03:44.238606 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560c2cd-9042-4c03-ad6c-2ba35326c3b7 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:44.267342 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560c2cd-9042-4c03-ad6c-2ba35326c3b7 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:44.283800 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdfe3c5-d366-4c10-aac3-8b3ac4d20e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:44.284651 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdfe3c5-d366-4c10-aac3-8b3ac4d20e32 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:44.285038 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdfe3c5-d366-4c10-aac3-8b3ac4d20e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:44.285417 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdfe3c5-d366-4c10-aac3-8b3ac4d20e32 admin admin] PATH_INFO: `/v3/projects/b9897bb5d8d743019427eab8dacfab56/users/218362c51e8841209b1edfb4f12537ca/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:44.323501 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdfe3c5-d366-4c10-aac3-8b3ac4d20e32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9897bb5d8d743019427eab8dacfab56, user_id=218362c51e8841209b1edfb4f12537ca, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:44.326374 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdfe3c5-d366-4c10-aac3-8b3ac4d20e32 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:44.354547 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2830/5672] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:03:44 2022] PUT /identity/v3/projects/b9897bb5d8d743019427eab8dacfab56/users/218362c51e8841209b1edfb4f12537ca/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:03:44.369617 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273b106-9a7f-4052-aece-0b0405867608 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:44.370162 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273b106-9a7f-4052-aece-0b0405867608 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:44.370162 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273b106-9a7f-4052-aece-0b0405867608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:44.448810 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-4273b106-9a7f-4052-aece-0b0405867608 None None] MFA Rules not processed for user `218362c51e8841209b1edfb4f12537ca`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:03:44.450336 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4273b106-9a7f-4052-aece-0b0405867608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:44.604185 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2843/5673] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:03:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:03:44.623581 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdfe3c5-d366-4c10-aac3-8b3ac4d20e32 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:44.626892 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1fdfe3c5-d366-4c10-aac3-8b3ac4d20e32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:44.776946 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdfe3c5-d366-4c10-aac3-8b3ac4d20e32 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:44.783719 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ecaa93-cf4c-4a2e-98dd-1a021730cb88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:44.785488 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecaa93-cf4c-4a2e-98dd-1a021730cb88 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:44.785955 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecaa93-cf4c-4a2e-98dd-1a021730cb88 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:44.786400 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecaa93-cf4c-4a2e-98dd-1a021730cb88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:44.800129 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ecaa93-cf4c-4a2e-98dd-1a021730cb88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:44.801902 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ecaa93-cf4c-4a2e-98dd-1a021730cb88 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:44.822116 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2831/5674] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:03:44 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:03:47.158235 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4273b106-9a7f-4052-aece-0b0405867608 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:47.160961 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4273b106-9a7f-4052-aece-0b0405867608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:47.183783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4273b106-9a7f-4052-aece-0b0405867608 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:47.199157 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a99d44-02e9-4294-a5af-6ad291b78b4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:47.199812 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a99d44-02e9-4294-a5af-6ad291b78b4f service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:47.200386 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a99d44-02e9-4294-a5af-6ad291b78b4f service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:47.200831 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a99d44-02e9-4294-a5af-6ad291b78b4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:47.205553 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-98a99d44-02e9-4294-a5af-6ad291b78b4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:47.386481 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:47.396260 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a99d44-02e9-4294-a5af-6ad291b78b4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:47.397984 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a99d44-02e9-4294-a5af-6ad291b78b4f service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:47.428180 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2844/5675] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:03:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:03:48.118394 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ecaa93-cf4c-4a2e-98dd-1a021730cb88 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:48.120552 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-49ecaa93-cf4c-4a2e-98dd-1a021730cb88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:48.232520 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:48.339081 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ecaa93-cf4c-4a2e-98dd-1a021730cb88 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:48.355017 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3549d44-fa54-43cc-8128-9da85eb0f868 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:48.355418 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3549d44-fa54-43cc-8128-9da85eb0f868 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:48.355702 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3549d44-fa54-43cc-8128-9da85eb0f868 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:48.355976 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3549d44-fa54-43cc-8128-9da85eb0f868 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:48.368164 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e3549d44-fa54-43cc-8128-9da85eb0f868 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:48.384488 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3549d44-fa54-43cc-8128-9da85eb0f868 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:48.386104 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3549d44-fa54-43cc-8128-9da85eb0f868 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:48.405764 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2832/5676] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:03:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:03:57.423540 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:57.535498 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a99d44-02e9-4294-a5af-6ad291b78b4f service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:57.537233 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-98a99d44-02e9-4294-a5af-6ad291b78b4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:57.563909 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a99d44-02e9-4294-a5af-6ad291b78b4f service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:57.571048 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6328771-5014-4c29-b081-53b0da2b8159 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:57.572536 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6328771-5014-4c29-b081-53b0da2b8159 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:57.573035 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6328771-5014-4c29-b081-53b0da2b8159 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:57.573503 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6328771-5014-4c29-b081-53b0da2b8159 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:57.575540 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b6328771-5014-4c29-b081-53b0da2b8159 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:57.591181 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6328771-5014-4c29-b081-53b0da2b8159 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:57.594474 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6328771-5014-4c29-b081-53b0da2b8159 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:57.619437 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2845/5677] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:03:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:03:58.396728 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=24 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:07.602403 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=6 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:09.323525 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3549d44-fa54-43cc-8128-9da85eb0f868 service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:09.325584 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e3549d44-fa54-43cc-8128-9da85eb0f868 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:09.356486 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3549d44-fa54-43cc-8128-9da85eb0f868 service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:09.376939 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def35e4-7537-4473-9593-356ccd4f5c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:09.382403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def35e4-7537-4473-9593-356ccd4f5c0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:09.382996 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def35e4-7537-4473-9593-356ccd4f5c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:09.383846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def35e4-7537-4473-9593-356ccd4f5c0e admin admin] PATH_INFO: `/v3/users/2cd0536429dd4c47b296b9645b6e0c48` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:09.385458 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6def35e4-7537-4473-9593-356ccd4f5c0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cd0536429dd4c47b296b9645b6e0c48)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:09.388724 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6def35e4-7537-4473-9593-356ccd4f5c0e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:09.565499 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6def35e4-7537-4473-9593-356ccd4f5c0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cd0536429dd4c47b296b9645b6e0c48'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:09.568701 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6def35e4-7537-4473-9593-356ccd4f5c0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cd0536429dd4c47b296b9645b6e0c48'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:09.613048 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6def35e4-7537-4473-9593-356ccd4f5c0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cd0536429dd4c47b296b9645b6e0c48'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:09.637548 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6def35e4-7537-4473-9593-356ccd4f5c0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cd0536429dd4c47b296b9645b6e0c48'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:09.665500 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6def35e4-7537-4473-9593-356ccd4f5c0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cd0536429dd4c47b296b9645b6e0c48'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:09.684619 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2833/5678] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:04:09 2022] DELETE /identity/v3/users/2cd0536429dd4c47b296b9645b6e0c48 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:10.234223 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6328771-5014-4c29-b081-53b0da2b8159 service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:10.252592 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6328771-5014-4c29-b081-53b0da2b8159 service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:10.428006 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4bce40-ba15-413f-96a7-6eb618014e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:10.428704 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4bce40-ba15-413f-96a7-6eb618014e80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:10.429010 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4bce40-ba15-413f-96a7-6eb618014e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:10.429309 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4bce40-ba15-413f-96a7-6eb618014e80 admin admin] PATH_INFO: `/v3/projects/32dcc4d8d4a44d24bce81642e49a84ab` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:10.434404 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4bce40-ba15-413f-96a7-6eb618014e80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32dcc4d8d4a44d24bce81642e49a84ab)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:10.436643 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4bce40-ba15-413f-96a7-6eb618014e80 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:10.532504 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5c4bce40-ba15-413f-96a7-6eb618014e80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32dcc4d8d4a44d24bce81642e49a84ab', 'request_id': 'req-5c4bce40-ba15-413f-96a7-6eb618014e80'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:10.547104 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5c4bce40-ba15-413f-96a7-6eb618014e80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32dcc4d8d4a44d24bce81642e49a84ab', 'request_id': 'req-5c4bce40-ba15-413f-96a7-6eb618014e80'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:10.573640 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5c4bce40-ba15-413f-96a7-6eb618014e80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32dcc4d8d4a44d24bce81642e49a84ab', 'request_id': 'req-5c4bce40-ba15-413f-96a7-6eb618014e80'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:10.599639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5c4bce40-ba15-413f-96a7-6eb618014e80 admin admin] The token cache is being invalidate because project 32dcc4d8d4a44d24bce81642e49a84ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:04:10.600148 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5c4bce40-ba15-413f-96a7-6eb618014e80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:10.600935 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5c4bce40-ba15-413f-96a7-6eb618014e80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:10.602883 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2846/5679] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:04:10 2022] DELETE /identity/v3/projects/32dcc4d8d4a44d24bce81642e49a84ab => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:10.607062 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def35e4-7537-4473-9593-356ccd4f5c0e admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:10.608543 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6def35e4-7537-4473-9593-356ccd4f5c0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:10.637236 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def35e4-7537-4473-9593-356ccd4f5c0e admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:10.731997 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e6f0c-f435-4d7f-aeda-e2e6c254a050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:10.733276 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e6f0c-f435-4d7f-aeda-e2e6c254a050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:10.733715 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e6f0c-f435-4d7f-aeda-e2e6c254a050 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:10.734255 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e6f0c-f435-4d7f-aeda-e2e6c254a050 admin admin] PATH_INFO: `/v3/users/af578f0b19294a96a5ec3217f5643f66` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:10.736451 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906e6f0c-f435-4d7f-aeda-e2e6c254a050 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af578f0b19294a96a5ec3217f5643f66)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:10.749372 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906e6f0c-f435-4d7f-aeda-e2e6c254a050 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:10.839662 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-906e6f0c-f435-4d7f-aeda-e2e6c254a050 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af578f0b19294a96a5ec3217f5643f66'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:10.841032 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-906e6f0c-f435-4d7f-aeda-e2e6c254a050 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af578f0b19294a96a5ec3217f5643f66'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:10.874141 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-906e6f0c-f435-4d7f-aeda-e2e6c254a050 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af578f0b19294a96a5ec3217f5643f66'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:10.893448 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-906e6f0c-f435-4d7f-aeda-e2e6c254a050 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af578f0b19294a96a5ec3217f5643f66'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:10.896888 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:10.915210 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-906e6f0c-f435-4d7f-aeda-e2e6c254a050 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af578f0b19294a96a5ec3217f5643f66'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:10.934669 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2834/5680] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:04:10 2022] DELETE /identity/v3/users/af578f0b19294a96a5ec3217f5643f66 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:11.643980 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4bce40-ba15-413f-96a7-6eb618014e80 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:11.646116 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5c4bce40-ba15-413f-96a7-6eb618014e80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:11.665717 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4bce40-ba15-413f-96a7-6eb618014e80 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:11.847566 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d3da6-d057-427f-83bf-699f89a745ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:11.849545 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d3da6-d057-427f-83bf-699f89a745ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:11.849545 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d3da6-d057-427f-83bf-699f89a745ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:11.849545 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d3da6-d057-427f-83bf-699f89a745ad admin admin] PATH_INFO: `/v3/projects/aba152541e384db68acce6f207e77c18` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:11.865643 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87d3da6-d057-427f-83bf-699f89a745ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=aba152541e384db68acce6f207e77c18)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:11.879823 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87d3da6-d057-427f-83bf-699f89a745ad admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:12.002704 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:12.067641 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e6f0c-f435-4d7f-aeda-e2e6c254a050 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:12.069265 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-906e6f0c-f435-4d7f-aeda-e2e6c254a050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:12.080326 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b87d3da6-d057-427f-83bf-699f89a745ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aba152541e384db68acce6f207e77c18', 'request_id': 'req-b87d3da6-d057-427f-83bf-699f89a745ad'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:12.105036 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e6f0c-f435-4d7f-aeda-e2e6c254a050 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:12.105896 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b87d3da6-d057-427f-83bf-699f89a745ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aba152541e384db68acce6f207e77c18', 'request_id': 'req-b87d3da6-d057-427f-83bf-699f89a745ad'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:12.130043 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b87d3da6-d057-427f-83bf-699f89a745ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aba152541e384db68acce6f207e77c18', 'request_id': 'req-b87d3da6-d057-427f-83bf-699f89a745ad'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:12.206011 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b87d3da6-d057-427f-83bf-699f89a745ad admin admin] The token cache is being invalidate because project aba152541e384db68acce6f207e77c18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:04:12.206357 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b87d3da6-d057-427f-83bf-699f89a745ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:12.211226 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b87d3da6-d057-427f-83bf-699f89a745ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:12.216559 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2847/5681] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:04:11 2022] DELETE /identity/v3/projects/aba152541e384db68acce6f207e77c18 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:12.221142 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc932f3-fc06-41af-845d-de117edc958a None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:12.221434 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc932f3-fc06-41af-845d-de117edc958a None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:12.221705 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc932f3-fc06-41af-845d-de117edc958a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:12.238962 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3b5e8-e175-4925-95e9-ba2c3ce3d50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:12.240142 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3b5e8-e175-4925-95e9-ba2c3ce3d50f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:12.240626 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3b5e8-e175-4925-95e9-ba2c3ce3d50f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:12.241157 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3b5e8-e175-4925-95e9-ba2c3ce3d50f admin admin] PATH_INFO: `/v3/users/218362c51e8841209b1edfb4f12537ca` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:12.242564 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3b5e8-e175-4925-95e9-ba2c3ce3d50f admin admin] RBAC: Authorizing `identity:delete_user(user_id=218362c51e8841209b1edfb4f12537ca)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:12.244873 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3b5e8-e175-4925-95e9-ba2c3ce3d50f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:12.256838 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-9bc932f3-fc06-41af-845d-de117edc958a None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:04:12.260919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9bc932f3-fc06-41af-845d-de117edc958a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:12.284574 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2848/5682] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:04:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:04:12.292354 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6057aaa-7b91-459e-a3bd-638c97e6596d None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:12.292709 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6057aaa-7b91-459e-a3bd-638c97e6596d None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:12.293042 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6057aaa-7b91-459e-a3bd-638c97e6596d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:12.332892 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1aa3b5e8-e175-4925-95e9-ba2c3ce3d50f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '218362c51e8841209b1edfb4f12537ca'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:12.334702 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-e6057aaa-7b91-459e-a3bd-638c97e6596d None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:04:12.336140 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e6057aaa-7b91-459e-a3bd-638c97e6596d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:12.337301 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1aa3b5e8-e175-4925-95e9-ba2c3ce3d50f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '218362c51e8841209b1edfb4f12537ca'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:12.350443 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2849/5683] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:04:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:04:12.351502 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6057aaa-7b91-459e-a3bd-638c97e6596d None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:12.365617 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6057aaa-7b91-459e-a3bd-638c97e6596d None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:12.370610 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1aa3b5e8-e175-4925-95e9-ba2c3ce3d50f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '218362c51e8841209b1edfb4f12537ca'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:12.372898 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1edabd8-2f22-4aca-8a79-cfbbecbf01b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:12.373985 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edabd8-2f22-4aca-8a79-cfbbecbf01b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:12.374267 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edabd8-2f22-4aca-8a79-cfbbecbf01b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:12.375488 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edabd8-2f22-4aca-8a79-cfbbecbf01b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:12.376239 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1edabd8-2f22-4aca-8a79-cfbbecbf01b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:04:12.376610 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1edabd8-2f22-4aca-8a79-cfbbecbf01b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:12.378172 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1edabd8-2f22-4aca-8a79-cfbbecbf01b8 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:12.389311 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1aa3b5e8-e175-4925-95e9-ba2c3ce3d50f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '218362c51e8841209b1edfb4f12537ca'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:12.401820 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2850/5684] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:04:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:04:12.403348 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1edabd8-2f22-4aca-8a79-cfbbecbf01b8 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:12.408898 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1aa3b5e8-e175-4925-95e9-ba2c3ce3d50f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '218362c51e8841209b1edfb4f12537ca'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:12.418992 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1edabd8-2f22-4aca-8a79-cfbbecbf01b8 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:12.428329 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53208ec8-d33a-4f55-8023-5c9b796e965c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:12.428951 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53208ec8-d33a-4f55-8023-5c9b796e965c admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:12.429231 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53208ec8-d33a-4f55-8023-5c9b796e965c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:12.429514 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53208ec8-d33a-4f55-8023-5c9b796e965c admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:12.430180 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2835/5685] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:04:12 2022] DELETE /identity/v3/users/218362c51e8841209b1edfb4f12537ca => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:12.433243 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53208ec8-d33a-4f55-8023-5c9b796e965c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:12.434570 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149e1ce-700e-46de-9c45-6f5418a230f7 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:12.435543 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149e1ce-700e-46de-9c45-6f5418a230f7 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:12.435955 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53208ec8-d33a-4f55-8023-5c9b796e965c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:12.436757 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149e1ce-700e-46de-9c45-6f5418a230f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:12.459122 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-1149e1ce-700e-46de-9c45-6f5418a230f7 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:04:12.460516 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1149e1ce-700e-46de-9c45-6f5418a230f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:12.500366 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2851/5686] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:04:12 2022] POST /identity/v3/projects => generated 379 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:04:12.502099 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53208ec8-d33a-4f55-8023-5c9b796e965c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:12.504195 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-53208ec8-d33a-4f55-8023-5c9b796e965c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:12.590113 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53208ec8-d33a-4f55-8023-5c9b796e965c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:12.599171 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e620746-d5fd-465e-ad5e-dfee69623a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:12.600184 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e620746-d5fd-465e-ad5e-dfee69623a5c admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:12.600693 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e620746-d5fd-465e-ad5e-dfee69623a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:12.601179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e620746-d5fd-465e-ad5e-dfee69623a5c admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:12.602158 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e620746-d5fd-465e-ad5e-dfee69623a5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:12.605041 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e620746-d5fd-465e-ad5e-dfee69623a5c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:12.621424 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2836/5687] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:04:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:04:12.629070 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1149e1ce-700e-46de-9c45-6f5418a230f7 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:12.630916 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1149e1ce-700e-46de-9c45-6f5418a230f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:12.663912 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:12.713280 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2852/5688] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:04:12 2022] POST /identity/v3/users => generated 290 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:04:12.715012 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e620746-d5fd-465e-ad5e-dfee69623a5c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:12.747840 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e620746-d5fd-465e-ad5e-dfee69623a5c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:12.754107 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1b9e6-dcd4-48bb-b13e-3dc6317def6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:12.754743 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1b9e6-dcd4-48bb-b13e-3dc6317def6a admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:12.755048 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1b9e6-dcd4-48bb-b13e-3dc6317def6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:12.755328 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1b9e6-dcd4-48bb-b13e-3dc6317def6a admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:12.756190 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1b9e6-dcd4-48bb-b13e-3dc6317def6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:12.759196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1b9e6-dcd4-48bb-b13e-3dc6317def6a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:12.771952 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1149e1ce-700e-46de-9c45-6f5418a230f7 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:12.775316 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2853/5689] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:04:12.776230 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1b9e6-dcd4-48bb-b13e-3dc6317def6a admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:12.787331 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1b9e6-dcd4-48bb-b13e-3dc6317def6a admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:12.793603 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7169d73-52e8-4b15-8e29-e35cf4234def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:12.794221 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7169d73-52e8-4b15-8e29-e35cf4234def admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:12.794501 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7169d73-52e8-4b15-8e29-e35cf4234def admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:12.794936 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7169d73-52e8-4b15-8e29-e35cf4234def admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:12.797589 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7169d73-52e8-4b15-8e29-e35cf4234def admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:12.799978 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7169d73-52e8-4b15-8e29-e35cf4234def admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:12.823157 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2854/5690] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:04:12.827436 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7169d73-52e8-4b15-8e29-e35cf4234def admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:12.846305 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7169d73-52e8-4b15-8e29-e35cf4234def admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:12.854067 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ea04e-1a1c-494d-9268-9c5163b872a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:12.854764 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ea04e-1a1c-494d-9268-9c5163b872a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:12.855075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ea04e-1a1c-494d-9268-9c5163b872a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:12.855361 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ea04e-1a1c-494d-9268-9c5163b872a6 admin admin] PATH_INFO: `/v3/projects/d0feabff683942e39790dd9c2db4c756/users/5e4172de0cf949438bd642c9086caa9e/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:12.880440 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9ea04e-1a1c-494d-9268-9c5163b872a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0feabff683942e39790dd9c2db4c756, user_id=5e4172de0cf949438bd642c9086caa9e, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:12.881029 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05cb96b-c6e7-4dfb-bf99-0100c70f9b92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:12.881992 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cb96b-c6e7-4dfb-bf99-0100c70f9b92 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:12.882339 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cb96b-c6e7-4dfb-bf99-0100c70f9b92 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:12.882684 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cb96b-c6e7-4dfb-bf99-0100c70f9b92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:12.886190 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9ea04e-1a1c-494d-9268-9c5163b872a6 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:12.904386 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05cb96b-c6e7-4dfb-bf99-0100c70f9b92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:12.906952 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05cb96b-c6e7-4dfb-bf99-0100c70f9b92 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:12.926545 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2855/5691] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:04:12 2022] PUT /identity/v3/projects/d0feabff683942e39790dd9c2db4c756/users/5e4172de0cf949438bd642c9086caa9e/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:12.928663 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab545cf-541f-4733-b2e9-6b7e03ee0e78 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:12.929026 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab545cf-541f-4733-b2e9-6b7e03ee0e78 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:12.929432 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab545cf-541f-4733-b2e9-6b7e03ee0e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:12.941162 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2837/5692] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:04:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:04:13.001816 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-fab545cf-541f-4733-b2e9-6b7e03ee0e78 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:04:13.003188 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-fab545cf-541f-4733-b2e9-6b7e03ee0e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:13.051313 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=5,keystone:INSERT=6 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:13.230667 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2856/5693] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:04:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:04:13.238317 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05cb96b-c6e7-4dfb-bf99-0100c70f9b92 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:13.239866 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b05cb96b-c6e7-4dfb-bf99-0100c70f9b92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:13.263482 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05cb96b-c6e7-4dfb-bf99-0100c70f9b92 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:13.271567 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab545cf-541f-4733-b2e9-6b7e03ee0e78 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:13.469480 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab545cf-541f-4733-b2e9-6b7e03ee0e78 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:13.481257 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c77f3b-0279-4cfe-9c40-72d5eaa2de31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:13.481993 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c77f3b-0279-4cfe-9c40-72d5eaa2de31 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:13.482347 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c77f3b-0279-4cfe-9c40-72d5eaa2de31 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:13.483222 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c77f3b-0279-4cfe-9c40-72d5eaa2de31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:13.488336 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b8c77f3b-0279-4cfe-9c40-72d5eaa2de31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:13.523814 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440f9ee-9b68-496a-9558-22a55506fe50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:13.524458 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440f9ee-9b68-496a-9558-22a55506fe50 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:13.524736 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440f9ee-9b68-496a-9558-22a55506fe50 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:13.525009 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440f9ee-9b68-496a-9558-22a55506fe50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:13.541009 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c77f3b-0279-4cfe-9c40-72d5eaa2de31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:13.543409 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c77f3b-0279-4cfe-9c40-72d5eaa2de31 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:13.552084 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7440f9ee-9b68-496a-9558-22a55506fe50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:13.553579 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7440f9ee-9b68-496a-9558-22a55506fe50 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:13.555752 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2857/5694] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:04:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:04:13.582099 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2838/5695] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:04:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:04:13.669179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c77f3b-0279-4cfe-9c40-72d5eaa2de31 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:13.671478 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b8c77f3b-0279-4cfe-9c40-72d5eaa2de31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:13.692237 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c77f3b-0279-4cfe-9c40-72d5eaa2de31 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:13.734834 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ecf700-fe4f-4ab5-aaef-d5c0478de588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:13.735555 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ecf700-fe4f-4ab5-aaef-d5c0478de588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:13.735839 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ecf700-fe4f-4ab5-aaef-d5c0478de588 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:13.737273 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ecf700-fe4f-4ab5-aaef-d5c0478de588 admin admin] PATH_INFO: `/v3/projects/b9897bb5d8d743019427eab8dacfab56` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:13.752605 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ecf700-fe4f-4ab5-aaef-d5c0478de588 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9897bb5d8d743019427eab8dacfab56)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:13.754607 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ecf700-fe4f-4ab5-aaef-d5c0478de588 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:13.888346 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e2ecf700-fe4f-4ab5-aaef-d5c0478de588 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9897bb5d8d743019427eab8dacfab56', 'request_id': 'req-e2ecf700-fe4f-4ab5-aaef-d5c0478de588'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:13.906859 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e2ecf700-fe4f-4ab5-aaef-d5c0478de588 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9897bb5d8d743019427eab8dacfab56', 'request_id': 'req-e2ecf700-fe4f-4ab5-aaef-d5c0478de588'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:13.917706 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e2ecf700-fe4f-4ab5-aaef-d5c0478de588 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9897bb5d8d743019427eab8dacfab56', 'request_id': 'req-e2ecf700-fe4f-4ab5-aaef-d5c0478de588'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:13.951275 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e2ecf700-fe4f-4ab5-aaef-d5c0478de588 admin admin] The token cache is being invalidate because project b9897bb5d8d743019427eab8dacfab56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:04:13.951275 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e2ecf700-fe4f-4ab5-aaef-d5c0478de588 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:13.952615 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e2ecf700-fe4f-4ab5-aaef-d5c0478de588 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:13.958992 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2858/5696] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:04:13 2022] DELETE /identity/v3/projects/b9897bb5d8d743019427eab8dacfab56 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:13.960774 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03430a51-8751-48fe-ac47-f6e3290dc85b None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:13.961156 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03430a51-8751-48fe-ac47-f6e3290dc85b None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:13.961589 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03430a51-8751-48fe-ac47-f6e3290dc85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:14.000979 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-03430a51-8751-48fe-ac47-f6e3290dc85b None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:04:14.002473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-03430a51-8751-48fe-ac47-f6e3290dc85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:14.182971 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2839/5697] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:04:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:04:14.185152 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7454711-e56c-4a9f-82f4-0843bca03c45 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:14.185439 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7454711-e56c-4a9f-82f4-0843bca03c45 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:14.185712 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7454711-e56c-4a9f-82f4-0843bca03c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:14.237979 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-f7454711-e56c-4a9f-82f4-0843bca03c45 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:04:14.239284 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f7454711-e56c-4a9f-82f4-0843bca03c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:14.264196 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2859/5698] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:04:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:04:14.265886 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03430a51-8751-48fe-ac47-f6e3290dc85b None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:14.293780 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03430a51-8751-48fe-ac47-f6e3290dc85b None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:14.310154 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c0d9c-75b7-4c7f-aab7-0ce371bb1f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:14.310966 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c0d9c-75b7-4c7f-aab7-0ce371bb1f68 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:14.311436 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c0d9c-75b7-4c7f-aab7-0ce371bb1f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:14.313249 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c0d9c-75b7-4c7f-aab7-0ce371bb1f68 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:14.314123 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2c0d9c-75b7-4c7f-aab7-0ce371bb1f68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:04:14.315816 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2c0d9c-75b7-4c7f-aab7-0ce371bb1f68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:14.321280 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2c0d9c-75b7-4c7f-aab7-0ce371bb1f68 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:14.336600 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:14.346411 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2840/5699] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:04:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:04:14.350972 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7454711-e56c-4a9f-82f4-0843bca03c45 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:14.370263 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7454711-e56c-4a9f-82f4-0843bca03c45 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:14.386367 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c1e05-a801-466b-bd7c-d3ed39aa8851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:14.387824 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c1e05-a801-466b-bd7c-d3ed39aa8851 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:14.389522 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c1e05-a801-466b-bd7c-d3ed39aa8851 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:14.390014 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c1e05-a801-466b-bd7c-d3ed39aa8851 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:14.392110 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88c1e05-a801-466b-bd7c-d3ed39aa8851 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:14.397066 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88c1e05-a801-466b-bd7c-d3ed39aa8851 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:14.472394 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2860/5700] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:04:14 2022] POST /identity/v3/projects => generated 359 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:04:14.477549 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c0d9c-75b7-4c7f-aab7-0ce371bb1f68 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:14.520608 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c0d9c-75b7-4c7f-aab7-0ce371bb1f68 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:14.717116 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446a5b5-986c-4a4a-8063-27034132a41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:14.718016 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446a5b5-986c-4a4a-8063-27034132a41b admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:14.719119 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446a5b5-986c-4a4a-8063-27034132a41b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:14.719452 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446a5b5-986c-4a4a-8063-27034132a41b admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:14.720195 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8446a5b5-986c-4a4a-8063-27034132a41b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:14.722822 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8446a5b5-986c-4a4a-8063-27034132a41b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:14.787054 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2841/5701] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:04:14 2022] POST /identity/v3/users => generated 280 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:04:14.789062 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c1e05-a801-466b-bd7c-d3ed39aa8851 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:14.808778 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c1e05-a801-466b-bd7c-d3ed39aa8851 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:14.830508 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912c746-393d-47b3-a067-ba370fa84ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:14.831407 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912c746-393d-47b3-a067-ba370fa84ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:14.831846 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912c746-393d-47b3-a067-ba370fa84ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:14.832270 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912c746-393d-47b3-a067-ba370fa84ff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:14.833063 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912c746-393d-47b3-a067-ba370fa84ff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:14.837107 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912c746-393d-47b3-a067-ba370fa84ff0 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:14.896871 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2861/5702] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:04:14 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:04:14.897919 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446a5b5-986c-4a4a-8063-27034132a41b admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:14.911894 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446a5b5-986c-4a4a-8063-27034132a41b admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:14.929146 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a4c4a6-b6b4-476e-9fe6-6a039eaa748b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:14.929787 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4c4a6-b6b4-476e-9fe6-6a039eaa748b admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:14.930629 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4c4a6-b6b4-476e-9fe6-6a039eaa748b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:14.930913 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4c4a6-b6b4-476e-9fe6-6a039eaa748b admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:14.931939 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a4c4a6-b6b4-476e-9fe6-6a039eaa748b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:14.933590 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a4c4a6-b6b4-476e-9fe6-6a039eaa748b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:14.973770 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2842/5703] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:04:14 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:04:14.975258 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912c746-393d-47b3-a067-ba370fa84ff0 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:14.980729 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:14.996962 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912c746-393d-47b3-a067-ba370fa84ff0 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:15.003194 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b75b41-f4d4-4c07-bab4-1212bd7d683d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:15.003895 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b75b41-f4d4-4c07-bab4-1212bd7d683d admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:15.004180 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b75b41-f4d4-4c07-bab4-1212bd7d683d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:15.004458 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b75b41-f4d4-4c07-bab4-1212bd7d683d admin admin] PATH_INFO: `/v3/projects/3e8c5cfbfa934212b352cde91b8756d3/users/777c9c05811146d494e241711b930744/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:15.047205 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b75b41-f4d4-4c07-bab4-1212bd7d683d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e8c5cfbfa934212b352cde91b8756d3, user_id=777c9c05811146d494e241711b930744, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:15.049941 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b75b41-f4d4-4c07-bab4-1212bd7d683d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:15.094286 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63b8a5-abc2-4683-9f6f-597734d3836f None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:15.094607 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63b8a5-abc2-4683-9f6f-597734d3836f None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:15.094848 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63b8a5-abc2-4683-9f6f-597734d3836f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:15.098135 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2862/5704] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:04:14 2022] PUT /identity/v3/projects/3e8c5cfbfa934212b352cde91b8756d3/users/777c9c05811146d494e241711b930744/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:15.154729 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-be63b8a5-abc2-4683-9f6f-597734d3836f None None] MFA Rules not processed for user `777c9c05811146d494e241711b930744`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:04:15.156609 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-be63b8a5-abc2-4683-9f6f-597734d3836f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:15.288267 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2843/5705] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:04:15 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:04:15.339082 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b75b41-f4d4-4c07-bab4-1212bd7d683d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:15.341057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-29b75b41-f4d4-4c07-bab4-1212bd7d683d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:15.482165 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b75b41-f4d4-4c07-bab4-1212bd7d683d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:15.487364 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6407dd-7583-4ba1-a7fe-e021d3b117bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:15.487882 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6407dd-7583-4ba1-a7fe-e021d3b117bc service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:15.488167 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6407dd-7583-4ba1-a7fe-e021d3b117bc service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:15.488483 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6407dd-7583-4ba1-a7fe-e021d3b117bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:15.516326 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6407dd-7583-4ba1-a7fe-e021d3b117bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:15.518095 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6407dd-7583-4ba1-a7fe-e021d3b117bc service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:15.536734 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2863/5706] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:04:15 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:04:23.734329 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea3ed2-9635-4b44-82fd-21b8870e9b65 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:23.735119 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea3ed2-9635-4b44-82fd-21b8870e9b65 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:23.735119 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea3ed2-9635-4b44-82fd-21b8870e9b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:23.856286 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-c7ea3ed2-9635-4b44-82fd-21b8870e9b65 None None] MFA Rules not processed for user `5e4172de0cf949438bd642c9086caa9e`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:04:23.861965 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c7ea3ed2-9635-4b44-82fd-21b8870e9b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:24.067698 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:24.085012 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2844/5707] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:04:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:04:24.098070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6407dd-7583-4ba1-a7fe-e021d3b117bc service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:24.099948 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-fa6407dd-7583-4ba1-a7fe-e021d3b117bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:24.242558 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6407dd-7583-4ba1-a7fe-e021d3b117bc service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:24.250935 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092918eb-db13-4681-bb52-7e2d53b9e8e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:24.251613 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092918eb-db13-4681-bb52-7e2d53b9e8e4 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:24.251865 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092918eb-db13-4681-bb52-7e2d53b9e8e4 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:24.254110 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092918eb-db13-4681-bb52-7e2d53b9e8e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:24.272961 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092918eb-db13-4681-bb52-7e2d53b9e8e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:24.276771 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092918eb-db13-4681-bb52-7e2d53b9e8e4 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:24.350602 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2864/5708] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:04:24 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:04:32.139334 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea3ed2-9635-4b44-82fd-21b8870e9b65 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:32.143220 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c7ea3ed2-9635-4b44-82fd-21b8870e9b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:32.217243 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea3ed2-9635-4b44-82fd-21b8870e9b65 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:32.223214 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575fa70b-83c7-48e8-a135-9b08915c9ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:32.224124 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fa70b-83c7-48e8-a135-9b08915c9ebc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:32.224506 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fa70b-83c7-48e8-a135-9b08915c9ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:32.224885 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fa70b-83c7-48e8-a135-9b08915c9ebc admin admin] PATH_INFO: `/v3/users/5e4172de0cf949438bd642c9086caa9e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:32.226140 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575fa70b-83c7-48e8-a135-9b08915c9ebc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e4172de0cf949438bd642c9086caa9e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:32.228212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575fa70b-83c7-48e8-a135-9b08915c9ebc admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:32.304019 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-575fa70b-83c7-48e8-a135-9b08915c9ebc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e4172de0cf949438bd642c9086caa9e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:32.304922 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-575fa70b-83c7-48e8-a135-9b08915c9ebc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e4172de0cf949438bd642c9086caa9e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:32.361596 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-575fa70b-83c7-48e8-a135-9b08915c9ebc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e4172de0cf949438bd642c9086caa9e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:32.372293 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-575fa70b-83c7-48e8-a135-9b08915c9ebc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e4172de0cf949438bd642c9086caa9e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:32.385978 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-575fa70b-83c7-48e8-a135-9b08915c9ebc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e4172de0cf949438bd642c9086caa9e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:32.397625 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2845/5709] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:04:32 2022] DELETE /identity/v3/users/5e4172de0cf949438bd642c9086caa9e => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:32.623215 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092918eb-db13-4681-bb52-7e2d53b9e8e4 service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:32.643256 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092918eb-db13-4681-bb52-7e2d53b9e8e4 service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:32.744156 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60576e0d-41f0-40fd-a051-d77ce821e38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:32.745846 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60576e0d-41f0-40fd-a051-d77ce821e38d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:32.746265 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60576e0d-41f0-40fd-a051-d77ce821e38d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:32.746976 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60576e0d-41f0-40fd-a051-d77ce821e38d admin admin] PATH_INFO: `/v3/projects/d0feabff683942e39790dd9c2db4c756` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:32.748521 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60576e0d-41f0-40fd-a051-d77ce821e38d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0feabff683942e39790dd9c2db4c756)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:32.751358 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60576e0d-41f0-40fd-a051-d77ce821e38d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:32.763489 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:32.813390 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-60576e0d-41f0-40fd-a051-d77ce821e38d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0feabff683942e39790dd9c2db4c756', 'request_id': 'req-60576e0d-41f0-40fd-a051-d77ce821e38d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:32.821943 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-60576e0d-41f0-40fd-a051-d77ce821e38d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0feabff683942e39790dd9c2db4c756', 'request_id': 'req-60576e0d-41f0-40fd-a051-d77ce821e38d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:32.831834 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-60576e0d-41f0-40fd-a051-d77ce821e38d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0feabff683942e39790dd9c2db4c756', 'request_id': 'req-60576e0d-41f0-40fd-a051-d77ce821e38d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:32.852410 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-60576e0d-41f0-40fd-a051-d77ce821e38d admin admin] The token cache is being invalidate because project d0feabff683942e39790dd9c2db4c756 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:04:32.853262 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-60576e0d-41f0-40fd-a051-d77ce821e38d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:32.855164 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-60576e0d-41f0-40fd-a051-d77ce821e38d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:32.857212 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2865/5710] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:04:32 2022] DELETE /identity/v3/projects/d0feabff683942e39790dd9c2db4c756 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:32.863428 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374ac43-06e5-4db4-9082-67a6471556c6 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:32.863708 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374ac43-06e5-4db4-9082-67a6471556c6 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:32.863968 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374ac43-06e5-4db4-9082-67a6471556c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:32.888167 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-6374ac43-06e5-4db4-9082-67a6471556c6 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:04:32.889178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6374ac43-06e5-4db4-9082-67a6471556c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:32.968776 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2846/5711] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:04:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:04:32.972594 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb15ee-f065-4401-95b7-d02f60144c75 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:32.973080 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb15ee-f065-4401-95b7-d02f60144c75 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:32.973531 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb15ee-f065-4401-95b7-d02f60144c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:32.998797 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a7fb15ee-f065-4401-95b7-d02f60144c75 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:04:33.000674 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a7fb15ee-f065-4401-95b7-d02f60144c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:33.009039 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2866/5712] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:04:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:04:33.013220 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6374ac43-06e5-4db4-9082-67a6471556c6 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:33.024435 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6374ac43-06e5-4db4-9082-67a6471556c6 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:33.030571 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1a9b1-d29b-4e3d-8f72-df926191b79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:33.031624 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1a9b1-d29b-4e3d-8f72-df926191b79a admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:33.032053 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1a9b1-d29b-4e3d-8f72-df926191b79a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:33.032506 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1a9b1-d29b-4e3d-8f72-df926191b79a admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:33.033176 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da1a9b1-d29b-4e3d-8f72-df926191b79a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:04:33.033484 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da1a9b1-d29b-4e3d-8f72-df926191b79a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:33.036138 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da1a9b1-d29b-4e3d-8f72-df926191b79a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:33.050174 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2847/5713] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:04:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:04:33.054017 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb15ee-f065-4401-95b7-d02f60144c75 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:33.064629 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb15ee-f065-4401-95b7-d02f60144c75 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:33.069813 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc2247-c232-41cb-a200-c3db0956e029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:33.070110 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc2247-c232-41cb-a200-c3db0956e029 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:33.070386 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc2247-c232-41cb-a200-c3db0956e029 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:33.070700 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc2247-c232-41cb-a200-c3db0956e029 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:33.071345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc2247-c232-41cb-a200-c3db0956e029 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:33.073344 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc2247-c232-41cb-a200-c3db0956e029 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:33.129292 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2867/5714] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:04:33 2022] POST /identity/v3/projects => generated 401 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:04:33.130249 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1a9b1-d29b-4e3d-8f72-df926191b79a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:33.138303 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:33.148849 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1a9b1-d29b-4e3d-8f72-df926191b79a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:33.242960 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f5932-83c7-4247-a009-be0234b22cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:33.244051 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f5932-83c7-4247-a009-be0234b22cea admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:33.244551 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f5932-83c7-4247-a009-be0234b22cea admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:33.245018 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f5932-83c7-4247-a009-be0234b22cea admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:33.245844 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f5932-83c7-4247-a009-be0234b22cea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:33.248232 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f5932-83c7-4247-a009-be0234b22cea admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:33.274969 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2848/5715] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:04:33 2022] POST /identity/v3/users => generated 301 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:04:33.278812 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc2247-c232-41cb-a200-c3db0956e029 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:33.290766 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc2247-c232-41cb-a200-c3db0956e029 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:33.297235 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82db8d08-d8b4-4bcf-b8fd-8b9f05499e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:33.298337 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db8d08-d8b4-4bcf-b8fd-8b9f05499e0f admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:33.298808 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db8d08-d8b4-4bcf-b8fd-8b9f05499e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:33.299294 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db8d08-d8b4-4bcf-b8fd-8b9f05499e0f admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:33.300418 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82db8d08-d8b4-4bcf-b8fd-8b9f05499e0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:33.302469 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82db8d08-d8b4-4bcf-b8fd-8b9f05499e0f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:33.320151 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2868/5716] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:04:33.321389 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f5932-83c7-4247-a009-be0234b22cea admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:33.334885 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f5932-83c7-4247-a009-be0234b22cea admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:33.341263 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98806a1f-2a3a-4c71-8af7-99c8e8f48a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:33.342508 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98806a1f-2a3a-4c71-8af7-99c8e8f48a63 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:33.342508 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98806a1f-2a3a-4c71-8af7-99c8e8f48a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:33.342798 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98806a1f-2a3a-4c71-8af7-99c8e8f48a63 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:33.344695 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98806a1f-2a3a-4c71-8af7-99c8e8f48a63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:33.346498 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98806a1f-2a3a-4c71-8af7-99c8e8f48a63 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:33.360668 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2849/5717] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:04:33.364925 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82db8d08-d8b4-4bcf-b8fd-8b9f05499e0f admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:33.375791 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82db8d08-d8b4-4bcf-b8fd-8b9f05499e0f admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:33.380928 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21435241-aebe-467d-87e1-93e12095f9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:33.381631 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21435241-aebe-467d-87e1-93e12095f9e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:33.381919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21435241-aebe-467d-87e1-93e12095f9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:33.382204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21435241-aebe-467d-87e1-93e12095f9e8 admin admin] PATH_INFO: `/v3/projects/723c2a60b20a499ea839f78455f26650/users/716ecea3e4114c52b81cfb887d1a2965/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:33.401159 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21435241-aebe-467d-87e1-93e12095f9e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=723c2a60b20a499ea839f78455f26650, user_id=716ecea3e4114c52b81cfb887d1a2965, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:33.403947 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21435241-aebe-467d-87e1-93e12095f9e8 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:33.428021 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2869/5718] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:04:33 2022] PUT /identity/v3/projects/723c2a60b20a499ea839f78455f26650/users/716ecea3e4114c52b81cfb887d1a2965/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:04:33.435428 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b9b2c-4930-4ed6-bace-882df25235f7 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:33.435631 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b9b2c-4930-4ed6-bace-882df25235f7 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:33.436101 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b9b2c-4930-4ed6-bace-882df25235f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:33.486895 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-769b9b2c-4930-4ed6-bace-882df25235f7 None None] MFA Rules not processed for user `716ecea3e4114c52b81cfb887d1a2965`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:04:33.488881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-769b9b2c-4930-4ed6-bace-882df25235f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:33.570833 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2850/5719] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:04:33 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:04:33.575132 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21435241-aebe-467d-87e1-93e12095f9e8 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:33.647877 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21435241-aebe-467d-87e1-93e12095f9e8 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:33.652653 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c319f-6453-4814-88e0-cae76822b225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:33.653261 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c319f-6453-4814-88e0-cae76822b225 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:33.653536 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c319f-6453-4814-88e0-cae76822b225 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:33.653804 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c319f-6453-4814-88e0-cae76822b225 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:33.654443 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c319f-6453-4814-88e0-cae76822b225 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:33.657103 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c319f-6453-4814-88e0-cae76822b225 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:33.686852 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2870/5720] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:04:33 2022] POST /identity/v3/projects => generated 401 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:04:33.690910 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b9b2c-4930-4ed6-bace-882df25235f7 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:33.702892 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b9b2c-4930-4ed6-bace-882df25235f7 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:33.792539 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21fa7cf-bcc2-4529-b125-d344962e3c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:33.793257 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21fa7cf-bcc2-4529-b125-d344962e3c44 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:33.793895 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21fa7cf-bcc2-4529-b125-d344962e3c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:33.793895 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21fa7cf-bcc2-4529-b125-d344962e3c44 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:33.794692 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21fa7cf-bcc2-4529-b125-d344962e3c44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:33.796849 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21fa7cf-bcc2-4529-b125-d344962e3c44 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:33.831098 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2851/5721] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:04:33 2022] POST /identity/v3/users => generated 307 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:04:33.832753 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c319f-6453-4814-88e0-cae76822b225 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:33.846882 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c319f-6453-4814-88e0-cae76822b225 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:33.852400 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b17e8-a9e6-4248-a648-e96973a32de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:33.853200 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b17e8-a9e6-4248-a648-e96973a32de4 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:33.853520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b17e8-a9e6-4248-a648-e96973a32de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:33.854007 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b17e8-a9e6-4248-a648-e96973a32de4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:33.854837 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b17e8-a9e6-4248-a648-e96973a32de4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:33.856786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b17e8-a9e6-4248-a648-e96973a32de4 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:33.869355 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2871/5722] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:04:33.876257 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21fa7cf-bcc2-4529-b125-d344962e3c44 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:33.886745 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:33.900276 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21fa7cf-bcc2-4529-b125-d344962e3c44 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:33.907435 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d031e5-ee7f-4c2d-bffe-6587bf7d098a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:33.908500 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d031e5-ee7f-4c2d-bffe-6587bf7d098a admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:33.909002 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d031e5-ee7f-4c2d-bffe-6587bf7d098a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:33.909485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d031e5-ee7f-4c2d-bffe-6587bf7d098a admin admin] PATH_INFO: `/v3/projects/02d557af15214d70a0fcf3bcc4978041/users/f7c662e8dfb6437caf97aa16d696ce87/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:33.926600 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d031e5-ee7f-4c2d-bffe-6587bf7d098a admin admin] RBAC: Authorizing `identity:create_grant(project_id=02d557af15214d70a0fcf3bcc4978041, user_id=f7c662e8dfb6437caf97aa16d696ce87, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:33.929611 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d031e5-ee7f-4c2d-bffe-6587bf7d098a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:33.948750 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2852/5723] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:04:33 2022] PUT /identity/v3/projects/02d557af15214d70a0fcf3bcc4978041/users/f7c662e8dfb6437caf97aa16d696ce87/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:33.953407 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b17e8-a9e6-4248-a648-e96973a32de4 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:33.971946 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b17e8-a9e6-4248-a648-e96973a32de4 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:33.978816 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:34.058131 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2612a07-b5f9-426f-8018-e2bc73f03397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:34.058420 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2612a07-b5f9-426f-8018-e2bc73f03397 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:34.058811 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2612a07-b5f9-426f-8018-e2bc73f03397 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:34.059173 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2612a07-b5f9-426f-8018-e2bc73f03397 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:34.059960 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2612a07-b5f9-426f-8018-e2bc73f03397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:34.061955 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2612a07-b5f9-426f-8018-e2bc73f03397 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:34.073205 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2872/5724] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:04:34.078119 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d031e5-ee7f-4c2d-bffe-6587bf7d098a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:34.091364 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d031e5-ee7f-4c2d-bffe-6587bf7d098a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:34.098103 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a46d74-b797-4f81-be99-fa32619de5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:34.099240 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a46d74-b797-4f81-be99-fa32619de5f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:34.099779 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a46d74-b797-4f81-be99-fa32619de5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:34.100219 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a46d74-b797-4f81-be99-fa32619de5f0 admin admin] PATH_INFO: `/v3/projects/02d557af15214d70a0fcf3bcc4978041/users/f7c662e8dfb6437caf97aa16d696ce87/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:34.102656 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a46d74-b797-4f81-be99-fa32619de5f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02d557af15214d70a0fcf3bcc4978041, user_id=f7c662e8dfb6437caf97aa16d696ce87, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:34.105764 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a46d74-b797-4f81-be99-fa32619de5f0 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:34.129641 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2853/5725] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:04:34 2022] PUT /identity/v3/projects/02d557af15214d70a0fcf3bcc4978041/users/f7c662e8dfb6437caf97aa16d696ce87/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:34.140185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd581e0a-84fc-4b02-8d77-034af1adaa5a None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:34.140561 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd581e0a-84fc-4b02-8d77-034af1adaa5a None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:34.140935 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd581e0a-84fc-4b02-8d77-034af1adaa5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:34.174311 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-bd581e0a-84fc-4b02-8d77-034af1adaa5a None None] MFA Rules not processed for user `f7c662e8dfb6437caf97aa16d696ce87`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:04:34.175916 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-bd581e0a-84fc-4b02-8d77-034af1adaa5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:34.274433 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2873/5726] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:04:34 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:04:34.275331 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a46d74-b797-4f81-be99-fa32619de5f0 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:34.298018 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a46d74-b797-4f81-be99-fa32619de5f0 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:34.306489 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c6f2e-b125-4d93-a18d-55de64003051 tempest-ApplicationCredentialsV3AdminTest-346277339 tempest-ApplicationCredentialsV3AdminTest-346277339-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7c662e8dfb6437caf97aa16d696ce87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02d557af15214d70a0fcf3bcc4978041', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:34.307340 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c6f2e-b125-4d93-a18d-55de64003051 tempest-ApplicationCredentialsV3AdminTest-346277339 tempest-ApplicationCredentialsV3AdminTest-346277339-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:34.307863 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c6f2e-b125-4d93-a18d-55de64003051 tempest-ApplicationCredentialsV3AdminTest-346277339 tempest-ApplicationCredentialsV3AdminTest-346277339-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:34.308375 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c6f2e-b125-4d93-a18d-55de64003051 tempest-ApplicationCredentialsV3AdminTest-346277339 tempest-ApplicationCredentialsV3AdminTest-346277339-project-admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:34.309132 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c6f2e-b125-4d93-a18d-55de64003051 tempest-ApplicationCredentialsV3AdminTest-346277339 tempest-ApplicationCredentialsV3AdminTest-346277339-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:34.310902 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c6f2e-b125-4d93-a18d-55de64003051 tempest-ApplicationCredentialsV3AdminTest-346277339 tempest-ApplicationCredentialsV3AdminTest-346277339-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:34.341941 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd581e0a-84fc-4b02-8d77-034af1adaa5a None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:34.344541 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2854/5727] 10.222.0.83 () {60 vars in 1143 bytes} [Mon Aug 29 16:04:34 2022] POST /identity/v3/roles => generated 240 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:04:34.353969 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd581e0a-84fc-4b02-8d77-034af1adaa5a None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:34.362431 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d5c57-f42c-40f0-95f9-580c7881aaca tempest-ApplicationCredentialsV3AdminTest-346277339 tempest-ApplicationCredentialsV3AdminTest-346277339-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7c662e8dfb6437caf97aa16d696ce87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02d557af15214d70a0fcf3bcc4978041', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:34.364539 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d5c57-f42c-40f0-95f9-580c7881aaca tempest-ApplicationCredentialsV3AdminTest-346277339 tempest-ApplicationCredentialsV3AdminTest-346277339-project-admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:34.365056 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d5c57-f42c-40f0-95f9-580c7881aaca tempest-ApplicationCredentialsV3AdminTest-346277339 tempest-ApplicationCredentialsV3AdminTest-346277339-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:34.365533 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d5c57-f42c-40f0-95f9-580c7881aaca tempest-ApplicationCredentialsV3AdminTest-346277339 tempest-ApplicationCredentialsV3AdminTest-346277339-project-admin] PATH_INFO: `/v3/projects/723c2a60b20a499ea839f78455f26650/users/716ecea3e4114c52b81cfb887d1a2965/roles/e007e0d3fb2f4487af1f71fe8c6cdfd9` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:34.369014 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0d5c57-f42c-40f0-95f9-580c7881aaca tempest-ApplicationCredentialsV3AdminTest-346277339 tempest-ApplicationCredentialsV3AdminTest-346277339-project-admin] RBAC: Authorizing `identity:create_grant(project_id=723c2a60b20a499ea839f78455f26650, user_id=716ecea3e4114c52b81cfb887d1a2965, role_id=e007e0d3fb2f4487af1f71fe8c6cdfd9)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:34.372353 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0d5c57-f42c-40f0-95f9-580c7881aaca tempest-ApplicationCredentialsV3AdminTest-346277339 tempest-ApplicationCredentialsV3AdminTest-346277339-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:34.395692 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c6f2e-b125-4d93-a18d-55de64003051 tempest-ApplicationCredentialsV3AdminTest-346277339 tempest-ApplicationCredentialsV3AdminTest-346277339-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:34.407135 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2874/5728] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:04:34 2022] PUT /identity/v3/projects/723c2a60b20a499ea839f78455f26650/users/716ecea3e4114c52b81cfb887d1a2965/roles/e007e0d3fb2f4487af1f71fe8c6cdfd9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:04:34.477544 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c6f2e-b125-4d93-a18d-55de64003051 tempest-ApplicationCredentialsV3AdminTest-346277339 tempest-ApplicationCredentialsV3AdminTest-346277339-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:34.608475 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d17a9b-3580-4108-9506-c031f347faae tempest-ApplicationCredentialsV3AdminTest-523303661 tempest-ApplicationCredentialsV3AdminTest-523303661-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716ecea3e4114c52b81cfb887d1a2965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '723c2a60b20a499ea839f78455f26650', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'tempest-test_role-1925789484'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:34.609758 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d17a9b-3580-4108-9506-c031f347faae tempest-ApplicationCredentialsV3AdminTest-523303661 tempest-ApplicationCredentialsV3AdminTest-523303661-project] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:34.610188 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d17a9b-3580-4108-9506-c031f347faae tempest-ApplicationCredentialsV3AdminTest-523303661 tempest-ApplicationCredentialsV3AdminTest-523303661-project] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:34.610719 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d17a9b-3580-4108-9506-c031f347faae tempest-ApplicationCredentialsV3AdminTest-523303661 tempest-ApplicationCredentialsV3AdminTest-523303661-project] PATH_INFO: `/v3/users/716ecea3e4114c52b81cfb887d1a2965/application_credentials` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:34.616438 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d17a9b-3580-4108-9506-c031f347faae tempest-ApplicationCredentialsV3AdminTest-523303661 tempest-ApplicationCredentialsV3AdminTest-523303661-project] RBAC: Authorizing `identity:create_application_credential(user_id=716ecea3e4114c52b81cfb887d1a2965)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:34.621799 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d17a9b-3580-4108-9506-c031f347faae tempest-ApplicationCredentialsV3AdminTest-523303661 tempest-ApplicationCredentialsV3AdminTest-523303661-project] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:34.805623 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:34.818773 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2855/5729] 10.222.0.83 () {60 vars in 1315 bytes} [Mon Aug 29 16:04:34 2022] POST /identity/v3/users/716ecea3e4114c52b81cfb887d1a2965/application_credentials => generated 660 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:04:34.823260 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f198e-dd36-4f7d-80cb-63719b1cfc0c None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:34.823737 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f198e-dd36-4f7d-80cb-63719b1cfc0c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:34.823824 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f198e-dd36-4f7d-80cb-63719b1cfc0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:34.849504 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-402f198e-dd36-4f7d-80cb-63719b1cfc0c None None] MFA Rules not processed for user `716ecea3e4114c52b81cfb887d1a2965`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:04:34.850779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-402f198e-dd36-4f7d-80cb-63719b1cfc0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:34.918315 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:34.979237 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2875/5730] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:04:34 2022] POST /identity/v3/auth/tokens => generated 3395 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Aug 29 16:04:34.985269 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d17a9b-3580-4108-9506-c031f347faae tempest-ApplicationCredentialsV3AdminTest-523303661 tempest-ApplicationCredentialsV3AdminTest-523303661-project] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:34.997763 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d17a9b-3580-4108-9506-c031f347faae tempest-ApplicationCredentialsV3AdminTest-523303661 tempest-ApplicationCredentialsV3AdminTest-523303661-project] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:35.003411 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66abe68-d163-4b01-8018-03328723fd55 tempest-ApplicationCredentialsV3AdminTest-523303661 tempest-ApplicationCredentialsV3AdminTest-523303661-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716ecea3e4114c52b81cfb887d1a2965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '723c2a60b20a499ea839f78455f26650', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'tempest-test_role-1925789484'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:35.004191 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66abe68-d163-4b01-8018-03328723fd55 tempest-ApplicationCredentialsV3AdminTest-523303661 tempest-ApplicationCredentialsV3AdminTest-523303661-project] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:35.004791 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66abe68-d163-4b01-8018-03328723fd55 tempest-ApplicationCredentialsV3AdminTest-523303661 tempest-ApplicationCredentialsV3AdminTest-523303661-project] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:35.004918 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66abe68-d163-4b01-8018-03328723fd55 tempest-ApplicationCredentialsV3AdminTest-523303661 tempest-ApplicationCredentialsV3AdminTest-523303661-project] PATH_INFO: `/v3/users/716ecea3e4114c52b81cfb887d1a2965/application_credentials/db35eac4401245f9a765a16d86d61f44` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:35.006660 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66abe68-d163-4b01-8018-03328723fd55 tempest-ApplicationCredentialsV3AdminTest-523303661 tempest-ApplicationCredentialsV3AdminTest-523303661-project] RBAC: Authorizing `identity:delete_application_credential(user_id=716ecea3e4114c52b81cfb887d1a2965, application_credential_id=db35eac4401245f9a765a16d86d61f44)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:35.008000 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66abe68-d163-4b01-8018-03328723fd55 tempest-ApplicationCredentialsV3AdminTest-523303661 tempest-ApplicationCredentialsV3AdminTest-523303661-project] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:35.034309 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2856/5731] 10.222.0.83 () {58 vars in 1395 bytes} [Mon Aug 29 16:04:34 2022] DELETE /identity/v3/users/716ecea3e4114c52b81cfb887d1a2965/application_credentials/db35eac4401245f9a765a16d86d61f44 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:35.038868 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f198e-dd36-4f7d-80cb-63719b1cfc0c None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:35.113995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f198e-dd36-4f7d-80cb-63719b1cfc0c None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:35.119260 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68f1a0-14a6-4c15-a384-0c3990020913 tempest-ApplicationCredentialsV3AdminTest-346277339 tempest-ApplicationCredentialsV3AdminTest-346277339-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7c662e8dfb6437caf97aa16d696ce87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02d557af15214d70a0fcf3bcc4978041', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:35.119909 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68f1a0-14a6-4c15-a384-0c3990020913 tempest-ApplicationCredentialsV3AdminTest-346277339 tempest-ApplicationCredentialsV3AdminTest-346277339-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:35.120196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68f1a0-14a6-4c15-a384-0c3990020913 tempest-ApplicationCredentialsV3AdminTest-346277339 tempest-ApplicationCredentialsV3AdminTest-346277339-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:35.120474 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68f1a0-14a6-4c15-a384-0c3990020913 tempest-ApplicationCredentialsV3AdminTest-346277339 tempest-ApplicationCredentialsV3AdminTest-346277339-project-admin] PATH_INFO: `/v3/roles/e007e0d3fb2f4487af1f71fe8c6cdfd9` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:35.121920 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb68f1a0-14a6-4c15-a384-0c3990020913 tempest-ApplicationCredentialsV3AdminTest-346277339 tempest-ApplicationCredentialsV3AdminTest-346277339-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e007e0d3fb2f4487af1f71fe8c6cdfd9)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:35.123622 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb68f1a0-14a6-4c15-a384-0c3990020913 tempest-ApplicationCredentialsV3AdminTest-346277339 tempest-ApplicationCredentialsV3AdminTest-346277339-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:35.169946 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fb68f1a0-14a6-4c15-a384-0c3990020913 tempest-ApplicationCredentialsV3AdminTest-346277339 tempest-ApplicationCredentialsV3AdminTest-346277339-project-admin] Invalidating the token cache because role e007e0d3fb2f4487af1f71fe8c6cdfd9 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:04:35.170261 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fb68f1a0-14a6-4c15-a384-0c3990020913 tempest-ApplicationCredentialsV3AdminTest-346277339 tempest-ApplicationCredentialsV3AdminTest-346277339-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:35.171701 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fb68f1a0-14a6-4c15-a384-0c3990020913 tempest-ApplicationCredentialsV3AdminTest-346277339 tempest-ApplicationCredentialsV3AdminTest-346277339-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:35.173962 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2876/5732] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:04:35 2022] DELETE /identity/v3/roles/e007e0d3fb2f4487af1f71fe8c6cdfd9 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:04:35.184541 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66abe68-d163-4b01-8018-03328723fd55 tempest-ApplicationCredentialsV3AdminTest-523303661 tempest-ApplicationCredentialsV3AdminTest-523303661-project] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:35.196621 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a66abe68-d163-4b01-8018-03328723fd55 tempest-ApplicationCredentialsV3AdminTest-523303661 tempest-ApplicationCredentialsV3AdminTest-523303661-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:35.384429 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66abe68-d163-4b01-8018-03328723fd55 tempest-ApplicationCredentialsV3AdminTest-523303661 tempest-ApplicationCredentialsV3AdminTest-523303661-project] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:35.504332 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a8a17-08ab-494d-9fb7-fe7ad328f996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:35.506299 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a8a17-08ab-494d-9fb7-fe7ad328f996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:35.508052 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a8a17-08ab-494d-9fb7-fe7ad328f996 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:35.508433 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a8a17-08ab-494d-9fb7-fe7ad328f996 admin admin] PATH_INFO: `/v3/users/716ecea3e4114c52b81cfb887d1a2965` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:35.517384 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67a8a17-08ab-494d-9fb7-fe7ad328f996 admin admin] RBAC: Authorizing `identity:delete_user(user_id=716ecea3e4114c52b81cfb887d1a2965)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:35.522371 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67a8a17-08ab-494d-9fb7-fe7ad328f996 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:35.646890 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a67a8a17-08ab-494d-9fb7-fe7ad328f996 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '716ecea3e4114c52b81cfb887d1a2965'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:35.648591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a67a8a17-08ab-494d-9fb7-fe7ad328f996 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '716ecea3e4114c52b81cfb887d1a2965'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:35.696455 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a67a8a17-08ab-494d-9fb7-fe7ad328f996 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '716ecea3e4114c52b81cfb887d1a2965'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:35.718831 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a67a8a17-08ab-494d-9fb7-fe7ad328f996 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '716ecea3e4114c52b81cfb887d1a2965'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:35.727226 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a67a8a17-08ab-494d-9fb7-fe7ad328f996 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '716ecea3e4114c52b81cfb887d1a2965'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:35.735083 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2857/5733] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:04:35 2022] DELETE /identity/v3/users/716ecea3e4114c52b81cfb887d1a2965 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:35.738822 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55db10-b716-45f0-bf0e-f57c222f8c5e None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:35.739171 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55db10-b716-45f0-bf0e-f57c222f8c5e None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:35.739529 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55db10-b716-45f0-bf0e-f57c222f8c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:35.762752 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74a361-b542-420b-a00f-068a33fab5dc None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:35.763468 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74a361-b542-420b-a00f-068a33fab5dc None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:35.764165 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74a361-b542-420b-a00f-068a33fab5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:35.773985 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:35.780183 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-2d55db10-b716-45f0-bf0e-f57c222f8c5e None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:04:35.784605 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2d55db10-b716-45f0-bf0e-f57c222f8c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:35.797198 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-5f74a361-b542-420b-a00f-068a33fab5dc None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:04:35.800592 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5f74a361-b542-420b-a00f-068a33fab5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:35.992006 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2877/5734] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:04:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:04:36.002715 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55db10-b716-45f0-bf0e-f57c222f8c5e None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:36.008264 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2d55db10-b716-45f0-bf0e-f57c222f8c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:36.009779 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2858/5735] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 16:04:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:04:36.060949 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:36.113455 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55db10-b716-45f0-bf0e-f57c222f8c5e None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:36.117793 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a608f-2a3f-4263-94a7-bd91e9fcd69d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:36.119247 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a608f-2a3f-4263-94a7-bd91e9fcd69d service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:36.120707 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a608f-2a3f-4263-94a7-bd91e9fcd69d service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:36.121178 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a608f-2a3f-4263-94a7-bd91e9fcd69d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:36.132338 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f74a361-b542-420b-a00f-068a33fab5dc None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:36.134022 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5f74a361-b542-420b-a00f-068a33fab5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:36.158905 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a608f-2a3f-4263-94a7-bd91e9fcd69d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:36.162335 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a608f-2a3f-4263-94a7-bd91e9fcd69d service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:36.191211 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2878/5736] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:04:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:04:36.237921 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f74a361-b542-420b-a00f-068a33fab5dc None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:36.244215 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41f66d-c6fc-482c-8b4e-47ccb16e5e9e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:36.245861 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41f66d-c6fc-482c-8b4e-47ccb16e5e9e service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:36.246347 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41f66d-c6fc-482c-8b4e-47ccb16e5e9e service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:36.246915 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41f66d-c6fc-482c-8b4e-47ccb16e5e9e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:36.261317 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a41f66d-c6fc-482c-8b4e-47ccb16e5e9e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:36.263015 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a41f66d-c6fc-482c-8b4e-47ccb16e5e9e service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:36.279360 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2859/5737] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 16:04:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 16:04:37.226940 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a608f-2a3f-4263-94a7-bd91e9fcd69d service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:37.228475 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-095a608f-2a3f-4263-94a7-bd91e9fcd69d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:37.257931 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a608f-2a3f-4263-94a7-bd91e9fcd69d service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:37.286871 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90265156-19b1-4ede-8402-4593cbbf55f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:37.287545 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90265156-19b1-4ede-8402-4593cbbf55f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:37.287826 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90265156-19b1-4ede-8402-4593cbbf55f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:37.288100 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90265156-19b1-4ede-8402-4593cbbf55f1 admin admin] PATH_INFO: `/v3/projects/723c2a60b20a499ea839f78455f26650` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:37.296636 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90265156-19b1-4ede-8402-4593cbbf55f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=723c2a60b20a499ea839f78455f26650)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:37.299229 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90265156-19b1-4ede-8402-4593cbbf55f1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:37.460986 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-90265156-19b1-4ede-8402-4593cbbf55f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '723c2a60b20a499ea839f78455f26650', 'request_id': 'req-90265156-19b1-4ede-8402-4593cbbf55f1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:37.473950 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-90265156-19b1-4ede-8402-4593cbbf55f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '723c2a60b20a499ea839f78455f26650', 'request_id': 'req-90265156-19b1-4ede-8402-4593cbbf55f1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:37.484762 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-90265156-19b1-4ede-8402-4593cbbf55f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '723c2a60b20a499ea839f78455f26650', 'request_id': 'req-90265156-19b1-4ede-8402-4593cbbf55f1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:37.526449 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-90265156-19b1-4ede-8402-4593cbbf55f1 admin admin] The token cache is being invalidate because project 723c2a60b20a499ea839f78455f26650 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:04:37.526748 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-90265156-19b1-4ede-8402-4593cbbf55f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:37.527498 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-90265156-19b1-4ede-8402-4593cbbf55f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:37.530986 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2879/5738] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:04:37 2022] DELETE /identity/v3/projects/723c2a60b20a499ea839f78455f26650 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:37.535195 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41f66d-c6fc-482c-8b4e-47ccb16e5e9e service swift] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:37.552337 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41f66d-c6fc-482c-8b4e-47ccb16e5e9e service swift] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:37.699238 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09304d-4521-4c57-bd22-31feb3de2ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:37.700574 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09304d-4521-4c57-bd22-31feb3de2ddf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:37.701073 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09304d-4521-4c57-bd22-31feb3de2ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:37.701516 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09304d-4521-4c57-bd22-31feb3de2ddf admin admin] PATH_INFO: `/v3/users/f7c662e8dfb6437caf97aa16d696ce87` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:37.704302 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09304d-4521-4c57-bd22-31feb3de2ddf admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7c662e8dfb6437caf97aa16d696ce87)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:37.707589 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09304d-4521-4c57-bd22-31feb3de2ddf admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:37.796758 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:37.815096 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fb09304d-4521-4c57-bd22-31feb3de2ddf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7c662e8dfb6437caf97aa16d696ce87'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:37.822139 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fb09304d-4521-4c57-bd22-31feb3de2ddf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7c662e8dfb6437caf97aa16d696ce87'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:37.883074 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fb09304d-4521-4c57-bd22-31feb3de2ddf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7c662e8dfb6437caf97aa16d696ce87'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:37.896840 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fb09304d-4521-4c57-bd22-31feb3de2ddf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7c662e8dfb6437caf97aa16d696ce87'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:37.906219 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fb09304d-4521-4c57-bd22-31feb3de2ddf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7c662e8dfb6437caf97aa16d696ce87'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:37.919049 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2860/5739] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:04:37 2022] DELETE /identity/v3/users/f7c662e8dfb6437caf97aa16d696ce87 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:38.693069 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90265156-19b1-4ede-8402-4593cbbf55f1 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:38.695401 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-90265156-19b1-4ede-8402-4593cbbf55f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:38.758715 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90265156-19b1-4ede-8402-4593cbbf55f1 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:38.953754 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ea07b-31e5-4576-a170-2a12a8d9e335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:38.954468 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ea07b-31e5-4576-a170-2a12a8d9e335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:38.954749 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ea07b-31e5-4576-a170-2a12a8d9e335 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:38.955102 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ea07b-31e5-4576-a170-2a12a8d9e335 admin admin] PATH_INFO: `/v3/projects/02d557af15214d70a0fcf3bcc4978041` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:38.957645 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ea07b-31e5-4576-a170-2a12a8d9e335 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02d557af15214d70a0fcf3bcc4978041)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:38.964638 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ea07b-31e5-4576-a170-2a12a8d9e335 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:39.081129 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:39.083260 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4a5ea07b-31e5-4576-a170-2a12a8d9e335 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02d557af15214d70a0fcf3bcc4978041', 'request_id': 'req-4a5ea07b-31e5-4576-a170-2a12a8d9e335'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:39.113874 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4a5ea07b-31e5-4576-a170-2a12a8d9e335 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02d557af15214d70a0fcf3bcc4978041', 'request_id': 'req-4a5ea07b-31e5-4576-a170-2a12a8d9e335'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:39.131747 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4a5ea07b-31e5-4576-a170-2a12a8d9e335 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02d557af15214d70a0fcf3bcc4978041', 'request_id': 'req-4a5ea07b-31e5-4576-a170-2a12a8d9e335'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:39.167859 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4a5ea07b-31e5-4576-a170-2a12a8d9e335 admin admin] The token cache is being invalidate because project 02d557af15214d70a0fcf3bcc4978041 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:04:39.168291 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4a5ea07b-31e5-4576-a170-2a12a8d9e335 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:39.170582 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4a5ea07b-31e5-4576-a170-2a12a8d9e335 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:39.178285 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2880/5740] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:04:38 2022] DELETE /identity/v3/projects/02d557af15214d70a0fcf3bcc4978041 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:39.179860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75184e09-249b-4d35-bd8e-2b9c6c74ca8a None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:39.180326 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75184e09-249b-4d35-bd8e-2b9c6c74ca8a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:39.180592 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75184e09-249b-4d35-bd8e-2b9c6c74ca8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:39.252465 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-75184e09-249b-4d35-bd8e-2b9c6c74ca8a None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:04:39.254956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-75184e09-249b-4d35-bd8e-2b9c6c74ca8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:39.386743 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ae759-e349-4933-941b-81cbb0d9c6e2 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:39.387160 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ae759-e349-4933-941b-81cbb0d9c6e2 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:39.387439 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ae759-e349-4933-941b-81cbb0d9c6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:39.398375 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2861/5741] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:04:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:04:39.447223 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-064ae759-e349-4933-941b-81cbb0d9c6e2 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:04:39.448467 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-064ae759-e349-4933-941b-81cbb0d9c6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:39.462717 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2881/5742] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:04:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:04:39.469792 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75184e09-249b-4d35-bd8e-2b9c6c74ca8a None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:39.484608 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75184e09-249b-4d35-bd8e-2b9c6c74ca8a None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:39.506391 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383d95c-ef95-4649-84bd-553a34332cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:39.507055 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383d95c-ef95-4649-84bd-553a34332cac admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:39.507479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383d95c-ef95-4649-84bd-553a34332cac admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:39.507839 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383d95c-ef95-4649-84bd-553a34332cac admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:39.508412 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4383d95c-ef95-4649-84bd-553a34332cac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:04:39.508710 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4383d95c-ef95-4649-84bd-553a34332cac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:39.510557 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4383d95c-ef95-4649-84bd-553a34332cac admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:39.539086 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2862/5743] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:04:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:04:39.544182 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ae759-e349-4933-941b-81cbb0d9c6e2 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:39.557342 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ae759-e349-4933-941b-81cbb0d9c6e2 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:39.588367 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03534380-dd4e-48c5-acb4-7f084d5767cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:39.589061 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03534380-dd4e-48c5-acb4-7f084d5767cc admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:39.589341 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03534380-dd4e-48c5-acb4-7f084d5767cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:39.589620 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03534380-dd4e-48c5-acb4-7f084d5767cc admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:39.590289 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03534380-dd4e-48c5-acb4-7f084d5767cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:39.592325 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03534380-dd4e-48c5-acb4-7f084d5767cc admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:39.686468 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383d95c-ef95-4649-84bd-553a34332cac admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:39.687323 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2882/5744] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:04:39 2022] POST /identity/v3/projects => generated 375 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:04:39.713060 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383d95c-ef95-4649-84bd-553a34332cac admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:39.893208 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0e744-e99e-47da-a821-332f9d08800a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:39.893800 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0e744-e99e-47da-a821-332f9d08800a admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:39.894081 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0e744-e99e-47da-a821-332f9d08800a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:39.894349 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0e744-e99e-47da-a821-332f9d08800a admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:39.895001 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b0e744-e99e-47da-a821-332f9d08800a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:39.896973 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b0e744-e99e-47da-a821-332f9d08800a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:39.949040 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2863/5745] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:04:39 2022] POST /identity/v3/users => generated 288 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:04:39.953769 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03534380-dd4e-48c5-acb4-7f084d5767cc admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:39.968759 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03534380-dd4e-48c5-acb4-7f084d5767cc admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:39.994316 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70164cbd-13e0-46ba-b8dd-e296e2d965f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:39.995144 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70164cbd-13e0-46ba-b8dd-e296e2d965f2 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:39.995591 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70164cbd-13e0-46ba-b8dd-e296e2d965f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:39.996043 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70164cbd-13e0-46ba-b8dd-e296e2d965f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:39.997434 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70164cbd-13e0-46ba-b8dd-e296e2d965f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:40.000609 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70164cbd-13e0-46ba-b8dd-e296e2d965f2 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:40.044633 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0e744-e99e-47da-a821-332f9d08800a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:40.062438 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0e744-e99e-47da-a821-332f9d08800a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:40.066581 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2883/5746] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:04:39 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:04:40.083856 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5510727f-bf95-41b0-814d-40ad7103ce75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:40.084868 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510727f-bf95-41b0-814d-40ad7103ce75 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:40.085352 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510727f-bf95-41b0-814d-40ad7103ce75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:40.087454 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510727f-bf95-41b0-814d-40ad7103ce75 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:40.088262 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5510727f-bf95-41b0-814d-40ad7103ce75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:40.090009 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5510727f-bf95-41b0-814d-40ad7103ce75 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:40.128865 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70164cbd-13e0-46ba-b8dd-e296e2d965f2 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:40.131616 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2864/5747] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:04:40.158458 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70164cbd-13e0-46ba-b8dd-e296e2d965f2 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:40.176786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0eda5d-6f78-428f-a5b9-7d36c468624d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:40.179004 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0eda5d-6f78-428f-a5b9-7d36c468624d admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:40.179004 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0eda5d-6f78-428f-a5b9-7d36c468624d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:40.179004 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0eda5d-6f78-428f-a5b9-7d36c468624d admin admin] PATH_INFO: `/v3/projects/d3abae5dfd284749bb1452d713caa9cc/users/ac436778de8544baae0a0bbae2d0baf1/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:40.289108 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0eda5d-6f78-428f-a5b9-7d36c468624d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3abae5dfd284749bb1452d713caa9cc, user_id=ac436778de8544baae0a0bbae2d0baf1, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:40.304454 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0eda5d-6f78-428f-a5b9-7d36c468624d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:40.372837 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2884/5748] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:04:40 2022] PUT /identity/v3/projects/d3abae5dfd284749bb1452d713caa9cc/users/ac436778de8544baae0a0bbae2d0baf1/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:40.377112 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf980f-91e3-491e-8e65-99844b902576 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:40.377562 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf980f-91e3-491e-8e65-99844b902576 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:40.378025 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf980f-91e3-491e-8e65-99844b902576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:40.461735 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-cbcf980f-91e3-491e-8e65-99844b902576 None None] MFA Rules not processed for user `ac436778de8544baae0a0bbae2d0baf1`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:04:40.467052 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-cbcf980f-91e3-491e-8e65-99844b902576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:40.496412 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:40.658037 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2865/5749] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:04:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:04:40.663441 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0eda5d-6f78-428f-a5b9-7d36c468624d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:40.859854 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0eda5d-6f78-428f-a5b9-7d36c468624d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:40.877099 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876cd163-9b73-4ec4-99fa-4de56e2d3a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:40.878863 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876cd163-9b73-4ec4-99fa-4de56e2d3a3d admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:40.879226 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876cd163-9b73-4ec4-99fa-4de56e2d3a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:40.879510 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876cd163-9b73-4ec4-99fa-4de56e2d3a3d admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:40.880169 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876cd163-9b73-4ec4-99fa-4de56e2d3a3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:40.882191 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876cd163-9b73-4ec4-99fa-4de56e2d3a3d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:40.979499 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2885/5750] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:04:40 2022] POST /identity/v3/projects => generated 375 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:04:40.984480 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcf980f-91e3-491e-8e65-99844b902576 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:41.014100 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcf980f-91e3-491e-8e65-99844b902576 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:41.218740 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82557869-7647-4cfa-b051-343d43035281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:41.221456 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82557869-7647-4cfa-b051-343d43035281 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:41.221828 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82557869-7647-4cfa-b051-343d43035281 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:41.222115 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82557869-7647-4cfa-b051-343d43035281 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:41.223795 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82557869-7647-4cfa-b051-343d43035281 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:41.226636 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82557869-7647-4cfa-b051-343d43035281 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:41.299576 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2866/5751] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:04:40 2022] POST /identity/v3/users => generated 294 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:04:41.301106 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876cd163-9b73-4ec4-99fa-4de56e2d3a3d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:41.316054 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876cd163-9b73-4ec4-99fa-4de56e2d3a3d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:41.343980 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905c6e9-9345-4973-b163-540e3283a2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:41.344380 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905c6e9-9345-4973-b163-540e3283a2d3 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:41.344664 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905c6e9-9345-4973-b163-540e3283a2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:41.344935 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905c6e9-9345-4973-b163-540e3283a2d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:41.345598 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f905c6e9-9345-4973-b163-540e3283a2d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:41.347242 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f905c6e9-9345-4973-b163-540e3283a2d3 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:41.407561 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2886/5752] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:04:41.412041 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82557869-7647-4cfa-b051-343d43035281 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:41.439007 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82557869-7647-4cfa-b051-343d43035281 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:41.445261 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7633a3-9ecf-42af-8461-4040ceb2fd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:41.446822 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7633a3-9ecf-42af-8461-4040ceb2fd97 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:41.447253 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7633a3-9ecf-42af-8461-4040ceb2fd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:41.447778 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7633a3-9ecf-42af-8461-4040ceb2fd97 admin admin] PATH_INFO: `/v3/projects/f953b2b099ac4ccc9678a679785fb24e/users/99984ca061b84733b8c757c1abadf62b/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:41.477513 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7633a3-9ecf-42af-8461-4040ceb2fd97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f953b2b099ac4ccc9678a679785fb24e, user_id=99984ca061b84733b8c757c1abadf62b, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:41.491750 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7633a3-9ecf-42af-8461-4040ceb2fd97 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:41.520169 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2867/5753] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:04:41 2022] PUT /identity/v3/projects/f953b2b099ac4ccc9678a679785fb24e/users/99984ca061b84733b8c757c1abadf62b/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:41.523579 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905c6e9-9345-4973-b163-540e3283a2d3 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:41.539206 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905c6e9-9345-4973-b163-540e3283a2d3 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:41.705318 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:41.753629 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032040b-8718-4fc1-9c95-94cb47bf37a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:41.754615 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032040b-8718-4fc1-9c95-94cb47bf37a6 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:41.755150 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032040b-8718-4fc1-9c95-94cb47bf37a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:41.755625 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032040b-8718-4fc1-9c95-94cb47bf37a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:41.756507 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e032040b-8718-4fc1-9c95-94cb47bf37a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:41.759704 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e032040b-8718-4fc1-9c95-94cb47bf37a6 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:41.802346 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2887/5754] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:04:41.806574 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7633a3-9ecf-42af-8461-4040ceb2fd97 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:41.823125 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7633a3-9ecf-42af-8461-4040ceb2fd97 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:41.861094 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cff65d-8916-4bfb-a9f7-d7de284c2eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:41.861788 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cff65d-8916-4bfb-a9f7-d7de284c2eb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:41.862072 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cff65d-8916-4bfb-a9f7-d7de284c2eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:41.862341 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cff65d-8916-4bfb-a9f7-d7de284c2eb4 admin admin] PATH_INFO: `/v3/projects/f953b2b099ac4ccc9678a679785fb24e/users/99984ca061b84733b8c757c1abadf62b/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:41.867996 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cff65d-8916-4bfb-a9f7-d7de284c2eb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f953b2b099ac4ccc9678a679785fb24e, user_id=99984ca061b84733b8c757c1abadf62b, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:41.874497 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cff65d-8916-4bfb-a9f7-d7de284c2eb4 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:41.910325 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2868/5755] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:04:41 2022] PUT /identity/v3/projects/f953b2b099ac4ccc9678a679785fb24e/users/99984ca061b84733b8c757c1abadf62b/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:41.923140 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61809772-ee71-4c7e-8dac-d0959c553328 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:41.924283 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61809772-ee71-4c7e-8dac-d0959c553328 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:41.924706 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61809772-ee71-4c7e-8dac-d0959c553328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:42.015983 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-61809772-ee71-4c7e-8dac-d0959c553328 None None] MFA Rules not processed for user `99984ca061b84733b8c757c1abadf62b`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:04:42.017438 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-61809772-ee71-4c7e-8dac-d0959c553328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:42.228218 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2888/5756] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:04:41 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:04:42.232946 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cff65d-8916-4bfb-a9f7-d7de284c2eb4 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:42.254654 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cff65d-8916-4bfb-a9f7-d7de284c2eb4 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:42.265703 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e0df8-bcb2-4dff-9617-12b7a03de755 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99984ca061b84733b8c757c1abadf62b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f953b2b099ac4ccc9678a679785fb24e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:42.267008 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e0df8-bcb2-4dff-9617-12b7a03de755 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:42.267600 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e0df8-bcb2-4dff-9617-12b7a03de755 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:42.276588 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e0df8-bcb2-4dff-9617-12b7a03de755 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:42.277690 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3e0df8-bcb2-4dff-9617-12b7a03de755 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:42.279596 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3e0df8-bcb2-4dff-9617-12b7a03de755 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:42.313004 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2869/5757] 10.222.0.83 () {60 vars in 1149 bytes} [Mon Aug 29 16:04:42 2022] POST /identity/v3/domains => generated 245 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:04:42.313996 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61809772-ee71-4c7e-8dac-d0959c553328 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:42.330528 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61809772-ee71-4c7e-8dac-d0959c553328 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:42.670098 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd2809-0c11-4f90-b5fe-411b4d6ef594 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99984ca061b84733b8c757c1abadf62b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f953b2b099ac4ccc9678a679785fb24e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:42.670737 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd2809-0c11-4f90-b5fe-411b4d6ef594 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:42.671671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd2809-0c11-4f90-b5fe-411b4d6ef594 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:42.671671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd2809-0c11-4f90-b5fe-411b4d6ef594 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:42.672300 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fd2809-0c11-4f90-b5fe-411b4d6ef594 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:42.678838 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fd2809-0c11-4f90-b5fe-411b4d6ef594 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:42.883663 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e0df8-bcb2-4dff-9617-12b7a03de755 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:42.884266 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2889/5758] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:04:42 2022] POST /identity/v3/projects => generated 409 bytes in 571 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:04:42.898072 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e0df8-bcb2-4dff-9617-12b7a03de755 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:43.103405 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:43.128035 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d65b4b-04c5-4327-ba44-cb2b6c380ec5 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99984ca061b84733b8c757c1abadf62b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f953b2b099ac4ccc9678a679785fb24e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:43.129468 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d65b4b-04c5-4327-ba44-cb2b6c380ec5 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:43.130013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d65b4b-04c5-4327-ba44-cb2b6c380ec5 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:43.130762 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d65b4b-04c5-4327-ba44-cb2b6c380ec5 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:43.131593 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d65b4b-04c5-4327-ba44-cb2b6c380ec5 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:43.141400 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d65b4b-04c5-4327-ba44-cb2b6c380ec5 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:43.192433 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd2809-0c11-4f90-b5fe-411b4d6ef594 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:43.200900 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2870/5759] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:04:42 2022] POST /identity/v3/users => generated 346 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:04:43.212322 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd2809-0c11-4f90-b5fe-411b4d6ef594 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:43.237853 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f818093-6b79-44ae-87df-db69a149a38b tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99984ca061b84733b8c757c1abadf62b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f953b2b099ac4ccc9678a679785fb24e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:43.243953 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f818093-6b79-44ae-87df-db69a149a38b tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:43.244285 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f818093-6b79-44ae-87df-db69a149a38b tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:43.245082 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f818093-6b79-44ae-87df-db69a149a38b tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:43.245790 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f818093-6b79-44ae-87df-db69a149a38b tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:43.253449 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f818093-6b79-44ae-87df-db69a149a38b tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:43.306193 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2890/5760] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:04:43.310916 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d65b4b-04c5-4327-ba44-cb2b6c380ec5 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:43.331396 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d65b4b-04c5-4327-ba44-cb2b6c380ec5 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:43.343489 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061557e8-62b7-415c-85c4-dc5c24c6e3e7 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99984ca061b84733b8c757c1abadf62b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f953b2b099ac4ccc9678a679785fb24e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:43.345282 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061557e8-62b7-415c-85c4-dc5c24c6e3e7 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:43.345976 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061557e8-62b7-415c-85c4-dc5c24c6e3e7 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:43.346500 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061557e8-62b7-415c-85c4-dc5c24c6e3e7 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] PATH_INFO: `/v3/projects/dae51427817a46048a27491beadd3d6f/users/ab710251c2924ae08453fd674b99c4c5/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:43.385340 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061557e8-62b7-415c-85c4-dc5c24c6e3e7 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] RBAC: Authorizing `identity:create_grant(project_id=dae51427817a46048a27491beadd3d6f, user_id=ab710251c2924ae08453fd674b99c4c5, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:43.388652 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061557e8-62b7-415c-85c4-dc5c24c6e3e7 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:43.444870 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2871/5761] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:04:43 2022] PUT /identity/v3/projects/dae51427817a46048a27491beadd3d6f/users/ab710251c2924ae08453fd674b99c4c5/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:43.446946 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35051b40-9492-4de8-82b6-1645b7c4fa64 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:43.447243 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35051b40-9492-4de8-82b6-1645b7c4fa64 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:43.447517 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35051b40-9492-4de8-82b6-1645b7c4fa64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:43.648583 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:43.817227 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-35051b40-9492-4de8-82b6-1645b7c4fa64 None None] MFA Rules not processed for user `ab710251c2924ae08453fd674b99c4c5`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:04:43.824319 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-35051b40-9492-4de8-82b6-1645b7c4fa64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:43.896951 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2891/5762] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:04:43 2022] POST /identity/v3/auth/tokens => generated 3359 bytes in 452 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:04:43.908601 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8f377-37df-438a-bcf6-0c2f22f770aa None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:43.909493 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8f377-37df-438a-bcf6-0c2f22f770aa None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:43.909915 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8f377-37df-438a-bcf6-0c2f22f770aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:43.992215 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-17d8f377-37df-438a-bcf6-0c2f22f770aa None None] MFA Rules not processed for user `ab710251c2924ae08453fd674b99c4c5`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:04:43.993399 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-17d8f377-37df-438a-bcf6-0c2f22f770aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:44.016363 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2872/5763] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:04:43 2022] POST /identity/v3/auth/tokens => generated 3359 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:04:44.020942 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35051b40-9492-4de8-82b6-1645b7c4fa64 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:44.034371 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35051b40-9492-4de8-82b6-1645b7c4fa64 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:44.063309 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8196f978-05c9-449b-b444-5e08f23d29f6 tempest-test_project-1369155094 tempest-user-21880023] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab710251c2924ae08453fd674b99c4c5', 'user_domain_id': '3a26f1dd2101405880daec3f266c655d', 'system_scope': None, 'project_id': 'dae51427817a46048a27491beadd3d6f', 'project_domain_id': '3a26f1dd2101405880daec3f266c655d', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:44.064395 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196f978-05c9-449b-b444-5e08f23d29f6 tempest-test_project-1369155094 tempest-user-21880023] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:44.064964 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196f978-05c9-449b-b444-5e08f23d29f6 tempest-test_project-1369155094 tempest-user-21880023] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:44.065383 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196f978-05c9-449b-b444-5e08f23d29f6 tempest-test_project-1369155094 tempest-user-21880023] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:44.114672 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8196f978-05c9-449b-b444-5e08f23d29f6 tempest-test_project-1369155094 tempest-user-21880023] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:44.116832 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8196f978-05c9-449b-b444-5e08f23d29f6 tempest-test_project-1369155094 tempest-user-21880023] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:44.148360 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8f377-37df-438a-bcf6-0c2f22f770aa None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:44.150319 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2892/5764] 10.222.0.83 () {56 vars in 1284 bytes} [Mon Aug 29 16:04:44 2022] GET /identity/v3/auth/tokens => generated 3359 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:04:44.286116 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8f377-37df-438a-bcf6-0c2f22f770aa None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:44.300272 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff35fa8-6d95-4f21-8725-84c0e6b19bd6 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99984ca061b84733b8c757c1abadf62b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f953b2b099ac4ccc9678a679785fb24e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:44.300957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff35fa8-6d95-4f21-8725-84c0e6b19bd6 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:44.301239 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff35fa8-6d95-4f21-8725-84c0e6b19bd6 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:44.301514 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff35fa8-6d95-4f21-8725-84c0e6b19bd6 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] PATH_INFO: `/v3/users/ab710251c2924ae08453fd674b99c4c5` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:44.303665 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff35fa8-6d95-4f21-8725-84c0e6b19bd6 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ab710251c2924ae08453fd674b99c4c5)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:44.305639 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff35fa8-6d95-4f21-8725-84c0e6b19bd6 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:44.411038 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1ff35fa8-6d95-4f21-8725-84c0e6b19bd6 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab710251c2924ae08453fd674b99c4c5'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:44.412103 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1ff35fa8-6d95-4f21-8725-84c0e6b19bd6 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab710251c2924ae08453fd674b99c4c5'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:44.450520 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1ff35fa8-6d95-4f21-8725-84c0e6b19bd6 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab710251c2924ae08453fd674b99c4c5'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:44.470814 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1ff35fa8-6d95-4f21-8725-84c0e6b19bd6 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab710251c2924ae08453fd674b99c4c5'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:44.489055 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1ff35fa8-6d95-4f21-8725-84c0e6b19bd6 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab710251c2924ae08453fd674b99c4c5'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:44.511151 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2873/5765] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:04:44 2022] DELETE /identity/v3/users/ab710251c2924ae08453fd674b99c4c5 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:44.515751 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8196f978-05c9-449b-b444-5e08f23d29f6 tempest-test_project-1369155094 tempest-user-21880023] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:44.540628 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8196f978-05c9-449b-b444-5e08f23d29f6 tempest-test_project-1369155094 tempest-user-21880023] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:44.665779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495129b1-5478-433d-8276-da5cb03f2929 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99984ca061b84733b8c757c1abadf62b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f953b2b099ac4ccc9678a679785fb24e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:44.666444 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495129b1-5478-433d-8276-da5cb03f2929 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:44.666752 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495129b1-5478-433d-8276-da5cb03f2929 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:44.667002 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495129b1-5478-433d-8276-da5cb03f2929 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] PATH_INFO: `/v3/projects/dae51427817a46048a27491beadd3d6f` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:44.668197 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495129b1-5478-433d-8276-da5cb03f2929 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] RBAC: Authorizing `identity:delete_project(project_id=dae51427817a46048a27491beadd3d6f)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:44.670147 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495129b1-5478-433d-8276-da5cb03f2929 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:44.871797 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-495129b1-5478-433d-8276-da5cb03f2929 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dae51427817a46048a27491beadd3d6f', 'request_id': 'req-495129b1-5478-433d-8276-da5cb03f2929'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:44.891795 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-495129b1-5478-433d-8276-da5cb03f2929 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dae51427817a46048a27491beadd3d6f', 'request_id': 'req-495129b1-5478-433d-8276-da5cb03f2929'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:44.923958 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-495129b1-5478-433d-8276-da5cb03f2929 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dae51427817a46048a27491beadd3d6f', 'request_id': 'req-495129b1-5478-433d-8276-da5cb03f2929'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:44.953338 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-495129b1-5478-433d-8276-da5cb03f2929 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] The token cache is being invalidate because project dae51427817a46048a27491beadd3d6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:04:44.953971 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-495129b1-5478-433d-8276-da5cb03f2929 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:44.954936 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-495129b1-5478-433d-8276-da5cb03f2929 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:44.959588 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2893/5766] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:04:44 2022] DELETE /identity/v3/projects/dae51427817a46048a27491beadd3d6f => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:04:44.961500 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff35fa8-6d95-4f21-8725-84c0e6b19bd6 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:44.963522 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1ff35fa8-6d95-4f21-8725-84c0e6b19bd6 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:44.993171 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff35fa8-6d95-4f21-8725-84c0e6b19bd6 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:45.097754 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:45.181315 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3c2dc-a9e9-49ed-b287-1657255ab0f7 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99984ca061b84733b8c757c1abadf62b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f953b2b099ac4ccc9678a679785fb24e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:45.185214 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3c2dc-a9e9-49ed-b287-1657255ab0f7 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:45.185685 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3c2dc-a9e9-49ed-b287-1657255ab0f7 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:45.186164 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3c2dc-a9e9-49ed-b287-1657255ab0f7 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] PATH_INFO: `/v3/domains/3a26f1dd2101405880daec3f266c655d` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:45.189747 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a3c2dc-a9e9-49ed-b287-1657255ab0f7 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=3a26f1dd2101405880daec3f266c655d)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:45.199487 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-87a3c2dc-a9e9-49ed-b287-1657255ab0f7 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:04:45.199487 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 16:04:45.199487 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 16:04:45.201364 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a3c2dc-a9e9-49ed-b287-1657255ab0f7 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:45.269880 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-87a3c2dc-a9e9-49ed-b287-1657255ab0f7 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '3a26f1dd2101405880daec3f266c655d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:45.273672 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-87a3c2dc-a9e9-49ed-b287-1657255ab0f7 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '3a26f1dd2101405880daec3f266c655d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:45.341849 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-87a3c2dc-a9e9-49ed-b287-1657255ab0f7 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '3a26f1dd2101405880daec3f266c655d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:45.343869 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-87a3c2dc-a9e9-49ed-b287-1657255ab0f7 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '3a26f1dd2101405880daec3f266c655d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:45.356021 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2874/5767] 10.222.0.83 () {60 vars in 1249 bytes} [Mon Aug 29 16:04:44 2022] PATCH /identity/v3/domains/3a26f1dd2101405880daec3f266c655d => generated 246 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:04:45.357194 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495129b1-5478-433d-8276-da5cb03f2929 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:45.359471 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-495129b1-5478-433d-8276-da5cb03f2929 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:45.410224 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495129b1-5478-433d-8276-da5cb03f2929 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:45.462884 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:45.565126 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a6637-2ab8-4709-98fe-05c0df7a250d tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99984ca061b84733b8c757c1abadf62b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f953b2b099ac4ccc9678a679785fb24e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:45.565934 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a6637-2ab8-4709-98fe-05c0df7a250d tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:45.566384 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a6637-2ab8-4709-98fe-05c0df7a250d tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:45.566762 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a6637-2ab8-4709-98fe-05c0df7a250d tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] PATH_INFO: `/v3/domains/3a26f1dd2101405880daec3f266c655d` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:45.595710 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a6637-2ab8-4709-98fe-05c0df7a250d tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=3a26f1dd2101405880daec3f266c655d)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:45.596986 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-487a6637-2ab8-4709-98fe-05c0df7a250d tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:04:45.596986 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 16:04:45.596986 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 16:04:45.598142 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a6637-2ab8-4709-98fe-05c0df7a250d tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:45.663230 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-487a6637-2ab8-4709-98fe-05c0df7a250d tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '3a26f1dd2101405880daec3f266c655d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:45.706018 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-487a6637-2ab8-4709-98fe-05c0df7a250d tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '3a26f1dd2101405880daec3f266c655d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:45.810116 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-487a6637-2ab8-4709-98fe-05c0df7a250d tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a26f1dd2101405880daec3f266c655d', 'request_id': 'req-487a6637-2ab8-4709-98fe-05c0df7a250d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:45.837250 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-487a6637-2ab8-4709-98fe-05c0df7a250d tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a26f1dd2101405880daec3f266c655d', 'request_id': 'req-487a6637-2ab8-4709-98fe-05c0df7a250d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:45.851054 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-487a6637-2ab8-4709-98fe-05c0df7a250d tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a26f1dd2101405880daec3f266c655d', 'request_id': 'req-487a6637-2ab8-4709-98fe-05c0df7a250d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:45.892786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-487a6637-2ab8-4709-98fe-05c0df7a250d tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] The token cache is being invalidate because project 3a26f1dd2101405880daec3f266c655d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:04:45.893132 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-487a6637-2ab8-4709-98fe-05c0df7a250d tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:45.895221 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-487a6637-2ab8-4709-98fe-05c0df7a250d tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:45.920259 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-487a6637-2ab8-4709-98fe-05c0df7a250d tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '3a26f1dd2101405880daec3f266c655d', 'request_id': 'req-487a6637-2ab8-4709-98fe-05c0df7a250d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:45.922511 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-487a6637-2ab8-4709-98fe-05c0df7a250d tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '3a26f1dd2101405880daec3f266c655d', 'request_id': 'req-487a6637-2ab8-4709-98fe-05c0df7a250d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:45.924682 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-487a6637-2ab8-4709-98fe-05c0df7a250d tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '3a26f1dd2101405880daec3f266c655d', 'request_id': 'req-487a6637-2ab8-4709-98fe-05c0df7a250d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:45.948626 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2894/5768] 10.222.0.83 () {58 vars in 1230 bytes} [Mon Aug 29 16:04:45 2022] DELETE /identity/v3/domains/3a26f1dd2101405880daec3f266c655d => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:45.954253 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3c2dc-a9e9-49ed-b287-1657255ab0f7 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:45.955805 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-87a3c2dc-a9e9-49ed-b287-1657255ab0f7 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:46.251678 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3c2dc-a9e9-49ed-b287-1657255ab0f7 tempest-TestDefaultProjectId-178530365 tempest-TestDefaultProjectId-178530365-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:46.521826 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33963515-c907-4a7c-8db2-86f2fd6e725d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:46.527508 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33963515-c907-4a7c-8db2-86f2fd6e725d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:46.536431 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33963515-c907-4a7c-8db2-86f2fd6e725d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:46.536431 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33963515-c907-4a7c-8db2-86f2fd6e725d admin admin] PATH_INFO: `/v3/users/ac436778de8544baae0a0bbae2d0baf1` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:46.539802 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33963515-c907-4a7c-8db2-86f2fd6e725d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac436778de8544baae0a0bbae2d0baf1)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:46.545196 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33963515-c907-4a7c-8db2-86f2fd6e725d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:46.690405 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=93,keystone:UPDATE=1,keystone:DELETE=6 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:46.696302 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-33963515-c907-4a7c-8db2-86f2fd6e725d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac436778de8544baae0a0bbae2d0baf1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:46.697613 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-33963515-c907-4a7c-8db2-86f2fd6e725d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac436778de8544baae0a0bbae2d0baf1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:46.730567 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-33963515-c907-4a7c-8db2-86f2fd6e725d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac436778de8544baae0a0bbae2d0baf1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:46.745992 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-33963515-c907-4a7c-8db2-86f2fd6e725d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac436778de8544baae0a0bbae2d0baf1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:46.762428 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-33963515-c907-4a7c-8db2-86f2fd6e725d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac436778de8544baae0a0bbae2d0baf1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:46.776688 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2875/5769] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:04:45 2022] DELETE /identity/v3/users/ac436778de8544baae0a0bbae2d0baf1 => generated 0 bytes in 823 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:46.781992 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8035fd-f2b3-4310-9d9c-3896549c9bec None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:46.782539 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8035fd-f2b3-4310-9d9c-3896549c9bec None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:46.782539 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8035fd-f2b3-4310-9d9c-3896549c9bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:46.814195 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-8e8035fd-f2b3-4310-9d9c-3896549c9bec None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:04:46.816124 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8e8035fd-f2b3-4310-9d9c-3896549c9bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:46.950167 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:47.011919 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2895/5770] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:04:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:04:47.020861 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33963515-c907-4a7c-8db2-86f2fd6e725d admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:47.022605 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-33963515-c907-4a7c-8db2-86f2fd6e725d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:47.180780 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33963515-c907-4a7c-8db2-86f2fd6e725d admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:47.199373 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2128f16-67a1-471b-bb91-d1f271b8703b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:47.200655 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2128f16-67a1-471b-bb91-d1f271b8703b service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:47.200946 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2128f16-67a1-471b-bb91-d1f271b8703b service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:47.201224 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2128f16-67a1-471b-bb91-d1f271b8703b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:47.219403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2128f16-67a1-471b-bb91-d1f271b8703b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:47.221897 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2128f16-67a1-471b-bb91-d1f271b8703b service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:47.235903 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2876/5771] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:04:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:04:47.763734 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8035fd-f2b3-4310-9d9c-3896549c9bec None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:47.767001 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8e8035fd-f2b3-4310-9d9c-3896549c9bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:47.808533 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8035fd-f2b3-4310-9d9c-3896549c9bec None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:47.823186 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795400eb-c647-40bc-bc39-ee95f08e8619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:47.823878 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795400eb-c647-40bc-bc39-ee95f08e8619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:47.824152 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795400eb-c647-40bc-bc39-ee95f08e8619 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:47.824422 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795400eb-c647-40bc-bc39-ee95f08e8619 admin admin] PATH_INFO: `/v3/projects/d3abae5dfd284749bb1452d713caa9cc` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:47.825574 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795400eb-c647-40bc-bc39-ee95f08e8619 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3abae5dfd284749bb1452d713caa9cc)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:47.828186 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795400eb-c647-40bc-bc39-ee95f08e8619 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:47.980720 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-795400eb-c647-40bc-bc39-ee95f08e8619 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3abae5dfd284749bb1452d713caa9cc', 'request_id': 'req-795400eb-c647-40bc-bc39-ee95f08e8619'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:48.001068 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-795400eb-c647-40bc-bc39-ee95f08e8619 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3abae5dfd284749bb1452d713caa9cc', 'request_id': 'req-795400eb-c647-40bc-bc39-ee95f08e8619'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:48.016193 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-795400eb-c647-40bc-bc39-ee95f08e8619 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3abae5dfd284749bb1452d713caa9cc', 'request_id': 'req-795400eb-c647-40bc-bc39-ee95f08e8619'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:48.056987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-795400eb-c647-40bc-bc39-ee95f08e8619 admin admin] The token cache is being invalidate because project d3abae5dfd284749bb1452d713caa9cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:04:48.057506 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-795400eb-c647-40bc-bc39-ee95f08e8619 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:48.061486 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-795400eb-c647-40bc-bc39-ee95f08e8619 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:48.068977 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2128f16-67a1-471b-bb91-d1f271b8703b service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:48.070196 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2896/5772] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:04:47 2022] DELETE /identity/v3/projects/d3abae5dfd284749bb1452d713caa9cc => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:48.099741 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2128f16-67a1-471b-bb91-d1f271b8703b service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:48.230081 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b6ae4f-ddd3-4ddf-85e2-097ec9ec7a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:48.232287 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6ae4f-ddd3-4ddf-85e2-097ec9ec7a1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:48.232572 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6ae4f-ddd3-4ddf-85e2-097ec9ec7a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:48.232851 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6ae4f-ddd3-4ddf-85e2-097ec9ec7a1f admin admin] PATH_INFO: `/v3/users/99984ca061b84733b8c757c1abadf62b` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:48.235747 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b6ae4f-ddd3-4ddf-85e2-097ec9ec7a1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=99984ca061b84733b8c757c1abadf62b)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:48.238757 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b6ae4f-ddd3-4ddf-85e2-097ec9ec7a1f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:48.382261 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-74b6ae4f-ddd3-4ddf-85e2-097ec9ec7a1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99984ca061b84733b8c757c1abadf62b'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:48.385380 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-74b6ae4f-ddd3-4ddf-85e2-097ec9ec7a1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99984ca061b84733b8c757c1abadf62b'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:48.420786 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-74b6ae4f-ddd3-4ddf-85e2-097ec9ec7a1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99984ca061b84733b8c757c1abadf62b'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:48.423396 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:48.437121 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-74b6ae4f-ddd3-4ddf-85e2-097ec9ec7a1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99984ca061b84733b8c757c1abadf62b'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:48.455751 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-74b6ae4f-ddd3-4ddf-85e2-097ec9ec7a1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99984ca061b84733b8c757c1abadf62b'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:48.474569 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2877/5773] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:04:48 2022] DELETE /identity/v3/users/99984ca061b84733b8c757c1abadf62b => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:49.026376 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795400eb-c647-40bc-bc39-ee95f08e8619 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:49.029632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-795400eb-c647-40bc-bc39-ee95f08e8619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:49.058457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795400eb-c647-40bc-bc39-ee95f08e8619 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:49.195186 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b8cbb4-3f2b-40b7-a081-96596948e324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:49.196606 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8cbb4-3f2b-40b7-a081-96596948e324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:49.197090 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8cbb4-3f2b-40b7-a081-96596948e324 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:49.200211 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8cbb4-3f2b-40b7-a081-96596948e324 admin admin] PATH_INFO: `/v3/projects/f953b2b099ac4ccc9678a679785fb24e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:49.202844 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b8cbb4-3f2b-40b7-a081-96596948e324 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f953b2b099ac4ccc9678a679785fb24e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:49.208377 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b8cbb4-3f2b-40b7-a081-96596948e324 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:49.343256 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d0b8cbb4-3f2b-40b7-a081-96596948e324 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f953b2b099ac4ccc9678a679785fb24e', 'request_id': 'req-d0b8cbb4-3f2b-40b7-a081-96596948e324'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:49.353154 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d0b8cbb4-3f2b-40b7-a081-96596948e324 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f953b2b099ac4ccc9678a679785fb24e', 'request_id': 'req-d0b8cbb4-3f2b-40b7-a081-96596948e324'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:49.365079 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d0b8cbb4-3f2b-40b7-a081-96596948e324 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f953b2b099ac4ccc9678a679785fb24e', 'request_id': 'req-d0b8cbb4-3f2b-40b7-a081-96596948e324'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:49.397854 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d0b8cbb4-3f2b-40b7-a081-96596948e324 admin admin] The token cache is being invalidate because project f953b2b099ac4ccc9678a679785fb24e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:04:49.399110 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d0b8cbb4-3f2b-40b7-a081-96596948e324 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:49.400169 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d0b8cbb4-3f2b-40b7-a081-96596948e324 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:49.406195 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2897/5774] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:04:49 2022] DELETE /identity/v3/projects/f953b2b099ac4ccc9678a679785fb24e => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:49.409032 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5ba69-2c04-4969-8167-fbb058833a3b None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:49.409529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5ba69-2c04-4969-8167-fbb058833a3b None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:49.409608 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5ba69-2c04-4969-8167-fbb058833a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:49.474595 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-1fe5ba69-2c04-4969-8167-fbb058833a3b None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:04:49.479556 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1fe5ba69-2c04-4969-8167-fbb058833a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:49.674100 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2878/5775] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:04:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:04:49.685922 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c235755-1ed6-4d40-97dc-6bb9e1d2abee None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:49.688197 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c235755-1ed6-4d40-97dc-6bb9e1d2abee None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:49.688648 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c235755-1ed6-4d40-97dc-6bb9e1d2abee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:49.766612 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-5c235755-1ed6-4d40-97dc-6bb9e1d2abee None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:04:49.768166 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5c235755-1ed6-4d40-97dc-6bb9e1d2abee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:49.792155 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2898/5776] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:04:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:04:49.793689 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5ba69-2c04-4969-8167-fbb058833a3b None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:49.810335 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5ba69-2c04-4969-8167-fbb058833a3b None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:49.839056 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c3eb3-7ae9-4837-913d-36af3ee32e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:49.839283 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c3eb3-7ae9-4837-913d-36af3ee32e04 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:49.839871 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c3eb3-7ae9-4837-913d-36af3ee32e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:49.844277 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c3eb3-7ae9-4837-913d-36af3ee32e04 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:49.845751 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c3eb3-7ae9-4837-913d-36af3ee32e04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:04:49.846069 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c3eb3-7ae9-4837-913d-36af3ee32e04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:49.856146 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c3eb3-7ae9-4837-913d-36af3ee32e04 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:49.909583 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2879/5777] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:04:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:04:49.915555 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c235755-1ed6-4d40-97dc-6bb9e1d2abee None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:49.921958 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:49.939903 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c235755-1ed6-4d40-97dc-6bb9e1d2abee None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:49.955375 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b4c99-317c-4621-869b-6d9cc994c843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:49.956261 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b4c99-317c-4621-869b-6d9cc994c843 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:49.956954 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b4c99-317c-4621-869b-6d9cc994c843 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:49.957321 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b4c99-317c-4621-869b-6d9cc994c843 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:49.958075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4b4c99-317c-4621-869b-6d9cc994c843 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:49.960144 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4b4c99-317c-4621-869b-6d9cc994c843 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:50.032654 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c3eb3-7ae9-4837-913d-36af3ee32e04 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:50.038659 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2899/5778] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:04:49 2022] POST /identity/v3/projects => generated 363 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:04:50.053478 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c3eb3-7ae9-4837-913d-36af3ee32e04 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:50.212058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0642a2-98d7-4906-9058-83a16c199d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:50.212698 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0642a2-98d7-4906-9058-83a16c199d7b admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:50.212979 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0642a2-98d7-4906-9058-83a16c199d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:50.213249 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0642a2-98d7-4906-9058-83a16c199d7b admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:50.219048 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0642a2-98d7-4906-9058-83a16c199d7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:50.225470 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0642a2-98d7-4906-9058-83a16c199d7b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:50.314619 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2880/5779] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:04:50 2022] POST /identity/v3/users => generated 282 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:04:50.318750 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b4c99-317c-4621-869b-6d9cc994c843 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:50.337587 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b4c99-317c-4621-869b-6d9cc994c843 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:50.353756 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20f7e4-c91c-4c51-b006-e08869aa491e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:50.354732 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20f7e4-c91c-4c51-b006-e08869aa491e admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:50.355228 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20f7e4-c91c-4c51-b006-e08869aa491e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:50.355688 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20f7e4-c91c-4c51-b006-e08869aa491e admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:50.356555 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e20f7e4-c91c-4c51-b006-e08869aa491e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:50.358412 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e20f7e4-c91c-4c51-b006-e08869aa491e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:50.382655 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2900/5780] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:04:50.387150 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0642a2-98d7-4906-9058-83a16c199d7b admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:50.404969 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0642a2-98d7-4906-9058-83a16c199d7b admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:50.419278 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4fb34f-bfaf-4e61-817f-308aae4b4e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:50.419997 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fb34f-bfaf-4e61-817f-308aae4b4e9e admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:50.420364 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fb34f-bfaf-4e61-817f-308aae4b4e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:50.420484 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fb34f-bfaf-4e61-817f-308aae4b4e9e admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:50.421180 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4fb34f-bfaf-4e61-817f-308aae4b4e9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:50.426841 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4fb34f-bfaf-4e61-817f-308aae4b4e9e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:50.456084 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2881/5781] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:04:50.459862 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20f7e4-c91c-4c51-b006-e08869aa491e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:50.472005 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20f7e4-c91c-4c51-b006-e08869aa491e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:50.492152 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee212d4-ec32-4da0-befc-13d0696cb7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:50.492152 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee212d4-ec32-4da0-befc-13d0696cb7e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:50.492708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee212d4-ec32-4da0-befc-13d0696cb7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:50.493077 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee212d4-ec32-4da0-befc-13d0696cb7e8 admin admin] PATH_INFO: `/v3/projects/c35e0b3adbd14c728398778c0cb9224f/users/1f92489eca7445968f207e4aa94083e7/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:50.538900 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee212d4-ec32-4da0-befc-13d0696cb7e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c35e0b3adbd14c728398778c0cb9224f, user_id=1f92489eca7445968f207e4aa94083e7, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:50.542565 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee212d4-ec32-4da0-befc-13d0696cb7e8 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:50.590739 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2901/5782] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:04:50 2022] PUT /identity/v3/projects/c35e0b3adbd14c728398778c0cb9224f/users/1f92489eca7445968f207e4aa94083e7/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:50.591111 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d8e4d-4b19-4b65-8b4e-dfd304bba8ab None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:50.591582 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d8e4d-4b19-4b65-8b4e-dfd304bba8ab None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:50.591856 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d8e4d-4b19-4b65-8b4e-dfd304bba8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:50.660857 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-0e2d8e4d-4b19-4b65-8b4e-dfd304bba8ab None None] MFA Rules not processed for user `1f92489eca7445968f207e4aa94083e7`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:04:50.663427 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0e2d8e4d-4b19-4b65-8b4e-dfd304bba8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:50.758280 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:50.829841 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2882/5783] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:04:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:04:50.837419 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee212d4-ec32-4da0-befc-13d0696cb7e8 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:50.929536 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee212d4-ec32-4da0-befc-13d0696cb7e8 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:50.954745 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48829d6-e834-4bf1-bb03-1eb445293beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:50.956479 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48829d6-e834-4bf1-bb03-1eb445293beb admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:50.956985 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48829d6-e834-4bf1-bb03-1eb445293beb admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:50.957473 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48829d6-e834-4bf1-bb03-1eb445293beb admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:50.958679 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48829d6-e834-4bf1-bb03-1eb445293beb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:50.962457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48829d6-e834-4bf1-bb03-1eb445293beb admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:51.041918 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2902/5784] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:04:50 2022] POST /identity/v3/projects => generated 367 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:04:51.044478 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d8e4d-4b19-4b65-8b4e-dfd304bba8ab None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:51.064719 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d8e4d-4b19-4b65-8b4e-dfd304bba8ab None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:51.198706 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e4c73-56bb-46a4-b18e-e3b5e5c2b71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:51.199460 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e4c73-56bb-46a4-b18e-e3b5e5c2b71a admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:51.200049 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e4c73-56bb-46a4-b18e-e3b5e5c2b71a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:51.200371 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e4c73-56bb-46a4-b18e-e3b5e5c2b71a admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:51.201257 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e4c73-56bb-46a4-b18e-e3b5e5c2b71a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:51.204447 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e4c73-56bb-46a4-b18e-e3b5e5c2b71a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:51.260820 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48829d6-e834-4bf1-bb03-1eb445293beb admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:51.262062 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2883/5785] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:04:51 2022] POST /identity/v3/users => generated 290 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:04:51.278273 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48829d6-e834-4bf1-bb03-1eb445293beb admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:51.292680 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cbda94-79c5-4f7c-8043-913025d9d9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:51.293869 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbda94-79c5-4f7c-8043-913025d9d9a4 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:51.294355 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbda94-79c5-4f7c-8043-913025d9d9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:51.294845 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbda94-79c5-4f7c-8043-913025d9d9a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:51.295819 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cbda94-79c5-4f7c-8043-913025d9d9a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:51.305564 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cbda94-79c5-4f7c-8043-913025d9d9a4 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:51.330563 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2903/5786] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:04:51.334515 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e4c73-56bb-46a4-b18e-e3b5e5c2b71a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:51.367912 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e4c73-56bb-46a4-b18e-e3b5e5c2b71a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:51.382860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3dd29-50c5-4e9a-bf2a-4ce847815ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:51.383593 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3dd29-50c5-4e9a-bf2a-4ce847815ab4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:51.383874 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3dd29-50c5-4e9a-bf2a-4ce847815ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:51.384153 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3dd29-50c5-4e9a-bf2a-4ce847815ab4 admin admin] PATH_INFO: `/v3/projects/56bc1f48f8c0497a8ac94dd66e374cb5/users/869b9ffc0b4542728cc7e43adcbd72b7/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:51.451321 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe3dd29-50c5-4e9a-bf2a-4ce847815ab4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56bc1f48f8c0497a8ac94dd66e374cb5, user_id=869b9ffc0b4542728cc7e43adcbd72b7, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:51.457504 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe3dd29-50c5-4e9a-bf2a-4ce847815ab4 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:51.491959 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2884/5787] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:04:51 2022] PUT /identity/v3/projects/56bc1f48f8c0497a8ac94dd66e374cb5/users/869b9ffc0b4542728cc7e43adcbd72b7/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:51.492876 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cbda94-79c5-4f7c-8043-913025d9d9a4 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:51.518230 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cbda94-79c5-4f7c-8043-913025d9d9a4 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:51.728382 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984d8de-463f-4909-a34d-b20fff587eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:51.729666 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984d8de-463f-4909-a34d-b20fff587eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:51.729953 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984d8de-463f-4909-a34d-b20fff587eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:51.730460 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984d8de-463f-4909-a34d-b20fff587eb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:51.732681 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d984d8de-463f-4909-a34d-b20fff587eb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:51.737317 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d984d8de-463f-4909-a34d-b20fff587eb1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:51.765726 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2904/5788] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:04:51.766947 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3dd29-50c5-4e9a-bf2a-4ce847815ab4 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:51.784662 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3dd29-50c5-4e9a-bf2a-4ce847815ab4 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:51.799492 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e26e9-96ca-4ec2-989b-0aebb05e4cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:51.800185 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e26e9-96ca-4ec2-989b-0aebb05e4cc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:51.800469 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e26e9-96ca-4ec2-989b-0aebb05e4cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:51.800748 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e26e9-96ca-4ec2-989b-0aebb05e4cc2 admin admin] PATH_INFO: `/v3/projects/56bc1f48f8c0497a8ac94dd66e374cb5/users/869b9ffc0b4542728cc7e43adcbd72b7/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:51.804476 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236e26e9-96ca-4ec2-989b-0aebb05e4cc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56bc1f48f8c0497a8ac94dd66e374cb5, user_id=869b9ffc0b4542728cc7e43adcbd72b7, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:51.806671 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236e26e9-96ca-4ec2-989b-0aebb05e4cc2 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:51.836871 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2885/5789] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:04:51 2022] PUT /identity/v3/projects/56bc1f48f8c0497a8ac94dd66e374cb5/users/869b9ffc0b4542728cc7e43adcbd72b7/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:51.851688 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d46df5-0148-4c35-94a3-cb38a10c0af2 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:51.852171 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d46df5-0148-4c35-94a3-cb38a10c0af2 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:51.853133 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d46df5-0148-4c35-94a3-cb38a10c0af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:51.892858 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-e7d46df5-0148-4c35-94a3-cb38a10c0af2 None None] MFA Rules not processed for user `869b9ffc0b4542728cc7e43adcbd72b7`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:04:51.894407 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e7d46df5-0148-4c35-94a3-cb38a10c0af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:51.899925 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:52.009187 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e26e9-96ca-4ec2-989b-0aebb05e4cc2 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:52.017606 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2905/5790] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:04:51 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:04:52.032907 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e26e9-96ca-4ec2-989b-0aebb05e4cc2 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:52.039388 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274dbbe6-6f87-4fa5-994b-5d354b74e07a tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '869b9ffc0b4542728cc7e43adcbd72b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56bc1f48f8c0497a8ac94dd66e374cb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:52.040569 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274dbbe6-6f87-4fa5-994b-5d354b74e07a tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:52.041369 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274dbbe6-6f87-4fa5-994b-5d354b74e07a tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:52.041369 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274dbbe6-6f87-4fa5-994b-5d354b74e07a tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:52.042078 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274dbbe6-6f87-4fa5-994b-5d354b74e07a tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:52.044105 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274dbbe6-6f87-4fa5-994b-5d354b74e07a tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:52.083605 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d46df5-0148-4c35-94a3-cb38a10c0af2 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:52.097212 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2886/5791] 10.222.0.83 () {60 vars in 1150 bytes} [Mon Aug 29 16:04:52 2022] POST /identity/v3/domains => generated 276 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:04:52.098185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d46df5-0148-4c35-94a3-cb38a10c0af2 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:52.190601 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a97f92-8210-45c9-bd71-83725a1bb14e tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '869b9ffc0b4542728cc7e43adcbd72b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56bc1f48f8c0497a8ac94dd66e374cb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:52.191676 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a97f92-8210-45c9-bd71-83725a1bb14e tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:52.192172 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a97f92-8210-45c9-bd71-83725a1bb14e tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:52.193830 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a97f92-8210-45c9-bd71-83725a1bb14e tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:52.194845 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a97f92-8210-45c9-bd71-83725a1bb14e tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:52.198504 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-59a97f92-8210-45c9-bd71-83725a1bb14e tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:04:52.198504 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 16:04:52.198504 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 16:04:52.204870 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a97f92-8210-45c9-bd71-83725a1bb14e tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:52.251720 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274dbbe6-6f87-4fa5-994b-5d354b74e07a tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:52.259097 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2906/5792] 10.222.0.83 () {60 vars in 1150 bytes} [Mon Aug 29 16:04:52 2022] POST /identity/v3/domains => generated 276 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:04:52.266392 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274dbbe6-6f87-4fa5-994b-5d354b74e07a tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:52.419097 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a597f6af-4e18-4317-bae1-ee1235e9cc5d tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '869b9ffc0b4542728cc7e43adcbd72b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56bc1f48f8c0497a8ac94dd66e374cb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:52.421489 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597f6af-4e18-4317-bae1-ee1235e9cc5d tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:52.421988 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597f6af-4e18-4317-bae1-ee1235e9cc5d tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:52.422521 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597f6af-4e18-4317-bae1-ee1235e9cc5d tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:52.426630 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a597f6af-4e18-4317-bae1-ee1235e9cc5d tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:52.429561 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a597f6af-4e18-4317-bae1-ee1235e9cc5d tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:52.469458 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a97f92-8210-45c9-bd71-83725a1bb14e tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:52.484359 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2887/5793] 10.222.0.83 () {60 vars in 1150 bytes} [Mon Aug 29 16:04:52 2022] POST /identity/v3/domains => generated 278 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:04:52.486472 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a97f92-8210-45c9-bd71-83725a1bb14e tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:52.558257 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a60c90-6989-4b1f-820c-8a499cbf4517 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:52.558648 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a60c90-6989-4b1f-820c-8a499cbf4517 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:52.558985 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a60c90-6989-4b1f-820c-8a499cbf4517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:52.613847 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-a1a60c90-6989-4b1f-820c-8a499cbf4517 None None] MFA Rules not processed for user `dcd426ac002048bf9db072739a81c2e4`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:04:52.618063 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a1a60c90-6989-4b1f-820c-8a499cbf4517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:52.633197 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:52.650556 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108bfa6b-90cf-492f-88bf-6641b13e75f2 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '869b9ffc0b4542728cc7e43adcbd72b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56bc1f48f8c0497a8ac94dd66e374cb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:52.652148 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108bfa6b-90cf-492f-88bf-6641b13e75f2 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:52.652525 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108bfa6b-90cf-492f-88bf-6641b13e75f2 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:52.652958 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108bfa6b-90cf-492f-88bf-6641b13e75f2 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:52.653718 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108bfa6b-90cf-492f-88bf-6641b13e75f2 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:52.658799 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108bfa6b-90cf-492f-88bf-6641b13e75f2 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:52.723353 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2907/5794] 10.222.0.83 () {60 vars in 1150 bytes} [Mon Aug 29 16:04:52 2022] POST /identity/v3/domains => generated 280 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:04:52.724295 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108bfa6b-90cf-492f-88bf-6641b13e75f2 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:52.834104 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2888/5795] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:04:52 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:04:52.840711 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:52.939898 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108bfa6b-90cf-492f-88bf-6641b13e75f2 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:52.953823 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f51862-9572-4bb9-9235-0e079b27a28f tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '869b9ffc0b4542728cc7e43adcbd72b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56bc1f48f8c0497a8ac94dd66e374cb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:52.954626 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f51862-9572-4bb9-9235-0e079b27a28f tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:52.954904 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f51862-9572-4bb9-9235-0e079b27a28f tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:52.955268 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f51862-9572-4bb9-9235-0e079b27a28f tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] PATH_INFO: `/v3/domains/47d0113017e14e72918d1c0d7effc63f` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:52.978777 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f51862-9572-4bb9-9235-0e079b27a28f tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=47d0113017e14e72918d1c0d7effc63f)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:52.980615 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f51862-9572-4bb9-9235-0e079b27a28f tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:53.099138 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-74f51862-9572-4bb9-9235-0e079b27a28f tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '47d0113017e14e72918d1c0d7effc63f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:53.150615 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-74f51862-9572-4bb9-9235-0e079b27a28f tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '47d0113017e14e72918d1c0d7effc63f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:53.345964 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-74f51862-9572-4bb9-9235-0e079b27a28f tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47d0113017e14e72918d1c0d7effc63f', 'request_id': 'req-74f51862-9572-4bb9-9235-0e079b27a28f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:53.356064 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-74f51862-9572-4bb9-9235-0e079b27a28f tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47d0113017e14e72918d1c0d7effc63f', 'request_id': 'req-74f51862-9572-4bb9-9235-0e079b27a28f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:53.377466 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-74f51862-9572-4bb9-9235-0e079b27a28f tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47d0113017e14e72918d1c0d7effc63f', 'request_id': 'req-74f51862-9572-4bb9-9235-0e079b27a28f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:53.419749 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-74f51862-9572-4bb9-9235-0e079b27a28f tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] The token cache is being invalidate because project 47d0113017e14e72918d1c0d7effc63f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:04:53.420373 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-74f51862-9572-4bb9-9235-0e079b27a28f tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:53.422233 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-74f51862-9572-4bb9-9235-0e079b27a28f tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:53.473758 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-74f51862-9572-4bb9-9235-0e079b27a28f tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '47d0113017e14e72918d1c0d7effc63f', 'request_id': 'req-74f51862-9572-4bb9-9235-0e079b27a28f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:53.477692 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-74f51862-9572-4bb9-9235-0e079b27a28f tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '47d0113017e14e72918d1c0d7effc63f', 'request_id': 'req-74f51862-9572-4bb9-9235-0e079b27a28f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:53.478838 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-74f51862-9572-4bb9-9235-0e079b27a28f tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '47d0113017e14e72918d1c0d7effc63f', 'request_id': 'req-74f51862-9572-4bb9-9235-0e079b27a28f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:53.509386 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2908/5796] 10.222.0.83 () {58 vars in 1230 bytes} [Mon Aug 29 16:04:52 2022] DELETE /identity/v3/domains/47d0113017e14e72918d1c0d7effc63f => generated 0 bytes in 785 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:53.516805 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a60c90-6989-4b1f-820c-8a499cbf4517 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:53.556170 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a60c90-6989-4b1f-820c-8a499cbf4517 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:53.746266 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde9d3b-9092-441c-9691-267d23582a58 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '869b9ffc0b4542728cc7e43adcbd72b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56bc1f48f8c0497a8ac94dd66e374cb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:53.754934 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde9d3b-9092-441c-9691-267d23582a58 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:53.755475 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde9d3b-9092-441c-9691-267d23582a58 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:53.755894 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde9d3b-9092-441c-9691-267d23582a58 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:53.756721 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdde9d3b-9092-441c-9691-267d23582a58 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:53.759215 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdde9d3b-9092-441c-9691-267d23582a58 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:53.804956 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2889/5797] 10.222.0.83 () {60 vars in 1149 bytes} [Mon Aug 29 16:04:53 2022] POST /identity/v3/domains => generated 248 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:04:53.808835 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f51862-9572-4bb9-9235-0e079b27a28f tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:53.810416 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-74f51862-9572-4bb9-9235-0e079b27a28f tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:53.837683 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f51862-9572-4bb9-9235-0e079b27a28f tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:54.025710 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317da4f8-1ca7-43a6-887c-1d14a2420351 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '869b9ffc0b4542728cc7e43adcbd72b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56bc1f48f8c0497a8ac94dd66e374cb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:54.026433 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317da4f8-1ca7-43a6-887c-1d14a2420351 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:54.027949 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317da4f8-1ca7-43a6-887c-1d14a2420351 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:54.028299 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317da4f8-1ca7-43a6-887c-1d14a2420351 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] PATH_INFO: `/v3/domains/fba19d915bdd4cbe9988283902b9a29a` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:54.082877 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:54.088698 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317da4f8-1ca7-43a6-887c-1d14a2420351 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=fba19d915bdd4cbe9988283902b9a29a)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:54.093686 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317da4f8-1ca7-43a6-887c-1d14a2420351 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:54.161343 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-317da4f8-1ca7-43a6-887c-1d14a2420351 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'fba19d915bdd4cbe9988283902b9a29a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:54.162426 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-317da4f8-1ca7-43a6-887c-1d14a2420351 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'fba19d915bdd4cbe9988283902b9a29a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:54.242180 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-317da4f8-1ca7-43a6-887c-1d14a2420351 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'fba19d915bdd4cbe9988283902b9a29a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:54.244077 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-317da4f8-1ca7-43a6-887c-1d14a2420351 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'fba19d915bdd4cbe9988283902b9a29a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:54.250015 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2909/5798] 10.222.0.83 () {60 vars in 1249 bytes} [Mon Aug 29 16:04:53 2022] PATCH /identity/v3/domains/fba19d915bdd4cbe9988283902b9a29a => generated 249 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:04:54.254946 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde9d3b-9092-441c-9691-267d23582a58 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:54.256406 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-fdde9d3b-9092-441c-9691-267d23582a58 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:54.299755 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde9d3b-9092-441c-9691-267d23582a58 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:54.625548 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f67cc7-9400-4043-b444-9ca9d9fb7329 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '869b9ffc0b4542728cc7e43adcbd72b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56bc1f48f8c0497a8ac94dd66e374cb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:54.626306 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f67cc7-9400-4043-b444-9ca9d9fb7329 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:54.626555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f67cc7-9400-4043-b444-9ca9d9fb7329 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:54.628517 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f67cc7-9400-4043-b444-9ca9d9fb7329 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] PATH_INFO: `/v3/domains/fba19d915bdd4cbe9988283902b9a29a` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:54.669894 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f67cc7-9400-4043-b444-9ca9d9fb7329 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=fba19d915bdd4cbe9988283902b9a29a)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:54.677359 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f67cc7-9400-4043-b444-9ca9d9fb7329 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:54.784657 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-36f67cc7-9400-4043-b444-9ca9d9fb7329 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'fba19d915bdd4cbe9988283902b9a29a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:54.794038 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-36f67cc7-9400-4043-b444-9ca9d9fb7329 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'fba19d915bdd4cbe9988283902b9a29a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:54.858636 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:54.944169 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-36f67cc7-9400-4043-b444-9ca9d9fb7329 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fba19d915bdd4cbe9988283902b9a29a', 'request_id': 'req-36f67cc7-9400-4043-b444-9ca9d9fb7329'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:54.965760 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-36f67cc7-9400-4043-b444-9ca9d9fb7329 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fba19d915bdd4cbe9988283902b9a29a', 'request_id': 'req-36f67cc7-9400-4043-b444-9ca9d9fb7329'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:55.001097 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-36f67cc7-9400-4043-b444-9ca9d9fb7329 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fba19d915bdd4cbe9988283902b9a29a', 'request_id': 'req-36f67cc7-9400-4043-b444-9ca9d9fb7329'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:55.028491 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-36f67cc7-9400-4043-b444-9ca9d9fb7329 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] The token cache is being invalidate because project fba19d915bdd4cbe9988283902b9a29a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:04:55.028850 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-36f67cc7-9400-4043-b444-9ca9d9fb7329 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:55.029550 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-36f67cc7-9400-4043-b444-9ca9d9fb7329 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:55.068078 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-36f67cc7-9400-4043-b444-9ca9d9fb7329 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'fba19d915bdd4cbe9988283902b9a29a', 'request_id': 'req-36f67cc7-9400-4043-b444-9ca9d9fb7329'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:55.071704 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-36f67cc7-9400-4043-b444-9ca9d9fb7329 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'fba19d915bdd4cbe9988283902b9a29a', 'request_id': 'req-36f67cc7-9400-4043-b444-9ca9d9fb7329'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:55.072995 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-36f67cc7-9400-4043-b444-9ca9d9fb7329 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'fba19d915bdd4cbe9988283902b9a29a', 'request_id': 'req-36f67cc7-9400-4043-b444-9ca9d9fb7329'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:55.096111 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2890/5799] 10.222.0.83 () {58 vars in 1230 bytes} [Mon Aug 29 16:04:54 2022] DELETE /identity/v3/domains/fba19d915bdd4cbe9988283902b9a29a => generated 0 bytes in 842 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:04:55.101202 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317da4f8-1ca7-43a6-887c-1d14a2420351 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:55.117872 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317da4f8-1ca7-43a6-887c-1d14a2420351 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:55.331830 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6745e-21b6-4efc-96de-c8646baed0c0 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '869b9ffc0b4542728cc7e43adcbd72b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56bc1f48f8c0497a8ac94dd66e374cb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:55.332507 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6745e-21b6-4efc-96de-c8646baed0c0 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:55.332794 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6745e-21b6-4efc-96de-c8646baed0c0 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:55.333069 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6745e-21b6-4efc-96de-c8646baed0c0 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:55.333742 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b6745e-21b6-4efc-96de-c8646baed0c0 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:55.345064 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b6745e-21b6-4efc-96de-c8646baed0c0 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:55.406832 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f67cc7-9400-4043-b444-9ca9d9fb7329 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:55.408298 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-36f67cc7-9400-4043-b444-9ca9d9fb7329 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:55.417388 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2910/5800] 10.222.0.83 () {60 vars in 1149 bytes} [Mon Aug 29 16:04:55 2022] POST /identity/v3/domains => generated 277 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:04:55.442032 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f67cc7-9400-4043-b444-9ca9d9fb7329 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:55.708954 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c038a4-4773-4a86-913d-76d4ef790e1c tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '869b9ffc0b4542728cc7e43adcbd72b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56bc1f48f8c0497a8ac94dd66e374cb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:55.711087 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c038a4-4773-4a86-913d-76d4ef790e1c tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:55.711373 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c038a4-4773-4a86-913d-76d4ef790e1c tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:55.711650 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c038a4-4773-4a86-913d-76d4ef790e1c tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] PATH_INFO: `/v3/domains/2f074f841488461caccaaa695c2fdd31` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:55.755989 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c038a4-4773-4a86-913d-76d4ef790e1c tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=2f074f841488461caccaaa695c2fdd31)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:55.757664 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c038a4-4773-4a86-913d-76d4ef790e1c tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:55.816254 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-29c038a4-4773-4a86-913d-76d4ef790e1c tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '2f074f841488461caccaaa695c2fdd31'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:55.816963 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-29c038a4-4773-4a86-913d-76d4ef790e1c tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '2f074f841488461caccaaa695c2fdd31'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:55.894011 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-29c038a4-4773-4a86-913d-76d4ef790e1c tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '2f074f841488461caccaaa695c2fdd31'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:55.894696 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-29c038a4-4773-4a86-913d-76d4ef790e1c tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '2f074f841488461caccaaa695c2fdd31'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:55.904098 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6745e-21b6-4efc-96de-c8646baed0c0 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:55.904603 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2891/5801] 10.222.0.83 () {60 vars in 1250 bytes} [Mon Aug 29 16:04:55 2022] PATCH /identity/v3/domains/2f074f841488461caccaaa695c2fdd31 => generated 277 bytes in 498 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:04:55.907451 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-96b6745e-21b6-4efc-96de-c8646baed0c0 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:55.931578 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6745e-21b6-4efc-96de-c8646baed0c0 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:56.050943 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a25e12-149b-45b6-b044-d04d4434c45c tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '869b9ffc0b4542728cc7e43adcbd72b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56bc1f48f8c0497a8ac94dd66e374cb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:56.051910 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a25e12-149b-45b6-b044-d04d4434c45c tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:56.052626 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a25e12-149b-45b6-b044-d04d4434c45c tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:56.053480 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a25e12-149b-45b6-b044-d04d4434c45c tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] PATH_INFO: `/v3/domains/2f074f841488461caccaaa695c2fdd31` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:56.075920 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a25e12-149b-45b6-b044-d04d4434c45c tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=2f074f841488461caccaaa695c2fdd31)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:56.078727 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a25e12-149b-45b6-b044-d04d4434c45c tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:56.084804 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c038a4-4773-4a86-913d-76d4ef790e1c tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:56.085011 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2911/5802] 10.222.0.83 () {58 vars in 1227 bytes} [Mon Aug 29 16:04:55 2022] GET /identity/v3/domains/2f074f841488461caccaaa695c2fdd31 => generated 277 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:04:56.100541 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c038a4-4773-4a86-913d-76d4ef790e1c tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:56.127142 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80acf5f-f8e1-4de9-833a-edf2a43ea395 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '869b9ffc0b4542728cc7e43adcbd72b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56bc1f48f8c0497a8ac94dd66e374cb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:56.128005 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80acf5f-f8e1-4de9-833a-edf2a43ea395 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:56.128440 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80acf5f-f8e1-4de9-833a-edf2a43ea395 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:56.135337 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80acf5f-f8e1-4de9-833a-edf2a43ea395 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] PATH_INFO: `/v3/domains/2f074f841488461caccaaa695c2fdd31` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:56.143991 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80acf5f-f8e1-4de9-833a-edf2a43ea395 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=2f074f841488461caccaaa695c2fdd31)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:56.145866 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80acf5f-f8e1-4de9-833a-edf2a43ea395 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:56.238093 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d80acf5f-f8e1-4de9-833a-edf2a43ea395 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '2f074f841488461caccaaa695c2fdd31'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:56.246928 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d80acf5f-f8e1-4de9-833a-edf2a43ea395 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '2f074f841488461caccaaa695c2fdd31'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:56.302680 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:56.381799 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d80acf5f-f8e1-4de9-833a-edf2a43ea395 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f074f841488461caccaaa695c2fdd31', 'request_id': 'req-d80acf5f-f8e1-4de9-833a-edf2a43ea395'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:56.391581 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d80acf5f-f8e1-4de9-833a-edf2a43ea395 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f074f841488461caccaaa695c2fdd31', 'request_id': 'req-d80acf5f-f8e1-4de9-833a-edf2a43ea395'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:56.413314 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d80acf5f-f8e1-4de9-833a-edf2a43ea395 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f074f841488461caccaaa695c2fdd31', 'request_id': 'req-d80acf5f-f8e1-4de9-833a-edf2a43ea395'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:56.431011 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d80acf5f-f8e1-4de9-833a-edf2a43ea395 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] The token cache is being invalidate because project 2f074f841488461caccaaa695c2fdd31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:04:56.431534 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d80acf5f-f8e1-4de9-833a-edf2a43ea395 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:56.432385 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d80acf5f-f8e1-4de9-833a-edf2a43ea395 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:56.441835 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d80acf5f-f8e1-4de9-833a-edf2a43ea395 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '2f074f841488461caccaaa695c2fdd31', 'request_id': 'req-d80acf5f-f8e1-4de9-833a-edf2a43ea395'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:56.442816 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d80acf5f-f8e1-4de9-833a-edf2a43ea395 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '2f074f841488461caccaaa695c2fdd31', 'request_id': 'req-d80acf5f-f8e1-4de9-833a-edf2a43ea395'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:56.443631 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d80acf5f-f8e1-4de9-833a-edf2a43ea395 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '2f074f841488461caccaaa695c2fdd31', 'request_id': 'req-d80acf5f-f8e1-4de9-833a-edf2a43ea395'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:56.454987 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2892/5803] 10.222.0.83 () {58 vars in 1230 bytes} [Mon Aug 29 16:04:56 2022] DELETE /identity/v3/domains/2f074f841488461caccaaa695c2fdd31 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:56.458952 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a25e12-149b-45b6-b044-d04d4434c45c tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:56.462138 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-68a25e12-149b-45b6-b044-d04d4434c45c tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:56.497972 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a25e12-149b-45b6-b044-d04d4434c45c tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:56.674044 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:56.692980 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca98f70-a58c-44b3-8709-be550a67ad9c tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '869b9ffc0b4542728cc7e43adcbd72b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56bc1f48f8c0497a8ac94dd66e374cb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:56.693866 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca98f70-a58c-44b3-8709-be550a67ad9c tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:56.694290 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca98f70-a58c-44b3-8709-be550a67ad9c tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:56.694704 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca98f70-a58c-44b3-8709-be550a67ad9c tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:56.696225 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca98f70-a58c-44b3-8709-be550a67ad9c tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:56.711285 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca98f70-a58c-44b3-8709-be550a67ad9c tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:56.758161 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2912/5804] 10.222.0.83 () {58 vars in 1128 bytes} [Mon Aug 29 16:04:56 2022] GET /identity/v3/domains => generated 1348 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:04:56.762567 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80acf5f-f8e1-4de9-833a-edf2a43ea395 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:56.774203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80acf5f-f8e1-4de9-833a-edf2a43ea395 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:56.811431 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9083468-ae8f-4077-8bcd-3a1b3d9c9d6b tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '869b9ffc0b4542728cc7e43adcbd72b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56bc1f48f8c0497a8ac94dd66e374cb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:56.812595 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9083468-ae8f-4077-8bcd-3a1b3d9c9d6b tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:56.812886 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9083468-ae8f-4077-8bcd-3a1b3d9c9d6b tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:56.813167 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9083468-ae8f-4077-8bcd-3a1b3d9c9d6b tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] PATH_INFO: `/v3/domains/2f074f841488461caccaaa695c2fdd31` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:56.865550 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9083468-ae8f-4077-8bcd-3a1b3d9c9d6b tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 16:04:56.903586 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-b9083468-ae8f-4077-8bcd-3a1b3d9c9d6b tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Could not find domain: 2f074f841488461caccaaa695c2fdd31.: keystone.exception.DomainNotFound: Could not find domain: 2f074f841488461caccaaa695c2fdd31. Aug 29 16:04:56.903586 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:04:56.903586 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 29 16:04:56.903586 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 29 16:04:56.903586 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 16:04:56.903586 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 16:04:56.903586 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 16:04:56.903586 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 16:04:56.903586 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 2f074f841488461caccaaa695c2fdd31. Aug 29 16:04:56.903586 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:04:56.903586 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 16:04:56.903586 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:04:56.903586 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:04:56.903586 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:04:56.903586 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:04:56.903586 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:04:56.904850 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:04:56.904850 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:04:56.904850 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:04:56.904850 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:04:56.904850 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:04:56.904850 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:04:56.904850 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:04:56.904850 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 29 16:04:56.904850 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 29 16:04:56.904850 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 16:04:56.904850 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 16:04:56.904850 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 16:04:56.904850 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 16:04:56.904850 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:04:56.904850 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:04:56.904850 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 16:04:56.906375 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 16:04:56.906375 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 16:04:56.906375 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 16:04:56.906375 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 16:04:56.906375 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 16:04:56.906375 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 16:04:56.906375 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 16:04:56.906375 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 16:04:56.906375 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 16:04:56.906375 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 16:04:56.906375 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 16:04:56.906375 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 16:04:56.906375 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 16:04:56.906375 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 29 16:04:56.906375 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 16:04:56.906375 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 2f074f841488461caccaaa695c2fdd31. Aug 29 16:04:56.906375 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:04:56.910240 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2893/5805] 10.222.0.83 () {60 vars in 1249 bytes} [Mon Aug 29 16:04:56 2022] PATCH /identity/v3/domains/2f074f841488461caccaaa695c2fdd31 => generated 112 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 29 16:04:56.910684 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca98f70-a58c-44b3-8709-be550a67ad9c tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:56.925222 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca98f70-a58c-44b3-8709-be550a67ad9c tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:56.943752 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94ef4b-6e53-4d0c-91a1-6596cdf2c43e tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '869b9ffc0b4542728cc7e43adcbd72b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56bc1f48f8c0497a8ac94dd66e374cb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:56.944393 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94ef4b-6e53-4d0c-91a1-6596cdf2c43e tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:56.944672 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94ef4b-6e53-4d0c-91a1-6596cdf2c43e tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:56.944947 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94ef4b-6e53-4d0c-91a1-6596cdf2c43e tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:56.945617 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d94ef4b-6e53-4d0c-91a1-6596cdf2c43e tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:56.947906 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d94ef4b-6e53-4d0c-91a1-6596cdf2c43e tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:57.020659 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2913/5806] 10.222.0.83 () {60 vars in 1149 bytes} [Mon Aug 29 16:04:56 2022] POST /identity/v3/domains => generated 277 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:04:57.025448 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9083468-ae8f-4077-8bcd-3a1b3d9c9d6b tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:57.090545 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9083468-ae8f-4077-8bcd-3a1b3d9c9d6b tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:57.321448 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5546fdbc-c8ab-4720-93e2-2edc42ad0e0d tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '869b9ffc0b4542728cc7e43adcbd72b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56bc1f48f8c0497a8ac94dd66e374cb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:57.323898 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546fdbc-c8ab-4720-93e2-2edc42ad0e0d tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:57.328105 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546fdbc-c8ab-4720-93e2-2edc42ad0e0d tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:57.331117 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546fdbc-c8ab-4720-93e2-2edc42ad0e0d tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:57.331855 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5546fdbc-c8ab-4720-93e2-2edc42ad0e0d tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:57.337553 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5546fdbc-c8ab-4720-93e2-2edc42ad0e0d tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:57.472245 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2894/5807] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:04:57 2022] POST /identity/v3/users => generated 346 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:04:57.476599 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94ef4b-6e53-4d0c-91a1-6596cdf2c43e tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:57.492534 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94ef4b-6e53-4d0c-91a1-6596cdf2c43e tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:57.508099 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476da29a-4637-4d92-afa0-536fba72d048 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '869b9ffc0b4542728cc7e43adcbd72b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56bc1f48f8c0497a8ac94dd66e374cb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:57.508923 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476da29a-4637-4d92-afa0-536fba72d048 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:57.509226 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476da29a-4637-4d92-afa0-536fba72d048 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:57.509500 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476da29a-4637-4d92-afa0-536fba72d048 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] PATH_INFO: `/v3/groups` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:57.510306 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476da29a-4637-4d92-afa0-536fba72d048 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:57.512291 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476da29a-4637-4d92-afa0-536fba72d048 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:57.565226 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2914/5808] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:04:57 2022] POST /identity/v3/groups => generated 323 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:04:57.570426 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5546fdbc-c8ab-4720-93e2-2edc42ad0e0d tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:57.595004 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5546fdbc-c8ab-4720-93e2-2edc42ad0e0d tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:57.614847 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb8a56-8998-417d-9275-dc60a7b96894 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '869b9ffc0b4542728cc7e43adcbd72b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56bc1f48f8c0497a8ac94dd66e374cb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:57.615541 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb8a56-8998-417d-9275-dc60a7b96894 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:57.615824 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb8a56-8998-417d-9275-dc60a7b96894 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:57.616103 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb8a56-8998-417d-9275-dc60a7b96894 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] PATH_INFO: `/v3/domains/a34f9e21bbdf4206951a30c1c09998e9` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:57.624465 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb8a56-8998-417d-9275-dc60a7b96894 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=a34f9e21bbdf4206951a30c1c09998e9)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:57.626114 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb8a56-8998-417d-9275-dc60a7b96894 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:57.736072 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-cabb8a56-8998-417d-9275-dc60a7b96894 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'a34f9e21bbdf4206951a30c1c09998e9'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:57.740298 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-cabb8a56-8998-417d-9275-dc60a7b96894 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'a34f9e21bbdf4206951a30c1c09998e9'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:57.821541 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-cabb8a56-8998-417d-9275-dc60a7b96894 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'a34f9e21bbdf4206951a30c1c09998e9'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:57.822314 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-cabb8a56-8998-417d-9275-dc60a7b96894 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'a34f9e21bbdf4206951a30c1c09998e9'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:57.827446 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2895/5809] 10.222.0.83 () {60 vars in 1249 bytes} [Mon Aug 29 16:04:57 2022] PATCH /identity/v3/domains/a34f9e21bbdf4206951a30c1c09998e9 => generated 278 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:04:57.832101 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476da29a-4637-4d92-afa0-536fba72d048 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:57.838654 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-476da29a-4637-4d92-afa0-536fba72d048 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:57.871480 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476da29a-4637-4d92-afa0-536fba72d048 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:58.188565 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c34301-834b-415c-b2dd-d640b75f1b64 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '869b9ffc0b4542728cc7e43adcbd72b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56bc1f48f8c0497a8ac94dd66e374cb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:58.189322 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c34301-834b-415c-b2dd-d640b75f1b64 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:58.189609 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c34301-834b-415c-b2dd-d640b75f1b64 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:58.189888 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c34301-834b-415c-b2dd-d640b75f1b64 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] PATH_INFO: `/v3/domains/a34f9e21bbdf4206951a30c1c09998e9` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:58.237209 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c34301-834b-415c-b2dd-d640b75f1b64 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a34f9e21bbdf4206951a30c1c09998e9)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:58.238890 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c34301-834b-415c-b2dd-d640b75f1b64 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:58.324275 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d6c34301-834b-415c-b2dd-d640b75f1b64 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a34f9e21bbdf4206951a30c1c09998e9'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:58.661937 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:58.729189 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d6c34301-834b-415c-b2dd-d640b75f1b64 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc105a5eca6c4263bdc0c16179411eda'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:58.729901 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d6c34301-834b-415c-b2dd-d640b75f1b64 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc105a5eca6c4263bdc0c16179411eda'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:58.752781 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d6c34301-834b-415c-b2dd-d640b75f1b64 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc105a5eca6c4263bdc0c16179411eda'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:58.769755 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d6c34301-834b-415c-b2dd-d640b75f1b64 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc105a5eca6c4263bdc0c16179411eda'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:58.770386 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d6c34301-834b-415c-b2dd-d640b75f1b64 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc105a5eca6c4263bdc0c16179411eda'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:58.843782 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d6c34301-834b-415c-b2dd-d640b75f1b64 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a34f9e21bbdf4206951a30c1c09998e9'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:58.915638 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d6c34301-834b-415c-b2dd-d640b75f1b64 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a34f9e21bbdf4206951a30c1c09998e9', 'request_id': 'req-d6c34301-834b-415c-b2dd-d640b75f1b64'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:58.931466 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d6c34301-834b-415c-b2dd-d640b75f1b64 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a34f9e21bbdf4206951a30c1c09998e9', 'request_id': 'req-d6c34301-834b-415c-b2dd-d640b75f1b64'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:58.945183 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d6c34301-834b-415c-b2dd-d640b75f1b64 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a34f9e21bbdf4206951a30c1c09998e9', 'request_id': 'req-d6c34301-834b-415c-b2dd-d640b75f1b64'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:58.989057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d6c34301-834b-415c-b2dd-d640b75f1b64 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] The token cache is being invalidate because project a34f9e21bbdf4206951a30c1c09998e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:04:58.989449 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d6c34301-834b-415c-b2dd-d640b75f1b64 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:58.990391 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d6c34301-834b-415c-b2dd-d640b75f1b64 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:59.012238 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d6c34301-834b-415c-b2dd-d640b75f1b64 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a34f9e21bbdf4206951a30c1c09998e9', 'request_id': 'req-d6c34301-834b-415c-b2dd-d640b75f1b64'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:59.013060 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d6c34301-834b-415c-b2dd-d640b75f1b64 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a34f9e21bbdf4206951a30c1c09998e9', 'request_id': 'req-d6c34301-834b-415c-b2dd-d640b75f1b64'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:59.013689 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d6c34301-834b-415c-b2dd-d640b75f1b64 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a34f9e21bbdf4206951a30c1c09998e9', 'request_id': 'req-d6c34301-834b-415c-b2dd-d640b75f1b64'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:59.058199 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2915/5810] 10.222.0.83 () {58 vars in 1230 bytes} [Mon Aug 29 16:04:57 2022] DELETE /identity/v3/domains/a34f9e21bbdf4206951a30c1c09998e9 => generated 0 bytes in 1222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:59.064537 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb8a56-8998-417d-9275-dc60a7b96894 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:59.090438 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb8a56-8998-417d-9275-dc60a7b96894 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:59.131506 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=84,keystone:DELETE=11,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:59.340659 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b76061-5ac3-47b2-8257-c7b3f1e5ea8b tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '869b9ffc0b4542728cc7e43adcbd72b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56bc1f48f8c0497a8ac94dd66e374cb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:59.341981 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b76061-5ac3-47b2-8257-c7b3f1e5ea8b tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:59.342263 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b76061-5ac3-47b2-8257-c7b3f1e5ea8b tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:59.342617 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b76061-5ac3-47b2-8257-c7b3f1e5ea8b tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] PATH_INFO: `/v3/domains/a34f9e21bbdf4206951a30c1c09998e9` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:59.364301 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b76061-5ac3-47b2-8257-c7b3f1e5ea8b tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=a34f9e21bbdf4206951a30c1c09998e9)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:59.371693 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b76061-5ac3-47b2-8257-c7b3f1e5ea8b tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:59.406245 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-f4b76061-5ac3-47b2-8257-c7b3f1e5ea8b tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Could not find domain: a34f9e21bbdf4206951a30c1c09998e9.: keystone.exception.DomainNotFound: Could not find domain: a34f9e21bbdf4206951a30c1c09998e9. Aug 29 16:04:59.406245 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:04:59.406245 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 29 16:04:59.406245 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 29 16:04:59.406245 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 16:04:59.406245 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 16:04:59.406245 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 16:04:59.406245 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 16:04:59.406245 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: a34f9e21bbdf4206951a30c1c09998e9. Aug 29 16:04:59.406245 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:04:59.406245 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 16:04:59.406245 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:04:59.406245 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:04:59.406245 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:04:59.406245 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:04:59.406245 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:04:59.407435 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:04:59.407435 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:04:59.407435 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:04:59.407435 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:04:59.407435 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:04:59.407435 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:04:59.407435 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:04:59.407435 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 16:04:59.407435 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 16:04:59.407435 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 16:04:59.407435 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 16:04:59.407435 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:04:59.407435 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:04:59.407435 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 16:04:59.407435 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 16:04:59.407435 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 16:04:59.407435 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 16:04:59.411763 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 16:04:59.411763 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 16:04:59.411763 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 16:04:59.411763 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 16:04:59.411763 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 16:04:59.411763 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 16:04:59.411763 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 16:04:59.411763 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 16:04:59.411763 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 16:04:59.411763 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 16:04:59.411763 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 29 16:04:59.411763 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 16:04:59.411763 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: a34f9e21bbdf4206951a30c1c09998e9. Aug 29 16:04:59.411763 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:04:59.411763 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2896/5811] 10.222.0.83 () {58 vars in 1227 bytes} [Mon Aug 29 16:04:59 2022] GET /identity/v3/domains/a34f9e21bbdf4206951a30c1c09998e9 => generated 112 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 16:04:59.412713 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c34301-834b-415c-b2dd-d640b75f1b64 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:59.414065 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d6c34301-834b-415c-b2dd-d640b75f1b64 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:59.433848 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c34301-834b-415c-b2dd-d640b75f1b64 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:59.449278 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f7472-8445-47b6-9158-7388c48725c2 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '869b9ffc0b4542728cc7e43adcbd72b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56bc1f48f8c0497a8ac94dd66e374cb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:59.449956 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f7472-8445-47b6-9158-7388c48725c2 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:59.450241 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f7472-8445-47b6-9158-7388c48725c2 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:59.450517 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f7472-8445-47b6-9158-7388c48725c2 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] PATH_INFO: `/v3/users/fc105a5eca6c4263bdc0c16179411eda` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:59.464162 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8f7472-8445-47b6-9158-7388c48725c2 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorizing `identity:get_user(user_id=fc105a5eca6c4263bdc0c16179411eda)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:59.466848 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8f7472-8445-47b6-9158-7388c48725c2 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:59.482200 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-6b8f7472-8445-47b6-9158-7388c48725c2 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Could not find user: fc105a5eca6c4263bdc0c16179411eda.: keystone.exception.UserNotFound: Could not find user: fc105a5eca6c4263bdc0c16179411eda. Aug 29 16:04:59.482200 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:04:59.482200 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:04:59.482200 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:04:59.482200 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:04:59.482200 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:04:59.482200 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:04:59.482200 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:04:59.482200 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:04:59.482200 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:04:59.482200 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:04:59.482200 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:04:59.482200 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 16:04:59.482200 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 16:04:59.482200 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 16:04:59.483236 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 16:04:59.483236 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:04:59.483236 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:04:59.483236 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 16:04:59.483236 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 16:04:59.483236 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 16:04:59.483236 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 16:04:59.483236 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 16:04:59.483236 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 16:04:59.483236 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 16:04:59.483236 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 16:04:59.483236 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 16:04:59.483236 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 16:04:59.483236 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 16:04:59.483236 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 16:04:59.483236 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 16:04:59.483236 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 16:04:59.484545 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 16:04:59.484545 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 16:04:59.484545 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 16:04:59.484545 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 16:04:59.484545 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 16:04:59.484545 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 16:04:59.484545 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 16:04:59.484545 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 16:04:59.484545 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 16:04:59.484545 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 16:04:59.484545 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: fc105a5eca6c4263bdc0c16179411eda. Aug 29 16:04:59.484545 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:04:59.490018 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b76061-5ac3-47b2-8257-c7b3f1e5ea8b tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:59.503383 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2916/5812] 10.222.0.83 () {58 vars in 1221 bytes} [Mon Aug 29 16:04:59 2022] GET /identity/v3/users/fc105a5eca6c4263bdc0c16179411eda => generated 110 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 16:04:59.504793 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b76061-5ac3-47b2-8257-c7b3f1e5ea8b tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:59.511215 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a009d7-2bfc-4b28-83dc-3ded3c66fa13 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '869b9ffc0b4542728cc7e43adcbd72b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56bc1f48f8c0497a8ac94dd66e374cb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:59.511986 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a009d7-2bfc-4b28-83dc-3ded3c66fa13 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:59.512203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a009d7-2bfc-4b28-83dc-3ded3c66fa13 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:59.512485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a009d7-2bfc-4b28-83dc-3ded3c66fa13 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] PATH_INFO: `/v3/groups/c77f81c8dc9b44e4ab61224b0993f57a` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:59.518966 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a009d7-2bfc-4b28-83dc-3ded3c66fa13 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorizing `identity:get_group(group_id=c77f81c8dc9b44e4ab61224b0993f57a)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:59.520244 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-81a009d7-2bfc-4b28-83dc-3ded3c66fa13 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:04:59.520244 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 16:04:59.520244 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 16:04:59.521417 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a009d7-2bfc-4b28-83dc-3ded3c66fa13 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:59.545159 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-81a009d7-2bfc-4b28-83dc-3ded3c66fa13 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Could not find group: c77f81c8dc9b44e4ab61224b0993f57a.: keystone.exception.GroupNotFound: Could not find group: c77f81c8dc9b44e4ab61224b0993f57a. Aug 29 16:04:59.545159 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:04:59.545159 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:04:59.545159 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:04:59.545159 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:04:59.545159 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:04:59.545159 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:04:59.545159 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:04:59.545159 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:04:59.545159 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:04:59.545159 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:04:59.545159 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:04:59.545159 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 58, in get Aug 29 16:04:59.545159 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_group(group_id) Aug 29 16:04:59.545159 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 70, in _get_group Aug 29 16:04:59.546871 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.identity_api.get_group(group_id)) Aug 29 16:04:59.546871 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:04:59.546871 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:04:59.546871 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 16:04:59.546871 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 16:04:59.546871 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 16:04:59.546871 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 16:04:59.546871 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 16:04:59.546871 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 16:04:59.546871 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 16:04:59.546871 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 16:04:59.546871 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 16:04:59.546871 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 16:04:59.546871 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 16:04:59.546871 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 16:04:59.546871 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 16:04:59.546871 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 16:04:59.547786 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 16:04:59.547786 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 16:04:59.547786 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 16:04:59.547786 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 16:04:59.547786 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Aug 29 16:04:59.547786 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Aug 29 16:04:59.547786 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Aug 29 16:04:59.547786 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Aug 29 16:04:59.547786 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Aug 29 16:04:59.547786 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Aug 29 16:04:59.547786 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: c77f81c8dc9b44e4ab61224b0993f57a. Aug 29 16:04:59.547786 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:04:59.551205 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2897/5813] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:04:59 2022] GET /identity/v3/groups/c77f81c8dc9b44e4ab61224b0993f57a => generated 111 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 16:04:59.552506 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f7472-8445-47b6-9158-7388c48725c2 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:59.565395 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f7472-8445-47b6-9158-7388c48725c2 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:59.571627 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398e6be-978f-42a5-b68a-c60a49b96a3f tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '869b9ffc0b4542728cc7e43adcbd72b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56bc1f48f8c0497a8ac94dd66e374cb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:59.572341 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398e6be-978f-42a5-b68a-c60a49b96a3f tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:59.572628 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398e6be-978f-42a5-b68a-c60a49b96a3f tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:59.572903 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398e6be-978f-42a5-b68a-c60a49b96a3f tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] PATH_INFO: `/v3/groups/c77f81c8dc9b44e4ab61224b0993f57a` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:59.580066 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3398e6be-978f-42a5-b68a-c60a49b96a3f tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 16:04:59.586180 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-3398e6be-978f-42a5-b68a-c60a49b96a3f tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Could not find group: c77f81c8dc9b44e4ab61224b0993f57a.: keystone.exception.GroupNotFound: Could not find group: c77f81c8dc9b44e4ab61224b0993f57a. Aug 29 16:04:59.586180 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:04:59.586180 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:04:59.586180 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:04:59.586180 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:04:59.586180 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:04:59.586180 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:04:59.586180 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:04:59.586180 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:04:59.586180 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:04:59.586180 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:04:59.586180 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:04:59.586180 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 133, in delete Aug 29 16:04:59.586180 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_group') Aug 29 16:04:59.587106 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 16:04:59.587106 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 16:04:59.587106 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 16:04:59.587106 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 16:04:59.587106 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:04:59.587106 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:04:59.587106 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 16:04:59.587106 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 16:04:59.587106 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 16:04:59.587106 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 16:04:59.587106 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 16:04:59.587106 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 16:04:59.587106 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 16:04:59.587106 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 16:04:59.587106 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 16:04:59.587106 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 16:04:59.587106 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 16:04:59.588000 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 16:04:59.588000 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 16:04:59.588000 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 16:04:59.588000 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 16:04:59.588000 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 16:04:59.588000 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 16:04:59.588000 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 16:04:59.588000 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Aug 29 16:04:59.588000 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Aug 29 16:04:59.588000 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Aug 29 16:04:59.588000 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Aug 29 16:04:59.588000 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Aug 29 16:04:59.588000 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Aug 29 16:04:59.588000 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: c77f81c8dc9b44e4ab61224b0993f57a. Aug 29 16:04:59.588000 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:04:59.593172 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a009d7-2bfc-4b28-83dc-3ded3c66fa13 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:59.594465 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2917/5814] 10.222.0.83 () {58 vars in 1227 bytes} [Mon Aug 29 16:04:59 2022] DELETE /identity/v3/groups/c77f81c8dc9b44e4ab61224b0993f57a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 16:04:59.605689 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a009d7-2bfc-4b28-83dc-3ded3c66fa13 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:59.611362 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603cf82f-ec35-4db6-9c88-19d65b93a196 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '869b9ffc0b4542728cc7e43adcbd72b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56bc1f48f8c0497a8ac94dd66e374cb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:59.612024 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603cf82f-ec35-4db6-9c88-19d65b93a196 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:59.612465 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603cf82f-ec35-4db6-9c88-19d65b93a196 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:59.612747 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603cf82f-ec35-4db6-9c88-19d65b93a196 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] PATH_INFO: `/v3/users/fc105a5eca6c4263bdc0c16179411eda` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:59.626305 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603cf82f-ec35-4db6-9c88-19d65b93a196 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorizing `identity:delete_user(user_id=fc105a5eca6c4263bdc0c16179411eda)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:59.628161 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603cf82f-ec35-4db6-9c88-19d65b93a196 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:59.649627 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-603cf82f-ec35-4db6-9c88-19d65b93a196 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Could not find user: fc105a5eca6c4263bdc0c16179411eda.: keystone.exception.UserNotFound: Could not find user: fc105a5eca6c4263bdc0c16179411eda. Aug 29 16:04:59.649627 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:04:59.649627 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:04:59.649627 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:04:59.649627 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:04:59.649627 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:04:59.649627 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:04:59.649627 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:04:59.649627 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:04:59.649627 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:04:59.649627 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:04:59.649627 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:04:59.649627 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete Aug 29 16:04:59.649627 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user(user_id) Aug 29 16:04:59.650498 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:04:59.650498 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:04:59.650498 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 16:04:59.650498 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 16:04:59.650498 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 16:04:59.650498 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 16:04:59.650498 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user Aug 29 16:04:59.650498 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) Aug 29 16:04:59.650498 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:04:59.650498 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:04:59.650498 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 16:04:59.650498 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 16:04:59.650498 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 16:04:59.650498 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 16:04:59.650498 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 16:04:59.650498 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 16:04:59.650498 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 16:04:59.650498 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 16:04:59.652480 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 16:04:59.652480 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 16:04:59.652480 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 16:04:59.652480 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 16:04:59.652480 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 16:04:59.652480 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 16:04:59.652480 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 16:04:59.652480 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 16:04:59.652480 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 16:04:59.652480 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 16:04:59.652480 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 16:04:59.652480 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 16:04:59.652480 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 16:04:59.652480 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 16:04:59.652480 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 16:04:59.652480 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 16:04:59.652480 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: fc105a5eca6c4263bdc0c16179411eda. Aug 29 16:04:59.652480 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:04:59.653424 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2898/5815] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:04:59 2022] DELETE /identity/v3/users/fc105a5eca6c4263bdc0c16179411eda => generated 110 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 16:04:59.656123 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398e6be-978f-42a5-b68a-c60a49b96a3f tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:59.669333 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398e6be-978f-42a5-b68a-c60a49b96a3f tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:59.677951 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3edab-2a6c-4474-92e8-1a23ec7c0aec tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '869b9ffc0b4542728cc7e43adcbd72b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56bc1f48f8c0497a8ac94dd66e374cb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:59.678717 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3edab-2a6c-4474-92e8-1a23ec7c0aec tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:59.679122 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3edab-2a6c-4474-92e8-1a23ec7c0aec tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:59.679490 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3edab-2a6c-4474-92e8-1a23ec7c0aec tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] PATH_INFO: `/v3/domains/a34f9e21bbdf4206951a30c1c09998e9` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:59.689782 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b3edab-2a6c-4474-92e8-1a23ec7c0aec tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 16:04:59.697306 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-38b3edab-2a6c-4474-92e8-1a23ec7c0aec tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Could not find domain: a34f9e21bbdf4206951a30c1c09998e9.: keystone.exception.DomainNotFound: Could not find domain: a34f9e21bbdf4206951a30c1c09998e9. Aug 29 16:04:59.697306 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:04:59.697306 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 29 16:04:59.697306 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 29 16:04:59.697306 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 16:04:59.697306 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 16:04:59.697306 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 16:04:59.697306 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 16:04:59.697306 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: a34f9e21bbdf4206951a30c1c09998e9. Aug 29 16:04:59.697306 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:04:59.697306 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 16:04:59.697306 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:04:59.697306 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:04:59.697306 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:04:59.697306 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:04:59.697306 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:04:59.698304 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:04:59.698304 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:04:59.698304 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:04:59.698304 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:04:59.698304 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:04:59.698304 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:04:59.698304 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:04:59.698304 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 29 16:04:59.698304 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 29 16:04:59.698304 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 16:04:59.698304 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 16:04:59.698304 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 16:04:59.698304 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 16:04:59.698304 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:04:59.698304 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:04:59.698304 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 16:04:59.699169 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 16:04:59.699169 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 16:04:59.699169 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 16:04:59.699169 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 16:04:59.699169 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 16:04:59.699169 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 16:04:59.699169 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 16:04:59.699169 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 16:04:59.699169 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 16:04:59.699169 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 16:04:59.699169 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 16:04:59.699169 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 16:04:59.699169 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 16:04:59.699169 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 29 16:04:59.699169 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 16:04:59.699169 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: a34f9e21bbdf4206951a30c1c09998e9. Aug 29 16:04:59.699169 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:04:59.704840 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603cf82f-ec35-4db6-9c88-19d65b93a196 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:59.715413 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2918/5816] 10.222.0.83 () {60 vars in 1249 bytes} [Mon Aug 29 16:04:59 2022] PATCH /identity/v3/domains/a34f9e21bbdf4206951a30c1c09998e9 => generated 112 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 16:04:59.718647 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603cf82f-ec35-4db6-9c88-19d65b93a196 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:59.724235 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e784cd-09da-4b6a-abf7-02beaa7abd41 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '869b9ffc0b4542728cc7e43adcbd72b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56bc1f48f8c0497a8ac94dd66e374cb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:59.724870 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e784cd-09da-4b6a-abf7-02beaa7abd41 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:59.725152 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e784cd-09da-4b6a-abf7-02beaa7abd41 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:59.725430 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e784cd-09da-4b6a-abf7-02beaa7abd41 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:59.726062 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e784cd-09da-4b6a-abf7-02beaa7abd41 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:59.728268 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e784cd-09da-4b6a-abf7-02beaa7abd41 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:59.774199 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3edab-2a6c-4474-92e8-1a23ec7c0aec tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:59.785304 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2899/5817] 10.222.0.83 () {58 vars in 1128 bytes} [Mon Aug 29 16:04:59 2022] GET /identity/v3/domains => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:04:59.789543 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3edab-2a6c-4474-92e8-1a23ec7c0aec tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:59.802328 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde43863-0c4e-422c-b8a2-b12adc69e40a tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '869b9ffc0b4542728cc7e43adcbd72b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56bc1f48f8c0497a8ac94dd66e374cb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:59.802998 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde43863-0c4e-422c-b8a2-b12adc69e40a tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:59.803312 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde43863-0c4e-422c-b8a2-b12adc69e40a tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:59.803738 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde43863-0c4e-422c-b8a2-b12adc69e40a tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:59.804451 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde43863-0c4e-422c-b8a2-b12adc69e40a tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:04:59.804737 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde43863-0c4e-422c-b8a2-b12adc69e40a tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:59.806533 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde43863-0c4e-422c-b8a2-b12adc69e40a tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:59.860912 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e784cd-09da-4b6a-abf7-02beaa7abd41 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:59.874995 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2919/5818] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:04:59 2022] GET /identity/v3/domains?enabled=True => generated 1094 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:04:59.876209 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e784cd-09da-4b6a-abf7-02beaa7abd41 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:59.886237 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd6773-ea4d-4f19-ad65-ceebd322a737 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '869b9ffc0b4542728cc7e43adcbd72b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56bc1f48f8c0497a8ac94dd66e374cb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:59.886870 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd6773-ea4d-4f19-ad65-ceebd322a737 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:59.887206 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd6773-ea4d-4f19-ad65-ceebd322a737 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:59.887486 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd6773-ea4d-4f19-ad65-ceebd322a737 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:59.888187 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bd6773-ea4d-4f19-ad65-ceebd322a737 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-317909412) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:04:59.888523 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bd6773-ea4d-4f19-ad65-ceebd322a737 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:59.897425 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bd6773-ea4d-4f19-ad65-ceebd322a737 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:59.939813 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde43863-0c4e-422c-b8a2-b12adc69e40a tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:59.951298 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde43863-0c4e-422c-b8a2-b12adc69e40a tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:59.953159 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2900/5819] 10.222.0.83 () {58 vars in 1197 bytes} [Mon Aug 29 16:04:59 2022] GET /identity/v3/domains?name=tempest-test_domain-317909412 => generated 407 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:04:59.973930 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f4521-704e-4b5f-8bb9-b41ec5d79190 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '869b9ffc0b4542728cc7e43adcbd72b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56bc1f48f8c0497a8ac94dd66e374cb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:59.974700 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f4521-704e-4b5f-8bb9-b41ec5d79190 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:59.974989 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f4521-704e-4b5f-8bb9-b41ec5d79190 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:59.975310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f4521-704e-4b5f-8bb9-b41ec5d79190 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] PATH_INFO: `/v3/domains/a34f9e21bbdf4206951a30c1c09998e9` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:59.992947 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043f4521-704e-4b5f-8bb9-b41ec5d79190 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 16:05:00.005785 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-043f4521-704e-4b5f-8bb9-b41ec5d79190 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Could not find domain: a34f9e21bbdf4206951a30c1c09998e9.: keystone.exception.DomainNotFound: Could not find domain: a34f9e21bbdf4206951a30c1c09998e9. Aug 29 16:05:00.005785 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:05:00.005785 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 29 16:05:00.005785 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 29 16:05:00.005785 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 16:05:00.005785 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 16:05:00.005785 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 16:05:00.005785 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 16:05:00.005785 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: a34f9e21bbdf4206951a30c1c09998e9. Aug 29 16:05:00.005785 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:05:00.005785 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 16:05:00.005785 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:05:00.005785 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:05:00.005785 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:05:00.005785 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:05:00.005785 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:05:00.006831 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:05:00.006831 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:05:00.006831 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:05:00.006831 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:05:00.006831 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:05:00.006831 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:05:00.006831 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:05:00.006831 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 29 16:05:00.006831 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 29 16:05:00.006831 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 16:05:00.006831 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 16:05:00.006831 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 16:05:00.006831 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 16:05:00.006831 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:05:00.006831 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:05:00.006831 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 16:05:00.007695 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 16:05:00.007695 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 16:05:00.007695 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 16:05:00.007695 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 16:05:00.007695 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 16:05:00.007695 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 16:05:00.007695 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 16:05:00.007695 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 16:05:00.007695 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 16:05:00.007695 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 16:05:00.007695 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 16:05:00.007695 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 16:05:00.007695 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 16:05:00.007695 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 29 16:05:00.007695 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 16:05:00.007695 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: a34f9e21bbdf4206951a30c1c09998e9. Aug 29 16:05:00.007695 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:05:00.012578 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd6773-ea4d-4f19-ad65-ceebd322a737 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:00.023652 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2920/5820] 10.222.0.83 () {60 vars in 1249 bytes} [Mon Aug 29 16:04:59 2022] PATCH /identity/v3/domains/a34f9e21bbdf4206951a30c1c09998e9 => generated 112 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 16:05:00.029896 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd6773-ea4d-4f19-ad65-ceebd322a737 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:00.048914 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb103008-9ae4-47a2-8dec-19c7cb5368b9 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '869b9ffc0b4542728cc7e43adcbd72b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56bc1f48f8c0497a8ac94dd66e374cb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:00.049608 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb103008-9ae4-47a2-8dec-19c7cb5368b9 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:00.050010 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb103008-9ae4-47a2-8dec-19c7cb5368b9 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:00.050292 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb103008-9ae4-47a2-8dec-19c7cb5368b9 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] PATH_INFO: `/v3/domains/2520d863301d4ee18303d89349156f4f` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:00.103801 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb103008-9ae4-47a2-8dec-19c7cb5368b9 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=2520d863301d4ee18303d89349156f4f)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:00.109964 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb103008-9ae4-47a2-8dec-19c7cb5368b9 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:00.289827 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2901/5821] 10.222.0.83 () {60 vars in 1249 bytes} [Mon Aug 29 16:05:00 2022] PATCH /identity/v3/domains/2520d863301d4ee18303d89349156f4f => generated 278 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:00.294790 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f4521-704e-4b5f-8bb9-b41ec5d79190 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:00.324032 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f4521-704e-4b5f-8bb9-b41ec5d79190 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:00.343241 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf340a-be5e-4043-ba60-d5fd9e825d04 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '869b9ffc0b4542728cc7e43adcbd72b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56bc1f48f8c0497a8ac94dd66e374cb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:00.344265 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf340a-be5e-4043-ba60-d5fd9e825d04 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:00.344644 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf340a-be5e-4043-ba60-d5fd9e825d04 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:00.344832 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf340a-be5e-4043-ba60-d5fd9e825d04 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] PATH_INFO: `/v3/domains/2520d863301d4ee18303d89349156f4f` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:00.361763 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bf340a-be5e-4043-ba60-d5fd9e825d04 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=2520d863301d4ee18303d89349156f4f)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:00.365075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bf340a-be5e-4043-ba60-d5fd9e825d04 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:00.400495 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:00.503313 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-16bf340a-be5e-4043-ba60-d5fd9e825d04 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '2520d863301d4ee18303d89349156f4f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:00.563719 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-16bf340a-be5e-4043-ba60-d5fd9e825d04 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '2520d863301d4ee18303d89349156f4f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:00.709242 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-16bf340a-be5e-4043-ba60-d5fd9e825d04 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2520d863301d4ee18303d89349156f4f', 'request_id': 'req-16bf340a-be5e-4043-ba60-d5fd9e825d04'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:00.716234 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-16bf340a-be5e-4043-ba60-d5fd9e825d04 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2520d863301d4ee18303d89349156f4f', 'request_id': 'req-16bf340a-be5e-4043-ba60-d5fd9e825d04'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:00.738098 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-16bf340a-be5e-4043-ba60-d5fd9e825d04 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2520d863301d4ee18303d89349156f4f', 'request_id': 'req-16bf340a-be5e-4043-ba60-d5fd9e825d04'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:00.764593 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-16bf340a-be5e-4043-ba60-d5fd9e825d04 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] The token cache is being invalidate because project 2520d863301d4ee18303d89349156f4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:00.764936 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-16bf340a-be5e-4043-ba60-d5fd9e825d04 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:00.766018 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-16bf340a-be5e-4043-ba60-d5fd9e825d04 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:00.790174 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-16bf340a-be5e-4043-ba60-d5fd9e825d04 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '2520d863301d4ee18303d89349156f4f', 'request_id': 'req-16bf340a-be5e-4043-ba60-d5fd9e825d04'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:00.791655 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-16bf340a-be5e-4043-ba60-d5fd9e825d04 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '2520d863301d4ee18303d89349156f4f', 'request_id': 'req-16bf340a-be5e-4043-ba60-d5fd9e825d04'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:00.792374 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-16bf340a-be5e-4043-ba60-d5fd9e825d04 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '2520d863301d4ee18303d89349156f4f', 'request_id': 'req-16bf340a-be5e-4043-ba60-d5fd9e825d04'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:00.814662 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2921/5822] 10.222.0.83 () {58 vars in 1230 bytes} [Mon Aug 29 16:05:00 2022] DELETE /identity/v3/domains/2520d863301d4ee18303d89349156f4f => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:00.818892 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb103008-9ae4-47a2-8dec-19c7cb5368b9 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:00.822863 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-cb103008-9ae4-47a2-8dec-19c7cb5368b9 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:00.846091 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb103008-9ae4-47a2-8dec-19c7cb5368b9 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:00.991002 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe568583-3f6a-43e9-b4b0-a78ac1967718 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '869b9ffc0b4542728cc7e43adcbd72b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56bc1f48f8c0497a8ac94dd66e374cb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:00.994089 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe568583-3f6a-43e9-b4b0-a78ac1967718 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:00.995346 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe568583-3f6a-43e9-b4b0-a78ac1967718 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:00.995869 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe568583-3f6a-43e9-b4b0-a78ac1967718 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] PATH_INFO: `/v3/domains/57961b5bc42d4288a6722f05a633b59f` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:01.027975 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:01.032924 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe568583-3f6a-43e9-b4b0-a78ac1967718 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=57961b5bc42d4288a6722f05a633b59f)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:01.035740 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe568583-3f6a-43e9-b4b0-a78ac1967718 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:01.069296 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fe568583-3f6a-43e9-b4b0-a78ac1967718 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '57961b5bc42d4288a6722f05a633b59f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:01.070355 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fe568583-3f6a-43e9-b4b0-a78ac1967718 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '57961b5bc42d4288a6722f05a633b59f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:01.136538 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fe568583-3f6a-43e9-b4b0-a78ac1967718 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '57961b5bc42d4288a6722f05a633b59f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:01.137724 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fe568583-3f6a-43e9-b4b0-a78ac1967718 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '57961b5bc42d4288a6722f05a633b59f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:01.151070 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2902/5823] 10.222.0.83 () {60 vars in 1249 bytes} [Mon Aug 29 16:05:00 2022] PATCH /identity/v3/domains/57961b5bc42d4288a6722f05a633b59f => generated 277 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:01.156569 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf340a-be5e-4043-ba60-d5fd9e825d04 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:01.178910 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf340a-be5e-4043-ba60-d5fd9e825d04 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:01.330452 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37021ce1-d653-4e0a-a537-eaaf1fd9ffcb tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '869b9ffc0b4542728cc7e43adcbd72b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56bc1f48f8c0497a8ac94dd66e374cb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:01.332345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37021ce1-d653-4e0a-a537-eaaf1fd9ffcb tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:01.333245 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37021ce1-d653-4e0a-a537-eaaf1fd9ffcb tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:01.333745 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37021ce1-d653-4e0a-a537-eaaf1fd9ffcb tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] PATH_INFO: `/v3/domains/57961b5bc42d4288a6722f05a633b59f` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:01.351455 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37021ce1-d653-4e0a-a537-eaaf1fd9ffcb tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=57961b5bc42d4288a6722f05a633b59f)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:01.354017 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37021ce1-d653-4e0a-a537-eaaf1fd9ffcb tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:01.407796 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-37021ce1-d653-4e0a-a537-eaaf1fd9ffcb tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '57961b5bc42d4288a6722f05a633b59f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:01.451471 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-37021ce1-d653-4e0a-a537-eaaf1fd9ffcb tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '57961b5bc42d4288a6722f05a633b59f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:01.534074 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:01.621244 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-37021ce1-d653-4e0a-a537-eaaf1fd9ffcb tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57961b5bc42d4288a6722f05a633b59f', 'request_id': 'req-37021ce1-d653-4e0a-a537-eaaf1fd9ffcb'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:01.651713 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-37021ce1-d653-4e0a-a537-eaaf1fd9ffcb tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57961b5bc42d4288a6722f05a633b59f', 'request_id': 'req-37021ce1-d653-4e0a-a537-eaaf1fd9ffcb'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:01.678584 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-37021ce1-d653-4e0a-a537-eaaf1fd9ffcb tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57961b5bc42d4288a6722f05a633b59f', 'request_id': 'req-37021ce1-d653-4e0a-a537-eaaf1fd9ffcb'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:01.715934 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-37021ce1-d653-4e0a-a537-eaaf1fd9ffcb tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] The token cache is being invalidate because project 57961b5bc42d4288a6722f05a633b59f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:01.716749 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-37021ce1-d653-4e0a-a537-eaaf1fd9ffcb tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:01.725425 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-37021ce1-d653-4e0a-a537-eaaf1fd9ffcb tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:01.750346 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-37021ce1-d653-4e0a-a537-eaaf1fd9ffcb tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '57961b5bc42d4288a6722f05a633b59f', 'request_id': 'req-37021ce1-d653-4e0a-a537-eaaf1fd9ffcb'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:01.751170 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-37021ce1-d653-4e0a-a537-eaaf1fd9ffcb tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '57961b5bc42d4288a6722f05a633b59f', 'request_id': 'req-37021ce1-d653-4e0a-a537-eaaf1fd9ffcb'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:01.751800 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-37021ce1-d653-4e0a-a537-eaaf1fd9ffcb tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '57961b5bc42d4288a6722f05a633b59f', 'request_id': 'req-37021ce1-d653-4e0a-a537-eaaf1fd9ffcb'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:01.767549 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2922/5824] 10.222.0.83 () {58 vars in 1230 bytes} [Mon Aug 29 16:05:01 2022] DELETE /identity/v3/domains/57961b5bc42d4288a6722f05a633b59f => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:01.771750 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe568583-3f6a-43e9-b4b0-a78ac1967718 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:01.773413 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-fe568583-3f6a-43e9-b4b0-a78ac1967718 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:01.796610 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe568583-3f6a-43e9-b4b0-a78ac1967718 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:01.920032 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a415b4-c065-4179-b2b2-8191277863a3 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '869b9ffc0b4542728cc7e43adcbd72b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56bc1f48f8c0497a8ac94dd66e374cb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:01.921106 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a415b4-c065-4179-b2b2-8191277863a3 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:01.921240 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a415b4-c065-4179-b2b2-8191277863a3 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:01.921507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a415b4-c065-4179-b2b2-8191277863a3 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] PATH_INFO: `/v3/domains/c5945dc5a77a46d7904900a0d7187d4e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:01.964313 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a415b4-c065-4179-b2b2-8191277863a3 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=c5945dc5a77a46d7904900a0d7187d4e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:01.969377 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a415b4-c065-4179-b2b2-8191277863a3 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:02.049619 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-14a415b4-c065-4179-b2b2-8191277863a3 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'c5945dc5a77a46d7904900a0d7187d4e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:02.052598 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-14a415b4-c065-4179-b2b2-8191277863a3 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'c5945dc5a77a46d7904900a0d7187d4e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:02.130750 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-14a415b4-c065-4179-b2b2-8191277863a3 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'c5945dc5a77a46d7904900a0d7187d4e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:02.133356 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-14a415b4-c065-4179-b2b2-8191277863a3 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'c5945dc5a77a46d7904900a0d7187d4e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:02.143069 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2903/5825] 10.222.0.83 () {60 vars in 1249 bytes} [Mon Aug 29 16:05:01 2022] PATCH /identity/v3/domains/c5945dc5a77a46d7904900a0d7187d4e => generated 277 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:02.147017 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37021ce1-d653-4e0a-a537-eaaf1fd9ffcb tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:02.149232 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-37021ce1-d653-4e0a-a537-eaaf1fd9ffcb tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:02.178925 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37021ce1-d653-4e0a-a537-eaaf1fd9ffcb tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:02.492022 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e7d9f-4fba-4751-9b01-d6fec87d370b tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '869b9ffc0b4542728cc7e43adcbd72b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56bc1f48f8c0497a8ac94dd66e374cb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:02.492689 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e7d9f-4fba-4751-9b01-d6fec87d370b tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:02.492968 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e7d9f-4fba-4751-9b01-d6fec87d370b tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:02.493240 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e7d9f-4fba-4751-9b01-d6fec87d370b tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] PATH_INFO: `/v3/domains/c5945dc5a77a46d7904900a0d7187d4e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:02.542378 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e7d9f-4fba-4751-9b01-d6fec87d370b tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=c5945dc5a77a46d7904900a0d7187d4e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:02.545065 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e7d9f-4fba-4751-9b01-d6fec87d370b tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:02.609956 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f62e7d9f-4fba-4751-9b01-d6fec87d370b tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'c5945dc5a77a46d7904900a0d7187d4e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:02.623531 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f62e7d9f-4fba-4751-9b01-d6fec87d370b tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'c5945dc5a77a46d7904900a0d7187d4e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:02.685616 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f62e7d9f-4fba-4751-9b01-d6fec87d370b tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5945dc5a77a46d7904900a0d7187d4e', 'request_id': 'req-f62e7d9f-4fba-4751-9b01-d6fec87d370b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:02.694641 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f62e7d9f-4fba-4751-9b01-d6fec87d370b tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5945dc5a77a46d7904900a0d7187d4e', 'request_id': 'req-f62e7d9f-4fba-4751-9b01-d6fec87d370b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:02.695975 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=17,keystone:SELECT=82,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:02.717849 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f62e7d9f-4fba-4751-9b01-d6fec87d370b tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5945dc5a77a46d7904900a0d7187d4e', 'request_id': 'req-f62e7d9f-4fba-4751-9b01-d6fec87d370b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:02.761004 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f62e7d9f-4fba-4751-9b01-d6fec87d370b tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] The token cache is being invalidate because project c5945dc5a77a46d7904900a0d7187d4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:02.761327 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f62e7d9f-4fba-4751-9b01-d6fec87d370b tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:02.761910 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f62e7d9f-4fba-4751-9b01-d6fec87d370b tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:02.776283 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f62e7d9f-4fba-4751-9b01-d6fec87d370b tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'c5945dc5a77a46d7904900a0d7187d4e', 'request_id': 'req-f62e7d9f-4fba-4751-9b01-d6fec87d370b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:02.780445 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f62e7d9f-4fba-4751-9b01-d6fec87d370b tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'c5945dc5a77a46d7904900a0d7187d4e', 'request_id': 'req-f62e7d9f-4fba-4751-9b01-d6fec87d370b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:02.781368 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f62e7d9f-4fba-4751-9b01-d6fec87d370b tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'c5945dc5a77a46d7904900a0d7187d4e', 'request_id': 'req-f62e7d9f-4fba-4751-9b01-d6fec87d370b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:02.807482 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2923/5826] 10.222.0.83 () {58 vars in 1230 bytes} [Mon Aug 29 16:05:02 2022] DELETE /identity/v3/domains/c5945dc5a77a46d7904900a0d7187d4e => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:02.814233 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a415b4-c065-4179-b2b2-8191277863a3 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:02.815915 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-14a415b4-c065-4179-b2b2-8191277863a3 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:03.063830 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a415b4-c065-4179-b2b2-8191277863a3 tempest-DomainsTestJSON-2009326161 tempest-DomainsTestJSON-2009326161-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:03.145973 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=98,keystone:UPDATE=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:03.231937 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c35da92-79f5-4125-8815-590c781fcdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:03.232859 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35da92-79f5-4125-8815-590c781fcdbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:03.233319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35da92-79f5-4125-8815-590c781fcdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:03.233953 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35da92-79f5-4125-8815-590c781fcdbf admin admin] PATH_INFO: `/v3/users/1f92489eca7445968f207e4aa94083e7` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:03.248367 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c35da92-79f5-4125-8815-590c781fcdbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f92489eca7445968f207e4aa94083e7)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:03.252492 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c35da92-79f5-4125-8815-590c781fcdbf admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:03.427464 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1c35da92-79f5-4125-8815-590c781fcdbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f92489eca7445968f207e4aa94083e7'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:03.428371 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1c35da92-79f5-4125-8815-590c781fcdbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f92489eca7445968f207e4aa94083e7'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:03.462264 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1c35da92-79f5-4125-8815-590c781fcdbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f92489eca7445968f207e4aa94083e7'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:03.475381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1c35da92-79f5-4125-8815-590c781fcdbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f92489eca7445968f207e4aa94083e7'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:03.487715 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1c35da92-79f5-4125-8815-590c781fcdbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f92489eca7445968f207e4aa94083e7'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:03.507410 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2904/5827] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:05:02 2022] DELETE /identity/v3/users/1f92489eca7445968f207e4aa94083e7 => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:03.512282 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fc141-3741-4e81-b43c-af370e67250d None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:03.512590 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fc141-3741-4e81-b43c-af370e67250d None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:03.513075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fc141-3741-4e81-b43c-af370e67250d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:03.557637 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-4d5fc141-3741-4e81-b43c-af370e67250d None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:03.563091 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4d5fc141-3741-4e81-b43c-af370e67250d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:03.697493 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2924/5828] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:03.711481 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c35da92-79f5-4125-8815-590c781fcdbf admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:03.713182 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1c35da92-79f5-4125-8815-590c781fcdbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:03.896533 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c35da92-79f5-4125-8815-590c781fcdbf admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:03.907127 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51331fe8-76aa-40f5-b74e-d44f44ca0656 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:03.908900 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51331fe8-76aa-40f5-b74e-d44f44ca0656 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:03.909194 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51331fe8-76aa-40f5-b74e-d44f44ca0656 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:03.910941 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51331fe8-76aa-40f5-b74e-d44f44ca0656 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:03.938929 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51331fe8-76aa-40f5-b74e-d44f44ca0656 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:03.940677 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51331fe8-76aa-40f5-b74e-d44f44ca0656 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:03.958755 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2905/5829] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:05:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:05:04.457721 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5fc141-3741-4e81-b43c-af370e67250d None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:04.460117 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4d5fc141-3741-4e81-b43c-af370e67250d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:04.480967 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5fc141-3741-4e81-b43c-af370e67250d None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:04.495326 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc7814f-4566-45ba-9be1-d7ca5633e5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:04.495992 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7814f-4566-45ba-9be1-d7ca5633e5e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:04.496272 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7814f-4566-45ba-9be1-d7ca5633e5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:04.496544 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7814f-4566-45ba-9be1-d7ca5633e5e2 admin admin] PATH_INFO: `/v3/users/90c0c0f8860541c0a54484d06e5fb475` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:04.500229 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc7814f-4566-45ba-9be1-d7ca5633e5e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90c0c0f8860541c0a54484d06e5fb475)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:04.502596 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc7814f-4566-45ba-9be1-d7ca5633e5e2 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:04.606977 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5fc7814f-4566-45ba-9be1-d7ca5633e5e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90c0c0f8860541c0a54484d06e5fb475'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:04.608840 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5fc7814f-4566-45ba-9be1-d7ca5633e5e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90c0c0f8860541c0a54484d06e5fb475'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:04.628818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5fc7814f-4566-45ba-9be1-d7ca5633e5e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90c0c0f8860541c0a54484d06e5fb475'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:04.647338 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5fc7814f-4566-45ba-9be1-d7ca5633e5e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90c0c0f8860541c0a54484d06e5fb475'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:04.648429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5fc7814f-4566-45ba-9be1-d7ca5633e5e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90c0c0f8860541c0a54484d06e5fb475'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:04.707512 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2925/5830] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:05:04 2022] DELETE /identity/v3/users/90c0c0f8860541c0a54484d06e5fb475 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:04.709112 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f66df-281c-4318-80c0-dc0a9dd85768 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:04.709560 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f66df-281c-4318-80c0-dc0a9dd85768 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:04.710797 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f66df-281c-4318-80c0-dc0a9dd85768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:04.784960 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-128f66df-281c-4318-80c0-dc0a9dd85768 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:04.789469 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-128f66df-281c-4318-80c0-dc0a9dd85768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:04.860363 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc7814f-4566-45ba-9be1-d7ca5633e5e2 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:04.862277 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5fc7814f-4566-45ba-9be1-d7ca5633e5e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:05.019679 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:05.073953 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=83,keystone:INSERT=2,keystone:DELETE=15 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:05.096418 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2906/5831] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:05.148757 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f66df-281c-4318-80c0-dc0a9dd85768 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:05.150271 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-128f66df-281c-4318-80c0-dc0a9dd85768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:05.175948 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc7814f-4566-45ba-9be1-d7ca5633e5e2 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:05.222979 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93fa746-2d07-4437-a8cb-298a11bda5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:05.224336 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93fa746-2d07-4437-a8cb-298a11bda5f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:05.225396 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93fa746-2d07-4437-a8cb-298a11bda5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:05.226046 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93fa746-2d07-4437-a8cb-298a11bda5f3 admin admin] PATH_INFO: `/v3/projects/c35e0b3adbd14c728398778c0cb9224f` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:05.228196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93fa746-2d07-4437-a8cb-298a11bda5f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c35e0b3adbd14c728398778c0cb9224f)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:05.231553 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93fa746-2d07-4437-a8cb-298a11bda5f3 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:05.366583 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f66df-281c-4318-80c0-dc0a9dd85768 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:05.397139 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d93fa746-2d07-4437-a8cb-298a11bda5f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c35e0b3adbd14c728398778c0cb9224f', 'request_id': 'req-d93fa746-2d07-4437-a8cb-298a11bda5f3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:05.442224 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d93fa746-2d07-4437-a8cb-298a11bda5f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c35e0b3adbd14c728398778c0cb9224f', 'request_id': 'req-d93fa746-2d07-4437-a8cb-298a11bda5f3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:05.473203 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d93fa746-2d07-4437-a8cb-298a11bda5f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c35e0b3adbd14c728398778c0cb9224f', 'request_id': 'req-d93fa746-2d07-4437-a8cb-298a11bda5f3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:05.504816 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d93fa746-2d07-4437-a8cb-298a11bda5f3 admin admin] The token cache is being invalidate because project c35e0b3adbd14c728398778c0cb9224f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:05.507933 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d93fa746-2d07-4437-a8cb-298a11bda5f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:05.509987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d93fa746-2d07-4437-a8cb-298a11bda5f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:05.516362 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2926/5832] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:04 2022] DELETE /identity/v3/projects/c35e0b3adbd14c728398778c0cb9224f => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:05.522033 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93fa746-2d07-4437-a8cb-298a11bda5f3 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:05.526702 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d93fa746-2d07-4437-a8cb-298a11bda5f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:05.576213 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21f385-1e72-4025-bc76-53b6466ab54a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:05.576557 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21f385-1e72-4025-bc76-53b6466ab54a service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:05.576889 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21f385-1e72-4025-bc76-53b6466ab54a service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:05.577878 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21f385-1e72-4025-bc76-53b6466ab54a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:05.591703 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-be21f385-1e72-4025-bc76-53b6466ab54a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:05.737482 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93fa746-2d07-4437-a8cb-298a11bda5f3 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:05.762378 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3907f5d-f8b8-4bc7-bdc6-c6fef32ef626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:05.764090 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3907f5d-f8b8-4bc7-bdc6-c6fef32ef626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:05.765094 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3907f5d-f8b8-4bc7-bdc6-c6fef32ef626 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:05.766845 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3907f5d-f8b8-4bc7-bdc6-c6fef32ef626 admin admin] PATH_INFO: `/v3/users/869b9ffc0b4542728cc7e43adcbd72b7` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:05.770462 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3907f5d-f8b8-4bc7-bdc6-c6fef32ef626 admin admin] RBAC: Authorizing `identity:delete_user(user_id=869b9ffc0b4542728cc7e43adcbd72b7)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:05.777488 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3907f5d-f8b8-4bc7-bdc6-c6fef32ef626 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:05.833446 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be21f385-1e72-4025-bc76-53b6466ab54a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:05.836080 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be21f385-1e72-4025-bc76-53b6466ab54a service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:05.849093 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2907/5833] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:05:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 701 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:05:05.859260 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a3907f5d-f8b8-4bc7-bdc6-c6fef32ef626 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '869b9ffc0b4542728cc7e43adcbd72b7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:05.860153 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a3907f5d-f8b8-4bc7-bdc6-c6fef32ef626 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '869b9ffc0b4542728cc7e43adcbd72b7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:05.870965 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a3907f5d-f8b8-4bc7-bdc6-c6fef32ef626 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '869b9ffc0b4542728cc7e43adcbd72b7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:05.890837 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a3907f5d-f8b8-4bc7-bdc6-c6fef32ef626 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '869b9ffc0b4542728cc7e43adcbd72b7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:05.894930 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a3907f5d-f8b8-4bc7-bdc6-c6fef32ef626 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '869b9ffc0b4542728cc7e43adcbd72b7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:05.909351 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:05.940599 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2927/5834] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:05:05 2022] DELETE /identity/v3/users/869b9ffc0b4542728cc7e43adcbd72b7 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:07.143059 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21f385-1e72-4025-bc76-53b6466ab54a service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:07.144580 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-be21f385-1e72-4025-bc76-53b6466ab54a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:07.159852 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21f385-1e72-4025-bc76-53b6466ab54a service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:07.220731 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:07.230375 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a9bbf-c646-447b-8d6e-c8891e0938ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:07.231490 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a9bbf-c646-447b-8d6e-c8891e0938ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:07.232010 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a9bbf-c646-447b-8d6e-c8891e0938ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:07.232556 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a9bbf-c646-447b-8d6e-c8891e0938ca admin admin] PATH_INFO: `/v3/projects/b0c2fe968e254c3b90095c31ae1faf2d` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:07.234657 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739a9bbf-c646-447b-8d6e-c8891e0938ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0c2fe968e254c3b90095c31ae1faf2d)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:07.237572 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739a9bbf-c646-447b-8d6e-c8891e0938ca admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:07.269106 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3907f5d-f8b8-4bc7-bdc6-c6fef32ef626 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:07.271505 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a3907f5d-f8b8-4bc7-bdc6-c6fef32ef626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:07.333143 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3907f5d-f8b8-4bc7-bdc6-c6fef32ef626 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:07.341966 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-739a9bbf-c646-447b-8d6e-c8891e0938ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0c2fe968e254c3b90095c31ae1faf2d', 'request_id': 'req-739a9bbf-c646-447b-8d6e-c8891e0938ca'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:07.354309 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-739a9bbf-c646-447b-8d6e-c8891e0938ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0c2fe968e254c3b90095c31ae1faf2d', 'request_id': 'req-739a9bbf-c646-447b-8d6e-c8891e0938ca'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:07.364550 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-739a9bbf-c646-447b-8d6e-c8891e0938ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0c2fe968e254c3b90095c31ae1faf2d', 'request_id': 'req-739a9bbf-c646-447b-8d6e-c8891e0938ca'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:07.377601 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-739a9bbf-c646-447b-8d6e-c8891e0938ca admin admin] The token cache is being invalidate because project b0c2fe968e254c3b90095c31ae1faf2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:07.377829 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-739a9bbf-c646-447b-8d6e-c8891e0938ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:07.378634 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-739a9bbf-c646-447b-8d6e-c8891e0938ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:07.380516 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2908/5835] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:07 2022] DELETE /identity/v3/projects/b0c2fe968e254c3b90095c31ae1faf2d => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:07.384252 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a9bbf-c646-447b-8d6e-c8891e0938ca admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:07.385725 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-739a9bbf-c646-447b-8d6e-c8891e0938ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:07.463467 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f5eb0-4a72-4d5a-8bcb-0762a8481470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:07.471058 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f5eb0-4a72-4d5a-8bcb-0762a8481470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:07.471359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f5eb0-4a72-4d5a-8bcb-0762a8481470 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:07.471644 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f5eb0-4a72-4d5a-8bcb-0762a8481470 admin admin] PATH_INFO: `/v3/projects/56bc1f48f8c0497a8ac94dd66e374cb5` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:07.473381 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f5eb0-4a72-4d5a-8bcb-0762a8481470 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56bc1f48f8c0497a8ac94dd66e374cb5)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:07.475092 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f5eb0-4a72-4d5a-8bcb-0762a8481470 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:07.511544 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a9bbf-c646-447b-8d6e-c8891e0938ca admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:07.523191 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd814a9-74fc-41d6-a32b-98105bf054e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:07.523964 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd814a9-74fc-41d6-a32b-98105bf054e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:07.524303 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd814a9-74fc-41d6-a32b-98105bf054e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:07.524575 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd814a9-74fc-41d6-a32b-98105bf054e4 admin admin] PATH_INFO: `/v3/users/8d7af0e706944637a6fa3e44da7069e6` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:07.526117 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd814a9-74fc-41d6-a32b-98105bf054e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d7af0e706944637a6fa3e44da7069e6)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:07.535666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd814a9-74fc-41d6-a32b-98105bf054e4 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:07.554178 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6d7f5eb0-4a72-4d5a-8bcb-0762a8481470 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56bc1f48f8c0497a8ac94dd66e374cb5', 'request_id': 'req-6d7f5eb0-4a72-4d5a-8bcb-0762a8481470'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:07.579245 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6d7f5eb0-4a72-4d5a-8bcb-0762a8481470 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56bc1f48f8c0497a8ac94dd66e374cb5', 'request_id': 'req-6d7f5eb0-4a72-4d5a-8bcb-0762a8481470'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:07.588136 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6d7f5eb0-4a72-4d5a-8bcb-0762a8481470 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56bc1f48f8c0497a8ac94dd66e374cb5', 'request_id': 'req-6d7f5eb0-4a72-4d5a-8bcb-0762a8481470'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:07.607739 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6d7f5eb0-4a72-4d5a-8bcb-0762a8481470 admin admin] The token cache is being invalidate because project 56bc1f48f8c0497a8ac94dd66e374cb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:07.608185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6d7f5eb0-4a72-4d5a-8bcb-0762a8481470 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:07.609321 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6d7f5eb0-4a72-4d5a-8bcb-0762a8481470 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:07.610779 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2928/5836] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:07 2022] DELETE /identity/v3/projects/56bc1f48f8c0497a8ac94dd66e374cb5 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:05:07.617464 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a66d9-9fd6-4c4d-823d-2774ba252c43 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:07.617464 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a66d9-9fd6-4c4d-823d-2774ba252c43 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:07.617464 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a66d9-9fd6-4c4d-823d-2774ba252c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:07.635631 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-cdd814a9-74fc-41d6-a32b-98105bf054e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d7af0e706944637a6fa3e44da7069e6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:07.636776 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-cdd814a9-74fc-41d6-a32b-98105bf054e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d7af0e706944637a6fa3e44da7069e6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:07.664774 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-cdd814a9-74fc-41d6-a32b-98105bf054e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d7af0e706944637a6fa3e44da7069e6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:07.680885 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-e51a66d9-9fd6-4c4d-823d-2774ba252c43 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:07.683614 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e51a66d9-9fd6-4c4d-823d-2774ba252c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:07.689195 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-cdd814a9-74fc-41d6-a32b-98105bf054e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d7af0e706944637a6fa3e44da7069e6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:07.704493 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-cdd814a9-74fc-41d6-a32b-98105bf054e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d7af0e706944637a6fa3e44da7069e6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:07.719334 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2909/5837] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:05:07 2022] DELETE /identity/v3/users/8d7af0e706944637a6fa3e44da7069e6 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:07.807726 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2929/5838] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:07.817777 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a105e6-2aa4-4048-9ab1-192ce3c62a4f None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:07.818067 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a105e6-2aa4-4048-9ab1-192ce3c62a4f None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:07.818336 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a105e6-2aa4-4048-9ab1-192ce3c62a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:07.831292 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:07.846014 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-b5a105e6-2aa4-4048-9ab1-192ce3c62a4f None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:07.848189 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b5a105e6-2aa4-4048-9ab1-192ce3c62a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:08.008926 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2910/5839] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:08.013439 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51a66d9-9fd6-4c4d-823d-2774ba252c43 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:08.028682 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51a66d9-9fd6-4c4d-823d-2774ba252c43 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:08.039378 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295e257a-1299-4b14-b827-7c449392350c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:08.040006 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e257a-1299-4b14-b827-7c449392350c admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:08.040287 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e257a-1299-4b14-b827-7c449392350c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:08.040813 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e257a-1299-4b14-b827-7c449392350c admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:08.041481 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295e257a-1299-4b14-b827-7c449392350c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:05:08.041786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295e257a-1299-4b14-b827-7c449392350c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:08.043764 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295e257a-1299-4b14-b827-7c449392350c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:08.063394 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a105e6-2aa4-4048-9ab1-192ce3c62a4f None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:08.074958 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2930/5840] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:08.078961 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a105e6-2aa4-4048-9ab1-192ce3c62a4f None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:08.084699 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce97d5-73d5-43e6-9789-e2f5b37c29f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:08.085566 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce97d5-73d5-43e6-9789-e2f5b37c29f9 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:08.085566 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce97d5-73d5-43e6-9789-e2f5b37c29f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:08.085996 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce97d5-73d5-43e6-9789-e2f5b37c29f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:08.086732 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ce97d5-73d5-43e6-9789-e2f5b37c29f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:08.089370 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ce97d5-73d5-43e6-9789-e2f5b37c29f9 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:08.122095 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295e257a-1299-4b14-b827-7c449392350c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:08.124777 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-295e257a-1299-4b14-b827-7c449392350c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:08.142206 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:08.193208 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2911/5841] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:05:08 2022] POST /identity/v3/projects => generated 365 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:08.198940 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce97d5-73d5-43e6-9789-e2f5b37c29f9 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:08.224651 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295e257a-1299-4b14-b827-7c449392350c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:08.303178 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252d647-dbb1-4edc-80f5-a9a51af3ede1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:08.304648 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252d647-dbb1-4edc-80f5-a9a51af3ede1 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:08.305118 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252d647-dbb1-4edc-80f5-a9a51af3ede1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:08.305534 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252d647-dbb1-4edc-80f5-a9a51af3ede1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:08.308219 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2252d647-dbb1-4edc-80f5-a9a51af3ede1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:08.374896 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce97d5-73d5-43e6-9789-e2f5b37c29f9 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:08.391438 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3985d4fa-3ae3-4c5a-86c2-25e4d4079260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:08.393079 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985d4fa-3ae3-4c5a-86c2-25e4d4079260 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:08.393717 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985d4fa-3ae3-4c5a-86c2-25e4d4079260 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:08.395529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985d4fa-3ae3-4c5a-86c2-25e4d4079260 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:08.396710 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3985d4fa-3ae3-4c5a-86c2-25e4d4079260 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:08.400838 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3985d4fa-3ae3-4c5a-86c2-25e4d4079260 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:08.458676 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2252d647-dbb1-4edc-80f5-a9a51af3ede1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:08.460882 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2912/5842] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:05:08 2022] POST /identity/v3/users => generated 283 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:05:08.465203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3985d4fa-3ae3-4c5a-86c2-25e4d4079260 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:08.465296 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2252d647-dbb1-4edc-80f5-a9a51af3ede1 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:08.468585 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3985d4fa-3ae3-4c5a-86c2-25e4d4079260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:08.488025 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3985d4fa-3ae3-4c5a-86c2-25e4d4079260 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:08.495489 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2931/5843] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:05:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:05:08.496915 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252d647-dbb1-4edc-80f5-a9a51af3ede1 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:08.506192 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344a3d2-e317-42de-bf4c-be9fc0a0b8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:08.506927 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344a3d2-e317-42de-bf4c-be9fc0a0b8f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:08.507244 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344a3d2-e317-42de-bf4c-be9fc0a0b8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:08.507516 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344a3d2-e317-42de-bf4c-be9fc0a0b8f4 admin admin] PATH_INFO: `/v3/projects/9c2901cd59214ec9888bcc63958724e6` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:08.508709 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344a3d2-e317-42de-bf4c-be9fc0a0b8f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c2901cd59214ec9888bcc63958724e6)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:08.510648 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344a3d2-e317-42de-bf4c-be9fc0a0b8f4 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:08.528671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252d647-dbb1-4edc-80f5-a9a51af3ede1 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:08.550375 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d7eef-dd28-419c-9fb5-781d33e7bdf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:08.551011 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d7eef-dd28-419c-9fb5-781d33e7bdf3 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:08.551316 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d7eef-dd28-419c-9fb5-781d33e7bdf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:08.551591 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d7eef-dd28-419c-9fb5-781d33e7bdf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:08.552245 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d7eef-dd28-419c-9fb5-781d33e7bdf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:08.553874 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d7eef-dd28-419c-9fb5-781d33e7bdf3 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:08.637455 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2932/5844] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:08 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:08.648256 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d7eef-dd28-419c-9fb5-781d33e7bdf3 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:08.680748 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d7eef-dd28-419c-9fb5-781d33e7bdf3 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:08.703621 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4344a3d2-e317-42de-bf4c-be9fc0a0b8f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c2901cd59214ec9888bcc63958724e6', 'request_id': 'req-4344a3d2-e317-42de-bf4c-be9fc0a0b8f4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:08.711348 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4344a3d2-e317-42de-bf4c-be9fc0a0b8f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c2901cd59214ec9888bcc63958724e6', 'request_id': 'req-4344a3d2-e317-42de-bf4c-be9fc0a0b8f4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:08.736186 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4344a3d2-e317-42de-bf4c-be9fc0a0b8f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c2901cd59214ec9888bcc63958724e6', 'request_id': 'req-4344a3d2-e317-42de-bf4c-be9fc0a0b8f4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:08.744565 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:08.787981 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4344a3d2-e317-42de-bf4c-be9fc0a0b8f4 admin admin] The token cache is being invalidate because project 9c2901cd59214ec9888bcc63958724e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:08.788280 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4344a3d2-e317-42de-bf4c-be9fc0a0b8f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:08.789878 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4344a3d2-e317-42de-bf4c-be9fc0a0b8f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:08.800604 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2913/5845] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:08 2022] DELETE /identity/v3/projects/9c2901cd59214ec9888bcc63958724e6 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:08.805467 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce6c7b-b607-4ebc-b9cd-a79a347595d9 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:08.805723 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce6c7b-b607-4ebc-b9cd-a79a347595d9 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:08.805940 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce6c7b-b607-4ebc-b9cd-a79a347595d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:08.829859 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-77ce6c7b-b607-4ebc-b9cd-a79a347595d9 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:08.831348 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-77ce6c7b-b607-4ebc-b9cd-a79a347595d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:08.846243 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e84b10b-ecf4-46dd-8660-0bc9905ae468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:08.846980 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84b10b-ecf4-46dd-8660-0bc9905ae468 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:08.847422 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84b10b-ecf4-46dd-8660-0bc9905ae468 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:08.847700 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84b10b-ecf4-46dd-8660-0bc9905ae468 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:08.848359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e84b10b-ecf4-46dd-8660-0bc9905ae468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:08.849986 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e84b10b-ecf4-46dd-8660-0bc9905ae468 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:08.859178 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:08.877504 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2933/5846] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:08 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:08.882476 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e84b10b-ecf4-46dd-8660-0bc9905ae468 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:08.892846 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0e84b10b-ecf4-46dd-8660-0bc9905ae468 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:08.918572 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2914/5847] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:05:08.920413 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10163680-31dd-4aeb-b05e-184b0f5f57e2 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:08.921363 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10163680-31dd-4aeb-b05e-184b0f5f57e2 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:08.922216 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e84b10b-ecf4-46dd-8660-0bc9905ae468 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:08.922642 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10163680-31dd-4aeb-b05e-184b0f5f57e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:08.928676 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ae68c-48ba-4851-854e-c6e94c2dd270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:08.929377 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ae68c-48ba-4851-854e-c6e94c2dd270 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:08.929663 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ae68c-48ba-4851-854e-c6e94c2dd270 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:08.929941 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ae68c-48ba-4851-854e-c6e94c2dd270 admin admin] PATH_INFO: `/v3/projects/d40b7db01bb040efa2586225d09118fb/users/6f2ca1c0ddee4331821edd3905bd1d36/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:08.956414 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ae68c-48ba-4851-854e-c6e94c2dd270 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d40b7db01bb040efa2586225d09118fb, user_id=6f2ca1c0ddee4331821edd3905bd1d36, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:08.959549 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ae68c-48ba-4851-854e-c6e94c2dd270 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:08.971227 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-10163680-31dd-4aeb-b05e-184b0f5f57e2 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:08.974365 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-10163680-31dd-4aeb-b05e-184b0f5f57e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:08.977408 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2934/5848] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:05:08 2022] PUT /identity/v3/projects/d40b7db01bb040efa2586225d09118fb/users/6f2ca1c0ddee4331821edd3905bd1d36/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:05:08.992580 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3201b-268f-4561-b9bc-d08b81a702ee None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:08.992580 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3201b-268f-4561-b9bc-d08b81a702ee None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:08.992823 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3201b-268f-4561-b9bc-d08b81a702ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:09.041727 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-53b3201b-268f-4561-b9bc-d08b81a702ee None None] MFA Rules not processed for user `6f2ca1c0ddee4331821edd3905bd1d36`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:09.043376 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-53b3201b-268f-4561-b9bc-d08b81a702ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:09.098898 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2915/5849] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:09.099950 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10163680-31dd-4aeb-b05e-184b0f5f57e2 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:09.123466 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10163680-31dd-4aeb-b05e-184b0f5f57e2 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:09.135235 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05753371-06a4-46bb-a082-ae4ec65ca0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:09.135871 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05753371-06a4-46bb-a082-ae4ec65ca0c5 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:09.136153 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05753371-06a4-46bb-a082-ae4ec65ca0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:09.136427 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05753371-06a4-46bb-a082-ae4ec65ca0c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:09.141219 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05753371-06a4-46bb-a082-ae4ec65ca0c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:05:09.141553 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05753371-06a4-46bb-a082-ae4ec65ca0c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:09.145565 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05753371-06a4-46bb-a082-ae4ec65ca0c5 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:09.175585 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2916/5850] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:05:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:09.182216 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05753371-06a4-46bb-a082-ae4ec65ca0c5 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:09.212348 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05753371-06a4-46bb-a082-ae4ec65ca0c5 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:09.228439 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf1600-90e4-4437-ae37-0d441a45f7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:09.229077 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf1600-90e4-4437-ae37-0d441a45f7e6 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:09.229360 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf1600-90e4-4437-ae37-0d441a45f7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:09.229634 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf1600-90e4-4437-ae37-0d441a45f7e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:09.230830 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2935/5851] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:05:09.234341 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3201b-268f-4561-b9bc-d08b81a702ee None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:09.234444 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf1600-90e4-4437-ae37-0d441a45f7e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:09.242399 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf1600-90e4-4437-ae37-0d441a45f7e6 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:09.253281 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3201b-268f-4561-b9bc-d08b81a702ee None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:09.260767 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e97951-e81b-4746-891f-7077f1a8c270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:09.270780 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e97951-e81b-4746-891f-7077f1a8c270 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:09.271197 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e97951-e81b-4746-891f-7077f1a8c270 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:09.271479 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e97951-e81b-4746-891f-7077f1a8c270 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:09.272408 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e97951-e81b-4746-891f-7077f1a8c270 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:09.275218 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e97951-e81b-4746-891f-7077f1a8c270 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:09.300814 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2917/5852] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:05:09 2022] POST /identity/v3/projects => generated 377 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:09.304820 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf1600-90e4-4437-ae37-0d441a45f7e6 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:09.365452 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2936/5853] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:05:09 2022] POST /identity/v3/projects => generated 367 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:09.369958 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e97951-e81b-4746-891f-7077f1a8c270 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:09.450462 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf1600-90e4-4437-ae37-0d441a45f7e6 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:09.468361 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:09.495427 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e97951-e81b-4746-891f-7077f1a8c270 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:09.508348 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a46fa2-a225-40c7-9fb6-0a071c122182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:09.508993 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a46fa2-a225-40c7-9fb6-0a071c122182 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:09.509595 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a46fa2-a225-40c7-9fb6-0a071c122182 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:09.509909 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a46fa2-a225-40c7-9fb6-0a071c122182 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:09.510563 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a46fa2-a225-40c7-9fb6-0a071c122182 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:09.512614 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a46fa2-a225-40c7-9fb6-0a071c122182 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:09.570085 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f7349e-2149-49f8-9437-ab6841ee4829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:09.570830 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7349e-2149-49f8-9437-ab6841ee4829 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:09.571330 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7349e-2149-49f8-9437-ab6841ee4829 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:09.571594 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7349e-2149-49f8-9437-ab6841ee4829 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:09.572361 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f7349e-2149-49f8-9437-ab6841ee4829 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:09.582985 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f7349e-2149-49f8-9437-ab6841ee4829 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:09.589737 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2937/5854] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:05:09 2022] POST /identity/v3/users => generated 290 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:09.596787 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a46fa2-a225-40c7-9fb6-0a071c122182 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:09.609972 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a46fa2-a225-40c7-9fb6-0a071c122182 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:09.615828 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0eca25-3ba3-4488-9a69-1bc06ae4b816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:09.617139 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0eca25-3ba3-4488-9a69-1bc06ae4b816 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:09.617573 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0eca25-3ba3-4488-9a69-1bc06ae4b816 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:09.617943 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0eca25-3ba3-4488-9a69-1bc06ae4b816 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:09.618841 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0eca25-3ba3-4488-9a69-1bc06ae4b816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:09.622720 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0eca25-3ba3-4488-9a69-1bc06ae4b816 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:09.638162 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2938/5855] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:09.642203 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2918/5856] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:05:09 2022] POST /identity/v3/users => generated 289 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:09.648536 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f7349e-2149-49f8-9437-ab6841ee4829 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:09.648697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0eca25-3ba3-4488-9a69-1bc06ae4b816 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:09.673673 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f7349e-2149-49f8-9437-ab6841ee4829 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:09.680543 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0eca25-3ba3-4488-9a69-1bc06ae4b816 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:09.680781 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446dd71-96a0-4dc3-8970-0fbbc30e5fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:09.681435 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446dd71-96a0-4dc3-8970-0fbbc30e5fdf admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:09.681717 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446dd71-96a0-4dc3-8970-0fbbc30e5fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:09.683016 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446dd71-96a0-4dc3-8970-0fbbc30e5fdf admin admin] PATH_INFO: `/v3/projects/20a8867eb86a458f8fd38eedd8df157e/users/cf1d74eaf36d4b708f0549f75dd815d8/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:09.718574 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369791e-090d-4783-b9e3-d68062ff727b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:09.719374 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369791e-090d-4783-b9e3-d68062ff727b admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:09.719750 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369791e-090d-4783-b9e3-d68062ff727b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:09.720161 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369791e-090d-4783-b9e3-d68062ff727b admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:09.720838 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8369791e-090d-4783-b9e3-d68062ff727b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:09.722478 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8369791e-090d-4783-b9e3-d68062ff727b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:09.725045 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b446dd71-96a0-4dc3-8970-0fbbc30e5fdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=20a8867eb86a458f8fd38eedd8df157e, user_id=cf1d74eaf36d4b708f0549f75dd815d8, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:09.727783 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b446dd71-96a0-4dc3-8970-0fbbc30e5fdf admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:09.755948 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2919/5857] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:05:09 2022] PUT /identity/v3/projects/20a8867eb86a458f8fd38eedd8df157e/users/cf1d74eaf36d4b708f0549f75dd815d8/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:09.762581 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446dd71-96a0-4dc3-8970-0fbbc30e5fdf admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:09.763047 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2939/5858] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:09.764119 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369791e-090d-4783-b9e3-d68062ff727b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:09.780988 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369791e-090d-4783-b9e3-d68062ff727b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:09.787003 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:09.915135 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba3d16b-9948-42ea-ac73-3cd0873a7c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:09.916742 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3d16b-9948-42ea-ac73-3cd0873a7c80 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:09.917032 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3d16b-9948-42ea-ac73-3cd0873a7c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:09.918880 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3d16b-9948-42ea-ac73-3cd0873a7c80 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:09.920381 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba3d16b-9948-42ea-ac73-3cd0873a7c80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:09.926065 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba3d16b-9948-42ea-ac73-3cd0873a7c80 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:09.928851 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446dd71-96a0-4dc3-8970-0fbbc30e5fdf admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:09.950833 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c6fd36-4bf8-496a-8700-fd1d72188a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:09.951515 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6fd36-4bf8-496a-8700-fd1d72188a59 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:09.951862 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6fd36-4bf8-496a-8700-fd1d72188a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:09.952132 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6fd36-4bf8-496a-8700-fd1d72188a59 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:09.952796 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c6fd36-4bf8-496a-8700-fd1d72188a59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:09.954450 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c6fd36-4bf8-496a-8700-fd1d72188a59 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:09.958023 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2940/5859] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:09.974123 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd1c2e-afdc-4ce6-881a-bdee08c05d9c None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:09.974967 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd1c2e-afdc-4ce6-881a-bdee08c05d9c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:09.976963 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd1c2e-afdc-4ce6-881a-bdee08c05d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:09.979588 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2920/5860] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:05:09.980456 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c6fd36-4bf8-496a-8700-fd1d72188a59 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:10.021439 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c6fd36-4bf8-496a-8700-fd1d72188a59 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:10.034763 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e9852-17fe-4472-952a-cd36c786dde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:10.035663 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e9852-17fe-4472-952a-cd36c786dde4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:10.036128 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e9852-17fe-4472-952a-cd36c786dde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:10.036552 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e9852-17fe-4472-952a-cd36c786dde4 admin admin] PATH_INFO: `/v3/projects/d96213509f4c4c2c96df69ba6a6ac64f/users/8b0d215b8be341709900d7d5edba42af/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:10.048449 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-24dd1c2e-afdc-4ce6-881a-bdee08c05d9c None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:10.049718 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-24dd1c2e-afdc-4ce6-881a-bdee08c05d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:10.073926 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5e9852-17fe-4472-952a-cd36c786dde4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d96213509f4c4c2c96df69ba6a6ac64f, user_id=8b0d215b8be341709900d7d5edba42af, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:10.077872 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5e9852-17fe-4472-952a-cd36c786dde4 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:10.098230 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2921/5861] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:05:09 2022] PUT /identity/v3/projects/d96213509f4c4c2c96df69ba6a6ac64f/users/8b0d215b8be341709900d7d5edba42af/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:10.100785 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e9852-17fe-4472-952a-cd36c786dde4 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:10.229783 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:10.236198 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2941/5862] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 16:05:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:10.250403 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c9044-a53a-4e5c-9297-19c6131a71a3 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:10.250619 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c9044-a53a-4e5c-9297-19c6131a71a3 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:10.253760 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c9044-a53a-4e5c-9297-19c6131a71a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:10.264533 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e9852-17fe-4472-952a-cd36c786dde4 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:10.283039 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e5df7d-148a-49b1-922a-ee50e8980e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:10.283896 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e5df7d-148a-49b1-922a-ee50e8980e32 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:10.284284 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e5df7d-148a-49b1-922a-ee50e8980e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:10.284678 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e5df7d-148a-49b1-922a-ee50e8980e32 admin admin] PATH_INFO: `/v3/projects/20a8867eb86a458f8fd38eedd8df157e/users/cf1d74eaf36d4b708f0549f75dd815d8/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:10.286799 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e5df7d-148a-49b1-922a-ee50e8980e32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20a8867eb86a458f8fd38eedd8df157e, user_id=cf1d74eaf36d4b708f0549f75dd815d8, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:10.289770 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e5df7d-148a-49b1-922a-ee50e8980e32 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:10.316349 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2922/5863] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:05:10 2022] PUT /identity/v3/projects/20a8867eb86a458f8fd38eedd8df157e/users/cf1d74eaf36d4b708f0549f75dd815d8/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:10.326586 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e5df7d-148a-49b1-922a-ee50e8980e32 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:10.328145 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-44e5df7d-148a-49b1-922a-ee50e8980e32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:10.332021 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-127c9044-a53a-4e5c-9297-19c6131a71a3 None None] MFA Rules not processed for user `8b0d215b8be341709900d7d5edba42af`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:10.333671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-127c9044-a53a-4e5c-9297-19c6131a71a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:10.489838 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e5df7d-148a-49b1-922a-ee50e8980e32 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:10.494050 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2942/5864] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:10.496236 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0d7cc-a774-434b-b900-9218d12aefde None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:10.497136 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0d7cc-a774-434b-b900-9218d12aefde None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:10.497593 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0d7cc-a774-434b-b900-9218d12aefde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:10.498932 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964250a3-ed17-47d5-b024-10f9f304e307 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:10.500281 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964250a3-ed17-47d5-b024-10f9f304e307 service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:10.500708 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964250a3-ed17-47d5-b024-10f9f304e307 service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:10.501167 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964250a3-ed17-47d5-b024-10f9f304e307 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:10.556236 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-fae0d7cc-a774-434b-b900-9218d12aefde None None] MFA Rules not processed for user `cf1d74eaf36d4b708f0549f75dd815d8`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:10.560420 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-fae0d7cc-a774-434b-b900-9218d12aefde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:10.597125 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964250a3-ed17-47d5-b024-10f9f304e307 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:10.599425 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964250a3-ed17-47d5-b024-10f9f304e307 service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:10.627390 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2923/5865] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 16:05:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:05:10.630603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964250a3-ed17-47d5-b024-10f9f304e307 service swift] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:10.633059 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-964250a3-ed17-47d5-b024-10f9f304e307 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:10.657217 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:10.758303 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2943/5866] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:10 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:10.759399 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae0d7cc-a774-434b-b900-9218d12aefde None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:10.763116 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-fae0d7cc-a774-434b-b900-9218d12aefde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:10.817236 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964250a3-ed17-47d5-b024-10f9f304e307 service swift] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:10.835170 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5afde-2aa4-4ea5-a1bd-f4f3d0794eac service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6b0f9835ed549cab91d684326be83fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:10.835972 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5afde-2aa4-4ea5-a1bd-f4f3d0794eac service glance] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:10.836358 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5afde-2aa4-4ea5-a1bd-f4f3d0794eac service glance] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:10.836738 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5afde-2aa4-4ea5-a1bd-f4f3d0794eac service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:10.865016 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e5afde-2aa4-4ea5-a1bd-f4f3d0794eac service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:10.869192 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e5afde-2aa4-4ea5-a1bd-f4f3d0794eac service glance] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:10.906725 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2924/5867] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:05:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:05:10.911570 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5afde-2aa4-4ea5-a1bd-f4f3d0794eac service glance] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:10.953010 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5afde-2aa4-4ea5-a1bd-f4f3d0794eac service glance] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:10.970863 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b4062-46ca-442d-a26e-c6c59c7e805b tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf1d74eaf36d4b708f0549f75dd815d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20a8867eb86a458f8fd38eedd8df157e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:10.977594 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b4062-46ca-442d-a26e-c6c59c7e805b tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:10.977594 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b4062-46ca-442d-a26e-c6c59c7e805b tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:10.977594 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b4062-46ca-442d-a26e-c6c59c7e805b tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:10.980889 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b4062-46ca-442d-a26e-c6c59c7e805b tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:10.982813 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b4062-46ca-442d-a26e-c6c59c7e805b tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:10.994541 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae0d7cc-a774-434b-b900-9218d12aefde None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:11.014896 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9efa59c-eea8-418a-84e0-4223a7090445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:11.015131 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:11.015932 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efa59c-eea8-418a-84e0-4223a7090445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:11.019553 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efa59c-eea8-418a-84e0-4223a7090445 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:11.020679 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efa59c-eea8-418a-84e0-4223a7090445 admin admin] PATH_INFO: `/v3/users/777c9c05811146d494e241711b930744` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:11.027173 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9efa59c-eea8-418a-84e0-4223a7090445 admin admin] RBAC: Authorizing `identity:delete_user(user_id=777c9c05811146d494e241711b930744)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:11.029952 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9efa59c-eea8-418a-84e0-4223a7090445 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:11.037083 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2925/5868] 10.222.0.83 () {60 vars in 1149 bytes} [Mon Aug 29 16:05:10 2022] POST /identity/v3/domains => generated 277 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:11.039195 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b4062-46ca-442d-a26e-c6c59c7e805b tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:11.207929 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f9efa59c-eea8-418a-84e0-4223a7090445 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '777c9c05811146d494e241711b930744'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:11.210044 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f9efa59c-eea8-418a-84e0-4223a7090445 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '777c9c05811146d494e241711b930744'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:11.232447 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f9efa59c-eea8-418a-84e0-4223a7090445 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '777c9c05811146d494e241711b930744'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:11.244270 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f9efa59c-eea8-418a-84e0-4223a7090445 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '777c9c05811146d494e241711b930744'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:11.245250 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f9efa59c-eea8-418a-84e0-4223a7090445 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '777c9c05811146d494e241711b930744'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:11.270521 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2944/5869] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:05:10 2022] DELETE /identity/v3/users/777c9c05811146d494e241711b930744 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:11.276099 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7212983-67d5-442d-9757-1a328335cbad None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:11.276602 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7212983-67d5-442d-9757-1a328335cbad None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:11.276986 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7212983-67d5-442d-9757-1a328335cbad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:11.297427 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b4062-46ca-442d-a26e-c6c59c7e805b tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:11.326706 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-c7212983-67d5-442d-9757-1a328335cbad None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:11.329003 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c7212983-67d5-442d-9757-1a328335cbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:11.389954 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:11.409278 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7029e45-7ffc-4c25-b213-349a02e07c90 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf1d74eaf36d4b708f0549f75dd815d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20a8867eb86a458f8fd38eedd8df157e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:11.409934 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7029e45-7ffc-4c25-b213-349a02e07c90 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:11.410324 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7029e45-7ffc-4c25-b213-349a02e07c90 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:11.410564 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7029e45-7ffc-4c25-b213-349a02e07c90 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:11.411971 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7029e45-7ffc-4c25-b213-349a02e07c90 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:11.417191 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7029e45-7ffc-4c25-b213-349a02e07c90 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:11.434917 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2945/5870] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:11.442550 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7212983-67d5-442d-9757-1a328335cbad None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:11.444316 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c7212983-67d5-442d-9757-1a328335cbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:11.494253 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2926/5871] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:05:11 2022] POST /identity/v3/users => generated 348 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:11.499333 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7029e45-7ffc-4c25-b213-349a02e07c90 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:11.508192 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b7029e45-7ffc-4c25-b213-349a02e07c90 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:11.558474 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7029e45-7ffc-4c25-b213-349a02e07c90 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:11.576434 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e4c2e1-ea42-42fe-affc-26eeaff09d44 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf1d74eaf36d4b708f0549f75dd815d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20a8867eb86a458f8fd38eedd8df157e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:11.580628 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e4c2e1-ea42-42fe-affc-26eeaff09d44 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:11.581679 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e4c2e1-ea42-42fe-affc-26eeaff09d44 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:11.582381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e4c2e1-ea42-42fe-affc-26eeaff09d44 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:11.583811 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e4c2e1-ea42-42fe-affc-26eeaff09d44 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:11.593511 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e4c2e1-ea42-42fe-affc-26eeaff09d44 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:11.641973 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7212983-67d5-442d-9757-1a328335cbad None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:11.660053 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb96017-4002-4ace-84a2-be0f517c51ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:11.663255 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb96017-4002-4ace-84a2-be0f517c51ec service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:11.663584 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb96017-4002-4ace-84a2-be0f517c51ec service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:11.663859 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb96017-4002-4ace-84a2-be0f517c51ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:11.682919 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2927/5872] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:05:11 2022] POST /identity/v3/users => generated 324 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:11.690823 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e4c2e1-ea42-42fe-affc-26eeaff09d44 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:11.701143 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb96017-4002-4ace-84a2-be0f517c51ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:11.707332 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb96017-4002-4ace-84a2-be0f517c51ec service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:11.725647 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e4c2e1-ea42-42fe-affc-26eeaff09d44 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:11.740764 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6cf827-7ff7-4148-a581-0f06e49fd276 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf1d74eaf36d4b708f0549f75dd815d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20a8867eb86a458f8fd38eedd8df157e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:11.741461 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6cf827-7ff7-4148-a581-0f06e49fd276 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:11.741769 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6cf827-7ff7-4148-a581-0f06e49fd276 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:11.742061 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6cf827-7ff7-4148-a581-0f06e49fd276 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] PATH_INFO: `/v3/users/7af47c26c34a42b3a4b4a5de58345e2f` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:11.747793 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2946/5873] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:05:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:05:11.785611 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6cf827-7ff7-4148-a581-0f06e49fd276 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] RBAC: Authorizing `identity:get_user(user_id=7af47c26c34a42b3a4b4a5de58345e2f)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:11.787936 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6cf827-7ff7-4148-a581-0f06e49fd276 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:11.793829 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2928/5874] 10.222.0.83 () {58 vars in 1221 bytes} [Mon Aug 29 16:05:11 2022] GET /identity/v3/users/7af47c26c34a42b3a4b4a5de58345e2f => generated 348 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:11.796956 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb96017-4002-4ace-84a2-be0f517c51ec service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:11.816211 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb96017-4002-4ace-84a2-be0f517c51ec service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:11.825243 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27163b6-28ec-40fb-80ef-a84198d5911f tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf1d74eaf36d4b708f0549f75dd815d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20a8867eb86a458f8fd38eedd8df157e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:11.825882 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27163b6-28ec-40fb-80ef-a84198d5911f tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:11.827317 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27163b6-28ec-40fb-80ef-a84198d5911f tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:11.827582 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27163b6-28ec-40fb-80ef-a84198d5911f tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:11.828318 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27163b6-28ec-40fb-80ef-a84198d5911f tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] RBAC: Adding query filter params (domain_id=d52e29f429bd45b9aa7564786d0b78f9) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:05:11.828627 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27163b6-28ec-40fb-80ef-a84198d5911f tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:11.829658 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-f27163b6-28ec-40fb-80ef-a84198d5911f tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:05:11.829658 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 16:05:11.829658 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 16:05:11.830836 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27163b6-28ec-40fb-80ef-a84198d5911f tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:11.864979 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2947/5875] 10.222.0.83 () {58 vars in 1207 bytes} [Mon Aug 29 16:05:11 2022] GET /identity/v3/users?domain_id=d52e29f429bd45b9aa7564786d0b78f9 => generated 485 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:11.870262 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6cf827-7ff7-4148-a581-0f06e49fd276 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:11.886646 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6cf827-7ff7-4148-a581-0f06e49fd276 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:11.895878 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c47a4d-9e3a-438a-b4db-04dd5df91f27 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf1d74eaf36d4b708f0549f75dd815d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20a8867eb86a458f8fd38eedd8df157e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:11.896555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c47a4d-9e3a-438a-b4db-04dd5df91f27 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:11.898531 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c47a4d-9e3a-438a-b4db-04dd5df91f27 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:11.898822 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c47a4d-9e3a-438a-b4db-04dd5df91f27 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:11.901770 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c47a4d-9e3a-438a-b4db-04dd5df91f27 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:11.905229 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-72c47a4d-9e3a-438a-b4db-04dd5df91f27 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:05:11.905229 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 16:05:11.905229 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 16:05:11.906967 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c47a4d-9e3a-438a-b4db-04dd5df91f27 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:12.000073 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27163b6-28ec-40fb-80ef-a84198d5911f tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:12.021233 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2929/5876] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:11 2022] GET /identity/v3/users => generated 8323 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:12.023500 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27163b6-28ec-40fb-80ef-a84198d5911f tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:12.043815 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b969ac-45ef-42b4-bb9d-9fc76c3c36e0 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf1d74eaf36d4b708f0549f75dd815d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20a8867eb86a458f8fd38eedd8df157e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:12.044501 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b969ac-45ef-42b4-bb9d-9fc76c3c36e0 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:12.044806 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b969ac-45ef-42b4-bb9d-9fc76c3c36e0 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:12.045107 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b969ac-45ef-42b4-bb9d-9fc76c3c36e0 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:12.045870 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b969ac-45ef-42b4-bb9d-9fc76c3c36e0 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] RBAC: Adding query filter params (name=tempest-test_user-1942505060) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:05:12.046183 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b969ac-45ef-42b4-bb9d-9fc76c3c36e0 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:12.048224 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b969ac-45ef-42b4-bb9d-9fc76c3c36e0 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:12.093526 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c47a4d-9e3a-438a-b4db-04dd5df91f27 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:12.100656 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2948/5877] 10.222.0.83 () {58 vars in 1189 bytes} [Mon Aug 29 16:05:11 2022] GET /identity/v3/users?name=tempest-test_user-1942505060 => generated 476 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:12.121951 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c47a4d-9e3a-438a-b4db-04dd5df91f27 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:12.134722 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a1306-c95a-4cc0-b313-acd2fa5d567e tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf1d74eaf36d4b708f0549f75dd815d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20a8867eb86a458f8fd38eedd8df157e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:12.135495 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a1306-c95a-4cc0-b313-acd2fa5d567e tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:12.136466 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a1306-c95a-4cc0-b313-acd2fa5d567e tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:12.136827 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a1306-c95a-4cc0-b313-acd2fa5d567e tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:12.137636 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9a1306-c95a-4cc0-b313-acd2fa5d567e tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:05:12.138477 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9a1306-c95a-4cc0-b313-acd2fa5d567e tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:12.145967 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9a1306-c95a-4cc0-b313-acd2fa5d567e tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:12.214846 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b969ac-45ef-42b4-bb9d-9fc76c3c36e0 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:12.224482 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2930/5878] 10.222.0.83 () {58 vars in 1149 bytes} [Mon Aug 29 16:05:12 2022] GET /identity/v3/users?enabled=False => generated 432 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:05:12.231788 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b969ac-45ef-42b4-bb9d-9fc76c3c36e0 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:12.263193 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca4966-74ec-4c2d-9b22-eaa4201724c6 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf1d74eaf36d4b708f0549f75dd815d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20a8867eb86a458f8fd38eedd8df157e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:12.264243 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca4966-74ec-4c2d-9b22-eaa4201724c6 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:12.265156 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca4966-74ec-4c2d-9b22-eaa4201724c6 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:12.265575 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca4966-74ec-4c2d-9b22-eaa4201724c6 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] PATH_INFO: `/v3/users/05e01b400b6d4485bed90ad81d1a997b` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:12.321489 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a1306-c95a-4cc0-b313-acd2fa5d567e tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:12.323850 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ea9a1306-c95a-4cc0-b313-acd2fa5d567e tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:12.358879 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca4966-74ec-4c2d-9b22-eaa4201724c6 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] RBAC: Authorizing `identity:delete_user(user_id=05e01b400b6d4485bed90ad81d1a997b)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:12.366179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca4966-74ec-4c2d-9b22-eaa4201724c6 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:12.377636 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a1306-c95a-4cc0-b313-acd2fa5d567e tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:12.410959 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679488b4-870f-4d55-b824-b6897a6f1b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:12.413436 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679488b4-870f-4d55-b824-b6897a6f1b8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:12.419550 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679488b4-870f-4d55-b824-b6897a6f1b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:12.419992 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679488b4-870f-4d55-b824-b6897a6f1b8e admin admin] PATH_INFO: `/v3/projects/3e8c5cfbfa934212b352cde91b8756d3` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:12.422509 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679488b4-870f-4d55-b824-b6897a6f1b8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e8c5cfbfa934212b352cde91b8756d3)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:12.430340 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679488b4-870f-4d55-b824-b6897a6f1b8e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:12.593096 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:DELETE=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:12.596164 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-deca4966-74ec-4c2d-9b22-eaa4201724c6 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05e01b400b6d4485bed90ad81d1a997b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:12.598768 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-deca4966-74ec-4c2d-9b22-eaa4201724c6 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05e01b400b6d4485bed90ad81d1a997b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:12.626160 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-deca4966-74ec-4c2d-9b22-eaa4201724c6 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05e01b400b6d4485bed90ad81d1a997b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:12.657204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-deca4966-74ec-4c2d-9b22-eaa4201724c6 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05e01b400b6d4485bed90ad81d1a997b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:12.666527 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-deca4966-74ec-4c2d-9b22-eaa4201724c6 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05e01b400b6d4485bed90ad81d1a997b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:12.676885 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-679488b4-870f-4d55-b824-b6897a6f1b8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e8c5cfbfa934212b352cde91b8756d3', 'request_id': 'req-679488b4-870f-4d55-b824-b6897a6f1b8e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:12.707623 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-679488b4-870f-4d55-b824-b6897a6f1b8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e8c5cfbfa934212b352cde91b8756d3', 'request_id': 'req-679488b4-870f-4d55-b824-b6897a6f1b8e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:12.727708 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-679488b4-870f-4d55-b824-b6897a6f1b8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e8c5cfbfa934212b352cde91b8756d3', 'request_id': 'req-679488b4-870f-4d55-b824-b6897a6f1b8e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:12.741206 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2949/5879] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:05:12 2022] DELETE /identity/v3/users/05e01b400b6d4485bed90ad81d1a997b => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:12.742680 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca4966-74ec-4c2d-9b22-eaa4201724c6 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:12.744632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-deca4966-74ec-4c2d-9b22-eaa4201724c6 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:12.762667 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-679488b4-870f-4d55-b824-b6897a6f1b8e admin admin] The token cache is being invalidate because project 3e8c5cfbfa934212b352cde91b8756d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:12.762992 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-679488b4-870f-4d55-b824-b6897a6f1b8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:12.765757 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-679488b4-870f-4d55-b824-b6897a6f1b8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:12.771654 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2931/5880] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:12 2022] DELETE /identity/v3/projects/3e8c5cfbfa934212b352cde91b8756d3 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:12.786758 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e7cc5-2e3a-40df-9c0b-bc845d9f532a None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:12.787123 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e7cc5-2e3a-40df-9c0b-bc845d9f532a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:12.787476 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e7cc5-2e3a-40df-9c0b-bc845d9f532a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:12.847742 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:12.856243 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-466e7cc5-2e3a-40df-9c0b-bc845d9f532a None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:12.857917 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-466e7cc5-2e3a-40df-9c0b-bc845d9f532a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:12.970265 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca4966-74ec-4c2d-9b22-eaa4201724c6 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:12.984607 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2dd93-3d5e-4f2a-b1f0-28e8a6757e8b tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf1d74eaf36d4b708f0549f75dd815d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20a8867eb86a458f8fd38eedd8df157e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:12.985938 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2dd93-3d5e-4f2a-b1f0-28e8a6757e8b tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:12.987208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2dd93-3d5e-4f2a-b1f0-28e8a6757e8b tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:12.987730 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2dd93-3d5e-4f2a-b1f0-28e8a6757e8b tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] PATH_INFO: `/v3/users/7af47c26c34a42b3a4b4a5de58345e2f` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:12.995463 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc2dd93-3d5e-4f2a-b1f0-28e8a6757e8b tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7af47c26c34a42b3a4b4a5de58345e2f)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:13.011724 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc2dd93-3d5e-4f2a-b1f0-28e8a6757e8b tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:13.070347 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2932/5881] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:13.075054 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60692a20-7efa-43ef-817f-713ede6c9731 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:13.075557 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60692a20-7efa-43ef-817f-713ede6c9731 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:13.076036 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60692a20-7efa-43ef-817f-713ede6c9731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:13.102630 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-60692a20-7efa-43ef-817f-713ede6c9731 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:13.104161 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-60692a20-7efa-43ef-817f-713ede6c9731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:13.117293 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2933/5882] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:13.121212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60692a20-7efa-43ef-817f-713ede6c9731 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:13.135410 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60692a20-7efa-43ef-817f-713ede6c9731 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:13.144988 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0bfa34-05bb-47ec-8e18-5da27facb8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:13.145992 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0bfa34-05bb-47ec-8e18-5da27facb8da admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:13.146657 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0bfa34-05bb-47ec-8e18-5da27facb8da admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:13.147299 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0bfa34-05bb-47ec-8e18-5da27facb8da admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:13.148224 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0bfa34-05bb-47ec-8e18-5da27facb8da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:05:13.148737 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0bfa34-05bb-47ec-8e18-5da27facb8da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:13.151201 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0bfa34-05bb-47ec-8e18-5da27facb8da admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:13.185820 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2934/5883] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:05:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:13.189788 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0bfa34-05bb-47ec-8e18-5da27facb8da admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:13.191947 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0fc2dd93-3d5e-4f2a-b1f0-28e8a6757e8b tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7af47c26c34a42b3a4b4a5de58345e2f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:13.192646 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0fc2dd93-3d5e-4f2a-b1f0-28e8a6757e8b tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7af47c26c34a42b3a4b4a5de58345e2f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:13.212039 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0bfa34-05bb-47ec-8e18-5da27facb8da admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:13.224714 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ddfea-b9ef-43f0-a97e-011fb7dd86cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:13.226138 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ddfea-b9ef-43f0-a97e-011fb7dd86cc admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:13.227080 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0fc2dd93-3d5e-4f2a-b1f0-28e8a6757e8b tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7af47c26c34a42b3a4b4a5de58345e2f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:13.227963 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ddfea-b9ef-43f0-a97e-011fb7dd86cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:13.229017 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ddfea-b9ef-43f0-a97e-011fb7dd86cc admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:13.230527 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0ddfea-b9ef-43f0-a97e-011fb7dd86cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:13.236448 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0ddfea-b9ef-43f0-a97e-011fb7dd86cc admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:13.265907 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0fc2dd93-3d5e-4f2a-b1f0-28e8a6757e8b tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7af47c26c34a42b3a4b4a5de58345e2f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:13.267179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0fc2dd93-3d5e-4f2a-b1f0-28e8a6757e8b tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7af47c26c34a42b3a4b4a5de58345e2f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:13.294259 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2935/5884] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:05:13 2022] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:13.296157 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ddfea-b9ef-43f0-a97e-011fb7dd86cc admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:13.299559 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0b0ddfea-b9ef-43f0-a97e-011fb7dd86cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:13.324253 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2950/5885] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:05:12 2022] DELETE /identity/v3/users/7af47c26c34a42b3a4b4a5de58345e2f => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:13.328860 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2dd93-3d5e-4f2a-b1f0-28e8a6757e8b tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:13.331893 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0fc2dd93-3d5e-4f2a-b1f0-28e8a6757e8b tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:13.413710 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ddfea-b9ef-43f0-a97e-011fb7dd86cc admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:13.445965 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:13.490873 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2dd93-3d5e-4f2a-b1f0-28e8a6757e8b tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:13.517307 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fac6851-020f-4f91-8831-a7c3bd984ddf tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf1d74eaf36d4b708f0549f75dd815d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20a8867eb86a458f8fd38eedd8df157e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:13.518067 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac6851-020f-4f91-8831-a7c3bd984ddf tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:13.518356 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac6851-020f-4f91-8831-a7c3bd984ddf tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:13.518632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac6851-020f-4f91-8831-a7c3bd984ddf tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] PATH_INFO: `/v3/domains/d52e29f429bd45b9aa7564786d0b78f9` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:13.522951 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fac6851-020f-4f91-8831-a7c3bd984ddf tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d52e29f429bd45b9aa7564786d0b78f9)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:13.526409 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fac6851-020f-4f91-8831-a7c3bd984ddf tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:13.547092 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d609309-2630-433a-a964-404a0a0cb5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:13.547755 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d609309-2630-433a-a964-404a0a0cb5c2 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:13.550541 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d609309-2630-433a-a964-404a0a0cb5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:13.550851 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d609309-2630-433a-a964-404a0a0cb5c2 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:13.551564 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d609309-2630-433a-a964-404a0a0cb5c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:13.553547 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d609309-2630-433a-a964-404a0a0cb5c2 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:13.599997 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2936/5886] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:05:13 2022] POST /identity/v3/users => generated 290 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:13.607911 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d609309-2630-433a-a964-404a0a0cb5c2 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:13.613393 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1fac6851-020f-4f91-8831-a7c3bd984ddf tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd52e29f429bd45b9aa7564786d0b78f9'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:13.614166 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1fac6851-020f-4f91-8831-a7c3bd984ddf tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd52e29f429bd45b9aa7564786d0b78f9'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:13.624709 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d609309-2630-433a-a964-404a0a0cb5c2 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:13.679925 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1fac6851-020f-4f91-8831-a7c3bd984ddf tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd52e29f429bd45b9aa7564786d0b78f9'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:13.680959 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1fac6851-020f-4f91-8831-a7c3bd984ddf tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd52e29f429bd45b9aa7564786d0b78f9'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:13.693303 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2951/5887] 10.222.0.83 () {60 vars in 1249 bytes} [Mon Aug 29 16:05:13 2022] PATCH /identity/v3/domains/d52e29f429bd45b9aa7564786d0b78f9 => generated 278 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:13.696211 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fac6851-020f-4f91-8831-a7c3bd984ddf tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:13.700541 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1fac6851-020f-4f91-8831-a7c3bd984ddf tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:13.721142 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:13.826796 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af25b6-9588-4f96-aa40-417348e05045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:13.830323 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af25b6-9588-4f96-aa40-417348e05045 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:13.830620 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af25b6-9588-4f96-aa40-417348e05045 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:13.830957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af25b6-9588-4f96-aa40-417348e05045 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:13.832481 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af25b6-9588-4f96-aa40-417348e05045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:13.836634 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af25b6-9588-4f96-aa40-417348e05045 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:13.866729 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2937/5888] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:13.870668 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af25b6-9588-4f96-aa40-417348e05045 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:13.878307 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-21af25b6-9588-4f96-aa40-417348e05045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:13.880788 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fac6851-020f-4f91-8831-a7c3bd984ddf tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:13.886350 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44787809-1b18-49b1-9896-80854956aa28 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf1d74eaf36d4b708f0549f75dd815d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20a8867eb86a458f8fd38eedd8df157e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:13.887202 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44787809-1b18-49b1-9896-80854956aa28 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:13.887486 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44787809-1b18-49b1-9896-80854956aa28 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:13.887800 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44787809-1b18-49b1-9896-80854956aa28 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] PATH_INFO: `/v3/domains/d52e29f429bd45b9aa7564786d0b78f9` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:13.918333 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af25b6-9588-4f96-aa40-417348e05045 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:13.928631 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44787809-1b18-49b1-9896-80854956aa28 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d52e29f429bd45b9aa7564786d0b78f9)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:13.930598 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44787809-1b18-49b1-9896-80854956aa28 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:13.933787 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe0190-33a6-4fcb-acfd-c9d10920dd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:13.934402 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe0190-33a6-4fcb-acfd-c9d10920dd13 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:13.938044 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe0190-33a6-4fcb-acfd-c9d10920dd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:13.938875 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe0190-33a6-4fcb-acfd-c9d10920dd13 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:13.939823 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe0190-33a6-4fcb-acfd-c9d10920dd13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:13.942917 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe0190-33a6-4fcb-acfd-c9d10920dd13 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:13.956836 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2938/5889] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:05:13.962289 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe0190-33a6-4fcb-acfd-c9d10920dd13 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:13.984049 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-44787809-1b18-49b1-9896-80854956aa28 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd52e29f429bd45b9aa7564786d0b78f9'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:13.987150 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe0190-33a6-4fcb-acfd-c9d10920dd13 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:14.007918 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531ff6b-e112-4568-957c-125cb9ead59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:14.008654 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531ff6b-e112-4568-957c-125cb9ead59d admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:14.008940 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531ff6b-e112-4568-957c-125cb9ead59d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:14.009226 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531ff6b-e112-4568-957c-125cb9ead59d admin admin] PATH_INFO: `/v3/projects/105cb7d68fca4c11acbfa7e09ff1e407/users/f7ff012e4cfe421b9036891c88341cbc/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:14.029175 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-44787809-1b18-49b1-9896-80854956aa28 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd52e29f429bd45b9aa7564786d0b78f9'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:14.053640 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4531ff6b-e112-4568-957c-125cb9ead59d admin admin] RBAC: Authorizing `identity:create_grant(project_id=105cb7d68fca4c11acbfa7e09ff1e407, user_id=f7ff012e4cfe421b9036891c88341cbc, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:14.060641 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4531ff6b-e112-4568-957c-125cb9ead59d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:14.103657 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2939/5890] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:05:13 2022] PUT /identity/v3/projects/105cb7d68fca4c11acbfa7e09ff1e407/users/f7ff012e4cfe421b9036891c88341cbc/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:14.107413 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68250940-bb64-479a-8b00-64609228b316 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:14.107706 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68250940-bb64-479a-8b00-64609228b316 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:14.109028 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68250940-bb64-479a-8b00-64609228b316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:14.173512 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-44787809-1b18-49b1-9896-80854956aa28 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd52e29f429bd45b9aa7564786d0b78f9', 'request_id': 'req-44787809-1b18-49b1-9896-80854956aa28'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:14.178612 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-68250940-bb64-479a-8b00-64609228b316 None None] MFA Rules not processed for user `f7ff012e4cfe421b9036891c88341cbc`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:14.180414 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-68250940-bb64-479a-8b00-64609228b316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:14.188466 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-44787809-1b18-49b1-9896-80854956aa28 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd52e29f429bd45b9aa7564786d0b78f9', 'request_id': 'req-44787809-1b18-49b1-9896-80854956aa28'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:14.226192 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-44787809-1b18-49b1-9896-80854956aa28 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd52e29f429bd45b9aa7564786d0b78f9', 'request_id': 'req-44787809-1b18-49b1-9896-80854956aa28'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:14.263226 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-44787809-1b18-49b1-9896-80854956aa28 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] The token cache is being invalidate because project d52e29f429bd45b9aa7564786d0b78f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:14.264770 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-44787809-1b18-49b1-9896-80854956aa28 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:14.268584 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-44787809-1b18-49b1-9896-80854956aa28 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:14.306022 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-44787809-1b18-49b1-9896-80854956aa28 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd52e29f429bd45b9aa7564786d0b78f9', 'request_id': 'req-44787809-1b18-49b1-9896-80854956aa28'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:14.306022 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-44787809-1b18-49b1-9896-80854956aa28 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd52e29f429bd45b9aa7564786d0b78f9', 'request_id': 'req-44787809-1b18-49b1-9896-80854956aa28'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:14.306022 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-44787809-1b18-49b1-9896-80854956aa28 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd52e29f429bd45b9aa7564786d0b78f9', 'request_id': 'req-44787809-1b18-49b1-9896-80854956aa28'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:14.342871 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2952/5891] 10.222.0.83 () {58 vars in 1230 bytes} [Mon Aug 29 16:05:13 2022] DELETE /identity/v3/domains/d52e29f429bd45b9aa7564786d0b78f9 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:14.347213 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44787809-1b18-49b1-9896-80854956aa28 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:14.352469 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-44787809-1b18-49b1-9896-80854956aa28 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:14.391203 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2940/5892] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:14.404281 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68250940-bb64-479a-8b00-64609228b316 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:14.407075 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-68250940-bb64-479a-8b00-64609228b316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:14.412771 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:14.513937 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:14.569322 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44787809-1b18-49b1-9896-80854956aa28 tempest-UsersV3TestJSON-1195019466 tempest-UsersV3TestJSON-1195019466-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:14.569541 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68250940-bb64-479a-8b00-64609228b316 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:14.573658 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace834eb-7c61-4b8c-a156-2f730f55b5c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:14.574487 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace834eb-7c61-4b8c-a156-2f730f55b5c2 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:14.574862 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace834eb-7c61-4b8c-a156-2f730f55b5c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:14.575437 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace834eb-7c61-4b8c-a156-2f730f55b5c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:14.585815 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99759eeb-607d-4b82-88f5-f046121b3a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:14.585815 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99759eeb-607d-4b82-88f5-f046121b3a66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:14.585815 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99759eeb-607d-4b82-88f5-f046121b3a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:14.585815 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99759eeb-607d-4b82-88f5-f046121b3a66 admin admin] PATH_INFO: `/v3/users/6f2ca1c0ddee4331821edd3905bd1d36` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:14.587639 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace834eb-7c61-4b8c-a156-2f730f55b5c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:14.589224 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace834eb-7c61-4b8c-a156-2f730f55b5c2 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:14.592170 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99759eeb-607d-4b82-88f5-f046121b3a66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f2ca1c0ddee4331821edd3905bd1d36)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:14.601161 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99759eeb-607d-4b82-88f5-f046121b3a66 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:14.603819 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2941/5893] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:05:14 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:05:14.625375 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace834eb-7c61-4b8c-a156-2f730f55b5c2 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:14.628285 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ace834eb-7c61-4b8c-a156-2f730f55b5c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:14.646667 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace834eb-7c61-4b8c-a156-2f730f55b5c2 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:14.651907 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437eaa87-c489-4500-8c96-2a0bad1d3f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:14.652863 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437eaa87-c489-4500-8c96-2a0bad1d3f05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:14.653377 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437eaa87-c489-4500-8c96-2a0bad1d3f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:14.653767 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437eaa87-c489-4500-8c96-2a0bad1d3f05 admin admin] PATH_INFO: `/v3/users/f7ff012e4cfe421b9036891c88341cbc` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:14.655728 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437eaa87-c489-4500-8c96-2a0bad1d3f05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7ff012e4cfe421b9036891c88341cbc)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:14.658443 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437eaa87-c489-4500-8c96-2a0bad1d3f05 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:14.755503 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-99759eeb-607d-4b82-88f5-f046121b3a66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f2ca1c0ddee4331821edd3905bd1d36'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:14.756819 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-99759eeb-607d-4b82-88f5-f046121b3a66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f2ca1c0ddee4331821edd3905bd1d36'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:14.779460 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-99759eeb-607d-4b82-88f5-f046121b3a66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f2ca1c0ddee4331821edd3905bd1d36'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:14.782511 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-437eaa87-c489-4500-8c96-2a0bad1d3f05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7ff012e4cfe421b9036891c88341cbc'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:14.784368 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-437eaa87-c489-4500-8c96-2a0bad1d3f05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7ff012e4cfe421b9036891c88341cbc'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:14.801672 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-99759eeb-607d-4b82-88f5-f046121b3a66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f2ca1c0ddee4331821edd3905bd1d36'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:14.802724 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-99759eeb-607d-4b82-88f5-f046121b3a66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f2ca1c0ddee4331821edd3905bd1d36'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:14.813667 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-437eaa87-c489-4500-8c96-2a0bad1d3f05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7ff012e4cfe421b9036891c88341cbc'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:14.833171 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-437eaa87-c489-4500-8c96-2a0bad1d3f05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7ff012e4cfe421b9036891c88341cbc'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:14.845677 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-437eaa87-c489-4500-8c96-2a0bad1d3f05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7ff012e4cfe421b9036891c88341cbc'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:14.847351 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2953/5894] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:05:14 2022] DELETE /identity/v3/users/6f2ca1c0ddee4331821edd3905bd1d36 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:14.851771 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c63b3-84b6-44a6-8865-c7eb9fd42827 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:14.852204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c63b3-84b6-44a6-8865-c7eb9fd42827 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:14.852592 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c63b3-84b6-44a6-8865-c7eb9fd42827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:14.855068 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2942/5895] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:05:14 2022] DELETE /identity/v3/users/f7ff012e4cfe421b9036891c88341cbc => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:05:14.862204 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ac947-f472-40b3-a33f-20b05f1a402a None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:14.862836 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ac947-f472-40b3-a33f-20b05f1a402a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:14.868337 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ac947-f472-40b3-a33f-20b05f1a402a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:14.904456 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-f02ac947-f472-40b3-a33f-20b05f1a402a None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:14.906371 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f02ac947-f472-40b3-a33f-20b05f1a402a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:14.917483 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-502c63b3-84b6-44a6-8865-c7eb9fd42827 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:14.927116 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-502c63b3-84b6-44a6-8865-c7eb9fd42827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:15.067527 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2943/5896] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:05:15.079128 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ac947-f472-40b3-a33f-20b05f1a402a None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:15.080998 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f02ac947-f472-40b3-a33f-20b05f1a402a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:15.086396 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2954/5897] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:15.102583 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c63b3-84b6-44a6-8865-c7eb9fd42827 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:15.107802 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-502c63b3-84b6-44a6-8865-c7eb9fd42827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:15.147298 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:15.272058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ac947-f472-40b3-a33f-20b05f1a402a None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:15.276998 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142f6b0-1c50-425b-ac04-91031dc73b4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:15.277871 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142f6b0-1c50-425b-ac04-91031dc73b4c service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:15.278311 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142f6b0-1c50-425b-ac04-91031dc73b4c service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:15.278999 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142f6b0-1c50-425b-ac04-91031dc73b4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:15.294399 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4142f6b0-1c50-425b-ac04-91031dc73b4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:15.297152 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4142f6b0-1c50-425b-ac04-91031dc73b4c service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:15.304530 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c63b3-84b6-44a6-8865-c7eb9fd42827 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:15.316912 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2944/5898] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:05:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:05:15.320389 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c85cd2-5b19-4cf4-951a-abf6ef2c558b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:15.323639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c85cd2-5b19-4cf4-951a-abf6ef2c558b service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:15.324357 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c85cd2-5b19-4cf4-951a-abf6ef2c558b service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:15.325160 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c85cd2-5b19-4cf4-951a-abf6ef2c558b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:15.341944 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c85cd2-5b19-4cf4-951a-abf6ef2c558b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:15.345045 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c85cd2-5b19-4cf4-951a-abf6ef2c558b service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:15.368567 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2955/5899] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:05:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:05:16.198235 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142f6b0-1c50-425b-ac04-91031dc73b4c service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:16.199962 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4142f6b0-1c50-425b-ac04-91031dc73b4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:16.241709 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142f6b0-1c50-425b-ac04-91031dc73b4c service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:16.253151 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed42fab2-721d-49d6-b289-8e969a8bd5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:16.257255 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42fab2-721d-49d6-b289-8e969a8bd5fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:16.257556 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42fab2-721d-49d6-b289-8e969a8bd5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:16.257830 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42fab2-721d-49d6-b289-8e969a8bd5fc admin admin] PATH_INFO: `/v3/projects/d40b7db01bb040efa2586225d09118fb` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:16.259911 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed42fab2-721d-49d6-b289-8e969a8bd5fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d40b7db01bb040efa2586225d09118fb)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:16.261982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed42fab2-721d-49d6-b289-8e969a8bd5fc admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:16.282289 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c85cd2-5b19-4cf4-951a-abf6ef2c558b service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:16.284182 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-01c85cd2-5b19-4cf4-951a-abf6ef2c558b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:16.334214 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c85cd2-5b19-4cf4-951a-abf6ef2c558b service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:16.349906 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe2806-0986-4f52-a9a2-42e0e2769c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:16.350572 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe2806-0986-4f52-a9a2-42e0e2769c82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:16.350853 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe2806-0986-4f52-a9a2-42e0e2769c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:16.351172 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe2806-0986-4f52-a9a2-42e0e2769c82 admin admin] PATH_INFO: `/v3/projects/105cb7d68fca4c11acbfa7e09ff1e407` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:16.354546 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbe2806-0986-4f52-a9a2-42e0e2769c82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=105cb7d68fca4c11acbfa7e09ff1e407)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:16.359832 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbe2806-0986-4f52-a9a2-42e0e2769c82 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:16.365169 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:16.441477 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ed42fab2-721d-49d6-b289-8e969a8bd5fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd40b7db01bb040efa2586225d09118fb', 'request_id': 'req-ed42fab2-721d-49d6-b289-8e969a8bd5fc'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:16.457657 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ed42fab2-721d-49d6-b289-8e969a8bd5fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd40b7db01bb040efa2586225d09118fb', 'request_id': 'req-ed42fab2-721d-49d6-b289-8e969a8bd5fc'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:16.484948 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ed42fab2-721d-49d6-b289-8e969a8bd5fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd40b7db01bb040efa2586225d09118fb', 'request_id': 'req-ed42fab2-721d-49d6-b289-8e969a8bd5fc'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:16.520414 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ed42fab2-721d-49d6-b289-8e969a8bd5fc admin admin] The token cache is being invalidate because project d40b7db01bb040efa2586225d09118fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:16.521516 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ed42fab2-721d-49d6-b289-8e969a8bd5fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:16.523704 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ed42fab2-721d-49d6-b289-8e969a8bd5fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:16.529518 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2945/5900] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:16 2022] DELETE /identity/v3/projects/d40b7db01bb040efa2586225d09118fb => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:16.534426 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed42fab2-721d-49d6-b289-8e969a8bd5fc admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:16.535211 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0cbe2806-0986-4f52-a9a2-42e0e2769c82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '105cb7d68fca4c11acbfa7e09ff1e407', 'request_id': 'req-0cbe2806-0986-4f52-a9a2-42e0e2769c82'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:16.555436 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ed42fab2-721d-49d6-b289-8e969a8bd5fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:16.564444 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0cbe2806-0986-4f52-a9a2-42e0e2769c82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '105cb7d68fca4c11acbfa7e09ff1e407', 'request_id': 'req-0cbe2806-0986-4f52-a9a2-42e0e2769c82'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:16.581477 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0cbe2806-0986-4f52-a9a2-42e0e2769c82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '105cb7d68fca4c11acbfa7e09ff1e407', 'request_id': 'req-0cbe2806-0986-4f52-a9a2-42e0e2769c82'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:16.629867 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0cbe2806-0986-4f52-a9a2-42e0e2769c82 admin admin] The token cache is being invalidate because project 105cb7d68fca4c11acbfa7e09ff1e407 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:16.630524 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0cbe2806-0986-4f52-a9a2-42e0e2769c82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:16.633675 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0cbe2806-0986-4f52-a9a2-42e0e2769c82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:16.635784 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2956/5901] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:16 2022] DELETE /identity/v3/projects/105cb7d68fca4c11acbfa7e09ff1e407 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:16.641752 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32703af2-7063-44f8-b693-af51401cea29 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:16.642281 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32703af2-7063-44f8-b693-af51401cea29 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:16.642759 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32703af2-7063-44f8-b693-af51401cea29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:16.690036 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-32703af2-7063-44f8-b693-af51401cea29 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:16.692298 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed42fab2-721d-49d6-b289-8e969a8bd5fc admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:16.694339 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-32703af2-7063-44f8-b693-af51401cea29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:16.878838 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:16.908957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac9ab6-2397-4577-b67a-a71ed155a76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:16.909922 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac9ab6-2397-4577-b67a-a71ed155a76d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:16.912611 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac9ab6-2397-4577-b67a-a71ed155a76d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:16.913275 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac9ab6-2397-4577-b67a-a71ed155a76d admin admin] PATH_INFO: `/v3/users/cf1d74eaf36d4b708f0549f75dd815d8` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:16.919743 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ac9ab6-2397-4577-b67a-a71ed155a76d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf1d74eaf36d4b708f0549f75dd815d8)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:16.938130 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ac9ab6-2397-4577-b67a-a71ed155a76d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:16.956916 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2957/5902] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:16.965575 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d22847-616a-4574-a04f-10c0748db4cc None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:16.965871 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d22847-616a-4574-a04f-10c0748db4cc None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:16.966149 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d22847-616a-4574-a04f-10c0748db4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:17.033872 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-24d22847-616a-4574-a04f-10c0748db4cc None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:17.039254 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-24d22847-616a-4574-a04f-10c0748db4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:17.066412 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2958/5903] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:17.068243 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d22847-616a-4574-a04f-10c0748db4cc None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:17.091465 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-83ac9ab6-2397-4577-b67a-a71ed155a76d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf1d74eaf36d4b708f0549f75dd815d8'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:17.095548 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-83ac9ab6-2397-4577-b67a-a71ed155a76d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf1d74eaf36d4b708f0549f75dd815d8'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:17.098791 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d22847-616a-4574-a04f-10c0748db4cc None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:17.110371 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c88153-6433-4c76-be8a-c0d8977a64f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:17.111017 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c88153-6433-4c76-be8a-c0d8977a64f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:17.113078 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c88153-6433-4c76-be8a-c0d8977a64f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:17.113363 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c88153-6433-4c76-be8a-c0d8977a64f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:17.114234 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c88153-6433-4c76-be8a-c0d8977a64f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:05:17.114546 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c88153-6433-4c76-be8a-c0d8977a64f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:17.116211 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c88153-6433-4c76-be8a-c0d8977a64f5 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:17.125790 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-83ac9ab6-2397-4577-b67a-a71ed155a76d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf1d74eaf36d4b708f0549f75dd815d8'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:17.147775 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-83ac9ab6-2397-4577-b67a-a71ed155a76d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf1d74eaf36d4b708f0549f75dd815d8'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:17.162322 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-83ac9ab6-2397-4577-b67a-a71ed155a76d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf1d74eaf36d4b708f0549f75dd815d8'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:17.171166 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2959/5904] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:17.174417 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c88153-6433-4c76-be8a-c0d8977a64f5 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:17.180813 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2946/5905] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:05:16 2022] DELETE /identity/v3/users/cf1d74eaf36d4b708f0549f75dd815d8 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:17.194243 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-39c88153-6433-4c76-be8a-c0d8977a64f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:17.232181 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c88153-6433-4c76-be8a-c0d8977a64f5 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:17.317335 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2c42d-0236-443a-b84b-9272b5459963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:17.318025 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2c42d-0236-443a-b84b-9272b5459963 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:17.318309 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2c42d-0236-443a-b84b-9272b5459963 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:17.318912 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2c42d-0236-443a-b84b-9272b5459963 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:17.319653 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f2c42d-0236-443a-b84b-9272b5459963 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:17.321993 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f2c42d-0236-443a-b84b-9272b5459963 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:17.348364 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:17.378997 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2960/5906] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:05:17 2022] POST /identity/v3/projects => generated 405 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:05:17.383236 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac9ab6-2397-4577-b67a-a71ed155a76d admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:17.397576 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac9ab6-2397-4577-b67a-a71ed155a76d admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:17.483625 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2c42d-0236-443a-b84b-9272b5459963 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:17.485690 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-15f2c42d-0236-443a-b84b-9272b5459963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:17.590598 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10ad4d-a0c2-410b-be01-0e8b5a45f0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:17.596085 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10ad4d-a0c2-410b-be01-0e8b5a45f0a8 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:17.598925 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10ad4d-a0c2-410b-be01-0e8b5a45f0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:17.603239 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10ad4d-a0c2-410b-be01-0e8b5a45f0a8 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:17.605061 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b10ad4d-a0c2-410b-be01-0e8b5a45f0a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:17.609723 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b10ad4d-a0c2-410b-be01-0e8b5a45f0a8 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:17.614752 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2c42d-0236-443a-b84b-9272b5459963 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:17.634821 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba460a-88c7-420f-ae4d-e61186741709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:17.635517 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba460a-88c7-420f-ae4d-e61186741709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:17.635799 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba460a-88c7-420f-ae4d-e61186741709 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:17.636069 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba460a-88c7-420f-ae4d-e61186741709 admin admin] PATH_INFO: `/v3/users/c1c8b71252e84112bb1fd0513cf49f69` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:17.637956 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba460a-88c7-420f-ae4d-e61186741709 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1c8b71252e84112bb1fd0513cf49f69)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:17.644196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba460a-88c7-420f-ae4d-e61186741709 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:17.689465 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2947/5907] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:05:17 2022] POST /identity/v3/users => generated 303 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:17.689465 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10ad4d-a0c2-410b-be01-0e8b5a45f0a8 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:17.713050 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10ad4d-a0c2-410b-be01-0e8b5a45f0a8 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:17.725518 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396bc29e-c9f9-4e02-b6c6-7c6d4918f98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:17.727606 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396bc29e-c9f9-4e02-b6c6-7c6d4918f98f admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:17.728828 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396bc29e-c9f9-4e02-b6c6-7c6d4918f98f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:17.730999 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396bc29e-c9f9-4e02-b6c6-7c6d4918f98f admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:17.731993 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396bc29e-c9f9-4e02-b6c6-7c6d4918f98f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:17.735247 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396bc29e-c9f9-4e02-b6c6-7c6d4918f98f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:17.770373 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2948/5908] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:17.776001 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396bc29e-c9f9-4e02-b6c6-7c6d4918f98f admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:17.802939 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396bc29e-c9f9-4e02-b6c6-7c6d4918f98f admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:17.813874 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-55ba460a-88c7-420f-ae4d-e61186741709 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1c8b71252e84112bb1fd0513cf49f69'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:17.814694 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-55ba460a-88c7-420f-ae4d-e61186741709 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1c8b71252e84112bb1fd0513cf49f69'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:17.822308 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee510c-63aa-489d-953a-90a6bbe45255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:17.823222 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee510c-63aa-489d-953a-90a6bbe45255 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:17.823653 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee510c-63aa-489d-953a-90a6bbe45255 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:17.824081 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee510c-63aa-489d-953a-90a6bbe45255 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:17.824895 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee510c-63aa-489d-953a-90a6bbe45255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:17.832409 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee510c-63aa-489d-953a-90a6bbe45255 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:17.834408 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-55ba460a-88c7-420f-ae4d-e61186741709 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1c8b71252e84112bb1fd0513cf49f69'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:17.848994 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-55ba460a-88c7-420f-ae4d-e61186741709 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1c8b71252e84112bb1fd0513cf49f69'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:17.850572 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-55ba460a-88c7-420f-ae4d-e61186741709 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1c8b71252e84112bb1fd0513cf49f69'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:17.857816 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2949/5909] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:17.860809 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee510c-63aa-489d-953a-90a6bbe45255 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:17.866689 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-16ee510c-63aa-489d-953a-90a6bbe45255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:17.886792 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee510c-63aa-489d-953a-90a6bbe45255 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:17.898779 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719e7e8-0ce0-40f6-a594-2f40290d77d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:17.899952 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719e7e8-0ce0-40f6-a594-2f40290d77d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:17.900612 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719e7e8-0ce0-40f6-a594-2f40290d77d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:17.901277 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719e7e8-0ce0-40f6-a594-2f40290d77d6 admin admin] PATH_INFO: `/v3/projects/c10c6040801b43abab86d5e744946449/users/389a799713e3437fa9b4982c71f8147f/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:17.903332 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2961/5910] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:05:17 2022] DELETE /identity/v3/users/c1c8b71252e84112bb1fd0513cf49f69 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:17.946175 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719e7e8-0ce0-40f6-a594-2f40290d77d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c10c6040801b43abab86d5e744946449, user_id=389a799713e3437fa9b4982c71f8147f, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:17.946632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba460a-88c7-420f-ae4d-e61186741709 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:17.949002 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-55ba460a-88c7-420f-ae4d-e61186741709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:17.955877 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719e7e8-0ce0-40f6-a594-2f40290d77d6 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:17.984371 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2950/5911] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:05:17 2022] PUT /identity/v3/projects/c10c6040801b43abab86d5e744946449/users/389a799713e3437fa9b4982c71f8147f/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:17.989667 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073f6a5-22b3-4044-a824-605e756da346 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:17.989950 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073f6a5-22b3-4044-a824-605e756da346 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:17.990276 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073f6a5-22b3-4044-a824-605e756da346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:18.059885 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-b073f6a5-22b3-4044-a824-605e756da346 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:18.062593 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b073f6a5-22b3-4044-a824-605e756da346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:18.083712 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:18.135386 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba460a-88c7-420f-ae4d-e61186741709 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:18.160416 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:18.189288 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2951/5912] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:05:18.227243 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073f6a5-22b3-4044-a824-605e756da346 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:18.249179 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b073f6a5-22b3-4044-a824-605e756da346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:18.253030 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b84f1-831c-45af-b85f-cc0e58cccbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:18.253675 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b84f1-831c-45af-b85f-cc0e58cccbc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:18.253957 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b84f1-831c-45af-b85f-cc0e58cccbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:18.254230 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b84f1-831c-45af-b85f-cc0e58cccbc6 admin admin] PATH_INFO: `/v3/projects/20a8867eb86a458f8fd38eedd8df157e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:18.255521 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b84f1-831c-45af-b85f-cc0e58cccbc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20a8867eb86a458f8fd38eedd8df157e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:18.258588 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b84f1-831c-45af-b85f-cc0e58cccbc6 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:18.380379 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f49b84f1-831c-45af-b85f-cc0e58cccbc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20a8867eb86a458f8fd38eedd8df157e', 'request_id': 'req-f49b84f1-831c-45af-b85f-cc0e58cccbc6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:18.393387 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f49b84f1-831c-45af-b85f-cc0e58cccbc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20a8867eb86a458f8fd38eedd8df157e', 'request_id': 'req-f49b84f1-831c-45af-b85f-cc0e58cccbc6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:18.399297 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073f6a5-22b3-4044-a824-605e756da346 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:18.409810 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f49b84f1-831c-45af-b85f-cc0e58cccbc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20a8867eb86a458f8fd38eedd8df157e', 'request_id': 'req-f49b84f1-831c-45af-b85f-cc0e58cccbc6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:18.435569 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f49b84f1-831c-45af-b85f-cc0e58cccbc6 admin admin] The token cache is being invalidate because project 20a8867eb86a458f8fd38eedd8df157e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:18.436067 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f49b84f1-831c-45af-b85f-cc0e58cccbc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:18.437540 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f49b84f1-831c-45af-b85f-cc0e58cccbc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:18.442936 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2962/5913] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:17 2022] DELETE /identity/v3/projects/20a8867eb86a458f8fd38eedd8df157e => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:05:18.447630 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811edbce-3b8e-41ec-8ec3-0b7fc6ef252e None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:18.447896 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811edbce-3b8e-41ec-8ec3-0b7fc6ef252e None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:18.448154 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811edbce-3b8e-41ec-8ec3-0b7fc6ef252e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:18.490514 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-811edbce-3b8e-41ec-8ec3-0b7fc6ef252e None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:18.492029 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-811edbce-3b8e-41ec-8ec3-0b7fc6ef252e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:18.510668 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be185ff-05f7-44b5-8681-469e5fb127f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:18.511361 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be185ff-05f7-44b5-8681-469e5fb127f2 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:18.511647 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be185ff-05f7-44b5-8681-469e5fb127f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:18.511925 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be185ff-05f7-44b5-8681-469e5fb127f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:18.514993 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7be185ff-05f7-44b5-8681-469e5fb127f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:18.592349 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2963/5914] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:18.593804 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811edbce-3b8e-41ec-8ec3-0b7fc6ef252e None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:18.595440 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-811edbce-3b8e-41ec-8ec3-0b7fc6ef252e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:18.609905 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811edbce-3b8e-41ec-8ec3-0b7fc6ef252e None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:18.615737 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c7b7c-924a-4602-a243-53216d681c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:18.616397 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c7b7c-924a-4602-a243-53216d681c7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:18.616682 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c7b7c-924a-4602-a243-53216d681c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:18.617297 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c7b7c-924a-4602-a243-53216d681c7a admin admin] PATH_INFO: `/v3/projects/b585ff61700d433e8b6c74e059537135` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:18.619017 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1c7b7c-924a-4602-a243-53216d681c7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b585ff61700d433e8b6c74e059537135)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:18.621695 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1c7b7c-924a-4602-a243-53216d681c7a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:18.633670 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be185ff-05f7-44b5-8681-469e5fb127f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:18.636092 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be185ff-05f7-44b5-8681-469e5fb127f2 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:18.666428 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2952/5915] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:05:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:05:18.670807 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ec21a-dc2a-47a2-8a39-02f88f251a10 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:18.671609 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ec21a-dc2a-47a2-8a39-02f88f251a10 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:18.672086 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ec21a-dc2a-47a2-8a39-02f88f251a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:18.715789 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-077ec21a-dc2a-47a2-8a39-02f88f251a10 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:18.720021 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-077ec21a-dc2a-47a2-8a39-02f88f251a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:18.728576 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:18.730384 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5f1c7b7c-924a-4602-a243-53216d681c7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b585ff61700d433e8b6c74e059537135', 'request_id': 'req-5f1c7b7c-924a-4602-a243-53216d681c7a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:18.738846 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5f1c7b7c-924a-4602-a243-53216d681c7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b585ff61700d433e8b6c74e059537135', 'request_id': 'req-5f1c7b7c-924a-4602-a243-53216d681c7a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:18.757765 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5f1c7b7c-924a-4602-a243-53216d681c7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b585ff61700d433e8b6c74e059537135', 'request_id': 'req-5f1c7b7c-924a-4602-a243-53216d681c7a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:18.767390 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:18.799329 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5f1c7b7c-924a-4602-a243-53216d681c7a admin admin] The token cache is being invalidate because project b585ff61700d433e8b6c74e059537135 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:18.800822 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5f1c7b7c-924a-4602-a243-53216d681c7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:18.802225 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5f1c7b7c-924a-4602-a243-53216d681c7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:18.813367 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2964/5916] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:18 2022] DELETE /identity/v3/projects/b585ff61700d433e8b6c74e059537135 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:18.815539 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34051c-4c3c-48ee-83ac-a6494431ff50 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:18.816019 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34051c-4c3c-48ee-83ac-a6494431ff50 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:18.816490 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34051c-4c3c-48ee-83ac-a6494431ff50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:18.851156 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-5b34051c-4c3c-48ee-83ac-a6494431ff50 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:18.852520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5b34051c-4c3c-48ee-83ac-a6494431ff50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:18.870724 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2953/5917] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:18.876600 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ec21a-dc2a-47a2-8a39-02f88f251a10 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:18.894088 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ec21a-dc2a-47a2-8a39-02f88f251a10 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:18.903201 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def97ce-8ff2-46df-b37d-d9b8670c7f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:18.904306 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def97ce-8ff2-46df-b37d-d9b8670c7f42 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:18.905183 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def97ce-8ff2-46df-b37d-d9b8670c7f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:18.905630 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def97ce-8ff2-46df-b37d-d9b8670c7f42 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:18.906586 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1def97ce-8ff2-46df-b37d-d9b8670c7f42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:05:18.906778 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1def97ce-8ff2-46df-b37d-d9b8670c7f42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:18.908636 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1def97ce-8ff2-46df-b37d-d9b8670c7f42 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:18.931608 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2954/5918] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:05:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:18.937031 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def97ce-8ff2-46df-b37d-d9b8670c7f42 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:18.960710 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def97ce-8ff2-46df-b37d-d9b8670c7f42 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:18.970764 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b23aa-05a6-4bda-bb95-0a41ba5aa61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:18.971887 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b23aa-05a6-4bda-bb95-0a41ba5aa61b admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:18.971887 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b23aa-05a6-4bda-bb95-0a41ba5aa61b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:18.972311 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b23aa-05a6-4bda-bb95-0a41ba5aa61b admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:18.973171 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b23aa-05a6-4bda-bb95-0a41ba5aa61b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:18.975558 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b23aa-05a6-4bda-bb95-0a41ba5aa61b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:18.997510 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2965/5919] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:19.005403 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb2004-7c37-445e-b6e7-61487cc07957 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:19.005963 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb2004-7c37-445e-b6e7-61487cc07957 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:19.006355 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb2004-7c37-445e-b6e7-61487cc07957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:19.042946 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2955/5920] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:05:18 2022] POST /identity/v3/projects => generated 387 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:19.046266 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b23aa-05a6-4bda-bb95-0a41ba5aa61b admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:19.060777 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-7adb2004-7c37-445e-b6e7-61487cc07957 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:19.062117 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7adb2004-7c37-445e-b6e7-61487cc07957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:19.225850 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b23aa-05a6-4bda-bb95-0a41ba5aa61b admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:19.228386 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2966/5921] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:05:19.229905 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb2004-7c37-445e-b6e7-61487cc07957 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:19.231724 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567fcf95-7431-467b-9478-053ee22d8830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:19.232513 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567fcf95-7431-467b-9478-053ee22d8830 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:19.232787 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567fcf95-7431-467b-9478-053ee22d8830 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:19.233549 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567fcf95-7431-467b-9478-053ee22d8830 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:19.234096 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567fcf95-7431-467b-9478-053ee22d8830 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:19.235903 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567fcf95-7431-467b-9478-053ee22d8830 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:19.252125 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb2004-7c37-445e-b6e7-61487cc07957 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:19.270900 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13d74b-7bea-4379-a9b6-71decd258ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:19.271584 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13d74b-7bea-4379-a9b6-71decd258ecf admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:19.271862 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13d74b-7bea-4379-a9b6-71decd258ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:19.272134 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13d74b-7bea-4379-a9b6-71decd258ecf admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:19.277751 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb13d74b-7bea-4379-a9b6-71decd258ecf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:05:19.278090 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb13d74b-7bea-4379-a9b6-71decd258ecf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:19.293418 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb13d74b-7bea-4379-a9b6-71decd258ecf admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:19.298242 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2956/5922] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:05:19 2022] POST /identity/v3/users => generated 294 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:19.299553 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567fcf95-7431-467b-9478-053ee22d8830 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:19.328302 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567fcf95-7431-467b-9478-053ee22d8830 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:19.341714 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2967/5923] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:19.343308 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13d74b-7bea-4379-a9b6-71decd258ecf admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:19.351501 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368dff3-6cb8-415d-ae82-53c2cd9d5ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:19.352296 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368dff3-6cb8-415d-ae82-53c2cd9d5ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:19.352587 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368dff3-6cb8-415d-ae82-53c2cd9d5ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:19.352881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368dff3-6cb8-415d-ae82-53c2cd9d5ab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:19.353534 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a368dff3-6cb8-415d-ae82-53c2cd9d5ab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:19.355928 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a368dff3-6cb8-415d-ae82-53c2cd9d5ab4 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:19.380933 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13d74b-7bea-4379-a9b6-71decd258ecf admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:19.388615 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2957/5924] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:05:19.390885 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368dff3-6cb8-415d-ae82-53c2cd9d5ab4 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:19.411832 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296839be-aa83-4e2a-9311-5bd9d8fff96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:19.412478 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296839be-aa83-4e2a-9311-5bd9d8fff96e admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:19.412765 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296839be-aa83-4e2a-9311-5bd9d8fff96e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:19.413180 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296839be-aa83-4e2a-9311-5bd9d8fff96e admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:19.413832 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296839be-aa83-4e2a-9311-5bd9d8fff96e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:19.416330 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296839be-aa83-4e2a-9311-5bd9d8fff96e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:19.427679 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368dff3-6cb8-415d-ae82-53c2cd9d5ab4 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:19.456301 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb881f-311d-479d-9e64-a714ede15e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:19.457360 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb881f-311d-479d-9e64-a714ede15e59 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:19.457651 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb881f-311d-479d-9e64-a714ede15e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:19.457930 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb881f-311d-479d-9e64-a714ede15e59 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:19.458735 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb881f-311d-479d-9e64-a714ede15e59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:19.460416 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb881f-311d-479d-9e64-a714ede15e59 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:19.502624 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2958/5925] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:19.503549 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb881f-311d-479d-9e64-a714ede15e59 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:19.513863 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2968/5926] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:05:19 2022] POST /identity/v3/projects => generated 369 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:19.515328 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296839be-aa83-4e2a-9311-5bd9d8fff96e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:19.530683 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb881f-311d-479d-9e64-a714ede15e59 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:19.625041 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:19.665228 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296839be-aa83-4e2a-9311-5bd9d8fff96e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:19.683188 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92553428-fc12-4eea-b869-92ca9ff7d062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:19.683829 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92553428-fc12-4eea-b869-92ca9ff7d062 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:19.684109 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92553428-fc12-4eea-b869-92ca9ff7d062 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:19.684387 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92553428-fc12-4eea-b869-92ca9ff7d062 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:19.685323 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92553428-fc12-4eea-b869-92ca9ff7d062 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:19.688047 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92553428-fc12-4eea-b869-92ca9ff7d062 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:19.689384 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:19.721750 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493bc64-4987-4d2c-9f1c-a7381b7b627e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:19.723406 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493bc64-4987-4d2c-9f1c-a7381b7b627e admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:19.723757 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493bc64-4987-4d2c-9f1c-a7381b7b627e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:19.724043 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493bc64-4987-4d2c-9f1c-a7381b7b627e admin admin] PATH_INFO: `/v3/projects/ff0b985edd794b1ea3dc48f24284a920/users/bcec85df0b144b1db1f6ff459fe6f04d/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:19.741249 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2969/5927] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:05:19 2022] POST /identity/v3/users => generated 285 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:19.743252 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92553428-fc12-4eea-b869-92ca9ff7d062 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:19.766483 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493bc64-4987-4d2c-9f1c-a7381b7b627e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff0b985edd794b1ea3dc48f24284a920, user_id=bcec85df0b144b1db1f6ff459fe6f04d, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:19.770246 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493bc64-4987-4d2c-9f1c-a7381b7b627e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:19.785424 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92553428-fc12-4eea-b869-92ca9ff7d062 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:19.792345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bdfc71-f2f3-4033-82a5-0361adc4f8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:19.792992 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bdfc71-f2f3-4033-82a5-0361adc4f8d0 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:19.793278 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bdfc71-f2f3-4033-82a5-0361adc4f8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:19.793555 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bdfc71-f2f3-4033-82a5-0361adc4f8d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:19.794229 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bdfc71-f2f3-4033-82a5-0361adc4f8d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:19.800698 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bdfc71-f2f3-4033-82a5-0361adc4f8d0 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:19.802507 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2959/5928] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:05:19 2022] PUT /identity/v3/projects/ff0b985edd794b1ea3dc48f24284a920/users/bcec85df0b144b1db1f6ff459fe6f04d/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:19.821589 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5668443c-61dd-49ec-9219-c3dcd5721f24 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:19.821876 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5668443c-61dd-49ec-9219-c3dcd5721f24 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:19.822155 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5668443c-61dd-49ec-9219-c3dcd5721f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:19.837940 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2970/5929] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:19.838918 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bdfc71-f2f3-4033-82a5-0361adc4f8d0 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:19.859851 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bdfc71-f2f3-4033-82a5-0361adc4f8d0 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:19.881681 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-5668443c-61dd-49ec-9219-c3dcd5721f24 None None] MFA Rules not processed for user `bcec85df0b144b1db1f6ff459fe6f04d`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:19.884599 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5668443c-61dd-49ec-9219-c3dcd5721f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:19.984593 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84070dc7-fcf2-4aa4-82f8-5cdbe87e94ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:19.985236 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84070dc7-fcf2-4aa4-82f8-5cdbe87e94ba admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:19.985510 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84070dc7-fcf2-4aa4-82f8-5cdbe87e94ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:19.985791 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84070dc7-fcf2-4aa4-82f8-5cdbe87e94ba admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:19.986449 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84070dc7-fcf2-4aa4-82f8-5cdbe87e94ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:19.988116 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84070dc7-fcf2-4aa4-82f8-5cdbe87e94ba admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:19.992502 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2960/5930] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:19 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:20.000967 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5668443c-61dd-49ec-9219-c3dcd5721f24 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:20.015233 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2971/5931] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:20.019821 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84070dc7-fcf2-4aa4-82f8-5cdbe87e94ba admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:20.025854 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5668443c-61dd-49ec-9219-c3dcd5721f24 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:20.034520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84070dc7-fcf2-4aa4-82f8-5cdbe87e94ba admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:20.034749 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72197d37-4e36-441c-a1fa-8c0a13059ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:20.035624 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72197d37-4e36-441c-a1fa-8c0a13059ee0 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:20.036064 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72197d37-4e36-441c-a1fa-8c0a13059ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:20.037882 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72197d37-4e36-441c-a1fa-8c0a13059ee0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:20.039534 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72197d37-4e36-441c-a1fa-8c0a13059ee0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:20.043224 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72197d37-4e36-441c-a1fa-8c0a13059ee0 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:20.051493 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5e33b-ab8c-46ff-88cd-807fd14fbf5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:20.052038 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5e33b-ab8c-46ff-88cd-807fd14fbf5e admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:20.052833 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5e33b-ab8c-46ff-88cd-807fd14fbf5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:20.052833 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5e33b-ab8c-46ff-88cd-807fd14fbf5e admin admin] PATH_INFO: `/v3/projects/1fa19a3a6d614d309bff00ded0769611/users/56dd02ed327b45449672ce2651c6b1ae/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:20.082152 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5e33b-ab8c-46ff-88cd-807fd14fbf5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fa19a3a6d614d309bff00ded0769611, user_id=56dd02ed327b45449672ce2651c6b1ae, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:20.084910 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5e33b-ab8c-46ff-88cd-807fd14fbf5e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:20.119394 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2972/5932] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:05:20 2022] PUT /identity/v3/projects/1fa19a3a6d614d309bff00ded0769611/users/56dd02ed327b45449672ce2651c6b1ae/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:05:20.137308 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e17f7-4c2a-4fbb-95c2-bef662cbbf4e None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:20.137602 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e17f7-4c2a-4fbb-95c2-bef662cbbf4e None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:20.137883 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e17f7-4c2a-4fbb-95c2-bef662cbbf4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:20.145396 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2961/5933] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:05:19 2022] POST /identity/v3/projects => generated 385 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:20.147080 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb496c-4ed4-4e67-b459-b7ff2999d923 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:20.150544 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb496c-4ed4-4e67-b459-b7ff2999d923 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:20.151570 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb496c-4ed4-4e67-b459-b7ff2999d923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:20.183753 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-545e17f7-4c2a-4fbb-95c2-bef662cbbf4e None None] MFA Rules not processed for user `56dd02ed327b45449672ce2651c6b1ae`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:20.185835 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-545e17f7-4c2a-4fbb-95c2-bef662cbbf4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:20.202659 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-62bb496c-4ed4-4e67-b459-b7ff2999d923 None None] MFA Rules not processed for user `389a799713e3437fa9b4982c71f8147f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:20.204933 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-62bb496c-4ed4-4e67-b459-b7ff2999d923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:20.309305 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2973/5934] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:20.310473 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e17f7-4c2a-4fbb-95c2-bef662cbbf4e None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:20.323387 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2962/5935] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:20 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:20.324404 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb496c-4ed4-4e67-b459-b7ff2999d923 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:20.388545 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:20.402404 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:20.463461 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb496c-4ed4-4e67-b459-b7ff2999d923 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:20.473440 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ff7a0-d8e8-48e1-bb05-629890fb054d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:20.474077 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ff7a0-d8e8-48e1-bb05-629890fb054d admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:20.474362 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ff7a0-d8e8-48e1-bb05-629890fb054d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:20.474770 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ff7a0-d8e8-48e1-bb05-629890fb054d admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:20.475661 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ff7a0-d8e8-48e1-bb05-629890fb054d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:20.477823 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ff7a0-d8e8-48e1-bb05-629890fb054d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:20.483864 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e17f7-4c2a-4fbb-95c2-bef662cbbf4e None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:20.490051 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f7dc1-8a31-43c1-98a3-4e44329ffb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:20.490860 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f7dc1-8a31-43c1-98a3-4e44329ffb19 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:20.491166 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f7dc1-8a31-43c1-98a3-4e44329ffb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:20.491438 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f7dc1-8a31-43c1-98a3-4e44329ffb19 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:20.492075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63f7dc1-8a31-43c1-98a3-4e44329ffb19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:20.494034 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63f7dc1-8a31-43c1-98a3-4e44329ffb19 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:20.550060 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2963/5936] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:05:20 2022] POST /identity/v3/projects => generated 367 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:20.550870 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ff7a0-d8e8-48e1-bb05-629890fb054d admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:20.556116 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-456ff7a0-d8e8-48e1-bb05-629890fb054d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:20.562556 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2974/5937] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:05:20 2022] POST /identity/v3/users => generated 299 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:20.563514 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f7dc1-8a31-43c1-98a3-4e44329ffb19 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:20.586251 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f7dc1-8a31-43c1-98a3-4e44329ffb19 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:20.690199 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ff7a0-d8e8-48e1-bb05-629890fb054d admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:20.696525 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e1484-261e-467f-86cc-3117345cf105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:20.697393 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e1484-261e-467f-86cc-3117345cf105 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:20.697848 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e1484-261e-467f-86cc-3117345cf105 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:20.698132 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e1484-261e-467f-86cc-3117345cf105 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:20.698781 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1e1484-261e-467f-86cc-3117345cf105 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:20.700773 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1e1484-261e-467f-86cc-3117345cf105 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:20.742293 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2964/5938] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:05:20 2022] POST /identity/v3/projects => generated 403 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:20.743948 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e1484-261e-467f-86cc-3117345cf105 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:20.763459 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eda82e-c01d-42dc-a16f-7b4222e40b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:20.764905 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eda82e-c01d-42dc-a16f-7b4222e40b83 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:20.766607 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eda82e-c01d-42dc-a16f-7b4222e40b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:20.767599 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eda82e-c01d-42dc-a16f-7b4222e40b83 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:20.768408 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eda82e-c01d-42dc-a16f-7b4222e40b83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:20.771726 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eda82e-c01d-42dc-a16f-7b4222e40b83 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:20.828748 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2975/5939] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:05:20 2022] POST /identity/v3/users => generated 290 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:20.829559 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eda82e-c01d-42dc-a16f-7b4222e40b83 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:20.845520 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e1484-261e-467f-86cc-3117345cf105 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:20.859614 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea37c9-d420-4bd6-b048-76f7ebedbc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:20.859614 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea37c9-d420-4bd6-b048-76f7ebedbc3b admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:20.860119 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eda82e-c01d-42dc-a16f-7b4222e40b83 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:20.860248 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea37c9-d420-4bd6-b048-76f7ebedbc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:20.860248 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea37c9-d420-4bd6-b048-76f7ebedbc3b admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:20.860525 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea37c9-d420-4bd6-b048-76f7ebedbc3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:20.866968 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b8831b-3347-49a1-b3f0-14db610ed7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:20.867769 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8831b-3347-49a1-b3f0-14db610ed7bc admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:20.868148 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8831b-3347-49a1-b3f0-14db610ed7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:20.868499 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8831b-3347-49a1-b3f0-14db610ed7bc admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:20.869362 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b8831b-3347-49a1-b3f0-14db610ed7bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:20.871434 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b8831b-3347-49a1-b3f0-14db610ed7bc admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:20.873129 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea37c9-d420-4bd6-b048-76f7ebedbc3b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:20.893671 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2965/5940] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:20.895733 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea37c9-d420-4bd6-b048-76f7ebedbc3b admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:20.913244 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2976/5941] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:05:20 2022] POST /identity/v3/users => generated 308 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:20.914162 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b8831b-3347-49a1-b3f0-14db610ed7bc admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:20.915508 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea37c9-d420-4bd6-b048-76f7ebedbc3b admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:20.924630 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d0a48-eb78-489e-97fd-5d879c556f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:20.925607 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d0a48-eb78-489e-97fd-5d879c556f6a admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:20.926095 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d0a48-eb78-489e-97fd-5d879c556f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:20.926567 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d0a48-eb78-489e-97fd-5d879c556f6a admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:20.927506 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d0a48-eb78-489e-97fd-5d879c556f6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:20.929717 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d0a48-eb78-489e-97fd-5d879c556f6a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:20.938291 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b8831b-3347-49a1-b3f0-14db610ed7bc admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:20.945134 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2966/5942] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:20.946394 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d0a48-eb78-489e-97fd-5d879c556f6a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:20.958450 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e50e6da-09b6-43e8-a972-6f60b7993321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:20.959174 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e50e6da-09b6-43e8-a972-6f60b7993321 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:20.959453 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e50e6da-09b6-43e8-a972-6f60b7993321 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:20.959764 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e50e6da-09b6-43e8-a972-6f60b7993321 admin admin] PATH_INFO: `/v3/projects/43c0ff09dad447fba23e6fd9161290b2/users/218398aa27b948e896d6d175e37450d7/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:20.975203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d0a48-eb78-489e-97fd-5d879c556f6a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:20.985826 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170f996-1a60-4fc0-b391-77c866040b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:20.986950 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170f996-1a60-4fc0-b391-77c866040b51 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:20.988854 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170f996-1a60-4fc0-b391-77c866040b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:20.989569 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e50e6da-09b6-43e8-a972-6f60b7993321 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43c0ff09dad447fba23e6fd9161290b2, user_id=218398aa27b948e896d6d175e37450d7, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:20.991105 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170f996-1a60-4fc0-b391-77c866040b51 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:20.992472 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e50e6da-09b6-43e8-a972-6f60b7993321 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:20.993607 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a170f996-1a60-4fc0-b391-77c866040b51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:20.999243 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a170f996-1a60-4fc0-b391-77c866040b51 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:21.024737 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2967/5943] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:21.025856 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170f996-1a60-4fc0-b391-77c866040b51 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:21.038412 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2977/5944] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:05:20 2022] PUT /identity/v3/projects/43c0ff09dad447fba23e6fd9161290b2/users/218398aa27b948e896d6d175e37450d7/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:21.039495 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e50e6da-09b6-43e8-a972-6f60b7993321 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:21.040795 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170f996-1a60-4fc0-b391-77c866040b51 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:21.070438 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:21.174352 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c5fc5-7568-4976-bc5e-448331cba09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:21.175991 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c5fc5-7568-4976-bc5e-448331cba09f admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:21.175991 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c5fc5-7568-4976-bc5e-448331cba09f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:21.176276 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c5fc5-7568-4976-bc5e-448331cba09f admin admin] PATH_INFO: `/v3/projects/14fc132d27f34c27a666dd8228555a98/users/22f9ef97de4b4d9bb2ae536cb62e32b4/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:21.183170 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e50e6da-09b6-43e8-a972-6f60b7993321 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:21.197887 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528dfeea-c7e0-4c8f-b68c-c6ec4e7b8dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:21.202273 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528dfeea-c7e0-4c8f-b68c-c6ec4e7b8dbe admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:21.202802 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17c5fc5-7568-4976-bc5e-448331cba09f admin admin] RBAC: Authorizing `identity:create_grant(project_id=14fc132d27f34c27a666dd8228555a98, user_id=22f9ef97de4b4d9bb2ae536cb62e32b4, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:21.203895 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528dfeea-c7e0-4c8f-b68c-c6ec4e7b8dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:21.205035 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528dfeea-c7e0-4c8f-b68c-c6ec4e7b8dbe admin admin] PATH_INFO: `/v3/projects/f6e3618936764ee3a9bad35ddd764c9f/users/ce80cc454f78432ca7b20ba704c64db5/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:21.208868 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:21.212792 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17c5fc5-7568-4976-bc5e-448331cba09f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:21.238149 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2968/5945] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:05:21 2022] PUT /identity/v3/projects/14fc132d27f34c27a666dd8228555a98/users/22f9ef97de4b4d9bb2ae536cb62e32b4/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:21.238149 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c5fc5-7568-4976-bc5e-448331cba09f admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:21.260653 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528dfeea-c7e0-4c8f-b68c-c6ec4e7b8dbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6e3618936764ee3a9bad35ddd764c9f, user_id=ce80cc454f78432ca7b20ba704c64db5, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:21.263847 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528dfeea-c7e0-4c8f-b68c-c6ec4e7b8dbe admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:21.297267 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2978/5946] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:05:21 2022] PUT /identity/v3/projects/f6e3618936764ee3a9bad35ddd764c9f/users/ce80cc454f78432ca7b20ba704c64db5/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:21.300683 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528dfeea-c7e0-4c8f-b68c-c6ec4e7b8dbe admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:21.393666 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528dfeea-c7e0-4c8f-b68c-c6ec4e7b8dbe admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:21.399802 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbdb468-52d1-4f1e-9daf-970bd50bbe56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:21.400533 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdb468-52d1-4f1e-9daf-970bd50bbe56 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:21.400909 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdb468-52d1-4f1e-9daf-970bd50bbe56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:21.401280 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdb468-52d1-4f1e-9daf-970bd50bbe56 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:21.402021 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbdb468-52d1-4f1e-9daf-970bd50bbe56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:21.404002 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbdb468-52d1-4f1e-9daf-970bd50bbe56 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:21.422617 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2979/5947] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:21.423729 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c5fc5-7568-4976-bc5e-448331cba09f admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:21.424514 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbdb468-52d1-4f1e-9daf-970bd50bbe56 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:21.437802 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbdb468-52d1-4f1e-9daf-970bd50bbe56 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:21.439372 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da479b-45fe-4f9f-b8c6-b3999d5af9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:21.441014 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da479b-45fe-4f9f-b8c6-b3999d5af9b7 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:21.441983 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da479b-45fe-4f9f-b8c6-b3999d5af9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:21.442264 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da479b-45fe-4f9f-b8c6-b3999d5af9b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:21.444288 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084258a-1882-47e7-9d75-14c5de9aaafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:21.444439 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da479b-45fe-4f9f-b8c6-b3999d5af9b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:21.445486 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084258a-1882-47e7-9d75-14c5de9aaafb admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:21.445972 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084258a-1882-47e7-9d75-14c5de9aaafb admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:21.446439 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084258a-1882-47e7-9d75-14c5de9aaafb admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:21.446899 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da479b-45fe-4f9f-b8c6-b3999d5af9b7 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:21.447515 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8084258a-1882-47e7-9d75-14c5de9aaafb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:21.449486 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8084258a-1882-47e7-9d75-14c5de9aaafb admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:21.463597 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2980/5948] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:21.465053 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084258a-1882-47e7-9d75-14c5de9aaafb admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:21.479138 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2969/5949] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:21.479681 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da479b-45fe-4f9f-b8c6-b3999d5af9b7 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:21.487042 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084258a-1882-47e7-9d75-14c5de9aaafb admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:21.504750 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c73fa-4cc3-4250-aca5-2272f040fdc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:21.505854 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c73fa-4cc3-4250-aca5-2272f040fdc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:21.506326 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c73fa-4cc3-4250-aca5-2272f040fdc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:21.506873 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c73fa-4cc3-4250-aca5-2272f040fdc0 admin admin] PATH_INFO: `/v3/projects/14fc132d27f34c27a666dd8228555a98/users/22f9ef97de4b4d9bb2ae536cb62e32b4/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:21.509204 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da479b-45fe-4f9f-b8c6-b3999d5af9b7 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:21.521816 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c73fa-4cc3-4250-aca5-2272f040fdc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14fc132d27f34c27a666dd8228555a98, user_id=22f9ef97de4b4d9bb2ae536cb62e32b4, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:21.525410 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe5458-cca7-4b3a-9a02-9f48684c713b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:21.527054 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe5458-cca7-4b3a-9a02-9f48684c713b admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:21.528110 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe5458-cca7-4b3a-9a02-9f48684c713b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:21.529854 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe5458-cca7-4b3a-9a02-9f48684c713b admin admin] PATH_INFO: `/v3/projects/f6e3618936764ee3a9bad35ddd764c9f/users/ce80cc454f78432ca7b20ba704c64db5/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:21.532626 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c73fa-4cc3-4250-aca5-2272f040fdc0 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:21.535908 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe5458-cca7-4b3a-9a02-9f48684c713b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6e3618936764ee3a9bad35ddd764c9f, user_id=ce80cc454f78432ca7b20ba704c64db5, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:21.541831 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe5458-cca7-4b3a-9a02-9f48684c713b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:21.548126 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2981/5950] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:05:21 2022] PUT /identity/v3/projects/14fc132d27f34c27a666dd8228555a98/users/22f9ef97de4b4d9bb2ae536cb62e32b4/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:21.549646 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c73fa-4cc3-4250-aca5-2272f040fdc0 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:21.583683 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2970/5951] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:05:21 2022] PUT /identity/v3/projects/f6e3618936764ee3a9bad35ddd764c9f/users/ce80cc454f78432ca7b20ba704c64db5/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:21.584819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a7481-cdea-46c8-bdd4-213309f00f0a None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:21.585430 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a7481-cdea-46c8-bdd4-213309f00f0a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:21.585711 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a7481-cdea-46c8-bdd4-213309f00f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:21.657381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-ae3a7481-cdea-46c8-bdd4-213309f00f0a None None] MFA Rules not processed for user `22f9ef97de4b4d9bb2ae536cb62e32b4`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:21.658626 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ae3a7481-cdea-46c8-bdd4-213309f00f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:21.745912 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c73fa-4cc3-4250-aca5-2272f040fdc0 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:21.893916 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74589d9a-73fd-450e-9af9-fd64b95dcc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:21.894766 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74589d9a-73fd-450e-9af9-fd64b95dcc90 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:21.895553 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74589d9a-73fd-450e-9af9-fd64b95dcc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:21.895553 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74589d9a-73fd-450e-9af9-fd64b95dcc90 admin admin] PATH_INFO: `/v3/projects/43c0ff09dad447fba23e6fd9161290b2/users/218398aa27b948e896d6d175e37450d7/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:21.900210 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74589d9a-73fd-450e-9af9-fd64b95dcc90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43c0ff09dad447fba23e6fd9161290b2, user_id=218398aa27b948e896d6d175e37450d7, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:21.907913 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74589d9a-73fd-450e-9af9-fd64b95dcc90 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:21.911739 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:21.921828 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2971/5952] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:21 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:21.926174 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a7481-cdea-46c8-bdd4-213309f00f0a None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:21.944193 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2982/5953] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:05:21 2022] PUT /identity/v3/projects/43c0ff09dad447fba23e6fd9161290b2/users/218398aa27b948e896d6d175e37450d7/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:21.948058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a7481-cdea-46c8-bdd4-213309f00f0a None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:21.955783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc37ac5-b240-4dc2-a2ae-d2ff7df740f6 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:21.956741 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc37ac5-b240-4dc2-a2ae-d2ff7df740f6 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:21.957171 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc37ac5-b240-4dc2-a2ae-d2ff7df740f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:21.961268 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:22.017710 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-dbc37ac5-b240-4dc2-a2ae-d2ff7df740f6 None None] MFA Rules not processed for user `218398aa27b948e896d6d175e37450d7`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:22.018916 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-dbc37ac5-b240-4dc2-a2ae-d2ff7df740f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:22.058073 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263186cc-b73c-444f-937b-d3186211c480 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f9ef97de4b4d9bb2ae536cb62e32b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14fc132d27f34c27a666dd8228555a98', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:22.058865 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263186cc-b73c-444f-937b-d3186211c480 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:22.059766 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263186cc-b73c-444f-937b-d3186211c480 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:22.060246 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263186cc-b73c-444f-937b-d3186211c480 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] PATH_INFO: `/v3/services` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:22.062330 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263186cc-b73c-444f-937b-d3186211c480 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:22.064466 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263186cc-b73c-444f-937b-d3186211c480 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:22.105204 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2972/5954] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:05:21 2022] POST /identity/v3/services => generated 289 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:22.114161 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263186cc-b73c-444f-937b-d3186211c480 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:22.150726 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263186cc-b73c-444f-937b-d3186211c480 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:22.158052 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2983/5955] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:21 2022] POST /identity/v3/auth/tokens => generated 3462 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:22.160753 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eaf313-8d64-4818-8e06-e0c62109052b tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f9ef97de4b4d9bb2ae536cb62e32b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14fc132d27f34c27a666dd8228555a98', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:22.162272 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eaf313-8d64-4818-8e06-e0c62109052b tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:22.163227 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc37ac5-b240-4dc2-a2ae-d2ff7df740f6 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:22.163397 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eaf313-8d64-4818-8e06-e0c62109052b tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:22.163761 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eaf313-8d64-4818-8e06-e0c62109052b tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:22.164477 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eaf313-8d64-4818-8e06-e0c62109052b tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:22.166051 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-89eaf313-8d64-4818-8e06-e0c62109052b tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:05:22.166051 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 16:05:22.166051 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 16:05:22.166952 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eaf313-8d64-4818-8e06-e0c62109052b tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:22.180739 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc37ac5-b240-4dc2-a2ae-d2ff7df740f6 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:22.188873 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3fbe26-0d3b-44e2-bd1d-9b58b44e7652 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218398aa27b948e896d6d175e37450d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43c0ff09dad447fba23e6fd9161290b2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:22.189643 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fbe26-0d3b-44e2-bd1d-9b58b44e7652 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:22.190270 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fbe26-0d3b-44e2-bd1d-9b58b44e7652 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:22.190270 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fbe26-0d3b-44e2-bd1d-9b58b44e7652 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:22.191208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3fbe26-0d3b-44e2-bd1d-9b58b44e7652 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:22.193317 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3fbe26-0d3b-44e2-bd1d-9b58b44e7652 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:22.214144 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-89eaf313-8d64-4818-8e06-e0c62109052b tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1601797589. To ensure interoperability, identifiers should be a valid uuid. Aug 29 16:05:22.214144 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 29 16:05:22.214144 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 16:05:22.269757 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2984/5956] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:05:22 2022] POST /identity/v3/projects => generated 359 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:22.273358 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3fbe26-0d3b-44e2-bd1d-9b58b44e7652 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:22.289526 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2973/5957] 10.222.0.83 () {60 vars in 1156 bytes} [Mon Aug 29 16:05:22 2022] POST /identity/v3/endpoints => generated 361 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:22.290140 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eaf313-8d64-4818-8e06-e0c62109052b tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:22.360848 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eaf313-8d64-4818-8e06-e0c62109052b tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:22.464640 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3fbe26-0d3b-44e2-bd1d-9b58b44e7652 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:22.486606 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed6e3e-1b70-46b4-8eeb-9bc6f32fcf50 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218398aa27b948e896d6d175e37450d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43c0ff09dad447fba23e6fd9161290b2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:22.487672 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed6e3e-1b70-46b4-8eeb-9bc6f32fcf50 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:22.488144 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed6e3e-1b70-46b4-8eeb-9bc6f32fcf50 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:22.488604 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed6e3e-1b70-46b4-8eeb-9bc6f32fcf50 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] PATH_INFO: `/v3/projects/9eaadcd2bb18435ab9b85b376e9bbc97/tags/tempest-tag-1931334839` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:22.490039 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed6e3e-1b70-46b4-8eeb-9bc6f32fcf50 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=9eaadcd2bb18435ab9b85b376e9bbc97, value=tempest-tag-1931334839)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:22.492830 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed6e3e-1b70-46b4-8eeb-9bc6f32fcf50 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:22.604596 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8975bee4-a0fd-438f-be40-5d81a5fe8206 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f9ef97de4b4d9bb2ae536cb62e32b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14fc132d27f34c27a666dd8228555a98', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:22.605313 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975bee4-a0fd-438f-be40-5d81a5fe8206 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:22.605594 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975bee4-a0fd-438f-be40-5d81a5fe8206 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:22.608005 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975bee4-a0fd-438f-be40-5d81a5fe8206 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] PATH_INFO: `/v3/regions/tempest-region-1601797589` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:22.608665 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8975bee4-a0fd-438f-be40-5d81a5fe8206 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1601797589)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:22.612390 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8975bee4-a0fd-438f-be40-5d81a5fe8206 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:22.618605 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-06ed6e3e-1b70-46b4-8eeb-9bc6f32fcf50 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-1931334839. To ensure interoperability, identifiers should be a valid uuid. Aug 29 16:05:22.618605 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 29 16:05:22.618605 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 16:05:22.621827 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2974/5958] 10.222.0.83 () {58 vars in 1206 bytes} [Mon Aug 29 16:05:22 2022] GET /identity/v3/regions/tempest-region-1601797589 => generated 180 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:22.624739 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8975bee4-a0fd-438f-be40-5d81a5fe8206 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:22.648025 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2985/5959] 10.222.0.83 () {60 vars in 1333 bytes} [Mon Aug 29 16:05:22 2022] PUT /identity/v3/projects/9eaadcd2bb18435ab9b85b376e9bbc97/tags/tempest-tag-1931334839 => generated 0 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 291 bytes (2 switches on core 0) Aug 29 16:05:22.650455 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed6e3e-1b70-46b4-8eeb-9bc6f32fcf50 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:22.651839 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8975bee4-a0fd-438f-be40-5d81a5fe8206 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:22.669592 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f024e-a7c6-4895-b2da-a065cfbe55c1 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f9ef97de4b4d9bb2ae536cb62e32b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14fc132d27f34c27a666dd8228555a98', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:22.670226 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f024e-a7c6-4895-b2da-a065cfbe55c1 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:22.670736 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f024e-a7c6-4895-b2da-a065cfbe55c1 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:22.670943 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed6e3e-1b70-46b4-8eeb-9bc6f32fcf50 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:22.671136 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f024e-a7c6-4895-b2da-a065cfbe55c1 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] PATH_INFO: `/v3/services` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:22.671788 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f024e-a7c6-4895-b2da-a065cfbe55c1 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:22.673362 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f024e-a7c6-4895-b2da-a065cfbe55c1 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:22.678949 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c00ac-d6c5-42e6-8afd-87c6798a4e58 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218398aa27b948e896d6d175e37450d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43c0ff09dad447fba23e6fd9161290b2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:22.679661 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c00ac-d6c5-42e6-8afd-87c6798a4e58 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:22.679946 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c00ac-d6c5-42e6-8afd-87c6798a4e58 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:22.681184 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c00ac-d6c5-42e6-8afd-87c6798a4e58 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] PATH_INFO: `/v3/projects/9eaadcd2bb18435ab9b85b376e9bbc97/tags/tempest-tag-1931334839` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:22.684357 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:22.709738 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2c00ac-d6c5-42e6-8afd-87c6798a4e58 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=9eaadcd2bb18435ab9b85b376e9bbc97, value=tempest-tag-1931334839)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:22.720957 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2c00ac-d6c5-42e6-8afd-87c6798a4e58 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:22.730198 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2975/5960] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:05:22 2022] POST /identity/v3/services => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:22.734797 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f024e-a7c6-4895-b2da-a065cfbe55c1 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:22.760997 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2986/5961] 10.222.0.83 () {58 vars in 1314 bytes} [Mon Aug 29 16:05:22 2022] GET /identity/v3/projects/9eaadcd2bb18435ab9b85b376e9bbc97/tags/tempest-tag-1931334839 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:22.765526 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c00ac-d6c5-42e6-8afd-87c6798a4e58 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:22.784542 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f024e-a7c6-4895-b2da-a065cfbe55c1 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:22.787572 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c00ac-d6c5-42e6-8afd-87c6798a4e58 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:22.798476 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980f35e-f1c3-4a52-b1f4-8b5d82954c63 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f9ef97de4b4d9bb2ae536cb62e32b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14fc132d27f34c27a666dd8228555a98', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:22.799144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980f35e-f1c3-4a52-b1f4-8b5d82954c63 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:22.799421 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980f35e-f1c3-4a52-b1f4-8b5d82954c63 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:22.799696 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980f35e-f1c3-4a52-b1f4-8b5d82954c63 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:22.800373 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980f35e-f1c3-4a52-b1f4-8b5d82954c63 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:22.802434 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980f35e-f1c3-4a52-b1f4-8b5d82954c63 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:22.827133 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4236bff-5e05-4bcb-9b50-6d5966a0fb22 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218398aa27b948e896d6d175e37450d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43c0ff09dad447fba23e6fd9161290b2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:22.827803 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4236bff-5e05-4bcb-9b50-6d5966a0fb22 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:22.828604 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4236bff-5e05-4bcb-9b50-6d5966a0fb22 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:22.830855 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4236bff-5e05-4bcb-9b50-6d5966a0fb22 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] PATH_INFO: `/v3/projects/9eaadcd2bb18435ab9b85b376e9bbc97/tags` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:22.833885 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4236bff-5e05-4bcb-9b50-6d5966a0fb22 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=9eaadcd2bb18435ab9b85b376e9bbc97)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:22.849210 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-1980f35e-f1c3-4a52-b1f4-8b5d82954c63 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1731804326. To ensure interoperability, identifiers should be a valid uuid. Aug 29 16:05:22.849210 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 29 16:05:22.849210 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 16:05:22.850179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4236bff-5e05-4bcb-9b50-6d5966a0fb22 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:22.867305 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:22.925460 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2976/5962] 10.222.0.83 () {60 vars in 1156 bytes} [Mon Aug 29 16:05:22 2022] POST /identity/v3/endpoints => generated 363 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:05:22.928944 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980f35e-f1c3-4a52-b1f4-8b5d82954c63 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:22.978763 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2987/5963] 10.222.0.83 () {60 vars in 1265 bytes} [Mon Aug 29 16:05:22 2022] PUT /identity/v3/projects/9eaadcd2bb18435ab9b85b376e9bbc97/tags => generated 140 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:22.980930 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4236bff-5e05-4bcb-9b50-6d5966a0fb22 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:22.989558 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980f35e-f1c3-4a52-b1f4-8b5d82954c63 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:23.003741 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9a88e-94ba-42e5-ac03-1cafbb1d408d tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f9ef97de4b4d9bb2ae536cb62e32b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14fc132d27f34c27a666dd8228555a98', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:23.004569 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9a88e-94ba-42e5-ac03-1cafbb1d408d tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:23.004853 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9a88e-94ba-42e5-ac03-1cafbb1d408d tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:23.005128 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9a88e-94ba-42e5-ac03-1cafbb1d408d tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] PATH_INFO: `/v3/regions/tempest-region-1731804326` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:23.005727 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc9a88e-94ba-42e5-ac03-1cafbb1d408d tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1731804326)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:23.006718 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4236bff-5e05-4bcb-9b50-6d5966a0fb22 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:23.007751 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc9a88e-94ba-42e5-ac03-1cafbb1d408d tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:23.015605 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2977/5964] 10.222.0.83 () {58 vars in 1206 bytes} [Mon Aug 29 16:05:22 2022] GET /identity/v3/regions/tempest-region-1731804326 => generated 180 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:23.017749 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9a88e-94ba-42e5-ac03-1cafbb1d408d tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:23.051472 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9a88e-94ba-42e5-ac03-1cafbb1d408d tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:23.056642 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01f9e40-d30f-417e-abbd-ddf5a2c6a6e7 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218398aa27b948e896d6d175e37450d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43c0ff09dad447fba23e6fd9161290b2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:23.057337 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f9e40-d30f-417e-abbd-ddf5a2c6a6e7 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:23.063007 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f9e40-d30f-417e-abbd-ddf5a2c6a6e7 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:23.063324 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f9e40-d30f-417e-abbd-ddf5a2c6a6e7 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] PATH_INFO: `/v3/projects/9eaadcd2bb18435ab9b85b376e9bbc97/tags` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:23.068213 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3733739b-f1db-4ede-a99e-bf86a8343c16 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f9ef97de4b4d9bb2ae536cb62e32b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14fc132d27f34c27a666dd8228555a98', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:23.068843 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733739b-f1db-4ede-a99e-bf86a8343c16 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:23.069122 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733739b-f1db-4ede-a99e-bf86a8343c16 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:23.069392 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733739b-f1db-4ede-a99e-bf86a8343c16 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:23.070079 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3733739b-f1db-4ede-a99e-bf86a8343c16 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:23.071915 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3733739b-f1db-4ede-a99e-bf86a8343c16 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:23.103885 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-3733739b-f1db-4ede-a99e-bf86a8343c16 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1910768117. To ensure interoperability, identifiers should be a valid uuid. Aug 29 16:05:23.103885 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 29 16:05:23.103885 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 16:05:23.104310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01f9e40-d30f-417e-abbd-ddf5a2c6a6e7 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=9eaadcd2bb18435ab9b85b376e9bbc97)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:23.110041 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01f9e40-d30f-417e-abbd-ddf5a2c6a6e7 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:23.173443 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2988/5965] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 29 16:05:22 2022] GET /identity/v3/projects/9eaadcd2bb18435ab9b85b376e9bbc97/tags => generated 140 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:23.177567 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01f9e40-d30f-417e-abbd-ddf5a2c6a6e7 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:23.182552 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2978/5966] 10.222.0.83 () {60 vars in 1156 bytes} [Mon Aug 29 16:05:23 2022] POST /identity/v3/endpoints => generated 361 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:23.185570 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3733739b-f1db-4ede-a99e-bf86a8343c16 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:23.200179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01f9e40-d30f-417e-abbd-ddf5a2c6a6e7 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:23.237502 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f86a02-6306-47ff-a350-99c9103b7d45 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218398aa27b948e896d6d175e37450d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43c0ff09dad447fba23e6fd9161290b2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:23.238678 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f86a02-6306-47ff-a350-99c9103b7d45 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:23.239162 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f86a02-6306-47ff-a350-99c9103b7d45 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:23.239920 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f86a02-6306-47ff-a350-99c9103b7d45 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] PATH_INFO: `/v3/projects/9eaadcd2bb18435ab9b85b376e9bbc97/tags/tempest-tag-298726901` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:23.241295 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f86a02-6306-47ff-a350-99c9103b7d45 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=9eaadcd2bb18435ab9b85b376e9bbc97, value=tempest-tag-298726901)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:23.244044 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f86a02-6306-47ff-a350-99c9103b7d45 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:23.253642 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3733739b-f1db-4ede-a99e-bf86a8343c16 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:23.276041 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66673fa9-3bfe-4366-bfdd-340846c62ba4 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f9ef97de4b4d9bb2ae536cb62e32b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14fc132d27f34c27a666dd8228555a98', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:23.277048 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66673fa9-3bfe-4366-bfdd-340846c62ba4 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:23.277611 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66673fa9-3bfe-4366-bfdd-340846c62ba4 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:23.277890 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66673fa9-3bfe-4366-bfdd-340846c62ba4 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] PATH_INFO: `/v3/regions/tempest-region-1910768117` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:23.278485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66673fa9-3bfe-4366-bfdd-340846c62ba4 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1910768117)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:23.279868 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66673fa9-3bfe-4366-bfdd-340846c62ba4 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:23.288021 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2979/5967] 10.222.0.83 () {58 vars in 1206 bytes} [Mon Aug 29 16:05:23 2022] GET /identity/v3/regions/tempest-region-1910768117 => generated 180 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:05:23.289314 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca3c0c-4f5d-456a-a852-d49b229dad7b None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:23.290144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca3c0c-4f5d-456a-a852-d49b229dad7b None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:23.290871 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca3c0c-4f5d-456a-a852-d49b229dad7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:23.335238 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-59f86a02-6306-47ff-a350-99c9103b7d45 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-298726901. To ensure interoperability, identifiers should be a valid uuid. Aug 29 16:05:23.335238 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 29 16:05:23.335238 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 16:05:23.360195 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2989/5968] 10.222.0.83 () {58 vars in 1314 bytes} [Mon Aug 29 16:05:23 2022] DELETE /identity/v3/projects/9eaadcd2bb18435ab9b85b376e9bbc97/tags/tempest-tag-298726901 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:23.362047 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-55ca3c0c-4f5d-456a-a852-d49b229dad7b None None] MFA Rules not processed for user `ce80cc454f78432ca7b20ba704c64db5`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:23.363607 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f86a02-6306-47ff-a350-99c9103b7d45 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:23.363751 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-55ca3c0c-4f5d-456a-a852-d49b229dad7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:23.405401 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f86a02-6306-47ff-a350-99c9103b7d45 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:23.424037 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9ea9a-dfd2-43ca-b02c-8e92939f89a3 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f9ef97de4b4d9bb2ae536cb62e32b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14fc132d27f34c27a666dd8228555a98', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:23.424698 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9ea9a-dfd2-43ca-b02c-8e92939f89a3 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:23.425117 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9ea9a-dfd2-43ca-b02c-8e92939f89a3 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:23.425586 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9ea9a-dfd2-43ca-b02c-8e92939f89a3 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:23.426310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c9ea9a-dfd2-43ca-b02c-8e92939f89a3 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:23.431643 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-47c9ea9a-dfd2-43ca-b02c-8e92939f89a3 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:05:23.431643 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 16:05:23.431643 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 16:05:23.432818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c9ea9a-dfd2-43ca-b02c-8e92939f89a3 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:23.461525 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2990/5969] 10.222.0.83 () {58 vars in 1134 bytes} [Mon Aug 29 16:05:23 2022] GET /identity/v3/endpoints => generated 4399 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:23.462148 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9ea9a-dfd2-43ca-b02c-8e92939f89a3 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:23.476972 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9ea9a-dfd2-43ca-b02c-8e92939f89a3 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:23.483425 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfaf626-4ca5-4390-8f8b-d2bbb14840eb tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218398aa27b948e896d6d175e37450d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43c0ff09dad447fba23e6fd9161290b2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:23.484180 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfaf626-4ca5-4390-8f8b-d2bbb14840eb tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:23.484491 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfaf626-4ca5-4390-8f8b-d2bbb14840eb tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:23.484765 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfaf626-4ca5-4390-8f8b-d2bbb14840eb tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] PATH_INFO: `/v3/projects/9eaadcd2bb18435ab9b85b376e9bbc97/tags/tempest-tag-298726901` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:23.486954 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2980/5970] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:23 2022] POST /identity/v3/auth/tokens => generated 4166 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:23.488490 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca3c0c-4f5d-456a-a852-d49b229dad7b None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:23.504716 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfaf626-4ca5-4390-8f8b-d2bbb14840eb tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=9eaadcd2bb18435ab9b85b376e9bbc97, value=tempest-tag-298726901)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:23.507176 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfaf626-4ca5-4390-8f8b-d2bbb14840eb tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:23.528414 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-dbfaf626-4ca5-4390-8f8b-d2bbb14840eb tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] Could not find project tag: tempest-tag-298726901.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-298726901. Aug 29 16:05:23.528414 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:05:23.528414 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:05:23.528414 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:05:23.528414 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:05:23.528414 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:05:23.528414 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:05:23.528414 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:05:23.528414 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:05:23.528414 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:05:23.528414 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:05:23.528414 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:05:23.528414 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 284, in get Aug 29 16:05:23.528414 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_project_tag(project_id, value) Aug 29 16:05:23.529293 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:05:23.529293 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:05:23.529293 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 960, in get_project_tag Aug 29 16:05:23.529293 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ProjectTagNotFound(project_tag=tag_name) Aug 29 16:05:23.529293 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-298726901. Aug 29 16:05:23.529293 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:05:23.532996 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2991/5971] 10.222.0.83 () {58 vars in 1311 bytes} [Mon Aug 29 16:05:23 2022] GET /identity/v3/projects/9eaadcd2bb18435ab9b85b376e9bbc97/tags/tempest-tag-298726901 => generated 106 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 16:05:23.533893 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfaf626-4ca5-4390-8f8b-d2bbb14840eb tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:23.541961 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca3c0c-4f5d-456a-a852-d49b229dad7b None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:23.550319 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfaf626-4ca5-4390-8f8b-d2bbb14840eb tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:23.556872 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b023289-3cc8-4ec8-8481-86a8a9e452fe tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f9ef97de4b4d9bb2ae536cb62e32b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14fc132d27f34c27a666dd8228555a98', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:23.557746 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b023289-3cc8-4ec8-8481-86a8a9e452fe tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:23.558183 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b023289-3cc8-4ec8-8481-86a8a9e452fe tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:23.558618 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b023289-3cc8-4ec8-8481-86a8a9e452fe tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] PATH_INFO: `/v3/endpoints/f7210783253e4831af1dc6a4993e3c6d` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:23.568543 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5210ed8b-e18e-48d7-a41d-2c3547ac88b7 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218398aa27b948e896d6d175e37450d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43c0ff09dad447fba23e6fd9161290b2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:23.569345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5210ed8b-e18e-48d7-a41d-2c3547ac88b7 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:23.569596 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5210ed8b-e18e-48d7-a41d-2c3547ac88b7 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:23.570211 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5210ed8b-e18e-48d7-a41d-2c3547ac88b7 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] PATH_INFO: `/v3/projects/9eaadcd2bb18435ab9b85b376e9bbc97/tags` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:23.574031 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5210ed8b-e18e-48d7-a41d-2c3547ac88b7 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=9eaadcd2bb18435ab9b85b376e9bbc97)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:23.576264 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5210ed8b-e18e-48d7-a41d-2c3547ac88b7 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:23.583515 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b023289-3cc8-4ec8-8481-86a8a9e452fe tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=f7210783253e4831af1dc6a4993e3c6d)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:23.584628 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-5b023289-3cc8-4ec8-8481-86a8a9e452fe tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:05:23.584628 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 16:05:23.584628 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 16:05:23.585547 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b023289-3cc8-4ec8-8481-86a8a9e452fe tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:23.588790 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2981/5972] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:23 2022] GET /identity/v3/endpoints/f7210783253e4831af1dc6a4993e3c6d => generated 361 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:23.592711 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b023289-3cc8-4ec8-8481-86a8a9e452fe tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:23.614554 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b023289-3cc8-4ec8-8481-86a8a9e452fe tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:23.632062 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2586913-c0a5-4d8a-bc24-bb85d4073d9a tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f9ef97de4b4d9bb2ae536cb62e32b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14fc132d27f34c27a666dd8228555a98', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:23.632736 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2586913-c0a5-4d8a-bc24-bb85d4073d9a tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:23.633101 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2586913-c0a5-4d8a-bc24-bb85d4073d9a tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:23.633378 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2586913-c0a5-4d8a-bc24-bb85d4073d9a tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] PATH_INFO: `/v3/endpoints/f7210783253e4831af1dc6a4993e3c6d` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:23.634856 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2586913-c0a5-4d8a-bc24-bb85d4073d9a tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=f7210783253e4831af1dc6a4993e3c6d)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:23.637712 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-d2586913-c0a5-4d8a-bc24-bb85d4073d9a tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:05:23.637712 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 16:05:23.637712 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 16:05:23.642302 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2586913-c0a5-4d8a-bc24-bb85d4073d9a tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:23.666061 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d2586913-c0a5-4d8a-bc24-bb85d4073d9a tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'f7210783253e4831af1dc6a4993e3c6d', 'request_id': 'req-d2586913-c0a5-4d8a-bc24-bb85d4073d9a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:23.689542 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2982/5973] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:23 2022] DELETE /identity/v3/endpoints/f7210783253e4831af1dc6a4993e3c6d => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:23.694860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2586913-c0a5-4d8a-bc24-bb85d4073d9a tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:23.698835 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2992/5974] 10.222.0.83 () {58 vars in 1248 bytes} [Mon Aug 29 16:05:23 2022] DELETE /identity/v3/projects/9eaadcd2bb18435ab9b85b376e9bbc97/tags => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:23.699911 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5210ed8b-e18e-48d7-a41d-2c3547ac88b7 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:23.723507 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5210ed8b-e18e-48d7-a41d-2c3547ac88b7 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:23.738998 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:23.766600 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264bd6e4-6d62-43f0-aeff-6efced1b3ba9 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218398aa27b948e896d6d175e37450d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43c0ff09dad447fba23e6fd9161290b2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:23.767958 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264bd6e4-6d62-43f0-aeff-6efced1b3ba9 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:23.769930 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264bd6e4-6d62-43f0-aeff-6efced1b3ba9 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:23.770219 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264bd6e4-6d62-43f0-aeff-6efced1b3ba9 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] PATH_INFO: `/v3/projects/9eaadcd2bb18435ab9b85b376e9bbc97/tags` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:23.788094 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2586913-c0a5-4d8a-bc24-bb85d4073d9a tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:23.793986 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264bd6e4-6d62-43f0-aeff-6efced1b3ba9 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=9eaadcd2bb18435ab9b85b376e9bbc97)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:23.798601 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264bd6e4-6d62-43f0-aeff-6efced1b3ba9 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:23.808732 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f31d6b-154a-4d61-bf6f-d8c88024014c tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f9ef97de4b4d9bb2ae536cb62e32b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14fc132d27f34c27a666dd8228555a98', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:23.809367 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f31d6b-154a-4d61-bf6f-d8c88024014c tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:23.809646 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f31d6b-154a-4d61-bf6f-d8c88024014c tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:23.809918 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f31d6b-154a-4d61-bf6f-d8c88024014c tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:23.810548 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f31d6b-154a-4d61-bf6f-d8c88024014c tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:23.822831 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-d0f31d6b-154a-4d61-bf6f-d8c88024014c tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:05:23.822831 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 16:05:23.822831 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 16:05:23.823898 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f31d6b-154a-4d61-bf6f-d8c88024014c tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:23.830731 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2993/5975] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 29 16:05:23 2022] GET /identity/v3/projects/9eaadcd2bb18435ab9b85b376e9bbc97/tags => generated 66 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 16:05:23.831856 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264bd6e4-6d62-43f0-aeff-6efced1b3ba9 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:23.859129 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264bd6e4-6d62-43f0-aeff-6efced1b3ba9 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:23.862421 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2983/5976] 10.222.0.83 () {58 vars in 1134 bytes} [Mon Aug 29 16:05:23 2022] GET /identity/v3/endpoints => generated 4051 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:23.863498 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f31d6b-154a-4d61-bf6f-d8c88024014c tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:23.872619 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df5f92d-d011-445c-b232-31b30c82f308 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218398aa27b948e896d6d175e37450d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43c0ff09dad447fba23e6fd9161290b2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:23.874175 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5f92d-d011-445c-b232-31b30c82f308 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:23.874599 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5f92d-d011-445c-b232-31b30c82f308 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:23.875140 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5f92d-d011-445c-b232-31b30c82f308 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] PATH_INFO: `/v3/projects/9eaadcd2bb18435ab9b85b376e9bbc97` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:23.877863 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df5f92d-d011-445c-b232-31b30c82f308 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9eaadcd2bb18435ab9b85b376e9bbc97)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:23.881102 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df5f92d-d011-445c-b232-31b30c82f308 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:23.892117 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f31d6b-154a-4d61-bf6f-d8c88024014c tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:23.909226 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89205d8a-9309-4d90-8a1c-973f4c070253 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f9ef97de4b4d9bb2ae536cb62e32b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14fc132d27f34c27a666dd8228555a98', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:23.912338 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89205d8a-9309-4d90-8a1c-973f4c070253 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:23.914057 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89205d8a-9309-4d90-8a1c-973f4c070253 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:23.914679 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89205d8a-9309-4d90-8a1c-973f4c070253 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] PATH_INFO: `/v3/endpoints/f7210783253e4831af1dc6a4993e3c6d` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:23.928997 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89205d8a-9309-4d90-8a1c-973f4c070253 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 16:05:23.963141 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-89205d8a-9309-4d90-8a1c-973f4c070253 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Could not find endpoint: f7210783253e4831af1dc6a4993e3c6d.: keystone.exception.EndpointNotFound: Could not find endpoint: f7210783253e4831af1dc6a4993e3c6d. Aug 29 16:05:23.963141 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:05:23.963141 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 236, in _get_endpoint Aug 29 16:05:23.963141 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return session.query(Endpoint).filter_by(id=endpoint_id).one() Aug 29 16:05:23.963141 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Aug 29 16:05:23.963141 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._iter().one() Aug 29 16:05:23.963141 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Aug 29 16:05:23.963141 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._only_one_row( Aug 29 16:05:23.963141 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Aug 29 16:05:23.963141 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exc.NoResultFound( Aug 29 16:05:23.963141 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Aug 29 16:05:23.963141 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:05:23.963141 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 16:05:23.963141 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:05:23.963141 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:05:23.963141 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 228, in get_endpoint Aug 29 16:05:23.964317 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_endpoint(endpoint_id) Aug 29 16:05:23.964317 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 242, in get_endpoint Aug 29 16:05:23.964317 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_endpoint(session, endpoint_id).to_dict() Aug 29 16:05:23.964317 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 238, in _get_endpoint Aug 29 16:05:23.964317 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Aug 29 16:05:23.964317 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: f7210783253e4831af1dc6a4993e3c6d. Aug 29 16:05:23.964317 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:05:23.964317 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 16:05:23.964317 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:05:23.964317 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:05:23.964317 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:05:23.964317 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:05:23.964317 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:05:23.964317 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:05:23.964317 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:05:23.964317 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:05:23.964317 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:05:23.965315 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:05:23.965315 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:05:23.965315 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:05:23.965315 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 113, in delete Aug 29 16:05:23.965315 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_endpoint') Aug 29 16:05:23.965315 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 16:05:23.965315 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 16:05:23.965315 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 16:05:23.965315 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 16:05:23.965315 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:05:23.965315 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:05:23.965315 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 16:05:23.965315 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 16:05:23.965315 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 16:05:23.965315 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 16:05:23.965315 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 16:05:23.966202 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 16:05:23.966202 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 16:05:23.966202 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 16:05:23.966202 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 16:05:23.966202 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 16:05:23.966202 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 16:05:23.966202 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 16:05:23.966202 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 16:05:23.966202 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 16:05:23.966202 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 230, in get_endpoint Aug 29 16:05:23.966202 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Aug 29 16:05:23.966202 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: f7210783253e4831af1dc6a4993e3c6d. Aug 29 16:05:23.966202 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:05:23.974753 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2984/5977] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:23 2022] DELETE /identity/v3/endpoints/f7210783253e4831af1dc6a4993e3c6d => generated 114 bytes in 111 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 16:05:23.977807 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89205d8a-9309-4d90-8a1c-973f4c070253 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:23.991943 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2df5f92d-d011-445c-b232-31b30c82f308 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9eaadcd2bb18435ab9b85b376e9bbc97', 'request_id': 'req-2df5f92d-d011-445c-b232-31b30c82f308'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:24.002985 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2df5f92d-d011-445c-b232-31b30c82f308 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9eaadcd2bb18435ab9b85b376e9bbc97', 'request_id': 'req-2df5f92d-d011-445c-b232-31b30c82f308'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:24.027468 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89205d8a-9309-4d90-8a1c-973f4c070253 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:24.028370 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2df5f92d-d011-445c-b232-31b30c82f308 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9eaadcd2bb18435ab9b85b376e9bbc97', 'request_id': 'req-2df5f92d-d011-445c-b232-31b30c82f308'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:24.073102 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2df5f92d-d011-445c-b232-31b30c82f308 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] The token cache is being invalidate because project 9eaadcd2bb18435ab9b85b376e9bbc97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:24.073549 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2df5f92d-d011-445c-b232-31b30c82f308 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:24.075290 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2df5f92d-d011-445c-b232-31b30c82f308 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:24.079437 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:24.079871 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2994/5978] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:23 2022] DELETE /identity/v3/projects/9eaadcd2bb18435ab9b85b376e9bbc97 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:24.085134 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df5f92d-d011-445c-b232-31b30c82f308 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:24.088516 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2df5f92d-d011-445c-b232-31b30c82f308 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:24.244393 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df5f92d-d011-445c-b232-31b30c82f308 tempest-IdentityV3ProjectTagsTest-951384912 tempest-IdentityV3ProjectTagsTest-951384912-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:24.245901 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa273c4-afde-418e-9295-5b116fbacb0f tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f9ef97de4b4d9bb2ae536cb62e32b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14fc132d27f34c27a666dd8228555a98', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:24.246579 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa273c4-afde-418e-9295-5b116fbacb0f tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:24.246895 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa273c4-afde-418e-9295-5b116fbacb0f tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:24.247169 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa273c4-afde-418e-9295-5b116fbacb0f tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] PATH_INFO: `/v3/regions/tempest-region-1910768117` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:24.247782 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa273c4-afde-418e-9295-5b116fbacb0f tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1910768117)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:24.249979 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa273c4-afde-418e-9295-5b116fbacb0f tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:24.254287 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d52d29-e129-4420-9084-33a8e81ea315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:24.255639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d52d29-e129-4420-9084-33a8e81ea315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:24.256480 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d52d29-e129-4420-9084-33a8e81ea315 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:24.256914 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d52d29-e129-4420-9084-33a8e81ea315 admin admin] PATH_INFO: `/v3/users/bcec85df0b144b1db1f6ff459fe6f04d` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:24.259465 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d52d29-e129-4420-9084-33a8e81ea315 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcec85df0b144b1db1f6ff459fe6f04d)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:24.262943 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d52d29-e129-4420-9084-33a8e81ea315 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:24.321115 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2985/5979] 10.222.0.83 () {58 vars in 1209 bytes} [Mon Aug 29 16:05:23 2022] DELETE /identity/v3/regions/tempest-region-1910768117 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:24.326009 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa273c4-afde-418e-9295-5b116fbacb0f tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:24.330787 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-cfa273c4-afde-418e-9295-5b116fbacb0f tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:24.395871 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa273c4-afde-418e-9295-5b116fbacb0f tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:24.400895 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c2d52d29-e129-4420-9084-33a8e81ea315 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcec85df0b144b1db1f6ff459fe6f04d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:24.402977 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c2d52d29-e129-4420-9084-33a8e81ea315 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcec85df0b144b1db1f6ff459fe6f04d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:24.411108 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587803ac-2afa-4f9b-b298-37762721b087 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f9ef97de4b4d9bb2ae536cb62e32b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14fc132d27f34c27a666dd8228555a98', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:24.411749 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587803ac-2afa-4f9b-b298-37762721b087 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:24.412030 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587803ac-2afa-4f9b-b298-37762721b087 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:24.412314 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587803ac-2afa-4f9b-b298-37762721b087 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:24.412960 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587803ac-2afa-4f9b-b298-37762721b087 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:24.415564 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587803ac-2afa-4f9b-b298-37762721b087 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:24.416724 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:24.426301 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c2d52d29-e129-4420-9084-33a8e81ea315 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcec85df0b144b1db1f6ff459fe6f04d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:24.447959 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c2d52d29-e129-4420-9084-33a8e81ea315 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcec85df0b144b1db1f6ff459fe6f04d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:24.448727 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c2d52d29-e129-4420-9084-33a8e81ea315 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcec85df0b144b1db1f6ff459fe6f04d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:24.457169 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2986/5980] 10.222.0.83 () {58 vars in 1134 bytes} [Mon Aug 29 16:05:24 2022] GET /identity/v3/endpoints => generated 4051 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:24.458179 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587803ac-2afa-4f9b-b298-37762721b087 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:24.460683 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-587803ac-2afa-4f9b-b298-37762721b087 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:24.493896 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587803ac-2afa-4f9b-b298-37762721b087 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:24.509828 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2995/5981] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:05:24 2022] DELETE /identity/v3/users/bcec85df0b144b1db1f6ff459fe6f04d => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:05:24.511318 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ddc0f-5188-4e2c-a2ca-376137b1e8fc None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:24.512333 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ddc0f-5188-4e2c-a2ca-376137b1e8fc None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:24.513454 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ddc0f-5188-4e2c-a2ca-376137b1e8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:24.514175 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae7b291-7e0b-477e-a6e9-9834ee3f9460 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f9ef97de4b4d9bb2ae536cb62e32b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14fc132d27f34c27a666dd8228555a98', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:24.515396 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7b291-7e0b-477e-a6e9-9834ee3f9460 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:24.515732 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7b291-7e0b-477e-a6e9-9834ee3f9460 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:24.516017 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7b291-7e0b-477e-a6e9-9834ee3f9460 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:24.516719 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae7b291-7e0b-477e-a6e9-9834ee3f9460 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Adding query filter params (service_id=11dbd7b687b1406f81630ca43cffd835) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:05:24.517031 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae7b291-7e0b-477e-a6e9-9834ee3f9460 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:24.518727 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae7b291-7e0b-477e-a6e9-9834ee3f9460 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:24.547828 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2987/5982] 10.222.0.83 () {58 vars in 1221 bytes} [Mon Aug 29 16:05:24 2022] GET /identity/v3/endpoints?service_id=11dbd7b687b1406f81630ca43cffd835 => generated 503 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:24.554064 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae7b291-7e0b-477e-a6e9-9834ee3f9460 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:24.568944 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-8f6ddc0f-5188-4e2c-a2ca-376137b1e8fc None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:24.571737 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8f6ddc0f-5188-4e2c-a2ca-376137b1e8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:24.581544 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae7b291-7e0b-477e-a6e9-9834ee3f9460 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:24.668625 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6508c-ef02-41f2-8c9f-1eecb5c54e21 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f9ef97de4b4d9bb2ae536cb62e32b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14fc132d27f34c27a666dd8228555a98', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:24.670886 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6508c-ef02-41f2-8c9f-1eecb5c54e21 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:24.671504 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6508c-ef02-41f2-8c9f-1eecb5c54e21 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:24.672079 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6508c-ef02-41f2-8c9f-1eecb5c54e21 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:24.672995 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e6508c-ef02-41f2-8c9f-1eecb5c54e21 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Adding query filter params (service_id=67c930d1e4e848eea76e3d119885415a) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:05:24.673517 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e6508c-ef02-41f2-8c9f-1eecb5c54e21 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:24.675373 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e6508c-ef02-41f2-8c9f-1eecb5c54e21 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:24.685244 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2988/5983] 10.222.0.83 () {58 vars in 1221 bytes} [Mon Aug 29 16:05:24 2022] GET /identity/v3/endpoints?service_id=67c930d1e4e848eea76e3d119885415a => generated 505 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:24.687137 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6508c-ef02-41f2-8c9f-1eecb5c54e21 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:24.699356 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6508c-ef02-41f2-8c9f-1eecb5c54e21 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:24.722233 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf49e03c-bba8-459b-86b8-0173418db28a tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f9ef97de4b4d9bb2ae536cb62e32b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14fc132d27f34c27a666dd8228555a98', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:24.723453 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49e03c-bba8-459b-86b8-0173418db28a tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:24.723966 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49e03c-bba8-459b-86b8-0173418db28a tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:24.724446 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49e03c-bba8-459b-86b8-0173418db28a tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:24.727456 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf49e03c-bba8-459b-86b8-0173418db28a tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:05:24.728003 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf49e03c-bba8-459b-86b8-0173418db28a tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:24.731403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf49e03c-bba8-459b-86b8-0173418db28a tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:24.754673 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2996/5984] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:24 2022] POST /identity/v3/auth/tokens => generated 3873 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:24.761478 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2989/5985] 10.222.0.83 () {58 vars in 1167 bytes} [Mon Aug 29 16:05:24 2022] GET /identity/v3/endpoints?interface=public => generated 3406 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:24.768408 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf49e03c-bba8-459b-86b8-0173418db28a tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:24.769627 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ddc0f-5188-4e2c-a2ca-376137b1e8fc None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:24.772882 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-bf49e03c-bba8-459b-86b8-0173418db28a tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:24.787409 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ddc0f-5188-4e2c-a2ca-376137b1e8fc None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:24.802781 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f42fec-bbb3-48be-9fb5-bd86eead3705 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f9ef97de4b4d9bb2ae536cb62e32b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14fc132d27f34c27a666dd8228555a98', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:24.806547 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f42fec-bbb3-48be-9fb5-bd86eead3705 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:24.806949 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f42fec-bbb3-48be-9fb5-bd86eead3705 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:24.816706 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f42fec-bbb3-48be-9fb5-bd86eead3705 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:24.817220 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f42fec-bbb3-48be-9fb5-bd86eead3705 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:05:24.817533 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f42fec-bbb3-48be-9fb5-bd86eead3705 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:24.819231 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f42fec-bbb3-48be-9fb5-bd86eead3705 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:24.838163 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2997/5986] 10.222.0.83 () {58 vars in 1171 bytes} [Mon Aug 29 16:05:24 2022] GET /identity/v3/endpoints?interface=internal => generated 480 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:24.845961 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f42fec-bbb3-48be-9fb5-bd86eead3705 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:24.871073 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f42fec-bbb3-48be-9fb5-bd86eead3705 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:24.901517 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb59bc-6f0f-413e-83af-5e1669e0bd84 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f9ef97de4b4d9bb2ae536cb62e32b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14fc132d27f34c27a666dd8228555a98', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:24.902153 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb59bc-6f0f-413e-83af-5e1669e0bd84 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:24.902434 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb59bc-6f0f-413e-83af-5e1669e0bd84 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:24.902708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb59bc-6f0f-413e-83af-5e1669e0bd84 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] PATH_INFO: `/v3/services` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:24.903576 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb59bc-6f0f-413e-83af-5e1669e0bd84 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:24.906275 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb59bc-6f0f-413e-83af-5e1669e0bd84 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:24.990744 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2998/5987] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:05:24 2022] POST /identity/v3/services => generated 289 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:24.991715 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb59bc-6f0f-413e-83af-5e1669e0bd84 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:25.044178 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb59bc-6f0f-413e-83af-5e1669e0bd84 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:25.045442 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf49e03c-bba8-459b-86b8-0173418db28a tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:25.050692 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5cbbbc-67a9-435f-9f3d-5776dedc06db tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f9ef97de4b4d9bb2ae536cb62e32b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14fc132d27f34c27a666dd8228555a98', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:25.051486 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5cbbbc-67a9-435f-9f3d-5776dedc06db tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:25.051946 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5cbbbc-67a9-435f-9f3d-5776dedc06db tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:25.052235 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5cbbbc-67a9-435f-9f3d-5776dedc06db tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:25.052925 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5cbbbc-67a9-435f-9f3d-5776dedc06db tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:25.054198 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-ce5cbbbc-67a9-435f-9f3d-5776dedc06db tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:05:25.054198 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 16:05:25.054198 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 16:05:25.055066 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5cbbbc-67a9-435f-9f3d-5776dedc06db tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:25.066112 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:25.079247 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c40239-5790-4c23-b071-ca8fd5948cc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:25.079881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c40239-5790-4c23-b071-ca8fd5948cc0 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:25.080165 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c40239-5790-4c23-b071-ca8fd5948cc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:25.080439 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c40239-5790-4c23-b071-ca8fd5948cc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:25.104465 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c40239-5790-4c23-b071-ca8fd5948cc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:25.107012 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c40239-5790-4c23-b071-ca8fd5948cc0 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:25.124795 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-ce5cbbbc-67a9-435f-9f3d-5776dedc06db tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1705685901. To ensure interoperability, identifiers should be a valid uuid. Aug 29 16:05:25.124795 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 29 16:05:25.124795 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 16:05:25.161367 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2990/5988] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:05:24 2022] GET /identity/v3/auth/tokens => generated 4007 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:05:25.190006 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 2999/5989] 10.222.0.83 () {60 vars in 1156 bytes} [Mon Aug 29 16:05:24 2022] POST /identity/v3/endpoints => generated 361 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:25.191313 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c40239-5790-4c23-b071-ca8fd5948cc0 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:25.210974 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c40239-5790-4c23-b071-ca8fd5948cc0 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:25.279083 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73e25a-f64b-49c2-b193-affa59bd89c9 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f9ef97de4b4d9bb2ae536cb62e32b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14fc132d27f34c27a666dd8228555a98', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:25.280342 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73e25a-f64b-49c2-b193-affa59bd89c9 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:25.280638 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73e25a-f64b-49c2-b193-affa59bd89c9 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:25.280920 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73e25a-f64b-49c2-b193-affa59bd89c9 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] PATH_INFO: `/v3/regions/tempest-region-1705685901` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:25.281626 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c73e25a-f64b-49c2-b193-affa59bd89c9 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1705685901)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:25.283088 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c73e25a-f64b-49c2-b193-affa59bd89c9 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:25.285411 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2991/5990] 10.222.0.83 () {58 vars in 1206 bytes} [Mon Aug 29 16:05:25 2022] GET /identity/v3/regions/tempest-region-1705685901 => generated 180 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:25.289570 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5cbbbc-67a9-435f-9f3d-5776dedc06db tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:25.306460 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5cbbbc-67a9-435f-9f3d-5776dedc06db tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:25.328949 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887748e3-3db4-4fc2-8ce9-4937115fc665 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f9ef97de4b4d9bb2ae536cb62e32b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14fc132d27f34c27a666dd8228555a98', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:25.330813 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887748e3-3db4-4fc2-8ce9-4937115fc665 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:25.331278 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887748e3-3db4-4fc2-8ce9-4937115fc665 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:25.331735 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887748e3-3db4-4fc2-8ce9-4937115fc665 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] PATH_INFO: `/v3/endpoints/403bbd6a920444abbe9f4e258a88a695` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:25.343746 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887748e3-3db4-4fc2-8ce9-4937115fc665 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=403bbd6a920444abbe9f4e258a88a695)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:25.344975 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-887748e3-3db4-4fc2-8ce9-4937115fc665 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:05:25.344975 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 16:05:25.344975 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 16:05:25.346274 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887748e3-3db4-4fc2-8ce9-4937115fc665 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:25.412823 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-887748e3-3db4-4fc2-8ce9-4937115fc665 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-623074988. To ensure interoperability, identifiers should be a valid uuid. Aug 29 16:05:25.412823 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 29 16:05:25.412823 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 16:05:25.494781 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3000/5991] 10.222.0.83 () {60 vars in 1256 bytes} [Mon Aug 29 16:05:25 2022] PATCH /identity/v3/endpoints/403bbd6a920444abbe9f4e258a88a695 => generated 362 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:25.494899 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73e25a-f64b-49c2-b193-affa59bd89c9 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:25.517319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73e25a-f64b-49c2-b193-affa59bd89c9 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:25.547075 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd311695-171f-4dcb-b167-5a97a7cd095b tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f9ef97de4b4d9bb2ae536cb62e32b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14fc132d27f34c27a666dd8228555a98', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:25.547863 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd311695-171f-4dcb-b167-5a97a7cd095b tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:25.548151 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd311695-171f-4dcb-b167-5a97a7cd095b tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:25.548653 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd311695-171f-4dcb-b167-5a97a7cd095b tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] PATH_INFO: `/v3/regions/tempest-region-623074988` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:25.549734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd311695-171f-4dcb-b167-5a97a7cd095b tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-623074988)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:25.550645 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd311695-171f-4dcb-b167-5a97a7cd095b tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:25.558934 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2992/5992] 10.222.0.83 () {58 vars in 1203 bytes} [Mon Aug 29 16:05:25 2022] GET /identity/v3/regions/tempest-region-623074988 => generated 178 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:25.559954 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887748e3-3db4-4fc2-8ce9-4937115fc665 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:25.596528 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887748e3-3db4-4fc2-8ce9-4937115fc665 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:25.615295 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90048fa-ab2e-413d-a453-77d3527b81fc tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f9ef97de4b4d9bb2ae536cb62e32b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14fc132d27f34c27a666dd8228555a98', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:25.619545 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90048fa-ab2e-413d-a453-77d3527b81fc tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:25.620732 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90048fa-ab2e-413d-a453-77d3527b81fc tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:25.621268 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90048fa-ab2e-413d-a453-77d3527b81fc tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] PATH_INFO: `/v3/endpoints/403bbd6a920444abbe9f4e258a88a695` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:25.637157 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:25.649665 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90048fa-ab2e-413d-a453-77d3527b81fc tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=403bbd6a920444abbe9f4e258a88a695)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:25.656036 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-a90048fa-ab2e-413d-a453-77d3527b81fc tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:05:25.656036 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 16:05:25.656036 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 16:05:25.660388 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90048fa-ab2e-413d-a453-77d3527b81fc tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:25.686475 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a90048fa-ab2e-413d-a453-77d3527b81fc tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '403bbd6a920444abbe9f4e258a88a695', 'request_id': 'req-a90048fa-ab2e-413d-a453-77d3527b81fc'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:25.719874 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3001/5993] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:25 2022] DELETE /identity/v3/endpoints/403bbd6a920444abbe9f4e258a88a695 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:25.726233 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd311695-171f-4dcb-b167-5a97a7cd095b tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:25.739262 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd311695-171f-4dcb-b167-5a97a7cd095b tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:25.812658 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa32aaa8-f414-42cb-9569-c9cf983138d3 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f9ef97de4b4d9bb2ae536cb62e32b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14fc132d27f34c27a666dd8228555a98', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:25.817420 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32aaa8-f414-42cb-9569-c9cf983138d3 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:25.817420 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32aaa8-f414-42cb-9569-c9cf983138d3 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:25.820559 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32aaa8-f414-42cb-9569-c9cf983138d3 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] PATH_INFO: `/v3/regions/tempest-region-623074988` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:25.822304 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa32aaa8-f414-42cb-9569-c9cf983138d3 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-623074988)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:25.824016 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa32aaa8-f414-42cb-9569-c9cf983138d3 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:25.884275 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90048fa-ab2e-413d-a453-77d3527b81fc tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:25.889845 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a90048fa-ab2e-413d-a453-77d3527b81fc tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:25.897302 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-fa32aaa8-f414-42cb-9569-c9cf983138d3 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-623074988. To ensure interoperability, identifiers should be a valid uuid. Aug 29 16:05:25.897302 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 29 16:05:25.897302 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 16:05:25.909878 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2993/5994] 10.222.0.83 () {58 vars in 1206 bytes} [Mon Aug 29 16:05:25 2022] DELETE /identity/v3/regions/tempest-region-623074988 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:25.915911 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa32aaa8-f414-42cb-9569-c9cf983138d3 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:25.960448 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa32aaa8-f414-42cb-9569-c9cf983138d3 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:25.976765 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90048fa-ab2e-413d-a453-77d3527b81fc tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:25.982879 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c60f77-0ba0-4b1f-9417-ee70f092d73f tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f9ef97de4b4d9bb2ae536cb62e32b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14fc132d27f34c27a666dd8228555a98', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:25.985571 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c60f77-0ba0-4b1f-9417-ee70f092d73f tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:25.985863 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c60f77-0ba0-4b1f-9417-ee70f092d73f tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:25.986150 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c60f77-0ba0-4b1f-9417-ee70f092d73f tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] PATH_INFO: `/v3/regions/tempest-region-1705685901` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:25.991729 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c60f77-0ba0-4b1f-9417-ee70f092d73f tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1705685901)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:25.993368 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c60f77-0ba0-4b1f-9417-ee70f092d73f tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:26.008694 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bef372-55ef-4128-82fc-ee3c33d4ceb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:26.009699 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bef372-55ef-4128-82fc-ee3c33d4ceb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:26.010294 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bef372-55ef-4128-82fc-ee3c33d4ceb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:26.010753 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bef372-55ef-4128-82fc-ee3c33d4ceb1 admin admin] PATH_INFO: `/v3/projects/ff0b985edd794b1ea3dc48f24284a920` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:26.012785 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bef372-55ef-4128-82fc-ee3c33d4ceb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff0b985edd794b1ea3dc48f24284a920)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:26.016874 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bef372-55ef-4128-82fc-ee3c33d4ceb1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:26.043114 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-d8c60f77-0ba0-4b1f-9417-ee70f092d73f tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1705685901. To ensure interoperability, identifiers should be a valid uuid. Aug 29 16:05:26.043114 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 29 16:05:26.043114 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 16:05:26.055793 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2994/5995] 10.222.0.83 () {58 vars in 1209 bytes} [Mon Aug 29 16:05:25 2022] DELETE /identity/v3/regions/tempest-region-1705685901 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:26.061007 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c60f77-0ba0-4b1f-9417-ee70f092d73f tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:26.094880 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-03bef372-55ef-4128-82fc-ee3c33d4ceb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff0b985edd794b1ea3dc48f24284a920', 'request_id': 'req-03bef372-55ef-4128-82fc-ee3c33d4ceb1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:26.102385 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-03bef372-55ef-4128-82fc-ee3c33d4ceb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff0b985edd794b1ea3dc48f24284a920', 'request_id': 'req-03bef372-55ef-4128-82fc-ee3c33d4ceb1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:26.112706 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-03bef372-55ef-4128-82fc-ee3c33d4ceb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff0b985edd794b1ea3dc48f24284a920', 'request_id': 'req-03bef372-55ef-4128-82fc-ee3c33d4ceb1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:26.119157 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c60f77-0ba0-4b1f-9417-ee70f092d73f tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:26.143593 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-03bef372-55ef-4128-82fc-ee3c33d4ceb1 admin admin] The token cache is being invalidate because project ff0b985edd794b1ea3dc48f24284a920 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:26.144158 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-03bef372-55ef-4128-82fc-ee3c33d4ceb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:26.145048 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-03bef372-55ef-4128-82fc-ee3c33d4ceb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:26.152728 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3002/5996] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:25 2022] DELETE /identity/v3/projects/ff0b985edd794b1ea3dc48f24284a920 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:05:26.159113 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bef372-55ef-4128-82fc-ee3c33d4ceb1 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:26.162671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-03bef372-55ef-4128-82fc-ee3c33d4ceb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:26.276089 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bfd50c-f816-4734-b81b-193fd76e6eec tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f9ef97de4b4d9bb2ae536cb62e32b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14fc132d27f34c27a666dd8228555a98', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:26.280075 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfd50c-f816-4734-b81b-193fd76e6eec tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:26.282405 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfd50c-f816-4734-b81b-193fd76e6eec tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:26.283017 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfd50c-f816-4734-b81b-193fd76e6eec tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] PATH_INFO: `/v3/services/e5309b674fa249cc8083b6e158d30dde` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:26.284450 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bfd50c-f816-4734-b81b-193fd76e6eec tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorizing `identity:delete_service(service_id=e5309b674fa249cc8083b6e158d30dde)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:26.288357 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bfd50c-f816-4734-b81b-193fd76e6eec tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:26.345633 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2995/5997] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:26 2022] DELETE /identity/v3/services/e5309b674fa249cc8083b6e158d30dde => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:26.352471 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bfd50c-f816-4734-b81b-193fd76e6eec tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:26.365575 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-49bfd50c-f816-4734-b81b-193fd76e6eec tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:26.391149 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bef372-55ef-4128-82fc-ee3c33d4ceb1 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:26.455158 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0a128-5d25-4450-927e-3741e67de04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:26.464263 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bfd50c-f816-4734-b81b-193fd76e6eec tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:26.464603 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0a128-5d25-4450-927e-3741e67de04d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:26.464975 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0a128-5d25-4450-927e-3741e67de04d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:26.465335 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0a128-5d25-4450-927e-3741e67de04d admin admin] PATH_INFO: `/v3/users/218398aa27b948e896d6d175e37450d7` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:26.475912 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac0a128-5d25-4450-927e-3741e67de04d admin admin] RBAC: Authorizing `identity:delete_user(user_id=218398aa27b948e896d6d175e37450d7)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:26.481471 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac0a128-5d25-4450-927e-3741e67de04d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:26.486538 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013bcb0-f46d-4a22-8724-ea8adbc4663b tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f9ef97de4b4d9bb2ae536cb62e32b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14fc132d27f34c27a666dd8228555a98', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:26.487326 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013bcb0-f46d-4a22-8724-ea8adbc4663b tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:26.487685 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013bcb0-f46d-4a22-8724-ea8adbc4663b tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:26.488965 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013bcb0-f46d-4a22-8724-ea8adbc4663b tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] PATH_INFO: `/v3/endpoints/4ca59a72bf3342f3a56a1f6ed2a62f81` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:26.508812 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d013bcb0-f46d-4a22-8724-ea8adbc4663b tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=4ca59a72bf3342f3a56a1f6ed2a62f81)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:26.515818 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d013bcb0-f46d-4a22-8724-ea8adbc4663b tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:26.550714 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d013bcb0-f46d-4a22-8724-ea8adbc4663b tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '4ca59a72bf3342f3a56a1f6ed2a62f81', 'request_id': 'req-d013bcb0-f46d-4a22-8724-ea8adbc4663b'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:26.553474 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:26.583154 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2996/5998] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:26 2022] DELETE /identity/v3/endpoints/4ca59a72bf3342f3a56a1f6ed2a62f81 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:26.584649 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013bcb0-f46d-4a22-8724-ea8adbc4663b tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:26.647353 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:26.655695 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0ac0a128-5d25-4450-927e-3741e67de04d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '218398aa27b948e896d6d175e37450d7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:26.659343 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0ac0a128-5d25-4450-927e-3741e67de04d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '218398aa27b948e896d6d175e37450d7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:26.665109 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013bcb0-f46d-4a22-8724-ea8adbc4663b tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:26.674111 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa7f54-be90-4df1-b66e-62ba50ba1a65 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f9ef97de4b4d9bb2ae536cb62e32b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14fc132d27f34c27a666dd8228555a98', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:26.675169 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa7f54-be90-4df1-b66e-62ba50ba1a65 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:26.675766 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa7f54-be90-4df1-b66e-62ba50ba1a65 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:26.676268 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa7f54-be90-4df1-b66e-62ba50ba1a65 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] PATH_INFO: `/v3/regions/tempest-region-1731804326` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:26.677089 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa7f54-be90-4df1-b66e-62ba50ba1a65 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1731804326)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:26.678971 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa7f54-be90-4df1-b66e-62ba50ba1a65 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:26.681728 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0ac0a128-5d25-4450-927e-3741e67de04d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '218398aa27b948e896d6d175e37450d7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:26.697240 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0ac0a128-5d25-4450-927e-3741e67de04d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '218398aa27b948e896d6d175e37450d7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:26.704496 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0ac0a128-5d25-4450-927e-3741e67de04d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '218398aa27b948e896d6d175e37450d7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:26.735321 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2997/5999] 10.222.0.83 () {58 vars in 1209 bytes} [Mon Aug 29 16:05:26 2022] DELETE /identity/v3/regions/tempest-region-1731804326 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:05:26.736943 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa7f54-be90-4df1-b66e-62ba50ba1a65 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:26.738945 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f9fa7f54-be90-4df1-b66e-62ba50ba1a65 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:26.744506 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3003/6000] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:05:26 2022] DELETE /identity/v3/users/218398aa27b948e896d6d175e37450d7 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:26.745410 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0a128-5d25-4450-927e-3741e67de04d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:26.747928 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0ac0a128-5d25-4450-927e-3741e67de04d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:26.781646 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa7f54-be90-4df1-b66e-62ba50ba1a65 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:26.856053 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516f407-f451-4c98-9b34-8afd3a384faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:26.857351 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516f407-f451-4c98-9b34-8afd3a384faf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:26.857771 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516f407-f451-4c98-9b34-8afd3a384faf admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:26.858203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516f407-f451-4c98-9b34-8afd3a384faf admin admin] PATH_INFO: `/v3/users/389a799713e3437fa9b4982c71f8147f` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:26.859757 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8516f407-f451-4c98-9b34-8afd3a384faf admin admin] RBAC: Authorizing `identity:delete_user(user_id=389a799713e3437fa9b4982c71f8147f)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:26.862224 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8516f407-f451-4c98-9b34-8afd3a384faf admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:26.950966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0a128-5d25-4450-927e-3741e67de04d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:26.966278 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8516f407-f451-4c98-9b34-8afd3a384faf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '389a799713e3437fa9b4982c71f8147f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:26.968297 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8516f407-f451-4c98-9b34-8afd3a384faf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '389a799713e3437fa9b4982c71f8147f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:26.994012 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8516f407-f451-4c98-9b34-8afd3a384faf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '389a799713e3437fa9b4982c71f8147f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:27.001318 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc3351-8ba7-444f-85ec-110370856ae5 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f9ef97de4b4d9bb2ae536cb62e32b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14fc132d27f34c27a666dd8228555a98', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:27.001746 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc3351-8ba7-444f-85ec-110370856ae5 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:27.002039 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc3351-8ba7-444f-85ec-110370856ae5 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:27.002307 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc3351-8ba7-444f-85ec-110370856ae5 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] PATH_INFO: `/v3/services/67c930d1e4e848eea76e3d119885415a` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:27.003010 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc3351-8ba7-444f-85ec-110370856ae5 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorizing `identity:delete_service(service_id=67c930d1e4e848eea76e3d119885415a)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:27.009426 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8516f407-f451-4c98-9b34-8afd3a384faf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '389a799713e3437fa9b4982c71f8147f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:27.010149 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc3351-8ba7-444f-85ec-110370856ae5 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:27.022803 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8516f407-f451-4c98-9b34-8afd3a384faf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '389a799713e3437fa9b4982c71f8147f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:27.034698 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2998/6001] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:05:26 2022] DELETE /identity/v3/users/389a799713e3437fa9b4982c71f8147f => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:27.066373 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3004/6002] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:26 2022] DELETE /identity/v3/services/67c930d1e4e848eea76e3d119885415a => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:27.067863 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516f407-f451-4c98-9b34-8afd3a384faf admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:27.070068 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8516f407-f451-4c98-9b34-8afd3a384faf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:27.143443 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:27.203645 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516f407-f451-4c98-9b34-8afd3a384faf admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:27.235674 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870fee44-3a19-4613-85ec-029071a66bd2 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f9ef97de4b4d9bb2ae536cb62e32b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14fc132d27f34c27a666dd8228555a98', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:27.239655 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870fee44-3a19-4613-85ec-029071a66bd2 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:27.240118 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870fee44-3a19-4613-85ec-029071a66bd2 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:27.240527 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870fee44-3a19-4613-85ec-029071a66bd2 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] PATH_INFO: `/v3/endpoints/12e4bd1af0ef48e4b3ec5cae3773089f` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:27.247139 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870fee44-3a19-4613-85ec-029071a66bd2 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=12e4bd1af0ef48e4b3ec5cae3773089f)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:27.250528 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870fee44-3a19-4613-85ec-029071a66bd2 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:27.275551 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-870fee44-3a19-4613-85ec-029071a66bd2 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '12e4bd1af0ef48e4b3ec5cae3773089f', 'request_id': 'req-870fee44-3a19-4613-85ec-029071a66bd2'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:27.299301 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc3351-8ba7-444f-85ec-110370856ae5 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:27.299723 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 2999/6003] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:27 2022] DELETE /identity/v3/endpoints/12e4bd1af0ef48e4b3ec5cae3773089f => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:27.312158 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc3351-8ba7-444f-85ec-110370856ae5 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:27.352767 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b3475-ef36-42ad-beed-3e419881c049 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f9ef97de4b4d9bb2ae536cb62e32b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14fc132d27f34c27a666dd8228555a98', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:27.353470 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b3475-ef36-42ad-beed-3e419881c049 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:27.360357 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b3475-ef36-42ad-beed-3e419881c049 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:27.360656 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b3475-ef36-42ad-beed-3e419881c049 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] PATH_INFO: `/v3/regions/tempest-region-1601797589` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:27.361340 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b3475-ef36-42ad-beed-3e419881c049 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1601797589)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:27.363701 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-649b3475-ef36-42ad-beed-3e419881c049 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:05:27.363701 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 16:05:27.363701 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 16:05:27.365313 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b3475-ef36-42ad-beed-3e419881c049 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:27.431340 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-649b3475-ef36-42ad-beed-3e419881c049 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1601797589. To ensure interoperability, identifiers should be a valid uuid. Aug 29 16:05:27.431340 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 29 16:05:27.431340 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 16:05:27.446584 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870fee44-3a19-4613-85ec-029071a66bd2 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:27.448440 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-870fee44-3a19-4613-85ec-029071a66bd2 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:27.458293 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3005/6004] 10.222.0.83 () {58 vars in 1209 bytes} [Mon Aug 29 16:05:27 2022] DELETE /identity/v3/regions/tempest-region-1601797589 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:27.483580 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b3475-ef36-42ad-beed-3e419881c049 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:27.583961 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b3475-ef36-42ad-beed-3e419881c049 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:27.605319 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788980e3-0c97-46fb-9f78-f0a2a55da1f5 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f9ef97de4b4d9bb2ae536cb62e32b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14fc132d27f34c27a666dd8228555a98', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:27.605319 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788980e3-0c97-46fb-9f78-f0a2a55da1f5 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:27.605319 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788980e3-0c97-46fb-9f78-f0a2a55da1f5 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:27.605740 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788980e3-0c97-46fb-9f78-f0a2a55da1f5 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] PATH_INFO: `/v3/services/11dbd7b687b1406f81630ca43cffd835` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:27.605740 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788980e3-0c97-46fb-9f78-f0a2a55da1f5 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorizing `identity:delete_service(service_id=11dbd7b687b1406f81630ca43cffd835)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:27.608912 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788980e3-0c97-46fb-9f78-f0a2a55da1f5 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:27.699275 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3006/6005] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:27 2022] DELETE /identity/v3/services/11dbd7b687b1406f81630ca43cffd835 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:27.704854 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788980e3-0c97-46fb-9f78-f0a2a55da1f5 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:27.709545 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-788980e3-0c97-46fb-9f78-f0a2a55da1f5 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:27.782345 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870fee44-3a19-4613-85ec-029071a66bd2 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:27.824266 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebb89e-83d3-4ff1-a7df-efb4542d453e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:27.824660 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:27.826204 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebb89e-83d3-4ff1-a7df-efb4542d453e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:27.827971 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebb89e-83d3-4ff1-a7df-efb4542d453e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:27.829529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebb89e-83d3-4ff1-a7df-efb4542d453e admin admin] PATH_INFO: `/v3/projects/c10c6040801b43abab86d5e744946449` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:27.832190 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ebb89e-83d3-4ff1-a7df-efb4542d453e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c10c6040801b43abab86d5e744946449)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:27.835276 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ebb89e-83d3-4ff1-a7df-efb4542d453e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:27.973990 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788980e3-0c97-46fb-9f78-f0a2a55da1f5 tempest-EndPointsTestJSON-54155129 tempest-EndPointsTestJSON-54155129-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:27.977940 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-00ebb89e-83d3-4ff1-a7df-efb4542d453e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c10c6040801b43abab86d5e744946449', 'request_id': 'req-00ebb89e-83d3-4ff1-a7df-efb4542d453e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:27.993320 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-00ebb89e-83d3-4ff1-a7df-efb4542d453e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c10c6040801b43abab86d5e744946449', 'request_id': 'req-00ebb89e-83d3-4ff1-a7df-efb4542d453e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:28.015396 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-00ebb89e-83d3-4ff1-a7df-efb4542d453e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c10c6040801b43abab86d5e744946449', 'request_id': 'req-00ebb89e-83d3-4ff1-a7df-efb4542d453e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:28.034303 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-00ebb89e-83d3-4ff1-a7df-efb4542d453e admin admin] The token cache is being invalidate because project c10c6040801b43abab86d5e744946449 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:28.038810 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-00ebb89e-83d3-4ff1-a7df-efb4542d453e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:28.040282 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-00ebb89e-83d3-4ff1-a7df-efb4542d453e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:28.051145 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3000/6006] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:27 2022] DELETE /identity/v3/projects/c10c6040801b43abab86d5e744946449 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:05:28.052309 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebb89e-83d3-4ff1-a7df-efb4542d453e admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:28.057533 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-00ebb89e-83d3-4ff1-a7df-efb4542d453e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:28.156302 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4847024-28e3-4781-ba06-6d62c9f35a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:28.157438 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4847024-28e3-4781-ba06-6d62c9f35a04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:28.157909 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4847024-28e3-4781-ba06-6d62c9f35a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:28.158392 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4847024-28e3-4781-ba06-6d62c9f35a04 admin admin] PATH_INFO: `/v3/users/56dd02ed327b45449672ce2651c6b1ae` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:28.159825 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4847024-28e3-4781-ba06-6d62c9f35a04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56dd02ed327b45449672ce2651c6b1ae)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:28.162684 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4847024-28e3-4781-ba06-6d62c9f35a04 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:28.173914 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:28.284176 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d4847024-28e3-4781-ba06-6d62c9f35a04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56dd02ed327b45449672ce2651c6b1ae'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:28.284891 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d4847024-28e3-4781-ba06-6d62c9f35a04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56dd02ed327b45449672ce2651c6b1ae'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:28.307277 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d4847024-28e3-4781-ba06-6d62c9f35a04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56dd02ed327b45449672ce2651c6b1ae'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:28.320553 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d4847024-28e3-4781-ba06-6d62c9f35a04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56dd02ed327b45449672ce2651c6b1ae'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:28.321331 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d4847024-28e3-4781-ba06-6d62c9f35a04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56dd02ed327b45449672ce2651c6b1ae'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:28.353505 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3007/6007] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:05:27 2022] DELETE /identity/v3/users/56dd02ed327b45449672ce2651c6b1ae => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:28.353505 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4847024-28e3-4781-ba06-6d62c9f35a04 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:28.354836 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d4847024-28e3-4781-ba06-6d62c9f35a04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:28.372020 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebb89e-83d3-4ff1-a7df-efb4542d453e admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:28.470088 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:28.479046 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4847024-28e3-4781-ba06-6d62c9f35a04 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:28.492554 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f628b90-5b27-481c-ae73-40e9e0be26c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:28.493941 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f628b90-5b27-481c-ae73-40e9e0be26c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:28.496888 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f628b90-5b27-481c-ae73-40e9e0be26c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:28.497475 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f628b90-5b27-481c-ae73-40e9e0be26c6 admin admin] PATH_INFO: `/v3/projects/43c0ff09dad447fba23e6fd9161290b2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:28.501163 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f628b90-5b27-481c-ae73-40e9e0be26c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43c0ff09dad447fba23e6fd9161290b2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:28.505442 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f628b90-5b27-481c-ae73-40e9e0be26c6 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:28.570057 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1c26b-71da-4ece-83a3-a7ae3eb653e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:28.573773 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1c26b-71da-4ece-83a3-a7ae3eb653e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:28.574695 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2f628b90-5b27-481c-ae73-40e9e0be26c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43c0ff09dad447fba23e6fd9161290b2', 'request_id': 'req-2f628b90-5b27-481c-ae73-40e9e0be26c6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:28.575997 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1c26b-71da-4ece-83a3-a7ae3eb653e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:28.576399 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1c26b-71da-4ece-83a3-a7ae3eb653e9 admin admin] PATH_INFO: `/v3/users/ce80cc454f78432ca7b20ba704c64db5` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:28.581693 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2f628b90-5b27-481c-ae73-40e9e0be26c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43c0ff09dad447fba23e6fd9161290b2', 'request_id': 'req-2f628b90-5b27-481c-ae73-40e9e0be26c6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:28.584025 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b1c26b-71da-4ece-83a3-a7ae3eb653e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce80cc454f78432ca7b20ba704c64db5)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:28.590455 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2f628b90-5b27-481c-ae73-40e9e0be26c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43c0ff09dad447fba23e6fd9161290b2', 'request_id': 'req-2f628b90-5b27-481c-ae73-40e9e0be26c6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:28.602103 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b1c26b-71da-4ece-83a3-a7ae3eb653e9 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:28.621352 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2f628b90-5b27-481c-ae73-40e9e0be26c6 admin admin] The token cache is being invalidate because project 43c0ff09dad447fba23e6fd9161290b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:28.621947 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2f628b90-5b27-481c-ae73-40e9e0be26c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:28.624271 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2f628b90-5b27-481c-ae73-40e9e0be26c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:28.627089 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3008/6008] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:28 2022] DELETE /identity/v3/projects/43c0ff09dad447fba23e6fd9161290b2 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:28.628855 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f628b90-5b27-481c-ae73-40e9e0be26c6 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:28.630946 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2f628b90-5b27-481c-ae73-40e9e0be26c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:28.693557 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-25b1c26b-71da-4ece-83a3-a7ae3eb653e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce80cc454f78432ca7b20ba704c64db5'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:28.695140 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-25b1c26b-71da-4ece-83a3-a7ae3eb653e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce80cc454f78432ca7b20ba704c64db5'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:28.735177 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-25b1c26b-71da-4ece-83a3-a7ae3eb653e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce80cc454f78432ca7b20ba704c64db5'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:28.775894 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-25b1c26b-71da-4ece-83a3-a7ae3eb653e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce80cc454f78432ca7b20ba704c64db5'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:28.798382 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-25b1c26b-71da-4ece-83a3-a7ae3eb653e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce80cc454f78432ca7b20ba704c64db5'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:28.810196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f628b90-5b27-481c-ae73-40e9e0be26c6 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:28.822393 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3001/6009] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:05:28 2022] DELETE /identity/v3/users/ce80cc454f78432ca7b20ba704c64db5 => generated 0 bytes in 770 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:28.824144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3969f66-efad-425d-af45-f52859817790 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:28.832510 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3969f66-efad-425d-af45-f52859817790 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:28.833058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3969f66-efad-425d-af45-f52859817790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:28.833177 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fcd211-8fd7-48bf-8b69-ea7c89a7ceb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:28.833788 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcd211-8fd7-48bf-8b69-ea7c89a7ceb2 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:28.834073 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcd211-8fd7-48bf-8b69-ea7c89a7ceb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:28.834348 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcd211-8fd7-48bf-8b69-ea7c89a7ceb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:28.840614 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-98fcd211-8fd7-48bf-8b69-ea7c89a7ceb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:28.871463 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fcd211-8fd7-48bf-8b69-ea7c89a7ceb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:28.872937 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fcd211-8fd7-48bf-8b69-ea7c89a7ceb2 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:28.884701 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-d3969f66-efad-425d-af45-f52859817790 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:28.886030 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d3969f66-efad-425d-af45-f52859817790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:28.902459 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3009/6010] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:05:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:05:28.926138 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bd119-4c78-422e-82a9-126c5fd8804e None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:28.926431 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bd119-4c78-422e-82a9-126c5fd8804e None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:28.926714 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bd119-4c78-422e-82a9-126c5fd8804e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:28.978192 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-c65bd119-4c78-422e-82a9-126c5fd8804e None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:28.981413 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c65bd119-4c78-422e-82a9-126c5fd8804e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:29.027049 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:29.075476 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3002/6011] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:29.076637 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3969f66-efad-425d-af45-f52859817790 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:29.077806 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d3969f66-efad-425d-af45-f52859817790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:29.120498 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3010/6012] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:29.131305 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bd119-4c78-422e-82a9-126c5fd8804e None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:29.133756 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c65bd119-4c78-422e-82a9-126c5fd8804e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:29.198168 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:29.284285 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bd119-4c78-422e-82a9-126c5fd8804e None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:29.293942 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaddf5d3-3468-4707-bcb1-6611b5b36aa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:29.299863 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddf5d3-3468-4707-bcb1-6611b5b36aa6 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:29.301065 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddf5d3-3468-4707-bcb1-6611b5b36aa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:29.301359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddf5d3-3468-4707-bcb1-6611b5b36aa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:29.307512 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3969f66-efad-425d-af45-f52859817790 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:29.315405 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11bb825-9267-4131-bca2-2ce4e0fe3c64 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:29.316264 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11bb825-9267-4131-bca2-2ce4e0fe3c64 service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:29.316548 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11bb825-9267-4131-bca2-2ce4e0fe3c64 service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:29.316852 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11bb825-9267-4131-bca2-2ce4e0fe3c64 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:29.320048 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a11bb825-9267-4131-bca2-2ce4e0fe3c64 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:29.327138 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaddf5d3-3468-4707-bcb1-6611b5b36aa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:29.329792 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaddf5d3-3468-4707-bcb1-6611b5b36aa6 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:29.346248 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3011/6013] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:05:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:05:29.350104 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b73333-6a9a-41f2-aaae-2f728ed0d12e None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:29.350396 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b73333-6a9a-41f2-aaae-2f728ed0d12e None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:29.350673 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b73333-6a9a-41f2-aaae-2f728ed0d12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:29.380935 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11bb825-9267-4131-bca2-2ce4e0fe3c64 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:29.386463 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11bb825-9267-4131-bca2-2ce4e0fe3c64 service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:29.407287 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-c8b73333-6a9a-41f2-aaae-2f728ed0d12e None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:29.409209 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c8b73333-6a9a-41f2-aaae-2f728ed0d12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:29.412567 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3003/6014] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:05:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:05:29.413441 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11bb825-9267-4131-bca2-2ce4e0fe3c64 service placement] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:29.418775 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a11bb825-9267-4131-bca2-2ce4e0fe3c64 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:29.421915 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3012/6015] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:29.426912 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b73333-6a9a-41f2-aaae-2f728ed0d12e None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:29.439311 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b73333-6a9a-41f2-aaae-2f728ed0d12e None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:29.439978 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11bb825-9267-4131-bca2-2ce4e0fe3c64 service placement] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:29.445845 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f640ff4-7025-449d-80bc-392560661865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:29.446773 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f640ff4-7025-449d-80bc-392560661865 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:29.447470 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5bf52-48ad-46c0-b37d-6e77ae958ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:29.448066 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f640ff4-7025-449d-80bc-392560661865 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:29.448337 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f640ff4-7025-449d-80bc-392560661865 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:29.449391 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f640ff4-7025-449d-80bc-392560661865 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:05:29.449768 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f640ff4-7025-449d-80bc-392560661865 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:29.450060 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5bf52-48ad-46c0-b37d-6e77ae958ded admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:29.450403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5bf52-48ad-46c0-b37d-6e77ae958ded admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:29.451272 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5bf52-48ad-46c0-b37d-6e77ae958ded admin admin] PATH_INFO: `/v3/projects/f6e3618936764ee3a9bad35ddd764c9f` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:29.451809 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f640ff4-7025-449d-80bc-392560661865 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:29.453141 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d5bf52-48ad-46c0-b37d-6e77ae958ded admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6e3618936764ee3a9bad35ddd764c9f)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:29.456906 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d5bf52-48ad-46c0-b37d-6e77ae958ded admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:29.476364 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3013/6016] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:29.478627 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f640ff4-7025-449d-80bc-392560661865 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:29.494581 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f640ff4-7025-449d-80bc-392560661865 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:29.502313 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae45a5-d7ce-46f9-b0f3-2cba498bb8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:29.503142 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae45a5-d7ce-46f9-b0f3-2cba498bb8e9 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:29.503503 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae45a5-d7ce-46f9-b0f3-2cba498bb8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:29.504216 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae45a5-d7ce-46f9-b0f3-2cba498bb8e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:29.505368 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae45a5-d7ce-46f9-b0f3-2cba498bb8e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:29.508001 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae45a5-d7ce-46f9-b0f3-2cba498bb8e9 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:29.555517 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-99d5bf52-48ad-46c0-b37d-6e77ae958ded admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6e3618936764ee3a9bad35ddd764c9f', 'request_id': 'req-99d5bf52-48ad-46c0-b37d-6e77ae958ded'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:29.561502 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3014/6017] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:05:29 2022] POST /identity/v3/projects => generated 367 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:29.562492 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae45a5-d7ce-46f9-b0f3-2cba498bb8e9 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:29.570549 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-99d5bf52-48ad-46c0-b37d-6e77ae958ded admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6e3618936764ee3a9bad35ddd764c9f', 'request_id': 'req-99d5bf52-48ad-46c0-b37d-6e77ae958ded'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:29.594465 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-99d5bf52-48ad-46c0-b37d-6e77ae958ded admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6e3618936764ee3a9bad35ddd764c9f', 'request_id': 'req-99d5bf52-48ad-46c0-b37d-6e77ae958ded'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:29.611702 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-99d5bf52-48ad-46c0-b37d-6e77ae958ded admin admin] The token cache is being invalidate because project f6e3618936764ee3a9bad35ddd764c9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:29.612243 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-99d5bf52-48ad-46c0-b37d-6e77ae958ded admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:29.613388 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-99d5bf52-48ad-46c0-b37d-6e77ae958ded admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:29.617123 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3004/6018] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:29 2022] DELETE /identity/v3/projects/f6e3618936764ee3a9bad35ddd764c9f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:29.627416 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2540b5-3e5b-4a85-9fec-4f8762ffd5fa None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:29.628341 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2540b5-3e5b-4a85-9fec-4f8762ffd5fa None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:29.628737 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2540b5-3e5b-4a85-9fec-4f8762ffd5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:29.662981 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-2b2540b5-3e5b-4a85-9fec-4f8762ffd5fa None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:29.664673 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2b2540b5-3e5b-4a85-9fec-4f8762ffd5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:29.705496 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae45a5-d7ce-46f9-b0f3-2cba498bb8e9 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:29.714095 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7cad7-1e4c-44d6-b371-70aa452a0e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:29.715250 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7cad7-1e4c-44d6-b371-70aa452a0e5e admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:29.715484 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7cad7-1e4c-44d6-b371-70aa452a0e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:29.715764 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7cad7-1e4c-44d6-b371-70aa452a0e5e admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:29.716404 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7cad7-1e4c-44d6-b371-70aa452a0e5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:29.724840 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7cad7-1e4c-44d6-b371-70aa452a0e5e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:29.778014 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3015/6019] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:05:29 2022] POST /identity/v3/users => generated 284 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:29.781843 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7cad7-1e4c-44d6-b371-70aa452a0e5e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:29.793751 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e8c7cad7-1e4c-44d6-b371-70aa452a0e5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:29.816258 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:29.827056 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7cad7-1e4c-44d6-b371-70aa452a0e5e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:29.835677 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d03c8e-401d-4ab5-89c7-a956c0e3c521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:29.836301 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d03c8e-401d-4ab5-89c7-a956c0e3c521 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:29.836577 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d03c8e-401d-4ab5-89c7-a956c0e3c521 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:29.836844 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d03c8e-401d-4ab5-89c7-a956c0e3c521 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:29.837554 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d03c8e-401d-4ab5-89c7-a956c0e3c521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:29.839238 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d03c8e-401d-4ab5-89c7-a956c0e3c521 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:29.851404 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3005/6020] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:29.853572 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c3aee-590a-4fcd-b96c-7c40f8cd1599 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:29.854819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c3aee-590a-4fcd-b96c-7c40f8cd1599 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:29.855147 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c3aee-590a-4fcd-b96c-7c40f8cd1599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:29.859886 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3016/6021] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:29.861985 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d03c8e-401d-4ab5-89c7-a956c0e3c521 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:29.876873 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d03c8e-401d-4ab5-89c7-a956c0e3c521 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:29.883787 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd070c2-17fc-4f4f-b2b6-2be1d86faca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:29.884555 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd070c2-17fc-4f4f-b2b6-2be1d86faca8 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:29.884842 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd070c2-17fc-4f4f-b2b6-2be1d86faca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:29.885109 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd070c2-17fc-4f4f-b2b6-2be1d86faca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:29.885865 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd070c2-17fc-4f4f-b2b6-2be1d86faca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:29.887589 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd070c2-17fc-4f4f-b2b6-2be1d86faca8 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:29.903706 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3017/6022] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:29.905482 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd070c2-17fc-4f4f-b2b6-2be1d86faca8 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:29.906582 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-0a8c3aee-590a-4fcd-b96c-7c40f8cd1599 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:29.909579 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0a8c3aee-590a-4fcd-b96c-7c40f8cd1599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:29.924684 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd070c2-17fc-4f4f-b2b6-2be1d86faca8 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:29.940870 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3006/6023] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:05:29.942407 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c3aee-590a-4fcd-b96c-7c40f8cd1599 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:29.944959 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd10e4-bdb0-427b-a873-d246fdf9d550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:29.945760 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd10e4-bdb0-427b-a873-d246fdf9d550 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:29.947145 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd10e4-bdb0-427b-a873-d246fdf9d550 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:29.948623 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd10e4-bdb0-427b-a873-d246fdf9d550 admin admin] PATH_INFO: `/v3/projects/2db4e78ac3604fff8f557c034933a0a2/users/a280770882e24d8d9146ce4c044866d1/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:29.962460 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c3aee-590a-4fcd-b96c-7c40f8cd1599 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:29.971603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9736b0-f070-4a87-b802-3129e830c5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:29.972767 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9736b0-f070-4a87-b802-3129e830c5c7 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:29.974439 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9736b0-f070-4a87-b802-3129e830c5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:29.987966 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9736b0-f070-4a87-b802-3129e830c5c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:29.988712 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9736b0-f070-4a87-b802-3129e830c5c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:05:29.989019 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9736b0-f070-4a87-b802-3129e830c5c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:29.992837 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9736b0-f070-4a87-b802-3129e830c5c7 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:30.009437 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3007/6024] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:30.010345 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9736b0-f070-4a87-b802-3129e830c5c7 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:30.014893 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd10e4-bdb0-427b-a873-d246fdf9d550 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2db4e78ac3604fff8f557c034933a0a2, user_id=a280770882e24d8d9146ce4c044866d1, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:30.015070 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5a9736b0-f070-4a87-b802-3129e830c5c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:30.021491 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd10e4-bdb0-427b-a873-d246fdf9d550 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:30.059861 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3018/6025] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:05:29 2022] PUT /identity/v3/projects/2db4e78ac3604fff8f557c034933a0a2/users/a280770882e24d8d9146ce4c044866d1/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:30.061215 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd10e4-bdb0-427b-a873-d246fdf9d550 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:30.204391 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9736b0-f070-4a87-b802-3129e830c5c7 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:30.212715 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:30.308410 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6795ba-1f7b-4bfa-a6dc-886a4f9be3a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:30.309034 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6795ba-1f7b-4bfa-a6dc-886a4f9be3a6 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:30.309311 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6795ba-1f7b-4bfa-a6dc-886a4f9be3a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:30.309640 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6795ba-1f7b-4bfa-a6dc-886a4f9be3a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:30.313137 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-cf6795ba-1f7b-4bfa-a6dc-886a4f9be3a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:30.320862 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd10e4-bdb0-427b-a873-d246fdf9d550 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:30.329225 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0d342-e2f1-4b15-acd3-acfc73b87ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:30.329987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0d342-e2f1-4b15-acd3-acfc73b87ef8 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:30.330274 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0d342-e2f1-4b15-acd3-acfc73b87ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:30.330598 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0d342-e2f1-4b15-acd3-acfc73b87ef8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:30.331290 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a0d342-e2f1-4b15-acd3-acfc73b87ef8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:30.335952 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a0d342-e2f1-4b15-acd3-acfc73b87ef8 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:30.368592 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6795ba-1f7b-4bfa-a6dc-886a4f9be3a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:30.374191 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6795ba-1f7b-4bfa-a6dc-886a4f9be3a6 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:30.395705 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3008/6026] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:05:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:05:30.399465 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d1953-69ab-4baa-aa4e-270ca6af8e80 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:30.401149 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d1953-69ab-4baa-aa4e-270ca6af8e80 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:30.401955 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d1953-69ab-4baa-aa4e-270ca6af8e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:30.434043 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3019/6027] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:05:30 2022] POST /identity/v3/projects => generated 381 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:30.435292 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0d342-e2f1-4b15-acd3-acfc73b87ef8 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:30.438536 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e3a0d342-e2f1-4b15-acd3-acfc73b87ef8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:30.494405 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-db0d1953-69ab-4baa-aa4e-270ca6af8e80 None None] MFA Rules not processed for user `a280770882e24d8d9146ce4c044866d1`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:30.495830 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-db0d1953-69ab-4baa-aa4e-270ca6af8e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:30.602474 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0d342-e2f1-4b15-acd3-acfc73b87ef8 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:30.613731 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e24163-24b0-4814-a5f1-1d0abfba02a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:30.614395 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e24163-24b0-4814-a5f1-1d0abfba02a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:30.614821 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e24163-24b0-4814-a5f1-1d0abfba02a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:30.615201 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e24163-24b0-4814-a5f1-1d0abfba02a3 admin admin] PATH_INFO: `/v3/projects/1fa19a3a6d614d309bff00ded0769611` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:30.616360 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e24163-24b0-4814-a5f1-1d0abfba02a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fa19a3a6d614d309bff00ded0769611)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:30.619100 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e24163-24b0-4814-a5f1-1d0abfba02a3 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:30.645856 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3009/6028] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:30.646749 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d1953-69ab-4baa-aa4e-270ca6af8e80 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:30.684781 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d1953-69ab-4baa-aa4e-270ca6af8e80 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:30.721299 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-18e24163-24b0-4814-a5f1-1d0abfba02a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fa19a3a6d614d309bff00ded0769611', 'request_id': 'req-18e24163-24b0-4814-a5f1-1d0abfba02a3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:30.725902 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:30.749505 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-18e24163-24b0-4814-a5f1-1d0abfba02a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fa19a3a6d614d309bff00ded0769611', 'request_id': 'req-18e24163-24b0-4814-a5f1-1d0abfba02a3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:30.758645 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-18e24163-24b0-4814-a5f1-1d0abfba02a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fa19a3a6d614d309bff00ded0769611', 'request_id': 'req-18e24163-24b0-4814-a5f1-1d0abfba02a3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:30.789134 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-18e24163-24b0-4814-a5f1-1d0abfba02a3 admin admin] The token cache is being invalidate because project 1fa19a3a6d614d309bff00ded0769611 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:30.789469 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-18e24163-24b0-4814-a5f1-1d0abfba02a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:30.791501 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-18e24163-24b0-4814-a5f1-1d0abfba02a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:30.796612 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3020/6029] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:30 2022] DELETE /identity/v3/projects/1fa19a3a6d614d309bff00ded0769611 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:30.796612 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e24163-24b0-4814-a5f1-1d0abfba02a3 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:30.797517 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-18e24163-24b0-4814-a5f1-1d0abfba02a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:30.817829 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577db13b-ede6-47e8-a908-cba30ad27310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:30.818463 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577db13b-ede6-47e8-a908-cba30ad27310 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:30.818776 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577db13b-ede6-47e8-a908-cba30ad27310 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:30.818897 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577db13b-ede6-47e8-a908-cba30ad27310 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:30.819744 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577db13b-ede6-47e8-a908-cba30ad27310 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:30.821668 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577db13b-ede6-47e8-a908-cba30ad27310 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:30.854700 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3010/6030] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:05:30 2022] POST /identity/v3/users => generated 291 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:30.855654 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577db13b-ede6-47e8-a908-cba30ad27310 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:30.857481 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-577db13b-ede6-47e8-a908-cba30ad27310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:30.859436 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:30.919166 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577db13b-ede6-47e8-a908-cba30ad27310 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:30.925416 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73814df-b33c-4eb3-b292-9a7f6e5ed284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:30.926026 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73814df-b33c-4eb3-b292-9a7f6e5ed284 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:30.926757 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73814df-b33c-4eb3-b292-9a7f6e5ed284 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:30.926757 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73814df-b33c-4eb3-b292-9a7f6e5ed284 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:30.933539 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73814df-b33c-4eb3-b292-9a7f6e5ed284 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:30.936608 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73814df-b33c-4eb3-b292-9a7f6e5ed284 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:30.956137 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e24163-24b0-4814-a5f1-1d0abfba02a3 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:30.972865 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9476c0-afff-4c15-95b3-2dcffef6156b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:30.974292 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9476c0-afff-4c15-95b3-2dcffef6156b service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:30.974573 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9476c0-afff-4c15-95b3-2dcffef6156b service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:30.974845 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9476c0-afff-4c15-95b3-2dcffef6156b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:30.979165 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ab9476c0-afff-4c15-95b3-2dcffef6156b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:30.980814 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3011/6031] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:05:30 2022] POST /identity/v3/projects => generated 369 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:30.981777 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73814df-b33c-4eb3-b292-9a7f6e5ed284 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:30.984865 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f73814df-b33c-4eb3-b292-9a7f6e5ed284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:30.995581 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9476c0-afff-4c15-95b3-2dcffef6156b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:30.999406 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9476c0-afff-4c15-95b3-2dcffef6156b service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:31.013631 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3021/6032] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:05:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:05:31.015579 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9476c0-afff-4c15-95b3-2dcffef6156b service placement] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:31.017209 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ab9476c0-afff-4c15-95b3-2dcffef6156b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:31.042085 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9476c0-afff-4c15-95b3-2dcffef6156b service placement] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:31.138815 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73814df-b33c-4eb3-b292-9a7f6e5ed284 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:31.145085 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d82e6-c7fa-4dce-92da-fdce9df87eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:31.145956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d82e6-c7fa-4dce-92da-fdce9df87eef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:31.146536 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d82e6-c7fa-4dce-92da-fdce9df87eef admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:31.146965 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d82e6-c7fa-4dce-92da-fdce9df87eef admin admin] PATH_INFO: `/v3/users/22f9ef97de4b4d9bb2ae536cb62e32b4` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:31.148354 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d82e6-c7fa-4dce-92da-fdce9df87eef admin admin] RBAC: Authorizing `identity:delete_user(user_id=22f9ef97de4b4d9bb2ae536cb62e32b4)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:31.150511 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d82e6-c7fa-4dce-92da-fdce9df87eef admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:31.184069 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd55a6d-b02b-4cfa-9697-ea43c3f35cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:31.186538 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd55a6d-b02b-4cfa-9697-ea43c3f35cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:31.188276 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd55a6d-b02b-4cfa-9697-ea43c3f35cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:31.190496 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd55a6d-b02b-4cfa-9697-ea43c3f35cc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:31.191451 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd55a6d-b02b-4cfa-9697-ea43c3f35cc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:31.195938 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd55a6d-b02b-4cfa-9697-ea43c3f35cc5 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:31.251514 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3022/6033] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:31.255360 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd55a6d-b02b-4cfa-9697-ea43c3f35cc5 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:31.269412 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5b8d82e6-c7fa-4dce-92da-fdce9df87eef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22f9ef97de4b4d9bb2ae536cb62e32b4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:31.270422 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5b8d82e6-c7fa-4dce-92da-fdce9df87eef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22f9ef97de4b4d9bb2ae536cb62e32b4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:31.281729 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:31.299647 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5b8d82e6-c7fa-4dce-92da-fdce9df87eef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22f9ef97de4b4d9bb2ae536cb62e32b4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:31.302950 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd55a6d-b02b-4cfa-9697-ea43c3f35cc5 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:31.334853 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5b8d82e6-c7fa-4dce-92da-fdce9df87eef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22f9ef97de4b4d9bb2ae536cb62e32b4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:31.351875 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df43702e-24eb-40d4-9552-9f56ec0e67bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:31.353219 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43702e-24eb-40d4-9552-9f56ec0e67bd admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:31.353807 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43702e-24eb-40d4-9552-9f56ec0e67bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:31.354030 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5b8d82e6-c7fa-4dce-92da-fdce9df87eef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22f9ef97de4b4d9bb2ae536cb62e32b4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:31.354136 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43702e-24eb-40d4-9552-9f56ec0e67bd admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:31.359273 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df43702e-24eb-40d4-9552-9f56ec0e67bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:31.359273 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df43702e-24eb-40d4-9552-9f56ec0e67bd admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:31.385862 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3012/6034] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:05:30 2022] DELETE /identity/v3/users/22f9ef97de4b4d9bb2ae536cb62e32b4 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:31.386944 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d82e6-c7fa-4dce-92da-fdce9df87eef admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:31.393913 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5b8d82e6-c7fa-4dce-92da-fdce9df87eef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:31.419333 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3023/6035] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:05:31 2022] POST /identity/v3/users => generated 291 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:31.420592 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df43702e-24eb-40d4-9552-9f56ec0e67bd admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:31.426785 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-df43702e-24eb-40d4-9552-9f56ec0e67bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:31.569015 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d82e6-c7fa-4dce-92da-fdce9df87eef admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:31.577333 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1919790a-6263-433e-aa8e-3c83a5337b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:31.577333 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919790a-6263-433e-aa8e-3c83a5337b20 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:31.577333 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919790a-6263-433e-aa8e-3c83a5337b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:31.577333 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919790a-6263-433e-aa8e-3c83a5337b20 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:31.577716 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1919790a-6263-433e-aa8e-3c83a5337b20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:31.580000 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1919790a-6263-433e-aa8e-3c83a5337b20 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:31.586424 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df43702e-24eb-40d4-9552-9f56ec0e67bd admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:31.604960 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3013/6036] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:31.604960 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1919790a-6263-433e-aa8e-3c83a5337b20 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:31.605351 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1919790a-6263-433e-aa8e-3c83a5337b20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:31.621510 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1919790a-6263-433e-aa8e-3c83a5337b20 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:31.628324 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6847a31-4ad2-430a-bc31-afa3fb5fa2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:31.628957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6847a31-4ad2-430a-bc31-afa3fb5fa2e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:31.629240 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6847a31-4ad2-430a-bc31-afa3fb5fa2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:31.634642 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6847a31-4ad2-430a-bc31-afa3fb5fa2e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:31.635938 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6847a31-4ad2-430a-bc31-afa3fb5fa2e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:31.642180 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6847a31-4ad2-430a-bc31-afa3fb5fa2e6 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:31.663235 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3014/6037] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:31.666778 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6847a31-4ad2-430a-bc31-afa3fb5fa2e6 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:31.678307 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:31.680996 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6847a31-4ad2-430a-bc31-afa3fb5fa2e6 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:31.690382 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d31baf-1efc-4a34-a860-312cd8133a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:31.691272 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d31baf-1efc-4a34-a860-312cd8133a5f admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:31.691819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d31baf-1efc-4a34-a860-312cd8133a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:31.692198 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d31baf-1efc-4a34-a860-312cd8133a5f admin admin] PATH_INFO: `/v3/projects/1dd597b5016441459719b4f2968ef1a6/users/8603e98b9d334bb4a05a5794ad51bd53/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:31.727633 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db310632-0ec8-4ccc-a333-63bf518e9eca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:31.729019 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db310632-0ec8-4ccc-a333-63bf518e9eca service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:31.731523 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db310632-0ec8-4ccc-a333-63bf518e9eca service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:31.732885 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db310632-0ec8-4ccc-a333-63bf518e9eca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:31.738519 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-db310632-0ec8-4ccc-a333-63bf518e9eca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:31.753262 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d31baf-1efc-4a34-a860-312cd8133a5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dd597b5016441459719b4f2968ef1a6, user_id=8603e98b9d334bb4a05a5794ad51bd53, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:31.765679 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d31baf-1efc-4a34-a860-312cd8133a5f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:31.808828 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3015/6038] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:05:31 2022] PUT /identity/v3/projects/1dd597b5016441459719b4f2968ef1a6/users/8603e98b9d334bb4a05a5794ad51bd53/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:31.808828 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d31baf-1efc-4a34-a860-312cd8133a5f admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:31.973475 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d31baf-1efc-4a34-a860-312cd8133a5f admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:31.985567 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd03117-cbf3-4d9e-89dd-e24cd5d2577a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:31.987434 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd03117-cbf3-4d9e-89dd-e24cd5d2577a admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:31.987867 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd03117-cbf3-4d9e-89dd-e24cd5d2577a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:31.988802 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd03117-cbf3-4d9e-89dd-e24cd5d2577a admin admin] PATH_INFO: `/v3/projects/984405c23591415eaf067cb43305057d/users/fa52b94a1308494bb283b7bfe4a1ce58/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:32.010793 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db310632-0ec8-4ccc-a333-63bf518e9eca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:32.013084 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db310632-0ec8-4ccc-a333-63bf518e9eca service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:32.019657 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd03117-cbf3-4d9e-89dd-e24cd5d2577a admin admin] RBAC: Authorizing `identity:create_grant(project_id=984405c23591415eaf067cb43305057d, user_id=fa52b94a1308494bb283b7bfe4a1ce58, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:32.023064 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd03117-cbf3-4d9e-89dd-e24cd5d2577a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:32.082185 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3024/6039] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:05:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 662 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:05:32.085718 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2cc365-5494-45a5-bf97-1b242a7dcadb None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:32.086013 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2cc365-5494-45a5-bf97-1b242a7dcadb None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:32.086292 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2cc365-5494-45a5-bf97-1b242a7dcadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:32.103169 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3016/6040] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:05:31 2022] PUT /identity/v3/projects/984405c23591415eaf067cb43305057d/users/fa52b94a1308494bb283b7bfe4a1ce58/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:32.105113 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd03117-cbf3-4d9e-89dd-e24cd5d2577a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:32.174517 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:32.176539 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-1f2cc365-5494-45a5-bf97-1b242a7dcadb None None] MFA Rules not processed for user `8603e98b9d334bb4a05a5794ad51bd53`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:32.177802 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1f2cc365-5494-45a5-bf97-1b242a7dcadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:32.319468 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3025/6041] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:32.320844 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2cc365-5494-45a5-bf97-1b242a7dcadb None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:32.333343 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd03117-cbf3-4d9e-89dd-e24cd5d2577a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:32.348143 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2cc365-5494-45a5-bf97-1b242a7dcadb None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:32.355702 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdefea3-a0f8-4623-9784-89217e794ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:32.356354 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdefea3-a0f8-4623-9784-89217e794ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:32.356645 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdefea3-a0f8-4623-9784-89217e794ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:32.356928 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdefea3-a0f8-4623-9784-89217e794ca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:32.358952 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdefea3-a0f8-4623-9784-89217e794ca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:32.367246 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db94e79-4dcf-45bb-82fa-315683130743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:32.368281 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db94e79-4dcf-45bb-82fa-315683130743 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:32.368697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db94e79-4dcf-45bb-82fa-315683130743 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:32.368848 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdefea3-a0f8-4623-9784-89217e794ca5 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:32.369263 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db94e79-4dcf-45bb-82fa-315683130743 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:32.370014 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db94e79-4dcf-45bb-82fa-315683130743 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:32.374977 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db94e79-4dcf-45bb-82fa-315683130743 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:32.417028 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3017/6042] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:32.424018 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdefea3-a0f8-4623-9784-89217e794ca5 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:32.460256 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3026/6043] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:05:32 2022] POST /identity/v3/projects => generated 379 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:32.461489 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db94e79-4dcf-45bb-82fa-315683130743 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:32.463886 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdefea3-a0f8-4623-9784-89217e794ca5 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:32.552586 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:32.637052 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db94e79-4dcf-45bb-82fa-315683130743 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:32.652372 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40124618-5f66-4c4b-a3a2-182f857de63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:32.652695 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40124618-5f66-4c4b-a3a2-182f857de63d admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:32.652987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40124618-5f66-4c4b-a3a2-182f857de63d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:32.653270 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40124618-5f66-4c4b-a3a2-182f857de63d admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:32.656576 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40124618-5f66-4c4b-a3a2-182f857de63d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:32.659380 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40124618-5f66-4c4b-a3a2-182f857de63d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:32.680323 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a085a3-eaf1-4bbe-a9a2-ba0b24fabb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:32.683233 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a085a3-eaf1-4bbe-a9a2-ba0b24fabb4f admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:32.684041 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a085a3-eaf1-4bbe-a9a2-ba0b24fabb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:32.685970 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a085a3-eaf1-4bbe-a9a2-ba0b24fabb4f admin admin] PATH_INFO: `/v3/projects/984405c23591415eaf067cb43305057d/users/fa52b94a1308494bb283b7bfe4a1ce58/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:32.690818 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a085a3-eaf1-4bbe-a9a2-ba0b24fabb4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=984405c23591415eaf067cb43305057d, user_id=fa52b94a1308494bb283b7bfe4a1ce58, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:32.696330 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a085a3-eaf1-4bbe-a9a2-ba0b24fabb4f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:32.726040 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3027/6044] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:05:32 2022] POST /identity/v3/users => generated 296 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:32.727126 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40124618-5f66-4c4b-a3a2-182f857de63d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:32.766458 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3018/6045] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:05:32 2022] PUT /identity/v3/projects/984405c23591415eaf067cb43305057d/users/fa52b94a1308494bb283b7bfe4a1ce58/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:32.767646 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a085a3-eaf1-4bbe-a9a2-ba0b24fabb4f admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:32.769592 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-89a085a3-eaf1-4bbe-a9a2-ba0b24fabb4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:32.793125 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40124618-5f66-4c4b-a3a2-182f857de63d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:32.960142 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08367c53-89bb-48fc-a71c-3784d2b392c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:32.961247 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08367c53-89bb-48fc-a71c-3784d2b392c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:32.963978 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08367c53-89bb-48fc-a71c-3784d2b392c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:32.963978 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08367c53-89bb-48fc-a71c-3784d2b392c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:32.964887 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08367c53-89bb-48fc-a71c-3784d2b392c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:32.970706 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08367c53-89bb-48fc-a71c-3784d2b392c3 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:32.983070 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a085a3-eaf1-4bbe-a9a2-ba0b24fabb4f admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:32.989751 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff2552-d451-4202-aa46-64ad43718f34 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:32.990509 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff2552-d451-4202-aa46-64ad43718f34 service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:32.990905 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff2552-d451-4202-aa46-64ad43718f34 service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:32.991305 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff2552-d451-4202-aa46-64ad43718f34 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:32.993211 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-53ff2552-d451-4202-aa46-64ad43718f34 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:33.009505 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3028/6046] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:33.010868 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90b172-7037-4602-98f0-ae8799d014b7 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:33.011489 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90b172-7037-4602-98f0-ae8799d014b7 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:33.011489 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90b172-7037-4602-98f0-ae8799d014b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:33.029418 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff2552-d451-4202-aa46-64ad43718f34 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:33.032082 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff2552-d451-4202-aa46-64ad43718f34 service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:33.062689 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3019/6047] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:05:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:05:33.064035 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff2552-d451-4202-aa46-64ad43718f34 service placement] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:33.068485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-53ff2552-d451-4202-aa46-64ad43718f34 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:33.095811 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-fa90b172-7037-4602-98f0-ae8799d014b7 None None] MFA Rules not processed for user `fa52b94a1308494bb283b7bfe4a1ce58`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:33.097665 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-fa90b172-7037-4602-98f0-ae8799d014b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:33.109695 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff2552-d451-4202-aa46-64ad43718f34 service placement] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:33.122759 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435468d1-e0c2-487e-9eed-3f7aab82a1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:33.123483 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435468d1-e0c2-487e-9eed-3f7aab82a1ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:33.128362 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435468d1-e0c2-487e-9eed-3f7aab82a1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:33.128362 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435468d1-e0c2-487e-9eed-3f7aab82a1ca admin admin] PATH_INFO: `/v3/projects/14fc132d27f34c27a666dd8228555a98` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:33.128362 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435468d1-e0c2-487e-9eed-3f7aab82a1ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=14fc132d27f34c27a666dd8228555a98)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:33.130402 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435468d1-e0c2-487e-9eed-3f7aab82a1ca admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:33.238060 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:33.261619 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-435468d1-e0c2-487e-9eed-3f7aab82a1ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14fc132d27f34c27a666dd8228555a98', 'request_id': 'req-435468d1-e0c2-487e-9eed-3f7aab82a1ca'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:33.275312 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-435468d1-e0c2-487e-9eed-3f7aab82a1ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14fc132d27f34c27a666dd8228555a98', 'request_id': 'req-435468d1-e0c2-487e-9eed-3f7aab82a1ca'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:33.297371 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-435468d1-e0c2-487e-9eed-3f7aab82a1ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14fc132d27f34c27a666dd8228555a98', 'request_id': 'req-435468d1-e0c2-487e-9eed-3f7aab82a1ca'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:33.320730 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3029/6048] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:33 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:33.322198 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa90b172-7037-4602-98f0-ae8799d014b7 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:33.326217 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-435468d1-e0c2-487e-9eed-3f7aab82a1ca admin admin] The token cache is being invalidate because project 14fc132d27f34c27a666dd8228555a98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:33.328525 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-435468d1-e0c2-487e-9eed-3f7aab82a1ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:33.329746 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-435468d1-e0c2-487e-9eed-3f7aab82a1ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:33.334267 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3020/6049] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:33 2022] DELETE /identity/v3/projects/14fc132d27f34c27a666dd8228555a98 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:33.335497 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435468d1-e0c2-487e-9eed-3f7aab82a1ca admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:33.338648 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-435468d1-e0c2-487e-9eed-3f7aab82a1ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:33.347890 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa90b172-7037-4602-98f0-ae8799d014b7 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:33.425506 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:33.502597 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec46e3fb-b28a-4f59-8ddc-3af3d120e42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:33.505384 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46e3fb-b28a-4f59-8ddc-3af3d120e42c admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:33.507975 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46e3fb-b28a-4f59-8ddc-3af3d120e42c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:33.508524 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46e3fb-b28a-4f59-8ddc-3af3d120e42c admin admin] PATH_INFO: `/v3/projects/5ab9e6d27d5442e38e2920b14440ef00/users/04ff74ccad7e46758348c91935d8eb8d/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:33.564651 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec46e3fb-b28a-4f59-8ddc-3af3d120e42c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ab9e6d27d5442e38e2920b14440ef00, user_id=04ff74ccad7e46758348c91935d8eb8d, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:33.576328 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435468d1-e0c2-487e-9eed-3f7aab82a1ca admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:33.578132 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec46e3fb-b28a-4f59-8ddc-3af3d120e42c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:33.591109 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f48c1-4a98-49cb-8a94-2c159bd50504 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52b94a1308494bb283b7bfe4a1ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984405c23591415eaf067cb43305057d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:33.591866 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f48c1-4a98-49cb-8a94-2c159bd50504 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:33.592172 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f48c1-4a98-49cb-8a94-2c159bd50504 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:33.592536 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f48c1-4a98-49cb-8a94-2c159bd50504 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:33.603852 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f48c1-4a98-49cb-8a94-2c159bd50504 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:33.613274 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f48c1-4a98-49cb-8a94-2c159bd50504 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:33.621402 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3030/6050] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:05:33 2022] PUT /identity/v3/projects/5ab9e6d27d5442e38e2920b14440ef00/users/04ff74ccad7e46758348c91935d8eb8d/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:33.625295 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299b9ab-ce7a-4209-968a-f73efb14395e None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:33.625295 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299b9ab-ce7a-4209-968a-f73efb14395e None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:33.625295 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299b9ab-ce7a-4209-968a-f73efb14395e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:33.683008 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-e299b9ab-ce7a-4209-968a-f73efb14395e None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:33.683008 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e299b9ab-ce7a-4209-968a-f73efb14395e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:33.710637 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3021/6051] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:05:33 2022] POST /identity/v3/projects => generated 360 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:33.711964 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f48c1-4a98-49cb-8a94-2c159bd50504 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:33.714410 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-692f48c1-4a98-49cb-8a94-2c159bd50504 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:33.949313 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3031/6052] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:33.951696 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e299b9ab-ce7a-4209-968a-f73efb14395e None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:33.979282 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f48c1-4a98-49cb-8a94-2c159bd50504 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:33.995900 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710784d6-b74e-4e68-8127-3b499dac2013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:33.996699 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710784d6-b74e-4e68-8127-3b499dac2013 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:33.996986 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710784d6-b74e-4e68-8127-3b499dac2013 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:33.997261 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710784d6-b74e-4e68-8127-3b499dac2013 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:33.998697 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710784d6-b74e-4e68-8127-3b499dac2013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:34.000502 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710784d6-b74e-4e68-8127-3b499dac2013 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:34.040538 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3022/6053] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:34.053896 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edecd08-ec71-42ce-a424-18e24f032a02 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:34.055279 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edecd08-ec71-42ce-a424-18e24f032a02 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:34.055571 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edecd08-ec71-42ce-a424-18e24f032a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:34.119552 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-0edecd08-ec71-42ce-a424-18e24f032a02 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:34.122541 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0edecd08-ec71-42ce-a424-18e24f032a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:34.138088 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e299b9ab-ce7a-4209-968a-f73efb14395e None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:34.145561 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3023/6054] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:34.146544 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edecd08-ec71-42ce-a424-18e24f032a02 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:34.190294 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edecd08-ec71-42ce-a424-18e24f032a02 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:34.205948 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632375be-d831-45fb-9282-3ccebbdb172a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:34.209491 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632375be-d831-45fb-9282-3ccebbdb172a admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:34.210601 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632375be-d831-45fb-9282-3ccebbdb172a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:34.210887 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632375be-d831-45fb-9282-3ccebbdb172a admin admin] PATH_INFO: `/v3/projects/5ab9e6d27d5442e38e2920b14440ef00/users/04ff74ccad7e46758348c91935d8eb8d/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:34.216199 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632375be-d831-45fb-9282-3ccebbdb172a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ab9e6d27d5442e38e2920b14440ef00, user_id=04ff74ccad7e46758348c91935d8eb8d, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:34.220254 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632375be-d831-45fb-9282-3ccebbdb172a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:34.272792 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3024/6055] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:05:34 2022] PUT /identity/v3/projects/5ab9e6d27d5442e38e2920b14440ef00/users/04ff74ccad7e46758348c91935d8eb8d/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:34.273676 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632375be-d831-45fb-9282-3ccebbdb172a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:34.283635 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e24bef-e2c4-4c06-90bb-af0a90866604 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52b94a1308494bb283b7bfe4a1ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984405c23591415eaf067cb43305057d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:34.284298 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e24bef-e2c4-4c06-90bb-af0a90866604 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:34.284578 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e24bef-e2c4-4c06-90bb-af0a90866604 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:34.284860 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e24bef-e2c4-4c06-90bb-af0a90866604 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:34.291624 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e24bef-e2c4-4c06-90bb-af0a90866604 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:34.297048 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e24bef-e2c4-4c06-90bb-af0a90866604 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:34.349788 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3032/6056] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:05:33 2022] POST /identity/v3/users => generated 416 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:34.351739 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c5240-17d5-4de3-8d75-80966f6456f4 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:34.352096 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c5240-17d5-4de3-8d75-80966f6456f4 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:34.352426 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c5240-17d5-4de3-8d75-80966f6456f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:34.361541 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:34.368215 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:34.432464 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-4f8c5240-17d5-4de3-8d75-80966f6456f4 None None] MFA Rules not processed for user `04ff74ccad7e46758348c91935d8eb8d`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:34.438393 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4f8c5240-17d5-4de3-8d75-80966f6456f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:34.478574 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632375be-d831-45fb-9282-3ccebbdb172a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:34.509631 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee7b5db-8126-4421-bd6b-6d3399b0b2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:34.519782 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7b5db-8126-4421-bd6b-6d3399b0b2d8 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:34.520069 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7b5db-8126-4421-bd6b-6d3399b0b2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:34.520356 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7b5db-8126-4421-bd6b-6d3399b0b2d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:34.521050 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee7b5db-8126-4421-bd6b-6d3399b0b2d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:05:34.521355 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee7b5db-8126-4421-bd6b-6d3399b0b2d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:34.527172 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee7b5db-8126-4421-bd6b-6d3399b0b2d8 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:34.543373 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3025/6057] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:34.548356 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee7b5db-8126-4421-bd6b-6d3399b0b2d8 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:34.659537 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3033/6058] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:34 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:34.662049 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c5240-17d5-4de3-8d75-80966f6456f4 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:34.708487 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c5240-17d5-4de3-8d75-80966f6456f4 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:34.711683 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee7b5db-8126-4421-bd6b-6d3399b0b2d8 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:34.714769 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7aeae9-3d0c-4a66-bdb6-d3a45274de6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:34.716793 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7aeae9-3d0c-4a66-bdb6-d3a45274de6c admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:34.716793 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7aeae9-3d0c-4a66-bdb6-d3a45274de6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:34.716793 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7aeae9-3d0c-4a66-bdb6-d3a45274de6c admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:34.716793 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7aeae9-3d0c-4a66-bdb6-d3a45274de6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:34.721749 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7aeae9-3d0c-4a66-bdb6-d3a45274de6c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:34.734769 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73817e3d-1eb0-4523-b6c0-8ddfee71f826 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52b94a1308494bb283b7bfe4a1ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984405c23591415eaf067cb43305057d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:34.735469 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73817e3d-1eb0-4523-b6c0-8ddfee71f826 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:34.735759 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73817e3d-1eb0-4523-b6c0-8ddfee71f826 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:34.742367 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73817e3d-1eb0-4523-b6c0-8ddfee71f826 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] PATH_INFO: `/v3/users/8edadeb851314ce08e5585852c3d662d` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:34.805468 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73817e3d-1eb0-4523-b6c0-8ddfee71f826 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorizing `identity:get_user(user_id=8edadeb851314ce08e5585852c3d662d)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:34.807663 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73817e3d-1eb0-4523-b6c0-8ddfee71f826 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:34.815784 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3026/6059] 10.222.0.83 () {58 vars in 1221 bytes} [Mon Aug 29 16:05:34 2022] GET /identity/v3/users/8edadeb851314ce08e5585852c3d662d => generated 416 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:34.816687 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73817e3d-1eb0-4523-b6c0-8ddfee71f826 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:34.824202 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-73817e3d-1eb0-4523-b6c0-8ddfee71f826 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:34.827389 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3034/6060] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:05:34 2022] POST /identity/v3/projects => generated 387 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:34.828263 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7aeae9-3d0c-4a66-bdb6-d3a45274de6c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:35.062868 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73817e3d-1eb0-4523-b6c0-8ddfee71f826 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:35.094886 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7aeae9-3d0c-4a66-bdb6-d3a45274de6c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:35.115456 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23347fea-b00c-41df-b6a5-6f538d98bb60 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52b94a1308494bb283b7bfe4a1ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984405c23591415eaf067cb43305057d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:35.118782 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23347fea-b00c-41df-b6a5-6f538d98bb60 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:35.119423 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23347fea-b00c-41df-b6a5-6f538d98bb60 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:35.120464 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23347fea-b00c-41df-b6a5-6f538d98bb60 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] PATH_INFO: `/v3/users/8edadeb851314ce08e5585852c3d662d` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:35.122024 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23347fea-b00c-41df-b6a5-6f538d98bb60 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8edadeb851314ce08e5585852c3d662d)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:35.128531 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23347fea-b00c-41df-b6a5-6f538d98bb60 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:35.272187 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-23347fea-b00c-41df-b6a5-6f538d98bb60 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8edadeb851314ce08e5585852c3d662d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:35.273184 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-23347fea-b00c-41df-b6a5-6f538d98bb60 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8edadeb851314ce08e5585852c3d662d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:35.273316 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:35.304273 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af122e7-886a-460e-8d79-bf7e0b204786 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:35.305289 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-23347fea-b00c-41df-b6a5-6f538d98bb60 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8edadeb851314ce08e5585852c3d662d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:35.306683 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af122e7-886a-460e-8d79-bf7e0b204786 service cinder] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:35.307453 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af122e7-886a-460e-8d79-bf7e0b204786 service cinder] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:35.308719 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af122e7-886a-460e-8d79-bf7e0b204786 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:35.318020 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-23347fea-b00c-41df-b6a5-6f538d98bb60 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8edadeb851314ce08e5585852c3d662d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:35.319335 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-23347fea-b00c-41df-b6a5-6f538d98bb60 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8edadeb851314ce08e5585852c3d662d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:35.344482 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:35.383252 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3035/6061] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:05:34 2022] DELETE /identity/v3/users/8edadeb851314ce08e5585852c3d662d => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:35.384394 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23347fea-b00c-41df-b6a5-6f538d98bb60 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:35.387576 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-23347fea-b00c-41df-b6a5-6f538d98bb60 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:35.485404 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af122e7-886a-460e-8d79-bf7e0b204786 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:35.486901 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af122e7-886a-460e-8d79-bf7e0b204786 service cinder] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:35.518156 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3027/6062] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:05:34 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 702 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:05:35.520960 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af122e7-886a-460e-8d79-bf7e0b204786 service cinder] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:35.563915 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af122e7-886a-460e-8d79-bf7e0b204786 service cinder] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:35.569638 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23347fea-b00c-41df-b6a5-6f538d98bb60 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:35.593006 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b50bf9-39b7-47d2-a6a6-b89f6fa8a00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:35.594325 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b50bf9-39b7-47d2-a6a6-b89f6fa8a00c admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:35.595336 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b50bf9-39b7-47d2-a6a6-b89f6fa8a00c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:35.595769 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b50bf9-39b7-47d2-a6a6-b89f6fa8a00c admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:35.597177 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b50bf9-39b7-47d2-a6a6-b89f6fa8a00c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:35.603429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b50bf9-39b7-47d2-a6a6-b89f6fa8a00c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:35.667556 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3036/6063] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:05:35 2022] POST /identity/v3/users => generated 294 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:35.672010 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b50bf9-39b7-47d2-a6a6-b89f6fa8a00c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:35.703457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b50bf9-39b7-47d2-a6a6-b89f6fa8a00c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:35.715876 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462aede-cb2f-44c7-a607-58b53491ac96 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52b94a1308494bb283b7bfe4a1ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984405c23591415eaf067cb43305057d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:35.716320 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3171b9c-dedf-4588-9454-09a972a4db1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:35.716798 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462aede-cb2f-44c7-a607-58b53491ac96 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:35.717114 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462aede-cb2f-44c7-a607-58b53491ac96 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:35.717281 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3171b9c-dedf-4588-9454-09a972a4db1b admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:35.717443 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462aede-cb2f-44c7-a607-58b53491ac96 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] PATH_INFO: `/v3/projects/9ca2093ea6ad4c9fa038c2665ff4e147` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:35.717646 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3171b9c-dedf-4588-9454-09a972a4db1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:35.717646 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3171b9c-dedf-4588-9454-09a972a4db1b admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:35.718462 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3171b9c-dedf-4588-9454-09a972a4db1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:35.719519 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9462aede-cb2f-44c7-a607-58b53491ac96 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9ca2093ea6ad4c9fa038c2665ff4e147)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:35.721159 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3171b9c-dedf-4588-9454-09a972a4db1b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:35.721412 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9462aede-cb2f-44c7-a607-58b53491ac96 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:35.737488 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3037/6064] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:35.749603 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3171b9c-dedf-4588-9454-09a972a4db1b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:35.781482 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3171b9c-dedf-4588-9454-09a972a4db1b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:35.804537 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3360b9b5-ad54-4697-b17a-c7fe5dcf6933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:35.805275 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360b9b5-ad54-4697-b17a-c7fe5dcf6933 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:35.805654 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360b9b5-ad54-4697-b17a-c7fe5dcf6933 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:35.806568 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360b9b5-ad54-4697-b17a-c7fe5dcf6933 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:35.807090 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3360b9b5-ad54-4697-b17a-c7fe5dcf6933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:35.811396 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3360b9b5-ad54-4697-b17a-c7fe5dcf6933 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:35.840935 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3038/6065] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:35.847055 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3360b9b5-ad54-4697-b17a-c7fe5dcf6933 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:35.868221 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9462aede-cb2f-44c7-a607-58b53491ac96 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ca2093ea6ad4c9fa038c2665ff4e147', 'request_id': 'req-9462aede-cb2f-44c7-a607-58b53491ac96'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:35.869865 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3360b9b5-ad54-4697-b17a-c7fe5dcf6933 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:35.887827 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9462aede-cb2f-44c7-a607-58b53491ac96 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ca2093ea6ad4c9fa038c2665ff4e147', 'request_id': 'req-9462aede-cb2f-44c7-a607-58b53491ac96'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:35.906431 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9462aede-cb2f-44c7-a607-58b53491ac96 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ca2093ea6ad4c9fa038c2665ff4e147', 'request_id': 'req-9462aede-cb2f-44c7-a607-58b53491ac96'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:35.938695 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9462aede-cb2f-44c7-a607-58b53491ac96 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] The token cache is being invalidate because project 9ca2093ea6ad4c9fa038c2665ff4e147 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:35.938993 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9462aede-cb2f-44c7-a607-58b53491ac96 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:35.944323 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9462aede-cb2f-44c7-a607-58b53491ac96 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:35.953113 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3028/6066] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:35 2022] DELETE /identity/v3/projects/9ca2093ea6ad4c9fa038c2665ff4e147 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:35.968388 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462aede-cb2f-44c7-a607-58b53491ac96 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:35.973402 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9462aede-cb2f-44c7-a607-58b53491ac96 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:35.977103 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ddc24-6dfd-4287-b454-29c4af95d19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:35.977785 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ddc24-6dfd-4287-b454-29c4af95d19c admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:35.978069 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ddc24-6dfd-4287-b454-29c4af95d19c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:35.978347 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ddc24-6dfd-4287-b454-29c4af95d19c admin admin] PATH_INFO: `/v3/projects/60a1e2d779514957a80d1a4c1026cc1d/users/387dfba1f1b7495dbda475b221d7fcae/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:36.005245 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ddc24-6dfd-4287-b454-29c4af95d19c admin admin] RBAC: Authorizing `identity:create_grant(project_id=60a1e2d779514957a80d1a4c1026cc1d, user_id=387dfba1f1b7495dbda475b221d7fcae, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:36.008399 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ddc24-6dfd-4287-b454-29c4af95d19c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:36.037622 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3039/6067] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:05:35 2022] PUT /identity/v3/projects/60a1e2d779514957a80d1a4c1026cc1d/users/387dfba1f1b7495dbda475b221d7fcae/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:36.051063 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:36.054510 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4715f9-87e5-450d-9c33-949a8bacc12b None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:36.055614 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4715f9-87e5-450d-9c33-949a8bacc12b None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:36.056252 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4715f9-87e5-450d-9c33-949a8bacc12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:36.097757 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-eb4715f9-87e5-450d-9c33-949a8bacc12b None None] MFA Rules not processed for user `387dfba1f1b7495dbda475b221d7fcae`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:36.099123 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-eb4715f9-87e5-450d-9c33-949a8bacc12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:36.133870 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:36.166763 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462aede-cb2f-44c7-a607-58b53491ac96 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:36.188606 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3040/6068] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:36 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:36.193471 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4715f9-87e5-450d-9c33-949a8bacc12b None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:36.194655 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-eb4715f9-87e5-450d-9c33-949a8bacc12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:36.308498 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4715f9-87e5-450d-9c33-949a8bacc12b None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:36.316564 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee49d06-5084-4889-8758-8bb1e61380fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:36.316749 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d1de5-140b-4550-8007-1c606b31c556 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52b94a1308494bb283b7bfe4a1ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984405c23591415eaf067cb43305057d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:36.317260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d1de5-140b-4550-8007-1c606b31c556 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:36.317551 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d1de5-140b-4550-8007-1c606b31c556 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:36.317843 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d1de5-140b-4550-8007-1c606b31c556 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:36.318497 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38d1de5-140b-4550-8007-1c606b31c556 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:36.318902 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee49d06-5084-4889-8758-8bb1e61380fe admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:36.319448 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee49d06-5084-4889-8758-8bb1e61380fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:36.320153 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee49d06-5084-4889-8758-8bb1e61380fe admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:36.320261 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38d1de5-140b-4550-8007-1c606b31c556 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:36.321101 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee49d06-5084-4889-8758-8bb1e61380fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:36.323459 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee49d06-5084-4889-8758-8bb1e61380fe admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:36.352499 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3029/6069] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:05:35 2022] POST /identity/v3/projects => generated 347 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:36.353425 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d1de5-140b-4550-8007-1c606b31c556 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:36.357434 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e38d1de5-140b-4550-8007-1c606b31c556 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:36.378777 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3041/6070] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:05:36 2022] POST /identity/v3/projects => generated 387 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:36.381787 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee49d06-5084-4889-8758-8bb1e61380fe admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:36.436429 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d1de5-140b-4550-8007-1c606b31c556 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:36.503638 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee49d06-5084-4889-8758-8bb1e61380fe admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:36.517716 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3df66-aa41-463d-94b9-4b07c0addffe tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52b94a1308494bb283b7bfe4a1ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984405c23591415eaf067cb43305057d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:36.518534 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3df66-aa41-463d-94b9-4b07c0addffe tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:36.519497 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3df66-aa41-463d-94b9-4b07c0addffe tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:36.519856 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3df66-aa41-463d-94b9-4b07c0addffe tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:36.523038 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc3df66-aa41-463d-94b9-4b07c0addffe tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:05:36.525176 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc3df66-aa41-463d-94b9-4b07c0addffe tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:36.527952 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc3df66-aa41-463d-94b9-4b07c0addffe tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:36.542816 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c128cfd-ed30-4e01-8b2a-2ce3d5c4ba09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:36.543732 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c128cfd-ed30-4e01-8b2a-2ce3d5c4ba09 service cinder] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:36.544237 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c128cfd-ed30-4e01-8b2a-2ce3d5c4ba09 service cinder] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:36.544715 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c128cfd-ed30-4e01-8b2a-2ce3d5c4ba09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:36.550439 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3042/6071] 10.222.0.83 () {58 vars in 1160 bytes} [Mon Aug 29 16:05:36 2022] GET /identity/v3/projects?is_domain=True => generated 1019 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:36.550439 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3df66-aa41-463d-94b9-4b07c0addffe tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:36.551544 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4c128cfd-ed30-4e01-8b2a-2ce3d5c4ba09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:36.654380 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:36.666057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:36.723133 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3df66-aa41-463d-94b9-4b07c0addffe tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:36.727651 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c128cfd-ed30-4e01-8b2a-2ce3d5c4ba09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:36.729568 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c128cfd-ed30-4e01-8b2a-2ce3d5c4ba09 service cinder] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:36.746501 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd66862-b212-4afe-9251-6c5e5ef05662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:36.746501 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd66862-b212-4afe-9251-6c5e5ef05662 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:36.746501 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd66862-b212-4afe-9251-6c5e5ef05662 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:36.746501 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd66862-b212-4afe-9251-6c5e5ef05662 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:36.746974 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd66862-b212-4afe-9251-6c5e5ef05662 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:36.746974 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd66862-b212-4afe-9251-6c5e5ef05662 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:36.780460 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3030/6072] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:05:36 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:05:36.787991 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c128cfd-ed30-4e01-8b2a-2ce3d5c4ba09 service cinder] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:36.833055 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3043/6073] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:05:36 2022] POST /identity/v3/users => generated 300 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:36.834426 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd66862-b212-4afe-9251-6c5e5ef05662 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:36.840149 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c128cfd-ed30-4e01-8b2a-2ce3d5c4ba09 service cinder] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:36.848687 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3414f3c0-b8a9-4757-a279-812243bc48c9 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52b94a1308494bb283b7bfe4a1ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984405c23591415eaf067cb43305057d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:36.849814 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414f3c0-b8a9-4757-a279-812243bc48c9 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:36.853202 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414f3c0-b8a9-4757-a279-812243bc48c9 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:36.853202 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414f3c0-b8a9-4757-a279-812243bc48c9 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:36.853202 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3414f3c0-b8a9-4757-a279-812243bc48c9 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:36.853202 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3414f3c0-b8a9-4757-a279-812243bc48c9 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:36.855139 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd66862-b212-4afe-9251-6c5e5ef05662 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:36.875009 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3031/6074] 10.222.0.83 () {58 vars in 1128 bytes} [Mon Aug 29 16:05:36 2022] GET /identity/v3/domains => generated 828 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:36.878640 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543aac85-08e2-489c-88f5-d0a2f58efd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:36.879325 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543aac85-08e2-489c-88f5-d0a2f58efd25 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:36.879614 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543aac85-08e2-489c-88f5-d0a2f58efd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:36.879898 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543aac85-08e2-489c-88f5-d0a2f58efd25 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:36.880569 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543aac85-08e2-489c-88f5-d0a2f58efd25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:36.880919 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3414f3c0-b8a9-4757-a279-812243bc48c9 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:36.893468 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543aac85-08e2-489c-88f5-d0a2f58efd25 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:36.908039 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3414f3c0-b8a9-4757-a279-812243bc48c9 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:36.917613 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3044/6075] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:36.918745 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543aac85-08e2-489c-88f5-d0a2f58efd25 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:36.919050 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f201f9-15c0-4bf4-bc32-cc5f572dc175 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52b94a1308494bb283b7bfe4a1ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984405c23591415eaf067cb43305057d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:36.919720 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f201f9-15c0-4bf4-bc32-cc5f572dc175 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:36.919993 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f201f9-15c0-4bf4-bc32-cc5f572dc175 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:36.921244 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f201f9-15c0-4bf4-bc32-cc5f572dc175 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] PATH_INFO: `/v3/projects/4427634bb0184989a37bbdc21e0edc46` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:36.922782 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f201f9-15c0-4bf4-bc32-cc5f572dc175 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorizing `identity:update_project(project_id=4427634bb0184989a37bbdc21e0edc46)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:36.923855 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-e4f201f9-15c0-4bf4-bc32-cc5f572dc175 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:05:36.923855 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 16:05:36.923855 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 16:05:36.925895 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f201f9-15c0-4bf4-bc32-cc5f572dc175 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:36.963389 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543aac85-08e2-489c-88f5-d0a2f58efd25 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:36.965968 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e4f201f9-15c0-4bf4-bc32-cc5f572dc175 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '4427634bb0184989a37bbdc21e0edc46'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:36.967770 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e4f201f9-15c0-4bf4-bc32-cc5f572dc175 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '4427634bb0184989a37bbdc21e0edc46'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:36.980188 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081314b-5ee0-4cd2-becb-cabfdce0ae58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:36.986907 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081314b-5ee0-4cd2-becb-cabfdce0ae58 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:36.990476 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081314b-5ee0-4cd2-becb-cabfdce0ae58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:36.991419 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081314b-5ee0-4cd2-becb-cabfdce0ae58 admin admin] PATH_INFO: `/v3/projects/719e987ad03d4c2eae8920a1047bd434/users/e9091743fac34d39b29926224ccda5d9/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:37.055499 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6081314b-5ee0-4cd2-becb-cabfdce0ae58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=719e987ad03d4c2eae8920a1047bd434, user_id=e9091743fac34d39b29926224ccda5d9, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:37.057040 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e4f201f9-15c0-4bf4-bc32-cc5f572dc175 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '4427634bb0184989a37bbdc21e0edc46'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:37.058405 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e4f201f9-15c0-4bf4-bc32-cc5f572dc175 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '4427634bb0184989a37bbdc21e0edc46'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:37.059919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6081314b-5ee0-4cd2-becb-cabfdce0ae58 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:37.082491 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3032/6076] 10.222.0.83 () {60 vars in 1252 bytes} [Mon Aug 29 16:05:36 2022] PATCH /identity/v3/projects/4427634bb0184989a37bbdc21e0edc46 => generated 361 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:37.088004 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f201f9-15c0-4bf4-bc32-cc5f572dc175 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:37.095843 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e4f201f9-15c0-4bf4-bc32-cc5f572dc175 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:37.121897 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3045/6077] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:05:36 2022] PUT /identity/v3/projects/719e987ad03d4c2eae8920a1047bd434/users/e9091743fac34d39b29926224ccda5d9/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:37.127013 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081314b-5ee0-4cd2-becb-cabfdce0ae58 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:37.131453 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6081314b-5ee0-4cd2-becb-cabfdce0ae58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:37.285024 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081314b-5ee0-4cd2-becb-cabfdce0ae58 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:37.294129 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632f85c-6ab5-4191-97d8-a6bd1acf2338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:37.294758 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632f85c-6ab5-4191-97d8-a6bd1acf2338 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:37.295068 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632f85c-6ab5-4191-97d8-a6bd1acf2338 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:37.296189 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632f85c-6ab5-4191-97d8-a6bd1acf2338 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:37.297362 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e632f85c-6ab5-4191-97d8-a6bd1acf2338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:37.299688 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e632f85c-6ab5-4191-97d8-a6bd1acf2338 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:37.308913 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f201f9-15c0-4bf4-bc32-cc5f572dc175 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:37.325619 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3046/6078] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:37.332131 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632f85c-6ab5-4191-97d8-a6bd1acf2338 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:37.349540 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632f85c-6ab5-4191-97d8-a6bd1acf2338 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:37.363771 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb24d59-bcf7-44b2-8ebc-55ba8b36ce62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:37.364602 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb24d59-bcf7-44b2-8ebc-55ba8b36ce62 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:37.364885 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb24d59-bcf7-44b2-8ebc-55ba8b36ce62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:37.365157 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb24d59-bcf7-44b2-8ebc-55ba8b36ce62 admin admin] PATH_INFO: `/v3/projects/719e987ad03d4c2eae8920a1047bd434/users/e9091743fac34d39b29926224ccda5d9/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:37.371225 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb24d59-bcf7-44b2-8ebc-55ba8b36ce62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=719e987ad03d4c2eae8920a1047bd434, user_id=e9091743fac34d39b29926224ccda5d9, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:37.374888 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb24d59-bcf7-44b2-8ebc-55ba8b36ce62 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:37.410288 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3047/6079] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:05:37 2022] PUT /identity/v3/projects/719e987ad03d4c2eae8920a1047bd434/users/e9091743fac34d39b29926224ccda5d9/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:37.422312 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3225b00-36be-4366-8112-610951174f1c None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:37.422562 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3225b00-36be-4366-8112-610951174f1c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:37.422826 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3225b00-36be-4366-8112-610951174f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:37.475728 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-b3225b00-36be-4366-8112-610951174f1c None None] MFA Rules not processed for user `e9091743fac34d39b29926224ccda5d9`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:37.477109 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b3225b00-36be-4366-8112-610951174f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:37.492131 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ad651-a146-4880-af49-fd21fe1a8ace tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52b94a1308494bb283b7bfe4a1ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984405c23591415eaf067cb43305057d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:37.493982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ad651-a146-4880-af49-fd21fe1a8ace tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:37.494218 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ad651-a146-4880-af49-fd21fe1a8ace tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:37.494498 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ad651-a146-4880-af49-fd21fe1a8ace tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] PATH_INFO: `/v3/projects/4427634bb0184989a37bbdc21e0edc46` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:37.524278 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915ad651-a146-4880-af49-fd21fe1a8ace tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4427634bb0184989a37bbdc21e0edc46)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:37.526051 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915ad651-a146-4880-af49-fd21fe1a8ace tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:37.582430 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-915ad651-a146-4880-af49-fd21fe1a8ace tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '4427634bb0184989a37bbdc21e0edc46'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:37.593607 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-915ad651-a146-4880-af49-fd21fe1a8ace tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '4427634bb0184989a37bbdc21e0edc46'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:37.596399 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:37.620066 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3048/6080] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:37 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:37.624592 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3225b00-36be-4366-8112-610951174f1c None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:37.645309 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3225b00-36be-4366-8112-610951174f1c None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:37.661307 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26a122-b1da-4967-ab62-32f78836ddaa tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9091743fac34d39b29926224ccda5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '719e987ad03d4c2eae8920a1047bd434', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:37.661941 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26a122-b1da-4967-ab62-32f78836ddaa tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:37.662438 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26a122-b1da-4967-ab62-32f78836ddaa tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:37.662566 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26a122-b1da-4967-ab62-32f78836ddaa tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] PATH_INFO: `/v3/services` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:37.663307 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb26a122-b1da-4967-ab62-32f78836ddaa tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:37.665304 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb26a122-b1da-4967-ab62-32f78836ddaa tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:37.672501 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:37.701427 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3049/6081] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:05:37 2022] POST /identity/v3/services => generated 287 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:37.702857 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26a122-b1da-4967-ab62-32f78836ddaa tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:37.718621 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-915ad651-a146-4880-af49-fd21fe1a8ace tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4427634bb0184989a37bbdc21e0edc46', 'request_id': 'req-915ad651-a146-4880-af49-fd21fe1a8ace'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:37.728783 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-915ad651-a146-4880-af49-fd21fe1a8ace tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4427634bb0184989a37bbdc21e0edc46', 'request_id': 'req-915ad651-a146-4880-af49-fd21fe1a8ace'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:37.749163 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26a122-b1da-4967-ab62-32f78836ddaa tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:37.754662 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-915ad651-a146-4880-af49-fd21fe1a8ace tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4427634bb0184989a37bbdc21e0edc46', 'request_id': 'req-915ad651-a146-4880-af49-fd21fe1a8ace'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:37.784576 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-915ad651-a146-4880-af49-fd21fe1a8ace tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] The token cache is being invalidate because project 4427634bb0184989a37bbdc21e0edc46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:37.784952 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-915ad651-a146-4880-af49-fd21fe1a8ace tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:37.785561 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-915ad651-a146-4880-af49-fd21fe1a8ace tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:37.796176 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-915ad651-a146-4880-af49-fd21fe1a8ace tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '4427634bb0184989a37bbdc21e0edc46', 'request_id': 'req-915ad651-a146-4880-af49-fd21fe1a8ace'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:37.796911 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-915ad651-a146-4880-af49-fd21fe1a8ace tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '4427634bb0184989a37bbdc21e0edc46', 'request_id': 'req-915ad651-a146-4880-af49-fd21fe1a8ace'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:37.797555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-915ad651-a146-4880-af49-fd21fe1a8ace tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '4427634bb0184989a37bbdc21e0edc46', 'request_id': 'req-915ad651-a146-4880-af49-fd21fe1a8ace'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:37.814126 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3033/6082] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:37 2022] DELETE /identity/v3/projects/4427634bb0184989a37bbdc21e0edc46 => generated 0 bytes in 728 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:05:37.819281 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ad651-a146-4880-af49-fd21fe1a8ace tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:37.821808 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-915ad651-a146-4880-af49-fd21fe1a8ace tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:37.865997 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e5f098-f35e-4341-9ff5-ae91e67658d0 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9091743fac34d39b29926224ccda5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '719e987ad03d4c2eae8920a1047bd434', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:37.866771 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5f098-f35e-4341-9ff5-ae91e67658d0 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:37.866982 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5f098-f35e-4341-9ff5-ae91e67658d0 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:37.867301 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5f098-f35e-4341-9ff5-ae91e67658d0 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:37.868033 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e5f098-f35e-4341-9ff5-ae91e67658d0 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:37.869878 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e5f098-f35e-4341-9ff5-ae91e67658d0 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:37.878610 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-a9e5f098-f35e-4341-9ff5-ae91e67658d0 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 29 16:05:37.878610 n-d-836830-13 devstack@keystone.service[82149]: Failed validating 'type' in schema['properties']['enabled']: Aug 29 16:05:37.878610 n-d-836830-13 devstack@keystone.service[82149]: {'enum': [True, False, None], 'type': 'boolean'} Aug 29 16:05:37.878610 n-d-836830-13 devstack@keystone.service[82149]: On instance['enabled']: Aug 29 16:05:37.878610 n-d-836830-13 devstack@keystone.service[82149]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 29 16:05:37.878610 n-d-836830-13 devstack@keystone.service[82149]: Failed validating 'type' in schema['properties']['enabled']: Aug 29 16:05:37.878610 n-d-836830-13 devstack@keystone.service[82149]: {'enum': [True, False, None], 'type': 'boolean'} Aug 29 16:05:37.878610 n-d-836830-13 devstack@keystone.service[82149]: On instance['enabled']: Aug 29 16:05:37.878610 n-d-836830-13 devstack@keystone.service[82149]: 'False' Aug 29 16:05:37.878610 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:05:37.878610 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 29 16:05:37.878610 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 29 16:05:37.878610 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 16:05:37.878610 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise error Aug 29 16:05:37.878610 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Aug 29 16:05:37.878610 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:05:37.878610 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 29 16:05:37.878610 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 29 16:05:37.878610 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:05:37.878610 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application On instance['enabled']: Aug 29 16:05:37.878610 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application 'False' Aug 29 16:05:37.878610 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:05:37.878610 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 16:05:37.880078 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:05:37.880078 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:05:37.880078 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:05:37.880078 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:05:37.880078 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:05:37.880078 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:05:37.880078 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:05:37.880078 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:05:37.880078 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:05:37.880078 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:05:37.880078 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:05:37.880078 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:05:37.880078 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Aug 29 16:05:37.880078 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Aug 29 16:05:37.880078 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 29 16:05:37.880078 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 29 16:05:37.880078 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 29 16:05:37.881440 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 29 16:05:37.881440 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 29 16:05:37.881440 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:05:37.881440 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 29 16:05:37.881440 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 29 16:05:37.881440 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:05:37.881440 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application On instance['enabled']: Aug 29 16:05:37.881440 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application 'False' Aug 29 16:05:37.881440 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:05:37.886950 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3050/6083] 10.222.0.83 () {60 vars in 1156 bytes} [Mon Aug 29 16:05:37 2022] POST /identity/v3/endpoints => generated 283 bytes in 185 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 29 16:05:37.887897 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e5f098-f35e-4341-9ff5-ae91e67658d0 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:37.889865 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a9e5f098-f35e-4341-9ff5-ae91e67658d0 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:37.905569 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e5f098-f35e-4341-9ff5-ae91e67658d0 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:37.913725 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b9842-6631-436c-9f56-ed652fd87955 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9091743fac34d39b29926224ccda5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '719e987ad03d4c2eae8920a1047bd434', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:37.914405 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b9842-6631-436c-9f56-ed652fd87955 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:37.914687 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b9842-6631-436c-9f56-ed652fd87955 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:37.914965 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b9842-6631-436c-9f56-ed652fd87955 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:37.915671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b9842-6631-436c-9f56-ed652fd87955 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:37.918344 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b9842-6631-436c-9f56-ed652fd87955 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:37.925466 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ad651-a146-4880-af49-fd21fe1a8ace tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:37.926863 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-ef8b9842-6631-436c-9f56-ed652fd87955 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 29 16:05:37.926863 n-d-836830-13 devstack@keystone.service[82149]: Failed validating 'type' in schema['properties']['enabled']: Aug 29 16:05:37.926863 n-d-836830-13 devstack@keystone.service[82149]: {'enum': [True, False, None], 'type': 'boolean'} Aug 29 16:05:37.926863 n-d-836830-13 devstack@keystone.service[82149]: On instance['enabled']: Aug 29 16:05:37.926863 n-d-836830-13 devstack@keystone.service[82149]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 29 16:05:37.926863 n-d-836830-13 devstack@keystone.service[82149]: Failed validating 'type' in schema['properties']['enabled']: Aug 29 16:05:37.926863 n-d-836830-13 devstack@keystone.service[82149]: {'enum': [True, False, None], 'type': 'boolean'} Aug 29 16:05:37.926863 n-d-836830-13 devstack@keystone.service[82149]: On instance['enabled']: Aug 29 16:05:37.926863 n-d-836830-13 devstack@keystone.service[82149]: 'True' Aug 29 16:05:37.926863 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:05:37.926863 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 29 16:05:37.926863 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 29 16:05:37.926863 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 16:05:37.926863 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise error Aug 29 16:05:37.926863 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Aug 29 16:05:37.926863 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:05:37.926863 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 29 16:05:37.926863 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 29 16:05:37.926863 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:05:37.926863 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application On instance['enabled']: Aug 29 16:05:37.926863 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application 'True' Aug 29 16:05:37.926863 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:05:37.926863 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 16:05:37.928384 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:05:37.928384 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:05:37.928384 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:05:37.928384 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:05:37.928384 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:05:37.928384 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:05:37.928384 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:05:37.928384 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:05:37.928384 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:05:37.928384 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:05:37.928384 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:05:37.928384 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:05:37.928384 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Aug 29 16:05:37.928384 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Aug 29 16:05:37.928384 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 29 16:05:37.928384 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 29 16:05:37.928384 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 29 16:05:37.929750 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 29 16:05:37.929750 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 29 16:05:37.929750 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:05:37.929750 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 29 16:05:37.929750 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 29 16:05:37.929750 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:05:37.929750 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application On instance['enabled']: Aug 29 16:05:37.929750 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application 'True' Aug 29 16:05:37.929750 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:05:37.931306 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3051/6084] 10.222.0.83 () {60 vars in 1156 bytes} [Mon Aug 29 16:05:37 2022] POST /identity/v3/endpoints => generated 281 bytes in 44 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 29 16:05:37.935343 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b9842-6631-436c-9f56-ed652fd87955 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:37.956612 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ae7dc-b3c0-4a68-873b-b6ad0bf879a3 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52b94a1308494bb283b7bfe4a1ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984405c23591415eaf067cb43305057d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:37.957285 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ae7dc-b3c0-4a68-873b-b6ad0bf879a3 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:37.957569 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ae7dc-b3c0-4a68-873b-b6ad0bf879a3 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:37.957851 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ae7dc-b3c0-4a68-873b-b6ad0bf879a3 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:37.958523 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672ae7dc-b3c0-4a68-873b-b6ad0bf879a3 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:37.959692 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b9842-6631-436c-9f56-ed652fd87955 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:37.960505 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672ae7dc-b3c0-4a68-873b-b6ad0bf879a3 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:37.965792 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6154f4ad-53e5-4fa2-9f8e-2e5647ebdd0e tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9091743fac34d39b29926224ccda5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '719e987ad03d4c2eae8920a1047bd434', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:37.969156 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154f4ad-53e5-4fa2-9f8e-2e5647ebdd0e tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:37.969677 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154f4ad-53e5-4fa2-9f8e-2e5647ebdd0e tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:37.970195 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154f4ad-53e5-4fa2-9f8e-2e5647ebdd0e tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:37.971160 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6154f4ad-53e5-4fa2-9f8e-2e5647ebdd0e tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:37.973981 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6154f4ad-53e5-4fa2-9f8e-2e5647ebdd0e tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:38.002650 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3034/6085] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:05:37 2022] POST /identity/v3/projects => generated 358 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:38.003493 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-6154f4ad-53e5-4fa2-9f8e-2e5647ebdd0e tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1716686393. To ensure interoperability, identifiers should be a valid uuid. Aug 29 16:05:38.003493 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 29 16:05:38.003493 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 16:05:38.006822 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ae7dc-b3c0-4a68-873b-b6ad0bf879a3 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:38.055052 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3052/6086] 10.222.0.83 () {60 vars in 1156 bytes} [Mon Aug 29 16:05:37 2022] POST /identity/v3/endpoints => generated 361 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:38.059847 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6154f4ad-53e5-4fa2-9f8e-2e5647ebdd0e tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:38.096560 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6154f4ad-53e5-4fa2-9f8e-2e5647ebdd0e tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:38.109237 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:38.142206 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ae7dc-b3c0-4a68-873b-b6ad0bf879a3 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:38.160581 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c01da0-9428-4e22-890e-4364a33c6c1f tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52b94a1308494bb283b7bfe4a1ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984405c23591415eaf067cb43305057d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:38.161277 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c01da0-9428-4e22-890e-4364a33c6c1f tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:38.161565 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c01da0-9428-4e22-890e-4364a33c6c1f tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:38.161894 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c01da0-9428-4e22-890e-4364a33c6c1f tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] PATH_INFO: `/v3/projects/dd21b67e1b594cc7ba9bb4ed24aedf52` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:38.163152 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c01da0-9428-4e22-890e-4364a33c6c1f tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorizing `identity:get_project(project_id=dd21b67e1b594cc7ba9bb4ed24aedf52)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:38.166316 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c01da0-9428-4e22-890e-4364a33c6c1f tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:38.173422 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3035/6087] 10.222.0.83 () {58 vars in 1230 bytes} [Mon Aug 29 16:05:38 2022] GET /identity/v3/projects/dd21b67e1b594cc7ba9bb4ed24aedf52 => generated 358 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:05:38.174399 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c01da0-9428-4e22-890e-4364a33c6c1f tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:38.188473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c01da0-9428-4e22-890e-4364a33c6c1f tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:38.196248 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50f9c7a-b7a0-4caf-bcc1-d71fa366bc5b tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9091743fac34d39b29926224ccda5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '719e987ad03d4c2eae8920a1047bd434', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:38.197346 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f9c7a-b7a0-4caf-bcc1-d71fa366bc5b tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:38.198517 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f9c7a-b7a0-4caf-bcc1-d71fa366bc5b tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:38.199068 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f9c7a-b7a0-4caf-bcc1-d71fa366bc5b tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] PATH_INFO: `/v3/regions/tempest-region-1716686393` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:38.199878 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50f9c7a-b7a0-4caf-bcc1-d71fa366bc5b tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1716686393)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:38.201203 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50f9c7a-b7a0-4caf-bcc1-d71fa366bc5b tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:38.205919 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3053/6088] 10.222.0.83 () {58 vars in 1206 bytes} [Mon Aug 29 16:05:38 2022] GET /identity/v3/regions/tempest-region-1716686393 => generated 180 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:38.210960 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50f9c7a-b7a0-4caf-bcc1-d71fa366bc5b tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:38.213644 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670b1ca-860c-4986-a162-0d3c7ffc083d tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52b94a1308494bb283b7bfe4a1ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984405c23591415eaf067cb43305057d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:38.219602 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670b1ca-860c-4986-a162-0d3c7ffc083d tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:38.220335 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670b1ca-860c-4986-a162-0d3c7ffc083d tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:38.220847 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670b1ca-860c-4986-a162-0d3c7ffc083d tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] PATH_INFO: `/v3/projects/dd21b67e1b594cc7ba9bb4ed24aedf52` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:38.223796 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6670b1ca-860c-4986-a162-0d3c7ffc083d tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorizing `identity:delete_project(project_id=dd21b67e1b594cc7ba9bb4ed24aedf52)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:38.226620 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6670b1ca-860c-4986-a162-0d3c7ffc083d tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:38.234440 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50f9c7a-b7a0-4caf-bcc1-d71fa366bc5b tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:38.249481 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835f677-1e23-4bbb-9dc6-b12f70ff2f37 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9091743fac34d39b29926224ccda5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '719e987ad03d4c2eae8920a1047bd434', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:38.250559 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835f677-1e23-4bbb-9dc6-b12f70ff2f37 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:38.252483 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835f677-1e23-4bbb-9dc6-b12f70ff2f37 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:38.253207 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835f677-1e23-4bbb-9dc6-b12f70ff2f37 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] PATH_INFO: `/v3/endpoints/a5287def0a334417b18e789c0ea72157` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:38.265642 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d835f677-1e23-4bbb-9dc6-b12f70ff2f37 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=a5287def0a334417b18e789c0ea72157)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:38.269435 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d835f677-1e23-4bbb-9dc6-b12f70ff2f37 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:38.290185 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-d835f677-1e23-4bbb-9dc6-b12f70ff2f37 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 29 16:05:38.290185 n-d-836830-13 devstack@keystone.service[82149]: Failed validating 'type' in schema['properties']['enabled']: Aug 29 16:05:38.290185 n-d-836830-13 devstack@keystone.service[82149]: {'enum': [True, False, None], 'type': 'boolean'} Aug 29 16:05:38.290185 n-d-836830-13 devstack@keystone.service[82149]: On instance['enabled']: Aug 29 16:05:38.290185 n-d-836830-13 devstack@keystone.service[82149]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 29 16:05:38.290185 n-d-836830-13 devstack@keystone.service[82149]: Failed validating 'type' in schema['properties']['enabled']: Aug 29 16:05:38.290185 n-d-836830-13 devstack@keystone.service[82149]: {'enum': [True, False, None], 'type': 'boolean'} Aug 29 16:05:38.290185 n-d-836830-13 devstack@keystone.service[82149]: On instance['enabled']: Aug 29 16:05:38.290185 n-d-836830-13 devstack@keystone.service[82149]: 'False' Aug 29 16:05:38.290185 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:05:38.290185 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 29 16:05:38.290185 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 29 16:05:38.290185 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 16:05:38.290185 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise error Aug 29 16:05:38.290185 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Aug 29 16:05:38.290185 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:05:38.290185 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 29 16:05:38.290185 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 29 16:05:38.290185 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:05:38.290185 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application On instance['enabled']: Aug 29 16:05:38.290185 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application 'False' Aug 29 16:05:38.290185 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:05:38.290185 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 16:05:38.291746 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:05:38.291746 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:05:38.291746 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:05:38.291746 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:05:38.291746 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:05:38.291746 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:05:38.291746 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:05:38.291746 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:05:38.291746 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:05:38.291746 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:05:38.291746 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:05:38.291746 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:05:38.291746 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Aug 29 16:05:38.291746 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Aug 29 16:05:38.291746 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 29 16:05:38.291746 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 29 16:05:38.291746 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 29 16:05:38.292738 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 29 16:05:38.292738 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 29 16:05:38.292738 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:05:38.292738 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 29 16:05:38.292738 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 29 16:05:38.292738 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:05:38.292738 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application On instance['enabled']: Aug 29 16:05:38.292738 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application 'False' Aug 29 16:05:38.292738 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:05:38.292738 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3054/6089] 10.222.0.83 () {60 vars in 1255 bytes} [Mon Aug 29 16:05:38 2022] PATCH /identity/v3/endpoints/a5287def0a334417b18e789c0ea72157 => generated 283 bytes in 76 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 29 16:05:38.293867 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835f677-1e23-4bbb-9dc6-b12f70ff2f37 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:38.315125 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835f677-1e23-4bbb-9dc6-b12f70ff2f37 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:38.335074 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6670b1ca-860c-4986-a162-0d3c7ffc083d tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd21b67e1b594cc7ba9bb4ed24aedf52', 'request_id': 'req-6670b1ca-860c-4986-a162-0d3c7ffc083d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:38.347014 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6670b1ca-860c-4986-a162-0d3c7ffc083d tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd21b67e1b594cc7ba9bb4ed24aedf52', 'request_id': 'req-6670b1ca-860c-4986-a162-0d3c7ffc083d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:38.364275 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6670b1ca-860c-4986-a162-0d3c7ffc083d tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd21b67e1b594cc7ba9bb4ed24aedf52', 'request_id': 'req-6670b1ca-860c-4986-a162-0d3c7ffc083d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:38.367199 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:38.386759 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6670b1ca-860c-4986-a162-0d3c7ffc083d tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] The token cache is being invalidate because project dd21b67e1b594cc7ba9bb4ed24aedf52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:38.387101 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6670b1ca-860c-4986-a162-0d3c7ffc083d tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:38.388197 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6670b1ca-860c-4986-a162-0d3c7ffc083d tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:38.390599 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3036/6090] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:38 2022] DELETE /identity/v3/projects/dd21b67e1b594cc7ba9bb4ed24aedf52 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:38.397195 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670b1ca-860c-4986-a162-0d3c7ffc083d tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:38.400438 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6670b1ca-860c-4986-a162-0d3c7ffc083d tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:38.440126 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57417097-a213-41d9-ad76-b0952a91fee8 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9091743fac34d39b29926224ccda5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '719e987ad03d4c2eae8920a1047bd434', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:38.440708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57417097-a213-41d9-ad76-b0952a91fee8 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:38.441406 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57417097-a213-41d9-ad76-b0952a91fee8 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:38.441693 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57417097-a213-41d9-ad76-b0952a91fee8 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] PATH_INFO: `/v3/endpoints/a5287def0a334417b18e789c0ea72157` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:38.445445 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57417097-a213-41d9-ad76-b0952a91fee8 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=a5287def0a334417b18e789c0ea72157)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:38.448792 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57417097-a213-41d9-ad76-b0952a91fee8 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:38.474352 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-57417097-a213-41d9-ad76-b0952a91fee8 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'a5287def0a334417b18e789c0ea72157', 'request_id': 'req-57417097-a213-41d9-ad76-b0952a91fee8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:38.502815 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3055/6091] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:38 2022] DELETE /identity/v3/endpoints/a5287def0a334417b18e789c0ea72157 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:38.507684 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57417097-a213-41d9-ad76-b0952a91fee8 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:38.511909 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-57417097-a213-41d9-ad76-b0952a91fee8 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:38.623110 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57417097-a213-41d9-ad76-b0952a91fee8 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:38.631357 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7b6a6-d8a3-4ff7-9855-41214ddc2c97 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9091743fac34d39b29926224ccda5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '719e987ad03d4c2eae8920a1047bd434', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:38.632426 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7b6a6-d8a3-4ff7-9855-41214ddc2c97 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:38.633010 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7b6a6-d8a3-4ff7-9855-41214ddc2c97 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:38.633459 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7b6a6-d8a3-4ff7-9855-41214ddc2c97 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] PATH_INFO: `/v3/regions/tempest-region-1716686393` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:38.634559 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e7b6a6-d8a3-4ff7-9855-41214ddc2c97 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1716686393)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:38.640026 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e7b6a6-d8a3-4ff7-9855-41214ddc2c97 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:38.643982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670b1ca-860c-4986-a162-0d3c7ffc083d tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:38.720609 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfd754-77bd-4a19-8e57-bdbb4e3a2eb0 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52b94a1308494bb283b7bfe4a1ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984405c23591415eaf067cb43305057d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:38.721024 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfd754-77bd-4a19-8e57-bdbb4e3a2eb0 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:38.721253 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfd754-77bd-4a19-8e57-bdbb4e3a2eb0 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:38.721531 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfd754-77bd-4a19-8e57-bdbb4e3a2eb0 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:38.722191 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dfd754-77bd-4a19-8e57-bdbb4e3a2eb0 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:38.728835 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3056/6092] 10.222.0.83 () {58 vars in 1209 bytes} [Mon Aug 29 16:05:38 2022] DELETE /identity/v3/regions/tempest-region-1716686393 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:38.736570 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dfd754-77bd-4a19-8e57-bdbb4e3a2eb0 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:38.752358 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7b6a6-d8a3-4ff7-9855-41214ddc2c97 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:38.834235 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7b6a6-d8a3-4ff7-9855-41214ddc2c97 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:38.836134 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3037/6093] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:05:38 2022] POST /identity/v3/projects => generated 360 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:38.837349 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfd754-77bd-4a19-8e57-bdbb4e3a2eb0 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:38.939370 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:38.968209 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfd754-77bd-4a19-8e57-bdbb4e3a2eb0 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:38.988700 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76834d89-a8bf-4b4f-89e7-20d7ca9a6223 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52b94a1308494bb283b7bfe4a1ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984405c23591415eaf067cb43305057d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:38.989407 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76834d89-a8bf-4b4f-89e7-20d7ca9a6223 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:38.989748 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76834d89-a8bf-4b4f-89e7-20d7ca9a6223 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:38.990123 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76834d89-a8bf-4b4f-89e7-20d7ca9a6223 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] PATH_INFO: `/v3/projects/4449f86ff99f4ec796c76166da3bc9f3` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:38.991389 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76834d89-a8bf-4b4f-89e7-20d7ca9a6223 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorizing `identity:get_project(project_id=4449f86ff99f4ec796c76166da3bc9f3)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:38.994456 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76834d89-a8bf-4b4f-89e7-20d7ca9a6223 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:38.999078 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3038/6094] 10.222.0.83 () {58 vars in 1230 bytes} [Mon Aug 29 16:05:38 2022] GET /identity/v3/projects/4449f86ff99f4ec796c76166da3bc9f3 => generated 360 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:39.000944 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76834d89-a8bf-4b4f-89e7-20d7ca9a6223 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:39.059262 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25783707-d32b-4cf8-b614-f51fbb9b1ad6 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9091743fac34d39b29926224ccda5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '719e987ad03d4c2eae8920a1047bd434', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:39.060111 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25783707-d32b-4cf8-b614-f51fbb9b1ad6 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:39.060649 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25783707-d32b-4cf8-b614-f51fbb9b1ad6 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:39.062240 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25783707-d32b-4cf8-b614-f51fbb9b1ad6 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:39.074881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76834d89-a8bf-4b4f-89e7-20d7ca9a6223 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:39.076215 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25783707-d32b-4cf8-b614-f51fbb9b1ad6 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:39.082700 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25783707-d32b-4cf8-b614-f51fbb9b1ad6 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:39.089566 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07e6f6-eddb-412d-97fb-e46a0b39527d tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52b94a1308494bb283b7bfe4a1ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984405c23591415eaf067cb43305057d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:39.091452 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07e6f6-eddb-412d-97fb-e46a0b39527d tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:39.091739 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07e6f6-eddb-412d-97fb-e46a0b39527d tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:39.093100 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07e6f6-eddb-412d-97fb-e46a0b39527d tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] PATH_INFO: `/v3/projects/4449f86ff99f4ec796c76166da3bc9f3` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:39.094715 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a07e6f6-eddb-412d-97fb-e46a0b39527d tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4449f86ff99f4ec796c76166da3bc9f3)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:39.098907 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a07e6f6-eddb-412d-97fb-e46a0b39527d tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:39.134929 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-25783707-d32b-4cf8-b614-f51fbb9b1ad6 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-116997457. To ensure interoperability, identifiers should be a valid uuid. Aug 29 16:05:39.134929 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 29 16:05:39.134929 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 16:05:39.181620 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3057/6095] 10.222.0.83 () {60 vars in 1156 bytes} [Mon Aug 29 16:05:38 2022] POST /identity/v3/endpoints => generated 358 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:39.186945 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25783707-d32b-4cf8-b614-f51fbb9b1ad6 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:39.196840 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3a07e6f6-eddb-412d-97fb-e46a0b39527d tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4449f86ff99f4ec796c76166da3bc9f3', 'request_id': 'req-3a07e6f6-eddb-412d-97fb-e46a0b39527d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:39.224412 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3a07e6f6-eddb-412d-97fb-e46a0b39527d tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4449f86ff99f4ec796c76166da3bc9f3', 'request_id': 'req-3a07e6f6-eddb-412d-97fb-e46a0b39527d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:39.240938 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25783707-d32b-4cf8-b614-f51fbb9b1ad6 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:39.249722 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3a07e6f6-eddb-412d-97fb-e46a0b39527d tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4449f86ff99f4ec796c76166da3bc9f3', 'request_id': 'req-3a07e6f6-eddb-412d-97fb-e46a0b39527d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:39.290124 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3a07e6f6-eddb-412d-97fb-e46a0b39527d tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] The token cache is being invalidate because project 4449f86ff99f4ec796c76166da3bc9f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:39.291168 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3a07e6f6-eddb-412d-97fb-e46a0b39527d tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:39.292833 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3a07e6f6-eddb-412d-97fb-e46a0b39527d tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:39.298376 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3039/6096] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:38 2022] DELETE /identity/v3/projects/4449f86ff99f4ec796c76166da3bc9f3 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:39.304624 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07e6f6-eddb-412d-97fb-e46a0b39527d tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:39.307246 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3a07e6f6-eddb-412d-97fb-e46a0b39527d tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:39.319602 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:39.339677 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe361448-c19d-4473-b6b7-9178da690e52 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9091743fac34d39b29926224ccda5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '719e987ad03d4c2eae8920a1047bd434', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:39.340427 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe361448-c19d-4473-b6b7-9178da690e52 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:39.340801 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe361448-c19d-4473-b6b7-9178da690e52 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:39.341083 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe361448-c19d-4473-b6b7-9178da690e52 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] PATH_INFO: `/v3/regions/tempest-region-116997457` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:39.341752 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe361448-c19d-4473-b6b7-9178da690e52 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-116997457)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:39.344017 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe361448-c19d-4473-b6b7-9178da690e52 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:39.346734 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3058/6097] 10.222.0.83 () {58 vars in 1203 bytes} [Mon Aug 29 16:05:39 2022] GET /identity/v3/regions/tempest-region-116997457 => generated 178 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:39.350707 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe361448-c19d-4473-b6b7-9178da690e52 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:39.356158 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-fe361448-c19d-4473-b6b7-9178da690e52 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:39.382834 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe361448-c19d-4473-b6b7-9178da690e52 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:39.399780 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e89163-68a7-47f1-9387-d16ecc235e73 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9091743fac34d39b29926224ccda5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '719e987ad03d4c2eae8920a1047bd434', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:39.400635 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e89163-68a7-47f1-9387-d16ecc235e73 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:39.400771 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e89163-68a7-47f1-9387-d16ecc235e73 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:39.401101 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e89163-68a7-47f1-9387-d16ecc235e73 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] PATH_INFO: `/v3/endpoints/235d79ff2d034eea95e8c6fc55e09e27` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:39.417932 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e89163-68a7-47f1-9387-d16ecc235e73 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=235d79ff2d034eea95e8c6fc55e09e27)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:39.419723 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e89163-68a7-47f1-9387-d16ecc235e73 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:39.432397 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-b5e89163-68a7-47f1-9387-d16ecc235e73 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 29 16:05:39.432397 n-d-836830-13 devstack@keystone.service[82149]: Failed validating 'type' in schema['properties']['enabled']: Aug 29 16:05:39.432397 n-d-836830-13 devstack@keystone.service[82149]: {'enum': [True, False, None], 'type': 'boolean'} Aug 29 16:05:39.432397 n-d-836830-13 devstack@keystone.service[82149]: On instance['enabled']: Aug 29 16:05:39.432397 n-d-836830-13 devstack@keystone.service[82149]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 29 16:05:39.432397 n-d-836830-13 devstack@keystone.service[82149]: Failed validating 'type' in schema['properties']['enabled']: Aug 29 16:05:39.432397 n-d-836830-13 devstack@keystone.service[82149]: {'enum': [True, False, None], 'type': 'boolean'} Aug 29 16:05:39.432397 n-d-836830-13 devstack@keystone.service[82149]: On instance['enabled']: Aug 29 16:05:39.432397 n-d-836830-13 devstack@keystone.service[82149]: 'True' Aug 29 16:05:39.432397 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:05:39.432397 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 29 16:05:39.432397 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 29 16:05:39.432397 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 16:05:39.432397 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise error Aug 29 16:05:39.432397 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Aug 29 16:05:39.432397 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:05:39.432397 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 29 16:05:39.432397 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 29 16:05:39.432397 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:05:39.432397 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application On instance['enabled']: Aug 29 16:05:39.432397 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application 'True' Aug 29 16:05:39.432397 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:05:39.432397 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 16:05:39.433661 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:05:39.433661 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:05:39.433661 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:05:39.433661 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:05:39.433661 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:05:39.433661 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:05:39.433661 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:05:39.433661 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:05:39.433661 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:05:39.433661 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:05:39.433661 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:05:39.433661 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:05:39.433661 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Aug 29 16:05:39.433661 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Aug 29 16:05:39.433661 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 29 16:05:39.433661 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 29 16:05:39.433661 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 29 16:05:39.434635 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 29 16:05:39.434635 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 29 16:05:39.434635 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:05:39.434635 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 29 16:05:39.434635 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 29 16:05:39.434635 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:05:39.434635 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application On instance['enabled']: Aug 29 16:05:39.434635 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application 'True' Aug 29 16:05:39.434635 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:05:39.444730 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3059/6098] 10.222.0.83 () {60 vars in 1255 bytes} [Mon Aug 29 16:05:39 2022] PATCH /identity/v3/endpoints/235d79ff2d034eea95e8c6fc55e09e27 => generated 281 bytes in 86 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 29 16:05:39.449466 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e89163-68a7-47f1-9387-d16ecc235e73 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:39.464370 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e89163-68a7-47f1-9387-d16ecc235e73 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:39.484872 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07e6f6-eddb-412d-97fb-e46a0b39527d tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:39.493265 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79504bfe-9aa3-4fe3-8616-fbeceb878352 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9091743fac34d39b29926224ccda5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '719e987ad03d4c2eae8920a1047bd434', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:39.494036 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79504bfe-9aa3-4fe3-8616-fbeceb878352 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:39.494380 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79504bfe-9aa3-4fe3-8616-fbeceb878352 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:39.494720 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79504bfe-9aa3-4fe3-8616-fbeceb878352 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] PATH_INFO: `/v3/endpoints/235d79ff2d034eea95e8c6fc55e09e27` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:39.496002 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79504bfe-9aa3-4fe3-8616-fbeceb878352 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=235d79ff2d034eea95e8c6fc55e09e27)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:39.497759 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79504bfe-9aa3-4fe3-8616-fbeceb878352 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:39.521984 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-79504bfe-9aa3-4fe3-8616-fbeceb878352 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '235d79ff2d034eea95e8c6fc55e09e27', 'request_id': 'req-79504bfe-9aa3-4fe3-8616-fbeceb878352'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:39.532554 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6b732-d0ed-4b38-9feb-12bc50398c3f tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52b94a1308494bb283b7bfe4a1ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984405c23591415eaf067cb43305057d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:39.533042 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6b732-d0ed-4b38-9feb-12bc50398c3f tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:39.533368 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6b732-d0ed-4b38-9feb-12bc50398c3f tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:39.533697 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6b732-d0ed-4b38-9feb-12bc50398c3f tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:39.535339 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe6b732-d0ed-4b38-9feb-12bc50398c3f tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:39.536397 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3060/6099] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:39 2022] DELETE /identity/v3/endpoints/235d79ff2d034eea95e8c6fc55e09e27 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:39.540605 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79504bfe-9aa3-4fe3-8616-fbeceb878352 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:39.541345 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe6b732-d0ed-4b38-9feb-12bc50398c3f tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:39.588378 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79504bfe-9aa3-4fe3-8616-fbeceb878352 tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:39.591883 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3040/6100] 10.222.0.83 () {60 vars in 1152 bytes} [Mon Aug 29 16:05:39 2022] POST /identity/v3/projects => generated 347 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:39.596486 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6b732-d0ed-4b38-9feb-12bc50398c3f tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:39.652233 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:39.750728 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6b732-d0ed-4b38-9feb-12bc50398c3f tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:39.759266 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b329f3-cd51-44b1-976a-54986d42ea0a tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9091743fac34d39b29926224ccda5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '719e987ad03d4c2eae8920a1047bd434', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:39.760708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b329f3-cd51-44b1-976a-54986d42ea0a tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:39.761216 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b329f3-cd51-44b1-976a-54986d42ea0a tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:39.761897 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b329f3-cd51-44b1-976a-54986d42ea0a tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] PATH_INFO: `/v3/regions/tempest-region-116997457` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:39.768463 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b329f3-cd51-44b1-976a-54986d42ea0a tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-116997457)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:39.771350 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b329f3-cd51-44b1-976a-54986d42ea0a tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:39.790486 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4f78d-ecf3-493a-bf93-b6118a7f9e13 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52b94a1308494bb283b7bfe4a1ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984405c23591415eaf067cb43305057d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:39.792342 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4f78d-ecf3-493a-bf93-b6118a7f9e13 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:39.793865 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4f78d-ecf3-493a-bf93-b6118a7f9e13 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:39.794159 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4f78d-ecf3-493a-bf93-b6118a7f9e13 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] PATH_INFO: `/v3/projects/089fa611deb4484494a1d88fa1c8f289` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:39.796382 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d4f78d-ecf3-493a-bf93-b6118a7f9e13 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorizing `identity:get_project(project_id=089fa611deb4484494a1d88fa1c8f289)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:39.798971 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d4f78d-ecf3-493a-bf93-b6118a7f9e13 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:39.804634 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3041/6101] 10.222.0.83 () {58 vars in 1230 bytes} [Mon Aug 29 16:05:39 2022] GET /identity/v3/projects/089fa611deb4484494a1d88fa1c8f289 => generated 347 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:39.813897 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4f78d-ecf3-493a-bf93-b6118a7f9e13 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:39.819971 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3061/6102] 10.222.0.83 () {58 vars in 1206 bytes} [Mon Aug 29 16:05:39 2022] DELETE /identity/v3/regions/tempest-region-116997457 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:39.820977 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b329f3-cd51-44b1-976a-54986d42ea0a tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:39.841311 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4f78d-ecf3-493a-bf93-b6118a7f9e13 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:39.866070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b329f3-cd51-44b1-976a-54986d42ea0a tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:39.871559 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef49e5-0179-49a1-bb44-3a82b998dc7a tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9091743fac34d39b29926224ccda5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '719e987ad03d4c2eae8920a1047bd434', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:39.872384 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef49e5-0179-49a1-bb44-3a82b998dc7a tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:39.872667 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef49e5-0179-49a1-bb44-3a82b998dc7a tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:39.872801 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ab694-e676-4c29-9fcd-b7247c3e074b tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52b94a1308494bb283b7bfe4a1ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984405c23591415eaf067cb43305057d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:39.872987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef49e5-0179-49a1-bb44-3a82b998dc7a tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] PATH_INFO: `/v3/services/fadac5de9ed143cbbb51ca99fec8e78d` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:39.873431 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ab694-e676-4c29-9fcd-b7247c3e074b tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:39.873774 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ef49e5-0179-49a1-bb44-3a82b998dc7a tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] RBAC: Authorizing `identity:delete_service(service_id=fadac5de9ed143cbbb51ca99fec8e78d)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:39.874450 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ab694-e676-4c29-9fcd-b7247c3e074b tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:39.875521 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ab694-e676-4c29-9fcd-b7247c3e074b tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] PATH_INFO: `/v3/projects/089fa611deb4484494a1d88fa1c8f289` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:39.878123 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499ab694-e676-4c29-9fcd-b7247c3e074b tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorizing `identity:delete_project(project_id=089fa611deb4484494a1d88fa1c8f289)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:39.882247 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499ab694-e676-4c29-9fcd-b7247c3e074b tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:39.884815 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ef49e5-0179-49a1-bb44-3a82b998dc7a tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:39.942716 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3062/6103] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:39 2022] DELETE /identity/v3/services/fadac5de9ed143cbbb51ca99fec8e78d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:39.947663 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef49e5-0179-49a1-bb44-3a82b998dc7a tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:39.950819 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a7ef49e5-0179-49a1-bb44-3a82b998dc7a tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:40.005602 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-499ab694-e676-4c29-9fcd-b7247c3e074b tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '089fa611deb4484494a1d88fa1c8f289', 'request_id': 'req-499ab694-e676-4c29-9fcd-b7247c3e074b'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:40.017915 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-499ab694-e676-4c29-9fcd-b7247c3e074b tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '089fa611deb4484494a1d88fa1c8f289', 'request_id': 'req-499ab694-e676-4c29-9fcd-b7247c3e074b'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:40.040184 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-499ab694-e676-4c29-9fcd-b7247c3e074b tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '089fa611deb4484494a1d88fa1c8f289', 'request_id': 'req-499ab694-e676-4c29-9fcd-b7247c3e074b'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:40.096179 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-499ab694-e676-4c29-9fcd-b7247c3e074b tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] The token cache is being invalidate because project 089fa611deb4484494a1d88fa1c8f289 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:40.096529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-499ab694-e676-4c29-9fcd-b7247c3e074b tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:40.100168 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-499ab694-e676-4c29-9fcd-b7247c3e074b tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:40.106284 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:40.114247 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3042/6104] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:39 2022] DELETE /identity/v3/projects/089fa611deb4484494a1d88fa1c8f289 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:40.115715 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ab694-e676-4c29-9fcd-b7247c3e074b tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:40.117504 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-499ab694-e676-4c29-9fcd-b7247c3e074b tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:40.123827 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef49e5-0179-49a1-bb44-3a82b998dc7a tempest-EndpointsNegativeTestJSON-1958774461 tempest-EndpointsNegativeTestJSON-1958774461-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:40.282018 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b8afc-bc1a-4803-8d82-8c4651d09d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:40.282961 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b8afc-bc1a-4803-8d82-8c4651d09d85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:40.283105 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ab694-e676-4c29-9fcd-b7247c3e074b tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:40.283562 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b8afc-bc1a-4803-8d82-8c4651d09d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:40.284097 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b8afc-bc1a-4803-8d82-8c4651d09d85 admin admin] PATH_INFO: `/v3/users/387dfba1f1b7495dbda475b221d7fcae` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:40.290442 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b8afc-bc1a-4803-8d82-8c4651d09d85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=387dfba1f1b7495dbda475b221d7fcae)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:40.293849 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b8afc-bc1a-4803-8d82-8c4651d09d85 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:40.355314 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd577a36-b968-4b32-b0a2-b8d347d775f3 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52b94a1308494bb283b7bfe4a1ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984405c23591415eaf067cb43305057d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:40.355946 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd577a36-b968-4b32-b0a2-b8d347d775f3 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:40.356229 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd577a36-b968-4b32-b0a2-b8d347d775f3 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:40.356503 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd577a36-b968-4b32-b0a2-b8d347d775f3 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:40.360690 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd577a36-b968-4b32-b0a2-b8d347d775f3 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:40.364486 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd577a36-b968-4b32-b0a2-b8d347d775f3 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:40.425978 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3043/6105] 10.222.0.83 () {60 vars in 1149 bytes} [Mon Aug 29 16:05:40 2022] POST /identity/v3/domains => generated 277 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:40.431208 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd577a36-b968-4b32-b0a2-b8d347d775f3 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:40.512644 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ad8b8afc-bc1a-4803-8d82-8c4651d09d85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '387dfba1f1b7495dbda475b221d7fcae'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:40.513294 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:40.515745 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ad8b8afc-bc1a-4803-8d82-8c4651d09d85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '387dfba1f1b7495dbda475b221d7fcae'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:40.557402 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ad8b8afc-bc1a-4803-8d82-8c4651d09d85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '387dfba1f1b7495dbda475b221d7fcae'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:40.577959 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ad8b8afc-bc1a-4803-8d82-8c4651d09d85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '387dfba1f1b7495dbda475b221d7fcae'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:40.582404 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ad8b8afc-bc1a-4803-8d82-8c4651d09d85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '387dfba1f1b7495dbda475b221d7fcae'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:40.629149 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd577a36-b968-4b32-b0a2-b8d347d775f3 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:40.648985 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3933b-59cf-490d-b01a-e68545251202 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52b94a1308494bb283b7bfe4a1ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984405c23591415eaf067cb43305057d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:40.649641 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3933b-59cf-490d-b01a-e68545251202 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:40.649929 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3933b-59cf-490d-b01a-e68545251202 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:40.650210 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3933b-59cf-490d-b01a-e68545251202 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:40.650880 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d3933b-59cf-490d-b01a-e68545251202 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:40.659947 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3063/6106] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:05:39 2022] DELETE /identity/v3/users/387dfba1f1b7495dbda475b221d7fcae => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:05:40.660520 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d3933b-59cf-490d-b01a-e68545251202 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:40.666455 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796954bd-e331-466b-8a28-008ef51bdb0f None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:40.667094 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796954bd-e331-466b-8a28-008ef51bdb0f None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:40.667379 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796954bd-e331-466b-8a28-008ef51bdb0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:40.743061 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-796954bd-e331-466b-8a28-008ef51bdb0f None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:40.744420 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-796954bd-e331-466b-8a28-008ef51bdb0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:40.792833 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3044/6107] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:05:40 2022] POST /identity/v3/projects => generated 405 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:40.797733 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3933b-59cf-490d-b01a-e68545251202 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:40.799800 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d0d3933b-59cf-490d-b01a-e68545251202 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:40.888458 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3064/6108] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:40.895114 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796954bd-e331-466b-8a28-008ef51bdb0f None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:40.896825 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-796954bd-e331-466b-8a28-008ef51bdb0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:40.981669 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:40.985469 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3933b-59cf-490d-b01a-e68545251202 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:40.996553 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32d361-fd90-4fe5-94bf-53079279e23d tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52b94a1308494bb283b7bfe4a1ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984405c23591415eaf067cb43305057d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:40.997227 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32d361-fd90-4fe5-94bf-53079279e23d tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:40.997514 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32d361-fd90-4fe5-94bf-53079279e23d tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:40.997834 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32d361-fd90-4fe5-94bf-53079279e23d tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] PATH_INFO: `/v3/projects/2fc11a65d67d4b79b6a691d530cb3c8a` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:41.000463 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e32d361-fd90-4fe5-94bf-53079279e23d tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorizing `identity:get_project(project_id=2fc11a65d67d4b79b6a691d530cb3c8a)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:41.003719 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e32d361-fd90-4fe5-94bf-53079279e23d tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:41.007128 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3045/6109] 10.222.0.83 () {58 vars in 1230 bytes} [Mon Aug 29 16:05:40 2022] GET /identity/v3/projects/2fc11a65d67d4b79b6a691d530cb3c8a => generated 405 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:05:41.012228 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32d361-fd90-4fe5-94bf-53079279e23d tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:41.050572 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32d361-fd90-4fe5-94bf-53079279e23d tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:41.067466 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb1f371-4d96-4ff7-8ba8-7d2dc85e0e74 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52b94a1308494bb283b7bfe4a1ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984405c23591415eaf067cb43305057d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:41.068175 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1f371-4d96-4ff7-8ba8-7d2dc85e0e74 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:41.068464 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1f371-4d96-4ff7-8ba8-7d2dc85e0e74 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:41.068736 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1f371-4d96-4ff7-8ba8-7d2dc85e0e74 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] PATH_INFO: `/v3/projects/2fc11a65d67d4b79b6a691d530cb3c8a` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:41.070832 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb1f371-4d96-4ff7-8ba8-7d2dc85e0e74 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2fc11a65d67d4b79b6a691d530cb3c8a)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:41.073979 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb1f371-4d96-4ff7-8ba8-7d2dc85e0e74 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:41.140338 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796954bd-e331-466b-8a28-008ef51bdb0f None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:41.192585 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-bcb1f371-4d96-4ff7-8ba8-7d2dc85e0e74 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fc11a65d67d4b79b6a691d530cb3c8a', 'request_id': 'req-bcb1f371-4d96-4ff7-8ba8-7d2dc85e0e74'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:41.210607 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-bcb1f371-4d96-4ff7-8ba8-7d2dc85e0e74 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fc11a65d67d4b79b6a691d530cb3c8a', 'request_id': 'req-bcb1f371-4d96-4ff7-8ba8-7d2dc85e0e74'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:41.223470 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-bcb1f371-4d96-4ff7-8ba8-7d2dc85e0e74 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fc11a65d67d4b79b6a691d530cb3c8a', 'request_id': 'req-bcb1f371-4d96-4ff7-8ba8-7d2dc85e0e74'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:41.243930 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-bcb1f371-4d96-4ff7-8ba8-7d2dc85e0e74 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] The token cache is being invalidate because project 2fc11a65d67d4b79b6a691d530cb3c8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:41.244349 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-bcb1f371-4d96-4ff7-8ba8-7d2dc85e0e74 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:41.246187 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-bcb1f371-4d96-4ff7-8ba8-7d2dc85e0e74 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:41.248773 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3046/6110] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:41 2022] DELETE /identity/v3/projects/2fc11a65d67d4b79b6a691d530cb3c8a => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:41.253262 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb1f371-4d96-4ff7-8ba8-7d2dc85e0e74 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:41.254694 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-bcb1f371-4d96-4ff7-8ba8-7d2dc85e0e74 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:41.287802 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e88eb-c6d5-457c-92fd-38f205ebf30a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:41.288442 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e88eb-c6d5-457c-92fd-38f205ebf30a service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:41.288720 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e88eb-c6d5-457c-92fd-38f205ebf30a service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:41.288988 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e88eb-c6d5-457c-92fd-38f205ebf30a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:41.296779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e71e88eb-c6d5-457c-92fd-38f205ebf30a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:41.355520 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:41.431221 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb1f371-4d96-4ff7-8ba8-7d2dc85e0e74 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:41.446423 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3187c-dfd7-4220-a52b-f81e8381ab35 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52b94a1308494bb283b7bfe4a1ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984405c23591415eaf067cb43305057d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:41.447479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3187c-dfd7-4220-a52b-f81e8381ab35 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:41.447852 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3187c-dfd7-4220-a52b-f81e8381ab35 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:41.448505 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3187c-dfd7-4220-a52b-f81e8381ab35 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] PATH_INFO: `/v3/domains/80e5c509ac0b4ad5bdece6722d5eb9af` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:41.452152 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c3187c-dfd7-4220-a52b-f81e8381ab35 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=80e5c509ac0b4ad5bdece6722d5eb9af)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:41.453937 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c3187c-dfd7-4220-a52b-f81e8381ab35 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:41.457624 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e88eb-c6d5-457c-92fd-38f205ebf30a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:41.459237 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e88eb-c6d5-457c-92fd-38f205ebf30a service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:41.499792 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3065/6111] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:05:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:05:41.523700 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d7c3187c-dfd7-4220-a52b-f81e8381ab35 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '80e5c509ac0b4ad5bdece6722d5eb9af'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:41.526196 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d7c3187c-dfd7-4220-a52b-f81e8381ab35 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '80e5c509ac0b4ad5bdece6722d5eb9af'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:41.618307 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d7c3187c-dfd7-4220-a52b-f81e8381ab35 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '80e5c509ac0b4ad5bdece6722d5eb9af'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:41.622263 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d7c3187c-dfd7-4220-a52b-f81e8381ab35 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '80e5c509ac0b4ad5bdece6722d5eb9af'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:41.633153 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3047/6112] 10.222.0.83 () {60 vars in 1249 bytes} [Mon Aug 29 16:05:41 2022] PATCH /identity/v3/domains/80e5c509ac0b4ad5bdece6722d5eb9af => generated 278 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:05:41.635971 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e88eb-c6d5-457c-92fd-38f205ebf30a service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:41.670708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e88eb-c6d5-457c-92fd-38f205ebf30a service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:41.794278 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c39ef2-fe36-4474-9456-2017bba2e540 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:41.795775 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c39ef2-fe36-4474-9456-2017bba2e540 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:41.796113 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c39ef2-fe36-4474-9456-2017bba2e540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:41.841158 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-d7c39ef2-fe36-4474-9456-2017bba2e540 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:41.842503 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d7c39ef2-fe36-4474-9456-2017bba2e540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:41.895840 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f84c948-0349-4501-8857-7d2c05af814e tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52b94a1308494bb283b7bfe4a1ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984405c23591415eaf067cb43305057d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:41.896760 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84c948-0349-4501-8857-7d2c05af814e tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:41.897190 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84c948-0349-4501-8857-7d2c05af814e tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:41.897641 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84c948-0349-4501-8857-7d2c05af814e tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] PATH_INFO: `/v3/domains/80e5c509ac0b4ad5bdece6722d5eb9af` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:41.922192 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f84c948-0349-4501-8857-7d2c05af814e tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=80e5c509ac0b4ad5bdece6722d5eb9af)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:41.924303 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f84c948-0349-4501-8857-7d2c05af814e tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:41.971420 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:42.042242 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9f84c948-0349-4501-8857-7d2c05af814e tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '80e5c509ac0b4ad5bdece6722d5eb9af'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:42.075183 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9f84c948-0349-4501-8857-7d2c05af814e tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '80e5c509ac0b4ad5bdece6722d5eb9af'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:42.079372 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3048/6113] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 16:05:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:42.105024 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c39ef2-fe36-4474-9456-2017bba2e540 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:42.106596 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d7c39ef2-fe36-4474-9456-2017bba2e540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:42.228537 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9f84c948-0349-4501-8857-7d2c05af814e tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80e5c509ac0b4ad5bdece6722d5eb9af', 'request_id': 'req-9f84c948-0349-4501-8857-7d2c05af814e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:42.251399 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9f84c948-0349-4501-8857-7d2c05af814e tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80e5c509ac0b4ad5bdece6722d5eb9af', 'request_id': 'req-9f84c948-0349-4501-8857-7d2c05af814e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:42.278276 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9f84c948-0349-4501-8857-7d2c05af814e tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80e5c509ac0b4ad5bdece6722d5eb9af', 'request_id': 'req-9f84c948-0349-4501-8857-7d2c05af814e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:42.334027 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9f84c948-0349-4501-8857-7d2c05af814e tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] The token cache is being invalidate because project 80e5c509ac0b4ad5bdece6722d5eb9af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:42.334338 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9f84c948-0349-4501-8857-7d2c05af814e tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:42.338080 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9f84c948-0349-4501-8857-7d2c05af814e tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:42.376452 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9f84c948-0349-4501-8857-7d2c05af814e tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '80e5c509ac0b4ad5bdece6722d5eb9af', 'request_id': 'req-9f84c948-0349-4501-8857-7d2c05af814e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:42.390926 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9f84c948-0349-4501-8857-7d2c05af814e tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '80e5c509ac0b4ad5bdece6722d5eb9af', 'request_id': 'req-9f84c948-0349-4501-8857-7d2c05af814e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:42.395707 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9f84c948-0349-4501-8857-7d2c05af814e tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '80e5c509ac0b4ad5bdece6722d5eb9af', 'request_id': 'req-9f84c948-0349-4501-8857-7d2c05af814e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:42.436985 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3066/6114] 10.222.0.83 () {58 vars in 1230 bytes} [Mon Aug 29 16:05:41 2022] DELETE /identity/v3/domains/80e5c509ac0b4ad5bdece6722d5eb9af => generated 0 bytes in 802 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:42.462139 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f84c948-0349-4501-8857-7d2c05af814e tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:42.468408 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9f84c948-0349-4501-8857-7d2c05af814e tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:42.475703 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c39ef2-fe36-4474-9456-2017bba2e540 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:42.547529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:42.629976 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f84c948-0349-4501-8857-7d2c05af814e tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:42.635689 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda50400-7550-4be0-9dd5-798fd4a0ec8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:42.636494 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda50400-7550-4be0-9dd5-798fd4a0ec8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:42.637037 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda50400-7550-4be0-9dd5-798fd4a0ec8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:42.637222 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda50400-7550-4be0-9dd5-798fd4a0ec8a admin admin] PATH_INFO: `/v3/projects/60a1e2d779514957a80d1a4c1026cc1d` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:42.638513 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda50400-7550-4be0-9dd5-798fd4a0ec8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=60a1e2d779514957a80d1a4c1026cc1d)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:42.643105 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda50400-7550-4be0-9dd5-798fd4a0ec8a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:42.654044 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa1f4c5-4275-4a70-b9b4-15cb5d639b85 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:42.655464 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1f4c5-4275-4a70-b9b4-15cb5d639b85 service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:42.655681 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1f4c5-4275-4a70-b9b4-15cb5d639b85 service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:42.655927 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1f4c5-4275-4a70-b9b4-15cb5d639b85 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:42.670776 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5aa1f4c5-4275-4a70-b9b4-15cb5d639b85 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:42.783303 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-bda50400-7550-4be0-9dd5-798fd4a0ec8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60a1e2d779514957a80d1a4c1026cc1d', 'request_id': 'req-bda50400-7550-4be0-9dd5-798fd4a0ec8a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:42.788774 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:42.792001 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-bda50400-7550-4be0-9dd5-798fd4a0ec8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60a1e2d779514957a80d1a4c1026cc1d', 'request_id': 'req-bda50400-7550-4be0-9dd5-798fd4a0ec8a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:42.809990 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-bda50400-7550-4be0-9dd5-798fd4a0ec8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60a1e2d779514957a80d1a4c1026cc1d', 'request_id': 'req-bda50400-7550-4be0-9dd5-798fd4a0ec8a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:42.855124 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-bda50400-7550-4be0-9dd5-798fd4a0ec8a admin admin] The token cache is being invalidate because project 60a1e2d779514957a80d1a4c1026cc1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:42.855124 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-bda50400-7550-4be0-9dd5-798fd4a0ec8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:42.856112 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-bda50400-7550-4be0-9dd5-798fd4a0ec8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:42.858842 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3067/6115] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:42 2022] DELETE /identity/v3/projects/60a1e2d779514957a80d1a4c1026cc1d => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:42.861953 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda50400-7550-4be0-9dd5-798fd4a0ec8a admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:42.864912 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-bda50400-7550-4be0-9dd5-798fd4a0ec8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:42.883177 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa1f4c5-4275-4a70-b9b4-15cb5d639b85 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:42.887193 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa1f4c5-4275-4a70-b9b4-15cb5d639b85 service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:42.921318 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3049/6116] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 16:05:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 820 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 16:05:42.922220 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa1f4c5-4275-4a70-b9b4-15cb5d639b85 service swift] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:42.965216 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa1f4c5-4275-4a70-b9b4-15cb5d639b85 service swift] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:43.070709 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda50400-7550-4be0-9dd5-798fd4a0ec8a admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:43.085364 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a344e1b-a13b-4787-9324-ce2887a2d8a3 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52b94a1308494bb283b7bfe4a1ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984405c23591415eaf067cb43305057d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:43.086211 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a344e1b-a13b-4787-9324-ce2887a2d8a3 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:43.087786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a344e1b-a13b-4787-9324-ce2887a2d8a3 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:43.088240 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a344e1b-a13b-4787-9324-ce2887a2d8a3 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:43.089253 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a344e1b-a13b-4787-9324-ce2887a2d8a3 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:43.094222 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a344e1b-a13b-4787-9324-ce2887a2d8a3 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:43.150248 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3068/6117] 10.222.0.83 () {60 vars in 1149 bytes} [Mon Aug 29 16:05:42 2022] POST /identity/v3/domains => generated 276 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:43.151190 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a344e1b-a13b-4787-9324-ce2887a2d8a3 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:43.151879 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d5aef-faa5-45d0-9206-d83a52cf4eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:43.153359 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d5aef-faa5-45d0-9206-d83a52cf4eab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:43.153643 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d5aef-faa5-45d0-9206-d83a52cf4eab admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:43.153919 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d5aef-faa5-45d0-9206-d83a52cf4eab admin admin] PATH_INFO: `/v3/users/e9091743fac34d39b29926224ccda5d9` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:43.158101 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d5aef-faa5-45d0-9206-d83a52cf4eab admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9091743fac34d39b29926224ccda5d9)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:43.163885 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d5aef-faa5-45d0-9206-d83a52cf4eab admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:43.339374 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6a2d5aef-faa5-45d0-9206-d83a52cf4eab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9091743fac34d39b29926224ccda5d9'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:43.339999 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a344e1b-a13b-4787-9324-ce2887a2d8a3 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:43.341748 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6a2d5aef-faa5-45d0-9206-d83a52cf4eab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9091743fac34d39b29926224ccda5d9'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:43.358492 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd1e857-9514-43f7-bae1-0f239afbc3f2 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52b94a1308494bb283b7bfe4a1ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984405c23591415eaf067cb43305057d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:43.359439 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1e857-9514-43f7-bae1-0f239afbc3f2 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:43.360943 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1e857-9514-43f7-bae1-0f239afbc3f2 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:43.362984 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1e857-9514-43f7-bae1-0f239afbc3f2 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:43.363895 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd1e857-9514-43f7-bae1-0f239afbc3f2 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:43.366072 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd1e857-9514-43f7-bae1-0f239afbc3f2 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:43.393581 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6a2d5aef-faa5-45d0-9206-d83a52cf4eab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9091743fac34d39b29926224ccda5d9'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:43.404253 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:43.437846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6a2d5aef-faa5-45d0-9206-d83a52cf4eab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9091743fac34d39b29926224ccda5d9'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:43.461114 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6a2d5aef-faa5-45d0-9206-d83a52cf4eab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9091743fac34d39b29926224ccda5d9'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:43.476109 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3069/6118] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:05:43 2022] POST /identity/v3/projects => generated 410 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:43.479276 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd1e857-9514-43f7-bae1-0f239afbc3f2 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:43.484972 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5cd1e857-9514-43f7-bae1-0f239afbc3f2 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:43.493699 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3050/6119] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:05:42 2022] DELETE /identity/v3/users/e9091743fac34d39b29926224ccda5d9 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:43.622161 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:43.651270 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd1e857-9514-43f7-bae1-0f239afbc3f2 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:43.894082 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504fec48-c6bd-4acb-9bf7-b3acb64467d4 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52b94a1308494bb283b7bfe4a1ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984405c23591415eaf067cb43305057d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:43.894547 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fec48-c6bd-4acb-9bf7-b3acb64467d4 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:43.894829 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fec48-c6bd-4acb-9bf7-b3acb64467d4 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:43.895136 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fec48-c6bd-4acb-9bf7-b3acb64467d4 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:43.895813 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504fec48-c6bd-4acb-9bf7-b3acb64467d4 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:43.900474 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504fec48-c6bd-4acb-9bf7-b3acb64467d4 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:44.061161 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3070/6120] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:05:43 2022] POST /identity/v3/projects => generated 404 bytes in 584 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:44.064937 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d5aef-faa5-45d0-9206-d83a52cf4eab admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:44.100016 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d5aef-faa5-45d0-9206-d83a52cf4eab admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:44.250354 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f626e2f-210b-424c-81c5-d9ea2a4a6bed tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52b94a1308494bb283b7bfe4a1ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984405c23591415eaf067cb43305057d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:44.250957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f626e2f-210b-424c-81c5-d9ea2a4a6bed tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:44.251264 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f626e2f-210b-424c-81c5-d9ea2a4a6bed tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:44.251535 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f626e2f-210b-424c-81c5-d9ea2a4a6bed tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] PATH_INFO: `/v3/projects/db8dfed7190c4cfc810255515eaabbb6` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:44.252716 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f626e2f-210b-424c-81c5-d9ea2a4a6bed tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorizing `identity:delete_project(project_id=db8dfed7190c4cfc810255515eaabbb6)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:44.254648 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f626e2f-210b-424c-81c5-d9ea2a4a6bed tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:44.314759 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504fec48-c6bd-4acb-9bf7-b3acb64467d4 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:44.316508 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-504fec48-c6bd-4acb-9bf7-b3acb64467d4 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:44.401877 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1f626e2f-210b-424c-81c5-d9ea2a4a6bed tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db8dfed7190c4cfc810255515eaabbb6', 'request_id': 'req-1f626e2f-210b-424c-81c5-d9ea2a4a6bed'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:44.418986 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1f626e2f-210b-424c-81c5-d9ea2a4a6bed tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db8dfed7190c4cfc810255515eaabbb6', 'request_id': 'req-1f626e2f-210b-424c-81c5-d9ea2a4a6bed'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:44.439141 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1f626e2f-210b-424c-81c5-d9ea2a4a6bed tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db8dfed7190c4cfc810255515eaabbb6', 'request_id': 'req-1f626e2f-210b-424c-81c5-d9ea2a4a6bed'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:44.476266 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1f626e2f-210b-424c-81c5-d9ea2a4a6bed tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] The token cache is being invalidate because project db8dfed7190c4cfc810255515eaabbb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:44.476561 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1f626e2f-210b-424c-81c5-d9ea2a4a6bed tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:44.494103 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1f626e2f-210b-424c-81c5-d9ea2a4a6bed tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:44.497099 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3051/6121] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:44 2022] DELETE /identity/v3/projects/db8dfed7190c4cfc810255515eaabbb6 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:44.509453 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f626e2f-210b-424c-81c5-d9ea2a4a6bed tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:44.521732 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1f626e2f-210b-424c-81c5-d9ea2a4a6bed tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:44.571580 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504fec48-c6bd-4acb-9bf7-b3acb64467d4 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:44.755676 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f626e2f-210b-424c-81c5-d9ea2a4a6bed tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:44.758862 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011491de-ab16-4124-b69e-9b638ca0dcd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:44.759552 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011491de-ab16-4124-b69e-9b638ca0dcd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:44.759828 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011491de-ab16-4124-b69e-9b638ca0dcd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:44.760097 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011491de-ab16-4124-b69e-9b638ca0dcd7 admin admin] PATH_INFO: `/v3/projects/719e987ad03d4c2eae8920a1047bd434` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:44.761816 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011491de-ab16-4124-b69e-9b638ca0dcd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=719e987ad03d4c2eae8920a1047bd434)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:44.765457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011491de-ab16-4124-b69e-9b638ca0dcd7 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:44.771213 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b0a90-11fa-417e-b311-46576ec55faa tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52b94a1308494bb283b7bfe4a1ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984405c23591415eaf067cb43305057d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:44.771919 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b0a90-11fa-417e-b311-46576ec55faa tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:44.772199 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b0a90-11fa-417e-b311-46576ec55faa tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:44.772470 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b0a90-11fa-417e-b311-46576ec55faa tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] PATH_INFO: `/v3/projects/57e069e159b14668825cfd7bd04afc37` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:44.773732 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b0a90-11fa-417e-b311-46576ec55faa tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorizing `identity:delete_project(project_id=57e069e159b14668825cfd7bd04afc37)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:44.777376 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b0a90-11fa-417e-b311-46576ec55faa tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:44.835728 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:44.848262 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:44.905828 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-011491de-ab16-4124-b69e-9b638ca0dcd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '719e987ad03d4c2eae8920a1047bd434', 'request_id': 'req-011491de-ab16-4124-b69e-9b638ca0dcd7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:44.926764 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e08b0a90-11fa-417e-b311-46576ec55faa tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57e069e159b14668825cfd7bd04afc37', 'request_id': 'req-e08b0a90-11fa-417e-b311-46576ec55faa'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:44.933069 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-011491de-ab16-4124-b69e-9b638ca0dcd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '719e987ad03d4c2eae8920a1047bd434', 'request_id': 'req-011491de-ab16-4124-b69e-9b638ca0dcd7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:44.955845 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e08b0a90-11fa-417e-b311-46576ec55faa tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57e069e159b14668825cfd7bd04afc37', 'request_id': 'req-e08b0a90-11fa-417e-b311-46576ec55faa'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:44.959319 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-011491de-ab16-4124-b69e-9b638ca0dcd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '719e987ad03d4c2eae8920a1047bd434', 'request_id': 'req-011491de-ab16-4124-b69e-9b638ca0dcd7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:44.986311 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e08b0a90-11fa-417e-b311-46576ec55faa tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57e069e159b14668825cfd7bd04afc37', 'request_id': 'req-e08b0a90-11fa-417e-b311-46576ec55faa'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:45.005964 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-011491de-ab16-4124-b69e-9b638ca0dcd7 admin admin] The token cache is being invalidate because project 719e987ad03d4c2eae8920a1047bd434 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:45.006261 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-011491de-ab16-4124-b69e-9b638ca0dcd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:45.012020 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-011491de-ab16-4124-b69e-9b638ca0dcd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:45.020727 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e08b0a90-11fa-417e-b311-46576ec55faa tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] The token cache is being invalidate because project 57e069e159b14668825cfd7bd04afc37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:45.021027 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e08b0a90-11fa-417e-b311-46576ec55faa tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:45.021378 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3071/6122] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:44 2022] DELETE /identity/v3/projects/719e987ad03d4c2eae8920a1047bd434 => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:05:45.022879 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e08b0a90-11fa-417e-b311-46576ec55faa tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:45.024629 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88de0a1-e920-4697-8a1d-c3b599526571 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:45.024909 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88de0a1-e920-4697-8a1d-c3b599526571 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:45.025185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88de0a1-e920-4697-8a1d-c3b599526571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:45.032147 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3052/6123] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:44 2022] DELETE /identity/v3/projects/57e069e159b14668825cfd7bd04afc37 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:45.036094 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b0a90-11fa-417e-b311-46576ec55faa tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:45.038385 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e08b0a90-11fa-417e-b311-46576ec55faa tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:45.096721 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a88de0a1-e920-4697-8a1d-c3b599526571 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:45.098000 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a88de0a1-e920-4697-8a1d-c3b599526571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:45.227558 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b0a90-11fa-417e-b311-46576ec55faa tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:45.269112 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1460c3-383d-4015-aea4-5e519d8cd349 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52b94a1308494bb283b7bfe4a1ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984405c23591415eaf067cb43305057d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:45.269780 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1460c3-383d-4015-aea4-5e519d8cd349 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:45.270058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1460c3-383d-4015-aea4-5e519d8cd349 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:45.270331 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1460c3-383d-4015-aea4-5e519d8cd349 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] PATH_INFO: `/v3/domains/53615249ca51484699185deb7d1ddb8e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:45.279599 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1460c3-383d-4015-aea4-5e519d8cd349 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=53615249ca51484699185deb7d1ddb8e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:45.281589 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1460c3-383d-4015-aea4-5e519d8cd349 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:45.303663 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3072/6124] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:45.305300 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d9e1d-2fde-4ad5-979e-295c11dc9ec8 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:45.305690 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d9e1d-2fde-4ad5-979e-295c11dc9ec8 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:45.306065 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d9e1d-2fde-4ad5-979e-295c11dc9ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:45.316435 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3b1460c3-383d-4015-aea4-5e519d8cd349 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '53615249ca51484699185deb7d1ddb8e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:45.317178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3b1460c3-383d-4015-aea4-5e519d8cd349 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '53615249ca51484699185deb7d1ddb8e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:45.343072 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-e12d9e1d-2fde-4ad5-979e-295c11dc9ec8 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:45.350963 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e12d9e1d-2fde-4ad5-979e-295c11dc9ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:45.367625 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3b1460c3-383d-4015-aea4-5e519d8cd349 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '53615249ca51484699185deb7d1ddb8e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:45.369575 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3b1460c3-383d-4015-aea4-5e519d8cd349 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '53615249ca51484699185deb7d1ddb8e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:45.375251 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3053/6125] 10.222.0.83 () {60 vars in 1249 bytes} [Mon Aug 29 16:05:45 2022] PATCH /identity/v3/domains/53615249ca51484699185deb7d1ddb8e => generated 277 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:45.385622 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1460c3-383d-4015-aea4-5e519d8cd349 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:45.388888 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3b1460c3-383d-4015-aea4-5e519d8cd349 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:45.540460 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3073/6126] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:45.545270 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12d9e1d-2fde-4ad5-979e-295c11dc9ec8 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:45.612218 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12d9e1d-2fde-4ad5-979e-295c11dc9ec8 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:45.637959 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b162c-dae2-4aa6-8f1c-a50b1904d733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:45.638643 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b162c-dae2-4aa6-8f1c-a50b1904d733 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:45.639670 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b162c-dae2-4aa6-8f1c-a50b1904d733 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:45.639956 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b162c-dae2-4aa6-8f1c-a50b1904d733 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:45.640702 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b162c-dae2-4aa6-8f1c-a50b1904d733 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:05:45.641013 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b162c-dae2-4aa6-8f1c-a50b1904d733 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:45.656449 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b162c-dae2-4aa6-8f1c-a50b1904d733 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:45.687569 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1460c3-383d-4015-aea4-5e519d8cd349 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:45.696053 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3074/6127] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:45.698566 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b162c-dae2-4aa6-8f1c-a50b1904d733 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:45.709119 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae3b8e-c80a-4f9d-9093-881037bcd5a0 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52b94a1308494bb283b7bfe4a1ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984405c23591415eaf067cb43305057d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:45.709816 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae3b8e-c80a-4f9d-9093-881037bcd5a0 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:45.710102 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae3b8e-c80a-4f9d-9093-881037bcd5a0 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:45.710380 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae3b8e-c80a-4f9d-9093-881037bcd5a0 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] PATH_INFO: `/v3/domains/53615249ca51484699185deb7d1ddb8e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:45.712560 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b162c-dae2-4aa6-8f1c-a50b1904d733 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:45.720036 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74371e62-51e9-4559-a6e3-48a50c3724c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:45.720674 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74371e62-51e9-4559-a6e3-48a50c3724c3 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:45.720978 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74371e62-51e9-4559-a6e3-48a50c3724c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:45.721233 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74371e62-51e9-4559-a6e3-48a50c3724c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:45.721880 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74371e62-51e9-4559-a6e3-48a50c3724c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:45.723895 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74371e62-51e9-4559-a6e3-48a50c3724c3 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:45.740437 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae3b8e-c80a-4f9d-9093-881037bcd5a0 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=53615249ca51484699185deb7d1ddb8e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:45.742244 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae3b8e-c80a-4f9d-9093-881037bcd5a0 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:45.748505 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:45.786478 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3075/6128] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:05:45 2022] POST /identity/v3/projects => generated 377 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:45.798030 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74371e62-51e9-4559-a6e3-48a50c3724c3 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:45.811135 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-34ae3b8e-c80a-4f9d-9093-881037bcd5a0 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '53615249ca51484699185deb7d1ddb8e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:45.818260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-34ae3b8e-c80a-4f9d-9093-881037bcd5a0 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '53615249ca51484699185deb7d1ddb8e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:45.871889 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:45.953130 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-34ae3b8e-c80a-4f9d-9093-881037bcd5a0 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53615249ca51484699185deb7d1ddb8e', 'request_id': 'req-34ae3b8e-c80a-4f9d-9093-881037bcd5a0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:45.965614 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-34ae3b8e-c80a-4f9d-9093-881037bcd5a0 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53615249ca51484699185deb7d1ddb8e', 'request_id': 'req-34ae3b8e-c80a-4f9d-9093-881037bcd5a0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:45.991767 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74371e62-51e9-4559-a6e3-48a50c3724c3 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:46.002477 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-34ae3b8e-c80a-4f9d-9093-881037bcd5a0 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53615249ca51484699185deb7d1ddb8e', 'request_id': 'req-34ae3b8e-c80a-4f9d-9093-881037bcd5a0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:46.033991 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-34ae3b8e-c80a-4f9d-9093-881037bcd5a0 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] The token cache is being invalidate because project 53615249ca51484699185deb7d1ddb8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:46.035849 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-34ae3b8e-c80a-4f9d-9093-881037bcd5a0 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:46.041418 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-34ae3b8e-c80a-4f9d-9093-881037bcd5a0 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:46.063468 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-34ae3b8e-c80a-4f9d-9093-881037bcd5a0 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '53615249ca51484699185deb7d1ddb8e', 'request_id': 'req-34ae3b8e-c80a-4f9d-9093-881037bcd5a0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:46.065626 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-34ae3b8e-c80a-4f9d-9093-881037bcd5a0 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '53615249ca51484699185deb7d1ddb8e', 'request_id': 'req-34ae3b8e-c80a-4f9d-9093-881037bcd5a0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:46.070936 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-34ae3b8e-c80a-4f9d-9093-881037bcd5a0 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '53615249ca51484699185deb7d1ddb8e', 'request_id': 'req-34ae3b8e-c80a-4f9d-9093-881037bcd5a0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:46.101381 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3054/6129] 10.222.0.83 () {58 vars in 1230 bytes} [Mon Aug 29 16:05:45 2022] DELETE /identity/v3/domains/53615249ca51484699185deb7d1ddb8e => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:46.102752 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae3b8e-c80a-4f9d-9093-881037bcd5a0 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:46.109687 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-34ae3b8e-c80a-4f9d-9093-881037bcd5a0 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:46.118163 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1c93a-8b9a-47ea-bd85-f3b70587fa62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:46.121400 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1c93a-8b9a-47ea-bd85-f3b70587fa62 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:46.121759 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1c93a-8b9a-47ea-bd85-f3b70587fa62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:46.122120 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1c93a-8b9a-47ea-bd85-f3b70587fa62 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:46.125996 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae1c93a-8b9a-47ea-bd85-f3b70587fa62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:46.132810 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae1c93a-8b9a-47ea-bd85-f3b70587fa62 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:46.205098 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3076/6130] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:05:45 2022] POST /identity/v3/users => generated 289 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:46.208664 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1c93a-8b9a-47ea-bd85-f3b70587fa62 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:46.213598 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9ae1c93a-8b9a-47ea-bd85-f3b70587fa62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:46.243761 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1c93a-8b9a-47ea-bd85-f3b70587fa62 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:46.255967 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77defd6d-9600-44e9-94e5-1d0d30e613ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:46.256608 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77defd6d-9600-44e9-94e5-1d0d30e613ee admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:46.256889 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77defd6d-9600-44e9-94e5-1d0d30e613ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:46.257163 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77defd6d-9600-44e9-94e5-1d0d30e613ee admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:46.257828 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77defd6d-9600-44e9-94e5-1d0d30e613ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:46.262212 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77defd6d-9600-44e9-94e5-1d0d30e613ee admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:46.278375 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3077/6131] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:46.283787 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77defd6d-9600-44e9-94e5-1d0d30e613ee admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:46.300641 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77defd6d-9600-44e9-94e5-1d0d30e613ee admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:46.310141 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae3b8e-c80a-4f9d-9093-881037bcd5a0 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:46.320119 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7deb38-41a2-49b5-8526-a957e4c14db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:46.321538 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7deb38-41a2-49b5-8526-a957e4c14db3 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:46.321834 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7deb38-41a2-49b5-8526-a957e4c14db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:46.322122 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7deb38-41a2-49b5-8526-a957e4c14db3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:46.323469 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7deb38-41a2-49b5-8526-a957e4c14db3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:46.325740 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa98c8f7-b775-41d4-855e-298fc0eceb02 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52b94a1308494bb283b7bfe4a1ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984405c23591415eaf067cb43305057d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:46.325988 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7deb38-41a2-49b5-8526-a957e4c14db3 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:46.326905 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98c8f7-b775-41d4-855e-298fc0eceb02 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:46.327613 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98c8f7-b775-41d4-855e-298fc0eceb02 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:46.328094 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98c8f7-b775-41d4-855e-298fc0eceb02 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:46.329183 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa98c8f7-b775-41d4-855e-298fc0eceb02 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:46.333344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa98c8f7-b775-41d4-855e-298fc0eceb02 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:46.343114 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3078/6132] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:05:46.361203 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7deb38-41a2-49b5-8526-a957e4c14db3 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:46.382706 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7deb38-41a2-49b5-8526-a957e4c14db3 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:46.396629 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411580e9-4ac6-4fab-a96e-199e24ec740e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:46.399356 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411580e9-4ac6-4fab-a96e-199e24ec740e admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:46.399939 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411580e9-4ac6-4fab-a96e-199e24ec740e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:46.400672 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411580e9-4ac6-4fab-a96e-199e24ec740e admin admin] PATH_INFO: `/v3/projects/893be1a6082e4c639b844bd14ed175e7/users/829d4ed8d9e4470da1c847393a5b02a5/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:46.424240 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3055/6133] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:05:46 2022] POST /identity/v3/projects => generated 377 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:46.426375 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa98c8f7-b775-41d4-855e-298fc0eceb02 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:46.453953 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411580e9-4ac6-4fab-a96e-199e24ec740e admin admin] RBAC: Authorizing `identity:create_grant(project_id=893be1a6082e4c639b844bd14ed175e7, user_id=829d4ed8d9e4470da1c847393a5b02a5, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:46.456987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411580e9-4ac6-4fab-a96e-199e24ec740e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:46.480149 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3079/6134] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:05:46 2022] PUT /identity/v3/projects/893be1a6082e4c639b844bd14ed175e7/users/829d4ed8d9e4470da1c847393a5b02a5/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:46.481867 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:46.528107 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa98c8f7-b775-41d4-855e-298fc0eceb02 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:46.606235 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef5c1a-7074-44f3-a88d-54b8e87d9cbe None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:46.606677 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73b089-062c-43e6-bf69-68886558213d tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52b94a1308494bb283b7bfe4a1ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984405c23591415eaf067cb43305057d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:46.607096 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef5c1a-7074-44f3-a88d-54b8e87d9cbe None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:46.608359 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73b089-062c-43e6-bf69-68886558213d tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:46.608717 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73b089-062c-43e6-bf69-68886558213d tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:46.609247 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73b089-062c-43e6-bf69-68886558213d tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] PATH_INFO: `/v3/projects/ca4b285a81f44862ba184a03946b4312` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:46.609643 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef5c1a-7074-44f3-a88d-54b8e87d9cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:46.610612 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f73b089-062c-43e6-bf69-68886558213d tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorizing `identity:get_project(project_id=ca4b285a81f44862ba184a03946b4312)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:46.613255 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f73b089-062c-43e6-bf69-68886558213d tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:46.619172 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3056/6135] 10.222.0.83 () {58 vars in 1230 bytes} [Mon Aug 29 16:05:46 2022] GET /identity/v3/projects/ca4b285a81f44862ba184a03946b4312 => generated 377 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:46.620185 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73b089-062c-43e6-bf69-68886558213d tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:46.636117 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73b089-062c-43e6-bf69-68886558213d tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:46.642606 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3611a-d5e7-4864-9b1a-6cdc672ab5e5 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52b94a1308494bb283b7bfe4a1ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984405c23591415eaf067cb43305057d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:46.643548 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3611a-d5e7-4864-9b1a-6cdc672ab5e5 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:46.644038 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3611a-d5e7-4864-9b1a-6cdc672ab5e5 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:46.644560 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3611a-d5e7-4864-9b1a-6cdc672ab5e5 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:46.645351 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d3611a-d5e7-4864-9b1a-6cdc672ab5e5 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:46.647520 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d3611a-d5e7-4864-9b1a-6cdc672ab5e5 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:46.676598 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-8fef5c1a-7074-44f3-a88d-54b8e87d9cbe None None] MFA Rules not processed for user `829d4ed8d9e4470da1c847393a5b02a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:46.678802 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3057/6136] 10.222.0.83 () {58 vars in 1131 bytes} [Mon Aug 29 16:05:46 2022] GET /identity/v3/projects => generated 6975 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:46.679218 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8fef5c1a-7074-44f3-a88d-54b8e87d9cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:46.686256 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3611a-d5e7-4864-9b1a-6cdc672ab5e5 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:46.704307 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3611a-d5e7-4864-9b1a-6cdc672ab5e5 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:46.711159 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cfba5c-0859-4b03-b266-ef7e2c5ad7f5 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52b94a1308494bb283b7bfe4a1ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984405c23591415eaf067cb43305057d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:46.711909 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfba5c-0859-4b03-b266-ef7e2c5ad7f5 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:46.712260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfba5c-0859-4b03-b266-ef7e2c5ad7f5 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:46.712606 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfba5c-0859-4b03-b266-ef7e2c5ad7f5 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] PATH_INFO: `/v3/projects/ca4b285a81f44862ba184a03946b4312` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:46.714315 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cfba5c-0859-4b03-b266-ef7e2c5ad7f5 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ca4b285a81f44862ba184a03946b4312)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:46.716517 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cfba5c-0859-4b03-b266-ef7e2c5ad7f5 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:46.810179 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-12cfba5c-0859-4b03-b266-ef7e2c5ad7f5 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca4b285a81f44862ba184a03946b4312', 'request_id': 'req-12cfba5c-0859-4b03-b266-ef7e2c5ad7f5'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:46.816946 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-12cfba5c-0859-4b03-b266-ef7e2c5ad7f5 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca4b285a81f44862ba184a03946b4312', 'request_id': 'req-12cfba5c-0859-4b03-b266-ef7e2c5ad7f5'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:46.829111 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-12cfba5c-0859-4b03-b266-ef7e2c5ad7f5 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca4b285a81f44862ba184a03946b4312', 'request_id': 'req-12cfba5c-0859-4b03-b266-ef7e2c5ad7f5'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:46.845085 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3080/6137] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:46.846037 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef5c1a-7074-44f3-a88d-54b8e87d9cbe None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:46.848263 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-12cfba5c-0859-4b03-b266-ef7e2c5ad7f5 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] The token cache is being invalidate because project ca4b285a81f44862ba184a03946b4312 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:46.848613 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-12cfba5c-0859-4b03-b266-ef7e2c5ad7f5 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:46.849413 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-12cfba5c-0859-4b03-b266-ef7e2c5ad7f5 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:46.855770 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3058/6138] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:46 2022] DELETE /identity/v3/projects/ca4b285a81f44862ba184a03946b4312 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:46.857008 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cfba5c-0859-4b03-b266-ef7e2c5ad7f5 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:46.861212 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:46.864487 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-12cfba5c-0859-4b03-b266-ef7e2c5ad7f5 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:46.980670 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef5c1a-7074-44f3-a88d-54b8e87d9cbe None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:46.984654 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:47.024685 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cfba5c-0859-4b03-b266-ef7e2c5ad7f5 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:47.040196 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfebf77-2cef-487c-8370-275ebcae1e23 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52b94a1308494bb283b7bfe4a1ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984405c23591415eaf067cb43305057d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:47.041846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfebf77-2cef-487c-8370-275ebcae1e23 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:47.042403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfebf77-2cef-487c-8370-275ebcae1e23 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:47.042827 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfebf77-2cef-487c-8370-275ebcae1e23 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:47.043645 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfebf77-2cef-487c-8370-275ebcae1e23 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:47.048811 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfebf77-2cef-487c-8370-275ebcae1e23 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:47.150484 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3059/6139] 10.222.0.83 () {60 vars in 1152 bytes} [Mon Aug 29 16:05:46 2022] POST /identity/v3/projects => generated 347 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:47.153176 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfebf77-2cef-487c-8370-275ebcae1e23 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:47.155553 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3216e6c-7b6b-4d89-a019-90439b632864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:47.156181 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3216e6c-7b6b-4d89-a019-90439b632864 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:47.156473 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3216e6c-7b6b-4d89-a019-90439b632864 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:47.156716 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3216e6c-7b6b-4d89-a019-90439b632864 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:47.157347 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3216e6c-7b6b-4d89-a019-90439b632864 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:47.163411 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3216e6c-7b6b-4d89-a019-90439b632864 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:47.246828 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3081/6140] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:05:46 2022] POST /identity/v3/projects => generated 375 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:47.251501 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3216e6c-7b6b-4d89-a019-90439b632864 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:47.261352 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfebf77-2cef-487c-8370-275ebcae1e23 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:47.264474 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a3216e6c-7b6b-4d89-a019-90439b632864 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:47.399782 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236056c3-f506-4a85-9f9e-8a9a9062eac1 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52b94a1308494bb283b7bfe4a1ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984405c23591415eaf067cb43305057d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:47.400454 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236056c3-f506-4a85-9f9e-8a9a9062eac1 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:47.400739 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236056c3-f506-4a85-9f9e-8a9a9062eac1 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:47.401016 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236056c3-f506-4a85-9f9e-8a9a9062eac1 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] PATH_INFO: `/v3/projects/1157ef8011b04b59b65caf1f555001c9` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:47.406053 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236056c3-f506-4a85-9f9e-8a9a9062eac1 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorizing `identity:update_project(project_id=1157ef8011b04b59b65caf1f555001c9)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:47.410538 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236056c3-f506-4a85-9f9e-8a9a9062eac1 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:47.488242 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3216e6c-7b6b-4d89-a019-90439b632864 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:47.502896 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e8312-a311-4827-b2d0-463c52c5b664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:47.503561 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e8312-a311-4827-b2d0-463c52c5b664 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:47.503844 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e8312-a311-4827-b2d0-463c52c5b664 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:47.504115 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e8312-a311-4827-b2d0-463c52c5b664 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:47.504917 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e8312-a311-4827-b2d0-463c52c5b664 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:47.506943 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e8312-a311-4827-b2d0-463c52c5b664 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:47.555560 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3060/6141] 10.222.0.83 () {60 vars in 1252 bytes} [Mon Aug 29 16:05:47 2022] PATCH /identity/v3/projects/1157ef8011b04b59b65caf1f555001c9 => generated 359 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:47.556838 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236056c3-f506-4a85-9f9e-8a9a9062eac1 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:47.565528 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3082/6142] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:05:47 2022] POST /identity/v3/users => generated 294 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:47.566675 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e8312-a311-4827-b2d0-463c52c5b664 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:47.584225 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e8312-a311-4827-b2d0-463c52c5b664 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:47.620477 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236056c3-f506-4a85-9f9e-8a9a9062eac1 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:47.632617 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f1af8-c521-40c2-85d9-efc923a84300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:47.641166 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f1af8-c521-40c2-85d9-efc923a84300 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:47.641508 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f1af8-c521-40c2-85d9-efc923a84300 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:47.641733 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f1af8-c521-40c2-85d9-efc923a84300 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:47.646357 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f1af8-c521-40c2-85d9-efc923a84300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:47.649047 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f1af8-c521-40c2-85d9-efc923a84300 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:47.663681 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e53ea5-984b-418e-85ae-51e657deaa6b tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52b94a1308494bb283b7bfe4a1ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984405c23591415eaf067cb43305057d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:47.664832 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e53ea5-984b-418e-85ae-51e657deaa6b tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:47.667788 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e53ea5-984b-418e-85ae-51e657deaa6b tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:47.671583 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e53ea5-984b-418e-85ae-51e657deaa6b tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] PATH_INFO: `/v3/projects/1157ef8011b04b59b65caf1f555001c9` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:47.695588 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3083/6143] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:47.704825 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f1af8-c521-40c2-85d9-efc923a84300 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:47.724835 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e53ea5-984b-418e-85ae-51e657deaa6b tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorizing `identity:get_project(project_id=1157ef8011b04b59b65caf1f555001c9)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:47.744775 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f1af8-c521-40c2-85d9-efc923a84300 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:47.761161 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f0afed-5949-495e-9a81-2bd2d3b3a1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:47.761850 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0afed-5949-495e-9a81-2bd2d3b3a1b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:47.762132 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0afed-5949-495e-9a81-2bd2d3b3a1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:47.762409 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0afed-5949-495e-9a81-2bd2d3b3a1b0 admin admin] PATH_INFO: `/v3/projects/b90b8a7f8d194825ad81b4e2443b2179/users/191795ba73e642e68596d20c2fae5473/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:47.764225 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e53ea5-984b-418e-85ae-51e657deaa6b tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:47.789114 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3061/6144] 10.222.0.83 () {58 vars in 1230 bytes} [Mon Aug 29 16:05:47 2022] GET /identity/v3/projects/1157ef8011b04b59b65caf1f555001c9 => generated 346 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:47.790615 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e53ea5-984b-418e-85ae-51e657deaa6b tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:47.799335 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:47.812928 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f0afed-5949-495e-9a81-2bd2d3b3a1b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b90b8a7f8d194825ad81b4e2443b2179, user_id=191795ba73e642e68596d20c2fae5473, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:47.816166 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f0afed-5949-495e-9a81-2bd2d3b3a1b0 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:47.860140 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e53ea5-984b-418e-85ae-51e657deaa6b tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:47.865876 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3084/6145] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:05:47 2022] PUT /identity/v3/projects/b90b8a7f8d194825ad81b4e2443b2179/users/191795ba73e642e68596d20c2fae5473/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:47.869055 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f0afed-5949-495e-9a81-2bd2d3b3a1b0 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:48.042622 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:48.100550 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f0afed-5949-495e-9a81-2bd2d3b3a1b0 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:48.117584 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0791a2-8027-4dd1-b671-6356870cc181 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52b94a1308494bb283b7bfe4a1ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984405c23591415eaf067cb43305057d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:48.121119 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0791a2-8027-4dd1-b671-6356870cc181 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:48.121119 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0791a2-8027-4dd1-b671-6356870cc181 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:48.124675 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0791a2-8027-4dd1-b671-6356870cc181 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] PATH_INFO: `/v3/projects/1157ef8011b04b59b65caf1f555001c9` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:48.129851 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0791a2-8027-4dd1-b671-6356870cc181 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1157ef8011b04b59b65caf1f555001c9)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:48.136589 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0791a2-8027-4dd1-b671-6356870cc181 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:48.153012 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c958f-e32e-4077-b3bd-46f61f91606f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:48.153560 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c958f-e32e-4077-b3bd-46f61f91606f admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:48.153846 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c958f-e32e-4077-b3bd-46f61f91606f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:48.154119 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c958f-e32e-4077-b3bd-46f61f91606f admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:48.167880 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74c958f-e32e-4077-b3bd-46f61f91606f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:48.169665 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74c958f-e32e-4077-b3bd-46f61f91606f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:48.267522 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3085/6146] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:48.284661 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01f66e-3b46-476c-828a-32314bf71a0a None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:48.284883 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01f66e-3b46-476c-828a-32314bf71a0a None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:48.285114 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01f66e-3b46-476c-828a-32314bf71a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:48.302920 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9a0791a2-8027-4dd1-b671-6356870cc181 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1157ef8011b04b59b65caf1f555001c9', 'request_id': 'req-9a0791a2-8027-4dd1-b671-6356870cc181'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:48.331152 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9a0791a2-8027-4dd1-b671-6356870cc181 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1157ef8011b04b59b65caf1f555001c9', 'request_id': 'req-9a0791a2-8027-4dd1-b671-6356870cc181'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:48.347918 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9a0791a2-8027-4dd1-b671-6356870cc181 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1157ef8011b04b59b65caf1f555001c9', 'request_id': 'req-9a0791a2-8027-4dd1-b671-6356870cc181'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:48.368831 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9a0791a2-8027-4dd1-b671-6356870cc181 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] The token cache is being invalidate because project 1157ef8011b04b59b65caf1f555001c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:48.369353 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9a0791a2-8027-4dd1-b671-6356870cc181 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:48.370288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9a0791a2-8027-4dd1-b671-6356870cc181 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:48.376309 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-2a01f66e-3b46-476c-828a-32314bf71a0a None None] MFA Rules not processed for user `e9cd9c0bd017459cb630823a39e8bd17`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:48.377628 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2a01f66e-3b46-476c-828a-32314bf71a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:48.378579 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3062/6147] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:47 2022] DELETE /identity/v3/projects/1157ef8011b04b59b65caf1f555001c9 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:48.380032 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0791a2-8027-4dd1-b671-6356870cc181 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:48.382087 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9a0791a2-8027-4dd1-b671-6356870cc181 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:48.478356 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0791a2-8027-4dd1-b671-6356870cc181 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:48.484326 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b60657-dc06-4b67-a2b0-89ddb4d38961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:48.485155 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b60657-dc06-4b67-a2b0-89ddb4d38961 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:48.485552 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b60657-dc06-4b67-a2b0-89ddb4d38961 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:48.485920 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b60657-dc06-4b67-a2b0-89ddb4d38961 admin admin] PATH_INFO: `/v3/projects/b90b8a7f8d194825ad81b4e2443b2179/users/191795ba73e642e68596d20c2fae5473/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:48.490048 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b60657-dc06-4b67-a2b0-89ddb4d38961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b90b8a7f8d194825ad81b4e2443b2179, user_id=191795ba73e642e68596d20c2fae5473, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:48.496016 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b60657-dc06-4b67-a2b0-89ddb4d38961 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:48.519908 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3063/6148] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:05:48 2022] PUT /identity/v3/projects/b90b8a7f8d194825ad81b4e2443b2179/users/191795ba73e642e68596d20c2fae5473/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:48.521024 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b60657-dc06-4b67-a2b0-89ddb4d38961 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:48.523554 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-55b60657-dc06-4b67-a2b0-89ddb4d38961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:48.624900 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3086/6149] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:48.627228 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5ca82-928f-400c-ad4c-8b9e60ea06de None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:48.627664 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5ca82-928f-400c-ad4c-8b9e60ea06de None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:48.628269 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5ca82-928f-400c-ad4c-8b9e60ea06de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:48.716027 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b60657-dc06-4b67-a2b0-89ddb4d38961 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:48.726690 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8878ac62-d57f-4e16-a929-95f3b6ca8452 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52b94a1308494bb283b7bfe4a1ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984405c23591415eaf067cb43305057d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:48.738665 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878ac62-d57f-4e16-a929-95f3b6ca8452 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:48.739336 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878ac62-d57f-4e16-a929-95f3b6ca8452 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:48.739827 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878ac62-d57f-4e16-a929-95f3b6ca8452 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:48.740719 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8878ac62-d57f-4e16-a929-95f3b6ca8452 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:48.743464 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8878ac62-d57f-4e16-a929-95f3b6ca8452 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:48.757844 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-d2b5ca82-928f-400c-ad4c-8b9e60ea06de None None] MFA Rules not processed for user `191795ba73e642e68596d20c2fae5473`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:48.762078 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d2b5ca82-928f-400c-ad4c-8b9e60ea06de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:48.814283 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:48.846312 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3064/6150] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:05:48 2022] POST /identity/v3/projects => generated 360 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:48.850278 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8878ac62-d57f-4e16-a929-95f3b6ca8452 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:48.958884 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8878ac62-d57f-4e16-a929-95f3b6ca8452 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:48.965020 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3087/6151] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:48 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:48.966579 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4fe75e-44fc-4ab7-af56-865d00d6bb47 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52b94a1308494bb283b7bfe4a1ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984405c23591415eaf067cb43305057d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:48.972090 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fe75e-44fc-4ab7-af56-865d00d6bb47 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:48.972623 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fe75e-44fc-4ab7-af56-865d00d6bb47 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:48.973012 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fe75e-44fc-4ab7-af56-865d00d6bb47 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] PATH_INFO: `/v3/projects/aaaf0a68e9aa47a896b7e06da93fa017` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:48.974529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4fe75e-44fc-4ab7-af56-865d00d6bb47 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorizing `identity:update_project(project_id=aaaf0a68e9aa47a896b7e06da93fa017)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:48.975319 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5ca82-928f-400c-ad4c-8b9e60ea06de None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:48.977032 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4fe75e-44fc-4ab7-af56-865d00d6bb47 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:48.996167 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5ca82-928f-400c-ad4c-8b9e60ea06de None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:49.002487 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:49.050378 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3065/6152] 10.222.0.83 () {60 vars in 1252 bytes} [Mon Aug 29 16:05:48 2022] PATCH /identity/v3/projects/aaaf0a68e9aa47a896b7e06da93fa017 => generated 372 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:49.051560 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4fe75e-44fc-4ab7-af56-865d00d6bb47 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:49.071141 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4fe75e-44fc-4ab7-af56-865d00d6bb47 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:49.078334 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e7dec-f07b-4f69-ab05-970a3bb25eab tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52b94a1308494bb283b7bfe4a1ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984405c23591415eaf067cb43305057d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:49.079176 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e7dec-f07b-4f69-ab05-970a3bb25eab tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:49.079596 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e7dec-f07b-4f69-ab05-970a3bb25eab tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:49.080002 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e7dec-f07b-4f69-ab05-970a3bb25eab tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] PATH_INFO: `/v3/projects/aaaf0a68e9aa47a896b7e06da93fa017` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:49.096654 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374e7dec-f07b-4f69-ab05-970a3bb25eab tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorizing `identity:get_project(project_id=aaaf0a68e9aa47a896b7e06da93fa017)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:49.099276 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374e7dec-f07b-4f69-ab05-970a3bb25eab tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:49.105147 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3066/6153] 10.222.0.83 () {58 vars in 1230 bytes} [Mon Aug 29 16:05:49 2022] GET /identity/v3/projects/aaaf0a68e9aa47a896b7e06da93fa017 => generated 359 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:49.106600 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e7dec-f07b-4f69-ab05-970a3bb25eab tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:49.120991 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a13c4c2-04e6-4071-971e-324db4ece549 tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '191795ba73e642e68596d20c2fae5473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b90b8a7f8d194825ad81b4e2443b2179', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:49.121221 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e7dec-f07b-4f69-ab05-970a3bb25eab tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:49.121779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13c4c2-04e6-4071-971e-324db4ece549 tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:49.122059 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13c4c2-04e6-4071-971e-324db4ece549 tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:49.122333 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13c4c2-04e6-4071-971e-324db4ece549 tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:49.122980 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a13c4c2-04e6-4071-971e-324db4ece549 tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:49.127444 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a13c4c2-04e6-4071-971e-324db4ece549 tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:49.127815 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ca8b5-fd50-431a-8c3f-eb0505400506 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52b94a1308494bb283b7bfe4a1ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984405c23591415eaf067cb43305057d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:49.128624 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ca8b5-fd50-431a-8c3f-eb0505400506 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:49.129016 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ca8b5-fd50-431a-8c3f-eb0505400506 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:49.129433 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ca8b5-fd50-431a-8c3f-eb0505400506 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] PATH_INFO: `/v3/projects/aaaf0a68e9aa47a896b7e06da93fa017` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:49.130807 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648ca8b5-fd50-431a-8c3f-eb0505400506 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorizing `identity:delete_project(project_id=aaaf0a68e9aa47a896b7e06da93fa017)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:49.132976 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648ca8b5-fd50-431a-8c3f-eb0505400506 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:49.197252 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-648ca8b5-fd50-431a-8c3f-eb0505400506 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaaf0a68e9aa47a896b7e06da93fa017', 'request_id': 'req-648ca8b5-fd50-431a-8c3f-eb0505400506'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:49.207317 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3088/6154] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:05:48 2022] POST /identity/v3/projects => generated 333 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:49.209144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-648ca8b5-fd50-431a-8c3f-eb0505400506 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaaf0a68e9aa47a896b7e06da93fa017', 'request_id': 'req-648ca8b5-fd50-431a-8c3f-eb0505400506'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:49.216246 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a13c4c2-04e6-4071-971e-324db4ece549 tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:49.228742 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-648ca8b5-fd50-431a-8c3f-eb0505400506 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaaf0a68e9aa47a896b7e06da93fa017', 'request_id': 'req-648ca8b5-fd50-431a-8c3f-eb0505400506'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:49.247436 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-648ca8b5-fd50-431a-8c3f-eb0505400506 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] The token cache is being invalidate because project aaaf0a68e9aa47a896b7e06da93fa017 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:49.247849 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-648ca8b5-fd50-431a-8c3f-eb0505400506 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:49.249517 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-648ca8b5-fd50-431a-8c3f-eb0505400506 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:49.252135 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3067/6155] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:49 2022] DELETE /identity/v3/projects/aaaf0a68e9aa47a896b7e06da93fa017 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:49.257336 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ca8b5-fd50-431a-8c3f-eb0505400506 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:49.260687 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-648ca8b5-fd50-431a-8c3f-eb0505400506 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:49.364786 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:49.446695 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ca8b5-fd50-431a-8c3f-eb0505400506 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:49.486367 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a13c4c2-04e6-4071-971e-324db4ece549 tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:49.499368 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e427d-f382-44de-8dcd-c79d5f4a7969 tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '191795ba73e642e68596d20c2fae5473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b90b8a7f8d194825ad81b4e2443b2179', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:49.503367 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e427d-f382-44de-8dcd-c79d5f4a7969 tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:49.503787 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e427d-f382-44de-8dcd-c79d5f4a7969 tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:49.504169 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e427d-f382-44de-8dcd-c79d5f4a7969 tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:49.504924 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794e427d-f382-44de-8dcd-c79d5f4a7969 tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:49.509534 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794e427d-f382-44de-8dcd-c79d5f4a7969 tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:49.594785 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3089/6156] 10.222.0.83 () {60 vars in 1152 bytes} [Mon Aug 29 16:05:49 2022] POST /identity/v3/projects => generated 333 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:49.599661 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e427d-f382-44de-8dcd-c79d5f4a7969 tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:49.603734 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-794e427d-f382-44de-8dcd-c79d5f4a7969 tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:49.643224 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489182c-a18c-45db-9648-cd2f354979e0 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52b94a1308494bb283b7bfe4a1ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984405c23591415eaf067cb43305057d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:49.644142 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489182c-a18c-45db-9648-cd2f354979e0 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:49.644142 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489182c-a18c-45db-9648-cd2f354979e0 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:49.644462 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489182c-a18c-45db-9648-cd2f354979e0 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:49.645110 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489182c-a18c-45db-9648-cd2f354979e0 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:49.647000 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489182c-a18c-45db-9648-cd2f354979e0 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:49.760048 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e427d-f382-44de-8dcd-c79d5f4a7969 tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:49.762931 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3068/6157] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:05:49 2022] POST /identity/v3/projects => generated 354 bytes in 506 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:49.773041 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489182c-a18c-45db-9648-cd2f354979e0 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:49.821528 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:49.934206 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b41ed7-39d5-4ddf-8ada-796c1048dac2 tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '191795ba73e642e68596d20c2fae5473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b90b8a7f8d194825ad81b4e2443b2179', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:49.934849 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b41ed7-39d5-4ddf-8ada-796c1048dac2 tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:49.935175 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b41ed7-39d5-4ddf-8ada-796c1048dac2 tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:49.935451 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b41ed7-39d5-4ddf-8ada-796c1048dac2 tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:49.940834 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b41ed7-39d5-4ddf-8ada-796c1048dac2 tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:49.943218 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b41ed7-39d5-4ddf-8ada-796c1048dac2 tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:49.950480 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489182c-a18c-45db-9648-cd2f354979e0 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:49.960623 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d26ea8-18f6-4e88-b6fd-2d9b54980285 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52b94a1308494bb283b7bfe4a1ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984405c23591415eaf067cb43305057d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:49.961858 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d26ea8-18f6-4e88-b6fd-2d9b54980285 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:49.962148 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d26ea8-18f6-4e88-b6fd-2d9b54980285 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:49.962429 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d26ea8-18f6-4e88-b6fd-2d9b54980285 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] PATH_INFO: `/v3/projects/276a4b7c73784d37bf6ca3a82506d0d8` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:49.965023 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d26ea8-18f6-4e88-b6fd-2d9b54980285 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorizing `identity:update_project(project_id=276a4b7c73784d37bf6ca3a82506d0d8)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:49.973522 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d26ea8-18f6-4e88-b6fd-2d9b54980285 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:50.052859 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3069/6158] 10.222.0.83 () {60 vars in 1252 bytes} [Mon Aug 29 16:05:49 2022] PATCH /identity/v3/projects/276a4b7c73784d37bf6ca3a82506d0d8 => generated 368 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:50.057847 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d26ea8-18f6-4e88-b6fd-2d9b54980285 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:50.082447 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d26ea8-18f6-4e88-b6fd-2d9b54980285 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:50.094017 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3090/6159] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:05:49 2022] POST /identity/v3/projects => generated 357 bytes in 495 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:50.094974 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced39f7-757f-43e3-9c31-d31e022bb042 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52b94a1308494bb283b7bfe4a1ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984405c23591415eaf067cb43305057d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:50.095675 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced39f7-757f-43e3-9c31-d31e022bb042 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:50.095959 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced39f7-757f-43e3-9c31-d31e022bb042 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:50.096237 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced39f7-757f-43e3-9c31-d31e022bb042 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] PATH_INFO: `/v3/projects/276a4b7c73784d37bf6ca3a82506d0d8` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:50.096456 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b41ed7-39d5-4ddf-8ada-796c1048dac2 tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:50.138052 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ced39f7-757f-43e3-9c31-d31e022bb042 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorizing `identity:get_project(project_id=276a4b7c73784d37bf6ca3a82506d0d8)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:50.141228 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ced39f7-757f-43e3-9c31-d31e022bb042 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:50.151457 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3070/6160] 10.222.0.83 () {58 vars in 1230 bytes} [Mon Aug 29 16:05:50 2022] GET /identity/v3/projects/276a4b7c73784d37bf6ca3a82506d0d8 => generated 355 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:50.152408 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced39f7-757f-43e3-9c31-d31e022bb042 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:50.178386 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced39f7-757f-43e3-9c31-d31e022bb042 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:50.245900 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b41ed7-39d5-4ddf-8ada-796c1048dac2 tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:50.278021 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa76ba9-d283-4a3d-879b-985f3d24bcf2 tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '191795ba73e642e68596d20c2fae5473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b90b8a7f8d194825ad81b4e2443b2179', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:50.279131 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa76ba9-d283-4a3d-879b-985f3d24bcf2 tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:50.279131 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa76ba9-d283-4a3d-879b-985f3d24bcf2 tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:50.279437 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa76ba9-d283-4a3d-879b-985f3d24bcf2 tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:50.280056 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa76ba9-d283-4a3d-879b-985f3d24bcf2 tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:50.282244 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa76ba9-d283-4a3d-879b-985f3d24bcf2 tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:50.311610 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:50.345165 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3091/6161] 10.222.0.83 () {58 vars in 1131 bytes} [Mon Aug 29 16:05:50 2022] GET /identity/v3/projects => generated 8303 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:50.346475 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa76ba9-d283-4a3d-879b-985f3d24bcf2 tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:50.357711 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa76ba9-d283-4a3d-879b-985f3d24bcf2 tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:50.369639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad28ec-94f1-496f-bda3-9d7a167b7e3d tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '191795ba73e642e68596d20c2fae5473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b90b8a7f8d194825ad81b4e2443b2179', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:50.370719 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad28ec-94f1-496f-bda3-9d7a167b7e3d tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:50.371160 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad28ec-94f1-496f-bda3-9d7a167b7e3d tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:50.371444 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad28ec-94f1-496f-bda3-9d7a167b7e3d tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:50.372137 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbad28ec-94f1-496f-bda3-9d7a167b7e3d tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:05:50.372464 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbad28ec-94f1-496f-bda3-9d7a167b7e3d tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:50.384282 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbad28ec-94f1-496f-bda3-9d7a167b7e3d tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:50.430462 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3092/6162] 10.222.0.83 () {58 vars in 1158 bytes} [Mon Aug 29 16:05:50 2022] GET /identity/v3/projects?enabled=False => generated 444 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:50.431237 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e4c744-edd0-43cf-86b4-2e47ef15ba09 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52b94a1308494bb283b7bfe4a1ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984405c23591415eaf067cb43305057d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:50.431465 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad28ec-94f1-496f-bda3-9d7a167b7e3d tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:50.435402 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e4c744-edd0-43cf-86b4-2e47ef15ba09 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:50.440713 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e4c744-edd0-43cf-86b4-2e47ef15ba09 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:50.441043 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e4c744-edd0-43cf-86b4-2e47ef15ba09 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] PATH_INFO: `/v3/projects/276a4b7c73784d37bf6ca3a82506d0d8` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:50.444816 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e4c744-edd0-43cf-86b4-2e47ef15ba09 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorizing `identity:delete_project(project_id=276a4b7c73784d37bf6ca3a82506d0d8)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:50.450224 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e4c744-edd0-43cf-86b4-2e47ef15ba09 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:50.455137 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad28ec-94f1-496f-bda3-9d7a167b7e3d tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:50.462797 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791140fe-70c8-4151-9f63-f075399c2e3c tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '191795ba73e642e68596d20c2fae5473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b90b8a7f8d194825ad81b4e2443b2179', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:50.463481 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791140fe-70c8-4151-9f63-f075399c2e3c tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:50.463759 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791140fe-70c8-4151-9f63-f075399c2e3c tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:50.464034 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791140fe-70c8-4151-9f63-f075399c2e3c tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:50.464712 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791140fe-70c8-4151-9f63-f075399c2e3c tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] RBAC: Adding query filter params (parent_id=5e53649803774c15bddee4ef0da21344) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:05:50.465020 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791140fe-70c8-4151-9f63-f075399c2e3c tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:50.471339 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791140fe-70c8-4151-9f63-f075399c2e3c tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:50.569721 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3093/6163] 10.222.0.83 () {58 vars in 1216 bytes} [Mon Aug 29 16:05:50 2022] GET /identity/v3/projects?parent_id=5e53649803774c15bddee4ef0da21344 => generated 497 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:50.578925 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791140fe-70c8-4151-9f63-f075399c2e3c tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:50.598616 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791140fe-70c8-4151-9f63-f075399c2e3c tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:50.615933 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10647a2d-5922-4dca-8cc5-769a89c0417f tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '191795ba73e642e68596d20c2fae5473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b90b8a7f8d194825ad81b4e2443b2179', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:50.616855 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10647a2d-5922-4dca-8cc5-769a89c0417f tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:50.617316 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10647a2d-5922-4dca-8cc5-769a89c0417f tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:50.617794 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10647a2d-5922-4dca-8cc5-769a89c0417f tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] PATH_INFO: `/v3/projects/82e7ece8e28f4b8ead5ff942fe5ca36d` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:50.619567 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10647a2d-5922-4dca-8cc5-769a89c0417f tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] RBAC: Authorizing `identity:delete_project(project_id=82e7ece8e28f4b8ead5ff942fe5ca36d)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:50.621736 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10647a2d-5922-4dca-8cc5-769a89c0417f tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:50.671538 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-88e4c744-edd0-43cf-86b4-2e47ef15ba09 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '276a4b7c73784d37bf6ca3a82506d0d8', 'request_id': 'req-88e4c744-edd0-43cf-86b4-2e47ef15ba09'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:50.681895 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-88e4c744-edd0-43cf-86b4-2e47ef15ba09 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '276a4b7c73784d37bf6ca3a82506d0d8', 'request_id': 'req-88e4c744-edd0-43cf-86b4-2e47ef15ba09'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:50.703707 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-88e4c744-edd0-43cf-86b4-2e47ef15ba09 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '276a4b7c73784d37bf6ca3a82506d0d8', 'request_id': 'req-88e4c744-edd0-43cf-86b4-2e47ef15ba09'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:50.727326 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-88e4c744-edd0-43cf-86b4-2e47ef15ba09 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] The token cache is being invalidate because project 276a4b7c73784d37bf6ca3a82506d0d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:50.727613 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-88e4c744-edd0-43cf-86b4-2e47ef15ba09 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:50.729783 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-88e4c744-edd0-43cf-86b4-2e47ef15ba09 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:50.731557 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3071/6164] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:50 2022] DELETE /identity/v3/projects/276a4b7c73784d37bf6ca3a82506d0d8 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:50.736686 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e4c744-edd0-43cf-86b4-2e47ef15ba09 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:50.738997 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-88e4c744-edd0-43cf-86b4-2e47ef15ba09 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:50.761211 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-10647a2d-5922-4dca-8cc5-769a89c0417f tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82e7ece8e28f4b8ead5ff942fe5ca36d', 'request_id': 'req-10647a2d-5922-4dca-8cc5-769a89c0417f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:50.781907 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-10647a2d-5922-4dca-8cc5-769a89c0417f tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82e7ece8e28f4b8ead5ff942fe5ca36d', 'request_id': 'req-10647a2d-5922-4dca-8cc5-769a89c0417f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:50.800543 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-10647a2d-5922-4dca-8cc5-769a89c0417f tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82e7ece8e28f4b8ead5ff942fe5ca36d', 'request_id': 'req-10647a2d-5922-4dca-8cc5-769a89c0417f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:50.809058 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:50.861165 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-10647a2d-5922-4dca-8cc5-769a89c0417f tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] The token cache is being invalidate because project 82e7ece8e28f4b8ead5ff942fe5ca36d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:50.861750 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-10647a2d-5922-4dca-8cc5-769a89c0417f tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:50.862662 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-10647a2d-5922-4dca-8cc5-769a89c0417f tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:50.868700 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3094/6165] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:50 2022] DELETE /identity/v3/projects/82e7ece8e28f4b8ead5ff942fe5ca36d => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:50.870091 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10647a2d-5922-4dca-8cc5-769a89c0417f tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:50.872044 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-10647a2d-5922-4dca-8cc5-769a89c0417f tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:50.935047 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e4c744-edd0-43cf-86b4-2e47ef15ba09 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:51.035780 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10647a2d-5922-4dca-8cc5-769a89c0417f tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:51.058583 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c568e08-d5ea-4454-95d7-97cea0a032e7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:51.059256 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c568e08-d5ea-4454-95d7-97cea0a032e7 service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:51.059538 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c568e08-d5ea-4454-95d7-97cea0a032e7 service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:51.059812 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c568e08-d5ea-4454-95d7-97cea0a032e7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:51.067946 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9c568e08-d5ea-4454-95d7-97cea0a032e7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:51.101478 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c568e08-d5ea-4454-95d7-97cea0a032e7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:51.103132 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c568e08-d5ea-4454-95d7-97cea0a032e7 service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:51.110359 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57dc3ff-1d69-4a55-90a8-fb18d585eb5a tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52b94a1308494bb283b7bfe4a1ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984405c23591415eaf067cb43305057d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:51.111367 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57dc3ff-1d69-4a55-90a8-fb18d585eb5a tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:51.116394 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57dc3ff-1d69-4a55-90a8-fb18d585eb5a tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:51.117077 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57dc3ff-1d69-4a55-90a8-fb18d585eb5a tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] PATH_INFO: `/v3/domains/53615249ca51484699185deb7d1ddb8e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:51.130614 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57dc3ff-1d69-4a55-90a8-fb18d585eb5a tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 16:05:51.133998 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3095/6166] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:05:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:05:51.134965 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c568e08-d5ea-4454-95d7-97cea0a032e7 service placement] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:51.138251 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9c568e08-d5ea-4454-95d7-97cea0a032e7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:51.140961 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-f57dc3ff-1d69-4a55-90a8-fb18d585eb5a tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Could not find domain: 53615249ca51484699185deb7d1ddb8e.: keystone.exception.DomainNotFound: Could not find domain: 53615249ca51484699185deb7d1ddb8e. Aug 29 16:05:51.140961 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:05:51.140961 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 29 16:05:51.140961 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 29 16:05:51.140961 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 16:05:51.140961 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 16:05:51.140961 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 16:05:51.140961 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 16:05:51.140961 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 53615249ca51484699185deb7d1ddb8e. Aug 29 16:05:51.140961 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:05:51.140961 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 16:05:51.140961 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:05:51.140961 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:05:51.140961 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:05:51.140961 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:05:51.140961 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:05:51.141925 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:05:51.141925 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:05:51.141925 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:05:51.141925 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:05:51.141925 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:05:51.141925 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:05:51.141925 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:05:51.141925 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 29 16:05:51.141925 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 29 16:05:51.141925 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 16:05:51.141925 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 16:05:51.141925 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 16:05:51.141925 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 16:05:51.141925 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:05:51.141925 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:05:51.141925 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 16:05:51.142805 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 16:05:51.142805 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 16:05:51.142805 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 16:05:51.142805 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 16:05:51.142805 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 16:05:51.142805 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 16:05:51.142805 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 16:05:51.142805 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 16:05:51.142805 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 16:05:51.142805 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 16:05:51.142805 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 16:05:51.142805 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 16:05:51.142805 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 16:05:51.142805 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 29 16:05:51.142805 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 16:05:51.142805 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 53615249ca51484699185deb7d1ddb8e. Aug 29 16:05:51.142805 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:05:51.147502 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3072/6167] 10.222.0.83 () {60 vars in 1249 bytes} [Mon Aug 29 16:05:50 2022] PATCH /identity/v3/domains/53615249ca51484699185deb7d1ddb8e => generated 112 bytes in 411 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 16:05:51.151508 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57dc3ff-1d69-4a55-90a8-fb18d585eb5a tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:51.155287 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f57dc3ff-1d69-4a55-90a8-fb18d585eb5a tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:51.164539 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:51.172969 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57dc3ff-1d69-4a55-90a8-fb18d585eb5a tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:51.180654 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d2513-ebdc-4d02-95c2-31b28de368e5 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52b94a1308494bb283b7bfe4a1ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984405c23591415eaf067cb43305057d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:51.181794 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d2513-ebdc-4d02-95c2-31b28de368e5 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:51.182288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d2513-ebdc-4d02-95c2-31b28de368e5 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:51.182818 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d2513-ebdc-4d02-95c2-31b28de368e5 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] PATH_INFO: `/v3/domains/80e5c509ac0b4ad5bdece6722d5eb9af` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:51.193407 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642d2513-ebdc-4d02-95c2-31b28de368e5 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 16:05:51.199706 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-642d2513-ebdc-4d02-95c2-31b28de368e5 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Could not find domain: 80e5c509ac0b4ad5bdece6722d5eb9af.: keystone.exception.DomainNotFound: Could not find domain: 80e5c509ac0b4ad5bdece6722d5eb9af. Aug 29 16:05:51.199706 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:05:51.199706 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 29 16:05:51.199706 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 29 16:05:51.199706 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 16:05:51.199706 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 16:05:51.199706 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 16:05:51.199706 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 16:05:51.199706 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 80e5c509ac0b4ad5bdece6722d5eb9af. Aug 29 16:05:51.199706 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:05:51.199706 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 16:05:51.199706 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:05:51.199706 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:05:51.199706 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:05:51.199706 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:05:51.199706 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:05:51.200737 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:05:51.200737 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:05:51.200737 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:05:51.200737 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:05:51.200737 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:05:51.200737 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:05:51.200737 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:05:51.200737 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 29 16:05:51.200737 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 29 16:05:51.200737 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 16:05:51.200737 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 16:05:51.200737 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 16:05:51.200737 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 16:05:51.200737 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:05:51.200737 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:05:51.200737 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 16:05:51.202201 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 16:05:51.202201 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 16:05:51.202201 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 16:05:51.202201 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 16:05:51.202201 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 16:05:51.202201 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 16:05:51.202201 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 16:05:51.202201 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 16:05:51.202201 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 16:05:51.202201 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 16:05:51.202201 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 16:05:51.202201 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 16:05:51.202201 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 16:05:51.202201 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 29 16:05:51.202201 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 16:05:51.202201 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 80e5c509ac0b4ad5bdece6722d5eb9af. Aug 29 16:05:51.202201 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:05:51.207697 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3073/6168] 10.222.0.83 () {60 vars in 1249 bytes} [Mon Aug 29 16:05:51 2022] PATCH /identity/v3/domains/80e5c509ac0b4ad5bdece6722d5eb9af => generated 112 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 16:05:51.212454 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d2513-ebdc-4d02-95c2-31b28de368e5 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:51.215828 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-642d2513-ebdc-4d02-95c2-31b28de368e5 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:51.303819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d2513-ebdc-4d02-95c2-31b28de368e5 tempest-ProjectsTestJSON-2008449596 tempest-ProjectsTestJSON-2008449596-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:51.311979 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c14378-32a7-404d-9d8c-9725105a86ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:51.313173 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c14378-32a7-404d-9d8c-9725105a86ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:51.314168 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c14378-32a7-404d-9d8c-9725105a86ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:51.314575 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c14378-32a7-404d-9d8c-9725105a86ea admin admin] PATH_INFO: `/v3/users/a280770882e24d8d9146ce4c044866d1` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:51.316261 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c14378-32a7-404d-9d8c-9725105a86ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=a280770882e24d8d9146ce4c044866d1)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:51.317474 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c568e08-d5ea-4454-95d7-97cea0a032e7 service placement] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:51.319693 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c14378-32a7-404d-9d8c-9725105a86ea admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:51.330324 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eeb8c2-f0e8-4643-9a3d-9b7f18cc1a54 tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '191795ba73e642e68596d20c2fae5473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b90b8a7f8d194825ad81b4e2443b2179', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:51.332526 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eeb8c2-f0e8-4643-9a3d-9b7f18cc1a54 tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:51.334186 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eeb8c2-f0e8-4643-9a3d-9b7f18cc1a54 tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:51.334597 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eeb8c2-f0e8-4643-9a3d-9b7f18cc1a54 tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] PATH_INFO: `/v3/projects/5e53649803774c15bddee4ef0da21344` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:51.344226 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eeb8c2-f0e8-4643-9a3d-9b7f18cc1a54 tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5e53649803774c15bddee4ef0da21344)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:51.346420 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eeb8c2-f0e8-4643-9a3d-9b7f18cc1a54 tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:51.505106 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-77c14378-32a7-404d-9d8c-9725105a86ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a280770882e24d8d9146ce4c044866d1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:51.506778 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-77c14378-32a7-404d-9d8c-9725105a86ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a280770882e24d8d9146ce4c044866d1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:51.548751 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c2eeb8c2-f0e8-4643-9a3d-9b7f18cc1a54 tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e53649803774c15bddee4ef0da21344', 'request_id': 'req-c2eeb8c2-f0e8-4643-9a3d-9b7f18cc1a54'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:51.569150 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c2eeb8c2-f0e8-4643-9a3d-9b7f18cc1a54 tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e53649803774c15bddee4ef0da21344', 'request_id': 'req-c2eeb8c2-f0e8-4643-9a3d-9b7f18cc1a54'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:51.577945 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-77c14378-32a7-404d-9d8c-9725105a86ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a280770882e24d8d9146ce4c044866d1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:51.591852 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-77c14378-32a7-404d-9d8c-9725105a86ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a280770882e24d8d9146ce4c044866d1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:51.604609 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c2eeb8c2-f0e8-4643-9a3d-9b7f18cc1a54 tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e53649803774c15bddee4ef0da21344', 'request_id': 'req-c2eeb8c2-f0e8-4643-9a3d-9b7f18cc1a54'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:51.605979 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-77c14378-32a7-404d-9d8c-9725105a86ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a280770882e24d8d9146ce4c044866d1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:51.612076 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:51.633523 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3074/6169] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:05:51 2022] DELETE /identity/v3/users/a280770882e24d8d9146ce4c044866d1 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:51.655422 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c2eeb8c2-f0e8-4643-9a3d-9b7f18cc1a54 tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] The token cache is being invalidate because project 5e53649803774c15bddee4ef0da21344 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:51.655754 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c2eeb8c2-f0e8-4643-9a3d-9b7f18cc1a54 tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:51.656397 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260023d-02a0-4406-b710-2e758728f79d None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:51.656798 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260023d-02a0-4406-b710-2e758728f79d None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:51.657071 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260023d-02a0-4406-b710-2e758728f79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:51.660794 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c2eeb8c2-f0e8-4643-9a3d-9b7f18cc1a54 tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:51.666865 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3096/6170] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:51 2022] DELETE /identity/v3/projects/5e53649803774c15bddee4ef0da21344 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:51.675229 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eeb8c2-f0e8-4643-9a3d-9b7f18cc1a54 tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:51.677171 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c2eeb8c2-f0e8-4643-9a3d-9b7f18cc1a54 tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:51.733020 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-b260023d-02a0-4406-b710-2e758728f79d None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:51.736480 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b260023d-02a0-4406-b710-2e758728f79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:51.961981 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3075/6171] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:51.975232 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260023d-02a0-4406-b710-2e758728f79d None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:51.978119 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b260023d-02a0-4406-b710-2e758728f79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:52.011419 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:52.015356 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eeb8c2-f0e8-4643-9a3d-9b7f18cc1a54 tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:52.202193 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260023d-02a0-4406-b710-2e758728f79d None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:52.211848 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542507e-1455-4761-ba11-2f198a7d95fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:52.213711 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542507e-1455-4761-ba11-2f198a7d95fb service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:52.214409 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542507e-1455-4761-ba11-2f198a7d95fb service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:52.215307 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542507e-1455-4761-ba11-2f198a7d95fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:52.254137 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5542507e-1455-4761-ba11-2f198a7d95fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:52.255825 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5542507e-1455-4761-ba11-2f198a7d95fb service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:52.267587 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee334c4-7838-4f08-96d9-9a984ae8232a tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '191795ba73e642e68596d20c2fae5473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b90b8a7f8d194825ad81b4e2443b2179', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:52.269253 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee334c4-7838-4f08-96d9-9a984ae8232a tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:52.272776 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee334c4-7838-4f08-96d9-9a984ae8232a tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:52.273482 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee334c4-7838-4f08-96d9-9a984ae8232a tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] PATH_INFO: `/v3/projects/a5f0cbed77874ff980e6f56f0ce587d9` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:52.277723 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee334c4-7838-4f08-96d9-9a984ae8232a tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a5f0cbed77874ff980e6f56f0ce587d9)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:52.279064 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3076/6172] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:05:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:05:52.282457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee334c4-7838-4f08-96d9-9a984ae8232a tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:52.410746 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4ee334c4-7838-4f08-96d9-9a984ae8232a tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5f0cbed77874ff980e6f56f0ce587d9', 'request_id': 'req-4ee334c4-7838-4f08-96d9-9a984ae8232a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:52.428051 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4ee334c4-7838-4f08-96d9-9a984ae8232a tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5f0cbed77874ff980e6f56f0ce587d9', 'request_id': 'req-4ee334c4-7838-4f08-96d9-9a984ae8232a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:52.458716 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4ee334c4-7838-4f08-96d9-9a984ae8232a tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5f0cbed77874ff980e6f56f0ce587d9', 'request_id': 'req-4ee334c4-7838-4f08-96d9-9a984ae8232a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:52.482061 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4ee334c4-7838-4f08-96d9-9a984ae8232a tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] The token cache is being invalidate because project a5f0cbed77874ff980e6f56f0ce587d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:52.483213 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4ee334c4-7838-4f08-96d9-9a984ae8232a tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:52.484163 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4ee334c4-7838-4f08-96d9-9a984ae8232a tempest-ListProjectsTestJSON-933581633 tempest-ListProjectsTestJSON-933581633-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:52.486683 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3097/6173] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:51 2022] DELETE /identity/v3/projects/a5f0cbed77874ff980e6f56f0ce587d9 => generated 0 bytes in 819 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:52.490458 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542507e-1455-4761-ba11-2f198a7d95fb service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:52.492587 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5542507e-1455-4761-ba11-2f198a7d95fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:52.517138 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542507e-1455-4761-ba11-2f198a7d95fb service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:52.625140 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6a511-afec-4d41-bfce-127dad2d5462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:52.625871 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6a511-afec-4d41-bfce-127dad2d5462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:52.626168 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6a511-afec-4d41-bfce-127dad2d5462 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:52.626437 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6a511-afec-4d41-bfce-127dad2d5462 admin admin] PATH_INFO: `/v3/users/829d4ed8d9e4470da1c847393a5b02a5` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:52.629716 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b6a511-afec-4d41-bfce-127dad2d5462 admin admin] RBAC: Authorizing `identity:delete_user(user_id=829d4ed8d9e4470da1c847393a5b02a5)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:52.637474 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b6a511-afec-4d41-bfce-127dad2d5462 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:52.859619 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d7b6a511-afec-4d41-bfce-127dad2d5462 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '829d4ed8d9e4470da1c847393a5b02a5'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:52.860683 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d7b6a511-afec-4d41-bfce-127dad2d5462 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '829d4ed8d9e4470da1c847393a5b02a5'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:52.910531 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d7b6a511-afec-4d41-bfce-127dad2d5462 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '829d4ed8d9e4470da1c847393a5b02a5'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:52.938099 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d7b6a511-afec-4d41-bfce-127dad2d5462 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '829d4ed8d9e4470da1c847393a5b02a5'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:52.962000 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d7b6a511-afec-4d41-bfce-127dad2d5462 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '829d4ed8d9e4470da1c847393a5b02a5'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:52.972427 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3077/6174] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:05:52 2022] DELETE /identity/v3/users/829d4ed8d9e4470da1c847393a5b02a5 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:52.974093 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a5176-acda-4368-8019-947fda752268 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:52.974398 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a5176-acda-4368-8019-947fda752268 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:52.974662 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a5176-acda-4368-8019-947fda752268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:53.056501 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-d15a5176-acda-4368-8019-947fda752268 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:53.061251 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d15a5176-acda-4368-8019-947fda752268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:53.119870 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:53.172304 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3098/6175] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:53.185256 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6a511-afec-4d41-bfce-127dad2d5462 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:53.188143 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d7b6a511-afec-4d41-bfce-127dad2d5462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:53.344165 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:53.401829 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6a511-afec-4d41-bfce-127dad2d5462 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:53.417073 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ddf9ba-467b-4b94-86de-656d33a35875 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:53.417864 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ddf9ba-467b-4b94-86de-656d33a35875 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:53.418932 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ddf9ba-467b-4b94-86de-656d33a35875 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:53.418932 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ddf9ba-467b-4b94-86de-656d33a35875 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:53.470298 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ddf9ba-467b-4b94-86de-656d33a35875 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:53.470298 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ddf9ba-467b-4b94-86de-656d33a35875 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:53.482218 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a5176-acda-4368-8019-947fda752268 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:53.485420 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d15a5176-acda-4368-8019-947fda752268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:53.490753 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3078/6176] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:05:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:05:53.516075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a5176-acda-4368-8019-947fda752268 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:53.540449 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851a4c4-8b23-4d45-91a0-92b9d28b4d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:53.541395 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851a4c4-8b23-4d45-91a0-92b9d28b4d0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:53.541685 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851a4c4-8b23-4d45-91a0-92b9d28b4d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:53.541962 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851a4c4-8b23-4d45-91a0-92b9d28b4d0a admin admin] PATH_INFO: `/v3/projects/2db4e78ac3604fff8f557c034933a0a2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:53.548809 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3851a4c4-8b23-4d45-91a0-92b9d28b4d0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2db4e78ac3604fff8f557c034933a0a2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:53.553358 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3851a4c4-8b23-4d45-91a0-92b9d28b4d0a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:53.693415 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3851a4c4-8b23-4d45-91a0-92b9d28b4d0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2db4e78ac3604fff8f557c034933a0a2', 'request_id': 'req-3851a4c4-8b23-4d45-91a0-92b9d28b4d0a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:53.720715 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3851a4c4-8b23-4d45-91a0-92b9d28b4d0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2db4e78ac3604fff8f557c034933a0a2', 'request_id': 'req-3851a4c4-8b23-4d45-91a0-92b9d28b4d0a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:53.738042 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3851a4c4-8b23-4d45-91a0-92b9d28b4d0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2db4e78ac3604fff8f557c034933a0a2', 'request_id': 'req-3851a4c4-8b23-4d45-91a0-92b9d28b4d0a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:53.782828 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3851a4c4-8b23-4d45-91a0-92b9d28b4d0a admin admin] The token cache is being invalidate because project 2db4e78ac3604fff8f557c034933a0a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:53.783312 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3851a4c4-8b23-4d45-91a0-92b9d28b4d0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:53.784544 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3851a4c4-8b23-4d45-91a0-92b9d28b4d0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:53.788355 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3099/6177] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:53 2022] DELETE /identity/v3/projects/2db4e78ac3604fff8f557c034933a0a2 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:05:53.793178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ddf9ba-467b-4b94-86de-656d33a35875 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:53.806716 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ddf9ba-467b-4b94-86de-656d33a35875 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:53.956823 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ee4d6-3ef6-4e07-8ec9-7aa2fbebb2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:53.957619 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ee4d6-3ef6-4e07-8ec9-7aa2fbebb2b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:53.957952 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ee4d6-3ef6-4e07-8ec9-7aa2fbebb2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:53.958241 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ee4d6-3ef6-4e07-8ec9-7aa2fbebb2b9 admin admin] PATH_INFO: `/v3/users/fa52b94a1308494bb283b7bfe4a1ce58` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:53.961358 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ee4d6-3ef6-4e07-8ec9-7aa2fbebb2b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa52b94a1308494bb283b7bfe4a1ce58)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:53.963435 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ee4d6-3ef6-4e07-8ec9-7aa2fbebb2b9 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:54.096418 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-948ee4d6-3ef6-4e07-8ec9-7aa2fbebb2b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa52b94a1308494bb283b7bfe4a1ce58'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:54.097379 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-948ee4d6-3ef6-4e07-8ec9-7aa2fbebb2b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa52b94a1308494bb283b7bfe4a1ce58'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:54.144419 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-948ee4d6-3ef6-4e07-8ec9-7aa2fbebb2b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa52b94a1308494bb283b7bfe4a1ce58'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:54.171766 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-948ee4d6-3ef6-4e07-8ec9-7aa2fbebb2b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa52b94a1308494bb283b7bfe4a1ce58'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:54.200099 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-948ee4d6-3ef6-4e07-8ec9-7aa2fbebb2b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa52b94a1308494bb283b7bfe4a1ce58'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:54.223108 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3079/6178] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:05:53 2022] DELETE /identity/v3/users/fa52b94a1308494bb283b7bfe4a1ce58 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:55.232171 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851a4c4-8b23-4d45-91a0-92b9d28b4d0a admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:55.234112 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3851a4c4-8b23-4d45-91a0-92b9d28b4d0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:55.271364 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851a4c4-8b23-4d45-91a0-92b9d28b4d0a admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:55.424059 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc5d76-5776-4637-9e60-a740ec73e471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:55.425143 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc5d76-5776-4637-9e60-a740ec73e471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:55.425896 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc5d76-5776-4637-9e60-a740ec73e471 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:55.428355 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc5d76-5776-4637-9e60-a740ec73e471 admin admin] PATH_INFO: `/v3/projects/984405c23591415eaf067cb43305057d` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:55.430568 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edc5d76-5776-4637-9e60-a740ec73e471 admin admin] RBAC: Authorizing `identity:delete_project(project_id=984405c23591415eaf067cb43305057d)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:55.432899 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edc5d76-5776-4637-9e60-a740ec73e471 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:55.550200 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0edc5d76-5776-4637-9e60-a740ec73e471 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '984405c23591415eaf067cb43305057d', 'request_id': 'req-0edc5d76-5776-4637-9e60-a740ec73e471'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:55.557214 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:55.559204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0edc5d76-5776-4637-9e60-a740ec73e471 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '984405c23591415eaf067cb43305057d', 'request_id': 'req-0edc5d76-5776-4637-9e60-a740ec73e471'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:55.574209 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0edc5d76-5776-4637-9e60-a740ec73e471 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '984405c23591415eaf067cb43305057d', 'request_id': 'req-0edc5d76-5776-4637-9e60-a740ec73e471'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:55.621371 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0edc5d76-5776-4637-9e60-a740ec73e471 admin admin] The token cache is being invalidate because project 984405c23591415eaf067cb43305057d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:55.621779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0edc5d76-5776-4637-9e60-a740ec73e471 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:55.622651 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0edc5d76-5776-4637-9e60-a740ec73e471 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:55.625436 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3100/6179] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:55 2022] DELETE /identity/v3/projects/984405c23591415eaf067cb43305057d => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:55.630423 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bd7b5-2751-4e0d-98eb-72cc48b9245d None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:55.630918 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bd7b5-2751-4e0d-98eb-72cc48b9245d None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:55.631061 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bd7b5-2751-4e0d-98eb-72cc48b9245d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:55.659947 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc5d76-5776-4637-9e60-a740ec73e471 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:55.661404 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0edc5d76-5776-4637-9e60-a740ec73e471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:55.680666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-ac8bd7b5-2751-4e0d-98eb-72cc48b9245d None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:55.683947 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ac8bd7b5-2751-4e0d-98eb-72cc48b9245d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:55.823898 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:55.829290 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc5d76-5776-4637-9e60-a740ec73e471 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:55.861041 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422f6ac-d592-4e81-8bb1-ea3e1964ffaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:55.861730 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422f6ac-d592-4e81-8bb1-ea3e1964ffaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:55.862012 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422f6ac-d592-4e81-8bb1-ea3e1964ffaf admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:55.862338 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422f6ac-d592-4e81-8bb1-ea3e1964ffaf admin admin] PATH_INFO: `/v3/projects/893be1a6082e4c639b844bd14ed175e7` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:55.870270 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b422f6ac-d592-4e81-8bb1-ea3e1964ffaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=893be1a6082e4c639b844bd14ed175e7)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:55.872350 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b422f6ac-d592-4e81-8bb1-ea3e1964ffaf admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:55.902993 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3080/6180] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:55.906834 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b623829-bf29-4723-8fcf-d2b4bbef6b04 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:55.907773 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b623829-bf29-4723-8fcf-d2b4bbef6b04 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:55.908963 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b623829-bf29-4723-8fcf-d2b4bbef6b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:55.973220 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-8b623829-bf29-4723-8fcf-d2b4bbef6b04 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:55.974657 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8b623829-bf29-4723-8fcf-d2b4bbef6b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:55.983727 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b422f6ac-d592-4e81-8bb1-ea3e1964ffaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '893be1a6082e4c639b844bd14ed175e7', 'request_id': 'req-b422f6ac-d592-4e81-8bb1-ea3e1964ffaf'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:56.019651 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b422f6ac-d592-4e81-8bb1-ea3e1964ffaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '893be1a6082e4c639b844bd14ed175e7', 'request_id': 'req-b422f6ac-d592-4e81-8bb1-ea3e1964ffaf'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:56.037043 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b422f6ac-d592-4e81-8bb1-ea3e1964ffaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '893be1a6082e4c639b844bd14ed175e7', 'request_id': 'req-b422f6ac-d592-4e81-8bb1-ea3e1964ffaf'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:56.076914 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b422f6ac-d592-4e81-8bb1-ea3e1964ffaf admin admin] The token cache is being invalidate because project 893be1a6082e4c639b844bd14ed175e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:56.077675 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b422f6ac-d592-4e81-8bb1-ea3e1964ffaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:56.078665 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b422f6ac-d592-4e81-8bb1-ea3e1964ffaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:56.085829 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3101/6181] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:55 2022] DELETE /identity/v3/projects/893be1a6082e4c639b844bd14ed175e7 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:05:56.089751 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422f6ac-d592-4e81-8bb1-ea3e1964ffaf admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:56.092443 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b422f6ac-d592-4e81-8bb1-ea3e1964ffaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:56.137728 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3081/6182] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:56.139235 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b623829-bf29-4723-8fcf-d2b4bbef6b04 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:56.161503 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b623829-bf29-4723-8fcf-d2b4bbef6b04 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:56.176857 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032de66-91ea-4933-8ef6-5b4aeb39d857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:56.177496 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032de66-91ea-4933-8ef6-5b4aeb39d857 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:56.177782 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032de66-91ea-4933-8ef6-5b4aeb39d857 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:56.180485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032de66-91ea-4933-8ef6-5b4aeb39d857 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:56.181214 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032de66-91ea-4933-8ef6-5b4aeb39d857 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:05:56.181533 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032de66-91ea-4933-8ef6-5b4aeb39d857 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:56.187479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032de66-91ea-4933-8ef6-5b4aeb39d857 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:56.211138 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422f6ac-d592-4e81-8bb1-ea3e1964ffaf admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:56.221184 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3082/6183] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:56.223393 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032de66-91ea-4933-8ef6-5b4aeb39d857 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:56.227234 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f891bc38-8365-45ef-8be6-88c9b6d5449a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:56.228076 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891bc38-8365-45ef-8be6-88c9b6d5449a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:56.229070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891bc38-8365-45ef-8be6-88c9b6d5449a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:56.229496 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891bc38-8365-45ef-8be6-88c9b6d5449a admin admin] PATH_INFO: `/v3/users/191795ba73e642e68596d20c2fae5473` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:56.231915 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f891bc38-8365-45ef-8be6-88c9b6d5449a admin admin] RBAC: Authorizing `identity:delete_user(user_id=191795ba73e642e68596d20c2fae5473)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:56.237167 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f891bc38-8365-45ef-8be6-88c9b6d5449a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:56.257607 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032de66-91ea-4933-8ef6-5b4aeb39d857 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:56.280109 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4703e7-f218-4a23-a896-919e311acdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:56.280737 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4703e7-f218-4a23-a896-919e311acdb6 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:56.281016 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4703e7-f218-4a23-a896-919e311acdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:56.281288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4703e7-f218-4a23-a896-919e311acdb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:56.282087 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4703e7-f218-4a23-a896-919e311acdb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:56.284055 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4703e7-f218-4a23-a896-919e311acdb6 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:56.294492 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:56.377600 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3083/6184] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:05:56 2022] POST /identity/v3/projects => generated 383 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:56.383421 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4703e7-f218-4a23-a896-919e311acdb6 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:56.385251 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f891bc38-8365-45ef-8be6-88c9b6d5449a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '191795ba73e642e68596d20c2fae5473'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:56.386997 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f891bc38-8365-45ef-8be6-88c9b6d5449a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '191795ba73e642e68596d20c2fae5473'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:56.405333 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f891bc38-8365-45ef-8be6-88c9b6d5449a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '191795ba73e642e68596d20c2fae5473'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:56.437649 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f891bc38-8365-45ef-8be6-88c9b6d5449a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '191795ba73e642e68596d20c2fae5473'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:56.442771 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f891bc38-8365-45ef-8be6-88c9b6d5449a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '191795ba73e642e68596d20c2fae5473'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:56.495923 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3102/6185] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:05:56 2022] DELETE /identity/v3/users/191795ba73e642e68596d20c2fae5473 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:56.606089 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4703e7-f218-4a23-a896-919e311acdb6 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:56.797376 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf122c-e90f-469f-82d6-d8c15b29a170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:56.798216 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf122c-e90f-469f-82d6-d8c15b29a170 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:56.798371 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf122c-e90f-469f-82d6-d8c15b29a170 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:56.798664 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf122c-e90f-469f-82d6-d8c15b29a170 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:56.799336 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf122c-e90f-469f-82d6-d8c15b29a170 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:56.820394 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf122c-e90f-469f-82d6-d8c15b29a170 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:56.884996 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:56.903583 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f891bc38-8365-45ef-8be6-88c9b6d5449a admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:56.907045 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3084/6186] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:05:56 2022] POST /identity/v3/users => generated 292 bytes in 522 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:56.908108 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f891bc38-8365-45ef-8be6-88c9b6d5449a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:56.942191 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f891bc38-8365-45ef-8be6-88c9b6d5449a admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:56.956743 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed8a65-d5d9-4e08-b963-68da90116d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:56.957594 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed8a65-d5d9-4e08-b963-68da90116d7a admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:56.958096 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed8a65-d5d9-4e08-b963-68da90116d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:56.959375 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed8a65-d5d9-4e08-b963-68da90116d7a admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:56.960105 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed8a65-d5d9-4e08-b963-68da90116d7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:56.961751 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed8a65-d5d9-4e08-b963-68da90116d7a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:57.019592 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3103/6187] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:57.019743 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf122c-e90f-469f-82d6-d8c15b29a170 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:57.032940 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf122c-e90f-469f-82d6-d8c15b29a170 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:57.052890 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10b32d-3afb-4985-abe8-b886cd8bea58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:57.056750 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10b32d-3afb-4985-abe8-b886cd8bea58 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:57.058805 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10b32d-3afb-4985-abe8-b886cd8bea58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:57.059327 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10b32d-3afb-4985-abe8-b886cd8bea58 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:57.061625 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb10b32d-3afb-4985-abe8-b886cd8bea58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:57.063852 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb10b32d-3afb-4985-abe8-b886cd8bea58 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:57.096460 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed8a65-d5d9-4e08-b963-68da90116d7a admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:57.102509 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3085/6188] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:57.111776 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed8a65-d5d9-4e08-b963-68da90116d7a admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:57.131165 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e986ae0-5a00-49aa-a0df-de0ba8469e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:57.131873 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e986ae0-5a00-49aa-a0df-de0ba8469e78 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:57.132152 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e986ae0-5a00-49aa-a0df-de0ba8469e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:57.132425 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e986ae0-5a00-49aa-a0df-de0ba8469e78 admin admin] PATH_INFO: `/v3/projects/49d9880fa3bb4b24939378397b1ff02e/users/1faa249db3be41418f54963af8d32d71/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:57.164751 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e986ae0-5a00-49aa-a0df-de0ba8469e78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49d9880fa3bb4b24939378397b1ff02e, user_id=1faa249db3be41418f54963af8d32d71, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:57.171544 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e986ae0-5a00-49aa-a0df-de0ba8469e78 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:57.202051 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3104/6189] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:05:57 2022] PUT /identity/v3/projects/49d9880fa3bb4b24939378397b1ff02e/users/1faa249db3be41418f54963af8d32d71/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:05:57.217797 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193e5e5-4400-4ddb-938e-f0770901e067 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:57.218258 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193e5e5-4400-4ddb-938e-f0770901e067 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:57.218865 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193e5e5-4400-4ddb-938e-f0770901e067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:57.290479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-3193e5e5-4400-4ddb-938e-f0770901e067 None None] MFA Rules not processed for user `1faa249db3be41418f54963af8d32d71`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:57.291430 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e986ae0-5a00-49aa-a0df-de0ba8469e78 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:57.293121 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5e986ae0-5a00-49aa-a0df-de0ba8469e78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:57.293915 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3193e5e5-4400-4ddb-938e-f0770901e067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:57.536098 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3086/6190] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:57.540029 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193e5e5-4400-4ddb-938e-f0770901e067 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:57.552940 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e986ae0-5a00-49aa-a0df-de0ba8469e78 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:57.568955 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193e5e5-4400-4ddb-938e-f0770901e067 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:57.579784 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359844a6-fb55-416e-83a1-d036b5c3e264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:57.580528 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359844a6-fb55-416e-83a1-d036b5c3e264 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:57.580808 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359844a6-fb55-416e-83a1-d036b5c3e264 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:57.581078 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359844a6-fb55-416e-83a1-d036b5c3e264 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:57.581719 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359844a6-fb55-416e-83a1-d036b5c3e264 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:57.594424 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41424f-f498-43e9-81c0-fb7f94b89bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:57.594921 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41424f-f498-43e9-81c0-fb7f94b89bfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:57.595248 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41424f-f498-43e9-81c0-fb7f94b89bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:57.599411 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359844a6-fb55-416e-83a1-d036b5c3e264 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:57.603563 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41424f-f498-43e9-81c0-fb7f94b89bfa admin admin] PATH_INFO: `/v3/projects/b90b8a7f8d194825ad81b4e2443b2179` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:57.606199 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c41424f-f498-43e9-81c0-fb7f94b89bfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=b90b8a7f8d194825ad81b4e2443b2179)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:57.608294 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c41424f-f498-43e9-81c0-fb7f94b89bfa admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:57.683612 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3087/6191] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:05:57 2022] POST /identity/v3/projects => generated 383 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:57.688603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359844a6-fb55-416e-83a1-d036b5c3e264 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:57.816932 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8c41424f-f498-43e9-81c0-fb7f94b89bfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b90b8a7f8d194825ad81b4e2443b2179', 'request_id': 'req-8c41424f-f498-43e9-81c0-fb7f94b89bfa'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:57.848870 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8c41424f-f498-43e9-81c0-fb7f94b89bfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b90b8a7f8d194825ad81b4e2443b2179', 'request_id': 'req-8c41424f-f498-43e9-81c0-fb7f94b89bfa'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:57.860889 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:57.880973 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8c41424f-f498-43e9-81c0-fb7f94b89bfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b90b8a7f8d194825ad81b4e2443b2179', 'request_id': 'req-8c41424f-f498-43e9-81c0-fb7f94b89bfa'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:57.931583 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8c41424f-f498-43e9-81c0-fb7f94b89bfa admin admin] The token cache is being invalidate because project b90b8a7f8d194825ad81b4e2443b2179 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:57.932621 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8c41424f-f498-43e9-81c0-fb7f94b89bfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:57.933524 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8c41424f-f498-43e9-81c0-fb7f94b89bfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:57.947070 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3105/6192] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:57 2022] DELETE /identity/v3/projects/b90b8a7f8d194825ad81b4e2443b2179 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:05:57.953136 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbcf3cf-c4f2-460d-8980-28a8f42fb944 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:57.953422 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbcf3cf-c4f2-460d-8980-28a8f42fb944 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:57.953701 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbcf3cf-c4f2-460d-8980-28a8f42fb944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:57.990077 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359844a6-fb55-416e-83a1-d036b5c3e264 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:58.041088 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-ffbcf3cf-c4f2-460d-8980-28a8f42fb944 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:58.048179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ffbcf3cf-c4f2-460d-8980-28a8f42fb944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:58.308113 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006487ec-addc-4d1a-93dd-a6098b788fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:58.309000 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006487ec-addc-4d1a-93dd-a6098b788fea admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:58.309435 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006487ec-addc-4d1a-93dd-a6098b788fea admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:58.309972 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006487ec-addc-4d1a-93dd-a6098b788fea admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:58.311635 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006487ec-addc-4d1a-93dd-a6098b788fea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:58.314027 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006487ec-addc-4d1a-93dd-a6098b788fea admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:58.361801 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:58.368782 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3106/6193] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:58.378627 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b69c07-6ce9-4549-b49c-b8bf09a8dc69 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:58.379171 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b69c07-6ce9-4549-b49c-b8bf09a8dc69 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:58.379283 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b69c07-6ce9-4549-b49c-b8bf09a8dc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:58.399204 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3088/6194] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:05:57 2022] POST /identity/v3/users => generated 298 bytes in 711 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:58.402723 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006487ec-addc-4d1a-93dd-a6098b788fea admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:58.410664 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-006487ec-addc-4d1a-93dd-a6098b788fea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:58.423539 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-e9b69c07-6ce9-4549-b49c-b8bf09a8dc69 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:58.425683 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e9b69c07-6ce9-4549-b49c-b8bf09a8dc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:58.441722 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3107/6195] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:05:58.443786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b69c07-6ce9-4549-b49c-b8bf09a8dc69 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:58.445774 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e9b69c07-6ce9-4549-b49c-b8bf09a8dc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:58.478794 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006487ec-addc-4d1a-93dd-a6098b788fea admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:58.487092 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b69c07-6ce9-4549-b49c-b8bf09a8dc69 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:58.495946 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331d700-0c08-4ade-a3eb-f64141ce5234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:58.497404 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331d700-0c08-4ade-a3eb-f64141ce5234 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:58.499284 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331d700-0c08-4ade-a3eb-f64141ce5234 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:58.499565 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331d700-0c08-4ade-a3eb-f64141ce5234 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:58.500245 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2331d700-0c08-4ade-a3eb-f64141ce5234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:58.501887 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2331d700-0c08-4ade-a3eb-f64141ce5234 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:58.503530 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf95a7-6074-4308-b753-0c294e00185b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:58.506059 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf95a7-6074-4308-b753-0c294e00185b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:58.506351 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf95a7-6074-4308-b753-0c294e00185b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:58.506627 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf95a7-6074-4308-b753-0c294e00185b admin admin] PATH_INFO: `/v3/users/8b0d215b8be341709900d7d5edba42af` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:58.509324 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daf95a7-6074-4308-b753-0c294e00185b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b0d215b8be341709900d7d5edba42af)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:58.511319 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daf95a7-6074-4308-b753-0c294e00185b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:58.532227 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3089/6196] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:58.542266 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331d700-0c08-4ade-a3eb-f64141ce5234 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:58.576657 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331d700-0c08-4ade-a3eb-f64141ce5234 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:58.590828 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac6796-f99b-4738-93ef-e843a1a32401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:58.593008 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac6796-f99b-4738-93ef-e843a1a32401 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:58.593299 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac6796-f99b-4738-93ef-e843a1a32401 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:58.593675 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac6796-f99b-4738-93ef-e843a1a32401 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:58.594438 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac6796-f99b-4738-93ef-e843a1a32401 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:05:58.594797 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac6796-f99b-4738-93ef-e843a1a32401 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:58.596726 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac6796-f99b-4738-93ef-e843a1a32401 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:58.656580 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9daf95a7-6074-4308-b753-0c294e00185b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b0d215b8be341709900d7d5edba42af'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:58.657431 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3090/6197] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:05:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:58.658349 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac6796-f99b-4738-93ef-e843a1a32401 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:58.660024 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9daf95a7-6074-4308-b753-0c294e00185b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b0d215b8be341709900d7d5edba42af'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:58.676134 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9daf95a7-6074-4308-b753-0c294e00185b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b0d215b8be341709900d7d5edba42af'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:58.689874 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac6796-f99b-4738-93ef-e843a1a32401 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:58.696818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9daf95a7-6074-4308-b753-0c294e00185b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b0d215b8be341709900d7d5edba42af'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:58.712607 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9daf95a7-6074-4308-b753-0c294e00185b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b0d215b8be341709900d7d5edba42af'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:58.717777 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15ffa9-7984-448d-b3f8-38a9643970fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:58.718548 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15ffa9-7984-448d-b3f8-38a9643970fc admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:58.718842 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15ffa9-7984-448d-b3f8-38a9643970fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:58.721587 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15ffa9-7984-448d-b3f8-38a9643970fc admin admin] PATH_INFO: `/v3/projects/13aebbe0443d49cba87c005860a676b4/users/e42927eab43948b9bc10e9de4dba1fd0/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:58.794860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15ffa9-7984-448d-b3f8-38a9643970fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=13aebbe0443d49cba87c005860a676b4, user_id=e42927eab43948b9bc10e9de4dba1fd0, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:58.801711 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3108/6198] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:05:58 2022] DELETE /identity/v3/users/8b0d215b8be341709900d7d5edba42af => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:58.805949 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf95a7-6074-4308-b753-0c294e00185b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:58.811197 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15ffa9-7984-448d-b3f8-38a9643970fc admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:58.816079 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9daf95a7-6074-4308-b753-0c294e00185b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:58.861812 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3091/6199] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:05:58 2022] PUT /identity/v3/projects/13aebbe0443d49cba87c005860a676b4/users/e42927eab43948b9bc10e9de4dba1fd0/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:58.865447 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e4846-b1cc-4467-a93c-ea784005b3c6 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:58.866115 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e4846-b1cc-4467-a93c-ea784005b3c6 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:58.867637 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e4846-b1cc-4467-a93c-ea784005b3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:58.926898 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-455e4846-b1cc-4467-a93c-ea784005b3c6 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:58.930296 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-455e4846-b1cc-4467-a93c-ea784005b3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:59.067838 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:59.110914 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf95a7-6074-4308-b753-0c294e00185b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:59.164725 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3092/6200] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:59.165815 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e4846-b1cc-4467-a93c-ea784005b3c6 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:59.170723 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-455e4846-b1cc-4467-a93c-ea784005b3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:59.205258 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e4846-b1cc-4467-a93c-ea784005b3c6 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:59.217994 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688daf35-4775-47a4-b8f7-6d5214aeca6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:59.218730 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688daf35-4775-47a4-b8f7-6d5214aeca6e admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:59.224467 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688daf35-4775-47a4-b8f7-6d5214aeca6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:59.224986 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688daf35-4775-47a4-b8f7-6d5214aeca6e admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:59.228915 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688daf35-4775-47a4-b8f7-6d5214aeca6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:59.232865 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688daf35-4775-47a4-b8f7-6d5214aeca6e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:59.287723 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3093/6201] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:59.288793 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688daf35-4775-47a4-b8f7-6d5214aeca6e admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:59.298278 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-688daf35-4775-47a4-b8f7-6d5214aeca6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:59.308658 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c3dc8-142a-472c-93ac-796d04e207da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:59.309314 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c3dc8-142a-472c-93ac-796d04e207da admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:59.309596 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c3dc8-142a-472c-93ac-796d04e207da admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:59.309868 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c3dc8-142a-472c-93ac-796d04e207da admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:59.313775 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46c3dc8-142a-472c-93ac-796d04e207da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:59.320661 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46c3dc8-142a-472c-93ac-796d04e207da admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:59.397702 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3109/6202] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:05:58 2022] POST /identity/v3/projects => generated 375 bytes in 595 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:59.399447 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c3dc8-142a-472c-93ac-796d04e207da admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:59.602833 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688daf35-4775-47a4-b8f7-6d5214aeca6e admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:59.630873 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c3dc8-142a-472c-93ac-796d04e207da admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:59.657559 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21417380-8b6a-4b49-8b8a-9f8931cd58e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:59.658414 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21417380-8b6a-4b49-8b8a-9f8931cd58e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:59.658789 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21417380-8b6a-4b49-8b8a-9f8931cd58e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:59.659709 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21417380-8b6a-4b49-8b8a-9f8931cd58e6 admin admin] PATH_INFO: `/v3/projects/13aebbe0443d49cba87c005860a676b4/users/e42927eab43948b9bc10e9de4dba1fd0/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:59.666938 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21417380-8b6a-4b49-8b8a-9f8931cd58e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13aebbe0443d49cba87c005860a676b4, user_id=e42927eab43948b9bc10e9de4dba1fd0, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:59.676207 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21417380-8b6a-4b49-8b8a-9f8931cd58e6 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:59.728083 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3110/6203] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:05:59 2022] PUT /identity/v3/projects/13aebbe0443d49cba87c005860a676b4/users/e42927eab43948b9bc10e9de4dba1fd0/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:59.729181 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21417380-8b6a-4b49-8b8a-9f8931cd58e6 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:59.752743 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc1dcd-24a3-425e-9213-bfa4a6f91311 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:59.761558 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc1dcd-24a3-425e-9213-bfa4a6f91311 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:59.762987 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc1dcd-24a3-425e-9213-bfa4a6f91311 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:59.763436 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc1dcd-24a3-425e-9213-bfa4a6f91311 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:59.777546 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:59.793369 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cc1dcd-24a3-425e-9213-bfa4a6f91311 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:59.795777 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cc1dcd-24a3-425e-9213-bfa4a6f91311 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:59.825632 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3094/6204] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:05:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:05:59.829732 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba673bec-d5cd-4c30-b85d-a1ca440d07e0 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:59.830188 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba673bec-d5cd-4c30-b85d-a1ca440d07e0 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:59.830721 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba673bec-d5cd-4c30-b85d-a1ca440d07e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:59.882967 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-ba673bec-d5cd-4c30-b85d-a1ca440d07e0 None None] MFA Rules not processed for user `e42927eab43948b9bc10e9de4dba1fd0`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:59.884594 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ba673bec-d5cd-4c30-b85d-a1ca440d07e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:59.975287 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21417380-8b6a-4b49-8b8a-9f8931cd58e6 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:00.001208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77067304-69a2-4b9b-9048-c2a65f34f5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:00.002042 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77067304-69a2-4b9b-9048-c2a65f34f5df admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:00.002422 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77067304-69a2-4b9b-9048-c2a65f34f5df admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:00.002797 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77067304-69a2-4b9b-9048-c2a65f34f5df admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:00.003967 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3095/6205] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:05:59 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:00.004998 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba673bec-d5cd-4c30-b85d-a1ca440d07e0 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:00.008092 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77067304-69a2-4b9b-9048-c2a65f34f5df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:00.014212 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77067304-69a2-4b9b-9048-c2a65f34f5df admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:00.019885 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ba673bec-d5cd-4c30-b85d-a1ca440d07e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:00.061346 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba673bec-d5cd-4c30-b85d-a1ca440d07e0 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:00.065830 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3111/6206] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:05:59 2022] POST /identity/v3/users => generated 288 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:00.067107 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77067304-69a2-4b9b-9048-c2a65f34f5df admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:00.082008 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be6cca-81fe-42f1-ac09-f4961a675110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:00.085909 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be6cca-81fe-42f1-ac09-f4961a675110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:00.086231 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be6cca-81fe-42f1-ac09-f4961a675110 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:00.086514 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be6cca-81fe-42f1-ac09-f4961a675110 admin admin] PATH_INFO: `/v3/users/8603e98b9d334bb4a05a5794ad51bd53` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:00.091424 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79be6cca-81fe-42f1-ac09-f4961a675110 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8603e98b9d334bb4a05a5794ad51bd53)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:00.106278 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79be6cca-81fe-42f1-ac09-f4961a675110 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:00.112920 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77067304-69a2-4b9b-9048-c2a65f34f5df admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:00.133734 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35ab4c-5c51-445d-92c8-033be71476a3 tempest-ProjectsNegativeTestJSON-529482562 tempest-ProjectsNegativeTestJSON-529482562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e42927eab43948b9bc10e9de4dba1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13aebbe0443d49cba87c005860a676b4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:00.141463 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35ab4c-5c51-445d-92c8-033be71476a3 tempest-ProjectsNegativeTestJSON-529482562 tempest-ProjectsNegativeTestJSON-529482562-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:00.141890 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35ab4c-5c51-445d-92c8-033be71476a3 tempest-ProjectsNegativeTestJSON-529482562 tempest-ProjectsNegativeTestJSON-529482562-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:00.142273 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35ab4c-5c51-445d-92c8-033be71476a3 tempest-ProjectsNegativeTestJSON-529482562 tempest-ProjectsNegativeTestJSON-529482562-project-admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:00.143077 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35ab4c-5c51-445d-92c8-033be71476a3 tempest-ProjectsNegativeTestJSON-529482562 tempest-ProjectsNegativeTestJSON-529482562-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:00.149061 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35ab4c-5c51-445d-92c8-033be71476a3 tempest-ProjectsNegativeTestJSON-529482562 tempest-ProjectsNegativeTestJSON-529482562-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:00.178852 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:00.223325 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-79be6cca-81fe-42f1-ac09-f4961a675110 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8603e98b9d334bb4a05a5794ad51bd53'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:00.223841 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-79be6cca-81fe-42f1-ac09-f4961a675110 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8603e98b9d334bb4a05a5794ad51bd53'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:00.238290 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3112/6207] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:06:00 2022] POST /identity/v3/projects => generated 359 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:00.240088 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35ab4c-5c51-445d-92c8-033be71476a3 tempest-ProjectsNegativeTestJSON-529482562 tempest-ProjectsNegativeTestJSON-529482562-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:00.254336 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-79be6cca-81fe-42f1-ac09-f4961a675110 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8603e98b9d334bb4a05a5794ad51bd53'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:00.277231 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-79be6cca-81fe-42f1-ac09-f4961a675110 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8603e98b9d334bb4a05a5794ad51bd53'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:00.298867 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-79be6cca-81fe-42f1-ac09-f4961a675110 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8603e98b9d334bb4a05a5794ad51bd53'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:00.316926 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3096/6208] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:06:00 2022] DELETE /identity/v3/users/8603e98b9d334bb4a05a5794ad51bd53 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:00.318684 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be6cca-81fe-42f1-ac09-f4961a675110 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:00.323706 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-79be6cca-81fe-42f1-ac09-f4961a675110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:00.410679 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35ab4c-5c51-445d-92c8-033be71476a3 tempest-ProjectsNegativeTestJSON-529482562 tempest-ProjectsNegativeTestJSON-529482562-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:00.456343 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:00.474356 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be6cca-81fe-42f1-ac09-f4961a675110 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:00.481804 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2dcb68-3b2b-486a-85ef-570641dc9b2e tempest-ProjectsNegativeTestJSON-585360792 tempest-ProjectsNegativeTestJSON-585360792-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1faa249db3be41418f54963af8d32d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49d9880fa3bb4b24939378397b1ff02e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:00.483774 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2dcb68-3b2b-486a-85ef-570641dc9b2e tempest-ProjectsNegativeTestJSON-585360792 tempest-ProjectsNegativeTestJSON-585360792-project] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:00.485863 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2dcb68-3b2b-486a-85ef-570641dc9b2e tempest-ProjectsNegativeTestJSON-585360792 tempest-ProjectsNegativeTestJSON-585360792-project] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:00.486261 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2dcb68-3b2b-486a-85ef-570641dc9b2e tempest-ProjectsNegativeTestJSON-585360792 tempest-ProjectsNegativeTestJSON-585360792-project] PATH_INFO: `/v3/projects/ca33f68192f54519a40a2b886f3a39c7` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:00.487807 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2dcb68-3b2b-486a-85ef-570641dc9b2e tempest-ProjectsNegativeTestJSON-585360792 tempest-ProjectsNegativeTestJSON-585360792-project] RBAC: Authorizing `identity:delete_project(project_id=ca33f68192f54519a40a2b886f3a39c7)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:00.499898 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-9c2dcb68-3b2b-486a-85ef-570641dc9b2e tempest-ProjectsNegativeTestJSON-585360792 tempest-ProjectsNegativeTestJSON-585360792-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Aug 29 16:06:00.499898 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:06:00.499898 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:06:00.499898 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:06:00.499898 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:06:00.499898 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:06:00.499898 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:06:00.499898 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:06:00.499898 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:06:00.499898 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:06:00.499898 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:06:00.499898 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:06:00.499898 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 207, in delete Aug 29 16:06:00.499898 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Aug 29 16:06:00.501014 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Aug 29 16:06:00.501014 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application enforcer_obj._enforce( Aug 29 16:06:00.501014 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Aug 29 16:06:00.501014 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Aug 29 16:06:00.501014 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 16:06:00.501014 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Aug 29 16:06:00.501014 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Aug 29 16:06:00.501014 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:06:00.512506 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3097/6209] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:06:00 2022] DELETE /identity/v3/projects/ca33f68192f54519a40a2b886f3a39c7 => generated 136 bytes in 192 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 29 16:06:00.512506 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9bd96-5baa-40bc-9f81-351b94e0abf3 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:00.512506 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9bd96-5baa-40bc-9f81-351b94e0abf3 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:00.512506 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9bd96-5baa-40bc-9f81-351b94e0abf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:00.554672 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-30f9bd96-5baa-40bc-9f81-351b94e0abf3 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:00.555743 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6c845-0283-4af4-8910-8f04f157d390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:00.556485 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6c845-0283-4af4-8910-8f04f157d390 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:00.556870 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6c845-0283-4af4-8910-8f04f157d390 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:00.557245 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6c845-0283-4af4-8910-8f04f157d390 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:00.558008 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf6c845-0283-4af4-8910-8f04f157d390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:00.560397 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-30f9bd96-5baa-40bc-9f81-351b94e0abf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:00.562428 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf6c845-0283-4af4-8910-8f04f157d390 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:00.591367 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3098/6210] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:00.593195 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f9bd96-5baa-40bc-9f81-351b94e0abf3 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:00.595429 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3113/6211] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:06:00.596228 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-30f9bd96-5baa-40bc-9f81-351b94e0abf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:00.599513 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6c845-0283-4af4-8910-8f04f157d390 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:00.603526 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8bf6c845-0283-4af4-8910-8f04f157d390 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:00.632766 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6c845-0283-4af4-8910-8f04f157d390 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:00.650489 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206f97e-3849-491e-9ebf-7844c1b97fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:00.651285 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206f97e-3849-491e-9ebf-7844c1b97fba admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:00.651670 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206f97e-3849-491e-9ebf-7844c1b97fba admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:00.652047 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206f97e-3849-491e-9ebf-7844c1b97fba admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:00.652924 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9206f97e-3849-491e-9ebf-7844c1b97fba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:00.658221 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9206f97e-3849-491e-9ebf-7844c1b97fba admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:00.680200 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3114/6212] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:06:00.681286 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206f97e-3849-491e-9ebf-7844c1b97fba admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:00.688653 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9206f97e-3849-491e-9ebf-7844c1b97fba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:00.769191 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f9bd96-5baa-40bc-9f81-351b94e0abf3 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:00.783642 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9cc269-f09f-4bba-b975-54e20194968c tempest-ProjectsNegativeTestJSON-529482562 tempest-ProjectsNegativeTestJSON-529482562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e42927eab43948b9bc10e9de4dba1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13aebbe0443d49cba87c005860a676b4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:00.784612 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cc269-f09f-4bba-b975-54e20194968c tempest-ProjectsNegativeTestJSON-529482562 tempest-ProjectsNegativeTestJSON-529482562-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:00.784996 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cc269-f09f-4bba-b975-54e20194968c tempest-ProjectsNegativeTestJSON-529482562 tempest-ProjectsNegativeTestJSON-529482562-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:00.785381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cc269-f09f-4bba-b975-54e20194968c tempest-ProjectsNegativeTestJSON-529482562 tempest-ProjectsNegativeTestJSON-529482562-project-admin] PATH_INFO: `/v3/projects/ca33f68192f54519a40a2b886f3a39c7` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:00.789495 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9cc269-f09f-4bba-b975-54e20194968c tempest-ProjectsNegativeTestJSON-529482562 tempest-ProjectsNegativeTestJSON-529482562-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ca33f68192f54519a40a2b886f3a39c7)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:00.791987 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9cc269-f09f-4bba-b975-54e20194968c tempest-ProjectsNegativeTestJSON-529482562 tempest-ProjectsNegativeTestJSON-529482562-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:00.860772 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206f97e-3849-491e-9ebf-7844c1b97fba admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:00.865664 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc6a3d-8da1-421a-a170-9d0f99030f02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:00.866488 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc6a3d-8da1-421a-a170-9d0f99030f02 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:00.866771 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc6a3d-8da1-421a-a170-9d0f99030f02 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:00.867118 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc6a3d-8da1-421a-a170-9d0f99030f02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:00.894221 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc6a3d-8da1-421a-a170-9d0f99030f02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:00.895791 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc6a3d-8da1-421a-a170-9d0f99030f02 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:00.923239 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3115/6213] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:06:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:06:00.927093 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc6a3d-8da1-421a-a170-9d0f99030f02 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:00.949408 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0e9cc269-f09f-4bba-b975-54e20194968c tempest-ProjectsNegativeTestJSON-529482562 tempest-ProjectsNegativeTestJSON-529482562-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca33f68192f54519a40a2b886f3a39c7', 'request_id': 'req-0e9cc269-f09f-4bba-b975-54e20194968c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:00.949632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc6a3d-8da1-421a-a170-9d0f99030f02 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:00.999809 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:01.001917 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0e9cc269-f09f-4bba-b975-54e20194968c tempest-ProjectsNegativeTestJSON-529482562 tempest-ProjectsNegativeTestJSON-529482562-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca33f68192f54519a40a2b886f3a39c7', 'request_id': 'req-0e9cc269-f09f-4bba-b975-54e20194968c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:01.017567 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0e9cc269-f09f-4bba-b975-54e20194968c tempest-ProjectsNegativeTestJSON-529482562 tempest-ProjectsNegativeTestJSON-529482562-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca33f68192f54519a40a2b886f3a39c7', 'request_id': 'req-0e9cc269-f09f-4bba-b975-54e20194968c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:01.047551 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0e9cc269-f09f-4bba-b975-54e20194968c tempest-ProjectsNegativeTestJSON-529482562 tempest-ProjectsNegativeTestJSON-529482562-project-admin] The token cache is being invalidate because project ca33f68192f54519a40a2b886f3a39c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:01.048243 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0e9cc269-f09f-4bba-b975-54e20194968c tempest-ProjectsNegativeTestJSON-529482562 tempest-ProjectsNegativeTestJSON-529482562-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:01.050054 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0e9cc269-f09f-4bba-b975-54e20194968c tempest-ProjectsNegativeTestJSON-529482562 tempest-ProjectsNegativeTestJSON-529482562-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:01.056957 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3099/6214] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:06:00 2022] DELETE /identity/v3/projects/ca33f68192f54519a40a2b886f3a39c7 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:01.058097 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9cc269-f09f-4bba-b975-54e20194968c tempest-ProjectsNegativeTestJSON-529482562 tempest-ProjectsNegativeTestJSON-529482562-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:01.059839 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0e9cc269-f09f-4bba-b975-54e20194968c tempest-ProjectsNegativeTestJSON-529482562 tempest-ProjectsNegativeTestJSON-529482562-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:01.106327 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f449d-7589-44a4-8ace-56d35574daa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:01.107017 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f449d-7589-44a4-8ace-56d35574daa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:01.108029 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f449d-7589-44a4-8ace-56d35574daa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:01.108282 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f449d-7589-44a4-8ace-56d35574daa0 admin admin] PATH_INFO: `/v3/projects/336b5607e3c5483b9aff68d52e86e6db/users/aba7331083b54bd3a0121ea222e476cb/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:01.176958 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f449d-7589-44a4-8ace-56d35574daa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=336b5607e3c5483b9aff68d52e86e6db, user_id=aba7331083b54bd3a0121ea222e476cb, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:01.187162 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f449d-7589-44a4-8ace-56d35574daa0 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:01.244124 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9cc269-f09f-4bba-b975-54e20194968c tempest-ProjectsNegativeTestJSON-529482562 tempest-ProjectsNegativeTestJSON-529482562-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:01.249634 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3116/6215] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:06:00 2022] PUT /identity/v3/projects/336b5607e3c5483b9aff68d52e86e6db/users/aba7331083b54bd3a0121ea222e476cb/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:01.254451 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a2c6a-49a4-4390-9807-f14dd8fdecab None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:01.254719 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a2c6a-49a4-4390-9807-f14dd8fdecab None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:01.254999 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a2c6a-49a4-4390-9807-f14dd8fdecab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:01.311695 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:01.365099 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-664a2c6a-49a4-4390-9807-f14dd8fdecab None None] MFA Rules not processed for user `aba7331083b54bd3a0121ea222e476cb`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:01.370596 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-664a2c6a-49a4-4390-9807-f14dd8fdecab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:01.401501 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b3cc4-f059-4582-bd5a-623166e75a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:01.402009 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b3cc4-f059-4582-bd5a-623166e75a50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:01.402470 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b3cc4-f059-4582-bd5a-623166e75a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:01.402856 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b3cc4-f059-4582-bd5a-623166e75a50 admin admin] PATH_INFO: `/v3/users/1faa249db3be41418f54963af8d32d71` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:01.408255 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b3cc4-f059-4582-bd5a-623166e75a50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1faa249db3be41418f54963af8d32d71)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:01.410747 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b3cc4-f059-4582-bd5a-623166e75a50 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:01.523316 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-984b3cc4-f059-4582-bd5a-623166e75a50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1faa249db3be41418f54963af8d32d71'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:01.526406 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-984b3cc4-f059-4582-bd5a-623166e75a50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1faa249db3be41418f54963af8d32d71'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:01.560001 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-984b3cc4-f059-4582-bd5a-623166e75a50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1faa249db3be41418f54963af8d32d71'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:01.585876 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-984b3cc4-f059-4582-bd5a-623166e75a50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1faa249db3be41418f54963af8d32d71'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:01.601099 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-984b3cc4-f059-4582-bd5a-623166e75a50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1faa249db3be41418f54963af8d32d71'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:01.602030 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3117/6216] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:01.604054 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a2c6a-49a4-4390-9807-f14dd8fdecab None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:01.607976 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-664a2c6a-49a4-4390-9807-f14dd8fdecab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:01.613538 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3100/6217] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:06:01 2022] DELETE /identity/v3/users/1faa249db3be41418f54963af8d32d71 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:01.617707 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08849e0a-d11f-4be6-b032-a98e59c10c9a None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:01.618152 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08849e0a-d11f-4be6-b032-a98e59c10c9a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:01.618589 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08849e0a-d11f-4be6-b032-a98e59c10c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:01.643821 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a2c6a-49a4-4390-9807-f14dd8fdecab None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:01.665809 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-08849e0a-d11f-4be6-b032-a98e59c10c9a None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:01.668885 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-08849e0a-d11f-4be6-b032-a98e59c10c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:01.828873 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63722c99-1ed7-4b2b-8b17-410b8ecbf3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:01.829751 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63722c99-1ed7-4b2b-8b17-410b8ecbf3d7 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:01.830032 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63722c99-1ed7-4b2b-8b17-410b8ecbf3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:01.830308 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63722c99-1ed7-4b2b-8b17-410b8ecbf3d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:01.830950 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63722c99-1ed7-4b2b-8b17-410b8ecbf3d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:01.839085 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63722c99-1ed7-4b2b-8b17-410b8ecbf3d7 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:01.879617 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3101/6218] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:01.882620 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08849e0a-d11f-4be6-b032-a98e59c10c9a None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:01.885381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-08849e0a-d11f-4be6-b032-a98e59c10c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:01.902443 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3118/6219] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:06:01 2022] POST /identity/v3/projects => generated 377 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:01.903785 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63722c99-1ed7-4b2b-8b17-410b8ecbf3d7 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:01.906454 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-63722c99-1ed7-4b2b-8b17-410b8ecbf3d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:01.913553 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08849e0a-d11f-4be6-b032-a98e59c10c9a None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:01.944967 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:01.981505 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:01.994370 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63722c99-1ed7-4b2b-8b17-410b8ecbf3d7 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:02.003859 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d0cfdb-314e-40f2-a2d0-1beb1f3fcad1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:02.004762 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146ab88-8e01-4a77-9303-0e21681398c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:02.004912 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0cfdb-314e-40f2-a2d0-1beb1f3fcad1 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:02.005365 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0cfdb-314e-40f2-a2d0-1beb1f3fcad1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:02.006413 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0cfdb-314e-40f2-a2d0-1beb1f3fcad1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:02.006769 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146ab88-8e01-4a77-9303-0e21681398c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:02.007069 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146ab88-8e01-4a77-9303-0e21681398c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:02.007352 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146ab88-8e01-4a77-9303-0e21681398c4 admin admin] PATH_INFO: `/v3/projects/1dd597b5016441459719b4f2968ef1a6` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:02.009049 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e146ab88-8e01-4a77-9303-0e21681398c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dd597b5016441459719b4f2968ef1a6)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:02.019117 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e146ab88-8e01-4a77-9303-0e21681398c4 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:02.021299 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d0cfdb-314e-40f2-a2d0-1beb1f3fcad1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:02.023581 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d0cfdb-314e-40f2-a2d0-1beb1f3fcad1 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:02.052175 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3119/6220] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:06:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:06:02.053709 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d0cfdb-314e-40f2-a2d0-1beb1f3fcad1 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:02.056093 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-60d0cfdb-314e-40f2-a2d0-1beb1f3fcad1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:02.099813 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d0cfdb-314e-40f2-a2d0-1beb1f3fcad1 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:02.103501 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1fa0af-1d7c-4b94-953a-2dc554198583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:02.105631 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1fa0af-1d7c-4b94-953a-2dc554198583 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:02.105921 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1fa0af-1d7c-4b94-953a-2dc554198583 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:02.106918 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1fa0af-1d7c-4b94-953a-2dc554198583 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:02.110393 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1fa0af-1d7c-4b94-953a-2dc554198583 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:02.114696 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1fa0af-1d7c-4b94-953a-2dc554198583 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:02.129399 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e146ab88-8e01-4a77-9303-0e21681398c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dd597b5016441459719b4f2968ef1a6', 'request_id': 'req-e146ab88-8e01-4a77-9303-0e21681398c4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:02.144597 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e146ab88-8e01-4a77-9303-0e21681398c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dd597b5016441459719b4f2968ef1a6', 'request_id': 'req-e146ab88-8e01-4a77-9303-0e21681398c4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:02.163722 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e146ab88-8e01-4a77-9303-0e21681398c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dd597b5016441459719b4f2968ef1a6', 'request_id': 'req-e146ab88-8e01-4a77-9303-0e21681398c4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:02.182395 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3120/6221] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:06:02 2022] POST /identity/v3/users => generated 295 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:02.184852 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1fa0af-1d7c-4b94-953a-2dc554198583 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:02.194740 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e146ab88-8e01-4a77-9303-0e21681398c4 admin admin] The token cache is being invalidate because project 1dd597b5016441459719b4f2968ef1a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:02.195064 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e146ab88-8e01-4a77-9303-0e21681398c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:02.195975 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e146ab88-8e01-4a77-9303-0e21681398c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:02.203106 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3102/6222] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:06:01 2022] DELETE /identity/v3/projects/1dd597b5016441459719b4f2968ef1a6 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:02.206084 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146ab88-8e01-4a77-9303-0e21681398c4 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:02.208498 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e146ab88-8e01-4a77-9303-0e21681398c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:02.218342 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1fa0af-1d7c-4b94-953a-2dc554198583 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:02.315619 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec40f0-13d9-4017-9846-d7c526f04ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:02.316606 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec40f0-13d9-4017-9846-d7c526f04ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:02.317055 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec40f0-13d9-4017-9846-d7c526f04ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:02.317490 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec40f0-13d9-4017-9846-d7c526f04ae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:02.318440 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ec40f0-13d9-4017-9846-d7c526f04ae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:02.320879 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ec40f0-13d9-4017-9846-d7c526f04ae1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:02.350174 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3121/6223] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:06:02 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:06:02.350932 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec40f0-13d9-4017-9846-d7c526f04ae1 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:02.358310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-10ec40f0-13d9-4017-9846-d7c526f04ae1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:02.388399 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec40f0-13d9-4017-9846-d7c526f04ae1 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:02.398197 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146ab88-8e01-4a77-9303-0e21681398c4 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:02.402642 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271fc6c-35fc-4849-8ff4-3f7a9ac9dc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:02.403834 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271fc6c-35fc-4849-8ff4-3f7a9ac9dc15 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:02.404017 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271fc6c-35fc-4849-8ff4-3f7a9ac9dc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:02.404851 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271fc6c-35fc-4849-8ff4-3f7a9ac9dc15 admin admin] PATH_INFO: `/v3/projects/3f384688989b440991f0e1d43d761213/users/404a66b2850848e3b88d522af62487a0/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:02.411431 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38baa656-844a-4d74-88aa-8facc8d35271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:02.412113 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38baa656-844a-4d74-88aa-8facc8d35271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:02.412388 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38baa656-844a-4d74-88aa-8facc8d35271 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:02.412662 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38baa656-844a-4d74-88aa-8facc8d35271 admin admin] PATH_INFO: `/v3/users/04ff74ccad7e46758348c91935d8eb8d` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:02.413966 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38baa656-844a-4d74-88aa-8facc8d35271 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04ff74ccad7e46758348c91935d8eb8d)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:02.421907 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38baa656-844a-4d74-88aa-8facc8d35271 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:02.446282 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0271fc6c-35fc-4849-8ff4-3f7a9ac9dc15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f384688989b440991f0e1d43d761213, user_id=404a66b2850848e3b88d522af62487a0, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:02.452023 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0271fc6c-35fc-4849-8ff4-3f7a9ac9dc15 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:02.482359 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3122/6224] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:06:02 2022] PUT /identity/v3/projects/3f384688989b440991f0e1d43d761213/users/404a66b2850848e3b88d522af62487a0/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:06:02.485001 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271fc6c-35fc-4849-8ff4-3f7a9ac9dc15 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:02.546839 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-38baa656-844a-4d74-88aa-8facc8d35271 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04ff74ccad7e46758348c91935d8eb8d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:02.547934 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-38baa656-844a-4d74-88aa-8facc8d35271 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04ff74ccad7e46758348c91935d8eb8d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:02.582052 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-38baa656-844a-4d74-88aa-8facc8d35271 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04ff74ccad7e46758348c91935d8eb8d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:02.608495 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-38baa656-844a-4d74-88aa-8facc8d35271 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04ff74ccad7e46758348c91935d8eb8d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:02.621901 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-38baa656-844a-4d74-88aa-8facc8d35271 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04ff74ccad7e46758348c91935d8eb8d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:02.625548 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:02.636641 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3103/6225] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:06:02 2022] DELETE /identity/v3/users/04ff74ccad7e46758348c91935d8eb8d => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:06:02.636970 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271fc6c-35fc-4849-8ff4-3f7a9ac9dc15 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:02.677992 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:02.721205 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71f74cb-664f-4ab9-bb5e-30506662a8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:02.721829 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f74cb-664f-4ab9-bb5e-30506662a8f0 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:02.722381 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f74cb-664f-4ab9-bb5e-30506662a8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:02.722666 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f74cb-664f-4ab9-bb5e-30506662a8f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:02.723360 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71f74cb-664f-4ab9-bb5e-30506662a8f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:02.726142 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71f74cb-664f-4ab9-bb5e-30506662a8f0 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:02.747304 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38baa656-844a-4d74-88aa-8facc8d35271 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:02.750564 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-38baa656-844a-4d74-88aa-8facc8d35271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:02.752210 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3123/6226] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:06:02 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:06:02.782601 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38baa656-844a-4d74-88aa-8facc8d35271 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:02.795460 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb23f79-64de-4da7-a7bf-b4639b6a70ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:02.796875 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb23f79-64de-4da7-a7bf-b4639b6a70ab admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:02.797226 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb23f79-64de-4da7-a7bf-b4639b6a70ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:02.797805 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb23f79-64de-4da7-a7bf-b4639b6a70ab admin admin] PATH_INFO: `/v3/projects/3f384688989b440991f0e1d43d761213/users/404a66b2850848e3b88d522af62487a0/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:02.803369 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb23f79-64de-4da7-a7bf-b4639b6a70ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f384688989b440991f0e1d43d761213, user_id=404a66b2850848e3b88d522af62487a0, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:02.810110 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb23f79-64de-4da7-a7bf-b4639b6a70ab admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:02.840354 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3104/6227] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:06:02 2022] PUT /identity/v3/projects/3f384688989b440991f0e1d43d761213/users/404a66b2850848e3b88d522af62487a0/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:02.844313 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa2d0b-a8b7-4261-9a84-2d7f4fb40d4d None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:02.844918 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa2d0b-a8b7-4261-9a84-2d7f4fb40d4d None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:02.845381 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa2d0b-a8b7-4261-9a84-2d7f4fb40d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:02.893405 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-b3fa2d0b-a8b7-4261-9a84-2d7f4fb40d4d None None] MFA Rules not processed for user `404a66b2850848e3b88d522af62487a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:02.894714 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b3fa2d0b-a8b7-4261-9a84-2d7f4fb40d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:03.017836 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb23f79-64de-4da7-a7bf-b4639b6a70ab admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:03.020564 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9cb23f79-64de-4da7-a7bf-b4639b6a70ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:03.037063 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3124/6228] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:02 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:03.042302 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa2d0b-a8b7-4261-9a84-2d7f4fb40d4d None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:03.069221 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa2d0b-a8b7-4261-9a84-2d7f4fb40d4d None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:03.087075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3482b5c-0f74-4961-8541-156794154f8f tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '404a66b2850848e3b88d522af62487a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f384688989b440991f0e1d43d761213', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:03.087946 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3482b5c-0f74-4961-8541-156794154f8f tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:03.088300 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3482b5c-0f74-4961-8541-156794154f8f tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:03.088642 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3482b5c-0f74-4961-8541-156794154f8f tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:03.089372 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3482b5c-0f74-4961-8541-156794154f8f tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:03.093221 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-a3482b5c-0f74-4961-8541-156794154f8f tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:06:03.093221 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 16:06:03.093221 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 16:06:03.096592 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3482b5c-0f74-4961-8541-156794154f8f tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:03.163312 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3125/6229] 10.222.0.83 () {60 vars in 1185 bytes} [Mon Aug 29 16:06:03 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:03.165070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3482b5c-0f74-4961-8541-156794154f8f tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:03.182471 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3482b5c-0f74-4961-8541-156794154f8f tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:03.200897 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a2115-0cbe-4da9-a454-0edc65bc9316 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '404a66b2850848e3b88d522af62487a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f384688989b440991f0e1d43d761213', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:03.206142 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a2115-0cbe-4da9-a454-0edc65bc9316 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:03.206857 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a2115-0cbe-4da9-a454-0edc65bc9316 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:03.207347 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a2115-0cbe-4da9-a454-0edc65bc9316 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/0853359b9a984c1c8eff90869c9fd184` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:03.208189 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a2115-0cbe-4da9-a454-0edc65bc9316 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=0853359b9a984c1c8eff90869c9fd184)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:03.209481 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-4f3a2115-0cbe-4da9-a454-0edc65bc9316 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:06:03.209481 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 16:06:03.209481 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 16:06:03.211488 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a2115-0cbe-4da9-a454-0edc65bc9316 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:03.223608 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3126/6230] 10.222.0.83 () {58 vars in 1263 bytes} [Mon Aug 29 16:06:03 2022] GET /identity/v3/OS-OAUTH1/consumers/0853359b9a984c1c8eff90869c9fd184 => generated 221 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:06:03.224930 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a2115-0cbe-4da9-a454-0edc65bc9316 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:03.238244 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a2115-0cbe-4da9-a454-0edc65bc9316 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:03.254826 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f901f690-8bcb-4dea-976a-69411de568d1 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '404a66b2850848e3b88d522af62487a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f384688989b440991f0e1d43d761213', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:03.258832 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f901f690-8bcb-4dea-976a-69411de568d1 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:03.259575 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f901f690-8bcb-4dea-976a-69411de568d1 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:03.260077 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f901f690-8bcb-4dea-976a-69411de568d1 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/0853359b9a984c1c8eff90869c9fd184` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:03.260925 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f901f690-8bcb-4dea-976a-69411de568d1 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=0853359b9a984c1c8eff90869c9fd184)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:03.262426 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-f901f690-8bcb-4dea-976a-69411de568d1 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:06:03.262426 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 16:06:03.262426 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 16:06:03.265170 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f901f690-8bcb-4dea-976a-69411de568d1 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:03.265864 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f901f690-8bcb-4dea-976a-69411de568d1 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Invalidating token cache because consumer 0853359b9a984c1c8eff90869c9fd184 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:03.266417 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f901f690-8bcb-4dea-976a-69411de568d1 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:03.267605 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f901f690-8bcb-4dea-976a-69411de568d1 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:03.302574 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f901f690-8bcb-4dea-976a-69411de568d1 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '0853359b9a984c1c8eff90869c9fd184', 'request_id': 'req-f901f690-8bcb-4dea-976a-69411de568d1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:03.310678 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb23f79-64de-4da7-a7bf-b4639b6a70ab admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:03.347397 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637acbf3-5f4a-4bd8-a967-6a41f06c2f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:03.347511 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3127/6231] 10.222.0.83 () {58 vars in 1266 bytes} [Mon Aug 29 16:06:03 2022] DELETE /identity/v3/OS-OAUTH1/consumers/0853359b9a984c1c8eff90869c9fd184 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:03.347616 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637acbf3-5f4a-4bd8-a967-6a41f06c2f86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:03.347616 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637acbf3-5f4a-4bd8-a967-6a41f06c2f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:03.347616 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637acbf3-5f4a-4bd8-a967-6a41f06c2f86 admin admin] PATH_INFO: `/v3/projects/49d9880fa3bb4b24939378397b1ff02e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:03.353761 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637acbf3-5f4a-4bd8-a967-6a41f06c2f86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49d9880fa3bb4b24939378397b1ff02e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:03.353964 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f901f690-8bcb-4dea-976a-69411de568d1 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:03.355564 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f901f690-8bcb-4dea-976a-69411de568d1 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:03.364381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637acbf3-5f4a-4bd8-a967-6a41f06c2f86 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:03.387619 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f901f690-8bcb-4dea-976a-69411de568d1 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:03.422161 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107243d-2708-4a2b-9ca4-16708c0ddd6c tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '404a66b2850848e3b88d522af62487a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f384688989b440991f0e1d43d761213', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:03.428060 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107243d-2708-4a2b-9ca4-16708c0ddd6c tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:03.428968 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107243d-2708-4a2b-9ca4-16708c0ddd6c tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:03.430441 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107243d-2708-4a2b-9ca4-16708c0ddd6c tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:03.434788 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c107243d-2708-4a2b-9ca4-16708c0ddd6c tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:03.438312 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c107243d-2708-4a2b-9ca4-16708c0ddd6c tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:03.473155 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3128/6232] 10.222.0.83 () {60 vars in 1185 bytes} [Mon Aug 29 16:06:03 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:03.474671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107243d-2708-4a2b-9ca4-16708c0ddd6c tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:03.513484 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107243d-2708-4a2b-9ca4-16708c0ddd6c tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:03.532793 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-637acbf3-5f4a-4bd8-a967-6a41f06c2f86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49d9880fa3bb4b24939378397b1ff02e', 'request_id': 'req-637acbf3-5f4a-4bd8-a967-6a41f06c2f86'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:03.548272 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-637acbf3-5f4a-4bd8-a967-6a41f06c2f86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49d9880fa3bb4b24939378397b1ff02e', 'request_id': 'req-637acbf3-5f4a-4bd8-a967-6a41f06c2f86'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:03.564173 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-637acbf3-5f4a-4bd8-a967-6a41f06c2f86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49d9880fa3bb4b24939378397b1ff02e', 'request_id': 'req-637acbf3-5f4a-4bd8-a967-6a41f06c2f86'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:03.594623 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-637acbf3-5f4a-4bd8-a967-6a41f06c2f86 admin admin] The token cache is being invalidate because project 49d9880fa3bb4b24939378397b1ff02e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:03.595259 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-637acbf3-5f4a-4bd8-a967-6a41f06c2f86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:03.599493 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-637acbf3-5f4a-4bd8-a967-6a41f06c2f86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:03.610166 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3105/6233] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:06:03 2022] DELETE /identity/v3/projects/49d9880fa3bb4b24939378397b1ff02e => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:06:03.611118 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637acbf3-5f4a-4bd8-a967-6a41f06c2f86 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:03.617123 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-637acbf3-5f4a-4bd8-a967-6a41f06c2f86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:03.833046 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:03.875761 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db6dc5-99e1-4247-b1a0-ed19d6f81061 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '404a66b2850848e3b88d522af62487a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f384688989b440991f0e1d43d761213', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:03.876661 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db6dc5-99e1-4247-b1a0-ed19d6f81061 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:03.876957 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db6dc5-99e1-4247-b1a0-ed19d6f81061 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:03.877241 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db6dc5-99e1-4247-b1a0-ed19d6f81061 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/02854e4bc03e4c62b3d2b2a530db5419` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:03.877846 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db6dc5-99e1-4247-b1a0-ed19d6f81061 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=02854e4bc03e4c62b3d2b2a530db5419)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:03.879577 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db6dc5-99e1-4247-b1a0-ed19d6f81061 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:03.886185 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637acbf3-5f4a-4bd8-a967-6a41f06c2f86 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:03.896099 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d5e47-191b-4a32-82a4-d8406c65e095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:03.896960 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d5e47-191b-4a32-82a4-d8406c65e095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:03.897326 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d5e47-191b-4a32-82a4-d8406c65e095 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:03.897859 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d5e47-191b-4a32-82a4-d8406c65e095 admin admin] PATH_INFO: `/v3/projects/d96213509f4c4c2c96df69ba6a6ac64f` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:03.898915 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3129/6234] 10.222.0.83 () {58 vars in 1263 bytes} [Mon Aug 29 16:06:03 2022] GET /identity/v3/OS-OAUTH1/consumers/02854e4bc03e4c62b3d2b2a530db5419 => generated 221 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:06:03.899786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db6dc5-99e1-4247-b1a0-ed19d6f81061 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:03.900932 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743d5e47-191b-4a32-82a4-d8406c65e095 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d96213509f4c4c2c96df69ba6a6ac64f)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:03.903498 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743d5e47-191b-4a32-82a4-d8406c65e095 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:03.906434 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-60db6dc5-99e1-4247-b1a0-ed19d6f81061 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:03.934406 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:03.946370 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db6dc5-99e1-4247-b1a0-ed19d6f81061 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:03.967162 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91e627-a4e5-46e3-879a-6aa7d6ad15e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:03.967162 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91e627-a4e5-46e3-879a-6aa7d6ad15e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:03.969024 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91e627-a4e5-46e3-879a-6aa7d6ad15e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:03.969447 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91e627-a4e5-46e3-879a-6aa7d6ad15e8 admin admin] PATH_INFO: `/v3/users/e42927eab43948b9bc10e9de4dba1fd0` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:03.976965 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f91e627-a4e5-46e3-879a-6aa7d6ad15e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e42927eab43948b9bc10e9de4dba1fd0)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:03.991639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f91e627-a4e5-46e3-879a-6aa7d6ad15e8 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:04.059372 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-743d5e47-191b-4a32-82a4-d8406c65e095 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd96213509f4c4c2c96df69ba6a6ac64f', 'request_id': 'req-743d5e47-191b-4a32-82a4-d8406c65e095'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:04.082121 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-743d5e47-191b-4a32-82a4-d8406c65e095 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd96213509f4c4c2c96df69ba6a6ac64f', 'request_id': 'req-743d5e47-191b-4a32-82a4-d8406c65e095'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:04.099598 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-743d5e47-191b-4a32-82a4-d8406c65e095 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd96213509f4c4c2c96df69ba6a6ac64f', 'request_id': 'req-743d5e47-191b-4a32-82a4-d8406c65e095'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:04.131018 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-743d5e47-191b-4a32-82a4-d8406c65e095 admin admin] The token cache is being invalidate because project d96213509f4c4c2c96df69ba6a6ac64f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:04.134056 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-743d5e47-191b-4a32-82a4-d8406c65e095 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:04.135958 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-743d5e47-191b-4a32-82a4-d8406c65e095 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:04.138721 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3106/6235] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:06:03 2022] DELETE /identity/v3/projects/d96213509f4c4c2c96df69ba6a6ac64f => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:04.142600 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d5e47-191b-4a32-82a4-d8406c65e095 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:04.152224 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-743d5e47-191b-4a32-82a4-d8406c65e095 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:04.171822 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2f91e627-a4e5-46e3-879a-6aa7d6ad15e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e42927eab43948b9bc10e9de4dba1fd0'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:04.173238 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2f91e627-a4e5-46e3-879a-6aa7d6ad15e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e42927eab43948b9bc10e9de4dba1fd0'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:04.192162 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2f91e627-a4e5-46e3-879a-6aa7d6ad15e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e42927eab43948b9bc10e9de4dba1fd0'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:04.214785 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2f91e627-a4e5-46e3-879a-6aa7d6ad15e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e42927eab43948b9bc10e9de4dba1fd0'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:04.215596 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2f91e627-a4e5-46e3-879a-6aa7d6ad15e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e42927eab43948b9bc10e9de4dba1fd0'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:04.252463 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3130/6236] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:06:03 2022] DELETE /identity/v3/users/e42927eab43948b9bc10e9de4dba1fd0 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:04.254021 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5e988-1225-44c1-9ef6-7ea1af8404b5 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:04.254309 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5e988-1225-44c1-9ef6-7ea1af8404b5 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:04.254574 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5e988-1225-44c1-9ef6-7ea1af8404b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:04.333280 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-1cc5e988-1225-44c1-9ef6-7ea1af8404b5 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:04.339362 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1cc5e988-1225-44c1-9ef6-7ea1af8404b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:04.395720 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d5e47-191b-4a32-82a4-d8406c65e095 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:04.487506 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c785803a-2140-46aa-b20b-7f7a243d31e0 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '404a66b2850848e3b88d522af62487a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f384688989b440991f0e1d43d761213', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:04.488643 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785803a-2140-46aa-b20b-7f7a243d31e0 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:04.489726 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785803a-2140-46aa-b20b-7f7a243d31e0 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:04.490225 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785803a-2140-46aa-b20b-7f7a243d31e0 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/02854e4bc03e4c62b3d2b2a530db5419` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:04.491071 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c785803a-2140-46aa-b20b-7f7a243d31e0 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=02854e4bc03e4c62b3d2b2a530db5419)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:04.492561 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-c785803a-2140-46aa-b20b-7f7a243d31e0 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:06:04.492561 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 16:06:04.492561 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 16:06:04.494083 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c785803a-2140-46aa-b20b-7f7a243d31e0 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:04.494549 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c785803a-2140-46aa-b20b-7f7a243d31e0 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Invalidating token cache because consumer 02854e4bc03e4c62b3d2b2a530db5419 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:04.495049 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c785803a-2140-46aa-b20b-7f7a243d31e0 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:04.497176 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c785803a-2140-46aa-b20b-7f7a243d31e0 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:04.526211 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3131/6237] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:04.535763 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974d735-e16e-4cfe-9fd2-fc0639ae5c93 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:04.536339 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974d735-e16e-4cfe-9fd2-fc0639ae5c93 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:04.536794 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974d735-e16e-4cfe-9fd2-fc0639ae5c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:04.547681 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c785803a-2140-46aa-b20b-7f7a243d31e0 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '02854e4bc03e4c62b3d2b2a530db5419', 'request_id': 'req-c785803a-2140-46aa-b20b-7f7a243d31e0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:04.585799 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3107/6238] 10.222.0.83 () {58 vars in 1266 bytes} [Mon Aug 29 16:06:04 2022] DELETE /identity/v3/OS-OAUTH1/consumers/02854e4bc03e4c62b3d2b2a530db5419 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:04.592342 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c785803a-2140-46aa-b20b-7f7a243d31e0 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:04.597406 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c785803a-2140-46aa-b20b-7f7a243d31e0 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:04.604713 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-4974d735-e16e-4cfe-9fd2-fc0639ae5c93 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:04.610297 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4974d735-e16e-4cfe-9fd2-fc0639ae5c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:04.623782 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c785803a-2140-46aa-b20b-7f7a243d31e0 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:04.634336 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3132/6239] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:06:04.635615 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4974d735-e16e-4cfe-9fd2-fc0639ae5c93 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:04.644746 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cdca40-eb7e-4927-8b4b-3c156868f806 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '404a66b2850848e3b88d522af62487a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f384688989b440991f0e1d43d761213', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:04.645564 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdca40-eb7e-4927-8b4b-3c156868f806 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:04.646001 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdca40-eb7e-4927-8b4b-3c156868f806 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:04.646324 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdca40-eb7e-4927-8b4b-3c156868f806 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/02854e4bc03e4c62b3d2b2a530db5419` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:04.647054 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cdca40-eb7e-4927-8b4b-3c156868f806 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=02854e4bc03e4c62b3d2b2a530db5419)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:04.649690 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-d3cdca40-eb7e-4927-8b4b-3c156868f806 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:06:04.649690 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 16:06:04.649690 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 16:06:04.650875 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cdca40-eb7e-4927-8b4b-3c156868f806 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:04.660416 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4974d735-e16e-4cfe-9fd2-fc0639ae5c93 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:04.673485 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7ec51-ff4b-4c06-823f-c9e700ca79ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:04.674464 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7ec51-ff4b-4c06-823f-c9e700ca79ba admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:04.676469 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7ec51-ff4b-4c06-823f-c9e700ca79ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:04.677222 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7ec51-ff4b-4c06-823f-c9e700ca79ba admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:04.678138 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd7ec51-ff4b-4c06-823f-c9e700ca79ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:06:04.680206 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-d3cdca40-eb7e-4927-8b4b-3c156868f806 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Aug 29 16:06:04.680206 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:06:04.680206 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:06:04.680206 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:06:04.680206 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:06:04.680206 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:06:04.680206 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:06:04.680206 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:06:04.680206 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:06:04.680206 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:06:04.680206 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:06:04.680206 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:06:04.680206 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 100, in get Aug 29 16:06:04.680206 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_consumer(consumer_id) Aug 29 16:06:04.680206 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 95, in _get_consumer Aug 29 16:06:04.681207 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.oauth_api.get_consumer(consumer_id)) Aug 29 16:06:04.681207 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 101, in get_consumer Aug 29 16:06:04.681207 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self.get_consumer_with_secret(consumer_id)) Aug 29 16:06:04.681207 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 96, in get_consumer_with_secret Aug 29 16:06:04.681207 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Aug 29 16:06:04.681207 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Aug 29 16:06:04.681207 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Aug 29 16:06:04.681207 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Aug 29 16:06:04.681207 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:06:04.683776 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3108/6240] 10.222.0.83 () {58 vars in 1263 bytes} [Mon Aug 29 16:06:04 2022] GET /identity/v3/OS-OAUTH1/consumers/02854e4bc03e4c62b3d2b2a530db5419 => generated 74 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 16:06:04.684357 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd7ec51-ff4b-4c06-823f-c9e700ca79ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:04.686784 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd7ec51-ff4b-4c06-823f-c9e700ca79ba admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:04.688499 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cdca40-eb7e-4927-8b4b-3c156868f806 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:04.720989 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cdca40-eb7e-4927-8b4b-3c156868f806 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:04.728772 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3133/6241] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:06:04.730271 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7ec51-ff4b-4c06-823f-c9e700ca79ba admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:04.732819 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2fd7ec51-ff4b-4c06-823f-c9e700ca79ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:04.733313 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908659f9-199b-44a1-8717-9abc83ad459a tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '404a66b2850848e3b88d522af62487a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f384688989b440991f0e1d43d761213', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:04.733983 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908659f9-199b-44a1-8717-9abc83ad459a tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:04.734270 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908659f9-199b-44a1-8717-9abc83ad459a tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:04.734653 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908659f9-199b-44a1-8717-9abc83ad459a tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/02854e4bc03e4c62b3d2b2a530db5419` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:04.735291 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908659f9-199b-44a1-8717-9abc83ad459a tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=02854e4bc03e4c62b3d2b2a530db5419)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:04.739064 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908659f9-199b-44a1-8717-9abc83ad459a tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:04.739327 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-908659f9-199b-44a1-8717-9abc83ad459a tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Invalidating token cache because consumer 02854e4bc03e4c62b3d2b2a530db5419 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:04.746358 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-908659f9-199b-44a1-8717-9abc83ad459a tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:04.746358 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-908659f9-199b-44a1-8717-9abc83ad459a tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:04.763688 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7ec51-ff4b-4c06-823f-c9e700ca79ba admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:04.768538 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-908659f9-199b-44a1-8717-9abc83ad459a tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Aug 29 16:06:04.768538 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:06:04.768538 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:06:04.768538 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:06:04.768538 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:06:04.768538 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:06:04.768538 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:06:04.768538 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:06:04.768538 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:06:04.768538 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:06:04.768538 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:06:04.768538 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:06:04.768538 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 123, in delete Aug 29 16:06:04.768538 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application PROVIDERS.oauth_api.delete_consumer( Aug 29 16:06:04.768538 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:06:04.769460 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:06:04.769460 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/core.py", line 139, in delete_consumer Aug 29 16:06:04.769460 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ret = self.driver.delete_consumer(consumer_id) Aug 29 16:06:04.769460 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 133, in delete_consumer Aug 29 16:06:04.769460 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self._delete_consumer(session, consumer_id) Aug 29 16:06:04.769460 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 110, in _delete_consumer Aug 29 16:06:04.769460 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Aug 29 16:06:04.769460 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Aug 29 16:06:04.769460 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Aug 29 16:06:04.769460 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Aug 29 16:06:04.769460 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:06:04.771219 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3109/6242] 10.222.0.83 () {58 vars in 1266 bytes} [Mon Aug 29 16:06:04 2022] DELETE /identity/v3/OS-OAUTH1/consumers/02854e4bc03e4c62b3d2b2a530db5419 => generated 74 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 16:06:04.772336 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908659f9-199b-44a1-8717-9abc83ad459a tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:04.780668 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd84419-baf8-4561-acdb-9dc708b982e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:04.781490 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd84419-baf8-4561-acdb-9dc708b982e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:04.793632 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-908659f9-199b-44a1-8717-9abc83ad459a tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:04.794289 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd84419-baf8-4561-acdb-9dc708b982e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:04.794855 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd84419-baf8-4561-acdb-9dc708b982e8 admin admin] PATH_INFO: `/v3/projects/5ab9e6d27d5442e38e2920b14440ef00` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:04.798794 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd84419-baf8-4561-acdb-9dc708b982e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ab9e6d27d5442e38e2920b14440ef00)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:04.803351 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd84419-baf8-4561-acdb-9dc708b982e8 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:04.846791 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908659f9-199b-44a1-8717-9abc83ad459a tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:04.887863 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ad79f-9e63-4ee1-8010-cb82c00c65f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:04.888563 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ad79f-9e63-4ee1-8010-cb82c00c65f4 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:04.889436 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ad79f-9e63-4ee1-8010-cb82c00c65f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:04.891163 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ad79f-9e63-4ee1-8010-cb82c00c65f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:04.900578 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0ad79f-9e63-4ee1-8010-cb82c00c65f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:04.914533 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0ad79f-9e63-4ee1-8010-cb82c00c65f4 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:04.942007 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:04.945087 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:04.996520 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3110/6243] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:06:04 2022] POST /identity/v3/projects => generated 375 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:04.996712 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8fd84419-baf8-4561-acdb-9dc708b982e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ab9e6d27d5442e38e2920b14440ef00', 'request_id': 'req-8fd84419-baf8-4561-acdb-9dc708b982e8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:04.996934 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ad79f-9e63-4ee1-8010-cb82c00c65f4 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:04.999911 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ca0ad79f-9e63-4ee1-8010-cb82c00c65f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:05.004999 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8fd84419-baf8-4561-acdb-9dc708b982e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ab9e6d27d5442e38e2920b14440ef00', 'request_id': 'req-8fd84419-baf8-4561-acdb-9dc708b982e8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:05.018374 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8fd84419-baf8-4561-acdb-9dc708b982e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ab9e6d27d5442e38e2920b14440ef00', 'request_id': 'req-8fd84419-baf8-4561-acdb-9dc708b982e8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:05.054635 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8fd84419-baf8-4561-acdb-9dc708b982e8 admin admin] The token cache is being invalidate because project 5ab9e6d27d5442e38e2920b14440ef00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:05.056871 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8fd84419-baf8-4561-acdb-9dc708b982e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:05.058240 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8fd84419-baf8-4561-acdb-9dc708b982e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:05.065149 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3134/6244] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:06:04 2022] DELETE /identity/v3/projects/5ab9e6d27d5442e38e2920b14440ef00 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:05.065149 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd84419-baf8-4561-acdb-9dc708b982e8 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:05.069005 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8fd84419-baf8-4561-acdb-9dc708b982e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:05.200609 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ad79f-9e63-4ee1-8010-cb82c00c65f4 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:05.216006 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953cd80c-72e3-48b4-b35a-5231514715af tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '404a66b2850848e3b88d522af62487a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f384688989b440991f0e1d43d761213', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:05.217009 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cd80c-72e3-48b4-b35a-5231514715af tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:05.217464 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cd80c-72e3-48b4-b35a-5231514715af tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:05.218032 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cd80c-72e3-48b4-b35a-5231514715af tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:05.226031 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953cd80c-72e3-48b4-b35a-5231514715af tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:05.227855 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-953cd80c-72e3-48b4-b35a-5231514715af tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:06:05.227855 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 16:06:05.227855 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 16:06:05.230411 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953cd80c-72e3-48b4-b35a-5231514715af tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:05.243795 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd84419-baf8-4561-acdb-9dc708b982e8 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:05.298593 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3111/6245] 10.222.0.83 () {60 vars in 1185 bytes} [Mon Aug 29 16:06:04 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:05.307065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72064f40-4f58-431b-8f5c-7b3c60ab0573 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:05.307354 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72064f40-4f58-431b-8f5c-7b3c60ab0573 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:05.307634 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72064f40-4f58-431b-8f5c-7b3c60ab0573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:05.424912 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abbbe40-f008-418b-bbde-a9f8f8b45f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:05.425849 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbbe40-f008-418b-bbde-a9f8f8b45f90 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:05.426233 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbbe40-f008-418b-bbde-a9f8f8b45f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:05.427757 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbbe40-f008-418b-bbde-a9f8f8b45f90 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:05.428665 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abbbe40-f008-418b-bbde-a9f8f8b45f90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:05.431733 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abbbe40-f008-418b-bbde-a9f8f8b45f90 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:05.452780 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-72064f40-4f58-431b-8f5c-7b3c60ab0573 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:05.455724 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-72064f40-4f58-431b-8f5c-7b3c60ab0573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:05.481641 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3135/6246] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:06:05 2022] POST /identity/v3/users => generated 288 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:05.485753 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abbbe40-f008-418b-bbde-a9f8f8b45f90 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:05.487723 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0abbbe40-f008-418b-bbde-a9f8f8b45f90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:05.496254 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3112/6247] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:05.505029 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72064f40-4f58-431b-8f5c-7b3c60ab0573 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:05.509688 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-72064f40-4f58-431b-8f5c-7b3c60ab0573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:05.523001 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abbbe40-f008-418b-bbde-a9f8f8b45f90 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:05.529161 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1617a2ff-9ed9-46e4-b919-9b4c17538fbe tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '404a66b2850848e3b88d522af62487a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f384688989b440991f0e1d43d761213', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:05.530178 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617a2ff-9ed9-46e4-b919-9b4c17538fbe tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:05.530854 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617a2ff-9ed9-46e4-b919-9b4c17538fbe tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:05.531476 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617a2ff-9ed9-46e4-b919-9b4c17538fbe tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:05.533492 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1617a2ff-9ed9-46e4-b919-9b4c17538fbe tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:05.536590 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1617a2ff-9ed9-46e4-b919-9b4c17538fbe tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:05.554191 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72064f40-4f58-431b-8f5c-7b3c60ab0573 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:05.559817 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3136/6248] 10.222.0.83 () {60 vars in 1185 bytes} [Mon Aug 29 16:06:05 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:05.561515 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1617a2ff-9ed9-46e4-b919-9b4c17538fbe tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:05.577365 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1617a2ff-9ed9-46e4-b919-9b4c17538fbe tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:05.578054 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8e8a9-76c7-4e14-b7b5-74b149ff90e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:05.578675 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8e8a9-76c7-4e14-b7b5-74b149ff90e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:05.578954 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8e8a9-76c7-4e14-b7b5-74b149ff90e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:05.579345 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8e8a9-76c7-4e14-b7b5-74b149ff90e0 admin admin] PATH_INFO: `/v3/projects/13aebbe0443d49cba87c005860a676b4` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:05.580529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a8e8a9-76c7-4e14-b7b5-74b149ff90e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13aebbe0443d49cba87c005860a676b4)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:05.582503 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a8e8a9-76c7-4e14-b7b5-74b149ff90e0 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:05.605678 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e2222-6bcf-4106-9600-29eff3059c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:05.606327 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e2222-6bcf-4106-9600-29eff3059c22 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:05.606612 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e2222-6bcf-4106-9600-29eff3059c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:05.606886 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e2222-6bcf-4106-9600-29eff3059c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:05.607994 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e2222-6bcf-4106-9600-29eff3059c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:05.609773 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e2222-6bcf-4106-9600-29eff3059c22 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:05.634645 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3137/6249] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:06:05.636090 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64dcbe-3879-44aa-b962-850a1188a5cd None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:05.636394 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64dcbe-3879-44aa-b962-850a1188a5cd None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:05.636673 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64dcbe-3879-44aa-b962-850a1188a5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:05.697392 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-ef64dcbe-3879-44aa-b962-850a1188a5cd None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:05.700901 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ef64dcbe-3879-44aa-b962-850a1188a5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:05.705101 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-99a8e8a9-76c7-4e14-b7b5-74b149ff90e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13aebbe0443d49cba87c005860a676b4', 'request_id': 'req-99a8e8a9-76c7-4e14-b7b5-74b149ff90e0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:05.725670 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-99a8e8a9-76c7-4e14-b7b5-74b149ff90e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13aebbe0443d49cba87c005860a676b4', 'request_id': 'req-99a8e8a9-76c7-4e14-b7b5-74b149ff90e0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:05.766078 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:05.767746 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-99a8e8a9-76c7-4e14-b7b5-74b149ff90e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13aebbe0443d49cba87c005860a676b4', 'request_id': 'req-99a8e8a9-76c7-4e14-b7b5-74b149ff90e0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:05.801843 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-99a8e8a9-76c7-4e14-b7b5-74b149ff90e0 admin admin] The token cache is being invalidate because project 13aebbe0443d49cba87c005860a676b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:05.802440 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-99a8e8a9-76c7-4e14-b7b5-74b149ff90e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:05.806649 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-99a8e8a9-76c7-4e14-b7b5-74b149ff90e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:05.814983 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3113/6250] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:06:05 2022] DELETE /identity/v3/projects/13aebbe0443d49cba87c005860a676b4 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:05.816535 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8e8a9-76c7-4e14-b7b5-74b149ff90e0 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:05.823547 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-99a8e8a9-76c7-4e14-b7b5-74b149ff90e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:05.939216 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3138/6251] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:05.942042 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64dcbe-3879-44aa-b962-850a1188a5cd None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:05.943830 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ef64dcbe-3879-44aa-b962-850a1188a5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:05.971306 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64dcbe-3879-44aa-b962-850a1188a5cd None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:05.980090 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15129371-eb77-4a38-bb39-c0151f8dae63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:05.981237 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15129371-eb77-4a38-bb39-c0151f8dae63 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:05.981802 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15129371-eb77-4a38-bb39-c0151f8dae63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:05.982492 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15129371-eb77-4a38-bb39-c0151f8dae63 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:05.983892 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15129371-eb77-4a38-bb39-c0151f8dae63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:05.986801 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15129371-eb77-4a38-bb39-c0151f8dae63 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:06.016536 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3139/6252] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:06:06.019052 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364383a-8eed-4da1-bb57-1c4aee17eb63 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:06.019626 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364383a-8eed-4da1-bb57-1c4aee17eb63 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:06.020147 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364383a-8eed-4da1-bb57-1c4aee17eb63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:06.094127 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-f364383a-8eed-4da1-bb57-1c4aee17eb63 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:06.103872 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f364383a-8eed-4da1-bb57-1c4aee17eb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:06.111517 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8e8a9-76c7-4e14-b7b5-74b149ff90e0 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:06.132124 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3140/6253] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:06.133266 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f364383a-8eed-4da1-bb57-1c4aee17eb63 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:06.140769 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5be7ed-a4dd-40af-8561-0ef744e7299c tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '404a66b2850848e3b88d522af62487a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f384688989b440991f0e1d43d761213', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:06.141427 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5be7ed-a4dd-40af-8561-0ef744e7299c tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:06.141712 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5be7ed-a4dd-40af-8561-0ef744e7299c tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:06.141991 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5be7ed-a4dd-40af-8561-0ef744e7299c tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:06.142584 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5be7ed-a4dd-40af-8561-0ef744e7299c tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:06.143660 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-1c5be7ed-a4dd-40af-8561-0ef744e7299c tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:06:06.143660 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 16:06:06.143660 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 16:06:06.156143 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5be7ed-a4dd-40af-8561-0ef744e7299c tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:06.156614 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f364383a-8eed-4da1-bb57-1c4aee17eb63 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:06.157505 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:06.170734 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c185900-1937-444e-9ef8-ec0b4751fba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:06.171706 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c185900-1937-444e-9ef8-ec0b4751fba1 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:06.172177 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c185900-1937-444e-9ef8-ec0b4751fba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:06.172692 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c185900-1937-444e-9ef8-ec0b4751fba1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:06.173669 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c185900-1937-444e-9ef8-ec0b4751fba1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:06:06.174187 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c185900-1937-444e-9ef8-ec0b4751fba1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:06.176088 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c185900-1937-444e-9ef8-ec0b4751fba1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:06.183794 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3114/6254] 10.222.0.83 () {58 vars in 1164 bytes} [Mon Aug 29 16:06:05 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 537 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:06:06.185803 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5be7ed-a4dd-40af-8561-0ef744e7299c tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:06.205692 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3141/6255] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:06:06.207398 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea21a463-8a84-411a-a6a2-3fee833849c6 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:06.207897 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea21a463-8a84-411a-a6a2-3fee833849c6 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:06.208373 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea21a463-8a84-411a-a6a2-3fee833849c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:06.233853 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5be7ed-a4dd-40af-8561-0ef744e7299c tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:06.253678 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12edac25-868c-4119-acc4-0b02be3a5b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:06.254598 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-ea21a463-8a84-411a-a6a2-3fee833849c6 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:06.256627 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ea21a463-8a84-411a-a6a2-3fee833849c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:06.256877 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12edac25-868c-4119-acc4-0b02be3a5b5f admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:06.257100 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12edac25-868c-4119-acc4-0b02be3a5b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:06.257382 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12edac25-868c-4119-acc4-0b02be3a5b5f admin admin] PATH_INFO: `/v3/projects/5d9f9eeb56554ad28775050a34ffb450/users/0c483227eeae4e819f2f771830707edd/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:06.277699 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3142/6256] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:06.278882 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea21a463-8a84-411a-a6a2-3fee833849c6 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:06.303812 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea21a463-8a84-411a-a6a2-3fee833849c6 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:06.316529 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470f814-7d1f-4e6d-acba-ab4464c98a89 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '404a66b2850848e3b88d522af62487a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f384688989b440991f0e1d43d761213', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:06.317574 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470f814-7d1f-4e6d-acba-ab4464c98a89 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:06.318091 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470f814-7d1f-4e6d-acba-ab4464c98a89 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:06.318584 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470f814-7d1f-4e6d-acba-ab4464c98a89 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/0597fe1f9f734633bc75f03742dd0cd1` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:06.319442 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7470f814-7d1f-4e6d-acba-ab4464c98a89 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=0597fe1f9f734633bc75f03742dd0cd1)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:06.321281 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7470f814-7d1f-4e6d-acba-ab4464c98a89 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:06.321776 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7470f814-7d1f-4e6d-acba-ab4464c98a89 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Invalidating token cache because consumer 0597fe1f9f734633bc75f03742dd0cd1 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:06.322310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7470f814-7d1f-4e6d-acba-ab4464c98a89 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:06.323389 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7470f814-7d1f-4e6d-acba-ab4464c98a89 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:06.325672 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12edac25-868c-4119-acc4-0b02be3a5b5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d9f9eeb56554ad28775050a34ffb450, user_id=0c483227eeae4e819f2f771830707edd, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:06.338190 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12edac25-868c-4119-acc4-0b02be3a5b5f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:06.352184 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7470f814-7d1f-4e6d-acba-ab4464c98a89 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '0597fe1f9f734633bc75f03742dd0cd1', 'request_id': 'req-7470f814-7d1f-4e6d-acba-ab4464c98a89'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:06.373982 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3143/6257] 10.222.0.83 () {58 vars in 1266 bytes} [Mon Aug 29 16:06:06 2022] DELETE /identity/v3/OS-OAUTH1/consumers/0597fe1f9f734633bc75f03742dd0cd1 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:06.375204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470f814-7d1f-4e6d-acba-ab4464c98a89 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:06.384459 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7470f814-7d1f-4e6d-acba-ab4464c98a89 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:06.407137 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3115/6258] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:06:06 2022] PUT /identity/v3/projects/5d9f9eeb56554ad28775050a34ffb450/users/0c483227eeae4e819f2f771830707edd/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:06.411420 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12edac25-868c-4119-acc4-0b02be3a5b5f admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:06.412324 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470f814-7d1f-4e6d-acba-ab4464c98a89 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:06.421085 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-12edac25-868c-4119-acc4-0b02be3a5b5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:06.569261 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b0600-e8ab-4cd6-b253-2ea0b6a2a226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:06.570274 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b0600-e8ab-4cd6-b253-2ea0b6a2a226 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:06.570763 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b0600-e8ab-4cd6-b253-2ea0b6a2a226 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:06.571301 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b0600-e8ab-4cd6-b253-2ea0b6a2a226 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:06.572157 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871b0600-e8ab-4cd6-b253-2ea0b6a2a226 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:06.574351 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871b0600-e8ab-4cd6-b253-2ea0b6a2a226 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:06.633735 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3144/6259] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:06:06 2022] POST /identity/v3/projects => generated 365 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:06.634971 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b0600-e8ab-4cd6-b253-2ea0b6a2a226 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:06.636693 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12edac25-868c-4119-acc4-0b02be3a5b5f admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:06.639603 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-871b0600-e8ab-4cd6-b253-2ea0b6a2a226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:06.808902 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:06.851624 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b0600-e8ab-4cd6-b253-2ea0b6a2a226 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:06.853931 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce015c7-c44a-4cd1-8bb8-2a4ada7dcfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:06.854892 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce015c7-c44a-4cd1-8bb8-2a4ada7dcfcf admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:06.855571 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce015c7-c44a-4cd1-8bb8-2a4ada7dcfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:06.856044 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce015c7-c44a-4cd1-8bb8-2a4ada7dcfcf admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:06.860842 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d60ba5e-906a-4424-bfc4-0ed4ef744d73 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '404a66b2850848e3b88d522af62487a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f384688989b440991f0e1d43d761213', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:06.861591 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d60ba5e-906a-4424-bfc4-0ed4ef744d73 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:06.861824 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d60ba5e-906a-4424-bfc4-0ed4ef744d73 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:06.862105 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d60ba5e-906a-4424-bfc4-0ed4ef744d73 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/be6850a0867d4386b62501cf90a84660` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:06.862715 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d60ba5e-906a-4424-bfc4-0ed4ef744d73 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=be6850a0867d4386b62501cf90a84660)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:06.863299 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce015c7-c44a-4cd1-8bb8-2a4ada7dcfcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:06:06.864457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d60ba5e-906a-4424-bfc4-0ed4ef744d73 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:06.864730 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6d60ba5e-906a-4424-bfc4-0ed4ef744d73 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Invalidating token cache because consumer be6850a0867d4386b62501cf90a84660 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:06.865168 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6d60ba5e-906a-4424-bfc4-0ed4ef744d73 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:06.865791 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce015c7-c44a-4cd1-8bb8-2a4ada7dcfcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:06.867788 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce015c7-c44a-4cd1-8bb8-2a4ada7dcfcf admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:06.875581 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6d60ba5e-906a-4424-bfc4-0ed4ef744d73 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:06.897997 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6d60ba5e-906a-4424-bfc4-0ed4ef744d73 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'be6850a0867d4386b62501cf90a84660', 'request_id': 'req-6d60ba5e-906a-4424-bfc4-0ed4ef744d73'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:06.899328 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3116/6260] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 492 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:06:06.901241 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd8120-9fe5-4afa-ae55-51c936c1c046 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:06.901935 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd8120-9fe5-4afa-ae55-51c936c1c046 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:06.902443 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd8120-9fe5-4afa-ae55-51c936c1c046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:06.922065 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3145/6261] 10.222.0.83 () {58 vars in 1266 bytes} [Mon Aug 29 16:06:06 2022] DELETE /identity/v3/OS-OAUTH1/consumers/be6850a0867d4386b62501cf90a84660 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:06.922917 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d60ba5e-906a-4424-bfc4-0ed4ef744d73 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:06.926065 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6d60ba5e-906a-4424-bfc4-0ed4ef744d73 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:06.955645 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d60ba5e-906a-4424-bfc4-0ed4ef744d73 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:06.970824 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbdd6a-6a06-4ac6-8cda-89589578ebff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:06.971551 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbdd6a-6a06-4ac6-8cda-89589578ebff admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:06.971811 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbdd6a-6a06-4ac6-8cda-89589578ebff admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:06.972070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbdd6a-6a06-4ac6-8cda-89589578ebff admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:06.972793 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bbdd6a-6a06-4ac6-8cda-89589578ebff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:06.975209 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bbdd6a-6a06-4ac6-8cda-89589578ebff admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:06.980741 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-08cd8120-9fe5-4afa-ae55-51c936c1c046 None None] MFA Rules not processed for user `0c483227eeae4e819f2f771830707edd`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:06.982981 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-08cd8120-9fe5-4afa-ae55-51c936c1c046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:07.027793 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3146/6262] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:06:06 2022] POST /identity/v3/users => generated 283 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:07.027793 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbdd6a-6a06-4ac6-8cda-89589578ebff admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:07.036258 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-51bbdd6a-6a06-4ac6-8cda-89589578ebff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:07.062405 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbdd6a-6a06-4ac6-8cda-89589578ebff admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:07.075249 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088fa78-c810-49b5-806c-c9528447921b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:07.075249 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088fa78-c810-49b5-806c-c9528447921b admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:07.075249 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088fa78-c810-49b5-806c-c9528447921b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:07.075683 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088fa78-c810-49b5-806c-c9528447921b admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:07.076647 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c088fa78-c810-49b5-806c-c9528447921b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:07.078708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c088fa78-c810-49b5-806c-c9528447921b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:07.112145 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3117/6263] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:07.115805 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd8120-9fe5-4afa-ae55-51c936c1c046 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:07.116090 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-08cd8120-9fe5-4afa-ae55-51c936c1c046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:07.140525 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:07.145438 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3147/6264] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:06:07 2022] POST /identity/v3/projects => generated 367 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:07.145438 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088fa78-c810-49b5-806c-c9528447921b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:07.150787 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd8120-9fe5-4afa-ae55-51c936c1c046 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:07.240006 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99082d53-d273-42ce-be1e-32c35430202a tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '404a66b2850848e3b88d522af62487a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f384688989b440991f0e1d43d761213', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:07.241337 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99082d53-d273-42ce-be1e-32c35430202a tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:07.241623 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99082d53-d273-42ce-be1e-32c35430202a tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:07.241893 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99082d53-d273-42ce-be1e-32c35430202a tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:07.242551 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99082d53-d273-42ce-be1e-32c35430202a tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:07.244280 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99082d53-d273-42ce-be1e-32c35430202a tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:07.280298 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3118/6265] 10.222.0.83 () {60 vars in 1185 bytes} [Mon Aug 29 16:06:07 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:07.281646 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99082d53-d273-42ce-be1e-32c35430202a tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:07.283847 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-99082d53-d273-42ce-be1e-32c35430202a tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:07.317306 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088fa78-c810-49b5-806c-c9528447921b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:07.331332 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb2a77-e97a-49d6-ac8b-f3624378b75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:07.331884 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb2a77-e97a-49d6-ac8b-f3624378b75a admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:07.332164 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb2a77-e97a-49d6-ac8b-f3624378b75a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:07.332438 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb2a77-e97a-49d6-ac8b-f3624378b75a admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:07.333095 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb2a77-e97a-49d6-ac8b-f3624378b75a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:07.335412 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb2a77-e97a-49d6-ac8b-f3624378b75a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:07.356418 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3148/6266] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:06:07.360281 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb2a77-e97a-49d6-ac8b-f3624378b75a admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:07.382969 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb2a77-e97a-49d6-ac8b-f3624378b75a admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:07.397553 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2b313-65a3-46b7-a5b1-c401aa90e1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:07.398200 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2b313-65a3-46b7-a5b1-c401aa90e1de admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:07.398499 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2b313-65a3-46b7-a5b1-c401aa90e1de admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:07.398758 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2b313-65a3-46b7-a5b1-c401aa90e1de admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:07.399522 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb2b313-65a3-46b7-a5b1-c401aa90e1de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:07.401477 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb2b313-65a3-46b7-a5b1-c401aa90e1de admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:07.425417 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99082d53-d273-42ce-be1e-32c35430202a tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:07.433829 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6477a6-29da-432b-a698-4252575235e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:07.434996 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6477a6-29da-432b-a698-4252575235e8 service cinder] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:07.435540 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6477a6-29da-432b-a698-4252575235e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:07.436120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6477a6-29da-432b-a698-4252575235e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:07.443685 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3149/6267] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:06:07 2022] POST /identity/v3/users => generated 284 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:07.444899 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2b313-65a3-46b7-a5b1-c401aa90e1de admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:07.471894 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2b313-65a3-46b7-a5b1-c401aa90e1de admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:07.483261 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f5091-43a1-4036-ad7f-074a45468eaa tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '404a66b2850848e3b88d522af62487a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f384688989b440991f0e1d43d761213', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:07.484139 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f5091-43a1-4036-ad7f-074a45468eaa tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:07.484572 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f5091-43a1-4036-ad7f-074a45468eaa tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:07.484995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f5091-43a1-4036-ad7f-074a45468eaa tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/f11daee0b4ac41abb739e53a9f305246` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:07.485812 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f5091-43a1-4036-ad7f-074a45468eaa tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=f11daee0b4ac41abb739e53a9f305246)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:07.495365 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-a69f5091-43a1-4036-ad7f-074a45468eaa tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:06:07.495365 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 16:06:07.495365 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 16:06:07.496707 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f5091-43a1-4036-ad7f-074a45468eaa tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:07.525625 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3150/6268] 10.222.0.83 () {60 vars in 1285 bytes} [Mon Aug 29 16:06:07 2022] PATCH /identity/v3/OS-OAUTH1/consumers/f11daee0b4ac41abb739e53a9f305246 => generated 220 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:06:07.526714 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f5091-43a1-4036-ad7f-074a45468eaa tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:07.545492 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6477a6-29da-432b-a698-4252575235e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:07.547073 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6477a6-29da-432b-a698-4252575235e8 service cinder] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:07.567287 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f5091-43a1-4036-ad7f-074a45468eaa tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:07.570995 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3119/6269] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:06:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:06:07.573164 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6477a6-29da-432b-a698-4252575235e8 service cinder] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:07.583370 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a157ee-dda3-4ab5-a8db-b5cf5dc16b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:07.584363 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a157ee-dda3-4ab5-a8db-b5cf5dc16b43 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:07.584363 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a157ee-dda3-4ab5-a8db-b5cf5dc16b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:07.584654 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a157ee-dda3-4ab5-a8db-b5cf5dc16b43 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:07.585089 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a157ee-dda3-4ab5-a8db-b5cf5dc16b43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:07.586709 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a157ee-dda3-4ab5-a8db-b5cf5dc16b43 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:07.607477 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6477a6-29da-432b-a698-4252575235e8 service cinder] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:07.617161 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650680d-0d7c-4680-beb0-55978c75ac2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:07.617389 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3151/6270] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:06:07.617875 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a157ee-dda3-4ab5-a8db-b5cf5dc16b43 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:07.618133 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650680d-0d7c-4680-beb0-55978c75ac2b admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:07.619237 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650680d-0d7c-4680-beb0-55978c75ac2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:07.619522 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650680d-0d7c-4680-beb0-55978c75ac2b admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:07.622508 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d650680d-0d7c-4680-beb0-55978c75ac2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:07.627242 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d650680d-0d7c-4680-beb0-55978c75ac2b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:07.644208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a157ee-dda3-4ab5-a8db-b5cf5dc16b43 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:07.657325 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3120/6271] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:06:07.659060 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650680d-0d7c-4680-beb0-55978c75ac2b admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:07.659183 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4008c-54a7-4c7f-94cd-f0cb8628c328 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '404a66b2850848e3b88d522af62487a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f384688989b440991f0e1d43d761213', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:07.659812 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4008c-54a7-4c7f-94cd-f0cb8628c328 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:07.660096 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4008c-54a7-4c7f-94cd-f0cb8628c328 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:07.660408 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4008c-54a7-4c7f-94cd-f0cb8628c328 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/f11daee0b4ac41abb739e53a9f305246` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:07.661001 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f4008c-54a7-4c7f-94cd-f0cb8628c328 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=f11daee0b4ac41abb739e53a9f305246)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:07.662741 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f4008c-54a7-4c7f-94cd-f0cb8628c328 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:07.678246 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3152/6272] 10.222.0.83 () {58 vars in 1263 bytes} [Mon Aug 29 16:06:07 2022] GET /identity/v3/OS-OAUTH1/consumers/f11daee0b4ac41abb739e53a9f305246 => generated 220 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:06:07.678246 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4008c-54a7-4c7f-94cd-f0cb8628c328 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:07.695445 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650680d-0d7c-4680-beb0-55978c75ac2b admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:07.704016 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4008c-54a7-4c7f-94cd-f0cb8628c328 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:07.715911 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb7942-3576-4aae-a3cd-73b64e7e2a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:07.717851 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb7942-3576-4aae-a3cd-73b64e7e2a3b admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:07.718260 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb7942-3576-4aae-a3cd-73b64e7e2a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:07.719832 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb7942-3576-4aae-a3cd-73b64e7e2a3b admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:07.720703 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb7942-3576-4aae-a3cd-73b64e7e2a3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:07.722496 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb7942-3576-4aae-a3cd-73b64e7e2a3b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:07.726687 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af1dd0-e7d4-4463-afba-2f5d05ed767b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:07.728494 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af1dd0-e7d4-4463-afba-2f5d05ed767b admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:07.730908 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af1dd0-e7d4-4463-afba-2f5d05ed767b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:07.731402 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af1dd0-e7d4-4463-afba-2f5d05ed767b admin admin] PATH_INFO: `/v3/projects/da968f7da1634ee592f09b114b92a746/users/92c5ce831e9e495bbafeb8850e81c7fe/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:07.736425 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3153/6273] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:06:07.737600 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb7942-3576-4aae-a3cd-73b64e7e2a3b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:07.764797 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb7942-3576-4aae-a3cd-73b64e7e2a3b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:07.773214 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2decac60-aedf-4d86-a9ff-36d0428ef549 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '404a66b2850848e3b88d522af62487a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f384688989b440991f0e1d43d761213', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:07.775305 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decac60-aedf-4d86-a9ff-36d0428ef549 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:07.775966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decac60-aedf-4d86-a9ff-36d0428ef549 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:07.776225 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decac60-aedf-4d86-a9ff-36d0428ef549 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/f11daee0b4ac41abb739e53a9f305246` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:07.776926 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2decac60-aedf-4d86-a9ff-36d0428ef549 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=f11daee0b4ac41abb739e53a9f305246)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:07.780158 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2decac60-aedf-4d86-a9ff-36d0428ef549 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:07.780619 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2decac60-aedf-4d86-a9ff-36d0428ef549 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Invalidating token cache because consumer f11daee0b4ac41abb739e53a9f305246 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:07.781085 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2decac60-aedf-4d86-a9ff-36d0428ef549 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:07.781936 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2decac60-aedf-4d86-a9ff-36d0428ef549 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:07.784810 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af1dd0-e7d4-4463-afba-2f5d05ed767b admin admin] RBAC: Authorizing `identity:create_grant(project_id=da968f7da1634ee592f09b114b92a746, user_id=92c5ce831e9e495bbafeb8850e81c7fe, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:07.793588 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af1dd0-e7d4-4463-afba-2f5d05ed767b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:07.803283 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2decac60-aedf-4d86-a9ff-36d0428ef549 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'f11daee0b4ac41abb739e53a9f305246', 'request_id': 'req-2decac60-aedf-4d86-a9ff-36d0428ef549'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:07.807268 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=87,keystone:DELETE=3,keystone:INSERT=9,keystone:UPDATE=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:07.815878 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:07.831658 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3154/6274] 10.222.0.83 () {58 vars in 1266 bytes} [Mon Aug 29 16:06:07 2022] DELETE /identity/v3/OS-OAUTH1/consumers/f11daee0b4ac41abb739e53a9f305246 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:07.832125 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2decac60-aedf-4d86-a9ff-36d0428ef549 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:07.836808 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2decac60-aedf-4d86-a9ff-36d0428ef549 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:07.841456 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3121/6275] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:06:07 2022] PUT /identity/v3/projects/da968f7da1634ee592f09b114b92a746/users/92c5ce831e9e495bbafeb8850e81c7fe/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:07.842873 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af1dd0-e7d4-4463-afba-2f5d05ed767b admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:07.845834 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d1af1dd0-e7d4-4463-afba-2f5d05ed767b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:07.867896 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2decac60-aedf-4d86-a9ff-36d0428ef549 tempest-OAUTHConsumersV3Test-1029849045 tempest-OAUTHConsumersV3Test-1029849045-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:08.038465 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af1dd0-e7d4-4463-afba-2f5d05ed767b admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:08.043980 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f57f4-82b7-4584-aa71-cefea6ff319b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:08.045833 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f57f4-82b7-4584-aa71-cefea6ff319b admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:08.046241 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f57f4-82b7-4584-aa71-cefea6ff319b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:08.047186 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f57f4-82b7-4584-aa71-cefea6ff319b admin admin] PATH_INFO: `/v3/projects/59fcefbcc807472498925f385bbb3de0/users/a5f6c2fb033a4f718a36a2bc6fcb87bc/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:08.054358 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b2723-01c8-4b14-acfd-e72c5802b858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:08.055890 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b2723-01c8-4b14-acfd-e72c5802b858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:08.056177 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b2723-01c8-4b14-acfd-e72c5802b858 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:08.056454 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b2723-01c8-4b14-acfd-e72c5802b858 admin admin] PATH_INFO: `/v3/users/aba7331083b54bd3a0121ea222e476cb` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:08.062906 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b2723-01c8-4b14-acfd-e72c5802b858 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aba7331083b54bd3a0121ea222e476cb)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:08.068791 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b2723-01c8-4b14-acfd-e72c5802b858 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:08.087537 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2f57f4-82b7-4584-aa71-cefea6ff319b admin admin] RBAC: Authorizing `identity:create_grant(project_id=59fcefbcc807472498925f385bbb3de0, user_id=a5f6c2fb033a4f718a36a2bc6fcb87bc, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:08.090824 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2f57f4-82b7-4584-aa71-cefea6ff319b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:08.162025 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3155/6276] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:06:07 2022] PUT /identity/v3/projects/59fcefbcc807472498925f385bbb3de0/users/a5f6c2fb033a4f718a36a2bc6fcb87bc/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:08.163152 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1eadd-a068-4abe-99f4-684d69cc98ea None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:08.163450 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1eadd-a068-4abe-99f4-684d69cc98ea None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:08.163708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1eadd-a068-4abe-99f4-684d69cc98ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:08.202064 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c15b2723-01c8-4b14-acfd-e72c5802b858 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aba7331083b54bd3a0121ea222e476cb'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:08.202794 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c15b2723-01c8-4b14-acfd-e72c5802b858 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aba7331083b54bd3a0121ea222e476cb'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:08.234004 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c15b2723-01c8-4b14-acfd-e72c5802b858 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aba7331083b54bd3a0121ea222e476cb'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:08.257631 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c15b2723-01c8-4b14-acfd-e72c5802b858 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aba7331083b54bd3a0121ea222e476cb'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:08.268204 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c15b2723-01c8-4b14-acfd-e72c5802b858 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aba7331083b54bd3a0121ea222e476cb'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:08.273757 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a0e1eadd-a068-4abe-99f4-684d69cc98ea None None] MFA Rules not processed for user `92c5ce831e9e495bbafeb8850e81c7fe`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:08.275178 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a0e1eadd-a068-4abe-99f4-684d69cc98ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:08.283980 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3122/6277] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:06:07 2022] DELETE /identity/v3/users/aba7331083b54bd3a0121ea222e476cb => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:08.285493 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418a793-2749-43cb-b961-4e178c0c82f6 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:08.286290 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418a793-2749-43cb-b961-4e178c0c82f6 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:08.286578 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418a793-2749-43cb-b961-4e178c0c82f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:08.322062 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-9418a793-2749-43cb-b961-4e178c0c82f6 None None] MFA Rules not processed for user `a5f6c2fb033a4f718a36a2bc6fcb87bc`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:08.323350 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9418a793-2749-43cb-b961-4e178c0c82f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:08.467887 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3123/6278] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:08.469326 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc3463-ae94-402a-b528-d511ea48f5f3 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:08.469634 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc3463-ae94-402a-b528-d511ea48f5f3 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:08.469916 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc3463-ae94-402a-b528-d511ea48f5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:08.506130 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:08.518497 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3156/6279] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:08.519419 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1eadd-a068-4abe-99f4-684d69cc98ea None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:08.520983 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-1abc3463-ae94-402a-b528-d511ea48f5f3 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:08.522419 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1abc3463-ae94-402a-b528-d511ea48f5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:08.523866 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a0e1eadd-a068-4abe-99f4-684d69cc98ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:08.774620 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3124/6280] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:08.778839 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc3463-ae94-402a-b528-d511ea48f5f3 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:08.778839 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1abc3463-ae94-402a-b528-d511ea48f5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:08.797343 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1eadd-a068-4abe-99f4-684d69cc98ea None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:08.817306 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5e795-1f9e-4d75-b617-67c930f0a1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:08.818082 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5e795-1f9e-4d75-b617-67c930f0a1f8 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:08.818558 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5e795-1f9e-4d75-b617-67c930f0a1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:08.820163 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5e795-1f9e-4d75-b617-67c930f0a1f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:08.821051 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f5e795-1f9e-4d75-b617-67c930f0a1f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:08.825625 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f5e795-1f9e-4d75-b617-67c930f0a1f8 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:08.831829 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc3463-ae94-402a-b528-d511ea48f5f3 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:08.848761 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353aa64f-a247-4588-9b90-7c9a84d61b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:08.849703 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353aa64f-a247-4588-9b90-7c9a84d61b47 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:08.850758 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353aa64f-a247-4588-9b90-7c9a84d61b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:08.851275 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353aa64f-a247-4588-9b90-7c9a84d61b47 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:08.852497 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353aa64f-a247-4588-9b90-7c9a84d61b47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:08.856133 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:08.856499 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353aa64f-a247-4588-9b90-7c9a84d61b47 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:08.906091 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3157/6281] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:06:08 2022] POST /identity/v3/projects => generated 365 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:08.906730 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5e795-1f9e-4d75-b617-67c930f0a1f8 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:08.921381 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c1f5e795-1f9e-4d75-b617-67c930f0a1f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:08.949625 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3125/6282] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:06:08 2022] POST /identity/v3/projects => generated 363 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:08.950719 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353aa64f-a247-4588-9b90-7c9a84d61b47 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:09.109651 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5e795-1f9e-4d75-b617-67c930f0a1f8 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:09.171176 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353aa64f-a247-4588-9b90-7c9a84d61b47 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:09.182370 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600b93e-b60d-4d58-ad4b-8a863584e3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:09.183014 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600b93e-b60d-4d58-ad4b-8a863584e3e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:09.183313 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600b93e-b60d-4d58-ad4b-8a863584e3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:09.183734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600b93e-b60d-4d58-ad4b-8a863584e3e7 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:09.184803 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b600b93e-b60d-4d58-ad4b-8a863584e3e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:09.188060 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b600b93e-b60d-4d58-ad4b-8a863584e3e7 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:09.236656 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0273b28-ed25-4e7e-bc80-955e8c34e273 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:09.237489 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0273b28-ed25-4e7e-bc80-955e8c34e273 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:09.237757 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0273b28-ed25-4e7e-bc80-955e8c34e273 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:09.238174 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0273b28-ed25-4e7e-bc80-955e8c34e273 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:09.265749 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3126/6283] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:06:08 2022] POST /identity/v3/users => generated 289 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:09.266414 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600b93e-b60d-4d58-ad4b-8a863584e3e7 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:09.279787 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0273b28-ed25-4e7e-bc80-955e8c34e273 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:09.289516 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0273b28-ed25-4e7e-bc80-955e8c34e273 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:09.308886 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600b93e-b60d-4d58-ad4b-8a863584e3e7 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:09.325706 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3158/6284] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:06:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:06:09.328364 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0273b28-ed25-4e7e-bc80-955e8c34e273 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:09.329416 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27609ee-3e02-41de-a7ab-eddbfe0331d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:09.330039 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27609ee-3e02-41de-a7ab-eddbfe0331d6 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:09.330316 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27609ee-3e02-41de-a7ab-eddbfe0331d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:09.330581 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27609ee-3e02-41de-a7ab-eddbfe0331d6 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:09.331237 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27609ee-3e02-41de-a7ab-eddbfe0331d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:09.343868 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27609ee-3e02-41de-a7ab-eddbfe0331d6 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:09.371502 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0273b28-ed25-4e7e-bc80-955e8c34e273 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:09.390329 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357096bd-1673-44cb-89c7-b5644cb649d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:09.390966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357096bd-1673-44cb-89c7-b5644cb649d3 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:09.391350 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357096bd-1673-44cb-89c7-b5644cb649d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:09.391523 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357096bd-1673-44cb-89c7-b5644cb649d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:09.392213 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357096bd-1673-44cb-89c7-b5644cb649d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:09.393779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357096bd-1673-44cb-89c7-b5644cb649d3 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:09.423754 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3159/6285] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:06:09.429154 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357096bd-1673-44cb-89c7-b5644cb649d3 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:09.430153 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3127/6286] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:06:09 2022] POST /identity/v3/users => generated 288 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:09.431380 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27609ee-3e02-41de-a7ab-eddbfe0331d6 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:09.450111 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357096bd-1673-44cb-89c7-b5644cb649d3 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:09.467698 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8f859-596e-4b34-8608-88a651d6d84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:09.468394 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8f859-596e-4b34-8608-88a651d6d84f admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:09.468671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8f859-596e-4b34-8608-88a651d6d84f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:09.468937 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8f859-596e-4b34-8608-88a651d6d84f admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:09.469736 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8f859-596e-4b34-8608-88a651d6d84f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:09.473534 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8f859-596e-4b34-8608-88a651d6d84f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:09.488134 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27609ee-3e02-41de-a7ab-eddbfe0331d6 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:09.497912 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3160/6287] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:06:09.499282 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8f859-596e-4b34-8608-88a651d6d84f admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:09.504828 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234223a8-cead-4eda-96f9-c4f0c3b9ba79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:09.505966 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234223a8-cead-4eda-96f9-c4f0c3b9ba79 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:09.508785 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234223a8-cead-4eda-96f9-c4f0c3b9ba79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:09.510990 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234223a8-cead-4eda-96f9-c4f0c3b9ba79 admin admin] PATH_INFO: `/v3/projects/f5f4d68286a0452595d1960baf97266a/users/5e588f0a86b747b789c18379d00163aa/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:09.540006 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8f859-596e-4b34-8608-88a651d6d84f admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:09.555412 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a255405-2eb4-4d8d-8820-bedf03a04b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:09.556556 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a255405-2eb4-4d8d-8820-bedf03a04b52 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:09.556779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a255405-2eb4-4d8d-8820-bedf03a04b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:09.557056 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a255405-2eb4-4d8d-8820-bedf03a04b52 admin admin] PATH_INFO: `/v3/projects/b181cfb46de043d1a9d0a8d64c1b4d1d/users/99bed36e7b924095a9e4a08b7a8e9536/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:09.592781 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234223a8-cead-4eda-96f9-c4f0c3b9ba79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5f4d68286a0452595d1960baf97266a, user_id=5e588f0a86b747b789c18379d00163aa, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:09.597879 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a255405-2eb4-4d8d-8820-bedf03a04b52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b181cfb46de043d1a9d0a8d64c1b4d1d, user_id=99bed36e7b924095a9e4a08b7a8e9536, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:09.600823 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a255405-2eb4-4d8d-8820-bedf03a04b52 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:09.613761 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234223a8-cead-4eda-96f9-c4f0c3b9ba79 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:09.625252 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3161/6288] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:06:09 2022] PUT /identity/v3/projects/b181cfb46de043d1a9d0a8d64c1b4d1d/users/99bed36e7b924095a9e4a08b7a8e9536/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:09.629024 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a255405-2eb4-4d8d-8820-bedf03a04b52 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:09.643464 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3128/6289] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:06:09 2022] PUT /identity/v3/projects/f5f4d68286a0452595d1960baf97266a/users/5e588f0a86b747b789c18379d00163aa/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:09.644772 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234223a8-cead-4eda-96f9-c4f0c3b9ba79 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:09.738920 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:09.827782 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a255405-2eb4-4d8d-8820-bedf03a04b52 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:09.838472 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234223a8-cead-4eda-96f9-c4f0c3b9ba79 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:09.850059 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d2e9a-9bf8-4e72-bdeb-cb43145a74ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:09.851117 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d2e9a-9bf8-4e72-bdeb-cb43145a74ba admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:09.851755 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d2e9a-9bf8-4e72-bdeb-cb43145a74ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:09.852267 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d2e9a-9bf8-4e72-bdeb-cb43145a74ba admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:09.853124 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d2e9a-9bf8-4e72-bdeb-cb43145a74ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:09.855888 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d2e9a-9bf8-4e72-bdeb-cb43145a74ba admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:09.856781 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e7e3d-739a-4e11-a3d8-bf3bf56d110c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:09.857635 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e7e3d-739a-4e11-a3d8-bf3bf56d110c admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:09.858086 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e7e3d-739a-4e11-a3d8-bf3bf56d110c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:09.858368 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e7e3d-739a-4e11-a3d8-bf3bf56d110c admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:09.859049 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e7e3d-739a-4e11-a3d8-bf3bf56d110c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:09.864113 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e7e3d-739a-4e11-a3d8-bf3bf56d110c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:09.870907 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:09.889512 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3162/6290] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:06:09.896182 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3129/6291] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:06:09.899412 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e7e3d-739a-4e11-a3d8-bf3bf56d110c admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:09.900336 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d2e9a-9bf8-4e72-bdeb-cb43145a74ba admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:09.919050 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d2e9a-9bf8-4e72-bdeb-cb43145a74ba admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:09.922649 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e7e3d-739a-4e11-a3d8-bf3bf56d110c admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:09.927182 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f32821-bbe9-4a83-a856-a2d9da2bfb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:09.928204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f32821-bbe9-4a83-a856-a2d9da2bfb2e admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:09.928783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f32821-bbe9-4a83-a856-a2d9da2bfb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:09.929825 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f32821-bbe9-4a83-a856-a2d9da2bfb2e admin admin] PATH_INFO: `/v3/projects/b181cfb46de043d1a9d0a8d64c1b4d1d/users/99bed36e7b924095a9e4a08b7a8e9536/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:09.935100 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f32821-bbe9-4a83-a856-a2d9da2bfb2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b181cfb46de043d1a9d0a8d64c1b4d1d, user_id=99bed36e7b924095a9e4a08b7a8e9536, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:09.936638 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fddab7-25e6-4058-90e6-7aa765e7c22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:09.938825 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fddab7-25e6-4058-90e6-7aa765e7c22b admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:09.941581 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f32821-bbe9-4a83-a856-a2d9da2bfb2e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:09.942135 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fddab7-25e6-4058-90e6-7aa765e7c22b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:09.942645 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fddab7-25e6-4058-90e6-7aa765e7c22b admin admin] PATH_INFO: `/v3/projects/f5f4d68286a0452595d1960baf97266a/users/5e588f0a86b747b789c18379d00163aa/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:09.950477 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fddab7-25e6-4058-90e6-7aa765e7c22b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5f4d68286a0452595d1960baf97266a, user_id=5e588f0a86b747b789c18379d00163aa, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:09.958273 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fddab7-25e6-4058-90e6-7aa765e7c22b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:09.982976 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3163/6293] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:06:09 2022] PUT /identity/v3/projects/b181cfb46de043d1a9d0a8d64c1b4d1d/users/99bed36e7b924095a9e4a08b7a8e9536/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:09.983612 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3130/6293] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:06:09 2022] PUT /identity/v3/projects/f5f4d68286a0452595d1960baf97266a/users/5e588f0a86b747b789c18379d00163aa/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:06:09.985967 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8b54a-b029-4cc7-a887-3690a3f76052 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:09.986110 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee175323-7b51-400a-8d2b-9e8f5ec7af89 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:09.986303 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee175323-7b51-400a-8d2b-9e8f5ec7af89 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:09.986427 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8b54a-b029-4cc7-a887-3690a3f76052 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:09.986508 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8b54a-b029-4cc7-a887-3690a3f76052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:09.986581 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee175323-7b51-400a-8d2b-9e8f5ec7af89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:10.024766 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-6fa8b54a-b029-4cc7-a887-3690a3f76052 None None] MFA Rules not processed for user `99bed36e7b924095a9e4a08b7a8e9536`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:10.026295 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6fa8b54a-b029-4cc7-a887-3690a3f76052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:10.147530 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3131/6294] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:09 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:10.148075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-ee175323-7b51-400a-8d2b-9e8f5ec7af89 None None] MFA Rules not processed for user `5e588f0a86b747b789c18379d00163aa`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:10.149709 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8b54a-b029-4cc7-a887-3690a3f76052 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:10.159642 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6fa8b54a-b029-4cc7-a887-3690a3f76052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:10.160623 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ee175323-7b51-400a-8d2b-9e8f5ec7af89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:10.365386 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8b54a-b029-4cc7-a887-3690a3f76052 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:10.385189 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74395be8-17b3-474d-915f-4f8ca5c3d546 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:10.386204 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74395be8-17b3-474d-915f-4f8ca5c3d546 service cinder] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:10.386690 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74395be8-17b3-474d-915f-4f8ca5c3d546 service cinder] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:10.387246 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74395be8-17b3-474d-915f-4f8ca5c3d546 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:10.427565 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74395be8-17b3-474d-915f-4f8ca5c3d546 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:10.429078 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74395be8-17b3-474d-915f-4f8ca5c3d546 service cinder] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:10.475556 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3132/6295] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:06:10 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:06:10.543008 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3164/6296] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:09 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 555 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:10.545688 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74395be8-17b3-474d-915f-4f8ca5c3d546 service cinder] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:10.568546 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74395be8-17b3-474d-915f-4f8ca5c3d546 service cinder] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:10.601700 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee175323-7b51-400a-8d2b-9e8f5ec7af89 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:10.602004 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a64bff-624b-4bcf-aaad-fc51c38f91e0 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:10.602807 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a64bff-624b-4bcf-aaad-fc51c38f91e0 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:10.603014 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ee175323-7b51-400a-8d2b-9e8f5ec7af89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:10.603144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a64bff-624b-4bcf-aaad-fc51c38f91e0 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:10.603383 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a64bff-624b-4bcf-aaad-fc51c38f91e0 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:10.604065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a64bff-624b-4bcf-aaad-fc51c38f91e0 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:10.605669 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a64bff-624b-4bcf-aaad-fc51c38f91e0 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:10.691829 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3133/6297] 10.222.0.83 () {60 vars in 1143 bytes} [Mon Aug 29 16:06:10 2022] POST /identity/v3/roles => generated 235 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:10.698438 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a64bff-624b-4bcf-aaad-fc51c38f91e0 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:10.700505 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-37a64bff-624b-4bcf-aaad-fc51c38f91e0 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:10.718099 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a64bff-624b-4bcf-aaad-fc51c38f91e0 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:10.723891 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa059b5-23ab-45ae-b31b-459b9610822c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:10.724574 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa059b5-23ab-45ae-b31b-459b9610822c service cinder] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:10.724908 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa059b5-23ab-45ae-b31b-459b9610822c service cinder] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:10.725186 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa059b5-23ab-45ae-b31b-459b9610822c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:10.773803 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:10.786178 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee175323-7b51-400a-8d2b-9e8f5ec7af89 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:10.797054 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c275e22-e7a5-4037-a493-e04df0f9e16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:10.798174 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c275e22-e7a5-4037-a493-e04df0f9e16d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:10.798611 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c275e22-e7a5-4037-a493-e04df0f9e16d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:10.799047 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c275e22-e7a5-4037-a493-e04df0f9e16d admin admin] PATH_INFO: `/v3/projects/336b5607e3c5483b9aff68d52e86e6db` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:10.800368 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c275e22-e7a5-4037-a493-e04df0f9e16d admin admin] RBAC: Authorizing `identity:delete_project(project_id=336b5607e3c5483b9aff68d52e86e6db)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:10.803645 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c275e22-e7a5-4037-a493-e04df0f9e16d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:10.836376 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa059b5-23ab-45ae-b31b-459b9610822c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:10.838748 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa059b5-23ab-45ae-b31b-459b9610822c service cinder] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:10.850929 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3134/6298] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:06:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:06:10.855247 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa059b5-23ab-45ae-b31b-459b9610822c service cinder] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:10.869310 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa059b5-23ab-45ae-b31b-459b9610822c service cinder] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:10.879797 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d61c31-97e5-4b5a-ac1d-9f0f8807c9a2 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:10.880589 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d61c31-97e5-4b5a-ac1d-9f0f8807c9a2 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:10.880958 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d61c31-97e5-4b5a-ac1d-9f0f8807c9a2 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:10.881312 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d61c31-97e5-4b5a-ac1d-9f0f8807c9a2 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:10.882602 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d61c31-97e5-4b5a-ac1d-9f0f8807c9a2 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:10.884052 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d61c31-97e5-4b5a-ac1d-9f0f8807c9a2 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:10.922141 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6c275e22-e7a5-4037-a493-e04df0f9e16d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '336b5607e3c5483b9aff68d52e86e6db', 'request_id': 'req-6c275e22-e7a5-4037-a493-e04df0f9e16d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:10.931356 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6c275e22-e7a5-4037-a493-e04df0f9e16d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '336b5607e3c5483b9aff68d52e86e6db', 'request_id': 'req-6c275e22-e7a5-4037-a493-e04df0f9e16d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:10.939287 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3135/6299] 10.222.0.83 () {60 vars in 1143 bytes} [Mon Aug 29 16:06:10 2022] POST /identity/v3/roles => generated 235 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:10.942581 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d61c31-97e5-4b5a-ac1d-9f0f8807c9a2 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:10.948408 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6c275e22-e7a5-4037-a493-e04df0f9e16d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '336b5607e3c5483b9aff68d52e86e6db', 'request_id': 'req-6c275e22-e7a5-4037-a493-e04df0f9e16d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:10.989099 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d61c31-97e5-4b5a-ac1d-9f0f8807c9a2 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:11.004303 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6c275e22-e7a5-4037-a493-e04df0f9e16d admin admin] The token cache is being invalidate because project 336b5607e3c5483b9aff68d52e86e6db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:11.004852 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6c275e22-e7a5-4037-a493-e04df0f9e16d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:11.012752 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6c275e22-e7a5-4037-a493-e04df0f9e16d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:11.017547 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3165/6300] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:06:10 2022] DELETE /identity/v3/projects/336b5607e3c5483b9aff68d52e86e6db => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:06:11.025365 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c275e22-e7a5-4037-a493-e04df0f9e16d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:11.028719 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6c275e22-e7a5-4037-a493-e04df0f9e16d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:11.053792 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:11.190926 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6027cb-ab07-4a0c-85ea-76bff51f5aa0 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:11.191643 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6027cb-ab07-4a0c-85ea-76bff51f5aa0 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:11.191933 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6027cb-ab07-4a0c-85ea-76bff51f5aa0 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:11.192212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6027cb-ab07-4a0c-85ea-76bff51f5aa0 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:11.199524 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6027cb-ab07-4a0c-85ea-76bff51f5aa0 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:11.210246 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6027cb-ab07-4a0c-85ea-76bff51f5aa0 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:11.262119 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3136/6301] 10.222.0.83 () {60 vars in 1143 bytes} [Mon Aug 29 16:06:10 2022] POST /identity/v3/roles => generated 235 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:11.267603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6027cb-ab07-4a0c-85ea-76bff51f5aa0 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:11.274039 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-fd6027cb-ab07-4a0c-85ea-76bff51f5aa0 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:11.283900 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c275e22-e7a5-4037-a493-e04df0f9e16d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:11.296862 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72e3b9-6b2f-4ab6-a0eb-4963425002c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:11.298334 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72e3b9-6b2f-4ab6-a0eb-4963425002c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:11.298877 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72e3b9-6b2f-4ab6-a0eb-4963425002c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:11.299490 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72e3b9-6b2f-4ab6-a0eb-4963425002c9 admin admin] PATH_INFO: `/v3/users/404a66b2850848e3b88d522af62487a0` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:11.300854 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72e3b9-6b2f-4ab6-a0eb-4963425002c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=404a66b2850848e3b88d522af62487a0)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:11.303738 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72e3b9-6b2f-4ab6-a0eb-4963425002c9 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:11.308813 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6027cb-ab07-4a0c-85ea-76bff51f5aa0 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:11.317982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb00890-ba5c-4960-ae36-7e258ce7690b tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:11.319444 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb00890-ba5c-4960-ae36-7e258ce7690b tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:11.319734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb00890-ba5c-4960-ae36-7e258ce7690b tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:11.320016 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb00890-ba5c-4960-ae36-7e258ce7690b tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:11.320753 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb00890-ba5c-4960-ae36-7e258ce7690b tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:11.322675 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb00890-ba5c-4960-ae36-7e258ce7690b tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:11.353912 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3137/6302] 10.222.0.83 () {60 vars in 1149 bytes} [Mon Aug 29 16:06:11 2022] POST /identity/v3/domains => generated 277 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:11.354897 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb00890-ba5c-4960-ae36-7e258ce7690b tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:11.438291 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3b72e3b9-6b2f-4ab6-a0eb-4963425002c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '404a66b2850848e3b88d522af62487a0'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:11.439182 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3b72e3b9-6b2f-4ab6-a0eb-4963425002c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '404a66b2850848e3b88d522af62487a0'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:11.451199 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb00890-ba5c-4960-ae36-7e258ce7690b tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:11.457214 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3b72e3b9-6b2f-4ab6-a0eb-4963425002c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '404a66b2850848e3b88d522af62487a0'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:11.463055 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8d510-041d-4446-b088-b552378dea2f tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:11.463894 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8d510-041d-4446-b088-b552378dea2f tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:11.464190 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8d510-041d-4446-b088-b552378dea2f tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:11.464473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8d510-041d-4446-b088-b552378dea2f tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:11.467318 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c8d510-041d-4446-b088-b552378dea2f tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:11.468111 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3b72e3b9-6b2f-4ab6-a0eb-4963425002c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '404a66b2850848e3b88d522af62487a0'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:11.470928 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c8d510-041d-4446-b088-b552378dea2f tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:11.477610 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3b72e3b9-6b2f-4ab6-a0eb-4963425002c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '404a66b2850848e3b88d522af62487a0'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:11.532374 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3166/6303] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:06:11 2022] DELETE /identity/v3/users/404a66b2850848e3b88d522af62487a0 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:11.583992 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3138/6304] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:06:11 2022] POST /identity/v3/projects => generated 400 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:11.584767 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72e3b9-6b2f-4ab6-a0eb-4963425002c9 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:11.587231 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3b72e3b9-6b2f-4ab6-a0eb-4963425002c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:11.817692 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72e3b9-6b2f-4ab6-a0eb-4963425002c9 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:11.912227 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:11.994964 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643583e0-74b5-454d-886f-3cd29511f9ae tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:11.995665 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643583e0-74b5-454d-886f-3cd29511f9ae tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:11.995946 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643583e0-74b5-454d-886f-3cd29511f9ae tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:11.998420 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643583e0-74b5-454d-886f-3cd29511f9ae tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/groups` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:11.999165 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643583e0-74b5-454d-886f-3cd29511f9ae tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:12.004316 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643583e0-74b5-454d-886f-3cd29511f9ae tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:12.050213 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3167/6305] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:06:11 2022] POST /identity/v3/groups => generated 300 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:06:12.053450 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8d510-041d-4446-b088-b552378dea2f tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:12.069230 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8d510-041d-4446-b088-b552378dea2f tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:12.094037 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5bbbc5-a611-4afa-9343-878582fa07bd tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:12.096134 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5bbbc5-a611-4afa-9343-878582fa07bd tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:12.097223 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5bbbc5-a611-4afa-9343-878582fa07bd tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:12.098083 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5bbbc5-a611-4afa-9343-878582fa07bd tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:12.099816 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5bbbc5-a611-4afa-9343-878582fa07bd tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:12.105746 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5bbbc5-a611-4afa-9343-878582fa07bd tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:12.133676 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:12.161023 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3139/6306] 10.222.0.83 () {60 vars in 1143 bytes} [Mon Aug 29 16:06:12 2022] POST /identity/v3/roles => generated 235 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:12.162567 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643583e0-74b5-454d-886f-3cd29511f9ae tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:12.190665 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643583e0-74b5-454d-886f-3cd29511f9ae tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:12.219671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43e873-580a-4281-a350-60fe2e2eea3c tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:12.220030 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43e873-580a-4281-a350-60fe2e2eea3c tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:12.227519 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43e873-580a-4281-a350-60fe2e2eea3c tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:12.228049 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43e873-580a-4281-a350-60fe2e2eea3c tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:12.234751 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f43e873-580a-4281-a350-60fe2e2eea3c tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:12.236415 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f43e873-580a-4281-a350-60fe2e2eea3c tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:12.401234 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5bbbc5-a611-4afa-9343-878582fa07bd tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:12.412731 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3168/6307] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:06:12 2022] POST /identity/v3/users => generated 439 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:12.449776 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5bbbc5-a611-4afa-9343-878582fa07bd tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:12.488690 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f7886-3462-466b-a34b-77ee25dfcadd tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:12.489675 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f7886-3462-466b-a34b-77ee25dfcadd tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:12.495341 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f7886-3462-466b-a34b-77ee25dfcadd tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:12.500306 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f7886-3462-466b-a34b-77ee25dfcadd tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:12.502103 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820f7886-3462-466b-a34b-77ee25dfcadd tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:12.504055 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-820f7886-3462-466b-a34b-77ee25dfcadd tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:06:12.504055 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 16:06:12.504055 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 16:06:12.505760 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820f7886-3462-466b-a34b-77ee25dfcadd tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:12.638987 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3140/6308] 10.222.0.83 () {60 vars in 1143 bytes} [Mon Aug 29 16:06:12 2022] POST /identity/v3/roles => generated 269 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:12.670518 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43e873-580a-4281-a350-60fe2e2eea3c tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:12.704757 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43e873-580a-4281-a350-60fe2e2eea3c tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:12.729856 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cddeefe-3938-4852-bd8a-f5f0e8ccb8fe tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:12.732867 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddeefe-3938-4852-bd8a-f5f0e8ccb8fe tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:12.734442 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddeefe-3938-4852-bd8a-f5f0e8ccb8fe tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:12.735481 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddeefe-3938-4852-bd8a-f5f0e8ccb8fe tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/projects/d164ab66e40644b7a5697cfd91a60a55/users/13cfa31b78294012a47ff6ba087da1f8/roles/1c97dbbf61fb45fda84034f3a3400dc1` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:12.825135 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f7886-3462-466b-a34b-77ee25dfcadd tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:12.827894 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-820f7886-3462-466b-a34b-77ee25dfcadd tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:12.852364 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cddeefe-3938-4852-bd8a-f5f0e8ccb8fe tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d164ab66e40644b7a5697cfd91a60a55, user_id=13cfa31b78294012a47ff6ba087da1f8, role_id=1c97dbbf61fb45fda84034f3a3400dc1)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:12.879406 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cddeefe-3938-4852-bd8a-f5f0e8ccb8fe tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:12.928835 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3169/6309] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:06:12 2022] PUT /identity/v3/projects/d164ab66e40644b7a5697cfd91a60a55/users/13cfa31b78294012a47ff6ba087da1f8/roles/1c97dbbf61fb45fda84034f3a3400dc1 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:12.939852 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cddeefe-3938-4852-bd8a-f5f0e8ccb8fe tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:13.023997 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f7886-3462-466b-a34b-77ee25dfcadd tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:13.185108 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cddeefe-3938-4852-bd8a-f5f0e8ccb8fe tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:13.211181 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40c67d-bc8e-4212-b7ee-65bcc2d2e95b tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:13.212147 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40c67d-bc8e-4212-b7ee-65bcc2d2e95b tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:13.212583 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40c67d-bc8e-4212-b7ee-65bcc2d2e95b tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:13.213838 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40c67d-bc8e-4212-b7ee-65bcc2d2e95b tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:13.216264 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb40c67d-bc8e-4212-b7ee-65bcc2d2e95b tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Adding query filter params (scope.project.id=d164ab66e40644b7a5697cfd91a60a55, user.id=13cfa31b78294012a47ff6ba087da1f8) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:06:13.220452 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb40c67d-bc8e-4212-b7ee-65bcc2d2e95b tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:13.226166 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-eb40c67d-bc8e-4212-b7ee-65bcc2d2e95b tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:06:13.226166 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 16:06:13.226166 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 16:06:13.230394 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb40c67d-bc8e-4212-b7ee-65bcc2d2e95b tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:13.361993 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3170/6310] 10.222.0.83 () {58 vars in 1356 bytes} [Mon Aug 29 16:06:12 2022] GET /identity/v3/role_assignments?scope.project.id=d164ab66e40644b7a5697cfd91a60a55&user.id=13cfa31b78294012a47ff6ba087da1f8&effective => generated 228 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:06:13.366231 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40c67d-bc8e-4212-b7ee-65bcc2d2e95b tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:13.393321 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40c67d-bc8e-4212-b7ee-65bcc2d2e95b tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:13.409392 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb5649-f56d-4244-8f90-56e35f107653 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:13.410841 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb5649-f56d-4244-8f90-56e35f107653 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:13.411525 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb5649-f56d-4244-8f90-56e35f107653 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:13.412031 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb5649-f56d-4244-8f90-56e35f107653 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/projects/d164ab66e40644b7a5697cfd91a60a55/users/13cfa31b78294012a47ff6ba087da1f8/roles/1c97dbbf61fb45fda84034f3a3400dc1` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:13.419524 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fb5649-f56d-4244-8f90-56e35f107653 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=d164ab66e40644b7a5697cfd91a60a55, user_id=13cfa31b78294012a47ff6ba087da1f8, role_id=1c97dbbf61fb45fda84034f3a3400dc1)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:13.435005 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fb5649-f56d-4244-8f90-56e35f107653 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:13.475105 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-92fb5649-f56d-4244-8f90-56e35f107653 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invalidating the token cache because role 1c97dbbf61fb45fda84034f3a3400dc1 was removed from user 13cfa31b78294012a47ff6ba087da1f8 on project d164ab66e40644b7a5697cfd91a60a55. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:13.475418 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-92fb5649-f56d-4244-8f90-56e35f107653 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:13.478184 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-92fb5649-f56d-4244-8f90-56e35f107653 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:13.493889 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc3b39-727c-4400-9fc4-56102712875f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:13.494787 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc3b39-727c-4400-9fc4-56102712875f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:13.495100 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc3b39-727c-4400-9fc4-56102712875f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:13.501769 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc3b39-727c-4400-9fc4-56102712875f admin admin] PATH_INFO: `/v3/projects/3f384688989b440991f0e1d43d761213` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:13.505506 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bc3b39-727c-4400-9fc4-56102712875f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f384688989b440991f0e1d43d761213)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:13.518652 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bc3b39-727c-4400-9fc4-56102712875f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:13.541939 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3171/6311] 10.222.0.83 () {58 vars in 1467 bytes} [Mon Aug 29 16:06:13 2022] DELETE /identity/v3/projects/d164ab66e40644b7a5697cfd91a60a55/users/13cfa31b78294012a47ff6ba087da1f8/roles/1c97dbbf61fb45fda84034f3a3400dc1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:13.545753 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb5649-f56d-4244-8f90-56e35f107653 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:13.548587 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-92fb5649-f56d-4244-8f90-56e35f107653 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:13.692032 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:13.739040 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-09bc3b39-727c-4400-9fc4-56102712875f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f384688989b440991f0e1d43d761213', 'request_id': 'req-09bc3b39-727c-4400-9fc4-56102712875f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:13.813395 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-09bc3b39-727c-4400-9fc4-56102712875f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f384688989b440991f0e1d43d761213', 'request_id': 'req-09bc3b39-727c-4400-9fc4-56102712875f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:13.824718 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb5649-f56d-4244-8f90-56e35f107653 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:13.840699 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-09bc3b39-727c-4400-9fc4-56102712875f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f384688989b440991f0e1d43d761213', 'request_id': 'req-09bc3b39-727c-4400-9fc4-56102712875f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:13.892250 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-09bc3b39-727c-4400-9fc4-56102712875f admin admin] The token cache is being invalidate because project 3f384688989b440991f0e1d43d761213 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:13.892551 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-09bc3b39-727c-4400-9fc4-56102712875f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:13.893443 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-09bc3b39-727c-4400-9fc4-56102712875f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:13.896102 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3141/6312] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:06:12 2022] DELETE /identity/v3/projects/3f384688989b440991f0e1d43d761213 => generated 0 bytes in 1072 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:06:13.903992 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ad633-a96e-46b6-b693-8596bb641e02 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:13.904284 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ad633-a96e-46b6-b693-8596bb641e02 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:13.923565 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ad633-a96e-46b6-b693-8596bb641e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:13.984405 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-a58ad633-a96e-46b6-b693-8596bb641e02 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:13.985659 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a58ad633-a96e-46b6-b693-8596bb641e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:14.030338 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:14.031815 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ffe53-f4f4-42a3-b0f0-fedf85eed3d2 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:14.032474 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ffe53-f4f4-42a3-b0f0-fedf85eed3d2 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:14.032762 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ffe53-f4f4-42a3-b0f0-fedf85eed3d2 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:14.033032 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ffe53-f4f4-42a3-b0f0-fedf85eed3d2 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles/1c97dbbf61fb45fda84034f3a3400dc1` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:14.037962 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94ffe53-f4f4-42a3-b0f0-fedf85eed3d2 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=1c97dbbf61fb45fda84034f3a3400dc1)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:14.039044 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-f94ffe53-f4f4-42a3-b0f0-fedf85eed3d2 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:06:14.039044 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 16:06:14.039044 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 16:06:14.067567 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94ffe53-f4f4-42a3-b0f0-fedf85eed3d2 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:14.143802 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f94ffe53-f4f4-42a3-b0f0-fedf85eed3d2 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invalidating the token cache because role 1c97dbbf61fb45fda84034f3a3400dc1 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:14.144445 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f94ffe53-f4f4-42a3-b0f0-fedf85eed3d2 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:14.145713 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f94ffe53-f4f4-42a3-b0f0-fedf85eed3d2 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:14.148233 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3172/6313] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:06:13 2022] DELETE /identity/v3/roles/1c97dbbf61fb45fda84034f3a3400dc1 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:14.153566 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ffe53-f4f4-42a3-b0f0-fedf85eed3d2 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:14.156472 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f94ffe53-f4f4-42a3-b0f0-fedf85eed3d2 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:14.212113 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3142/6314] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:14.213629 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0fc759-d4e6-446d-9192-229bfc8aeec0 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:14.214086 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0fc759-d4e6-446d-9192-229bfc8aeec0 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:14.214726 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0fc759-d4e6-446d-9192-229bfc8aeec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:14.287364 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-9f0fc759-d4e6-446d-9192-229bfc8aeec0 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:14.289145 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9f0fc759-d4e6-446d-9192-229bfc8aeec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:14.345282 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ffe53-f4f4-42a3-b0f0-fedf85eed3d2 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:14.352284 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab00d46-9acd-434c-aaab-aadc359cd626 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:14.353196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab00d46-9acd-434c-aaab-aadc359cd626 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:14.353488 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab00d46-9acd-434c-aaab-aadc359cd626 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:14.353897 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab00d46-9acd-434c-aaab-aadc359cd626 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/projects/d164ab66e40644b7a5697cfd91a60a55/users/13cfa31b78294012a47ff6ba087da1f8/roles/7aa55204a70248fb9424e819859d9291` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:14.356472 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab00d46-9acd-434c-aaab-aadc359cd626 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d164ab66e40644b7a5697cfd91a60a55, user_id=13cfa31b78294012a47ff6ba087da1f8, role_id=7aa55204a70248fb9424e819859d9291)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:14.361972 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab00d46-9acd-434c-aaab-aadc359cd626 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:14.387327 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3173/6315] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:06:14 2022] PUT /identity/v3/projects/d164ab66e40644b7a5697cfd91a60a55/users/13cfa31b78294012a47ff6ba087da1f8/roles/7aa55204a70248fb9424e819859d9291 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:14.388681 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab00d46-9acd-434c-aaab-aadc359cd626 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:14.437489 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:14.472952 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3143/6316] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:14.474049 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0fc759-d4e6-446d-9192-229bfc8aeec0 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:14.500791 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0fc759-d4e6-446d-9192-229bfc8aeec0 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:14.549234 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab00d46-9acd-434c-aaab-aadc359cd626 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:14.562496 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a5ed8-9a8c-4cd4-b326-26b9f825329a tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:14.564441 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a5ed8-9a8c-4cd4-b326-26b9f825329a tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:14.564901 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a5ed8-9a8c-4cd4-b326-26b9f825329a tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:14.566882 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a5ed8-9a8c-4cd4-b326-26b9f825329a tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles/7aa55204a70248fb9424e819859d9291/implies/f14942d5228c44eb94397856d71fcfbe` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:14.572278 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4a5ed8-9a8c-4cd4-b326-26b9f825329a tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=7aa55204a70248fb9424e819859d9291, implied_role_id=f14942d5228c44eb94397856d71fcfbe)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:14.575630 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-ec4a5ed8-9a8c-4cd4-b326-26b9f825329a tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:06:14.575630 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 16:06:14.575630 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 16:06:14.579687 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4a5ed8-9a8c-4cd4-b326-26b9f825329a tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:14.691235 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3174/6317] 10.222.0.83 () {60 vars in 1363 bytes} [Mon Aug 29 16:06:14 2022] PUT /identity/v3/roles/7aa55204a70248fb9424e819859d9291/implies/f14942d5228c44eb94397856d71fcfbe => generated 521 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:14.691921 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56a53d-c57e-4f49-85a7-a768f07e8d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:14.692577 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56a53d-c57e-4f49-85a7-a768f07e8d07 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:14.692862 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56a53d-c57e-4f49-85a7-a768f07e8d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:14.693138 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56a53d-c57e-4f49-85a7-a768f07e8d07 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:14.693472 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a5ed8-9a8c-4cd4-b326-26b9f825329a tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:14.693822 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56a53d-c57e-4f49-85a7-a768f07e8d07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:06:14.694124 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56a53d-c57e-4f49-85a7-a768f07e8d07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:14.696596 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56a53d-c57e-4f49-85a7-a768f07e8d07 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:14.744208 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3144/6318] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:06:14.745221 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56a53d-c57e-4f49-85a7-a768f07e8d07 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:14.780734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56a53d-c57e-4f49-85a7-a768f07e8d07 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:14.884474 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a5ed8-9a8c-4cd4-b326-26b9f825329a tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:14.891872 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde63642-0401-4ad8-ad50-ce683da7f31e tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:14.892780 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde63642-0401-4ad8-ad50-ce683da7f31e tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:14.893232 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde63642-0401-4ad8-ad50-ce683da7f31e tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:14.893661 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde63642-0401-4ad8-ad50-ce683da7f31e tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:14.894554 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde63642-0401-4ad8-ad50-ce683da7f31e tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Adding query filter params (scope.project.id=d164ab66e40644b7a5697cfd91a60a55, user.id=13cfa31b78294012a47ff6ba087da1f8) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:06:14.895327 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde63642-0401-4ad8-ad50-ce683da7f31e tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:14.898084 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde63642-0401-4ad8-ad50-ce683da7f31e tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:14.971290 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3175/6319] 10.222.0.83 () {58 vars in 1356 bytes} [Mon Aug 29 16:06:14 2022] GET /identity/v3/role_assignments?scope.project.id=d164ab66e40644b7a5697cfd91a60a55&user.id=13cfa31b78294012a47ff6ba087da1f8&effective => generated 1061 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:06:14.975312 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde63642-0401-4ad8-ad50-ce683da7f31e tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:14.990571 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde63642-0401-4ad8-ad50-ce683da7f31e tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:14.999539 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2fa4d-1c48-4466-ae90-521bc6f47508 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:15.000392 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2fa4d-1c48-4466-ae90-521bc6f47508 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:15.001166 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2fa4d-1c48-4466-ae90-521bc6f47508 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:15.001569 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2fa4d-1c48-4466-ae90-521bc6f47508 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles/7aa55204a70248fb9424e819859d9291/implies/f14942d5228c44eb94397856d71fcfbe` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:15.003766 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe2fa4d-1c48-4466-ae90-521bc6f47508 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=7aa55204a70248fb9424e819859d9291, implied_role_id=f14942d5228c44eb94397856d71fcfbe)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:15.004922 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-ffe2fa4d-1c48-4466-ae90-521bc6f47508 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:06:15.004922 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 16:06:15.004922 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 16:06:15.006321 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe2fa4d-1c48-4466-ae90-521bc6f47508 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:15.021891 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3176/6320] 10.222.0.83 () {58 vars in 1347 bytes} [Mon Aug 29 16:06:14 2022] DELETE /identity/v3/roles/7aa55204a70248fb9424e819859d9291/implies/f14942d5228c44eb94397856d71fcfbe => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:06:15.025582 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dee1c0-9611-4dc2-ba3b-66f9eb843b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:15.026228 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dee1c0-9611-4dc2-ba3b-66f9eb843b0c admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:15.026516 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dee1c0-9611-4dc2-ba3b-66f9eb843b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:15.026793 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dee1c0-9611-4dc2-ba3b-66f9eb843b0c admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:15.027168 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2fa4d-1c48-4466-ae90-521bc6f47508 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:15.027486 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dee1c0-9611-4dc2-ba3b-66f9eb843b0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:15.037089 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dee1c0-9611-4dc2-ba3b-66f9eb843b0c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:15.056549 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:15.149250 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3145/6321] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:06:14 2022] POST /identity/v3/projects => generated 367 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:15.150502 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dee1c0-9611-4dc2-ba3b-66f9eb843b0c admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:15.188049 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:15.210684 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2fa4d-1c48-4466-ae90-521bc6f47508 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:15.347886 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dee1c0-9611-4dc2-ba3b-66f9eb843b0c admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:15.378985 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9f0f1-dee9-4fd9-8400-8f02b8e81cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:15.383990 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9f0f1-dee9-4fd9-8400-8f02b8e81cb9 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:15.384469 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9f0f1-dee9-4fd9-8400-8f02b8e81cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:15.384887 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9f0f1-dee9-4fd9-8400-8f02b8e81cb9 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:15.385904 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c9f0f1-dee9-4fd9-8400-8f02b8e81cb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:15.393261 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c9f0f1-dee9-4fd9-8400-8f02b8e81cb9 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:15.453254 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532d73a-db9d-42d6-8fc2-ec1386727222 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:15.459689 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532d73a-db9d-42d6-8fc2-ec1386727222 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:15.460000 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532d73a-db9d-42d6-8fc2-ec1386727222 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:15.461277 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532d73a-db9d-42d6-8fc2-ec1386727222 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:15.461927 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532d73a-db9d-42d6-8fc2-ec1386727222 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Adding query filter params (scope.project.id=d164ab66e40644b7a5697cfd91a60a55, user.id=13cfa31b78294012a47ff6ba087da1f8) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:06:15.462243 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532d73a-db9d-42d6-8fc2-ec1386727222 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:15.472059 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532d73a-db9d-42d6-8fc2-ec1386727222 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:15.473811 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3146/6322] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:06:15 2022] POST /identity/v3/users => generated 284 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:15.476029 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9f0f1-dee9-4fd9-8400-8f02b8e81cb9 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:15.497322 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9f0f1-dee9-4fd9-8400-8f02b8e81cb9 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:15.534033 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c662da-9c2c-4db9-9bdd-09163be6a2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:15.534722 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c662da-9c2c-4db9-9bdd-09163be6a2eb admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:15.534922 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c662da-9c2c-4db9-9bdd-09163be6a2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:15.535227 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c662da-9c2c-4db9-9bdd-09163be6a2eb admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:15.535881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c662da-9c2c-4db9-9bdd-09163be6a2eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:15.537713 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c662da-9c2c-4db9-9bdd-09163be6a2eb admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:15.569777 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3147/6323] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:06:15 2022] GET /identity/v3/roles => generated 2324 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:06:15.572524 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c662da-9c2c-4db9-9bdd-09163be6a2eb admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:15.600256 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c662da-9c2c-4db9-9bdd-09163be6a2eb admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:15.615302 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732780ee-60eb-4be2-9889-e043538651b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:15.615650 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3177/6324] 10.222.0.83 () {58 vars in 1356 bytes} [Mon Aug 29 16:06:15 2022] GET /identity/v3/role_assignments?scope.project.id=d164ab66e40644b7a5697cfd91a60a55&user.id=13cfa31b78294012a47ff6ba087da1f8&effective => generated 577 bytes in 589 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:06:15.616579 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532d73a-db9d-42d6-8fc2-ec1386727222 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:15.617426 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732780ee-60eb-4be2-9889-e043538651b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:15.617700 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732780ee-60eb-4be2-9889-e043538651b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:15.617968 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732780ee-60eb-4be2-9889-e043538651b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:15.618628 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732780ee-60eb-4be2-9889-e043538651b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:15.620704 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732780ee-60eb-4be2-9889-e043538651b8 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:15.638102 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532d73a-db9d-42d6-8fc2-ec1386727222 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:15.648602 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3148/6325] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:06:15 2022] GET /identity/v3/roles => generated 2324 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:06:15.649730 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732780ee-60eb-4be2-9889-e043538651b8 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:15.650760 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a017c1-0eba-4971-a41d-e9a292f3780a tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:15.651489 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a017c1-0eba-4971-a41d-e9a292f3780a tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:15.651763 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a017c1-0eba-4971-a41d-e9a292f3780a tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:15.652034 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a017c1-0eba-4971-a41d-e9a292f3780a tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles/7aa55204a70248fb9424e819859d9291/implies/f14942d5228c44eb94397856d71fcfbe` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:15.656226 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a017c1-0eba-4971-a41d-e9a292f3780a tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=7aa55204a70248fb9424e819859d9291, implied_role_id=f14942d5228c44eb94397856d71fcfbe)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:15.661558 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a017c1-0eba-4971-a41d-e9a292f3780a tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:15.674710 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732780ee-60eb-4be2-9889-e043538651b8 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:15.682860 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-32a017c1-0eba-4971-a41d-e9a292f3780a tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] 7aa55204a70248fb9424e819859d9291 does not imply f14942d5228c44eb94397856d71fcfbe.: keystone.exception.ImpliedRoleNotFound: 7aa55204a70248fb9424e819859d9291 does not imply f14942d5228c44eb94397856d71fcfbe. Aug 29 16:06:15.682860 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:06:15.682860 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Aug 29 16:06:15.682860 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = query.one() Aug 29 16:06:15.682860 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Aug 29 16:06:15.682860 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._iter().one() Aug 29 16:06:15.682860 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Aug 29 16:06:15.682860 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._only_one_row( Aug 29 16:06:15.682860 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Aug 29 16:06:15.682860 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exc.NoResultFound( Aug 29 16:06:15.682860 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Aug 29 16:06:15.682860 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:06:15.682860 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 16:06:15.682860 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:06:15.682860 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:06:15.682860 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:06:15.683966 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:06:15.683966 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:06:15.683966 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:06:15.683966 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:06:15.683966 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:06:15.683966 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:06:15.683966 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:06:15.683966 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:06:15.683966 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:06:15.683966 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Aug 29 16:06:15.683966 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Aug 29 16:06:15.683966 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:06:15.683966 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:06:15.683966 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Aug 29 16:06:15.683966 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Aug 29 16:06:15.683966 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Aug 29 16:06:15.684910 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Aug 29 16:06:15.684910 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Aug 29 16:06:15.684910 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Aug 29 16:06:15.684910 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 7aa55204a70248fb9424e819859d9291 does not imply f14942d5228c44eb94397856d71fcfbe. Aug 29 16:06:15.684910 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:06:15.692537 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3178/6326] 10.222.0.83 () {58 vars in 1347 bytes} [Mon Aug 29 16:06:15 2022] DELETE /identity/v3/roles/7aa55204a70248fb9424e819859d9291/implies/f14942d5228c44eb94397856d71fcfbe => generated 137 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 16:06:15.693483 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a017c1-0eba-4971-a41d-e9a292f3780a tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:15.694509 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e333328a-b88a-43c3-bf7c-07bcd4f4c62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:15.695221 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333328a-b88a-43c3-bf7c-07bcd4f4c62a admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:15.695496 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333328a-b88a-43c3-bf7c-07bcd4f4c62a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:15.695766 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333328a-b88a-43c3-bf7c-07bcd4f4c62a admin admin] PATH_INFO: `/v3/projects/d1f4ab86fde8493d989b7982cce04088/users/2a6581ea631a4730b1e1a54c99a95544/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:15.721801 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a017c1-0eba-4971-a41d-e9a292f3780a tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:15.733635 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61595f38-9a24-487a-b9a9-25ceed6b4169 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:15.734340 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61595f38-9a24-487a-b9a9-25ceed6b4169 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:15.734623 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61595f38-9a24-487a-b9a9-25ceed6b4169 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:15.735566 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61595f38-9a24-487a-b9a9-25ceed6b4169 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/projects/d164ab66e40644b7a5697cfd91a60a55/users/13cfa31b78294012a47ff6ba087da1f8/roles/7aa55204a70248fb9424e819859d9291` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:15.738905 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61595f38-9a24-487a-b9a9-25ceed6b4169 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=d164ab66e40644b7a5697cfd91a60a55, user_id=13cfa31b78294012a47ff6ba087da1f8, role_id=7aa55204a70248fb9424e819859d9291)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:15.739236 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e333328a-b88a-43c3-bf7c-07bcd4f4c62a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1f4ab86fde8493d989b7982cce04088, user_id=2a6581ea631a4730b1e1a54c99a95544, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:15.746606 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61595f38-9a24-487a-b9a9-25ceed6b4169 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:15.748742 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e333328a-b88a-43c3-bf7c-07bcd4f4c62a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:15.751338 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-61595f38-9a24-487a-b9a9-25ceed6b4169 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invalidating the token cache because role 7aa55204a70248fb9424e819859d9291 was removed from user 13cfa31b78294012a47ff6ba087da1f8 on project d164ab66e40644b7a5697cfd91a60a55. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:15.752489 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-61595f38-9a24-487a-b9a9-25ceed6b4169 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:15.753251 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-61595f38-9a24-487a-b9a9-25ceed6b4169 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:15.819138 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3179/6327] 10.222.0.83 () {58 vars in 1467 bytes} [Mon Aug 29 16:06:15 2022] DELETE /identity/v3/projects/d164ab66e40644b7a5697cfd91a60a55/users/13cfa31b78294012a47ff6ba087da1f8/roles/7aa55204a70248fb9424e819859d9291 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:15.835146 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3149/6328] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:06:15 2022] PUT /identity/v3/projects/d1f4ab86fde8493d989b7982cce04088/users/2a6581ea631a4730b1e1a54c99a95544/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:06:15.835341 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61595f38-9a24-487a-b9a9-25ceed6b4169 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:15.835341 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-61595f38-9a24-487a-b9a9-25ceed6b4169 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:15.843971 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97126d4b-eea4-4684-b933-4a7944ceb074 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:15.844910 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97126d4b-eea4-4684-b933-4a7944ceb074 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:15.845332 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97126d4b-eea4-4684-b933-4a7944ceb074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:15.996777 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-97126d4b-eea4-4684-b933-4a7944ceb074 None None] MFA Rules not processed for user `2a6581ea631a4730b1e1a54c99a95544`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:16.000799 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-97126d4b-eea4-4684-b933-4a7944ceb074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:16.084649 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61595f38-9a24-487a-b9a9-25ceed6b4169 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:16.137733 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be00bc4-0d3c-4551-b04b-cdde8ee36fcb tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:16.139990 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be00bc4-0d3c-4551-b04b-cdde8ee36fcb tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:16.140484 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be00bc4-0d3c-4551-b04b-cdde8ee36fcb tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:16.140918 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be00bc4-0d3c-4551-b04b-cdde8ee36fcb tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:16.141780 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be00bc4-0d3c-4551-b04b-cdde8ee36fcb tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:16.145164 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-7be00bc4-0d3c-4551-b04b-cdde8ee36fcb tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:06:16.145164 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 16:06:16.145164 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 16:06:16.146501 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be00bc4-0d3c-4551-b04b-cdde8ee36fcb tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:16.181474 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3150/6329] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:16.189661 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97126d4b-eea4-4684-b933-4a7944ceb074 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:16.191356 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-97126d4b-eea4-4684-b933-4a7944ceb074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:16.205765 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3180/6330] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:06:15 2022] POST /identity/v3/roles => generated 272 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:16.210866 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be00bc4-0d3c-4551-b04b-cdde8ee36fcb tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:16.255642 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:16.264187 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be00bc4-0d3c-4551-b04b-cdde8ee36fcb tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:16.281338 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b5e8c-0dfa-4cbf-a0c6-90b9c63d1498 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:16.282383 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b5e8c-0dfa-4cbf-a0c6-90b9c63d1498 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:16.282956 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b5e8c-0dfa-4cbf-a0c6-90b9c63d1498 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:16.283380 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b5e8c-0dfa-4cbf-a0c6-90b9c63d1498 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:16.284354 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b5e8c-0dfa-4cbf-a0c6-90b9c63d1498 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Adding query filter params (domain_id=9c133110c6634d2180f310fd4b8d61ca) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:06:16.284779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b5e8c-0dfa-4cbf-a0c6-90b9c63d1498 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:16.286158 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-ea5b5e8c-0dfa-4cbf-a0c6-90b9c63d1498 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:06:16.286158 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 16:06:16.286158 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 16:06:16.288864 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b5e8c-0dfa-4cbf-a0c6-90b9c63d1498 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:16.306590 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3181/6331] 10.222.0.83 () {58 vars in 1207 bytes} [Mon Aug 29 16:06:16 2022] GET /identity/v3/roles?domain_id=9c133110c6634d2180f310fd4b8d61ca => generated 409 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:06:16.311643 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b5e8c-0dfa-4cbf-a0c6-90b9c63d1498 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:16.337062 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b5e8c-0dfa-4cbf-a0c6-90b9c63d1498 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:16.352002 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c1a1c-f15b-4e01-a85a-2e596e458630 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:16.352776 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c1a1c-f15b-4e01-a85a-2e596e458630 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:16.353221 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c1a1c-f15b-4e01-a85a-2e596e458630 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:16.353621 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c1a1c-f15b-4e01-a85a-2e596e458630 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles/997b8b70b49e456baaee04769b7b4bff` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:16.354977 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c1a1c-f15b-4e01-a85a-2e596e458630 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=997b8b70b49e456baaee04769b7b4bff)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:16.358222 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c1a1c-f15b-4e01-a85a-2e596e458630 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:16.367127 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97126d4b-eea4-4684-b933-4a7944ceb074 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:16.374879 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4faf6-860e-4de9-a02e-f9fd4491c03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:16.375567 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4faf6-860e-4de9-a02e-f9fd4491c03f admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:16.375966 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4faf6-860e-4de9-a02e-f9fd4491c03f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:16.376083 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4faf6-860e-4de9-a02e-f9fd4491c03f admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:16.377799 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf4faf6-860e-4de9-a02e-f9fd4491c03f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:16.379585 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf4faf6-860e-4de9-a02e-f9fd4491c03f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:16.386825 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:16.439391 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3151/6332] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:06:16 2022] POST /identity/v3/projects => generated 367 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:16.442632 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4faf6-860e-4de9-a02e-f9fd4491c03f admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:16.468860 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-678c1a1c-f15b-4e01-a85a-2e596e458630 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invalidating the token cache because role 997b8b70b49e456baaee04769b7b4bff has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:16.469402 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-678c1a1c-f15b-4e01-a85a-2e596e458630 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:16.477047 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-678c1a1c-f15b-4e01-a85a-2e596e458630 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:16.481958 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3182/6333] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:06:16 2022] DELETE /identity/v3/roles/997b8b70b49e456baaee04769b7b4bff => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:16.486894 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c1a1c-f15b-4e01-a85a-2e596e458630 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:16.490491 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-678c1a1c-f15b-4e01-a85a-2e596e458630 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:16.618554 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c1a1c-f15b-4e01-a85a-2e596e458630 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:16.624046 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2baef-fe49-41fc-a4a0-312d1ee33485 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:16.624682 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2baef-fe49-41fc-a4a0-312d1ee33485 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:16.624963 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2baef-fe49-41fc-a4a0-312d1ee33485 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:16.625609 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2baef-fe49-41fc-a4a0-312d1ee33485 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:16.625903 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2baef-fe49-41fc-a4a0-312d1ee33485 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Adding query filter params (domain_id=9c133110c6634d2180f310fd4b8d61ca) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:06:16.626367 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2baef-fe49-41fc-a4a0-312d1ee33485 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:16.628210 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2baef-fe49-41fc-a4a0-312d1ee33485 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:16.635577 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3183/6334] 10.222.0.83 () {58 vars in 1207 bytes} [Mon Aug 29 16:06:16 2022] GET /identity/v3/roles?domain_id=9c133110c6634d2180f310fd4b8d61ca => generated 148 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:06:16.639960 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2baef-fe49-41fc-a4a0-312d1ee33485 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:16.651000 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2baef-fe49-41fc-a4a0-312d1ee33485 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:16.658065 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75220d8d-8dfe-4c43-9239-0c192ac63c64 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:16.658815 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75220d8d-8dfe-4c43-9239-0c192ac63c64 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:16.659249 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75220d8d-8dfe-4c43-9239-0c192ac63c64 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:16.659602 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75220d8d-8dfe-4c43-9239-0c192ac63c64 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles/997b8b70b49e456baaee04769b7b4bff` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:16.674138 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75220d8d-8dfe-4c43-9239-0c192ac63c64 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 16:06:16.680630 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-75220d8d-8dfe-4c43-9239-0c192ac63c64 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Could not find role: 997b8b70b49e456baaee04769b7b4bff.: keystone.exception.RoleNotFound: Could not find role: 997b8b70b49e456baaee04769b7b4bff. Aug 29 16:06:16.680630 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:06:16.680630 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:06:16.680630 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:06:16.680630 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:06:16.680630 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:06:16.680630 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:06:16.680630 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:06:16.680630 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:06:16.680630 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:06:16.680630 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:06:16.680630 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:06:16.680630 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 165, in delete Aug 29 16:06:16.680630 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_role') Aug 29 16:06:16.681817 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 16:06:16.681817 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 16:06:16.681817 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 16:06:16.681817 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 16:06:16.681817 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:06:16.681817 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:06:16.681817 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 16:06:16.681817 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 16:06:16.681817 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 16:06:16.681817 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 16:06:16.681817 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 16:06:16.681817 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 16:06:16.681817 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 16:06:16.681817 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 16:06:16.681817 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 16:06:16.681817 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 16:06:16.682907 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 16:06:16.682907 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 16:06:16.682907 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 16:06:16.682907 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 16:06:16.682907 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 16:06:16.682907 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 16:06:16.682907 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 16:06:16.682907 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 16:06:16.682907 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 16:06:16.682907 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 16:06:16.682907 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 997b8b70b49e456baaee04769b7b4bff. Aug 29 16:06:16.682907 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:06:16.684410 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3184/6335] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:06:16 2022] DELETE /identity/v3/roles/997b8b70b49e456baaee04769b7b4bff => generated 110 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 29 16:06:16.690599 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75220d8d-8dfe-4c43-9239-0c192ac63c64 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:16.702465 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75220d8d-8dfe-4c43-9239-0c192ac63c64 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:16.705568 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4faf6-860e-4de9-a02e-f9fd4491c03f admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:16.711490 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77628881-dedd-4dca-bacb-c4efe723424b tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:16.713279 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77628881-dedd-4dca-bacb-c4efe723424b tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:16.714912 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77628881-dedd-4dca-bacb-c4efe723424b tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:16.717293 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77628881-dedd-4dca-bacb-c4efe723424b tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/domains/9c133110c6634d2180f310fd4b8d61ca/groups/d984fb079c4a4c0884c81e9461564d64/roles/6a8ad8055c9d446995f93021abfda9d5` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:16.733720 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77628881-dedd-4dca-bacb-c4efe723424b tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=9c133110c6634d2180f310fd4b8d61ca, group_id=d984fb079c4a4c0884c81e9461564d64, role_id=6a8ad8055c9d446995f93021abfda9d5)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:16.736839 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77628881-dedd-4dca-bacb-c4efe723424b tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:16.766388 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3185/6336] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:06:16 2022] PUT /identity/v3/domains/9c133110c6634d2180f310fd4b8d61ca/groups/d984fb079c4a4c0884c81e9461564d64/roles/6a8ad8055c9d446995f93021abfda9d5 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:16.772581 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77628881-dedd-4dca-bacb-c4efe723424b tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:16.874598 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e145d-1cb5-423d-8c28-2c30a1875b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:16.875506 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e145d-1cb5-423d-8c28-2c30a1875b41 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:16.875795 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e145d-1cb5-423d-8c28-2c30a1875b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:16.879125 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e145d-1cb5-423d-8c28-2c30a1875b41 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:16.879821 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440e145d-1cb5-423d-8c28-2c30a1875b41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:16.884935 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440e145d-1cb5-423d-8c28-2c30a1875b41 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:16.963965 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3152/6337] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:06:16 2022] POST /identity/v3/users => generated 290 bytes in 521 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:16.965343 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e145d-1cb5-423d-8c28-2c30a1875b41 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:16.968273 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-440e145d-1cb5-423d-8c28-2c30a1875b41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:16.972247 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77628881-dedd-4dca-bacb-c4efe723424b tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:16.978008 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c82b01-f28e-45f4-98c6-72a96409e686 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:16.978861 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c82b01-f28e-45f4-98c6-72a96409e686 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:16.979208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c82b01-f28e-45f4-98c6-72a96409e686 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:16.979488 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c82b01-f28e-45f4-98c6-72a96409e686 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/domains/9c133110c6634d2180f310fd4b8d61ca/groups/d984fb079c4a4c0884c81e9461564d64/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:16.983973 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c82b01-f28e-45f4-98c6-72a96409e686 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=9c133110c6634d2180f310fd4b8d61ca, group_id=d984fb079c4a4c0884c81e9461564d64)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:16.985031 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-c8c82b01-f28e-45f4-98c6-72a96409e686 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:06:16.985031 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 16:06:16.985031 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 16:06:16.987592 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c82b01-f28e-45f4-98c6-72a96409e686 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:17.005596 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e145d-1cb5-423d-8c28-2c30a1875b41 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:17.056129 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3186/6338] 10.222.0.83 () {58 vars in 1365 bytes} [Mon Aug 29 16:06:16 2022] GET /identity/v3/domains/9c133110c6634d2180f310fd4b8d61ca/groups/d984fb079c4a4c0884c81e9461564d64/roles => generated 410 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:06:17.061179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c82b01-f28e-45f4-98c6-72a96409e686 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:17.093411 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c82b01-f28e-45f4-98c6-72a96409e686 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:17.108196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c1414-8cdf-496d-8f3b-db436c6889a4 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:17.109114 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c1414-8cdf-496d-8f3b-db436c6889a4 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:17.109954 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c1414-8cdf-496d-8f3b-db436c6889a4 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:17.110240 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c1414-8cdf-496d-8f3b-db436c6889a4 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/domains/9c133110c6634d2180f310fd4b8d61ca/groups/d984fb079c4a4c0884c81e9461564d64/roles/6a8ad8055c9d446995f93021abfda9d5` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:17.126021 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c1414-8cdf-496d-8f3b-db436c6889a4 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=9c133110c6634d2180f310fd4b8d61ca, group_id=d984fb079c4a4c0884c81e9461564d64, role_id=6a8ad8055c9d446995f93021abfda9d5)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:17.138998 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c1414-8cdf-496d-8f3b-db436c6889a4 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:17.156902 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3187/6339] 10.222.0.83 () {58 vars in 1465 bytes} [Mon Aug 29 16:06:17 2022] HEAD /identity/v3/domains/9c133110c6634d2180f310fd4b8d61ca/groups/d984fb079c4a4c0884c81e9461564d64/roles/6a8ad8055c9d446995f93021abfda9d5 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:17.165125 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c1414-8cdf-496d-8f3b-db436c6889a4 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:17.171275 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:17.192621 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c1414-8cdf-496d-8f3b-db436c6889a4 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:17.203119 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c90044-32b1-428d-8d4c-9ed2acd02a78 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:17.204291 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c90044-32b1-428d-8d4c-9ed2acd02a78 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:17.204830 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c90044-32b1-428d-8d4c-9ed2acd02a78 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:17.205207 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c90044-32b1-428d-8d4c-9ed2acd02a78 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/domains/9c133110c6634d2180f310fd4b8d61ca/groups/d984fb079c4a4c0884c81e9461564d64/roles/6a8ad8055c9d446995f93021abfda9d5` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:17.208999 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c90044-32b1-428d-8d4c-9ed2acd02a78 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=9c133110c6634d2180f310fd4b8d61ca, group_id=d984fb079c4a4c0884c81e9461564d64, role_id=6a8ad8055c9d446995f93021abfda9d5)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:17.215284 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c90044-32b1-428d-8d4c-9ed2acd02a78 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:17.224689 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169efcfa-91e5-4a4f-b487-f3a83a68b8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:17.226877 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169efcfa-91e5-4a4f-b487-f3a83a68b8c5 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:17.227265 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169efcfa-91e5-4a4f-b487-f3a83a68b8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:17.227620 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169efcfa-91e5-4a4f-b487-f3a83a68b8c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:17.228844 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169efcfa-91e5-4a4f-b487-f3a83a68b8c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:17.234053 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169efcfa-91e5-4a4f-b487-f3a83a68b8c5 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:17.236100 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-10c90044-32b1-428d-8d4c-9ed2acd02a78 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invalidating the token cache because role 6a8ad8055c9d446995f93021abfda9d5 was removed from group d984fb079c4a4c0884c81e9461564d64 on domain 9c133110c6634d2180f310fd4b8d61ca. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:17.236667 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-10c90044-32b1-428d-8d4c-9ed2acd02a78 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:17.238040 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-10c90044-32b1-428d-8d4c-9ed2acd02a78 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:17.267942 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3188/6340] 10.222.0.83 () {58 vars in 1467 bytes} [Mon Aug 29 16:06:17 2022] DELETE /identity/v3/domains/9c133110c6634d2180f310fd4b8d61ca/groups/d984fb079c4a4c0884c81e9461564d64/roles/6a8ad8055c9d446995f93021abfda9d5 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:17.273726 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c90044-32b1-428d-8d4c-9ed2acd02a78 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:17.276208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-10c90044-32b1-428d-8d4c-9ed2acd02a78 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:17.284726 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3153/6341] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:06:16 2022] GET /identity/v3/roles => generated 2324 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:06:17.286005 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169efcfa-91e5-4a4f-b487-f3a83a68b8c5 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:17.292366 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-169efcfa-91e5-4a4f-b487-f3a83a68b8c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:17.304104 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:17.325308 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169efcfa-91e5-4a4f-b487-f3a83a68b8c5 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:17.448321 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c90044-32b1-428d-8d4c-9ed2acd02a78 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:17.452970 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e37d72-2592-48bb-a415-8212d2b200c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:17.454007 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e37d72-2592-48bb-a415-8212d2b200c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:17.454910 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e37d72-2592-48bb-a415-8212d2b200c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:17.456832 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e37d72-2592-48bb-a415-8212d2b200c9 admin admin] PATH_INFO: `/v3/projects/de7271a29ccc4d1ab7ea4df61e0260d2/users/a0fbc9c15ddf437f920a346a04d0fd83/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:17.463309 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47540115-2249-453a-95ba-9fe0e1c1427e tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:17.463826 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47540115-2249-453a-95ba-9fe0e1c1427e tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:17.465018 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47540115-2249-453a-95ba-9fe0e1c1427e tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:17.465408 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47540115-2249-453a-95ba-9fe0e1c1427e tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/projects/d164ab66e40644b7a5697cfd91a60a55/groups/d984fb079c4a4c0884c81e9461564d64/roles/6a8ad8055c9d446995f93021abfda9d5` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:17.470406 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47540115-2249-453a-95ba-9fe0e1c1427e tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d164ab66e40644b7a5697cfd91a60a55, group_id=d984fb079c4a4c0884c81e9461564d64, role_id=6a8ad8055c9d446995f93021abfda9d5)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:17.476280 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47540115-2249-453a-95ba-9fe0e1c1427e tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:17.504734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e37d72-2592-48bb-a415-8212d2b200c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de7271a29ccc4d1ab7ea4df61e0260d2, user_id=a0fbc9c15ddf437f920a346a04d0fd83, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:17.513595 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e37d72-2592-48bb-a415-8212d2b200c9 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:17.517976 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3189/6342] 10.222.0.83 () {60 vars in 1486 bytes} [Mon Aug 29 16:06:17 2022] PUT /identity/v3/projects/d164ab66e40644b7a5697cfd91a60a55/groups/d984fb079c4a4c0884c81e9461564d64/roles/6a8ad8055c9d446995f93021abfda9d5 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:17.520044 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47540115-2249-453a-95ba-9fe0e1c1427e tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:17.555401 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3154/6343] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:06:17 2022] PUT /identity/v3/projects/de7271a29ccc4d1ab7ea4df61e0260d2/users/a0fbc9c15ddf437f920a346a04d0fd83/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:17.559427 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e37d72-2592-48bb-a415-8212d2b200c9 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:17.709907 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47540115-2249-453a-95ba-9fe0e1c1427e tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:17.739599 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e37d72-2592-48bb-a415-8212d2b200c9 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:17.756072 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2adc65-bcac-4e21-bab5-3c87ca07bb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:17.756847 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2adc65-bcac-4e21-bab5-3c87ca07bb46 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:17.757224 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2adc65-bcac-4e21-bab5-3c87ca07bb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:17.757596 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2adc65-bcac-4e21-bab5-3c87ca07bb46 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:17.758376 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2adc65-bcac-4e21-bab5-3c87ca07bb46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:17.772033 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2adc65-bcac-4e21-bab5-3c87ca07bb46 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:17.810064 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3155/6344] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:06:17 2022] GET /identity/v3/roles => generated 2324 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:06:17.814427 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a9ff4-2fbd-45f1-ae0a-d5275d96b691 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:17.816086 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a9ff4-2fbd-45f1-ae0a-d5275d96b691 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:17.816531 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a9ff4-2fbd-45f1-ae0a-d5275d96b691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:17.859297 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-bc2a9ff4-2fbd-45f1-ae0a-d5275d96b691 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:17.864603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-bc2a9ff4-2fbd-45f1-ae0a-d5275d96b691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:17.867244 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca29fe-c1b5-4445-bce5-e8adf6f65a7a tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:17.868197 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca29fe-c1b5-4445-bce5-e8adf6f65a7a tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:17.868617 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca29fe-c1b5-4445-bce5-e8adf6f65a7a tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:17.868998 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca29fe-c1b5-4445-bce5-e8adf6f65a7a tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/projects/d164ab66e40644b7a5697cfd91a60a55/groups/d984fb079c4a4c0884c81e9461564d64/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:17.872299 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca29fe-c1b5-4445-bce5-e8adf6f65a7a tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:list_grants(project_id=d164ab66e40644b7a5697cfd91a60a55, group_id=d984fb079c4a4c0884c81e9461564d64)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:17.879089 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca29fe-c1b5-4445-bce5-e8adf6f65a7a tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:17.943422 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3190/6345] 10.222.0.83 () {58 vars in 1368 bytes} [Mon Aug 29 16:06:17 2022] GET /identity/v3/projects/d164ab66e40644b7a5697cfd91a60a55/groups/d984fb079c4a4c0884c81e9461564d64/roles => generated 411 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:06:17.943422 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca29fe-c1b5-4445-bce5-e8adf6f65a7a tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:17.985124 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:17.988519 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca29fe-c1b5-4445-bce5-e8adf6f65a7a tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:17.996915 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70858e3-c91e-4b4a-931d-931d11131707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:17.998631 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70858e3-c91e-4b4a-931d-931d11131707 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:17.999103 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70858e3-c91e-4b4a-931d-931d11131707 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:17.999689 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70858e3-c91e-4b4a-931d-931d11131707 admin admin] PATH_INFO: `/v3/projects/de7271a29ccc4d1ab7ea4df61e0260d2/users/a0fbc9c15ddf437f920a346a04d0fd83/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:18.000022 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3156/6346] 10.222.0.83 () {58 vars in 967 bytes} [Mon Aug 29 16:06:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:18.009002 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70858e3-c91e-4b4a-931d-931d11131707 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de7271a29ccc4d1ab7ea4df61e0260d2, user_id=a0fbc9c15ddf437f920a346a04d0fd83, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:18.016844 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70858e3-c91e-4b4a-931d-931d11131707 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:18.022031 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a9ff4-2fbd-45f1-ae0a-d5275d96b691 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:18.043087 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a9ff4-2fbd-45f1-ae0a-d5275d96b691 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:18.043834 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3191/6347] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:06:17 2022] PUT /identity/v3/projects/de7271a29ccc4d1ab7ea4df61e0260d2/users/a0fbc9c15ddf437f920a346a04d0fd83/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:18.045456 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70858e3-c91e-4b4a-931d-931d11131707 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:18.049187 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d70858e3-c91e-4b4a-931d-931d11131707 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:18.157256 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:18.241392 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9138f14-e77d-44cc-ab5e-ffb1ab65f3c2 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:18.242254 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9138f14-e77d-44cc-ab5e-ffb1ab65f3c2 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:18.244493 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9138f14-e77d-44cc-ab5e-ffb1ab65f3c2 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:18.245434 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9138f14-e77d-44cc-ab5e-ffb1ab65f3c2 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/groups/d984fb079c4a4c0884c81e9461564d64/users/13cfa31b78294012a47ff6ba087da1f8` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:18.255414 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9138f14-e77d-44cc-ab5e-ffb1ab65f3c2 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=d984fb079c4a4c0884c81e9461564d64, user_id=13cfa31b78294012a47ff6ba087da1f8)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:18.259417 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9138f14-e77d-44cc-ab5e-ffb1ab65f3c2 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:18.286763 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70858e3-c91e-4b4a-931d-931d11131707 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:18.299480 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c984adbb-e3a2-4111-a99c-7531c7ffb571 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:18.300481 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984adbb-e3a2-4111-a99c-7531c7ffb571 service swift] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:18.300984 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984adbb-e3a2-4111-a99c-7531c7ffb571 service swift] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:18.301533 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984adbb-e3a2-4111-a99c-7531c7ffb571 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:18.321468 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3157/6348] 10.222.0.83 () {60 vars in 1360 bytes} [Mon Aug 29 16:06:18 2022] PUT /identity/v3/groups/d984fb079c4a4c0884c81e9461564d64/users/13cfa31b78294012a47ff6ba087da1f8 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:18.325038 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a039e-e1ab-4f04-b98e-6c83b710999e None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:18.327107 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a039e-e1ab-4f04-b98e-6c83b710999e None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:18.327107 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a039e-e1ab-4f04-b98e-6c83b710999e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:18.424482 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-ba3a039e-e1ab-4f04-b98e-6c83b710999e None None] MFA Rules not processed for user `a0fbc9c15ddf437f920a346a04d0fd83`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:18.446544 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ba3a039e-e1ab-4f04-b98e-6c83b710999e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:18.525561 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c984adbb-e3a2-4111-a99c-7531c7ffb571 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:18.528501 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c984adbb-e3a2-4111-a99c-7531c7ffb571 service swift] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:18.548269 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3192/6349] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 16:06:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:06:18.549738 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86001fb-f6de-41af-912d-3498544857c4 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:18.550034 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86001fb-f6de-41af-912d-3498544857c4 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:18.550420 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86001fb-f6de-41af-912d-3498544857c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:18.624601 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-e86001fb-f6de-41af-912d-3498544857c4 None None] MFA Rules not processed for user `13cfa31b78294012a47ff6ba087da1f8`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:18.625820 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e86001fb-f6de-41af-912d-3498544857c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:18.697263 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3158/6350] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:18 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:18.712641 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a039e-e1ab-4f04-b98e-6c83b710999e None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:18.731436 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a039e-e1ab-4f04-b98e-6c83b710999e None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:18.752860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4213b24f-51c5-4a68-9065-f4a628eb2bb0 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:18.753612 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213b24f-51c5-4a68-9065-f4a628eb2bb0 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:18.754037 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213b24f-51c5-4a68-9065-f4a628eb2bb0 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:18.754412 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213b24f-51c5-4a68-9065-f4a628eb2bb0 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:18.755186 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4213b24f-51c5-4a68-9065-f4a628eb2bb0 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:18.758246 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4213b24f-51c5-4a68-9065-f4a628eb2bb0 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:18.875552 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3159/6351] 10.222.0.83 () {60 vars in 1152 bytes} [Mon Aug 29 16:06:18 2022] POST /identity/v3/projects => generated 328 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:18.876637 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4213b24f-51c5-4a68-9065-f4a628eb2bb0 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:18.880003 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3193/6352] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:18 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:18.883678 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86001fb-f6de-41af-912d-3498544857c4 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:18.962572 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:19.019596 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:19.041850 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4213b24f-51c5-4a68-9065-f4a628eb2bb0 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:19.052614 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86001fb-f6de-41af-912d-3498544857c4 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:19.067121 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9fcff-0ac4-42a6-870d-53b22727555a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:19.069055 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9fcff-0ac4-42a6-870d-53b22727555a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:19.069759 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9fcff-0ac4-42a6-870d-53b22727555a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:19.071186 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9fcff-0ac4-42a6-870d-53b22727555a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:19.073217 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b9fcff-0ac4-42a6-870d-53b22727555a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:19.080823 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b9fcff-0ac4-42a6-870d-53b22727555a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:19.143671 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3160/6353] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:06:18 2022] POST /identity/v3/users => generated 413 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:19.144635 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9fcff-0ac4-42a6-870d-53b22727555a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:19.187262 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9fcff-0ac4-42a6-870d-53b22727555a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:19.189886 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6380b81-5cdf-4747-9fd5-f9b65e6931ba tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:19.190588 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6380b81-5cdf-4747-9fd5-f9b65e6931ba tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:19.190878 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6380b81-5cdf-4747-9fd5-f9b65e6931ba tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:19.191194 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6380b81-5cdf-4747-9fd5-f9b65e6931ba tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/projects/d164ab66e40644b7a5697cfd91a60a55/groups/d984fb079c4a4c0884c81e9461564d64/roles/6a8ad8055c9d446995f93021abfda9d5` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:19.193605 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6380b81-5cdf-4747-9fd5-f9b65e6931ba tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:check_grant(project_id=d164ab66e40644b7a5697cfd91a60a55, group_id=d984fb079c4a4c0884c81e9461564d64, role_id=6a8ad8055c9d446995f93021abfda9d5)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:19.197565 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6380b81-5cdf-4747-9fd5-f9b65e6931ba tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:19.200514 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97072e-f353-4102-ab4c-2841f276c9a2 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:19.201822 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97072e-f353-4102-ab4c-2841f276c9a2 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:19.202337 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97072e-f353-4102-ab4c-2841f276c9a2 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:19.202837 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97072e-f353-4102-ab4c-2841f276c9a2 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:19.203909 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c97072e-f353-4102-ab4c-2841f276c9a2 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:19.207074 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3194/6354] 10.222.0.83 () {58 vars in 1468 bytes} [Mon Aug 29 16:06:18 2022] HEAD /identity/v3/projects/d164ab66e40644b7a5697cfd91a60a55/groups/d984fb079c4a4c0884c81e9461564d64/roles/6a8ad8055c9d446995f93021abfda9d5 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:19.208524 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c97072e-f353-4102-ab4c-2841f276c9a2 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:19.209637 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6380b81-5cdf-4747-9fd5-f9b65e6931ba tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:19.229353 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6380b81-5cdf-4747-9fd5-f9b65e6931ba tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:19.243701 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf2029e-10b5-413a-8668-41f90ec0c649 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:19.244402 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2029e-10b5-413a-8668-41f90ec0c649 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:19.244688 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2029e-10b5-413a-8668-41f90ec0c649 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:19.244972 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2029e-10b5-413a-8668-41f90ec0c649 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/projects/d164ab66e40644b7a5697cfd91a60a55/groups/d984fb079c4a4c0884c81e9461564d64/roles/6a8ad8055c9d446995f93021abfda9d5` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:19.248366 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf2029e-10b5-413a-8668-41f90ec0c649 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=d164ab66e40644b7a5697cfd91a60a55, group_id=d984fb079c4a4c0884c81e9461564d64, role_id=6a8ad8055c9d446995f93021abfda9d5)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:19.251383 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf2029e-10b5-413a-8668-41f90ec0c649 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:19.254851 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3161/6355] 10.222.0.83 () {60 vars in 1143 bytes} [Mon Aug 29 16:06:19 2022] POST /identity/v3/roles => generated 243 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:19.259548 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97072e-f353-4102-ab4c-2841f276c9a2 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:19.261551 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-bbf2029e-10b5-413a-8668-41f90ec0c649 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invalidating the token cache because role 6a8ad8055c9d446995f93021abfda9d5 was removed from group d984fb079c4a4c0884c81e9461564d64 on project d164ab66e40644b7a5697cfd91a60a55. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:19.261853 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-bbf2029e-10b5-413a-8668-41f90ec0c649 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:19.262838 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-bbf2029e-10b5-413a-8668-41f90ec0c649 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:19.287073 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3195/6356] 10.222.0.83 () {58 vars in 1470 bytes} [Mon Aug 29 16:06:19 2022] DELETE /identity/v3/projects/d164ab66e40644b7a5697cfd91a60a55/groups/d984fb079c4a4c0884c81e9461564d64/roles/6a8ad8055c9d446995f93021abfda9d5 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:19.290691 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf2029e-10b5-413a-8668-41f90ec0c649 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:19.293276 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-bbf2029e-10b5-413a-8668-41f90ec0c649 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:19.302159 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97072e-f353-4102-ab4c-2841f276c9a2 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:19.386220 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf2029e-10b5-413a-8668-41f90ec0c649 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:19.395438 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4fbed-69a7-46ec-86ee-a4e5c022359a tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:19.396338 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4fbed-69a7-46ec-86ee-a4e5c022359a tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:19.396638 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4fbed-69a7-46ec-86ee-a4e5c022359a tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:19.396932 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4fbed-69a7-46ec-86ee-a4e5c022359a tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/groups/d984fb079c4a4c0884c81e9461564d64/users/13cfa31b78294012a47ff6ba087da1f8` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:19.398852 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a4fbed-69a7-46ec-86ee-a4e5c022359a tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=d984fb079c4a4c0884c81e9461564d64, user_id=13cfa31b78294012a47ff6ba087da1f8)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:19.401396 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a4fbed-69a7-46ec-86ee-a4e5c022359a tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:19.416808 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-51a4fbed-69a7-46ec-86ee-a4e5c022359a tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '13cfa31b78294012a47ff6ba087da1f8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:19.452287 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3196/6357] 10.222.0.83 () {58 vars in 1344 bytes} [Mon Aug 29 16:06:19 2022] DELETE /identity/v3/groups/d984fb079c4a4c0884c81e9461564d64/users/13cfa31b78294012a47ff6ba087da1f8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:19.457110 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf2c76f-8e3b-4d8a-995a-e58b7d4885b1 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:19.457716 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2c76f-8e3b-4d8a-995a-e58b7d4885b1 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:19.457996 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2c76f-8e3b-4d8a-995a-e58b7d4885b1 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:19.458154 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4fbed-69a7-46ec-86ee-a4e5c022359a tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:19.458259 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2c76f-8e3b-4d8a-995a-e58b7d4885b1 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:19.458942 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf2c76f-8e3b-4d8a-995a-e58b7d4885b1 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:19.461095 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf2c76f-8e3b-4d8a-995a-e58b7d4885b1 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:19.491849 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3162/6358] 10.222.0.83 () {60 vars in 1143 bytes} [Mon Aug 29 16:06:19 2022] POST /identity/v3/roles => generated 246 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:06:19.496388 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf2c76f-8e3b-4d8a-995a-e58b7d4885b1 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:19.499602 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-baf2c76f-8e3b-4d8a-995a-e58b7d4885b1 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:19.527557 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf2c76f-8e3b-4d8a-995a-e58b7d4885b1 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:19.530998 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:19.557370 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4fbed-69a7-46ec-86ee-a4e5c022359a tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:19.562547 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24872f-fcf9-4e6b-8303-4b9781de135a tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:19.563528 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24872f-fcf9-4e6b-8303-4b9781de135a tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:19.563932 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24872f-fcf9-4e6b-8303-4b9781de135a tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:19.564325 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24872f-fcf9-4e6b-8303-4b9781de135a tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/system/groups/d984fb079c4a4c0884c81e9461564d64/roles/6a8ad8055c9d446995f93021abfda9d5` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:19.566160 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce24872f-fcf9-4e6b-8303-4b9781de135a tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=d984fb079c4a4c0884c81e9461564d64, role_id=6a8ad8055c9d446995f93021abfda9d5)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:19.567340 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-ce24872f-fcf9-4e6b-8303-4b9781de135a tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:06:19.567340 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 16:06:19.567340 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 16:06:19.568585 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce24872f-fcf9-4e6b-8303-4b9781de135a tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:19.578364 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3197/6359] 10.222.0.83 () {60 vars in 1381 bytes} [Mon Aug 29 16:06:19 2022] PUT /identity/v3/system/groups/d984fb079c4a4c0884c81e9461564d64/roles/6a8ad8055c9d446995f93021abfda9d5 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:19.580206 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24872f-fcf9-4e6b-8303-4b9781de135a tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:19.582436 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ce24872f-fcf9-4e6b-8303-4b9781de135a tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:19.603842 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605eff64-605c-4255-bd29-c5c1367cac34 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:19.604816 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605eff64-605c-4255-bd29-c5c1367cac34 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:19.605255 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605eff64-605c-4255-bd29-c5c1367cac34 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:19.605720 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605eff64-605c-4255-bd29-c5c1367cac34 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/projects/a183d59b1af947ab881f9f1ce42c83d2/users/d981293fe9924a5da6a82f51b1b685c9/roles/12cbf80f348144c0948e40020542da14` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:19.634060 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605eff64-605c-4255-bd29-c5c1367cac34 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a183d59b1af947ab881f9f1ce42c83d2, user_id=d981293fe9924a5da6a82f51b1b685c9, role_id=12cbf80f348144c0948e40020542da14)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:19.637653 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605eff64-605c-4255-bd29-c5c1367cac34 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:19.669643 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3163/6360] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:06:19 2022] PUT /identity/v3/projects/a183d59b1af947ab881f9f1ce42c83d2/users/d981293fe9924a5da6a82f51b1b685c9/roles/12cbf80f348144c0948e40020542da14 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:19.672401 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605eff64-605c-4255-bd29-c5c1367cac34 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:19.684375 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24872f-fcf9-4e6b-8303-4b9781de135a tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:19.733873 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:19.763294 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605eff64-605c-4255-bd29-c5c1367cac34 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:19.784638 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75f14f-d325-473d-b451-cecfa61019d4 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:19.786231 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75f14f-d325-473d-b451-cecfa61019d4 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:19.788140 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75f14f-d325-473d-b451-cecfa61019d4 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:19.791090 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75f14f-d325-473d-b451-cecfa61019d4 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/system/groups/d984fb079c4a4c0884c81e9461564d64/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:19.795682 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d75f14f-d325-473d-b451-cecfa61019d4 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=d984fb079c4a4c0884c81e9461564d64)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:19.799217 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-7d75f14f-d325-473d-b451-cecfa61019d4 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:06:19.799217 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 16:06:19.799217 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 16:06:19.801490 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d75f14f-d325-473d-b451-cecfa61019d4 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:19.819090 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1b9c9-b51f-4871-963b-249d871442ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:19.820290 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1b9c9-b51f-4871-963b-249d871442ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:19.820870 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1b9c9-b51f-4871-963b-249d871442ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:19.821472 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1b9c9-b51f-4871-963b-249d871442ec admin admin] PATH_INFO: `/v3/users/0c483227eeae4e819f2f771830707edd` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:19.822546 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3164/6361] 10.222.0.83 () {58 vars in 1263 bytes} [Mon Aug 29 16:06:19 2022] GET /identity/v3/system/groups/d984fb079c4a4c0884c81e9461564d64/roles => generated 376 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:06:19.823535 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75f14f-d325-473d-b451-cecfa61019d4 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:19.827879 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c1b9c9-b51f-4871-963b-249d871442ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c483227eeae4e819f2f771830707edd)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:19.832108 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c1b9c9-b51f-4871-963b-249d871442ec admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:19.903544 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-38c1b9c9-b51f-4871-963b-249d871442ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c483227eeae4e819f2f771830707edd'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:19.904967 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-38c1b9c9-b51f-4871-963b-249d871442ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c483227eeae4e819f2f771830707edd'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:19.919234 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-38c1b9c9-b51f-4871-963b-249d871442ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c483227eeae4e819f2f771830707edd'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:19.928868 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-38c1b9c9-b51f-4871-963b-249d871442ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c483227eeae4e819f2f771830707edd'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:19.929860 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-38c1b9c9-b51f-4871-963b-249d871442ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c483227eeae4e819f2f771830707edd'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:19.937824 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75f14f-d325-473d-b451-cecfa61019d4 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:19.943608 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f25747-4dbf-4b7d-bd3a-e58b9e7a4477 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:19.944466 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f25747-4dbf-4b7d-bd3a-e58b9e7a4477 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:19.944757 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f25747-4dbf-4b7d-bd3a-e58b9e7a4477 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:19.945134 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f25747-4dbf-4b7d-bd3a-e58b9e7a4477 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/projects/a183d59b1af947ab881f9f1ce42c83d2/users/d981293fe9924a5da6a82f51b1b685c9/roles/647e60a734da40e692e3c756b8d688ad` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:19.947693 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f25747-4dbf-4b7d-bd3a-e58b9e7a4477 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a183d59b1af947ab881f9f1ce42c83d2, user_id=d981293fe9924a5da6a82f51b1b685c9, role_id=647e60a734da40e692e3c756b8d688ad)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:19.950592 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f25747-4dbf-4b7d-bd3a-e58b9e7a4477 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:19.953301 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3198/6362] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:06:19 2022] DELETE /identity/v3/users/0c483227eeae4e819f2f771830707edd => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:19.954151 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1b9c9-b51f-4871-963b-249d871442ec admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:19.955803 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-38c1b9c9-b51f-4871-963b-249d871442ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:19.963474 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:19.988037 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3165/6363] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:06:19 2022] PUT /identity/v3/projects/a183d59b1af947ab881f9f1ce42c83d2/users/d981293fe9924a5da6a82f51b1b685c9/roles/647e60a734da40e692e3c756b8d688ad => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:19.989348 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03497b6-1eeb-4bc3-9c31-ec9638ca618d None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:19.991744 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03497b6-1eeb-4bc3-9c31-ec9638ca618d None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:19.991995 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03497b6-1eeb-4bc3-9c31-ec9638ca618d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:20.065544 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-b03497b6-1eeb-4bc3-9c31-ec9638ca618d None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:20.067762 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b03497b6-1eeb-4bc3-9c31-ec9638ca618d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:20.069541 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1b9c9-b51f-4871-963b-249d871442ec admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:20.176770 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460b9b2-7597-402f-be49-d2b2c2a5c7ed tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:20.178181 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460b9b2-7597-402f-be49-d2b2c2a5c7ed tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:20.179009 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460b9b2-7597-402f-be49-d2b2c2a5c7ed tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:20.179741 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460b9b2-7597-402f-be49-d2b2c2a5c7ed tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/system/groups/d984fb079c4a4c0884c81e9461564d64/roles/6a8ad8055c9d446995f93021abfda9d5` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:20.183115 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0460b9b2-7597-402f-be49-d2b2c2a5c7ed tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=d984fb079c4a4c0884c81e9461564d64, role_id=6a8ad8055c9d446995f93021abfda9d5)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:20.185061 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-0460b9b2-7597-402f-be49-d2b2c2a5c7ed tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:06:20.185061 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 16:06:20.185061 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 16:06:20.187925 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0460b9b2-7597-402f-be49-d2b2c2a5c7ed tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:20.206564 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3199/6364] 10.222.0.83 () {58 vars in 1363 bytes} [Mon Aug 29 16:06:19 2022] HEAD /identity/v3/system/groups/d984fb079c4a4c0884c81e9461564d64/roles/6a8ad8055c9d446995f93021abfda9d5 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:20.206564 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460b9b2-7597-402f-be49-d2b2c2a5c7ed tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:20.207660 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0460b9b2-7597-402f-be49-d2b2c2a5c7ed tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:20.349543 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3166/6365] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:20.355831 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03497b6-1eeb-4bc3-9c31-ec9638ca618d None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:20.376956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03497b6-1eeb-4bc3-9c31-ec9638ca618d None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:20.385129 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b54f3-c736-45cd-b56d-804816c6ed2d tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:20.386248 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b54f3-c736-45cd-b56d-804816c6ed2d tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:20.386724 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b54f3-c736-45cd-b56d-804816c6ed2d tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:20.387253 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b54f3-c736-45cd-b56d-804816c6ed2d tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/system/groups/d984fb079c4a4c0884c81e9461564d64/roles/6a8ad8055c9d446995f93021abfda9d5` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:20.390696 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b54f3-c736-45cd-b56d-804816c6ed2d tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=d984fb079c4a4c0884c81e9461564d64, role_id=6a8ad8055c9d446995f93021abfda9d5)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:20.394419 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-7d1b54f3-c736-45cd-b56d-804816c6ed2d tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:06:20.394419 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 16:06:20.394419 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 16:06:20.396252 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b54f3-c736-45cd-b56d-804816c6ed2d tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:20.421154 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3167/6366] 10.222.0.83 () {58 vars in 1365 bytes} [Mon Aug 29 16:06:20 2022] DELETE /identity/v3/system/groups/d984fb079c4a4c0884c81e9461564d64/roles/6a8ad8055c9d446995f93021abfda9d5 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:20.423162 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b54f3-c736-45cd-b56d-804816c6ed2d tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:20.425746 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7d1b54f3-c736-45cd-b56d-804816c6ed2d tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:20.456065 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460b9b2-7597-402f-be49-d2b2c2a5c7ed tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:20.467404 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465992cc-6780-4f07-ab2e-bd75d977372b tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:20.468643 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465992cc-6780-4f07-ab2e-bd75d977372b tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:20.469229 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465992cc-6780-4f07-ab2e-bd75d977372b tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:20.469800 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465992cc-6780-4f07-ab2e-bd75d977372b tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:20.471182 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465992cc-6780-4f07-ab2e-bd75d977372b tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:20.475082 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465992cc-6780-4f07-ab2e-bd75d977372b tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:20.568063 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3200/6367] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:06:20 2022] GET /identity/v3/users => generated 9048 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:06:20.568063 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465992cc-6780-4f07-ab2e-bd75d977372b tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:20.588700 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465992cc-6780-4f07-ab2e-bd75d977372b tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:20.599599 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc131da-ac67-496d-8498-de99d4a43f55 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:20.600898 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc131da-ac67-496d-8498-de99d4a43f55 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:20.601474 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc131da-ac67-496d-8498-de99d4a43f55 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:20.602061 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc131da-ac67-496d-8498-de99d4a43f55 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/domains/9c133110c6634d2180f310fd4b8d61ca/users/13cfa31b78294012a47ff6ba087da1f8/roles/6a8ad8055c9d446995f93021abfda9d5` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:20.607166 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc131da-ac67-496d-8498-de99d4a43f55 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=9c133110c6634d2180f310fd4b8d61ca, user_id=13cfa31b78294012a47ff6ba087da1f8, role_id=6a8ad8055c9d446995f93021abfda9d5)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:20.612993 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc131da-ac67-496d-8498-de99d4a43f55 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:20.647844 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3201/6368] 10.222.0.83 () {60 vars in 1480 bytes} [Mon Aug 29 16:06:20 2022] PUT /identity/v3/domains/9c133110c6634d2180f310fd4b8d61ca/users/13cfa31b78294012a47ff6ba087da1f8/roles/6a8ad8055c9d446995f93021abfda9d5 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:20.652144 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be402937-9c01-43c4-84d0-8ffa8f7aaae0 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:20.652787 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be402937-9c01-43c4-84d0-8ffa8f7aaae0 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:20.653365 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be402937-9c01-43c4-84d0-8ffa8f7aaae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:20.657549 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b54f3-c736-45cd-b56d-804816c6ed2d tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:20.715903 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:20.755152 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-be402937-9c01-43c4-84d0-8ffa8f7aaae0 None None] MFA Rules not processed for user `d981293fe9924a5da6a82f51b1b685c9`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:20.765786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-be402937-9c01-43c4-84d0-8ffa8f7aaae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:20.813695 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:20.816746 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef5be44-5cce-4120-aa81-fa82c1a32072 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:20.817417 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5be44-5cce-4120-aa81-fa82c1a32072 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:20.817928 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5be44-5cce-4120-aa81-fa82c1a32072 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:20.818503 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5be44-5cce-4120-aa81-fa82c1a32072 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:20.947777 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3202/6369] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:20 2022] POST /identity/v3/auth/tokens => generated 3277 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:20.948731 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be402937-9c01-43c4-84d0-8ffa8f7aaae0 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:20.971797 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef5be44-5cce-4120-aa81-fa82c1a32072 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:20.973416 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef5be44-5cce-4120-aa81-fa82c1a32072 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:20.995794 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3168/6370] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:06:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:06:20.997141 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7169f99-c12a-4149-ac9a-2d75501cbfc9 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:20.997442 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7169f99-c12a-4149-ac9a-2d75501cbfc9 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:20.998637 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7169f99-c12a-4149-ac9a-2d75501cbfc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:21.034905 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-b7169f99-c12a-4149-ac9a-2d75501cbfc9 None None] MFA Rules not processed for user `d981293fe9924a5da6a82f51b1b685c9`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:21.036203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b7169f99-c12a-4149-ac9a-2d75501cbfc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:21.049688 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3169/6371] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:20 2022] POST /identity/v3/auth/tokens => generated 3277 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:21.054304 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb697c7a-e1b1-4d6e-ac71-a0d167bb73a7 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:21.054593 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb697c7a-e1b1-4d6e-ac71-a0d167bb73a7 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:21.054869 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb697c7a-e1b1-4d6e-ac71-a0d167bb73a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:21.083660 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be402937-9c01-43c4-84d0-8ffa8f7aaae0 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:21.094219 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fab07d-8e1c-4e68-ac53-e7ac43b27410 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:21.096682 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fab07d-8e1c-4e68-ac53-e7ac43b27410 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:21.096985 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fab07d-8e1c-4e68-ac53-e7ac43b27410 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:21.097314 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fab07d-8e1c-4e68-ac53-e7ac43b27410 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/domains/9c133110c6634d2180f310fd4b8d61ca/users/13cfa31b78294012a47ff6ba087da1f8/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:21.099188 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-eb697c7a-e1b1-4d6e-ac71-a0d167bb73a7 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:21.099348 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fab07d-8e1c-4e68-ac53-e7ac43b27410 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=9c133110c6634d2180f310fd4b8d61ca, user_id=13cfa31b78294012a47ff6ba087da1f8)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:21.100442 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-eb697c7a-e1b1-4d6e-ac71-a0d167bb73a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:21.102395 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fab07d-8e1c-4e68-ac53-e7ac43b27410 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:21.121369 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3203/6372] 10.222.0.83 () {58 vars in 1362 bytes} [Mon Aug 29 16:06:20 2022] GET /identity/v3/domains/9c133110c6634d2180f310fd4b8d61ca/users/13cfa31b78294012a47ff6ba087da1f8/roles => generated 409 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:06:21.121369 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fab07d-8e1c-4e68-ac53-e7ac43b27410 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:21.140136 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fab07d-8e1c-4e68-ac53-e7ac43b27410 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:21.145849 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd44740-bae8-414a-a25f-f191185d3e66 tempest-TrustsV3TestJSON-206668964 tempest-user-699164670] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd981293fe9924a5da6a82f51b1b685c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a183d59b1af947ab881f9f1ce42c83d2', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-585690025', 'tempest-NotDelegatedRole-716024305'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:21.147502 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd44740-bae8-414a-a25f-f191185d3e66 tempest-TrustsV3TestJSON-206668964 tempest-user-699164670] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:21.147981 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd44740-bae8-414a-a25f-f191185d3e66 tempest-TrustsV3TestJSON-206668964 tempest-user-699164670] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:21.148355 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd44740-bae8-414a-a25f-f191185d3e66 tempest-TrustsV3TestJSON-206668964 tempest-user-699164670] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:21.149512 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd44740-bae8-414a-a25f-f191185d3e66 tempest-TrustsV3TestJSON-206668964 tempest-user-699164670] RBAC: Authorizing `identity:create_trust()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:21.151049 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd44740-bae8-414a-a25f-f191185d3e66 tempest-TrustsV3TestJSON-206668964 tempest-user-699164670] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:21.223264 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3170/6373] 10.222.0.83 () {58 vars in 967 bytes} [Mon Aug 29 16:06:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:21.224346 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb697c7a-e1b1-4d6e-ac71-a0d167bb73a7 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:21.242227 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb697c7a-e1b1-4d6e-ac71-a0d167bb73a7 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:21.249928 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4e440-2c7f-4c8d-9c06-e8ee81b571b3 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:21.251251 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4e440-2c7f-4c8d-9c06-e8ee81b571b3 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:21.251606 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4e440-2c7f-4c8d-9c06-e8ee81b571b3 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:21.252121 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4e440-2c7f-4c8d-9c06-e8ee81b571b3 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/domains/9c133110c6634d2180f310fd4b8d61ca/users/13cfa31b78294012a47ff6ba087da1f8/roles/6a8ad8055c9d446995f93021abfda9d5` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:21.254565 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a4e440-2c7f-4c8d-9c06-e8ee81b571b3 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=9c133110c6634d2180f310fd4b8d61ca, user_id=13cfa31b78294012a47ff6ba087da1f8, role_id=6a8ad8055c9d446995f93021abfda9d5)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:21.257929 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a4e440-2c7f-4c8d-9c06-e8ee81b571b3 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:21.274877 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3171/6374] 10.222.0.83 () {58 vars in 1462 bytes} [Mon Aug 29 16:06:21 2022] HEAD /identity/v3/domains/9c133110c6634d2180f310fd4b8d61ca/users/13cfa31b78294012a47ff6ba087da1f8/roles/6a8ad8055c9d446995f93021abfda9d5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:21.274877 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4e440-2c7f-4c8d-9c06-e8ee81b571b3 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:21.276659 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-19a4e440-2c7f-4c8d-9c06-e8ee81b571b3 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:21.286814 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3204/6375] 10.222.0.83 () {60 vars in 1174 bytes} [Mon Aug 29 16:06:21 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:21.287960 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd44740-bae8-414a-a25f-f191185d3e66 tempest-TrustsV3TestJSON-206668964 tempest-user-699164670] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:21.302690 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd44740-bae8-414a-a25f-f191185d3e66 tempest-TrustsV3TestJSON-206668964 tempest-user-699164670] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:21.312365 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80e3bf-4281-4fc5-97d7-a52909ed6799 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:21.313182 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80e3bf-4281-4fc5-97d7-a52909ed6799 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:21.313530 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80e3bf-4281-4fc5-97d7-a52909ed6799 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:21.313971 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80e3bf-4281-4fc5-97d7-a52909ed6799 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/domains/9c133110c6634d2180f310fd4b8d61ca/users/13cfa31b78294012a47ff6ba087da1f8/roles/6a8ad8055c9d446995f93021abfda9d5` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:21.317954 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc80e3bf-4281-4fc5-97d7-a52909ed6799 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=9c133110c6634d2180f310fd4b8d61ca, user_id=13cfa31b78294012a47ff6ba087da1f8, role_id=6a8ad8055c9d446995f93021abfda9d5)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:21.321965 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc80e3bf-4281-4fc5-97d7-a52909ed6799 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:21.332586 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-dc80e3bf-4281-4fc5-97d7-a52909ed6799 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invalidating the token cache because role 6a8ad8055c9d446995f93021abfda9d5 was removed from user 13cfa31b78294012a47ff6ba087da1f8 on domain 9c133110c6634d2180f310fd4b8d61ca. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:21.333011 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-dc80e3bf-4281-4fc5-97d7-a52909ed6799 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:21.333894 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-dc80e3bf-4281-4fc5-97d7-a52909ed6799 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:21.367168 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3205/6376] 10.222.0.83 () {58 vars in 1464 bytes} [Mon Aug 29 16:06:21 2022] DELETE /identity/v3/domains/9c133110c6634d2180f310fd4b8d61ca/users/13cfa31b78294012a47ff6ba087da1f8/roles/6a8ad8055c9d446995f93021abfda9d5 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:21.367168 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80e3bf-4281-4fc5-97d7-a52909ed6799 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:21.370690 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-dc80e3bf-4281-4fc5-97d7-a52909ed6799 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:21.406145 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:21.422048 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:21.429689 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4e440-2c7f-4c8d-9c06-e8ee81b571b3 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:21.514850 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf2d29d-02a9-4116-a50f-ca8d0771b3ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:21.515707 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2d29d-02a9-4116-a50f-ca8d0771b3ea service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:21.516130 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2d29d-02a9-4116-a50f-ca8d0771b3ea service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:21.516495 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2d29d-02a9-4116-a50f-ca8d0771b3ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:21.517835 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80e3bf-4281-4fc5-97d7-a52909ed6799 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:21.518934 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-fcf2d29d-02a9-4116-a50f-ca8d0771b3ea service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:21.531679 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3a0c46-f155-4567-8812-1a208263dc4d tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:21.532324 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a0c46-f155-4567-8812-1a208263dc4d tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:21.532610 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a0c46-f155-4567-8812-1a208263dc4d tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:21.532886 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a0c46-f155-4567-8812-1a208263dc4d tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:21.533535 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3a0c46-f155-4567-8812-1a208263dc4d tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:21.534568 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-0e3a0c46-f155-4567-8812-1a208263dc4d tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:06:21.534568 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 16:06:21.534568 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 16:06:21.539071 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3a0c46-f155-4567-8812-1a208263dc4d tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:21.553555 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3206/6377] 10.222.0.83 () {58 vars in 1155 bytes} [Mon Aug 29 16:06:21 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:06:21.554814 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3a0c46-f155-4567-8812-1a208263dc4d tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:21.561649 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0e3a0c46-f155-4567-8812-1a208263dc4d tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:21.617088 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf2d29d-02a9-4116-a50f-ca8d0771b3ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:21.619478 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf2d29d-02a9-4116-a50f-ca8d0771b3ea service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:21.632451 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3172/6378] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 16:06:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:06:21.634497 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf2d29d-02a9-4116-a50f-ca8d0771b3ea service swift] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:21.636811 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-fcf2d29d-02a9-4116-a50f-ca8d0771b3ea service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:21.759312 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf2d29d-02a9-4116-a50f-ca8d0771b3ea service swift] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:21.769962 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dbc9e2-90bd-4761-bf52-5f445f181885 tempest-TrustsV3TestJSON-206668964 tempest-user-699164670] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd981293fe9924a5da6a82f51b1b685c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a183d59b1af947ab881f9f1ce42c83d2', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-585690025', 'tempest-NotDelegatedRole-716024305'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:21.770752 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dbc9e2-90bd-4761-bf52-5f445f181885 tempest-TrustsV3TestJSON-206668964 tempest-user-699164670] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:21.771409 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dbc9e2-90bd-4761-bf52-5f445f181885 tempest-TrustsV3TestJSON-206668964 tempest-user-699164670] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:21.771864 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dbc9e2-90bd-4761-bf52-5f445f181885 tempest-TrustsV3TestJSON-206668964 tempest-user-699164670] PATH_INFO: `/v3/OS-TRUST/trusts/755b67a87eee467fa54c8e0243c939db` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:21.780236 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3a0c46-f155-4567-8812-1a208263dc4d tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:21.788285 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a8d9e-066a-4cf8-a702-a4a97dbfcddd tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:21.789448 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a8d9e-066a-4cf8-a702-a4a97dbfcddd tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:21.789919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a8d9e-066a-4cf8-a702-a4a97dbfcddd tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:21.790432 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a8d9e-066a-4cf8-a702-a4a97dbfcddd tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/projects/d164ab66e40644b7a5697cfd91a60a55/users/13cfa31b78294012a47ff6ba087da1f8/roles/6a8ad8055c9d446995f93021abfda9d5` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:21.793705 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a8d9e-066a-4cf8-a702-a4a97dbfcddd tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d164ab66e40644b7a5697cfd91a60a55, user_id=13cfa31b78294012a47ff6ba087da1f8, role_id=6a8ad8055c9d446995f93021abfda9d5)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:21.798739 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a8d9e-066a-4cf8-a702-a4a97dbfcddd tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:21.823595 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3207/6379] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:06:21 2022] PUT /identity/v3/projects/d164ab66e40644b7a5697cfd91a60a55/users/13cfa31b78294012a47ff6ba087da1f8/roles/6a8ad8055c9d446995f93021abfda9d5 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:21.825454 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a8d9e-066a-4cf8-a702-a4a97dbfcddd tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:21.828661 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dbc9e2-90bd-4761-bf52-5f445f181885 tempest-TrustsV3TestJSON-206668964 tempest-user-699164670] RBAC: Authorizing `identity:delete_trust(trust_id=755b67a87eee467fa54c8e0243c939db)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:21.831747 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-fb0a8d9e-066a-4cf8-a702-a4a97dbfcddd tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:21.834553 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dbc9e2-90bd-4761-bf52-5f445f181885 tempest-TrustsV3TestJSON-206668964 tempest-user-699164670] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:21.897500 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b4dbc9e2-90bd-4761-bf52-5f445f181885 tempest-TrustsV3TestJSON-206668964 tempest-user-699164670] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '755b67a87eee467fa54c8e0243c939db', 'request_id': 'req-b4dbc9e2-90bd-4761-bf52-5f445f181885'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:21.898495 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b4dbc9e2-90bd-4761-bf52-5f445f181885 tempest-TrustsV3TestJSON-206668964 tempest-user-699164670] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '755b67a87eee467fa54c8e0243c939db', 'request_id': 'req-b4dbc9e2-90bd-4761-bf52-5f445f181885'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:21.899353 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b4dbc9e2-90bd-4761-bf52-5f445f181885 tempest-TrustsV3TestJSON-206668964 tempest-user-699164670] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '755b67a87eee467fa54c8e0243c939db', 'request_id': 'req-b4dbc9e2-90bd-4761-bf52-5f445f181885'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:21.928430 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3173/6380] 10.222.0.83 () {58 vars in 1254 bytes} [Mon Aug 29 16:06:21 2022] DELETE /identity/v3/OS-TRUST/trusts/755b67a87eee467fa54c8e0243c939db => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:21.928430 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dbc9e2-90bd-4761-bf52-5f445f181885 tempest-TrustsV3TestJSON-206668964 tempest-user-699164670] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:21.930643 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b4dbc9e2-90bd-4761-bf52-5f445f181885 tempest-TrustsV3TestJSON-206668964 tempest-user-699164670] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:21.963062 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dbc9e2-90bd-4761-bf52-5f445f181885 tempest-TrustsV3TestJSON-206668964 tempest-user-699164670] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:21.983178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:22.041456 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a8d9e-066a-4cf8-a702-a4a97dbfcddd tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:22.068671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7facd-7ab0-4035-89a4-3b804f5dc440 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:22.069345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7facd-7ab0-4035-89a4-3b804f5dc440 service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:22.069632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7facd-7ab0-4035-89a4-3b804f5dc440 service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:22.072964 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7facd-7ab0-4035-89a4-3b804f5dc440 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:22.081741 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-28a7facd-7ab0-4035-89a4-3b804f5dc440 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:22.119210 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a7facd-7ab0-4035-89a4-3b804f5dc440 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:22.124224 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a7facd-7ab0-4035-89a4-3b804f5dc440 service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:22.126255 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9e738-6ea4-456e-a672-405f55a01dbb tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:22.127349 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9e738-6ea4-456e-a672-405f55a01dbb tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:22.128152 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9e738-6ea4-456e-a672-405f55a01dbb tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:22.128152 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9e738-6ea4-456e-a672-405f55a01dbb tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/projects/d164ab66e40644b7a5697cfd91a60a55/users/13cfa31b78294012a47ff6ba087da1f8/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:22.130088 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b9e738-6ea4-456e-a672-405f55a01dbb tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:list_grants(project_id=d164ab66e40644b7a5697cfd91a60a55, user_id=13cfa31b78294012a47ff6ba087da1f8)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:22.134135 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b9e738-6ea4-456e-a672-405f55a01dbb tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:22.150728 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3208/6381] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:06:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:06:22.157223 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3174/6382] 10.222.0.83 () {58 vars in 1365 bytes} [Mon Aug 29 16:06:21 2022] GET /identity/v3/projects/d164ab66e40644b7a5697cfd91a60a55/users/13cfa31b78294012a47ff6ba087da1f8/roles => generated 410 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:06:22.161518 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9e738-6ea4-456e-a672-405f55a01dbb tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:22.162286 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7facd-7ab0-4035-89a4-3b804f5dc440 service placement] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:22.165596 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-90b9e738-6ea4-456e-a672-405f55a01dbb tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:22.166122 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-28a7facd-7ab0-4035-89a4-3b804f5dc440 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:22.244786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:22.276195 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9e738-6ea4-456e-a672-405f55a01dbb tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:22.277842 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7facd-7ab0-4035-89a4-3b804f5dc440 service placement] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:22.282586 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54424c7-9c82-4cd9-9b9c-b86abdd83bdb tempest-TrustsV3TestJSON-206668964 tempest-user-699164670] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd981293fe9924a5da6a82f51b1b685c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a183d59b1af947ab881f9f1ce42c83d2', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-585690025', 'tempest-NotDelegatedRole-716024305'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:22.283289 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54424c7-9c82-4cd9-9b9c-b86abdd83bdb tempest-TrustsV3TestJSON-206668964 tempest-user-699164670] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:22.283572 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54424c7-9c82-4cd9-9b9c-b86abdd83bdb tempest-TrustsV3TestJSON-206668964 tempest-user-699164670] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:22.283849 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54424c7-9c82-4cd9-9b9c-b86abdd83bdb tempest-TrustsV3TestJSON-206668964 tempest-user-699164670] PATH_INFO: `/v3/OS-TRUST/trusts/755b67a87eee467fa54c8e0243c939db` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:22.286537 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007609f5-1c62-4c9e-8b9b-eff798935a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:22.287560 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007609f5-1c62-4c9e-8b9b-eff798935a8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:22.288079 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007609f5-1c62-4c9e-8b9b-eff798935a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:22.288561 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007609f5-1c62-4c9e-8b9b-eff798935a8c admin admin] PATH_INFO: `/v3/projects/5d9f9eeb56554ad28775050a34ffb450` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:22.290118 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007609f5-1c62-4c9e-8b9b-eff798935a8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d9f9eeb56554ad28775050a34ffb450)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:22.292686 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007609f5-1c62-4c9e-8b9b-eff798935a8c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:22.311601 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-b54424c7-9c82-4cd9-9b9c-b86abdd83bdb tempest-TrustsV3TestJSON-206668964 tempest-user-699164670] Could not find trust: 755b67a87eee467fa54c8e0243c939db.: keystone.exception.TrustNotFound: Could not find trust: 755b67a87eee467fa54c8e0243c939db. Aug 29 16:06:22.311601 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:06:22.311601 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:06:22.311601 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:06:22.311601 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:06:22.311601 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:06:22.311601 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:06:22.311601 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:06:22.311601 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:06:22.311601 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:06:22.311601 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:06:22.311601 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:06:22.311601 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 29 16:06:22.311601 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 29 16:06:22.311601 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 29 16:06:22.312762 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 29 16:06:22.312762 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 29 16:06:22.312762 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 29 16:06:22.312762 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 29 16:06:22.312762 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 29 16:06:22.312762 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:06:22.312762 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:06:22.312762 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 29 16:06:22.312762 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 29 16:06:22.312762 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 29 16:06:22.312762 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 29 16:06:22.312762 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 755b67a87eee467fa54c8e0243c939db. Aug 29 16:06:22.312762 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:06:22.318487 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3175/6383] 10.222.0.83 () {58 vars in 1251 bytes} [Mon Aug 29 16:06:22 2022] GET /identity/v3/OS-TRUST/trusts/755b67a87eee467fa54c8e0243c939db => generated 111 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 16:06:22.320029 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54424c7-9c82-4cd9-9b9c-b86abdd83bdb tempest-TrustsV3TestJSON-206668964 tempest-user-699164670] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:22.334332 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54424c7-9c82-4cd9-9b9c-b86abdd83bdb tempest-TrustsV3TestJSON-206668964 tempest-user-699164670] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:22.339373 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b0406-1f2e-4ca1-9cbd-8c44821150ee tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:22.340361 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b0406-1f2e-4ca1-9cbd-8c44821150ee tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:22.340726 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b0406-1f2e-4ca1-9cbd-8c44821150ee tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:22.341045 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b0406-1f2e-4ca1-9cbd-8c44821150ee tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/projects/d164ab66e40644b7a5697cfd91a60a55/users/13cfa31b78294012a47ff6ba087da1f8/roles/6a8ad8055c9d446995f93021abfda9d5` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:22.343570 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284b0406-1f2e-4ca1-9cbd-8c44821150ee tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:check_grant(project_id=d164ab66e40644b7a5697cfd91a60a55, user_id=13cfa31b78294012a47ff6ba087da1f8, role_id=6a8ad8055c9d446995f93021abfda9d5)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:22.347752 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284b0406-1f2e-4ca1-9cbd-8c44821150ee tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:22.361683 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3176/6384] 10.222.0.83 () {58 vars in 1465 bytes} [Mon Aug 29 16:06:22 2022] HEAD /identity/v3/projects/d164ab66e40644b7a5697cfd91a60a55/users/13cfa31b78294012a47ff6ba087da1f8/roles/6a8ad8055c9d446995f93021abfda9d5 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:22.363790 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3429ca8-63f3-408f-a288-91f0d4f1b0cc None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:22.364735 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3429ca8-63f3-408f-a288-91f0d4f1b0cc None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:22.365197 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3429ca8-63f3-408f-a288-91f0d4f1b0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:22.386517 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-007609f5-1c62-4c9e-8b9b-eff798935a8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d9f9eeb56554ad28775050a34ffb450', 'request_id': 'req-007609f5-1c62-4c9e-8b9b-eff798935a8c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:22.394610 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-b3429ca8-63f3-408f-a288-91f0d4f1b0cc None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:22.396437 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b3429ca8-63f3-408f-a288-91f0d4f1b0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:22.398912 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-007609f5-1c62-4c9e-8b9b-eff798935a8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d9f9eeb56554ad28775050a34ffb450', 'request_id': 'req-007609f5-1c62-4c9e-8b9b-eff798935a8c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:22.412339 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-007609f5-1c62-4c9e-8b9b-eff798935a8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d9f9eeb56554ad28775050a34ffb450', 'request_id': 'req-007609f5-1c62-4c9e-8b9b-eff798935a8c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:22.443056 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-007609f5-1c62-4c9e-8b9b-eff798935a8c admin admin] The token cache is being invalidate because project 5d9f9eeb56554ad28775050a34ffb450 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:22.443056 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-007609f5-1c62-4c9e-8b9b-eff798935a8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:22.446593 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-007609f5-1c62-4c9e-8b9b-eff798935a8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:22.447911 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3209/6385] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:06:22 2022] DELETE /identity/v3/projects/5d9f9eeb56554ad28775050a34ffb450 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:22.448825 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007609f5-1c62-4c9e-8b9b-eff798935a8c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:22.452279 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-007609f5-1c62-4c9e-8b9b-eff798935a8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:22.516601 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3177/6386] 10.222.0.83 () {58 vars in 967 bytes} [Mon Aug 29 16:06:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:22.518997 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3429ca8-63f3-408f-a288-91f0d4f1b0cc None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:22.520859 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b3429ca8-63f3-408f-a288-91f0d4f1b0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:22.582043 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:22.594093 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007609f5-1c62-4c9e-8b9b-eff798935a8c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:22.600417 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fadcf4-120c-4535-9be9-18c5cc16b8f3 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:22.601311 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fadcf4-120c-4535-9be9-18c5cc16b8f3 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:22.601695 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fadcf4-120c-4535-9be9-18c5cc16b8f3 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:22.602074 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fadcf4-120c-4535-9be9-18c5cc16b8f3 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/roles/647e60a734da40e692e3c756b8d688ad` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:22.603866 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fadcf4-120c-4535-9be9-18c5cc16b8f3 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:delete_role(role_id=647e60a734da40e692e3c756b8d688ad)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:22.605621 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fadcf4-120c-4535-9be9-18c5cc16b8f3 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:22.617309 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3429ca8-63f3-408f-a288-91f0d4f1b0cc None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:22.630675 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aaecc6-84f5-4559-9f5d-f077f0ea0f23 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:22.632013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aaecc6-84f5-4559-9f5d-f077f0ea0f23 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:22.632492 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aaecc6-84f5-4559-9f5d-f077f0ea0f23 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:22.633469 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aaecc6-84f5-4559-9f5d-f077f0ea0f23 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/projects/d164ab66e40644b7a5697cfd91a60a55/users/13cfa31b78294012a47ff6ba087da1f8/roles/6a8ad8055c9d446995f93021abfda9d5` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:22.636715 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aaecc6-84f5-4559-9f5d-f077f0ea0f23 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=d164ab66e40644b7a5697cfd91a60a55, user_id=13cfa31b78294012a47ff6ba087da1f8, role_id=6a8ad8055c9d446995f93021abfda9d5)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:22.640463 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aaecc6-84f5-4559-9f5d-f077f0ea0f23 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:22.648470 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-58aaecc6-84f5-4559-9f5d-f077f0ea0f23 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invalidating the token cache because role 6a8ad8055c9d446995f93021abfda9d5 was removed from user 13cfa31b78294012a47ff6ba087da1f8 on project d164ab66e40644b7a5697cfd91a60a55. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:22.648765 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-58aaecc6-84f5-4559-9f5d-f077f0ea0f23 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:22.649577 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-58aaecc6-84f5-4559-9f5d-f077f0ea0f23 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:22.657369 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e9fadcf4-120c-4535-9be9-18c5cc16b8f3 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invalidating the token cache because role 647e60a734da40e692e3c756b8d688ad has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:22.657845 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e9fadcf4-120c-4535-9be9-18c5cc16b8f3 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:22.658592 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e9fadcf4-120c-4535-9be9-18c5cc16b8f3 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:22.661088 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3210/6387] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:06:22 2022] DELETE /identity/v3/roles/647e60a734da40e692e3c756b8d688ad => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:22.662636 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785cb56f-aac6-4f27-8ff5-2806a3aca802 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:22.663195 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785cb56f-aac6-4f27-8ff5-2806a3aca802 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:22.663479 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785cb56f-aac6-4f27-8ff5-2806a3aca802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:22.664876 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3178/6388] 10.222.0.83 () {58 vars in 1467 bytes} [Mon Aug 29 16:06:22 2022] DELETE /identity/v3/projects/d164ab66e40644b7a5697cfd91a60a55/users/13cfa31b78294012a47ff6ba087da1f8/roles/6a8ad8055c9d446995f93021abfda9d5 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:22.665666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aaecc6-84f5-4559-9f5d-f077f0ea0f23 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:22.667770 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-58aaecc6-84f5-4559-9f5d-f077f0ea0f23 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:22.706141 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-785cb56f-aac6-4f27-8ff5-2806a3aca802 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:22.706141 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-785cb56f-aac6-4f27-8ff5-2806a3aca802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:22.739135 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:22.773696 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aaecc6-84f5-4559-9f5d-f077f0ea0f23 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:22.788402 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3211/6389] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:22.797413 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785cb56f-aac6-4f27-8ff5-2806a3aca802 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:22.799179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-785cb56f-aac6-4f27-8ff5-2806a3aca802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:22.853087 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97063beb-081c-4d59-ab43-4b3b5e59caf1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:22.853800 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97063beb-081c-4d59-ab43-4b3b5e59caf1 service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:22.854086 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97063beb-081c-4d59-ab43-4b3b5e59caf1 service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:22.854359 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97063beb-081c-4d59-ab43-4b3b5e59caf1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:22.856507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-97063beb-081c-4d59-ab43-4b3b5e59caf1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:22.881358 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785cb56f-aac6-4f27-8ff5-2806a3aca802 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:22.886798 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6cfa18-5653-4ee4-9537-cdcb5cdbaf38 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:22.889695 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6cfa18-5653-4ee4-9537-cdcb5cdbaf38 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:22.890317 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6cfa18-5653-4ee4-9537-cdcb5cdbaf38 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:22.890788 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6cfa18-5653-4ee4-9537-cdcb5cdbaf38 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/roles/12cbf80f348144c0948e40020542da14` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:22.892651 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6cfa18-5653-4ee4-9537-cdcb5cdbaf38 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:delete_role(role_id=12cbf80f348144c0948e40020542da14)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:22.894480 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6cfa18-5653-4ee4-9537-cdcb5cdbaf38 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:22.938409 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97063beb-081c-4d59-ab43-4b3b5e59caf1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:22.940066 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97063beb-081c-4d59-ab43-4b3b5e59caf1 service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:22.946107 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0a6cfa18-5653-4ee4-9537-cdcb5cdbaf38 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invalidating the token cache because role 12cbf80f348144c0948e40020542da14 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:22.946627 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0a6cfa18-5653-4ee4-9537-cdcb5cdbaf38 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:22.947599 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0a6cfa18-5653-4ee4-9537-cdcb5cdbaf38 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:22.949781 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3212/6390] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:06:22 2022] DELETE /identity/v3/roles/12cbf80f348144c0948e40020542da14 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:22.950607 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6cfa18-5653-4ee4-9537-cdcb5cdbaf38 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:22.953683 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0a6cfa18-5653-4ee4-9537-cdcb5cdbaf38 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:22.954272 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3179/6391] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 16:06:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:06:22.955681 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b78f8b-7d73-4af9-8624-d5a9bf1b266e None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:22.956061 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b78f8b-7d73-4af9-8624-d5a9bf1b266e None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:22.956336 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b78f8b-7d73-4af9-8624-d5a9bf1b266e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:22.990495 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-13b78f8b-7d73-4af9-8624-d5a9bf1b266e None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:22.991745 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-13b78f8b-7d73-4af9-8624-d5a9bf1b266e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:23.002839 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:23.096191 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6cfa18-5653-4ee4-9537-cdcb5cdbaf38 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:23.112298 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1756ca-5e74-4dda-b8a4-2d317c322d89 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:23.113073 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1756ca-5e74-4dda-b8a4-2d317c322d89 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:23.113449 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1756ca-5e74-4dda-b8a4-2d317c322d89 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:23.113819 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1756ca-5e74-4dda-b8a4-2d317c322d89 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/system/users/13cfa31b78294012a47ff6ba087da1f8/roles/6a8ad8055c9d446995f93021abfda9d5` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:23.130565 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1756ca-5e74-4dda-b8a4-2d317c322d89 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=13cfa31b78294012a47ff6ba087da1f8, role_id=6a8ad8055c9d446995f93021abfda9d5)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:23.130565 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-6e1756ca-5e74-4dda-b8a4-2d317c322d89 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:06:23.130565 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 16:06:23.130565 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 16:06:23.131712 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3180/6392] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:23.132431 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1756ca-5e74-4dda-b8a4-2d317c322d89 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:23.133136 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b78f8b-7d73-4af9-8624-d5a9bf1b266e None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:23.134898 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-13b78f8b-7d73-4af9-8624-d5a9bf1b266e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:23.169410 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3213/6393] 10.222.0.83 () {60 vars in 1378 bytes} [Mon Aug 29 16:06:22 2022] PUT /identity/v3/system/users/13cfa31b78294012a47ff6ba087da1f8/roles/6a8ad8055c9d446995f93021abfda9d5 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:23.175372 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1756ca-5e74-4dda-b8a4-2d317c322d89 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:23.200396 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1756ca-5e74-4dda-b8a4-2d317c322d89 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:23.215401 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a021c6d-35b7-48d9-ba02-700cd5abb6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:23.215997 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a021c6d-35b7-48d9-ba02-700cd5abb6e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:23.216288 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a021c6d-35b7-48d9-ba02-700cd5abb6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:23.220594 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a021c6d-35b7-48d9-ba02-700cd5abb6e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:23.221317 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a021c6d-35b7-48d9-ba02-700cd5abb6e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:06:23.221683 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a021c6d-35b7-48d9-ba02-700cd5abb6e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:23.223358 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a021c6d-35b7-48d9-ba02-700cd5abb6e6 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:23.260719 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3214/6394] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:06:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:06:23.262225 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a021c6d-35b7-48d9-ba02-700cd5abb6e6 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:23.277058 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a021c6d-35b7-48d9-ba02-700cd5abb6e6 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:23.285718 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21756646-9a94-4810-be11-d4b7d533a076 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:23.287579 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21756646-9a94-4810-be11-d4b7d533a076 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:23.288080 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21756646-9a94-4810-be11-d4b7d533a076 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:23.288816 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21756646-9a94-4810-be11-d4b7d533a076 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/system/users/13cfa31b78294012a47ff6ba087da1f8/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:23.291454 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21756646-9a94-4810-be11-d4b7d533a076 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=13cfa31b78294012a47ff6ba087da1f8)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:23.293376 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-21756646-9a94-4810-be11-d4b7d533a076 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:06:23.293376 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 16:06:23.293376 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 16:06:23.295371 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21756646-9a94-4810-be11-d4b7d533a076 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:23.298373 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b78f8b-7d73-4af9-8624-d5a9bf1b266e None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:23.314061 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3215/6395] 10.222.0.83 () {58 vars in 1260 bytes} [Mon Aug 29 16:06:23 2022] GET /identity/v3/system/users/13cfa31b78294012a47ff6ba087da1f8/roles => generated 375 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:06:23.314731 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa32a86-419b-41c3-afc5-8ec8ea36defd tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:23.315475 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa32a86-419b-41c3-afc5-8ec8ea36defd tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:23.315763 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa32a86-419b-41c3-afc5-8ec8ea36defd tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:23.316038 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa32a86-419b-41c3-afc5-8ec8ea36defd tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/users/d981293fe9924a5da6a82f51b1b685c9` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:23.316413 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21756646-9a94-4810-be11-d4b7d533a076 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:23.318708 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa32a86-419b-41c3-afc5-8ec8ea36defd tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d981293fe9924a5da6a82f51b1b685c9)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:23.324620 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa32a86-419b-41c3-afc5-8ec8ea36defd tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:23.334811 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21756646-9a94-4810-be11-d4b7d533a076 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:23.342343 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305e4d0-83a3-46d9-ad80-7919a1b524bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:23.343395 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305e4d0-83a3-46d9-ad80-7919a1b524bb admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:23.344818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305e4d0-83a3-46d9-ad80-7919a1b524bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:23.345302 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305e4d0-83a3-46d9-ad80-7919a1b524bb admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:23.346629 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e305e4d0-83a3-46d9-ad80-7919a1b524bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:23.364472 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e305e4d0-83a3-46d9-ad80-7919a1b524bb admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:23.389083 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:23.431008 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3216/6396] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:06:23 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:23.432268 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305e4d0-83a3-46d9-ad80-7919a1b524bb admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:23.491574 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3aa32a86-419b-41c3-afc5-8ec8ea36defd tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd981293fe9924a5da6a82f51b1b685c9'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:23.493587 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3aa32a86-419b-41c3-afc5-8ec8ea36defd tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd981293fe9924a5da6a82f51b1b685c9'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:23.515628 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3aa32a86-419b-41c3-afc5-8ec8ea36defd tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd981293fe9924a5da6a82f51b1b685c9'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:23.532550 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3aa32a86-419b-41c3-afc5-8ec8ea36defd tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd981293fe9924a5da6a82f51b1b685c9'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:23.548424 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3aa32a86-419b-41c3-afc5-8ec8ea36defd tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd981293fe9924a5da6a82f51b1b685c9'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:23.576563 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3181/6397] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:06:23 2022] DELETE /identity/v3/users/d981293fe9924a5da6a82f51b1b685c9 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:23.577655 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa32a86-419b-41c3-afc5-8ec8ea36defd tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:23.579914 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3aa32a86-419b-41c3-afc5-8ec8ea36defd tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:23.690540 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305e4d0-83a3-46d9-ad80-7919a1b524bb admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:23.714111 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:23.865941 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa32a86-419b-41c3-afc5-8ec8ea36defd tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:23.881370 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37244556-950e-4911-8615-b83496261d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:23.882816 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37244556-950e-4911-8615-b83496261d84 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:23.883541 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37244556-950e-4911-8615-b83496261d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:23.884251 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37244556-950e-4911-8615-b83496261d84 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:23.885653 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37244556-950e-4911-8615-b83496261d84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:23.891840 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37244556-950e-4911-8615-b83496261d84 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:23.900199 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837fc8e-3e0d-4587-9b16-88697e51ea52 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:23.915401 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837fc8e-3e0d-4587-9b16-88697e51ea52 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:23.915692 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837fc8e-3e0d-4587-9b16-88697e51ea52 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:23.915983 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837fc8e-3e0d-4587-9b16-88697e51ea52 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/system/users/13cfa31b78294012a47ff6ba087da1f8/roles/6a8ad8055c9d446995f93021abfda9d5` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:23.919070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a837fc8e-3e0d-4587-9b16-88697e51ea52 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=13cfa31b78294012a47ff6ba087da1f8, role_id=6a8ad8055c9d446995f93021abfda9d5)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:23.920688 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-a837fc8e-3e0d-4587-9b16-88697e51ea52 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:06:23.920688 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 16:06:23.920688 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 16:06:23.926330 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a837fc8e-3e0d-4587-9b16-88697e51ea52 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:23.940366 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3217/6398] 10.222.0.83 () {58 vars in 1360 bytes} [Mon Aug 29 16:06:23 2022] HEAD /identity/v3/system/users/13cfa31b78294012a47ff6ba087da1f8/roles/6a8ad8055c9d446995f93021abfda9d5 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:23.941313 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837fc8e-3e0d-4587-9b16-88697e51ea52 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:23.946166 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a837fc8e-3e0d-4587-9b16-88697e51ea52 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:23.965841 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3182/6399] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:06:23 2022] POST /identity/v3/users => generated 287 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:23.971360 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37244556-950e-4911-8615-b83496261d84 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:23.974788 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-37244556-950e-4911-8615-b83496261d84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:24.020842 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37244556-950e-4911-8615-b83496261d84 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:24.042089 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58731a52-8e9e-482c-ae33-958b52df6c38 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:24.044193 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58731a52-8e9e-482c-ae33-958b52df6c38 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:24.047110 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58731a52-8e9e-482c-ae33-958b52df6c38 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:24.047612 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58731a52-8e9e-482c-ae33-958b52df6c38 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/system/users/13cfa31b78294012a47ff6ba087da1f8/roles/6a8ad8055c9d446995f93021abfda9d5` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:24.051552 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58731a52-8e9e-482c-ae33-958b52df6c38 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=13cfa31b78294012a47ff6ba087da1f8, role_id=6a8ad8055c9d446995f93021abfda9d5)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:24.056493 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-58731a52-8e9e-482c-ae33-958b52df6c38 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:06:24.056493 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 16:06:24.056493 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 16:06:24.064218 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58731a52-8e9e-482c-ae33-958b52df6c38 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:24.083932 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3183/6400] 10.222.0.83 () {58 vars in 1362 bytes} [Mon Aug 29 16:06:23 2022] DELETE /identity/v3/system/users/13cfa31b78294012a47ff6ba087da1f8/roles/6a8ad8055c9d446995f93021abfda9d5 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:24.084975 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58731a52-8e9e-482c-ae33-958b52df6c38 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:24.112061 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837fc8e-3e0d-4587-9b16-88697e51ea52 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:24.115397 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58731a52-8e9e-482c-ae33-958b52df6c38 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:24.124230 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce31e3-ab15-4790-ad9b-f74cf8c0ade1 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:24.127938 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce31e3-ab15-4790-ad9b-f74cf8c0ade1 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:24.128234 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce31e3-ab15-4790-ad9b-f74cf8c0ade1 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:24.128515 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce31e3-ab15-4790-ad9b-f74cf8c0ade1 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/projects/a183d59b1af947ab881f9f1ce42c83d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:24.130132 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ce31e3-ab15-4790-ad9b-f74cf8c0ade1 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a183d59b1af947ab881f9f1ce42c83d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:24.131317 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32ee2b-fb52-44fc-858a-dee04709fa8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:24.132233 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ce31e3-ab15-4790-ad9b-f74cf8c0ade1 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:24.133036 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32ee2b-fb52-44fc-858a-dee04709fa8d admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:24.133461 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32ee2b-fb52-44fc-858a-dee04709fa8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:24.133854 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32ee2b-fb52-44fc-858a-dee04709fa8d admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:24.135067 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd32ee2b-fb52-44fc-858a-dee04709fa8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:24.139423 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd32ee2b-fb52-44fc-858a-dee04709fa8d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:24.170478 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3184/6401] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:06:24 2022] GET /identity/v3/roles => generated 2324 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:06:24.176775 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32ee2b-fb52-44fc-858a-dee04709fa8d admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:24.220006 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32ee2b-fb52-44fc-858a-dee04709fa8d admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:24.233214 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb81be-8aa6-4606-8e48-ee7be717ff3d tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:24.234809 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb81be-8aa6-4606-8e48-ee7be717ff3d tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:24.235117 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb81be-8aa6-4606-8e48-ee7be717ff3d tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:24.236690 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb81be-8aa6-4606-8e48-ee7be717ff3d tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:24.241078 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbb81be-8aa6-4606-8e48-ee7be717ff3d tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:24.242751 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:24.244670 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbb81be-8aa6-4606-8e48-ee7be717ff3d tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:24.286129 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-29ce31e3-ab15-4790-ad9b-f74cf8c0ade1 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a183d59b1af947ab881f9f1ce42c83d2', 'request_id': 'req-29ce31e3-ab15-4790-ad9b-f74cf8c0ade1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:24.292628 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3185/6402] 10.222.0.83 () {60 vars in 1143 bytes} [Mon Aug 29 16:06:24 2022] POST /identity/v3/roles => generated 269 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:24.293625 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb81be-8aa6-4606-8e48-ee7be717ff3d tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:24.299381 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-29ce31e3-ab15-4790-ad9b-f74cf8c0ade1 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a183d59b1af947ab881f9f1ce42c83d2', 'request_id': 'req-29ce31e3-ab15-4790-ad9b-f74cf8c0ade1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:24.306930 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-29ce31e3-ab15-4790-ad9b-f74cf8c0ade1 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a183d59b1af947ab881f9f1ce42c83d2', 'request_id': 'req-29ce31e3-ab15-4790-ad9b-f74cf8c0ade1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:24.337785 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb81be-8aa6-4606-8e48-ee7be717ff3d tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:24.362688 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-29ce31e3-ab15-4790-ad9b-f74cf8c0ade1 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] The token cache is being invalidate because project a183d59b1af947ab881f9f1ce42c83d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:24.362984 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-29ce31e3-ab15-4790-ad9b-f74cf8c0ade1 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:24.363709 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-29ce31e3-ab15-4790-ad9b-f74cf8c0ade1 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:24.365498 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3218/6403] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:06:23 2022] DELETE /identity/v3/projects/a183d59b1af947ab881f9f1ce42c83d2 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:24.366178 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce31e3-ab15-4790-ad9b-f74cf8c0ade1 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:24.367564 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-29ce31e3-ab15-4790-ad9b-f74cf8c0ade1 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:24.527954 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f15ce-c161-4bbd-b466-fc3d110398ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:24.528608 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f15ce-c161-4bbd-b466-fc3d110398ab admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:24.528929 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f15ce-c161-4bbd-b466-fc3d110398ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:24.529204 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f15ce-c161-4bbd-b466-fc3d110398ab admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:24.530016 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6f15ce-c161-4bbd-b466-fc3d110398ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:24.532313 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6f15ce-c161-4bbd-b466-fc3d110398ab admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:24.549778 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3186/6404] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:06:24 2022] GET /identity/v3/roles => generated 2324 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:06:24.549778 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f15ce-c161-4bbd-b466-fc3d110398ab admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:24.550086 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-aa6f15ce-c161-4bbd-b466-fc3d110398ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:24.563048 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce31e3-ab15-4790-ad9b-f74cf8c0ade1 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:24.568714 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a8df4-2f32-451b-becb-947c4d6cc054 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:24.569340 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a8df4-2f32-451b-becb-947c4d6cc054 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:24.569626 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a8df4-2f32-451b-becb-947c4d6cc054 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:24.569902 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a8df4-2f32-451b-becb-947c4d6cc054 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:24.570649 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a8df4-2f32-451b-becb-947c4d6cc054 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:24.572469 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a8df4-2f32-451b-becb-947c4d6cc054 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:24.612199 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3219/6405] 10.222.0.83 () {60 vars in 1143 bytes} [Mon Aug 29 16:06:24 2022] POST /identity/v3/roles => generated 269 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:24.614819 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a8df4-2f32-451b-becb-947c4d6cc054 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:24.617876 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f86a8df4-2f32-451b-becb-947c4d6cc054 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:24.642996 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a8df4-2f32-451b-becb-947c4d6cc054 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:24.650162 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa6849e-af7c-452c-b101-f83d47e2e219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:24.650863 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6849e-af7c-452c-b101-f83d47e2e219 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:24.651348 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6849e-af7c-452c-b101-f83d47e2e219 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:24.651627 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6849e-af7c-452c-b101-f83d47e2e219 admin admin] PATH_INFO: `/v3/projects/3e18c8f49fef4b79b9b9dfa05bec73a0/users/4de4105e1d104fd3a2301272eadb7d57/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:24.676104 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa6849e-af7c-452c-b101-f83d47e2e219 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e18c8f49fef4b79b9b9dfa05bec73a0, user_id=4de4105e1d104fd3a2301272eadb7d57, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:24.680312 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa6849e-af7c-452c-b101-f83d47e2e219 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:24.719328 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3220/6406] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:06:24 2022] PUT /identity/v3/projects/3e18c8f49fef4b79b9b9dfa05bec73a0/users/4de4105e1d104fd3a2301272eadb7d57/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:24.720538 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f15ce-c161-4bbd-b466-fc3d110398ab admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:24.729793 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa6849e-af7c-452c-b101-f83d47e2e219 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:24.778510 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:24.864156 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff03e0-2b8c-4706-833d-738f77879485 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:24.864803 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff03e0-2b8c-4706-833d-738f77879485 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:24.865082 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff03e0-2b8c-4706-833d-738f77879485 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:24.865354 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff03e0-2b8c-4706-833d-738f77879485 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:24.866141 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff03e0-2b8c-4706-833d-738f77879485 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:24.868099 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff03e0-2b8c-4706-833d-738f77879485 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:24.940310 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3187/6407] 10.222.0.83 () {60 vars in 1152 bytes} [Mon Aug 29 16:06:24 2022] POST /identity/v3/projects => generated 328 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:24.941788 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175d164-a9b7-44e3-9013-6cabeee09dd0 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:24.944385 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175d164-a9b7-44e3-9013-6cabeee09dd0 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:24.944868 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175d164-a9b7-44e3-9013-6cabeee09dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:25.000133 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa6849e-af7c-452c-b101-f83d47e2e219 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:25.014051 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-9175d164-a9b7-44e3-9013-6cabeee09dd0 None None] MFA Rules not processed for user `4de4105e1d104fd3a2301272eadb7d57`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:25.016533 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9175d164-a9b7-44e3-9013-6cabeee09dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:25.117325 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:UPDATE=1,keystone:DELETE=4,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:25.149995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92504530-ce63-42cf-b48b-cfc0dc5d9833 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:25.150677 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92504530-ce63-42cf-b48b-cfc0dc5d9833 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:25.150964 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92504530-ce63-42cf-b48b-cfc0dc5d9833 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:25.151294 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92504530-ce63-42cf-b48b-cfc0dc5d9833 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles/14ed599305ab4f07853513d18342d419/implies/b1b6d3b52afe4ea0bdbc991b8af64b99` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:25.153698 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92504530-ce63-42cf-b48b-cfc0dc5d9833 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=14ed599305ab4f07853513d18342d419, implied_role_id=b1b6d3b52afe4ea0bdbc991b8af64b99)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:25.156854 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92504530-ce63-42cf-b48b-cfc0dc5d9833 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:25.212192 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3221/6408] 10.222.0.83 () {60 vars in 1363 bytes} [Mon Aug 29 16:06:24 2022] PUT /identity/v3/roles/14ed599305ab4f07853513d18342d419/implies/b1b6d3b52afe4ea0bdbc991b8af64b99 => generated 529 bytes in 484 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:25.214591 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92504530-ce63-42cf-b48b-cfc0dc5d9833 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:25.233456 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3188/6409] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:25.234453 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175d164-a9b7-44e3-9013-6cabeee09dd0 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:25.272822 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175d164-a9b7-44e3-9013-6cabeee09dd0 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:25.356399 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b75043-f7af-4f07-9630-8fe5ac5bbed9 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:25.358620 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b75043-f7af-4f07-9630-8fe5ac5bbed9 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:25.359302 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b75043-f7af-4f07-9630-8fe5ac5bbed9 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:25.359730 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b75043-f7af-4f07-9630-8fe5ac5bbed9 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:25.361334 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b75043-f7af-4f07-9630-8fe5ac5bbed9 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:25.363674 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b75043-f7af-4f07-9630-8fe5ac5bbed9 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:25.370081 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92504530-ce63-42cf-b48b-cfc0dc5d9833 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:25.384362 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c87a03-11e0-4fdf-8f90-39a0af8e3a73 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:25.385046 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c87a03-11e0-4fdf-8f90-39a0af8e3a73 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:25.385432 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c87a03-11e0-4fdf-8f90-39a0af8e3a73 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:25.386334 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c87a03-11e0-4fdf-8f90-39a0af8e3a73 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:25.386689 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c87a03-11e0-4fdf-8f90-39a0af8e3a73 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:25.389265 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c87a03-11e0-4fdf-8f90-39a0af8e3a73 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:25.406511 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3189/6410] 10.222.0.83 () {60 vars in 1149 bytes} [Mon Aug 29 16:06:25 2022] POST /identity/v3/domains => generated 277 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:25.407706 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b75043-f7af-4f07-9630-8fe5ac5bbed9 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:25.411058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b9b75043-f7af-4f07-9630-8fe5ac5bbed9 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:25.428247 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3222/6411] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:06:25 2022] POST /identity/v3/users => generated 416 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:25.432347 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c87a03-11e0-4fdf-8f90-39a0af8e3a73 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:25.458872 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c87a03-11e0-4fdf-8f90-39a0af8e3a73 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:25.521700 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:25.587791 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b75043-f7af-4f07-9630-8fe5ac5bbed9 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:25.594360 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e04fb0-18a8-4031-8618-ccc323320677 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:25.595150 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e04fb0-18a8-4031-8618-ccc323320677 service cinder] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:25.595651 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e04fb0-18a8-4031-8618-ccc323320677 service cinder] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:25.595934 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e04fb0-18a8-4031-8618-ccc323320677 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:25.633937 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4bd21-8ecc-4413-8226-912a17a7481b tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:25.634615 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4bd21-8ecc-4413-8226-912a17a7481b tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:25.634922 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4bd21-8ecc-4413-8226-912a17a7481b tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:25.635965 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4bd21-8ecc-4413-8226-912a17a7481b tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:25.636558 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c4bd21-8ecc-4413-8226-912a17a7481b tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:25.640355 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c4bd21-8ecc-4413-8226-912a17a7481b tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:25.671718 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3223/6412] 10.222.0.83 () {60 vars in 1143 bytes} [Mon Aug 29 16:06:25 2022] POST /identity/v3/roles => generated 269 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:25.672815 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4bd21-8ecc-4413-8226-912a17a7481b tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:25.757480 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e04fb0-18a8-4031-8618-ccc323320677 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:25.759687 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e04fb0-18a8-4031-8618-ccc323320677 service cinder] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:25.773801 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3190/6413] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:06:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:06:25.775197 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e04fb0-18a8-4031-8618-ccc323320677 service cinder] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:25.790942 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e04fb0-18a8-4031-8618-ccc323320677 service cinder] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:25.798513 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e29427-bf25-4533-816f-47f6ca8bb01d tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:25.800329 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e29427-bf25-4533-816f-47f6ca8bb01d tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:25.800723 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e29427-bf25-4533-816f-47f6ca8bb01d tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:25.801200 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e29427-bf25-4533-816f-47f6ca8bb01d tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles/14ed599305ab4f07853513d18342d419/implies/bc8a288831d447919cd6b7a2eb3d764d` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:25.804472 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e29427-bf25-4533-816f-47f6ca8bb01d tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=14ed599305ab4f07853513d18342d419, implied_role_id=bc8a288831d447919cd6b7a2eb3d764d)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:25.805882 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-b9e29427-bf25-4533-816f-47f6ca8bb01d tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:06:25.805882 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 16:06:25.805882 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 16:06:25.807977 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e29427-bf25-4533-816f-47f6ca8bb01d tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:25.829062 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:25.862616 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4bd21-8ecc-4413-8226-912a17a7481b tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:25.883823 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3191/6414] 10.222.0.83 () {60 vars in 1363 bytes} [Mon Aug 29 16:06:25 2022] PUT /identity/v3/roles/14ed599305ab4f07853513d18342d419/implies/bc8a288831d447919cd6b7a2eb3d764d => generated 529 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:25.891182 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e29427-bf25-4533-816f-47f6ca8bb01d tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:26.049924 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f144c55-8f94-4e6b-aea9-b8a723f4a98a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:26.050559 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f144c55-8f94-4e6b-aea9-b8a723f4a98a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:26.050975 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f144c55-8f94-4e6b-aea9-b8a723f4a98a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:26.051413 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f144c55-8f94-4e6b-aea9-b8a723f4a98a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:26.052106 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f144c55-8f94-4e6b-aea9-b8a723f4a98a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:26.053899 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f144c55-8f94-4e6b-aea9-b8a723f4a98a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:26.063264 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e29427-bf25-4533-816f-47f6ca8bb01d tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:26.071596 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1d624-2049-4d9a-a635-5efb4d861b32 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:26.072935 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1d624-2049-4d9a-a635-5efb4d861b32 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:26.073510 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1d624-2049-4d9a-a635-5efb4d861b32 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:26.074010 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1d624-2049-4d9a-a635-5efb4d861b32 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles/14ed599305ab4f07853513d18342d419/implies/6a8ad8055c9d446995f93021abfda9d5` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:26.077160 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d1d624-2049-4d9a-a635-5efb4d861b32 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=14ed599305ab4f07853513d18342d419, implied_role_id=6a8ad8055c9d446995f93021abfda9d5)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:26.079785 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d1d624-2049-4d9a-a635-5efb4d861b32 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:26.098661 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3224/6415] 10.222.0.83 () {60 vars in 1143 bytes} [Mon Aug 29 16:06:25 2022] POST /identity/v3/roles => generated 244 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:26.105249 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f144c55-8f94-4e6b-aea9-b8a723f4a98a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:26.113619 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3192/6416] 10.222.0.83 () {60 vars in 1363 bytes} [Mon Aug 29 16:06:25 2022] PUT /identity/v3/roles/14ed599305ab4f07853513d18342d419/implies/6a8ad8055c9d446995f93021abfda9d5 => generated 525 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:26.120422 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1d624-2049-4d9a-a635-5efb4d861b32 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:26.153999 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f144c55-8f94-4e6b-aea9-b8a723f4a98a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:26.233698 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:26.272169 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1d624-2049-4d9a-a635-5efb4d861b32 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:26.287080 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17dce8-1594-4418-b210-b4c73fa7487f tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:26.288209 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17dce8-1594-4418-b210-b4c73fa7487f tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:26.290217 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17dce8-1594-4418-b210-b4c73fa7487f tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:26.290733 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17dce8-1594-4418-b210-b4c73fa7487f tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles/6a8ad8055c9d446995f93021abfda9d5/implies/14ed599305ab4f07853513d18342d419` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:26.296116 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a17dce8-1594-4418-b210-b4c73fa7487f tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=6a8ad8055c9d446995f93021abfda9d5, implied_role_id=14ed599305ab4f07853513d18342d419)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:26.302240 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a17dce8-1594-4418-b210-b4c73fa7487f tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:26.377628 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-9a17dce8-1594-4418-b210-b4c73fa7487f tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] 14ed599305ab4f07853513d18342d419 cannot be an implied roles.: keystone.exception.InvalidImpliedRole: 14ed599305ab4f07853513d18342d419 cannot be an implied roles. Aug 29 16:06:26.377628 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:06:26.377628 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:06:26.377628 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:06:26.377628 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:06:26.377628 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:06:26.377628 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:06:26.377628 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:06:26.377628 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:06:26.377628 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:06:26.377628 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:06:26.377628 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:06:26.377628 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 259, in put Aug 29 16:06:26.377628 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application PROVIDERS.role_api.create_implied_role(prior_role_id, implied_role_id) Aug 29 16:06:26.378919 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:06:26.378919 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:06:26.378919 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1361, in create_implied_role Aug 29 16:06:26.378919 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.InvalidImpliedRole(msg, Aug 29 16:06:26.378919 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.InvalidImpliedRole: 14ed599305ab4f07853513d18342d419 cannot be an implied roles. Aug 29 16:06:26.378919 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:06:26.379598 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3193/6417] 10.222.0.83 () {60 vars in 1363 bytes} [Mon Aug 29 16:06:26 2022] PUT /identity/v3/roles/6a8ad8055c9d446995f93021abfda9d5/implies/14ed599305ab4f07853513d18342d419 => generated 116 bytes in 262 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Aug 29 16:06:26.381640 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17dce8-1594-4418-b210-b4c73fa7487f tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:26.384120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9a17dce8-1594-4418-b210-b4c73fa7487f tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:26.386748 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b8d87-6e52-46ef-95c5-caca9357c046 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:26.387435 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b8d87-6e52-46ef-95c5-caca9357c046 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:26.387724 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b8d87-6e52-46ef-95c5-caca9357c046 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:26.388081 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b8d87-6e52-46ef-95c5-caca9357c046 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:26.388992 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2b8d87-6e52-46ef-95c5-caca9357c046 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:26.390845 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2b8d87-6e52-46ef-95c5-caca9357c046 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:26.511382 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3225/6418] 10.222.0.83 () {60 vars in 1143 bytes} [Mon Aug 29 16:06:26 2022] POST /identity/v3/roles => generated 246 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:06:26.516083 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b8d87-6e52-46ef-95c5-caca9357c046 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:26.552472 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b8d87-6e52-46ef-95c5-caca9357c046 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:26.563938 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab0a70-8adf-4e55-bc21-b495d9101a7f tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:26.564820 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab0a70-8adf-4e55-bc21-b495d9101a7f tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:26.565117 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab0a70-8adf-4e55-bc21-b495d9101a7f tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:26.566128 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab0a70-8adf-4e55-bc21-b495d9101a7f tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles/14ed599305ab4f07853513d18342d419/implies/6a8ad8055c9d446995f93021abfda9d5` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:26.568987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cab0a70-8adf-4e55-bc21-b495d9101a7f tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=14ed599305ab4f07853513d18342d419, implied_role_id=6a8ad8055c9d446995f93021abfda9d5)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:26.577389 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cab0a70-8adf-4e55-bc21-b495d9101a7f tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:26.596543 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3226/6419] 10.222.0.83 () {58 vars in 1347 bytes} [Mon Aug 29 16:06:26 2022] DELETE /identity/v3/roles/14ed599305ab4f07853513d18342d419/implies/6a8ad8055c9d446995f93021abfda9d5 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:26.597778 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab0a70-8adf-4e55-bc21-b495d9101a7f tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:26.616723 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17dce8-1594-4418-b210-b4c73fa7487f tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:26.841270 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb15f05-556c-4dc0-913c-b1cf3b9b5b6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:26.842695 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb15f05-556c-4dc0-913c-b1cf3b9b5b6e service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:26.843000 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb15f05-556c-4dc0-913c-b1cf3b9b5b6e service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:26.843404 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb15f05-556c-4dc0-913c-b1cf3b9b5b6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:26.854013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5cb15f05-556c-4dc0-913c-b1cf3b9b5b6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:26.867350 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab0a70-8adf-4e55-bc21-b495d9101a7f tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:26.906620 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d2ca5-89b4-4e9e-9865-6659dfbdafe8 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:26.907683 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d2ca5-89b4-4e9e-9865-6659dfbdafe8 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:26.908014 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d2ca5-89b4-4e9e-9865-6659dfbdafe8 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:26.910027 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d2ca5-89b4-4e9e-9865-6659dfbdafe8 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/projects/a037676e493b437d92685f75ad9ad6f3/users/c309d14d6e39433195778efa26a28309/roles/fae5c522d3744578b3c31744c3520bf0` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:26.974291 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:26.980275 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d2ca5-89b4-4e9e-9865-6659dfbdafe8 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a037676e493b437d92685f75ad9ad6f3, user_id=c309d14d6e39433195778efa26a28309, role_id=fae5c522d3744578b3c31744c3520bf0)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:26.984797 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d2ca5-89b4-4e9e-9865-6659dfbdafe8 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:27.014734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb15f05-556c-4dc0-913c-b1cf3b9b5b6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:27.019931 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb15f05-556c-4dc0-913c-b1cf3b9b5b6e service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:27.040351 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3227/6420] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:06:26 2022] PUT /identity/v3/projects/a037676e493b437d92685f75ad9ad6f3/users/c309d14d6e39433195778efa26a28309/roles/fae5c522d3744578b3c31744c3520bf0 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:27.041301 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d2ca5-89b4-4e9e-9865-6659dfbdafe8 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:27.052593 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:27.071915 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3194/6421] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:06:26 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 690 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:06:27.072856 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb15f05-556c-4dc0-913c-b1cf3b9b5b6e service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:27.099415 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb15f05-556c-4dc0-913c-b1cf3b9b5b6e service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:27.197046 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d2ca5-89b4-4e9e-9865-6659dfbdafe8 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:27.205813 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26cb329-411c-46a5-bad6-879c5d7c9026 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:27.206765 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26cb329-411c-46a5-bad6-879c5d7c9026 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:27.207225 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26cb329-411c-46a5-bad6-879c5d7c9026 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:27.207646 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26cb329-411c-46a5-bad6-879c5d7c9026 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles/14ed599305ab4f07853513d18342d419/implies/bc8a288831d447919cd6b7a2eb3d764d` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:27.210531 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26cb329-411c-46a5-bad6-879c5d7c9026 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=14ed599305ab4f07853513d18342d419, implied_role_id=bc8a288831d447919cd6b7a2eb3d764d)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:27.212342 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26cb329-411c-46a5-bad6-879c5d7c9026 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:27.236739 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3228/6422] 10.222.0.83 () {58 vars in 1347 bytes} [Mon Aug 29 16:06:27 2022] DELETE /identity/v3/roles/14ed599305ab4f07853513d18342d419/implies/bc8a288831d447919cd6b7a2eb3d764d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:27.239744 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26cb329-411c-46a5-bad6-879c5d7c9026 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:27.300468 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718414ce-1767-4b39-b70e-e255499612a3 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:27.301149 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718414ce-1767-4b39-b70e-e255499612a3 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:27.309753 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718414ce-1767-4b39-b70e-e255499612a3 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:27.309753 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718414ce-1767-4b39-b70e-e255499612a3 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/projects/a037676e493b437d92685f75ad9ad6f3/users/c309d14d6e39433195778efa26a28309/roles/aa8eea8715e14a4996f1eec3cafc6f3b` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:27.319438 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718414ce-1767-4b39-b70e-e255499612a3 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a037676e493b437d92685f75ad9ad6f3, user_id=c309d14d6e39433195778efa26a28309, role_id=aa8eea8715e14a4996f1eec3cafc6f3b)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:27.339656 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718414ce-1767-4b39-b70e-e255499612a3 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:27.387432 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3195/6423] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:06:27 2022] PUT /identity/v3/projects/a037676e493b437d92685f75ad9ad6f3/users/c309d14d6e39433195778efa26a28309/roles/aa8eea8715e14a4996f1eec3cafc6f3b => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:27.392573 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718414ce-1767-4b39-b70e-e255499612a3 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:27.401145 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-718414ce-1767-4b39-b70e-e255499612a3 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:27.511725 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26cb329-411c-46a5-bad6-879c5d7c9026 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:27.753021 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718414ce-1767-4b39-b70e-e255499612a3 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:27.764072 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9fef77-435f-4d5e-8315-b07f920a12ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:27.765520 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9fef77-435f-4d5e-8315-b07f920a12ba service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:27.766526 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9fef77-435f-4d5e-8315-b07f920a12ba service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:27.767605 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9fef77-435f-4d5e-8315-b07f920a12ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:27.771522 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e0ad0-830d-40c5-b5f2-a8a66fc58c15 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:27.772193 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e0ad0-830d-40c5-b5f2-a8a66fc58c15 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:27.772479 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e0ad0-830d-40c5-b5f2-a8a66fc58c15 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:27.772752 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e0ad0-830d-40c5-b5f2-a8a66fc58c15 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles/bc8a288831d447919cd6b7a2eb3d764d` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:27.773947 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0f9fef77-435f-4d5e-8315-b07f920a12ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:27.782322 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0e0ad0-830d-40c5-b5f2-a8a66fc58c15 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=bc8a288831d447919cd6b7a2eb3d764d)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:27.785567 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0e0ad0-830d-40c5-b5f2-a8a66fc58c15 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:27.877303 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:27.886744 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0a0e0ad0-830d-40c5-b5f2-a8a66fc58c15 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invalidating the token cache because role bc8a288831d447919cd6b7a2eb3d764d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:27.887329 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0a0e0ad0-830d-40c5-b5f2-a8a66fc58c15 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:27.891803 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0a0e0ad0-830d-40c5-b5f2-a8a66fc58c15 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:27.900646 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3229/6424] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:06:27 2022] DELETE /identity/v3/roles/bc8a288831d447919cd6b7a2eb3d764d => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:27.900646 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e0ad0-830d-40c5-b5f2-a8a66fc58c15 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:27.902197 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0a0e0ad0-830d-40c5-b5f2-a8a66fc58c15 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:27.974110 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9fef77-435f-4d5e-8315-b07f920a12ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:28.000764 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9fef77-435f-4d5e-8315-b07f920a12ba service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:28.078201 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e0ad0-830d-40c5-b5f2-a8a66fc58c15 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:28.088990 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3478d1-0d81-41e8-b4bc-fe2a3cead430 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:28.090048 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3478d1-0d81-41e8-b4bc-fe2a3cead430 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:28.090304 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3478d1-0d81-41e8-b4bc-fe2a3cead430 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:28.090591 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3478d1-0d81-41e8-b4bc-fe2a3cead430 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:28.093402 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3478d1-0d81-41e8-b4bc-fe2a3cead430 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:28.103891 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3196/6425] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:06:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 716 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:06:28.104881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9fef77-435f-4d5e-8315-b07f920a12ba service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:28.119282 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3478d1-0d81-41e8-b4bc-fe2a3cead430 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:28.172417 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9fef77-435f-4d5e-8315-b07f920a12ba service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:28.225262 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3230/6426] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:06:27 2022] GET /identity/v3/users => generated 9329 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:06:28.240623 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d26416-b29d-45f1-ba69-5d355da7b3df None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:28.240938 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d26416-b29d-45f1-ba69-5d355da7b3df None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:28.241425 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d26416-b29d-45f1-ba69-5d355da7b3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:28.312694 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:28.322239 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-83d26416-b29d-45f1-ba69-5d355da7b3df None None] MFA Rules not processed for user `c309d14d6e39433195778efa26a28309`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:28.324330 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-83d26416-b29d-45f1-ba69-5d355da7b3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:28.409564 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4fc739-0de1-4cc3-97a8-c92052aaded7 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:28.412509 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fc739-0de1-4cc3-97a8-c92052aaded7 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:28.415503 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fc739-0de1-4cc3-97a8-c92052aaded7 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:28.418857 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fc739-0de1-4cc3-97a8-c92052aaded7 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/domains/b956b9b0059449fc8883a0032bf362b1` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:28.461238 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4fc739-0de1-4cc3-97a8-c92052aaded7 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=b956b9b0059449fc8883a0032bf362b1)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:28.464543 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4fc739-0de1-4cc3-97a8-c92052aaded7 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:28.490557 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5d4fc739-0de1-4cc3-97a8-c92052aaded7 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'b956b9b0059449fc8883a0032bf362b1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:28.490838 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3231/6427] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:28 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:28.492369 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5d4fc739-0de1-4cc3-97a8-c92052aaded7 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'b956b9b0059449fc8883a0032bf362b1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:28.502628 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092a6e1-a850-49f2-9b84-f46a5d3e0d66 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:28.502982 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092a6e1-a850-49f2-9b84-f46a5d3e0d66 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:28.503399 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092a6e1-a850-49f2-9b84-f46a5d3e0d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:28.523946 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5d4fc739-0de1-4cc3-97a8-c92052aaded7 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'b956b9b0059449fc8883a0032bf362b1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:28.525078 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5d4fc739-0de1-4cc3-97a8-c92052aaded7 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'b956b9b0059449fc8883a0032bf362b1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:28.536738 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3197/6428] 10.222.0.83 () {60 vars in 1249 bytes} [Mon Aug 29 16:06:28 2022] PATCH /identity/v3/domains/b956b9b0059449fc8883a0032bf362b1 => generated 278 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:06:28.538043 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4fc739-0de1-4cc3-97a8-c92052aaded7 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:28.545086 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5d4fc739-0de1-4cc3-97a8-c92052aaded7 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:28.551844 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-1092a6e1-a850-49f2-9b84-f46a5d3e0d66 None None] MFA Rules not processed for user `c309d14d6e39433195778efa26a28309`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:28.553108 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1092a6e1-a850-49f2-9b84-f46a5d3e0d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:28.722876 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4fc739-0de1-4cc3-97a8-c92052aaded7 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:28.741530 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716016f-7a0e-48cb-914b-7c2cfee3c451 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:28.746724 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716016f-7a0e-48cb-914b-7c2cfee3c451 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:28.747017 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716016f-7a0e-48cb-914b-7c2cfee3c451 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:28.748049 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716016f-7a0e-48cb-914b-7c2cfee3c451 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/domains/b956b9b0059449fc8883a0032bf362b1` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:28.765141 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3232/6429] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:28 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:28.766384 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092a6e1-a850-49f2-9b84-f46a5d3e0d66 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:28.783939 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b716016f-7a0e-48cb-914b-7c2cfee3c451 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b956b9b0059449fc8883a0032bf362b1)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:28.784420 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092a6e1-a850-49f2-9b84-f46a5d3e0d66 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:28.789491 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b716016f-7a0e-48cb-914b-7c2cfee3c451 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:28.798880 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db43a2-b2f5-4d15-b234-ed842b913a5e tempest-TrustsV3TestJSON-582084361 tempest-user-1024707457] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c309d14d6e39433195778efa26a28309', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a037676e493b437d92685f75ad9ad6f3', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1302722748', 'tempest-NotDelegatedRole-662352652'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:28.799538 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db43a2-b2f5-4d15-b234-ed842b913a5e tempest-TrustsV3TestJSON-582084361 tempest-user-1024707457] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:28.799820 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db43a2-b2f5-4d15-b234-ed842b913a5e tempest-TrustsV3TestJSON-582084361 tempest-user-1024707457] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:28.800071 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db43a2-b2f5-4d15-b234-ed842b913a5e tempest-TrustsV3TestJSON-582084361 tempest-user-1024707457] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:28.800737 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db43a2-b2f5-4d15-b234-ed842b913a5e tempest-TrustsV3TestJSON-582084361 tempest-user-1024707457] RBAC: Authorizing `identity:create_trust()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:28.801904 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db43a2-b2f5-4d15-b234-ed842b913a5e tempest-TrustsV3TestJSON-582084361 tempest-user-1024707457] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:28.849044 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:28.881773 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b716016f-7a0e-48cb-914b-7c2cfee3c451 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b956b9b0059449fc8883a0032bf362b1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:28.888556 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b716016f-7a0e-48cb-914b-7c2cfee3c451 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b956b9b0059449fc8883a0032bf362b1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:28.998982 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3233/6430] 10.222.0.83 () {60 vars in 1174 bytes} [Mon Aug 29 16:06:28 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:28.999677 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b716016f-7a0e-48cb-914b-7c2cfee3c451 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b956b9b0059449fc8883a0032bf362b1', 'request_id': 'req-b716016f-7a0e-48cb-914b-7c2cfee3c451'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:29.000545 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db43a2-b2f5-4d15-b234-ed842b913a5e tempest-TrustsV3TestJSON-582084361 tempest-user-1024707457] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:29.014042 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b716016f-7a0e-48cb-914b-7c2cfee3c451 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b956b9b0059449fc8883a0032bf362b1', 'request_id': 'req-b716016f-7a0e-48cb-914b-7c2cfee3c451'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:29.020397 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:29.023966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db43a2-b2f5-4d15-b234-ed842b913a5e tempest-TrustsV3TestJSON-582084361 tempest-user-1024707457] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:29.029130 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b716016f-7a0e-48cb-914b-7c2cfee3c451 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b956b9b0059449fc8883a0032bf362b1', 'request_id': 'req-b716016f-7a0e-48cb-914b-7c2cfee3c451'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:29.055449 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b716016f-7a0e-48cb-914b-7c2cfee3c451 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] The token cache is being invalidate because project b956b9b0059449fc8883a0032bf362b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:29.055748 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b716016f-7a0e-48cb-914b-7c2cfee3c451 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:29.057462 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b716016f-7a0e-48cb-914b-7c2cfee3c451 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:29.074978 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b716016f-7a0e-48cb-914b-7c2cfee3c451 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b956b9b0059449fc8883a0032bf362b1', 'request_id': 'req-b716016f-7a0e-48cb-914b-7c2cfee3c451'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:29.079587 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b716016f-7a0e-48cb-914b-7c2cfee3c451 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b956b9b0059449fc8883a0032bf362b1', 'request_id': 'req-b716016f-7a0e-48cb-914b-7c2cfee3c451'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:29.080716 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b716016f-7a0e-48cb-914b-7c2cfee3c451 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b956b9b0059449fc8883a0032bf362b1', 'request_id': 'req-b716016f-7a0e-48cb-914b-7c2cfee3c451'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:29.104265 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3198/6431] 10.222.0.83 () {58 vars in 1230 bytes} [Mon Aug 29 16:06:28 2022] DELETE /identity/v3/domains/b956b9b0059449fc8883a0032bf362b1 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:29.111513 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716016f-7a0e-48cb-914b-7c2cfee3c451 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:29.112998 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b716016f-7a0e-48cb-914b-7c2cfee3c451 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:29.233278 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddacfeac-bb23-4438-9511-afe4420dd195 tempest-TrustsV3TestJSON-582084361 tempest-user-1024707457] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c309d14d6e39433195778efa26a28309', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a037676e493b437d92685f75ad9ad6f3', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1302722748', 'tempest-NotDelegatedRole-662352652'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:29.236220 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddacfeac-bb23-4438-9511-afe4420dd195 tempest-TrustsV3TestJSON-582084361 tempest-user-1024707457] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:29.238137 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddacfeac-bb23-4438-9511-afe4420dd195 tempest-TrustsV3TestJSON-582084361 tempest-user-1024707457] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:29.238794 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddacfeac-bb23-4438-9511-afe4420dd195 tempest-TrustsV3TestJSON-582084361 tempest-user-1024707457] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:29.239742 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddacfeac-bb23-4438-9511-afe4420dd195 tempest-TrustsV3TestJSON-582084361 tempest-user-1024707457] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:29.241486 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddacfeac-bb23-4438-9511-afe4420dd195 tempest-TrustsV3TestJSON-582084361 tempest-user-1024707457] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:29.259155 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3234/6432] 10.222.0.83 () {58 vars in 1252 bytes} [Mon Aug 29 16:06:28 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=c309d14d6e39433195778efa26a28309 => generated 611 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:06:29.263480 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddacfeac-bb23-4438-9511-afe4420dd195 tempest-TrustsV3TestJSON-582084361 tempest-user-1024707457] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:29.265927 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ddacfeac-bb23-4438-9511-afe4420dd195 tempest-TrustsV3TestJSON-582084361 tempest-user-1024707457] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:29.275327 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716016f-7a0e-48cb-914b-7c2cfee3c451 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:29.292522 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddacfeac-bb23-4438-9511-afe4420dd195 tempest-TrustsV3TestJSON-582084361 tempest-user-1024707457] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:29.298405 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a731c-58f0-4dc3-b5ef-1343a6a17f98 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:29.301450 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a731c-58f0-4dc3-b5ef-1343a6a17f98 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:29.301757 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a731c-58f0-4dc3-b5ef-1343a6a17f98 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:29.302044 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a731c-58f0-4dc3-b5ef-1343a6a17f98 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles/14ed599305ab4f07853513d18342d419/implies/b1b6d3b52afe4ea0bdbc991b8af64b99` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:29.308356 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c876f190-a9ec-44cc-8507-6546d677119a tempest-TrustsV3TestJSON-582084361 tempest-user-1024707457] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c309d14d6e39433195778efa26a28309', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a037676e493b437d92685f75ad9ad6f3', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1302722748', 'tempest-NotDelegatedRole-662352652'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:29.310234 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a731c-58f0-4dc3-b5ef-1343a6a17f98 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=14ed599305ab4f07853513d18342d419, implied_role_id=b1b6d3b52afe4ea0bdbc991b8af64b99)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:29.310527 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876f190-a9ec-44cc-8507-6546d677119a tempest-TrustsV3TestJSON-582084361 tempest-user-1024707457] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:29.310621 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-be4a731c-58f0-4dc3-b5ef-1343a6a17f98 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:06:29.310621 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 16:06:29.310621 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 16:06:29.312233 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a731c-58f0-4dc3-b5ef-1343a6a17f98 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:29.316446 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876f190-a9ec-44cc-8507-6546d677119a tempest-TrustsV3TestJSON-582084361 tempest-user-1024707457] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:29.317043 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876f190-a9ec-44cc-8507-6546d677119a tempest-TrustsV3TestJSON-582084361 tempest-user-1024707457] PATH_INFO: `/v3/OS-TRUST/trusts/2a15ff406e2e4844986d7012b8fc6db7` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:29.345457 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3199/6433] 10.222.0.83 () {58 vars in 1347 bytes} [Mon Aug 29 16:06:29 2022] DELETE /identity/v3/roles/14ed599305ab4f07853513d18342d419/implies/b1b6d3b52afe4ea0bdbc991b8af64b99 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:29.348232 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f591f0-256a-4978-9599-4907b8df7f1d None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:29.348515 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f591f0-256a-4978-9599-4907b8df7f1d None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:29.352444 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f591f0-256a-4978-9599-4907b8df7f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:29.359557 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c876f190-a9ec-44cc-8507-6546d677119a tempest-TrustsV3TestJSON-582084361 tempest-user-1024707457] RBAC: Authorizing `identity:delete_trust(trust_id=2a15ff406e2e4844986d7012b8fc6db7)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:29.365392 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c876f190-a9ec-44cc-8507-6546d677119a tempest-TrustsV3TestJSON-582084361 tempest-user-1024707457] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:29.399638 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-b0f591f0-256a-4978-9599-4907b8df7f1d None None] MFA Rules not processed for user `4de4105e1d104fd3a2301272eadb7d57`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:29.400890 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b0f591f0-256a-4978-9599-4907b8df7f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:29.437772 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c876f190-a9ec-44cc-8507-6546d677119a tempest-TrustsV3TestJSON-582084361 tempest-user-1024707457] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '2a15ff406e2e4844986d7012b8fc6db7', 'request_id': 'req-c876f190-a9ec-44cc-8507-6546d677119a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:29.438975 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c876f190-a9ec-44cc-8507-6546d677119a tempest-TrustsV3TestJSON-582084361 tempest-user-1024707457] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '2a15ff406e2e4844986d7012b8fc6db7', 'request_id': 'req-c876f190-a9ec-44cc-8507-6546d677119a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:29.439907 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c876f190-a9ec-44cc-8507-6546d677119a tempest-TrustsV3TestJSON-582084361 tempest-user-1024707457] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '2a15ff406e2e4844986d7012b8fc6db7', 'request_id': 'req-c876f190-a9ec-44cc-8507-6546d677119a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:29.479721 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3235/6434] 10.222.0.83 () {58 vars in 1254 bytes} [Mon Aug 29 16:06:29 2022] DELETE /identity/v3/OS-TRUST/trusts/2a15ff406e2e4844986d7012b8fc6db7 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:29.484847 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c876f190-a9ec-44cc-8507-6546d677119a tempest-TrustsV3TestJSON-582084361 tempest-user-1024707457] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:29.490879 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c876f190-a9ec-44cc-8507-6546d677119a tempest-TrustsV3TestJSON-582084361 tempest-user-1024707457] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:29.520720 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c876f190-a9ec-44cc-8507-6546d677119a tempest-TrustsV3TestJSON-582084361 tempest-user-1024707457] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:29.598029 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3200/6435] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:29.600639 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f591f0-256a-4978-9599-4907b8df7f1d None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:29.626520 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b0f591f0-256a-4978-9599-4907b8df7f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:29.770846 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a3e01-4d28-4b8c-ade0-cf913cad1de2 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:29.772055 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a3e01-4d28-4b8c-ade0-cf913cad1de2 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:29.772566 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a3e01-4d28-4b8c-ade0-cf913cad1de2 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:29.773319 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a3e01-4d28-4b8c-ade0-cf913cad1de2 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles/b1b6d3b52afe4ea0bdbc991b8af64b99` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:29.783182 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a3e01-4d28-4b8c-ade0-cf913cad1de2 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=b1b6d3b52afe4ea0bdbc991b8af64b99)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:29.793571 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a3e01-4d28-4b8c-ade0-cf913cad1de2 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:29.848324 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:29.867261 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f591f0-256a-4978-9599-4907b8df7f1d None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:29.895128 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17642a-a6da-43d8-bdb7-841b5b193627 tempest-TrustsV3TestJSON-582084361 tempest-user-1024707457] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c309d14d6e39433195778efa26a28309', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a037676e493b437d92685f75ad9ad6f3', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1302722748', 'tempest-NotDelegatedRole-662352652'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:29.896434 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17642a-a6da-43d8-bdb7-841b5b193627 tempest-TrustsV3TestJSON-582084361 tempest-user-1024707457] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:29.896927 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17642a-a6da-43d8-bdb7-841b5b193627 tempest-TrustsV3TestJSON-582084361 tempest-user-1024707457] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:29.897439 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17642a-a6da-43d8-bdb7-841b5b193627 tempest-TrustsV3TestJSON-582084361 tempest-user-1024707457] PATH_INFO: `/v3/OS-TRUST/trusts/2a15ff406e2e4844986d7012b8fc6db7` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:29.910695 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6f4a3e01-4d28-4b8c-ade0-cf913cad1de2 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invalidating the token cache because role b1b6d3b52afe4ea0bdbc991b8af64b99 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:29.911165 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6f4a3e01-4d28-4b8c-ade0-cf913cad1de2 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:29.912501 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6f4a3e01-4d28-4b8c-ade0-cf913cad1de2 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:29.917246 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3236/6436] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:06:29 2022] DELETE /identity/v3/roles/b1b6d3b52afe4ea0bdbc991b8af64b99 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:29.918368 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a3e01-4d28-4b8c-ade0-cf913cad1de2 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:29.926798 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6f4a3e01-4d28-4b8c-ade0-cf913cad1de2 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:29.930905 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-ef17642a-a6da-43d8-bdb7-841b5b193627 tempest-TrustsV3TestJSON-582084361 tempest-user-1024707457] Could not find trust: 2a15ff406e2e4844986d7012b8fc6db7.: keystone.exception.TrustNotFound: Could not find trust: 2a15ff406e2e4844986d7012b8fc6db7. Aug 29 16:06:29.930905 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:06:29.930905 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:06:29.930905 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:06:29.930905 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:06:29.930905 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:06:29.930905 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:06:29.930905 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:06:29.930905 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:06:29.930905 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:06:29.930905 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:06:29.930905 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:06:29.930905 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 29 16:06:29.930905 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 29 16:06:29.930905 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 29 16:06:29.931879 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 29 16:06:29.931879 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 29 16:06:29.931879 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 29 16:06:29.931879 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 29 16:06:29.931879 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 29 16:06:29.931879 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:06:29.931879 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:06:29.931879 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 29 16:06:29.931879 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 29 16:06:29.931879 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 29 16:06:29.931879 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 29 16:06:29.931879 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 2a15ff406e2e4844986d7012b8fc6db7. Aug 29 16:06:29.931879 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:06:29.942906 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3201/6437] 10.222.0.83 () {58 vars in 1251 bytes} [Mon Aug 29 16:06:29 2022] GET /identity/v3/OS-TRUST/trusts/2a15ff406e2e4844986d7012b8fc6db7 => generated 111 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 16:06:29.952342 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17642a-a6da-43d8-bdb7-841b5b193627 tempest-TrustsV3TestJSON-582084361 tempest-user-1024707457] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:29.958171 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ef17642a-a6da-43d8-bdb7-841b5b193627 tempest-TrustsV3TestJSON-582084361 tempest-user-1024707457] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:30.090207 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:30.196939 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a3e01-4d28-4b8c-ade0-cf913cad1de2 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:30.209635 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17642a-a6da-43d8-bdb7-841b5b193627 tempest-TrustsV3TestJSON-582084361 tempest-user-1024707457] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:30.210438 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcdb9a9-8460-45e6-80cf-aca3ae377ca6 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:30.211168 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcdb9a9-8460-45e6-80cf-aca3ae377ca6 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:30.211461 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcdb9a9-8460-45e6-80cf-aca3ae377ca6 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:30.211741 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcdb9a9-8460-45e6-80cf-aca3ae377ca6 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles/14ed599305ab4f07853513d18342d419` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:30.213587 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcdb9a9-8460-45e6-80cf-aca3ae377ca6 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=14ed599305ab4f07853513d18342d419)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:30.215820 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcdb9a9-8460-45e6-80cf-aca3ae377ca6 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:30.266762 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3bcdb9a9-8460-45e6-80cf-aca3ae377ca6 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invalidating the token cache because role 14ed599305ab4f07853513d18342d419 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:30.267422 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3bcdb9a9-8460-45e6-80cf-aca3ae377ca6 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:30.268293 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3bcdb9a9-8460-45e6-80cf-aca3ae377ca6 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:30.270887 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3237/6438] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:06:29 2022] DELETE /identity/v3/roles/14ed599305ab4f07853513d18342d419 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:30.277058 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcdb9a9-8460-45e6-80cf-aca3ae377ca6 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:30.279576 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3bcdb9a9-8460-45e6-80cf-aca3ae377ca6 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:30.476122 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcdb9a9-8460-45e6-80cf-aca3ae377ca6 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:30.492665 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1859089-a1a1-42e4-b705-56d5dc6fc8a6 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:30.493352 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1859089-a1a1-42e4-b705-56d5dc6fc8a6 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:30.493637 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1859089-a1a1-42e4-b705-56d5dc6fc8a6 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:30.494098 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1859089-a1a1-42e4-b705-56d5dc6fc8a6 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles/7aa55204a70248fb9424e819859d9291/implies/f14942d5228c44eb94397856d71fcfbe` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:30.499995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1859089-a1a1-42e4-b705-56d5dc6fc8a6 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=7aa55204a70248fb9424e819859d9291, implied_role_id=f14942d5228c44eb94397856d71fcfbe)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:30.501670 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1859089-a1a1-42e4-b705-56d5dc6fc8a6 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:30.503933 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8692445-9e7a-414e-8ecf-68abed7a3195 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:30.507479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8692445-9e7a-414e-8ecf-68abed7a3195 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:30.512966 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8692445-9e7a-414e-8ecf-68abed7a3195 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:30.513960 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8692445-9e7a-414e-8ecf-68abed7a3195 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/roles/aa8eea8715e14a4996f1eec3cafc6f3b` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:30.520817 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8692445-9e7a-414e-8ecf-68abed7a3195 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:delete_role(role_id=aa8eea8715e14a4996f1eec3cafc6f3b)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:30.524702 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8692445-9e7a-414e-8ecf-68abed7a3195 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:30.601002 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3238/6439] 10.222.0.83 () {60 vars in 1363 bytes} [Mon Aug 29 16:06:30 2022] PUT /identity/v3/roles/7aa55204a70248fb9424e819859d9291/implies/f14942d5228c44eb94397856d71fcfbe => generated 521 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:30.605476 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1859089-a1a1-42e4-b705-56d5dc6fc8a6 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:30.620349 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d8692445-9e7a-414e-8ecf-68abed7a3195 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invalidating the token cache because role aa8eea8715e14a4996f1eec3cafc6f3b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:30.620944 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d8692445-9e7a-414e-8ecf-68abed7a3195 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:30.623553 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d8692445-9e7a-414e-8ecf-68abed7a3195 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:30.637390 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3202/6440] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:06:29 2022] DELETE /identity/v3/roles/aa8eea8715e14a4996f1eec3cafc6f3b => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:30.642276 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8692445-9e7a-414e-8ecf-68abed7a3195 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:30.644178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d8692445-9e7a-414e-8ecf-68abed7a3195 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:30.709924 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:30.789449 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8692445-9e7a-414e-8ecf-68abed7a3195 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:30.797677 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1859089-a1a1-42e4-b705-56d5dc6fc8a6 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:30.813217 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9536668-cab9-4280-96c7-0c9b646e5298 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:30.814286 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9536668-cab9-4280-96c7-0c9b646e5298 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:30.814850 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9536668-cab9-4280-96c7-0c9b646e5298 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:30.821792 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9536668-cab9-4280-96c7-0c9b646e5298 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/roles/fae5c522d3744578b3c31744c3520bf0` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:30.824070 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9536668-cab9-4280-96c7-0c9b646e5298 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:delete_role(role_id=fae5c522d3744578b3c31744c3520bf0)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:30.826642 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9536668-cab9-4280-96c7-0c9b646e5298 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:30.915138 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:30.942936 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c9536668-cab9-4280-96c7-0c9b646e5298 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invalidating the token cache because role fae5c522d3744578b3c31744c3520bf0 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:30.946428 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c9536668-cab9-4280-96c7-0c9b646e5298 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:30.947694 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c9536668-cab9-4280-96c7-0c9b646e5298 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:30.956640 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3203/6441] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:06:30 2022] DELETE /identity/v3/roles/fae5c522d3744578b3c31744c3520bf0 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:06:30.959094 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9536668-cab9-4280-96c7-0c9b646e5298 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:30.963815 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c9536668-cab9-4280-96c7-0c9b646e5298 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:30.969346 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b105c9f-376b-4d9f-a723-003f4dac9321 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:30.970015 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b105c9f-376b-4d9f-a723-003f4dac9321 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:30.970303 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b105c9f-376b-4d9f-a723-003f4dac9321 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:30.970759 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b105c9f-376b-4d9f-a723-003f4dac9321 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles/7aa55204a70248fb9424e819859d9291/implies/f14942d5228c44eb94397856d71fcfbe` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:30.976427 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b105c9f-376b-4d9f-a723-003f4dac9321 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=7aa55204a70248fb9424e819859d9291, implied_role_id=f14942d5228c44eb94397856d71fcfbe)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:30.977672 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-1b105c9f-376b-4d9f-a723-003f4dac9321 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:06:30.977672 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 16:06:30.977672 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 16:06:30.978591 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b105c9f-376b-4d9f-a723-003f4dac9321 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:30.979595 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b105c9f-376b-4d9f-a723-003f4dac9321 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=7aa55204a70248fb9424e819859d9291, implied_role_id=f14942d5228c44eb94397856d71fcfbe)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:30.980488 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-1b105c9f-376b-4d9f-a723-003f4dac9321 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:06:30.980488 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 16:06:30.980488 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 16:06:30.987543 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b105c9f-376b-4d9f-a723-003f4dac9321 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:31.000797 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3239/6442] 10.222.0.83 () {58 vars in 1345 bytes} [Mon Aug 29 16:06:30 2022] HEAD /identity/v3/roles/7aa55204a70248fb9424e819859d9291/implies/f14942d5228c44eb94397856d71fcfbe => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:31.005407 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b105c9f-376b-4d9f-a723-003f4dac9321 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:31.009222 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1b105c9f-376b-4d9f-a723-003f4dac9321 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:31.034370 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b105c9f-376b-4d9f-a723-003f4dac9321 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:31.250542 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9536668-cab9-4280-96c7-0c9b646e5298 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:31.270264 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6feb4-7ae6-49a0-8ea7-c3b6f177c6c8 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:31.274115 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6feb4-7ae6-49a0-8ea7-c3b6f177c6c8 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:31.277350 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6feb4-7ae6-49a0-8ea7-c3b6f177c6c8 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:31.277820 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6feb4-7ae6-49a0-8ea7-c3b6f177c6c8 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/users/c309d14d6e39433195778efa26a28309` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:31.282757 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf6feb4-7ae6-49a0-8ea7-c3b6f177c6c8 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c309d14d6e39433195778efa26a28309)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:31.284071 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0984abcf-0c81-44a4-9936-e45858a12587 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:31.287169 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984abcf-0c81-44a4-9936-e45858a12587 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:31.287338 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf6feb4-7ae6-49a0-8ea7-c3b6f177c6c8 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:31.289739 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984abcf-0c81-44a4-9936-e45858a12587 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:31.298937 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984abcf-0c81-44a4-9936-e45858a12587 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles/7aa55204a70248fb9424e819859d9291/implies/f14942d5228c44eb94397856d71fcfbe` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:31.316007 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0984abcf-0c81-44a4-9936-e45858a12587 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=7aa55204a70248fb9424e819859d9291, implied_role_id=f14942d5228c44eb94397856d71fcfbe)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:31.321208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0984abcf-0c81-44a4-9936-e45858a12587 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:31.337928 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3240/6443] 10.222.0.83 () {58 vars in 1344 bytes} [Mon Aug 29 16:06:31 2022] GET /identity/v3/roles/7aa55204a70248fb9424e819859d9291/implies/f14942d5228c44eb94397856d71fcfbe => generated 521 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:06:31.340916 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0984abcf-0c81-44a4-9936-e45858a12587 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:31.360995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0984abcf-0c81-44a4-9936-e45858a12587 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:31.387358 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aafae6-4e19-447e-9f37-c14bec335274 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:31.387885 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aafae6-4e19-447e-9f37-c14bec335274 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:31.388753 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aafae6-4e19-447e-9f37-c14bec335274 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:31.389033 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aafae6-4e19-447e-9f37-c14bec335274 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles/7aa55204a70248fb9424e819859d9291/implies/f14942d5228c44eb94397856d71fcfbe` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:31.418911 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aafae6-4e19-447e-9f37-c14bec335274 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=7aa55204a70248fb9424e819859d9291, implied_role_id=f14942d5228c44eb94397856d71fcfbe)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:31.425622 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aafae6-4e19-447e-9f37-c14bec335274 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:31.475191 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3241/6444] 10.222.0.83 () {58 vars in 1347 bytes} [Mon Aug 29 16:06:31 2022] DELETE /identity/v3/roles/7aa55204a70248fb9424e819859d9291/implies/f14942d5228c44eb94397856d71fcfbe => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:06:31.476555 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aafae6-4e19-447e-9f37-c14bec335274 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:31.509894 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8bf6feb4-7ae6-49a0-8ea7-c3b6f177c6c8 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c309d14d6e39433195778efa26a28309'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:31.510747 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8bf6feb4-7ae6-49a0-8ea7-c3b6f177c6c8 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c309d14d6e39433195778efa26a28309'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:31.542448 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8bf6feb4-7ae6-49a0-8ea7-c3b6f177c6c8 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c309d14d6e39433195778efa26a28309'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:31.568944 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8bf6feb4-7ae6-49a0-8ea7-c3b6f177c6c8 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c309d14d6e39433195778efa26a28309'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:31.595316 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8bf6feb4-7ae6-49a0-8ea7-c3b6f177c6c8 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c309d14d6e39433195778efa26a28309'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:31.630253 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3204/6445] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:06:30 2022] DELETE /identity/v3/users/c309d14d6e39433195778efa26a28309 => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:31.632074 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6feb4-7ae6-49a0-8ea7-c3b6f177c6c8 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:31.636477 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8bf6feb4-7ae6-49a0-8ea7-c3b6f177c6c8 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:31.791104 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aafae6-4e19-447e-9f37-c14bec335274 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:31.801970 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:31.885113 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6feb4-7ae6-49a0-8ea7-c3b6f177c6c8 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:31.917417 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75cecc-af34-41ae-baa4-8cf21f3cbe9e tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:31.921522 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75cecc-af34-41ae-baa4-8cf21f3cbe9e tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:31.926535 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75cecc-af34-41ae-baa4-8cf21f3cbe9e tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:31.926891 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75cecc-af34-41ae-baa4-8cf21f3cbe9e tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/projects/a037676e493b437d92685f75ad9ad6f3` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:31.937202 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b75cecc-af34-41ae-baa4-8cf21f3cbe9e tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a037676e493b437d92685f75ad9ad6f3)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:31.943912 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b75cecc-af34-41ae-baa4-8cf21f3cbe9e tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:32.023884 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:32.053258 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3497f-a9bd-412e-b2b2-6500cd4f28fc tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:32.053950 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3497f-a9bd-412e-b2b2-6500cd4f28fc tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:32.054237 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3497f-a9bd-412e-b2b2-6500cd4f28fc tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:32.054512 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3497f-a9bd-412e-b2b2-6500cd4f28fc tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles/7aa55204a70248fb9424e819859d9291/implies/f14942d5228c44eb94397856d71fcfbe` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:32.057541 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c3497f-a9bd-412e-b2b2-6500cd4f28fc tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=7aa55204a70248fb9424e819859d9291, implied_role_id=f14942d5228c44eb94397856d71fcfbe)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:32.064035 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c3497f-a9bd-412e-b2b2-6500cd4f28fc tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:32.090757 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-09c3497f-a9bd-412e-b2b2-6500cd4f28fc tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] 7aa55204a70248fb9424e819859d9291 does not imply f14942d5228c44eb94397856d71fcfbe.: keystone.exception.ImpliedRoleNotFound: 7aa55204a70248fb9424e819859d9291 does not imply f14942d5228c44eb94397856d71fcfbe. Aug 29 16:06:32.090757 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:06:32.090757 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Aug 29 16:06:32.090757 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = query.one() Aug 29 16:06:32.090757 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Aug 29 16:06:32.090757 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._iter().one() Aug 29 16:06:32.090757 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Aug 29 16:06:32.090757 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._only_one_row( Aug 29 16:06:32.090757 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Aug 29 16:06:32.090757 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exc.NoResultFound( Aug 29 16:06:32.090757 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Aug 29 16:06:32.090757 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:06:32.090757 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 16:06:32.090757 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:06:32.090757 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:06:32.090757 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:06:32.092195 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:06:32.092195 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:06:32.092195 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:06:32.092195 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:06:32.092195 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:06:32.092195 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:06:32.092195 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:06:32.092195 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:06:32.092195 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:06:32.092195 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 235, in get Aug 29 16:06:32.092195 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_implied_role(prior_role_id, implied_role_id) Aug 29 16:06:32.092195 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 239, in _get_implied_role Aug 29 16:06:32.092195 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application PROVIDERS.role_api.get_implied_role( Aug 29 16:06:32.092195 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 149, in get_implied_role Aug 29 16:06:32.092195 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Aug 29 16:06:32.092195 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Aug 29 16:06:32.093158 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Aug 29 16:06:32.093158 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 7aa55204a70248fb9424e819859d9291 does not imply f14942d5228c44eb94397856d71fcfbe. Aug 29 16:06:32.093158 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:06:32.095386 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3242/6446] 10.222.0.83 () {58 vars in 1344 bytes} [Mon Aug 29 16:06:31 2022] GET /identity/v3/roles/7aa55204a70248fb9424e819859d9291/implies/f14942d5228c44eb94397856d71fcfbe => generated 137 bytes in 619 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 16:06:32.103434 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3497f-a9bd-412e-b2b2-6500cd4f28fc tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:32.106001 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-09c3497f-a9bd-412e-b2b2-6500cd4f28fc tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:32.145420 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3497f-a9bd-412e-b2b2-6500cd4f28fc tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:32.147911 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4b75cecc-af34-41ae-baa4-8cf21f3cbe9e tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a037676e493b437d92685f75ad9ad6f3', 'request_id': 'req-4b75cecc-af34-41ae-baa4-8cf21f3cbe9e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:32.185571 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4b75cecc-af34-41ae-baa4-8cf21f3cbe9e tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a037676e493b437d92685f75ad9ad6f3', 'request_id': 'req-4b75cecc-af34-41ae-baa4-8cf21f3cbe9e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:32.234736 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4b75cecc-af34-41ae-baa4-8cf21f3cbe9e tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a037676e493b437d92685f75ad9ad6f3', 'request_id': 'req-4b75cecc-af34-41ae-baa4-8cf21f3cbe9e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:32.264970 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4b75cecc-af34-41ae-baa4-8cf21f3cbe9e tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] The token cache is being invalidate because project a037676e493b437d92685f75ad9ad6f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:32.265646 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4b75cecc-af34-41ae-baa4-8cf21f3cbe9e tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:32.268672 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4b75cecc-af34-41ae-baa4-8cf21f3cbe9e tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:32.277222 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3205/6447] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:06:31 2022] DELETE /identity/v3/projects/a037676e493b437d92685f75ad9ad6f3 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:32.284743 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ae01e-e005-4773-ac47-46f760c81121 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:32.285050 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ae01e-e005-4773-ac47-46f760c81121 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:32.285464 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ae01e-e005-4773-ac47-46f760c81121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:32.296000 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec2d72-1e3b-4fa7-a4b8-1f8831788efc tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:32.296699 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec2d72-1e3b-4fa7-a4b8-1f8831788efc tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:32.296975 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec2d72-1e3b-4fa7-a4b8-1f8831788efc tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:32.297254 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec2d72-1e3b-4fa7-a4b8-1f8831788efc tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles/7aa55204a70248fb9424e819859d9291/implies/f14942d5228c44eb94397856d71fcfbe` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:32.301129 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec2d72-1e3b-4fa7-a4b8-1f8831788efc tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=7aa55204a70248fb9424e819859d9291, implied_role_id=f14942d5228c44eb94397856d71fcfbe)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:32.302939 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec2d72-1e3b-4fa7-a4b8-1f8831788efc tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:32.324330 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-82ec2d72-1e3b-4fa7-a4b8-1f8831788efc tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] 7aa55204a70248fb9424e819859d9291 does not imply f14942d5228c44eb94397856d71fcfbe.: keystone.exception.ImpliedRoleNotFound: 7aa55204a70248fb9424e819859d9291 does not imply f14942d5228c44eb94397856d71fcfbe. Aug 29 16:06:32.324330 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:06:32.324330 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Aug 29 16:06:32.324330 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = query.one() Aug 29 16:06:32.324330 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Aug 29 16:06:32.324330 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._iter().one() Aug 29 16:06:32.324330 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Aug 29 16:06:32.324330 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._only_one_row( Aug 29 16:06:32.324330 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Aug 29 16:06:32.324330 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exc.NoResultFound( Aug 29 16:06:32.324330 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Aug 29 16:06:32.324330 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:06:32.324330 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 16:06:32.324330 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:06:32.324330 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:06:32.324330 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:06:32.325444 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:06:32.325444 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:06:32.325444 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:06:32.325444 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:06:32.325444 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:06:32.325444 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:06:32.325444 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:06:32.325444 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:06:32.325444 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:06:32.325444 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Aug 29 16:06:32.325444 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Aug 29 16:06:32.325444 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:06:32.325444 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:06:32.325444 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Aug 29 16:06:32.325444 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Aug 29 16:06:32.325444 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Aug 29 16:06:32.327975 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Aug 29 16:06:32.327975 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Aug 29 16:06:32.327975 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Aug 29 16:06:32.327975 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 7aa55204a70248fb9424e819859d9291 does not imply f14942d5228c44eb94397856d71fcfbe. Aug 29 16:06:32.327975 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:06:32.327975 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3243/6448] 10.222.0.83 () {58 vars in 1347 bytes} [Mon Aug 29 16:06:32 2022] DELETE /identity/v3/roles/7aa55204a70248fb9424e819859d9291/implies/f14942d5228c44eb94397856d71fcfbe => generated 137 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 16:06:32.332720 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-654ae01e-e005-4773-ac47-46f760c81121 None None] MFA Rules not processed for user `f075974a803f46eda667db6d754453ba`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:32.333138 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec2d72-1e3b-4fa7-a4b8-1f8831788efc tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:32.334936 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-82ec2d72-1e3b-4fa7-a4b8-1f8831788efc tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:32.335803 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-654ae01e-e005-4773-ac47-46f760c81121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:32.584199 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec2d72-1e3b-4fa7-a4b8-1f8831788efc tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:32.605633 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b20f9-ed77-43bd-913b-c3e5f182f053 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:32.606273 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b20f9-ed77-43bd-913b-c3e5f182f053 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:32.606558 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b20f9-ed77-43bd-913b-c3e5f182f053 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:32.607046 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b20f9-ed77-43bd-913b-c3e5f182f053 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:32.607679 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b20f9-ed77-43bd-913b-c3e5f182f053 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:32.610139 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b20f9-ed77-43bd-913b-c3e5f182f053 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:32.629392 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3206/6449] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:32.630419 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ae01e-e005-4773-ac47-46f760c81121 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:32.633156 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-654ae01e-e005-4773-ac47-46f760c81121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:32.674383 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ae01e-e005-4773-ac47-46f760c81121 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:32.695319 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3244/6450] 10.222.0.83 () {60 vars in 1152 bytes} [Mon Aug 29 16:06:32 2022] POST /identity/v3/projects => generated 328 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:32.697200 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ff03f-6c34-40cb-8708-9d61880fdc30 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:32.697888 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ff03f-6c34-40cb-8708-9d61880fdc30 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:32.698177 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ff03f-6c34-40cb-8708-9d61880fdc30 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:32.698494 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ff03f-6c34-40cb-8708-9d61880fdc30 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles/7aa55204a70248fb9424e819859d9291/implies/f14942d5228c44eb94397856d71fcfbe` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:32.700062 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b20f9-ed77-43bd-913b-c3e5f182f053 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:32.709924 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192ff03f-6c34-40cb-8708-9d61880fdc30 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=7aa55204a70248fb9424e819859d9291, implied_role_id=f14942d5228c44eb94397856d71fcfbe)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:32.714209 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192ff03f-6c34-40cb-8708-9d61880fdc30 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:32.811864 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3207/6451] 10.222.0.83 () {60 vars in 1363 bytes} [Mon Aug 29 16:06:32 2022] PUT /identity/v3/roles/7aa55204a70248fb9424e819859d9291/implies/f14942d5228c44eb94397856d71fcfbe => generated 521 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:32.816660 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ff03f-6c34-40cb-8708-9d61880fdc30 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:32.825492 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:32.908241 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b20f9-ed77-43bd-913b-c3e5f182f053 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:32.967877 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ff03f-6c34-40cb-8708-9d61880fdc30 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:32.979431 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744f3cd-021a-49ea-a671-9403ae58e716 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:32.979987 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744f3cd-021a-49ea-a671-9403ae58e716 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:32.980275 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744f3cd-021a-49ea-a671-9403ae58e716 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:32.980555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744f3cd-021a-49ea-a671-9403ae58e716 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles/7aa55204a70248fb9424e819859d9291/implies/2b87390de93e4e4ba452097d3d4560a4` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:32.988492 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4744f3cd-021a-49ea-a671-9403ae58e716 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=7aa55204a70248fb9424e819859d9291, implied_role_id=2b87390de93e4e4ba452097d3d4560a4)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:32.990142 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4744f3cd-021a-49ea-a671-9403ae58e716 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:33.014575 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc1d32-66d5-4390-a65d-c67153618ba1 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:33.015355 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc1d32-66d5-4390-a65d-c67153618ba1 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:33.015759 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc1d32-66d5-4390-a65d-c67153618ba1 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:33.016113 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc1d32-66d5-4390-a65d-c67153618ba1 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:33.016849 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dc1d32-66d5-4390-a65d-c67153618ba1 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:33.018879 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dc1d32-66d5-4390-a65d-c67153618ba1 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:33.024960 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:33.056519 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3208/6452] 10.222.0.83 () {60 vars in 1363 bytes} [Mon Aug 29 16:06:32 2022] PUT /identity/v3/roles/7aa55204a70248fb9424e819859d9291/implies/2b87390de93e4e4ba452097d3d4560a4 => generated 521 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:33.057422 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744f3cd-021a-49ea-a671-9403ae58e716 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:33.060937 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3245/6453] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:06:32 2022] POST /identity/v3/users => generated 410 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:33.062439 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc1d32-66d5-4390-a65d-c67153618ba1 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:33.083596 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc1d32-66d5-4390-a65d-c67153618ba1 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:33.230444 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744f3cd-021a-49ea-a671-9403ae58e716 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:33.250641 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8c327-e808-4f88-a648-ca939693ae93 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:33.251363 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8c327-e808-4f88-a648-ca939693ae93 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:33.251649 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8c327-e808-4f88-a648-ca939693ae93 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:33.251925 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8c327-e808-4f88-a648-ca939693ae93 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles/2b87390de93e4e4ba452097d3d4560a4/implies/6a8ad8055c9d446995f93021abfda9d5` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:33.255194 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7c32d-6b3f-4309-91f4-df8bd017beea tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:33.255911 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7c32d-6b3f-4309-91f4-df8bd017beea tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:33.256194 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7c32d-6b3f-4309-91f4-df8bd017beea tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:33.256474 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7c32d-6b3f-4309-91f4-df8bd017beea tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:33.257155 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7c32d-6b3f-4309-91f4-df8bd017beea tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:33.258864 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7c32d-6b3f-4309-91f4-df8bd017beea tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:33.268984 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda8c327-e808-4f88-a648-ca939693ae93 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=2b87390de93e4e4ba452097d3d4560a4, implied_role_id=6a8ad8055c9d446995f93021abfda9d5)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:33.270786 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda8c327-e808-4f88-a648-ca939693ae93 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:33.318028 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3246/6454] 10.222.0.83 () {60 vars in 1143 bytes} [Mon Aug 29 16:06:33 2022] POST /identity/v3/roles => generated 243 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:33.318028 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7c32d-6b3f-4309-91f4-df8bd017beea tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:33.322455 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-fbd7c32d-6b3f-4309-91f4-df8bd017beea tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:33.355480 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3209/6455] 10.222.0.83 () {60 vars in 1363 bytes} [Mon Aug 29 16:06:33 2022] PUT /identity/v3/roles/2b87390de93e4e4ba452097d3d4560a4/implies/6a8ad8055c9d446995f93021abfda9d5 => generated 521 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:33.358491 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8c327-e808-4f88-a648-ca939693ae93 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:33.527663 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7c32d-6b3f-4309-91f4-df8bd017beea tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:33.536486 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8c327-e808-4f88-a648-ca939693ae93 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:33.540395 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:33.549211 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2612dda-7445-479c-b3e8-150b9444f86e tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:33.549829 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2612dda-7445-479c-b3e8-150b9444f86e tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:33.550117 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2612dda-7445-479c-b3e8-150b9444f86e tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:33.550396 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2612dda-7445-479c-b3e8-150b9444f86e tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:33.551120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2612dda-7445-479c-b3e8-150b9444f86e tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:33.552797 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2612dda-7445-479c-b3e8-150b9444f86e tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:33.602951 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3210/6456] 10.222.0.83 () {60 vars in 1143 bytes} [Mon Aug 29 16:06:33 2022] POST /identity/v3/roles => generated 247 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:33.605017 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2612dda-7445-479c-b3e8-150b9444f86e tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:33.654733 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a4453-8baa-448c-99ef-7a9b6f8f6673 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:33.655589 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a4453-8baa-448c-99ef-7a9b6f8f6673 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:33.655930 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a4453-8baa-448c-99ef-7a9b6f8f6673 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:33.656269 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a4453-8baa-448c-99ef-7a9b6f8f6673 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:33.660800 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6c7a4453-8baa-448c-99ef-7a9b6f8f6673 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:33.692070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7a4453-8baa-448c-99ef-7a9b6f8f6673 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:33.696254 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7a4453-8baa-448c-99ef-7a9b6f8f6673 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:33.722068 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3247/6457] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:06:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:06:33.724594 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a4453-8baa-448c-99ef-7a9b6f8f6673 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:33.753545 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2612dda-7445-479c-b3e8-150b9444f86e tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:33.755347 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a4453-8baa-448c-99ef-7a9b6f8f6673 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:33.767005 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ca71d-ad14-4e55-ac0b-de0c0aaeaf1f tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:33.768582 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a12f741-e10b-463d-99bd-546ee5fe0648 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:33.769293 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12f741-e10b-463d-99bd-546ee5fe0648 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:33.770950 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ca71d-ad14-4e55-ac0b-de0c0aaeaf1f tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:33.770950 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ca71d-ad14-4e55-ac0b-de0c0aaeaf1f tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:33.771301 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ca71d-ad14-4e55-ac0b-de0c0aaeaf1f tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:33.772390 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12f741-e10b-463d-99bd-546ee5fe0648 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:33.772681 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12f741-e10b-463d-99bd-546ee5fe0648 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/projects/1b720acbddd24734a9953cb5063ec362/users/d611e08d388d4c0ca7eb2e24b2225a0f/roles/8079581c2855445ca66d3b49f5cf6912` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:33.773193 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ca71d-ad14-4e55-ac0b-de0c0aaeaf1f tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:33.774355 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-934ca71d-ad14-4e55-ac0b-de0c0aaeaf1f tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:06:33.774355 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 16:06:33.774355 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 16:06:33.777372 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ca71d-ad14-4e55-ac0b-de0c0aaeaf1f tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:33.794259 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:33.801450 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a12f741-e10b-463d-99bd-546ee5fe0648 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:create_grant(project_id=1b720acbddd24734a9953cb5063ec362, user_id=d611e08d388d4c0ca7eb2e24b2225a0f, role_id=8079581c2855445ca66d3b49f5cf6912)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:33.805275 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a12f741-e10b-463d-99bd-546ee5fe0648 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:33.830241 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3211/6458] 10.222.0.83 () {58 vars in 1152 bytes} [Mon Aug 29 16:06:33 2022] GET /identity/v3/role_inferences => generated 1608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:06:33.831796 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ca71d-ad14-4e55-ac0b-de0c0aaeaf1f tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:33.848820 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3248/6459] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:06:33 2022] PUT /identity/v3/projects/1b720acbddd24734a9953cb5063ec362/users/d611e08d388d4c0ca7eb2e24b2225a0f/roles/8079581c2855445ca66d3b49f5cf6912 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:33.853331 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a12f741-e10b-463d-99bd-546ee5fe0648 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:33.854488 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ca71d-ad14-4e55-ac0b-de0c0aaeaf1f tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:34.018551 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec512df-e653-4242-98c4-2b33a9fdcb17 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:34.020501 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec512df-e653-4242-98c4-2b33a9fdcb17 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:34.024388 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec512df-e653-4242-98c4-2b33a9fdcb17 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:34.024388 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec512df-e653-4242-98c4-2b33a9fdcb17 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles/2b87390de93e4e4ba452097d3d4560a4/implies/6a8ad8055c9d446995f93021abfda9d5` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:34.031243 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec512df-e653-4242-98c4-2b33a9fdcb17 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=2b87390de93e4e4ba452097d3d4560a4, implied_role_id=6a8ad8055c9d446995f93021abfda9d5)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:34.036367 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec512df-e653-4242-98c4-2b33a9fdcb17 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:34.072987 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3212/6460] 10.222.0.83 () {58 vars in 1347 bytes} [Mon Aug 29 16:06:33 2022] DELETE /identity/v3/roles/2b87390de93e4e4ba452097d3d4560a4/implies/6a8ad8055c9d446995f93021abfda9d5 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:34.078084 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec512df-e653-4242-98c4-2b33a9fdcb17 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:34.152090 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a12f741-e10b-463d-99bd-546ee5fe0648 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:34.251834 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec512df-e653-4242-98c4-2b33a9fdcb17 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:34.281602 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba3945-7c88-49cc-b673-4178c95f2a91 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:34.282481 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba3945-7c88-49cc-b673-4178c95f2a91 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:34.282771 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba3945-7c88-49cc-b673-4178c95f2a91 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:34.283130 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba3945-7c88-49cc-b673-4178c95f2a91 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles/7aa55204a70248fb9424e819859d9291/implies/2b87390de93e4e4ba452097d3d4560a4` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:34.286344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba3945-7c88-49cc-b673-4178c95f2a91 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=7aa55204a70248fb9424e819859d9291, implied_role_id=2b87390de93e4e4ba452097d3d4560a4)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:34.293318 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba3945-7c88-49cc-b673-4178c95f2a91 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:34.298288 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b78e1-4878-4690-bf20-e8ec0279b9c8 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:34.298990 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b78e1-4878-4690-bf20-e8ec0279b9c8 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:34.299306 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b78e1-4878-4690-bf20-e8ec0279b9c8 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:34.299624 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b78e1-4878-4690-bf20-e8ec0279b9c8 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/projects/1b720acbddd24734a9953cb5063ec362/users/d611e08d388d4c0ca7eb2e24b2225a0f/roles/2a8815bacabd49beba0fa1d686e87dff` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:34.309398 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86b78e1-4878-4690-bf20-e8ec0279b9c8 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:create_grant(project_id=1b720acbddd24734a9953cb5063ec362, user_id=d611e08d388d4c0ca7eb2e24b2225a0f, role_id=2a8815bacabd49beba0fa1d686e87dff)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:34.320079 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3213/6461] 10.222.0.83 () {58 vars in 1347 bytes} [Mon Aug 29 16:06:34 2022] DELETE /identity/v3/roles/7aa55204a70248fb9424e819859d9291/implies/2b87390de93e4e4ba452097d3d4560a4 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:34.320281 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86b78e1-4878-4690-bf20-e8ec0279b9c8 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:34.321398 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba3945-7c88-49cc-b673-4178c95f2a91 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:34.343992 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3249/6462] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:06:33 2022] PUT /identity/v3/projects/1b720acbddd24734a9953cb5063ec362/users/d611e08d388d4c0ca7eb2e24b2225a0f/roles/2a8815bacabd49beba0fa1d686e87dff => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:34.349841 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b78e1-4878-4690-bf20-e8ec0279b9c8 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:34.426676 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:34.502762 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba3945-7c88-49cc-b673-4178c95f2a91 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:34.503228 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b78e1-4878-4690-bf20-e8ec0279b9c8 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:34.517618 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668444a3-78fe-455e-8053-39ef6c79d04a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:34.518261 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668444a3-78fe-455e-8053-39ef6c79d04a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:34.518547 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668444a3-78fe-455e-8053-39ef6c79d04a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:34.518824 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668444a3-78fe-455e-8053-39ef6c79d04a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:34.519559 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668444a3-78fe-455e-8053-39ef6c79d04a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:34.521487 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668444a3-78fe-455e-8053-39ef6c79d04a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:34.605008 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:34.611059 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3250/6463] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:06:34 2022] GET /identity/v3/users => generated 9323 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:06:34.616303 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca607a03-7136-417a-8ec4-55b3b954001d None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:34.616521 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca607a03-7136-417a-8ec4-55b3b954001d None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:34.616800 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca607a03-7136-417a-8ec4-55b3b954001d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:34.640539 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab53073d-5abf-4d0b-b617-32d648b9dcb3 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:34.641609 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53073d-5abf-4d0b-b617-32d648b9dcb3 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:34.642005 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53073d-5abf-4d0b-b617-32d648b9dcb3 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:34.642382 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53073d-5abf-4d0b-b617-32d648b9dcb3 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles/7aa55204a70248fb9424e819859d9291/implies/f14942d5228c44eb94397856d71fcfbe` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:34.646481 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab53073d-5abf-4d0b-b617-32d648b9dcb3 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=7aa55204a70248fb9424e819859d9291, implied_role_id=f14942d5228c44eb94397856d71fcfbe)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:34.648254 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab53073d-5abf-4d0b-b617-32d648b9dcb3 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:34.665811 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3214/6464] 10.222.0.83 () {58 vars in 1347 bytes} [Mon Aug 29 16:06:34 2022] DELETE /identity/v3/roles/7aa55204a70248fb9424e819859d9291/implies/f14942d5228c44eb94397856d71fcfbe => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:06:34.667395 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab53073d-5abf-4d0b-b617-32d648b9dcb3 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:34.737913 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-ca607a03-7136-417a-8ec4-55b3b954001d None None] MFA Rules not processed for user `d611e08d388d4c0ca7eb2e24b2225a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:34.754769 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ca607a03-7136-417a-8ec4-55b3b954001d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:34.797567 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab53073d-5abf-4d0b-b617-32d648b9dcb3 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:34.804667 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d23e6-5004-4d26-8037-1b3ea322ce64 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:34.805717 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d23e6-5004-4d26-8037-1b3ea322ce64 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:34.806306 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d23e6-5004-4d26-8037-1b3ea322ce64 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:34.806689 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d23e6-5004-4d26-8037-1b3ea322ce64 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:34.807981 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d23e6-5004-4d26-8037-1b3ea322ce64 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:34.809832 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d23e6-5004-4d26-8037-1b3ea322ce64 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:34.834897 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3215/6465] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:06:34 2022] GET /identity/v3/roles => generated 2796 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:06:34.836799 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d23e6-5004-4d26-8037-1b3ea322ce64 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:34.851717 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d23e6-5004-4d26-8037-1b3ea322ce64 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:34.858402 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d05520-bb46-4223-9b80-f9c53812aada tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:34.859236 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d05520-bb46-4223-9b80-f9c53812aada tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:34.859701 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d05520-bb46-4223-9b80-f9c53812aada tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:34.860815 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d05520-bb46-4223-9b80-f9c53812aada tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:34.861165 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d05520-bb46-4223-9b80-f9c53812aada tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:34.865440 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d05520-bb46-4223-9b80-f9c53812aada tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:34.892100 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3216/6466] 10.222.0.83 () {60 vars in 1143 bytes} [Mon Aug 29 16:06:34 2022] POST /identity/v3/roles => generated 234 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:34.893403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d05520-bb46-4223-9b80-f9c53812aada tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:34.908446 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d05520-bb46-4223-9b80-f9c53812aada tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:34.913720 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a7488-9581-4757-9f06-a98531ba7cab tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:34.914396 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a7488-9581-4757-9f06-a98531ba7cab tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:34.914678 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a7488-9581-4757-9f06-a98531ba7cab tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:34.914954 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a7488-9581-4757-9f06-a98531ba7cab tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles/519780d5de7046c79e962783d5814681` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:34.917065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4a7488-9581-4757-9f06-a98531ba7cab tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:update_role(role_id=519780d5de7046c79e962783d5814681)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:34.918474 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-7c4a7488-9581-4757-9f06-a98531ba7cab tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:06:34.918474 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 16:06:34.918474 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 16:06:34.919469 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4a7488-9581-4757-9f06-a98531ba7cab tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:34.947581 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3251/6467] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:34 2022] POST /identity/v3/auth/tokens => generated 3277 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:34.956887 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c5e66-75e7-41c5-bb00-7a2704c2ca46 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:34.957411 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c5e66-75e7-41c5-bb00-7a2704c2ca46 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:34.957917 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c5e66-75e7-41c5-bb00-7a2704c2ca46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:34.993987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-703c5e66-75e7-41c5-bb00-7a2704c2ca46 None None] MFA Rules not processed for user `d611e08d388d4c0ca7eb2e24b2225a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:34.995860 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-703c5e66-75e7-41c5-bb00-7a2704c2ca46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:34.998812 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3217/6468] 10.222.0.83 () {60 vars in 1243 bytes} [Mon Aug 29 16:06:34 2022] PATCH /identity/v3/roles/519780d5de7046c79e962783d5814681 => generated 238 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:06:34.999937 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a7488-9581-4757-9f06-a98531ba7cab tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:35.005376 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3252/6469] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:34 2022] POST /identity/v3/auth/tokens => generated 3277 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:06:35.009370 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c5e66-75e7-41c5-bb00-7a2704c2ca46 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:35.030400 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a7488-9581-4757-9f06-a98531ba7cab tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:35.050980 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4970975-3b2b-4b36-8dc4-7ac2b0d602af tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:35.052176 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4970975-3b2b-4b36-8dc4-7ac2b0d602af tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:35.052468 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4970975-3b2b-4b36-8dc4-7ac2b0d602af tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:35.055567 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4970975-3b2b-4b36-8dc4-7ac2b0d602af tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles/519780d5de7046c79e962783d5814681` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:35.058953 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c5e66-75e7-41c5-bb00-7a2704c2ca46 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:35.076321 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc64b6b-3bc4-42e8-8289-71cd39928e10 tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd611e08d388d4c0ca7eb2e24b2225a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b720acbddd24734a9953cb5063ec362', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-261313294', 'tempest-NotDelegatedRole-1513361912'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:35.082409 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc64b6b-3bc4-42e8-8289-71cd39928e10 tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:35.087562 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc64b6b-3bc4-42e8-8289-71cd39928e10 tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:35.088197 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc64b6b-3bc4-42e8-8289-71cd39928e10 tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:35.089041 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc64b6b-3bc4-42e8-8289-71cd39928e10 tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] RBAC: Authorizing `identity:create_trust()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:35.091679 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4970975-3b2b-4b36-8dc4-7ac2b0d602af tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:get_role(role_id=519780d5de7046c79e962783d5814681)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:35.092337 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc64b6b-3bc4-42e8-8289-71cd39928e10 tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:35.094509 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-d4970975-3b2b-4b36-8dc4-7ac2b0d602af tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:06:35.094509 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 16:06:35.094509 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 16:06:35.095989 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4970975-3b2b-4b36-8dc4-7ac2b0d602af tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:35.101367 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3218/6470] 10.222.0.83 () {58 vars in 1221 bytes} [Mon Aug 29 16:06:34 2022] GET /identity/v3/roles/519780d5de7046c79e962783d5814681 => generated 238 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:06:35.102616 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4970975-3b2b-4b36-8dc4-7ac2b0d602af tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:35.121181 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4970975-3b2b-4b36-8dc4-7ac2b0d602af tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:35.134128 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdbe0f9-293e-45a2-829e-b858df88fc96 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:35.140607 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdbe0f9-293e-45a2-829e-b858df88fc96 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:35.140917 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdbe0f9-293e-45a2-829e-b858df88fc96 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:35.141196 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdbe0f9-293e-45a2-829e-b858df88fc96 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:35.141891 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdbe0f9-293e-45a2-829e-b858df88fc96 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:35.147714 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdbe0f9-293e-45a2-829e-b858df88fc96 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:35.196578 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3219/6471] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:06:35 2022] GET /identity/v3/roles => generated 3025 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:06:35.205238 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdbe0f9-293e-45a2-829e-b858df88fc96 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:35.233580 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdbe0f9-293e-45a2-829e-b858df88fc96 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:35.268183 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fcd31d-6aaa-4be5-9a99-a2eb33629159 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:35.269148 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcd31d-6aaa-4be5-9a99-a2eb33629159 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:35.269569 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcd31d-6aaa-4be5-9a99-a2eb33629159 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:35.269982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcd31d-6aaa-4be5-9a99-a2eb33629159 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles/519780d5de7046c79e962783d5814681` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:35.276899 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fcd31d-6aaa-4be5-9a99-a2eb33629159 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:delete_role(role_id=519780d5de7046c79e962783d5814681)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:35.279615 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fcd31d-6aaa-4be5-9a99-a2eb33629159 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:35.334865 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3253/6472] 10.222.0.83 () {60 vars in 1174 bytes} [Mon Aug 29 16:06:35 2022] POST /identity/v3/OS-TRUST/trusts => generated 858 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:06:35.337829 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc64b6b-3bc4-42e8-8289-71cd39928e10 tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:35.378178 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc64b6b-3bc4-42e8-8289-71cd39928e10 tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:35.389514 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2627fb35-e41b-4e15-999b-b6954231112a tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd611e08d388d4c0ca7eb2e24b2225a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b720acbddd24734a9953cb5063ec362', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-261313294', 'tempest-NotDelegatedRole-1513361912'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:35.390397 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627fb35-e41b-4e15-999b-b6954231112a tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:35.390832 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627fb35-e41b-4e15-999b-b6954231112a tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:35.392263 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627fb35-e41b-4e15-999b-b6954231112a tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] PATH_INFO: `/v3/OS-TRUST/trusts/23f7e24f6fbb4c69b861d0c2460b7b95` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:35.409579 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2627fb35-e41b-4e15-999b-b6954231112a tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] RBAC: Authorizing `identity:get_trust(trust_id=23f7e24f6fbb4c69b861d0c2460b7b95)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:35.413605 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2627fb35-e41b-4e15-999b-b6954231112a tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:35.460346 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3254/6473] 10.222.0.83 () {58 vars in 1251 bytes} [Mon Aug 29 16:06:35 2022] GET /identity/v3/OS-TRUST/trusts/23f7e24f6fbb4c69b861d0c2460b7b95 => generated 858 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:06:35.472674 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2627fb35-e41b-4e15-999b-b6954231112a tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:35.571142 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-42fcd31d-6aaa-4be5-9a99-a2eb33629159 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invalidating the token cache because role 519780d5de7046c79e962783d5814681 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:35.572480 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-42fcd31d-6aaa-4be5-9a99-a2eb33629159 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:35.582549 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-42fcd31d-6aaa-4be5-9a99-a2eb33629159 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:35.612690 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3220/6474] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:06:35 2022] DELETE /identity/v3/roles/519780d5de7046c79e962783d5814681 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:35.624668 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2627fb35-e41b-4e15-999b-b6954231112a tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:35.628540 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fcd31d-6aaa-4be5-9a99-a2eb33629159 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:35.630735 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-42fcd31d-6aaa-4be5-9a99-a2eb33629159 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:35.677238 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:35.767443 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:35.945080 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6dc97-bda1-4ee4-89f1-e19a2f4f966f tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd611e08d388d4c0ca7eb2e24b2225a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b720acbddd24734a9953cb5063ec362', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-261313294', 'tempest-NotDelegatedRole-1513361912'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:35.947116 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6dc97-bda1-4ee4-89f1-e19a2f4f966f tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:35.947427 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6dc97-bda1-4ee4-89f1-e19a2f4f966f tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:35.947708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6dc97-bda1-4ee4-89f1-e19a2f4f966f tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] PATH_INFO: `/v3/OS-TRUST/trusts/23f7e24f6fbb4c69b861d0c2460b7b95/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:35.969183 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b6dc97-bda1-4ee4-89f1-e19a2f4f966f tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=23f7e24f6fbb4c69b861d0c2460b7b95)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:35.971552 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b6dc97-bda1-4ee4-89f1-e19a2f4f966f tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:35.980694 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fcd31d-6aaa-4be5-9a99-a2eb33629159 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:36.000653 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3255/6475] 10.222.0.83 () {58 vars in 1269 bytes} [Mon Aug 29 16:06:35 2022] GET /identity/v3/OS-TRUST/trusts/23f7e24f6fbb4c69b861d0c2460b7b95/roles => generated 370 bytes in 539 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:06:36.002523 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6dc97-bda1-4ee4-89f1-e19a2f4f966f tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:36.005120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797e351-0f83-410d-8a3c-b71e32285628 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:36.008351 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797e351-0f83-410d-8a3c-b71e32285628 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:36.008647 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797e351-0f83-410d-8a3c-b71e32285628 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:36.008933 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797e351-0f83-410d-8a3c-b71e32285628 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles/7aa55204a70248fb9424e819859d9291/implies/f14942d5228c44eb94397856d71fcfbe` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:36.010721 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-52b6dc97-bda1-4ee4-89f1-e19a2f4f966f tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:36.021883 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797e351-0f83-410d-8a3c-b71e32285628 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=7aa55204a70248fb9424e819859d9291, implied_role_id=f14942d5228c44eb94397856d71fcfbe)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:36.025550 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797e351-0f83-410d-8a3c-b71e32285628 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:36.070606 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6dc97-bda1-4ee4-89f1-e19a2f4f966f tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:36.102258 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac40b45d-ae42-4228-8841-9bbf730912f9 tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd611e08d388d4c0ca7eb2e24b2225a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b720acbddd24734a9953cb5063ec362', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-261313294', 'tempest-NotDelegatedRole-1513361912'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:36.105813 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40b45d-ae42-4228-8841-9bbf730912f9 tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:36.107663 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40b45d-ae42-4228-8841-9bbf730912f9 tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:36.107663 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40b45d-ae42-4228-8841-9bbf730912f9 tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] PATH_INFO: `/v3/OS-TRUST/trusts/23f7e24f6fbb4c69b861d0c2460b7b95/roles/8079581c2855445ca66d3b49f5cf6912` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:36.151310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac40b45d-ae42-4228-8841-9bbf730912f9 tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] RBAC: Authorizing `identity:get_role_for_trust(trust_id=23f7e24f6fbb4c69b861d0c2460b7b95, role_id=8079581c2855445ca66d3b49f5cf6912)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:36.164343 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3221/6476] 10.222.0.83 () {60 vars in 1363 bytes} [Mon Aug 29 16:06:35 2022] PUT /identity/v3/roles/7aa55204a70248fb9424e819859d9291/implies/f14942d5228c44eb94397856d71fcfbe => generated 521 bytes in 549 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:36.170958 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797e351-0f83-410d-8a3c-b71e32285628 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:36.171195 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac40b45d-ae42-4228-8841-9bbf730912f9 tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:36.205482 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3256/6477] 10.222.0.83 () {58 vars in 1368 bytes} [Mon Aug 29 16:06:36 2022] GET /identity/v3/OS-TRUST/trusts/23f7e24f6fbb4c69b861d0c2460b7b95/roles/8079581c2855445ca66d3b49f5cf6912 => generated 243 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:06:36.206492 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac40b45d-ae42-4228-8841-9bbf730912f9 tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:36.275489 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac40b45d-ae42-4228-8841-9bbf730912f9 tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:36.404438 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797e351-0f83-410d-8a3c-b71e32285628 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:36.417456 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac40af1c-bb43-42bf-8137-aa4db8aec284 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:36.420538 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40af1c-bb43-42bf-8137-aa4db8aec284 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:36.422157 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40af1c-bb43-42bf-8137-aa4db8aec284 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:36.424060 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40af1c-bb43-42bf-8137-aa4db8aec284 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles/7aa55204a70248fb9424e819859d9291/implies/2b87390de93e4e4ba452097d3d4560a4` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:36.427013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac40af1c-bb43-42bf-8137-aa4db8aec284 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=7aa55204a70248fb9424e819859d9291, implied_role_id=2b87390de93e4e4ba452097d3d4560a4)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:36.433172 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac40af1c-bb43-42bf-8137-aa4db8aec284 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:36.458614 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f51c6c-9a65-4284-8527-c4dcb49bf16d tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd611e08d388d4c0ca7eb2e24b2225a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b720acbddd24734a9953cb5063ec362', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-261313294', 'tempest-NotDelegatedRole-1513361912'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:36.461342 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f51c6c-9a65-4284-8527-c4dcb49bf16d tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] REQUEST_METHOD: `HEAD` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:36.461342 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f51c6c-9a65-4284-8527-c4dcb49bf16d tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:36.461342 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f51c6c-9a65-4284-8527-c4dcb49bf16d tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] PATH_INFO: `/v3/OS-TRUST/trusts/23f7e24f6fbb4c69b861d0c2460b7b95/roles/8079581c2855445ca66d3b49f5cf6912` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:36.474086 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f51c6c-9a65-4284-8527-c4dcb49bf16d tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] RBAC: Authorizing `identity:get_role_for_trust(trust_id=23f7e24f6fbb4c69b861d0c2460b7b95, role_id=8079581c2855445ca66d3b49f5cf6912)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:36.475687 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f51c6c-9a65-4284-8527-c4dcb49bf16d tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:36.493648 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3257/6478] 10.222.0.83 () {58 vars in 1369 bytes} [Mon Aug 29 16:06:36 2022] HEAD /identity/v3/OS-TRUST/trusts/23f7e24f6fbb4c69b861d0c2460b7b95/roles/8079581c2855445ca66d3b49f5cf6912 => generated 0 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Aug 29 16:06:36.498758 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f51c6c-9a65-4284-8527-c4dcb49bf16d tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:36.534497 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3222/6479] 10.222.0.83 () {60 vars in 1363 bytes} [Mon Aug 29 16:06:36 2022] PUT /identity/v3/roles/7aa55204a70248fb9424e819859d9291/implies/2b87390de93e4e4ba452097d3d4560a4 => generated 521 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:36.536974 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f51c6c-9a65-4284-8527-c4dcb49bf16d tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:36.538956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac40af1c-bb43-42bf-8137-aa4db8aec284 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:36.710892 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac40af1c-bb43-42bf-8137-aa4db8aec284 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:36.714810 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbcd123-bd81-44e2-9c8b-b637ab99a3b1 tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd611e08d388d4c0ca7eb2e24b2225a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b720acbddd24734a9953cb5063ec362', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-261313294', 'tempest-NotDelegatedRole-1513361912'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:36.715741 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbcd123-bd81-44e2-9c8b-b637ab99a3b1 tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:36.716023 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbcd123-bd81-44e2-9c8b-b637ab99a3b1 tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:36.716346 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbcd123-bd81-44e2-9c8b-b637ab99a3b1 tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] PATH_INFO: `/v3/OS-TRUST/trusts/23f7e24f6fbb4c69b861d0c2460b7b95/roles/2a8815bacabd49beba0fa1d686e87dff` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:36.723838 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237251b3-0c38-4914-b4d8-1e0fff962a11 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:36.724715 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237251b3-0c38-4914-b4d8-1e0fff962a11 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:36.725679 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237251b3-0c38-4914-b4d8-1e0fff962a11 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:36.725965 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237251b3-0c38-4914-b4d8-1e0fff962a11 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles/2b87390de93e4e4ba452097d3d4560a4/implies/6a8ad8055c9d446995f93021abfda9d5` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:36.728123 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237251b3-0c38-4914-b4d8-1e0fff962a11 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=2b87390de93e4e4ba452097d3d4560a4, implied_role_id=6a8ad8055c9d446995f93021abfda9d5)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:36.729824 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237251b3-0c38-4914-b4d8-1e0fff962a11 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:36.733698 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbcd123-bd81-44e2-9c8b-b637ab99a3b1 tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] RBAC: Authorizing `identity:get_role_for_trust(trust_id=23f7e24f6fbb4c69b861d0c2460b7b95, role_id=2a8815bacabd49beba0fa1d686e87dff)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:36.736746 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbcd123-bd81-44e2-9c8b-b637ab99a3b1 tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:36.771278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-cfbcd123-bd81-44e2-9c8b-b637ab99a3b1 tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] Could not find role: 2a8815bacabd49beba0fa1d686e87dff.: keystone.exception.RoleNotFound: Could not find role: 2a8815bacabd49beba0fa1d686e87dff. Aug 29 16:06:36.771278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:06:36.771278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:06:36.771278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:06:36.771278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:06:36.771278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:06:36.771278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:06:36.771278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:06:36.771278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:06:36.771278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:06:36.771278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:06:36.771278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:06:36.771278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 29 16:06:36.771278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 16:06:36.771278 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 2a8815bacabd49beba0fa1d686e87dff. Aug 29 16:06:36.772962 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:06:36.778023 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3258/6480] 10.222.0.83 () {58 vars in 1368 bytes} [Mon Aug 29 16:06:36 2022] GET /identity/v3/OS-TRUST/trusts/23f7e24f6fbb4c69b861d0c2460b7b95/roles/2a8815bacabd49beba0fa1d686e87dff => generated 110 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 16:06:36.779396 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbcd123-bd81-44e2-9c8b-b637ab99a3b1 tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:36.786519 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3223/6481] 10.222.0.83 () {60 vars in 1363 bytes} [Mon Aug 29 16:06:36 2022] PUT /identity/v3/roles/2b87390de93e4e4ba452097d3d4560a4/implies/6a8ad8055c9d446995f93021abfda9d5 => generated 521 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:36.792041 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237251b3-0c38-4914-b4d8-1e0fff962a11 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:36.792315 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbcd123-bd81-44e2-9c8b-b637ab99a3b1 tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:36.809829 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:36.817146 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:36.916076 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc433da-87ac-4c2a-a1a6-b096d19e31aa tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd611e08d388d4c0ca7eb2e24b2225a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b720acbddd24734a9953cb5063ec362', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-261313294', 'tempest-NotDelegatedRole-1513361912'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:36.916759 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc433da-87ac-4c2a-a1a6-b096d19e31aa tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] REQUEST_METHOD: `HEAD` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:36.917301 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc433da-87ac-4c2a-a1a6-b096d19e31aa tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:36.917566 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc433da-87ac-4c2a-a1a6-b096d19e31aa tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] PATH_INFO: `/v3/OS-TRUST/trusts/23f7e24f6fbb4c69b861d0c2460b7b95/roles/2a8815bacabd49beba0fa1d686e87dff` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:36.937524 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc433da-87ac-4c2a-a1a6-b096d19e31aa tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] RBAC: Authorizing `identity:get_role_for_trust(trust_id=23f7e24f6fbb4c69b861d0c2460b7b95, role_id=2a8815bacabd49beba0fa1d686e87dff)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:36.938991 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc433da-87ac-4c2a-a1a6-b096d19e31aa tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:36.965477 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-ddc433da-87ac-4c2a-a1a6-b096d19e31aa tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] Could not find role: 2a8815bacabd49beba0fa1d686e87dff.: keystone.exception.RoleNotFound: Could not find role: 2a8815bacabd49beba0fa1d686e87dff. Aug 29 16:06:36.965477 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:06:36.965477 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:06:36.965477 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:06:36.965477 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:06:36.965477 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:06:36.965477 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:06:36.965477 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:06:36.965477 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:06:36.965477 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:06:36.965477 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:06:36.965477 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:06:36.965477 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 29 16:06:36.965477 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 16:06:36.965477 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 2a8815bacabd49beba0fa1d686e87dff. Aug 29 16:06:36.967355 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:06:36.980316 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3259/6482] 10.222.0.83 () {58 vars in 1369 bytes} [Mon Aug 29 16:06:36 2022] HEAD /identity/v3/OS-TRUST/trusts/23f7e24f6fbb4c69b861d0c2460b7b95/roles/2a8815bacabd49beba0fa1d686e87dff => generated 0 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Aug 29 16:06:36.985470 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc433da-87ac-4c2a-a1a6-b096d19e31aa tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:37.003282 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237251b3-0c38-4914-b4d8-1e0fff962a11 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:37.011299 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc433da-87ac-4c2a-a1a6-b096d19e31aa tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:37.025534 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a8f1d-b6c5-4cbe-b907-8c95dd159b6c tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:37.026211 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a8f1d-b6c5-4cbe-b907-8c95dd159b6c tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:37.026496 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a8f1d-b6c5-4cbe-b907-8c95dd159b6c tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:37.026770 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a8f1d-b6c5-4cbe-b907-8c95dd159b6c tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles/2b87390de93e4e4ba452097d3d4560a4/implies` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:37.027541 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78543b-c372-49e2-a6b2-7acc8b0a4f8d tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd611e08d388d4c0ca7eb2e24b2225a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b720acbddd24734a9953cb5063ec362', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-261313294', 'tempest-NotDelegatedRole-1513361912'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:37.028324 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78543b-c372-49e2-a6b2-7acc8b0a4f8d tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:37.029270 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78543b-c372-49e2-a6b2-7acc8b0a4f8d tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:37.030275 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a8f1d-b6c5-4cbe-b907-8c95dd159b6c tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=2b87390de93e4e4ba452097d3d4560a4)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:37.031687 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-b10a8f1d-b6c5-4cbe-b907-8c95dd159b6c tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:06:37.031687 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 16:06:37.031687 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 16:06:37.032913 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78543b-c372-49e2-a6b2-7acc8b0a4f8d tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] PATH_INFO: `/v3/OS-TRUST/trusts/23f7e24f6fbb4c69b861d0c2460b7b95` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:37.033053 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a8f1d-b6c5-4cbe-b907-8c95dd159b6c tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:37.040508 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3224/6483] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 29 16:06:36 2022] GET /identity/v3/roles/2b87390de93e4e4ba452097d3d4560a4/implies => generated 490 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:06:37.047171 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a8f1d-b6c5-4cbe-b907-8c95dd159b6c tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:37.056245 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78543b-c372-49e2-a6b2-7acc8b0a4f8d tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] RBAC: Authorizing `identity:delete_trust(trust_id=23f7e24f6fbb4c69b861d0c2460b7b95)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:37.058497 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78543b-c372-49e2-a6b2-7acc8b0a4f8d tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:37.070954 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a8f1d-b6c5-4cbe-b907-8c95dd159b6c tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:37.083235 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9e465-5f4c-4531-ba9e-8e0e0775bc48 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:37.083905 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9e465-5f4c-4531-ba9e-8e0e0775bc48 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:37.084186 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9e465-5f4c-4531-ba9e-8e0e0775bc48 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:37.084458 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9e465-5f4c-4531-ba9e-8e0e0775bc48 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles/7aa55204a70248fb9424e819859d9291/implies` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:37.088665 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b9e465-5f4c-4531-ba9e-8e0e0775bc48 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=7aa55204a70248fb9424e819859d9291)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:37.090916 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b9e465-5f4c-4531-ba9e-8e0e0775bc48 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:37.094657 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3f78543b-c372-49e2-a6b2-7acc8b0a4f8d tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '23f7e24f6fbb4c69b861d0c2460b7b95', 'request_id': 'req-3f78543b-c372-49e2-a6b2-7acc8b0a4f8d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:37.095774 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3f78543b-c372-49e2-a6b2-7acc8b0a4f8d tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '23f7e24f6fbb4c69b861d0c2460b7b95', 'request_id': 'req-3f78543b-c372-49e2-a6b2-7acc8b0a4f8d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:37.105625 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3f78543b-c372-49e2-a6b2-7acc8b0a4f8d tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '23f7e24f6fbb4c69b861d0c2460b7b95', 'request_id': 'req-3f78543b-c372-49e2-a6b2-7acc8b0a4f8d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:37.129949 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3225/6484] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 29 16:06:37 2022] GET /identity/v3/roles/7aa55204a70248fb9424e819859d9291/implies => generated 661 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:06:37.130927 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9e465-5f4c-4531-ba9e-8e0e0775bc48 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:37.139287 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a3b9e465-5f4c-4531-ba9e-8e0e0775bc48 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:37.145692 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3260/6485] 10.222.0.83 () {58 vars in 1254 bytes} [Mon Aug 29 16:06:36 2022] DELETE /identity/v3/OS-TRUST/trusts/23f7e24f6fbb4c69b861d0c2460b7b95 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:37.150209 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78543b-c372-49e2-a6b2-7acc8b0a4f8d tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:37.152345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3f78543b-c372-49e2-a6b2-7acc8b0a4f8d tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:37.175776 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9e465-5f4c-4531-ba9e-8e0e0775bc48 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:37.177558 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78543b-c372-49e2-a6b2-7acc8b0a4f8d tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:37.189497 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74bcebe-9a7c-4a2d-b98e-ae8a9276afb0 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:37.190629 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bcebe-9a7c-4a2d-b98e-ae8a9276afb0 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:37.191041 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bcebe-9a7c-4a2d-b98e-ae8a9276afb0 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:37.191447 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bcebe-9a7c-4a2d-b98e-ae8a9276afb0 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles/2b87390de93e4e4ba452097d3d4560a4/implies/6a8ad8055c9d446995f93021abfda9d5` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:37.193296 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684d8f19-44e7-45c3-804a-812af8523180 tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd611e08d388d4c0ca7eb2e24b2225a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b720acbddd24734a9953cb5063ec362', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-261313294', 'tempest-NotDelegatedRole-1513361912'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:37.193954 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d8f19-44e7-45c3-804a-812af8523180 tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:37.194231 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d8f19-44e7-45c3-804a-812af8523180 tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:37.194952 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d8f19-44e7-45c3-804a-812af8523180 tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] PATH_INFO: `/v3/OS-TRUST/trusts/23f7e24f6fbb4c69b861d0c2460b7b95` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:37.195163 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74bcebe-9a7c-4a2d-b98e-ae8a9276afb0 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=2b87390de93e4e4ba452097d3d4560a4, implied_role_id=6a8ad8055c9d446995f93021abfda9d5)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:37.198098 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74bcebe-9a7c-4a2d-b98e-ae8a9276afb0 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:37.218709 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-684d8f19-44e7-45c3-804a-812af8523180 tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] Could not find trust: 23f7e24f6fbb4c69b861d0c2460b7b95.: keystone.exception.TrustNotFound: Could not find trust: 23f7e24f6fbb4c69b861d0c2460b7b95. Aug 29 16:06:37.218709 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:06:37.218709 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:06:37.218709 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:06:37.218709 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:06:37.218709 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:06:37.218709 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:06:37.218709 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:06:37.218709 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:06:37.218709 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:06:37.218709 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:06:37.218709 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:06:37.218709 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 29 16:06:37.218709 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 29 16:06:37.218709 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 29 16:06:37.220001 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 29 16:06:37.220001 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 29 16:06:37.220001 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 29 16:06:37.220001 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 29 16:06:37.220001 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 29 16:06:37.220001 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:06:37.220001 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:06:37.220001 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 29 16:06:37.220001 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 29 16:06:37.220001 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 29 16:06:37.220001 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 29 16:06:37.220001 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 23f7e24f6fbb4c69b861d0c2460b7b95. Aug 29 16:06:37.220001 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:06:37.233116 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3261/6486] 10.222.0.83 () {58 vars in 1251 bytes} [Mon Aug 29 16:06:37 2022] GET /identity/v3/OS-TRUST/trusts/23f7e24f6fbb4c69b861d0c2460b7b95 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 29 16:06:37.233729 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684d8f19-44e7-45c3-804a-812af8523180 tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:37.237314 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3226/6487] 10.222.0.83 () {58 vars in 1347 bytes} [Mon Aug 29 16:06:37 2022] DELETE /identity/v3/roles/2b87390de93e4e4ba452097d3d4560a4/implies/6a8ad8055c9d446995f93021abfda9d5 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:37.238517 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74bcebe-9a7c-4a2d-b98e-ae8a9276afb0 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:37.243675 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-684d8f19-44e7-45c3-804a-812af8523180 tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:37.427656 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684d8f19-44e7-45c3-804a-812af8523180 tempest-TrustsV3TestJSON-708691285 tempest-user-35447810] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:37.445039 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74bcebe-9a7c-4a2d-b98e-ae8a9276afb0 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:37.459759 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0664d12e-f6c2-42e4-a0be-cb17f1b07ccc tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:37.460595 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664d12e-f6c2-42e4-a0be-cb17f1b07ccc tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:37.460981 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664d12e-f6c2-42e4-a0be-cb17f1b07ccc tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:37.461356 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664d12e-f6c2-42e4-a0be-cb17f1b07ccc tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles/7aa55204a70248fb9424e819859d9291/implies/2b87390de93e4e4ba452097d3d4560a4` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:37.465606 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0664d12e-f6c2-42e4-a0be-cb17f1b07ccc tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=7aa55204a70248fb9424e819859d9291, implied_role_id=2b87390de93e4e4ba452097d3d4560a4)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:37.467994 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0664d12e-f6c2-42e4-a0be-cb17f1b07ccc tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:37.495802 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3227/6488] 10.222.0.83 () {58 vars in 1347 bytes} [Mon Aug 29 16:06:37 2022] DELETE /identity/v3/roles/7aa55204a70248fb9424e819859d9291/implies/2b87390de93e4e4ba452097d3d4560a4 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:37.500467 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0664d12e-f6c2-42e4-a0be-cb17f1b07ccc tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:37.524007 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7cea73-a5d0-4942-a0a6-dd14515a037f tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:37.524900 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7cea73-a5d0-4942-a0a6-dd14515a037f tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:37.525276 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7cea73-a5d0-4942-a0a6-dd14515a037f tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:37.525595 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7cea73-a5d0-4942-a0a6-dd14515a037f tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/roles/2a8815bacabd49beba0fa1d686e87dff` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:37.527893 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7cea73-a5d0-4942-a0a6-dd14515a037f tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2a8815bacabd49beba0fa1d686e87dff)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:37.531239 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7cea73-a5d0-4942-a0a6-dd14515a037f tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:37.543772 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:37.678008 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-cb7cea73-a5d0-4942-a0a6-dd14515a037f tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invalidating the token cache because role 2a8815bacabd49beba0fa1d686e87dff has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:37.678305 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-cb7cea73-a5d0-4942-a0a6-dd14515a037f tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:37.679132 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-cb7cea73-a5d0-4942-a0a6-dd14515a037f tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:37.689805 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3262/6489] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:06:37 2022] DELETE /identity/v3/roles/2a8815bacabd49beba0fa1d686e87dff => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:37.691400 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7cea73-a5d0-4942-a0a6-dd14515a037f tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:37.692827 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-cb7cea73-a5d0-4942-a0a6-dd14515a037f tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:37.750620 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0664d12e-f6c2-42e4-a0be-cb17f1b07ccc tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:37.846078 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7cea73-a5d0-4942-a0a6-dd14515a037f tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:37.880118 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c89a19-6c5b-4e60-8bd4-5682979ce7cc tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:37.880784 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c89a19-6c5b-4e60-8bd4-5682979ce7cc tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:37.881068 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c89a19-6c5b-4e60-8bd4-5682979ce7cc tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:37.881343 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c89a19-6c5b-4e60-8bd4-5682979ce7cc tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/roles/8079581c2855445ca66d3b49f5cf6912` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:37.883283 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c89a19-6c5b-4e60-8bd4-5682979ce7cc tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:delete_role(role_id=8079581c2855445ca66d3b49f5cf6912)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:37.884958 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c89a19-6c5b-4e60-8bd4-5682979ce7cc tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:37.889126 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:37.952043 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa026c7c-eecd-41c0-bcce-797591cd4ebe tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:37.953342 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa026c7c-eecd-41c0-bcce-797591cd4ebe tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:37.953705 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa026c7c-eecd-41c0-bcce-797591cd4ebe tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:37.954054 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa026c7c-eecd-41c0-bcce-797591cd4ebe tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles/7aa55204a70248fb9424e819859d9291/implies/f14942d5228c44eb94397856d71fcfbe` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:37.956595 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa026c7c-eecd-41c0-bcce-797591cd4ebe tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=7aa55204a70248fb9424e819859d9291, implied_role_id=f14942d5228c44eb94397856d71fcfbe)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:37.960430 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa026c7c-eecd-41c0-bcce-797591cd4ebe tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:37.975779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b0c89a19-6c5b-4e60-8bd4-5682979ce7cc tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invalidating the token cache because role 8079581c2855445ca66d3b49f5cf6912 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:37.976154 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b0c89a19-6c5b-4e60-8bd4-5682979ce7cc tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:37.977000 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b0c89a19-6c5b-4e60-8bd4-5682979ce7cc tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:37.983939 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3228/6490] 10.222.0.83 () {58 vars in 1347 bytes} [Mon Aug 29 16:06:37 2022] DELETE /identity/v3/roles/7aa55204a70248fb9424e819859d9291/implies/f14942d5228c44eb94397856d71fcfbe => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:06:37.987274 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa026c7c-eecd-41c0-bcce-797591cd4ebe tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:37.987764 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3263/6491] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:06:37 2022] DELETE /identity/v3/roles/8079581c2855445ca66d3b49f5cf6912 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:37.988822 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c89a19-6c5b-4e60-8bd4-5682979ce7cc tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:37.989042 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-aa026c7c-eecd-41c0-bcce-797591cd4ebe tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:37.992147 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b0c89a19-6c5b-4e60-8bd4-5682979ce7cc tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:38.135862 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa026c7c-eecd-41c0-bcce-797591cd4ebe tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:38.170778 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c89a19-6c5b-4e60-8bd4-5682979ce7cc tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:38.178737 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80708290-6377-427c-bebb-e949b070db77 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:38.179949 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80708290-6377-427c-bebb-e949b070db77 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:38.180442 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80708290-6377-427c-bebb-e949b070db77 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:38.180902 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80708290-6377-427c-bebb-e949b070db77 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/domains/b956b9b0059449fc8883a0032bf362b1` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:38.199754 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80708290-6377-427c-bebb-e949b070db77 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 16:06:38.213492 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-80708290-6377-427c-bebb-e949b070db77 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Could not find domain: b956b9b0059449fc8883a0032bf362b1.: keystone.exception.DomainNotFound: Could not find domain: b956b9b0059449fc8883a0032bf362b1. Aug 29 16:06:38.213492 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:06:38.213492 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 29 16:06:38.213492 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 29 16:06:38.213492 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 16:06:38.213492 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 16:06:38.213492 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 16:06:38.213492 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 16:06:38.213492 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: b956b9b0059449fc8883a0032bf362b1. Aug 29 16:06:38.213492 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:06:38.213492 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 16:06:38.213492 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:06:38.213492 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:06:38.213492 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:06:38.213492 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:06:38.213492 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:06:38.214593 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:06:38.214593 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:06:38.214593 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:06:38.214593 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:06:38.214593 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:06:38.214593 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:06:38.214593 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:06:38.214593 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 29 16:06:38.214593 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 29 16:06:38.214593 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 16:06:38.214593 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 16:06:38.214593 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 16:06:38.214593 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 16:06:38.214593 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:06:38.214593 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:06:38.214593 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 16:06:38.215613 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 16:06:38.215613 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 16:06:38.215613 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 16:06:38.215613 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 16:06:38.215613 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 16:06:38.215613 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 16:06:38.215613 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 16:06:38.215613 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 16:06:38.215613 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 16:06:38.215613 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 16:06:38.215613 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 16:06:38.215613 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 16:06:38.215613 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 16:06:38.215613 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 29 16:06:38.215613 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 16:06:38.215613 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: b956b9b0059449fc8883a0032bf362b1. Aug 29 16:06:38.215613 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:06:38.221372 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3264/6492] 10.222.0.83 () {60 vars in 1249 bytes} [Mon Aug 29 16:06:37 2022] PATCH /identity/v3/domains/b956b9b0059449fc8883a0032bf362b1 => generated 112 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 16:06:38.222450 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80708290-6377-427c-bebb-e949b070db77 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:38.230329 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-80708290-6377-427c-bebb-e949b070db77 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:38.234157 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4fd17e-89b7-4a47-9235-7af886fd7356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:38.234839 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4fd17e-89b7-4a47-9235-7af886fd7356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:38.235219 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4fd17e-89b7-4a47-9235-7af886fd7356 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:38.235564 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4fd17e-89b7-4a47-9235-7af886fd7356 admin admin] PATH_INFO: `/v3/users/dcd426ac002048bf9db072739a81c2e4` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:38.237340 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4fd17e-89b7-4a47-9235-7af886fd7356 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcd426ac002048bf9db072739a81c2e4)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:38.239776 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4fd17e-89b7-4a47-9235-7af886fd7356 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:38.330335 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9c4fd17e-89b7-4a47-9235-7af886fd7356 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcd426ac002048bf9db072739a81c2e4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:38.331217 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9c4fd17e-89b7-4a47-9235-7af886fd7356 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcd426ac002048bf9db072739a81c2e4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:38.333026 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:38.348852 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:38.363649 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9c4fd17e-89b7-4a47-9235-7af886fd7356 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcd426ac002048bf9db072739a81c2e4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:38.385358 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9c4fd17e-89b7-4a47-9235-7af886fd7356 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcd426ac002048bf9db072739a81c2e4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:38.398089 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9c4fd17e-89b7-4a47-9235-7af886fd7356 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcd426ac002048bf9db072739a81c2e4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:38.406662 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80708290-6377-427c-bebb-e949b070db77 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:38.407958 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3229/6493] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:06:37 2022] DELETE /identity/v3/users/dcd426ac002048bf9db072739a81c2e4 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:38.409600 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4fd17e-89b7-4a47-9235-7af886fd7356 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:38.411367 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9c4fd17e-89b7-4a47-9235-7af886fd7356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:38.550695 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe2a95-d848-40f9-a1f6-681da1d26b3d tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:38.551474 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe2a95-d848-40f9-a1f6-681da1d26b3d tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:38.551685 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe2a95-d848-40f9-a1f6-681da1d26b3d tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:38.551913 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe2a95-d848-40f9-a1f6-681da1d26b3d tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/users/d611e08d388d4c0ca7eb2e24b2225a0f` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:38.553340 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe2a95-d848-40f9-a1f6-681da1d26b3d tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d611e08d388d4c0ca7eb2e24b2225a0f)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:38.554590 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4fd17e-89b7-4a47-9235-7af886fd7356 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:38.555333 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe2a95-d848-40f9-a1f6-681da1d26b3d tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:38.560422 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ea6ff-344b-414d-89f9-e716f0498478 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:38.561271 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ea6ff-344b-414d-89f9-e716f0498478 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:38.561657 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ea6ff-344b-414d-89f9-e716f0498478 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:38.562037 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ea6ff-344b-414d-89f9-e716f0498478 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/users/13cfa31b78294012a47ff6ba087da1f8` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:38.563443 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125ea6ff-344b-414d-89f9-e716f0498478 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:delete_user(user_id=13cfa31b78294012a47ff6ba087da1f8)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:38.565613 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125ea6ff-344b-414d-89f9-e716f0498478 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:38.629372 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-125ea6ff-344b-414d-89f9-e716f0498478 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13cfa31b78294012a47ff6ba087da1f8'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:38.630241 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-125ea6ff-344b-414d-89f9-e716f0498478 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13cfa31b78294012a47ff6ba087da1f8'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:38.651144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-125ea6ff-344b-414d-89f9-e716f0498478 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13cfa31b78294012a47ff6ba087da1f8'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:38.662986 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-125ea6ff-344b-414d-89f9-e716f0498478 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13cfa31b78294012a47ff6ba087da1f8'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:38.689981 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-15fe2a95-d848-40f9-a1f6-681da1d26b3d tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd611e08d388d4c0ca7eb2e24b2225a0f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:38.691344 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-15fe2a95-d848-40f9-a1f6-681da1d26b3d tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd611e08d388d4c0ca7eb2e24b2225a0f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:38.693337 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-125ea6ff-344b-414d-89f9-e716f0498478 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13cfa31b78294012a47ff6ba087da1f8'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:38.709772 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-15fe2a95-d848-40f9-a1f6-681da1d26b3d tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd611e08d388d4c0ca7eb2e24b2225a0f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:38.711313 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3230/6494] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:06:38 2022] DELETE /identity/v3/users/13cfa31b78294012a47ff6ba087da1f8 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:38.716802 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ea6ff-344b-414d-89f9-e716f0498478 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:38.719996 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-15fe2a95-d848-40f9-a1f6-681da1d26b3d tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd611e08d388d4c0ca7eb2e24b2225a0f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:38.720935 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-125ea6ff-344b-414d-89f9-e716f0498478 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:38.722189 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-15fe2a95-d848-40f9-a1f6-681da1d26b3d tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd611e08d388d4c0ca7eb2e24b2225a0f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:38.768602 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3265/6495] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:06:38 2022] DELETE /identity/v3/users/d611e08d388d4c0ca7eb2e24b2225a0f => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:38.772632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe2a95-d848-40f9-a1f6-681da1d26b3d tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:38.779474 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-15fe2a95-d848-40f9-a1f6-681da1d26b3d tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:38.894251 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe2a95-d848-40f9-a1f6-681da1d26b3d tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:38.900242 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86fa8e0-0928-4a42-8e29-9a125cf6059c tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:38.901232 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86fa8e0-0928-4a42-8e29-9a125cf6059c tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:38.901808 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86fa8e0-0928-4a42-8e29-9a125cf6059c tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:38.902592 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86fa8e0-0928-4a42-8e29-9a125cf6059c tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/projects/1b720acbddd24734a9953cb5063ec362` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:38.904844 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86fa8e0-0928-4a42-8e29-9a125cf6059c tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1b720acbddd24734a9953cb5063ec362)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:38.907513 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86fa8e0-0928-4a42-8e29-9a125cf6059c tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:38.908646 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:38.917812 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:38.933251 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ea6ff-344b-414d-89f9-e716f0498478 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:39.002674 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f86fa8e0-0928-4a42-8e29-9a125cf6059c tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b720acbddd24734a9953cb5063ec362', 'request_id': 'req-f86fa8e0-0928-4a42-8e29-9a125cf6059c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:39.011526 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f86fa8e0-0928-4a42-8e29-9a125cf6059c tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b720acbddd24734a9953cb5063ec362', 'request_id': 'req-f86fa8e0-0928-4a42-8e29-9a125cf6059c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:39.021319 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f86fa8e0-0928-4a42-8e29-9a125cf6059c tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b720acbddd24734a9953cb5063ec362', 'request_id': 'req-f86fa8e0-0928-4a42-8e29-9a125cf6059c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:39.058612 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f86fa8e0-0928-4a42-8e29-9a125cf6059c tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] The token cache is being invalidate because project 1b720acbddd24734a9953cb5063ec362 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:39.058835 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f86fa8e0-0928-4a42-8e29-9a125cf6059c tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:39.059681 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f86fa8e0-0928-4a42-8e29-9a125cf6059c tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:39.062087 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3266/6496] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:06:38 2022] DELETE /identity/v3/projects/1b720acbddd24734a9953cb5063ec362 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:39.063073 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86fa8e0-0928-4a42-8e29-9a125cf6059c tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:39.068799 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f86fa8e0-0928-4a42-8e29-9a125cf6059c tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:39.074427 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3045e98-dbdd-441f-bd7c-30e907070c12 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:39.075235 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3045e98-dbdd-441f-bd7c-30e907070c12 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:39.076214 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3045e98-dbdd-441f-bd7c-30e907070c12 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:39.076525 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3045e98-dbdd-441f-bd7c-30e907070c12 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles/6a8ad8055c9d446995f93021abfda9d5` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:39.079825 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3045e98-dbdd-441f-bd7c-30e907070c12 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:delete_role(role_id=6a8ad8055c9d446995f93021abfda9d5)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:39.082738 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3045e98-dbdd-441f-bd7c-30e907070c12 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:39.150553 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c3045e98-dbdd-441f-bd7c-30e907070c12 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invalidating the token cache because role 6a8ad8055c9d446995f93021abfda9d5 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:39.155467 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c3045e98-dbdd-441f-bd7c-30e907070c12 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:39.156518 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c3045e98-dbdd-441f-bd7c-30e907070c12 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:39.163759 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3231/6497] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:06:38 2022] DELETE /identity/v3/roles/6a8ad8055c9d446995f93021abfda9d5 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:39.165113 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3045e98-dbdd-441f-bd7c-30e907070c12 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:39.168009 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c3045e98-dbdd-441f-bd7c-30e907070c12 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:39.184531 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86fa8e0-0928-4a42-8e29-9a125cf6059c tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:39.265970 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ee7dd-826a-40af-ab2a-e101b684ef49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:39.267230 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ee7dd-826a-40af-ab2a-e101b684ef49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:39.267765 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ee7dd-826a-40af-ab2a-e101b684ef49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:39.268164 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ee7dd-826a-40af-ab2a-e101b684ef49 admin admin] PATH_INFO: `/v3/projects/eb9fe4b710cb46779f13a142f1301567` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:39.269554 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ee7dd-826a-40af-ab2a-e101b684ef49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb9fe4b710cb46779f13a142f1301567)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:39.272047 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ee7dd-826a-40af-ab2a-e101b684ef49 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:39.283674 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3045e98-dbdd-441f-bd7c-30e907070c12 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:39.291784 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ae34a-65db-4168-a1c5-ebe6806f2130 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:39.293973 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ae34a-65db-4168-a1c5-ebe6806f2130 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:39.294491 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ae34a-65db-4168-a1c5-ebe6806f2130 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:39.295472 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ae34a-65db-4168-a1c5-ebe6806f2130 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:39.296299 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ae34a-65db-4168-a1c5-ebe6806f2130 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:39.299724 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ae34a-65db-4168-a1c5-ebe6806f2130 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:39.336061 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:39.342441 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3232/6498] 10.222.0.83 () {60 vars in 1152 bytes} [Mon Aug 29 16:06:39 2022] POST /identity/v3/projects => generated 329 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:39.343870 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ae34a-65db-4168-a1c5-ebe6806f2130 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:39.346411 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a16ee7dd-826a-40af-ab2a-e101b684ef49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb9fe4b710cb46779f13a142f1301567', 'request_id': 'req-a16ee7dd-826a-40af-ab2a-e101b684ef49'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:39.348150 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7b5ae34a-65db-4168-a1c5-ebe6806f2130 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:39.355618 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a16ee7dd-826a-40af-ab2a-e101b684ef49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb9fe4b710cb46779f13a142f1301567', 'request_id': 'req-a16ee7dd-826a-40af-ab2a-e101b684ef49'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:39.365556 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a16ee7dd-826a-40af-ab2a-e101b684ef49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb9fe4b710cb46779f13a142f1301567', 'request_id': 'req-a16ee7dd-826a-40af-ab2a-e101b684ef49'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:39.385690 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a16ee7dd-826a-40af-ab2a-e101b684ef49 admin admin] The token cache is being invalidate because project eb9fe4b710cb46779f13a142f1301567 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:39.386181 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a16ee7dd-826a-40af-ab2a-e101b684ef49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:39.387246 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a16ee7dd-826a-40af-ab2a-e101b684ef49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:39.390686 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3267/6499] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:06:39 2022] DELETE /identity/v3/projects/eb9fe4b710cb46779f13a142f1301567 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:39.391870 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ee7dd-826a-40af-ab2a-e101b684ef49 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:39.395421 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a16ee7dd-826a-40af-ab2a-e101b684ef49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:39.425528 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:39.458734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ae34a-65db-4168-a1c5-ebe6806f2130 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:39.472060 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74243f1-2ba8-4180-9e7d-647c3147361d tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:39.472717 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74243f1-2ba8-4180-9e7d-647c3147361d tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:39.473002 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74243f1-2ba8-4180-9e7d-647c3147361d tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:39.473299 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74243f1-2ba8-4180-9e7d-647c3147361d tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/groups/d984fb079c4a4c0884c81e9461564d64` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:39.476870 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74243f1-2ba8-4180-9e7d-647c3147361d tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:delete_group(group_id=d984fb079c4a4c0884c81e9461564d64)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:39.479502 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74243f1-2ba8-4180-9e7d-647c3147361d tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:39.535238 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ee7dd-826a-40af-ab2a-e101b684ef49 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:39.570687 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3233/6500] 10.222.0.83 () {58 vars in 1227 bytes} [Mon Aug 29 16:06:39 2022] DELETE /identity/v3/groups/d984fb079c4a4c0884c81e9461564d64 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:39.572243 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dda740-7115-440a-ac6f-c26c0b32c200 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:39.572535 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dda740-7115-440a-ac6f-c26c0b32c200 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:39.572816 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dda740-7115-440a-ac6f-c26c0b32c200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:39.627578 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd347c-aaa7-4f21-89cb-ba19def5bae3 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:39.639123 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd347c-aaa7-4f21-89cb-ba19def5bae3 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:39.639426 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd347c-aaa7-4f21-89cb-ba19def5bae3 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:39.639692 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd347c-aaa7-4f21-89cb-ba19def5bae3 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:39.640415 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cd347c-aaa7-4f21-89cb-ba19def5bae3 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:39.642378 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cd347c-aaa7-4f21-89cb-ba19def5bae3 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:39.654934 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-12dda740-7115-440a-ac6f-c26c0b32c200 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:39.656144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-12dda740-7115-440a-ac6f-c26c0b32c200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:39.668813 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3268/6501] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:06:39 2022] POST /identity/v3/users => generated 416 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:39.670516 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd347c-aaa7-4f21-89cb-ba19def5bae3 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:39.673618 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-89cd347c-aaa7-4f21-89cb-ba19def5bae3 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:39.692423 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd347c-aaa7-4f21-89cb-ba19def5bae3 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:39.786447 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b727a527-d12b-442b-a02c-203ebc629a20 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:39.787360 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727a527-d12b-442b-a02c-203ebc629a20 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:39.787950 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727a527-d12b-442b-a02c-203ebc629a20 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:39.788469 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727a527-d12b-442b-a02c-203ebc629a20 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/projects/d164ab66e40644b7a5697cfd91a60a55` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:39.790190 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3234/6502] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:39.790877 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b727a527-d12b-442b-a02c-203ebc629a20 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d164ab66e40644b7a5697cfd91a60a55)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:39.793285 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b727a527-d12b-442b-a02c-203ebc629a20 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:39.798686 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dda740-7115-440a-ac6f-c26c0b32c200 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:39.804373 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:39.885197 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b727a527-d12b-442b-a02c-203ebc629a20 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd164ab66e40644b7a5697cfd91a60a55', 'request_id': 'req-b727a527-d12b-442b-a02c-203ebc629a20'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:39.899161 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b727a527-d12b-442b-a02c-203ebc629a20 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd164ab66e40644b7a5697cfd91a60a55', 'request_id': 'req-b727a527-d12b-442b-a02c-203ebc629a20'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:39.909789 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b727a527-d12b-442b-a02c-203ebc629a20 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd164ab66e40644b7a5697cfd91a60a55', 'request_id': 'req-b727a527-d12b-442b-a02c-203ebc629a20'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:39.918363 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dda740-7115-440a-ac6f-c26c0b32c200 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:39.928113 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b727a527-d12b-442b-a02c-203ebc629a20 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] The token cache is being invalidate because project d164ab66e40644b7a5697cfd91a60a55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:39.928930 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b727a527-d12b-442b-a02c-203ebc629a20 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:39.930138 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b727a527-d12b-442b-a02c-203ebc629a20 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:39.932387 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3269/6503] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:06:39 2022] DELETE /identity/v3/projects/d164ab66e40644b7a5697cfd91a60a55 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:39.934039 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db6f9f-0fb0-40a9-beb8-c2ae5ca2be2a None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:39.934540 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db6f9f-0fb0-40a9-beb8-c2ae5ca2be2a None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:39.935719 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db6f9f-0fb0-40a9-beb8-c2ae5ca2be2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:39.961818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-15db6f9f-0fb0-40a9-beb8-c2ae5ca2be2a None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:39.963563 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-15db6f9f-0fb0-40a9-beb8-c2ae5ca2be2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:39.972716 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:40.007367 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e463e7-4819-4a3a-86f4-313cd712f574 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:40.008101 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e463e7-4819-4a3a-86f4-313cd712f574 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:40.008455 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e463e7-4819-4a3a-86f4-313cd712f574 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:40.008743 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e463e7-4819-4a3a-86f4-313cd712f574 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:40.009425 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e463e7-4819-4a3a-86f4-313cd712f574 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:40.012174 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e463e7-4819-4a3a-86f4-313cd712f574 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:40.036215 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3235/6504] 10.222.0.83 () {60 vars in 1143 bytes} [Mon Aug 29 16:06:39 2022] POST /identity/v3/roles => generated 244 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:40.036215 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e463e7-4819-4a3a-86f4-313cd712f574 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:40.037985 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-33e463e7-4819-4a3a-86f4-313cd712f574 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:40.052287 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3270/6505] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:40.053545 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db6f9f-0fb0-40a9-beb8-c2ae5ca2be2a None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:40.055209 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-15db6f9f-0fb0-40a9-beb8-c2ae5ca2be2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:40.073391 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db6f9f-0fb0-40a9-beb8-c2ae5ca2be2a None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:40.080571 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f59343-95da-480e-971b-189698754c84 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:40.081492 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f59343-95da-480e-971b-189698754c84 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:40.081992 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f59343-95da-480e-971b-189698754c84 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:40.082894 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f59343-95da-480e-971b-189698754c84 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:40.083884 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f59343-95da-480e-971b-189698754c84 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:40.085741 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f59343-95da-480e-971b-189698754c84 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:40.127822 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3271/6506] 10.222.0.83 () {60 vars in 1143 bytes} [Mon Aug 29 16:06:40 2022] POST /identity/v3/roles => generated 247 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:40.129949 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f59343-95da-480e-971b-189698754c84 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:40.144092 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f59343-95da-480e-971b-189698754c84 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:40.156225 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc259f8-b687-4c6b-855d-f9c52cd76421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:40.158524 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc259f8-b687-4c6b-855d-f9c52cd76421 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:40.160290 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc259f8-b687-4c6b-855d-f9c52cd76421 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:40.161854 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc259f8-b687-4c6b-855d-f9c52cd76421 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:40.162798 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc259f8-b687-4c6b-855d-f9c52cd76421 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:06:40.165141 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc259f8-b687-4c6b-855d-f9c52cd76421 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:40.170506 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc259f8-b687-4c6b-855d-f9c52cd76421 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:40.172547 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e463e7-4819-4a3a-86f4-313cd712f574 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:40.180111 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d9d31-1cdf-4e62-84e7-78604d22d454 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:40.180891 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d9d31-1cdf-4e62-84e7-78604d22d454 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:40.181242 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d9d31-1cdf-4e62-84e7-78604d22d454 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:40.181550 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d9d31-1cdf-4e62-84e7-78604d22d454 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/domains/9c133110c6634d2180f310fd4b8d61ca` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:40.183034 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d9d31-1cdf-4e62-84e7-78604d22d454 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=9c133110c6634d2180f310fd4b8d61ca)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:40.187061 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d9d31-1cdf-4e62-84e7-78604d22d454 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:40.195751 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3272/6507] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:06:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:06:40.197215 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc259f8-b687-4c6b-855d-f9c52cd76421 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:40.215189 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc259f8-b687-4c6b-855d-f9c52cd76421 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:40.222154 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a062e-96f3-411c-bd8f-462437c0854e tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:40.225753 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a062e-96f3-411c-bd8f-462437c0854e tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:40.226291 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a062e-96f3-411c-bd8f-462437c0854e tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:40.226674 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a062e-96f3-411c-bd8f-462437c0854e tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/projects/c51ecde9b22e4a40800e799451ae9ea6/users/79241ee66d944213953bd2ba11fc4064/roles/99bec824e54a49019709b521ae545b6b` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:40.246379 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a062e-96f3-411c-bd8f-462437c0854e tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c51ecde9b22e4a40800e799451ae9ea6, user_id=79241ee66d944213953bd2ba11fc4064, role_id=99bec824e54a49019709b521ae545b6b)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:40.250214 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a062e-96f3-411c-bd8f-462437c0854e tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:40.261752 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6c9d9d31-1cdf-4e62-84e7-78604d22d454 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '9c133110c6634d2180f310fd4b8d61ca'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:40.264489 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6c9d9d31-1cdf-4e62-84e7-78604d22d454 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '9c133110c6634d2180f310fd4b8d61ca'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:40.277226 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3273/6508] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:06:40 2022] PUT /identity/v3/projects/c51ecde9b22e4a40800e799451ae9ea6/users/79241ee66d944213953bd2ba11fc4064/roles/99bec824e54a49019709b521ae545b6b => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:40.281753 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a062e-96f3-411c-bd8f-462437c0854e tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:40.283689 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d20a062e-96f3-411c-bd8f-462437c0854e tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:40.319009 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6c9d9d31-1cdf-4e62-84e7-78604d22d454 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '9c133110c6634d2180f310fd4b8d61ca'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:40.321279 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6c9d9d31-1cdf-4e62-84e7-78604d22d454 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '9c133110c6634d2180f310fd4b8d61ca'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:40.328235 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3236/6509] 10.222.0.83 () {60 vars in 1249 bytes} [Mon Aug 29 16:06:40 2022] PATCH /identity/v3/domains/9c133110c6634d2180f310fd4b8d61ca => generated 278 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:06:40.330163 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d9d31-1cdf-4e62-84e7-78604d22d454 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:40.334157 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6c9d9d31-1cdf-4e62-84e7-78604d22d454 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:40.373090 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:40.402895 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a062e-96f3-411c-bd8f-462437c0854e tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:40.454715 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d9d31-1cdf-4e62-84e7-78604d22d454 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:40.464833 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba6ac6-0721-44f0-985e-57bcb4e5ddc5 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:40.465747 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba6ac6-0721-44f0-985e-57bcb4e5ddc5 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:40.466007 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba6ac6-0721-44f0-985e-57bcb4e5ddc5 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:40.466346 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba6ac6-0721-44f0-985e-57bcb4e5ddc5 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/projects/c51ecde9b22e4a40800e799451ae9ea6/users/79241ee66d944213953bd2ba11fc4064/roles/3aac2abd85ac43368fd1b0a5f7eee2d3` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:40.470402 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba6ac6-0721-44f0-985e-57bcb4e5ddc5 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c51ecde9b22e4a40800e799451ae9ea6, user_id=79241ee66d944213953bd2ba11fc4064, role_id=3aac2abd85ac43368fd1b0a5f7eee2d3)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:40.473624 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba6ac6-0721-44f0-985e-57bcb4e5ddc5 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:40.496841 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3237/6510] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:06:40 2022] PUT /identity/v3/projects/c51ecde9b22e4a40800e799451ae9ea6/users/79241ee66d944213953bd2ba11fc4064/roles/3aac2abd85ac43368fd1b0a5f7eee2d3 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:40.496841 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba6ac6-0721-44f0-985e-57bcb4e5ddc5 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:40.500308 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-03ba6ac6-0721-44f0-985e-57bcb4e5ddc5 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:40.516368 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7330e6-5397-4a9e-b472-1c9dcc0d9906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:40.516995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7330e6-5397-4a9e-b472-1c9dcc0d9906 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:40.517302 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7330e6-5397-4a9e-b472-1c9dcc0d9906 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:40.517570 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7330e6-5397-4a9e-b472-1c9dcc0d9906 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:40.518263 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7330e6-5397-4a9e-b472-1c9dcc0d9906 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:40.521104 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7330e6-5397-4a9e-b472-1c9dcc0d9906 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:40.592502 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3274/6511] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:06:40 2022] POST /identity/v3/projects => generated 405 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:40.592502 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7330e6-5397-4a9e-b472-1c9dcc0d9906 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:40.593965 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:40.659378 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba6ac6-0721-44f0-985e-57bcb4e5ddc5 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:40.706150 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7330e6-5397-4a9e-b472-1c9dcc0d9906 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:40.712972 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0ad11-398f-464e-a1c4-73cb3981232e tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:40.713766 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0ad11-398f-464e-a1c4-73cb3981232e tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:40.714144 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0ad11-398f-464e-a1c4-73cb3981232e tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:40.715165 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0ad11-398f-464e-a1c4-73cb3981232e tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:40.715781 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a0ad11-398f-464e-a1c4-73cb3981232e tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:40.717840 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a0ad11-398f-464e-a1c4-73cb3981232e tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:40.755961 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3275/6512] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:06:40 2022] GET /identity/v3/users => generated 8612 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:06:40.757432 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0ad11-398f-464e-a1c4-73cb3981232e tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:40.760295 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-21a0ad11-398f-464e-a1c4-73cb3981232e tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:40.761722 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24ce1e-5f56-4a60-bca2-94bc63b74c1e tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:40.762389 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24ce1e-5f56-4a60-bca2-94bc63b74c1e tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:40.762677 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24ce1e-5f56-4a60-bca2-94bc63b74c1e tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:40.762956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24ce1e-5f56-4a60-bca2-94bc63b74c1e tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/domains/9c133110c6634d2180f310fd4b8d61ca` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:40.780822 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de24ce1e-5f56-4a60-bca2-94bc63b74c1e tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=9c133110c6634d2180f310fd4b8d61ca)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:40.783069 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de24ce1e-5f56-4a60-bca2-94bc63b74c1e tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:40.835248 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-de24ce1e-5f56-4a60-bca2-94bc63b74c1e tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '9c133110c6634d2180f310fd4b8d61ca'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:40.839683 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-de24ce1e-5f56-4a60-bca2-94bc63b74c1e tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '9c133110c6634d2180f310fd4b8d61ca'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:40.841221 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0ad11-398f-464e-a1c4-73cb3981232e tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:40.848552 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e6e41-2fe2-4f5f-a8bf-1c496164c42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:40.849180 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e6e41-2fe2-4f5f-a8bf-1c496164c42a admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:40.849465 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e6e41-2fe2-4f5f-a8bf-1c496164c42a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:40.849736 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e6e41-2fe2-4f5f-a8bf-1c496164c42a admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:40.850758 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e6e41-2fe2-4f5f-a8bf-1c496164c42a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:40.853940 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e6e41-2fe2-4f5f-a8bf-1c496164c42a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:40.895954 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3276/6513] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:06:40 2022] POST /identity/v3/users => generated 303 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:40.897122 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0facfbdb-d98c-4146-a519-d99398e82a2a None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:40.897407 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0facfbdb-d98c-4146-a519-d99398e82a2a None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:40.897679 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0facfbdb-d98c-4146-a519-d99398e82a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:40.914350 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-de24ce1e-5f56-4a60-bca2-94bc63b74c1e tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c133110c6634d2180f310fd4b8d61ca', 'request_id': 'req-de24ce1e-5f56-4a60-bca2-94bc63b74c1e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:40.915746 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:40.930383 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-de24ce1e-5f56-4a60-bca2-94bc63b74c1e tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c133110c6634d2180f310fd4b8d61ca', 'request_id': 'req-de24ce1e-5f56-4a60-bca2-94bc63b74c1e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:40.946212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-de24ce1e-5f56-4a60-bca2-94bc63b74c1e tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c133110c6634d2180f310fd4b8d61ca', 'request_id': 'req-de24ce1e-5f56-4a60-bca2-94bc63b74c1e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:40.961772 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-0facfbdb-d98c-4146-a519-d99398e82a2a None None] MFA Rules not processed for user `79241ee66d944213953bd2ba11fc4064`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:40.962999 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0facfbdb-d98c-4146-a519-d99398e82a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:40.980792 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-de24ce1e-5f56-4a60-bca2-94bc63b74c1e tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] The token cache is being invalidate because project 9c133110c6634d2180f310fd4b8d61ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:40.981966 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-de24ce1e-5f56-4a60-bca2-94bc63b74c1e tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:40.983314 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-de24ce1e-5f56-4a60-bca2-94bc63b74c1e tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:40.998108 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-de24ce1e-5f56-4a60-bca2-94bc63b74c1e tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '9c133110c6634d2180f310fd4b8d61ca', 'request_id': 'req-de24ce1e-5f56-4a60-bca2-94bc63b74c1e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:40.999921 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-de24ce1e-5f56-4a60-bca2-94bc63b74c1e tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '9c133110c6634d2180f310fd4b8d61ca', 'request_id': 'req-de24ce1e-5f56-4a60-bca2-94bc63b74c1e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:41.001262 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-de24ce1e-5f56-4a60-bca2-94bc63b74c1e tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '9c133110c6634d2180f310fd4b8d61ca', 'request_id': 'req-de24ce1e-5f56-4a60-bca2-94bc63b74c1e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:41.030750 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3238/6514] 10.222.0.83 () {58 vars in 1230 bytes} [Mon Aug 29 16:06:40 2022] DELETE /identity/v3/domains/9c133110c6634d2180f310fd4b8d61ca => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:41.032485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24ce1e-5f56-4a60-bca2-94bc63b74c1e tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:41.035551 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-de24ce1e-5f56-4a60-bca2-94bc63b74c1e tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:41.075373 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:41.079239 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3277/6515] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:40 2022] POST /identity/v3/auth/tokens => generated 3281 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:41.080105 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0facfbdb-d98c-4146-a519-d99398e82a2a None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:41.088814 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0facfbdb-d98c-4146-a519-d99398e82a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:41.188477 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24ce1e-5f56-4a60-bca2-94bc63b74c1e tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:41.208183 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e07a5-8b11-4e37-8ca2-03c809a7aa44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:41.208810 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e07a5-8b11-4e37-8ca2-03c809a7aa44 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:41.209089 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e07a5-8b11-4e37-8ca2-03c809a7aa44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:41.209217 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0facfbdb-d98c-4146-a519-d99398e82a2a None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:41.209387 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e07a5-8b11-4e37-8ca2-03c809a7aa44 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:41.209997 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e07a5-8b11-4e37-8ca2-03c809a7aa44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:41.211682 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e07a5-8b11-4e37-8ca2-03c809a7aa44 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:41.219152 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377546f5-3b99-4210-af4b-8b959322bc57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:41.219791 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377546f5-3b99-4210-af4b-8b959322bc57 service cinder] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:41.220077 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377546f5-3b99-4210-af4b-8b959322bc57 service cinder] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:41.220352 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377546f5-3b99-4210-af4b-8b959322bc57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:41.225174 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3239/6516] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:06:41 2022] GET /identity/v3/roles => generated 2571 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:06:41.226025 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e07a5-8b11-4e37-8ca2-03c809a7aa44 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:41.226719 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-377546f5-3b99-4210-af4b-8b959322bc57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:41.227887 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-468e07a5-8b11-4e37-8ca2-03c809a7aa44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:41.315258 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377546f5-3b99-4210-af4b-8b959322bc57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:41.316955 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377546f5-3b99-4210-af4b-8b959322bc57 service cinder] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:41.333346 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e07a5-8b11-4e37-8ca2-03c809a7aa44 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:41.334451 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3278/6517] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:06:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:06:41.336802 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f3d51-ce21-4cbe-be49-a2edbf1ae423 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:41.337153 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f3d51-ce21-4cbe-be49-a2edbf1ae423 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:41.337441 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f3d51-ce21-4cbe-be49-a2edbf1ae423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:41.341807 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c6c28-c3ba-442a-accb-43b5bc2d6439 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:41.342823 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c6c28-c3ba-442a-accb-43b5bc2d6439 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:41.343350 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c6c28-c3ba-442a-accb-43b5bc2d6439 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:41.343829 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c6c28-c3ba-442a-accb-43b5bc2d6439 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles/2b87390de93e4e4ba452097d3d4560a4` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:41.345790 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246c6c28-c3ba-442a-accb-43b5bc2d6439 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2b87390de93e4e4ba452097d3d4560a4)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:41.347700 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246c6c28-c3ba-442a-accb-43b5bc2d6439 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:41.365149 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-983f3d51-ce21-4cbe-be49-a2edbf1ae423 None None] MFA Rules not processed for user `79241ee66d944213953bd2ba11fc4064`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:41.368133 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-983f3d51-ce21-4cbe-be49-a2edbf1ae423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:41.379481 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3279/6518] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:41 2022] POST /identity/v3/auth/tokens => generated 3281 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:41.384334 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f3d51-ce21-4cbe-be49-a2edbf1ae423 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:41.398275 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f3d51-ce21-4cbe-be49-a2edbf1ae423 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:41.400938 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-246c6c28-c3ba-442a-accb-43b5bc2d6439 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invalidating the token cache because role 2b87390de93e4e4ba452097d3d4560a4 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:41.401842 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-246c6c28-c3ba-442a-accb-43b5bc2d6439 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:41.402745 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-246c6c28-c3ba-442a-accb-43b5bc2d6439 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:41.404990 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a5d16-9157-4a3a-a7e9-57723990bdba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:41.405434 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a5d16-9157-4a3a-a7e9-57723990bdba admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:41.405709 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a5d16-9157-4a3a-a7e9-57723990bdba admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:41.405977 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a5d16-9157-4a3a-a7e9-57723990bdba admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:41.406889 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a5d16-9157-4a3a-a7e9-57723990bdba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:41.407004 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3240/6519] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:06:41 2022] DELETE /identity/v3/roles/2b87390de93e4e4ba452097d3d4560a4 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:41.407575 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c6c28-c3ba-442a-accb-43b5bc2d6439 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:41.408978 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-246c6c28-c3ba-442a-accb-43b5bc2d6439 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:41.411307 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a5d16-9157-4a3a-a7e9-57723990bdba admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:41.427799 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3280/6520] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:06:41 2022] GET /identity/v3/roles => generated 2345 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:06:41.428730 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a5d16-9157-4a3a-a7e9-57723990bdba admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:41.430789 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c49a5d16-9157-4a3a-a7e9-57723990bdba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:41.458335 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a5d16-9157-4a3a-a7e9-57723990bdba admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:41.523529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c6c28-c3ba-442a-accb-43b5bc2d6439 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:41.527969 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:41.535402 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced6e51-eb47-47d1-b24b-962a34e490ae tempest-TrustsV3TestJSON-1002972565 tempest-user-1987586734] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79241ee66d944213953bd2ba11fc4064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c51ecde9b22e4a40800e799451ae9ea6', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1147101949', 'tempest-NotDelegatedRole-1789874200'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:41.537699 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced6e51-eb47-47d1-b24b-962a34e490ae tempest-TrustsV3TestJSON-1002972565 tempest-user-1987586734] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:41.538186 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced6e51-eb47-47d1-b24b-962a34e490ae tempest-TrustsV3TestJSON-1002972565 tempest-user-1987586734] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:41.538668 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced6e51-eb47-47d1-b24b-962a34e490ae tempest-TrustsV3TestJSON-1002972565 tempest-user-1987586734] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:41.539603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced6e51-eb47-47d1-b24b-962a34e490ae tempest-TrustsV3TestJSON-1002972565 tempest-user-1987586734] RBAC: Authorizing `identity:create_trust()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:41.541681 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced6e51-eb47-47d1-b24b-962a34e490ae tempest-TrustsV3TestJSON-1002972565 tempest-user-1987586734] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:41.576589 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2783bd0b-76dc-4d67-876e-ef10d7359205 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:41.577796 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783bd0b-76dc-4d67-876e-ef10d7359205 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:41.578251 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783bd0b-76dc-4d67-876e-ef10d7359205 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:41.578693 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783bd0b-76dc-4d67-876e-ef10d7359205 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles/f14942d5228c44eb94397856d71fcfbe` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:41.580452 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2783bd0b-76dc-4d67-876e-ef10d7359205 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f14942d5228c44eb94397856d71fcfbe)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:41.582380 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2783bd0b-76dc-4d67-876e-ef10d7359205 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:41.592939 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:41.645950 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2783bd0b-76dc-4d67-876e-ef10d7359205 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invalidating the token cache because role f14942d5228c44eb94397856d71fcfbe has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:41.646560 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2783bd0b-76dc-4d67-876e-ef10d7359205 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:41.647936 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2783bd0b-76dc-4d67-876e-ef10d7359205 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:41.650481 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3281/6521] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:06:41 2022] DELETE /identity/v3/roles/f14942d5228c44eb94397856d71fcfbe => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:41.651461 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2783bd0b-76dc-4d67-876e-ef10d7359205 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:41.653808 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2783bd0b-76dc-4d67-876e-ef10d7359205 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:41.677546 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-4ced6e51-eb47-47d1-b24b-962a34e490ae tempest-TrustsV3TestJSON-1002972565 tempest-user-1987586734] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 29 16:06:41.677546 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:06:41.677546 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 44, in parse_isotime Aug 29 16:06:41.677546 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return iso8601.parse_date(timestr) Aug 29 16:06:41.677546 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/iso8601/iso8601.py", line 127, in parse_date Aug 29 16:06:41.677546 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise ParseError(f"Unable to parse date string {datestring!r}") Aug 29 16:06:41.677546 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application iso8601.iso8601.ParseError: Unable to parse date string 'bad.123Z' Aug 29 16:06:41.677546 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:06:41.677546 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 16:06:41.677546 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:06:41.677546 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:06:41.677546 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 346, in parse_expiration_date Aug 29 16:06:41.677546 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application expiration_time = timeutils.parse_isotime(expiration_date) Aug 29 16:06:41.677546 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 46, in parse_isotime Aug 29 16:06:41.678766 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise ValueError(str(e)) Aug 29 16:06:41.678766 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ValueError: Unable to parse date string 'bad.123Z' Aug 29 16:06:41.678766 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:06:41.678766 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 16:06:41.678766 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:06:41.678766 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:06:41.678766 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:06:41.678766 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:06:41.678766 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:06:41.678766 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:06:41.678766 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:06:41.678766 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:06:41.678766 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:06:41.678766 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:06:41.678766 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:06:41.678766 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:06:41.678766 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 296, in post Aug 29 16:06:41.678766 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application trust['expires_at'] = self._parse_expiration_date( Aug 29 16:06:41.680082 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 127, in _parse_expiration_date Aug 29 16:06:41.680082 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return utils.parse_expiration_date(expiration_date) Aug 29 16:06:41.680082 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 348, in parse_expiration_date Aug 29 16:06:41.680082 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ValidationTimeStampError() Aug 29 16:06:41.680082 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 29 16:06:41.680082 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:06:41.683497 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3241/6522] 10.222.0.83 () {60 vars in 1174 bytes} [Mon Aug 29 16:06:41 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 276 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 29 16:06:41.686542 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced6e51-eb47-47d1-b24b-962a34e490ae tempest-TrustsV3TestJSON-1002972565 tempest-user-1987586734] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:41.689992 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4ced6e51-eb47-47d1-b24b-962a34e490ae tempest-TrustsV3TestJSON-1002972565 tempest-user-1987586734] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:41.727666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced6e51-eb47-47d1-b24b-962a34e490ae tempest-TrustsV3TestJSON-1002972565 tempest-user-1987586734] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:41.769869 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2783bd0b-76dc-4d67-876e-ef10d7359205 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:41.775270 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49563739-dc7d-4f19-80b0-6b352e15e8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:41.775947 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49563739-dc7d-4f19-80b0-6b352e15e8ed admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:41.776275 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49563739-dc7d-4f19-80b0-6b352e15e8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:41.776552 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49563739-dc7d-4f19-80b0-6b352e15e8ed admin admin] PATH_INFO: `/v3/projects/b30e1134a82b4fdc8e7f84e6ce4faf76/users/4bb54ce3cfac4eb7b9095f3733745cf1/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:41.797376 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49563739-dc7d-4f19-80b0-6b352e15e8ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=b30e1134a82b4fdc8e7f84e6ce4faf76, user_id=4bb54ce3cfac4eb7b9095f3733745cf1, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:41.800387 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49563739-dc7d-4f19-80b0-6b352e15e8ed admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:41.817426 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3282/6523] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:06:41 2022] PUT /identity/v3/projects/b30e1134a82b4fdc8e7f84e6ce4faf76/users/4bb54ce3cfac4eb7b9095f3733745cf1/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:41.818484 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49563739-dc7d-4f19-80b0-6b352e15e8ed admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:41.822618 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-49563739-dc7d-4f19-80b0-6b352e15e8ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:41.872000 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ab90d4-fa35-4d79-8d24-4b50b8e3a856 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e588f0a86b747b789c18379d00163aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f4d68286a0452595d1960baf97266a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:41.873161 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab90d4-fa35-4d79-8d24-4b50b8e3a856 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:41.873706 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab90d4-fa35-4d79-8d24-4b50b8e3a856 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:41.874131 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab90d4-fa35-4d79-8d24-4b50b8e3a856 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] PATH_INFO: `/v3/roles/7aa55204a70248fb9424e819859d9291` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:41.876047 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ab90d4-fa35-4d79-8d24-4b50b8e3a856 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7aa55204a70248fb9424e819859d9291)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:41.878072 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ab90d4-fa35-4d79-8d24-4b50b8e3a856 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:41.917832 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49563739-dc7d-4f19-80b0-6b352e15e8ed admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:41.926994 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-48ab90d4-fa35-4d79-8d24-4b50b8e3a856 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invalidating the token cache because role 7aa55204a70248fb9424e819859d9291 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:41.926994 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-48ab90d4-fa35-4d79-8d24-4b50b8e3a856 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:41.927809 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-48ab90d4-fa35-4d79-8d24-4b50b8e3a856 tempest-RolesV3TestJSON-991377722 tempest-RolesV3TestJSON-991377722-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:41.930246 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3242/6524] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:06:41 2022] DELETE /identity/v3/roles/7aa55204a70248fb9424e819859d9291 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:41.931567 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afdcfc9-206e-4137-a17e-831e3ba8c0de None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:41.932144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afdcfc9-206e-4137-a17e-831e3ba8c0de None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:41.932144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afdcfc9-206e-4137-a17e-831e3ba8c0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:41.932630 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442687d-d663-45ab-8ae6-e62d4506f2b0 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:41.934075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442687d-d663-45ab-8ae6-e62d4506f2b0 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:41.934801 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442687d-d663-45ab-8ae6-e62d4506f2b0 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:41.934931 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442687d-d663-45ab-8ae6-e62d4506f2b0 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/roles/3aac2abd85ac43368fd1b0a5f7eee2d3` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:41.936947 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4442687d-d663-45ab-8ae6-e62d4506f2b0 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3aac2abd85ac43368fd1b0a5f7eee2d3)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:41.939812 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4442687d-d663-45ab-8ae6-e62d4506f2b0 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:41.956196 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-1afdcfc9-206e-4137-a17e-831e3ba8c0de None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:41.957679 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1afdcfc9-206e-4137-a17e-831e3ba8c0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:41.973480 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:42.016020 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4442687d-d663-45ab-8ae6-e62d4506f2b0 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invalidating the token cache because role 3aac2abd85ac43368fd1b0a5f7eee2d3 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:42.016306 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4442687d-d663-45ab-8ae6-e62d4506f2b0 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:42.018122 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4442687d-d663-45ab-8ae6-e62d4506f2b0 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:42.022225 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3283/6525] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:06:41 2022] DELETE /identity/v3/roles/3aac2abd85ac43368fd1b0a5f7eee2d3 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:42.023735 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442687d-d663-45ab-8ae6-e62d4506f2b0 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:42.030235 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4442687d-d663-45ab-8ae6-e62d4506f2b0 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:42.115905 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3243/6526] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:42.116864 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afdcfc9-206e-4137-a17e-831e3ba8c0de None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:42.118323 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1afdcfc9-206e-4137-a17e-831e3ba8c0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:42.203815 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:42.226492 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442687d-d663-45ab-8ae6-e62d4506f2b0 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:42.233533 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6511a-c3b6-4247-b8cc-88f41a0d15c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:42.234206 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6511a-c3b6-4247-b8cc-88f41a0d15c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:42.234487 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6511a-c3b6-4247-b8cc-88f41a0d15c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:42.234768 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6511a-c3b6-4247-b8cc-88f41a0d15c5 admin admin] PATH_INFO: `/v3/users/a5f6c2fb033a4f718a36a2bc6fcb87bc` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:42.239949 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d6511a-c3b6-4247-b8cc-88f41a0d15c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5f6c2fb033a4f718a36a2bc6fcb87bc)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:42.242019 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d6511a-c3b6-4247-b8cc-88f41a0d15c5 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:42.246182 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afdcfc9-206e-4137-a17e-831e3ba8c0de None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:42.327558 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d0d6511a-c3b6-4247-b8cc-88f41a0d15c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5f6c2fb033a4f718a36a2bc6fcb87bc'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:42.328195 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1db3f5-c990-4852-9987-fe0cfaff652d tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:42.328363 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d0d6511a-c3b6-4247-b8cc-88f41a0d15c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5f6c2fb033a4f718a36a2bc6fcb87bc'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:42.330272 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1db3f5-c990-4852-9987-fe0cfaff652d tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:42.330677 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1db3f5-c990-4852-9987-fe0cfaff652d tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:42.331716 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1db3f5-c990-4852-9987-fe0cfaff652d tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/roles/99bec824e54a49019709b521ae545b6b` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:42.334816 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1db3f5-c990-4852-9987-fe0cfaff652d tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:delete_role(role_id=99bec824e54a49019709b521ae545b6b)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:42.337755 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1db3f5-c990-4852-9987-fe0cfaff652d tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:42.339190 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d0d6511a-c3b6-4247-b8cc-88f41a0d15c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5f6c2fb033a4f718a36a2bc6fcb87bc'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:42.360834 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d0d6511a-c3b6-4247-b8cc-88f41a0d15c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5f6c2fb033a4f718a36a2bc6fcb87bc'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:42.367858 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d0d6511a-c3b6-4247-b8cc-88f41a0d15c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5f6c2fb033a4f718a36a2bc6fcb87bc'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:42.398609 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3d1db3f5-c990-4852-9987-fe0cfaff652d tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invalidating the token cache because role 99bec824e54a49019709b521ae545b6b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:42.398980 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3d1db3f5-c990-4852-9987-fe0cfaff652d tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:42.400046 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3d1db3f5-c990-4852-9987-fe0cfaff652d tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:42.421297 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3244/6527] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:06:42 2022] DELETE /identity/v3/roles/99bec824e54a49019709b521ae545b6b => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:42.423243 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1db3f5-c990-4852-9987-fe0cfaff652d tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:42.425027 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3d1db3f5-c990-4852-9987-fe0cfaff652d tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:42.442733 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3284/6528] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:06:42 2022] DELETE /identity/v3/users/a5f6c2fb033a4f718a36a2bc6fcb87bc => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:42.447482 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6511a-c3b6-4247-b8cc-88f41a0d15c5 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:42.449826 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d0d6511a-c3b6-4247-b8cc-88f41a0d15c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:42.523608 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1db3f5-c990-4852-9987-fe0cfaff652d tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:42.573305 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:42.579493 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6511a-c3b6-4247-b8cc-88f41a0d15c5 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:42.585831 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff59e1e-5e46-4764-a8df-f29b8e7f6d8e tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:42.586578 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff59e1e-5e46-4764-a8df-f29b8e7f6d8e tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:42.587159 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff59e1e-5e46-4764-a8df-f29b8e7f6d8e tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:42.587916 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff59e1e-5e46-4764-a8df-f29b8e7f6d8e tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/users/79241ee66d944213953bd2ba11fc4064` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:42.589226 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff59e1e-5e46-4764-a8df-f29b8e7f6d8e tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:delete_user(user_id=79241ee66d944213953bd2ba11fc4064)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:42.593425 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff59e1e-5e46-4764-a8df-f29b8e7f6d8e tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:42.603712 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836872d2-7eca-41d2-a1bb-2d669fdf8ec9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:42.604770 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836872d2-7eca-41d2-a1bb-2d669fdf8ec9 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:42.605274 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836872d2-7eca-41d2-a1bb-2d669fdf8ec9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:42.605774 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836872d2-7eca-41d2-a1bb-2d669fdf8ec9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:42.609433 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-836872d2-7eca-41d2-a1bb-2d669fdf8ec9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:42.632750 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:42.650469 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9ff59e1e-5e46-4764-a8df-f29b8e7f6d8e tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79241ee66d944213953bd2ba11fc4064'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:42.651290 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9ff59e1e-5e46-4764-a8df-f29b8e7f6d8e tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79241ee66d944213953bd2ba11fc4064'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:42.662262 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9ff59e1e-5e46-4764-a8df-f29b8e7f6d8e tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79241ee66d944213953bd2ba11fc4064'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:42.671380 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9ff59e1e-5e46-4764-a8df-f29b8e7f6d8e tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79241ee66d944213953bd2ba11fc4064'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:42.672372 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9ff59e1e-5e46-4764-a8df-f29b8e7f6d8e tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79241ee66d944213953bd2ba11fc4064'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:42.686991 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836872d2-7eca-41d2-a1bb-2d669fdf8ec9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:42.688743 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836872d2-7eca-41d2-a1bb-2d669fdf8ec9 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:42.693747 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3285/6529] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:06:42 2022] DELETE /identity/v3/users/79241ee66d944213953bd2ba11fc4064 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:42.695317 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659a94e-35a0-4102-9e73-dedf78aad572 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:42.695602 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659a94e-35a0-4102-9e73-dedf78aad572 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:42.695872 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659a94e-35a0-4102-9e73-dedf78aad572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:42.710497 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3245/6530] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:06:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:06:42.712777 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836872d2-7eca-41d2-a1bb-2d669fdf8ec9 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:42.715355 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-836872d2-7eca-41d2-a1bb-2d669fdf8ec9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:42.721655 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-0659a94e-35a0-4102-9e73-dedf78aad572 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:42.723041 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0659a94e-35a0-4102-9e73-dedf78aad572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:42.736120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836872d2-7eca-41d2-a1bb-2d669fdf8ec9 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:42.818369 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa66fb2-626f-4457-81e3-5ff9ae50656a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:42.819612 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa66fb2-626f-4457-81e3-5ff9ae50656a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:42.820167 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa66fb2-626f-4457-81e3-5ff9ae50656a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:42.820471 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa66fb2-626f-4457-81e3-5ff9ae50656a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/projects/c51ecde9b22e4a40800e799451ae9ea6` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:42.822241 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa66fb2-626f-4457-81e3-5ff9ae50656a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c51ecde9b22e4a40800e799451ae9ea6)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:42.824151 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa66fb2-626f-4457-81e3-5ff9ae50656a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:42.828202 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3286/6531] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:42.838169 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659a94e-35a0-4102-9e73-dedf78aad572 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:42.839756 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0659a94e-35a0-4102-9e73-dedf78aad572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:42.893687 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-daa66fb2-626f-4457-81e3-5ff9ae50656a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c51ecde9b22e4a40800e799451ae9ea6', 'request_id': 'req-daa66fb2-626f-4457-81e3-5ff9ae50656a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:42.900712 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-daa66fb2-626f-4457-81e3-5ff9ae50656a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c51ecde9b22e4a40800e799451ae9ea6', 'request_id': 'req-daa66fb2-626f-4457-81e3-5ff9ae50656a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:42.909336 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-daa66fb2-626f-4457-81e3-5ff9ae50656a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c51ecde9b22e4a40800e799451ae9ea6', 'request_id': 'req-daa66fb2-626f-4457-81e3-5ff9ae50656a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:42.924511 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-daa66fb2-626f-4457-81e3-5ff9ae50656a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] The token cache is being invalidate because project c51ecde9b22e4a40800e799451ae9ea6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:42.924818 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-daa66fb2-626f-4457-81e3-5ff9ae50656a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:42.926219 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-daa66fb2-626f-4457-81e3-5ff9ae50656a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:42.933263 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659a94e-35a0-4102-9e73-dedf78aad572 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:42.933408 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3246/6532] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:06:42 2022] DELETE /identity/v3/projects/c51ecde9b22e4a40800e799451ae9ea6 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:42.934156 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa66fb2-626f-4457-81e3-5ff9ae50656a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:42.936461 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-daa66fb2-626f-4457-81e3-5ff9ae50656a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:42.981263 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:43.022892 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdbd268-2d52-4979-bb80-9fe48ef20cce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:43.024853 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdbd268-2d52-4979-bb80-9fe48ef20cce service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:43.025447 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdbd268-2d52-4979-bb80-9fe48ef20cce service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:43.026717 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdbd268-2d52-4979-bb80-9fe48ef20cce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:43.027505 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:43.034700 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6fdbd268-2d52-4979-bb80-9fe48ef20cce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:43.053942 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa66fb2-626f-4457-81e3-5ff9ae50656a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:43.062584 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f89cca-db53-48a7-a6c5-2f82386273d1 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:43.063387 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f89cca-db53-48a7-a6c5-2f82386273d1 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:43.063626 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f89cca-db53-48a7-a6c5-2f82386273d1 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:43.063948 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f89cca-db53-48a7-a6c5-2f82386273d1 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:43.064668 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f89cca-db53-48a7-a6c5-2f82386273d1 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:43.066615 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f89cca-db53-48a7-a6c5-2f82386273d1 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:43.121506 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3247/6533] 10.222.0.83 () {60 vars in 1152 bytes} [Mon Aug 29 16:06:42 2022] POST /identity/v3/projects => generated 328 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:43.126467 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f89cca-db53-48a7-a6c5-2f82386273d1 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:43.167954 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdbd268-2d52-4979-bb80-9fe48ef20cce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:43.170185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdbd268-2d52-4979-bb80-9fe48ef20cce service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:43.196279 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3287/6534] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:06:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:06:43.223473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f89cca-db53-48a7-a6c5-2f82386273d1 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:43.236672 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b8ebc-0f99-427a-84bd-b0d4e63d358f tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:43.237671 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b8ebc-0f99-427a-84bd-b0d4e63d358f tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:43.239870 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b8ebc-0f99-427a-84bd-b0d4e63d358f tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:43.240209 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b8ebc-0f99-427a-84bd-b0d4e63d358f tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:43.240879 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b8ebc-0f99-427a-84bd-b0d4e63d358f tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:43.244909 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b8ebc-0f99-427a-84bd-b0d4e63d358f tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:43.292277 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdbd268-2d52-4979-bb80-9fe48ef20cce service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:43.292602 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3248/6535] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:06:43 2022] POST /identity/v3/users => generated 416 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:43.313814 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdbd268-2d52-4979-bb80-9fe48ef20cce service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:43.327844 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc653ca0-e906-4529-8c29-9f260961591d tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:43.328101 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc653ca0-e906-4529-8c29-9f260961591d tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:43.328361 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc653ca0-e906-4529-8c29-9f260961591d tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:43.328637 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc653ca0-e906-4529-8c29-9f260961591d tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:43.329319 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc653ca0-e906-4529-8c29-9f260961591d tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:43.330932 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc653ca0-e906-4529-8c29-9f260961591d tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:43.373273 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3288/6536] 10.222.0.83 () {60 vars in 1143 bytes} [Mon Aug 29 16:06:43 2022] POST /identity/v3/roles => generated 243 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:43.374275 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b8ebc-0f99-427a-84bd-b0d4e63d358f tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:43.408183 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b8ebc-0f99-427a-84bd-b0d4e63d358f tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:43.428312 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe66af5-7597-4dbc-8e2f-ec9eefcbba89 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:43.428844 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe66af5-7597-4dbc-8e2f-ec9eefcbba89 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:43.429462 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe66af5-7597-4dbc-8e2f-ec9eefcbba89 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:43.429755 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe66af5-7597-4dbc-8e2f-ec9eefcbba89 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:43.430502 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe66af5-7597-4dbc-8e2f-ec9eefcbba89 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:43.441650 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe66af5-7597-4dbc-8e2f-ec9eefcbba89 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:43.471068 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3249/6537] 10.222.0.83 () {60 vars in 1143 bytes} [Mon Aug 29 16:06:43 2022] POST /identity/v3/roles => generated 247 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:06:43.474771 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc653ca0-e906-4529-8c29-9f260961591d tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:43.507368 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc653ca0-e906-4529-8c29-9f260961591d tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:43.531111 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ca7be-b1f9-48e0-9c48-d1c66ec9b4ef tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:43.532113 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ca7be-b1f9-48e0-9c48-d1c66ec9b4ef tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:43.532554 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ca7be-b1f9-48e0-9c48-d1c66ec9b4ef tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:43.532987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ca7be-b1f9-48e0-9c48-d1c66ec9b4ef tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/projects/d9d354c6d82f4e4db185411439365282/users/3fb06fd4fda2471ba6a8833d92f7f220/roles/f300ec3596394245b4cc33be1d9fadbf` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:43.592514 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ca7be-b1f9-48e0-9c48-d1c66ec9b4ef tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d9d354c6d82f4e4db185411439365282, user_id=3fb06fd4fda2471ba6a8833d92f7f220, role_id=f300ec3596394245b4cc33be1d9fadbf)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:43.595741 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ca7be-b1f9-48e0-9c48-d1c66ec9b4ef tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:43.631950 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3289/6538] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:06:43 2022] PUT /identity/v3/projects/d9d354c6d82f4e4db185411439365282/users/3fb06fd4fda2471ba6a8833d92f7f220/roles/f300ec3596394245b4cc33be1d9fadbf => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:43.633440 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe66af5-7597-4dbc-8e2f-ec9eefcbba89 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:43.655422 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe66af5-7597-4dbc-8e2f-ec9eefcbba89 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:43.805259 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bdb246-b7d5-4367-9cb6-96606a5de852 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:43.806849 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdb246-b7d5-4367-9cb6-96606a5de852 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:43.807587 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdb246-b7d5-4367-9cb6-96606a5de852 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:43.808098 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdb246-b7d5-4367-9cb6-96606a5de852 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/projects/d9d354c6d82f4e4db185411439365282/users/3fb06fd4fda2471ba6a8833d92f7f220/roles/175d3fd1a56f401b84575b2ab438b7b9` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:43.812311 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bdb246-b7d5-4367-9cb6-96606a5de852 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d9d354c6d82f4e4db185411439365282, user_id=3fb06fd4fda2471ba6a8833d92f7f220, role_id=175d3fd1a56f401b84575b2ab438b7b9)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:43.816462 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bdb246-b7d5-4367-9cb6-96606a5de852 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:43.856340 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3250/6539] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:06:43 2022] PUT /identity/v3/projects/d9d354c6d82f4e4db185411439365282/users/3fb06fd4fda2471ba6a8833d92f7f220/roles/175d3fd1a56f401b84575b2ab438b7b9 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:43.856483 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ca7be-b1f9-48e0-9c48-d1c66ec9b4ef tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:43.908718 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ca7be-b1f9-48e0-9c48-d1c66ec9b4ef tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:44.039871 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bdb246-b7d5-4367-9cb6-96606a5de852 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:44.039871 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-44bdb246-b7d5-4367-9cb6-96606a5de852 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:44.142889 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:44.172184 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b963aab3-19a8-425e-8728-59275acf7db5 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:44.172819 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963aab3-19a8-425e-8728-59275acf7db5 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:44.173102 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963aab3-19a8-425e-8728-59275acf7db5 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:44.173380 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963aab3-19a8-425e-8728-59275acf7db5 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:44.174058 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b963aab3-19a8-425e-8728-59275acf7db5 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:44.176015 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b963aab3-19a8-425e-8728-59275acf7db5 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:44.190412 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bdb246-b7d5-4367-9cb6-96606a5de852 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:44.201988 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d61d506-7583-440d-874a-123d8825fe09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:44.203605 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61d506-7583-440d-874a-123d8825fe09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:44.204155 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61d506-7583-440d-874a-123d8825fe09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:44.206203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61d506-7583-440d-874a-123d8825fe09 admin admin] PATH_INFO: `/v3/projects/59fcefbcc807472498925f385bbb3de0` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:44.208296 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d61d506-7583-440d-874a-123d8825fe09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59fcefbcc807472498925f385bbb3de0)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:44.212557 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d61d506-7583-440d-874a-123d8825fe09 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:44.244168 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3290/6540] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:06:43 2022] GET /identity/v3/users => generated 8631 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:06:44.245922 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7699f-6032-4c01-b2d2-7c80e9656405 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:44.246433 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7699f-6032-4c01-b2d2-7c80e9656405 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:44.246878 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7699f-6032-4c01-b2d2-7c80e9656405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:44.309291 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6d61d506-7583-440d-874a-123d8825fe09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59fcefbcc807472498925f385bbb3de0', 'request_id': 'req-6d61d506-7583-440d-874a-123d8825fe09'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:44.319348 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6d61d506-7583-440d-874a-123d8825fe09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59fcefbcc807472498925f385bbb3de0', 'request_id': 'req-6d61d506-7583-440d-874a-123d8825fe09'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:44.336157 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-91e7699f-6032-4c01-b2d2-7c80e9656405 None None] MFA Rules not processed for user `3fb06fd4fda2471ba6a8833d92f7f220`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:44.337863 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-91e7699f-6032-4c01-b2d2-7c80e9656405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:44.343340 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6d61d506-7583-440d-874a-123d8825fe09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59fcefbcc807472498925f385bbb3de0', 'request_id': 'req-6d61d506-7583-440d-874a-123d8825fe09'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:44.379082 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6d61d506-7583-440d-874a-123d8825fe09 admin admin] The token cache is being invalidate because project 59fcefbcc807472498925f385bbb3de0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:44.379082 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6d61d506-7583-440d-874a-123d8825fe09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:44.381626 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6d61d506-7583-440d-874a-123d8825fe09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:44.385135 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3251/6541] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:06:44 2022] DELETE /identity/v3/projects/59fcefbcc807472498925f385bbb3de0 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:44.388023 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:44.392405 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d61d506-7583-440d-874a-123d8825fe09 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:44.407400 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6d61d506-7583-440d-874a-123d8825fe09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:44.502087 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3291/6542] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:44 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:44.511869 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea432c89-75f9-4180-be7a-73dbd254c61d None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:44.512408 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea432c89-75f9-4180-be7a-73dbd254c61d None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:44.512890 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea432c89-75f9-4180-be7a-73dbd254c61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:44.555690 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-ea432c89-75f9-4180-be7a-73dbd254c61d None None] MFA Rules not processed for user `3fb06fd4fda2471ba6a8833d92f7f220`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:44.559132 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ea432c89-75f9-4180-be7a-73dbd254c61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:44.578674 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3292/6543] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:44 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:44.579852 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea432c89-75f9-4180-be7a-73dbd254c61d None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:44.596461 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea432c89-75f9-4180-be7a-73dbd254c61d None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:44.603548 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a19a6-ee63-4679-abbc-8d4b7b898179 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fb06fd4fda2471ba6a8833d92f7f220', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9d354c6d82f4e4db185411439365282', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-847943632', 'tempest-NotDelegatedRole-1705475945'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:44.604440 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a19a6-ee63-4679-abbc-8d4b7b898179 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:44.604894 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a19a6-ee63-4679-abbc-8d4b7b898179 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:44.605325 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a19a6-ee63-4679-abbc-8d4b7b898179 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:44.606349 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03a19a6-ee63-4679-abbc-8d4b7b898179 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] RBAC: Authorizing `identity:create_trust()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:44.608302 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03a19a6-ee63-4679-abbc-8d4b7b898179 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:44.650685 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d61d506-7583-440d-874a-123d8825fe09 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:44.668451 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e367d-79d5-439a-84c4-7473b9292acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:44.669801 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e367d-79d5-439a-84c4-7473b9292acf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:44.671512 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e367d-79d5-439a-84c4-7473b9292acf admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:44.671690 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e367d-79d5-439a-84c4-7473b9292acf admin admin] PATH_INFO: `/v3/users/5e588f0a86b747b789c18379d00163aa` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:44.674126 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741e367d-79d5-439a-84c4-7473b9292acf admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e588f0a86b747b789c18379d00163aa)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:44.680269 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741e367d-79d5-439a-84c4-7473b9292acf admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:44.833167 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-741e367d-79d5-439a-84c4-7473b9292acf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e588f0a86b747b789c18379d00163aa'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:44.834734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-741e367d-79d5-439a-84c4-7473b9292acf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e588f0a86b747b789c18379d00163aa'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:44.836335 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3293/6544] 10.222.0.83 () {60 vars in 1174 bytes} [Mon Aug 29 16:06:44 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:44.837326 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a19a6-ee63-4679-abbc-8d4b7b898179 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:44.857491 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a19a6-ee63-4679-abbc-8d4b7b898179 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:44.863542 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-741e367d-79d5-439a-84c4-7473b9292acf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e588f0a86b747b789c18379d00163aa'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:44.871065 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eff832-7624-4bc2-b29a-ee03e817f6c1 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fb06fd4fda2471ba6a8833d92f7f220', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9d354c6d82f4e4db185411439365282', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-847943632', 'tempest-NotDelegatedRole-1705475945'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:44.872164 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eff832-7624-4bc2-b29a-ee03e817f6c1 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:44.873203 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eff832-7624-4bc2-b29a-ee03e817f6c1 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:44.873767 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eff832-7624-4bc2-b29a-ee03e817f6c1 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] PATH_INFO: `/v3/OS-TRUST/trusts/db11cb6266154c7da1dc3d78374bcfd3` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:44.880666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-741e367d-79d5-439a-84c4-7473b9292acf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e588f0a86b747b789c18379d00163aa'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:44.883790 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:44.888772 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eff832-7624-4bc2-b29a-ee03e817f6c1 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] RBAC: Authorizing `identity:get_trust(trust_id=db11cb6266154c7da1dc3d78374bcfd3)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:44.890006 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eff832-7624-4bc2-b29a-ee03e817f6c1 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:44.900982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-741e367d-79d5-439a-84c4-7473b9292acf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e588f0a86b747b789c18379d00163aa'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:44.922958 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3252/6545] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:06:44 2022] DELETE /identity/v3/users/5e588f0a86b747b789c18379d00163aa => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:44.927283 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3294/6546] 10.222.0.83 () {58 vars in 1251 bytes} [Mon Aug 29 16:06:44 2022] GET /identity/v3/OS-TRUST/trusts/db11cb6266154c7da1dc3d78374bcfd3 => generated 833 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:06:44.932356 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e367d-79d5-439a-84c4-7473b9292acf admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:44.934034 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-741e367d-79d5-439a-84c4-7473b9292acf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:45.203779 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e367d-79d5-439a-84c4-7473b9292acf admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:45.209713 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176dade-318e-48bc-bc08-ec0b55507055 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fb06fd4fda2471ba6a8833d92f7f220', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9d354c6d82f4e4db185411439365282', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-847943632', 'tempest-NotDelegatedRole-1705475945'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:45.210399 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176dade-318e-48bc-bc08-ec0b55507055 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:45.211244 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176dade-318e-48bc-bc08-ec0b55507055 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:45.211580 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176dade-318e-48bc-bc08-ec0b55507055 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] PATH_INFO: `/v3/OS-TRUST/trusts/db11cb6266154c7da1dc3d78374bcfd3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:45.222929 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9176dade-318e-48bc-bc08-ec0b55507055 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=db11cb6266154c7da1dc3d78374bcfd3)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:45.224598 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9176dade-318e-48bc-bc08-ec0b55507055 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:45.238687 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3253/6547] 10.222.0.83 () {58 vars in 1269 bytes} [Mon Aug 29 16:06:44 2022] GET /identity/v3/OS-TRUST/trusts/db11cb6266154c7da1dc3d78374bcfd3/roles => generated 370 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:06:45.239313 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eff832-7624-4bc2-b29a-ee03e817f6c1 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:45.253201 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eff832-7624-4bc2-b29a-ee03e817f6c1 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:45.264744 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b2ec6-861e-48d0-a945-7203d0fcfe8b tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fb06fd4fda2471ba6a8833d92f7f220', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9d354c6d82f4e4db185411439365282', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-847943632', 'tempest-NotDelegatedRole-1705475945'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:45.265428 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b2ec6-861e-48d0-a945-7203d0fcfe8b tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:45.265713 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b2ec6-861e-48d0-a945-7203d0fcfe8b tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:45.265992 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b2ec6-861e-48d0-a945-7203d0fcfe8b tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] PATH_INFO: `/v3/OS-TRUST/trusts/db11cb6266154c7da1dc3d78374bcfd3/roles/f300ec3596394245b4cc33be1d9fadbf` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:45.287176 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25b2ec6-861e-48d0-a945-7203d0fcfe8b tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] RBAC: Authorizing `identity:get_role_for_trust(trust_id=db11cb6266154c7da1dc3d78374bcfd3, role_id=f300ec3596394245b4cc33be1d9fadbf)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:45.289223 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25b2ec6-861e-48d0-a945-7203d0fcfe8b tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:45.304043 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3295/6548] 10.222.0.83 () {58 vars in 1368 bytes} [Mon Aug 29 16:06:45 2022] GET /identity/v3/OS-TRUST/trusts/db11cb6266154c7da1dc3d78374bcfd3/roles/f300ec3596394245b4cc33be1d9fadbf => generated 243 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:06:45.307960 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176dade-318e-48bc-bc08-ec0b55507055 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:45.324962 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176dade-318e-48bc-bc08-ec0b55507055 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:45.342817 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8297c67-dbaa-4986-8f97-415f1772a766 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fb06fd4fda2471ba6a8833d92f7f220', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9d354c6d82f4e4db185411439365282', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-847943632', 'tempest-NotDelegatedRole-1705475945'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:45.345886 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8297c67-dbaa-4986-8f97-415f1772a766 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] REQUEST_METHOD: `HEAD` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:45.345886 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8297c67-dbaa-4986-8f97-415f1772a766 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:45.347256 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8297c67-dbaa-4986-8f97-415f1772a766 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] PATH_INFO: `/v3/OS-TRUST/trusts/db11cb6266154c7da1dc3d78374bcfd3/roles/f300ec3596394245b4cc33be1d9fadbf` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:45.362875 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8297c67-dbaa-4986-8f97-415f1772a766 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] RBAC: Authorizing `identity:get_role_for_trust(trust_id=db11cb6266154c7da1dc3d78374bcfd3, role_id=f300ec3596394245b4cc33be1d9fadbf)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:45.366128 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8297c67-dbaa-4986-8f97-415f1772a766 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:45.381380 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b2ec6-861e-48d0-a945-7203d0fcfe8b tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:45.381891 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3254/6549] 10.222.0.83 () {58 vars in 1369 bytes} [Mon Aug 29 16:06:45 2022] HEAD /identity/v3/OS-TRUST/trusts/db11cb6266154c7da1dc3d78374bcfd3/roles/f300ec3596394245b4cc33be1d9fadbf => generated 0 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Aug 29 16:06:45.394564 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b2ec6-861e-48d0-a945-7203d0fcfe8b tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:45.399944 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd16e9d1-177d-46ae-91e6-35f23690e610 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fb06fd4fda2471ba6a8833d92f7f220', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9d354c6d82f4e4db185411439365282', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-847943632', 'tempest-NotDelegatedRole-1705475945'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:45.400772 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16e9d1-177d-46ae-91e6-35f23690e610 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:45.401115 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16e9d1-177d-46ae-91e6-35f23690e610 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:45.401398 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16e9d1-177d-46ae-91e6-35f23690e610 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] PATH_INFO: `/v3/OS-TRUST/trusts/db11cb6266154c7da1dc3d78374bcfd3/roles/175d3fd1a56f401b84575b2ab438b7b9` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:45.414132 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd16e9d1-177d-46ae-91e6-35f23690e610 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] RBAC: Authorizing `identity:get_role_for_trust(trust_id=db11cb6266154c7da1dc3d78374bcfd3, role_id=175d3fd1a56f401b84575b2ab438b7b9)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:45.415683 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd16e9d1-177d-46ae-91e6-35f23690e610 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:45.442352 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-bd16e9d1-177d-46ae-91e6-35f23690e610 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] Could not find role: 175d3fd1a56f401b84575b2ab438b7b9.: keystone.exception.RoleNotFound: Could not find role: 175d3fd1a56f401b84575b2ab438b7b9. Aug 29 16:06:45.442352 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:06:45.442352 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:06:45.442352 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:06:45.442352 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:06:45.442352 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:06:45.442352 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:06:45.442352 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:06:45.442352 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:06:45.442352 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:06:45.442352 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:06:45.442352 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:06:45.442352 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 29 16:06:45.442352 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 16:06:45.442352 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 175d3fd1a56f401b84575b2ab438b7b9. Aug 29 16:06:45.443466 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:06:45.449168 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3296/6550] 10.222.0.83 () {58 vars in 1368 bytes} [Mon Aug 29 16:06:45 2022] GET /identity/v3/OS-TRUST/trusts/db11cb6266154c7da1dc3d78374bcfd3/roles/175d3fd1a56f401b84575b2ab438b7b9 => generated 110 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 16:06:45.454015 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8297c67-dbaa-4986-8f97-415f1772a766 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:45.468524 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8297c67-dbaa-4986-8f97-415f1772a766 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:45.483367 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2c317-a825-430f-a441-524b04ca582f tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fb06fd4fda2471ba6a8833d92f7f220', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9d354c6d82f4e4db185411439365282', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-847943632', 'tempest-NotDelegatedRole-1705475945'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:45.484055 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2c317-a825-430f-a441-524b04ca582f tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] REQUEST_METHOD: `HEAD` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:45.484337 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2c317-a825-430f-a441-524b04ca582f tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:45.484730 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2c317-a825-430f-a441-524b04ca582f tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] PATH_INFO: `/v3/OS-TRUST/trusts/db11cb6266154c7da1dc3d78374bcfd3/roles/175d3fd1a56f401b84575b2ab438b7b9` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:45.491931 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead2c317-a825-430f-a441-524b04ca582f tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] RBAC: Authorizing `identity:get_role_for_trust(trust_id=db11cb6266154c7da1dc3d78374bcfd3, role_id=175d3fd1a56f401b84575b2ab438b7b9)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:45.493651 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead2c317-a825-430f-a441-524b04ca582f tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:45.516896 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-ead2c317-a825-430f-a441-524b04ca582f tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] Could not find role: 175d3fd1a56f401b84575b2ab438b7b9.: keystone.exception.RoleNotFound: Could not find role: 175d3fd1a56f401b84575b2ab438b7b9. Aug 29 16:06:45.516896 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:06:45.516896 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:06:45.516896 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:06:45.516896 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:06:45.516896 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:06:45.516896 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:06:45.516896 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:06:45.516896 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:06:45.516896 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:06:45.516896 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:06:45.516896 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:06:45.516896 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 29 16:06:45.516896 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 16:06:45.516896 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 175d3fd1a56f401b84575b2ab438b7b9. Aug 29 16:06:45.518035 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:06:45.526422 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3255/6551] 10.222.0.83 () {58 vars in 1369 bytes} [Mon Aug 29 16:06:45 2022] HEAD /identity/v3/OS-TRUST/trusts/db11cb6266154c7da1dc3d78374bcfd3/roles/175d3fd1a56f401b84575b2ab438b7b9 => generated 0 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Aug 29 16:06:45.527812 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd16e9d1-177d-46ae-91e6-35f23690e610 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:45.553736 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd16e9d1-177d-46ae-91e6-35f23690e610 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:45.558092 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f2bf2-5537-4989-a64d-320d663f7017 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fb06fd4fda2471ba6a8833d92f7f220', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9d354c6d82f4e4db185411439365282', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-847943632', 'tempest-NotDelegatedRole-1705475945'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:45.558786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f2bf2-5537-4989-a64d-320d663f7017 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:45.559094 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f2bf2-5537-4989-a64d-320d663f7017 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:45.559417 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f2bf2-5537-4989-a64d-320d663f7017 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] PATH_INFO: `/v3/OS-TRUST/trusts/db11cb6266154c7da1dc3d78374bcfd3` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:45.574409 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720f2bf2-5537-4989-a64d-320d663f7017 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] RBAC: Authorizing `identity:delete_trust(trust_id=db11cb6266154c7da1dc3d78374bcfd3)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:45.576655 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720f2bf2-5537-4989-a64d-320d663f7017 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:45.623628 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-720f2bf2-5537-4989-a64d-320d663f7017 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'db11cb6266154c7da1dc3d78374bcfd3', 'request_id': 'req-720f2bf2-5537-4989-a64d-320d663f7017'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:45.624460 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-720f2bf2-5537-4989-a64d-320d663f7017 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'db11cb6266154c7da1dc3d78374bcfd3', 'request_id': 'req-720f2bf2-5537-4989-a64d-320d663f7017'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:45.625353 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-720f2bf2-5537-4989-a64d-320d663f7017 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'db11cb6266154c7da1dc3d78374bcfd3', 'request_id': 'req-720f2bf2-5537-4989-a64d-320d663f7017'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:45.652837 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3297/6552] 10.222.0.83 () {58 vars in 1254 bytes} [Mon Aug 29 16:06:45 2022] DELETE /identity/v3/OS-TRUST/trusts/db11cb6266154c7da1dc3d78374bcfd3 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:45.657762 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2c317-a825-430f-a441-524b04ca582f tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:45.659691 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ead2c317-a825-430f-a441-524b04ca582f tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:45.680923 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2c317-a825-430f-a441-524b04ca582f tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:45.692084 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061b638-a9a7-47f8-9206-315c6b2e81ad tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fb06fd4fda2471ba6a8833d92f7f220', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9d354c6d82f4e4db185411439365282', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-847943632', 'tempest-NotDelegatedRole-1705475945'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:45.695336 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061b638-a9a7-47f8-9206-315c6b2e81ad tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:45.695636 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061b638-a9a7-47f8-9206-315c6b2e81ad tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:45.695921 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061b638-a9a7-47f8-9206-315c6b2e81ad tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] PATH_INFO: `/v3/OS-TRUST/trusts/db11cb6266154c7da1dc3d78374bcfd3` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:45.728184 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-e061b638-a9a7-47f8-9206-315c6b2e81ad tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] Could not find trust: db11cb6266154c7da1dc3d78374bcfd3.: keystone.exception.TrustNotFound: Could not find trust: db11cb6266154c7da1dc3d78374bcfd3. Aug 29 16:06:45.728184 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:06:45.728184 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:06:45.728184 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:06:45.728184 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:06:45.728184 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:06:45.728184 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:06:45.728184 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:06:45.728184 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:06:45.728184 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:06:45.728184 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:06:45.728184 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:06:45.728184 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 29 16:06:45.728184 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 29 16:06:45.728184 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 29 16:06:45.729316 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 29 16:06:45.729316 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 29 16:06:45.729316 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 29 16:06:45.729316 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 29 16:06:45.729316 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 29 16:06:45.729316 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:06:45.729316 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:06:45.729316 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 29 16:06:45.729316 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 29 16:06:45.729316 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 29 16:06:45.729316 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 29 16:06:45.729316 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: db11cb6266154c7da1dc3d78374bcfd3. Aug 29 16:06:45.729316 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:06:45.730291 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3256/6553] 10.222.0.83 () {58 vars in 1251 bytes} [Mon Aug 29 16:06:45 2022] GET /identity/v3/OS-TRUST/trusts/db11cb6266154c7da1dc3d78374bcfd3 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 16:06:45.735724 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f2bf2-5537-4989-a64d-320d663f7017 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:45.738161 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-720f2bf2-5537-4989-a64d-320d663f7017 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:45.774587 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:45.899732 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061b638-a9a7-47f8-9206-315c6b2e81ad tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:45.901500 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e061b638-a9a7-47f8-9206-315c6b2e81ad tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:45.988734 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f2bf2-5537-4989-a64d-320d663f7017 tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:46.004273 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa1524-d89d-40cc-92a0-cd7ab7067e3c tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:46.004941 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa1524-d89d-40cc-92a0-cd7ab7067e3c tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:46.005226 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa1524-d89d-40cc-92a0-cd7ab7067e3c tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:46.005504 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa1524-d89d-40cc-92a0-cd7ab7067e3c tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/roles/175d3fd1a56f401b84575b2ab438b7b9` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:46.008027 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa1524-d89d-40cc-92a0-cd7ab7067e3c tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:delete_role(role_id=175d3fd1a56f401b84575b2ab438b7b9)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:46.009664 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa1524-d89d-40cc-92a0-cd7ab7067e3c tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:46.131561 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6daa1524-d89d-40cc-92a0-cd7ab7067e3c tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invalidating the token cache because role 175d3fd1a56f401b84575b2ab438b7b9 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:46.132099 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6daa1524-d89d-40cc-92a0-cd7ab7067e3c tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:46.133628 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6daa1524-d89d-40cc-92a0-cd7ab7067e3c tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:46.136943 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3298/6554] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:06:45 2022] DELETE /identity/v3/roles/175d3fd1a56f401b84575b2ab438b7b9 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:46.142680 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa1524-d89d-40cc-92a0-cd7ab7067e3c tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:46.145469 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6daa1524-d89d-40cc-92a0-cd7ab7067e3c tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:46.157035 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061b638-a9a7-47f8-9206-315c6b2e81ad tempest-TrustsV3TestJSON-901018785 tempest-user-1255477605] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:46.275591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:46.332290 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa1524-d89d-40cc-92a0-cd7ab7067e3c tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:46.332550 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87975936-0d10-438d-9b80-e5808c2cfd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:46.333317 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87975936-0d10-438d-9b80-e5808c2cfd3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:46.333749 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87975936-0d10-438d-9b80-e5808c2cfd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:46.334284 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87975936-0d10-438d-9b80-e5808c2cfd3d admin admin] PATH_INFO: `/v3/users/92c5ce831e9e495bbafeb8850e81c7fe` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:46.339254 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87975936-0d10-438d-9b80-e5808c2cfd3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=92c5ce831e9e495bbafeb8850e81c7fe)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:46.346054 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e40476-1c5b-4b7e-9b88-984a63104191 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:46.346988 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87975936-0d10-438d-9b80-e5808c2cfd3d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:46.349802 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e40476-1c5b-4b7e-9b88-984a63104191 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:46.353338 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e40476-1c5b-4b7e-9b88-984a63104191 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:46.354366 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e40476-1c5b-4b7e-9b88-984a63104191 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/roles/f300ec3596394245b4cc33be1d9fadbf` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:46.358338 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e40476-1c5b-4b7e-9b88-984a63104191 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f300ec3596394245b4cc33be1d9fadbf)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:46.362254 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e40476-1c5b-4b7e-9b88-984a63104191 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:46.449339 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-21e40476-1c5b-4b7e-9b88-984a63104191 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invalidating the token cache because role f300ec3596394245b4cc33be1d9fadbf has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:46.450976 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-21e40476-1c5b-4b7e-9b88-984a63104191 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:46.452515 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-21e40476-1c5b-4b7e-9b88-984a63104191 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:46.458776 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3299/6555] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:06:46 2022] DELETE /identity/v3/roles/f300ec3596394245b4cc33be1d9fadbf => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:46.459946 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e40476-1c5b-4b7e-9b88-984a63104191 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:46.462784 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-21e40476-1c5b-4b7e-9b88-984a63104191 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:46.492496 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-87975936-0d10-438d-9b80-e5808c2cfd3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92c5ce831e9e495bbafeb8850e81c7fe'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:46.493129 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-87975936-0d10-438d-9b80-e5808c2cfd3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92c5ce831e9e495bbafeb8850e81c7fe'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:46.525874 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-87975936-0d10-438d-9b80-e5808c2cfd3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92c5ce831e9e495bbafeb8850e81c7fe'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:46.538438 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-87975936-0d10-438d-9b80-e5808c2cfd3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92c5ce831e9e495bbafeb8850e81c7fe'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:46.553550 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-87975936-0d10-438d-9b80-e5808c2cfd3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92c5ce831e9e495bbafeb8850e81c7fe'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:46.561792 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3257/6556] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:06:45 2022] DELETE /identity/v3/users/92c5ce831e9e495bbafeb8850e81c7fe => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:46.567347 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae941b4e-01c4-4d58-b3e0-762ee6aa5f2c None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:46.567347 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae941b4e-01c4-4d58-b3e0-762ee6aa5f2c None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:46.567805 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae941b4e-01c4-4d58-b3e0-762ee6aa5f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:46.605462 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:46.610251 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-ae941b4e-01c4-4d58-b3e0-762ee6aa5f2c None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:46.613630 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ae941b4e-01c4-4d58-b3e0-762ee6aa5f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:46.657157 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e40476-1c5b-4b7e-9b88-984a63104191 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:46.764140 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3258/6557] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:06:46.781585 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae941b4e-01c4-4d58-b3e0-762ee6aa5f2c None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:46.783264 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ae941b4e-01c4-4d58-b3e0-762ee6aa5f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:46.890355 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e7c1f-1882-4f18-8af7-75b68d283591 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:46.890596 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e7c1f-1882-4f18-8af7-75b68d283591 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:46.890797 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e7c1f-1882-4f18-8af7-75b68d283591 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:46.891143 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e7c1f-1882-4f18-8af7-75b68d283591 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/users/3fb06fd4fda2471ba6a8833d92f7f220` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:46.894191 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01e7c1f-1882-4f18-8af7-75b68d283591 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3fb06fd4fda2471ba6a8833d92f7f220)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:46.896278 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01e7c1f-1882-4f18-8af7-75b68d283591 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:47.049133 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae941b4e-01c4-4d58-b3e0-762ee6aa5f2c None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:47.058927 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a15dd-0a0a-40ee-8f14-c630338380de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:47.059679 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a15dd-0a0a-40ee-8f14-c630338380de service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:47.067467 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a15dd-0a0a-40ee-8f14-c630338380de service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:47.067875 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a15dd-0a0a-40ee-8f14-c630338380de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:47.070090 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d01e7c1f-1882-4f18-8af7-75b68d283591 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fb06fd4fda2471ba6a8833d92f7f220'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:47.071656 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d01e7c1f-1882-4f18-8af7-75b68d283591 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fb06fd4fda2471ba6a8833d92f7f220'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:47.113046 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d01e7c1f-1882-4f18-8af7-75b68d283591 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fb06fd4fda2471ba6a8833d92f7f220'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:47.127109 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a15dd-0a0a-40ee-8f14-c630338380de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:47.134178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a15dd-0a0a-40ee-8f14-c630338380de service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:47.140020 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d01e7c1f-1882-4f18-8af7-75b68d283591 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fb06fd4fda2471ba6a8833d92f7f220'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:47.141226 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d01e7c1f-1882-4f18-8af7-75b68d283591 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fb06fd4fda2471ba6a8833d92f7f220'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:47.166796 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3259/6558] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:06:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:06:47.167940 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a15dd-0a0a-40ee-8f14-c630338380de service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:47.183253 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d86a15dd-0a0a-40ee-8f14-c630338380de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:47.214575 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3300/6559] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:06:46 2022] DELETE /identity/v3/users/3fb06fd4fda2471ba6a8833d92f7f220 => generated 0 bytes in 752 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:47.215674 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e7c1f-1882-4f18-8af7-75b68d283591 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:47.220217 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d01e7c1f-1882-4f18-8af7-75b68d283591 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:47.241678 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a15dd-0a0a-40ee-8f14-c630338380de service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:47.274772 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:47.531412 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e7c1f-1882-4f18-8af7-75b68d283591 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:47.546225 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba9e3b-5e60-4fac-895f-5887c5386941 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:47.549061 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba9e3b-5e60-4fac-895f-5887c5386941 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:47.551416 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba9e3b-5e60-4fac-895f-5887c5386941 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:47.552843 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba9e3b-5e60-4fac-895f-5887c5386941 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/projects/d9d354c6d82f4e4db185411439365282` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:47.554870 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba9e3b-5e60-4fac-895f-5887c5386941 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d9d354c6d82f4e4db185411439365282)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:47.559140 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba9e3b-5e60-4fac-895f-5887c5386941 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:47.560468 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf9b31-4a0e-4650-a6d5-e0bdc8bd4afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:47.561232 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf9b31-4a0e-4650-a6d5-e0bdc8bd4afe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:47.561504 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf9b31-4a0e-4650-a6d5-e0bdc8bd4afe admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:47.561755 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf9b31-4a0e-4650-a6d5-e0bdc8bd4afe admin admin] PATH_INFO: `/v3/projects/f5f4d68286a0452595d1960baf97266a` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:47.563736 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf9b31-4a0e-4650-a6d5-e0bdc8bd4afe admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5f4d68286a0452595d1960baf97266a)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:47.573527 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf9b31-4a0e-4650-a6d5-e0bdc8bd4afe admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:47.620648 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:47.679066 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4fba9e3b-5e60-4fac-895f-5887c5386941 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9d354c6d82f4e4db185411439365282', 'request_id': 'req-4fba9e3b-5e60-4fac-895f-5887c5386941'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:47.695650 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4fba9e3b-5e60-4fac-895f-5887c5386941 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9d354c6d82f4e4db185411439365282', 'request_id': 'req-4fba9e3b-5e60-4fac-895f-5887c5386941'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:47.718745 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4fba9e3b-5e60-4fac-895f-5887c5386941 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9d354c6d82f4e4db185411439365282', 'request_id': 'req-4fba9e3b-5e60-4fac-895f-5887c5386941'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:47.749611 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4fba9e3b-5e60-4fac-895f-5887c5386941 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] The token cache is being invalidate because project d9d354c6d82f4e4db185411439365282 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:47.749913 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4fba9e3b-5e60-4fac-895f-5887c5386941 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:47.751534 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1baf9b31-4a0e-4650-a6d5-e0bdc8bd4afe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5f4d68286a0452595d1960baf97266a', 'request_id': 'req-1baf9b31-4a0e-4650-a6d5-e0bdc8bd4afe'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:47.752965 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4fba9e3b-5e60-4fac-895f-5887c5386941 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:47.766587 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3301/6560] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:06:47 2022] DELETE /identity/v3/projects/d9d354c6d82f4e4db185411439365282 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:47.768170 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba9e3b-5e60-4fac-895f-5887c5386941 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:47.770447 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4fba9e3b-5e60-4fac-895f-5887c5386941 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:47.786435 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1baf9b31-4a0e-4650-a6d5-e0bdc8bd4afe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5f4d68286a0452595d1960baf97266a', 'request_id': 'req-1baf9b31-4a0e-4650-a6d5-e0bdc8bd4afe'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:47.809691 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1baf9b31-4a0e-4650-a6d5-e0bdc8bd4afe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5f4d68286a0452595d1960baf97266a', 'request_id': 'req-1baf9b31-4a0e-4650-a6d5-e0bdc8bd4afe'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:47.855077 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1baf9b31-4a0e-4650-a6d5-e0bdc8bd4afe admin admin] The token cache is being invalidate because project f5f4d68286a0452595d1960baf97266a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:47.858894 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1baf9b31-4a0e-4650-a6d5-e0bdc8bd4afe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:47.862282 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1baf9b31-4a0e-4650-a6d5-e0bdc8bd4afe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:47.869232 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3260/6561] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:06:47 2022] DELETE /identity/v3/projects/f5f4d68286a0452595d1960baf97266a => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:47.874732 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453ef16-ebdf-428e-8607-31b9f052d714 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:47.875258 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453ef16-ebdf-428e-8607-31b9f052d714 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:47.878638 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453ef16-ebdf-428e-8607-31b9f052d714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:47.936952 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-1453ef16-ebdf-428e-8607-31b9f052d714 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:47.938213 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1453ef16-ebdf-428e-8607-31b9f052d714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:47.990192 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba9e3b-5e60-4fac-895f-5887c5386941 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:48.091993 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3261/6562] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:48.101088 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f76e50-ba53-4bdc-8b9a-a1166f6fe937 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:48.101364 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f76e50-ba53-4bdc-8b9a-a1166f6fe937 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:48.101666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f76e50-ba53-4bdc-8b9a-a1166f6fe937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:48.161625 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-e8f76e50-ba53-4bdc-8b9a-a1166f6fe937 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:48.162903 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e8f76e50-ba53-4bdc-8b9a-a1166f6fe937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:48.190985 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafc791-2567-4315-b889-859cdbc9dfe4 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:48.192219 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafc791-2567-4315-b889-859cdbc9dfe4 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:48.194371 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafc791-2567-4315-b889-859cdbc9dfe4 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:48.194842 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafc791-2567-4315-b889-859cdbc9dfe4 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:48.195783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aafc791-2567-4315-b889-859cdbc9dfe4 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:48.196157 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3262/6563] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:48.198344 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aafc791-2567-4315-b889-859cdbc9dfe4 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:48.199477 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f76e50-ba53-4bdc-8b9a-a1166f6fe937 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:48.219506 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f76e50-ba53-4bdc-8b9a-a1166f6fe937 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:48.236522 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941fec7d-4df7-4ef2-9882-d3aaccd558b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:48.237423 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941fec7d-4df7-4ef2-9882-d3aaccd558b4 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:48.237958 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941fec7d-4df7-4ef2-9882-d3aaccd558b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:48.238467 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941fec7d-4df7-4ef2-9882-d3aaccd558b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:48.239336 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941fec7d-4df7-4ef2-9882-d3aaccd558b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:06:48.239801 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941fec7d-4df7-4ef2-9882-d3aaccd558b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:48.242574 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941fec7d-4df7-4ef2-9882-d3aaccd558b4 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:48.276970 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3302/6564] 10.222.0.83 () {60 vars in 1152 bytes} [Mon Aug 29 16:06:47 2022] POST /identity/v3/projects => generated 328 bytes in 509 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:06:48.293259 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafc791-2567-4315-b889-859cdbc9dfe4 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:48.303673 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6aafc791-2567-4315-b889-859cdbc9dfe4 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:48.309137 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3263/6565] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:06:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:06:48.315304 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941fec7d-4df7-4ef2-9882-d3aaccd558b4 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:48.347340 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941fec7d-4df7-4ef2-9882-d3aaccd558b4 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:48.450314 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:48.483636 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:48.579005 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafc791-2567-4315-b889-859cdbc9dfe4 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:48.595011 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99110dd9-990e-4258-b8c0-4c29fdb0b620 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:48.595960 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99110dd9-990e-4258-b8c0-4c29fdb0b620 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:48.596246 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99110dd9-990e-4258-b8c0-4c29fdb0b620 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:48.596614 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99110dd9-990e-4258-b8c0-4c29fdb0b620 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:48.597372 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99110dd9-990e-4258-b8c0-4c29fdb0b620 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:48.599473 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99110dd9-990e-4258-b8c0-4c29fdb0b620 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:48.608384 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ec5ce-4b82-492b-99cb-faba30853648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:48.609028 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ec5ce-4b82-492b-99cb-faba30853648 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:48.609313 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ec5ce-4b82-492b-99cb-faba30853648 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:48.609593 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ec5ce-4b82-492b-99cb-faba30853648 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:48.610249 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ec5ce-4b82-492b-99cb-faba30853648 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:48.612218 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ec5ce-4b82-492b-99cb-faba30853648 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:48.650181 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3303/6566] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:06:48 2022] POST /identity/v3/users => generated 413 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:48.652158 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99110dd9-990e-4258-b8c0-4c29fdb0b620 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:48.675059 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99110dd9-990e-4258-b8c0-4c29fdb0b620 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:48.695261 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5cb916-5608-4347-a683-dee4282d861d tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:48.696001 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5cb916-5608-4347-a683-dee4282d861d tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:48.697328 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5cb916-5608-4347-a683-dee4282d861d tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:48.698605 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5cb916-5608-4347-a683-dee4282d861d tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:48.709155 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5cb916-5608-4347-a683-dee4282d861d tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:48.712945 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3264/6567] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:06:48 2022] POST /identity/v3/projects => generated 369 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:48.714105 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ec5ce-4b82-492b-99cb-faba30853648 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:48.718214 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5cb916-5608-4347-a683-dee4282d861d tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:48.752574 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3304/6568] 10.222.0.83 () {60 vars in 1143 bytes} [Mon Aug 29 16:06:48 2022] POST /identity/v3/roles => generated 243 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:48.754349 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5cb916-5608-4347-a683-dee4282d861d tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:48.789652 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5cb916-5608-4347-a683-dee4282d861d tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:48.926006 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ec5ce-4b82-492b-99cb-faba30853648 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:48.932309 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd0772-2bbb-40ae-996a-a1de5da674fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:48.932955 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd0772-2bbb-40ae-996a-a1de5da674fa admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:48.933244 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd0772-2bbb-40ae-996a-a1de5da674fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:48.933594 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd0772-2bbb-40ae-996a-a1de5da674fa admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:48.934259 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd0772-2bbb-40ae-996a-a1de5da674fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:48.940513 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd0772-2bbb-40ae-996a-a1de5da674fa admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:48.979054 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a4196-9d9e-4501-9c78-ed8be58cadb0 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:48.979691 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a4196-9d9e-4501-9c78-ed8be58cadb0 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:48.979981 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a4196-9d9e-4501-9c78-ed8be58cadb0 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:48.980275 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a4196-9d9e-4501-9c78-ed8be58cadb0 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:48.980932 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a4196-9d9e-4501-9c78-ed8be58cadb0 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:48.983691 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a4196-9d9e-4501-9c78-ed8be58cadb0 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:48.987589 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3265/6569] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:06:48 2022] POST /identity/v3/users => generated 285 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:48.988557 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd0772-2bbb-40ae-996a-a1de5da674fa admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:49.014092 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd0772-2bbb-40ae-996a-a1de5da674fa admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:49.018207 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3305/6570] 10.222.0.83 () {60 vars in 1143 bytes} [Mon Aug 29 16:06:48 2022] POST /identity/v3/roles => generated 246 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:49.019244 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a4196-9d9e-4501-9c78-ed8be58cadb0 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:49.042317 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a804740-da34-46b9-ba3f-9d354d4f0acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:49.043701 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a804740-da34-46b9-ba3f-9d354d4f0acb admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:49.043985 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a804740-da34-46b9-ba3f-9d354d4f0acb admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:49.044302 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a804740-da34-46b9-ba3f-9d354d4f0acb admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:49.044987 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a804740-da34-46b9-ba3f-9d354d4f0acb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:49.048566 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a4196-9d9e-4501-9c78-ed8be58cadb0 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:49.050617 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a804740-da34-46b9-ba3f-9d354d4f0acb admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:49.061508 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bdbab1-edc9-4fc1-aae4-3fadbc76259a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:49.062023 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bdbab1-edc9-4fc1-aae4-3fadbc76259a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:49.062305 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bdbab1-edc9-4fc1-aae4-3fadbc76259a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:49.062578 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bdbab1-edc9-4fc1-aae4-3fadbc76259a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/projects/4f93e93aeafd434c90b554b010b32578/users/86b59b8ef1684cf7aae607ed2f567557/roles/0923d9eb9a554a518bac56c8512558ba` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:49.098683 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3266/6571] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:06:48 2022] GET /identity/v3/roles => generated 1891 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:06:49.099755 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a804740-da34-46b9-ba3f-9d354d4f0acb admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:49.128322 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bdbab1-edc9-4fc1-aae4-3fadbc76259a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4f93e93aeafd434c90b554b010b32578, user_id=86b59b8ef1684cf7aae607ed2f567557, role_id=0923d9eb9a554a518bac56c8512558ba)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:49.133700 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a804740-da34-46b9-ba3f-9d354d4f0acb admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:49.136697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bdbab1-edc9-4fc1-aae4-3fadbc76259a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:49.155634 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d9ae2a-f04e-44cc-879a-4484833d7eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:49.156356 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9ae2a-f04e-44cc-879a-4484833d7eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:49.156637 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9ae2a-f04e-44cc-879a-4484833d7eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:49.156912 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9ae2a-f04e-44cc-879a-4484833d7eb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:49.157757 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d9ae2a-f04e-44cc-879a-4484833d7eb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:49.165182 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d9ae2a-f04e-44cc-879a-4484833d7eb9 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:49.187970 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3306/6572] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:06:49 2022] PUT /identity/v3/projects/4f93e93aeafd434c90b554b010b32578/users/86b59b8ef1684cf7aae607ed2f567557/roles/0923d9eb9a554a518bac56c8512558ba => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:49.188953 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bdbab1-edc9-4fc1-aae4-3fadbc76259a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:49.221219 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3267/6573] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:06:49 2022] GET /identity/v3/roles => generated 1891 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:06:49.221417 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d9ae2a-f04e-44cc-879a-4484833d7eb9 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:49.255168 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d9ae2a-f04e-44cc-879a-4484833d7eb9 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:49.397972 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bdbab1-edc9-4fc1-aae4-3fadbc76259a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:49.412686 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83401cbc-b0f7-4b4a-b7ca-eef58fdba33a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:49.413624 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83401cbc-b0f7-4b4a-b7ca-eef58fdba33a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:49.413915 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83401cbc-b0f7-4b4a-b7ca-eef58fdba33a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:49.414340 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83401cbc-b0f7-4b4a-b7ca-eef58fdba33a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/projects/4f93e93aeafd434c90b554b010b32578/users/86b59b8ef1684cf7aae607ed2f567557/roles/0f6e4bb4768e48299899e1e18539a832` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:49.420228 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83401cbc-b0f7-4b4a-b7ca-eef58fdba33a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4f93e93aeafd434c90b554b010b32578, user_id=86b59b8ef1684cf7aae607ed2f567557, role_id=0f6e4bb4768e48299899e1e18539a832)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:49.420790 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaca343-8876-4b47-a98b-93b6049637df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:49.423054 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaca343-8876-4b47-a98b-93b6049637df admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:49.423180 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83401cbc-b0f7-4b4a-b7ca-eef58fdba33a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:49.426725 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaca343-8876-4b47-a98b-93b6049637df admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:49.427207 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaca343-8876-4b47-a98b-93b6049637df admin admin] PATH_INFO: `/v3/projects/e52a6166bdb84df8b590884efba1f7b6/users/568693f2bf7843c78f15a31217eb5df7/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:49.462224 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3307/6574] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:06:49 2022] PUT /identity/v3/projects/4f93e93aeafd434c90b554b010b32578/users/86b59b8ef1684cf7aae607ed2f567557/roles/0f6e4bb4768e48299899e1e18539a832 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:49.463575 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83401cbc-b0f7-4b4a-b7ca-eef58fdba33a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:49.467472 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaca343-8876-4b47-a98b-93b6049637df admin admin] RBAC: Authorizing `identity:create_grant(project_id=e52a6166bdb84df8b590884efba1f7b6, user_id=568693f2bf7843c78f15a31217eb5df7, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:49.476248 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaca343-8876-4b47-a98b-93b6049637df admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:49.492608 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:49.493794 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:49.519061 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3268/6575] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:06:49 2022] PUT /identity/v3/projects/e52a6166bdb84df8b590884efba1f7b6/users/568693f2bf7843c78f15a31217eb5df7/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:49.524521 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1bc20-dd70-447f-8dec-50e42e9f91bb None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:49.525265 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1bc20-dd70-447f-8dec-50e42e9f91bb None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:49.525706 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1bc20-dd70-447f-8dec-50e42e9f91bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:49.607104 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-1eb1bc20-dd70-447f-8dec-50e42e9f91bb None None] MFA Rules not processed for user `568693f2bf7843c78f15a31217eb5df7`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:49.607104 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1eb1bc20-dd70-447f-8dec-50e42e9f91bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:49.629679 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83401cbc-b0f7-4b4a-b7ca-eef58fdba33a tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:49.965636 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3269/6576] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 437 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:49.966916 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae8df8-7da8-414e-ba1d-5f557ec45098 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:49.966916 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae8df8-7da8-414e-ba1d-5f557ec45098 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:49.967176 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1bc20-dd70-447f-8dec-50e42e9f91bb None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:49.967457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae8df8-7da8-414e-ba1d-5f557ec45098 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:49.967457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae8df8-7da8-414e-ba1d-5f557ec45098 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:49.967457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae8df8-7da8-414e-ba1d-5f557ec45098 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:49.969354 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae8df8-7da8-414e-ba1d-5f557ec45098 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:49.988735 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1bc20-dd70-447f-8dec-50e42e9f91bb None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:49.996245 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca374b0-b5eb-49aa-885a-4fc79697740b tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '568693f2bf7843c78f15a31217eb5df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e52a6166bdb84df8b590884efba1f7b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:49.998677 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca374b0-b5eb-49aa-885a-4fc79697740b tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:49.999121 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca374b0-b5eb-49aa-885a-4fc79697740b tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:50.000083 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca374b0-b5eb-49aa-885a-4fc79697740b tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] PATH_INFO: `/v3/users/568693f2bf7843c78f15a31217eb5df7/application_credentials` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:50.001193 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca374b0-b5eb-49aa-885a-4fc79697740b tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] RBAC: Authorizing `identity:create_application_credential(user_id=568693f2bf7843c78f15a31217eb5df7)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:50.002820 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca374b0-b5eb-49aa-885a-4fc79697740b tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:50.037145 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3308/6577] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:06:49 2022] GET /identity/v3/users => generated 8350 bytes in 574 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:06:50.044090 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eda9f2-e7d5-45df-9c79-386bb8e1b4f6 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:50.044976 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eda9f2-e7d5-45df-9c79-386bb8e1b4f6 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:50.045257 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eda9f2-e7d5-45df-9c79-386bb8e1b4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:50.162573 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3270/6578] 10.222.0.83 () {60 vars in 1315 bytes} [Mon Aug 29 16:06:49 2022] POST /identity/v3/users/568693f2bf7843c78f15a31217eb5df7/application_credentials => generated 921 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:06:50.166495 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-c0eda9f2-e7d5-45df-9c79-386bb8e1b4f6 None None] MFA Rules not processed for user `86b59b8ef1684cf7aae607ed2f567557`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:50.166826 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca374b0-b5eb-49aa-885a-4fc79697740b tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:50.168105 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c0eda9f2-e7d5-45df-9c79-386bb8e1b4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:50.188325 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca374b0-b5eb-49aa-885a-4fc79697740b tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:50.194293 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71ce2f-2ec8-4410-a752-394a2938a001 tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '568693f2bf7843c78f15a31217eb5df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e52a6166bdb84df8b590884efba1f7b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:50.195434 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71ce2f-2ec8-4410-a752-394a2938a001 tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:50.195727 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71ce2f-2ec8-4410-a752-394a2938a001 tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:50.196007 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71ce2f-2ec8-4410-a752-394a2938a001 tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] PATH_INFO: `/v3/users/568693f2bf7843c78f15a31217eb5df7/access_rules/b92bbe87b5c14a21941c9da41e256991` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:50.197381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f71ce2f-2ec8-4410-a752-394a2938a001 tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] RBAC: Authorizing `identity:delete_access_rule(user_id=568693f2bf7843c78f15a31217eb5df7, access_rule_id=b92bbe87b5c14a21941c9da41e256991)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:50.199626 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f71ce2f-2ec8-4410-a752-394a2938a001 tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:50.241156 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-5f71ce2f-2ec8-4410-a752-394a2938a001 tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Aug 29 16:06:50.241156 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:06:50.241156 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 256, in delete_access_rule Aug 29 16:06:50.241156 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application session.delete(ref) Aug 29 16:06:50.241156 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 16:06:50.241156 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application next(self.gen) Aug 29 16:06:50.241156 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 16:06:50.241156 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application yield resource Aug 29 16:06:50.241156 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 16:06:50.241156 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application next(self.gen) Aug 29 16:06:50.241156 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 16:06:50.241156 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 16:06:50.241156 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 16:06:50.241156 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 16:06:50.241156 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 16:06:50.241156 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise self.value Aug 29 16:06:50.242459 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 16:06:50.242459 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 16:06:50.242459 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 16:06:50.242459 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application session.commit() Aug 29 16:06:50.242459 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 16:06:50.242459 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 16:06:50.242459 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 16:06:50.242459 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 16:06:50.242459 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 16:06:50.242459 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self.session.flush() Aug 29 16:06:50.242459 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 16:06:50.242459 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 16:06:50.242459 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 16:06:50.242459 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 16:06:50.242459 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 16:06:50.242459 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application compat.raise_( Aug 29 16:06:50.243799 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 16:06:50.243799 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception Aug 29 16:06:50.243799 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 16:06:50.243799 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 16:06:50.243799 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 16:06:50.243799 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 16:06:50.243799 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 577, in execute Aug 29 16:06:50.243799 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self.dependency_processor.process_deletes(uow, states) Aug 29 16:06:50.243799 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 552, in process_deletes Aug 29 16:06:50.243799 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self._synchronize( Aug 29 16:06:50.243799 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 610, in _synchronize Aug 29 16:06:50.243799 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application sync.clear(dest, self.mapper, self.prop.synchronize_pairs) Aug 29 16:06:50.243799 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/sync.py", line 86, in clear Aug 29 16:06:50.243799 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise AssertionError( Aug 29 16:06:50.243799 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application AssertionError: Dependency rule tried to blank-out primary key column 'application_credential_access_rule.access_rule_id' on instance '' Aug 29 16:06:50.243799 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:06:50.244960 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 16:06:50.244960 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:06:50.244960 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:06:50.244960 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:06:50.244960 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:06:50.244960 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:06:50.244960 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:06:50.244960 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:06:50.244960 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:06:50.244960 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:06:50.244960 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:06:50.244960 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:06:50.244960 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:06:50.244960 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 763, in delete Aug 29 16:06:50.244960 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application PROVIDERS.application_credential_api.delete_access_rule( Aug 29 16:06:50.244960 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:06:50.244960 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:06:50.248106 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/core.py", line 252, in delete_access_rule Aug 29 16:06:50.248106 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self.driver.delete_access_rule(access_rule_id) Aug 29 16:06:50.248106 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 258, in delete_access_rule Aug 29 16:06:50.248106 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Aug 29 16:06:50.248106 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Aug 29 16:06:50.248106 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:06:50.248106 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3271/6579] 10.222.0.83 () {58 vars in 1362 bytes} [Mon Aug 29 16:06:50 2022] DELETE /identity/v3/users/568693f2bf7843c78f15a31217eb5df7/access_rules/b92bbe87b5c14a21941c9da41e256991 => generated 89 bytes in 76 msecs (HTTP/1.1 403) 5 headers in 183 bytes (2 switches on core 0) Aug 29 16:06:50.248106 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71ce2f-2ec8-4410-a752-394a2938a001 tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:50.269873 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71ce2f-2ec8-4410-a752-394a2938a001 tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:50.283490 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4e3e8-932e-4823-875d-da936d441884 tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '568693f2bf7843c78f15a31217eb5df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e52a6166bdb84df8b590884efba1f7b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:50.284939 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4e3e8-932e-4823-875d-da936d441884 tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:50.285320 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4e3e8-932e-4823-875d-da936d441884 tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:50.285674 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4e3e8-932e-4823-875d-da936d441884 tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] PATH_INFO: `/v3/users/568693f2bf7843c78f15a31217eb5df7/application_credentials/b916d0f6624c4991a84b42fed8bdb064` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:50.326030 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b4e3e8-932e-4823-875d-da936d441884 tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] RBAC: Authorizing `identity:delete_application_credential(user_id=568693f2bf7843c78f15a31217eb5df7, application_credential_id=b916d0f6624c4991a84b42fed8bdb064)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:50.332078 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b4e3e8-932e-4823-875d-da936d441884 tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:50.347085 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3309/6580] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:50 2022] POST /identity/v3/auth/tokens => generated 3277 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:50.363006 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457b4e3-d03f-411a-84ab-e50fe043701f None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:50.363732 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457b4e3-d03f-411a-84ab-e50fe043701f None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:50.364580 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457b4e3-d03f-411a-84ab-e50fe043701f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:50.377106 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3272/6581] 10.222.0.83 () {58 vars in 1395 bytes} [Mon Aug 29 16:06:50 2022] DELETE /identity/v3/users/568693f2bf7843c78f15a31217eb5df7/application_credentials/b916d0f6624c4991a84b42fed8bdb064 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:50.384029 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4e3e8-932e-4823-875d-da936d441884 tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:50.398144 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-8457b4e3-d03f-411a-84ab-e50fe043701f None None] MFA Rules not processed for user `86b59b8ef1684cf7aae607ed2f567557`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:50.399491 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8457b4e3-d03f-411a-84ab-e50fe043701f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:50.406275 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4e3e8-932e-4823-875d-da936d441884 tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:50.414786 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3310/6582] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:50 2022] POST /identity/v3/auth/tokens => generated 3277 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:50.417425 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385803d-93d2-453a-bd52-e92a231c2d3e tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '568693f2bf7843c78f15a31217eb5df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e52a6166bdb84df8b590884efba1f7b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:50.418086 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385803d-93d2-453a-bd52-e92a231c2d3e tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:50.419316 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385803d-93d2-453a-bd52-e92a231c2d3e tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:50.419730 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457b4e3-d03f-411a-84ab-e50fe043701f None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:50.419922 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385803d-93d2-453a-bd52-e92a231c2d3e tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] PATH_INFO: `/v3/users/568693f2bf7843c78f15a31217eb5df7/access_rules` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:50.422380 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3385803d-93d2-453a-bd52-e92a231c2d3e tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] RBAC: Authorizing `identity:list_access_rules(user_id=568693f2bf7843c78f15a31217eb5df7)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:50.422822 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3385803d-93d2-453a-bd52-e92a231c2d3e tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:50.436731 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3273/6583] 10.222.0.83 () {58 vars in 1260 bytes} [Mon Aug 29 16:06:50 2022] GET /identity/v3/users/568693f2bf7843c78f15a31217eb5df7/access_rules => generated 369 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:06:50.436731 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385803d-93d2-453a-bd52-e92a231c2d3e tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:50.440266 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457b4e3-d03f-411a-84ab-e50fe043701f None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:50.451117 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd51c5-e2e1-46b8-bde5-67a2540f508c tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b59b8ef1684cf7aae607ed2f567557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f93e93aeafd434c90b554b010b32578', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-635969368', 'tempest-NotDelegatedRole-326215655'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:50.452373 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd51c5-e2e1-46b8-bde5-67a2540f508c tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:50.452831 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd51c5-e2e1-46b8-bde5-67a2540f508c tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:50.453390 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd51c5-e2e1-46b8-bde5-67a2540f508c tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:50.454094 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd51c5-e2e1-46b8-bde5-67a2540f508c tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] RBAC: Authorizing `identity:create_trust()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:50.456037 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385803d-93d2-453a-bd52-e92a231c2d3e tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:50.456342 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd51c5-e2e1-46b8-bde5-67a2540f508c tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:50.461597 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1123f-cfc2-4b98-a4ab-378122771595 tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '568693f2bf7843c78f15a31217eb5df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e52a6166bdb84df8b590884efba1f7b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:50.462568 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1123f-cfc2-4b98-a4ab-378122771595 tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:50.463012 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1123f-cfc2-4b98-a4ab-378122771595 tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:50.463618 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1123f-cfc2-4b98-a4ab-378122771595 tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] PATH_INFO: `/v3/users/568693f2bf7843c78f15a31217eb5df7/access_rules/b92bbe87b5c14a21941c9da41e256991` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:50.465053 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa1123f-cfc2-4b98-a4ab-378122771595 tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] RBAC: Authorizing `identity:delete_access_rule(user_id=568693f2bf7843c78f15a31217eb5df7, access_rule_id=b92bbe87b5c14a21941c9da41e256991)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:50.467308 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa1123f-cfc2-4b98-a4ab-378122771595 tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:50.493632 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:50.503768 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3274/6584] 10.222.0.83 () {58 vars in 1362 bytes} [Mon Aug 29 16:06:50 2022] DELETE /identity/v3/users/568693f2bf7843c78f15a31217eb5df7/access_rules/b92bbe87b5c14a21941c9da41e256991 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:50.505426 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1123f-cfc2-4b98-a4ab-378122771595 tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:50.508539 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6aa1123f-cfc2-4b98-a4ab-378122771595 tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:50.510296 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:50.592091 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3311/6585] 10.222.0.83 () {60 vars in 1174 bytes} [Mon Aug 29 16:06:50 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:06:50.593189 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd51c5-e2e1-46b8-bde5-67a2540f508c tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:50.610676 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd51c5-e2e1-46b8-bde5-67a2540f508c tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:50.617426 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474fbf95-b3a1-46cc-88ac-9af071e04bca tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '568693f2bf7843c78f15a31217eb5df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e52a6166bdb84df8b590884efba1f7b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:50.618274 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474fbf95-b3a1-46cc-88ac-9af071e04bca tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:50.618710 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474fbf95-b3a1-46cc-88ac-9af071e04bca tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:50.618993 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474fbf95-b3a1-46cc-88ac-9af071e04bca tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] PATH_INFO: `/v3/users/568693f2bf7843c78f15a31217eb5df7/access_rules` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:50.620314 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474fbf95-b3a1-46cc-88ac-9af071e04bca tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] RBAC: Authorizing `identity:list_access_rules(user_id=568693f2bf7843c78f15a31217eb5df7)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:50.622076 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474fbf95-b3a1-46cc-88ac-9af071e04bca tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:50.629597 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3312/6586] 10.222.0.83 () {58 vars in 1260 bytes} [Mon Aug 29 16:06:50 2022] GET /identity/v3/users/568693f2bf7843c78f15a31217eb5df7/access_rules => generated 158 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:06:50.630555 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474fbf95-b3a1-46cc-88ac-9af071e04bca tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:50.646545 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474fbf95-b3a1-46cc-88ac-9af071e04bca tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:50.655131 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755f227-3e41-4e40-8e9f-448a97cdb0ca tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b59b8ef1684cf7aae607ed2f567557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f93e93aeafd434c90b554b010b32578', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-635969368', 'tempest-NotDelegatedRole-326215655'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:50.656441 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755f227-3e41-4e40-8e9f-448a97cdb0ca tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:50.659427 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755f227-3e41-4e40-8e9f-448a97cdb0ca tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:50.659743 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755f227-3e41-4e40-8e9f-448a97cdb0ca tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] PATH_INFO: `/v3/OS-TRUST/trusts/7b3ad7288af14b88b7cb73943815afa2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:50.672755 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c755f227-3e41-4e40-8e9f-448a97cdb0ca tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] RBAC: Authorizing `identity:get_trust(trust_id=7b3ad7288af14b88b7cb73943815afa2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:50.674862 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c755f227-3e41-4e40-8e9f-448a97cdb0ca tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:50.689003 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1123f-cfc2-4b98-a4ab-378122771595 tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:50.704328 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929bf8cd-3ebb-4d94-99fc-14477457c8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:50.705021 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bf8cd-3ebb-4d94-99fc-14477457c8b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:50.705311 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bf8cd-3ebb-4d94-99fc-14477457c8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:50.706584 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bf8cd-3ebb-4d94-99fc-14477457c8b6 admin admin] PATH_INFO: `/v3/projects/da968f7da1634ee592f09b114b92a746` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:50.709182 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929bf8cd-3ebb-4d94-99fc-14477457c8b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da968f7da1634ee592f09b114b92a746)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:50.711190 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929bf8cd-3ebb-4d94-99fc-14477457c8b6 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:50.715881 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3313/6587] 10.222.0.83 () {58 vars in 1251 bytes} [Mon Aug 29 16:06:50 2022] GET /identity/v3/OS-TRUST/trusts/7b3ad7288af14b88b7cb73943815afa2 => generated 834 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:06:50.717452 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755f227-3e41-4e40-8e9f-448a97cdb0ca tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:50.733081 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755f227-3e41-4e40-8e9f-448a97cdb0ca tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:50.738127 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f48bae4-e472-494e-a756-fd59aa5bf06b tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '568693f2bf7843c78f15a31217eb5df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e52a6166bdb84df8b590884efba1f7b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:50.745388 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48bae4-e472-494e-a756-fd59aa5bf06b tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:50.745388 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48bae4-e472-494e-a756-fd59aa5bf06b tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:50.745388 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48bae4-e472-494e-a756-fd59aa5bf06b tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] PATH_INFO: `/v3/users/568693f2bf7843c78f15a31217eb5df7/application_credentials` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:50.752902 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f48bae4-e472-494e-a756-fd59aa5bf06b tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] RBAC: Authorizing `identity:create_application_credential(user_id=568693f2bf7843c78f15a31217eb5df7)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:50.762954 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f48bae4-e472-494e-a756-fd59aa5bf06b tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:50.835259 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-929bf8cd-3ebb-4d94-99fc-14477457c8b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da968f7da1634ee592f09b114b92a746', 'request_id': 'req-929bf8cd-3ebb-4d94-99fc-14477457c8b6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:50.847923 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-929bf8cd-3ebb-4d94-99fc-14477457c8b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da968f7da1634ee592f09b114b92a746', 'request_id': 'req-929bf8cd-3ebb-4d94-99fc-14477457c8b6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:50.871231 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-929bf8cd-3ebb-4d94-99fc-14477457c8b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da968f7da1634ee592f09b114b92a746', 'request_id': 'req-929bf8cd-3ebb-4d94-99fc-14477457c8b6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:50.897214 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-929bf8cd-3ebb-4d94-99fc-14477457c8b6 admin admin] The token cache is being invalidate because project da968f7da1634ee592f09b114b92a746 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:50.897775 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-929bf8cd-3ebb-4d94-99fc-14477457c8b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:50.898674 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-929bf8cd-3ebb-4d94-99fc-14477457c8b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:50.900475 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3275/6588] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:06:50 2022] DELETE /identity/v3/projects/da968f7da1634ee592f09b114b92a746 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:50.905259 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929bf8cd-3ebb-4d94-99fc-14477457c8b6 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:50.907439 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-929bf8cd-3ebb-4d94-99fc-14477457c8b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:50.937538 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3314/6589] 10.222.0.83 () {60 vars in 1315 bytes} [Mon Aug 29 16:06:50 2022] POST /identity/v3/users/568693f2bf7843c78f15a31217eb5df7/application_credentials => generated 921 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:50.941242 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f48bae4-e472-494e-a756-fd59aa5bf06b tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:50.947071 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4f48bae4-e472-494e-a756-fd59aa5bf06b tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:50.993762 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f48bae4-e472-494e-a756-fd59aa5bf06b tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:51.037862 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929bf8cd-3ebb-4d94-99fc-14477457c8b6 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:51.045618 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46bdbc-d6db-4611-9625-392ecbb8f973 tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b59b8ef1684cf7aae607ed2f567557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f93e93aeafd434c90b554b010b32578', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-635969368', 'tempest-NotDelegatedRole-326215655'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:51.046292 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46bdbc-d6db-4611-9625-392ecbb8f973 tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:51.046979 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46bdbc-d6db-4611-9625-392ecbb8f973 tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:51.046979 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46bdbc-d6db-4611-9625-392ecbb8f973 tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] PATH_INFO: `/v3/OS-TRUST/trusts/7b3ad7288af14b88b7cb73943815afa2/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:51.056184 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a46bdbc-d6db-4611-9625-392ecbb8f973 tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=7b3ad7288af14b88b7cb73943815afa2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:51.057708 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a46bdbc-d6db-4611-9625-392ecbb8f973 tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:51.068262 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3276/6590] 10.222.0.83 () {58 vars in 1269 bytes} [Mon Aug 29 16:06:50 2022] GET /identity/v3/OS-TRUST/trusts/7b3ad7288af14b88b7cb73943815afa2/roles => generated 370 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:06:51.072673 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46bdbc-d6db-4611-9625-392ecbb8f973 tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:51.077838 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1a46bdbc-d6db-4611-9625-392ecbb8f973 tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:51.098979 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96888c33-d518-4cc1-ad40-c7a5e1f09749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:51.100309 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96888c33-d518-4cc1-ad40-c7a5e1f09749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:51.100867 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96888c33-d518-4cc1-ad40-c7a5e1f09749 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:51.101288 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96888c33-d518-4cc1-ad40-c7a5e1f09749 admin admin] PATH_INFO: `/v3/users/99bed36e7b924095a9e4a08b7a8e9536` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:51.102662 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96888c33-d518-4cc1-ad40-c7a5e1f09749 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99bed36e7b924095a9e4a08b7a8e9536)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:51.106167 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96888c33-d518-4cc1-ad40-c7a5e1f09749 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:51.129431 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:51.148754 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=90,keystone:INSERT=6,keystone:DELETE=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:51.189088 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46bdbc-d6db-4611-9625-392ecbb8f973 tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:51.195484 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846add5d-7ac7-486a-a317-ed7f809e279f tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '568693f2bf7843c78f15a31217eb5df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e52a6166bdb84df8b590884efba1f7b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:51.197205 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-96888c33-d518-4cc1-ad40-c7a5e1f09749 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99bed36e7b924095a9e4a08b7a8e9536'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:51.198220 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-96888c33-d518-4cc1-ad40-c7a5e1f09749 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99bed36e7b924095a9e4a08b7a8e9536'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:51.198439 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846add5d-7ac7-486a-a317-ed7f809e279f tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:51.198911 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846add5d-7ac7-486a-a317-ed7f809e279f tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:51.199467 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846add5d-7ac7-486a-a317-ed7f809e279f tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] PATH_INFO: `/v3/users/568693f2bf7843c78f15a31217eb5df7/access_rules` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:51.201725 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846add5d-7ac7-486a-a317-ed7f809e279f tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] RBAC: Authorizing `identity:list_access_rules(user_id=568693f2bf7843c78f15a31217eb5df7)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:51.204522 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846add5d-7ac7-486a-a317-ed7f809e279f tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:51.212121 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3277/6591] 10.222.0.83 () {58 vars in 1260 bytes} [Mon Aug 29 16:06:51 2022] GET /identity/v3/users/568693f2bf7843c78f15a31217eb5df7/access_rules => generated 369 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:06:51.213529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846add5d-7ac7-486a-a317-ed7f809e279f tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:51.218876 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-96888c33-d518-4cc1-ad40-c7a5e1f09749 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99bed36e7b924095a9e4a08b7a8e9536'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:51.228391 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846add5d-7ac7-486a-a317-ed7f809e279f tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:51.234072 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2527445-d27a-452b-8d97-64a48e87dcee tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b59b8ef1684cf7aae607ed2f567557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f93e93aeafd434c90b554b010b32578', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-635969368', 'tempest-NotDelegatedRole-326215655'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:51.235034 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2527445-d27a-452b-8d97-64a48e87dcee tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:51.235478 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2527445-d27a-452b-8d97-64a48e87dcee tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:51.235916 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2527445-d27a-452b-8d97-64a48e87dcee tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] PATH_INFO: `/v3/OS-TRUST/trusts/7b3ad7288af14b88b7cb73943815afa2/roles/0923d9eb9a554a518bac56c8512558ba` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:51.237640 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-96888c33-d518-4cc1-ad40-c7a5e1f09749 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99bed36e7b924095a9e4a08b7a8e9536'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:51.240965 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-96888c33-d518-4cc1-ad40-c7a5e1f09749 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99bed36e7b924095a9e4a08b7a8e9536'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:51.245098 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2527445-d27a-452b-8d97-64a48e87dcee tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] RBAC: Authorizing `identity:get_role_for_trust(trust_id=7b3ad7288af14b88b7cb73943815afa2, role_id=0923d9eb9a554a518bac56c8512558ba)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:51.246994 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2527445-d27a-452b-8d97-64a48e87dcee tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:51.275488 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3278/6592] 10.222.0.83 () {58 vars in 1368 bytes} [Mon Aug 29 16:06:51 2022] GET /identity/v3/OS-TRUST/trusts/7b3ad7288af14b88b7cb73943815afa2/roles/0923d9eb9a554a518bac56c8512558ba => generated 243 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:06:51.276594 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2527445-d27a-452b-8d97-64a48e87dcee tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:51.279561 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c2527445-d27a-452b-8d97-64a48e87dcee tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:51.286504 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3315/6593] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:06:50 2022] DELETE /identity/v3/users/99bed36e7b924095a9e4a08b7a8e9536 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:51.287524 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96888c33-d518-4cc1-ad40-c7a5e1f09749 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:51.296664 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2527445-d27a-452b-8d97-64a48e87dcee tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:51.303065 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-96888c33-d518-4cc1-ad40-c7a5e1f09749 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:51.368444 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba3d5a-a422-4e62-bc1f-007324f3065c tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '568693f2bf7843c78f15a31217eb5df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e52a6166bdb84df8b590884efba1f7b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:51.368724 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba3d5a-a422-4e62-bc1f-007324f3065c tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:51.368903 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba3d5a-a422-4e62-bc1f-007324f3065c tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:51.369346 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba3d5a-a422-4e62-bc1f-007324f3065c tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] PATH_INFO: `/v3/users/568693f2bf7843c78f15a31217eb5df7/application_credentials` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:51.370033 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba3d5a-a422-4e62-bc1f-007324f3065c tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] RBAC: Authorizing `identity:create_application_credential(user_id=568693f2bf7843c78f15a31217eb5df7)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:51.375834 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba3d5a-a422-4e62-bc1f-007324f3065c tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:51.449765 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96888c33-d518-4cc1-ad40-c7a5e1f09749 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:51.457854 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e4b7ab-b09e-4ece-ac48-5a8351e66b77 tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b59b8ef1684cf7aae607ed2f567557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f93e93aeafd434c90b554b010b32578', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-635969368', 'tempest-NotDelegatedRole-326215655'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:51.458797 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4b7ab-b09e-4ece-ac48-5a8351e66b77 tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] REQUEST_METHOD: `HEAD` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:51.459250 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4b7ab-b09e-4ece-ac48-5a8351e66b77 tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:51.459621 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4b7ab-b09e-4ece-ac48-5a8351e66b77 tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] PATH_INFO: `/v3/OS-TRUST/trusts/7b3ad7288af14b88b7cb73943815afa2/roles/0923d9eb9a554a518bac56c8512558ba` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:51.479711 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e4b7ab-b09e-4ece-ac48-5a8351e66b77 tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] RBAC: Authorizing `identity:get_role_for_trust(trust_id=7b3ad7288af14b88b7cb73943815afa2, role_id=0923d9eb9a554a518bac56c8512558ba)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:51.482306 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e4b7ab-b09e-4ece-ac48-5a8351e66b77 tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:51.506260 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3316/6594] 10.222.0.83 () {58 vars in 1369 bytes} [Mon Aug 29 16:06:51 2022] HEAD /identity/v3/OS-TRUST/trusts/7b3ad7288af14b88b7cb73943815afa2/roles/0923d9eb9a554a518bac56c8512558ba => generated 0 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Aug 29 16:06:51.510333 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e4b7ab-b09e-4ece-ac48-5a8351e66b77 tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:51.529843 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e4b7ab-b09e-4ece-ac48-5a8351e66b77 tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:51.535167 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3279/6595] 10.222.0.83 () {60 vars in 1315 bytes} [Mon Aug 29 16:06:51 2022] POST /identity/v3/users/568693f2bf7843c78f15a31217eb5df7/application_credentials => generated 920 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:51.541057 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba3d5a-a422-4e62-bc1f-007324f3065c tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:51.547264 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdeb0d3-9ce7-4c32-8dc0-884134e524c4 tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b59b8ef1684cf7aae607ed2f567557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f93e93aeafd434c90b554b010b32578', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-635969368', 'tempest-NotDelegatedRole-326215655'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:51.548077 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdeb0d3-9ce7-4c32-8dc0-884134e524c4 tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:51.548621 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdeb0d3-9ce7-4c32-8dc0-884134e524c4 tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:51.549126 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdeb0d3-9ce7-4c32-8dc0-884134e524c4 tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] PATH_INFO: `/v3/OS-TRUST/trusts/7b3ad7288af14b88b7cb73943815afa2/roles/0f6e4bb4768e48299899e1e18539a832` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:51.557347 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba3d5a-a422-4e62-bc1f-007324f3065c tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:51.560463 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdeb0d3-9ce7-4c32-8dc0-884134e524c4 tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] RBAC: Authorizing `identity:get_role_for_trust(trust_id=7b3ad7288af14b88b7cb73943815afa2, role_id=0f6e4bb4768e48299899e1e18539a832)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:51.564837 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091898d1-4c97-45b5-a63d-4248c4f71eac tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '568693f2bf7843c78f15a31217eb5df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e52a6166bdb84df8b590884efba1f7b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:51.566128 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdeb0d3-9ce7-4c32-8dc0-884134e524c4 tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:51.567007 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091898d1-4c97-45b5-a63d-4248c4f71eac tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:51.567540 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091898d1-4c97-45b5-a63d-4248c4f71eac tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:51.569081 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091898d1-4c97-45b5-a63d-4248c4f71eac tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] PATH_INFO: `/v3/users/568693f2bf7843c78f15a31217eb5df7/access_rules/c6728a7f745d4a388e96c2c9995d02b3` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:51.572296 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091898d1-4c97-45b5-a63d-4248c4f71eac tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] RBAC: Authorizing `identity:get_access_rule(user_id=568693f2bf7843c78f15a31217eb5df7, access_rule_id=c6728a7f745d4a388e96c2c9995d02b3)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:51.574648 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091898d1-4c97-45b5-a63d-4248c4f71eac tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:51.583067 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-dcdeb0d3-9ce7-4c32-8dc0-884134e524c4 tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] Could not find role: 0f6e4bb4768e48299899e1e18539a832.: keystone.exception.RoleNotFound: Could not find role: 0f6e4bb4768e48299899e1e18539a832. Aug 29 16:06:51.583067 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:06:51.583067 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:06:51.583067 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:06:51.583067 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:06:51.583067 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:06:51.583067 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:06:51.583067 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:06:51.583067 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:06:51.583067 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:06:51.583067 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:06:51.583067 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:06:51.583067 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 29 16:06:51.583067 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 16:06:51.583067 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 0f6e4bb4768e48299899e1e18539a832. Aug 29 16:06:51.584810 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:06:51.589285 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3317/6596] 10.222.0.83 () {58 vars in 1368 bytes} [Mon Aug 29 16:06:51 2022] GET /identity/v3/OS-TRUST/trusts/7b3ad7288af14b88b7cb73943815afa2/roles/0f6e4bb4768e48299899e1e18539a832 => generated 110 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 16:06:51.590444 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdeb0d3-9ce7-4c32-8dc0-884134e524c4 tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:51.596535 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3280/6597] 10.222.0.83 () {58 vars in 1359 bytes} [Mon Aug 29 16:06:51 2022] GET /identity/v3/users/568693f2bf7843c78f15a31217eb5df7/access_rules/c6728a7f745d4a388e96c2c9995d02b3 => generated 229 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:06:51.604429 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091898d1-4c97-45b5-a63d-4248c4f71eac tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:51.608268 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdeb0d3-9ce7-4c32-8dc0-884134e524c4 tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:51.610411 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-091898d1-4c97-45b5-a63d-4248c4f71eac tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:51.613889 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323ceaed-c0c3-4d0a-8b1d-25d5ae698773 tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b59b8ef1684cf7aae607ed2f567557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f93e93aeafd434c90b554b010b32578', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-635969368', 'tempest-NotDelegatedRole-326215655'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:51.614675 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ceaed-c0c3-4d0a-8b1d-25d5ae698773 tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] REQUEST_METHOD: `HEAD` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:51.615093 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ceaed-c0c3-4d0a-8b1d-25d5ae698773 tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:51.615480 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ceaed-c0c3-4d0a-8b1d-25d5ae698773 tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] PATH_INFO: `/v3/OS-TRUST/trusts/7b3ad7288af14b88b7cb73943815afa2/roles/0f6e4bb4768e48299899e1e18539a832` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:51.625975 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323ceaed-c0c3-4d0a-8b1d-25d5ae698773 tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] RBAC: Authorizing `identity:get_role_for_trust(trust_id=7b3ad7288af14b88b7cb73943815afa2, role_id=0f6e4bb4768e48299899e1e18539a832)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:51.627910 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323ceaed-c0c3-4d0a-8b1d-25d5ae698773 tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:51.664450 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-323ceaed-c0c3-4d0a-8b1d-25d5ae698773 tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] Could not find role: 0f6e4bb4768e48299899e1e18539a832.: keystone.exception.RoleNotFound: Could not find role: 0f6e4bb4768e48299899e1e18539a832. Aug 29 16:06:51.664450 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:06:51.664450 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:06:51.664450 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:06:51.664450 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:06:51.664450 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:06:51.664450 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:06:51.664450 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:06:51.664450 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:06:51.664450 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:06:51.664450 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:06:51.664450 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:06:51.664450 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 29 16:06:51.664450 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 16:06:51.664450 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 0f6e4bb4768e48299899e1e18539a832. Aug 29 16:06:51.665655 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:06:51.670519 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3318/6598] 10.222.0.83 () {58 vars in 1369 bytes} [Mon Aug 29 16:06:51 2022] HEAD /identity/v3/OS-TRUST/trusts/7b3ad7288af14b88b7cb73943815afa2/roles/0f6e4bb4768e48299899e1e18539a832 => generated 0 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Aug 29 16:06:51.675141 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323ceaed-c0c3-4d0a-8b1d-25d5ae698773 tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:51.693703 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323ceaed-c0c3-4d0a-8b1d-25d5ae698773 tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:51.705697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c7822-aa76-444b-9d66-62df07b2624c tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b59b8ef1684cf7aae607ed2f567557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f93e93aeafd434c90b554b010b32578', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-635969368', 'tempest-NotDelegatedRole-326215655'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:51.706564 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c7822-aa76-444b-9d66-62df07b2624c tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:51.706948 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c7822-aa76-444b-9d66-62df07b2624c tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:51.707363 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c7822-aa76-444b-9d66-62df07b2624c tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] PATH_INFO: `/v3/OS-TRUST/trusts/7b3ad7288af14b88b7cb73943815afa2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:51.719558 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971c7822-aa76-444b-9d66-62df07b2624c tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] RBAC: Authorizing `identity:delete_trust(trust_id=7b3ad7288af14b88b7cb73943815afa2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:51.722933 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971c7822-aa76-444b-9d66-62df07b2624c tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:51.729382 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:51.764723 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-971c7822-aa76-444b-9d66-62df07b2624c tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '7b3ad7288af14b88b7cb73943815afa2', 'request_id': 'req-971c7822-aa76-444b-9d66-62df07b2624c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:51.765758 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-971c7822-aa76-444b-9d66-62df07b2624c tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '7b3ad7288af14b88b7cb73943815afa2', 'request_id': 'req-971c7822-aa76-444b-9d66-62df07b2624c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:51.766611 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-971c7822-aa76-444b-9d66-62df07b2624c tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '7b3ad7288af14b88b7cb73943815afa2', 'request_id': 'req-971c7822-aa76-444b-9d66-62df07b2624c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:51.790243 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3319/6599] 10.222.0.83 () {58 vars in 1254 bytes} [Mon Aug 29 16:06:51 2022] DELETE /identity/v3/OS-TRUST/trusts/7b3ad7288af14b88b7cb73943815afa2 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:51.790454 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091898d1-4c97-45b5-a63d-4248c4f71eac tempest-AccessRulesV3Test-558851604 tempest-AccessRulesV3Test-558851604-project] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:51.796474 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c7822-aa76-444b-9d66-62df07b2624c tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:51.799612 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-971c7822-aa76-444b-9d66-62df07b2624c tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:51.806449 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5a7c9-8d35-474c-b0d0-7b417ad2b7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:51.807299 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5a7c9-8d35-474c-b0d0-7b417ad2b7f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:51.807647 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5a7c9-8d35-474c-b0d0-7b417ad2b7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:51.808140 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5a7c9-8d35-474c-b0d0-7b417ad2b7f1 admin admin] PATH_INFO: `/v3/users/568693f2bf7843c78f15a31217eb5df7` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:51.811760 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d5a7c9-8d35-474c-b0d0-7b417ad2b7f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=568693f2bf7843c78f15a31217eb5df7)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:51.813846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d5a7c9-8d35-474c-b0d0-7b417ad2b7f1 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:51.824537 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c7822-aa76-444b-9d66-62df07b2624c tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:51.839725 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0f46b-be5f-4d39-8f3c-1c4d636443e6 tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b59b8ef1684cf7aae607ed2f567557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f93e93aeafd434c90b554b010b32578', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-635969368', 'tempest-NotDelegatedRole-326215655'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:51.840486 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0f46b-be5f-4d39-8f3c-1c4d636443e6 tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:51.840806 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0f46b-be5f-4d39-8f3c-1c4d636443e6 tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:51.855463 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0f46b-be5f-4d39-8f3c-1c4d636443e6 tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] PATH_INFO: `/v3/OS-TRUST/trusts/7b3ad7288af14b88b7cb73943815afa2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:51.867899 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-e9c0f46b-be5f-4d39-8f3c-1c4d636443e6 tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] Could not find trust: 7b3ad7288af14b88b7cb73943815afa2.: keystone.exception.TrustNotFound: Could not find trust: 7b3ad7288af14b88b7cb73943815afa2. Aug 29 16:06:51.867899 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:06:51.867899 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:06:51.867899 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:06:51.867899 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:06:51.867899 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:06:51.867899 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:06:51.867899 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:06:51.867899 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:06:51.867899 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:06:51.867899 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:06:51.867899 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:06:51.867899 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 29 16:06:51.867899 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 29 16:06:51.867899 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 29 16:06:51.868971 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 29 16:06:51.868971 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 29 16:06:51.868971 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 29 16:06:51.868971 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 29 16:06:51.868971 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 29 16:06:51.868971 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:06:51.868971 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:06:51.868971 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 29 16:06:51.868971 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 29 16:06:51.868971 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 29 16:06:51.868971 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 29 16:06:51.868971 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 7b3ad7288af14b88b7cb73943815afa2. Aug 29 16:06:51.868971 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:06:51.869710 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3320/6600] 10.222.0.83 () {58 vars in 1251 bytes} [Mon Aug 29 16:06:51 2022] GET /identity/v3/OS-TRUST/trusts/7b3ad7288af14b88b7cb73943815afa2 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 16:06:51.873603 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0f46b-be5f-4d39-8f3c-1c4d636443e6 tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:51.875980 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e9c0f46b-be5f-4d39-8f3c-1c4d636443e6 tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:51.905444 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:51.946133 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f6d5a7c9-8d35-474c-b0d0-7b417ad2b7f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '568693f2bf7843c78f15a31217eb5df7'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:51.948713 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f6d5a7c9-8d35-474c-b0d0-7b417ad2b7f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '568693f2bf7843c78f15a31217eb5df7'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:52.059668 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f6d5a7c9-8d35-474c-b0d0-7b417ad2b7f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '568693f2bf7843c78f15a31217eb5df7'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:52.073351 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f6d5a7c9-8d35-474c-b0d0-7b417ad2b7f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '568693f2bf7843c78f15a31217eb5df7'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:52.099868 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f6d5a7c9-8d35-474c-b0d0-7b417ad2b7f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '568693f2bf7843c78f15a31217eb5df7'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:52.129023 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3281/6601] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:06:51 2022] DELETE /identity/v3/users/568693f2bf7843c78f15a31217eb5df7 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:52.149392 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447c62b-de13-4e87-9d6b-aaa7f55305a0 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:52.149687 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447c62b-de13-4e87-9d6b-aaa7f55305a0 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:52.151349 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447c62b-de13-4e87-9d6b-aaa7f55305a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:52.155401 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0f46b-be5f-4d39-8f3c-1c4d636443e6 tempest-TrustsV3TestJSON-165914358 tempest-user-251790043] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:52.240957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-0447c62b-de13-4e87-9d6b-aaa7f55305a0 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:52.242339 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0447c62b-de13-4e87-9d6b-aaa7f55305a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:52.312694 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7b031-b4f2-4da1-81e4-09b75b1664ab tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:52.313511 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7b031-b4f2-4da1-81e4-09b75b1664ab tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:52.313760 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7b031-b4f2-4da1-81e4-09b75b1664ab tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:52.313953 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7b031-b4f2-4da1-81e4-09b75b1664ab tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/roles/0f6e4bb4768e48299899e1e18539a832` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:52.315643 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb7b031-b4f2-4da1-81e4-09b75b1664ab tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0f6e4bb4768e48299899e1e18539a832)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:52.317359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb7b031-b4f2-4da1-81e4-09b75b1664ab tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:52.399126 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4cb7b031-b4f2-4da1-81e4-09b75b1664ab tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invalidating the token cache because role 0f6e4bb4768e48299899e1e18539a832 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:52.399475 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4cb7b031-b4f2-4da1-81e4-09b75b1664ab tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:52.400163 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4cb7b031-b4f2-4da1-81e4-09b75b1664ab tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:52.402310 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3321/6602] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:06:51 2022] DELETE /identity/v3/roles/0f6e4bb4768e48299899e1e18539a832 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:06:52.403243 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7b031-b4f2-4da1-81e4-09b75b1664ab tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:52.405205 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4cb7b031-b4f2-4da1-81e4-09b75b1664ab tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:52.407066 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3282/6603] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:52.408167 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447c62b-de13-4e87-9d6b-aaa7f55305a0 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:52.418393 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0447c62b-de13-4e87-9d6b-aaa7f55305a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:52.473179 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447c62b-de13-4e87-9d6b-aaa7f55305a0 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:52.517861 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7b031-b4f2-4da1-81e4-09b75b1664ab tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:52.543227 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d403e2-3b8b-4a5e-b2da-0a3b94f734fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:52.543227 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d403e2-3b8b-4a5e-b2da-0a3b94f734fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:52.543227 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d403e2-3b8b-4a5e-b2da-0a3b94f734fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:52.543227 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d403e2-3b8b-4a5e-b2da-0a3b94f734fb admin admin] PATH_INFO: `/v3/projects/b181cfb46de043d1a9d0a8d64c1b4d1d` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:52.543639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d403e2-3b8b-4a5e-b2da-0a3b94f734fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b181cfb46de043d1a9d0a8d64c1b4d1d)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:52.549750 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d403e2-3b8b-4a5e-b2da-0a3b94f734fb admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:52.578707 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:52.621410 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:52.642784 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9586be-f430-4f57-8265-9db617f4048f tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:52.643524 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9586be-f430-4f57-8265-9db617f4048f tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:52.643802 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9586be-f430-4f57-8265-9db617f4048f tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:52.644077 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9586be-f430-4f57-8265-9db617f4048f tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/roles/0923d9eb9a554a518bac56c8512558ba` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:52.647081 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9586be-f430-4f57-8265-9db617f4048f tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0923d9eb9a554a518bac56c8512558ba)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:52.648353 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9586be-f430-4f57-8265-9db617f4048f tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:52.668547 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-51d403e2-3b8b-4a5e-b2da-0a3b94f734fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b181cfb46de043d1a9d0a8d64c1b4d1d', 'request_id': 'req-51d403e2-3b8b-4a5e-b2da-0a3b94f734fb'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:52.686620 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-51d403e2-3b8b-4a5e-b2da-0a3b94f734fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b181cfb46de043d1a9d0a8d64c1b4d1d', 'request_id': 'req-51d403e2-3b8b-4a5e-b2da-0a3b94f734fb'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:52.712477 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-51d403e2-3b8b-4a5e-b2da-0a3b94f734fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b181cfb46de043d1a9d0a8d64c1b4d1d', 'request_id': 'req-51d403e2-3b8b-4a5e-b2da-0a3b94f734fb'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:52.751063 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-51d403e2-3b8b-4a5e-b2da-0a3b94f734fb admin admin] The token cache is being invalidate because project b181cfb46de043d1a9d0a8d64c1b4d1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:52.751365 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-51d403e2-3b8b-4a5e-b2da-0a3b94f734fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:52.753033 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-51d403e2-3b8b-4a5e-b2da-0a3b94f734fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:52.755580 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ae9586be-f430-4f57-8265-9db617f4048f tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invalidating the token cache because role 0923d9eb9a554a518bac56c8512558ba has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:52.756044 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ae9586be-f430-4f57-8265-9db617f4048f tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:52.760735 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ae9586be-f430-4f57-8265-9db617f4048f tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:52.761512 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3322/6604] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:06:52 2022] DELETE /identity/v3/projects/b181cfb46de043d1a9d0a8d64c1b4d1d => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:52.762123 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d403e2-3b8b-4a5e-b2da-0a3b94f734fb admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:52.766444 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3283/6605] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:06:52 2022] DELETE /identity/v3/roles/0923d9eb9a554a518bac56c8512558ba => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:52.766444 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9b4ad-dc78-4a13-bcca-94dbe8da52b6 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:52.766444 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9b4ad-dc78-4a13-bcca-94dbe8da52b6 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:52.766444 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9b4ad-dc78-4a13-bcca-94dbe8da52b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:52.767575 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-51d403e2-3b8b-4a5e-b2da-0a3b94f734fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:52.811839 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-d5e9b4ad-dc78-4a13-bcca-94dbe8da52b6 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:52.813143 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d5e9b4ad-dc78-4a13-bcca-94dbe8da52b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:52.920322 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d403e2-3b8b-4a5e-b2da-0a3b94f734fb admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:52.962380 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3284/6606] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:52.962380 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e9b4ad-dc78-4a13-bcca-94dbe8da52b6 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:52.972381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d5e9b4ad-dc78-4a13-bcca-94dbe8da52b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:53.021251 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db06a99-392c-44dd-9a6f-5c8f77e3f5ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:53.022013 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db06a99-392c-44dd-9a6f-5c8f77e3f5ca service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:53.022159 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db06a99-392c-44dd-9a6f-5c8f77e3f5ca service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:53.022464 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db06a99-392c-44dd-9a6f-5c8f77e3f5ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:53.024329 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9db06a99-392c-44dd-9a6f-5c8f77e3f5ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:53.058402 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db06a99-392c-44dd-9a6f-5c8f77e3f5ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:53.060016 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db06a99-392c-44dd-9a6f-5c8f77e3f5ca service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:53.085748 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3323/6607] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:06:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:06:53.089758 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf789e03-61ea-4297-9b66-ae23bb53a5aa None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:53.090052 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf789e03-61ea-4297-9b66-ae23bb53a5aa None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:53.090332 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf789e03-61ea-4297-9b66-ae23bb53a5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:53.111050 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e9b4ad-dc78-4a13-bcca-94dbe8da52b6 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:53.128233 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c702342-98ba-4673-9746-7fe8e4ce71cd tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:53.129635 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c702342-98ba-4673-9746-7fe8e4ce71cd tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:53.130495 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c702342-98ba-4673-9746-7fe8e4ce71cd tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:53.131070 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c702342-98ba-4673-9746-7fe8e4ce71cd tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/users/86b59b8ef1684cf7aae607ed2f567557` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:53.132285 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-bf789e03-61ea-4297-9b66-ae23bb53a5aa None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:53.132878 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c702342-98ba-4673-9746-7fe8e4ce71cd tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:delete_user(user_id=86b59b8ef1684cf7aae607ed2f567557)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:53.133510 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-bf789e03-61ea-4297-9b66-ae23bb53a5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:53.135795 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c702342-98ba-4673-9746-7fe8e4ce71cd tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:53.157360 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3324/6608] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:53.161768 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf789e03-61ea-4297-9b66-ae23bb53a5aa None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:53.178011 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf789e03-61ea-4297-9b66-ae23bb53a5aa None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:53.195474 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cae7d5-720e-408b-a083-30bdb646094a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:53.196301 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cae7d5-720e-408b-a083-30bdb646094a admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:53.196990 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cae7d5-720e-408b-a083-30bdb646094a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:53.197894 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cae7d5-720e-408b-a083-30bdb646094a admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:53.201383 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cae7d5-720e-408b-a083-30bdb646094a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:06:53.201383 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cae7d5-720e-408b-a083-30bdb646094a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:53.207431 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cae7d5-720e-408b-a083-30bdb646094a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:53.225797 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:53.245807 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5c702342-98ba-4673-9746-7fe8e4ce71cd tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86b59b8ef1684cf7aae607ed2f567557'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:53.247924 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5c702342-98ba-4673-9746-7fe8e4ce71cd tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86b59b8ef1684cf7aae607ed2f567557'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:53.252320 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3325/6609] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:06:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:06:53.258023 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cae7d5-720e-408b-a083-30bdb646094a admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:53.301925 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cae7d5-720e-408b-a083-30bdb646094a admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:53.308798 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5c702342-98ba-4673-9746-7fe8e4ce71cd tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86b59b8ef1684cf7aae607ed2f567557'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:53.369071 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b359d8-75b7-4b4c-a5d1-5be337db5dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:53.373900 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b359d8-75b7-4b4c-a5d1-5be337db5dbf admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:53.375375 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b359d8-75b7-4b4c-a5d1-5be337db5dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:53.375799 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b359d8-75b7-4b4c-a5d1-5be337db5dbf admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:53.381163 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b359d8-75b7-4b4c-a5d1-5be337db5dbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:53.388029 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b359d8-75b7-4b4c-a5d1-5be337db5dbf admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:53.413448 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5c702342-98ba-4673-9746-7fe8e4ce71cd tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86b59b8ef1684cf7aae607ed2f567557'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:53.445719 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5c702342-98ba-4673-9746-7fe8e4ce71cd tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86b59b8ef1684cf7aae607ed2f567557'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:53.485553 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3285/6610] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:06:52 2022] DELETE /identity/v3/users/86b59b8ef1684cf7aae607ed2f567557 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:53.489847 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c702342-98ba-4673-9746-7fe8e4ce71cd tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:53.497817 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5c702342-98ba-4673-9746-7fe8e4ce71cd tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:53.522517 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3326/6611] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:06:53 2022] POST /identity/v3/projects => generated 369 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:53.525445 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b359d8-75b7-4b4c-a5d1-5be337db5dbf admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:53.529078 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-57b359d8-75b7-4b4c-a5d1-5be337db5dbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:53.626279 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:53.677194 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c702342-98ba-4673-9746-7fe8e4ce71cd tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:53.728872 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b359d8-75b7-4b4c-a5d1-5be337db5dbf admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:53.735459 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc380c-7e0a-4171-b2df-f9b29f34e909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:53.737225 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc380c-7e0a-4171-b2df-f9b29f34e909 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:53.737644 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc380c-7e0a-4171-b2df-f9b29f34e909 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:53.738015 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc380c-7e0a-4171-b2df-f9b29f34e909 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:53.738962 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc380c-7e0a-4171-b2df-f9b29f34e909 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:53.745210 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc380c-7e0a-4171-b2df-f9b29f34e909 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:53.752876 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70275ce1-999b-4154-9514-88f4179ed875 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fbc9c15ddf437f920a346a04d0fd83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:53.753747 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70275ce1-999b-4154-9514-88f4179ed875 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:53.754208 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70275ce1-999b-4154-9514-88f4179ed875 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:53.754879 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70275ce1-999b-4154-9514-88f4179ed875 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] PATH_INFO: `/v3/projects/4f93e93aeafd434c90b554b010b32578` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:53.758415 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70275ce1-999b-4154-9514-88f4179ed875 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4f93e93aeafd434c90b554b010b32578)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:53.761139 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70275ce1-999b-4154-9514-88f4179ed875 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:53.778795 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3327/6612] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:06:53 2022] POST /identity/v3/users => generated 285 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:53.780539 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc380c-7e0a-4171-b2df-f9b29f34e909 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:53.797338 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc380c-7e0a-4171-b2df-f9b29f34e909 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:53.805468 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47be67-ecbb-402d-8b11-466398f6a5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:53.806665 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47be67-ecbb-402d-8b11-466398f6a5d9 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:53.806942 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47be67-ecbb-402d-8b11-466398f6a5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:53.807264 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47be67-ecbb-402d-8b11-466398f6a5d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:53.808060 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c47be67-ecbb-402d-8b11-466398f6a5d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:53.810689 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c47be67-ecbb-402d-8b11-466398f6a5d9 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:53.827112 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3328/6613] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:06:53.828371 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47be67-ecbb-402d-8b11-466398f6a5d9 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:53.846425 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-70275ce1-999b-4154-9514-88f4179ed875 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f93e93aeafd434c90b554b010b32578', 'request_id': 'req-70275ce1-999b-4154-9514-88f4179ed875'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:53.854369 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-70275ce1-999b-4154-9514-88f4179ed875 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f93e93aeafd434c90b554b010b32578', 'request_id': 'req-70275ce1-999b-4154-9514-88f4179ed875'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:53.860636 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47be67-ecbb-402d-8b11-466398f6a5d9 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:53.869956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-70275ce1-999b-4154-9514-88f4179ed875 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f93e93aeafd434c90b554b010b32578', 'request_id': 'req-70275ce1-999b-4154-9514-88f4179ed875'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:53.871622 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:53.896750 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-70275ce1-999b-4154-9514-88f4179ed875 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] The token cache is being invalidate because project 4f93e93aeafd434c90b554b010b32578 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:53.897137 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-70275ce1-999b-4154-9514-88f4179ed875 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:53.899558 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-70275ce1-999b-4154-9514-88f4179ed875 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:53.910257 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3286/6614] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:06:53 2022] DELETE /identity/v3/projects/4f93e93aeafd434c90b554b010b32578 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:53.937243 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70275ce1-999b-4154-9514-88f4179ed875 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:53.946942 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-70275ce1-999b-4154-9514-88f4179ed875 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:54.057791 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aedafb1-0803-4729-a103-a9571609cd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:54.058584 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aedafb1-0803-4729-a103-a9571609cd08 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:54.060744 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aedafb1-0803-4729-a103-a9571609cd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:54.061028 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aedafb1-0803-4729-a103-a9571609cd08 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:54.061700 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aedafb1-0803-4729-a103-a9571609cd08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:54.063411 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aedafb1-0803-4729-a103-a9571609cd08 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:54.093641 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3329/6615] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:06:54.094499 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aedafb1-0803-4729-a103-a9571609cd08 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:54.105115 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6aedafb1-0803-4729-a103-a9571609cd08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:54.134294 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aedafb1-0803-4729-a103-a9571609cd08 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:54.148068 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089eb47d-eeab-48e7-b4a8-c2818d1cc0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:54.150600 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089eb47d-eeab-48e7-b4a8-c2818d1cc0eb admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:54.151130 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089eb47d-eeab-48e7-b4a8-c2818d1cc0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:54.153149 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089eb47d-eeab-48e7-b4a8-c2818d1cc0eb admin admin] PATH_INFO: `/v3/projects/4ecdcc9915844370942da032055832fa/users/b0619bdfb1954a38875fcbe1a16284e8/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:54.158090 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70275ce1-999b-4154-9514-88f4179ed875 tempest-TrustsV3TestJSON-831361558 tempest-TrustsV3TestJSON-831361558-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:54.175406 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400b095e-ecc5-4940-be70-2e1ebe9b396f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:54.175406 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b095e-ecc5-4940-be70-2e1ebe9b396f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:54.175406 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b095e-ecc5-4940-be70-2e1ebe9b396f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:54.175406 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b095e-ecc5-4940-be70-2e1ebe9b396f admin admin] PATH_INFO: `/v3/users/2a6581ea631a4730b1e1a54c99a95544` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:54.178005 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400b095e-ecc5-4940-be70-2e1ebe9b396f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a6581ea631a4730b1e1a54c99a95544)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:54.179585 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400b095e-ecc5-4940-be70-2e1ebe9b396f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:54.192487 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089eb47d-eeab-48e7-b4a8-c2818d1cc0eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ecdcc9915844370942da032055832fa, user_id=b0619bdfb1954a38875fcbe1a16284e8, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:54.195367 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089eb47d-eeab-48e7-b4a8-c2818d1cc0eb admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:54.226290 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3330/6616] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:06:54 2022] PUT /identity/v3/projects/4ecdcc9915844370942da032055832fa/users/b0619bdfb1954a38875fcbe1a16284e8/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:54.236535 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507f82a-d9f1-462b-b801-d50350102fd8 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:54.236894 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507f82a-d9f1-462b-b801-d50350102fd8 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:54.237166 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507f82a-d9f1-462b-b801-d50350102fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:54.285884 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-5507f82a-d9f1-462b-b801-d50350102fd8 None None] MFA Rules not processed for user `b0619bdfb1954a38875fcbe1a16284e8`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:54.287156 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5507f82a-d9f1-462b-b801-d50350102fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:54.292374 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-400b095e-ecc5-4940-be70-2e1ebe9b396f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a6581ea631a4730b1e1a54c99a95544'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:54.293335 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-400b095e-ecc5-4940-be70-2e1ebe9b396f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a6581ea631a4730b1e1a54c99a95544'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:54.339095 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-400b095e-ecc5-4940-be70-2e1ebe9b396f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a6581ea631a4730b1e1a54c99a95544'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:54.360794 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-400b095e-ecc5-4940-be70-2e1ebe9b396f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a6581ea631a4730b1e1a54c99a95544'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:54.373598 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-400b095e-ecc5-4940-be70-2e1ebe9b396f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a6581ea631a4730b1e1a54c99a95544'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:54.391953 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3287/6617] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:06:53 2022] DELETE /identity/v3/users/2a6581ea631a4730b1e1a54c99a95544 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:54.398389 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7db1d6-b7f7-4f51-a6b6-ce4e6d944b31 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:54.402211 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7db1d6-b7f7-4f51-a6b6-ce4e6d944b31 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:54.402552 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7db1d6-b7f7-4f51-a6b6-ce4e6d944b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:54.423532 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3331/6618] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:54.425031 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507f82a-d9f1-462b-b801-d50350102fd8 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:54.426215 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5507f82a-d9f1-462b-b801-d50350102fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:54.438721 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-1e7db1d6-b7f7-4f51-a6b6-ce4e6d944b31 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:54.440471 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1e7db1d6-b7f7-4f51-a6b6-ce4e6d944b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:54.445013 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:54.518940 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507f82a-d9f1-462b-b801-d50350102fd8 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:54.520054 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3288/6619] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:54.537348 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7db1d6-b7f7-4f51-a6b6-ce4e6d944b31 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:54.539512 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1e7db1d6-b7f7-4f51-a6b6-ce4e6d944b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:54.545523 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220181fa-67c5-46a6-88fa-c03c28337a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:54.546900 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220181fa-67c5-46a6-88fa-c03c28337a43 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:54.547367 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220181fa-67c5-46a6-88fa-c03c28337a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:54.547981 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220181fa-67c5-46a6-88fa-c03c28337a43 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:54.548788 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220181fa-67c5-46a6-88fa-c03c28337a43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:54.551132 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220181fa-67c5-46a6-88fa-c03c28337a43 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:54.570117 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:54.596670 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3332/6620] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:06:54 2022] POST /identity/v3/projects => generated 369 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:54.599697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220181fa-67c5-46a6-88fa-c03c28337a43 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:54.681153 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7db1d6-b7f7-4f51-a6b6-ce4e6d944b31 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:54.762326 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220181fa-67c5-46a6-88fa-c03c28337a43 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:54.776652 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfe249-80ad-4c8b-827e-28811e1bdfaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:54.777289 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfe249-80ad-4c8b-827e-28811e1bdfaa admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:54.777684 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfe249-80ad-4c8b-827e-28811e1bdfaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:54.777963 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfe249-80ad-4c8b-827e-28811e1bdfaa admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:54.779549 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cfe249-80ad-4c8b-827e-28811e1bdfaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:54.781443 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cfe249-80ad-4c8b-827e-28811e1bdfaa admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:54.802760 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2f21d-00ae-4b14-b9ad-b46557797112 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:54.803934 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2f21d-00ae-4b14-b9ad-b46557797112 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:54.804432 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2f21d-00ae-4b14-b9ad-b46557797112 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:54.804922 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2f21d-00ae-4b14-b9ad-b46557797112 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:54.818431 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e2f21d-00ae-4b14-b9ad-b46557797112 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:54.822158 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e2f21d-00ae-4b14-b9ad-b46557797112 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:54.831623 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3333/6621] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:06:54 2022] POST /identity/v3/users => generated 291 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:54.836208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfe249-80ad-4c8b-827e-28811e1bdfaa admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:54.846510 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3289/6622] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:06:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:06:54.861515 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfe249-80ad-4c8b-827e-28811e1bdfaa admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:54.879279 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb6b82-09e5-4fcd-abcc-03105bc9f4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:54.879914 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb6b82-09e5-4fcd-abcc-03105bc9f4ff admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:54.880196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb6b82-09e5-4fcd-abcc-03105bc9f4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:54.880470 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb6b82-09e5-4fcd-abcc-03105bc9f4ff admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:54.881132 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb6b82-09e5-4fcd-abcc-03105bc9f4ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:54.882735 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb6b82-09e5-4fcd-abcc-03105bc9f4ff admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:54.903057 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3334/6623] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:06:54.907908 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2f21d-00ae-4b14-b9ad-b46557797112 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:54.921180 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2f21d-00ae-4b14-b9ad-b46557797112 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:54.932482 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9883d81-f273-4af8-9359-51ae99a275eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:54.933208 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9883d81-f273-4af8-9359-51ae99a275eb admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:54.933496 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9883d81-f273-4af8-9359-51ae99a275eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:54.933775 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9883d81-f273-4af8-9359-51ae99a275eb admin admin] PATH_INFO: `/v3/projects/04fde6f30a1a41bc801533e4fd880eb2/users/9373f6f431ab43fbbfc7b2a2771c5b5f/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:54.964865 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9883d81-f273-4af8-9359-51ae99a275eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=04fde6f30a1a41bc801533e4fd880eb2, user_id=9373f6f431ab43fbbfc7b2a2771c5b5f, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:54.977581 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9883d81-f273-4af8-9359-51ae99a275eb admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:55.008398 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3290/6624] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:06:54 2022] PUT /identity/v3/projects/04fde6f30a1a41bc801533e4fd880eb2/users/9373f6f431ab43fbbfc7b2a2771c5b5f/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:06:55.013579 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb6b82-09e5-4fcd-abcc-03105bc9f4ff admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:55.034918 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb6b82-09e5-4fcd-abcc-03105bc9f4ff admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:55.155810 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9883d81-f273-4af8-9359-51ae99a275eb admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:55.157622 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e9883d81-f273-4af8-9359-51ae99a275eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:55.178423 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959ab60-b715-4e85-9d88-ac9833b44886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:55.179230 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959ab60-b715-4e85-9d88-ac9833b44886 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:55.179512 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959ab60-b715-4e85-9d88-ac9833b44886 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:55.179787 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959ab60-b715-4e85-9d88-ac9833b44886 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:55.180864 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4959ab60-b715-4e85-9d88-ac9833b44886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:55.182058 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4959ab60-b715-4e85-9d88-ac9833b44886 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:55.212535 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3335/6625] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:06:55.213426 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959ab60-b715-4e85-9d88-ac9833b44886 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:55.234774 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959ab60-b715-4e85-9d88-ac9833b44886 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:55.255772 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044376c-d9ac-4319-bb2e-82411b0d7708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:55.256480 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044376c-d9ac-4319-bb2e-82411b0d7708 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:55.256730 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044376c-d9ac-4319-bb2e-82411b0d7708 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:55.257005 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044376c-d9ac-4319-bb2e-82411b0d7708 admin admin] PATH_INFO: `/v3/projects/04fde6f30a1a41bc801533e4fd880eb2/users/9373f6f431ab43fbbfc7b2a2771c5b5f/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:55.260821 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044376c-d9ac-4319-bb2e-82411b0d7708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04fde6f30a1a41bc801533e4fd880eb2, user_id=9373f6f431ab43fbbfc7b2a2771c5b5f, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:55.263701 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044376c-d9ac-4319-bb2e-82411b0d7708 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:55.280840 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:55.306661 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3336/6626] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:06:55 2022] PUT /identity/v3/projects/04fde6f30a1a41bc801533e4fd880eb2/users/9373f6f431ab43fbbfc7b2a2771c5b5f/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:55.321970 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99aee2d-7281-4557-885f-6170a8c3965c None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:55.322252 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99aee2d-7281-4557-885f-6170a8c3965c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:55.322523 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99aee2d-7281-4557-885f-6170a8c3965c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:55.389745 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a99aee2d-7281-4557-885f-6170a8c3965c None None] MFA Rules not processed for user `9373f6f431ab43fbbfc7b2a2771c5b5f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:55.391381 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a99aee2d-7281-4557-885f-6170a8c3965c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:55.403925 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9883d81-f273-4af8-9359-51ae99a275eb admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:55.572302 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:55.592714 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5a64d-1820-4975-9321-9774de31fe83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:55.593379 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5a64d-1820-4975-9321-9774de31fe83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:55.593663 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5a64d-1820-4975-9321-9774de31fe83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:55.593938 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5a64d-1820-4975-9321-9774de31fe83 admin admin] PATH_INFO: `/v3/projects/e52a6166bdb84df8b590884efba1f7b6` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:55.595252 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5a64d-1820-4975-9321-9774de31fe83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e52a6166bdb84df8b590884efba1f7b6)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:55.597195 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5a64d-1820-4975-9321-9774de31fe83 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:55.623664 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3337/6627] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:55 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:55.635091 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99aee2d-7281-4557-885f-6170a8c3965c None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:55.643485 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a99aee2d-7281-4557-885f-6170a8c3965c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:55.730158 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5ac5a64d-1820-4975-9321-9774de31fe83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e52a6166bdb84df8b590884efba1f7b6', 'request_id': 'req-5ac5a64d-1820-4975-9321-9774de31fe83'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:55.754499 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5ac5a64d-1820-4975-9321-9774de31fe83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e52a6166bdb84df8b590884efba1f7b6', 'request_id': 'req-5ac5a64d-1820-4975-9321-9774de31fe83'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:55.769468 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5ac5a64d-1820-4975-9321-9774de31fe83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e52a6166bdb84df8b590884efba1f7b6', 'request_id': 'req-5ac5a64d-1820-4975-9321-9774de31fe83'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:55.785852 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5ac5a64d-1820-4975-9321-9774de31fe83 admin admin] The token cache is being invalidate because project e52a6166bdb84df8b590884efba1f7b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:55.786504 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5ac5a64d-1820-4975-9321-9774de31fe83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:55.787728 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5ac5a64d-1820-4975-9321-9774de31fe83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:55.790015 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3291/6628] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:06:55 2022] DELETE /identity/v3/projects/e52a6166bdb84df8b590884efba1f7b6 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:06:55.795930 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f56de8-4d26-4867-b505-ea2e1ecc92e2 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:55.796467 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f56de8-4d26-4867-b505-ea2e1ecc92e2 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:55.796873 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f56de8-4d26-4867-b505-ea2e1ecc92e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:55.840888 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-21f56de8-4d26-4867-b505-ea2e1ecc92e2 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:55.843052 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-21f56de8-4d26-4867-b505-ea2e1ecc92e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:55.852322 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99aee2d-7281-4557-885f-6170a8c3965c None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:56.028921 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3292/6629] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:06:56.031305 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11ad3e-398f-4abd-b073-6d9af3d24d90 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:56.031599 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11ad3e-398f-4abd-b073-6d9af3d24d90 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:56.031957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11ad3e-398f-4abd-b073-6d9af3d24d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:56.050650 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a25564-e470-4566-b3e5-44a6fbd1ceb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:56.051615 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a25564-e470-4566-b3e5-44a6fbd1ceb0 service cinder] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:56.052061 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a25564-e470-4566-b3e5-44a6fbd1ceb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:56.052500 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a25564-e470-4566-b3e5-44a6fbd1ceb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:56.062458 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-56a25564-e470-4566-b3e5-44a6fbd1ceb0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:56.066218 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-3a11ad3e-398f-4abd-b073-6d9af3d24d90 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:56.067631 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3a11ad3e-398f-4abd-b073-6d9af3d24d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:56.098107 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3293/6630] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:56.105509 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a11ad3e-398f-4abd-b073-6d9af3d24d90 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:56.130640 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a11ad3e-398f-4abd-b073-6d9af3d24d90 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:56.145948 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e133c-ccb0-47ac-a8b8-64e579f72d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:56.148050 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e133c-ccb0-47ac-a8b8-64e579f72d02 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:56.148336 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e133c-ccb0-47ac-a8b8-64e579f72d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:56.148614 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e133c-ccb0-47ac-a8b8-64e579f72d02 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:56.149442 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e133c-ccb0-47ac-a8b8-64e579f72d02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:06:56.149904 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e133c-ccb0-47ac-a8b8-64e579f72d02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:56.151939 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e133c-ccb0-47ac-a8b8-64e579f72d02 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:56.178133 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3294/6631] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:06:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:06:56.181559 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e133c-ccb0-47ac-a8b8-64e579f72d02 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:56.205087 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e133c-ccb0-47ac-a8b8-64e579f72d02 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:56.229575 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683c23e-2632-437f-b78e-4b34a343a1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:56.232757 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:56.233335 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683c23e-2632-437f-b78e-4b34a343a1f0 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:56.235053 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683c23e-2632-437f-b78e-4b34a343a1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:56.236668 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683c23e-2632-437f-b78e-4b34a343a1f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:56.246100 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683c23e-2632-437f-b78e-4b34a343a1f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:56.249473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683c23e-2632-437f-b78e-4b34a343a1f0 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:56.298634 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a25564-e470-4566-b3e5-44a6fbd1ceb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:56.300250 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a25564-e470-4566-b3e5-44a6fbd1ceb0 service cinder] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:56.324252 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3295/6632] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:06:56 2022] POST /identity/v3/projects => generated 375 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:56.328772 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683c23e-2632-437f-b78e-4b34a343a1f0 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:56.361939 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3338/6633] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:06:55 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 728 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:06:56.419259 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:56.475624 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683c23e-2632-437f-b78e-4b34a343a1f0 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:56.498894 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66c9d1-2109-4eef-82f9-5746b7046fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:56.499566 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66c9d1-2109-4eef-82f9-5746b7046fab admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:56.502238 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66c9d1-2109-4eef-82f9-5746b7046fab admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:56.502532 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66c9d1-2109-4eef-82f9-5746b7046fab admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:56.503235 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a66c9d1-2109-4eef-82f9-5746b7046fab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:56.511251 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a66c9d1-2109-4eef-82f9-5746b7046fab admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:56.579134 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3296/6634] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:06:56 2022] POST /identity/v3/users => generated 288 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:56.583668 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a25564-e470-4566-b3e5-44a6fbd1ceb0 service cinder] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:56.601771 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a25564-e470-4566-b3e5-44a6fbd1ceb0 service cinder] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:56.620389 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e230f-fdd0-44aa-93dd-0cd7579b6116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:56.621040 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e230f-fdd0-44aa-93dd-0cd7579b6116 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:56.621320 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e230f-fdd0-44aa-93dd-0cd7579b6116 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:56.621596 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e230f-fdd0-44aa-93dd-0cd7579b6116 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:56.622289 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e230f-fdd0-44aa-93dd-0cd7579b6116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:56.630643 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e230f-fdd0-44aa-93dd-0cd7579b6116 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:56.664818 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3339/6635] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:06:56.667732 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66c9d1-2109-4eef-82f9-5746b7046fab admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:56.683948 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66c9d1-2109-4eef-82f9-5746b7046fab admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:56.714952 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9e219-6cd1-4b1c-a0bd-83f57b6094f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:56.715623 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9e219-6cd1-4b1c-a0bd-83f57b6094f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:56.715943 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9e219-6cd1-4b1c-a0bd-83f57b6094f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:56.716842 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9e219-6cd1-4b1c-a0bd-83f57b6094f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:56.722828 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d9e219-6cd1-4b1c-a0bd-83f57b6094f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:56.733486 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d9e219-6cd1-4b1c-a0bd-83f57b6094f7 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:56.778323 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3297/6636] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:06:56.783651 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e230f-fdd0-44aa-93dd-0cd7579b6116 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:56.811153 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e230f-fdd0-44aa-93dd-0cd7579b6116 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:56.821593 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386fad76-519b-4a09-ab48-2eccd538975d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:56.822294 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386fad76-519b-4a09-ab48-2eccd538975d admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:56.822609 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386fad76-519b-4a09-ab48-2eccd538975d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:56.822855 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386fad76-519b-4a09-ab48-2eccd538975d admin admin] PATH_INFO: `/v3/projects/4c799d509455479ca6b2017f81997a5a/users/bd764daa1d254731a1c7ebcbb4a0f643/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:56.856180 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386fad76-519b-4a09-ab48-2eccd538975d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c799d509455479ca6b2017f81997a5a, user_id=bd764daa1d254731a1c7ebcbb4a0f643, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:56.860009 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386fad76-519b-4a09-ab48-2eccd538975d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:56.877454 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9e219-6cd1-4b1c-a0bd-83f57b6094f7 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:56.879397 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-39d9e219-6cd1-4b1c-a0bd-83f57b6094f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:56.901811 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9e219-6cd1-4b1c-a0bd-83f57b6094f7 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:56.903150 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3340/6637] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:06:56 2022] PUT /identity/v3/projects/4c799d509455479ca6b2017f81997a5a/users/bd764daa1d254731a1c7ebcbb4a0f643/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:06:56.918693 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f7d75-924d-460e-91d5-9fa9297e036f None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:56.918693 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f7d75-924d-460e-91d5-9fa9297e036f None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:56.918693 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f7d75-924d-460e-91d5-9fa9297e036f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:57.047808 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd3db2-95f6-4bea-a282-3bea26eab274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:57.048473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd3db2-95f6-4bea-a282-3bea26eab274 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:57.048755 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd3db2-95f6-4bea-a282-3bea26eab274 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:57.049028 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd3db2-95f6-4bea-a282-3bea26eab274 admin admin] PATH_INFO: `/v3/projects/d1f4ab86fde8493d989b7982cce04088` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:57.050476 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fd3db2-95f6-4bea-a282-3bea26eab274 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1f4ab86fde8493d989b7982cce04088)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:57.052619 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-e92f7d75-924d-460e-91d5-9fa9297e036f None None] MFA Rules not processed for user `bd764daa1d254731a1c7ebcbb4a0f643`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:57.054849 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e92f7d75-924d-460e-91d5-9fa9297e036f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:57.057873 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fd3db2-95f6-4bea-a282-3bea26eab274 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:57.201229 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-04fd3db2-95f6-4bea-a282-3bea26eab274 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1f4ab86fde8493d989b7982cce04088', 'request_id': 'req-04fd3db2-95f6-4bea-a282-3bea26eab274'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:57.214144 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3341/6638] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:57.219310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f7d75-924d-460e-91d5-9fa9297e036f None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:57.239578 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f7d75-924d-460e-91d5-9fa9297e036f None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:57.303423 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-04fd3db2-95f6-4bea-a282-3bea26eab274 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1f4ab86fde8493d989b7982cce04088', 'request_id': 'req-04fd3db2-95f6-4bea-a282-3bea26eab274'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:57.358007 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-04fd3db2-95f6-4bea-a282-3bea26eab274 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1f4ab86fde8493d989b7982cce04088', 'request_id': 'req-04fd3db2-95f6-4bea-a282-3bea26eab274'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:57.411528 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-04fd3db2-95f6-4bea-a282-3bea26eab274 admin admin] The token cache is being invalidate because project d1f4ab86fde8493d989b7982cce04088 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:57.411975 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-04fd3db2-95f6-4bea-a282-3bea26eab274 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:57.413608 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-04fd3db2-95f6-4bea-a282-3bea26eab274 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:57.419766 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3298/6639] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:06:56 2022] DELETE /identity/v3/projects/d1f4ab86fde8493d989b7982cce04088 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:57.421489 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd3db2-95f6-4bea-a282-3bea26eab274 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:57.423052 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-04fd3db2-95f6-4bea-a282-3bea26eab274 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:57.546716 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b54344-4027-420a-a2d4-8c6ce107d51d tempest-IdentityCatalogTest-1194085625 tempest-IdentityCatalogTest-1194085625-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd764daa1d254731a1c7ebcbb4a0f643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c799d509455479ca6b2017f81997a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:57.548922 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b54344-4027-420a-a2d4-8c6ce107d51d tempest-IdentityCatalogTest-1194085625 tempest-IdentityCatalogTest-1194085625-project] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:57.549759 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b54344-4027-420a-a2d4-8c6ce107d51d tempest-IdentityCatalogTest-1194085625 tempest-IdentityCatalogTest-1194085625-project] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:57.550214 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b54344-4027-420a-a2d4-8c6ce107d51d tempest-IdentityCatalogTest-1194085625 tempest-IdentityCatalogTest-1194085625-project] PATH_INFO: `/v3/auth/catalog` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:57.553762 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b54344-4027-420a-a2d4-8c6ce107d51d tempest-IdentityCatalogTest-1194085625 tempest-IdentityCatalogTest-1194085625-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:57.562765 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b54344-4027-420a-a2d4-8c6ce107d51d tempest-IdentityCatalogTest-1194085625 tempest-IdentityCatalogTest-1194085625-project] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:57.568157 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3342/6640] 10.222.0.83 () {58 vars in 1143 bytes} [Mon Aug 29 16:06:57 2022] GET /identity/v3/auth/catalog => generated 2658 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:06:57.589078 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:57.612216 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b54344-4027-420a-a2d4-8c6ce107d51d tempest-IdentityCatalogTest-1194085625 tempest-IdentityCatalogTest-1194085625-project] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:57.623637 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a9b54344-4027-420a-a2d4-8c6ce107d51d tempest-IdentityCatalogTest-1194085625 tempest-IdentityCatalogTest-1194085625-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:57.683234 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd3db2-95f6-4bea-a282-3bea26eab274 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:57.716458 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b54344-4027-420a-a2d4-8c6ce107d51d tempest-IdentityCatalogTest-1194085625 tempest-IdentityCatalogTest-1194085625-project] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:57.719495 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd990f-ca92-4dae-a943-4886bd1f3989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:57.720687 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd990f-ca92-4dae-a943-4886bd1f3989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:57.721303 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd990f-ca92-4dae-a943-4886bd1f3989 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:57.722606 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd990f-ca92-4dae-a943-4886bd1f3989 admin admin] PATH_INFO: `/v3/users/a0fbc9c15ddf437f920a346a04d0fd83` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:57.723771 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e84e3e-de04-469f-96d0-a4824735e154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:57.724847 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e84e3e-de04-469f-96d0-a4824735e154 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:57.725763 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e84e3e-de04-469f-96d0-a4824735e154 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:57.725763 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e84e3e-de04-469f-96d0-a4824735e154 admin admin] PATH_INFO: `/v3/users/bd764daa1d254731a1c7ebcbb4a0f643` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:57.727298 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e84e3e-de04-469f-96d0-a4824735e154 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd764daa1d254731a1c7ebcbb4a0f643)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:57.728942 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd990f-ca92-4dae-a943-4886bd1f3989 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0fbc9c15ddf437f920a346a04d0fd83)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:57.729580 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e84e3e-de04-469f-96d0-a4824735e154 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:57.734362 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd990f-ca92-4dae-a943-4886bd1f3989 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:57.881749 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:57.892617 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-31e84e3e-de04-469f-96d0-a4824735e154 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd764daa1d254731a1c7ebcbb4a0f643'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:57.907716 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-31e84e3e-de04-469f-96d0-a4824735e154 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd764daa1d254731a1c7ebcbb4a0f643'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:57.939468 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-31e84e3e-de04-469f-96d0-a4824735e154 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd764daa1d254731a1c7ebcbb4a0f643'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:57.956073 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-31e84e3e-de04-469f-96d0-a4824735e154 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd764daa1d254731a1c7ebcbb4a0f643'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:57.957034 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-31e84e3e-de04-469f-96d0-a4824735e154 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd764daa1d254731a1c7ebcbb4a0f643'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:57.978558 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b9bd990f-ca92-4dae-a943-4886bd1f3989 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0fbc9c15ddf437f920a346a04d0fd83'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:57.991120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b9bd990f-ca92-4dae-a943-4886bd1f3989 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0fbc9c15ddf437f920a346a04d0fd83'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:58.058859 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3343/6641] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:06:57 2022] DELETE /identity/v3/users/bd764daa1d254731a1c7ebcbb4a0f643 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:58.062855 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e045d54-e08d-4b69-9eef-686ef1c60ff2 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:58.063185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e045d54-e08d-4b69-9eef-686ef1c60ff2 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:58.063456 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e045d54-e08d-4b69-9eef-686ef1c60ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:58.086493 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b9bd990f-ca92-4dae-a943-4886bd1f3989 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0fbc9c15ddf437f920a346a04d0fd83'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:58.116473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b9bd990f-ca92-4dae-a943-4886bd1f3989 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0fbc9c15ddf437f920a346a04d0fd83'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:58.134206 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-7e045d54-e08d-4b69-9eef-686ef1c60ff2 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:58.135530 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7e045d54-e08d-4b69-9eef-686ef1c60ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:58.140068 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b9bd990f-ca92-4dae-a943-4886bd1f3989 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0fbc9c15ddf437f920a346a04d0fd83'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:58.192937 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3299/6642] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:06:57 2022] DELETE /identity/v3/users/a0fbc9c15ddf437f920a346a04d0fd83 => generated 0 bytes in 772 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:58.348975 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3344/6643] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:06:58.383681 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd990f-ca92-4dae-a943-4886bd1f3989 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:58.386874 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b9bd990f-ca92-4dae-a943-4886bd1f3989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:58.487008 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3cb5d0-00a9-4bc6-b748-ffced15cd206 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:58.487008 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3cb5d0-00a9-4bc6-b748-ffced15cd206 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:58.487008 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3cb5d0-00a9-4bc6-b748-ffced15cd206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:58.504648 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd990f-ca92-4dae-a943-4886bd1f3989 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:58.510545 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d080b-4a65-4493-a239-5a3cfae1b5e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:58.511502 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d080b-4a65-4493-a239-5a3cfae1b5e6 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:58.511502 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d080b-4a65-4493-a239-5a3cfae1b5e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:58.511798 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d080b-4a65-4493-a239-5a3cfae1b5e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:58.554236 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-ca3cb5d0-00a9-4bc6-b748-ffced15cd206 None None] MFA Rules not processed for user `4bb54ce3cfac4eb7b9095f3733745cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:58.555478 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ca3cb5d0-00a9-4bc6-b748-ffced15cd206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:58.659122 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d080b-4a65-4493-a239-5a3cfae1b5e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:58.659122 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d080b-4a65-4493-a239-5a3cfae1b5e6 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:58.675380 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3300/6644] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:06:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:06:58.733550 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3345/6645] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:06:58 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:06:58.738251 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d080b-4a65-4493-a239-5a3cfae1b5e6 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:58.749444 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-df1d080b-4a65-4493-a239-5a3cfae1b5e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:58.775305 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d080b-4a65-4493-a239-5a3cfae1b5e6 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:58.791821 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86500b62-15f0-4dbe-8f2a-bf8945046b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:58.792856 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86500b62-15f0-4dbe-8f2a-bf8945046b4e admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:58.793233 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86500b62-15f0-4dbe-8f2a-bf8945046b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:58.793759 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86500b62-15f0-4dbe-8f2a-bf8945046b4e admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:58.794559 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86500b62-15f0-4dbe-8f2a-bf8945046b4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:58.798913 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86500b62-15f0-4dbe-8f2a-bf8945046b4e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:58.855115 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:58.879941 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3301/6646] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:06:58 2022] POST /identity/v3/projects => generated 403 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:58.880436 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3cb5d0-00a9-4bc6-b748-ffced15cd206 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:58.901668 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3cb5d0-00a9-4bc6-b748-ffced15cd206 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:59.095207 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:59.119938 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c6017-56df-4955-b38c-088e8be94882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:59.122839 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c6017-56df-4955-b38c-088e8be94882 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:59.127342 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c6017-56df-4955-b38c-088e8be94882 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:59.127900 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c6017-56df-4955-b38c-088e8be94882 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:59.131614 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c6017-56df-4955-b38c-088e8be94882 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:59.144319 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c6017-56df-4955-b38c-088e8be94882 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:59.161574 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ede206-53c1-4972-8de0-07d9d269c3e8 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:59.162080 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ede206-53c1-4972-8de0-07d9d269c3e8 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:59.162534 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ede206-53c1-4972-8de0-07d9d269c3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:59.206889 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3346/6647] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:06:58 2022] POST /identity/v3/users => generated 302 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:06:59.208112 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c6017-56df-4955-b38c-088e8be94882 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:59.246384 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c6017-56df-4955-b38c-088e8be94882 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:59.268227 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-75ede206-53c1-4972-8de0-07d9d269c3e8 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:59.269818 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-75ede206-53c1-4972-8de0-07d9d269c3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:59.277590 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae570da-1618-4078-89d8-63916806e411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:59.278275 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae570da-1618-4078-89d8-63916806e411 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:59.279568 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae570da-1618-4078-89d8-63916806e411 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:59.279956 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae570da-1618-4078-89d8-63916806e411 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:59.297116 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae570da-1618-4078-89d8-63916806e411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:59.305768 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae570da-1618-4078-89d8-63916806e411 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:59.344929 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3347/6648] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:06:59.345897 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae570da-1618-4078-89d8-63916806e411 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:59.359990 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae570da-1618-4078-89d8-63916806e411 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:59.366610 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c7ca8-9fde-40a4-9d6e-584035ec7d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:59.367560 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c7ca8-9fde-40a4-9d6e-584035ec7d50 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:59.368008 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c7ca8-9fde-40a4-9d6e-584035ec7d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:59.368439 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c7ca8-9fde-40a4-9d6e-584035ec7d50 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:59.369297 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399c7ca8-9fde-40a4-9d6e-584035ec7d50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:59.371598 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399c7ca8-9fde-40a4-9d6e-584035ec7d50 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:59.427149 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3348/6649] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:06:59.432218 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c7ca8-9fde-40a4-9d6e-584035ec7d50 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:59.458375 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3302/6650] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 16:06:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:59.470294 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c7ca8-9fde-40a4-9d6e-584035ec7d50 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:59.487403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ede206-53c1-4972-8de0-07d9d269c3e8 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:59.488958 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50002775-be01-4120-891c-f37a297ae834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:59.489351 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-75ede206-53c1-4972-8de0-07d9d269c3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:59.492028 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50002775-be01-4120-891c-f37a297ae834 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:59.492315 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50002775-be01-4120-891c-f37a297ae834 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:59.492596 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50002775-be01-4120-891c-f37a297ae834 admin admin] PATH_INFO: `/v3/projects/a214cd253d0949e980d11633ba5ae6ba/users/a6b9bb23a4604eaabd5ba85cec428e4b/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:59.551976 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50002775-be01-4120-891c-f37a297ae834 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a214cd253d0949e980d11633ba5ae6ba, user_id=a6b9bb23a4604eaabd5ba85cec428e4b, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:59.555738 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50002775-be01-4120-891c-f37a297ae834 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:59.594421 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3349/6651] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:06:59 2022] PUT /identity/v3/projects/a214cd253d0949e980d11633ba5ae6ba/users/a6b9bb23a4604eaabd5ba85cec428e4b/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:59.634428 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ede206-53c1-4972-8de0-07d9d269c3e8 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:59.743128 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9af29-8b7f-450b-b65d-1d7b18d9eed0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:59.744089 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9af29-8b7f-450b-b65d-1d7b18d9eed0 service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:59.744370 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9af29-8b7f-450b-b65d-1d7b18d9eed0 service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:59.744722 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9af29-8b7f-450b-b65d-1d7b18d9eed0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:59.834962 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:59.863308 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba9af29-8b7f-450b-b65d-1d7b18d9eed0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:59.865081 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba9af29-8b7f-450b-b65d-1d7b18d9eed0 service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:59.875475 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3303/6652] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 16:06:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:07:00.063194 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50002775-be01-4120-891c-f37a297ae834 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:00.065520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-50002775-be01-4120-891c-f37a297ae834 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:00.119850 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9af29-8b7f-450b-b65d-1d7b18d9eed0 service swift] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:00.121571 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-fba9af29-8b7f-450b-b65d-1d7b18d9eed0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:00.226296 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50002775-be01-4120-891c-f37a297ae834 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:00.238964 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d62b49-ddb8-48fe-87ee-3570a218ff20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:00.239802 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d62b49-ddb8-48fe-87ee-3570a218ff20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:00.240136 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d62b49-ddb8-48fe-87ee-3570a218ff20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:00.240491 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d62b49-ddb8-48fe-87ee-3570a218ff20 admin admin] PATH_INFO: `/v3/users/b0619bdfb1954a38875fcbe1a16284e8` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:00.242659 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d62b49-ddb8-48fe-87ee-3570a218ff20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0619bdfb1954a38875fcbe1a16284e8)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:00.244705 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d62b49-ddb8-48fe-87ee-3570a218ff20 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:00.282439 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9af29-8b7f-450b-b65d-1d7b18d9eed0 service swift] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:00.293584 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfcbffa-11bc-40cb-b149-fd5c05a43bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:00.294778 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfcbffa-11bc-40cb-b149-fd5c05a43bdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:00.295583 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfcbffa-11bc-40cb-b149-fd5c05a43bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:00.295934 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfcbffa-11bc-40cb-b149-fd5c05a43bdb admin admin] PATH_INFO: `/v3/projects/de7271a29ccc4d1ab7ea4df61e0260d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:00.297475 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfcbffa-11bc-40cb-b149-fd5c05a43bdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=de7271a29ccc4d1ab7ea4df61e0260d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:00.299540 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfcbffa-11bc-40cb-b149-fd5c05a43bdb admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:00.350444 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-98d62b49-ddb8-48fe-87ee-3570a218ff20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0619bdfb1954a38875fcbe1a16284e8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:00.350662 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-98d62b49-ddb8-48fe-87ee-3570a218ff20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0619bdfb1954a38875fcbe1a16284e8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:00.364247 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-98d62b49-ddb8-48fe-87ee-3570a218ff20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0619bdfb1954a38875fcbe1a16284e8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:00.384511 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-98d62b49-ddb8-48fe-87ee-3570a218ff20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0619bdfb1954a38875fcbe1a16284e8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:00.386561 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-98d62b49-ddb8-48fe-87ee-3570a218ff20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0619bdfb1954a38875fcbe1a16284e8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:00.396791 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3bfcbffa-11bc-40cb-b149-fd5c05a43bdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'request_id': 'req-3bfcbffa-11bc-40cb-b149-fd5c05a43bdb'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:00.405255 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3bfcbffa-11bc-40cb-b149-fd5c05a43bdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'request_id': 'req-3bfcbffa-11bc-40cb-b149-fd5c05a43bdb'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:00.421650 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3bfcbffa-11bc-40cb-b149-fd5c05a43bdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de7271a29ccc4d1ab7ea4df61e0260d2', 'request_id': 'req-3bfcbffa-11bc-40cb-b149-fd5c05a43bdb'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:00.441884 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3350/6653] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:07:00 2022] DELETE /identity/v3/users/b0619bdfb1954a38875fcbe1a16284e8 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:00.444695 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d786de7-5f08-46c7-8e91-a3d902250756 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:00.445028 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d786de7-5f08-46c7-8e91-a3d902250756 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:00.445308 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d786de7-5f08-46c7-8e91-a3d902250756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:00.475040 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3bfcbffa-11bc-40cb-b149-fd5c05a43bdb admin admin] The token cache is being invalidate because project de7271a29ccc4d1ab7ea4df61e0260d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:07:00.475409 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3bfcbffa-11bc-40cb-b149-fd5c05a43bdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:00.482536 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3bfcbffa-11bc-40cb-b149-fd5c05a43bdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:00.486774 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3304/6654] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:07:00 2022] DELETE /identity/v3/projects/de7271a29ccc4d1ab7ea4df61e0260d2 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:07:00.489224 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-4d786de7-5f08-46c7-8e91-a3d902250756 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:00.490518 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4d786de7-5f08-46c7-8e91-a3d902250756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:00.494692 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed631a0e-271f-44c2-b4b9-14d89a7eb8e8 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:00.497684 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed631a0e-271f-44c2-b4b9-14d89a7eb8e8 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:00.497997 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed631a0e-271f-44c2-b4b9-14d89a7eb8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:00.517032 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:00.589194 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-ed631a0e-271f-44c2-b4b9-14d89a7eb8e8 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:00.592401 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ed631a0e-271f-44c2-b4b9-14d89a7eb8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:00.636810 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3351/6655] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:00.673261 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d786de7-5f08-46c7-8e91-a3d902250756 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:00.674798 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4d786de7-5f08-46c7-8e91-a3d902250756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:00.790314 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3305/6656] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:00.793886 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19483ab5-8b6e-42f6-bbc7-b5aed0dbc38a None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:00.794394 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19483ab5-8b6e-42f6-bbc7-b5aed0dbc38a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:00.794510 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19483ab5-8b6e-42f6-bbc7-b5aed0dbc38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:00.799037 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d786de7-5f08-46c7-8e91-a3d902250756 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:00.810445 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b81f07-912e-4aba-a9b5-bccfeb6eb8ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:00.811293 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b81f07-912e-4aba-a9b5-bccfeb6eb8ee service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:00.811572 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b81f07-912e-4aba-a9b5-bccfeb6eb8ee service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:00.811844 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b81f07-912e-4aba-a9b5-bccfeb6eb8ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:00.833231 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b81f07-912e-4aba-a9b5-bccfeb6eb8ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:00.834700 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b81f07-912e-4aba-a9b5-bccfeb6eb8ee service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:00.861635 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3352/6657] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:07:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:07:00.870540 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-19483ab5-8b6e-42f6-bbc7-b5aed0dbc38a None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:00.871461 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-19483ab5-8b6e-42f6-bbc7-b5aed0dbc38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:00.899339 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3306/6658] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:00.900143 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b81f07-912e-4aba-a9b5-bccfeb6eb8ee service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:00.916525 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b81f07-912e-4aba-a9b5-bccfeb6eb8ee service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:00.943540 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c95fd-77e8-4ff3-82d0-bcafeaa5adaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:00.944253 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c95fd-77e8-4ff3-82d0-bcafeaa5adaa admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:00.944536 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c95fd-77e8-4ff3-82d0-bcafeaa5adaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:00.944810 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c95fd-77e8-4ff3-82d0-bcafeaa5adaa admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:00.945634 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727c95fd-77e8-4ff3-82d0-bcafeaa5adaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:07:00.945936 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727c95fd-77e8-4ff3-82d0-bcafeaa5adaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:00.946049 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1142128-338e-4bbc-968e-aa71cf839157 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:00.946279 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1142128-338e-4bbc-968e-aa71cf839157 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:00.946563 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1142128-338e-4bbc-968e-aa71cf839157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:00.952711 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727c95fd-77e8-4ff3-82d0-bcafeaa5adaa admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:00.965509 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:00.993176 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3353/6659] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:07:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:07:00.999366 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c95fd-77e8-4ff3-82d0-bcafeaa5adaa admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:01.010504 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-b1142128-338e-4bbc-968e-aa71cf839157 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:01.024224 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c95fd-77e8-4ff3-82d0-bcafeaa5adaa admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:01.027703 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b1142128-338e-4bbc-968e-aa71cf839157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:01.038102 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeaf7e2-45ef-48a4-b2d8-0a0d822bf8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:01.038960 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeaf7e2-45ef-48a4-b2d8-0a0d822bf8c3 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:01.039384 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeaf7e2-45ef-48a4-b2d8-0a0d822bf8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:01.039734 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeaf7e2-45ef-48a4-b2d8-0a0d822bf8c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:01.040611 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeaf7e2-45ef-48a4-b2d8-0a0d822bf8c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:01.046323 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeaf7e2-45ef-48a4-b2d8-0a0d822bf8c3 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:01.110663 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3354/6660] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:07:00 2022] POST /identity/v3/projects => generated 379 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:07:01.113138 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeaf7e2-45ef-48a4-b2d8-0a0d822bf8c3 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:01.115850 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-eeeaf7e2-45ef-48a4-b2d8-0a0d822bf8c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:01.183790 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3307/6661] 10.222.0.83 () {58 vars in 967 bytes} [Mon Aug 29 16:07:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:01.185346 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1142128-338e-4bbc-968e-aa71cf839157 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:01.221433 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1142128-338e-4bbc-968e-aa71cf839157 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:01.311175 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeaf7e2-45ef-48a4-b2d8-0a0d822bf8c3 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:01.321481 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c55b6-2f7d-41c8-abad-d71059623c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:01.322157 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c55b6-2f7d-41c8-abad-d71059623c21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:01.322439 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c55b6-2f7d-41c8-abad-d71059623c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:01.322713 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c55b6-2f7d-41c8-abad-d71059623c21 admin admin] PATH_INFO: `/v3/projects/4c799d509455479ca6b2017f81997a5a` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:01.326255 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903c55b6-2f7d-41c8-abad-d71059623c21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c799d509455479ca6b2017f81997a5a)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:01.333567 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903c55b6-2f7d-41c8-abad-d71059623c21 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:01.344489 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef0d46-ed15-4183-981c-d7647cdd2101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:01.345124 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef0d46-ed15-4183-981c-d7647cdd2101 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:01.345406 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef0d46-ed15-4183-981c-d7647cdd2101 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:01.345681 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef0d46-ed15-4183-981c-d7647cdd2101 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:01.346336 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebef0d46-ed15-4183-981c-d7647cdd2101 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:01.348389 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebef0d46-ed15-4183-981c-d7647cdd2101 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:01.396261 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3308/6662] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:07:01 2022] POST /identity/v3/users => generated 296 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:07:01.397142 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef0d46-ed15-4183-981c-d7647cdd2101 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:01.403120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ebef0d46-ed15-4183-981c-d7647cdd2101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:01.472250 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:01.501260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef0d46-ed15-4183-981c-d7647cdd2101 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:01.537528 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-903c55b6-2f7d-41c8-abad-d71059623c21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c799d509455479ca6b2017f81997a5a', 'request_id': 'req-903c55b6-2f7d-41c8-abad-d71059623c21'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:01.576466 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-903c55b6-2f7d-41c8-abad-d71059623c21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c799d509455479ca6b2017f81997a5a', 'request_id': 'req-903c55b6-2f7d-41c8-abad-d71059623c21'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:01.593577 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-903c55b6-2f7d-41c8-abad-d71059623c21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c799d509455479ca6b2017f81997a5a', 'request_id': 'req-903c55b6-2f7d-41c8-abad-d71059623c21'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:01.597197 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:01.645967 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-903c55b6-2f7d-41c8-abad-d71059623c21 admin admin] The token cache is being invalidate because project 4c799d509455479ca6b2017f81997a5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:07:01.648341 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-903c55b6-2f7d-41c8-abad-d71059623c21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:01.649192 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-903c55b6-2f7d-41c8-abad-d71059623c21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:01.653311 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3355/6663] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:07:01 2022] DELETE /identity/v3/projects/4c799d509455479ca6b2017f81997a5a => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:01.657088 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c55b6-2f7d-41c8-abad-d71059623c21 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:01.668126 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-903c55b6-2f7d-41c8-abad-d71059623c21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:01.674522 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4174a-9912-477c-95dd-ad107a97d08a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:01.675181 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4174a-9912-477c-95dd-ad107a97d08a service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:01.675461 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4174a-9912-477c-95dd-ad107a97d08a service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:01.675813 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4174a-9912-477c-95dd-ad107a97d08a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:01.685315 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-cee4174a-9912-477c-95dd-ad107a97d08a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:01.867103 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee4174a-9912-477c-95dd-ad107a97d08a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:01.873504 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee4174a-9912-477c-95dd-ad107a97d08a service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:01.902470 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3309/6664] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 16:07:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:07:01.906359 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49537baa-3256-4c78-ac06-5f18e5522e3a None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:01.906646 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49537baa-3256-4c78-ac06-5f18e5522e3a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:01.907045 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49537baa-3256-4c78-ac06-5f18e5522e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:01.958918 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-49537baa-3256-4c78-ac06-5f18e5522e3a None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:01.960236 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-49537baa-3256-4c78-ac06-5f18e5522e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:01.990745 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3310/6665] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:01.993193 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d5ac9-a9f0-4ba2-beb2-2c2f05aab699 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:01.993486 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d5ac9-a9f0-4ba2-beb2-2c2f05aab699 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:01.993764 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d5ac9-a9f0-4ba2-beb2-2c2f05aab699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:02.007959 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c55b6-2f7d-41c8-abad-d71059623c21 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:02.022504 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9358ded4-1313-4070-9b8f-5b096f1a6a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:02.024820 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358ded4-1313-4070-9b8f-5b096f1a6a8a admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:02.032702 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358ded4-1313-4070-9b8f-5b096f1a6a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:02.035697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358ded4-1313-4070-9b8f-5b096f1a6a8a admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:02.036639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9358ded4-1313-4070-9b8f-5b096f1a6a8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:02.040911 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-5f7d5ac9-a9f0-4ba2-beb2-2c2f05aab699 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:02.044469 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9358ded4-1313-4070-9b8f-5b096f1a6a8a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:02.046511 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5f7d5ac9-a9f0-4ba2-beb2-2c2f05aab699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:02.071525 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3311/6666] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:02.076056 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d5ac9-a9f0-4ba2-beb2-2c2f05aab699 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:02.086470 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3356/6667] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:07:01 2022] GET /identity/v3/roles => generated 1420 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:07:02.090489 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9358ded4-1313-4070-9b8f-5b096f1a6a8a admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:02.102661 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d5ac9-a9f0-4ba2-beb2-2c2f05aab699 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:02.118098 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe77b53-0451-4900-baab-0196f3b848a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:02.118788 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe77b53-0451-4900-baab-0196f3b848a8 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:02.119118 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe77b53-0451-4900-baab-0196f3b848a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:02.119232 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9358ded4-1313-4070-9b8f-5b096f1a6a8a admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:02.119697 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe77b53-0451-4900-baab-0196f3b848a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:02.122877 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe77b53-0451-4900-baab-0196f3b848a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:07:02.123266 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe77b53-0451-4900-baab-0196f3b848a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:02.125060 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe77b53-0451-4900-baab-0196f3b848a8 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:02.149454 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938f7bb-5c7f-4ff3-8a72-9792b95b2df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:02.151633 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938f7bb-5c7f-4ff3-8a72-9792b95b2df7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:02.152015 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938f7bb-5c7f-4ff3-8a72-9792b95b2df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:02.152340 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938f7bb-5c7f-4ff3-8a72-9792b95b2df7 admin admin] PATH_INFO: `/v3/projects/b1a2ee2f75f040ee9749d4a73b4a141b/users/745eda28114048088a243c4e7aa6a4c0/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:02.181885 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3312/6668] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:07:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:07:02.183604 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe77b53-0451-4900-baab-0196f3b848a8 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:02.186956 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1938f7bb-5c7f-4ff3-8a72-9792b95b2df7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1a2ee2f75f040ee9749d4a73b4a141b, user_id=745eda28114048088a243c4e7aa6a4c0, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:02.189802 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1938f7bb-5c7f-4ff3-8a72-9792b95b2df7 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:02.214596 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3357/6669] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:07:02 2022] PUT /identity/v3/projects/b1a2ee2f75f040ee9749d4a73b4a141b/users/745eda28114048088a243c4e7aa6a4c0/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:02.218557 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938f7bb-5c7f-4ff3-8a72-9792b95b2df7 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:02.222158 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe77b53-0451-4900-baab-0196f3b848a8 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:02.391163 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81054ba4-2dc4-40be-a6bf-31b03949bacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:02.391846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81054ba4-2dc4-40be-a6bf-31b03949bacf admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:02.392139 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81054ba4-2dc4-40be-a6bf-31b03949bacf admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:02.392397 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81054ba4-2dc4-40be-a6bf-31b03949bacf admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:02.393048 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81054ba4-2dc4-40be-a6bf-31b03949bacf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:02.400316 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81054ba4-2dc4-40be-a6bf-31b03949bacf admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:02.427926 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938f7bb-5c7f-4ff3-8a72-9792b95b2df7 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:02.447252 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f13e36-c8ac-4e81-9246-bc8f13631e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:02.449846 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f13e36-c8ac-4e81-9246-bc8f13631e50 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:02.454740 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f13e36-c8ac-4e81-9246-bc8f13631e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:02.455279 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f13e36-c8ac-4e81-9246-bc8f13631e50 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:02.457975 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f13e36-c8ac-4e81-9246-bc8f13631e50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:02.461582 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f13e36-c8ac-4e81-9246-bc8f13631e50 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:02.485641 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3358/6670] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:07:02.489896 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f13e36-c8ac-4e81-9246-bc8f13631e50 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:02.516998 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3313/6671] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:07:02 2022] POST /identity/v3/projects => generated 379 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:07:02.518605 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f13e36-c8ac-4e81-9246-bc8f13631e50 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:02.518856 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca508f-3818-4a69-9ec5-f8a4c9472f39 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:02.519210 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca508f-3818-4a69-9ec5-f8a4c9472f39 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:02.519489 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca508f-3818-4a69-9ec5-f8a4c9472f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:02.568278 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-53ca508f-3818-4a69-9ec5-f8a4c9472f39 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:02.569447 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-53ca508f-3818-4a69-9ec5-f8a4c9472f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:02.570017 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:02.672351 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:02.682450 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dbf71d-a0b5-49b2-8c11-bff7d7404e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:02.683217 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbf71d-a0b5-49b2-8c11-bff7d7404e07 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:02.683520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbf71d-a0b5-49b2-8c11-bff7d7404e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:02.685625 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbf71d-a0b5-49b2-8c11-bff7d7404e07 admin admin] PATH_INFO: `/v3/projects/b1a2ee2f75f040ee9749d4a73b4a141b/users/745eda28114048088a243c4e7aa6a4c0/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:02.692648 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dbf71d-a0b5-49b2-8c11-bff7d7404e07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1a2ee2f75f040ee9749d4a73b4a141b, user_id=745eda28114048088a243c4e7aa6a4c0, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:02.696275 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dbf71d-a0b5-49b2-8c11-bff7d7404e07 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:02.723594 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3314/6672] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 16:07:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:07:02.724461 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca508f-3818-4a69-9ec5-f8a4c9472f39 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:02.735891 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3359/6673] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:07:02 2022] PUT /identity/v3/projects/b1a2ee2f75f040ee9749d4a73b4a141b/users/745eda28114048088a243c4e7aa6a4c0/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:07:02.744087 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c43e1e-5f09-4762-b546-20c117f7962c None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:02.744380 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c43e1e-5f09-4762-b546-20c117f7962c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:02.744656 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c43e1e-5f09-4762-b546-20c117f7962c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:02.767543 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca508f-3818-4a69-9ec5-f8a4c9472f39 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:02.844190 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-66c43e1e-5f09-4762-b546-20c117f7962c None None] MFA Rules not processed for user `745eda28114048088a243c4e7aa6a4c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:02.845437 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-66c43e1e-5f09-4762-b546-20c117f7962c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:02.875469 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e6712-585d-45fb-ba80-fe3df130c118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:02.876098 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e6712-585d-45fb-ba80-fe3df130c118 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:02.876376 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e6712-585d-45fb-ba80-fe3df130c118 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:02.876798 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e6712-585d-45fb-ba80-fe3df130c118 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:02.877443 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e6712-585d-45fb-ba80-fe3df130c118 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:02.879433 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e6712-585d-45fb-ba80-fe3df130c118 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:02.914161 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3315/6674] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:07:02 2022] POST /identity/v3/users => generated 290 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:07:02.920552 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e6712-585d-45fb-ba80-fe3df130c118 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:02.929504 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f52e6712-585d-45fb-ba80-fe3df130c118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:03.032768 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3360/6675] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:02 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:03.034577 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c43e1e-5f09-4762-b546-20c117f7962c None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:03.060066 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c43e1e-5f09-4762-b546-20c117f7962c None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:03.086536 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e6712-585d-45fb-ba80-fe3df130c118 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:03.098467 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0387e1a7-93f6-4882-9c53-184e88c512b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:03.101527 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0349e-d841-48ba-a81c-501ea6bd75b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:03.102264 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0349e-d841-48ba-a81c-501ea6bd75b1 service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:03.102641 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0349e-d841-48ba-a81c-501ea6bd75b1 service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:03.102802 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387e1a7-93f6-4882-9c53-184e88c512b3 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:03.103115 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0349e-d841-48ba-a81c-501ea6bd75b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:03.103241 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387e1a7-93f6-4882-9c53-184e88c512b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:03.103394 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387e1a7-93f6-4882-9c53-184e88c512b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:03.104075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0387e1a7-93f6-4882-9c53-184e88c512b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:03.109816 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0387e1a7-93f6-4882-9c53-184e88c512b3 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:03.176238 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3361/6676] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:07:03.178579 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0387e1a7-93f6-4882-9c53-184e88c512b3 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:03.230996 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0387e1a7-93f6-4882-9c53-184e88c512b3 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:03.249698 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d80e67-d715-4594-acf9-0211d210a298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:03.250338 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d80e67-d715-4594-acf9-0211d210a298 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:03.250618 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d80e67-d715-4594-acf9-0211d210a298 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:03.258565 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d80e67-d715-4594-acf9-0211d210a298 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:03.260337 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d80e67-d715-4594-acf9-0211d210a298 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:03.264487 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d80e67-d715-4594-acf9-0211d210a298 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:03.265486 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba0349e-d841-48ba-a81c-501ea6bd75b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:03.269644 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba0349e-d841-48ba-a81c-501ea6bd75b1 service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:03.299962 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3316/6677] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 16:07:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:07:03.303344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0349e-d841-48ba-a81c-501ea6bd75b1 service swift] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:03.364544 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0349e-d841-48ba-a81c-501ea6bd75b1 service swift] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:03.401801 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d330ed5-0001-4278-968e-e144370df2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:03.402745 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d330ed5-0001-4278-968e-e144370df2ad admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:03.403243 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d330ed5-0001-4278-968e-e144370df2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:03.404489 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d330ed5-0001-4278-968e-e144370df2ad admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:03.407404 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d330ed5-0001-4278-968e-e144370df2ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:03.409265 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d330ed5-0001-4278-968e-e144370df2ad admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:03.450243 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3362/6678] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:07:03 2022] POST /identity/v3/projects => generated 381 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:07:03.460680 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d80e67-d715-4594-acf9-0211d210a298 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:03.468859 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3317/6679] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:07:03.470087 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d330ed5-0001-4278-968e-e144370df2ad admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:03.471896 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-45d80e67-d715-4594-acf9-0211d210a298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:03.498523 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d330ed5-0001-4278-968e-e144370df2ad admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:03.509897 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:03.717809 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676515b-e05e-49ae-8d96-d7116d1bb667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:03.718442 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676515b-e05e-49ae-8d96-d7116d1bb667 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:03.718719 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676515b-e05e-49ae-8d96-d7116d1bb667 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:03.718986 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676515b-e05e-49ae-8d96-d7116d1bb667 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:03.723869 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9676515b-e05e-49ae-8d96-d7116d1bb667 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:03.725864 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9676515b-e05e-49ae-8d96-d7116d1bb667 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:03.765062 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d80e67-d715-4594-acf9-0211d210a298 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:03.779735 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25849385-48f9-4e77-a815-e8feef5aef47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:03.789763 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25849385-48f9-4e77-a815-e8feef5aef47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:03.791243 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25849385-48f9-4e77-a815-e8feef5aef47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:03.792171 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25849385-48f9-4e77-a815-e8feef5aef47 admin admin] PATH_INFO: `/v3/projects/4ecdcc9915844370942da032055832fa` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:03.819312 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25849385-48f9-4e77-a815-e8feef5aef47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ecdcc9915844370942da032055832fa)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:03.823949 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25849385-48f9-4e77-a815-e8feef5aef47 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:03.833149 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3318/6680] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:07:03 2022] POST /identity/v3/users => generated 291 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:07:03.834152 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676515b-e05e-49ae-8d96-d7116d1bb667 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:03.882884 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:03.898600 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676515b-e05e-49ae-8d96-d7116d1bb667 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:03.913966 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf7890-5873-46a4-a817-c5f73575e269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:03.920912 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf7890-5873-46a4-a817-c5f73575e269 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:03.921218 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf7890-5873-46a4-a817-c5f73575e269 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:03.921618 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf7890-5873-46a4-a817-c5f73575e269 admin admin] PATH_INFO: `/v3/projects/c1ce66b9a7e44e069c21082060dfdd36/users/58fb277a10d343d6939c9e71b872b426/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:03.952734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf7890-5873-46a4-a817-c5f73575e269 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1ce66b9a7e44e069c21082060dfdd36, user_id=58fb277a10d343d6939c9e71b872b426, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:03.961295 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf7890-5873-46a4-a817-c5f73575e269 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:03.976916 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-25849385-48f9-4e77-a815-e8feef5aef47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ecdcc9915844370942da032055832fa', 'request_id': 'req-25849385-48f9-4e77-a815-e8feef5aef47'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:03.990187 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3319/6681] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:07:03 2022] PUT /identity/v3/projects/c1ce66b9a7e44e069c21082060dfdd36/users/58fb277a10d343d6939c9e71b872b426/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:03.990820 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf7890-5873-46a4-a817-c5f73575e269 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:03.995186 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-25849385-48f9-4e77-a815-e8feef5aef47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ecdcc9915844370942da032055832fa', 'request_id': 'req-25849385-48f9-4e77-a815-e8feef5aef47'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:04.009721 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-25849385-48f9-4e77-a815-e8feef5aef47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ecdcc9915844370942da032055832fa', 'request_id': 'req-25849385-48f9-4e77-a815-e8feef5aef47'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:04.069769 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-25849385-48f9-4e77-a815-e8feef5aef47 admin admin] The token cache is being invalidate because project 4ecdcc9915844370942da032055832fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:07:04.070277 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-25849385-48f9-4e77-a815-e8feef5aef47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:04.073123 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-25849385-48f9-4e77-a815-e8feef5aef47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:04.078751 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3363/6682] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:07:03 2022] DELETE /identity/v3/projects/4ecdcc9915844370942da032055832fa => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:04.091320 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d387ec-16da-4767-ba05-207e12facbb4 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:04.091745 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d387ec-16da-4767-ba05-207e12facbb4 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:04.092137 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d387ec-16da-4767-ba05-207e12facbb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:04.198872 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-e0d387ec-16da-4767-ba05-207e12facbb4 None None] MFA Rules not processed for user `58fb277a10d343d6939c9e71b872b426`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:04.206638 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e0d387ec-16da-4767-ba05-207e12facbb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:04.236776 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf7890-5873-46a4-a817-c5f73575e269 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:04.250418 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ab077-03f3-4001-b23e-1bc37a7b67bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:04.253666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ab077-03f3-4001-b23e-1bc37a7b67bb admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:04.255378 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ab077-03f3-4001-b23e-1bc37a7b67bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:04.255821 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ab077-03f3-4001-b23e-1bc37a7b67bb admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:04.256665 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378ab077-03f3-4001-b23e-1bc37a7b67bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:04.260993 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378ab077-03f3-4001-b23e-1bc37a7b67bb admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:04.285210 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3320/6683] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:07:04.290127 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ab077-03f3-4001-b23e-1bc37a7b67bb admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:04.296461 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-378ab077-03f3-4001-b23e-1bc37a7b67bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:04.326140 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ab077-03f3-4001-b23e-1bc37a7b67bb admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:04.344202 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb2d168-b455-410c-a05b-d60b43c1c95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:04.345052 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2d168-b455-410c-a05b-d60b43c1c95f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:04.360194 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2d168-b455-410c-a05b-d60b43c1c95f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:04.360591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2d168-b455-410c-a05b-d60b43c1c95f admin admin] PATH_INFO: `/v3/users/9373f6f431ab43fbbfc7b2a2771c5b5f` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:04.367499 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb2d168-b455-410c-a05b-d60b43c1c95f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9373f6f431ab43fbbfc7b2a2771c5b5f)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:04.369665 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb2d168-b455-410c-a05b-d60b43c1c95f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:04.398406 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3364/6684] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:04.399919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7def1-e61e-4f11-afad-d8de6a2d1db4 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:04.400306 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7def1-e61e-4f11-afad-d8de6a2d1db4 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:04.400685 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7def1-e61e-4f11-afad-d8de6a2d1db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:04.433573 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-9ad7def1-e61e-4f11-afad-d8de6a2d1db4 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:04.450821 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9ad7def1-e61e-4f11-afad-d8de6a2d1db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:04.468092 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2cb2d168-b455-410c-a05b-d60b43c1c95f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9373f6f431ab43fbbfc7b2a2771c5b5f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:04.469804 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2cb2d168-b455-410c-a05b-d60b43c1c95f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9373f6f431ab43fbbfc7b2a2771c5b5f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:04.501077 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:04.505197 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2cb2d168-b455-410c-a05b-d60b43c1c95f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9373f6f431ab43fbbfc7b2a2771c5b5f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:04.524901 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2cb2d168-b455-410c-a05b-d60b43c1c95f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9373f6f431ab43fbbfc7b2a2771c5b5f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:04.536969 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2cb2d168-b455-410c-a05b-d60b43c1c95f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9373f6f431ab43fbbfc7b2a2771c5b5f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:04.565152 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3321/6685] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:07:04 2022] DELETE /identity/v3/users/9373f6f431ab43fbbfc7b2a2771c5b5f => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:04.565152 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb2d168-b455-410c-a05b-d60b43c1c95f admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:04.566466 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2cb2d168-b455-410c-a05b-d60b43c1c95f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:04.620529 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3365/6686] 10.222.0.83 () {58 vars in 967 bytes} [Mon Aug 29 16:07:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:04.624943 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7def1-e61e-4f11-afad-d8de6a2d1db4 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:04.629066 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9ad7def1-e61e-4f11-afad-d8de6a2d1db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:04.659163 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7def1-e61e-4f11-afad-d8de6a2d1db4 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:04.737420 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb2d168-b455-410c-a05b-d60b43c1c95f admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:04.749269 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:04.754057 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac5205-71b3-4e43-a6ce-2e1187e04b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:04.756328 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac5205-71b3-4e43-a6ce-2e1187e04b68 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:04.756608 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac5205-71b3-4e43-a6ce-2e1187e04b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:04.756887 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac5205-71b3-4e43-a6ce-2e1187e04b68 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:04.757710 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac5205-71b3-4e43-a6ce-2e1187e04b68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:04.759628 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac5205-71b3-4e43-a6ce-2e1187e04b68 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:04.777412 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3322/6687] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:07:04.778142 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac5205-71b3-4e43-a6ce-2e1187e04b68 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:04.783936 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3bac5205-71b3-4e43-a6ce-2e1187e04b68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:04.830979 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3a89d-7098-4132-b6a3-ad781036b68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:04.832142 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3a89d-7098-4132-b6a3-ad781036b68a admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:04.832777 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3a89d-7098-4132-b6a3-ad781036b68a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:04.834134 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3a89d-7098-4132-b6a3-ad781036b68a admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:04.835069 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f3a89d-7098-4132-b6a3-ad781036b68a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:04.838186 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f3a89d-7098-4132-b6a3-ad781036b68a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:04.916910 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3366/6688] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:07:04 2022] POST /identity/v3/projects => generated 381 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:07:04.918162 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3a89d-7098-4132-b6a3-ad781036b68a admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:04.980382 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac5205-71b3-4e43-a6ce-2e1187e04b68 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:05.084249 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3a89d-7098-4132-b6a3-ad781036b68a admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:05.101030 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da8cc0-4b7a-4e8e-a03c-80dafb18e80e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:05.101294 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e254a07-48f7-4b60-8721-773dc7186da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:05.102210 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da8cc0-4b7a-4e8e-a03c-80dafb18e80e service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:05.102382 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e254a07-48f7-4b60-8721-773dc7186da6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:05.102682 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e254a07-48f7-4b60-8721-773dc7186da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:05.102965 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e254a07-48f7-4b60-8721-773dc7186da6 admin admin] PATH_INFO: `/v3/projects/0d28eab51ee34f2d9f685ba479a600d1/users/0b81d4201af142d597df3f7c7e93a36c/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:05.103300 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da8cc0-4b7a-4e8e-a03c-80dafb18e80e service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:05.103985 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da8cc0-4b7a-4e8e-a03c-80dafb18e80e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:05.133187 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:05.143809 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e254a07-48f7-4b60-8721-773dc7186da6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d28eab51ee34f2d9f685ba479a600d1, user_id=0b81d4201af142d597df3f7c7e93a36c, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:05.148642 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e254a07-48f7-4b60-8721-773dc7186da6 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:05.189304 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3367/6689] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:07:04 2022] PUT /identity/v3/projects/0d28eab51ee34f2d9f685ba479a600d1/users/0b81d4201af142d597df3f7c7e93a36c/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:05.191493 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e254a07-48f7-4b60-8721-773dc7186da6 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:05.225145 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da8cc0-4b7a-4e8e-a03c-80dafb18e80e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:05.227181 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da8cc0-4b7a-4e8e-a03c-80dafb18e80e service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:05.239653 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3323/6690] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 16:07:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:07:05.241153 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bec84b-a1d3-407d-a830-d3a0099401e8 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:05.241567 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bec84b-a1d3-407d-a830-d3a0099401e8 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:05.241873 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bec84b-a1d3-407d-a830-d3a0099401e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:05.306171 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-b6bec84b-a1d3-407d-a830-d3a0099401e8 None None] MFA Rules not processed for user `0b81d4201af142d597df3f7c7e93a36c`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:05.307737 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b6bec84b-a1d3-407d-a830-d3a0099401e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:05.394301 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e254a07-48f7-4b60-8721-773dc7186da6 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:05.409619 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29441e-4ba4-4cc7-80b1-6f844b40f0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:05.410278 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29441e-4ba4-4cc7-80b1-6f844b40f0a1 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:05.410553 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29441e-4ba4-4cc7-80b1-6f844b40f0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:05.410828 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29441e-4ba4-4cc7-80b1-6f844b40f0a1 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:05.411792 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd29441e-4ba4-4cc7-80b1-6f844b40f0a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:05.413877 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd29441e-4ba4-4cc7-80b1-6f844b40f0a1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:05.431171 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3324/6691] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:05.455283 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bec84b-a1d3-407d-a830-d3a0099401e8 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:05.458476 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b6bec84b-a1d3-407d-a830-d3a0099401e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:05.465811 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3368/6692] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:07:05 2022] POST /identity/v3/users => generated 291 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:07:05.480191 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29441e-4ba4-4cc7-80b1-6f844b40f0a1 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:05.538527 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29441e-4ba4-4cc7-80b1-6f844b40f0a1 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:05.567837 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb5251c-c223-49c8-add4-c4921cfe9480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:05.569344 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5251c-c223-49c8-add4-c4921cfe9480 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:05.576199 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5251c-c223-49c8-add4-c4921cfe9480 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:05.576829 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5251c-c223-49c8-add4-c4921cfe9480 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:05.577695 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb5251c-c223-49c8-add4-c4921cfe9480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:05.587493 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb5251c-c223-49c8-add4-c4921cfe9480 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:05.611916 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3369/6693] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:07:05.617370 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb5251c-c223-49c8-add4-c4921cfe9480 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:05.670643 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb5251c-c223-49c8-add4-c4921cfe9480 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:05.673561 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bec84b-a1d3-407d-a830-d3a0099401e8 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:05.677080 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec822534-c7d2-4b3d-bf4b-ac1eb2d41c6e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6b0f9835ed549cab91d684326be83fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:05.679082 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec822534-c7d2-4b3d-bf4b-ac1eb2d41c6e service glance] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:05.679082 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec822534-c7d2-4b3d-bf4b-ac1eb2d41c6e service glance] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:05.679082 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec822534-c7d2-4b3d-bf4b-ac1eb2d41c6e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:05.683722 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ec822534-c7d2-4b3d-bf4b-ac1eb2d41c6e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:05.689971 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066ea83-f032-42c5-be22-a3aec48611e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:05.690609 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066ea83-f032-42c5-be22-a3aec48611e5 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:05.690888 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066ea83-f032-42c5-be22-a3aec48611e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:05.691190 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066ea83-f032-42c5-be22-a3aec48611e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:05.694083 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4066ea83-f032-42c5-be22-a3aec48611e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:05.697137 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4066ea83-f032-42c5-be22-a3aec48611e5 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:05.728712 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3370/6694] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:07:05.732205 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066ea83-f032-42c5-be22-a3aec48611e5 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:05.797522 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066ea83-f032-42c5-be22-a3aec48611e5 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:05.798047 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:05.816906 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa143c-10f3-4070-b6e0-a673bd93fbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:05.819636 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa143c-10f3-4070-b6e0-a673bd93fbc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:05.820288 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa143c-10f3-4070-b6e0-a673bd93fbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:05.821340 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec822534-c7d2-4b3d-bf4b-ac1eb2d41c6e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:05.821696 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa143c-10f3-4070-b6e0-a673bd93fbc9 admin admin] PATH_INFO: `/v3/projects/50535a5bc11144b7a5d31c7b5967ae6c/users/0f006fa88e2c4685b53a4297f55afc9d/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:05.824144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec822534-c7d2-4b3d-bf4b-ac1eb2d41c6e service glance] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:05.830735 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:05.892601 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3325/6695] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:07:05 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:07:05.903397 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa143c-10f3-4070-b6e0-a673bd93fbc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50535a5bc11144b7a5d31c7b5967ae6c, user_id=0f006fa88e2c4685b53a4297f55afc9d, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:05.906660 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa143c-10f3-4070-b6e0-a673bd93fbc9 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:05.953888 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3371/6696] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:07:05 2022] PUT /identity/v3/projects/50535a5bc11144b7a5d31c7b5967ae6c/users/0f006fa88e2c4685b53a4297f55afc9d/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:05.962626 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21092832-3774-43e7-87e0-1b536725fa94 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:05.962799 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21092832-3774-43e7-87e0-1b536725fa94 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:05.963057 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21092832-3774-43e7-87e0-1b536725fa94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:06.052457 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-21092832-3774-43e7-87e0-1b536725fa94 None None] MFA Rules not processed for user `0f006fa88e2c4685b53a4297f55afc9d`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:06.056593 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-21092832-3774-43e7-87e0-1b536725fa94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:06.405097 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa143c-10f3-4070-b6e0-a673bd93fbc9 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:06.406373 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3326/6697] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 446 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:06.407453 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2ffa143c-10f3-4070-b6e0-a673bd93fbc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:06.551985 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa143c-10f3-4070-b6e0-a673bd93fbc9 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:06.557518 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e360775-7e34-4961-8524-4251b624e33c tempest-IdentityV3ProjectsTest-944037987 tempest-IdentityV3ProjectsTest-944037987-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58fb277a10d343d6939c9e71b872b426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1ce66b9a7e44e069c21082060dfdd36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:06.558405 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e360775-7e34-4961-8524-4251b624e33c tempest-IdentityV3ProjectsTest-944037987 tempest-IdentityV3ProjectsTest-944037987-project] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:06.559265 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e360775-7e34-4961-8524-4251b624e33c tempest-IdentityV3ProjectsTest-944037987 tempest-IdentityV3ProjectsTest-944037987-project] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:06.560014 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e360775-7e34-4961-8524-4251b624e33c tempest-IdentityV3ProjectsTest-944037987 tempest-IdentityV3ProjectsTest-944037987-project] PATH_INFO: `/v3/users/58fb277a10d343d6939c9e71b872b426/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:06.563352 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e360775-7e34-4961-8524-4251b624e33c tempest-IdentityV3ProjectsTest-944037987 tempest-IdentityV3ProjectsTest-944037987-project] RBAC: Authorizing `identity:list_user_projects(user_id=58fb277a10d343d6939c9e71b872b426)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:06.581689 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e360775-7e34-4961-8524-4251b624e33c tempest-IdentityV3ProjectsTest-944037987 tempest-IdentityV3ProjectsTest-944037987-project] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:06.689990 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3372/6698] 10.222.0.83 () {58 vars in 1248 bytes} [Mon Aug 29 16:07:06 2022] GET /identity/v3/users/58fb277a10d343d6939c9e71b872b426/projects => generated 515 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:07:06.692969 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2e9d4-db64-4743-ad59-524681bd1785 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:06.693598 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2e9d4-db64-4743-ad59-524681bd1785 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:06.694111 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2e9d4-db64-4743-ad59-524681bd1785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:06.755991 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-6bb2e9d4-db64-4743-ad59-524681bd1785 None None] MFA Rules not processed for user `58fb277a10d343d6939c9e71b872b426`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:06.757575 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6bb2e9d4-db64-4743-ad59-524681bd1785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:06.774612 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3327/6699] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:07:06.776505 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555f4d1-32f9-40e9-b9c7-d4b9d01af748 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:06.776616 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555f4d1-32f9-40e9-b9c7-d4b9d01af748 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:06.776811 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555f4d1-32f9-40e9-b9c7-d4b9d01af748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:06.814402 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-d555f4d1-32f9-40e9-b9c7-d4b9d01af748 None None] MFA Rules not processed for user `58fb277a10d343d6939c9e71b872b426`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:06.815977 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d555f4d1-32f9-40e9-b9c7-d4b9d01af748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:06.934036 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.models.token_model [None req-d555f4d1-32f9-40e9-b9c7-d4b9d01af748 None None] User 58fb277a10d343d6939c9e71b872b426 has no access to project 50535a5bc11144b7a5d31c7b5967ae6c {{(pid=82149) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Aug 29 16:07:06.943408 n-d-836830-13 devstack@keystone.service[82149]: WARNING keystone.server.flask.application [None req-d555f4d1-32f9-40e9-b9c7-d4b9d01af748 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.83: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 29 16:07:06.944859 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3373/6700] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:06 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 170 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Aug 29 16:07:06.952383 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb2e9d4-db64-4743-ad59-524681bd1785 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:07.013616 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d555f4d1-32f9-40e9-b9c7-d4b9d01af748 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:07.018126 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d555f4d1-32f9-40e9-b9c7-d4b9d01af748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:07.144479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb2e9d4-db64-4743-ad59-524681bd1785 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:07.154695 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb5e17-cb0b-46bc-9a14-02f1de6a68ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:07.156358 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb5e17-cb0b-46bc-9a14-02f1de6a68ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:07.156971 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb5e17-cb0b-46bc-9a14-02f1de6a68ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:07.157634 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb5e17-cb0b-46bc-9a14-02f1de6a68ef admin admin] PATH_INFO: `/v3/users/58fb277a10d343d6939c9e71b872b426` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:07.159506 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb5e17-cb0b-46bc-9a14-02f1de6a68ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=58fb277a10d343d6939c9e71b872b426)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:07.163188 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d555f4d1-32f9-40e9-b9c7-d4b9d01af748 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:07.170495 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0c96c-74e4-453b-ae28-bd108c54f52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:07.171218 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0c96c-74e4-453b-ae28-bd108c54f52e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:07.171500 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0c96c-74e4-453b-ae28-bd108c54f52e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:07.171779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0c96c-74e4-453b-ae28-bd108c54f52e admin admin] PATH_INFO: `/v3/projects/04fde6f30a1a41bc801533e4fd880eb2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:07.172956 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c0c96c-74e4-453b-ae28-bd108c54f52e admin admin] RBAC: Authorizing `identity:delete_project(project_id=04fde6f30a1a41bc801533e4fd880eb2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:07.175351 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c0c96c-74e4-453b-ae28-bd108c54f52e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:07.177054 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb5e17-cb0b-46bc-9a14-02f1de6a68ef admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:07.217583 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:07.288563 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-06bb5e17-cb0b-46bc-9a14-02f1de6a68ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58fb277a10d343d6939c9e71b872b426'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:07.288563 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-06bb5e17-cb0b-46bc-9a14-02f1de6a68ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58fb277a10d343d6939c9e71b872b426'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:07.322723 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-06bb5e17-cb0b-46bc-9a14-02f1de6a68ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58fb277a10d343d6939c9e71b872b426'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:07.326945 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-14c0c96c-74e4-453b-ae28-bd108c54f52e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04fde6f30a1a41bc801533e4fd880eb2', 'request_id': 'req-14c0c96c-74e4-453b-ae28-bd108c54f52e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:07.335708 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:07.339456 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-14c0c96c-74e4-453b-ae28-bd108c54f52e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04fde6f30a1a41bc801533e4fd880eb2', 'request_id': 'req-14c0c96c-74e4-453b-ae28-bd108c54f52e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:07.344263 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-06bb5e17-cb0b-46bc-9a14-02f1de6a68ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58fb277a10d343d6939c9e71b872b426'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:07.359746 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-06bb5e17-cb0b-46bc-9a14-02f1de6a68ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58fb277a10d343d6939c9e71b872b426'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:07.374792 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-14c0c96c-74e4-453b-ae28-bd108c54f52e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04fde6f30a1a41bc801533e4fd880eb2', 'request_id': 'req-14c0c96c-74e4-453b-ae28-bd108c54f52e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:07.383790 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3328/6701] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:07:06 2022] DELETE /identity/v3/users/58fb277a10d343d6939c9e71b872b426 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:07.389647 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8064b-3f1b-44e4-bd39-1a14ef9ce548 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:07.389957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8064b-3f1b-44e4-bd39-1a14ef9ce548 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:07.390302 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8064b-3f1b-44e4-bd39-1a14ef9ce548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:07.414928 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-14c0c96c-74e4-453b-ae28-bd108c54f52e admin admin] The token cache is being invalidate because project 04fde6f30a1a41bc801533e4fd880eb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:07:07.415490 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-14c0c96c-74e4-453b-ae28-bd108c54f52e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:07.416207 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-14c0c96c-74e4-453b-ae28-bd108c54f52e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:07.427259 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3374/6702] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:07:07 2022] DELETE /identity/v3/projects/04fde6f30a1a41bc801533e4fd880eb2 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:07.429379 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585f2e4-8022-43bd-8140-a32413abe92c None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:07.429661 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585f2e4-8022-43bd-8140-a32413abe92c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:07.429929 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585f2e4-8022-43bd-8140-a32413abe92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:07.458648 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-b7c8064b-3f1b-44e4-bd39-1a14ef9ce548 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:07.459929 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b7c8064b-3f1b-44e4-bd39-1a14ef9ce548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:07.528321 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-7585f2e4-8022-43bd-8140-a32413abe92c None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:07.536185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7585f2e4-8022-43bd-8140-a32413abe92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:07.621907 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3329/6703] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:07:07.626360 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8064b-3f1b-44e4-bd39-1a14ef9ce548 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:07.628387 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b7c8064b-3f1b-44e4-bd39-1a14ef9ce548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:07.659721 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8064b-3f1b-44e4-bd39-1a14ef9ce548 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:07.689349 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc1fa8f-f97b-442d-81bb-7468da4a20b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:07.690079 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1fa8f-f97b-442d-81bb-7468da4a20b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:07.690279 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1fa8f-f97b-442d-81bb-7468da4a20b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:07.690554 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1fa8f-f97b-442d-81bb-7468da4a20b0 admin admin] PATH_INFO: `/v3/users/745eda28114048088a243c4e7aa6a4c0` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:07.735504 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc1fa8f-f97b-442d-81bb-7468da4a20b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=745eda28114048088a243c4e7aa6a4c0)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:07.737593 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc1fa8f-f97b-442d-81bb-7468da4a20b0 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:07.833738 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3375/6704] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:07:07.834750 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7585f2e4-8022-43bd-8140-a32413abe92c None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:07.840013 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7585f2e4-8022-43bd-8140-a32413abe92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:07.855804 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-dfc1fa8f-f97b-442d-81bb-7468da4a20b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '745eda28114048088a243c4e7aa6a4c0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:07.857016 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-dfc1fa8f-f97b-442d-81bb-7468da4a20b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '745eda28114048088a243c4e7aa6a4c0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:07.896353 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-dfc1fa8f-f97b-442d-81bb-7468da4a20b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '745eda28114048088a243c4e7aa6a4c0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:07.915244 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-dfc1fa8f-f97b-442d-81bb-7468da4a20b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '745eda28114048088a243c4e7aa6a4c0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:07.930370 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-dfc1fa8f-f97b-442d-81bb-7468da4a20b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '745eda28114048088a243c4e7aa6a4c0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:07.967492 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3330/6705] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:07:07 2022] DELETE /identity/v3/users/745eda28114048088a243c4e7aa6a4c0 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:07.969433 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04aa85-b570-4b9b-9da6-70f6f568d12e None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:07.972022 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04aa85-b570-4b9b-9da6-70f6f568d12e None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:07.972743 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04aa85-b570-4b9b-9da6-70f6f568d12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:08.031665 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-5e04aa85-b570-4b9b-9da6-70f6f568d12e None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:08.037595 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5e04aa85-b570-4b9b-9da6-70f6f568d12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:08.159701 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:08.179181 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3331/6706] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:08.180856 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1d7c4-3a6d-4c4e-96fa-13314f37c971 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:08.184121 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1d7c4-3a6d-4c4e-96fa-13314f37c971 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:08.184422 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1d7c4-3a6d-4c4e-96fa-13314f37c971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:08.234356 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-7dd1d7c4-3a6d-4c4e-96fa-13314f37c971 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:08.238240 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7dd1d7c4-3a6d-4c4e-96fa-13314f37c971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:08.257293 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7585f2e4-8022-43bd-8140-a32413abe92c None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:08.262525 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3332/6707] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:08.265015 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd1d7c4-3a6d-4c4e-96fa-13314f37c971 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:08.288817 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd1d7c4-3a6d-4c4e-96fa-13314f37c971 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:08.318682 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f810f-3424-449f-8b41-5d5ec8f91e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:08.319362 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f810f-3424-449f-8b41-5d5ec8f91e85 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:08.319644 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f810f-3424-449f-8b41-5d5ec8f91e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:08.319917 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f810f-3424-449f-8b41-5d5ec8f91e85 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:08.322807 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f810f-3424-449f-8b41-5d5ec8f91e85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:07:08.324299 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f810f-3424-449f-8b41-5d5ec8f91e85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:08.332083 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f810f-3424-449f-8b41-5d5ec8f91e85 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:08.367540 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3333/6708] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:07:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:07:08.368444 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f810f-3424-449f-8b41-5d5ec8f91e85 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:08.376414 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a54f810f-3424-449f-8b41-5d5ec8f91e85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:08.453419 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74867b34-a1a4-4cf5-8394-edad6fbe8f2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:08.454041 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74867b34-a1a4-4cf5-8394-edad6fbe8f2d service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:08.454316 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74867b34-a1a4-4cf5-8394-edad6fbe8f2d service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:08.454578 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74867b34-a1a4-4cf5-8394-edad6fbe8f2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:08.460219 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-74867b34-a1a4-4cf5-8394-edad6fbe8f2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:08.467635 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f810f-3424-449f-8b41-5d5ec8f91e85 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:08.472825 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69878414-efad-46a4-a6a6-9608ea6e804c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:08.473930 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69878414-efad-46a4-a6a6-9608ea6e804c service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:08.474309 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69878414-efad-46a4-a6a6-9608ea6e804c service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:08.474746 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69878414-efad-46a4-a6a6-9608ea6e804c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:08.488110 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69878414-efad-46a4-a6a6-9608ea6e804c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:08.490807 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69878414-efad-46a4-a6a6-9608ea6e804c service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:08.491392 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74867b34-a1a4-4cf5-8394-edad6fbe8f2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:08.492843 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74867b34-a1a4-4cf5-8394-edad6fbe8f2d service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:08.501251 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:08.508194 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3334/6709] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:07:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:07:08.522094 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3376/6710] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:07:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 688 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:07:08.529581 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69878414-efad-46a4-a6a6-9608ea6e804c service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:08.556591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69878414-efad-46a4-a6a6-9608ea6e804c service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:08.569278 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fdb7c5-b3c7-4933-bd10-92f50221c812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:08.571310 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdb7c5-b3c7-4933-bd10-92f50221c812 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:08.572399 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdb7c5-b3c7-4933-bd10-92f50221c812 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:08.572876 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdb7c5-b3c7-4933-bd10-92f50221c812 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:08.575803 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fdb7c5-b3c7-4933-bd10-92f50221c812 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:08.580044 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fdb7c5-b3c7-4933-bd10-92f50221c812 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:08.660048 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3335/6711] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:07:08 2022] POST /identity/v3/projects => generated 359 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:07:08.661303 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74867b34-a1a4-4cf5-8394-edad6fbe8f2d service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:08.677671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74867b34-a1a4-4cf5-8394-edad6fbe8f2d service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:08.779457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0800c8-9317-4dc6-bbef-50a406fd3d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:08.780086 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0800c8-9317-4dc6-bbef-50a406fd3d14 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:08.780447 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0800c8-9317-4dc6-bbef-50a406fd3d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:08.780951 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0800c8-9317-4dc6-bbef-50a406fd3d14 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:08.782478 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0800c8-9317-4dc6-bbef-50a406fd3d14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:08.785588 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0800c8-9317-4dc6-bbef-50a406fd3d14 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:08.819544 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3377/6712] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:07:08 2022] POST /identity/v3/users => generated 280 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:07:08.820819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fdb7c5-b3c7-4933-bd10-92f50221c812 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:08.876664 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fdb7c5-b3c7-4933-bd10-92f50221c812 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:08.889174 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b9b12-95a6-4a91-ac79-76c3a09ada46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:08.891901 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b9b12-95a6-4a91-ac79-76c3a09ada46 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:08.892454 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b9b12-95a6-4a91-ac79-76c3a09ada46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:08.893174 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b9b12-95a6-4a91-ac79-76c3a09ada46 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:08.894114 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b9b12-95a6-4a91-ac79-76c3a09ada46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:08.896158 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b9b12-95a6-4a91-ac79-76c3a09ada46 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:08.920627 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0800c8-9317-4dc6-bbef-50a406fd3d14 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:08.937229 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0800c8-9317-4dc6-bbef-50a406fd3d14 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:08.938128 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3336/6713] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:07:08.948424 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70be27b-fcd6-4db6-833f-ad70bbac6846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:08.949218 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70be27b-fcd6-4db6-833f-ad70bbac6846 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:08.949858 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70be27b-fcd6-4db6-833f-ad70bbac6846 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:08.949858 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70be27b-fcd6-4db6-833f-ad70bbac6846 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:08.951040 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70be27b-fcd6-4db6-833f-ad70bbac6846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:08.952884 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70be27b-fcd6-4db6-833f-ad70bbac6846 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:08.968423 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3378/6714] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:07:08.972998 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b9b12-95a6-4a91-ac79-76c3a09ada46 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:09.000467 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b9b12-95a6-4a91-ac79-76c3a09ada46 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:09.009530 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18544f2f-81e3-4380-b445-554177c04bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:09.010814 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18544f2f-81e3-4380-b445-554177c04bac admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:09.011205 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18544f2f-81e3-4380-b445-554177c04bac admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:09.011561 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18544f2f-81e3-4380-b445-554177c04bac admin admin] PATH_INFO: `/v3/projects/9ebe1fb74b794232876bf5ef3ed0a6df/users/50683344202f4fe3b6849feff2eae382/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:09.048736 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18544f2f-81e3-4380-b445-554177c04bac admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ebe1fb74b794232876bf5ef3ed0a6df, user_id=50683344202f4fe3b6849feff2eae382, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:09.055652 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18544f2f-81e3-4380-b445-554177c04bac admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:09.081472 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3337/6715] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:07:08 2022] PUT /identity/v3/projects/9ebe1fb74b794232876bf5ef3ed0a6df/users/50683344202f4fe3b6849feff2eae382/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:09.093662 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69201e31-013f-4441-a81f-d08dbd743e00 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:09.093662 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69201e31-013f-4441-a81f-d08dbd743e00 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:09.094192 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69201e31-013f-4441-a81f-d08dbd743e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:09.171259 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-69201e31-013f-4441-a81f-d08dbd743e00 None None] MFA Rules not processed for user `50683344202f4fe3b6849feff2eae382`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:09.176785 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-69201e31-013f-4441-a81f-d08dbd743e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:09.345893 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3379/6716] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:09 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:09.395408 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18544f2f-81e3-4380-b445-554177c04bac admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:09.397492 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-18544f2f-81e3-4380-b445-554177c04bac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:09.474216 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69201e31-013f-4441-a81f-d08dbd743e00 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:09.475963 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-69201e31-013f-4441-a81f-d08dbd743e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:09.517298 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18544f2f-81e3-4380-b445-554177c04bac admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:09.527088 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58070e90-8e92-41bd-87d6-6668a6846978 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:09.527803 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58070e90-8e92-41bd-87d6-6668a6846978 service cinder] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:09.528067 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58070e90-8e92-41bd-87d6-6668a6846978 service cinder] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:09.528450 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58070e90-8e92-41bd-87d6-6668a6846978 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:09.553226 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58070e90-8e92-41bd-87d6-6668a6846978 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:09.554886 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58070e90-8e92-41bd-87d6-6668a6846978 service cinder] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:09.577737 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3338/6717] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:07:09 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:07:09.595847 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58070e90-8e92-41bd-87d6-6668a6846978 service cinder] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:09.657919 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:09.678118 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69201e31-013f-4441-a81f-d08dbd743e00 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:09.692086 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaee2d7-c263-4575-afe2-b4e34dd1b4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:09.692784 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaee2d7-c263-4575-afe2-b4e34dd1b4a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:09.693065 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaee2d7-c263-4575-afe2-b4e34dd1b4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:09.693372 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaee2d7-c263-4575-afe2-b4e34dd1b4a1 admin admin] PATH_INFO: `/v3/projects/c1ce66b9a7e44e069c21082060dfdd36` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:09.695769 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaee2d7-c263-4575-afe2-b4e34dd1b4a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1ce66b9a7e44e069c21082060dfdd36)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:09.697701 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaee2d7-c263-4575-afe2-b4e34dd1b4a1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:09.720675 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:09.734608 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58070e90-8e92-41bd-87d6-6668a6846978 service cinder] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:09.749860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1bfd4c-2516-4e53-bf1d-abeeb7aeb8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:09.750887 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1bfd4c-2516-4e53-bf1d-abeeb7aeb8eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:09.751554 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1bfd4c-2516-4e53-bf1d-abeeb7aeb8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:09.752226 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1bfd4c-2516-4e53-bf1d-abeeb7aeb8eb admin admin] PATH_INFO: `/v3/users/50683344202f4fe3b6849feff2eae382` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:09.753755 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1bfd4c-2516-4e53-bf1d-abeeb7aeb8eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=50683344202f4fe3b6849feff2eae382)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:09.756061 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1bfd4c-2516-4e53-bf1d-abeeb7aeb8eb admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:09.807306 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1aaee2d7-c263-4575-afe2-b4e34dd1b4a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1ce66b9a7e44e069c21082060dfdd36', 'request_id': 'req-1aaee2d7-c263-4575-afe2-b4e34dd1b4a1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:09.821623 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1aaee2d7-c263-4575-afe2-b4e34dd1b4a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1ce66b9a7e44e069c21082060dfdd36', 'request_id': 'req-1aaee2d7-c263-4575-afe2-b4e34dd1b4a1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:09.831570 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1aaee2d7-c263-4575-afe2-b4e34dd1b4a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1ce66b9a7e44e069c21082060dfdd36', 'request_id': 'req-1aaee2d7-c263-4575-afe2-b4e34dd1b4a1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:09.856978 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1aaee2d7-c263-4575-afe2-b4e34dd1b4a1 admin admin] The token cache is being invalidate because project c1ce66b9a7e44e069c21082060dfdd36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:07:09.857731 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1aaee2d7-c263-4575-afe2-b4e34dd1b4a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:09.859412 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1aaee2d7-c263-4575-afe2-b4e34dd1b4a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:09.864546 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3380/6718] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:07:09 2022] DELETE /identity/v3/projects/c1ce66b9a7e44e069c21082060dfdd36 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:07:09.867600 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-de1bfd4c-2516-4e53-bf1d-abeeb7aeb8eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50683344202f4fe3b6849feff2eae382'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:09.868162 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaee2d7-c263-4575-afe2-b4e34dd1b4a1 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:09.868444 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-de1bfd4c-2516-4e53-bf1d-abeeb7aeb8eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50683344202f4fe3b6849feff2eae382'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:09.869710 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1aaee2d7-c263-4575-afe2-b4e34dd1b4a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:09.902161 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-de1bfd4c-2516-4e53-bf1d-abeeb7aeb8eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50683344202f4fe3b6849feff2eae382'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:09.924597 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-de1bfd4c-2516-4e53-bf1d-abeeb7aeb8eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50683344202f4fe3b6849feff2eae382'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:09.973185 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-de1bfd4c-2516-4e53-bf1d-abeeb7aeb8eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50683344202f4fe3b6849feff2eae382'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:10.020102 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3339/6719] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:07:09 2022] DELETE /identity/v3/users/50683344202f4fe3b6849feff2eae382 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:07:10.022953 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaee2d7-c263-4575-afe2-b4e34dd1b4a1 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:10.023352 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1bfd4c-2516-4e53-bf1d-abeeb7aeb8eb admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:10.030685 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-de1bfd4c-2516-4e53-bf1d-abeeb7aeb8eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:10.152328 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9c99e-9231-4a40-bc28-ebdcf553b8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:10.153733 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9c99e-9231-4a40-bc28-ebdcf553b8c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:10.154152 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9c99e-9231-4a40-bc28-ebdcf553b8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:10.154344 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9c99e-9231-4a40-bc28-ebdcf553b8c3 admin admin] PATH_INFO: `/v3/users/0f006fa88e2c4685b53a4297f55afc9d` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:10.157181 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e9c99e-9231-4a40-bc28-ebdcf553b8c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f006fa88e2c4685b53a4297f55afc9d)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:10.163126 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e9c99e-9231-4a40-bc28-ebdcf553b8c3 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:10.228372 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1bfd4c-2516-4e53-bf1d-abeeb7aeb8eb admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:10.248985 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc84e7-cfad-40ba-aa57-7f538536de20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:10.249644 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc84e7-cfad-40ba-aa57-7f538536de20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:10.249923 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc84e7-cfad-40ba-aa57-7f538536de20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:10.250199 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc84e7-cfad-40ba-aa57-7f538536de20 admin admin] PATH_INFO: `/v3/projects/b1a2ee2f75f040ee9749d4a73b4a141b` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:10.257536 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:10.259226 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bc84e7-cfad-40ba-aa57-7f538536de20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1a2ee2f75f040ee9749d4a73b4a141b)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:10.261155 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-80e9c99e-9231-4a40-bc28-ebdcf553b8c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f006fa88e2c4685b53a4297f55afc9d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:10.263795 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-80e9c99e-9231-4a40-bc28-ebdcf553b8c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f006fa88e2c4685b53a4297f55afc9d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:10.269694 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bc84e7-cfad-40ba-aa57-7f538536de20 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:10.280233 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-80e9c99e-9231-4a40-bc28-ebdcf553b8c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f006fa88e2c4685b53a4297f55afc9d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:10.299235 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-80e9c99e-9231-4a40-bc28-ebdcf553b8c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f006fa88e2c4685b53a4297f55afc9d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:10.300101 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-80e9c99e-9231-4a40-bc28-ebdcf553b8c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f006fa88e2c4685b53a4297f55afc9d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:10.333125 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3381/6720] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:07:09 2022] DELETE /identity/v3/users/0f006fa88e2c4685b53a4297f55afc9d => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:07:10.334420 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fa751-bf17-4888-a923-4a2d96c2eec6 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:10.334854 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fa751-bf17-4888-a923-4a2d96c2eec6 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:10.334960 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fa751-bf17-4888-a923-4a2d96c2eec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:10.402744 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-f51fa751-bf17-4888-a923-4a2d96c2eec6 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:10.406258 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f51fa751-bf17-4888-a923-4a2d96c2eec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:10.409529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-17bc84e7-cfad-40ba-aa57-7f538536de20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1a2ee2f75f040ee9749d4a73b4a141b', 'request_id': 'req-17bc84e7-cfad-40ba-aa57-7f538536de20'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:10.412275 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:10.427522 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-17bc84e7-cfad-40ba-aa57-7f538536de20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1a2ee2f75f040ee9749d4a73b4a141b', 'request_id': 'req-17bc84e7-cfad-40ba-aa57-7f538536de20'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:10.452127 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-17bc84e7-cfad-40ba-aa57-7f538536de20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1a2ee2f75f040ee9749d4a73b4a141b', 'request_id': 'req-17bc84e7-cfad-40ba-aa57-7f538536de20'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:10.479771 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-17bc84e7-cfad-40ba-aa57-7f538536de20 admin admin] The token cache is being invalidate because project b1a2ee2f75f040ee9749d4a73b4a141b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:07:10.481152 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-17bc84e7-cfad-40ba-aa57-7f538536de20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:10.484514 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-17bc84e7-cfad-40ba-aa57-7f538536de20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:10.492567 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3340/6721] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:07:10 2022] DELETE /identity/v3/projects/b1a2ee2f75f040ee9749d4a73b4a141b => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:10.494871 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc84e7-cfad-40ba-aa57-7f538536de20 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:10.498613 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-17bc84e7-cfad-40ba-aa57-7f538536de20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:10.589721 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3382/6722] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:10.665931 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc84e7-cfad-40ba-aa57-7f538536de20 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:10.676056 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04f1e1-1e7e-4d8d-a081-4a9cbaf8ce08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:10.676266 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51fa751-bf17-4888-a923-4a2d96c2eec6 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:10.678042 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04f1e1-1e7e-4d8d-a081-4a9cbaf8ce08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:10.678457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f51fa751-bf17-4888-a923-4a2d96c2eec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:10.679428 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04f1e1-1e7e-4d8d-a081-4a9cbaf8ce08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:10.680012 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04f1e1-1e7e-4d8d-a081-4a9cbaf8ce08 admin admin] PATH_INFO: `/v3/users/0b81d4201af142d597df3f7c7e93a36c` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:10.685091 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04f1e1-1e7e-4d8d-a081-4a9cbaf8ce08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b81d4201af142d597df3f7c7e93a36c)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:10.688106 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04f1e1-1e7e-4d8d-a081-4a9cbaf8ce08 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:10.819114 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ba04f1e1-1e7e-4d8d-a081-4a9cbaf8ce08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b81d4201af142d597df3f7c7e93a36c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:10.819969 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ba04f1e1-1e7e-4d8d-a081-4a9cbaf8ce08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b81d4201af142d597df3f7c7e93a36c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:10.869413 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ba04f1e1-1e7e-4d8d-a081-4a9cbaf8ce08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b81d4201af142d597df3f7c7e93a36c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:10.884021 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51fa751-bf17-4888-a923-4a2d96c2eec6 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:10.887189 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ba04f1e1-1e7e-4d8d-a081-4a9cbaf8ce08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b81d4201af142d597df3f7c7e93a36c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:10.906885 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c2659-6ab5-4766-aefc-45911767620d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:10.907550 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c2659-6ab5-4766-aefc-45911767620d service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:10.907828 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c2659-6ab5-4766-aefc-45911767620d service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:10.908096 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c2659-6ab5-4766-aefc-45911767620d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:10.915278 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ba04f1e1-1e7e-4d8d-a081-4a9cbaf8ce08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b81d4201af142d597df3f7c7e93a36c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:10.935775 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3341/6723] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:07:10 2022] DELETE /identity/v3/users/0b81d4201af142d597df3f7c7e93a36c => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:10.954802 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508c2659-6ab5-4766-aefc-45911767620d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:10.956802 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508c2659-6ab5-4766-aefc-45911767620d service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:10.973213 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3383/6724] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:07:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:07:11.870042 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04f1e1-1e7e-4d8d-a081-4a9cbaf8ce08 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:11.871748 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ba04f1e1-1e7e-4d8d-a081-4a9cbaf8ce08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:12.048540 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:12.052767 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04f1e1-1e7e-4d8d-a081-4a9cbaf8ce08 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:12.068359 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a67b7-3fe0-45e0-965d-7c56d928932d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:12.070746 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a67b7-3fe0-45e0-965d-7c56d928932d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:12.070746 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a67b7-3fe0-45e0-965d-7c56d928932d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:12.070746 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a67b7-3fe0-45e0-965d-7c56d928932d admin admin] PATH_INFO: `/v3/projects/0d28eab51ee34f2d9f685ba479a600d1` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:12.072857 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a67b7-3fe0-45e0-965d-7c56d928932d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d28eab51ee34f2d9f685ba479a600d1)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:12.074850 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a67b7-3fe0-45e0-965d-7c56d928932d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:12.184287 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-943a67b7-3fe0-45e0-965d-7c56d928932d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d28eab51ee34f2d9f685ba479a600d1', 'request_id': 'req-943a67b7-3fe0-45e0-965d-7c56d928932d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:12.200772 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-943a67b7-3fe0-45e0-965d-7c56d928932d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d28eab51ee34f2d9f685ba479a600d1', 'request_id': 'req-943a67b7-3fe0-45e0-965d-7c56d928932d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:12.216378 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-943a67b7-3fe0-45e0-965d-7c56d928932d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d28eab51ee34f2d9f685ba479a600d1', 'request_id': 'req-943a67b7-3fe0-45e0-965d-7c56d928932d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:12.241836 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-943a67b7-3fe0-45e0-965d-7c56d928932d admin admin] The token cache is being invalidate because project 0d28eab51ee34f2d9f685ba479a600d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:07:12.242140 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-943a67b7-3fe0-45e0-965d-7c56d928932d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:12.243127 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-943a67b7-3fe0-45e0-965d-7c56d928932d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:12.245912 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3342/6725] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:07:11 2022] DELETE /identity/v3/projects/0d28eab51ee34f2d9f685ba479a600d1 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:12.251449 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ad3d9-d896-462a-a2f1-f28cb2443bbb None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:12.251933 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ad3d9-d896-462a-a2f1-f28cb2443bbb None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:12.252182 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ad3d9-d896-462a-a2f1-f28cb2443bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:12.293713 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-0f7ad3d9-d896-462a-a2f1-f28cb2443bbb None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:12.299011 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0f7ad3d9-d896-462a-a2f1-f28cb2443bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:12.427931 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a67b7-3fe0-45e0-965d-7c56d928932d admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:12.430259 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-943a67b7-3fe0-45e0-965d-7c56d928932d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:12.546856 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3384/6726] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:07:12.548414 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc9ff7-3be6-4c62-a4e1-e42f9697e71f None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:12.548711 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc9ff7-3be6-4c62-a4e1-e42f9697e71f None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:12.548978 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc9ff7-3be6-4c62-a4e1-e42f9697e71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:12.573847 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:12.586493 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-ffdc9ff7-3be6-4c62-a4e1-e42f9697e71f None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:12.589505 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ffdc9ff7-3be6-4c62-a4e1-e42f9697e71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:12.611282 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3385/6727] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:07:12.612669 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc9ff7-3be6-4c62-a4e1-e42f9697e71f None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:12.614420 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ffdc9ff7-3be6-4c62-a4e1-e42f9697e71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:12.640724 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc9ff7-3be6-4c62-a4e1-e42f9697e71f None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:12.647333 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7f49e-f84e-4693-8b5f-1fe5fe668afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:12.648046 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7f49e-f84e-4693-8b5f-1fe5fe668afa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:12.648739 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7f49e-f84e-4693-8b5f-1fe5fe668afa admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:12.648739 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7f49e-f84e-4693-8b5f-1fe5fe668afa admin admin] PATH_INFO: `/v3/users/4de4105e1d104fd3a2301272eadb7d57` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:12.649932 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd7f49e-f84e-4693-8b5f-1fe5fe668afa admin admin] RBAC: Authorizing `identity:delete_user(user_id=4de4105e1d104fd3a2301272eadb7d57)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:12.653018 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd7f49e-f84e-4693-8b5f-1fe5fe668afa admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:12.673503 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a67b7-3fe0-45e0-965d-7c56d928932d admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:12.687905 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e256b7c5-fae5-4f8a-904c-5957bbce4247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:12.689622 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256b7c5-fae5-4f8a-904c-5957bbce4247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:12.690736 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256b7c5-fae5-4f8a-904c-5957bbce4247 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:12.694361 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256b7c5-fae5-4f8a-904c-5957bbce4247 admin admin] PATH_INFO: `/v3/projects/50535a5bc11144b7a5d31c7b5967ae6c` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:12.713156 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e256b7c5-fae5-4f8a-904c-5957bbce4247 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50535a5bc11144b7a5d31c7b5967ae6c)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:12.716513 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e256b7c5-fae5-4f8a-904c-5957bbce4247 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:12.728569 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5cd7f49e-f84e-4693-8b5f-1fe5fe668afa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4de4105e1d104fd3a2301272eadb7d57'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:12.729291 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5cd7f49e-f84e-4693-8b5f-1fe5fe668afa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4de4105e1d104fd3a2301272eadb7d57'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:12.744553 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5cd7f49e-f84e-4693-8b5f-1fe5fe668afa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4de4105e1d104fd3a2301272eadb7d57'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:12.761103 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5cd7f49e-f84e-4693-8b5f-1fe5fe668afa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4de4105e1d104fd3a2301272eadb7d57'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:12.762047 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5cd7f49e-f84e-4693-8b5f-1fe5fe668afa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4de4105e1d104fd3a2301272eadb7d57'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:12.801188 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3386/6728] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:07:12 2022] DELETE /identity/v3/users/4de4105e1d104fd3a2301272eadb7d57 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:12.802497 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7f49e-f84e-4693-8b5f-1fe5fe668afa admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:12.804310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5cd7f49e-f84e-4693-8b5f-1fe5fe668afa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:12.823796 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e256b7c5-fae5-4f8a-904c-5957bbce4247 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50535a5bc11144b7a5d31c7b5967ae6c', 'request_id': 'req-e256b7c5-fae5-4f8a-904c-5957bbce4247'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:12.844299 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e256b7c5-fae5-4f8a-904c-5957bbce4247 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50535a5bc11144b7a5d31c7b5967ae6c', 'request_id': 'req-e256b7c5-fae5-4f8a-904c-5957bbce4247'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:12.858576 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e256b7c5-fae5-4f8a-904c-5957bbce4247 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50535a5bc11144b7a5d31c7b5967ae6c', 'request_id': 'req-e256b7c5-fae5-4f8a-904c-5957bbce4247'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:12.878145 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e256b7c5-fae5-4f8a-904c-5957bbce4247 admin admin] The token cache is being invalidate because project 50535a5bc11144b7a5d31c7b5967ae6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:07:12.878701 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e256b7c5-fae5-4f8a-904c-5957bbce4247 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:12.883382 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e256b7c5-fae5-4f8a-904c-5957bbce4247 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:12.888643 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3343/6729] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:07:12 2022] DELETE /identity/v3/projects/50535a5bc11144b7a5d31c7b5967ae6c => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:12.892764 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6245210-0b5f-41a9-a5c7-8e34936f6e19 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:12.895085 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6245210-0b5f-41a9-a5c7-8e34936f6e19 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:12.895932 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6245210-0b5f-41a9-a5c7-8e34936f6e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:12.971229 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-a6245210-0b5f-41a9-a5c7-8e34936f6e19 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:12.975494 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a6245210-0b5f-41a9-a5c7-8e34936f6e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:13.021363 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:13.081781 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7f49e-f84e-4693-8b5f-1fe5fe668afa admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:13.118065 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e947b6-8b51-470d-b2b8-63c58ea71db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:13.118716 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e947b6-8b51-470d-b2b8-63c58ea71db7 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:13.118997 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e947b6-8b51-470d-b2b8-63c58ea71db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:13.119300 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e947b6-8b51-470d-b2b8-63c58ea71db7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:13.119980 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e947b6-8b51-470d-b2b8-63c58ea71db7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:07:13.120284 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e947b6-8b51-470d-b2b8-63c58ea71db7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:13.122514 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e947b6-8b51-470d-b2b8-63c58ea71db7 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:13.179710 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3387/6730] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:07:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:07:13.188670 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c920d-cec6-43d5-a92e-a1b18a963344 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:13.191314 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c920d-cec6-43d5-a92e-a1b18a963344 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:13.192018 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c920d-cec6-43d5-a92e-a1b18a963344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:13.205481 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3344/6731] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:13.206633 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6245210-0b5f-41a9-a5c7-8e34936f6e19 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:13.211301 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a6245210-0b5f-41a9-a5c7-8e34936f6e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:13.244199 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6245210-0b5f-41a9-a5c7-8e34936f6e19 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:13.255073 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-6d6c920d-cec6-43d5-a92e-a1b18a963344 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:13.255619 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7495662d-6262-4c13-a42c-411d5ded2cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:13.256033 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495662d-6262-4c13-a42c-411d5ded2cba admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:13.256318 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495662d-6262-4c13-a42c-411d5ded2cba admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:13.256590 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495662d-6262-4c13-a42c-411d5ded2cba admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:13.257249 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7495662d-6262-4c13-a42c-411d5ded2cba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:13.259259 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6d6c920d-cec6-43d5-a92e-a1b18a963344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:13.259407 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7495662d-6262-4c13-a42c-411d5ded2cba admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:13.291096 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3388/6732] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:13.293630 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c920d-cec6-43d5-a92e-a1b18a963344 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:13.303049 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6d6c920d-cec6-43d5-a92e-a1b18a963344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:13.323549 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3345/6733] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:07:13 2022] POST /identity/v3/projects => generated 367 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:07:13.325518 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904b1a7-ac1f-4344-bffc-8145f7078373 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:13.326410 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904b1a7-ac1f-4344-bffc-8145f7078373 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:13.326898 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904b1a7-ac1f-4344-bffc-8145f7078373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:13.384330 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-0904b1a7-ac1f-4344-bffc-8145f7078373 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:13.385880 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0904b1a7-ac1f-4344-bffc-8145f7078373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:13.488014 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3346/6734] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:13.489388 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904b1a7-ac1f-4344-bffc-8145f7078373 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:13.502357 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904b1a7-ac1f-4344-bffc-8145f7078373 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:13.508399 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a716a-4b11-4581-91ea-e1e82467d201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:13.509258 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a716a-4b11-4581-91ea-e1e82467d201 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:13.509615 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c920d-cec6-43d5-a92e-a1b18a963344 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:13.509972 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a716a-4b11-4581-91ea-e1e82467d201 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:13.510586 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a716a-4b11-4581-91ea-e1e82467d201 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:13.511575 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1a716a-4b11-4581-91ea-e1e82467d201 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:13.513752 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1a716a-4b11-4581-91ea-e1e82467d201 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:13.541846 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3347/6735] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:07:13 2022] POST /identity/v3/users => generated 284 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:07:13.543582 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a716a-4b11-4581-91ea-e1e82467d201 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:13.547096 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-fe1a716a-4b11-4581-91ea-e1e82467d201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:13.560513 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:13.565812 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a716a-4b11-4581-91ea-e1e82467d201 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:13.573726 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c806c6d-9baa-4cb9-974d-1caf94db87f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:13.576026 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c806c6d-9baa-4cb9-974d-1caf94db87f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:13.577136 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c806c6d-9baa-4cb9-974d-1caf94db87f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:13.577730 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c806c6d-9baa-4cb9-974d-1caf94db87f3 admin admin] PATH_INFO: `/v3/projects/9ebe1fb74b794232876bf5ef3ed0a6df` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:13.580565 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c806c6d-9baa-4cb9-974d-1caf94db87f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ebe1fb74b794232876bf5ef3ed0a6df)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:13.583699 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c806c6d-9baa-4cb9-974d-1caf94db87f3 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:13.674957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3c806c6d-9baa-4cb9-974d-1caf94db87f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ebe1fb74b794232876bf5ef3ed0a6df', 'request_id': 'req-3c806c6d-9baa-4cb9-974d-1caf94db87f3'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:13.692910 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3c806c6d-9baa-4cb9-974d-1caf94db87f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ebe1fb74b794232876bf5ef3ed0a6df', 'request_id': 'req-3c806c6d-9baa-4cb9-974d-1caf94db87f3'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:13.694155 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b920e7-92de-48c2-a738-b8862e41cb59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:13.695252 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b920e7-92de-48c2-a738-b8862e41cb59 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:13.695766 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b920e7-92de-48c2-a738-b8862e41cb59 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:13.696603 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b920e7-92de-48c2-a738-b8862e41cb59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:13.715039 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3c806c6d-9baa-4cb9-974d-1caf94db87f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ebe1fb74b794232876bf5ef3ed0a6df', 'request_id': 'req-3c806c6d-9baa-4cb9-974d-1caf94db87f3'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:13.724132 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b920e7-92de-48c2-a738-b8862e41cb59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:13.725947 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b920e7-92de-48c2-a738-b8862e41cb59 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:13.734280 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3c806c6d-9baa-4cb9-974d-1caf94db87f3 admin admin] The token cache is being invalidate because project 9ebe1fb74b794232876bf5ef3ed0a6df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:07:13.734575 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3c806c6d-9baa-4cb9-974d-1caf94db87f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:13.735411 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3c806c6d-9baa-4cb9-974d-1caf94db87f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:13.744815 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3348/6736] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:07:13 2022] DELETE /identity/v3/projects/9ebe1fb74b794232876bf5ef3ed0a6df => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:13.745782 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c806c6d-9baa-4cb9-974d-1caf94db87f3 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:13.747798 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3c806c6d-9baa-4cb9-974d-1caf94db87f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:13.753945 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3389/6737] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:07:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:07:13.754747 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b920e7-92de-48c2-a738-b8862e41cb59 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:13.757668 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:13.768982 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b920e7-92de-48c2-a738-b8862e41cb59 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:13.887667 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c806c6d-9baa-4cb9-974d-1caf94db87f3 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:13.912580 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23f7b0-fbe6-4d0a-9856-cb275c6019bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:13.913229 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23f7b0-fbe6-4d0a-9856-cb275c6019bd admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:13.913509 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23f7b0-fbe6-4d0a-9856-cb275c6019bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:13.913780 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23f7b0-fbe6-4d0a-9856-cb275c6019bd admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:13.914451 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da23f7b0-fbe6-4d0a-9856-cb275c6019bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:07:13.914769 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da23f7b0-fbe6-4d0a-9856-cb275c6019bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:13.916428 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da23f7b0-fbe6-4d0a-9856-cb275c6019bd admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:13.930252 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e41ad5-9936-4e54-be19-196e9267a8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:13.930986 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e41ad5-9936-4e54-be19-196e9267a8da admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:13.931429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e41ad5-9936-4e54-be19-196e9267a8da admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:13.931707 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e41ad5-9936-4e54-be19-196e9267a8da admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:13.934311 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e41ad5-9936-4e54-be19-196e9267a8da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:13.936070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e41ad5-9936-4e54-be19-196e9267a8da admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:13.956004 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3349/6738] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:07:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:07:13.956721 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc850d-2a02-4190-96a2-698daf10a9a8 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:13.956950 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc850d-2a02-4190-96a2-698daf10a9a8 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:13.957231 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc850d-2a02-4190-96a2-698daf10a9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:13.969299 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3390/6739] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:07:13 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:07:13.970560 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e41ad5-9936-4e54-be19-196e9267a8da admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:13.983859 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e41ad5-9936-4e54-be19-196e9267a8da admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:13.995801 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe91470-f5d9-4b93-a5bd-90f0e22a1186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:13.996641 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe91470-f5d9-4b93-a5bd-90f0e22a1186 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:13.997623 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe91470-f5d9-4b93-a5bd-90f0e22a1186 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:13.997974 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe91470-f5d9-4b93-a5bd-90f0e22a1186 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:13.998706 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe91470-f5d9-4b93-a5bd-90f0e22a1186 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:14.001832 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-6bbc850d-2a02-4190-96a2-698daf10a9a8 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:14.003090 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6bbc850d-2a02-4190-96a2-698daf10a9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:14.003934 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe91470-f5d9-4b93-a5bd-90f0e22a1186 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:14.029832 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3350/6740] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:14.030731 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc850d-2a02-4190-96a2-698daf10a9a8 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:14.032122 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6bbc850d-2a02-4190-96a2-698daf10a9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:14.059075 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc850d-2a02-4190-96a2-698daf10a9a8 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:14.083982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd137d-8444-49c1-9fea-8ffeace785d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:14.088441 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd137d-8444-49c1-9fea-8ffeace785d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:14.088441 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd137d-8444-49c1-9fea-8ffeace785d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:14.088441 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd137d-8444-49c1-9fea-8ffeace785d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:14.088441 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd137d-8444-49c1-9fea-8ffeace785d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:14.089291 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3391/6741] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:07:13 2022] POST /identity/v3/projects => generated 387 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:07:14.091055 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74578ce6-8e9a-4abe-871b-f50c746c7434 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:14.092699 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74578ce6-8e9a-4abe-871b-f50c746c7434 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:14.092958 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd137d-8444-49c1-9fea-8ffeace785d5 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:14.093583 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74578ce6-8e9a-4abe-871b-f50c746c7434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:14.141844 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-74578ce6-8e9a-4abe-871b-f50c746c7434 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:14.143450 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3351/6742] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:07:14.143846 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-74578ce6-8e9a-4abe-871b-f50c746c7434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:14.144409 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd137d-8444-49c1-9fea-8ffeace785d5 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:14.172071 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd137d-8444-49c1-9fea-8ffeace785d5 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:14.321380 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3392/6743] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:14.325769 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74578ce6-8e9a-4abe-871b-f50c746c7434 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:14.344505 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0149cd-69bb-4111-a06d-3a90072fb704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:14.344986 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0149cd-69bb-4111-a06d-3a90072fb704 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:14.345265 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0149cd-69bb-4111-a06d-3a90072fb704 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:14.345573 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0149cd-69bb-4111-a06d-3a90072fb704 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:14.346255 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0149cd-69bb-4111-a06d-3a90072fb704 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:14.348471 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0149cd-69bb-4111-a06d-3a90072fb704 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:14.348776 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74578ce6-8e9a-4abe-871b-f50c746c7434 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:14.364491 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf285166-a57b-4ba5-bb74-6bfec38f6d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:14.365338 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf285166-a57b-4ba5-bb74-6bfec38f6d41 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:14.365709 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf285166-a57b-4ba5-bb74-6bfec38f6d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:14.366078 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf285166-a57b-4ba5-bb74-6bfec38f6d41 admin admin] PATH_INFO: `/v3/projects/1837c79cf5ca4709916154fb31c69780/users/2b8da415f02a44e588d739f130fb83cd/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:14.398166 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3352/6744] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:07:14 2022] POST /identity/v3/users => generated 300 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:07:14.399990 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0149cd-69bb-4111-a06d-3a90072fb704 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:14.402596 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf285166-a57b-4ba5-bb74-6bfec38f6d41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1837c79cf5ca4709916154fb31c69780, user_id=2b8da415f02a44e588d739f130fb83cd, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:14.405764 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf285166-a57b-4ba5-bb74-6bfec38f6d41 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:14.413463 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0149cd-69bb-4111-a06d-3a90072fb704 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:14.422164 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08264b-35ab-4671-ad2c-8641755f7221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:14.422857 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08264b-35ab-4671-ad2c-8641755f7221 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:14.423310 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08264b-35ab-4671-ad2c-8641755f7221 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:14.423659 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08264b-35ab-4671-ad2c-8641755f7221 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:14.424752 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b08264b-35ab-4671-ad2c-8641755f7221 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:07:14.425459 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b08264b-35ab-4671-ad2c-8641755f7221 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:14.428381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b08264b-35ab-4671-ad2c-8641755f7221 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:14.430857 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3393/6745] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:07:14 2022] PUT /identity/v3/projects/1837c79cf5ca4709916154fb31c69780/users/2b8da415f02a44e588d739f130fb83cd/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:14.441131 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf285166-a57b-4ba5-bb74-6bfec38f6d41 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:14.452653 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3353/6746] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:07:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:07:14.452653 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78fe86e-241e-4483-b32e-7f4099f7ea66 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:14.452653 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78fe86e-241e-4483-b32e-7f4099f7ea66 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:14.452653 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78fe86e-241e-4483-b32e-7f4099f7ea66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:14.462263 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:14.522912 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-c78fe86e-241e-4483-b32e-7f4099f7ea66 None None] MFA Rules not processed for user `2b8da415f02a44e588d739f130fb83cd`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:14.523845 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c78fe86e-241e-4483-b32e-7f4099f7ea66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:14.582810 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf285166-a57b-4ba5-bb74-6bfec38f6d41 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:14.594428 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1227726-e3eb-4e85-ac0e-d5dd1a8c2f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:14.594791 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1227726-e3eb-4e85-ac0e-d5dd1a8c2f20 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:14.595193 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1227726-e3eb-4e85-ac0e-d5dd1a8c2f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:14.595567 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1227726-e3eb-4e85-ac0e-d5dd1a8c2f20 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:14.596312 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1227726-e3eb-4e85-ac0e-d5dd1a8c2f20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:14.598027 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1227726-e3eb-4e85-ac0e-d5dd1a8c2f20 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:14.618662 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3394/6747] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:07:14.624743 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1227726-e3eb-4e85-ac0e-d5dd1a8c2f20 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:14.628434 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:14.644428 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1227726-e3eb-4e85-ac0e-d5dd1a8c2f20 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:14.675847 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75391237-3b6f-4560-99b4-ac777cc37be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:14.677098 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75391237-3b6f-4560-99b4-ac777cc37be6 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:14.677481 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75391237-3b6f-4560-99b4-ac777cc37be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:14.677864 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75391237-3b6f-4560-99b4-ac777cc37be6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:14.678658 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75391237-3b6f-4560-99b4-ac777cc37be6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:14.686503 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75391237-3b6f-4560-99b4-ac777cc37be6 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:14.708604 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3354/6748] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:14.712293 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78fe86e-241e-4483-b32e-7f4099f7ea66 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:14.747918 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78fe86e-241e-4483-b32e-7f4099f7ea66 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:14.767857 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa778bf-7e65-4a17-ae55-b4617800373c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:14.770186 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa778bf-7e65-4a17-ae55-b4617800373c admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:14.770649 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa778bf-7e65-4a17-ae55-b4617800373c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:14.771277 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa778bf-7e65-4a17-ae55-b4617800373c admin admin] PATH_INFO: `/v3/projects/4436a4c623f640f6a131f04e37d21d33/users/2cbb0dfa113a41a1927c3c11783f4622/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:14.778447 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3395/6749] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:07:14 2022] POST /identity/v3/projects => generated 373 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:07:14.778447 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75391237-3b6f-4560-99b4-ac777cc37be6 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:14.817614 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa778bf-7e65-4a17-ae55-b4617800373c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4436a4c623f640f6a131f04e37d21d33, user_id=2cbb0dfa113a41a1927c3c11783f4622, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:14.825752 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa778bf-7e65-4a17-ae55-b4617800373c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:14.850662 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3355/6750] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:07:14 2022] PUT /identity/v3/projects/4436a4c623f640f6a131f04e37d21d33/users/2cbb0dfa113a41a1927c3c11783f4622/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:14.851741 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa778bf-7e65-4a17-ae55-b4617800373c admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:14.927843 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa778bf-7e65-4a17-ae55-b4617800373c admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:14.938353 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e38f3-8fc1-4ea5-8f6b-a6217b128909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:14.939417 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e38f3-8fc1-4ea5-8f6b-a6217b128909 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:14.940034 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e38f3-8fc1-4ea5-8f6b-a6217b128909 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:14.940623 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e38f3-8fc1-4ea5-8f6b-a6217b128909 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:14.941432 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e38f3-8fc1-4ea5-8f6b-a6217b128909 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:14.943464 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e38f3-8fc1-4ea5-8f6b-a6217b128909 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:14.944893 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75391237-3b6f-4560-99b4-ac777cc37be6 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:14.951385 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385075c4-ea3e-4ce6-adc1-07e87b6da096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:14.952771 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385075c4-ea3e-4ce6-adc1-07e87b6da096 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:14.953338 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385075c4-ea3e-4ce6-adc1-07e87b6da096 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:14.954186 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385075c4-ea3e-4ce6-adc1-07e87b6da096 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:14.955836 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385075c4-ea3e-4ce6-adc1-07e87b6da096 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:14.958747 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385075c4-ea3e-4ce6-adc1-07e87b6da096 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:15.014637 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3356/6751] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:07:14 2022] POST /identity/v3/users => generated 287 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:07:15.014637 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e38f3-8fc1-4ea5-8f6b-a6217b128909 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:15.023104 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3396/6752] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:07:14 2022] POST /identity/v3/projects => generated 369 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:07:15.024380 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385075c4-ea3e-4ce6-adc1-07e87b6da096 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:15.036160 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e38f3-8fc1-4ea5-8f6b-a6217b128909 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:15.161666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ecefe7-85a6-4e04-82e3-66a094358bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:15.162978 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ecefe7-85a6-4e04-82e3-66a094358bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:15.163296 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ecefe7-85a6-4e04-82e3-66a094358bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:15.163604 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ecefe7-85a6-4e04-82e3-66a094358bc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:15.164281 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ecefe7-85a6-4e04-82e3-66a094358bc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:15.166084 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ecefe7-85a6-4e04-82e3-66a094358bc0 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:15.173307 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385075c4-ea3e-4ce6-adc1-07e87b6da096 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:15.181650 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3357/6753] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:07:15.182801 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ecefe7-85a6-4e04-82e3-66a094358bc0 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:15.190974 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1eff24-6efe-4a79-ba84-cb0b20addbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:15.191909 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1eff24-6efe-4a79-ba84-cb0b20addbfe admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:15.192287 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1eff24-6efe-4a79-ba84-cb0b20addbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:15.192651 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1eff24-6efe-4a79-ba84-cb0b20addbfe admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:15.193407 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1eff24-6efe-4a79-ba84-cb0b20addbfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:15.194840 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ecefe7-85a6-4e04-82e3-66a094358bc0 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:15.197546 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1eff24-6efe-4a79-ba84-cb0b20addbfe admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:15.211319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab7d484-6f52-4766-a6d1-728a28474819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:15.212097 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7d484-6f52-4766-a6d1-728a28474819 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:15.212387 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7d484-6f52-4766-a6d1-728a28474819 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:15.212667 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7d484-6f52-4766-a6d1-728a28474819 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:15.213329 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab7d484-6f52-4766-a6d1-728a28474819 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:15.224088 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab7d484-6f52-4766-a6d1-728a28474819 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:15.224998 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3397/6754] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:07:15.225934 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1eff24-6efe-4a79-ba84-cb0b20addbfe admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:15.241225 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:15.254081 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1eff24-6efe-4a79-ba84-cb0b20addbfe admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:15.262191 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f786eb-15b9-49b3-9934-a866bdce8f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:15.263916 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f786eb-15b9-49b3-9934-a866bdce8f97 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:15.264267 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f786eb-15b9-49b3-9934-a866bdce8f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:15.264549 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f786eb-15b9-49b3-9934-a866bdce8f97 admin admin] PATH_INFO: `/v3/projects/4436a4c623f640f6a131f04e37d21d33/users/2cbb0dfa113a41a1927c3c11783f4622/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:15.269162 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f786eb-15b9-49b3-9934-a866bdce8f97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4436a4c623f640f6a131f04e37d21d33, user_id=2cbb0dfa113a41a1927c3c11783f4622, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:15.272742 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3358/6755] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:07:15 2022] POST /identity/v3/users => generated 285 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:07:15.274022 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab7d484-6f52-4766-a6d1-728a28474819 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:15.274865 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f786eb-15b9-49b3-9934-a866bdce8f97 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:15.312803 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab7d484-6f52-4766-a6d1-728a28474819 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:15.332480 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3398/6756] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:07:15 2022] PUT /identity/v3/projects/4436a4c623f640f6a131f04e37d21d33/users/2cbb0dfa113a41a1927c3c11783f4622/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:15.333381 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f786eb-15b9-49b3-9934-a866bdce8f97 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:15.385667 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:15.482274 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7daf78-4475-4005-9db0-05a9660644a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:15.482935 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7daf78-4475-4005-9db0-05a9660644a8 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:15.483244 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7daf78-4475-4005-9db0-05a9660644a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:15.483520 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7daf78-4475-4005-9db0-05a9660644a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:15.484195 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7daf78-4475-4005-9db0-05a9660644a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:15.486575 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7daf78-4475-4005-9db0-05a9660644a8 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:15.531932 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f786eb-15b9-49b3-9934-a866bdce8f97 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:15.532984 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3359/6757] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:07:15.535472 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271891d-ac39-445b-a426-319d56cff3c4 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:15.535770 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271891d-ac39-445b-a426-319d56cff3c4 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:15.536051 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271891d-ac39-445b-a426-319d56cff3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:15.553084 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5a8a8-689b-4e48-aa75-75dca41da82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:15.556305 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5a8a8-689b-4e48-aa75-75dca41da82c admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:15.556504 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5a8a8-689b-4e48-aa75-75dca41da82c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:15.556787 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5a8a8-689b-4e48-aa75-75dca41da82c admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:15.557459 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc5a8a8-689b-4e48-aa75-75dca41da82c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:15.565153 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc5a8a8-689b-4e48-aa75-75dca41da82c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:15.595598 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3399/6758] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:07:15.597612 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5a8a8-689b-4e48-aa75-75dca41da82c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:15.639128 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-5271891d-ac39-445b-a426-319d56cff3c4 None None] MFA Rules not processed for user `2cbb0dfa113a41a1927c3c11783f4622`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:15.641633 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5271891d-ac39-445b-a426-319d56cff3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:15.645779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5a8a8-689b-4e48-aa75-75dca41da82c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:15.658924 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5ef45-3da4-4741-8328-4622695a55c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:15.660619 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5ef45-3da4-4741-8328-4622695a55c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:15.661087 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5ef45-3da4-4741-8328-4622695a55c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:15.661609 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5ef45-3da4-4741-8328-4622695a55c0 admin admin] PATH_INFO: `/v3/projects/bfb86016fdd84306b2cc2c7bfead6767/users/0ddc065817da47d79059d7eef4e08d8c/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:15.714094 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b5ef45-3da4-4741-8328-4622695a55c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfb86016fdd84306b2cc2c7bfead6767, user_id=0ddc065817da47d79059d7eef4e08d8c, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:15.719995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b5ef45-3da4-4741-8328-4622695a55c0 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:15.766239 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3400/6759] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:07:15 2022] PUT /identity/v3/projects/bfb86016fdd84306b2cc2c7bfead6767/users/0ddc065817da47d79059d7eef4e08d8c/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:15.769584 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5ef45-3da4-4741-8328-4622695a55c0 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:15.875382 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3360/6760] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:15 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:15.879729 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271891d-ac39-445b-a426-319d56cff3c4 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:15.883567 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5271891d-ac39-445b-a426-319d56cff3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:15.948478 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271891d-ac39-445b-a426-319d56cff3c4 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:16.007998 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5ef45-3da4-4741-8328-4622695a55c0 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:16.035706 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e72da-d37c-4315-af62-63349f3fdc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:16.038512 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e72da-d37c-4315-af62-63349f3fdc2c admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:16.042938 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e72da-d37c-4315-af62-63349f3fdc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:16.043581 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e72da-d37c-4315-af62-63349f3fdc2c admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:16.045567 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71e72da-d37c-4315-af62-63349f3fdc2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:16.047533 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71e72da-d37c-4315-af62-63349f3fdc2c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:16.079200 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a4275c-307a-4a98-9d76-678d5491e4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:16.086101 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4275c-307a-4a98-9d76-678d5491e4c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:16.087755 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4275c-307a-4a98-9d76-678d5491e4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:16.088863 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4275c-307a-4a98-9d76-678d5491e4c1 admin admin] PATH_INFO: `/v3/projects/3e18c8f49fef4b79b9b9dfa05bec73a0` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:16.091750 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a4275c-307a-4a98-9d76-678d5491e4c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e18c8f49fef4b79b9b9dfa05bec73a0)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:16.094152 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a4275c-307a-4a98-9d76-678d5491e4c1 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:16.103495 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3401/6761] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:07:16.104935 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2ade4-3192-49b8-ba8b-b22f5814a602 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:16.105220 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2ade4-3192-49b8-ba8b-b22f5814a602 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:16.105499 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2ade4-3192-49b8-ba8b-b22f5814a602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:16.206918 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-68a4275c-307a-4a98-9d76-678d5491e4c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e18c8f49fef4b79b9b9dfa05bec73a0', 'request_id': 'req-68a4275c-307a-4a98-9d76-678d5491e4c1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:16.213159 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:16.227851 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-85a2ade4-3192-49b8-ba8b-b22f5814a602 None None] MFA Rules not processed for user `0ddc065817da47d79059d7eef4e08d8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:16.229089 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-85a2ade4-3192-49b8-ba8b-b22f5814a602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:16.235930 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-68a4275c-307a-4a98-9d76-678d5491e4c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e18c8f49fef4b79b9b9dfa05bec73a0', 'request_id': 'req-68a4275c-307a-4a98-9d76-678d5491e4c1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:16.253053 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-68a4275c-307a-4a98-9d76-678d5491e4c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e18c8f49fef4b79b9b9dfa05bec73a0', 'request_id': 'req-68a4275c-307a-4a98-9d76-678d5491e4c1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:16.284995 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-68a4275c-307a-4a98-9d76-678d5491e4c1 admin admin] The token cache is being invalidate because project 3e18c8f49fef4b79b9b9dfa05bec73a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:07:16.285368 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-68a4275c-307a-4a98-9d76-678d5491e4c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:16.288165 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-68a4275c-307a-4a98-9d76-678d5491e4c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:16.299420 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3361/6762] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:07:15 2022] DELETE /identity/v3/projects/3e18c8f49fef4b79b9b9dfa05bec73a0 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:16.301253 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a4275c-307a-4a98-9d76-678d5491e4c1 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:16.307753 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-68a4275c-307a-4a98-9d76-678d5491e4c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:16.337527 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:16.393951 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3402/6763] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:16.397820 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2ade4-3192-49b8-ba8b-b22f5814a602 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:16.401112 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-85a2ade4-3192-49b8-ba8b-b22f5814a602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:16.473507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a4275c-307a-4a98-9d76-678d5491e4c1 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:16.489036 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4345a4d-0244-447c-8c82-fd2765475a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:16.489856 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4345a4d-0244-447c-8c82-fd2765475a22 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:16.490132 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4345a4d-0244-447c-8c82-fd2765475a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:16.490404 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4345a4d-0244-447c-8c82-fd2765475a22 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:16.491428 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4345a4d-0244-447c-8c82-fd2765475a22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:16.499811 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4345a4d-0244-447c-8c82-fd2765475a22 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:16.574509 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3362/6764] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:07:16 2022] POST /identity/v3/projects => generated 387 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:07:16.576846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597db47c-9db6-4b91-9bf2-058986552eaf None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:16.577135 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597db47c-9db6-4b91-9bf2-058986552eaf None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:16.577409 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597db47c-9db6-4b91-9bf2-058986552eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:16.592643 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2ade4-3192-49b8-ba8b-b22f5814a602 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:16.620195 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-597db47c-9db6-4b91-9bf2-058986552eaf None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:16.622355 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-597db47c-9db6-4b91-9bf2-058986552eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:16.737960 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d88ff2d-07e0-44a8-92b9-403c919eb86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:16.744196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88ff2d-07e0-44a8-92b9-403c919eb86b admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:16.744196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88ff2d-07e0-44a8-92b9-403c919eb86b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:16.744196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88ff2d-07e0-44a8-92b9-403c919eb86b admin admin] PATH_INFO: `/v3/projects/83e2d558961340dca3c746902df4b689/users/917ab155f59d4e689ebd897be85d7ab2/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:16.775411 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d88ff2d-07e0-44a8-92b9-403c919eb86b admin admin] RBAC: Authorizing `identity:create_grant(project_id=83e2d558961340dca3c746902df4b689, user_id=917ab155f59d4e689ebd897be85d7ab2, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:16.783082 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d88ff2d-07e0-44a8-92b9-403c919eb86b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:16.783320 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3363/6765] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:16.791483 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597db47c-9db6-4b91-9bf2-058986552eaf None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:16.796440 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-597db47c-9db6-4b91-9bf2-058986552eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:16.805358 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3403/6766] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:07:16 2022] PUT /identity/v3/projects/83e2d558961340dca3c746902df4b689/users/917ab155f59d4e689ebd897be85d7ab2/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:16.806882 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371b427-a4d9-4ac0-bad4-55009455caa6 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:16.807279 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371b427-a4d9-4ac0-bad4-55009455caa6 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:16.807632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371b427-a4d9-4ac0-bad4-55009455caa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:16.827731 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597db47c-9db6-4b91-9bf2-058986552eaf None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:16.874074 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-6371b427-a4d9-4ac0-bad4-55009455caa6 None None] MFA Rules not processed for user `a6b9bb23a4604eaabd5ba85cec428e4b`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:16.875559 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6371b427-a4d9-4ac0-bad4-55009455caa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:16.993529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e2c6e-73c6-4045-b844-aaa3b512299f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:16.994831 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e2c6e-73c6-4045-b844-aaa3b512299f admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:16.995467 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e2c6e-73c6-4045-b844-aaa3b512299f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:16.995928 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e2c6e-73c6-4045-b844-aaa3b512299f admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:16.996907 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e2c6e-73c6-4045-b844-aaa3b512299f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:16.999172 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e2c6e-73c6-4045-b844-aaa3b512299f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:17.014160 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:17.040999 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3404/6767] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:16 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:17.042037 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371b427-a4d9-4ac0-bad4-55009455caa6 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:17.057860 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3364/6768] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:07:16 2022] POST /identity/v3/projects => generated 373 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:07:17.060067 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7600c-c6cd-4548-ba30-67ef9cefc05f None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:17.061532 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7600c-c6cd-4548-ba30-67ef9cefc05f None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:17.062084 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7600c-c6cd-4548-ba30-67ef9cefc05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:17.069224 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371b427-a4d9-4ac0-bad4-55009455caa6 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:17.074901 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:17.108026 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-8ef7600c-c6cd-4548-ba30-67ef9cefc05f None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:17.109680 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8ef7600c-c6cd-4548-ba30-67ef9cefc05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:17.189281 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027cb12e-7fa5-48f8-b7e3-511e67453161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:17.190080 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cb12e-7fa5-48f8-b7e3-511e67453161 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:17.190358 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cb12e-7fa5-48f8-b7e3-511e67453161 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:17.190626 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cb12e-7fa5-48f8-b7e3-511e67453161 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:17.192180 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027cb12e-7fa5-48f8-b7e3-511e67453161 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:17.196762 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027cb12e-7fa5-48f8-b7e3-511e67453161 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:17.242194 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3405/6769] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:07:17 2022] POST /identity/v3/users => generated 294 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:07:17.243364 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbccac17-c0d3-4d75-8833-dd159a028d8d None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:17.243967 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbccac17-c0d3-4d75-8833-dd159a028d8d None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:17.246066 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbccac17-c0d3-4d75-8833-dd159a028d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:17.290732 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3365/6770] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:17.292298 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31a133-9fdc-432f-9443-1cb812c023f4 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:17.292916 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31a133-9fdc-432f-9443-1cb812c023f4 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:17.293134 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31a133-9fdc-432f-9443-1cb812c023f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:17.296697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-dbccac17-c0d3-4d75-8833-dd159a028d8d None None] MFA Rules not processed for user `917ab155f59d4e689ebd897be85d7ab2`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:17.300776 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-dbccac17-c0d3-4d75-8833-dd159a028d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:17.329777 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-ab31a133-9fdc-432f-9443-1cb812c023f4 None None] MFA Rules not processed for user `4bb54ce3cfac4eb7b9095f3733745cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:17.331074 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ab31a133-9fdc-432f-9443-1cb812c023f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:17.460015 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3406/6771] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:17.460884 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbccac17-c0d3-4d75-8833-dd159a028d8d None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:17.469850 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3366/6772] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:17 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:17.471521 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31a133-9fdc-432f-9443-1cb812c023f4 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:17.499808 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbccac17-c0d3-4d75-8833-dd159a028d8d None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:17.504526 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31a133-9fdc-432f-9443-1cb812c023f4 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:17.509473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cad2cf-ba90-4426-bb8b-baa01d9c0cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:17.509938 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cad2cf-ba90-4426-bb8b-baa01d9c0cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:17.510216 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cad2cf-ba90-4426-bb8b-baa01d9c0cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:17.510487 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cad2cf-ba90-4426-bb8b-baa01d9c0cb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:17.511168 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cad2cf-ba90-4426-bb8b-baa01d9c0cb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:17.512856 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cad2cf-ba90-4426-bb8b-baa01d9c0cb2 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:17.514585 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876000e0-a79a-4186-a1cb-596ad52298ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:17.515420 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876000e0-a79a-4186-a1cb-596ad52298ba admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:17.515420 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876000e0-a79a-4186-a1cb-596ad52298ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:17.515666 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876000e0-a79a-4186-a1cb-596ad52298ba admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:17.516282 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876000e0-a79a-4186-a1cb-596ad52298ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:17.518197 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876000e0-a79a-4186-a1cb-596ad52298ba admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:17.553835 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3367/6773] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:07:17.554851 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cad2cf-ba90-4426-bb8b-baa01d9c0cb2 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:17.562039 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3407/6774] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:07:17 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:07:17.562921 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876000e0-a79a-4186-a1cb-596ad52298ba admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:17.565864 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-876000e0-a79a-4186-a1cb-596ad52298ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:17.571194 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cad2cf-ba90-4426-bb8b-baa01d9c0cb2 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:17.583871 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff959dd2-e1ea-4cce-8c85-975f4b774b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:17.584506 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff959dd2-e1ea-4cce-8c85-975f4b774b76 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:17.584789 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff959dd2-e1ea-4cce-8c85-975f4b774b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:17.585063 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff959dd2-e1ea-4cce-8c85-975f4b774b76 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:17.585829 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff959dd2-e1ea-4cce-8c85-975f4b774b76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:07:17.586140 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff959dd2-e1ea-4cce-8c85-975f4b774b76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:17.587815 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff959dd2-e1ea-4cce-8c85-975f4b774b76 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:17.630213 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3368/6775] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:07:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:07:17.631211 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff959dd2-e1ea-4cce-8c85-975f4b774b76 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:17.639482 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ff959dd2-e1ea-4cce-8c85-975f4b774b76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:17.692462 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876000e0-a79a-4186-a1cb-596ad52298ba admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:17.697372 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d40171-9189-47f3-8576-2c59d0327050 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6b0f9835ed549cab91d684326be83fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:17.697995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d40171-9189-47f3-8576-2c59d0327050 service glance] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:17.698276 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d40171-9189-47f3-8576-2c59d0327050 service glance] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:17.698548 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d40171-9189-47f3-8576-2c59d0327050 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:17.708698 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-60d40171-9189-47f3-8576-2c59d0327050 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:17.755589 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:17.793007 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d40171-9189-47f3-8576-2c59d0327050 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:17.795074 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d40171-9189-47f3-8576-2c59d0327050 service glance] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:17.814657 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3408/6776] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:07:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:07:17.815703 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d40171-9189-47f3-8576-2c59d0327050 service glance] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:17.818070 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:17.840112 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d40171-9189-47f3-8576-2c59d0327050 service glance] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:17.852240 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff959dd2-e1ea-4cce-8c85-975f4b774b76 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:17.856686 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82948dc-14ce-4fc8-b957-c93b90ed0ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:17.857321 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82948dc-14ce-4fc8-b957-c93b90ed0ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:17.857593 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82948dc-14ce-4fc8-b957-c93b90ed0ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:17.857856 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82948dc-14ce-4fc8-b957-c93b90ed0ce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:17.858499 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82948dc-14ce-4fc8-b957-c93b90ed0ce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:17.860140 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82948dc-14ce-4fc8-b957-c93b90ed0ce9 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:17.864941 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f0d90-437f-47b3-a776-0ea07ad4336c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:17.865577 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f0d90-437f-47b3-a776-0ea07ad4336c service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:17.865860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f0d90-437f-47b3-a776-0ea07ad4336c service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:17.866158 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f0d90-437f-47b3-a776-0ea07ad4336c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:17.871054 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-049f0d90-437f-47b3-a776-0ea07ad4336c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:17.880020 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3409/6777] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:07:17.881064 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82948dc-14ce-4fc8-b957-c93b90ed0ce9 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:17.899893 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f0d90-437f-47b3-a776-0ea07ad4336c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:17.901521 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f0d90-437f-47b3-a776-0ea07ad4336c service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:17.907581 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82948dc-14ce-4fc8-b957-c93b90ed0ce9 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:17.926011 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3369/6778] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:07:17 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:07:17.926523 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01336799-3282-4a14-a04e-47db125f3551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:17.927223 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01336799-3282-4a14-a04e-47db125f3551 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:17.927521 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01336799-3282-4a14-a04e-47db125f3551 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:17.927787 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01336799-3282-4a14-a04e-47db125f3551 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:17.928165 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f0d90-437f-47b3-a776-0ea07ad4336c service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:17.928428 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01336799-3282-4a14-a04e-47db125f3551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:17.930037 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01336799-3282-4a14-a04e-47db125f3551 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:17.943157 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f0d90-437f-47b3-a776-0ea07ad4336c service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:17.949612 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdfdc99-ad5d-4004-ac50-996433a74766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:17.951082 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfdc99-ad5d-4004-ac50-996433a74766 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:17.951665 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfdc99-ad5d-4004-ac50-996433a74766 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:17.951871 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3410/6779] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:07:17.952374 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfdc99-ad5d-4004-ac50-996433a74766 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:17.952728 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01336799-3282-4a14-a04e-47db125f3551 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:17.953461 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdfdc99-ad5d-4004-ac50-996433a74766 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:17.969372 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdfdc99-ad5d-4004-ac50-996433a74766 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:17.987427 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01336799-3282-4a14-a04e-47db125f3551 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:17.997728 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cad438-da03-42d0-9766-97ea31dd18de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:17.998745 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cad438-da03-42d0-9766-97ea31dd18de admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:17.999296 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cad438-da03-42d0-9766-97ea31dd18de admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:17.999727 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cad438-da03-42d0-9766-97ea31dd18de admin admin] PATH_INFO: `/v3/projects/4dc5f7b5a089450b85f9935d9dfc4ff9/users/8173ad759e3a4abc851191866d9220be/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:18.018606 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cad438-da03-42d0-9766-97ea31dd18de admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dc5f7b5a089450b85f9935d9dfc4ff9, user_id=8173ad759e3a4abc851191866d9220be, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:18.021897 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cad438-da03-42d0-9766-97ea31dd18de admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:18.038897 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3370/6780] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:07:17 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:07:18.038897 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdfdc99-ad5d-4004-ac50-996433a74766 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:18.041215 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3411/6781] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:07:17 2022] PUT /identity/v3/projects/4dc5f7b5a089450b85f9935d9dfc4ff9/users/8173ad759e3a4abc851191866d9220be/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:18.050884 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cad438-da03-42d0-9766-97ea31dd18de admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:18.223103 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cad438-da03-42d0-9766-97ea31dd18de admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:18.241823 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8837c-dba1-4427-868e-d3fed77f40ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:18.243376 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8837c-dba1-4427-868e-d3fed77f40ff admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:18.243765 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8837c-dba1-4427-868e-d3fed77f40ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:18.244196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8837c-dba1-4427-868e-d3fed77f40ff admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:18.244563 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdfdc99-ad5d-4004-ac50-996433a74766 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:18.245045 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed8837c-dba1-4427-868e-d3fed77f40ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:18.248856 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed8837c-dba1-4427-868e-d3fed77f40ff admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:18.255425 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb47705-fb75-4f2d-8a93-a90de89369eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:18.256274 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb47705-fb75-4f2d-8a93-a90de89369eb admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:18.256558 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb47705-fb75-4f2d-8a93-a90de89369eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:18.256838 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb47705-fb75-4f2d-8a93-a90de89369eb admin admin] PATH_INFO: `/v3/projects/baf63a7690a4456c995c4ba09887913c/users/e878b6aa483f4696ad6f4262a1f01375/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:18.296547 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3412/6782] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:07:18 2022] POST /identity/v3/users => generated 292 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:07:18.300379 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb47705-fb75-4f2d-8a93-a90de89369eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=baf63a7690a4456c995c4ba09887913c, user_id=e878b6aa483f4696ad6f4262a1f01375, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:18.302508 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfab624-b353-42af-824a-0ac1a3123883 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:18.303234 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfab624-b353-42af-824a-0ac1a3123883 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:18.304782 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfab624-b353-42af-824a-0ac1a3123883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:18.308982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb47705-fb75-4f2d-8a93-a90de89369eb admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:18.345633 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3371/6783] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:07:18 2022] PUT /identity/v3/projects/baf63a7690a4456c995c4ba09887913c/users/e878b6aa483f4696ad6f4262a1f01375/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:18.347675 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb47705-fb75-4f2d-8a93-a90de89369eb admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:18.380051 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-8cfab624-b353-42af-824a-0ac1a3123883 None None] MFA Rules not processed for user `8173ad759e3a4abc851191866d9220be`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:18.383648 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8cfab624-b353-42af-824a-0ac1a3123883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:18.517199 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb47705-fb75-4f2d-8a93-a90de89369eb admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:18.531866 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5b9cd-3649-4c44-aa1b-f9ec65a18dbe service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6b0f9835ed549cab91d684326be83fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:18.532530 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5b9cd-3649-4c44-aa1b-f9ec65a18dbe service glance] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:18.532815 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5b9cd-3649-4c44-aa1b-f9ec65a18dbe service glance] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:18.533100 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5b9cd-3649-4c44-aa1b-f9ec65a18dbe service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:18.599233 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:18.632054 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3413/6784] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:18.633709 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfab624-b353-42af-824a-0ac1a3123883 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:18.705753 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a5b9cd-3649-4c44-aa1b-f9ec65a18dbe service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:18.707216 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a5b9cd-3649-4c44-aa1b-f9ec65a18dbe service glance] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:18.735986 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3372/6785] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:07:18 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:07:18.739212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5b9cd-3649-4c44-aa1b-f9ec65a18dbe service glance] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:18.750771 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:18.893380 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfab624-b353-42af-824a-0ac1a3123883 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:18.905528 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e5306-048f-4f53-a2d4-53d0aa348aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:18.907639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e5306-048f-4f53-a2d4-53d0aa348aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:18.908812 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e5306-048f-4f53-a2d4-53d0aa348aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:18.909714 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e5306-048f-4f53-a2d4-53d0aa348aa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:18.911642 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e5306-048f-4f53-a2d4-53d0aa348aa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:18.915388 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e5306-048f-4f53-a2d4-53d0aa348aa7 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:18.960151 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3414/6786] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:07:18.962829 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e5306-048f-4f53-a2d4-53d0aa348aa7 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:18.970897 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0f2e5306-048f-4f53-a2d4-53d0aa348aa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:18.985335 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5b9cd-3649-4c44-aa1b-f9ec65a18dbe service glance] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:19.017297 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e21ff-5761-481c-9548-e8600a091df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:19.017945 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e21ff-5761-481c-9548-e8600a091df9 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:19.018231 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e21ff-5761-481c-9548-e8600a091df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:19.018507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e21ff-5761-481c-9548-e8600a091df9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:19.019202 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e21ff-5761-481c-9548-e8600a091df9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:19.027319 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e5306-048f-4f53-a2d4-53d0aa348aa7 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:19.029693 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e21ff-5761-481c-9548-e8600a091df9 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:19.037104 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2508b7-2d52-49ee-9255-9b1ec064bb6a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6b0f9835ed549cab91d684326be83fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:19.037980 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2508b7-2d52-49ee-9255-9b1ec064bb6a service glance] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:19.038494 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2508b7-2d52-49ee-9255-9b1ec064bb6a service glance] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:19.039134 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2508b7-2d52-49ee-9255-9b1ec064bb6a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:19.044918 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ce2508b7-2d52-49ee-9255-9b1ec064bb6a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:19.067702 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3373/6787] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:07:19.077055 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e21ff-5761-481c-9548-e8600a091df9 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:19.116224 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e21ff-5761-481c-9548-e8600a091df9 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:19.132838 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1578b-1b0a-46ba-98c7-6e202f4f294e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:19.133566 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1578b-1b0a-46ba-98c7-6e202f4f294e admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:19.133862 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1578b-1b0a-46ba-98c7-6e202f4f294e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:19.134146 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1578b-1b0a-46ba-98c7-6e202f4f294e admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:19.135418 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad1578b-1b0a-46ba-98c7-6e202f4f294e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:19.137237 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad1578b-1b0a-46ba-98c7-6e202f4f294e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:19.166997 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3374/6788] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:07:19.166997 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1578b-1b0a-46ba-98c7-6e202f4f294e admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:19.188419 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1578b-1b0a-46ba-98c7-6e202f4f294e admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:19.199649 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b73b89c-abe3-49d0-914b-2587ca7c2941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:19.200656 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73b89c-abe3-49d0-914b-2587ca7c2941 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:19.200969 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73b89c-abe3-49d0-914b-2587ca7c2941 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:19.201326 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73b89c-abe3-49d0-914b-2587ca7c2941 admin admin] PATH_INFO: `/v3/projects/baf63a7690a4456c995c4ba09887913c/users/e878b6aa483f4696ad6f4262a1f01375/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:19.211229 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b73b89c-abe3-49d0-914b-2587ca7c2941 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baf63a7690a4456c995c4ba09887913c, user_id=e878b6aa483f4696ad6f4262a1f01375, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:19.214143 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b73b89c-abe3-49d0-914b-2587ca7c2941 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:19.243446 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3375/6789] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:07:19 2022] PUT /identity/v3/projects/baf63a7690a4456c995c4ba09887913c/users/e878b6aa483f4696ad6f4262a1f01375/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:19.245238 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b73b89c-abe3-49d0-914b-2587ca7c2941 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:19.327123 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2508b7-2d52-49ee-9255-9b1ec064bb6a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:19.337472 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2508b7-2d52-49ee-9255-9b1ec064bb6a service glance] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:19.381281 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3415/6790] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:07:18 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:07:19.384900 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e54380-26d5-4386-94a7-d71332a854a3 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:19.387259 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e54380-26d5-4386-94a7-d71332a854a3 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:19.390522 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e54380-26d5-4386-94a7-d71332a854a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:19.415442 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b73b89c-abe3-49d0-914b-2587ca7c2941 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:19.428642 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a4f37f-b3fd-4670-b18d-ea6586905294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:19.429814 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4f37f-b3fd-4670-b18d-ea6586905294 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:19.430289 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4f37f-b3fd-4670-b18d-ea6586905294 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:19.432471 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4f37f-b3fd-4670-b18d-ea6586905294 admin admin] PATH_INFO: `/v3/projects/7b07be353bbc481cbd35a4304501c57e/users/35cca2c3486c4389a04f6a20b8d567e9/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:19.472694 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-01e54380-26d5-4386-94a7-d71332a854a3 None None] MFA Rules not processed for user `e878b6aa483f4696ad6f4262a1f01375`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:19.474415 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-01e54380-26d5-4386-94a7-d71332a854a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:19.492084 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a4f37f-b3fd-4670-b18d-ea6586905294 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b07be353bbc481cbd35a4304501c57e, user_id=35cca2c3486c4389a04f6a20b8d567e9, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:19.518521 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a4f37f-b3fd-4670-b18d-ea6586905294 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:19.563544 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3376/6791] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:07:19 2022] PUT /identity/v3/projects/7b07be353bbc481cbd35a4304501c57e/users/35cca2c3486c4389a04f6a20b8d567e9/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:19.571413 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1d6a2-b5f9-4dbf-9a91-e17ac6672a84 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:19.571930 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1d6a2-b5f9-4dbf-9a91-e17ac6672a84 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:19.573421 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1d6a2-b5f9-4dbf-9a91-e17ac6672a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:19.674508 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-85d1d6a2-b5f9-4dbf-9a91-e17ac6672a84 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:19.676268 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-85d1d6a2-b5f9-4dbf-9a91-e17ac6672a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:19.742200 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3416/6792] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:19.757798 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e54380-26d5-4386-94a7-d71332a854a3 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:19.767947 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-01e54380-26d5-4386-94a7-d71332a854a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:19.818464 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:19.868553 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:19.916396 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3377/6793] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:19.933346 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1d6a2-b5f9-4dbf-9a91-e17ac6672a84 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:19.938310 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-85d1d6a2-b5f9-4dbf-9a91-e17ac6672a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:19.982988 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e54380-26d5-4386-94a7-d71332a854a3 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:20.202950 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1d6a2-b5f9-4dbf-9a91-e17ac6672a84 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:20.218865 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdbd3ee-feaa-4421-92e2-30e374413fa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:20.219677 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdbd3ee-feaa-4421-92e2-30e374413fa1 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:20.224592 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdbd3ee-feaa-4421-92e2-30e374413fa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:20.226726 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdbd3ee-feaa-4421-92e2-30e374413fa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:20.230875 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c96c7-d9dd-4e48-a194-8a5652015822 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:20.235664 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c96c7-d9dd-4e48-a194-8a5652015822 service cinder] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:20.235952 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c96c7-d9dd-4e48-a194-8a5652015822 service cinder] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:20.236230 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c96c7-d9dd-4e48-a194-8a5652015822 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:20.260115 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdbd3ee-feaa-4421-92e2-30e374413fa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:20.270805 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdbd3ee-feaa-4421-92e2-30e374413fa1 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:20.326871 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3378/6794] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:07:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:07:20.527483 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998c96c7-d9dd-4e48-a194-8a5652015822 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:20.533596 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998c96c7-d9dd-4e48-a194-8a5652015822 service cinder] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:20.557881 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3417/6795] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:07:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 802 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:07:21.133889 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdbd3ee-feaa-4421-92e2-30e374413fa1 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:21.150590 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdbd3ee-feaa-4421-92e2-30e374413fa1 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:21.177158 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e88935f-0984-42ef-815c-9bccbf0c9d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:21.177903 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88935f-0984-42ef-815c-9bccbf0c9d25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:21.178292 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88935f-0984-42ef-815c-9bccbf0c9d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:21.178658 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88935f-0984-42ef-815c-9bccbf0c9d25 admin admin] PATH_INFO: `/v3/users/2cbb0dfa113a41a1927c3c11783f4622` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:21.180298 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e88935f-0984-42ef-815c-9bccbf0c9d25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cbb0dfa113a41a1927c3c11783f4622)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:21.183319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e88935f-0984-42ef-815c-9bccbf0c9d25 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:21.280547 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1e88935f-0984-42ef-815c-9bccbf0c9d25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cbb0dfa113a41a1927c3c11783f4622'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:21.282188 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1e88935f-0984-42ef-815c-9bccbf0c9d25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cbb0dfa113a41a1927c3c11783f4622'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:21.305571 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1e88935f-0984-42ef-815c-9bccbf0c9d25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cbb0dfa113a41a1927c3c11783f4622'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:21.321686 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1e88935f-0984-42ef-815c-9bccbf0c9d25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cbb0dfa113a41a1927c3c11783f4622'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:21.337372 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1e88935f-0984-42ef-815c-9bccbf0c9d25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cbb0dfa113a41a1927c3c11783f4622'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:21.348012 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3379/6796] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:07:21 2022] DELETE /identity/v3/users/2cbb0dfa113a41a1927c3c11783f4622 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:21.352713 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71305ee1-9b83-43c0-9f84-2b75bea33ea6 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:21.353260 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71305ee1-9b83-43c0-9f84-2b75bea33ea6 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:21.353260 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71305ee1-9b83-43c0-9f84-2b75bea33ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:21.432771 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-71305ee1-9b83-43c0-9f84-2b75bea33ea6 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:21.434007 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-71305ee1-9b83-43c0-9f84-2b75bea33ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:21.639560 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3418/6797] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:21.676650 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e88935f-0984-42ef-815c-9bccbf0c9d25 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:21.678279 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1e88935f-0984-42ef-815c-9bccbf0c9d25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:21.895896 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e88935f-0984-42ef-815c-9bccbf0c9d25 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:21.905308 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d5e45-cda3-467c-ba83-2146e38a3ff9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:21.908273 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d5e45-cda3-467c-ba83-2146e38a3ff9 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:21.908909 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d5e45-cda3-467c-ba83-2146e38a3ff9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:21.909412 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d5e45-cda3-467c-ba83-2146e38a3ff9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:21.934123 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d5e45-cda3-467c-ba83-2146e38a3ff9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:21.936315 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d5e45-cda3-467c-ba83-2146e38a3ff9 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:21.985510 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3380/6798] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:07:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:07:22.248034 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71305ee1-9b83-43c0-9f84-2b75bea33ea6 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:22.249510 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-71305ee1-9b83-43c0-9f84-2b75bea33ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:22.276568 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71305ee1-9b83-43c0-9f84-2b75bea33ea6 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:22.302919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a374a-63c5-437c-8735-e1776f9de753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:22.303795 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a374a-63c5-437c-8735-e1776f9de753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:22.304077 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a374a-63c5-437c-8735-e1776f9de753 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:22.304344 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a374a-63c5-437c-8735-e1776f9de753 admin admin] PATH_INFO: `/v3/users/2b8da415f02a44e588d739f130fb83cd` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:22.310437 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a374a-63c5-437c-8735-e1776f9de753 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b8da415f02a44e588d739f130fb83cd)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:22.321028 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a374a-63c5-437c-8735-e1776f9de753 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:22.376158 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:22.436800 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2b6a374a-63c5-437c-8735-e1776f9de753 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b8da415f02a44e588d739f130fb83cd'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:22.437625 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2b6a374a-63c5-437c-8735-e1776f9de753 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b8da415f02a44e588d739f130fb83cd'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:22.473116 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2b6a374a-63c5-437c-8735-e1776f9de753 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b8da415f02a44e588d739f130fb83cd'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:22.496480 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2b6a374a-63c5-437c-8735-e1776f9de753 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b8da415f02a44e588d739f130fb83cd'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:22.498013 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2b6a374a-63c5-437c-8735-e1776f9de753 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b8da415f02a44e588d739f130fb83cd'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:22.591321 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3419/6799] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:07:22 2022] DELETE /identity/v3/users/2b8da415f02a44e588d739f130fb83cd => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:22.596585 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca92da5-7413-4dde-9a31-e101ce7957e4 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:22.597117 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca92da5-7413-4dde-9a31-e101ce7957e4 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:22.597117 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca92da5-7413-4dde-9a31-e101ce7957e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:22.638461 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-bca92da5-7413-4dde-9a31-e101ce7957e4 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:22.639925 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-bca92da5-7413-4dde-9a31-e101ce7957e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:22.664398 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:22.763656 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3381/6800] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:07:22.813712 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a374a-63c5-437c-8735-e1776f9de753 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:22.815200 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2b6a374a-63c5-437c-8735-e1776f9de753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:22.985527 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a374a-63c5-437c-8735-e1776f9de753 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:22.990364 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66530203-bad0-4f1a-add5-68f370d9072a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:22.991616 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66530203-bad0-4f1a-add5-68f370d9072a service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:22.992110 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66530203-bad0-4f1a-add5-68f370d9072a service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:22.992589 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66530203-bad0-4f1a-add5-68f370d9072a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:23.019624 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66530203-bad0-4f1a-add5-68f370d9072a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:23.021540 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66530203-bad0-4f1a-add5-68f370d9072a service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:23.065893 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3420/6801] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:07:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:07:24.663334 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9482b-4ac2-40d6-abbc-97536867a49b None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:24.663935 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9482b-4ac2-40d6-abbc-97536867a49b None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:24.663935 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9482b-4ac2-40d6-abbc-97536867a49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:24.705630 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-45a9482b-4ac2-40d6-abbc-97536867a49b None None] MFA Rules not processed for user `e1ce5d3d668743d5b8843936f77c0150`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:24.712484 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-45a9482b-4ac2-40d6-abbc-97536867a49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:24.726174 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66530203-bad0-4f1a-add5-68f370d9072a service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:24.727775 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-66530203-bad0-4f1a-add5-68f370d9072a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:24.754453 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66530203-bad0-4f1a-add5-68f370d9072a service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:24.773079 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362bda9-b129-433d-8deb-8222c911aace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:24.773718 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362bda9-b129-433d-8deb-8222c911aace admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:24.774204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362bda9-b129-433d-8deb-8222c911aace admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:24.774640 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362bda9-b129-433d-8deb-8222c911aace admin admin] PATH_INFO: `/v3/projects/1837c79cf5ca4709916154fb31c69780` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:24.777859 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0362bda9-b129-433d-8deb-8222c911aace admin admin] RBAC: Authorizing `identity:delete_project(project_id=1837c79cf5ca4709916154fb31c69780)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:24.808896 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0362bda9-b129-433d-8deb-8222c911aace admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:24.937330 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3382/6802] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:24.939948 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9482b-4ac2-40d6-abbc-97536867a49b None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:24.945268 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-45a9482b-4ac2-40d6-abbc-97536867a49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:24.981902 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9482b-4ac2-40d6-abbc-97536867a49b None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:25.053352 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0362bda9-b129-433d-8deb-8222c911aace admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1837c79cf5ca4709916154fb31c69780', 'request_id': 'req-0362bda9-b129-433d-8deb-8222c911aace'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:25.113254 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0362bda9-b129-433d-8deb-8222c911aace admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1837c79cf5ca4709916154fb31c69780', 'request_id': 'req-0362bda9-b129-433d-8deb-8222c911aace'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:25.124702 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0362bda9-b129-433d-8deb-8222c911aace admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1837c79cf5ca4709916154fb31c69780', 'request_id': 'req-0362bda9-b129-433d-8deb-8222c911aace'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:25.159952 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea6547-a211-4da2-9af9-dcabdd70353e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:25.160841 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea6547-a211-4da2-9af9-dcabdd70353e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:25.161126 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea6547-a211-4da2-9af9-dcabdd70353e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:25.161593 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea6547-a211-4da2-9af9-dcabdd70353e admin admin] PATH_INFO: `/v3/projects/4436a4c623f640f6a131f04e37d21d33` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:25.166577 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea6547-a211-4da2-9af9-dcabdd70353e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4436a4c623f640f6a131f04e37d21d33)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:25.168913 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea6547-a211-4da2-9af9-dcabdd70353e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:25.174620 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0362bda9-b129-433d-8deb-8222c911aace admin admin] The token cache is being invalidate because project 1837c79cf5ca4709916154fb31c69780 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:07:25.178197 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0362bda9-b129-433d-8deb-8222c911aace admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:25.183976 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0362bda9-b129-433d-8deb-8222c911aace admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:25.187363 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3421/6803] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:07:24 2022] DELETE /identity/v3/projects/1837c79cf5ca4709916154fb31c69780 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:25.191476 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362bda9-b129-433d-8deb-8222c911aace admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:25.193226 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0362bda9-b129-433d-8deb-8222c911aace admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:25.215944 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362bda9-b129-433d-8deb-8222c911aace admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:25.222862 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12777d1a-57ff-489a-bd1b-08ccb11a1763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:25.225743 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12777d1a-57ff-489a-bd1b-08ccb11a1763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:25.227643 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12777d1a-57ff-489a-bd1b-08ccb11a1763 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:25.228169 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12777d1a-57ff-489a-bd1b-08ccb11a1763 admin admin] PATH_INFO: `/v3/users/917ab155f59d4e689ebd897be85d7ab2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:25.237122 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12777d1a-57ff-489a-bd1b-08ccb11a1763 admin admin] RBAC: Authorizing `identity:delete_user(user_id=917ab155f59d4e689ebd897be85d7ab2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:25.241245 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12777d1a-57ff-489a-bd1b-08ccb11a1763 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:25.281534 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:25.310348 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7bea6547-a211-4da2-9af9-dcabdd70353e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4436a4c623f640f6a131f04e37d21d33', 'request_id': 'req-7bea6547-a211-4da2-9af9-dcabdd70353e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:25.318492 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:25.324845 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7bea6547-a211-4da2-9af9-dcabdd70353e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4436a4c623f640f6a131f04e37d21d33', 'request_id': 'req-7bea6547-a211-4da2-9af9-dcabdd70353e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:25.339348 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7bea6547-a211-4da2-9af9-dcabdd70353e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4436a4c623f640f6a131f04e37d21d33', 'request_id': 'req-7bea6547-a211-4da2-9af9-dcabdd70353e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:25.354867 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-12777d1a-57ff-489a-bd1b-08ccb11a1763 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '917ab155f59d4e689ebd897be85d7ab2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:25.359640 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7bea6547-a211-4da2-9af9-dcabdd70353e admin admin] The token cache is being invalidate because project 4436a4c623f640f6a131f04e37d21d33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:07:25.360010 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-12777d1a-57ff-489a-bd1b-08ccb11a1763 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '917ab155f59d4e689ebd897be85d7ab2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:25.360167 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7bea6547-a211-4da2-9af9-dcabdd70353e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:25.360921 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7bea6547-a211-4da2-9af9-dcabdd70353e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:25.364428 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3383/6804] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:07:24 2022] DELETE /identity/v3/projects/4436a4c623f640f6a131f04e37d21d33 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:25.368388 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea6547-a211-4da2-9af9-dcabdd70353e admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:25.370516 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7bea6547-a211-4da2-9af9-dcabdd70353e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:25.376234 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-12777d1a-57ff-489a-bd1b-08ccb11a1763 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '917ab155f59d4e689ebd897be85d7ab2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:25.387249 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-12777d1a-57ff-489a-bd1b-08ccb11a1763 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '917ab155f59d4e689ebd897be85d7ab2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:25.389285 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-12777d1a-57ff-489a-bd1b-08ccb11a1763 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '917ab155f59d4e689ebd897be85d7ab2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:25.415584 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3422/6805] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:07:25 2022] DELETE /identity/v3/users/917ab155f59d4e689ebd897be85d7ab2 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:25.487464 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea6547-a211-4da2-9af9-dcabdd70353e admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:25.642337 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91199c94-4845-4899-921a-1531a5fb82c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:25.643428 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91199c94-4845-4899-921a-1531a5fb82c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:25.643774 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91199c94-4845-4899-921a-1531a5fb82c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:25.644110 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91199c94-4845-4899-921a-1531a5fb82c0 admin admin] PATH_INFO: `/v3/users/8173ad759e3a4abc851191866d9220be` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:25.645412 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91199c94-4845-4899-921a-1531a5fb82c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8173ad759e3a4abc851191866d9220be)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:25.647799 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91199c94-4845-4899-921a-1531a5fb82c0 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:25.753608 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-91199c94-4845-4899-921a-1531a5fb82c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8173ad759e3a4abc851191866d9220be'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:25.754846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-91199c94-4845-4899-921a-1531a5fb82c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8173ad759e3a4abc851191866d9220be'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:25.791316 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-91199c94-4845-4899-921a-1531a5fb82c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8173ad759e3a4abc851191866d9220be'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:25.830610 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-91199c94-4845-4899-921a-1531a5fb82c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8173ad759e3a4abc851191866d9220be'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:25.847758 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-91199c94-4845-4899-921a-1531a5fb82c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8173ad759e3a4abc851191866d9220be'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:25.864372 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3384/6806] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:07:25 2022] DELETE /identity/v3/users/8173ad759e3a4abc851191866d9220be => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:28.089159 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12777d1a-57ff-489a-bd1b-08ccb11a1763 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:28.091286 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-12777d1a-57ff-489a-bd1b-08ccb11a1763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:28.126320 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12777d1a-57ff-489a-bd1b-08ccb11a1763 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:28.311750 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d060a3f-90cd-436b-adf0-b3d2811b93d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:28.312044 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d060a3f-90cd-436b-adf0-b3d2811b93d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:28.312329 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d060a3f-90cd-436b-adf0-b3d2811b93d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:28.312601 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d060a3f-90cd-436b-adf0-b3d2811b93d5 admin admin] PATH_INFO: `/v3/projects/83e2d558961340dca3c746902df4b689` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:28.315823 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d060a3f-90cd-436b-adf0-b3d2811b93d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83e2d558961340dca3c746902df4b689)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:28.317812 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d060a3f-90cd-436b-adf0-b3d2811b93d5 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:28.446415 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1d060a3f-90cd-436b-adf0-b3d2811b93d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83e2d558961340dca3c746902df4b689', 'request_id': 'req-1d060a3f-90cd-436b-adf0-b3d2811b93d5'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:28.461007 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1d060a3f-90cd-436b-adf0-b3d2811b93d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83e2d558961340dca3c746902df4b689', 'request_id': 'req-1d060a3f-90cd-436b-adf0-b3d2811b93d5'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:28.474893 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1d060a3f-90cd-436b-adf0-b3d2811b93d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83e2d558961340dca3c746902df4b689', 'request_id': 'req-1d060a3f-90cd-436b-adf0-b3d2811b93d5'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:28.507987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1d060a3f-90cd-436b-adf0-b3d2811b93d5 admin admin] The token cache is being invalidate because project 83e2d558961340dca3c746902df4b689 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:07:28.508293 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1d060a3f-90cd-436b-adf0-b3d2811b93d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:28.509075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1d060a3f-90cd-436b-adf0-b3d2811b93d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:28.524606 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3423/6807] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:07:28 2022] DELETE /identity/v3/projects/83e2d558961340dca3c746902df4b689 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:28.533021 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5abfae-516b-4f9b-a3f1-ddfc047a18ce None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:28.533496 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5abfae-516b-4f9b-a3f1-ddfc047a18ce None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:28.533699 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5abfae-516b-4f9b-a3f1-ddfc047a18ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:28.610210 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-7f5abfae-516b-4f9b-a3f1-ddfc047a18ce None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:28.620413 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7f5abfae-516b-4f9b-a3f1-ddfc047a18ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:28.633382 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:28.743740 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d060a3f-90cd-436b-adf0-b3d2811b93d5 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:28.752333 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1d060a3f-90cd-436b-adf0-b3d2811b93d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:28.828320 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3385/6808] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:28.844784 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f2d15-ce7f-4a9f-b554-da0f197ee6a9 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:28.845327 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f2d15-ce7f-4a9f-b554-da0f197ee6a9 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:28.846366 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f2d15-ce7f-4a9f-b554-da0f197ee6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:28.859176 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:28.921275 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-bd8f2d15-ce7f-4a9f-b554-da0f197ee6a9 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:28.930320 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-bd8f2d15-ce7f-4a9f-b554-da0f197ee6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:28.973348 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3386/6809] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:28.975462 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f2d15-ce7f-4a9f-b554-da0f197ee6a9 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:29.002884 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f2d15-ce7f-4a9f-b554-da0f197ee6a9 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:29.008815 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d060a3f-90cd-436b-adf0-b3d2811b93d5 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:29.024912 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e7d74-6103-42b7-92f7-2862d498099f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:29.026110 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e7d74-6103-42b7-92f7-2862d498099f admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:29.027398 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e7d74-6103-42b7-92f7-2862d498099f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:29.027693 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e7d74-6103-42b7-92f7-2862d498099f admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:29.028404 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0e7d74-6103-42b7-92f7-2862d498099f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:07:29.028705 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0e7d74-6103-42b7-92f7-2862d498099f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:29.029058 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e41ae-1ed3-434b-a55b-e993ecfd339d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:29.033923 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e41ae-1ed3-434b-a55b-e993ecfd339d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:29.034347 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e41ae-1ed3-434b-a55b-e993ecfd339d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:29.036890 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e41ae-1ed3-434b-a55b-e993ecfd339d admin admin] PATH_INFO: `/v3/projects/4dc5f7b5a089450b85f9935d9dfc4ff9` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:29.040384 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0e7d74-6103-42b7-92f7-2862d498099f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:29.040983 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38e41ae-1ed3-434b-a55b-e993ecfd339d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dc5f7b5a089450b85f9935d9dfc4ff9)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:29.046450 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38e41ae-1ed3-434b-a55b-e993ecfd339d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:29.093727 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3387/6810] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:07:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:07:29.094703 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e7d74-6103-42b7-92f7-2862d498099f admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:29.123071 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e7d74-6103-42b7-92f7-2862d498099f admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:29.140757 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241f295-aa91-4698-8dd2-66bc55f8c10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:29.141397 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241f295-aa91-4698-8dd2-66bc55f8c10d admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:29.141678 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241f295-aa91-4698-8dd2-66bc55f8c10d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:29.141950 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241f295-aa91-4698-8dd2-66bc55f8c10d admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:29.142591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0241f295-aa91-4698-8dd2-66bc55f8c10d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:29.150515 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0241f295-aa91-4698-8dd2-66bc55f8c10d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:29.269217 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e38e41ae-1ed3-434b-a55b-e993ecfd339d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dc5f7b5a089450b85f9935d9dfc4ff9', 'request_id': 'req-e38e41ae-1ed3-434b-a55b-e993ecfd339d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:29.298535 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e38e41ae-1ed3-434b-a55b-e993ecfd339d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dc5f7b5a089450b85f9935d9dfc4ff9', 'request_id': 'req-e38e41ae-1ed3-434b-a55b-e993ecfd339d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:29.329018 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e38e41ae-1ed3-434b-a55b-e993ecfd339d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dc5f7b5a089450b85f9935d9dfc4ff9', 'request_id': 'req-e38e41ae-1ed3-434b-a55b-e993ecfd339d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:29.373726 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e38e41ae-1ed3-434b-a55b-e993ecfd339d admin admin] The token cache is being invalidate because project 4dc5f7b5a089450b85f9935d9dfc4ff9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:07:29.379934 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e38e41ae-1ed3-434b-a55b-e993ecfd339d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:29.382163 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e38e41ae-1ed3-434b-a55b-e993ecfd339d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:29.389189 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3424/6811] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:07:28 2022] DELETE /identity/v3/projects/4dc5f7b5a089450b85f9935d9dfc4ff9 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:07:29.391680 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26f1ad-a2a7-47ce-924c-cb05cc00d313 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:29.392185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26f1ad-a2a7-47ce-924c-cb05cc00d313 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:29.400827 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26f1ad-a2a7-47ce-924c-cb05cc00d313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:29.488971 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-ef26f1ad-a2a7-47ce-924c-cb05cc00d313 None None] MFA Rules not processed for user `f075974a803f46eda667db6d754453ba`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:29.500904 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ef26f1ad-a2a7-47ce-924c-cb05cc00d313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:29.763453 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3388/6812] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:07:29 2022] POST /identity/v3/projects => generated 411 bytes in 669 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:07:29.765553 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc3a7c-a911-4620-92ff-bab56d871f0a None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:29.767647 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc3a7c-a911-4620-92ff-bab56d871f0a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:29.768094 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc3a7c-a911-4620-92ff-bab56d871f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:29.804712 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3425/6813] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:29.805781 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef26f1ad-a2a7-47ce-924c-cb05cc00d313 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:29.817194 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ef26f1ad-a2a7-47ce-924c-cb05cc00d313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:29.874909 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-01fc3a7c-a911-4620-92ff-bab56d871f0a None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:29.878073 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-01fc3a7c-a911-4620-92ff-bab56d871f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:30.158995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef26f1ad-a2a7-47ce-924c-cb05cc00d313 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:30.182960 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40bd0e-4fea-4360-9338-1bf1d84bbd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:30.182960 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40bd0e-4fea-4360-9338-1bf1d84bbd2b admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:30.183299 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40bd0e-4fea-4360-9338-1bf1d84bbd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:30.183460 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40bd0e-4fea-4360-9338-1bf1d84bbd2b admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:30.186931 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef40bd0e-4fea-4360-9338-1bf1d84bbd2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:30.187675 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3389/6814] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:30.189467 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ddca54-4680-4622-99c1-f1c7eca4f555 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:30.189758 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ddca54-4680-4622-99c1-f1c7eca4f555 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:30.190028 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ddca54-4680-4622-99c1-f1c7eca4f555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:30.195618 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef40bd0e-4fea-4360-9338-1bf1d84bbd2b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:30.234764 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:30.253867 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-09ddca54-4680-4622-99c1-f1c7eca4f555 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:30.263851 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-09ddca54-4680-4622-99c1-f1c7eca4f555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:30.277659 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3426/6815] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:07:29 2022] POST /identity/v3/users => generated 306 bytes in 472 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:07:30.283448 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40bd0e-4fea-4360-9338-1bf1d84bbd2b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:30.285597 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3390/6816] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:30.286946 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ddca54-4680-4622-99c1-f1c7eca4f555 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:30.313608 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ddca54-4680-4622-99c1-f1c7eca4f555 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:30.317528 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40bd0e-4fea-4360-9338-1bf1d84bbd2b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:30.329287 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531362b-27e4-470d-93e1-ee2a4c43b429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:30.330759 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531362b-27e4-470d-93e1-ee2a4c43b429 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:30.331250 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67206b67-8e9c-44ec-8025-a0c220157cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:30.332069 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67206b67-8e9c-44ec-8025-a0c220157cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:30.332711 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67206b67-8e9c-44ec-8025-a0c220157cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:30.332845 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531362b-27e4-470d-93e1-ee2a4c43b429 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:30.333313 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67206b67-8e9c-44ec-8025-a0c220157cb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:30.333477 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531362b-27e4-470d-93e1-ee2a4c43b429 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:30.334284 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67206b67-8e9c-44ec-8025-a0c220157cb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:07:30.334638 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531362b-27e4-470d-93e1-ee2a4c43b429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:30.334920 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67206b67-8e9c-44ec-8025-a0c220157cb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:30.337645 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531362b-27e4-470d-93e1-ee2a4c43b429 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:30.338858 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67206b67-8e9c-44ec-8025-a0c220157cb5 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:30.370848 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3391/6818] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:07:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:07:30.371101 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3427/6818] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:07:30 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:07:30.372401 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67206b67-8e9c-44ec-8025-a0c220157cb5 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:30.372981 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531362b-27e4-470d-93e1-ee2a4c43b429 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:30.396702 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67206b67-8e9c-44ec-8025-a0c220157cb5 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:30.396945 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531362b-27e4-470d-93e1-ee2a4c43b429 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:30.408558 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddbfdcc-01e5-41c0-8e27-46b91326be25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:30.409463 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbfdcc-01e5-41c0-8e27-46b91326be25 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:30.409666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbfdcc-01e5-41c0-8e27-46b91326be25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:30.410134 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbfdcc-01e5-41c0-8e27-46b91326be25 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:30.410933 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddbfdcc-01e5-41c0-8e27-46b91326be25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:30.414005 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddbfdcc-01e5-41c0-8e27-46b91326be25 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:30.417078 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c7510-976e-4da9-b6ed-79d0d1fff98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:30.420555 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c7510-976e-4da9-b6ed-79d0d1fff98b admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:30.420852 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c7510-976e-4da9-b6ed-79d0d1fff98b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:30.425068 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c7510-976e-4da9-b6ed-79d0d1fff98b admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:30.425836 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c7510-976e-4da9-b6ed-79d0d1fff98b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:30.433632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c7510-976e-4da9-b6ed-79d0d1fff98b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:30.480230 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3428/6819] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:07:30 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:07:30.485448 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c7510-976e-4da9-b6ed-79d0d1fff98b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:30.502493 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3392/6820] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:07:30 2022] POST /identity/v3/projects => generated 375 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:07:30.507224 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddbfdcc-01e5-41c0-8e27-46b91326be25 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:30.507903 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c7510-976e-4da9-b6ed-79d0d1fff98b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:30.612955 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:30.673206 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddbfdcc-01e5-41c0-8e27-46b91326be25 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:30.693684 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70cc70-f6f7-4547-9601-a1340b0b29d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:30.694370 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70cc70-f6f7-4547-9601-a1340b0b29d6 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:30.694657 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70cc70-f6f7-4547-9601-a1340b0b29d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:30.694937 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70cc70-f6f7-4547-9601-a1340b0b29d6 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:30.695634 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a70cc70-f6f7-4547-9601-a1340b0b29d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:30.701438 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a70cc70-f6f7-4547-9601-a1340b0b29d6 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:30.766639 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3393/6821] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:07:30 2022] POST /identity/v3/users => generated 288 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:07:30.771215 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70cc70-f6f7-4547-9601-a1340b0b29d6 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:30.829343 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70cc70-f6f7-4547-9601-a1340b0b29d6 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:30.832076 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf57a41-81d4-4744-9044-c85598a7a4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:30.834780 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf57a41-81d4-4744-9044-c85598a7a4f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:30.835088 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf57a41-81d4-4744-9044-c85598a7a4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:30.838111 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf57a41-81d4-4744-9044-c85598a7a4f4 admin admin] PATH_INFO: `/v3/projects/8cb60ed7fb4d4f3d858669d378ce1156/users/7c2864092cd04541802a617d174f3104/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:30.851061 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27165794-4f30-4005-b50c-37c2a00ec886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:30.851789 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27165794-4f30-4005-b50c-37c2a00ec886 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:30.853382 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27165794-4f30-4005-b50c-37c2a00ec886 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:30.853769 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27165794-4f30-4005-b50c-37c2a00ec886 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:30.855132 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27165794-4f30-4005-b50c-37c2a00ec886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:30.861064 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27165794-4f30-4005-b50c-37c2a00ec886 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:30.893348 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3394/6822] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:07:30 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:07:30.897736 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27165794-4f30-4005-b50c-37c2a00ec886 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:30.922800 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27165794-4f30-4005-b50c-37c2a00ec886 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:30.932407 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b87635-a8be-4577-a337-276733b02868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:30.933145 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b87635-a8be-4577-a337-276733b02868 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:30.933543 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b87635-a8be-4577-a337-276733b02868 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:30.933914 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b87635-a8be-4577-a337-276733b02868 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:30.937986 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf57a41-81d4-4744-9044-c85598a7a4f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cb60ed7fb4d4f3d858669d378ce1156, user_id=7c2864092cd04541802a617d174f3104, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:30.939694 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b87635-a8be-4577-a337-276733b02868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:30.943650 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b87635-a8be-4577-a337-276733b02868 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:30.957542 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf57a41-81d4-4744-9044-c85598a7a4f4 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:30.979373 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3395/6823] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:07:30 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:07:30.980710 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b87635-a8be-4577-a337-276733b02868 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:30.985258 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-00b87635-a8be-4577-a337-276733b02868 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:31.021090 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3429/6824] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:07:30 2022] PUT /identity/v3/projects/8cb60ed7fb4d4f3d858669d378ce1156/users/7c2864092cd04541802a617d174f3104/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:31.021538 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b87635-a8be-4577-a337-276733b02868 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:31.025813 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf57a41-81d4-4744-9044-c85598a7a4f4 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:31.191490 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496838f-8e81-4117-a19c-ef8dc39b7626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:31.192334 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496838f-8e81-4117-a19c-ef8dc39b7626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:31.193082 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496838f-8e81-4117-a19c-ef8dc39b7626 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:31.193082 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496838f-8e81-4117-a19c-ef8dc39b7626 admin admin] PATH_INFO: `/v3/users/0ddc065817da47d79059d7eef4e08d8c` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:31.197029 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e496838f-8e81-4117-a19c-ef8dc39b7626 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ddc065817da47d79059d7eef4e08d8c)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:31.199251 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e496838f-8e81-4117-a19c-ef8dc39b7626 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:31.213675 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf57a41-81d4-4744-9044-c85598a7a4f4 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:31.230375 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22192bce-e5bf-4b80-9807-c78a1f5dfa53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:31.233328 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22192bce-e5bf-4b80-9807-c78a1f5dfa53 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:31.233800 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22192bce-e5bf-4b80-9807-c78a1f5dfa53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:31.234250 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22192bce-e5bf-4b80-9807-c78a1f5dfa53 admin admin] PATH_INFO: `/v3/projects/b0e5afa06e52468ab56347c25f069fbe/users/d6d858c7decc497282941db30d72fa1d/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:31.276112 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22192bce-e5bf-4b80-9807-c78a1f5dfa53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0e5afa06e52468ab56347c25f069fbe, user_id=d6d858c7decc497282941db30d72fa1d, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:31.288379 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22192bce-e5bf-4b80-9807-c78a1f5dfa53 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:31.327637 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3430/6825] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:07:31 2022] PUT /identity/v3/projects/b0e5afa06e52468ab56347c25f069fbe/users/d6d858c7decc497282941db30d72fa1d/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:31.329266 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052be58-e811-495c-b94a-2152f6e75bcb None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:31.329556 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052be58-e811-495c-b94a-2152f6e75bcb None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:31.329825 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052be58-e811-495c-b94a-2152f6e75bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:31.341563 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e496838f-8e81-4117-a19c-ef8dc39b7626 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ddc065817da47d79059d7eef4e08d8c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:31.343319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e496838f-8e81-4117-a19c-ef8dc39b7626 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ddc065817da47d79059d7eef4e08d8c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:31.375965 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e496838f-8e81-4117-a19c-ef8dc39b7626 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ddc065817da47d79059d7eef4e08d8c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:31.392891 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e496838f-8e81-4117-a19c-ef8dc39b7626 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ddc065817da47d79059d7eef4e08d8c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:31.405801 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e496838f-8e81-4117-a19c-ef8dc39b7626 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ddc065817da47d79059d7eef4e08d8c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:31.417659 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3396/6826] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:07:30 2022] DELETE /identity/v3/users/0ddc065817da47d79059d7eef4e08d8c => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:31.420106 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc663acc-e4e3-47c3-a2cf-f43afe7b23f2 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:31.420561 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc663acc-e4e3-47c3-a2cf-f43afe7b23f2 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:31.420946 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc663acc-e4e3-47c3-a2cf-f43afe7b23f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:31.422067 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a052be58-e811-495c-b94a-2152f6e75bcb None None] MFA Rules not processed for user `7c2864092cd04541802a617d174f3104`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:31.425017 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a052be58-e811-495c-b94a-2152f6e75bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:31.461988 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:31.466203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-bc663acc-e4e3-47c3-a2cf-f43afe7b23f2 None None] MFA Rules not processed for user `d6d858c7decc497282941db30d72fa1d`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:31.469775 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-bc663acc-e4e3-47c3-a2cf-f43afe7b23f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:31.495168 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:31.638306 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3431/6827] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:31 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:31.640453 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4e123-abdc-43bf-841b-b43ad8ce2a38 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:31.640786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4e123-abdc-43bf-841b-b43ad8ce2a38 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:31.641456 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4e123-abdc-43bf-841b-b43ad8ce2a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:31.651857 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3397/6828] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:31.652974 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc663acc-e4e3-47c3-a2cf-f43afe7b23f2 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:31.656367 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-bc663acc-e4e3-47c3-a2cf-f43afe7b23f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:31.722084 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-2cd4e123-abdc-43bf-841b-b43ad8ce2a38 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:31.730809 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2cd4e123-abdc-43bf-841b-b43ad8ce2a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:31.748477 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc663acc-e4e3-47c3-a2cf-f43afe7b23f2 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:31.760022 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe4e99-425b-44d7-bd53-ae396c3177a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:31.761757 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe4e99-425b-44d7-bd53-ae396c3177a9 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:31.762865 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe4e99-425b-44d7-bd53-ae396c3177a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:31.763489 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe4e99-425b-44d7-bd53-ae396c3177a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:31.765889 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfe4e99-425b-44d7-bd53-ae396c3177a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:31.766532 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3432/6829] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:31.768158 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4e123-abdc-43bf-841b-b43ad8ce2a38 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:31.770375 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfe4e99-425b-44d7-bd53-ae396c3177a9 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:31.771695 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2cd4e123-abdc-43bf-841b-b43ad8ce2a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:31.799737 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4e123-abdc-43bf-841b-b43ad8ce2a38 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:31.811828 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c171aed-2d26-47bb-842d-09822a8fea37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:31.812673 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c171aed-2d26-47bb-842d-09822a8fea37 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:31.813049 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c171aed-2d26-47bb-842d-09822a8fea37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:31.813659 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c171aed-2d26-47bb-842d-09822a8fea37 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:31.814471 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c171aed-2d26-47bb-842d-09822a8fea37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:31.817362 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c171aed-2d26-47bb-842d-09822a8fea37 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:31.833030 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3398/6830] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:07:31 2022] POST /identity/v3/projects => generated 411 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:07:31.834701 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe4e99-425b-44d7-bd53-ae396c3177a9 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:31.842610 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7dfe4e99-425b-44d7-bd53-ae396c3177a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:31.929062 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3433/6831] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:07:31 2022] POST /identity/v3/projects => generated 375 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:07:31.931149 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c171aed-2d26-47bb-842d-09822a8fea37 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:32.004713 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe4e99-425b-44d7-bd53-ae396c3177a9 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:32.081937 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:32.100083 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f68710-3749-441e-90de-aca94fb21963 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:32.101002 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f68710-3749-441e-90de-aca94fb21963 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:32.101437 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f68710-3749-441e-90de-aca94fb21963 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:32.102859 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f68710-3749-441e-90de-aca94fb21963 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:32.148380 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c171aed-2d26-47bb-842d-09822a8fea37 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:32.172072 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e146c-d268-4236-9d68-f97aa1edf8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:32.174964 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e146c-d268-4236-9d68-f97aa1edf8db admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:32.176768 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e146c-d268-4236-9d68-f97aa1edf8db admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:32.177677 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e146c-d268-4236-9d68-f97aa1edf8db admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:32.178445 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e146c-d268-4236-9d68-f97aa1edf8db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:32.182994 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e146c-d268-4236-9d68-f97aa1edf8db admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:32.287262 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3434/6832] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:07:31 2022] POST /identity/v3/users => generated 312 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:07:32.288252 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e146c-d268-4236-9d68-f97aa1edf8db admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:32.318449 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e146c-d268-4236-9d68-f97aa1edf8db admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:32.329156 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f68710-3749-441e-90de-aca94fb21963 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:32.330634 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f68710-3749-441e-90de-aca94fb21963 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:32.343592 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd00565-1bac-41be-add7-a0d962585d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:32.343592 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd00565-1bac-41be-add7-a0d962585d9a admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:32.343592 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd00565-1bac-41be-add7-a0d962585d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:32.343592 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd00565-1bac-41be-add7-a0d962585d9a admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:32.344083 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd00565-1bac-41be-add7-a0d962585d9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:32.346004 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd00565-1bac-41be-add7-a0d962585d9a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:32.355669 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3399/6833] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:07:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:07:32.358790 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f68710-3749-441e-90de-aca94fb21963 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:32.395919 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3435/6834] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:07:32 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:07:32.398971 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f68710-3749-441e-90de-aca94fb21963 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:32.399761 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd00565-1bac-41be-add7-a0d962585d9a admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:32.412843 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da73a800-ad93-4d40-8ad4-60d1eb127a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:32.413472 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73a800-ad93-4d40-8ad4-60d1eb127a25 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:32.413756 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73a800-ad93-4d40-8ad4-60d1eb127a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:32.414029 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73a800-ad93-4d40-8ad4-60d1eb127a25 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:32.414685 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da73a800-ad93-4d40-8ad4-60d1eb127a25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:32.418431 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da73a800-ad93-4d40-8ad4-60d1eb127a25 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:32.425772 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd00565-1bac-41be-add7-a0d962585d9a admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:32.436657 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e5b04-b848-4761-a18f-61dd3121efc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:32.442535 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e5b04-b848-4761-a18f-61dd3121efc3 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:32.442902 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e5b04-b848-4761-a18f-61dd3121efc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:32.443220 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e5b04-b848-4761-a18f-61dd3121efc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:32.444005 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e5b04-b848-4761-a18f-61dd3121efc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:32.446020 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3400/6835] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:07:32.449443 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e5b04-b848-4761-a18f-61dd3121efc3 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:32.451612 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da73a800-ad93-4d40-8ad4-60d1eb127a25 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:32.466903 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3436/6836] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:07:32.474662 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e5b04-b848-4761-a18f-61dd3121efc3 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:32.478770 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da73a800-ad93-4d40-8ad4-60d1eb127a25 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:32.494856 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e5b04-b848-4761-a18f-61dd3121efc3 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:32.507665 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d109c-f528-457a-920b-97bd55cf0ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:32.508581 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ab8a6-be17-49f7-811b-be9af8f167ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:32.509281 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ab8a6-be17-49f7-811b-be9af8f167ee admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:32.509564 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ab8a6-be17-49f7-811b-be9af8f167ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:32.509681 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d109c-f528-457a-920b-97bd55cf0ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:32.509840 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ab8a6-be17-49f7-811b-be9af8f167ee admin admin] PATH_INFO: `/v3/projects/76e7c8d3cf5c42c6ad0cc4019354b3e7/users/0f35e4a3956b47e0884e233bda60dfeb/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:32.510122 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d109c-f528-457a-920b-97bd55cf0ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:32.510944 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d109c-f528-457a-920b-97bd55cf0ac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:32.513143 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d109c-f528-457a-920b-97bd55cf0ac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:32.517339 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d109c-f528-457a-920b-97bd55cf0ac2 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:32.549901 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3437/6837] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:07:32.551199 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d109c-f528-457a-920b-97bd55cf0ac2 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:32.571269 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73ab8a6-be17-49f7-811b-be9af8f167ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=76e7c8d3cf5c42c6ad0cc4019354b3e7, user_id=0f35e4a3956b47e0884e233bda60dfeb, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:32.577879 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73ab8a6-be17-49f7-811b-be9af8f167ee admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:32.578282 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d109c-f528-457a-920b-97bd55cf0ac2 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:32.583174 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf46a4-5ef6-4c78-b96d-ce6446794cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:32.583855 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf46a4-5ef6-4c78-b96d-ce6446794cdc admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:32.584793 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf46a4-5ef6-4c78-b96d-ce6446794cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:32.584793 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf46a4-5ef6-4c78-b96d-ce6446794cdc admin admin] PATH_INFO: `/v3/projects/b4fe7617d7f24c5ca6a137df14f27a72/users/8d927abfc94248e6afd38a61cfb12f3a/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:32.619232 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3401/6838] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:07:32 2022] PUT /identity/v3/projects/76e7c8d3cf5c42c6ad0cc4019354b3e7/users/0f35e4a3956b47e0884e233bda60dfeb/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:32.620744 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ab8a6-be17-49f7-811b-be9af8f167ee admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:32.622941 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf46a4-5ef6-4c78-b96d-ce6446794cdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4fe7617d7f24c5ca6a137df14f27a72, user_id=8d927abfc94248e6afd38a61cfb12f3a, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:32.625790 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf46a4-5ef6-4c78-b96d-ce6446794cdc admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:32.660275 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3438/6839] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:07:32 2022] PUT /identity/v3/projects/b4fe7617d7f24c5ca6a137df14f27a72/users/8d927abfc94248e6afd38a61cfb12f3a/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:32.672143 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336558a7-7ba1-4e80-bf5d-cd0ddf36a406 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:32.672437 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336558a7-7ba1-4e80-bf5d-cd0ddf36a406 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:32.672773 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336558a7-7ba1-4e80-bf5d-cd0ddf36a406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:32.782394 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-336558a7-7ba1-4e80-bf5d-cd0ddf36a406 None None] MFA Rules not processed for user `8d927abfc94248e6afd38a61cfb12f3a`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:32.793940 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-336558a7-7ba1-4e80-bf5d-cd0ddf36a406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:32.798050 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ab8a6-be17-49f7-811b-be9af8f167ee admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:32.819544 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:32.997407 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3439/6840] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:07:33.015469 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336558a7-7ba1-4e80-bf5d-cd0ddf36a406 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:33.016952 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-336558a7-7ba1-4e80-bf5d-cd0ddf36a406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:33.027341 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7dfede-8348-478f-abd1-ec76599d76a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:33.028636 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7dfede-8348-478f-abd1-ec76599d76a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:33.028934 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7dfede-8348-478f-abd1-ec76599d76a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:33.029215 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7dfede-8348-478f-abd1-ec76599d76a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:33.029887 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7dfede-8348-478f-abd1-ec76599d76a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:33.031559 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7dfede-8348-478f-abd1-ec76599d76a2 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:33.082930 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3402/6841] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 463 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:07:33.092586 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7dfede-8348-478f-abd1-ec76599d76a2 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:33.111275 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:33.123970 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7dfede-8348-478f-abd1-ec76599d76a2 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:33.139076 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336558a7-7ba1-4e80-bf5d-cd0ddf36a406 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:33.139832 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9048154d-56cb-442a-b843-3be77afea61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:33.142135 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048154d-56cb-442a-b843-3be77afea61e admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:33.143416 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048154d-56cb-442a-b843-3be77afea61e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:33.143851 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048154d-56cb-442a-b843-3be77afea61e admin admin] PATH_INFO: `/v3/projects/76e7c8d3cf5c42c6ad0cc4019354b3e7/users/0f35e4a3956b47e0884e233bda60dfeb/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:33.144671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7da860-eba0-4ae9-bd76-c10dac1e350a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6b0f9835ed549cab91d684326be83fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:33.146245 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7da860-eba0-4ae9-bd76-c10dac1e350a service glance] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:33.146778 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7da860-eba0-4ae9-bd76-c10dac1e350a service glance] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:33.147294 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7da860-eba0-4ae9-bd76-c10dac1e350a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:33.165355 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9048154d-56cb-442a-b843-3be77afea61e admin admin] RBAC: Authorizing `identity:create_grant(project_id=76e7c8d3cf5c42c6ad0cc4019354b3e7, user_id=0f35e4a3956b47e0884e233bda60dfeb, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:33.169921 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9048154d-56cb-442a-b843-3be77afea61e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:33.224856 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7da860-eba0-4ae9-bd76-c10dac1e350a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:33.227145 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7da860-eba0-4ae9-bd76-c10dac1e350a service glance] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:33.233703 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3403/6842] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:07:33 2022] PUT /identity/v3/projects/76e7c8d3cf5c42c6ad0cc4019354b3e7/users/0f35e4a3956b47e0884e233bda60dfeb/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:33.245046 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78c747-168a-46a2-84ec-890c00fae212 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:33.245350 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78c747-168a-46a2-84ec-890c00fae212 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:33.245633 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78c747-168a-46a2-84ec-890c00fae212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:33.250174 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3440/6843] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:07:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:07:33.373612 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-3b78c747-168a-46a2-84ec-890c00fae212 None None] MFA Rules not processed for user `0f35e4a3956b47e0884e233bda60dfeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:33.377907 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3b78c747-168a-46a2-84ec-890c00fae212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:33.477867 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ccf2bd-4034-484a-b122-12f0f981009a None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:33.478492 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ccf2bd-4034-484a-b122-12f0f981009a None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:33.478492 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ccf2bd-4034-484a-b122-12f0f981009a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:33.509431 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a1ccf2bd-4034-484a-b122-12f0f981009a None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:33.510663 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a1ccf2bd-4034-484a-b122-12f0f981009a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:33.610812 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3404/6844] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:33 2022] POST /identity/v3/auth/tokens => generated 3355 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:33.623573 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3441/6845] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 16:07:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 29 16:07:33.640602 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78c747-168a-46a2-84ec-890c00fae212 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:33.642010 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3b78c747-168a-46a2-84ec-890c00fae212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:33.661704 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ccf2bd-4034-484a-b122-12f0f981009a None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:33.663692 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a1ccf2bd-4034-484a-b122-12f0f981009a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:33.686686 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:33.837976 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78c747-168a-46a2-84ec-890c00fae212 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:33.844417 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ccf2bd-4034-484a-b122-12f0f981009a None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:33.845718 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b592bc-629b-460c-b017-26a90c07dfa6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:33.846354 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b592bc-629b-460c-b017-26a90c07dfa6 service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:33.846737 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b592bc-629b-460c-b017-26a90c07dfa6 service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:33.847013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b592bc-629b-460c-b017-26a90c07dfa6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:33.853127 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2c2b6-022f-49db-b366-c2d44ddf5de1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:33.853766 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2c2b6-022f-49db-b366-c2d44ddf5de1 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:33.854054 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2c2b6-022f-49db-b366-c2d44ddf5de1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:33.854324 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2c2b6-022f-49db-b366-c2d44ddf5de1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:33.858265 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b592bc-629b-460c-b017-26a90c07dfa6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:33.860894 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b592bc-629b-460c-b017-26a90c07dfa6 service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:33.872255 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3405/6846] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 16:07:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:07:33.890157 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c2c2b6-022f-49db-b366-c2d44ddf5de1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:33.891739 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c2c2b6-022f-49db-b366-c2d44ddf5de1 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:33.912475 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3442/6847] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:07:33 2022] GET /identity/v3/auth/tokens => generated 3355 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:07:34.146141 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b592bc-629b-460c-b017-26a90c07dfa6 service swift] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:34.147880 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-06b592bc-629b-460c-b017-26a90c07dfa6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:34.223215 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2c2b6-022f-49db-b366-c2d44ddf5de1 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:34.224748 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-72c2c2b6-022f-49db-b366-c2d44ddf5de1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:34.267923 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b592bc-629b-460c-b017-26a90c07dfa6 service swift] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:34.273908 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a9be2-4fef-496c-ad5b-4ccda0f2b645 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6b0f9835ed549cab91d684326be83fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:34.274552 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a9be2-4fef-496c-ad5b-4ccda0f2b645 service glance] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:34.274831 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a9be2-4fef-496c-ad5b-4ccda0f2b645 service glance] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:34.275134 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a9be2-4fef-496c-ad5b-4ccda0f2b645 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:34.301581 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:34.382163 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58a9be2-4fef-496c-ad5b-4ccda0f2b645 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:34.384282 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58a9be2-4fef-496c-ad5b-4ccda0f2b645 service glance] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:34.398852 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3406/6848] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:07:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:07:34.411953 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2c2b6-022f-49db-b366-c2d44ddf5de1 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:34.417520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e2341-b451-4f74-a698-97a818965678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:34.419205 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e2341-b451-4f74-a698-97a818965678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:34.419831 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e2341-b451-4f74-a698-97a818965678 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:34.420263 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e2341-b451-4f74-a698-97a818965678 admin admin] PATH_INFO: `/v3/projects/bfb86016fdd84306b2cc2c7bfead6767` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:34.421759 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e2341-b451-4f74-a698-97a818965678 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfb86016fdd84306b2cc2c7bfead6767)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:34.424045 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e2341-b451-4f74-a698-97a818965678 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:34.510378 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c20e2341-b451-4f74-a698-97a818965678 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfb86016fdd84306b2cc2c7bfead6767', 'request_id': 'req-c20e2341-b451-4f74-a698-97a818965678'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:34.524323 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c20e2341-b451-4f74-a698-97a818965678 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfb86016fdd84306b2cc2c7bfead6767', 'request_id': 'req-c20e2341-b451-4f74-a698-97a818965678'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:34.566948 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c20e2341-b451-4f74-a698-97a818965678 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfb86016fdd84306b2cc2c7bfead6767', 'request_id': 'req-c20e2341-b451-4f74-a698-97a818965678'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:34.585499 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b53c7-5a47-4ff2-8e7c-2ff50c31e2b2 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:34.585849 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b53c7-5a47-4ff2-8e7c-2ff50c31e2b2 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:34.586124 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b53c7-5a47-4ff2-8e7c-2ff50c31e2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:34.598521 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c20e2341-b451-4f74-a698-97a818965678 admin admin] The token cache is being invalidate because project bfb86016fdd84306b2cc2c7bfead6767 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:07:34.598823 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c20e2341-b451-4f74-a698-97a818965678 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:34.601779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c20e2341-b451-4f74-a698-97a818965678 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:34.609303 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3443/6849] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:07:34 2022] DELETE /identity/v3/projects/bfb86016fdd84306b2cc2c7bfead6767 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:34.611939 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e2341-b451-4f74-a698-97a818965678 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:34.613417 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c20e2341-b451-4f74-a698-97a818965678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:34.668494 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-052b53c7-5a47-4ff2-8e7c-2ff50c31e2b2 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:34.669964 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-052b53c7-5a47-4ff2-8e7c-2ff50c31e2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:34.778954 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:34.808101 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e2341-b451-4f74-a698-97a818965678 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:34.814508 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd82c029-aa7a-475d-bfca-63fa8a857228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:34.815308 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82c029-aa7a-475d-bfca-63fa8a857228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:34.815661 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82c029-aa7a-475d-bfca-63fa8a857228 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:34.816035 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82c029-aa7a-475d-bfca-63fa8a857228 admin admin] PATH_INFO: `/v3/users/e878b6aa483f4696ad6f4262a1f01375` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:34.817333 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd82c029-aa7a-475d-bfca-63fa8a857228 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e878b6aa483f4696ad6f4262a1f01375)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:34.819622 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd82c029-aa7a-475d-bfca-63fa8a857228 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:34.869798 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3407/6850] 10.222.0.83 () {58 vars in 967 bytes} [Mon Aug 29 16:07:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:07:34.902814 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b53c7-5a47-4ff2-8e7c-2ff50c31e2b2 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:34.906519 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-052b53c7-5a47-4ff2-8e7c-2ff50c31e2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:34.939640 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-cd82c029-aa7a-475d-bfca-63fa8a857228 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e878b6aa483f4696ad6f4262a1f01375'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:34.943489 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-cd82c029-aa7a-475d-bfca-63fa8a857228 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e878b6aa483f4696ad6f4262a1f01375'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:34.967007 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-cd82c029-aa7a-475d-bfca-63fa8a857228 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e878b6aa483f4696ad6f4262a1f01375'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:34.980282 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-cd82c029-aa7a-475d-bfca-63fa8a857228 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e878b6aa483f4696ad6f4262a1f01375'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:34.982872 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-cd82c029-aa7a-475d-bfca-63fa8a857228 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e878b6aa483f4696ad6f4262a1f01375'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:35.048889 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3444/6851] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:07:34 2022] DELETE /identity/v3/users/e878b6aa483f4696ad6f4262a1f01375 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:35.136063 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b53c7-5a47-4ff2-8e7c-2ff50c31e2b2 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:35.267919 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f8590-eda6-4673-bba2-fa8a8c8102ff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:35.268826 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f8590-eda6-4673-bba2-fa8a8c8102ff service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:35.269346 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f8590-eda6-4673-bba2-fa8a8c8102ff service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:35.269875 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f8590-eda6-4673-bba2-fa8a8c8102ff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:35.272701 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-167f8590-eda6-4673-bba2-fa8a8c8102ff service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:35.280733 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:35.436452 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167f8590-eda6-4673-bba2-fa8a8c8102ff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:35.440937 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167f8590-eda6-4673-bba2-fa8a8c8102ff service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:35.469537 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3408/6852] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 16:07:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:07:35.784130 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd82c029-aa7a-475d-bfca-63fa8a857228 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:35.785944 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-cd82c029-aa7a-475d-bfca-63fa8a857228 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:35.994899 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd82c029-aa7a-475d-bfca-63fa8a857228 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:36.010923 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeccccc-ef08-4fb0-b677-c37bd5145ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:36.013122 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeccccc-ef08-4fb0-b677-c37bd5145ef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:36.013582 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeccccc-ef08-4fb0-b677-c37bd5145ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:36.014036 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeccccc-ef08-4fb0-b677-c37bd5145ef6 admin admin] PATH_INFO: `/v3/users/d6d858c7decc497282941db30d72fa1d` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:36.018260 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeccccc-ef08-4fb0-b677-c37bd5145ef6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6d858c7decc497282941db30d72fa1d)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:36.020637 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeccccc-ef08-4fb0-b677-c37bd5145ef6 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:36.155788 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2eeccccc-ef08-4fb0-b677-c37bd5145ef6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6d858c7decc497282941db30d72fa1d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:36.158207 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2eeccccc-ef08-4fb0-b677-c37bd5145ef6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6d858c7decc497282941db30d72fa1d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:36.181747 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2eeccccc-ef08-4fb0-b677-c37bd5145ef6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6d858c7decc497282941db30d72fa1d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:36.200865 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2eeccccc-ef08-4fb0-b677-c37bd5145ef6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6d858c7decc497282941db30d72fa1d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:36.202603 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2eeccccc-ef08-4fb0-b677-c37bd5145ef6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6d858c7decc497282941db30d72fa1d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:36.208015 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:36.262211 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3445/6853] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:07:35 2022] DELETE /identity/v3/users/d6d858c7decc497282941db30d72fa1d => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:36.264554 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b841b-c2ef-441b-94bf-80b2751f7ae1 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:36.265616 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b841b-c2ef-441b-94bf-80b2751f7ae1 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:36.266045 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b841b-c2ef-441b-94bf-80b2751f7ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:36.297055 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-261b841b-c2ef-441b-94bf-80b2751f7ae1 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:36.302734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-261b841b-c2ef-441b-94bf-80b2751f7ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:36.438389 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3409/6854] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:36.490563 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeccccc-ef08-4fb0-b677-c37bd5145ef6 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:36.492374 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2eeccccc-ef08-4fb0-b677-c37bd5145ef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:36.749201 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeccccc-ef08-4fb0-b677-c37bd5145ef6 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:36.765508 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f282bb-6a33-4eee-9638-f1af7618463f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:36.766157 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f282bb-6a33-4eee-9638-f1af7618463f service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:36.766441 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f282bb-6a33-4eee-9638-f1af7618463f service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:36.766711 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f282bb-6a33-4eee-9638-f1af7618463f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:36.779587 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f282bb-6a33-4eee-9638-f1af7618463f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:36.781083 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f282bb-6a33-4eee-9638-f1af7618463f service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:36.805626 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3446/6855] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:07:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:07:37.396686 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98071d9b-09c0-4902-b0de-d322a62c5a35 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:37.401758 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98071d9b-09c0-4902-b0de-d322a62c5a35 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:37.402305 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98071d9b-09c0-4902-b0de-d322a62c5a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:37.479492 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f282bb-6a33-4eee-9638-f1af7618463f service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:37.482107 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-83f282bb-6a33-4eee-9638-f1af7618463f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:37.502295 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-98071d9b-09c0-4902-b0de-d322a62c5a35 None None] MFA Rules not processed for user `35cca2c3486c4389a04f6a20b8d567e9`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:37.519823 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-98071d9b-09c0-4902-b0de-d322a62c5a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:37.521692 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f282bb-6a33-4eee-9638-f1af7618463f service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:37.537397 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f8b9a-7f55-4196-b2ae-990deb370c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:37.539468 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f8b9a-7f55-4196-b2ae-990deb370c4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:37.539974 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f8b9a-7f55-4196-b2ae-990deb370c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:37.540482 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f8b9a-7f55-4196-b2ae-990deb370c4c admin admin] PATH_INFO: `/v3/projects/b0e5afa06e52468ab56347c25f069fbe` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:37.542529 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8f8b9a-7f55-4196-b2ae-990deb370c4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0e5afa06e52468ab56347c25f069fbe)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:37.545997 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8f8b9a-7f55-4196-b2ae-990deb370c4c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:37.712899 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fd8f8b9a-7f55-4196-b2ae-990deb370c4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0e5afa06e52468ab56347c25f069fbe', 'request_id': 'req-fd8f8b9a-7f55-4196-b2ae-990deb370c4c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:37.735638 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fd8f8b9a-7f55-4196-b2ae-990deb370c4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0e5afa06e52468ab56347c25f069fbe', 'request_id': 'req-fd8f8b9a-7f55-4196-b2ae-990deb370c4c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:37.758604 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fd8f8b9a-7f55-4196-b2ae-990deb370c4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0e5afa06e52468ab56347c25f069fbe', 'request_id': 'req-fd8f8b9a-7f55-4196-b2ae-990deb370c4c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:37.791298 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3410/6856] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:37.794885 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98071d9b-09c0-4902-b0de-d322a62c5a35 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:37.802654 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-98071d9b-09c0-4902-b0de-d322a62c5a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:37.835561 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fd8f8b9a-7f55-4196-b2ae-990deb370c4c admin admin] The token cache is being invalidate because project b0e5afa06e52468ab56347c25f069fbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:07:37.835561 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fd8f8b9a-7f55-4196-b2ae-990deb370c4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:37.835561 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fd8f8b9a-7f55-4196-b2ae-990deb370c4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:37.835561 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3447/6857] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:07:37 2022] DELETE /identity/v3/projects/b0e5afa06e52468ab56347c25f069fbe => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:07:37.848151 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f8b9a-7f55-4196-b2ae-990deb370c4c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:37.862576 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-fd8f8b9a-7f55-4196-b2ae-990deb370c4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:37.881132 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98071d9b-09c0-4902-b0de-d322a62c5a35 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:37.995910 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:38.072766 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e126e-25d7-4c7c-9449-d1cc5edaac13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:38.074081 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e126e-25d7-4c7c-9449-d1cc5edaac13 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:38.076504 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e126e-25d7-4c7c-9449-d1cc5edaac13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:38.076978 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e126e-25d7-4c7c-9449-d1cc5edaac13 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:38.077825 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e126e-25d7-4c7c-9449-d1cc5edaac13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:38.085659 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e126e-25d7-4c7c-9449-d1cc5edaac13 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:38.097879 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f8b9a-7f55-4196-b2ae-990deb370c4c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:38.103763 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac7fc2-3a9b-4bec-a033-423a2eda4c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:38.104613 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac7fc2-3a9b-4bec-a033-423a2eda4c3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:38.105035 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac7fc2-3a9b-4bec-a033-423a2eda4c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:38.105442 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac7fc2-3a9b-4bec-a033-423a2eda4c3e admin admin] PATH_INFO: `/v3/users/8d927abfc94248e6afd38a61cfb12f3a` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:38.107783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac7fc2-3a9b-4bec-a033-423a2eda4c3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d927abfc94248e6afd38a61cfb12f3a)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:38.110230 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac7fc2-3a9b-4bec-a033-423a2eda4c3e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:38.117221 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:38.187013 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-24ac7fc2-3a9b-4bec-a033-423a2eda4c3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d927abfc94248e6afd38a61cfb12f3a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:38.187925 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-24ac7fc2-3a9b-4bec-a033-423a2eda4c3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d927abfc94248e6afd38a61cfb12f3a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:38.196088 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3411/6858] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:07:37 2022] POST /identity/v3/projects => generated 381 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:07:38.207825 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-24ac7fc2-3a9b-4bec-a033-423a2eda4c3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d927abfc94248e6afd38a61cfb12f3a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:38.207943 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e126e-25d7-4c7c-9449-d1cc5edaac13 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:38.215003 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-912e126e-25d7-4c7c-9449-d1cc5edaac13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:38.216450 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-24ac7fc2-3a9b-4bec-a033-423a2eda4c3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d927abfc94248e6afd38a61cfb12f3a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:38.234029 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-24ac7fc2-3a9b-4bec-a033-423a2eda4c3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d927abfc94248e6afd38a61cfb12f3a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:38.287560 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3448/6859] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:07:37 2022] DELETE /identity/v3/users/8d927abfc94248e6afd38a61cfb12f3a => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:38.290217 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac7fc2-3a9b-4bec-a033-423a2eda4c3e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:38.297450 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-24ac7fc2-3a9b-4bec-a033-423a2eda4c3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:38.386909 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e126e-25d7-4c7c-9449-d1cc5edaac13 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:38.427775 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac7fc2-3a9b-4bec-a033-423a2eda4c3e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:38.438632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e117d0-1039-4926-a19e-1cdc7652be25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:38.439312 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e117d0-1039-4926-a19e-1cdc7652be25 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:38.439588 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e117d0-1039-4926-a19e-1cdc7652be25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:38.439861 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e117d0-1039-4926-a19e-1cdc7652be25 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:38.440493 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e117d0-1039-4926-a19e-1cdc7652be25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:38.443174 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e117d0-1039-4926-a19e-1cdc7652be25 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:38.488887 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3449/6860] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:07:38 2022] POST /identity/v3/users => generated 297 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:07:38.492454 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e117d0-1039-4926-a19e-1cdc7652be25 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:38.499342 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12485d10-e3f1-4c64-8478-2dc85f6a695d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:38.500151 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12485d10-e3f1-4c64-8478-2dc85f6a695d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:38.500529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12485d10-e3f1-4c64-8478-2dc85f6a695d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:38.501808 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12485d10-e3f1-4c64-8478-2dc85f6a695d admin admin] PATH_INFO: `/v3/projects/baf63a7690a4456c995c4ba09887913c` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:38.503794 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12485d10-e3f1-4c64-8478-2dc85f6a695d admin admin] RBAC: Authorizing `identity:delete_project(project_id=baf63a7690a4456c995c4ba09887913c)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:38.505883 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e117d0-1039-4926-a19e-1cdc7652be25 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:38.509587 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12485d10-e3f1-4c64-8478-2dc85f6a695d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:38.511666 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e521c3-aed0-4b73-bb92-49bf0594fe36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:38.513082 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e521c3-aed0-4b73-bb92-49bf0594fe36 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:38.513424 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e521c3-aed0-4b73-bb92-49bf0594fe36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:38.513915 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e521c3-aed0-4b73-bb92-49bf0594fe36 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:38.514569 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e521c3-aed0-4b73-bb92-49bf0594fe36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:38.516333 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e521c3-aed0-4b73-bb92-49bf0594fe36 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:38.544939 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3450/6861] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:07:38.546476 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e521c3-aed0-4b73-bb92-49bf0594fe36 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:38.572312 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e521c3-aed0-4b73-bb92-49bf0594fe36 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:38.587435 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c3a748-468b-4595-bb23-2a5817d2bf6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:38.588130 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3a748-468b-4595-bb23-2a5817d2bf6c admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:38.588405 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3a748-468b-4595-bb23-2a5817d2bf6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:38.588678 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3a748-468b-4595-bb23-2a5817d2bf6c admin admin] PATH_INFO: `/v3/projects/c6203fa4f591453693b634904490286c/users/0abe97082cd44d87b9fc6e51d21487c4/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:38.606500 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-12485d10-e3f1-4c64-8478-2dc85f6a695d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baf63a7690a4456c995c4ba09887913c', 'request_id': 'req-12485d10-e3f1-4c64-8478-2dc85f6a695d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:38.618043 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-12485d10-e3f1-4c64-8478-2dc85f6a695d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baf63a7690a4456c995c4ba09887913c', 'request_id': 'req-12485d10-e3f1-4c64-8478-2dc85f6a695d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:38.628206 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c3a748-468b-4595-bb23-2a5817d2bf6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6203fa4f591453693b634904490286c, user_id=0abe97082cd44d87b9fc6e51d21487c4, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:38.632847 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c3a748-468b-4595-bb23-2a5817d2bf6c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:38.634524 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-12485d10-e3f1-4c64-8478-2dc85f6a695d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baf63a7690a4456c995c4ba09887913c', 'request_id': 'req-12485d10-e3f1-4c64-8478-2dc85f6a695d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:38.650341 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:38.657433 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-12485d10-e3f1-4c64-8478-2dc85f6a695d admin admin] The token cache is being invalidate because project baf63a7690a4456c995c4ba09887913c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:07:38.657942 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-12485d10-e3f1-4c64-8478-2dc85f6a695d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:38.659373 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-12485d10-e3f1-4c64-8478-2dc85f6a695d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:38.661857 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3451/6862] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:07:38 2022] PUT /identity/v3/projects/c6203fa4f591453693b634904490286c/users/0abe97082cd44d87b9fc6e51d21487c4/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:38.666136 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c3a748-468b-4595-bb23-2a5817d2bf6c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:38.667837 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3412/6863] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:07:38 2022] DELETE /identity/v3/projects/baf63a7690a4456c995c4ba09887913c => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:38.673991 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-26c3a748-468b-4595-bb23-2a5817d2bf6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:38.674187 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396781f-bd08-484f-aca9-6a90b531c204 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:38.674758 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396781f-bd08-484f-aca9-6a90b531c204 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:38.675215 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396781f-bd08-484f-aca9-6a90b531c204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:38.704975 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-0396781f-bd08-484f-aca9-6a90b531c204 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:38.706520 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0396781f-bd08-484f-aca9-6a90b531c204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:38.757504 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:38.785981 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c3a748-468b-4595-bb23-2a5817d2bf6c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:38.795502 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3993ecd-7a46-4127-9a5b-263dd895afcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:38.796140 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3993ecd-7a46-4127-9a5b-263dd895afcd admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:38.796416 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3993ecd-7a46-4127-9a5b-263dd895afcd admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:38.796686 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3993ecd-7a46-4127-9a5b-263dd895afcd admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:38.797324 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3413/6864] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:38.806588 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3993ecd-7a46-4127-9a5b-263dd895afcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:38.807961 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19464e-9442-4697-be82-3e8f5b020d5e None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:38.808615 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3993ecd-7a46-4127-9a5b-263dd895afcd admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:38.810667 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19464e-9442-4697-be82-3e8f5b020d5e None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:38.811121 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19464e-9442-4697-be82-3e8f5b020d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:38.828304 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3452/6865] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:07:38.832756 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3993ecd-7a46-4127-9a5b-263dd895afcd admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:38.845651 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3993ecd-7a46-4127-9a5b-263dd895afcd admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:38.855828 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c65113-509d-4fea-9440-8bcf15ba327d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:38.858443 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c65113-509d-4fea-9440-8bcf15ba327d admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:38.858931 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c65113-509d-4fea-9440-8bcf15ba327d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:38.860787 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c65113-509d-4fea-9440-8bcf15ba327d admin admin] PATH_INFO: `/v3/projects/c6203fa4f591453693b634904490286c/users/0abe97082cd44d87b9fc6e51d21487c4/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:38.864623 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c65113-509d-4fea-9440-8bcf15ba327d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6203fa4f591453693b634904490286c, user_id=0abe97082cd44d87b9fc6e51d21487c4, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:38.874963 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c65113-509d-4fea-9440-8bcf15ba327d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:38.907462 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-1e19464e-9442-4697-be82-3e8f5b020d5e None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:38.908712 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1e19464e-9442-4697-be82-3e8f5b020d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:38.914332 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3453/6866] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:07:38 2022] PUT /identity/v3/projects/c6203fa4f591453693b634904490286c/users/0abe97082cd44d87b9fc6e51d21487c4/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:39.035845 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3414/6867] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:39.039146 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c65113-509d-4fea-9440-8bcf15ba327d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:39.052368 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c65113-509d-4fea-9440-8bcf15ba327d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:39.071915 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7102b-b002-4d43-9f5d-38c55ad61281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:39.072627 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7102b-b002-4d43-9f5d-38c55ad61281 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:39.072905 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7102b-b002-4d43-9f5d-38c55ad61281 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:39.073174 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7102b-b002-4d43-9f5d-38c55ad61281 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:39.074428 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa7102b-b002-4d43-9f5d-38c55ad61281 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:07:39.074764 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa7102b-b002-4d43-9f5d-38c55ad61281 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:39.076960 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa7102b-b002-4d43-9f5d-38c55ad61281 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:39.093932 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e19464e-9442-4697-be82-3e8f5b020d5e None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:39.095421 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1e19464e-9442-4697-be82-3e8f5b020d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:39.113506 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e19464e-9442-4697-be82-3e8f5b020d5e None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:39.123663 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3454/6868] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:07:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:07:39.124609 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7102b-b002-4d43-9f5d-38c55ad61281 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:39.132472 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8287ed3e-fcd9-42e2-9806-0fa98f95c510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:39.134641 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287ed3e-fcd9-42e2-9806-0fa98f95c510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:39.134641 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287ed3e-fcd9-42e2-9806-0fa98f95c510 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:39.134641 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287ed3e-fcd9-42e2-9806-0fa98f95c510 admin admin] PATH_INFO: `/v3/projects/b4fe7617d7f24c5ca6a137df14f27a72` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:39.135925 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8287ed3e-fcd9-42e2-9806-0fa98f95c510 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4fe7617d7f24c5ca6a137df14f27a72)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:39.138842 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8287ed3e-fcd9-42e2-9806-0fa98f95c510 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:39.144953 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7102b-b002-4d43-9f5d-38c55ad61281 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:39.161132 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fcd791-dc7c-4335-941e-ca4c371d7f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:39.161826 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcd791-dc7c-4335-941e-ca4c371d7f11 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:39.162282 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcd791-dc7c-4335-941e-ca4c371d7f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:39.162401 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcd791-dc7c-4335-941e-ca4c371d7f11 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:39.163146 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fcd791-dc7c-4335-941e-ca4c371d7f11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:39.169045 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fcd791-dc7c-4335-941e-ca4c371d7f11 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:39.237214 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8287ed3e-fcd9-42e2-9806-0fa98f95c510 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4fe7617d7f24c5ca6a137df14f27a72', 'request_id': 'req-8287ed3e-fcd9-42e2-9806-0fa98f95c510'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:39.244615 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3455/6869] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:07:39 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:07:39.246373 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fcd791-dc7c-4335-941e-ca4c371d7f11 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:39.258918 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8287ed3e-fcd9-42e2-9806-0fa98f95c510 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4fe7617d7f24c5ca6a137df14f27a72', 'request_id': 'req-8287ed3e-fcd9-42e2-9806-0fa98f95c510'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:39.284822 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8287ed3e-fcd9-42e2-9806-0fa98f95c510 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4fe7617d7f24c5ca6a137df14f27a72', 'request_id': 'req-8287ed3e-fcd9-42e2-9806-0fa98f95c510'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:39.306325 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8287ed3e-fcd9-42e2-9806-0fa98f95c510 admin admin] The token cache is being invalidate because project b4fe7617d7f24c5ca6a137df14f27a72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:07:39.306325 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8287ed3e-fcd9-42e2-9806-0fa98f95c510 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:39.306325 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8287ed3e-fcd9-42e2-9806-0fa98f95c510 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:39.316430 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3415/6870] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:07:39 2022] DELETE /identity/v3/projects/b4fe7617d7f24c5ca6a137df14f27a72 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:07:39.318068 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb200d8-6838-46c0-b663-07f40482245c None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:39.318505 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb200d8-6838-46c0-b663-07f40482245c None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:39.318874 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb200d8-6838-46c0-b663-07f40482245c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:39.347667 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-afb200d8-6838-46c0-b663-07f40482245c None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:39.349161 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-afb200d8-6838-46c0-b663-07f40482245c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:39.401332 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:39.444900 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fcd791-dc7c-4335-941e-ca4c371d7f11 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:39.465010 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed43bb-3f47-4aae-9fa3-c3159beb33fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:39.470897 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed43bb-3f47-4aae-9fa3-c3159beb33fd admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:39.471352 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed43bb-3f47-4aae-9fa3-c3159beb33fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:39.471655 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed43bb-3f47-4aae-9fa3-c3159beb33fd admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:39.472429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed43bb-3f47-4aae-9fa3-c3159beb33fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:39.479398 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed43bb-3f47-4aae-9fa3-c3159beb33fd admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:39.501813 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3416/6871] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:39.511802 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335a934-8c9f-4f5c-a4f6-09a11e61df70 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:39.513146 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335a934-8c9f-4f5c-a4f6-09a11e61df70 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:39.513880 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335a934-8c9f-4f5c-a4f6-09a11e61df70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:39.555275 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3456/6872] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:07:39 2022] POST /identity/v3/users => generated 293 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:07:39.561053 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed43bb-3f47-4aae-9fa3-c3159beb33fd admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:39.566154 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6bed43bb-3f47-4aae-9fa3-c3159beb33fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:39.581436 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-b335a934-8c9f-4f5c-a4f6-09a11e61df70 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:39.583648 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b335a934-8c9f-4f5c-a4f6-09a11e61df70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:39.604421 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed43bb-3f47-4aae-9fa3-c3159beb33fd admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:39.614470 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3417/6873] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:07:39.615866 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335a934-8c9f-4f5c-a4f6-09a11e61df70 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:39.618474 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d379dcd-c5b6-497c-99c8-9fabab79a794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:39.619154 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d379dcd-c5b6-497c-99c8-9fabab79a794 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:39.619438 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d379dcd-c5b6-497c-99c8-9fabab79a794 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:39.619712 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d379dcd-c5b6-497c-99c8-9fabab79a794 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:39.620373 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d379dcd-c5b6-497c-99c8-9fabab79a794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:39.622851 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d379dcd-c5b6-497c-99c8-9fabab79a794 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:39.646145 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335a934-8c9f-4f5c-a4f6-09a11e61df70 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:39.651565 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3457/6874] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:07:39.656669 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d379dcd-c5b6-497c-99c8-9fabab79a794 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:39.669269 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109c856-6c2c-4608-b1c9-a6ed15397028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:39.670144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109c856-6c2c-4608-b1c9-a6ed15397028 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:39.671212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109c856-6c2c-4608-b1c9-a6ed15397028 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:39.671212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109c856-6c2c-4608-b1c9-a6ed15397028 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:39.671702 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d109c856-6c2c-4608-b1c9-a6ed15397028 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:07:39.672014 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d109c856-6c2c-4608-b1c9-a6ed15397028 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:39.676489 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d379dcd-c5b6-497c-99c8-9fabab79a794 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:39.680600 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d109c856-6c2c-4608-b1c9-a6ed15397028 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:39.693522 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e1d99-a7b7-44e1-a8cd-643b79573f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:39.694164 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e1d99-a7b7-44e1-a8cd-643b79573f33 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:39.694446 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e1d99-a7b7-44e1-a8cd-643b79573f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:39.694720 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e1d99-a7b7-44e1-a8cd-643b79573f33 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:39.695405 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e1d99-a7b7-44e1-a8cd-643b79573f33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:39.697034 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e1d99-a7b7-44e1-a8cd-643b79573f33 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:39.727209 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3418/6875] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:07:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:07:39.732741 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109c856-6c2c-4608-b1c9-a6ed15397028 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:39.735619 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3458/6876] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:07:39.740724 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e1d99-a7b7-44e1-a8cd-643b79573f33 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:39.762813 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109c856-6c2c-4608-b1c9-a6ed15397028 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:39.769468 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e1d99-a7b7-44e1-a8cd-643b79573f33 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:39.781133 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ddfcb9-2e29-4e6d-8ab5-2fff6071a73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:39.781754 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ddfcb9-2e29-4e6d-8ab5-2fff6071a73f admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:39.782034 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ddfcb9-2e29-4e6d-8ab5-2fff6071a73f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:39.782309 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ddfcb9-2e29-4e6d-8ab5-2fff6071a73f admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:39.782960 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ddfcb9-2e29-4e6d-8ab5-2fff6071a73f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:39.784962 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ddfcb9-2e29-4e6d-8ab5-2fff6071a73f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:39.792732 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee9d0d-247f-4049-a189-02d1bd0e994c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:39.794596 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee9d0d-247f-4049-a189-02d1bd0e994c admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:39.794596 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee9d0d-247f-4049-a189-02d1bd0e994c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:39.794879 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee9d0d-247f-4049-a189-02d1bd0e994c admin admin] PATH_INFO: `/v3/projects/d969699a1f4a415a9dec415fafafb985/users/362874933c9f47f18e70bb3fe9e8cb19/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:39.860635 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee9d0d-247f-4049-a189-02d1bd0e994c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d969699a1f4a415a9dec415fafafb985, user_id=362874933c9f47f18e70bb3fe9e8cb19, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:39.863443 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee9d0d-247f-4049-a189-02d1bd0e994c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:39.890095 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3419/6877] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:07:39 2022] POST /identity/v3/projects => generated 379 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:07:39.894226 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ddfcb9-2e29-4e6d-8ab5-2fff6071a73f admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:39.899950 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3459/6878] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:07:39 2022] PUT /identity/v3/projects/d969699a1f4a415a9dec415fafafb985/users/362874933c9f47f18e70bb3fe9e8cb19/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:39.915563 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5c5ba-fc5d-4b74-a14a-ac18c5ae0fca None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:39.915846 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5c5ba-fc5d-4b74-a14a-ac18c5ae0fca None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:39.916120 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5c5ba-fc5d-4b74-a14a-ac18c5ae0fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:40.006307 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-53f5c5ba-fc5d-4b74-a14a-ac18c5ae0fca None None] MFA Rules not processed for user `362874933c9f47f18e70bb3fe9e8cb19`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:40.007561 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-53f5c5ba-fc5d-4b74-a14a-ac18c5ae0fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:40.065295 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:40.114734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ddfcb9-2e29-4e6d-8ab5-2fff6071a73f admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:40.131953 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ddbb32-fb8d-46d8-be3c-b06aa41cff14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:40.132584 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ddbb32-fb8d-46d8-be3c-b06aa41cff14 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:40.133206 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ddbb32-fb8d-46d8-be3c-b06aa41cff14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:40.133206 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ddbb32-fb8d-46d8-be3c-b06aa41cff14 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:40.134377 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ddbb32-fb8d-46d8-be3c-b06aa41cff14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:40.136357 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ddbb32-fb8d-46d8-be3c-b06aa41cff14 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:40.206353 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3420/6879] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:07:39 2022] POST /identity/v3/users => generated 290 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:07:40.207386 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ddbb32-fb8d-46d8-be3c-b06aa41cff14 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:40.242277 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3460/6880] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:40.243269 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ddbb32-fb8d-46d8-be3c-b06aa41cff14 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:40.244817 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f5c5ba-fc5d-4b74-a14a-ac18c5ae0fca None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:40.260137 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f57fed-0729-4dcb-89b2-502da891d7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:40.260787 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f57fed-0729-4dcb-89b2-502da891d7f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:40.261186 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f57fed-0729-4dcb-89b2-502da891d7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:40.261505 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f57fed-0729-4dcb-89b2-502da891d7f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:40.262709 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f57fed-0729-4dcb-89b2-502da891d7f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:40.265990 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f57fed-0729-4dcb-89b2-502da891d7f6 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:40.268333 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f5c5ba-fc5d-4b74-a14a-ac18c5ae0fca None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:40.281262 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e17bd5-b2d8-4ab1-a6c3-6ad6c9fe4239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:40.281754 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e17bd5-b2d8-4ab1-a6c3-6ad6c9fe4239 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:40.282039 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e17bd5-b2d8-4ab1-a6c3-6ad6c9fe4239 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:40.282314 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e17bd5-b2d8-4ab1-a6c3-6ad6c9fe4239 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:40.282961 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e17bd5-b2d8-4ab1-a6c3-6ad6c9fe4239 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:40.284946 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e17bd5-b2d8-4ab1-a6c3-6ad6c9fe4239 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:40.295052 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3421/6881] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:07:40.304944 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f57fed-0729-4dcb-89b2-502da891d7f6 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:40.347715 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f57fed-0729-4dcb-89b2-502da891d7f6 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:40.372225 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58095f7e-d3e2-43f9-a1e8-be2023098fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:40.372894 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58095f7e-d3e2-43f9-a1e8-be2023098fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:40.373158 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58095f7e-d3e2-43f9-a1e8-be2023098fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:40.373570 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58095f7e-d3e2-43f9-a1e8-be2023098fe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:40.374238 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58095f7e-d3e2-43f9-a1e8-be2023098fe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:40.378814 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58095f7e-d3e2-43f9-a1e8-be2023098fe7 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:40.395524 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3461/6882] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:07:40 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:07:40.396607 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e17bd5-b2d8-4ab1-a6c3-6ad6c9fe4239 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:40.424987 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3422/6883] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:07:40.426077 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58095f7e-d3e2-43f9-a1e8-be2023098fe7 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:40.447348 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58095f7e-d3e2-43f9-a1e8-be2023098fe7 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:40.545303 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e17bd5-b2d8-4ab1-a6c3-6ad6c9fe4239 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:40.560043 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc2c83-4933-4d67-aec5-ea225abb8131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:40.560979 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc2c83-4933-4d67-aec5-ea225abb8131 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:40.561435 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc2c83-4933-4d67-aec5-ea225abb8131 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:40.562033 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc2c83-4933-4d67-aec5-ea225abb8131 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:40.562840 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc2c83-4933-4d67-aec5-ea225abb8131 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:40.567568 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc2c83-4933-4d67-aec5-ea225abb8131 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:40.584558 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:40.610039 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12d9360-ec3a-4ecc-8e28-ae969e95b11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:40.611472 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d9360-ec3a-4ecc-8e28-ae969e95b11e admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:40.615496 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d9360-ec3a-4ecc-8e28-ae969e95b11e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:40.621426 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d9360-ec3a-4ecc-8e28-ae969e95b11e admin admin] PATH_INFO: `/v3/projects/2df0b2d386f34cdfbb993e3c381331d6/users/9d3c67fed1cf40d6806a4617b1d84871/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:40.622428 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3462/6884] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:07:40 2022] POST /identity/v3/users => generated 293 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:07:40.626236 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc2c83-4933-4d67-aec5-ea225abb8131 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:40.646623 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc2c83-4933-4d67-aec5-ea225abb8131 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:40.659474 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd58deb0-0e7c-4d38-ae31-2fb5239ec88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:40.660214 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58deb0-0e7c-4d38-ae31-2fb5239ec88d admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:40.660562 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58deb0-0e7c-4d38-ae31-2fb5239ec88d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:40.660954 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58deb0-0e7c-4d38-ae31-2fb5239ec88d admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:40.661684 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd58deb0-0e7c-4d38-ae31-2fb5239ec88d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:40.663566 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd58deb0-0e7c-4d38-ae31-2fb5239ec88d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:40.664940 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12d9360-ec3a-4ecc-8e28-ae969e95b11e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2df0b2d386f34cdfbb993e3c381331d6, user_id=9d3c67fed1cf40d6806a4617b1d84871, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:40.673873 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12d9360-ec3a-4ecc-8e28-ae969e95b11e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:40.687613 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3463/6885] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:07:40.691626 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd58deb0-0e7c-4d38-ae31-2fb5239ec88d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:40.698751 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3423/6886] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:07:40 2022] PUT /identity/v3/projects/2df0b2d386f34cdfbb993e3c381331d6/users/9d3c67fed1cf40d6806a4617b1d84871/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:40.713735 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7428a1c-18a8-4ad9-9fde-edcd210c03ba None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:40.716745 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd58deb0-0e7c-4d38-ae31-2fb5239ec88d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:40.717403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7428a1c-18a8-4ad9-9fde-edcd210c03ba None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:40.718046 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7428a1c-18a8-4ad9-9fde-edcd210c03ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:40.797114 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-a7428a1c-18a8-4ad9-9fde-edcd210c03ba None None] MFA Rules not processed for user `9d3c67fed1cf40d6806a4617b1d84871`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:40.799590 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a7428a1c-18a8-4ad9-9fde-edcd210c03ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:40.855551 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907df66-cf23-4fd6-b79d-def2c65b4d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:40.856903 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907df66-cf23-4fd6-b79d-def2c65b4d20 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:40.857319 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907df66-cf23-4fd6-b79d-def2c65b4d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:40.857604 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907df66-cf23-4fd6-b79d-def2c65b4d20 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:40.858263 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e907df66-cf23-4fd6-b79d-def2c65b4d20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:40.861507 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e907df66-cf23-4fd6-b79d-def2c65b4d20 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:40.910185 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3464/6887] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:07:40.911265 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907df66-cf23-4fd6-b79d-def2c65b4d20 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:40.946146 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907df66-cf23-4fd6-b79d-def2c65b4d20 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:40.978040 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c692c7c-6562-4382-8dd2-698ccb2f32af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:40.978732 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c692c7c-6562-4382-8dd2-698ccb2f32af admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:40.980156 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c692c7c-6562-4382-8dd2-698ccb2f32af admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:40.980449 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c692c7c-6562-4382-8dd2-698ccb2f32af admin admin] PATH_INFO: `/v3/projects/d34da1ae384245299acb4feef22187e1/users/f624a6c6800d49d6835d8aa6fda202d7/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:41.027413 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3424/6888] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:07:41.029604 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:41.032092 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7428a1c-18a8-4ad9-9fde-edcd210c03ba None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:41.037328 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a7428a1c-18a8-4ad9-9fde-edcd210c03ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:41.049935 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c692c7c-6562-4382-8dd2-698ccb2f32af admin admin] RBAC: Authorizing `identity:create_grant(project_id=d34da1ae384245299acb4feef22187e1, user_id=f624a6c6800d49d6835d8aa6fda202d7, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:41.064322 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c692c7c-6562-4382-8dd2-698ccb2f32af admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:41.104361 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3465/6889] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:07:40 2022] PUT /identity/v3/projects/d34da1ae384245299acb4feef22187e1/users/f624a6c6800d49d6835d8aa6fda202d7/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:41.107425 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf6001-bdc8-4f56-98e4-3b23e46defda None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:41.107717 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf6001-bdc8-4f56-98e4-3b23e46defda None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:41.108092 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf6001-bdc8-4f56-98e4-3b23e46defda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:41.266466 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-eeaf6001-bdc8-4f56-98e4-3b23e46defda None None] MFA Rules not processed for user `f624a6c6800d49d6835d8aa6fda202d7`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:41.268768 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-eeaf6001-bdc8-4f56-98e4-3b23e46defda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:41.317433 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7428a1c-18a8-4ad9-9fde-edcd210c03ba None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:41.514804 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfd480-bf09-4e64-93f1-38b55737aa82 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6b0f9835ed549cab91d684326be83fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:41.515487 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfd480-bf09-4e64-93f1-38b55737aa82 service glance] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:41.515787 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfd480-bf09-4e64-93f1-38b55737aa82 service glance] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:41.516043 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfd480-bf09-4e64-93f1-38b55737aa82 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:41.525064 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3466/6890] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:41.529709 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf6001-bdc8-4f56-98e4-3b23e46defda None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:41.600936 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:41.694107 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bfd480-bf09-4e64-93f1-38b55737aa82 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:41.695775 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bfd480-bf09-4e64-93f1-38b55737aa82 service glance] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:41.699515 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf6001-bdc8-4f56-98e4-3b23e46defda None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:41.721000 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6f18c-88c3-4a50-a8eb-3e3af6ecf295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:41.722019 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6f18c-88c3-4a50-a8eb-3e3af6ecf295 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:41.722515 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6f18c-88c3-4a50-a8eb-3e3af6ecf295 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:41.723063 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6f18c-88c3-4a50-a8eb-3e3af6ecf295 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:41.723951 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa6f18c-88c3-4a50-a8eb-3e3af6ecf295 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:41.726164 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa6f18c-88c3-4a50-a8eb-3e3af6ecf295 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:41.737415 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3425/6891] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:07:41 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 706 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:07:41.829325 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3467/6892] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:07:41 2022] POST /identity/v3/projects => generated 385 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:07:41.833292 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfd480-bf09-4e64-93f1-38b55737aa82 service glance] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:41.853655 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfd480-bf09-4e64-93f1-38b55737aa82 service glance] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:42.051262 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f59e2e-9142-4285-9dbd-69bde4c723b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:42.051699 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f59e2e-9142-4285-9dbd-69bde4c723b3 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:42.051973 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f59e2e-9142-4285-9dbd-69bde4c723b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:42.052254 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f59e2e-9142-4285-9dbd-69bde4c723b3 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:42.052896 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f59e2e-9142-4285-9dbd-69bde4c723b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:42.054843 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f59e2e-9142-4285-9dbd-69bde4c723b3 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:42.136932 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3426/6893] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:07:41 2022] POST /identity/v3/users => generated 299 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:07:42.141285 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6f18c-88c3-4a50-a8eb-3e3af6ecf295 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:42.157879 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6f18c-88c3-4a50-a8eb-3e3af6ecf295 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:42.173111 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc7971-b374-466d-baef-939c616a1cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:42.174028 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc7971-b374-466d-baef-939c616a1cbc admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:42.174422 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc7971-b374-466d-baef-939c616a1cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:42.174837 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc7971-b374-466d-baef-939c616a1cbc admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:42.175689 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbc7971-b374-466d-baef-939c616a1cbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:42.177667 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbc7971-b374-466d-baef-939c616a1cbc admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:42.206475 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3468/6894] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:07:42 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:07:42.207807 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f59e2e-9142-4285-9dbd-69bde4c723b3 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:42.229393 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f59e2e-9142-4285-9dbd-69bde4c723b3 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:42.243892 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a24eaf-2ab9-432c-80ca-6f8b2fdd4b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:42.245363 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a24eaf-2ab9-432c-80ca-6f8b2fdd4b2e admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:42.245578 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a24eaf-2ab9-432c-80ca-6f8b2fdd4b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:42.246024 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a24eaf-2ab9-432c-80ca-6f8b2fdd4b2e admin admin] PATH_INFO: `/v3/projects/54e11a13aaf84e258795abfee24304f6/users/e92fae99a3064d7ea20ff46bbec35959/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:42.295819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a24eaf-2ab9-432c-80ca-6f8b2fdd4b2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=54e11a13aaf84e258795abfee24304f6, user_id=e92fae99a3064d7ea20ff46bbec35959, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:42.303849 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a24eaf-2ab9-432c-80ca-6f8b2fdd4b2e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:42.313685 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc7971-b374-466d-baef-939c616a1cbc admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:42.330706 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc7971-b374-466d-baef-939c616a1cbc admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:42.352303 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91d7ce-61d7-46ed-9643-87ee9afea0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:42.352981 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91d7ce-61d7-46ed-9643-87ee9afea0d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:42.354832 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91d7ce-61d7-46ed-9643-87ee9afea0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:42.357595 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91d7ce-61d7-46ed-9643-87ee9afea0d8 admin admin] PATH_INFO: `/v3/users/9d3c67fed1cf40d6806a4617b1d84871` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:42.359147 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91d7ce-61d7-46ed-9643-87ee9afea0d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d3c67fed1cf40d6806a4617b1d84871)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:42.362136 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91d7ce-61d7-46ed-9643-87ee9afea0d8 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:42.368612 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3427/6895] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:07:42 2022] PUT /identity/v3/projects/54e11a13aaf84e258795abfee24304f6/users/e92fae99a3064d7ea20ff46bbec35959/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:42.372767 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a24eaf-2ab9-432c-80ca-6f8b2fdd4b2e admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:42.533922 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-df91d7ce-61d7-46ed-9643-87ee9afea0d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d3c67fed1cf40d6806a4617b1d84871'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:42.535494 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-df91d7ce-61d7-46ed-9643-87ee9afea0d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d3c67fed1cf40d6806a4617b1d84871'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:42.537853 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:42.562286 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-df91d7ce-61d7-46ed-9643-87ee9afea0d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d3c67fed1cf40d6806a4617b1d84871'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:42.580424 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-df91d7ce-61d7-46ed-9643-87ee9afea0d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d3c67fed1cf40d6806a4617b1d84871'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:42.583879 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-df91d7ce-61d7-46ed-9643-87ee9afea0d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d3c67fed1cf40d6806a4617b1d84871'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:42.601995 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a24eaf-2ab9-432c-80ca-6f8b2fdd4b2e admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:42.621097 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69be70-7233-4c2c-b161-a6c65c3e5942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:42.621785 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69be70-7233-4c2c-b161-a6c65c3e5942 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:42.622104 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69be70-7233-4c2c-b161-a6c65c3e5942 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:42.622382 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69be70-7233-4c2c-b161-a6c65c3e5942 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:42.627468 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e69be70-7233-4c2c-b161-a6c65c3e5942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:42.632878 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e69be70-7233-4c2c-b161-a6c65c3e5942 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:42.663015 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3469/6896] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:07:42 2022] DELETE /identity/v3/users/9d3c67fed1cf40d6806a4617b1d84871 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:07:42.670946 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53823a-2370-43f1-8420-c76154f1c071 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:42.671268 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53823a-2370-43f1-8420-c76154f1c071 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:42.671549 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53823a-2370-43f1-8420-c76154f1c071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:42.688664 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3428/6897] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:07:42 2022] GET /identity/v3/roles => generated 1420 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:07:42.690806 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69be70-7233-4c2c-b161-a6c65c3e5942 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:42.700080 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4e69be70-7233-4c2c-b161-a6c65c3e5942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:42.723584 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-7e53823a-2370-43f1-8420-c76154f1c071 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:42.724913 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7e53823a-2370-43f1-8420-c76154f1c071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:42.737659 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69be70-7233-4c2c-b161-a6c65c3e5942 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:42.886001 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3470/6898] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:42.890724 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:42.953025 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c0c2b-3783-4f07-b606-3250e604af66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:42.956070 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c0c2b-3783-4f07-b606-3250e604af66 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:42.956070 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c0c2b-3783-4f07-b606-3250e604af66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:42.956070 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c0c2b-3783-4f07-b606-3250e604af66 admin admin] PATH_INFO: `/v3/projects/54e11a13aaf84e258795abfee24304f6/users/e92fae99a3064d7ea20ff46bbec35959/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:42.956639 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c0c2b-3783-4f07-b606-3250e604af66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54e11a13aaf84e258795abfee24304f6, user_id=e92fae99a3064d7ea20ff46bbec35959, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:42.960507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c0c2b-3783-4f07-b606-3250e604af66 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:42.986864 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3429/6899] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:07:42 2022] PUT /identity/v3/projects/54e11a13aaf84e258795abfee24304f6/users/e92fae99a3064d7ea20ff46bbec35959/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:42.998429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3b359-8b1c-4cef-b960-59592d9813d8 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:42.999813 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3b359-8b1c-4cef-b960-59592d9813d8 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:43.000463 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3b359-8b1c-4cef-b960-59592d9813d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:43.054701 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a7b3b359-8b1c-4cef-b960-59592d9813d8 None None] MFA Rules not processed for user `e92fae99a3064d7ea20ff46bbec35959`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:43.056388 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a7b3b359-8b1c-4cef-b960-59592d9813d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:43.235093 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3471/6900] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:42 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:43.249469 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c0c2b-3783-4f07-b606-3250e604af66 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:43.251179 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-232c0c2b-3783-4f07-b606-3250e604af66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:43.375250 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c0c2b-3783-4f07-b606-3250e604af66 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:43.397542 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a689c0cf-b64d-4f9b-8c58-81d2d0697843 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:43.399804 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689c0cf-b64d-4f9b-8c58-81d2d0697843 service cinder] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:43.401880 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689c0cf-b64d-4f9b-8c58-81d2d0697843 service cinder] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:43.402742 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689c0cf-b64d-4f9b-8c58-81d2d0697843 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:43.428950 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a689c0cf-b64d-4f9b-8c58-81d2d0697843 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:43.563015 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b3b359-8b1c-4cef-b960-59592d9813d8 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:43.565672 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a7b3b359-8b1c-4cef-b960-59592d9813d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:43.577377 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a689c0cf-b64d-4f9b-8c58-81d2d0697843 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:43.579148 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a689c0cf-b64d-4f9b-8c58-81d2d0697843 service cinder] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:43.617039 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3430/6901] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:07:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:07:43.781299 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b3b359-8b1c-4cef-b960-59592d9813d8 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:43.792847 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b60d7c-24cb-4a2e-ba5e-613db06cf54b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:43.793894 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b60d7c-24cb-4a2e-ba5e-613db06cf54b service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:43.794378 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b60d7c-24cb-4a2e-ba5e-613db06cf54b service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:43.794779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b60d7c-24cb-4a2e-ba5e-613db06cf54b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:43.815554 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:44.027187 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b60d7c-24cb-4a2e-ba5e-613db06cf54b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:44.029783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b60d7c-24cb-4a2e-ba5e-613db06cf54b service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:44.069877 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3472/6902] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:07:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:07:45.587761 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a689c0cf-b64d-4f9b-8c58-81d2d0697843 service cinder] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:45.593065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a689c0cf-b64d-4f9b-8c58-81d2d0697843 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:45.908738 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a689c0cf-b64d-4f9b-8c58-81d2d0697843 service cinder] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:45.920346 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db42a9a-483e-48ad-8568-ad87e5c23558 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:45.921875 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db42a9a-483e-48ad-8568-ad87e5c23558 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:45.921875 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db42a9a-483e-48ad-8568-ad87e5c23558 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:45.921875 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db42a9a-483e-48ad-8568-ad87e5c23558 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:45.928643 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7db42a9a-483e-48ad-8568-ad87e5c23558 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:45.972087 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:46.065750 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db42a9a-483e-48ad-8568-ad87e5c23558 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:46.067478 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db42a9a-483e-48ad-8568-ad87e5c23558 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:46.088356 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3431/6903] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:07:45 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:07:46.471787 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b60d7c-24cb-4a2e-ba5e-613db06cf54b service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:46.473414 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d7b60d7c-24cb-4a2e-ba5e-613db06cf54b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:46.503776 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b60d7c-24cb-4a2e-ba5e-613db06cf54b service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:46.510274 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c39fcca-b565-4a3b-876b-282b3eba6590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:46.511347 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39fcca-b565-4a3b-876b-282b3eba6590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:46.511827 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39fcca-b565-4a3b-876b-282b3eba6590 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:46.513144 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39fcca-b565-4a3b-876b-282b3eba6590 admin admin] PATH_INFO: `/v3/projects/2df0b2d386f34cdfbb993e3c381331d6` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:46.516140 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c39fcca-b565-4a3b-876b-282b3eba6590 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2df0b2d386f34cdfbb993e3c381331d6)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:46.520254 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c39fcca-b565-4a3b-876b-282b3eba6590 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:46.721277 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1c39fcca-b565-4a3b-876b-282b3eba6590 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2df0b2d386f34cdfbb993e3c381331d6', 'request_id': 'req-1c39fcca-b565-4a3b-876b-282b3eba6590'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:46.764196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1c39fcca-b565-4a3b-876b-282b3eba6590 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2df0b2d386f34cdfbb993e3c381331d6', 'request_id': 'req-1c39fcca-b565-4a3b-876b-282b3eba6590'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:46.793343 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1c39fcca-b565-4a3b-876b-282b3eba6590 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2df0b2d386f34cdfbb993e3c381331d6', 'request_id': 'req-1c39fcca-b565-4a3b-876b-282b3eba6590'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:46.813891 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1c39fcca-b565-4a3b-876b-282b3eba6590 admin admin] The token cache is being invalidate because project 2df0b2d386f34cdfbb993e3c381331d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:07:46.815144 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1c39fcca-b565-4a3b-876b-282b3eba6590 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:46.816630 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1c39fcca-b565-4a3b-876b-282b3eba6590 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:46.818567 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3473/6904] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:07:46 2022] DELETE /identity/v3/projects/2df0b2d386f34cdfbb993e3c381331d6 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:46.824070 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8cf0b6-5187-4fa0-8645-2369a08e912a None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:46.825867 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8cf0b6-5187-4fa0-8645-2369a08e912a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:46.825867 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8cf0b6-5187-4fa0-8645-2369a08e912a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:46.873253 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-7e8cf0b6-5187-4fa0-8645-2369a08e912a None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:46.875518 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7e8cf0b6-5187-4fa0-8645-2369a08e912a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:47.026888 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3432/6905] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:47.030166 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bf542-3caa-421f-b49c-d2c2eac33f3a None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:47.030630 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bf542-3caa-421f-b49c-d2c2eac33f3a None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:47.031077 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bf542-3caa-421f-b49c-d2c2eac33f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:47.085771 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8cf0b6-5187-4fa0-8645-2369a08e912a None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:47.087338 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7e8cf0b6-5187-4fa0-8645-2369a08e912a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:47.104251 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-6b8bf542-3caa-421f-b49c-d2c2eac33f3a None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:47.111306 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6b8bf542-3caa-421f-b49c-d2c2eac33f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:47.125024 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3474/6906] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:47.130193 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8bf542-3caa-421f-b49c-d2c2eac33f3a None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:47.140384 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8bf542-3caa-421f-b49c-d2c2eac33f3a None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:47.148934 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96465bb4-e289-44af-90a9-a51926ccb608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:47.149568 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96465bb4-e289-44af-90a9-a51926ccb608 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:47.149848 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96465bb4-e289-44af-90a9-a51926ccb608 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:47.150135 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96465bb4-e289-44af-90a9-a51926ccb608 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:47.150784 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96465bb4-e289-44af-90a9-a51926ccb608 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:07:47.151103 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96465bb4-e289-44af-90a9-a51926ccb608 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:47.152727 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96465bb4-e289-44af-90a9-a51926ccb608 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:47.183376 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3475/6907] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:07:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:07:47.186391 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96465bb4-e289-44af-90a9-a51926ccb608 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:47.209846 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96465bb4-e289-44af-90a9-a51926ccb608 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:47.225506 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c547772-62f0-4035-a739-a5bed2ba6ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:47.226460 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c547772-62f0-4035-a739-a5bed2ba6ea7 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:47.226922 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c547772-62f0-4035-a739-a5bed2ba6ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:47.229478 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c547772-62f0-4035-a739-a5bed2ba6ea7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:47.230339 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c547772-62f0-4035-a739-a5bed2ba6ea7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:47.233789 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c547772-62f0-4035-a739-a5bed2ba6ea7 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:47.310949 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8cf0b6-5187-4fa0-8645-2369a08e912a None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:47.315463 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3476/6908] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:07:47 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:07:47.316693 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c547772-62f0-4035-a739-a5bed2ba6ea7 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:47.318266 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3c547772-62f0-4035-a739-a5bed2ba6ea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:47.399585 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:47.446824 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dcad79-d0f0-4bc7-9182-bf9c21070a83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:47.447891 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dcad79-d0f0-4bc7-9182-bf9c21070a83 service cinder] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:47.448503 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dcad79-d0f0-4bc7-9182-bf9c21070a83 service cinder] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:47.449045 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dcad79-d0f0-4bc7-9182-bf9c21070a83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:47.451532 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-85dcad79-d0f0-4bc7-9182-bf9c21070a83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:47.493485 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c547772-62f0-4035-a739-a5bed2ba6ea7 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:47.511403 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad81e25d-1eab-4ef0-b2f2-03d73d2d8721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:47.515074 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81e25d-1eab-4ef0-b2f2-03d73d2d8721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:47.515074 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81e25d-1eab-4ef0-b2f2-03d73d2d8721 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:47.515074 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81e25d-1eab-4ef0-b2f2-03d73d2d8721 admin admin] PATH_INFO: `/v3/users/7c2864092cd04541802a617d174f3104` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:47.521353 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad81e25d-1eab-4ef0-b2f2-03d73d2d8721 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c2864092cd04541802a617d174f3104)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:47.526013 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad81e25d-1eab-4ef0-b2f2-03d73d2d8721 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:47.544472 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:47.640234 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ad81e25d-1eab-4ef0-b2f2-03d73d2d8721 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c2864092cd04541802a617d174f3104'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:47.640927 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ad81e25d-1eab-4ef0-b2f2-03d73d2d8721 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c2864092cd04541802a617d174f3104'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:47.653545 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ad81e25d-1eab-4ef0-b2f2-03d73d2d8721 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c2864092cd04541802a617d174f3104'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:47.664590 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dcad79-d0f0-4bc7-9182-bf9c21070a83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:47.666885 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dcad79-d0f0-4bc7-9182-bf9c21070a83 service cinder] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:47.682595 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3433/6909] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:07:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:07:47.683500 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dcad79-d0f0-4bc7-9182-bf9c21070a83 service cinder] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:47.687519 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ad81e25d-1eab-4ef0-b2f2-03d73d2d8721 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c2864092cd04541802a617d174f3104'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:47.688398 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ad81e25d-1eab-4ef0-b2f2-03d73d2d8721 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c2864092cd04541802a617d174f3104'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:47.702299 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dcad79-d0f0-4bc7-9182-bf9c21070a83 service cinder] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:47.727453 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd4f6b3-b83f-48c8-ac22-7b13cc8068fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:47.730097 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4f6b3-b83f-48c8-ac22-7b13cc8068fa admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:47.730371 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4f6b3-b83f-48c8-ac22-7b13cc8068fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:47.730646 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4f6b3-b83f-48c8-ac22-7b13cc8068fa admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:47.731356 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd4f6b3-b83f-48c8-ac22-7b13cc8068fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:47.733319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd4f6b3-b83f-48c8-ac22-7b13cc8068fa admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:47.764980 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3477/6910] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:07:47 2022] DELETE /identity/v3/users/7c2864092cd04541802a617d174f3104 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:47.767724 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137bfc7-42e8-4f7c-a175-c8fd8daf5c34 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:47.768009 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137bfc7-42e8-4f7c-a175-c8fd8daf5c34 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:47.770508 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137bfc7-42e8-4f7c-a175-c8fd8daf5c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:47.821731 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3434/6911] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:07:47 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:07:47.825741 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd4f6b3-b83f-48c8-ac22-7b13cc8068fa admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:47.833307 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1bd4f6b3-b83f-48c8-ac22-7b13cc8068fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:47.852609 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-4137bfc7-42e8-4f7c-a175-c8fd8daf5c34 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:47.853857 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4137bfc7-42e8-4f7c-a175-c8fd8daf5c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:47.861150 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd4f6b3-b83f-48c8-ac22-7b13cc8068fa admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:48.025466 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3dc503-206f-46f2-8dee-1b9f74696044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:48.026362 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3dc503-206f-46f2-8dee-1b9f74696044 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:48.026633 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3dc503-206f-46f2-8dee-1b9f74696044 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:48.026904 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3dc503-206f-46f2-8dee-1b9f74696044 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:48.027592 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3dc503-206f-46f2-8dee-1b9f74696044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:48.029403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3dc503-206f-46f2-8dee-1b9f74696044 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:48.071853 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3435/6912] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:07:48.072743 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3dc503-206f-46f2-8dee-1b9f74696044 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:48.087735 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3dc503-206f-46f2-8dee-1b9f74696044 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:48.096125 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b883d-a026-45bb-907f-ac294bd1c8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:48.096923 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b883d-a026-45bb-907f-ac294bd1c8df admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:48.097297 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b883d-a026-45bb-907f-ac294bd1c8df admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:48.097667 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b883d-a026-45bb-907f-ac294bd1c8df admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:48.099226 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b883d-a026-45bb-907f-ac294bd1c8df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:48.100530 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b883d-a026-45bb-907f-ac294bd1c8df admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:48.121152 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3436/6913] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:07:48.123190 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b883d-a026-45bb-907f-ac294bd1c8df admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:48.143937 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3478/6914] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:48.146766 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b883d-a026-45bb-907f-ac294bd1c8df admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:48.155929 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137bfc7-42e8-4f7c-a175-c8fd8daf5c34 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:48.158575 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4137bfc7-42e8-4f7c-a175-c8fd8daf5c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:48.159155 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0054801f-fb7a-4fcf-ae3b-9704ff77fe64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:48.159979 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0054801f-fb7a-4fcf-ae3b-9704ff77fe64 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:48.160252 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0054801f-fb7a-4fcf-ae3b-9704ff77fe64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:48.160538 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0054801f-fb7a-4fcf-ae3b-9704ff77fe64 admin admin] PATH_INFO: `/v3/projects/2089c2e63e7b4b48b85b259aefdf7ce7/users/c7cc72688ec7411f88c8b9aed54f11e1/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:48.184834 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0054801f-fb7a-4fcf-ae3b-9704ff77fe64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2089c2e63e7b4b48b85b259aefdf7ce7, user_id=c7cc72688ec7411f88c8b9aed54f11e1, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:48.187936 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0054801f-fb7a-4fcf-ae3b-9704ff77fe64 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:48.215094 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3437/6915] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:07:48 2022] PUT /identity/v3/projects/2089c2e63e7b4b48b85b259aefdf7ce7/users/c7cc72688ec7411f88c8b9aed54f11e1/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:48.224285 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528de272-ef1b-4d1b-9ce1-2fda6cda9f15 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:48.224805 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528de272-ef1b-4d1b-9ce1-2fda6cda9f15 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:48.225211 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528de272-ef1b-4d1b-9ce1-2fda6cda9f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:48.302600 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-528de272-ef1b-4d1b-9ce1-2fda6cda9f15 None None] MFA Rules not processed for user `c7cc72688ec7411f88c8b9aed54f11e1`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:48.306875 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-528de272-ef1b-4d1b-9ce1-2fda6cda9f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:48.309817 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137bfc7-42e8-4f7c-a175-c8fd8daf5c34 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:48.343294 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:48.433396 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8332070-5c54-468f-9d53-72641e6cf436 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:48.434345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8332070-5c54-468f-9d53-72641e6cf436 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:48.434609 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8332070-5c54-468f-9d53-72641e6cf436 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:48.434841 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8332070-5c54-468f-9d53-72641e6cf436 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:48.469130 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3438/6916] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:48.469912 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528de272-ef1b-4d1b-9ce1-2fda6cda9f15 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:48.487502 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:48.620955 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528de272-ef1b-4d1b-9ce1-2fda6cda9f15 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:48.643355 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084c91e-85ba-40f8-9562-1e9a44e59d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:48.647453 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8332070-5c54-468f-9d53-72641e6cf436 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:48.649690 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8332070-5c54-468f-9d53-72641e6cf436 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:48.651839 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084c91e-85ba-40f8-9562-1e9a44e59d46 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:48.653928 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084c91e-85ba-40f8-9562-1e9a44e59d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:48.655293 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084c91e-85ba-40f8-9562-1e9a44e59d46 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:48.664309 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3084c91e-85ba-40f8-9562-1e9a44e59d46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:48.665193 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3479/6917] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:07:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:07:48.666862 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3084c91e-85ba-40f8-9562-1e9a44e59d46 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:48.798950 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3439/6918] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:07:48 2022] POST /identity/v3/projects => generated 383 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:07:48.814281 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8332070-5c54-468f-9d53-72641e6cf436 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:48.820634 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8332070-5c54-468f-9d53-72641e6cf436 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:49.093627 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a40316-584c-4930-a5e7-289ed281bff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:49.095731 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a40316-584c-4930-a5e7-289ed281bff0 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:49.098269 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a40316-584c-4930-a5e7-289ed281bff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:49.099764 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a40316-584c-4930-a5e7-289ed281bff0 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:49.101502 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a40316-584c-4930-a5e7-289ed281bff0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:49.103459 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a40316-584c-4930-a5e7-289ed281bff0 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:49.241141 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3480/6919] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:07:48 2022] POST /identity/v3/users => generated 298 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:07:49.244519 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084c91e-85ba-40f8-9562-1e9a44e59d46 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:49.262161 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084c91e-85ba-40f8-9562-1e9a44e59d46 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:49.286159 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8327e78f-de79-491e-a0a7-d40cb6843d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:49.295065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327e78f-de79-491e-a0a7-d40cb6843d0e admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:49.296059 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327e78f-de79-491e-a0a7-d40cb6843d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:49.296563 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327e78f-de79-491e-a0a7-d40cb6843d0e admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:49.299306 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8327e78f-de79-491e-a0a7-d40cb6843d0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:49.306954 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8327e78f-de79-491e-a0a7-d40cb6843d0e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:49.361322 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3440/6920] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:07:49.364865 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a40316-584c-4930-a5e7-289ed281bff0 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:49.376033 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8327e78f-de79-491e-a0a7-d40cb6843d0e admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:49.378610 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a40316-584c-4930-a5e7-289ed281bff0 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:49.382900 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8327e78f-de79-491e-a0a7-d40cb6843d0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:49.394248 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2223cbd-d88c-45e1-82f9-10f9f4b03a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:49.395096 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2223cbd-d88c-45e1-82f9-10f9f4b03a38 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:49.395414 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2223cbd-d88c-45e1-82f9-10f9f4b03a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:49.395688 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2223cbd-d88c-45e1-82f9-10f9f4b03a38 admin admin] PATH_INFO: `/v3/projects/529e88bb52854ae480ba73342bccc1af/users/fa039e17d0344c8db7611e5af043e6cb/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:49.432463 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2223cbd-d88c-45e1-82f9-10f9f4b03a38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=529e88bb52854ae480ba73342bccc1af, user_id=fa039e17d0344c8db7611e5af043e6cb, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:49.441566 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2223cbd-d88c-45e1-82f9-10f9f4b03a38 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:49.533290 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3481/6921] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:07:49 2022] PUT /identity/v3/projects/529e88bb52854ae480ba73342bccc1af/users/fa039e17d0344c8db7611e5af043e6cb/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:49.546185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2223cbd-d88c-45e1-82f9-10f9f4b03a38 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:49.602736 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8327e78f-de79-491e-a0a7-d40cb6843d0e admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:49.648725 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:49.726766 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14eb2ea-088a-4e04-a9be-37c7c8e833ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:49.727496 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14eb2ea-088a-4e04-a9be-37c7c8e833ea service cinder] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:49.727920 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14eb2ea-088a-4e04-a9be-37c7c8e833ea service cinder] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:49.728421 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14eb2ea-088a-4e04-a9be-37c7c8e833ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:49.732589 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f14eb2ea-088a-4e04-a9be-37c7c8e833ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:49.759934 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2223cbd-d88c-45e1-82f9-10f9f4b03a38 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:49.790678 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4994386-917e-48e9-a453-6a2fb83d91d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:49.791417 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4994386-917e-48e9-a453-6a2fb83d91d8 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:49.791721 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4994386-917e-48e9-a453-6a2fb83d91d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:49.792364 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4994386-917e-48e9-a453-6a2fb83d91d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:49.794416 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4994386-917e-48e9-a453-6a2fb83d91d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:49.796436 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4994386-917e-48e9-a453-6a2fb83d91d8 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:49.833985 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3482/6922] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:07:49.838205 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4994386-917e-48e9-a453-6a2fb83d91d8 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:49.844095 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:49.876132 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4994386-917e-48e9-a453-6a2fb83d91d8 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:49.881375 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c17c6-95ee-4891-b2f6-86f301ce1490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:49.882302 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c17c6-95ee-4891-b2f6-86f301ce1490 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:49.882442 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c17c6-95ee-4891-b2f6-86f301ce1490 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:49.882639 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14eb2ea-088a-4e04-a9be-37c7c8e833ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:49.883090 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c17c6-95ee-4891-b2f6-86f301ce1490 admin admin] PATH_INFO: `/v3/projects/529e88bb52854ae480ba73342bccc1af/users/fa039e17d0344c8db7611e5af043e6cb/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:49.884166 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14eb2ea-088a-4e04-a9be-37c7c8e833ea service cinder] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:49.885193 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59c17c6-95ee-4891-b2f6-86f301ce1490 admin admin] RBAC: Authorizing `identity:create_grant(project_id=529e88bb52854ae480ba73342bccc1af, user_id=fa039e17d0344c8db7611e5af043e6cb, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:49.887739 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59c17c6-95ee-4891-b2f6-86f301ce1490 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:49.908094 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3441/6923] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:07:49 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:07:49.909256 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14eb2ea-088a-4e04-a9be-37c7c8e833ea service cinder] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:49.911246 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f14eb2ea-088a-4e04-a9be-37c7c8e833ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:49.939007 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3483/6924] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:07:49 2022] PUT /identity/v3/projects/529e88bb52854ae480ba73342bccc1af/users/fa039e17d0344c8db7611e5af043e6cb/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:49.962507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14eb2ea-088a-4e04-a9be-37c7c8e833ea service cinder] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:49.969299 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf2dcb-3823-4105-8676-865678428a4f None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:49.969793 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf2dcb-3823-4105-8676-865678428a4f None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:49.970049 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf2dcb-3823-4105-8676-865678428a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:50.048574 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-9ddf2dcb-3823-4105-8676-865678428a4f None None] MFA Rules not processed for user `fa039e17d0344c8db7611e5af043e6cb`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:50.053907 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9ddf2dcb-3823-4105-8676-865678428a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:50.122500 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c615b6-b01c-41b7-9a9f-c20b9b7268b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:50.125162 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c615b6-b01c-41b7-9a9f-c20b9b7268b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:50.125162 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c615b6-b01c-41b7-9a9f-c20b9b7268b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:50.125162 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c615b6-b01c-41b7-9a9f-c20b9b7268b6 admin admin] PATH_INFO: `/v3/projects/8cb60ed7fb4d4f3d858669d378ce1156` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:50.126662 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c615b6-b01c-41b7-9a9f-c20b9b7268b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cb60ed7fb4d4f3d858669d378ce1156)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:50.130039 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c615b6-b01c-41b7-9a9f-c20b9b7268b6 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:50.244132 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b1c615b6-b01c-41b7-9a9f-c20b9b7268b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cb60ed7fb4d4f3d858669d378ce1156', 'request_id': 'req-b1c615b6-b01c-41b7-9a9f-c20b9b7268b6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:50.258743 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b1c615b6-b01c-41b7-9a9f-c20b9b7268b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cb60ed7fb4d4f3d858669d378ce1156', 'request_id': 'req-b1c615b6-b01c-41b7-9a9f-c20b9b7268b6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:50.277353 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b1c615b6-b01c-41b7-9a9f-c20b9b7268b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cb60ed7fb4d4f3d858669d378ce1156', 'request_id': 'req-b1c615b6-b01c-41b7-9a9f-c20b9b7268b6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:50.302260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b1c615b6-b01c-41b7-9a9f-c20b9b7268b6 admin admin] The token cache is being invalidate because project 8cb60ed7fb4d4f3d858669d378ce1156 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:07:50.304387 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b1c615b6-b01c-41b7-9a9f-c20b9b7268b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:50.306498 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b1c615b6-b01c-41b7-9a9f-c20b9b7268b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:50.310255 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3442/6925] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:07:49 2022] DELETE /identity/v3/projects/8cb60ed7fb4d4f3d858669d378ce1156 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:50.320116 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c615b6-b01c-41b7-9a9f-c20b9b7268b6 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:50.321833 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b1c615b6-b01c-41b7-9a9f-c20b9b7268b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:50.345654 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3484/6926] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:49 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:07:50.370502 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf2dcb-3823-4105-8676-865678428a4f None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:50.457120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c615b6-b01c-41b7-9a9f-c20b9b7268b6 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:50.475518 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b97a6-1d83-4e44-9763-0fe18d69c8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:50.476185 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b97a6-1d83-4e44-9763-0fe18d69c8e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:50.476463 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b97a6-1d83-4e44-9763-0fe18d69c8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:50.476730 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b97a6-1d83-4e44-9763-0fe18d69c8e4 admin admin] PATH_INFO: `/v3/users/0f35e4a3956b47e0884e233bda60dfeb` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:50.480526 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b97a6-1d83-4e44-9763-0fe18d69c8e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f35e4a3956b47e0884e233bda60dfeb)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:50.493048 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b97a6-1d83-4e44-9763-0fe18d69c8e4 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:50.525919 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:50.603211 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-566b97a6-1d83-4e44-9763-0fe18d69c8e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f35e4a3956b47e0884e233bda60dfeb'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:50.604970 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-566b97a6-1d83-4e44-9763-0fe18d69c8e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f35e4a3956b47e0884e233bda60dfeb'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:50.638976 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-566b97a6-1d83-4e44-9763-0fe18d69c8e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f35e4a3956b47e0884e233bda60dfeb'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:50.646246 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf2dcb-3823-4105-8676-865678428a4f None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:50.663631 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-566b97a6-1d83-4e44-9763-0fe18d69c8e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f35e4a3956b47e0884e233bda60dfeb'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:50.673641 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-566b97a6-1d83-4e44-9763-0fe18d69c8e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f35e4a3956b47e0884e233bda60dfeb'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:50.695643 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3443/6927] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:07:50 2022] DELETE /identity/v3/users/0f35e4a3956b47e0884e233bda60dfeb => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:07:50.937246 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb97132c-e299-4654-935b-d0355c60b546 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:50.939295 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97132c-e299-4654-935b-d0355c60b546 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:50.939756 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97132c-e299-4654-935b-d0355c60b546 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:50.940813 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97132c-e299-4654-935b-d0355c60b546 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:50.951128 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-eb97132c-e299-4654-935b-d0355c60b546 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:50.994657 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:51.147978 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb97132c-e299-4654-935b-d0355c60b546 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:51.149729 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb97132c-e299-4654-935b-d0355c60b546 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:51.170919 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3485/6928] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:07:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 814 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:07:52.109497 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b97a6-1d83-4e44-9763-0fe18d69c8e4 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:52.115314 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-566b97a6-1d83-4e44-9763-0fe18d69c8e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:52.138344 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb97132c-e299-4654-935b-d0355c60b546 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:52.146404 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-eb97132c-e299-4654-935b-d0355c60b546 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:52.174147 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb97132c-e299-4654-935b-d0355c60b546 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:52.345278 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0af23-32ee-4a45-b773-76eeee454e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:52.346154 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0af23-32ee-4a45-b773-76eeee454e93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:52.347185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0af23-32ee-4a45-b773-76eeee454e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:52.347185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0af23-32ee-4a45-b773-76eeee454e93 admin admin] PATH_INFO: `/v3/projects/76e7c8d3cf5c42c6ad0cc4019354b3e7` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:52.354414 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0af23-32ee-4a45-b773-76eeee454e93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76e7c8d3cf5c42c6ad0cc4019354b3e7)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:52.358119 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0af23-32ee-4a45-b773-76eeee454e93 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:52.519208 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b97a6-1d83-4e44-9763-0fe18d69c8e4 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:52.612588 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-58e0af23-32ee-4a45-b773-76eeee454e93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76e7c8d3cf5c42c6ad0cc4019354b3e7', 'request_id': 'req-58e0af23-32ee-4a45-b773-76eeee454e93'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:52.650480 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-58e0af23-32ee-4a45-b773-76eeee454e93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76e7c8d3cf5c42c6ad0cc4019354b3e7', 'request_id': 'req-58e0af23-32ee-4a45-b773-76eeee454e93'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:52.690587 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-58e0af23-32ee-4a45-b773-76eeee454e93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76e7c8d3cf5c42c6ad0cc4019354b3e7', 'request_id': 'req-58e0af23-32ee-4a45-b773-76eeee454e93'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:52.765011 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-58e0af23-32ee-4a45-b773-76eeee454e93 admin admin] The token cache is being invalidate because project 76e7c8d3cf5c42c6ad0cc4019354b3e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:07:52.765438 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-58e0af23-32ee-4a45-b773-76eeee454e93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:52.773615 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-58e0af23-32ee-4a45-b773-76eeee454e93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:07:52.777076 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90203159-5a7f-4234-9f92-d6f1e7734ff6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:52.779081 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90203159-5a7f-4234-9f92-d6f1e7734ff6 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:52.779655 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90203159-5a7f-4234-9f92-d6f1e7734ff6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:52.779934 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90203159-5a7f-4234-9f92-d6f1e7734ff6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:52.785043 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-90203159-5a7f-4234-9f92-d6f1e7734ff6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:52.787151 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3486/6929] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:07:52 2022] DELETE /identity/v3/projects/76e7c8d3cf5c42c6ad0cc4019354b3e7 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:07:52.793524 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0af23-32ee-4a45-b773-76eeee454e93 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:52.798706 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-58e0af23-32ee-4a45-b773-76eeee454e93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:52.892119 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0af23-32ee-4a45-b773-76eeee454e93 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:52.913018 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2709887b-5763-4724-ad2e-e512e0a6f839 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:52.913750 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709887b-5763-4724-ad2e-e512e0a6f839 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:52.914025 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709887b-5763-4724-ad2e-e512e0a6f839 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:52.915438 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709887b-5763-4724-ad2e-e512e0a6f839 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:52.921949 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2709887b-5763-4724-ad2e-e512e0a6f839 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:53.067914 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90203159-5a7f-4234-9f92-d6f1e7734ff6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:53.069393 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90203159-5a7f-4234-9f92-d6f1e7734ff6 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:53.090969 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:53.095437 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:53.109410 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3444/6930] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:07:52 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 1001 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:07:53.114718 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35d3ee-1263-437e-ad16-1f8621a11c2a None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:53.122012 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35d3ee-1263-437e-ad16-1f8621a11c2a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:53.122795 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35d3ee-1263-437e-ad16-1f8621a11c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:53.213777 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-3b35d3ee-1263-437e-ad16-1f8621a11c2a None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:53.221224 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3b35d3ee-1263-437e-ad16-1f8621a11c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:53.250967 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2709887b-5763-4724-ad2e-e512e0a6f839 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:53.253564 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2709887b-5763-4724-ad2e-e512e0a6f839 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:53.359089 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3487/6931] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:07:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:07:53.392666 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2709887b-5763-4724-ad2e-e512e0a6f839 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:53.394541 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2709887b-5763-4724-ad2e-e512e0a6f839 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:53.423530 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2709887b-5763-4724-ad2e-e512e0a6f839 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:53.436672 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec64efe-c86b-4a4d-9645-424a5c1c9694 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:53.438744 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec64efe-c86b-4a4d-9645-424a5c1c9694 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:53.439221 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec64efe-c86b-4a4d-9645-424a5c1c9694 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:53.439639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec64efe-c86b-4a4d-9645-424a5c1c9694 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:53.441834 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-fec64efe-c86b-4a4d-9645-424a5c1c9694 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:53.510987 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3445/6932] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:53.521594 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ded5e-d882-490a-b58d-2718d8191098 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:53.521888 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ded5e-d882-490a-b58d-2718d8191098 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:53.522168 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ded5e-d882-490a-b58d-2718d8191098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:53.549873 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec64efe-c86b-4a4d-9645-424a5c1c9694 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:53.552769 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec64efe-c86b-4a4d-9645-424a5c1c9694 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:53.600621 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3488/6933] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:07:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:07:53.620741 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-e36ded5e-d882-490a-b58d-2718d8191098 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:53.641687 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e36ded5e-d882-490a-b58d-2718d8191098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:53.671468 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3446/6934] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:53.675913 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec64efe-c86b-4a4d-9645-424a5c1c9694 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:53.690547 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec64efe-c86b-4a4d-9645-424a5c1c9694 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:53.699013 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0e061-5dfd-4f30-85b3-dc68eaba8f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:53.700873 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0e061-5dfd-4f30-85b3-dc68eaba8f9e admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:53.701578 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0e061-5dfd-4f30-85b3-dc68eaba8f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:53.702284 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0e061-5dfd-4f30-85b3-dc68eaba8f9e admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:53.703206 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0e061-5dfd-4f30-85b3-dc68eaba8f9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:07:53.704016 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0e061-5dfd-4f30-85b3-dc68eaba8f9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:53.709133 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0e061-5dfd-4f30-85b3-dc68eaba8f9e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:53.736156 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3489/6935] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:07:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:07:53.740500 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ded5e-d882-490a-b58d-2718d8191098 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:53.753716 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ded5e-d882-490a-b58d-2718d8191098 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:53.761188 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53155e8f-d653-4545-92bd-c4aa69bf2a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:53.761566 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53155e8f-d653-4545-92bd-c4aa69bf2a97 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:53.762030 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53155e8f-d653-4545-92bd-c4aa69bf2a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:53.763195 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53155e8f-d653-4545-92bd-c4aa69bf2a97 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:53.764852 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53155e8f-d653-4545-92bd-c4aa69bf2a97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:53.767915 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53155e8f-d653-4545-92bd-c4aa69bf2a97 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:53.836839 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0e061-5dfd-4f30-85b3-dc68eaba8f9e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:53.837050 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3447/6936] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:07:53 2022] POST /identity/v3/projects => generated 371 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:07:53.851716 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0e061-5dfd-4f30-85b3-dc68eaba8f9e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:54.016075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77507d17-f64a-4c2f-ab2c-1f52f89d3b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:54.018034 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77507d17-f64a-4c2f-ab2c-1f52f89d3b76 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:54.018326 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77507d17-f64a-4c2f-ab2c-1f52f89d3b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:54.018991 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77507d17-f64a-4c2f-ab2c-1f52f89d3b76 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:54.021596 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77507d17-f64a-4c2f-ab2c-1f52f89d3b76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:54.027443 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77507d17-f64a-4c2f-ab2c-1f52f89d3b76 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:54.104936 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3490/6937] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:07:53 2022] POST /identity/v3/users => generated 286 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:07:54.107218 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53155e8f-d653-4545-92bd-c4aa69bf2a97 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:54.129034 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53155e8f-d653-4545-92bd-c4aa69bf2a97 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:54.134107 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dcbf22-2043-44c1-bc93-d0f35576a325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:54.134755 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcbf22-2043-44c1-bc93-d0f35576a325 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:54.135074 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcbf22-2043-44c1-bc93-d0f35576a325 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:54.135344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcbf22-2043-44c1-bc93-d0f35576a325 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:54.135997 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dcbf22-2043-44c1-bc93-d0f35576a325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:54.141183 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dcbf22-2043-44c1-bc93-d0f35576a325 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:54.186502 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3448/6938] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:07:54.188040 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77507d17-f64a-4c2f-ab2c-1f52f89d3b76 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:54.209839 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77507d17-f64a-4c2f-ab2c-1f52f89d3b76 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:54.223413 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba2f7f-48a0-4059-a9ee-874fba2ec27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:54.224053 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba2f7f-48a0-4059-a9ee-874fba2ec27a admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:54.224331 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba2f7f-48a0-4059-a9ee-874fba2ec27a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:54.224601 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba2f7f-48a0-4059-a9ee-874fba2ec27a admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:54.225254 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba2f7f-48a0-4059-a9ee-874fba2ec27a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:54.229430 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba2f7f-48a0-4059-a9ee-874fba2ec27a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:54.251737 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3491/6939] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:07:54.253414 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dcbf22-2043-44c1-bc93-d0f35576a325 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:54.267263 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dcbf22-2043-44c1-bc93-d0f35576a325 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:54.281438 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83caab6-2bc0-4d9b-851b-a6693b5e9dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:54.282129 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83caab6-2bc0-4d9b-851b-a6693b5e9dd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:54.282407 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83caab6-2bc0-4d9b-851b-a6693b5e9dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:54.282678 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83caab6-2bc0-4d9b-851b-a6693b5e9dd8 admin admin] PATH_INFO: `/v3/projects/cd5d47e369c94980b3f0332e0e96bbeb/users/4f6177eafb574f6a875bd983fa908136/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:54.346538 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83caab6-2bc0-4d9b-851b-a6693b5e9dd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd5d47e369c94980b3f0332e0e96bbeb, user_id=4f6177eafb574f6a875bd983fa908136, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:54.352681 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83caab6-2bc0-4d9b-851b-a6693b5e9dd8 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:54.398823 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3449/6940] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:07:54 2022] PUT /identity/v3/projects/cd5d47e369c94980b3f0332e0e96bbeb/users/4f6177eafb574f6a875bd983fa908136/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:54.400656 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a3b1b-e3dd-4051-8fe3-c587ff7ddd8c None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:54.400943 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a3b1b-e3dd-4051-8fe3-c587ff7ddd8c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:54.401213 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a3b1b-e3dd-4051-8fe3-c587ff7ddd8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:54.478260 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-348a3b1b-e3dd-4051-8fe3-c587ff7ddd8c None None] MFA Rules not processed for user `4f6177eafb574f6a875bd983fa908136`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:54.481511 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-348a3b1b-e3dd-4051-8fe3-c587ff7ddd8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:54.670919 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3492/6941] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:54.677973 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83caab6-2bc0-4d9b-851b-a6693b5e9dd8 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:54.867411 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b89ec-6249-47fd-b31d-bee527685001 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:54.868025 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b89ec-6249-47fd-b31d-bee527685001 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:54.868940 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b89ec-6249-47fd-b31d-bee527685001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:54.915752 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83caab6-2bc0-4d9b-851b-a6693b5e9dd8 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:54.929302 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:54.938477 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec2950-d684-4950-ac5b-5f1532c35826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:54.939200 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec2950-d684-4950-ac5b-5f1532c35826 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:54.939486 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec2950-d684-4950-ac5b-5f1532c35826 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:54.939762 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec2950-d684-4950-ac5b-5f1532c35826 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:54.940781 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec2950-d684-4950-ac5b-5f1532c35826 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:54.943009 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec2950-d684-4950-ac5b-5f1532c35826 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:54.961330 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-9b4b89ec-6249-47fd-b31d-bee527685001 None None] MFA Rules not processed for user `0abe97082cd44d87b9fc6e51d21487c4`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:54.962458 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9b4b89ec-6249-47fd-b31d-bee527685001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:55.017528 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3450/6942] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:07:54 2022] POST /identity/v3/projects => generated 373 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:07:55.023012 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec2950-d684-4950-ac5b-5f1532c35826 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:55.058161 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:55.259217 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec2950-d684-4950-ac5b-5f1532c35826 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:55.281570 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd972ca1-f1c8-435d-a91d-c1178004c395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:55.282594 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd972ca1-f1c8-435d-a91d-c1178004c395 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:55.283151 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd972ca1-f1c8-435d-a91d-c1178004c395 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:55.283664 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd972ca1-f1c8-435d-a91d-c1178004c395 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:55.285003 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd972ca1-f1c8-435d-a91d-c1178004c395 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:55.303321 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd972ca1-f1c8-435d-a91d-c1178004c395 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:55.325441 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3493/6943] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:54 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:07:55.339183 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b89ec-6249-47fd-b31d-bee527685001 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:55.346668 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9b4b89ec-6249-47fd-b31d-bee527685001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:55.380403 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3451/6944] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:07:55 2022] POST /identity/v3/users => generated 293 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:07:55.384219 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd972ca1-f1c8-435d-a91d-c1178004c395 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:55.410689 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd972ca1-f1c8-435d-a91d-c1178004c395 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:55.424792 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27280bc1-e65b-4a36-a3c9-bc1d016ab2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:55.425576 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27280bc1-e65b-4a36-a3c9-bc1d016ab2ef admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:55.426981 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27280bc1-e65b-4a36-a3c9-bc1d016ab2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:55.428487 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27280bc1-e65b-4a36-a3c9-bc1d016ab2ef admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:55.430549 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27280bc1-e65b-4a36-a3c9-bc1d016ab2ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:55.435127 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27280bc1-e65b-4a36-a3c9-bc1d016ab2ef admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:55.461354 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3452/6945] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:07:55.466323 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27280bc1-e65b-4a36-a3c9-bc1d016ab2ef admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:55.502445 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27280bc1-e65b-4a36-a3c9-bc1d016ab2ef admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:55.518481 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d90ce37-524e-4b8e-b1a5-ddcd30e85ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:55.519355 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90ce37-524e-4b8e-b1a5-ddcd30e85ff4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:55.519746 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90ce37-524e-4b8e-b1a5-ddcd30e85ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:55.520082 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90ce37-524e-4b8e-b1a5-ddcd30e85ff4 admin admin] PATH_INFO: `/v3/projects/f4c022a008604d37bd2c31ae47ead820/users/d1608dfef38146d688beca53339ec492/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:55.524627 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b89ec-6249-47fd-b31d-bee527685001 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:55.563467 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d90ce37-524e-4b8e-b1a5-ddcd30e85ff4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4c022a008604d37bd2c31ae47ead820, user_id=d1608dfef38146d688beca53339ec492, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:55.566450 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d90ce37-524e-4b8e-b1a5-ddcd30e85ff4 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:55.620232 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3453/6946] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:07:55 2022] PUT /identity/v3/projects/f4c022a008604d37bd2c31ae47ead820/users/d1608dfef38146d688beca53339ec492/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:55.629658 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d90ce37-524e-4b8e-b1a5-ddcd30e85ff4 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:55.662237 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b7983-86eb-4fdf-8cb7-e9afbfc4f3ab service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6b0f9835ed549cab91d684326be83fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:55.664356 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b7983-86eb-4fdf-8cb7-e9afbfc4f3ab service glance] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:55.664748 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b7983-86eb-4fdf-8cb7-e9afbfc4f3ab service glance] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:55.665127 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b7983-86eb-4fdf-8cb7-e9afbfc4f3ab service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:55.675946 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-cc0b7983-86eb-4fdf-8cb7-e9afbfc4f3ab service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:55.810226 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0b7983-86eb-4fdf-8cb7-e9afbfc4f3ab service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:55.811941 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0b7983-86eb-4fdf-8cb7-e9afbfc4f3ab service glance] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:55.843658 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3494/6947] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:07:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:07:55.851485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d90ce37-524e-4b8e-b1a5-ddcd30e85ff4 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:55.857619 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf32e9-640e-475e-9a73-368b4fda3961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:55.858350 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf32e9-640e-475e-9a73-368b4fda3961 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:55.858628 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf32e9-640e-475e-9a73-368b4fda3961 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:55.858898 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf32e9-640e-475e-9a73-368b4fda3961 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:55.859592 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf32e9-640e-475e-9a73-368b4fda3961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:55.861293 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf32e9-640e-475e-9a73-368b4fda3961 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:55.877750 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3454/6948] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:07:55.883141 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b7983-86eb-4fdf-8cb7-e9afbfc4f3ab service glance] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:55.899887 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:55.908937 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b7983-86eb-4fdf-8cb7-e9afbfc4f3ab service glance] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:55.922783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab07adf-df30-4bad-bfab-9941597a5df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:55.923651 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab07adf-df30-4bad-bfab-9941597a5df9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:55.926439 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab07adf-df30-4bad-bfab-9941597a5df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:55.926893 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab07adf-df30-4bad-bfab-9941597a5df9 admin admin] PATH_INFO: `/v3/projects/f4c022a008604d37bd2c31ae47ead820/users/d1608dfef38146d688beca53339ec492/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:55.931924 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab07adf-df30-4bad-bfab-9941597a5df9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4c022a008604d37bd2c31ae47ead820, user_id=d1608dfef38146d688beca53339ec492, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:55.938237 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab07adf-df30-4bad-bfab-9941597a5df9 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:56.030156 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a48cbd-58fd-4815-98a3-a07baf7b2884 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:56.030577 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a48cbd-58fd-4815-98a3-a07baf7b2884 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:56.030961 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a48cbd-58fd-4815-98a3-a07baf7b2884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:56.037538 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3495/6949] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:07:55 2022] PUT /identity/v3/projects/f4c022a008604d37bd2c31ae47ead820/users/d1608dfef38146d688beca53339ec492/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:07:56.110331 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-63a48cbd-58fd-4815-98a3-a07baf7b2884 None None] MFA Rules not processed for user `d1608dfef38146d688beca53339ec492`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:56.111807 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-63a48cbd-58fd-4815-98a3-a07baf7b2884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:56.327914 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:56.383499 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3455/6950] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:07:56 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:56.384187 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab07adf-df30-4bad-bfab-9941597a5df9 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:56.406151 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab07adf-df30-4bad-bfab-9941597a5df9 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:56.430951 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93992998-f5df-4aab-a872-6d063ef8acc3 tempest-QuotasNegativeTest-2053875675 tempest-QuotasNegativeTest-2053875675-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1608dfef38146d688beca53339ec492', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4c022a008604d37bd2c31ae47ead820', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:56.431980 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93992998-f5df-4aab-a872-6d063ef8acc3 tempest-QuotasNegativeTest-2053875675 tempest-QuotasNegativeTest-2053875675-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:56.432456 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93992998-f5df-4aab-a872-6d063ef8acc3 tempest-QuotasNegativeTest-2053875675 tempest-QuotasNegativeTest-2053875675-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:56.432895 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93992998-f5df-4aab-a872-6d063ef8acc3 tempest-QuotasNegativeTest-2053875675 tempest-QuotasNegativeTest-2053875675-project-admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:56.433788 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93992998-f5df-4aab-a872-6d063ef8acc3 tempest-QuotasNegativeTest-2053875675 tempest-QuotasNegativeTest-2053875675-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:07:56.434773 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93992998-f5df-4aab-a872-6d063ef8acc3 tempest-QuotasNegativeTest-2053875675 tempest-QuotasNegativeTest-2053875675-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:56.436616 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93992998-f5df-4aab-a872-6d063ef8acc3 tempest-QuotasNegativeTest-2053875675 tempest-QuotasNegativeTest-2053875675-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:56.495928 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a48cbd-58fd-4815-98a3-a07baf7b2884 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:56.501810 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3496/6951] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:07:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:07:56.513303 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a48cbd-58fd-4815-98a3-a07baf7b2884 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:56.531138 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f5c9a-b2c6-40d8-ac19-30add906b520 tempest-QuotasNegativeTest-2053875675 tempest-QuotasNegativeTest-2053875675-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1608dfef38146d688beca53339ec492', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4c022a008604d37bd2c31ae47ead820', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:56.532038 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f5c9a-b2c6-40d8-ac19-30add906b520 tempest-QuotasNegativeTest-2053875675 tempest-QuotasNegativeTest-2053875675-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:56.540106 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f5c9a-b2c6-40d8-ac19-30add906b520 tempest-QuotasNegativeTest-2053875675 tempest-QuotasNegativeTest-2053875675-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:56.541396 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f5c9a-b2c6-40d8-ac19-30add906b520 tempest-QuotasNegativeTest-2053875675 tempest-QuotasNegativeTest-2053875675-project-admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:56.542786 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f5c9a-b2c6-40d8-ac19-30add906b520 tempest-QuotasNegativeTest-2053875675 tempest-QuotasNegativeTest-2053875675-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:56.547279 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f5c9a-b2c6-40d8-ac19-30add906b520 tempest-QuotasNegativeTest-2053875675 tempest-QuotasNegativeTest-2053875675-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:56.629359 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3456/6952] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:07:56 2022] POST /identity/v3/projects => generated 347 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:07:56.629866 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93992998-f5df-4aab-a872-6d063ef8acc3 tempest-QuotasNegativeTest-2053875675 tempest-QuotasNegativeTest-2053875675-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:56.658739 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93992998-f5df-4aab-a872-6d063ef8acc3 tempest-QuotasNegativeTest-2053875675 tempest-QuotasNegativeTest-2053875675-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:56.907585 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d503c1-dc8a-4992-8034-94803dde2423 tempest-QuotasNegativeTest-2053875675 tempest-QuotasNegativeTest-2053875675-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1608dfef38146d688beca53339ec492', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4c022a008604d37bd2c31ae47ead820', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:56.908224 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d503c1-dc8a-4992-8034-94803dde2423 tempest-QuotasNegativeTest-2053875675 tempest-QuotasNegativeTest-2053875675-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:56.908496 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d503c1-dc8a-4992-8034-94803dde2423 tempest-QuotasNegativeTest-2053875675 tempest-QuotasNegativeTest-2053875675-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:56.911046 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d503c1-dc8a-4992-8034-94803dde2423 tempest-QuotasNegativeTest-2053875675 tempest-QuotasNegativeTest-2053875675-project-admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:56.912970 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d503c1-dc8a-4992-8034-94803dde2423 tempest-QuotasNegativeTest-2053875675 tempest-QuotasNegativeTest-2053875675-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:07:56.913310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d503c1-dc8a-4992-8034-94803dde2423 tempest-QuotasNegativeTest-2053875675 tempest-QuotasNegativeTest-2053875675-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:56.916279 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d503c1-dc8a-4992-8034-94803dde2423 tempest-QuotasNegativeTest-2053875675 tempest-QuotasNegativeTest-2053875675-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:56.950804 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3497/6953] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:07:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:07:57.074499 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f5c9a-b2c6-40d8-ac19-30add906b520 tempest-QuotasNegativeTest-2053875675 tempest-QuotasNegativeTest-2053875675-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:57.234164 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f5c9a-b2c6-40d8-ac19-30add906b520 tempest-QuotasNegativeTest-2053875675 tempest-QuotasNegativeTest-2053875675-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:57.252968 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322960eb-bbe6-46aa-bfb9-cd35644d7535 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:57.253881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322960eb-bbe6-46aa-bfb9-cd35644d7535 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:57.254346 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322960eb-bbe6-46aa-bfb9-cd35644d7535 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:57.254775 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322960eb-bbe6-46aa-bfb9-cd35644d7535 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:57.290094 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322960eb-bbe6-46aa-bfb9-cd35644d7535 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:57.291619 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322960eb-bbe6-46aa-bfb9-cd35644d7535 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:57.333052 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3457/6954] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:07:57 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:08:03.910646 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d503c1-dc8a-4992-8034-94803dde2423 tempest-QuotasNegativeTest-2053875675 tempest-QuotasNegativeTest-2053875675-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:03.913585 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-93d503c1-dc8a-4992-8034-94803dde2423 tempest-QuotasNegativeTest-2053875675 tempest-QuotasNegativeTest-2053875675-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:04.058935 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d503c1-dc8a-4992-8034-94803dde2423 tempest-QuotasNegativeTest-2053875675 tempest-QuotasNegativeTest-2053875675-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:04.075832 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a189af-cdfb-4cdf-ad5b-6bfd1f7ed06e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:04.077460 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a189af-cdfb-4cdf-ad5b-6bfd1f7ed06e service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:04.078111 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a189af-cdfb-4cdf-ad5b-6bfd1f7ed06e service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:04.080538 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a189af-cdfb-4cdf-ad5b-6bfd1f7ed06e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:04.097750 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e5a189af-cdfb-4cdf-ad5b-6bfd1f7ed06e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:04.176456 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a189af-cdfb-4cdf-ad5b-6bfd1f7ed06e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:04.180591 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a189af-cdfb-4cdf-ad5b-6bfd1f7ed06e service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:04.257639 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3498/6955] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:08:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:08:05.605201 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322960eb-bbe6-46aa-bfb9-cd35644d7535 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:05.607302 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-322960eb-bbe6-46aa-bfb9-cd35644d7535 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:05.755750 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322960eb-bbe6-46aa-bfb9-cd35644d7535 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:05.766161 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2560e74-fdc9-42d1-aacc-c43f52221dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:05.770891 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2560e74-fdc9-42d1-aacc-c43f52221dd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:05.771342 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2560e74-fdc9-42d1-aacc-c43f52221dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:05.771728 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2560e74-fdc9-42d1-aacc-c43f52221dd5 admin admin] PATH_INFO: `/v3/users/362874933c9f47f18e70bb3fe9e8cb19` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:05.774206 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2560e74-fdc9-42d1-aacc-c43f52221dd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=362874933c9f47f18e70bb3fe9e8cb19)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:05.779862 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2560e74-fdc9-42d1-aacc-c43f52221dd5 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:05.914949 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e2560e74-fdc9-42d1-aacc-c43f52221dd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '362874933c9f47f18e70bb3fe9e8cb19'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:05.915911 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e2560e74-fdc9-42d1-aacc-c43f52221dd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '362874933c9f47f18e70bb3fe9e8cb19'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:05.942727 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e2560e74-fdc9-42d1-aacc-c43f52221dd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '362874933c9f47f18e70bb3fe9e8cb19'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:05.963326 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e2560e74-fdc9-42d1-aacc-c43f52221dd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '362874933c9f47f18e70bb3fe9e8cb19'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:05.964238 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:05.995571 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a189af-cdfb-4cdf-ad5b-6bfd1f7ed06e service placement] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:06.020260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e2560e74-fdc9-42d1-aacc-c43f52221dd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '362874933c9f47f18e70bb3fe9e8cb19'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:06.021709 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a189af-cdfb-4cdf-ad5b-6bfd1f7ed06e service placement] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:06.036594 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9b16f-39cd-429d-8736-6fcd7b3e9df5 tempest-QuotasNegativeTest-2053875675 tempest-QuotasNegativeTest-2053875675-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1608dfef38146d688beca53339ec492', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4c022a008604d37bd2c31ae47ead820', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:06.040818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9b16f-39cd-429d-8736-6fcd7b3e9df5 tempest-QuotasNegativeTest-2053875675 tempest-QuotasNegativeTest-2053875675-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:06.040818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9b16f-39cd-429d-8736-6fcd7b3e9df5 tempest-QuotasNegativeTest-2053875675 tempest-QuotasNegativeTest-2053875675-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:06.040818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9b16f-39cd-429d-8736-6fcd7b3e9df5 tempest-QuotasNegativeTest-2053875675 tempest-QuotasNegativeTest-2053875675-project-admin] PATH_INFO: `/v3/projects/a3309e4a03e64af69a7c2ce0ae8cf0b9` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:06.040818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f9b16f-39cd-429d-8736-6fcd7b3e9df5 tempest-QuotasNegativeTest-2053875675 tempest-QuotasNegativeTest-2053875675-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a3309e4a03e64af69a7c2ce0ae8cf0b9)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:06.044912 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f9b16f-39cd-429d-8736-6fcd7b3e9df5 tempest-QuotasNegativeTest-2053875675 tempest-QuotasNegativeTest-2053875675-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:06.050485 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3458/6956] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:08:05 2022] DELETE /identity/v3/users/362874933c9f47f18e70bb3fe9e8cb19 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:08:06.057697 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed246660-4397-4285-834f-60e005e7a3fc None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:06.057988 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed246660-4397-4285-834f-60e005e7a3fc None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:06.061751 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed246660-4397-4285-834f-60e005e7a3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:06.115770 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-ed246660-4397-4285-834f-60e005e7a3fc None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:08:06.119940 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ed246660-4397-4285-834f-60e005e7a3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:06.140998 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-37f9b16f-39cd-429d-8736-6fcd7b3e9df5 tempest-QuotasNegativeTest-2053875675 tempest-QuotasNegativeTest-2053875675-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3309e4a03e64af69a7c2ce0ae8cf0b9', 'request_id': 'req-37f9b16f-39cd-429d-8736-6fcd7b3e9df5'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:06.150232 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:06.154439 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-37f9b16f-39cd-429d-8736-6fcd7b3e9df5 tempest-QuotasNegativeTest-2053875675 tempest-QuotasNegativeTest-2053875675-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3309e4a03e64af69a7c2ce0ae8cf0b9', 'request_id': 'req-37f9b16f-39cd-429d-8736-6fcd7b3e9df5'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:06.184722 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-37f9b16f-39cd-429d-8736-6fcd7b3e9df5 tempest-QuotasNegativeTest-2053875675 tempest-QuotasNegativeTest-2053875675-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3309e4a03e64af69a7c2ce0ae8cf0b9', 'request_id': 'req-37f9b16f-39cd-429d-8736-6fcd7b3e9df5'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:06.220728 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-37f9b16f-39cd-429d-8736-6fcd7b3e9df5 tempest-QuotasNegativeTest-2053875675 tempest-QuotasNegativeTest-2053875675-project-admin] The token cache is being invalidate because project a3309e4a03e64af69a7c2ce0ae8cf0b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:08:06.222501 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-37f9b16f-39cd-429d-8736-6fcd7b3e9df5 tempest-QuotasNegativeTest-2053875675 tempest-QuotasNegativeTest-2053875675-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:06.224006 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-37f9b16f-39cd-429d-8736-6fcd7b3e9df5 tempest-QuotasNegativeTest-2053875675 tempest-QuotasNegativeTest-2053875675-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:06.233112 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3499/6957] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:08:05 2022] DELETE /identity/v3/projects/a3309e4a03e64af69a7c2ce0ae8cf0b9 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:08:06.234226 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9b16f-39cd-429d-8736-6fcd7b3e9df5 tempest-QuotasNegativeTest-2053875675 tempest-QuotasNegativeTest-2053875675-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:06.240593 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-37f9b16f-39cd-429d-8736-6fcd7b3e9df5 tempest-QuotasNegativeTest-2053875675 tempest-QuotasNegativeTest-2053875675-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:06.247905 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3459/6958] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:08:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:08:06.260650 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed246660-4397-4285-834f-60e005e7a3fc None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:06.262905 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ed246660-4397-4285-834f-60e005e7a3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:06.287442 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9b16f-39cd-429d-8736-6fcd7b3e9df5 tempest-QuotasNegativeTest-2053875675 tempest-QuotasNegativeTest-2053875675-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:06.306885 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56571ae2-b72a-4f3f-8f40-3ccdd8b95dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:06.307689 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56571ae2-b72a-4f3f-8f40-3ccdd8b95dbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:06.309954 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56571ae2-b72a-4f3f-8f40-3ccdd8b95dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:06.312047 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56571ae2-b72a-4f3f-8f40-3ccdd8b95dbd admin admin] PATH_INFO: `/v3/users/4f6177eafb574f6a875bd983fa908136` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:06.320223 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56571ae2-b72a-4f3f-8f40-3ccdd8b95dbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f6177eafb574f6a875bd983fa908136)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:06.323394 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56571ae2-b72a-4f3f-8f40-3ccdd8b95dbd admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:06.350590 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed246660-4397-4285-834f-60e005e7a3fc None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:06.356525 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed5696-c422-400c-9497-249854f84471 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:06.357139 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed5696-c422-400c-9497-249854f84471 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:06.357423 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed5696-c422-400c-9497-249854f84471 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:06.357706 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed5696-c422-400c-9497-249854f84471 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:06.385248 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed5696-c422-400c-9497-249854f84471 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:06.386744 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed5696-c422-400c-9497-249854f84471 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:06.408610 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3460/6959] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:08:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:08:06.474565 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-56571ae2-b72a-4f3f-8f40-3ccdd8b95dbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f6177eafb574f6a875bd983fa908136'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:06.478590 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-56571ae2-b72a-4f3f-8f40-3ccdd8b95dbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f6177eafb574f6a875bd983fa908136'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:06.531896 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-56571ae2-b72a-4f3f-8f40-3ccdd8b95dbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f6177eafb574f6a875bd983fa908136'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:06.598816 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-56571ae2-b72a-4f3f-8f40-3ccdd8b95dbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f6177eafb574f6a875bd983fa908136'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:06.599827 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-56571ae2-b72a-4f3f-8f40-3ccdd8b95dbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f6177eafb574f6a875bd983fa908136'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:06.649524 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3500/6960] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:08:06 2022] DELETE /identity/v3/users/4f6177eafb574f6a875bd983fa908136 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:08:06.654541 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17af159-8941-4e1d-87de-cbb2bcea647c None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:06.655073 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17af159-8941-4e1d-87de-cbb2bcea647c None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:06.655177 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17af159-8941-4e1d-87de-cbb2bcea647c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:06.688629 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-e17af159-8941-4e1d-87de-cbb2bcea647c None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:08:06.689871 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e17af159-8941-4e1d-87de-cbb2bcea647c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:06.822547 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3461/6961] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:08:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:08:07.016682 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56571ae2-b72a-4f3f-8f40-3ccdd8b95dbd admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:07.031124 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-56571ae2-b72a-4f3f-8f40-3ccdd8b95dbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:07.187973 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56571ae2-b72a-4f3f-8f40-3ccdd8b95dbd admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:07.193881 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92739d46-a3a3-4c94-8ae2-f37859956d7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:07.194698 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92739d46-a3a3-4c94-8ae2-f37859956d7d service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:07.195105 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92739d46-a3a3-4c94-8ae2-f37859956d7d service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:07.195483 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92739d46-a3a3-4c94-8ae2-f37859956d7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:07.212128 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92739d46-a3a3-4c94-8ae2-f37859956d7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:07.212128 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92739d46-a3a3-4c94-8ae2-f37859956d7d service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:07.225208 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3501/6962] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:08:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:08:07.758789 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17af159-8941-4e1d-87de-cbb2bcea647c None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:07.765033 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e17af159-8941-4e1d-87de-cbb2bcea647c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:07.843290 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17af159-8941-4e1d-87de-cbb2bcea647c None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:07.859847 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f5fb7-b96d-453d-af7b-113f6cdf665a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:07.882848 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f5fb7-b96d-453d-af7b-113f6cdf665a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:07.883604 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f5fb7-b96d-453d-af7b-113f6cdf665a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:07.886359 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f5fb7-b96d-453d-af7b-113f6cdf665a admin admin] PATH_INFO: `/v3/projects/d969699a1f4a415a9dec415fafafb985` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:07.891364 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f5fb7-b96d-453d-af7b-113f6cdf665a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d969699a1f4a415a9dec415fafafb985)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:07.904846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f5fb7-b96d-453d-af7b-113f6cdf665a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:08.033905 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:08.105871 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0b7f5fb7-b96d-453d-af7b-113f6cdf665a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd969699a1f4a415a9dec415fafafb985', 'request_id': 'req-0b7f5fb7-b96d-453d-af7b-113f6cdf665a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:08.125219 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0b7f5fb7-b96d-453d-af7b-113f6cdf665a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd969699a1f4a415a9dec415fafafb985', 'request_id': 'req-0b7f5fb7-b96d-453d-af7b-113f6cdf665a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:08.150562 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0b7f5fb7-b96d-453d-af7b-113f6cdf665a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd969699a1f4a415a9dec415fafafb985', 'request_id': 'req-0b7f5fb7-b96d-453d-af7b-113f6cdf665a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:08.205707 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0b7f5fb7-b96d-453d-af7b-113f6cdf665a admin admin] The token cache is being invalidate because project d969699a1f4a415a9dec415fafafb985 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:08:08.206002 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0b7f5fb7-b96d-453d-af7b-113f6cdf665a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:08.223784 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0b7f5fb7-b96d-453d-af7b-113f6cdf665a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:08.235392 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3462/6963] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:08:07 2022] DELETE /identity/v3/projects/d969699a1f4a415a9dec415fafafb985 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:08:08.239836 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92739d46-a3a3-4c94-8ae2-f37859956d7d service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:08.270187 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92739d46-a3a3-4c94-8ae2-f37859956d7d service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:08.442445 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b914b1-5cad-404f-8564-9ec08cefd353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:08.443567 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b914b1-5cad-404f-8564-9ec08cefd353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:08.444073 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b914b1-5cad-404f-8564-9ec08cefd353 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:08.444523 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b914b1-5cad-404f-8564-9ec08cefd353 admin admin] PATH_INFO: `/v3/users/f624a6c6800d49d6835d8aa6fda202d7` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:08.448470 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b914b1-5cad-404f-8564-9ec08cefd353 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f624a6c6800d49d6835d8aa6fda202d7)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:08.452349 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b914b1-5cad-404f-8564-9ec08cefd353 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:08.457445 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:08.551692 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f5fb7-b96d-453d-af7b-113f6cdf665a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:08.555890 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0b7f5fb7-b96d-453d-af7b-113f6cdf665a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:08.610682 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f5fb7-b96d-453d-af7b-113f6cdf665a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:08.632258 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee210a-45f2-41a1-94ac-3fef51be4993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:08.632893 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee210a-45f2-41a1-94ac-3fef51be4993 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:08.634410 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee210a-45f2-41a1-94ac-3fef51be4993 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:08.634764 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee210a-45f2-41a1-94ac-3fef51be4993 admin admin] PATH_INFO: `/v3/projects/cd5d47e369c94980b3f0332e0e96bbeb` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:08.641641 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee210a-45f2-41a1-94ac-3fef51be4993 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd5d47e369c94980b3f0332e0e96bbeb)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:08.646919 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee210a-45f2-41a1-94ac-3fef51be4993 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:08.651405 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c4b914b1-5cad-404f-8564-9ec08cefd353 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f624a6c6800d49d6835d8aa6fda202d7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:08.653046 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c4b914b1-5cad-404f-8564-9ec08cefd353 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f624a6c6800d49d6835d8aa6fda202d7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:08.693794 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c4b914b1-5cad-404f-8564-9ec08cefd353 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f624a6c6800d49d6835d8aa6fda202d7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:08.721291 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c4b914b1-5cad-404f-8564-9ec08cefd353 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f624a6c6800d49d6835d8aa6fda202d7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:08.721986 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c4b914b1-5cad-404f-8564-9ec08cefd353 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f624a6c6800d49d6835d8aa6fda202d7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:08.782410 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3502/6964] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:08:08 2022] DELETE /identity/v3/users/f624a6c6800d49d6835d8aa6fda202d7 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:08:08.866899 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5aee210a-45f2-41a1-94ac-3fef51be4993 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd5d47e369c94980b3f0332e0e96bbeb', 'request_id': 'req-5aee210a-45f2-41a1-94ac-3fef51be4993'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:08.883213 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5aee210a-45f2-41a1-94ac-3fef51be4993 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd5d47e369c94980b3f0332e0e96bbeb', 'request_id': 'req-5aee210a-45f2-41a1-94ac-3fef51be4993'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:08.898004 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5aee210a-45f2-41a1-94ac-3fef51be4993 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd5d47e369c94980b3f0332e0e96bbeb', 'request_id': 'req-5aee210a-45f2-41a1-94ac-3fef51be4993'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:08.930403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5aee210a-45f2-41a1-94ac-3fef51be4993 admin admin] The token cache is being invalidate because project cd5d47e369c94980b3f0332e0e96bbeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:08:08.930858 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5aee210a-45f2-41a1-94ac-3fef51be4993 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:08.931719 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5aee210a-45f2-41a1-94ac-3fef51be4993 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:08.933412 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3463/6965] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:08:08 2022] DELETE /identity/v3/projects/cd5d47e369c94980b3f0332e0e96bbeb => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:08:08.938826 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b914b1-5cad-404f-8564-9ec08cefd353 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:08.940346 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c4b914b1-5cad-404f-8564-9ec08cefd353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:09.145773 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b914b1-5cad-404f-8564-9ec08cefd353 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:09.341814 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811e27d2-4e8b-4d17-9a46-7590886e91d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:09.343264 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e27d2-4e8b-4d17-9a46-7590886e91d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:09.343722 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e27d2-4e8b-4d17-9a46-7590886e91d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:09.344169 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e27d2-4e8b-4d17-9a46-7590886e91d8 admin admin] PATH_INFO: `/v3/users/d1608dfef38146d688beca53339ec492` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:09.345559 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811e27d2-4e8b-4d17-9a46-7590886e91d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1608dfef38146d688beca53339ec492)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:09.349381 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811e27d2-4e8b-4d17-9a46-7590886e91d8 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:09.397342 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:09.431912 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-811e27d2-4e8b-4d17-9a46-7590886e91d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1608dfef38146d688beca53339ec492'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:09.433109 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-811e27d2-4e8b-4d17-9a46-7590886e91d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1608dfef38146d688beca53339ec492'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:09.446638 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-811e27d2-4e8b-4d17-9a46-7590886e91d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1608dfef38146d688beca53339ec492'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:09.459894 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-811e27d2-4e8b-4d17-9a46-7590886e91d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1608dfef38146d688beca53339ec492'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:09.461777 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-811e27d2-4e8b-4d17-9a46-7590886e91d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1608dfef38146d688beca53339ec492'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:09.491732 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3503/6966] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:08:08 2022] DELETE /identity/v3/users/d1608dfef38146d688beca53339ec492 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:08:09.885221 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee210a-45f2-41a1-94ac-3fef51be4993 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:09.889619 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5aee210a-45f2-41a1-94ac-3fef51be4993 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:09.920961 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee210a-45f2-41a1-94ac-3fef51be4993 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:10.171809 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c89928-3357-446b-b194-a8178c2e545c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:10.172680 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c89928-3357-446b-b194-a8178c2e545c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:10.182711 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c89928-3357-446b-b194-a8178c2e545c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:10.186474 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c89928-3357-446b-b194-a8178c2e545c admin admin] PATH_INFO: `/v3/projects/d34da1ae384245299acb4feef22187e1` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:10.190158 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c89928-3357-446b-b194-a8178c2e545c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d34da1ae384245299acb4feef22187e1)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:10.193753 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c89928-3357-446b-b194-a8178c2e545c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:10.378485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:10.394825 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-37c89928-3357-446b-b194-a8178c2e545c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd34da1ae384245299acb4feef22187e1', 'request_id': 'req-37c89928-3357-446b-b194-a8178c2e545c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:10.414266 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-37c89928-3357-446b-b194-a8178c2e545c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd34da1ae384245299acb4feef22187e1', 'request_id': 'req-37c89928-3357-446b-b194-a8178c2e545c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:10.437972 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-37c89928-3357-446b-b194-a8178c2e545c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd34da1ae384245299acb4feef22187e1', 'request_id': 'req-37c89928-3357-446b-b194-a8178c2e545c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:10.485182 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-37c89928-3357-446b-b194-a8178c2e545c admin admin] The token cache is being invalidate because project d34da1ae384245299acb4feef22187e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:08:10.485440 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-37c89928-3357-446b-b194-a8178c2e545c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:10.486174 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-37c89928-3357-446b-b194-a8178c2e545c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:10.488524 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3464/6967] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:08:09 2022] DELETE /identity/v3/projects/d34da1ae384245299acb4feef22187e1 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:08:10.492221 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811e27d2-4e8b-4d17-9a46-7590886e91d8 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:10.493877 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-811e27d2-4e8b-4d17-9a46-7590886e91d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:10.552990 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811e27d2-4e8b-4d17-9a46-7590886e91d8 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:10.600300 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c89928-3357-446b-b194-a8178c2e545c admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:10.602135 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-37c89928-3357-446b-b194-a8178c2e545c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:10.743346 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2274f065-e7e4-4f62-84a9-b8e3a1b314df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:10.746734 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274f065-e7e4-4f62-84a9-b8e3a1b314df admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:10.747570 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274f065-e7e4-4f62-84a9-b8e3a1b314df admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:10.749009 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274f065-e7e4-4f62-84a9-b8e3a1b314df admin admin] PATH_INFO: `/v3/users/e92fae99a3064d7ea20ff46bbec35959` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:10.752132 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2274f065-e7e4-4f62-84a9-b8e3a1b314df admin admin] RBAC: Authorizing `identity:delete_user(user_id=e92fae99a3064d7ea20ff46bbec35959)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:10.759799 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2274f065-e7e4-4f62-84a9-b8e3a1b314df admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:10.851750 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c89928-3357-446b-b194-a8178c2e545c admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:10.865486 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e4113a-cb16-46b2-9dc2-76fee46ef3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:10.867269 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e4113a-cb16-46b2-9dc2-76fee46ef3ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:10.868319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e4113a-cb16-46b2-9dc2-76fee46ef3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:10.868962 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e4113a-cb16-46b2-9dc2-76fee46ef3ff admin admin] PATH_INFO: `/v3/projects/f4c022a008604d37bd2c31ae47ead820` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:10.873170 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e4113a-cb16-46b2-9dc2-76fee46ef3ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4c022a008604d37bd2c31ae47ead820)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:10.879053 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e4113a-cb16-46b2-9dc2-76fee46ef3ff admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:10.906442 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2274f065-e7e4-4f62-84a9-b8e3a1b314df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e92fae99a3064d7ea20ff46bbec35959'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:10.909375 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2274f065-e7e4-4f62-84a9-b8e3a1b314df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e92fae99a3064d7ea20ff46bbec35959'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:10.942645 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2274f065-e7e4-4f62-84a9-b8e3a1b314df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e92fae99a3064d7ea20ff46bbec35959'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:10.951960 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2274f065-e7e4-4f62-84a9-b8e3a1b314df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e92fae99a3064d7ea20ff46bbec35959'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:10.953474 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2274f065-e7e4-4f62-84a9-b8e3a1b314df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e92fae99a3064d7ea20ff46bbec35959'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:11.009417 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-03e4113a-cb16-46b2-9dc2-76fee46ef3ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4c022a008604d37bd2c31ae47ead820', 'request_id': 'req-03e4113a-cb16-46b2-9dc2-76fee46ef3ff'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:11.015796 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3504/6968] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:08:10 2022] DELETE /identity/v3/users/e92fae99a3064d7ea20ff46bbec35959 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:08:11.039714 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-03e4113a-cb16-46b2-9dc2-76fee46ef3ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4c022a008604d37bd2c31ae47ead820', 'request_id': 'req-03e4113a-cb16-46b2-9dc2-76fee46ef3ff'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:11.066605 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-03e4113a-cb16-46b2-9dc2-76fee46ef3ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4c022a008604d37bd2c31ae47ead820', 'request_id': 'req-03e4113a-cb16-46b2-9dc2-76fee46ef3ff'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:11.091462 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-03e4113a-cb16-46b2-9dc2-76fee46ef3ff admin admin] The token cache is being invalidate because project f4c022a008604d37bd2c31ae47ead820 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:08:11.091801 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-03e4113a-cb16-46b2-9dc2-76fee46ef3ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:11.092506 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-03e4113a-cb16-46b2-9dc2-76fee46ef3ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:11.094767 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3465/6969] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:08:10 2022] DELETE /identity/v3/projects/f4c022a008604d37bd2c31ae47ead820 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:08:11.101708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551cfd00-9ce0-4ff3-91c3-f59fca5a7628 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:11.102025 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551cfd00-9ce0-4ff3-91c3-f59fca5a7628 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:11.102294 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551cfd00-9ce0-4ff3-91c3-f59fca5a7628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:11.135719 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-551cfd00-9ce0-4ff3-91c3-f59fca5a7628 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:08:11.138837 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-551cfd00-9ce0-4ff3-91c3-f59fca5a7628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:11.205563 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:11.330196 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3505/6970] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:08:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:08:11.330731 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69953e5b-01d4-4523-9626-2af318a8f61f None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:11.331059 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69953e5b-01d4-4523-9626-2af318a8f61f None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:11.331333 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69953e5b-01d4-4523-9626-2af318a8f61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:11.381853 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-69953e5b-01d4-4523-9626-2af318a8f61f None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:08:11.385170 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-69953e5b-01d4-4523-9626-2af318a8f61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:11.407444 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3466/6971] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:08:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:08:11.410345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551cfd00-9ce0-4ff3-91c3-f59fca5a7628 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:11.425278 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551cfd00-9ce0-4ff3-91c3-f59fca5a7628 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:11.438056 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e4c56-0a11-4a8c-9291-b84c23abb520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:11.438703 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e4c56-0a11-4a8c-9291-b84c23abb520 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:11.438985 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e4c56-0a11-4a8c-9291-b84c23abb520 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:11.441496 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e4c56-0a11-4a8c-9291-b84c23abb520 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:11.442367 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7e4c56-0a11-4a8c-9291-b84c23abb520 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:08:11.444287 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7e4c56-0a11-4a8c-9291-b84c23abb520 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:11.452292 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7e4c56-0a11-4a8c-9291-b84c23abb520 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:11.479187 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3506/6972] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:08:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:08:11.484291 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69953e5b-01d4-4523-9626-2af318a8f61f None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:11.497136 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69953e5b-01d4-4523-9626-2af318a8f61f None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:11.523940 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f44c6f-e96e-4917-b279-b44aa7a94338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:11.524805 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f44c6f-e96e-4917-b279-b44aa7a94338 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:11.525554 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f44c6f-e96e-4917-b279-b44aa7a94338 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:11.525832 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f44c6f-e96e-4917-b279-b44aa7a94338 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:11.526493 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f44c6f-e96e-4917-b279-b44aa7a94338 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:11.534436 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f44c6f-e96e-4917-b279-b44aa7a94338 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:11.609242 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3467/6973] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:08:11 2022] POST /identity/v3/projects => generated 389 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:08:11.613138 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e4c56-0a11-4a8c-9291-b84c23abb520 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:11.629320 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e4c56-0a11-4a8c-9291-b84c23abb520 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:11.782335 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977704a-a422-455d-b8ea-570b0f16aef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:11.782987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977704a-a422-455d-b8ea-570b0f16aef9 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:11.783363 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977704a-a422-455d-b8ea-570b0f16aef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:11.783684 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977704a-a422-455d-b8ea-570b0f16aef9 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:11.784300 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2977704a-a422-455d-b8ea-570b0f16aef9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:11.791382 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2977704a-a422-455d-b8ea-570b0f16aef9 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:11.859108 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f44c6f-e96e-4917-b279-b44aa7a94338 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:11.869373 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3507/6974] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:08:11 2022] POST /identity/v3/users => generated 295 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:08:11.877573 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f44c6f-e96e-4917-b279-b44aa7a94338 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:11.894720 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b49b6-8057-4633-80ae-d932eb60314b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:11.896677 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b49b6-8057-4633-80ae-d932eb60314b admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:11.899251 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b49b6-8057-4633-80ae-d932eb60314b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:11.899537 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b49b6-8057-4633-80ae-d932eb60314b admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:11.900206 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b49b6-8057-4633-80ae-d932eb60314b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:11.901883 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b49b6-8057-4633-80ae-d932eb60314b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:11.951407 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3468/6975] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:08:11 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:08:11.955471 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977704a-a422-455d-b8ea-570b0f16aef9 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:12.003058 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977704a-a422-455d-b8ea-570b0f16aef9 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:12.010639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b016cf0-a574-4c40-acc2-a0e5c5d5068b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:12.010639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b016cf0-a574-4c40-acc2-a0e5c5d5068b admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:12.010639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b016cf0-a574-4c40-acc2-a0e5c5d5068b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:12.010639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b016cf0-a574-4c40-acc2-a0e5c5d5068b admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:12.011312 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b016cf0-a574-4c40-acc2-a0e5c5d5068b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:12.015582 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b016cf0-a574-4c40-acc2-a0e5c5d5068b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:12.058155 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3508/6976] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:08:11 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:08:12.062548 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b49b6-8057-4633-80ae-d932eb60314b admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:12.087716 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b49b6-8057-4633-80ae-d932eb60314b admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:12.118329 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc793385-aaee-4735-9c9b-744975b61bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:12.119743 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc793385-aaee-4735-9c9b-744975b61bc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:12.122510 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc793385-aaee-4735-9c9b-744975b61bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:12.123641 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc793385-aaee-4735-9c9b-744975b61bc1 admin admin] PATH_INFO: `/v3/projects/d1952d83b83e44b8ac215ad2ebccd994/users/5c92d1f12afa418a9c516104bc9484c9/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:12.167657 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc793385-aaee-4735-9c9b-744975b61bc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1952d83b83e44b8ac215ad2ebccd994, user_id=5c92d1f12afa418a9c516104bc9484c9, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:12.176272 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc793385-aaee-4735-9c9b-744975b61bc1 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:12.180452 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:12.200091 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3469/6977] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:08:12 2022] PUT /identity/v3/projects/d1952d83b83e44b8ac215ad2ebccd994/users/5c92d1f12afa418a9c516104bc9484c9/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:08:12.211846 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51c673-b8e0-45bf-a1f2-6159624060e6 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:12.212357 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51c673-b8e0-45bf-a1f2-6159624060e6 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:12.213216 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51c673-b8e0-45bf-a1f2-6159624060e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:12.286827 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-2e51c673-b8e0-45bf-a1f2-6159624060e6 None None] MFA Rules not processed for user `5c92d1f12afa418a9c516104bc9484c9`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:08:12.288952 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2e51c673-b8e0-45bf-a1f2-6159624060e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:12.551197 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3509/6978] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:08:12 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:08:12.594545 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc793385-aaee-4735-9c9b-744975b61bc1 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:12.598038 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-cc793385-aaee-4735-9c9b-744975b61bc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:12.758614 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc793385-aaee-4735-9c9b-744975b61bc1 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:12.779429 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e46d7-8d87-4863-b7c2-4b0f688c43a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:12.781188 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e46d7-8d87-4863-b7c2-4b0f688c43a1 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:12.781613 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e46d7-8d87-4863-b7c2-4b0f688c43a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:12.781990 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e46d7-8d87-4863-b7c2-4b0f688c43a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:12.799249 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e46d7-8d87-4863-b7c2-4b0f688c43a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:12.803715 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e46d7-8d87-4863-b7c2-4b0f688c43a1 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:12.823866 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3470/6979] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:08:12 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:08:12.877982 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51c673-b8e0-45bf-a1f2-6159624060e6 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:12.980487 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:13.108024 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51c673-b8e0-45bf-a1f2-6159624060e6 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:13.122457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031edf52-9d8f-4680-a176-65d66125392a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:13.123644 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031edf52-9d8f-4680-a176-65d66125392a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:13.124292 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031edf52-9d8f-4680-a176-65d66125392a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:13.124954 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031edf52-9d8f-4680-a176-65d66125392a admin admin] PATH_INFO: `/v3/users/5c92d1f12afa418a9c516104bc9484c9` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:13.127851 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031edf52-9d8f-4680-a176-65d66125392a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c92d1f12afa418a9c516104bc9484c9)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:13.130047 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031edf52-9d8f-4680-a176-65d66125392a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:13.139782 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e46d7-8d87-4863-b7c2-4b0f688c43a1 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:13.142527 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-828e46d7-8d87-4863-b7c2-4b0f688c43a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:13.176454 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e46d7-8d87-4863-b7c2-4b0f688c43a1 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:13.192469 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948cdbb5-79dc-452e-bd9c-faf376b70d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:13.193746 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948cdbb5-79dc-452e-bd9c-faf376b70d3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:13.194282 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948cdbb5-79dc-452e-bd9c-faf376b70d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:13.194570 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948cdbb5-79dc-452e-bd9c-faf376b70d3c admin admin] PATH_INFO: `/v3/projects/54e11a13aaf84e258795abfee24304f6` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:13.199206 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948cdbb5-79dc-452e-bd9c-faf376b70d3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=54e11a13aaf84e258795abfee24304f6)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:13.204597 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948cdbb5-79dc-452e-bd9c-faf376b70d3c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:13.327396 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-031edf52-9d8f-4680-a176-65d66125392a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c92d1f12afa418a9c516104bc9484c9'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:13.329763 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-031edf52-9d8f-4680-a176-65d66125392a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c92d1f12afa418a9c516104bc9484c9'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:13.361860 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-031edf52-9d8f-4680-a176-65d66125392a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c92d1f12afa418a9c516104bc9484c9'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:13.412331 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-031edf52-9d8f-4680-a176-65d66125392a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c92d1f12afa418a9c516104bc9484c9'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:13.413156 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-031edf52-9d8f-4680-a176-65d66125392a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c92d1f12afa418a9c516104bc9484c9'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:13.425056 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-948cdbb5-79dc-452e-bd9c-faf376b70d3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54e11a13aaf84e258795abfee24304f6', 'request_id': 'req-948cdbb5-79dc-452e-bd9c-faf376b70d3c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:13.440739 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-948cdbb5-79dc-452e-bd9c-faf376b70d3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54e11a13aaf84e258795abfee24304f6', 'request_id': 'req-948cdbb5-79dc-452e-bd9c-faf376b70d3c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:13.462030 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-948cdbb5-79dc-452e-bd9c-faf376b70d3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54e11a13aaf84e258795abfee24304f6', 'request_id': 'req-948cdbb5-79dc-452e-bd9c-faf376b70d3c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:13.469419 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3510/6980] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:08:12 2022] DELETE /identity/v3/users/5c92d1f12afa418a9c516104bc9484c9 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:08:13.477474 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b14ec8-dc2d-4861-81ae-9831c3b617bd None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:13.479558 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b14ec8-dc2d-4861-81ae-9831c3b617bd None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:13.485998 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b14ec8-dc2d-4861-81ae-9831c3b617bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:13.500019 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-948cdbb5-79dc-452e-bd9c-faf376b70d3c admin admin] The token cache is being invalidate because project 54e11a13aaf84e258795abfee24304f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:08:13.500330 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-948cdbb5-79dc-452e-bd9c-faf376b70d3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:13.501309 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-948cdbb5-79dc-452e-bd9c-faf376b70d3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:13.506663 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3471/6981] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:08:13 2022] DELETE /identity/v3/projects/54e11a13aaf84e258795abfee24304f6 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:08:13.509416 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce69a5-89ac-4899-81ca-731dc1ccbf41 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:13.509776 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce69a5-89ac-4899-81ca-731dc1ccbf41 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:13.510125 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce69a5-89ac-4899-81ca-731dc1ccbf41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:13.531088 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-b9b14ec8-dc2d-4861-81ae-9831c3b617bd None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:08:13.533128 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b9b14ec8-dc2d-4861-81ae-9831c3b617bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:13.548377 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-a4ce69a5-89ac-4899-81ca-731dc1ccbf41 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:08:13.548712 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a4ce69a5-89ac-4899-81ca-731dc1ccbf41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:13.681961 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3472/6982] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:08:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:08:13.690993 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51823584-7aea-4484-ad8f-5ec15e7c031d None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:13.691565 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51823584-7aea-4484-ad8f-5ec15e7c031d None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:13.692007 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51823584-7aea-4484-ad8f-5ec15e7c031d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:13.696794 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3511/6983] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:08:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:08:13.723556 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-51823584-7aea-4484-ad8f-5ec15e7c031d None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:08:13.725629 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-51823584-7aea-4484-ad8f-5ec15e7c031d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:13.728370 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b14ec8-dc2d-4861-81ae-9831c3b617bd None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:13.729861 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b9b14ec8-dc2d-4861-81ae-9831c3b617bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:13.739312 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3473/6984] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:08:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:08:13.744689 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51823584-7aea-4484-ad8f-5ec15e7c031d None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:13.765020 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51823584-7aea-4484-ad8f-5ec15e7c031d None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:13.773579 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f258f79-a216-4412-b424-9e02adafd581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:13.775163 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f258f79-a216-4412-b424-9e02adafd581 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:13.775611 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f258f79-a216-4412-b424-9e02adafd581 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:13.779148 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f258f79-a216-4412-b424-9e02adafd581 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:13.780215 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f258f79-a216-4412-b424-9e02adafd581 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:08:13.781004 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f258f79-a216-4412-b424-9e02adafd581 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:13.782765 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f258f79-a216-4412-b424-9e02adafd581 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:13.801093 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3474/6985] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:08:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:08:13.805734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f258f79-a216-4412-b424-9e02adafd581 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:13.814889 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:13.823645 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f258f79-a216-4412-b424-9e02adafd581 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:13.839881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a507b-5a02-4b3e-a515-ec33403fb91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:13.841838 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a507b-5a02-4b3e-a515-ec33403fb91c admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:13.842182 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a507b-5a02-4b3e-a515-ec33403fb91c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:13.842522 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a507b-5a02-4b3e-a515-ec33403fb91c admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:13.845144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a507b-5a02-4b3e-a515-ec33403fb91c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:13.851581 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a507b-5a02-4b3e-a515-ec33403fb91c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:13.869737 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:13.921062 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b14ec8-dc2d-4861-81ae-9831c3b617bd None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:13.922704 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3475/6986] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:08:13 2022] POST /identity/v3/projects => generated 371 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:08:13.924473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a507b-5a02-4b3e-a515-ec33403fb91c admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:14.022886 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f90f5-d3b6-4ad6-a4b2-501e3ae48781 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:14.024419 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f90f5-d3b6-4ad6-a4b2-501e3ae48781 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:14.024918 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f90f5-d3b6-4ad6-a4b2-501e3ae48781 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:14.027007 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f90f5-d3b6-4ad6-a4b2-501e3ae48781 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:14.078278 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a507b-5a02-4b3e-a515-ec33403fb91c admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:14.090528 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8b8f2-4253-4a9e-a0f9-155fb51a4714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:14.092746 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8b8f2-4253-4a9e-a0f9-155fb51a4714 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:14.093045 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8b8f2-4253-4a9e-a0f9-155fb51a4714 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:14.093326 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8b8f2-4253-4a9e-a0f9-155fb51a4714 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:14.096325 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe8b8f2-4253-4a9e-a0f9-155fb51a4714 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:14.098457 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe8b8f2-4253-4a9e-a0f9-155fb51a4714 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:14.143954 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f90f5-d3b6-4ad6-a4b2-501e3ae48781 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:14.145429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f90f5-d3b6-4ad6-a4b2-501e3ae48781 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:14.160450 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3512/6987] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:08:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:08:14.176921 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f90f5-d3b6-4ad6-a4b2-501e3ae48781 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:14.185185 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3476/6988] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:08:13 2022] POST /identity/v3/users => generated 286 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:08:14.196207 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f90f5-d3b6-4ad6-a4b2-501e3ae48781 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:14.202864 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e2b88e-5ea2-46c6-bf68-97989af905f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:14.203870 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2b88e-5ea2-46c6-bf68-97989af905f0 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:14.204230 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2b88e-5ea2-46c6-bf68-97989af905f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:14.204564 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2b88e-5ea2-46c6-bf68-97989af905f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:14.205881 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e2b88e-5ea2-46c6-bf68-97989af905f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:14.207756 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e2b88e-5ea2-46c6-bf68-97989af905f0 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:14.220913 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3513/6989] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:08:14 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:08:14.224776 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8b8f2-4253-4a9e-a0f9-155fb51a4714 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:14.241056 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8b8f2-4253-4a9e-a0f9-155fb51a4714 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:14.247075 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b65eed-dd4e-45de-a7ec-a1e1dbe5ee25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:14.247700 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b65eed-dd4e-45de-a7ec-a1e1dbe5ee25 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:14.248075 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b65eed-dd4e-45de-a7ec-a1e1dbe5ee25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:14.248344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b65eed-dd4e-45de-a7ec-a1e1dbe5ee25 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:14.249119 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b65eed-dd4e-45de-a7ec-a1e1dbe5ee25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:14.250825 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b65eed-dd4e-45de-a7ec-a1e1dbe5ee25 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:14.263806 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3477/6990] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:08:14 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:08:14.267885 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e2b88e-5ea2-46c6-bf68-97989af905f0 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:14.280452 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e2b88e-5ea2-46c6-bf68-97989af905f0 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:14.286288 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0f96f-2f2b-4621-b7a0-a893f582f9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:14.286963 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0f96f-2f2b-4621-b7a0-a893f582f9e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:14.287455 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0f96f-2f2b-4621-b7a0-a893f582f9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:14.287728 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0f96f-2f2b-4621-b7a0-a893f582f9e7 admin admin] PATH_INFO: `/v3/projects/4c81ef7b2ac644b394ffa1c04c11ea45/users/c4dc9da48de7438598c1aa4bc8d238ce/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:14.306149 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb0f96f-2f2b-4621-b7a0-a893f582f9e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c81ef7b2ac644b394ffa1c04c11ea45, user_id=c4dc9da48de7438598c1aa4bc8d238ce, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:14.309788 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb0f96f-2f2b-4621-b7a0-a893f582f9e7 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:14.335146 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fa4b0-c18c-4177-a660-8011df0e81b1 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:14.335585 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fa4b0-c18c-4177-a660-8011df0e81b1 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:14.335862 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fa4b0-c18c-4177-a660-8011df0e81b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:14.339007 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3514/6991] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:08:14 2022] PUT /identity/v3/projects/4c81ef7b2ac644b394ffa1c04c11ea45/users/c4dc9da48de7438598c1aa4bc8d238ce/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:08:14.372971 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-f60fa4b0-c18c-4177-a660-8011df0e81b1 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:08:14.376558 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f60fa4b0-c18c-4177-a660-8011df0e81b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:14.529134 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3478/6992] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:08:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:08:14.554890 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0f96f-2f2b-4621-b7a0-a893f582f9e7 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:14.554890 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3eb0f96f-2f2b-4621-b7a0-a893f582f9e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:14.708169 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0f96f-2f2b-4621-b7a0-a893f582f9e7 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:14.715511 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a555a69a-24bb-48ca-8eee-cdc17dcbdfad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:14.716692 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555a69a-24bb-48ca-8eee-cdc17dcbdfad service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:14.716692 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555a69a-24bb-48ca-8eee-cdc17dcbdfad service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:14.717805 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555a69a-24bb-48ca-8eee-cdc17dcbdfad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:14.739855 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a555a69a-24bb-48ca-8eee-cdc17dcbdfad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:14.743738 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a555a69a-24bb-48ca-8eee-cdc17dcbdfad service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:14.773707 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3515/6993] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:08:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:08:15.400160 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60fa4b0-c18c-4177-a660-8011df0e81b1 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:15.404238 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f60fa4b0-c18c-4177-a660-8011df0e81b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:15.430922 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60fa4b0-c18c-4177-a660-8011df0e81b1 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:15.448897 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51548d18-396d-4fad-8611-851707faf41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:15.459312 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51548d18-396d-4fad-8611-851707faf41e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:15.462661 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51548d18-396d-4fad-8611-851707faf41e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:15.462969 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51548d18-396d-4fad-8611-851707faf41e admin admin] PATH_INFO: `/v3/projects/d1952d83b83e44b8ac215ad2ebccd994` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:15.470361 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51548d18-396d-4fad-8611-851707faf41e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1952d83b83e44b8ac215ad2ebccd994)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:15.476907 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51548d18-396d-4fad-8611-851707faf41e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:15.658864 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-51548d18-396d-4fad-8611-851707faf41e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1952d83b83e44b8ac215ad2ebccd994', 'request_id': 'req-51548d18-396d-4fad-8611-851707faf41e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:15.666975 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:15.675422 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-51548d18-396d-4fad-8611-851707faf41e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1952d83b83e44b8ac215ad2ebccd994', 'request_id': 'req-51548d18-396d-4fad-8611-851707faf41e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:15.690110 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-51548d18-396d-4fad-8611-851707faf41e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1952d83b83e44b8ac215ad2ebccd994', 'request_id': 'req-51548d18-396d-4fad-8611-851707faf41e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:15.712067 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-51548d18-396d-4fad-8611-851707faf41e admin admin] The token cache is being invalidate because project d1952d83b83e44b8ac215ad2ebccd994 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:08:15.712411 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-51548d18-396d-4fad-8611-851707faf41e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:15.713215 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-51548d18-396d-4fad-8611-851707faf41e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:15.715763 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3479/6994] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:08:15 2022] DELETE /identity/v3/projects/d1952d83b83e44b8ac215ad2ebccd994 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:08:15.721694 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98165a76-87bb-4e0a-b76c-1bf194fcf868 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:15.722202 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98165a76-87bb-4e0a-b76c-1bf194fcf868 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:15.722870 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98165a76-87bb-4e0a-b76c-1bf194fcf868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:15.778265 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-98165a76-87bb-4e0a-b76c-1bf194fcf868 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:08:15.779991 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-98165a76-87bb-4e0a-b76c-1bf194fcf868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:15.800102 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:15.859872 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51548d18-396d-4fad-8611-851707faf41e admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:15.861582 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-51548d18-396d-4fad-8611-851707faf41e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:16.053909 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51548d18-396d-4fad-8611-851707faf41e admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:16.071899 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6ed3c-3658-4ca0-bdff-e95bb7fde160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:16.072571 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6ed3c-3658-4ca0-bdff-e95bb7fde160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:16.072850 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6ed3c-3658-4ca0-bdff-e95bb7fde160 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:16.073245 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6ed3c-3658-4ca0-bdff-e95bb7fde160 admin admin] PATH_INFO: `/v3/users/c7cc72688ec7411f88c8b9aed54f11e1` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:16.079128 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6ed3c-3658-4ca0-bdff-e95bb7fde160 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7cc72688ec7411f88c8b9aed54f11e1)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:16.089800 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6ed3c-3658-4ca0-bdff-e95bb7fde160 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:16.112436 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3516/6995] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:08:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:08:16.114314 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe48fd-1ca7-4200-8359-495acee109fc None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:16.118035 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe48fd-1ca7-4200-8359-495acee109fc None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:16.118667 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe48fd-1ca7-4200-8359-495acee109fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:16.214562 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-3cfe48fd-1ca7-4200-8359-495acee109fc None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:08:16.219105 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3cfe48fd-1ca7-4200-8359-495acee109fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:16.242958 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3517/6996] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:08:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:08:16.245723 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe48fd-1ca7-4200-8359-495acee109fc None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:16.269071 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe48fd-1ca7-4200-8359-495acee109fc None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:16.270384 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5ed6ed3c-3658-4ca0-bdff-e95bb7fde160 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7cc72688ec7411f88c8b9aed54f11e1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:16.278968 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5ed6ed3c-3658-4ca0-bdff-e95bb7fde160 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7cc72688ec7411f88c8b9aed54f11e1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:16.285673 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3abef87-12e1-427c-a2f8-89f1b9090376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:16.287075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abef87-12e1-427c-a2f8-89f1b9090376 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:16.288062 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abef87-12e1-427c-a2f8-89f1b9090376 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:16.288544 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abef87-12e1-427c-a2f8-89f1b9090376 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:16.289566 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3abef87-12e1-427c-a2f8-89f1b9090376 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:08:16.289976 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3abef87-12e1-427c-a2f8-89f1b9090376 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:16.295004 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3abef87-12e1-427c-a2f8-89f1b9090376 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:16.312005 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5ed6ed3c-3658-4ca0-bdff-e95bb7fde160 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7cc72688ec7411f88c8b9aed54f11e1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:16.331439 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3518/6997] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:08:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:08:16.332295 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5ed6ed3c-3658-4ca0-bdff-e95bb7fde160 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7cc72688ec7411f88c8b9aed54f11e1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:16.336680 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3abef87-12e1-427c-a2f8-89f1b9090376 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:16.350155 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5ed6ed3c-3658-4ca0-bdff-e95bb7fde160 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7cc72688ec7411f88c8b9aed54f11e1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:16.358007 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3abef87-12e1-427c-a2f8-89f1b9090376 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:16.364963 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517754f9-0ae0-4152-b029-31a5313f4cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:16.365733 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517754f9-0ae0-4152-b029-31a5313f4cc5 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:16.366103 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517754f9-0ae0-4152-b029-31a5313f4cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:16.366496 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517754f9-0ae0-4152-b029-31a5313f4cc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:16.367614 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517754f9-0ae0-4152-b029-31a5313f4cc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:16.370138 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3480/6998] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:08:15 2022] DELETE /identity/v3/users/c7cc72688ec7411f88c8b9aed54f11e1 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:08:16.375013 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517754f9-0ae0-4152-b029-31a5313f4cc5 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:16.379153 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10231d-c517-4b99-8ee7-d6dd8c93be6f None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:16.379491 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10231d-c517-4b99-8ee7-d6dd8c93be6f None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:16.379769 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10231d-c517-4b99-8ee7-d6dd8c93be6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:16.413641 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-ba10231d-c517-4b99-8ee7-d6dd8c93be6f None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:08:16.414877 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ba10231d-c517-4b99-8ee7-d6dd8c93be6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:16.477415 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3519/6999] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:08:16 2022] POST /identity/v3/projects => generated 393 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:08:16.485873 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517754f9-0ae0-4152-b029-31a5313f4cc5 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:16.487924 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-517754f9-0ae0-4152-b029-31a5313f4cc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:16.510261 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3481/7000] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:08:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:08:16.520675 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10231d-c517-4b99-8ee7-d6dd8c93be6f None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:16.523648 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ba10231d-c517-4b99-8ee7-d6dd8c93be6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:16.541191 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:16.644100 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517754f9-0ae0-4152-b029-31a5313f4cc5 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:16.675547 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10231d-c517-4b99-8ee7-d6dd8c93be6f None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:16.681716 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6046f3-c972-4690-b7a5-2c691b8b2ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:16.682381 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6046f3-c972-4690-b7a5-2c691b8b2ca5 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:16.683018 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6046f3-c972-4690-b7a5-2c691b8b2ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:16.683018 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6046f3-c972-4690-b7a5-2c691b8b2ca5 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:16.686341 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6046f3-c972-4690-b7a5-2c691b8b2ca5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:16.688800 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6046f3-c972-4690-b7a5-2c691b8b2ca5 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:16.731346 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3520/7001] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:08:16 2022] POST /identity/v3/users => generated 297 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:08:16.735804 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6046f3-c972-4690-b7a5-2c691b8b2ca5 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:16.759314 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6046f3-c972-4690-b7a5-2c691b8b2ca5 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:16.770729 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890c6cc-371f-4646-82fa-686dba123e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:16.771919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890c6cc-371f-4646-82fa-686dba123e0a admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:16.772311 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890c6cc-371f-4646-82fa-686dba123e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:16.772603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b5c29-1454-4515-9cc9-21b6051176c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:16.772907 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890c6cc-371f-4646-82fa-686dba123e0a admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:16.773395 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b5c29-1454-4515-9cc9-21b6051176c2 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:16.773687 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b5c29-1454-4515-9cc9-21b6051176c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:16.774119 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f890c6cc-371f-4646-82fa-686dba123e0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:16.774228 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b5c29-1454-4515-9cc9-21b6051176c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:16.788768 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f890c6cc-371f-4646-82fa-686dba123e0a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:16.789034 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b5c29-1454-4515-9cc9-21b6051176c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:16.796353 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b5c29-1454-4515-9cc9-21b6051176c2 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:16.813078 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3521/7002] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:08:16.815286 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890c6cc-371f-4646-82fa-686dba123e0a admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:16.828886 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3482/7003] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:08:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:08:16.836928 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890c6cc-371f-4646-82fa-686dba123e0a admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:16.844554 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f91c5-7484-4767-b92c-899767047d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:16.857415 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f91c5-7484-4767-b92c-899767047d09 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:16.860477 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f91c5-7484-4767-b92c-899767047d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:16.860962 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f91c5-7484-4767-b92c-899767047d09 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:16.861816 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f91c5-7484-4767-b92c-899767047d09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:16.867581 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f91c5-7484-4767-b92c-899767047d09 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:16.893513 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3522/7004] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:08:16.897999 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b5c29-1454-4515-9cc9-21b6051176c2 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:16.914535 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b5c29-1454-4515-9cc9-21b6051176c2 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:16.931098 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f8cd88-be1a-418b-8855-2fc149b409f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:16.931674 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8cd88-be1a-418b-8855-2fc149b409f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:16.931960 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8cd88-be1a-418b-8855-2fc149b409f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:16.932412 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8cd88-be1a-418b-8855-2fc149b409f5 admin admin] PATH_INFO: `/v3/projects/ebeb9c7869484bc68f967d82022d2aa9/users/0634b446a1674ee2862b766521a234b8/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:16.966805 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f8cd88-be1a-418b-8855-2fc149b409f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebeb9c7869484bc68f967d82022d2aa9, user_id=0634b446a1674ee2862b766521a234b8, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:16.969696 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f8cd88-be1a-418b-8855-2fc149b409f5 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:17.003147 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3483/7005] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:08:16 2022] PUT /identity/v3/projects/ebeb9c7869484bc68f967d82022d2aa9/users/0634b446a1674ee2862b766521a234b8/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:08:17.018735 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd0f76-3e47-4a89-af57-a34967ae1bee None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:17.019047 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd0f76-3e47-4a89-af57-a34967ae1bee None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:17.019384 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd0f76-3e47-4a89-af57-a34967ae1bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:17.088708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-99dd0f76-3e47-4a89-af57-a34967ae1bee None None] MFA Rules not processed for user `0634b446a1674ee2862b766521a234b8`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:08:17.091200 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-99dd0f76-3e47-4a89-af57-a34967ae1bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:17.163084 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:17.204486 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f8cd88-be1a-418b-8855-2fc149b409f5 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:17.205485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-72f8cd88-be1a-418b-8855-2fc149b409f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:17.233989 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3523/7006] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:08:17 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:08:17.264986 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd0f76-3e47-4a89-af57-a34967ae1bee None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:17.378629 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f8cd88-be1a-418b-8855-2fc149b409f5 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:17.385718 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8041a00-7b39-4f92-a2be-3e89a81ee315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:17.387518 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8041a00-7b39-4f92-a2be-3e89a81ee315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:17.387518 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8041a00-7b39-4f92-a2be-3e89a81ee315 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:17.388835 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8041a00-7b39-4f92-a2be-3e89a81ee315 admin admin] PATH_INFO: `/v3/projects/2089c2e63e7b4b48b85b259aefdf7ce7` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:17.388940 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8041a00-7b39-4f92-a2be-3e89a81ee315 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2089c2e63e7b4b48b85b259aefdf7ce7)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:17.391348 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8041a00-7b39-4f92-a2be-3e89a81ee315 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:17.422486 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd0f76-3e47-4a89-af57-a34967ae1bee None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:17.434914 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a0c59-5622-4057-9b52-044526eb75a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:17.441499 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a0c59-5622-4057-9b52-044526eb75a3 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:17.442732 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a0c59-5622-4057-9b52-044526eb75a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:17.442999 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a0c59-5622-4057-9b52-044526eb75a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:17.476008 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046a0c59-5622-4057-9b52-044526eb75a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:17.477490 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046a0c59-5622-4057-9b52-044526eb75a3 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:17.511608 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3524/7007] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:08:17 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:08:17.514627 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:17.526704 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e8041a00-7b39-4f92-a2be-3e89a81ee315 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2089c2e63e7b4b48b85b259aefdf7ce7', 'request_id': 'req-e8041a00-7b39-4f92-a2be-3e89a81ee315'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:17.549007 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e8041a00-7b39-4f92-a2be-3e89a81ee315 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2089c2e63e7b4b48b85b259aefdf7ce7', 'request_id': 'req-e8041a00-7b39-4f92-a2be-3e89a81ee315'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:17.577949 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e8041a00-7b39-4f92-a2be-3e89a81ee315 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2089c2e63e7b4b48b85b259aefdf7ce7', 'request_id': 'req-e8041a00-7b39-4f92-a2be-3e89a81ee315'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:17.633824 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e8041a00-7b39-4f92-a2be-3e89a81ee315 admin admin] The token cache is being invalidate because project 2089c2e63e7b4b48b85b259aefdf7ce7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:08:17.637774 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e8041a00-7b39-4f92-a2be-3e89a81ee315 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:17.642604 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e8041a00-7b39-4f92-a2be-3e89a81ee315 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:17.652514 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3484/7008] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:08:17 2022] DELETE /identity/v3/projects/2089c2e63e7b4b48b85b259aefdf7ce7 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:08:17.654248 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a0c59-5622-4057-9b52-044526eb75a3 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:17.702660 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a0c59-5622-4057-9b52-044526eb75a3 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:17.940761 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a35fb-f953-4999-9474-a3e61d96d1a8 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:17.941141 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a35fb-f953-4999-9474-a3e61d96d1a8 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:17.941338 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a35fb-f953-4999-9474-a3e61d96d1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:18.029698 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e923f-f993-4bca-a084-e3d84040a31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:18.036384 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e923f-f993-4bca-a084-e3d84040a31b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:18.037472 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e923f-f993-4bca-a084-e3d84040a31b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:18.037764 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e923f-f993-4bca-a084-e3d84040a31b admin admin] PATH_INFO: `/v3/users/fa039e17d0344c8db7611e5af043e6cb` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:18.039185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e923f-f993-4bca-a084-e3d84040a31b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa039e17d0344c8db7611e5af043e6cb)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:18.040013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-7d0a35fb-f953-4999-9474-a3e61d96d1a8 None None] MFA Rules not processed for user `c4dc9da48de7438598c1aa4bc8d238ce`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:08:18.044646 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7d0a35fb-f953-4999-9474-a3e61d96d1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:18.046231 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e923f-f993-4bca-a084-e3d84040a31b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:18.223172 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6e7e923f-f993-4bca-a084-e3d84040a31b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa039e17d0344c8db7611e5af043e6cb'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:18.223869 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6e7e923f-f993-4bca-a084-e3d84040a31b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa039e17d0344c8db7611e5af043e6cb'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:18.238547 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6e7e923f-f993-4bca-a084-e3d84040a31b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa039e17d0344c8db7611e5af043e6cb'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:18.254974 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6e7e923f-f993-4bca-a084-e3d84040a31b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa039e17d0344c8db7611e5af043e6cb'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:18.256946 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6e7e923f-f993-4bca-a084-e3d84040a31b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa039e17d0344c8db7611e5af043e6cb'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:18.260519 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3485/7009] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:08:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:08:18.274465 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a35fb-f953-4999-9474-a3e61d96d1a8 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:18.278440 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:18.282189 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7d0a35fb-f953-4999-9474-a3e61d96d1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:18.318954 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3525/7010] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:08:17 2022] DELETE /identity/v3/users/fa039e17d0344c8db7611e5af043e6cb => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:08:18.483000 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a35fb-f953-4999-9474-a3e61d96d1a8 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:18.718942 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a0368-8bb1-4515-a2b2-8c4838d0862a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:18.719568 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a0368-8bb1-4515-a2b2-8c4838d0862a service cinder] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:18.719916 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a0368-8bb1-4515-a2b2-8c4838d0862a service cinder] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:18.720256 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a0368-8bb1-4515-a2b2-8c4838d0862a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:18.722517 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-071a0368-8bb1-4515-a2b2-8c4838d0862a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:18.803375 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:18.872733 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a0368-8bb1-4515-a2b2-8c4838d0862a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:18.874574 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a0368-8bb1-4515-a2b2-8c4838d0862a service cinder] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:18.934317 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3486/7011] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:08:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 662 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:08:19.106433 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e923f-f993-4bca-a084-e3d84040a31b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:19.108719 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6e7e923f-f993-4bca-a084-e3d84040a31b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:19.393585 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e923f-f993-4bca-a084-e3d84040a31b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:19.411488 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89bcfa0-e2bc-4d1f-af70-356c186ebfb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:19.412328 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89bcfa0-e2bc-4d1f-af70-356c186ebfb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:19.412611 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89bcfa0-e2bc-4d1f-af70-356c186ebfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:19.412882 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89bcfa0-e2bc-4d1f-af70-356c186ebfb7 admin admin] PATH_INFO: `/v3/projects/529e88bb52854ae480ba73342bccc1af` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:19.414419 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89bcfa0-e2bc-4d1f-af70-356c186ebfb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=529e88bb52854ae480ba73342bccc1af)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:19.420271 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89bcfa0-e2bc-4d1f-af70-356c186ebfb7 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:19.594566 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d89bcfa0-e2bc-4d1f-af70-356c186ebfb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '529e88bb52854ae480ba73342bccc1af', 'request_id': 'req-d89bcfa0-e2bc-4d1f-af70-356c186ebfb7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:19.628719 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d89bcfa0-e2bc-4d1f-af70-356c186ebfb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '529e88bb52854ae480ba73342bccc1af', 'request_id': 'req-d89bcfa0-e2bc-4d1f-af70-356c186ebfb7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:19.665382 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d89bcfa0-e2bc-4d1f-af70-356c186ebfb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '529e88bb52854ae480ba73342bccc1af', 'request_id': 'req-d89bcfa0-e2bc-4d1f-af70-356c186ebfb7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:19.723738 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d89bcfa0-e2bc-4d1f-af70-356c186ebfb7 admin admin] The token cache is being invalidate because project 529e88bb52854ae480ba73342bccc1af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:08:19.724076 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d89bcfa0-e2bc-4d1f-af70-356c186ebfb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:19.725766 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d89bcfa0-e2bc-4d1f-af70-356c186ebfb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:19.728324 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3526/7012] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:08:19 2022] DELETE /identity/v3/projects/529e88bb52854ae480ba73342bccc1af => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:08:19.732993 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd33fc1-7efc-48ce-b845-ec7e47e6b154 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:19.733488 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd33fc1-7efc-48ce-b845-ec7e47e6b154 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:19.733671 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd33fc1-7efc-48ce-b845-ec7e47e6b154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:19.791602 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-2bd33fc1-7efc-48ce-b845-ec7e47e6b154 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:08:19.799321 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2bd33fc1-7efc-48ce-b845-ec7e47e6b154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:19.998084 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3487/7013] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:08:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:08:20.013571 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f315c-1bf0-4512-9ee1-b5ddbf044296 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:20.014103 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f315c-1bf0-4512-9ee1-b5ddbf044296 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:20.014251 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f315c-1bf0-4512-9ee1-b5ddbf044296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:20.074497 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-e74f315c-1bf0-4512-9ee1-b5ddbf044296 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:08:20.075946 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e74f315c-1bf0-4512-9ee1-b5ddbf044296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:20.091865 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3527/7014] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:08:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:08:20.096509 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd33fc1-7efc-48ce-b845-ec7e47e6b154 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:20.111311 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd33fc1-7efc-48ce-b845-ec7e47e6b154 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:20.125424 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68539e0-82b1-405d-b5cd-ab098e20baf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:20.126136 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68539e0-82b1-405d-b5cd-ab098e20baf7 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:20.126480 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68539e0-82b1-405d-b5cd-ab098e20baf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:20.126819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68539e0-82b1-405d-b5cd-ab098e20baf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:20.127609 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68539e0-82b1-405d-b5cd-ab098e20baf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:08:20.127950 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68539e0-82b1-405d-b5cd-ab098e20baf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:20.129658 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68539e0-82b1-405d-b5cd-ab098e20baf7 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:20.145765 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3488/7015] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:08:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:08:20.150040 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f315c-1bf0-4512-9ee1-b5ddbf044296 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:20.161797 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f315c-1bf0-4512-9ee1-b5ddbf044296 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:20.174086 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6334c-4f1c-41fa-9344-4e08a26d5845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:20.174723 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6334c-4f1c-41fa-9344-4e08a26d5845 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:20.175001 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6334c-4f1c-41fa-9344-4e08a26d5845 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:20.176842 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6334c-4f1c-41fa-9344-4e08a26d5845 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:20.177599 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa6334c-4f1c-41fa-9344-4e08a26d5845 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:20.179725 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa6334c-4f1c-41fa-9344-4e08a26d5845 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:20.241182 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3528/7016] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:08:20 2022] POST /identity/v3/projects => generated 373 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:08:20.245344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68539e0-82b1-405d-b5cd-ab098e20baf7 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:20.257943 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68539e0-82b1-405d-b5cd-ab098e20baf7 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:20.398699 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceee3f5-e1af-4c5f-80cf-06a5a421b67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:20.400085 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceee3f5-e1af-4c5f-80cf-06a5a421b67b admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:20.400586 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceee3f5-e1af-4c5f-80cf-06a5a421b67b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:20.401071 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceee3f5-e1af-4c5f-80cf-06a5a421b67b admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:20.404706 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceee3f5-e1af-4c5f-80cf-06a5a421b67b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:20.408316 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceee3f5-e1af-4c5f-80cf-06a5a421b67b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:20.479132 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3489/7017] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:08:20 2022] POST /identity/v3/users => generated 287 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:08:20.481443 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6334c-4f1c-41fa-9344-4e08a26d5845 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:20.503222 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6334c-4f1c-41fa-9344-4e08a26d5845 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:20.513509 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa7707-c1c0-4bfd-88ac-f8906e1abbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:20.514317 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa7707-c1c0-4bfd-88ac-f8906e1abbbd admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:20.514559 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa7707-c1c0-4bfd-88ac-f8906e1abbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:20.514968 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa7707-c1c0-4bfd-88ac-f8906e1abbbd admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:20.515701 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa7707-c1c0-4bfd-88ac-f8906e1abbbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:20.517345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa7707-c1c0-4bfd-88ac-f8906e1abbbd admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:20.544558 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3529/7018] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:08:20 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:08:20.548333 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceee3f5-e1af-4c5f-80cf-06a5a421b67b admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:20.563674 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa7707-c1c0-4bfd-88ac-f8906e1abbbd admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:20.564708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a8fa7707-c1c0-4bfd-88ac-f8906e1abbbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:20.570725 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceee3f5-e1af-4c5f-80cf-06a5a421b67b admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:20.590003 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd372ef0-d033-4455-8598-c3d7bad963e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:20.590716 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd372ef0-d033-4455-8598-c3d7bad963e7 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:20.591063 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd372ef0-d033-4455-8598-c3d7bad963e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:20.591397 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd372ef0-d033-4455-8598-c3d7bad963e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:20.592063 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd372ef0-d033-4455-8598-c3d7bad963e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:20.597376 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd372ef0-d033-4455-8598-c3d7bad963e7 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:20.631093 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3490/7019] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:08:20 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:08:20.639986 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd372ef0-d033-4455-8598-c3d7bad963e7 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:20.662671 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd372ef0-d033-4455-8598-c3d7bad963e7 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:20.678989 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a89d7e-af1c-4ed4-ad72-24fe52052dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:20.683241 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a89d7e-af1c-4ed4-ad72-24fe52052dc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:20.683525 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a89d7e-af1c-4ed4-ad72-24fe52052dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:20.684390 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a89d7e-af1c-4ed4-ad72-24fe52052dc9 admin admin] PATH_INFO: `/v3/projects/ccd48739040549e383aa70ea4e8fd150/users/55919e733ba946e0806e40ff5d3a9ad2/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:20.739856 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a89d7e-af1c-4ed4-ad72-24fe52052dc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccd48739040549e383aa70ea4e8fd150, user_id=55919e733ba946e0806e40ff5d3a9ad2, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:20.751525 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a89d7e-af1c-4ed4-ad72-24fe52052dc9 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:20.775450 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:20.815577 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3491/7020] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:08:20 2022] PUT /identity/v3/projects/ccd48739040549e383aa70ea4e8fd150/users/55919e733ba946e0806e40ff5d3a9ad2/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:08:20.841642 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce8dd9-93d5-455f-bcf9-21429316bba5 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:20.842297 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce8dd9-93d5-455f-bcf9-21429316bba5 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:20.843011 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce8dd9-93d5-455f-bcf9-21429316bba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:20.877680 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa7707-c1c0-4bfd-88ac-f8906e1abbbd admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:20.916615 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:20.941703 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-75ce8dd9-93d5-455f-bcf9-21429316bba5 None None] MFA Rules not processed for user `55919e733ba946e0806e40ff5d3a9ad2`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:08:20.943247 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-75ce8dd9-93d5-455f-bcf9-21429316bba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:21.078520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b5f57-8be3-47a5-ac54-3135c0d9bba4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:21.078520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b5f57-8be3-47a5-ac54-3135c0d9bba4 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:21.078520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b5f57-8be3-47a5-ac54-3135c0d9bba4 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:21.078520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b5f57-8be3-47a5-ac54-3135c0d9bba4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:21.082414 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5c0b5f57-8be3-47a5-ac54-3135c0d9bba4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:21.159386 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3492/7021] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:08:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:08:21.239879 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce8dd9-93d5-455f-bcf9-21429316bba5 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:21.240419 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-75ce8dd9-93d5-455f-bcf9-21429316bba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:21.279671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b5f57-8be3-47a5-ac54-3135c0d9bba4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:21.281930 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b5f57-8be3-47a5-ac54-3135c0d9bba4 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:21.352740 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3530/7022] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:08:20 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 790 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:08:21.422895 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce8dd9-93d5-455f-bcf9-21429316bba5 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:21.431531 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e113749-38c3-43f8-b246-49b5e9515e67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:21.436922 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e113749-38c3-43f8-b246-49b5e9515e67 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:21.437215 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e113749-38c3-43f8-b246-49b5e9515e67 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:21.437644 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e113749-38c3-43f8-b246-49b5e9515e67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:21.458974 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e113749-38c3-43f8-b246-49b5e9515e67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:21.460599 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e113749-38c3-43f8-b246-49b5e9515e67 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:21.493189 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3493/7023] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:08:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:08:22.485753 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b5f57-8be3-47a5-ac54-3135c0d9bba4 service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:22.487231 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5c0b5f57-8be3-47a5-ac54-3135c0d9bba4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:22.645870 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e113749-38c3-43f8-b246-49b5e9515e67 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:22.649330 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1e113749-38c3-43f8-b246-49b5e9515e67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:22.749042 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b5f57-8be3-47a5-ac54-3135c0d9bba4 service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:22.768686 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de445b4e-73fd-40a7-bbbb-1c1cd3257d10 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:22.770360 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de445b4e-73fd-40a7-bbbb-1c1cd3257d10 service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:22.770918 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de445b4e-73fd-40a7-bbbb-1c1cd3257d10 service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:22.771400 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de445b4e-73fd-40a7-bbbb-1c1cd3257d10 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:22.780079 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-de445b4e-73fd-40a7-bbbb-1c1cd3257d10 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:22.823129 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de445b4e-73fd-40a7-bbbb-1c1cd3257d10 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:22.826041 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de445b4e-73fd-40a7-bbbb-1c1cd3257d10 service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:22.856935 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e113749-38c3-43f8-b246-49b5e9515e67 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:22.862047 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f67e7a-f451-4466-a769-eed419da8efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:22.862699 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f67e7a-f451-4466-a769-eed419da8efc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:22.863002 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f67e7a-f451-4466-a769-eed419da8efc admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:22.863358 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f67e7a-f451-4466-a769-eed419da8efc admin admin] PATH_INFO: `/v3/users/4bb54ce3cfac4eb7b9095f3733745cf1` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:22.867729 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f67e7a-f451-4466-a769-eed419da8efc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bb54ce3cfac4eb7b9095f3733745cf1)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:22.870721 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f67e7a-f451-4466-a769-eed419da8efc admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:22.873300 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3531/7024] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:08:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:08:22.989698 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:22.999146 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-17f67e7a-f451-4466-a769-eed419da8efc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bb54ce3cfac4eb7b9095f3733745cf1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:23.000084 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-17f67e7a-f451-4466-a769-eed419da8efc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bb54ce3cfac4eb7b9095f3733745cf1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:23.039787 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-17f67e7a-f451-4466-a769-eed419da8efc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bb54ce3cfac4eb7b9095f3733745cf1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:23.043675 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd89e13-e980-4e4b-9a65-3ebac42da1ca None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:23.044413 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd89e13-e980-4e4b-9a65-3ebac42da1ca None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:23.044648 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd89e13-e980-4e4b-9a65-3ebac42da1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:23.060547 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-17f67e7a-f451-4466-a769-eed419da8efc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bb54ce3cfac4eb7b9095f3733745cf1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:23.061478 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:23.070697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-1fd89e13-e980-4e4b-9a65-3ebac42da1ca None None] MFA Rules not processed for user `c4dc9da48de7438598c1aa4bc8d238ce`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:08:23.072424 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1fd89e13-e980-4e4b-9a65-3ebac42da1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:23.087422 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-17f67e7a-f451-4466-a769-eed419da8efc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bb54ce3cfac4eb7b9095f3733745cf1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:23.116508 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3494/7025] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:08:22 2022] DELETE /identity/v3/users/4bb54ce3cfac4eb7b9095f3733745cf1 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:08:23.186493 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3532/7026] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:08:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:08:23.991035 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f67e7a-f451-4466-a769-eed419da8efc admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:23.992512 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-17f67e7a-f451-4466-a769-eed419da8efc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:24.141983 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f67e7a-f451-4466-a769-eed419da8efc admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:24.147455 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c1a57-bb61-4c22-b52e-b083307b1feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:24.149098 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c1a57-bb61-4c22-b52e-b083307b1feb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:24.149392 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c1a57-bb61-4c22-b52e-b083307b1feb admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:24.149670 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c1a57-bb61-4c22-b52e-b083307b1feb admin admin] PATH_INFO: `/v3/projects/b30e1134a82b4fdc8e7f84e6ce4faf76` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:24.153547 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c1a57-bb61-4c22-b52e-b083307b1feb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b30e1134a82b4fdc8e7f84e6ce4faf76)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:24.158340 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c1a57-bb61-4c22-b52e-b083307b1feb admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:24.268634 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fc2c1a57-bb61-4c22-b52e-b083307b1feb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b30e1134a82b4fdc8e7f84e6ce4faf76', 'request_id': 'req-fc2c1a57-bb61-4c22-b52e-b083307b1feb'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:24.302437 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fc2c1a57-bb61-4c22-b52e-b083307b1feb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b30e1134a82b4fdc8e7f84e6ce4faf76', 'request_id': 'req-fc2c1a57-bb61-4c22-b52e-b083307b1feb'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:24.323268 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fc2c1a57-bb61-4c22-b52e-b083307b1feb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b30e1134a82b4fdc8e7f84e6ce4faf76', 'request_id': 'req-fc2c1a57-bb61-4c22-b52e-b083307b1feb'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:24.358051 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fc2c1a57-bb61-4c22-b52e-b083307b1feb admin admin] The token cache is being invalidate because project b30e1134a82b4fdc8e7f84e6ce4faf76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:08:24.366506 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fc2c1a57-bb61-4c22-b52e-b083307b1feb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:24.367799 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fc2c1a57-bb61-4c22-b52e-b083307b1feb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:24.376524 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd89e13-e980-4e4b-9a65-3ebac42da1ca None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:24.377632 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3495/7027] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:08:23 2022] DELETE /identity/v3/projects/b30e1134a82b4fdc8e7f84e6ce4faf76 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:08:24.395553 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd89e13-e980-4e4b-9a65-3ebac42da1ca None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:24.548622 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5f36b-8585-4f1a-831d-9af655c8bb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:24.551546 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5f36b-8585-4f1a-831d-9af655c8bb6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:24.566231 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5f36b-8585-4f1a-831d-9af655c8bb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:24.567307 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5f36b-8585-4f1a-831d-9af655c8bb6b admin admin] PATH_INFO: `/v3/users/a6b9bb23a4604eaabd5ba85cec428e4b` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:24.571801 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5f36b-8585-4f1a-831d-9af655c8bb6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6b9bb23a4604eaabd5ba85cec428e4b)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:24.575576 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5f36b-8585-4f1a-831d-9af655c8bb6b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:24.748824 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-96b5f36b-8585-4f1a-831d-9af655c8bb6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6b9bb23a4604eaabd5ba85cec428e4b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:24.750011 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-96b5f36b-8585-4f1a-831d-9af655c8bb6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6b9bb23a4604eaabd5ba85cec428e4b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:24.774197 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-96b5f36b-8585-4f1a-831d-9af655c8bb6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6b9bb23a4604eaabd5ba85cec428e4b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:24.791188 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-96b5f36b-8585-4f1a-831d-9af655c8bb6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6b9bb23a4604eaabd5ba85cec428e4b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:24.796477 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-96b5f36b-8585-4f1a-831d-9af655c8bb6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6b9bb23a4604eaabd5ba85cec428e4b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:24.839971 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3533/7028] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:08:24 2022] DELETE /identity/v3/users/a6b9bb23a4604eaabd5ba85cec428e4b => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:08:25.164267 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c1a57-bb61-4c22-b52e-b083307b1feb admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:25.165901 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-fc2c1a57-bb61-4c22-b52e-b083307b1feb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:25.193822 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c1a57-bb61-4c22-b52e-b083307b1feb admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:25.347765 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:25.394249 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee27d2b-9e43-4973-be7d-b0c3375bdbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:25.395748 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee27d2b-9e43-4973-be7d-b0c3375bdbfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:25.396062 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee27d2b-9e43-4973-be7d-b0c3375bdbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:25.396314 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee27d2b-9e43-4973-be7d-b0c3375bdbfd admin admin] PATH_INFO: `/v3/projects/a214cd253d0949e980d11633ba5ae6ba` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:25.400173 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee27d2b-9e43-4973-be7d-b0c3375bdbfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a214cd253d0949e980d11633ba5ae6ba)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:25.426636 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee27d2b-9e43-4973-be7d-b0c3375bdbfd admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:25.582185 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2ee27d2b-9e43-4973-be7d-b0c3375bdbfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a214cd253d0949e980d11633ba5ae6ba', 'request_id': 'req-2ee27d2b-9e43-4973-be7d-b0c3375bdbfd'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:25.599864 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2ee27d2b-9e43-4973-be7d-b0c3375bdbfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a214cd253d0949e980d11633ba5ae6ba', 'request_id': 'req-2ee27d2b-9e43-4973-be7d-b0c3375bdbfd'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:25.616018 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2ee27d2b-9e43-4973-be7d-b0c3375bdbfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a214cd253d0949e980d11633ba5ae6ba', 'request_id': 'req-2ee27d2b-9e43-4973-be7d-b0c3375bdbfd'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:25.657566 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2ee27d2b-9e43-4973-be7d-b0c3375bdbfd admin admin] The token cache is being invalidate because project a214cd253d0949e980d11633ba5ae6ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:08:25.659920 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2ee27d2b-9e43-4973-be7d-b0c3375bdbfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:25.666628 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2ee27d2b-9e43-4973-be7d-b0c3375bdbfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:25.672894 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3496/7029] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:08:25 2022] DELETE /identity/v3/projects/a214cd253d0949e980d11633ba5ae6ba => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:08:25.674927 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47aa7e-ea81-4a28-9a65-580c25184b54 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:25.675446 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47aa7e-ea81-4a28-9a65-580c25184b54 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:25.675544 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47aa7e-ea81-4a28-9a65-580c25184b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:25.786040 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-dc47aa7e-ea81-4a28-9a65-580c25184b54 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:08:25.787479 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-dc47aa7e-ea81-4a28-9a65-580c25184b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:25.952560 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:26.022814 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3534/7030] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:08:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:08:26.028326 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4d978-5902-4ab8-93cd-e33094b9fff7 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:26.028670 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4d978-5902-4ab8-93cd-e33094b9fff7 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:26.028949 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4d978-5902-4ab8-93cd-e33094b9fff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:26.086610 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-53a4d978-5902-4ab8-93cd-e33094b9fff7 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:08:26.087996 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-53a4d978-5902-4ab8-93cd-e33094b9fff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:26.112616 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3497/7031] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:08:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:08:26.114824 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47aa7e-ea81-4a28-9a65-580c25184b54 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:26.141991 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47aa7e-ea81-4a28-9a65-580c25184b54 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:26.162666 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86fd1f5-6332-4da6-bc38-30f549fa6fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:26.163625 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86fd1f5-6332-4da6-bc38-30f549fa6fed admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:26.164385 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86fd1f5-6332-4da6-bc38-30f549fa6fed admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:26.165873 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86fd1f5-6332-4da6-bc38-30f549fa6fed admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:26.171167 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86fd1f5-6332-4da6-bc38-30f549fa6fed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:08:26.172277 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86fd1f5-6332-4da6-bc38-30f549fa6fed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:26.175635 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86fd1f5-6332-4da6-bc38-30f549fa6fed admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:26.225878 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3535/7032] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:08:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:08:26.227069 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a4d978-5902-4ab8-93cd-e33094b9fff7 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:26.251011 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a4d978-5902-4ab8-93cd-e33094b9fff7 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:26.262782 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06c6db-b019-4ad0-8d10-dded4aaeb699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:26.263451 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06c6db-b019-4ad0-8d10-dded4aaeb699 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:26.264926 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06c6db-b019-4ad0-8d10-dded4aaeb699 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:26.266344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06c6db-b019-4ad0-8d10-dded4aaeb699 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:26.267771 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee06c6db-b019-4ad0-8d10-dded4aaeb699 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:26.274979 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee06c6db-b019-4ad0-8d10-dded4aaeb699 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:26.369755 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3498/7033] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:08:26 2022] POST /identity/v3/projects => generated 365 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:08:26.370972 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86fd1f5-6332-4da6-bc38-30f549fa6fed admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:26.403924 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86fd1f5-6332-4da6-bc38-30f549fa6fed admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:26.604345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4c6d1-1bf1-4cbb-9b32-d40f5bc607e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:26.604991 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4c6d1-1bf1-4cbb-9b32-d40f5bc607e5 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:26.605277 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4c6d1-1bf1-4cbb-9b32-d40f5bc607e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:26.605610 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4c6d1-1bf1-4cbb-9b32-d40f5bc607e5 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:26.608974 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e4c6d1-1bf1-4cbb-9b32-d40f5bc607e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:26.610969 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e4c6d1-1bf1-4cbb-9b32-d40f5bc607e5 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:26.688013 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3536/7034] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:08:26 2022] POST /identity/v3/users => generated 283 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:08:26.691946 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06c6db-b019-4ad0-8d10-dded4aaeb699 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:26.715758 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06c6db-b019-4ad0-8d10-dded4aaeb699 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:26.729572 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e8ea4-58fc-4790-a4a1-64cb173379e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:26.730206 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e8ea4-58fc-4790-a4a1-64cb173379e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:26.730520 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e8ea4-58fc-4790-a4a1-64cb173379e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:26.730795 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e8ea4-58fc-4790-a4a1-64cb173379e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:26.738730 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e8ea4-58fc-4790-a4a1-64cb173379e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:26.740523 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e8ea4-58fc-4790-a4a1-64cb173379e2 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:26.801517 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4c6d1-1bf1-4cbb-9b32-d40f5bc607e5 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:26.811095 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3499/7035] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:08:26 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:08:26.819170 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4c6d1-1bf1-4cbb-9b32-d40f5bc607e5 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:26.839330 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e2bc9-47f8-4819-b0f6-0717b708bfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:26.840359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e2bc9-47f8-4819-b0f6-0717b708bfc1 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:26.840688 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e2bc9-47f8-4819-b0f6-0717b708bfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:26.840993 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e2bc9-47f8-4819-b0f6-0717b708bfc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:26.847837 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e2bc9-47f8-4819-b0f6-0717b708bfc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:26.850923 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e2bc9-47f8-4819-b0f6-0717b708bfc1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:26.916552 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e8ea4-58fc-4790-a4a1-64cb173379e2 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:26.919669 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3537/7036] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:08:26 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:08:26.935500 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e8ea4-58fc-4790-a4a1-64cb173379e2 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:26.966698 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35164de4-f115-425e-b789-7c15b76b739c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:26.968754 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35164de4-f115-425e-b789-7c15b76b739c admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:26.969146 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35164de4-f115-425e-b789-7c15b76b739c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:26.969655 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35164de4-f115-425e-b789-7c15b76b739c admin admin] PATH_INFO: `/v3/projects/06560a6a43fa473fbfd33c517581c56e/users/1e457774964d4df59f04bde990770d35/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:27.052124 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35164de4-f115-425e-b789-7c15b76b739c admin admin] RBAC: Authorizing `identity:create_grant(project_id=06560a6a43fa473fbfd33c517581c56e, user_id=1e457774964d4df59f04bde990770d35, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:27.055018 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35164de4-f115-425e-b789-7c15b76b739c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:27.109252 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3500/7037] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:08:26 2022] PUT /identity/v3/projects/06560a6a43fa473fbfd33c517581c56e/users/1e457774964d4df59f04bde990770d35/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:08:27.120231 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01fd8f2-8228-4e2b-8335-e78ca8edf475 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:27.120516 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01fd8f2-8228-4e2b-8335-e78ca8edf475 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:27.120794 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01fd8f2-8228-4e2b-8335-e78ca8edf475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:27.169375 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-b01fd8f2-8228-4e2b-8335-e78ca8edf475 None None] MFA Rules not processed for user `1e457774964d4df59f04bde990770d35`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:08:27.170874 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b01fd8f2-8228-4e2b-8335-e78ca8edf475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:27.424570 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3538/7038] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:08:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:08:27.438860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35164de4-f115-425e-b789-7c15b76b739c admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:27.441439 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-35164de4-f115-425e-b789-7c15b76b739c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:27.616123 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35164de4-f115-425e-b789-7c15b76b739c admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:27.623299 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1687be-f24b-47f6-865d-a0c470f3a7ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:27.624230 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1687be-f24b-47f6-865d-a0c470f3a7ce service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:27.624712 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1687be-f24b-47f6-865d-a0c470f3a7ce service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:27.625185 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1687be-f24b-47f6-865d-a0c470f3a7ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:27.638326 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1687be-f24b-47f6-865d-a0c470f3a7ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:27.640574 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1687be-f24b-47f6-865d-a0c470f3a7ce service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:27.659379 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3501/7039] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:08:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:08:27.748991 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01fd8f2-8228-4e2b-8335-e78ca8edf475 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:27.833343 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:27.908904 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01fd8f2-8228-4e2b-8335-e78ca8edf475 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:27.914396 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf656c-10aa-4b38-b2cd-ecceaf3dada6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:27.915370 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf656c-10aa-4b38-b2cd-ecceaf3dada6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:27.915809 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf656c-10aa-4b38-b2cd-ecceaf3dada6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:27.916393 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf656c-10aa-4b38-b2cd-ecceaf3dada6 admin admin] PATH_INFO: `/v3/users/1e457774964d4df59f04bde990770d35` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:27.917952 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf656c-10aa-4b38-b2cd-ecceaf3dada6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e457774964d4df59f04bde990770d35)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:27.920739 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf656c-10aa-4b38-b2cd-ecceaf3dada6 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:28.021586 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9dbf656c-10aa-4b38-b2cd-ecceaf3dada6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e457774964d4df59f04bde990770d35'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:28.022888 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9dbf656c-10aa-4b38-b2cd-ecceaf3dada6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e457774964d4df59f04bde990770d35'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:28.052404 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9dbf656c-10aa-4b38-b2cd-ecceaf3dada6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e457774964d4df59f04bde990770d35'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:28.062839 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9dbf656c-10aa-4b38-b2cd-ecceaf3dada6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e457774964d4df59f04bde990770d35'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:28.064406 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9dbf656c-10aa-4b38-b2cd-ecceaf3dada6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e457774964d4df59f04bde990770d35'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:28.127767 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3539/7040] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:08:27 2022] DELETE /identity/v3/users/1e457774964d4df59f04bde990770d35 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:08:28.134583 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55350f8d-d104-4436-881a-8cfebd1b6a1e None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:28.134934 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55350f8d-d104-4436-881a-8cfebd1b6a1e None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:28.135169 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55350f8d-d104-4436-881a-8cfebd1b6a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:28.145591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:28.172819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-55350f8d-d104-4436-881a-8cfebd1b6a1e None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:08:28.174040 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-55350f8d-d104-4436-881a-8cfebd1b6a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:28.322280 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3502/7041] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:08:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:08:28.434820 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf656c-10aa-4b38-b2cd-ecceaf3dada6 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:28.436418 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9dbf656c-10aa-4b38-b2cd-ecceaf3dada6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:28.704359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf656c-10aa-4b38-b2cd-ecceaf3dada6 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:28.724809 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d284bbe-62f4-41f6-90b7-a7d7016a4be9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:28.725454 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d284bbe-62f4-41f6-90b7-a7d7016a4be9 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:28.725740 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d284bbe-62f4-41f6-90b7-a7d7016a4be9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:28.726010 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d284bbe-62f4-41f6-90b7-a7d7016a4be9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:28.754796 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d284bbe-62f4-41f6-90b7-a7d7016a4be9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:28.765873 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d284bbe-62f4-41f6-90b7-a7d7016a4be9 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:28.877247 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3540/7042] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:08:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:08:28.988320 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55350f8d-d104-4436-881a-8cfebd1b6a1e None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:29.007536 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55350f8d-d104-4436-881a-8cfebd1b6a1e None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:29.033289 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb026970-7215-4995-98cb-9abc96292f58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:29.034775 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb026970-7215-4995-98cb-9abc96292f58 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:29.035145 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb026970-7215-4995-98cb-9abc96292f58 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:29.035427 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb026970-7215-4995-98cb-9abc96292f58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:29.038943 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-eb026970-7215-4995-98cb-9abc96292f58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:29.073380 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb026970-7215-4995-98cb-9abc96292f58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:29.075442 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb026970-7215-4995-98cb-9abc96292f58 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:29.104148 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3503/7043] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:08:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:08:30.381619 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d284bbe-62f4-41f6-90b7-a7d7016a4be9 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:30.384771 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3d284bbe-62f4-41f6-90b7-a7d7016a4be9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:30.418770 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d284bbe-62f4-41f6-90b7-a7d7016a4be9 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:30.445490 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67edf49-1ad7-415e-b2a9-b5ba54845c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:30.446303 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67edf49-1ad7-415e-b2a9-b5ba54845c44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:30.446683 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67edf49-1ad7-415e-b2a9-b5ba54845c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:30.447170 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67edf49-1ad7-415e-b2a9-b5ba54845c44 admin admin] PATH_INFO: `/v3/users/0634b446a1674ee2862b766521a234b8` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:30.448852 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67edf49-1ad7-415e-b2a9-b5ba54845c44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0634b446a1674ee2862b766521a234b8)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:30.451224 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67edf49-1ad7-415e-b2a9-b5ba54845c44 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:30.556166 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:30.564370 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f67edf49-1ad7-415e-b2a9-b5ba54845c44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0634b446a1674ee2862b766521a234b8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:30.566539 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f67edf49-1ad7-415e-b2a9-b5ba54845c44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0634b446a1674ee2862b766521a234b8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:30.596776 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f67edf49-1ad7-415e-b2a9-b5ba54845c44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0634b446a1674ee2862b766521a234b8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:30.606804 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f67edf49-1ad7-415e-b2a9-b5ba54845c44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0634b446a1674ee2862b766521a234b8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:30.608557 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f67edf49-1ad7-415e-b2a9-b5ba54845c44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0634b446a1674ee2862b766521a234b8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:30.659013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c2cbf-6ad2-440e-af50-3160cad8b367 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:30.659596 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c2cbf-6ad2-440e-af50-3160cad8b367 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:30.659814 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c2cbf-6ad2-440e-af50-3160cad8b367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:30.662889 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3541/7044] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:08:30 2022] DELETE /identity/v3/users/0634b446a1674ee2862b766521a234b8 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:08:30.698228 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-e67c2cbf-6ad2-440e-af50-3160cad8b367 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:08:30.700359 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e67c2cbf-6ad2-440e-af50-3160cad8b367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:30.853175 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3504/7045] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:08:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:08:30.879245 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67edf49-1ad7-415e-b2a9-b5ba54845c44 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:30.881011 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f67edf49-1ad7-415e-b2a9-b5ba54845c44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:31.000667 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67edf49-1ad7-415e-b2a9-b5ba54845c44 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:31.024796 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61c70e-9752-46de-ab02-c66c2dc5ea67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:31.025606 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61c70e-9752-46de-ab02-c66c2dc5ea67 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:31.025983 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61c70e-9752-46de-ab02-c66c2dc5ea67 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:31.026355 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61c70e-9752-46de-ab02-c66c2dc5ea67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:31.056250 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61c70e-9752-46de-ab02-c66c2dc5ea67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:31.057877 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61c70e-9752-46de-ab02-c66c2dc5ea67 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:31.110350 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3542/7046] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:08:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:08:31.773635 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c2cbf-6ad2-440e-af50-3160cad8b367 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:31.775215 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e67c2cbf-6ad2-440e-af50-3160cad8b367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:31.793647 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61c70e-9752-46de-ab02-c66c2dc5ea67 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:31.795640 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-df61c70e-9752-46de-ab02-c66c2dc5ea67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:31.799616 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c2cbf-6ad2-440e-af50-3160cad8b367 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:31.838457 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458a4212-cc00-4c36-b37a-cf80fa047f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:31.852513 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a4212-cc00-4c36-b37a-cf80fa047f05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:31.855352 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a4212-cc00-4c36-b37a-cf80fa047f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:31.856490 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a4212-cc00-4c36-b37a-cf80fa047f05 admin admin] PATH_INFO: `/v3/projects/06560a6a43fa473fbfd33c517581c56e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:31.859425 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61c70e-9752-46de-ab02-c66c2dc5ea67 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:31.862592 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458a4212-cc00-4c36-b37a-cf80fa047f05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06560a6a43fa473fbfd33c517581c56e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:31.869175 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458a4212-cc00-4c36-b37a-cf80fa047f05 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:31.877404 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca3c8d-b3d0-47c4-9ec8-7245d76718b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:31.879277 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca3c8d-b3d0-47c4-9ec8-7245d76718b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:31.880904 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca3c8d-b3d0-47c4-9ec8-7245d76718b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:31.882693 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca3c8d-b3d0-47c4-9ec8-7245d76718b0 admin admin] PATH_INFO: `/v3/projects/ebeb9c7869484bc68f967d82022d2aa9` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:31.885130 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca3c8d-b3d0-47c4-9ec8-7245d76718b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebeb9c7869484bc68f967d82022d2aa9)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:31.891070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca3c8d-b3d0-47c4-9ec8-7245d76718b0 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:31.982937 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-53ca3c8d-b3d0-47c4-9ec8-7245d76718b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebeb9c7869484bc68f967d82022d2aa9', 'request_id': 'req-53ca3c8d-b3d0-47c4-9ec8-7245d76718b0'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:31.990475 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-458a4212-cc00-4c36-b37a-cf80fa047f05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06560a6a43fa473fbfd33c517581c56e', 'request_id': 'req-458a4212-cc00-4c36-b37a-cf80fa047f05'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:31.995167 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-53ca3c8d-b3d0-47c4-9ec8-7245d76718b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebeb9c7869484bc68f967d82022d2aa9', 'request_id': 'req-53ca3c8d-b3d0-47c4-9ec8-7245d76718b0'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:32.005429 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-458a4212-cc00-4c36-b37a-cf80fa047f05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06560a6a43fa473fbfd33c517581c56e', 'request_id': 'req-458a4212-cc00-4c36-b37a-cf80fa047f05'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:32.011124 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-53ca3c8d-b3d0-47c4-9ec8-7245d76718b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebeb9c7869484bc68f967d82022d2aa9', 'request_id': 'req-53ca3c8d-b3d0-47c4-9ec8-7245d76718b0'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:32.022977 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-458a4212-cc00-4c36-b37a-cf80fa047f05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06560a6a43fa473fbfd33c517581c56e', 'request_id': 'req-458a4212-cc00-4c36-b37a-cf80fa047f05'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:32.032608 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-53ca3c8d-b3d0-47c4-9ec8-7245d76718b0 admin admin] The token cache is being invalidate because project ebeb9c7869484bc68f967d82022d2aa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:08:32.033184 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-53ca3c8d-b3d0-47c4-9ec8-7245d76718b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:32.040850 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-458a4212-cc00-4c36-b37a-cf80fa047f05 admin admin] The token cache is being invalidate because project 06560a6a43fa473fbfd33c517581c56e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:08:32.043591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-458a4212-cc00-4c36-b37a-cf80fa047f05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:32.043591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-458a4212-cc00-4c36-b37a-cf80fa047f05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:32.044153 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-53ca3c8d-b3d0-47c4-9ec8-7245d76718b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:32.061903 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3543/7048] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:08:31 2022] DELETE /identity/v3/projects/ebeb9c7869484bc68f967d82022d2aa9 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:08:32.063713 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174fa68-8221-4b6c-a671-9ee8c715499a None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:32.066229 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174fa68-8221-4b6c-a671-9ee8c715499a None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:32.068401 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174fa68-8221-4b6c-a671-9ee8c715499a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:32.096431 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3505/7048] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:08:31 2022] DELETE /identity/v3/projects/06560a6a43fa473fbfd33c517581c56e => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:08:32.098850 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e0b06-5d5f-4390-9ca6-d3d4d5a041c7 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:32.101239 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e0b06-5d5f-4390-9ca6-d3d4d5a041c7 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:32.101774 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e0b06-5d5f-4390-9ca6-d3d4d5a041c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:32.103273 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-0174fa68-8221-4b6c-a671-9ee8c715499a None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:08:32.104807 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0174fa68-8221-4b6c-a671-9ee8c715499a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:32.138241 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-766e0b06-5d5f-4390-9ca6-d3d4d5a041c7 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:08:32.139954 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-766e0b06-5d5f-4390-9ca6-d3d4d5a041c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:32.151746 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:32.205262 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:32.241843 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3544/7049] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:08:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:08:32.244909 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8137e0a-c081-4d4a-8a59-56f05f0a52e0 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:32.245141 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8137e0a-c081-4d4a-8a59-56f05f0a52e0 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:32.245414 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8137e0a-c081-4d4a-8a59-56f05f0a52e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:32.276464 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3506/7050] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:08:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:08:32.296716 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a8137e0a-c081-4d4a-8a59-56f05f0a52e0 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:08:32.300213 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a8137e0a-c081-4d4a-8a59-56f05f0a52e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:32.325717 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3545/7051] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:08:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:08:32.330701 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e0b06-5d5f-4390-9ca6-d3d4d5a041c7 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:32.351415 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e0b06-5d5f-4390-9ca6-d3d4d5a041c7 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:32.364471 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63979e9-c985-4361-a9a4-3d08e44bca95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:32.365614 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63979e9-c985-4361-a9a4-3d08e44bca95 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:32.366452 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63979e9-c985-4361-a9a4-3d08e44bca95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:32.366957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63979e9-c985-4361-a9a4-3d08e44bca95 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:32.369102 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63979e9-c985-4361-a9a4-3d08e44bca95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:08:32.369735 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63979e9-c985-4361-a9a4-3d08e44bca95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:32.373689 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63979e9-c985-4361-a9a4-3d08e44bca95 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:32.385799 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8137e0a-c081-4d4a-8a59-56f05f0a52e0 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:32.388245 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a8137e0a-c081-4d4a-8a59-56f05f0a52e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:32.404288 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3507/7052] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:08:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:08:32.408754 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63979e9-c985-4361-a9a4-3d08e44bca95 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:32.426086 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63979e9-c985-4361-a9a4-3d08e44bca95 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:32.433538 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a6a92f-319d-4880-97fe-d5f9cc3b1b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:32.434507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6a92f-319d-4880-97fe-d5f9cc3b1b3f admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:32.435328 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6a92f-319d-4880-97fe-d5f9cc3b1b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:32.435860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6a92f-319d-4880-97fe-d5f9cc3b1b3f admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:32.437280 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a6a92f-319d-4880-97fe-d5f9cc3b1b3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:32.440157 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a6a92f-319d-4880-97fe-d5f9cc3b1b3f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:32.497792 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3508/7053] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:08:32 2022] POST /identity/v3/projects => generated 389 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:08:32.503803 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33734c5f-6603-4733-9f71-f91ca8adcccb None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:32.504120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33734c5f-6603-4733-9f71-f91ca8adcccb None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:32.505891 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33734c5f-6603-4733-9f71-f91ca8adcccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:32.556054 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-33734c5f-6603-4733-9f71-f91ca8adcccb None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:08:32.557314 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-33734c5f-6603-4733-9f71-f91ca8adcccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:32.571308 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8137e0a-c081-4d4a-8a59-56f05f0a52e0 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:32.758019 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2408403-4b76-4709-baaa-0ecf4a441a8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:32.758875 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2408403-4b76-4709-baaa-0ecf4a441a8a service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:32.761696 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2408403-4b76-4709-baaa-0ecf4a441a8a service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:32.764523 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2408403-4b76-4709-baaa-0ecf4a441a8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:32.780017 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d2408403-4b76-4709-baaa-0ecf4a441a8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:32.824749 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3509/7054] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:08:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:08:32.828306 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2408403-4b76-4709-baaa-0ecf4a441a8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:32.831106 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33734c5f-6603-4733-9f71-f91ca8adcccb None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:32.834529 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2408403-4b76-4709-baaa-0ecf4a441a8a service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:32.863048 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33734c5f-6603-4733-9f71-f91ca8adcccb None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:32.888026 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94741fa4-ccf9-4388-9678-8a0e39e442ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:32.889487 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3546/7055] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:08:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:08:32.889972 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94741fa4-ccf9-4388-9678-8a0e39e442ad admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:32.890257 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94741fa4-ccf9-4388-9678-8a0e39e442ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:32.890482 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2408403-4b76-4709-baaa-0ecf4a441a8a service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:32.890604 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94741fa4-ccf9-4388-9678-8a0e39e442ad admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:32.894302 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94741fa4-ccf9-4388-9678-8a0e39e442ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:32.896309 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94741fa4-ccf9-4388-9678-8a0e39e442ad admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:32.924482 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2408403-4b76-4709-baaa-0ecf4a441a8a service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:32.946511 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18def63c-82a7-4749-ba1c-e44613a0c854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:32.948563 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18def63c-82a7-4749-ba1c-e44613a0c854 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:32.953531 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18def63c-82a7-4749-ba1c-e44613a0c854 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:32.953971 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18def63c-82a7-4749-ba1c-e44613a0c854 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:32.956773 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18def63c-82a7-4749-ba1c-e44613a0c854 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:08:32.957199 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18def63c-82a7-4749-ba1c-e44613a0c854 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:32.963627 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18def63c-82a7-4749-ba1c-e44613a0c854 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:32.993806 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3510/7056] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:08:32 2022] POST /identity/v3/users => generated 295 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:08:32.994815 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94741fa4-ccf9-4388-9678-8a0e39e442ad admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:32.998248 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3547/7057] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:08:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:08:33.006676 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18def63c-82a7-4749-ba1c-e44613a0c854 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:33.030259 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94741fa4-ccf9-4388-9678-8a0e39e442ad admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:33.036722 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18def63c-82a7-4749-ba1c-e44613a0c854 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:33.050902 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f222a0-ad0b-40a8-b71d-1bcf1d0400bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:33.052498 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1cf3e-f3ed-413b-b574-36192c4cd478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:33.053388 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1cf3e-f3ed-413b-b574-36192c4cd478 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:33.053559 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f222a0-ad0b-40a8-b71d-1bcf1d0400bf admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:33.053991 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1cf3e-f3ed-413b-b574-36192c4cd478 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:33.054119 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f222a0-ad0b-40a8-b71d-1bcf1d0400bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:33.054530 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1cf3e-f3ed-413b-b574-36192c4cd478 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:33.056168 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab1cf3e-f3ed-413b-b574-36192c4cd478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:33.057182 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f222a0-ad0b-40a8-b71d-1bcf1d0400bf admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:33.058106 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f222a0-ad0b-40a8-b71d-1bcf1d0400bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:33.060275 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab1cf3e-f3ed-413b-b574-36192c4cd478 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:33.071076 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f222a0-ad0b-40a8-b71d-1bcf1d0400bf admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:33.094653 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3511/7058] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:08:32 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:08:33.095764 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1cf3e-f3ed-413b-b574-36192c4cd478 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:33.123126 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1cf3e-f3ed-413b-b574-36192c4cd478 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:33.139526 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73828626-0198-427b-92cd-8f2bd4a000b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:33.140443 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73828626-0198-427b-92cd-8f2bd4a000b7 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:33.140873 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73828626-0198-427b-92cd-8f2bd4a000b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:33.141331 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73828626-0198-427b-92cd-8f2bd4a000b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:33.142163 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73828626-0198-427b-92cd-8f2bd4a000b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:33.144172 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73828626-0198-427b-92cd-8f2bd4a000b7 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:33.147331 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3548/7059] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:08:33 2022] POST /identity/v3/projects => generated 371 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:08:33.151952 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f222a0-ad0b-40a8-b71d-1bcf1d0400bf admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:33.170387 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3512/7060] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:08:33.180066 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73828626-0198-427b-92cd-8f2bd4a000b7 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:33.207704 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73828626-0198-427b-92cd-8f2bd4a000b7 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:33.255599 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:33.309016 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f222a0-ad0b-40a8-b71d-1bcf1d0400bf admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:33.313964 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:33.343904 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d39abf-867a-4492-bd36-4977e3381895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:33.344815 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d39abf-867a-4492-bd36-4977e3381895 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:33.345111 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d39abf-867a-4492-bd36-4977e3381895 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:33.345466 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d39abf-867a-4492-bd36-4977e3381895 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:33.349486 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d39abf-867a-4492-bd36-4977e3381895 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:33.354452 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d39abf-867a-4492-bd36-4977e3381895 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:33.357612 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8119e3-ff39-468c-bf58-c7beeef4fcba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:33.359284 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8119e3-ff39-468c-bf58-c7beeef4fcba admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:33.359564 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8119e3-ff39-468c-bf58-c7beeef4fcba admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:33.359843 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8119e3-ff39-468c-bf58-c7beeef4fcba admin admin] PATH_INFO: `/v3/projects/a32ab2f89fcf4b3ab01be67165388175/users/884be770746c44d29f50c099613f08ed/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:33.382445 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8119e3-ff39-468c-bf58-c7beeef4fcba admin admin] RBAC: Authorizing `identity:create_grant(project_id=a32ab2f89fcf4b3ab01be67165388175, user_id=884be770746c44d29f50c099613f08ed, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:33.387800 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8119e3-ff39-468c-bf58-c7beeef4fcba admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:33.415197 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3513/7061] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:08:33 2022] PUT /identity/v3/projects/a32ab2f89fcf4b3ab01be67165388175/users/884be770746c44d29f50c099613f08ed/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:08:33.421333 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571934c8-5570-4617-b9d8-7eb4210f63d6 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:33.423892 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571934c8-5570-4617-b9d8-7eb4210f63d6 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:33.424213 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571934c8-5570-4617-b9d8-7eb4210f63d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:33.430072 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3549/7062] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:08:33 2022] POST /identity/v3/users => generated 286 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:08:33.431196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d39abf-867a-4492-bd36-4977e3381895 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:33.464228 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d39abf-867a-4492-bd36-4977e3381895 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:33.493348 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-571934c8-5570-4617-b9d8-7eb4210f63d6 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:08:33.500696 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-571934c8-5570-4617-b9d8-7eb4210f63d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:33.621203 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458fb270-cbe1-43cb-8653-05f1f8a81d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:33.621865 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fb270-cbe1-43cb-8653-05f1f8a81d63 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:33.622258 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fb270-cbe1-43cb-8653-05f1f8a81d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:33.623740 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fb270-cbe1-43cb-8653-05f1f8a81d63 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:33.624505 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458fb270-cbe1-43cb-8653-05f1f8a81d63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:33.627386 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458fb270-cbe1-43cb-8653-05f1f8a81d63 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:33.654477 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3514/7063] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:08:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:08:33.655232 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3550/7064] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:08:33.659425 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571934c8-5570-4617-b9d8-7eb4210f63d6 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:33.666371 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458fb270-cbe1-43cb-8653-05f1f8a81d63 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:33.671529 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-458fb270-cbe1-43cb-8653-05f1f8a81d63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:33.673152 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571934c8-5570-4617-b9d8-7eb4210f63d6 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:33.680727 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e663b725-b85e-44ec-b1ab-ebd497723928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:33.681813 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663b725-b85e-44ec-b1ab-ebd497723928 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:33.682192 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663b725-b85e-44ec-b1ab-ebd497723928 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:33.682557 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663b725-b85e-44ec-b1ab-ebd497723928 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:33.683237 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e663b725-b85e-44ec-b1ab-ebd497723928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:33.686042 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e663b725-b85e-44ec-b1ab-ebd497723928 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:33.703222 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3515/7065] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:08:33.704491 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e663b725-b85e-44ec-b1ab-ebd497723928 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:33.741881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e663b725-b85e-44ec-b1ab-ebd497723928 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:33.766344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a81b0-9aee-4e2c-9114-74120888bd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:33.767663 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a81b0-9aee-4e2c-9114-74120888bd5e admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:33.768230 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a81b0-9aee-4e2c-9114-74120888bd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:33.768795 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a81b0-9aee-4e2c-9114-74120888bd5e admin admin] PATH_INFO: `/v3/projects/b5d27b7826ec4b03bf3be5ac255a69fd/users/4ed8abb8fd294c788f828524139b2e49/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:33.800178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a81b0-9aee-4e2c-9114-74120888bd5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5d27b7826ec4b03bf3be5ac255a69fd, user_id=4ed8abb8fd294c788f828524139b2e49, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:33.805253 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a81b0-9aee-4e2c-9114-74120888bd5e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:33.823278 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458fb270-cbe1-43cb-8653-05f1f8a81d63 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:33.835733 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641af3b-e74f-41f0-aaaa-8ab6939ec80c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:33.836921 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641af3b-e74f-41f0-aaaa-8ab6939ec80c service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:33.836921 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641af3b-e74f-41f0-aaaa-8ab6939ec80c service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:33.838588 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641af3b-e74f-41f0-aaaa-8ab6939ec80c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:33.847486 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3516/7066] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:08:33 2022] PUT /identity/v3/projects/b5d27b7826ec4b03bf3be5ac255a69fd/users/4ed8abb8fd294c788f828524139b2e49/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:08:33.848153 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a81b0-9aee-4e2c-9114-74120888bd5e admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:33.850737 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-954a81b0-9aee-4e2c-9114-74120888bd5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:33.869692 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641af3b-e74f-41f0-aaaa-8ab6939ec80c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:33.871962 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641af3b-e74f-41f0-aaaa-8ab6939ec80c service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:33.893247 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3551/7067] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:08:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:08:33.894878 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88167b62-9484-4e47-9b8a-186a2b42b118 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:33.895399 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88167b62-9484-4e47-9b8a-186a2b42b118 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:33.895862 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88167b62-9484-4e47-9b8a-186a2b42b118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:33.947800 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-88167b62-9484-4e47-9b8a-186a2b42b118 None None] MFA Rules not processed for user `4ed8abb8fd294c788f828524139b2e49`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:08:33.951331 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-88167b62-9484-4e47-9b8a-186a2b42b118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:34.063134 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a81b0-9aee-4e2c-9114-74120888bd5e admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:34.082275 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:34.084222 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b51b3-ad8e-4d37-85aa-59ef7666633c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:34.085042 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b51b3-ad8e-4d37-85aa-59ef7666633c service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:34.085501 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b51b3-ad8e-4d37-85aa-59ef7666633c service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:34.085846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b51b3-ad8e-4d37-85aa-59ef7666633c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:34.095330 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-247b51b3-ad8e-4d37-85aa-59ef7666633c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:34.122245 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3552/7068] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:08:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:08:34.147336 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88167b62-9484-4e47-9b8a-186a2b42b118 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:34.149274 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-88167b62-9484-4e47-9b8a-186a2b42b118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:34.150412 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:34.208631 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b51b3-ad8e-4d37-85aa-59ef7666633c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:34.210779 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b51b3-ad8e-4d37-85aa-59ef7666633c service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:34.238381 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3517/7069] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:08:33 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:08:34.239053 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88167b62-9484-4e47-9b8a-186a2b42b118 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:34.243168 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929f557-5d48-48c8-9707-3bf43e3fca7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:34.243873 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929f557-5d48-48c8-9707-3bf43e3fca7d service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:34.244290 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929f557-5d48-48c8-9707-3bf43e3fca7d service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:34.244686 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929f557-5d48-48c8-9707-3bf43e3fca7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:34.257866 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1929f557-5d48-48c8-9707-3bf43e3fca7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:34.261424 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1929f557-5d48-48c8-9707-3bf43e3fca7d service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:34.274831 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3553/7070] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:08:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:08:42.964490 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9a68d-426c-4188-9f7d-aacfb399e671 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:42.965483 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9a68d-426c-4188-9f7d-aacfb399e671 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:42.965634 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9a68d-426c-4188-9f7d-aacfb399e671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:43.048180 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-3de9a68d-426c-4188-9f7d-aacfb399e671 None None] MFA Rules not processed for user `884be770746c44d29f50c099613f08ed`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:08:43.049361 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3de9a68d-426c-4188-9f7d-aacfb399e671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:43.208291 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3518/7071] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:08:42 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:08:43.246872 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929f557-5d48-48c8-9707-3bf43e3fca7d service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:43.270520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929f557-5d48-48c8-9707-3bf43e3fca7d service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:43.287387 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5a226-43c2-4c47-9ef7-cc68f0f990e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:43.288283 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5a226-43c2-4c47-9ef7-cc68f0f990e2 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:43.288754 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5a226-43c2-4c47-9ef7-cc68f0f990e2 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:43.289192 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5a226-43c2-4c47-9ef7-cc68f0f990e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:43.310871 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a5a226-43c2-4c47-9ef7-cc68f0f990e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:43.313113 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a5a226-43c2-4c47-9ef7-cc68f0f990e2 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:43.333443 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3554/7072] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:08:43 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:08:48.259873 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403264f9-5da6-4085-9260-79f223cf578a None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:48.260450 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403264f9-5da6-4085-9260-79f223cf578a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:48.260668 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403264f9-5da6-4085-9260-79f223cf578a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:48.302772 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-403264f9-5da6-4085-9260-79f223cf578a None None] MFA Rules not processed for user `884be770746c44d29f50c099613f08ed`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:08:48.304466 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-403264f9-5da6-4085-9260-79f223cf578a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:48.315066 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3519/7073] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:08:48 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:08:48.890588 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5a226-43c2-4c47-9ef7-cc68f0f990e2 service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:48.892069 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-78a5a226-43c2-4c47-9ef7-cc68f0f990e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:49.101209 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5a226-43c2-4c47-9ef7-cc68f0f990e2 service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:49.116635 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9711f2-5dab-452e-9e5d-d880840a764c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:49.117278 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9711f2-5dab-452e-9e5d-d880840a764c service swift] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:49.117559 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9711f2-5dab-452e-9e5d-d880840a764c service swift] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:49.117833 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9711f2-5dab-452e-9e5d-d880840a764c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:49.119692 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1f9711f2-5dab-452e-9e5d-d880840a764c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:49.258109 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9711f2-5dab-452e-9e5d-d880840a764c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:49.259704 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9711f2-5dab-452e-9e5d-d880840a764c service swift] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:49.279351 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3555/7074] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 16:08:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:08:50.558596 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403264f9-5da6-4085-9260-79f223cf578a None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:50.560240 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-403264f9-5da6-4085-9260-79f223cf578a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:50.811610 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403264f9-5da6-4085-9260-79f223cf578a None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:50.821396 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1946b-8989-4306-a08a-f261147a74a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:50.822684 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1946b-8989-4306-a08a-f261147a74a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:50.823036 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1946b-8989-4306-a08a-f261147a74a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:50.823323 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1946b-8989-4306-a08a-f261147a74a9 admin admin] PATH_INFO: `/v3/users/55919e733ba946e0806e40ff5d3a9ad2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:50.827526 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee1946b-8989-4306-a08a-f261147a74a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55919e733ba946e0806e40ff5d3a9ad2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:50.831607 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee1946b-8989-4306-a08a-f261147a74a9 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:50.993720 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4ee1946b-8989-4306-a08a-f261147a74a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55919e733ba946e0806e40ff5d3a9ad2'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:50.994475 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4ee1946b-8989-4306-a08a-f261147a74a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55919e733ba946e0806e40ff5d3a9ad2'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:50.998527 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:51.035412 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4ee1946b-8989-4306-a08a-f261147a74a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55919e733ba946e0806e40ff5d3a9ad2'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:51.072161 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4ee1946b-8989-4306-a08a-f261147a74a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55919e733ba946e0806e40ff5d3a9ad2'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:51.122845 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4ee1946b-8989-4306-a08a-f261147a74a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55919e733ba946e0806e40ff5d3a9ad2'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:51.154893 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3520/7075] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:08:50 2022] DELETE /identity/v3/users/55919e733ba946e0806e40ff5d3a9ad2 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:08:51.159667 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576778f-36c7-4900-972c-077e4e312956 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:51.160115 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576778f-36c7-4900-972c-077e4e312956 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:51.160570 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576778f-36c7-4900-972c-077e4e312956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:51.247734 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-0576778f-36c7-4900-972c-077e4e312956 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:08:51.249319 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0576778f-36c7-4900-972c-077e4e312956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:51.308527 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:51.515422 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3556/7076] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:08:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:08:51.524863 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1946b-8989-4306-a08a-f261147a74a9 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:51.526722 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4ee1946b-8989-4306-a08a-f261147a74a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:51.806594 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1946b-8989-4306-a08a-f261147a74a9 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:51.814625 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07543f94-2784-4b4c-99be-3e5d320b80c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:51.815289 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07543f94-2784-4b4c-99be-3e5d320b80c4 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:51.815569 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07543f94-2784-4b4c-99be-3e5d320b80c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:51.816015 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07543f94-2784-4b4c-99be-3e5d320b80c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:51.851010 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07543f94-2784-4b4c-99be-3e5d320b80c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:51.855582 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07543f94-2784-4b4c-99be-3e5d320b80c4 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:51.890742 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3521/7077] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:08:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:08:52.542068 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576778f-36c7-4900-972c-077e4e312956 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:52.544944 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0576778f-36c7-4900-972c-077e4e312956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:52.575433 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576778f-36c7-4900-972c-077e4e312956 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:52.593244 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80be24a-31b5-4430-8c94-77b09b13c33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:52.594177 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80be24a-31b5-4430-8c94-77b09b13c33f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:52.594635 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80be24a-31b5-4430-8c94-77b09b13c33f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:52.595090 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80be24a-31b5-4430-8c94-77b09b13c33f admin admin] PATH_INFO: `/v3/projects/ccd48739040549e383aa70ea4e8fd150` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:52.596575 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80be24a-31b5-4430-8c94-77b09b13c33f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccd48739040549e383aa70ea4e8fd150)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:52.598548 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80be24a-31b5-4430-8c94-77b09b13c33f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:52.749990 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c80be24a-31b5-4430-8c94-77b09b13c33f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccd48739040549e383aa70ea4e8fd150', 'request_id': 'req-c80be24a-31b5-4430-8c94-77b09b13c33f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:52.772430 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c80be24a-31b5-4430-8c94-77b09b13c33f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccd48739040549e383aa70ea4e8fd150', 'request_id': 'req-c80be24a-31b5-4430-8c94-77b09b13c33f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:52.789873 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c80be24a-31b5-4430-8c94-77b09b13c33f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccd48739040549e383aa70ea4e8fd150', 'request_id': 'req-c80be24a-31b5-4430-8c94-77b09b13c33f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:52.842851 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c80be24a-31b5-4430-8c94-77b09b13c33f admin admin] The token cache is being invalidate because project ccd48739040549e383aa70ea4e8fd150 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:08:52.843390 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c80be24a-31b5-4430-8c94-77b09b13c33f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:52.858756 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c80be24a-31b5-4430-8c94-77b09b13c33f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:52.862851 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3557/7078] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:08:52 2022] DELETE /identity/v3/projects/ccd48739040549e383aa70ea4e8fd150 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:08:52.866570 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6d556-61bb-46ed-878a-084a54ecde69 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:52.867083 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6d556-61bb-46ed-878a-084a54ecde69 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:52.867197 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6d556-61bb-46ed-878a-084a54ecde69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:52.877775 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46bb91d-5c93-4ccb-ad9e-9e9090b5115b None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:52.878062 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46bb91d-5c93-4ccb-ad9e-9e9090b5115b None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:52.878342 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46bb91d-5c93-4ccb-ad9e-9e9090b5115b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:52.914387 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-69f6d556-61bb-46ed-878a-084a54ecde69 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:08:52.915667 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-69f6d556-61bb-46ed-878a-084a54ecde69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:52.968075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a46bb91d-5c93-4ccb-ad9e-9e9090b5115b None None] MFA Rules not processed for user `c4dc9da48de7438598c1aa4bc8d238ce`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:08:52.969304 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a46bb91d-5c93-4ccb-ad9e-9e9090b5115b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:53.134278 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3522/7079] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:08:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:08:53.141449 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db341f7c-37eb-4afc-baf3-e3c98e00e1f0 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:53.142065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db341f7c-37eb-4afc-baf3-e3c98e00e1f0 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:53.142594 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db341f7c-37eb-4afc-baf3-e3c98e00e1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:53.167524 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3558/7080] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:08:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:08:53.187339 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-db341f7c-37eb-4afc-baf3-e3c98e00e1f0 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:08:53.189130 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-db341f7c-37eb-4afc-baf3-e3c98e00e1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:53.204286 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3523/7081] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:08:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:08:53.208279 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46bb91d-5c93-4ccb-ad9e-9e9090b5115b None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:53.229885 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46bb91d-5c93-4ccb-ad9e-9e9090b5115b None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:53.248718 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b2922-f086-4218-9cb3-4b4f9464bdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:53.249657 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b2922-f086-4218-9cb3-4b4f9464bdf8 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:53.250259 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b2922-f086-4218-9cb3-4b4f9464bdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:53.250691 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b2922-f086-4218-9cb3-4b4f9464bdf8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:53.251752 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b2922-f086-4218-9cb3-4b4f9464bdf8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:08:53.252223 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b2922-f086-4218-9cb3-4b4f9464bdf8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:53.254212 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b2922-f086-4218-9cb3-4b4f9464bdf8 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:53.276533 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3559/7082] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:08:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:08:53.282017 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db341f7c-37eb-4afc-baf3-e3c98e00e1f0 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:53.295970 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db341f7c-37eb-4afc-baf3-e3c98e00e1f0 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:53.313124 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4382c9-1ac1-496a-9484-f3ea228373c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:53.313642 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4382c9-1ac1-496a-9484-f3ea228373c7 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:53.313926 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4382c9-1ac1-496a-9484-f3ea228373c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:53.314201 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4382c9-1ac1-496a-9484-f3ea228373c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:53.315275 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4382c9-1ac1-496a-9484-f3ea228373c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:53.317384 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4382c9-1ac1-496a-9484-f3ea228373c7 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:53.424959 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b2922-f086-4218-9cb3-4b4f9464bdf8 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:53.443928 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3524/7083] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:08:53 2022] POST /identity/v3/projects => generated 379 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:08:53.448739 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b2922-f086-4218-9cb3-4b4f9464bdf8 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:53.553008 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:53.635002 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14607936-18f2-44e1-8f3c-80ed06bede1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:53.637539 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14607936-18f2-44e1-8f3c-80ed06bede1e admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:53.637994 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14607936-18f2-44e1-8f3c-80ed06bede1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:53.638427 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14607936-18f2-44e1-8f3c-80ed06bede1e admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:53.639319 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14607936-18f2-44e1-8f3c-80ed06bede1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:53.641666 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14607936-18f2-44e1-8f3c-80ed06bede1e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:53.686413 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3560/7084] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:08:53 2022] POST /identity/v3/users => generated 290 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:08:53.689946 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4382c9-1ac1-496a-9484-f3ea228373c7 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:53.704276 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4382c9-1ac1-496a-9484-f3ea228373c7 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:53.712688 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe5a4ce-3956-4141-9664-b849fe25eba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:53.713502 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5a4ce-3956-4141-9664-b849fe25eba5 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:53.714104 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5a4ce-3956-4141-9664-b849fe25eba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:53.714545 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5a4ce-3956-4141-9664-b849fe25eba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:53.715289 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe5a4ce-3956-4141-9664-b849fe25eba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:53.716975 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe5a4ce-3956-4141-9664-b849fe25eba5 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:53.742950 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3525/7085] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:08:53 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:08:53.748087 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14607936-18f2-44e1-8f3c-80ed06bede1e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:53.772344 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14607936-18f2-44e1-8f3c-80ed06bede1e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:53.800908 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff1e91d-df26-4d5d-ac9c-f2907783ab73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:53.801617 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1e91d-df26-4d5d-ac9c-f2907783ab73 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:53.802772 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1e91d-df26-4d5d-ac9c-f2907783ab73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:53.803165 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1e91d-df26-4d5d-ac9c-f2907783ab73 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:53.803890 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff1e91d-df26-4d5d-ac9c-f2907783ab73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:53.807425 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff1e91d-df26-4d5d-ac9c-f2907783ab73 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:53.833106 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3561/7086] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:08:53 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:08:53.838123 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe5a4ce-3956-4141-9664-b849fe25eba5 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:53.867931 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe5a4ce-3956-4141-9664-b849fe25eba5 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:53.881612 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bee682-5788-4cb3-86b2-2f967e97b14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:53.882653 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bee682-5788-4cb3-86b2-2f967e97b14d admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:53.884331 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bee682-5788-4cb3-86b2-2f967e97b14d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:53.885306 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bee682-5788-4cb3-86b2-2f967e97b14d admin admin] PATH_INFO: `/v3/projects/02aef726b4de480eaac39ce336f2455c/users/e3f31d0f9c094979bfbddfa323cbe762/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:53.935526 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bee682-5788-4cb3-86b2-2f967e97b14d admin admin] RBAC: Authorizing `identity:create_grant(project_id=02aef726b4de480eaac39ce336f2455c, user_id=e3f31d0f9c094979bfbddfa323cbe762, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:53.943017 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bee682-5788-4cb3-86b2-2f967e97b14d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:53.971712 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3526/7087] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:08:53 2022] PUT /identity/v3/projects/02aef726b4de480eaac39ce336f2455c/users/e3f31d0f9c094979bfbddfa323cbe762/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:08:54.092220 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4dd43f-7c67-43ef-bc27-a4cf53ba2307 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:54.092854 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4dd43f-7c67-43ef-bc27-a4cf53ba2307 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:54.093285 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4dd43f-7c67-43ef-bc27-a4cf53ba2307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:54.177240 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-7f4dd43f-7c67-43ef-bc27-a4cf53ba2307 None None] MFA Rules not processed for user `e3f31d0f9c094979bfbddfa323cbe762`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:08:54.181576 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7f4dd43f-7c67-43ef-bc27-a4cf53ba2307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:54.366380 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3562/7088] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:08:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:08:54.388892 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bee682-5788-4cb3-86b2-2f967e97b14d admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:54.391895 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b2bee682-5788-4cb3-86b2-2f967e97b14d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:54.426847 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:54.640508 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bee682-5788-4cb3-86b2-2f967e97b14d admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:54.650580 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48427fa3-bb76-4378-b322-875744fec041 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:54.651371 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48427fa3-bb76-4378-b322-875744fec041 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:54.651784 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48427fa3-bb76-4378-b322-875744fec041 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:54.653444 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48427fa3-bb76-4378-b322-875744fec041 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:54.678318 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48427fa3-bb76-4378-b322-875744fec041 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:54.680378 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48427fa3-bb76-4378-b322-875744fec041 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:54.728150 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3527/7089] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:08:54 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:09:04.352050 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=51,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:04.696335 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=23 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:04.759312 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4dd43f-7c67-43ef-bc27-a4cf53ba2307 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:09:04.777152 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4dd43f-7c67-43ef-bc27-a4cf53ba2307 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:09:04.792079 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1290f-6c58-42c0-aedd-832d3dbb1f3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:09:04.792988 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1290f-6c58-42c0-aedd-832d3dbb1f3a service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:09:04.793322 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1290f-6c58-42c0-aedd-832d3dbb1f3a service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:09:04.794967 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1290f-6c58-42c0-aedd-832d3dbb1f3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:09:04.801303 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0fa1290f-6c58-42c0-aedd-832d3dbb1f3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:09:05.010149 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa1290f-6c58-42c0-aedd-832d3dbb1f3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:09:05.012896 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa1290f-6c58-42c0-aedd-832d3dbb1f3a service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:09:05.038630 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3563/7090] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:09:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:09:06.331986 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48427fa3-bb76-4378-b322-875744fec041 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:09:06.334174 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-48427fa3-bb76-4378-b322-875744fec041 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:09:06.536610 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48427fa3-bb76-4378-b322-875744fec041 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:09:06.546526 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fffed5-0aee-4b76-b688-816fbeb2586f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:09:06.547570 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fffed5-0aee-4b76-b688-816fbeb2586f service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:09:06.548087 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fffed5-0aee-4b76-b688-816fbeb2586f service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:09:06.548568 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fffed5-0aee-4b76-b688-816fbeb2586f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:09:06.550774 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-05fffed5-0aee-4b76-b688-816fbeb2586f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:09:06.767864 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fffed5-0aee-4b76-b688-816fbeb2586f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:09:06.769971 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fffed5-0aee-4b76-b688-816fbeb2586f service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:09:06.834962 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3528/7091] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:09:06 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:09:07.374953 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1290f-6c58-42c0-aedd-832d3dbb1f3a service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:09:07.377700 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0fa1290f-6c58-42c0-aedd-832d3dbb1f3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:09:07.398377 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1290f-6c58-42c0-aedd-832d3dbb1f3a service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:09:07.408833 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6106b413-e65b-4eb2-b7ac-883e8d646b4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:09:07.409853 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106b413-e65b-4eb2-b7ac-883e8d646b4e service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:09:07.410360 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106b413-e65b-4eb2-b7ac-883e8d646b4e service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:09:07.410860 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106b413-e65b-4eb2-b7ac-883e8d646b4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:09:07.412989 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6106b413-e65b-4eb2-b7ac-883e8d646b4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:09:07.429826 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6106b413-e65b-4eb2-b7ac-883e8d646b4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:09:07.432226 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6106b413-e65b-4eb2-b7ac-883e8d646b4e service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:09:07.474968 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3564/7092] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:09:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:09:07.731699 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fffed5-0aee-4b76-b688-816fbeb2586f service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:09:07.733737 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-05fffed5-0aee-4b76-b688-816fbeb2586f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:09:07.775336 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fffed5-0aee-4b76-b688-816fbeb2586f service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:09:07.789647 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ebec82-8b60-4200-ae5c-bf7e1a014752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:09:07.790316 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ebec82-8b60-4200-ae5c-bf7e1a014752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:09:07.790607 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ebec82-8b60-4200-ae5c-bf7e1a014752 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:09:07.790929 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ebec82-8b60-4200-ae5c-bf7e1a014752 admin admin] PATH_INFO: `/v3/users/e9cd9c0bd017459cb630823a39e8bd17` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:09:07.795472 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ebec82-8b60-4200-ae5c-bf7e1a014752 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9cd9c0bd017459cb630823a39e8bd17)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:09:07.797533 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ebec82-8b60-4200-ae5c-bf7e1a014752 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:09:07.902779 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-83ebec82-8b60-4200-ae5c-bf7e1a014752 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9cd9c0bd017459cb630823a39e8bd17'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:09:07.903575 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-83ebec82-8b60-4200-ae5c-bf7e1a014752 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9cd9c0bd017459cb630823a39e8bd17'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:09:07.920878 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-83ebec82-8b60-4200-ae5c-bf7e1a014752 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9cd9c0bd017459cb630823a39e8bd17'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:09:07.935353 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-83ebec82-8b60-4200-ae5c-bf7e1a014752 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9cd9c0bd017459cb630823a39e8bd17'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:09:07.944412 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:07.947139 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-83ebec82-8b60-4200-ae5c-bf7e1a014752 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9cd9c0bd017459cb630823a39e8bd17'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:09:07.971501 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3529/7093] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:09:07 2022] DELETE /identity/v3/users/e9cd9c0bd017459cb630823a39e8bd17 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:09:09.211551 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6106b413-e65b-4eb2-b7ac-883e8d646b4e service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:09:09.224582 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6106b413-e65b-4eb2-b7ac-883e8d646b4e service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:09:09.288223 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1963a5f8-8afc-4046-b80a-60b590f2b64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:09:09.289208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963a5f8-8afc-4046-b80a-60b590f2b64c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:09:09.289717 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963a5f8-8afc-4046-b80a-60b590f2b64c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:09:09.290200 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963a5f8-8afc-4046-b80a-60b590f2b64c admin admin] PATH_INFO: `/v3/projects/315f3de5e40e4a0ca12713b37c555371` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:09:09.291624 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1963a5f8-8afc-4046-b80a-60b590f2b64c admin admin] RBAC: Authorizing `identity:delete_project(project_id=315f3de5e40e4a0ca12713b37c555371)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:09:09.294352 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1963a5f8-8afc-4046-b80a-60b590f2b64c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:09:09.350074 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1963a5f8-8afc-4046-b80a-60b590f2b64c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '315f3de5e40e4a0ca12713b37c555371', 'request_id': 'req-1963a5f8-8afc-4046-b80a-60b590f2b64c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:09:09.358790 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1963a5f8-8afc-4046-b80a-60b590f2b64c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '315f3de5e40e4a0ca12713b37c555371', 'request_id': 'req-1963a5f8-8afc-4046-b80a-60b590f2b64c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:09:09.366592 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1963a5f8-8afc-4046-b80a-60b590f2b64c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '315f3de5e40e4a0ca12713b37c555371', 'request_id': 'req-1963a5f8-8afc-4046-b80a-60b590f2b64c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:09:09.384179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1963a5f8-8afc-4046-b80a-60b590f2b64c admin admin] The token cache is being invalidate because project 315f3de5e40e4a0ca12713b37c555371 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:09:09.384861 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1963a5f8-8afc-4046-b80a-60b590f2b64c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:09:09.385851 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1963a5f8-8afc-4046-b80a-60b590f2b64c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:09:09.393786 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3565/7094] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:09:09 2022] DELETE /identity/v3/projects/315f3de5e40e4a0ca12713b37c555371 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:09:09.395388 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eebdb8-108f-4deb-a442-dca1ca995ef9 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:09:09.395878 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eebdb8-108f-4deb-a442-dca1ca995ef9 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:09:09.395993 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eebdb8-108f-4deb-a442-dca1ca995ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:09:09.438999 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-25eebdb8-108f-4deb-a442-dca1ca995ef9 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:09:09.440427 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-25eebdb8-108f-4deb-a442-dca1ca995ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:09:09.616343 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3530/7095] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:09:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:09:09.624107 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbe379-2fba-49c1-9b40-33c5f6a728d3 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:09:09.624393 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbe379-2fba-49c1-9b40-33c5f6a728d3 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:09:09.624679 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbe379-2fba-49c1-9b40-33c5f6a728d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:09:09.655343 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-47dbe379-2fba-49c1-9b40-33c5f6a728d3 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:09:09.656996 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-47dbe379-2fba-49c1-9b40-33c5f6a728d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:09:09.675075 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eebdb8-108f-4deb-a442-dca1ca995ef9 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:09:09.683182 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3566/7096] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:09:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:09:09.703948 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eebdb8-108f-4deb-a442-dca1ca995ef9 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:09:09.732297 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed7bb48-373a-4f02-9644-8aa784dfcd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:09:09.734312 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7bb48-373a-4f02-9644-8aa784dfcd9f admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:09:09.735365 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7bb48-373a-4f02-9644-8aa784dfcd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:09:09.737309 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7bb48-373a-4f02-9644-8aa784dfcd9f admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:09:09.738307 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed7bb48-373a-4f02-9644-8aa784dfcd9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:09:09.740131 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed7bb48-373a-4f02-9644-8aa784dfcd9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:09:09.745303 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed7bb48-373a-4f02-9644-8aa784dfcd9f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:09:09.783276 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3531/7097] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:09:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:09:09.783949 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dbe379-2fba-49c1-9b40-33c5f6a728d3 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:09:09.790569 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:09.796335 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dbe379-2fba-49c1-9b40-33c5f6a728d3 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:09:09.813016 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d764b8-061f-4b00-b045-8d073134d0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:09:09.813758 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d764b8-061f-4b00-b045-8d073134d0a6 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:09:09.814154 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d764b8-061f-4b00-b045-8d073134d0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:09:09.814507 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d764b8-061f-4b00-b045-8d073134d0a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:09:09.815199 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d764b8-061f-4b00-b045-8d073134d0a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:09:09.817533 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d764b8-061f-4b00-b045-8d073134d0a6 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:09:09.894400 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3567/7098] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:09:09 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:09:09.897209 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed7bb48-373a-4f02-9644-8aa784dfcd9f admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:09:09.922490 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed7bb48-373a-4f02-9644-8aa784dfcd9f admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:09:10.086786 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80737fd9-97e0-41cc-a8ee-dde3af54d57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:09:10.087717 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80737fd9-97e0-41cc-a8ee-dde3af54d57a admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:09:10.098944 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80737fd9-97e0-41cc-a8ee-dde3af54d57a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:09:10.100293 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80737fd9-97e0-41cc-a8ee-dde3af54d57a admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:09:10.101188 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80737fd9-97e0-41cc-a8ee-dde3af54d57a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:09:10.103862 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80737fd9-97e0-41cc-a8ee-dde3af54d57a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:09:10.186387 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d764b8-061f-4b00-b045-8d073134d0a6 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:09:10.191252 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3532/7099] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:09:09 2022] POST /identity/v3/users => generated 288 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:09:10.202911 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d764b8-061f-4b00-b045-8d073134d0a6 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:09:10.218298 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da1ba92-29f9-47e2-b15a-ae2e5d73629a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:09:10.218939 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1ba92-29f9-47e2-b15a-ae2e5d73629a admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:09:10.219208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1ba92-29f9-47e2-b15a-ae2e5d73629a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:09:10.219486 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1ba92-29f9-47e2-b15a-ae2e5d73629a admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:09:10.220717 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da1ba92-29f9-47e2-b15a-ae2e5d73629a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:09:10.224299 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da1ba92-29f9-47e2-b15a-ae2e5d73629a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:09:10.254334 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3568/7100] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:09:10.256430 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80737fd9-97e0-41cc-a8ee-dde3af54d57a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:09:10.271856 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80737fd9-97e0-41cc-a8ee-dde3af54d57a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:09:10.286015 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775b19a-4dc9-4001-ac66-26936607371c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:09:10.286771 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775b19a-4dc9-4001-ac66-26936607371c admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:09:10.287685 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775b19a-4dc9-4001-ac66-26936607371c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:09:10.288777 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775b19a-4dc9-4001-ac66-26936607371c admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:09:10.291241 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2775b19a-4dc9-4001-ac66-26936607371c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:09:10.295548 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2775b19a-4dc9-4001-ac66-26936607371c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:09:10.304825 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da1ba92-29f9-47e2-b15a-ae2e5d73629a admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:09:10.308180 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6da1ba92-29f9-47e2-b15a-ae2e5d73629a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:09:10.325881 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3533/7101] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:09:10.327010 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775b19a-4dc9-4001-ac66-26936607371c admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:09:10.357238 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775b19a-4dc9-4001-ac66-26936607371c admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:09:10.374260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f819ca-d4a1-41a6-ab73-ffb0ecbe24c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:09:10.375144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f819ca-d4a1-41a6-ab73-ffb0ecbe24c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:09:10.375527 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f819ca-d4a1-41a6-ab73-ffb0ecbe24c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:09:10.376012 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f819ca-d4a1-41a6-ab73-ffb0ecbe24c2 admin admin] PATH_INFO: `/v3/projects/86b55124150c4d06b81f03f7732310db/users/d6f8a74078404f08bbcacbeb5b915f36/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:09:10.414365 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f819ca-d4a1-41a6-ab73-ffb0ecbe24c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86b55124150c4d06b81f03f7732310db, user_id=d6f8a74078404f08bbcacbeb5b915f36, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:09:10.424505 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f819ca-d4a1-41a6-ab73-ffb0ecbe24c2 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:09:10.461431 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3534/7102] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:09:10 2022] PUT /identity/v3/projects/86b55124150c4d06b81f03f7732310db/users/d6f8a74078404f08bbcacbeb5b915f36/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:09:10.467278 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f40c4-160b-4014-8f0c-da3629b499f0 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:09:10.467845 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f40c4-160b-4014-8f0c-da3629b499f0 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:09:10.468356 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f40c4-160b-4014-8f0c-da3629b499f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:09:10.504484 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da1ba92-29f9-47e2-b15a-ae2e5d73629a admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:09:10.515648 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-bc3f40c4-160b-4014-8f0c-da3629b499f0 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:09:10.516930 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-bc3f40c4-160b-4014-8f0c-da3629b499f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:09:10.624878 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f639f9-259f-4e15-baf6-69ebc90ef6e1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:09:10.628788 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f639f9-259f-4e15-baf6-69ebc90ef6e1 service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:09:10.629087 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f639f9-259f-4e15-baf6-69ebc90ef6e1 service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:09:10.629370 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f639f9-259f-4e15-baf6-69ebc90ef6e1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:09:10.631013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:10.640458 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e7f639f9-259f-4e15-baf6-69ebc90ef6e1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:09:10.679217 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f639f9-259f-4e15-baf6-69ebc90ef6e1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:09:10.685390 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f639f9-259f-4e15-baf6-69ebc90ef6e1 service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:09:10.702999 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3535/7103] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:09:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:09:10.720490 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3569/7104] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:09:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:09:10.722772 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f40c4-160b-4014-8f0c-da3629b499f0 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:09:10.730107 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-bc3f40c4-160b-4014-8f0c-da3629b499f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:09:10.912751 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f40c4-160b-4014-8f0c-da3629b499f0 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:09:10.923872 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7accbe0e-b556-43b6-912f-5c04a21bdce1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:09:10.924522 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accbe0e-b556-43b6-912f-5c04a21bdce1 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:09:10.924804 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accbe0e-b556-43b6-912f-5c04a21bdce1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:09:10.925090 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accbe0e-b556-43b6-912f-5c04a21bdce1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:09:10.967363 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7accbe0e-b556-43b6-912f-5c04a21bdce1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:09:10.969070 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7accbe0e-b556-43b6-912f-5c04a21bdce1 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:09:10.990607 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3536/7105] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:09:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:09:12.784972 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f639f9-259f-4e15-baf6-69ebc90ef6e1 service placement] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:09:12.819319 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f639f9-259f-4e15-baf6-69ebc90ef6e1 service placement] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:09:12.824348 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d15f7-183f-419d-8866-94bf71fcab97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:09:12.825355 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d15f7-183f-419d-8866-94bf71fcab97 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:09:12.825644 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d15f7-183f-419d-8866-94bf71fcab97 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:09:12.826056 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d15f7-183f-419d-8866-94bf71fcab97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:09:12.828714 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-579d15f7-183f-419d-8866-94bf71fcab97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:09:12.856726 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579d15f7-183f-419d-8866-94bf71fcab97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:09:12.858966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579d15f7-183f-419d-8866-94bf71fcab97 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:09:12.888000 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3570/7106] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:09:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:09:14.883982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7accbe0e-b556-43b6-912f-5c04a21bdce1 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:09:14.885542 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7accbe0e-b556-43b6-912f-5c04a21bdce1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:09:15.066917 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7accbe0e-b556-43b6-912f-5c04a21bdce1 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:09:15.084193 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59918fe5-4c29-4adc-8bb7-80a41faa1ade service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:09:15.085021 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59918fe5-4c29-4adc-8bb7-80a41faa1ade service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:09:15.085439 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59918fe5-4c29-4adc-8bb7-80a41faa1ade service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:09:15.085806 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59918fe5-4c29-4adc-8bb7-80a41faa1ade service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:09:15.087762 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-59918fe5-4c29-4adc-8bb7-80a41faa1ade service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:09:15.123154 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59918fe5-4c29-4adc-8bb7-80a41faa1ade service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:09:15.125286 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59918fe5-4c29-4adc-8bb7-80a41faa1ade service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:09:15.154358 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3537/7107] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:09:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:09:22.866349 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=76,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:25.140433 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=70 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:25.817727 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e1f01-1b96-44c7-be8c-6f9d0369fb24 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:09:25.818299 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e1f01-1b96-44c7-be8c-6f9d0369fb24 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:09:25.818299 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e1f01-1b96-44c7-be8c-6f9d0369fb24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:09:25.841153 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59206d55-4a53-4c00-8584-daa278059e3e None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:09:25.843215 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59206d55-4a53-4c00-8584-daa278059e3e None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:09:25.843750 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59206d55-4a53-4c00-8584-daa278059e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:09:25.865675 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-fe8e1f01-1b96-44c7-be8c-6f9d0369fb24 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:09:25.878687 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-fe8e1f01-1b96-44c7-be8c-6f9d0369fb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:09:25.969945 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-59206d55-4a53-4c00-8584-daa278059e3e None None] MFA Rules not processed for user `d6f8a74078404f08bbcacbeb5b915f36`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:09:25.972877 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-59206d55-4a53-4c00-8584-daa278059e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:09:26.079978 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3571/7108] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 16:09:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:09:26.158848 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e1f01-1b96-44c7-be8c-6f9d0369fb24 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:09:26.160388 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-fe8e1f01-1b96-44c7-be8c-6f9d0369fb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:09:26.189451 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3538/7109] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:09:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:09:26.190395 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59206d55-4a53-4c00-8584-daa278059e3e None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:09:26.217448 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59206d55-4a53-4c00-8584-daa278059e3e None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:09:26.229281 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28d2de-5237-4414-8ad4-2756e0c5df05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:09:26.230446 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28d2de-5237-4414-8ad4-2756e0c5df05 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:09:26.230731 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28d2de-5237-4414-8ad4-2756e0c5df05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:09:26.231041 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28d2de-5237-4414-8ad4-2756e0c5df05 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:09:26.231767 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f28d2de-5237-4414-8ad4-2756e0c5df05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:09:26.246390 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f28d2de-5237-4414-8ad4-2756e0c5df05 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:09:26.304881 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3539/7110] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:09:26 2022] POST /identity/v3/projects => generated 375 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:09:26.310018 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28d2de-5237-4414-8ad4-2756e0c5df05 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:09:26.312924 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e1f01-1b96-44c7-be8c-6f9d0369fb24 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:09:26.409114 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28d2de-5237-4414-8ad4-2756e0c5df05 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:09:26.414551 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e5365-dd4d-4d62-9d43-d53d5dd965a3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:09:26.415544 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e5365-dd4d-4d62-9d43-d53d5dd965a3 service swift] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:09:26.416617 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e5365-dd4d-4d62-9d43-d53d5dd965a3 service swift] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:09:26.417287 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e5365-dd4d-4d62-9d43-d53d5dd965a3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:09:26.425375 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83703c3-2290-4e8d-ba5e-93dd51bff960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:09:26.425977 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83703c3-2290-4e8d-ba5e-93dd51bff960 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:09:26.426273 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83703c3-2290-4e8d-ba5e-93dd51bff960 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:09:26.426541 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83703c3-2290-4e8d-ba5e-93dd51bff960 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:09:26.427285 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83703c3-2290-4e8d-ba5e-93dd51bff960 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:09:26.432212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83703c3-2290-4e8d-ba5e-93dd51bff960 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:09:26.495252 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3540/7111] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:09:26 2022] POST /identity/v3/users => generated 294 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:09:26.497478 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83703c3-2290-4e8d-ba5e-93dd51bff960 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:09:26.513298 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:26.525778 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83703c3-2290-4e8d-ba5e-93dd51bff960 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:09:26.535419 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e5365-dd4d-4d62-9d43-d53d5dd965a3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:09:26.538244 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e5365-dd4d-4d62-9d43-d53d5dd965a3 service swift] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:09:26.549630 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7cec72-47e6-41f6-b95c-9afabd263c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:09:26.550333 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7cec72-47e6-41f6-b95c-9afabd263c69 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:09:26.550780 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7cec72-47e6-41f6-b95c-9afabd263c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:09:26.551171 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7cec72-47e6-41f6-b95c-9afabd263c69 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:09:26.551861 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7cec72-47e6-41f6-b95c-9afabd263c69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:09:26.553501 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7cec72-47e6-41f6-b95c-9afabd263c69 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:09:26.592189 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3541/7112] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:09:26.595656 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3572/7113] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 16:09:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 16:09:26.605478 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7cec72-47e6-41f6-b95c-9afabd263c69 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:09:26.646300 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7cec72-47e6-41f6-b95c-9afabd263c69 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:09:26.662974 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3d637-32a7-4ca9-9255-8f959bb6f0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:09:26.669367 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3d637-32a7-4ca9-9255-8f959bb6f0af admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:09:26.669654 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3d637-32a7-4ca9-9255-8f959bb6f0af admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:09:26.670313 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3d637-32a7-4ca9-9255-8f959bb6f0af admin admin] PATH_INFO: `/v3/projects/e4d5ce8b0cc1426dacca8b2f631a5949/users/6726e156cfb9479bbcca0d6a88f39566/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:09:26.731263 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e3d637-32a7-4ca9-9255-8f959bb6f0af admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4d5ce8b0cc1426dacca8b2f631a5949, user_id=6726e156cfb9479bbcca0d6a88f39566, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:09:26.741605 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e3d637-32a7-4ca9-9255-8f959bb6f0af admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:09:26.812142 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3542/7114] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:09:26 2022] PUT /identity/v3/projects/e4d5ce8b0cc1426dacca8b2f631a5949/users/6726e156cfb9479bbcca0d6a88f39566/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:09:26.813316 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e5365-dd4d-4d62-9d43-d53d5dd965a3 service swift] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:09:26.851736 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e5365-dd4d-4d62-9d43-d53d5dd965a3 service swift] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:09:27.062652 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b690d-09ae-4702-b1f9-8e02cdb29ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:09:27.063346 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b690d-09ae-4702-b1f9-8e02cdb29ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:09:27.063624 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b690d-09ae-4702-b1f9-8e02cdb29ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:09:27.063901 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b690d-09ae-4702-b1f9-8e02cdb29ef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:09:27.064559 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368b690d-09ae-4702-b1f9-8e02cdb29ef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:09:27.066326 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368b690d-09ae-4702-b1f9-8e02cdb29ef0 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:09:27.129464 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3573/7115] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:09:27.130363 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3d637-32a7-4ca9-9255-8f959bb6f0af admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:09:27.149159 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3d637-32a7-4ca9-9255-8f959bb6f0af admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:09:27.181386 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1a55c-d776-400c-b6ff-2985318782e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:09:27.185766 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1a55c-d776-400c-b6ff-2985318782e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:09:27.186267 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1a55c-d776-400c-b6ff-2985318782e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:09:27.205594 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1a55c-d776-400c-b6ff-2985318782e7 admin admin] PATH_INFO: `/v3/projects/e4d5ce8b0cc1426dacca8b2f631a5949/users/6726e156cfb9479bbcca0d6a88f39566/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:09:27.218175 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1a55c-d776-400c-b6ff-2985318782e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4d5ce8b0cc1426dacca8b2f631a5949, user_id=6726e156cfb9479bbcca0d6a88f39566, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:09:27.220861 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1a55c-d776-400c-b6ff-2985318782e7 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:09:27.288716 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3543/7116] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:09:27 2022] PUT /identity/v3/projects/e4d5ce8b0cc1426dacca8b2f631a5949/users/6726e156cfb9479bbcca0d6a88f39566/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:09:37.090997 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=34 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:37.268860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=90,keystone:INSERT=6 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:39.318210 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b690d-09ae-4702-b1f9-8e02cdb29ef0 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:09:39.320261 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-368b690d-09ae-4702-b1f9-8e02cdb29ef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:09:39.351753 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b690d-09ae-4702-b1f9-8e02cdb29ef0 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:09:39.522457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fcead9-6db7-4839-ac4a-c760755cfd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:09:39.523836 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcead9-6db7-4839-ac4a-c760755cfd6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:09:39.524070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcead9-6db7-4839-ac4a-c760755cfd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:09:39.524311 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcead9-6db7-4839-ac4a-c760755cfd6b admin admin] PATH_INFO: `/v3/users/e3f31d0f9c094979bfbddfa323cbe762` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:09:39.537776 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fcead9-6db7-4839-ac4a-c760755cfd6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3f31d0f9c094979bfbddfa323cbe762)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:09:39.540356 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fcead9-6db7-4839-ac4a-c760755cfd6b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:09:39.665777 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f5fcead9-6db7-4839-ac4a-c760755cfd6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3f31d0f9c094979bfbddfa323cbe762'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:09:39.668257 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f5fcead9-6db7-4839-ac4a-c760755cfd6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3f31d0f9c094979bfbddfa323cbe762'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:09:39.689555 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f5fcead9-6db7-4839-ac4a-c760755cfd6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3f31d0f9c094979bfbddfa323cbe762'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:09:39.702476 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f5fcead9-6db7-4839-ac4a-c760755cfd6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3f31d0f9c094979bfbddfa323cbe762'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:09:39.703607 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f5fcead9-6db7-4839-ac4a-c760755cfd6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3f31d0f9c094979bfbddfa323cbe762'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:09:39.744549 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3574/7117] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:09:39 2022] DELETE /identity/v3/users/e3f31d0f9c094979bfbddfa323cbe762 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:09:39.749816 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf6889-7349-4bd4-9c66-a1b8b92d49d5 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:09:39.750293 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf6889-7349-4bd4-9c66-a1b8b92d49d5 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:09:39.750394 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf6889-7349-4bd4-9c66-a1b8b92d49d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:09:39.804333 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-9dcf6889-7349-4bd4-9c66-a1b8b92d49d5 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:09:39.805603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9dcf6889-7349-4bd4-9c66-a1b8b92d49d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:09:39.985176 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3544/7118] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:09:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:09:39.986206 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fcead9-6db7-4839-ac4a-c760755cfd6b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:09:39.988177 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f5fcead9-6db7-4839-ac4a-c760755cfd6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:09:40.187056 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fcead9-6db7-4839-ac4a-c760755cfd6b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:09:40.198988 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d366c38-3a9c-49eb-9b25-ab1e13251e9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:09:40.206158 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d366c38-3a9c-49eb-9b25-ab1e13251e9e service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:09:40.206736 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d366c38-3a9c-49eb-9b25-ab1e13251e9e service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:09:40.207242 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d366c38-3a9c-49eb-9b25-ab1e13251e9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:09:40.255302 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d366c38-3a9c-49eb-9b25-ab1e13251e9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:09:40.257134 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d366c38-3a9c-49eb-9b25-ab1e13251e9e service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:09:40.289323 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3575/7119] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:09:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:09:40.739071 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf6889-7349-4bd4-9c66-a1b8b92d49d5 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:09:40.746473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9dcf6889-7349-4bd4-9c66-a1b8b92d49d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:09:40.775881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf6889-7349-4bd4-9c66-a1b8b92d49d5 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:09:40.795893 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20e4f2-208d-4d32-82d5-db1882a041fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:09:40.796131 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20e4f2-208d-4d32-82d5-db1882a041fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:09:40.796520 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20e4f2-208d-4d32-82d5-db1882a041fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:09:40.796917 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20e4f2-208d-4d32-82d5-db1882a041fe admin admin] PATH_INFO: `/v3/projects/02aef726b4de480eaac39ce336f2455c` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:09:40.799951 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea20e4f2-208d-4d32-82d5-db1882a041fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=02aef726b4de480eaac39ce336f2455c)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:09:40.810950 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea20e4f2-208d-4d32-82d5-db1882a041fe admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:09:40.950849 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ea20e4f2-208d-4d32-82d5-db1882a041fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02aef726b4de480eaac39ce336f2455c', 'request_id': 'req-ea20e4f2-208d-4d32-82d5-db1882a041fe'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:09:40.962982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ea20e4f2-208d-4d32-82d5-db1882a041fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02aef726b4de480eaac39ce336f2455c', 'request_id': 'req-ea20e4f2-208d-4d32-82d5-db1882a041fe'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:09:40.990498 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ea20e4f2-208d-4d32-82d5-db1882a041fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02aef726b4de480eaac39ce336f2455c', 'request_id': 'req-ea20e4f2-208d-4d32-82d5-db1882a041fe'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:09:41.010644 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ea20e4f2-208d-4d32-82d5-db1882a041fe admin admin] The token cache is being invalidate because project 02aef726b4de480eaac39ce336f2455c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:09:41.011962 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ea20e4f2-208d-4d32-82d5-db1882a041fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:09:41.012832 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ea20e4f2-208d-4d32-82d5-db1882a041fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:09:41.019297 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3545/7120] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:09:40 2022] DELETE /identity/v3/projects/02aef726b4de480eaac39ce336f2455c => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:09:41.024082 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b4a5f-4d5f-4994-8a19-f0787f6d7026 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:09:41.024938 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b4a5f-4d5f-4994-8a19-f0787f6d7026 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:09:41.025385 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b4a5f-4d5f-4994-8a19-f0787f6d7026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:09:41.055569 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-7c9b4a5f-4d5f-4994-8a19-f0787f6d7026 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:09:41.057071 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7c9b4a5f-4d5f-4994-8a19-f0787f6d7026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:09:41.077778 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:41.145891 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3576/7121] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:09:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:09:41.156464 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290ff6c-ea9f-4465-b939-c41d43c7313b None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:09:41.157109 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290ff6c-ea9f-4465-b939-c41d43c7313b None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:09:41.157562 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290ff6c-ea9f-4465-b939-c41d43c7313b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:09:41.208577 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-d290ff6c-ea9f-4465-b939-c41d43c7313b None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:09:41.212192 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d290ff6c-ea9f-4465-b939-c41d43c7313b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:09:41.224530 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3546/7122] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:09:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:09:41.228652 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b4a5f-4d5f-4994-8a19-f0787f6d7026 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:09:41.247440 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b4a5f-4d5f-4994-8a19-f0787f6d7026 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:09:41.262259 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48dd9b-9c4e-4bf0-8693-e522b6de6721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:09:41.263382 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48dd9b-9c4e-4bf0-8693-e522b6de6721 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:09:41.263903 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48dd9b-9c4e-4bf0-8693-e522b6de6721 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:09:41.264395 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48dd9b-9c4e-4bf0-8693-e522b6de6721 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:09:41.267741 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b48dd9b-9c4e-4bf0-8693-e522b6de6721 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:09:41.268417 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b48dd9b-9c4e-4bf0-8693-e522b6de6721 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:09:41.271695 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b48dd9b-9c4e-4bf0-8693-e522b6de6721 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:09:41.301974 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3577/7123] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:09:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:09:41.303649 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290ff6c-ea9f-4465-b939-c41d43c7313b None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:09:41.320038 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290ff6c-ea9f-4465-b939-c41d43c7313b None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:09:41.332535 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc01e16-7778-42ac-b115-cfd862ddac1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:09:41.333918 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc01e16-7778-42ac-b115-cfd862ddac1c admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:09:41.334440 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc01e16-7778-42ac-b115-cfd862ddac1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:09:41.334941 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc01e16-7778-42ac-b115-cfd862ddac1c admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:09:41.336459 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc01e16-7778-42ac-b115-cfd862ddac1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:09:41.339432 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc01e16-7778-42ac-b115-cfd862ddac1c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:09:41.438486 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3547/7124] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:09:41 2022] POST /identity/v3/projects => generated 359 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:09:41.440339 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48dd9b-9c4e-4bf0-8693-e522b6de6721 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:09:41.496314 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48dd9b-9c4e-4bf0-8693-e522b6de6721 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:09:41.639723 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed83abc5-2e45-4940-a39f-c314104d0e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:09:41.640358 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83abc5-2e45-4940-a39f-c314104d0e96 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:09:41.640641 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83abc5-2e45-4940-a39f-c314104d0e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:09:41.640913 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83abc5-2e45-4940-a39f-c314104d0e96 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:09:41.642245 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed83abc5-2e45-4940-a39f-c314104d0e96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:09:41.646853 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed83abc5-2e45-4940-a39f-c314104d0e96 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:09:41.712166 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3578/7125] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:09:41 2022] POST /identity/v3/users => generated 280 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:09:41.716359 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc01e16-7778-42ac-b115-cfd862ddac1c admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:09:41.744425 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc01e16-7778-42ac-b115-cfd862ddac1c admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:09:41.764598 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763745b5-900f-4b6a-9044-255014afe2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:09:41.765883 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763745b5-900f-4b6a-9044-255014afe2ec admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:09:41.766524 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763745b5-900f-4b6a-9044-255014afe2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:09:41.768274 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763745b5-900f-4b6a-9044-255014afe2ec admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:09:41.769189 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763745b5-900f-4b6a-9044-255014afe2ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:09:41.771366 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763745b5-900f-4b6a-9044-255014afe2ec admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:09:41.828213 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed83abc5-2e45-4940-a39f-c314104d0e96 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:09:41.828460 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3548/7126] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:09:41.871505 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed83abc5-2e45-4940-a39f-c314104d0e96 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:09:41.892231 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a1c8a-2f7c-4093-aea8-3cd8e1410ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:09:41.893612 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a1c8a-2f7c-4093-aea8-3cd8e1410ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:09:41.894059 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a1c8a-2f7c-4093-aea8-3cd8e1410ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:09:41.895144 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a1c8a-2f7c-4093-aea8-3cd8e1410ab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:09:41.900240 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a1c8a-2f7c-4093-aea8-3cd8e1410ab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:09:41.905927 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a1c8a-2f7c-4093-aea8-3cd8e1410ab1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:09:41.952407 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3579/7127] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:09:41.956395 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763745b5-900f-4b6a-9044-255014afe2ec admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:09:41.977958 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763745b5-900f-4b6a-9044-255014afe2ec admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:09:42.006817 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd178784-932a-4186-b5be-e2f63bd98348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:09:42.015150 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd178784-932a-4186-b5be-e2f63bd98348 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:09:42.016629 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd178784-932a-4186-b5be-e2f63bd98348 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:09:42.018185 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd178784-932a-4186-b5be-e2f63bd98348 admin admin] PATH_INFO: `/v3/projects/e85abf442b8e4ba09240b5adc34729f4/users/17033e70ef7a431e9eb1080a29c659a9/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:09:42.087988 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd178784-932a-4186-b5be-e2f63bd98348 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e85abf442b8e4ba09240b5adc34729f4, user_id=17033e70ef7a431e9eb1080a29c659a9, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:09:42.091355 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd178784-932a-4186-b5be-e2f63bd98348 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:09:42.138336 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3549/7128] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:09:41 2022] PUT /identity/v3/projects/e85abf442b8e4ba09240b5adc34729f4/users/17033e70ef7a431e9eb1080a29c659a9/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:09:42.148361 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed9c97-486e-409c-ac7a-d642597971ca None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:09:42.148947 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed9c97-486e-409c-ac7a-d642597971ca None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:09:42.148947 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed9c97-486e-409c-ac7a-d642597971ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:09:42.238244 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-faed9c97-486e-409c-ac7a-d642597971ca None None] MFA Rules not processed for user `17033e70ef7a431e9eb1080a29c659a9`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:09:42.239518 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-faed9c97-486e-409c-ac7a-d642597971ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:09:42.425152 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3580/7129] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:09:42 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:09:42.436022 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd178784-932a-4186-b5be-e2f63bd98348 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:09:42.437729 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-fd178784-932a-4186-b5be-e2f63bd98348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:09:42.482888 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:42.607901 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd178784-932a-4186-b5be-e2f63bd98348 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:09:42.611760 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6481d35-698d-4cd6-9154-cb167425f479 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:09:42.612448 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6481d35-698d-4cd6-9154-cb167425f479 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:09:42.612737 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6481d35-698d-4cd6-9154-cb167425f479 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:09:42.613008 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6481d35-698d-4cd6-9154-cb167425f479 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:09:42.650141 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6481d35-698d-4cd6-9154-cb167425f479 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:09:42.652737 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6481d35-698d-4cd6-9154-cb167425f479 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:09:42.676387 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3550/7130] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:09:42 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:09:44.203465 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96544a7c-0530-40c6-a46a-df05806bc533 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:09:44.205107 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96544a7c-0530-40c6-a46a-df05806bc533 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:09:44.205712 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96544a7c-0530-40c6-a46a-df05806bc533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:09:44.277910 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-96544a7c-0530-40c6-a46a-df05806bc533 None None] MFA Rules not processed for user `6726e156cfb9479bbcca0d6a88f39566`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:09:44.279824 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-96544a7c-0530-40c6-a46a-df05806bc533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:09:44.297097 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:44.522571 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3581/7131] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:09:44 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:09:44.915260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6481d35-698d-4cd6-9154-cb167425f479 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:09:44.916790 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c6481d35-698d-4cd6-9154-cb167425f479 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:09:45.084192 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6481d35-698d-4cd6-9154-cb167425f479 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:09:45.106812 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f44dd-a160-4ad4-8f53-d5b361bcfa1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:09:45.107860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f44dd-a160-4ad4-8f53-d5b361bcfa1f service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:09:45.108301 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f44dd-a160-4ad4-8f53-d5b361bcfa1f service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:09:45.108732 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f44dd-a160-4ad4-8f53-d5b361bcfa1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:09:45.131289 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f44dd-a160-4ad4-8f53-d5b361bcfa1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:09:45.133237 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f44dd-a160-4ad4-8f53-d5b361bcfa1f service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:09:45.152899 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3551/7132] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:09:44 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:09:45.371606 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec771d8-a1fa-419c-b2ae-92e15e880a9c None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:09:45.372383 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec771d8-a1fa-419c-b2ae-92e15e880a9c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:09:45.372383 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec771d8-a1fa-419c-b2ae-92e15e880a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:09:45.441773 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-aec771d8-a1fa-419c-b2ae-92e15e880a9c None None] MFA Rules not processed for user `d6f8a74078404f08bbcacbeb5b915f36`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:09:45.443669 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-aec771d8-a1fa-419c-b2ae-92e15e880a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:09:45.730110 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3582/7133] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:09:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:09:53.358614 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8efd7-03f3-441c-a55a-369ead1532a4 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:09:53.359566 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8efd7-03f3-441c-a55a-369ead1532a4 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:09:53.360025 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8efd7-03f3-441c-a55a-369ead1532a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:09:53.407941 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-c7a8efd7-03f3-441c-a55a-369ead1532a4 None None] MFA Rules not processed for user `f075974a803f46eda667db6d754453ba`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:09:53.414219 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c7a8efd7-03f3-441c-a55a-369ead1532a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:09:53.661447 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3552/7134] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:09:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:09:55.692692 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=51 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:03.626165 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=76 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:08.212472 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bb1ff-c4b2-4504-af40-11540ff5fca1 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:08.213139 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bb1ff-c4b2-4504-af40-11540ff5fca1 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:08.213493 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bb1ff-c4b2-4504-af40-11540ff5fca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:08.443857 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-175bb1ff-c4b2-4504-af40-11540ff5fca1 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:10:08.455615 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-175bb1ff-c4b2-4504-af40-11540ff5fca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:08.556701 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3583/7135] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 16:10:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:10:08.582239 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8efd7-03f3-441c-a55a-369ead1532a4 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:08.583783 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c7a8efd7-03f3-441c-a55a-369ead1532a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:08.894937 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8efd7-03f3-441c-a55a-369ead1532a4 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:08.934465 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ea85c-e2f8-4114-a9fa-6e0b11b7c27b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:08.935446 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ea85c-e2f8-4114-a9fa-6e0b11b7c27b service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:08.935446 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ea85c-e2f8-4114-a9fa-6e0b11b7c27b service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:08.935779 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ea85c-e2f8-4114-a9fa-6e0b11b7c27b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:08.951639 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ea85c-e2f8-4114-a9fa-6e0b11b7c27b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:08.953692 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ea85c-e2f8-4114-a9fa-6e0b11b7c27b service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:08.965238 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3553/7136] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 16:10:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:10:17.382284 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e069f6c-4741-4278-8c90-3c3b1e9f53fa None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:17.382962 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e069f6c-4741-4278-8c90-3c3b1e9f53fa None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:17.383099 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e069f6c-4741-4278-8c90-3c3b1e9f53fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:17.434017 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-0e069f6c-4741-4278-8c90-3c3b1e9f53fa None None] MFA Rules not processed for user `d6f8a74078404f08bbcacbeb5b915f36`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:10:17.436398 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0e069f6c-4741-4278-8c90-3c3b1e9f53fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:17.458313 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3584/7137] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:10:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:10:18.408764 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c63bb6-4bd0-42e1-8d0d-b0f9822cd6ba None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:18.409296 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c63bb6-4bd0-42e1-8d0d-b0f9822cd6ba None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:18.409296 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c63bb6-4bd0-42e1-8d0d-b0f9822cd6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:18.442326 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-21c63bb6-4bd0-42e1-8d0d-b0f9822cd6ba None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:10:18.443889 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-21c63bb6-4bd0-42e1-8d0d-b0f9822cd6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:18.457298 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3554/7138] 10.222.0.83 () {58 vars in 967 bytes} [Mon Aug 29 16:10:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:10:18.500231 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e069f6c-4741-4278-8c90-3c3b1e9f53fa None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:18.524273 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e069f6c-4741-4278-8c90-3c3b1e9f53fa None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:18.536686 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a045000-6a04-4eeb-850a-06ecc3155e09 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:18.538621 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a045000-6a04-4eeb-850a-06ecc3155e09 service swift] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:18.538919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a045000-6a04-4eeb-850a-06ecc3155e09 service swift] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:18.542536 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a045000-6a04-4eeb-850a-06ecc3155e09 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:18.561312 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a045000-6a04-4eeb-850a-06ecc3155e09 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:18.565853 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a045000-6a04-4eeb-850a-06ecc3155e09 service swift] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:18.590340 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3585/7139] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 16:10:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:10:27.222654 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c63bb6-4bd0-42e1-8d0d-b0f9822cd6ba None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:27.425245 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c63bb6-4bd0-42e1-8d0d-b0f9822cd6ba None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:27.445001 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1924c27a-ed67-4a4e-a5f4-ad9a2f715ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:27.445786 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924c27a-ed67-4a4e-a5f4-ad9a2f715ced admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:27.446070 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924c27a-ed67-4a4e-a5f4-ad9a2f715ced admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:27.447354 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924c27a-ed67-4a4e-a5f4-ad9a2f715ced admin admin] PATH_INFO: `/v3/users/17033e70ef7a431e9eb1080a29c659a9` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:27.451630 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1924c27a-ed67-4a4e-a5f4-ad9a2f715ced admin admin] RBAC: Authorizing `identity:delete_user(user_id=17033e70ef7a431e9eb1080a29c659a9)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:27.453625 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1924c27a-ed67-4a4e-a5f4-ad9a2f715ced admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:27.613350 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1924c27a-ed67-4a4e-a5f4-ad9a2f715ced admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17033e70ef7a431e9eb1080a29c659a9'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:27.614100 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1924c27a-ed67-4a4e-a5f4-ad9a2f715ced admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17033e70ef7a431e9eb1080a29c659a9'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:27.656944 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1924c27a-ed67-4a4e-a5f4-ad9a2f715ced admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17033e70ef7a431e9eb1080a29c659a9'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:27.685911 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1924c27a-ed67-4a4e-a5f4-ad9a2f715ced admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17033e70ef7a431e9eb1080a29c659a9'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:27.689222 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:27.700792 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1924c27a-ed67-4a4e-a5f4-ad9a2f715ced admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17033e70ef7a431e9eb1080a29c659a9'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:27.719941 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3555/7140] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:10:27 2022] DELETE /identity/v3/users/17033e70ef7a431e9eb1080a29c659a9 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:10:27.724116 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea14269-0a19-41f6-9bfc-c1776b27e043 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:27.724946 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea14269-0a19-41f6-9bfc-c1776b27e043 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:27.725584 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea14269-0a19-41f6-9bfc-c1776b27e043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:27.766027 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-8ea14269-0a19-41f6-9bfc-c1776b27e043 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:10:27.767587 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8ea14269-0a19-41f6-9bfc-c1776b27e043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:27.958204 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3586/7141] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:10:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:10:28.006573 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1924c27a-ed67-4a4e-a5f4-ad9a2f715ced admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:28.008457 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1924c27a-ed67-4a4e-a5f4-ad9a2f715ced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:28.134225 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1924c27a-ed67-4a4e-a5f4-ad9a2f715ced admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:28.140081 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea1ef98-e34a-4317-b47f-b834ba208e5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:28.141426 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1ef98-e34a-4317-b47f-b834ba208e5d service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:28.141925 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1ef98-e34a-4317-b47f-b834ba208e5d service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:28.142455 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1ef98-e34a-4317-b47f-b834ba208e5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:28.155766 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea1ef98-e34a-4317-b47f-b834ba208e5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:28.157554 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea1ef98-e34a-4317-b47f-b834ba208e5d service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:28.180456 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3556/7142] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:10:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:10:28.569385 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea14269-0a19-41f6-9bfc-c1776b27e043 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:28.571680 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8ea14269-0a19-41f6-9bfc-c1776b27e043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:28.592548 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea14269-0a19-41f6-9bfc-c1776b27e043 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:28.603128 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4bd61d-f940-44d0-975b-81fdbb067e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:28.604530 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4bd61d-f940-44d0-975b-81fdbb067e78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:28.605081 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4bd61d-f940-44d0-975b-81fdbb067e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:28.605521 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4bd61d-f940-44d0-975b-81fdbb067e78 admin admin] PATH_INFO: `/v3/users/c4dc9da48de7438598c1aa4bc8d238ce` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:28.608736 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4bd61d-f940-44d0-975b-81fdbb067e78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4dc9da48de7438598c1aa4bc8d238ce)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:28.613752 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4bd61d-f940-44d0-975b-81fdbb067e78 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:28.769666 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7d4bd61d-f940-44d0-975b-81fdbb067e78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4dc9da48de7438598c1aa4bc8d238ce'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:28.772763 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7d4bd61d-f940-44d0-975b-81fdbb067e78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4dc9da48de7438598c1aa4bc8d238ce'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:28.788448 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7d4bd61d-f940-44d0-975b-81fdbb067e78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4dc9da48de7438598c1aa4bc8d238ce'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:28.791965 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:28.812323 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7d4bd61d-f940-44d0-975b-81fdbb067e78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4dc9da48de7438598c1aa4bc8d238ce'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:28.813663 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7d4bd61d-f940-44d0-975b-81fdbb067e78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4dc9da48de7438598c1aa4bc8d238ce'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:28.864469 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3587/7143] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:10:28 2022] DELETE /identity/v3/users/c4dc9da48de7438598c1aa4bc8d238ce => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:10:29.587892 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea1ef98-e34a-4317-b47f-b834ba208e5d service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:29.589950 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-aea1ef98-e34a-4317-b47f-b834ba208e5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:29.622150 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea1ef98-e34a-4317-b47f-b834ba208e5d service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:29.768942 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ea0d8-35b2-43c1-8364-2f8679ccc645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:29.769535 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ea0d8-35b2-43c1-8364-2f8679ccc645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:29.769798 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ea0d8-35b2-43c1-8364-2f8679ccc645 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:29.770065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ea0d8-35b2-43c1-8364-2f8679ccc645 admin admin] PATH_INFO: `/v3/projects/e85abf442b8e4ba09240b5adc34729f4` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:29.775552 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ea0d8-35b2-43c1-8364-2f8679ccc645 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e85abf442b8e4ba09240b5adc34729f4)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:29.788520 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ea0d8-35b2-43c1-8364-2f8679ccc645 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:29.929037 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-107ea0d8-35b2-43c1-8364-2f8679ccc645 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e85abf442b8e4ba09240b5adc34729f4', 'request_id': 'req-107ea0d8-35b2-43c1-8364-2f8679ccc645'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:29.948512 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-107ea0d8-35b2-43c1-8364-2f8679ccc645 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e85abf442b8e4ba09240b5adc34729f4', 'request_id': 'req-107ea0d8-35b2-43c1-8364-2f8679ccc645'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:29.962127 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4bd61d-f940-44d0-975b-81fdbb067e78 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:29.964454 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7d4bd61d-f940-44d0-975b-81fdbb067e78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:29.966243 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-107ea0d8-35b2-43c1-8364-2f8679ccc645 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e85abf442b8e4ba09240b5adc34729f4', 'request_id': 'req-107ea0d8-35b2-43c1-8364-2f8679ccc645'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:29.984639 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-107ea0d8-35b2-43c1-8364-2f8679ccc645 admin admin] The token cache is being invalidate because project e85abf442b8e4ba09240b5adc34729f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:10:29.984938 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-107ea0d8-35b2-43c1-8364-2f8679ccc645 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:29.991593 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-107ea0d8-35b2-43c1-8364-2f8679ccc645 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:29.993491 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3557/7144] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:10:29 2022] DELETE /identity/v3/projects/e85abf442b8e4ba09240b5adc34729f4 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:10:29.998593 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd27502-c2a1-4a1b-8400-a4de1da11524 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:29.998877 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd27502-c2a1-4a1b-8400-a4de1da11524 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:29.999188 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd27502-c2a1-4a1b-8400-a4de1da11524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:30.007975 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4bd61d-f940-44d0-975b-81fdbb067e78 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:30.039378 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-fcd27502-c2a1-4a1b-8400-a4de1da11524 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:10:30.040632 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-fcd27502-c2a1-4a1b-8400-a4de1da11524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:30.083296 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:30.187077 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3558/7145] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:10:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:10:30.190487 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb37ba0-cddf-4145-8d14-175814b3f81e None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:30.190773 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb37ba0-cddf-4145-8d14-175814b3f81e None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:30.191072 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb37ba0-cddf-4145-8d14-175814b3f81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:30.221266 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9832c-7cf7-4f9b-ae2c-b9fd7d864dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:30.221848 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9832c-7cf7-4f9b-ae2c-b9fd7d864dd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:30.222126 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9832c-7cf7-4f9b-ae2c-b9fd7d864dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:30.222395 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9832c-7cf7-4f9b-ae2c-b9fd7d864dd9 admin admin] PATH_INFO: `/v3/projects/4c81ef7b2ac644b394ffa1c04c11ea45` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:30.227594 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c9832c-7cf7-4f9b-ae2c-b9fd7d864dd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c81ef7b2ac644b394ffa1c04c11ea45)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:30.237138 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c9832c-7cf7-4f9b-ae2c-b9fd7d864dd9 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:30.242686 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-dbb37ba0-cddf-4145-8d14-175814b3f81e None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:10:30.243951 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-dbb37ba0-cddf-4145-8d14-175814b3f81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:30.261931 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3559/7146] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:10:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:10:30.262874 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb37ba0-cddf-4145-8d14-175814b3f81e None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:30.275562 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb37ba0-cddf-4145-8d14-175814b3f81e None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:30.282853 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcca2bb-8b5e-42d0-8bd0-daa44535e4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:30.283581 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcca2bb-8b5e-42d0-8bd0-daa44535e4c0 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:30.283865 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcca2bb-8b5e-42d0-8bd0-daa44535e4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:30.284139 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcca2bb-8b5e-42d0-8bd0-daa44535e4c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:30.284795 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcca2bb-8b5e-42d0-8bd0-daa44535e4c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:10:30.285178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcca2bb-8b5e-42d0-8bd0-daa44535e4c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:30.287371 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcca2bb-8b5e-42d0-8bd0-daa44535e4c0 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:30.310247 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3560/7147] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:10:30.313459 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcca2bb-8b5e-42d0-8bd0-daa44535e4c0 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:30.331924 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcca2bb-8b5e-42d0-8bd0-daa44535e4c0 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:30.338682 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f686cd0-fe84-40f7-bfc4-e2197a124f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:30.339365 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f686cd0-fe84-40f7-bfc4-e2197a124f87 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:30.339740 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f686cd0-fe84-40f7-bfc4-e2197a124f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:30.340716 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f686cd0-fe84-40f7-bfc4-e2197a124f87 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:30.341779 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f686cd0-fe84-40f7-bfc4-e2197a124f87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:30.344103 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f686cd0-fe84-40f7-bfc4-e2197a124f87 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:30.413593 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-42c9832c-7cf7-4f9b-ae2c-b9fd7d864dd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c81ef7b2ac644b394ffa1c04c11ea45', 'request_id': 'req-42c9832c-7cf7-4f9b-ae2c-b9fd7d864dd9'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:30.435056 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-42c9832c-7cf7-4f9b-ae2c-b9fd7d864dd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c81ef7b2ac644b394ffa1c04c11ea45', 'request_id': 'req-42c9832c-7cf7-4f9b-ae2c-b9fd7d864dd9'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:30.447056 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3561/7148] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:10:30 2022] POST /identity/v3/projects => generated 351 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:10:30.449104 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f686cd0-fe84-40f7-bfc4-e2197a124f87 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:30.450642 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-42c9832c-7cf7-4f9b-ae2c-b9fd7d864dd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c81ef7b2ac644b394ffa1c04c11ea45', 'request_id': 'req-42c9832c-7cf7-4f9b-ae2c-b9fd7d864dd9'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:30.493813 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-42c9832c-7cf7-4f9b-ae2c-b9fd7d864dd9 admin admin] The token cache is being invalidate because project 4c81ef7b2ac644b394ffa1c04c11ea45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:10:30.494073 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-42c9832c-7cf7-4f9b-ae2c-b9fd7d864dd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:30.497315 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-42c9832c-7cf7-4f9b-ae2c-b9fd7d864dd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:30.501101 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3588/7149] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:10:29 2022] DELETE /identity/v3/projects/4c81ef7b2ac644b394ffa1c04c11ea45 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:10:30.509225 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31412fab-639b-487c-80a1-d62b379a8561 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:30.509626 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31412fab-639b-487c-80a1-d62b379a8561 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:30.510036 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31412fab-639b-487c-80a1-d62b379a8561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:30.584071 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-31412fab-639b-487c-80a1-d62b379a8561 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:10:30.585788 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-31412fab-639b-487c-80a1-d62b379a8561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:30.638483 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f686cd0-fe84-40f7-bfc4-e2197a124f87 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:30.657268 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d911f7a9-f79a-486c-8efd-9e7d644515f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:30.658707 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d911f7a9-f79a-486c-8efd-9e7d644515f1 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:30.659496 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d911f7a9-f79a-486c-8efd-9e7d644515f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:30.660182 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d911f7a9-f79a-486c-8efd-9e7d644515f1 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:30.661602 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d911f7a9-f79a-486c-8efd-9e7d644515f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:30.666194 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d911f7a9-f79a-486c-8efd-9e7d644515f1 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:30.757930 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3562/7150] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:10:30 2022] POST /identity/v3/users => generated 276 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:10:30.764768 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d911f7a9-f79a-486c-8efd-9e7d644515f1 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:30.770623 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d911f7a9-f79a-486c-8efd-9e7d644515f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:30.776914 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3589/7151] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:10:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:10:30.786555 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e5b86-88af-4a50-9cfd-32f70b3dcdb6 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:30.787036 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e5b86-88af-4a50-9cfd-32f70b3dcdb6 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:30.787581 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e5b86-88af-4a50-9cfd-32f70b3dcdb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:30.799372 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:30.810230 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d911f7a9-f79a-486c-8efd-9e7d644515f1 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:30.816210 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a959d2-b914-424e-8d35-34c41d15af68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:30.817244 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a959d2-b914-424e-8d35-34c41d15af68 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:30.817578 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a959d2-b914-424e-8d35-34c41d15af68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:30.817847 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a959d2-b914-424e-8d35-34c41d15af68 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:30.818727 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a959d2-b914-424e-8d35-34c41d15af68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:30.820405 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a959d2-b914-424e-8d35-34c41d15af68 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:30.835868 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-769e5b86-88af-4a50-9cfd-32f70b3dcdb6 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:10:30.842179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-769e5b86-88af-4a50-9cfd-32f70b3dcdb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:30.861700 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3563/7152] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:10:30.862230 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3590/7153] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:10:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:10:30.863221 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a959d2-b914-424e-8d35-34c41d15af68 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:30.868093 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e5b86-88af-4a50-9cfd-32f70b3dcdb6 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:30.875059 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a959d2-b914-424e-8d35-34c41d15af68 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:30.880829 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23dca49-cee0-4d9a-8428-375e8185fdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:30.881456 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23dca49-cee0-4d9a-8428-375e8185fdee admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:30.881740 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23dca49-cee0-4d9a-8428-375e8185fdee admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:30.882017 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23dca49-cee0-4d9a-8428-375e8185fdee admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:30.882696 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23dca49-cee0-4d9a-8428-375e8185fdee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:30.884327 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23dca49-cee0-4d9a-8428-375e8185fdee admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:30.891583 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e5b86-88af-4a50-9cfd-32f70b3dcdb6 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:30.902860 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3564/7154] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:10:30.905539 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344ebef-000c-43f5-9cc0-ecfe4df71552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:30.908427 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344ebef-000c-43f5-9cc0-ecfe4df71552 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:30.909620 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344ebef-000c-43f5-9cc0-ecfe4df71552 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:30.910181 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344ebef-000c-43f5-9cc0-ecfe4df71552 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:30.911266 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23dca49-cee0-4d9a-8428-375e8185fdee admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:30.911511 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f344ebef-000c-43f5-9cc0-ecfe4df71552 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:10:30.912394 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f344ebef-000c-43f5-9cc0-ecfe4df71552 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:30.916045 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f344ebef-000c-43f5-9cc0-ecfe4df71552 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:30.942164 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23dca49-cee0-4d9a-8428-375e8185fdee admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:30.949613 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3591/7155] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:10:30.954607 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344ebef-000c-43f5-9cc0-ecfe4df71552 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:30.959361 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a710128-6b7f-4cef-ac36-28acc00bad66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:30.959988 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a710128-6b7f-4cef-ac36-28acc00bad66 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:30.960454 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a710128-6b7f-4cef-ac36-28acc00bad66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:30.960920 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a710128-6b7f-4cef-ac36-28acc00bad66 admin admin] PATH_INFO: `/v3/projects/9f46b1583f304d129b2a7b4074f8f799/users/f2f6e234846742a6b16ce686c6df5dd2/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:31.002057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344ebef-000c-43f5-9cc0-ecfe4df71552 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:31.023611 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd58bab-fdcf-4c53-81e9-3372784c5d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:31.024929 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd58bab-fdcf-4c53-81e9-3372784c5d3b admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:31.025574 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd58bab-fdcf-4c53-81e9-3372784c5d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:31.028072 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd58bab-fdcf-4c53-81e9-3372784c5d3b admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:31.031563 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd58bab-fdcf-4c53-81e9-3372784c5d3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:31.038293 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd58bab-fdcf-4c53-81e9-3372784c5d3b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:31.052911 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a710128-6b7f-4cef-ac36-28acc00bad66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f46b1583f304d129b2a7b4074f8f799, user_id=f2f6e234846742a6b16ce686c6df5dd2, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:31.057924 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a710128-6b7f-4cef-ac36-28acc00bad66 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:31.121214 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3565/7156] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:10:30 2022] PUT /identity/v3/projects/9f46b1583f304d129b2a7b4074f8f799/users/f2f6e234846742a6b16ce686c6df5dd2/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:10:31.121214 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cc377-59a7-41db-aa43-23f7cfc44da4 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:31.121214 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cc377-59a7-41db-aa43-23f7cfc44da4 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:31.121214 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cc377-59a7-41db-aa43-23f7cfc44da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:31.163753 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3592/7157] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:10:30 2022] POST /identity/v3/projects => generated 379 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:10:31.170354 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6b3ce-368e-4402-b184-1c6315043523 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:31.170963 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6b3ce-368e-4402-b184-1c6315043523 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:31.172284 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6b3ce-368e-4402-b184-1c6315043523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:31.196369 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-557cc377-59a7-41db-aa43-23f7cfc44da4 None None] MFA Rules not processed for user `f075974a803f46eda667db6d754453ba`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:10:31.199857 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-557cc377-59a7-41db-aa43-23f7cfc44da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:31.299728 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:31.314232 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-ede6b3ce-368e-4402-b184-1c6315043523 None None] MFA Rules not processed for user `f2f6e234846742a6b16ce686c6df5dd2`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:10:31.325177 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ede6b3ce-368e-4402-b184-1c6315043523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:31.376270 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3566/7158] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:10:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:10:31.386067 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cc377-59a7-41db-aa43-23f7cfc44da4 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:31.543212 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3593/7159] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:10:31 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:10:31.556990 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede6b3ce-368e-4402-b184-1c6315043523 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:31.559167 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ede6b3ce-368e-4402-b184-1c6315043523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:31.672032 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cc377-59a7-41db-aa43-23f7cfc44da4 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:31.685951 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99306bda-8189-4a38-b8a7-75baa5eb5d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:31.686935 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99306bda-8189-4a38-b8a7-75baa5eb5d00 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:31.687457 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99306bda-8189-4a38-b8a7-75baa5eb5d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:31.688091 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99306bda-8189-4a38-b8a7-75baa5eb5d00 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:31.689242 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99306bda-8189-4a38-b8a7-75baa5eb5d00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:31.693309 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99306bda-8189-4a38-b8a7-75baa5eb5d00 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:31.738227 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3567/7160] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:10:31 2022] POST /identity/v3/users => generated 290 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:10:31.757045 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99306bda-8189-4a38-b8a7-75baa5eb5d00 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:31.759190 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede6b3ce-368e-4402-b184-1c6315043523 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:31.783452 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d84c3-e262-4293-abb6-ddd2ed0ba991 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:31.784509 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d84c3-e262-4293-abb6-ddd2ed0ba991 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:31.785076 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d84c3-e262-4293-abb6-ddd2ed0ba991 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:31.787952 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d84c3-e262-4293-abb6-ddd2ed0ba991 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:31.820796 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2d84c3-e262-4293-abb6-ddd2ed0ba991 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:31.830708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2d84c3-e262-4293-abb6-ddd2ed0ba991 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:31.833215 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99306bda-8189-4a38-b8a7-75baa5eb5d00 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:31.859293 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb81ff2-75b0-4a01-aeb0-4f0356070598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:31.863916 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb81ff2-75b0-4a01-aeb0-4f0356070598 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:31.867128 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb81ff2-75b0-4a01-aeb0-4f0356070598 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:31.868336 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb81ff2-75b0-4a01-aeb0-4f0356070598 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:31.871284 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb81ff2-75b0-4a01-aeb0-4f0356070598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:31.880693 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb81ff2-75b0-4a01-aeb0-4f0356070598 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:31.881329 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3594/7161] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:10:31 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:10:31.908130 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3568/7162] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:10:31.916358 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d84c3-e262-4293-abb6-ddd2ed0ba991 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:31.945449 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d84c3-e262-4293-abb6-ddd2ed0ba991 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:31.954911 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae93140-82fa-4f4e-a833-1942b246dda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:31.956457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae93140-82fa-4f4e-a833-1942b246dda3 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:31.957169 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae93140-82fa-4f4e-a833-1942b246dda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:31.957918 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae93140-82fa-4f4e-a833-1942b246dda3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:31.959817 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae93140-82fa-4f4e-a833-1942b246dda3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:31.963860 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae93140-82fa-4f4e-a833-1942b246dda3 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:32.017935 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3595/7163] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:10:32.020994 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb81ff2-75b0-4a01-aeb0-4f0356070598 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:32.043756 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb81ff2-75b0-4a01-aeb0-4f0356070598 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:32.061422 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8a0e4-9b1e-4f65-9519-8c21185953c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:32.062120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8a0e4-9b1e-4f65-9519-8c21185953c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:32.062461 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8a0e4-9b1e-4f65-9519-8c21185953c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:32.062658 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8a0e4-9b1e-4f65-9519-8c21185953c5 admin admin] PATH_INFO: `/v3/projects/61f119733900461392838359ec76959f/users/c406cf9a10e043dbaf54abede459023a/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:32.109507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce8a0e4-9b1e-4f65-9519-8c21185953c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61f119733900461392838359ec76959f, user_id=c406cf9a10e043dbaf54abede459023a, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:32.112312 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce8a0e4-9b1e-4f65-9519-8c21185953c5 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:32.159882 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3569/7164] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:10:32 2022] PUT /identity/v3/projects/61f119733900461392838359ec76959f/users/c406cf9a10e043dbaf54abede459023a/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:10:32.177392 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b155ccb-6929-4464-97cd-16e571c6fe3f None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:32.178306 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b155ccb-6929-4464-97cd-16e571c6fe3f None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:32.179143 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b155ccb-6929-4464-97cd-16e571c6fe3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:32.279268 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-8b155ccb-6929-4464-97cd-16e571c6fe3f None None] MFA Rules not processed for user `c406cf9a10e043dbaf54abede459023a`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:10:32.283007 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8b155ccb-6929-4464-97cd-16e571c6fe3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:32.356285 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:32.446636 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3596/7165] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:10:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:10:32.450445 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8a0e4-9b1e-4f65-9519-8c21185953c5 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:32.457684 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-fce8a0e4-9b1e-4f65-9519-8c21185953c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:32.610039 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8a0e4-9b1e-4f65-9519-8c21185953c5 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:32.619177 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593daf3-f4fe-45ba-a884-88123a23cc1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:32.621030 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593daf3-f4fe-45ba-a884-88123a23cc1b service cinder] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:32.621547 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593daf3-f4fe-45ba-a884-88123a23cc1b service cinder] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:32.621972 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593daf3-f4fe-45ba-a884-88123a23cc1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:32.642472 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f593daf3-f4fe-45ba-a884-88123a23cc1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:32.654042 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f593daf3-f4fe-45ba-a884-88123a23cc1b service cinder] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:32.679645 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3570/7166] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:10:32 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:10:33.414548 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b155ccb-6929-4464-97cd-16e571c6fe3f None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:33.417509 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8b155ccb-6929-4464-97cd-16e571c6fe3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:33.614486 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b155ccb-6929-4464-97cd-16e571c6fe3f None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:33.629658 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ae958-a96e-4058-ae95-a7ce8d6ba679 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:33.630397 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ae958-a96e-4058-ae95-a7ce8d6ba679 service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:33.630744 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ae958-a96e-4058-ae95-a7ce8d6ba679 service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:33.633029 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ae958-a96e-4058-ae95-a7ce8d6ba679 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:33.636534 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2c8ae958-a96e-4058-ae95-a7ce8d6ba679 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:33.668057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ae958-a96e-4058-ae95-a7ce8d6ba679 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:33.675612 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ae958-a96e-4058-ae95-a7ce8d6ba679 service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:33.711787 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3597/7167] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:10:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:10:36.099556 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593daf3-f4fe-45ba-a884-88123a23cc1b service cinder] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:36.158715 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:36.214019 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593daf3-f4fe-45ba-a884-88123a23cc1b service cinder] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:36.221896 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda3b01-a4e3-4f16-bf1e-6294a6449426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:36.223297 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda3b01-a4e3-4f16-bf1e-6294a6449426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:36.225458 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda3b01-a4e3-4f16-bf1e-6294a6449426 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:36.225973 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda3b01-a4e3-4f16-bf1e-6294a6449426 admin admin] PATH_INFO: `/v3/users/f2f6e234846742a6b16ce686c6df5dd2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:36.229257 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cda3b01-a4e3-4f16-bf1e-6294a6449426 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2f6e234846742a6b16ce686c6df5dd2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:36.235094 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cda3b01-a4e3-4f16-bf1e-6294a6449426 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:36.364452 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8cda3b01-a4e3-4f16-bf1e-6294a6449426 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2f6e234846742a6b16ce686c6df5dd2'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:36.365316 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8cda3b01-a4e3-4f16-bf1e-6294a6449426 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2f6e234846742a6b16ce686c6df5dd2'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:36.392673 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8cda3b01-a4e3-4f16-bf1e-6294a6449426 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2f6e234846742a6b16ce686c6df5dd2'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:36.426426 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8cda3b01-a4e3-4f16-bf1e-6294a6449426 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2f6e234846742a6b16ce686c6df5dd2'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:36.436771 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8cda3b01-a4e3-4f16-bf1e-6294a6449426 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2f6e234846742a6b16ce686c6df5dd2'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:36.449143 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3571/7168] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:10:36 2022] DELETE /identity/v3/users/f2f6e234846742a6b16ce686c6df5dd2 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:10:36.450281 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79483d5-563c-4234-8e5b-a76e7ac4e5f2 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:36.450733 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79483d5-563c-4234-8e5b-a76e7ac4e5f2 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:36.450934 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79483d5-563c-4234-8e5b-a76e7ac4e5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:36.501083 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-f79483d5-563c-4234-8e5b-a76e7ac4e5f2 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:10:36.502518 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f79483d5-563c-4234-8e5b-a76e7ac4e5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:36.772761 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3598/7169] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:10:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:10:36.914793 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda3b01-a4e3-4f16-bf1e-6294a6449426 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:36.920440 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8cda3b01-a4e3-4f16-bf1e-6294a6449426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:37.072317 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda3b01-a4e3-4f16-bf1e-6294a6449426 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:37.076668 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0117f-ac83-4508-926a-5edaceff3542 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:37.077317 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0117f-ac83-4508-926a-5edaceff3542 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:37.077570 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0117f-ac83-4508-926a-5edaceff3542 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:37.077842 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0117f-ac83-4508-926a-5edaceff3542 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:37.097658 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b0117f-ac83-4508-926a-5edaceff3542 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:37.100057 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b0117f-ac83-4508-926a-5edaceff3542 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:37.124185 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3572/7170] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:10:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:10:38.220699 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79483d5-563c-4234-8e5b-a76e7ac4e5f2 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:38.222148 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f79483d5-563c-4234-8e5b-a76e7ac4e5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:38.253493 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79483d5-563c-4234-8e5b-a76e7ac4e5f2 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:38.259639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba867313-25f6-4155-b016-83366afe1732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:38.261721 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba867313-25f6-4155-b016-83366afe1732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:38.262217 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba867313-25f6-4155-b016-83366afe1732 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:38.262702 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba867313-25f6-4155-b016-83366afe1732 admin admin] PATH_INFO: `/v3/projects/9f46b1583f304d129b2a7b4074f8f799` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:38.266377 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba867313-25f6-4155-b016-83366afe1732 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f46b1583f304d129b2a7b4074f8f799)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:38.269625 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba867313-25f6-4155-b016-83366afe1732 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:38.357835 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ba867313-25f6-4155-b016-83366afe1732 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f46b1583f304d129b2a7b4074f8f799', 'request_id': 'req-ba867313-25f6-4155-b016-83366afe1732'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:38.373234 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ba867313-25f6-4155-b016-83366afe1732 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f46b1583f304d129b2a7b4074f8f799', 'request_id': 'req-ba867313-25f6-4155-b016-83366afe1732'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:38.374881 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:38.386156 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ba867313-25f6-4155-b016-83366afe1732 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f46b1583f304d129b2a7b4074f8f799', 'request_id': 'req-ba867313-25f6-4155-b016-83366afe1732'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:38.418808 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ba867313-25f6-4155-b016-83366afe1732 admin admin] The token cache is being invalidate because project 9f46b1583f304d129b2a7b4074f8f799 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:10:38.419575 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ba867313-25f6-4155-b016-83366afe1732 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:38.420566 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ba867313-25f6-4155-b016-83366afe1732 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:38.427577 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3599/7171] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:10:38 2022] DELETE /identity/v3/projects/9f46b1583f304d129b2a7b4074f8f799 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:10:38.429251 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8803b-306c-4d24-b41b-a6a72b4b0d1b None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:38.429757 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8803b-306c-4d24-b41b-a6a72b4b0d1b None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:38.429876 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8803b-306c-4d24-b41b-a6a72b4b0d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:38.464647 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-8af8803b-306c-4d24-b41b-a6a72b4b0d1b None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:10:38.466253 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8af8803b-306c-4d24-b41b-a6a72b4b0d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:38.582487 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:38.653131 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3573/7172] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:10:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:10:38.661425 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48707b17-8eee-4b70-9fd3-2f20c5551966 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:38.661856 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48707b17-8eee-4b70-9fd3-2f20c5551966 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:38.662210 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48707b17-8eee-4b70-9fd3-2f20c5551966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:38.701350 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-48707b17-8eee-4b70-9fd3-2f20c5551966 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:10:38.703398 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-48707b17-8eee-4b70-9fd3-2f20c5551966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:38.722311 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3600/7173] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:10:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:10:38.726241 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8803b-306c-4d24-b41b-a6a72b4b0d1b None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:38.738802 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8803b-306c-4d24-b41b-a6a72b4b0d1b None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:38.746028 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52420810-f7b7-40ab-8c63-93183e7fcfee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:38.747542 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52420810-f7b7-40ab-8c63-93183e7fcfee admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:38.748017 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52420810-f7b7-40ab-8c63-93183e7fcfee admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:38.748495 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52420810-f7b7-40ab-8c63-93183e7fcfee admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:38.750186 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52420810-f7b7-40ab-8c63-93183e7fcfee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:10:38.750868 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52420810-f7b7-40ab-8c63-93183e7fcfee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:38.752650 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52420810-f7b7-40ab-8c63-93183e7fcfee admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:38.768808 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3574/7174] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:10:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:10:38.774477 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48707b17-8eee-4b70-9fd3-2f20c5551966 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:38.802545 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48707b17-8eee-4b70-9fd3-2f20c5551966 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:38.815557 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b08cb-14a7-4414-8a8e-916dcb39d361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:38.815557 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b08cb-14a7-4414-8a8e-916dcb39d361 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:38.815557 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b08cb-14a7-4414-8a8e-916dcb39d361 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:38.817008 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b08cb-14a7-4414-8a8e-916dcb39d361 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:38.817929 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b08cb-14a7-4414-8a8e-916dcb39d361 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:38.823598 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b08cb-14a7-4414-8a8e-916dcb39d361 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:38.865912 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3601/7175] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:10:38 2022] POST /identity/v3/projects => generated 403 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:10:38.869676 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52420810-f7b7-40ab-8c63-93183e7fcfee admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:38.884944 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52420810-f7b7-40ab-8c63-93183e7fcfee admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:39.016015 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d36dd9e-7ee5-4c9b-970a-891cee23120a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:39.016974 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36dd9e-7ee5-4c9b-970a-891cee23120a admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:39.017497 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36dd9e-7ee5-4c9b-970a-891cee23120a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:39.018031 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36dd9e-7ee5-4c9b-970a-891cee23120a admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:39.018917 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d36dd9e-7ee5-4c9b-970a-891cee23120a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:39.021168 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d36dd9e-7ee5-4c9b-970a-891cee23120a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:39.058394 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3575/7176] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:10:38 2022] POST /identity/v3/users => generated 302 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:10:39.062180 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b08cb-14a7-4414-8a8e-916dcb39d361 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:39.081362 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b08cb-14a7-4414-8a8e-916dcb39d361 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:39.098287 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e2fe2e-e7b6-4a9e-b332-007801a94899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:39.098923 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2fe2e-e7b6-4a9e-b332-007801a94899 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:39.099222 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2fe2e-e7b6-4a9e-b332-007801a94899 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:39.099490 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2fe2e-e7b6-4a9e-b332-007801a94899 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:39.108280 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e2fe2e-e7b6-4a9e-b332-007801a94899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:39.110019 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e2fe2e-e7b6-4a9e-b332-007801a94899 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:39.138763 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3602/7177] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:10:39.139594 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d36dd9e-7ee5-4c9b-970a-891cee23120a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:39.155456 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d36dd9e-7ee5-4c9b-970a-891cee23120a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:39.180910 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab34d54a-f2d9-4aa9-859a-a661bce66b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:39.183618 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34d54a-f2d9-4aa9-859a-a661bce66b12 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:39.184339 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34d54a-f2d9-4aa9-859a-a661bce66b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:39.184855 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34d54a-f2d9-4aa9-859a-a661bce66b12 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:39.185907 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab34d54a-f2d9-4aa9-859a-a661bce66b12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:39.188203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab34d54a-f2d9-4aa9-859a-a661bce66b12 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:39.227968 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e2fe2e-e7b6-4a9e-b332-007801a94899 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:39.236965 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3576/7178] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:10:39.242109 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e2fe2e-e7b6-4a9e-b332-007801a94899 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:39.249980 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d804ef-d715-40f2-b2d4-5bcffd0de5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:39.251005 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d804ef-d715-40f2-b2d4-5bcffd0de5da admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:39.251520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d804ef-d715-40f2-b2d4-5bcffd0de5da admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:39.252014 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d804ef-d715-40f2-b2d4-5bcffd0de5da admin admin] PATH_INFO: `/v3/projects/c4cadc21d86c4d6fb1c11278ed80940d/users/da4c6a38a095486a806411936cc825e3/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:39.298001 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d804ef-d715-40f2-b2d4-5bcffd0de5da admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4cadc21d86c4d6fb1c11278ed80940d, user_id=da4c6a38a095486a806411936cc825e3, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:39.301020 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d804ef-d715-40f2-b2d4-5bcffd0de5da admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:39.337068 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3603/7179] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:10:39 2022] PUT /identity/v3/projects/c4cadc21d86c4d6fb1c11278ed80940d/users/da4c6a38a095486a806411936cc825e3/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:10:39.366610 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5233333-5003-4169-82d3-96fd5e936d60 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:39.367017 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5233333-5003-4169-82d3-96fd5e936d60 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:39.373711 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5233333-5003-4169-82d3-96fd5e936d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:39.437112 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-e5233333-5003-4169-82d3-96fd5e936d60 None None] MFA Rules not processed for user `da4c6a38a095486a806411936cc825e3`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:10:39.439728 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e5233333-5003-4169-82d3-96fd5e936d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:39.593144 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3577/7180] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:10:39 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:10:39.597748 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d804ef-d715-40f2-b2d4-5bcffd0de5da admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:39.723372 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d804ef-d715-40f2-b2d4-5bcffd0de5da admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:39.742593 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d93c0-0932-4f76-a20f-fb8f03753255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:39.743270 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d93c0-0932-4f76-a20f-fb8f03753255 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:39.744029 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d93c0-0932-4f76-a20f-fb8f03753255 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:39.744318 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d93c0-0932-4f76-a20f-fb8f03753255 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:39.746515 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d93c0-0932-4f76-a20f-fb8f03753255 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:39.749384 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d93c0-0932-4f76-a20f-fb8f03753255 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:39.827403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5233333-5003-4169-82d3-96fd5e936d60 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:39.827956 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3604/7181] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:10:39 2022] POST /identity/v3/projects => generated 405 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:10:39.842683 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5233333-5003-4169-82d3-96fd5e936d60 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:39.997742 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:40.053166 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d16948d-0792-44af-8186-05d1853d30d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:40.061200 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16948d-0792-44af-8186-05d1853d30d6 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:40.062464 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16948d-0792-44af-8186-05d1853d30d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:40.062837 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16948d-0792-44af-8186-05d1853d30d6 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:40.065107 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d16948d-0792-44af-8186-05d1853d30d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:40.070432 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d16948d-0792-44af-8186-05d1853d30d6 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:40.130686 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3578/7182] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:10:39 2022] POST /identity/v3/users => generated 309 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:10:40.133762 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d93c0-0932-4f76-a20f-fb8f03753255 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:40.158567 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d93c0-0932-4f76-a20f-fb8f03753255 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:40.176559 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65263586-c544-4f8b-9430-30c6d8af749e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:40.177733 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65263586-c544-4f8b-9430-30c6d8af749e admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:40.178229 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65263586-c544-4f8b-9430-30c6d8af749e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:40.178716 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65263586-c544-4f8b-9430-30c6d8af749e admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:40.180014 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65263586-c544-4f8b-9430-30c6d8af749e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:40.183283 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65263586-c544-4f8b-9430-30c6d8af749e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:40.218750 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3605/7183] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:10:40.223774 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d16948d-0792-44af-8186-05d1853d30d6 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:40.240834 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d16948d-0792-44af-8186-05d1853d30d6 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:40.253105 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0b2a0-ec01-4adc-9f4f-cb9cb8993d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:40.254424 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0b2a0-ec01-4adc-9f4f-cb9cb8993d7a admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:40.258040 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0b2a0-ec01-4adc-9f4f-cb9cb8993d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:40.258489 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0b2a0-ec01-4adc-9f4f-cb9cb8993d7a admin admin] PATH_INFO: `/v3/projects/c5538e30e5124b73b9b8af9b9441ecd8/users/46303f99f4a54c0c9ebe49c273284c3f/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:40.301035 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f0b2a0-ec01-4adc-9f4f-cb9cb8993d7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5538e30e5124b73b9b8af9b9441ecd8, user_id=46303f99f4a54c0c9ebe49c273284c3f, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:40.303775 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f0b2a0-ec01-4adc-9f4f-cb9cb8993d7a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:40.354730 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3579/7184] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:10:40 2022] PUT /identity/v3/projects/c5538e30e5124b73b9b8af9b9441ecd8/users/46303f99f4a54c0c9ebe49c273284c3f/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:10:40.358604 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65263586-c544-4f8b-9430-30c6d8af749e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:40.374766 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65263586-c544-4f8b-9430-30c6d8af749e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:40.550668 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:40.565532 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5143dea8-9107-459b-ba71-f34de5a034be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:40.566169 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143dea8-9107-459b-ba71-f34de5a034be admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:40.566689 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143dea8-9107-459b-ba71-f34de5a034be admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:40.566689 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143dea8-9107-459b-ba71-f34de5a034be admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:40.567384 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5143dea8-9107-459b-ba71-f34de5a034be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:40.569037 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5143dea8-9107-459b-ba71-f34de5a034be admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:40.597756 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3606/7185] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:10:40.601032 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0b2a0-ec01-4adc-9f4f-cb9cb8993d7a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:40.622767 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0b2a0-ec01-4adc-9f4f-cb9cb8993d7a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:40.631910 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c4c98-63f2-4d9f-af45-648836f297ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:40.632599 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c4c98-63f2-4d9f-af45-648836f297ac admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:40.632880 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c4c98-63f2-4d9f-af45-648836f297ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:40.633159 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c4c98-63f2-4d9f-af45-648836f297ac admin admin] PATH_INFO: `/v3/projects/c5538e30e5124b73b9b8af9b9441ecd8/users/46303f99f4a54c0c9ebe49c273284c3f/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:40.635319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c4c98-63f2-4d9f-af45-648836f297ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5538e30e5124b73b9b8af9b9441ecd8, user_id=46303f99f4a54c0c9ebe49c273284c3f, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:40.640652 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c4c98-63f2-4d9f-af45-648836f297ac admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:40.673830 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3580/7186] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:10:40 2022] PUT /identity/v3/projects/c5538e30e5124b73b9b8af9b9441ecd8/users/46303f99f4a54c0c9ebe49c273284c3f/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:10:40.687658 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864a319-31d7-4ece-87b3-0ba86d67897f None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:40.687954 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864a319-31d7-4ece-87b3-0ba86d67897f None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:40.688266 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864a319-31d7-4ece-87b3-0ba86d67897f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:40.749506 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-0864a319-31d7-4ece-87b3-0ba86d67897f None None] MFA Rules not processed for user `46303f99f4a54c0c9ebe49c273284c3f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:10:40.750796 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0864a319-31d7-4ece-87b3-0ba86d67897f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:40.973404 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3607/7187] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:10:40 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:10:40.983997 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c4c98-63f2-4d9f-af45-648836f297ac admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:40.985764 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7f4c4c98-63f2-4d9f-af45-648836f297ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:41.162791 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c4c98-63f2-4d9f-af45-648836f297ac admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:41.168624 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea7851-c9e6-44b2-bc92-f67396027ab2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:41.169259 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea7851-c9e6-44b2-bc92-f67396027ab2 service cinder] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:41.170127 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea7851-c9e6-44b2-bc92-f67396027ab2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:41.170127 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea7851-c9e6-44b2-bc92-f67396027ab2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:41.180948 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ea7851-c9e6-44b2-bc92-f67396027ab2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:41.183599 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ea7851-c9e6-44b2-bc92-f67396027ab2 service cinder] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:41.205314 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3581/7188] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:10:40 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:10:41.445121 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864a319-31d7-4ece-87b3-0ba86d67897f None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:41.718563 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864a319-31d7-4ece-87b3-0ba86d67897f None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:41.761404 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a92fc-88f1-403e-a7e5-ac56d69def03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:41.765326 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a92fc-88f1-403e-a7e5-ac56d69def03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:41.765918 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a92fc-88f1-403e-a7e5-ac56d69def03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:41.767151 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a92fc-88f1-403e-a7e5-ac56d69def03 admin admin] PATH_INFO: `/v3/users/da4c6a38a095486a806411936cc825e3` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:41.769786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315a92fc-88f1-403e-a7e5-ac56d69def03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da4c6a38a095486a806411936cc825e3)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:41.775231 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315a92fc-88f1-403e-a7e5-ac56d69def03 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:41.900602 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-315a92fc-88f1-403e-a7e5-ac56d69def03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da4c6a38a095486a806411936cc825e3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:41.903874 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-315a92fc-88f1-403e-a7e5-ac56d69def03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da4c6a38a095486a806411936cc825e3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:41.928025 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-315a92fc-88f1-403e-a7e5-ac56d69def03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da4c6a38a095486a806411936cc825e3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:41.945210 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-315a92fc-88f1-403e-a7e5-ac56d69def03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da4c6a38a095486a806411936cc825e3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:41.947198 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-315a92fc-88f1-403e-a7e5-ac56d69def03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da4c6a38a095486a806411936cc825e3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:42.044806 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:42.069383 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3608/7189] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:10:41 2022] DELETE /identity/v3/users/da4c6a38a095486a806411936cc825e3 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:10:42.071942 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84949b97-f8e6-4265-ae75-02447f913a08 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:42.073879 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84949b97-f8e6-4265-ae75-02447f913a08 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:42.074368 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84949b97-f8e6-4265-ae75-02447f913a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:42.150505 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-84949b97-f8e6-4265-ae75-02447f913a08 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:10:42.155053 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-84949b97-f8e6-4265-ae75-02447f913a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:42.333890 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3582/7190] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:10:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:10:42.352671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a92fc-88f1-403e-a7e5-ac56d69def03 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:42.355243 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-315a92fc-88f1-403e-a7e5-ac56d69def03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:42.575181 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a92fc-88f1-403e-a7e5-ac56d69def03 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:42.592408 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f86ee2e-2fa4-44ee-8371-d4070304221a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:42.593312 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86ee2e-2fa4-44ee-8371-d4070304221a service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:42.593802 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86ee2e-2fa4-44ee-8371-d4070304221a service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:42.594383 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86ee2e-2fa4-44ee-8371-d4070304221a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:42.639208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f86ee2e-2fa4-44ee-8371-d4070304221a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:42.645062 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f86ee2e-2fa4-44ee-8371-d4070304221a service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:42.678634 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3609/7191] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:10:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:10:43.395895 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84949b97-f8e6-4265-ae75-02447f913a08 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:43.397782 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-84949b97-f8e6-4265-ae75-02447f913a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:43.431490 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84949b97-f8e6-4265-ae75-02447f913a08 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:43.448743 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b73055-0fae-4a40-8441-fc26df2bbe71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:43.449394 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b73055-0fae-4a40-8441-fc26df2bbe71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:43.449879 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b73055-0fae-4a40-8441-fc26df2bbe71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:43.450302 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b73055-0fae-4a40-8441-fc26df2bbe71 admin admin] PATH_INFO: `/v3/projects/c4cadc21d86c4d6fb1c11278ed80940d` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:43.451943 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b73055-0fae-4a40-8441-fc26df2bbe71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4cadc21d86c4d6fb1c11278ed80940d)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:43.453961 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b73055-0fae-4a40-8441-fc26df2bbe71 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:43.538838 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:43.564185 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-96b73055-0fae-4a40-8441-fc26df2bbe71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4cadc21d86c4d6fb1c11278ed80940d', 'request_id': 'req-96b73055-0fae-4a40-8441-fc26df2bbe71'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:43.581976 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f86ee2e-2fa4-44ee-8371-d4070304221a service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:43.582494 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-96b73055-0fae-4a40-8441-fc26df2bbe71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4cadc21d86c4d6fb1c11278ed80940d', 'request_id': 'req-96b73055-0fae-4a40-8441-fc26df2bbe71'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:43.584088 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3f86ee2e-2fa4-44ee-8371-d4070304221a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:43.605246 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-96b73055-0fae-4a40-8441-fc26df2bbe71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4cadc21d86c4d6fb1c11278ed80940d', 'request_id': 'req-96b73055-0fae-4a40-8441-fc26df2bbe71'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:43.630390 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-96b73055-0fae-4a40-8441-fc26df2bbe71 admin admin] The token cache is being invalidate because project c4cadc21d86c4d6fb1c11278ed80940d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:10:43.630963 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-96b73055-0fae-4a40-8441-fc26df2bbe71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:43.632119 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-96b73055-0fae-4a40-8441-fc26df2bbe71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:43.634872 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3583/7192] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:10:43 2022] DELETE /identity/v3/projects/c4cadc21d86c4d6fb1c11278ed80940d => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:10:43.639323 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b73055-0fae-4a40-8441-fc26df2bbe71 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:43.640984 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-96b73055-0fae-4a40-8441-fc26df2bbe71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:43.750875 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f86ee2e-2fa4-44ee-8371-d4070304221a service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:43.802935 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b73055-0fae-4a40-8441-fc26df2bbe71 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:43.818740 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca5ee6-4370-468d-8ebd-9436b6ff1924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:43.819695 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca5ee6-4370-468d-8ebd-9436b6ff1924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:43.820129 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca5ee6-4370-468d-8ebd-9436b6ff1924 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:43.820555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca5ee6-4370-468d-8ebd-9436b6ff1924 admin admin] PATH_INFO: `/v3/users/46303f99f4a54c0c9ebe49c273284c3f` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:43.824977 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca5ee6-4370-468d-8ebd-9436b6ff1924 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46303f99f4a54c0c9ebe49c273284c3f)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:43.827755 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca5ee6-4370-468d-8ebd-9436b6ff1924 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:43.880100 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6230ae-3e3a-4cea-a9f9-0a9c85cf69aa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6b0f9835ed549cab91d684326be83fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:43.882521 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6230ae-3e3a-4cea-a9f9-0a9c85cf69aa service glance] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:43.882806 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6230ae-3e3a-4cea-a9f9-0a9c85cf69aa service glance] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:43.883104 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6230ae-3e3a-4cea-a9f9-0a9c85cf69aa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:43.887741 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4e6230ae-3e3a-4cea-a9f9-0a9c85cf69aa service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:43.952131 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d6ca5ee6-4370-468d-8ebd-9436b6ff1924 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46303f99f4a54c0c9ebe49c273284c3f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:43.955500 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d6ca5ee6-4370-468d-8ebd-9436b6ff1924 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46303f99f4a54c0c9ebe49c273284c3f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:43.987245 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d6ca5ee6-4370-468d-8ebd-9436b6ff1924 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46303f99f4a54c0c9ebe49c273284c3f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:44.009089 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d6ca5ee6-4370-468d-8ebd-9436b6ff1924 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46303f99f4a54c0c9ebe49c273284c3f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:44.029075 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d6ca5ee6-4370-468d-8ebd-9436b6ff1924 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46303f99f4a54c0c9ebe49c273284c3f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:44.048354 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3584/7193] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:10:43 2022] DELETE /identity/v3/users/46303f99f4a54c0c9ebe49c273284c3f => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:10:44.096497 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6230ae-3e3a-4cea-a9f9-0a9c85cf69aa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:44.098197 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6230ae-3e3a-4cea-a9f9-0a9c85cf69aa service glance] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:44.105104 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:44.131087 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3610/7194] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:10:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:10:44.322823 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca5ee6-4370-468d-8ebd-9436b6ff1924 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:44.327901 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d6ca5ee6-4370-468d-8ebd-9436b6ff1924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:44.480972 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:44.523166 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca5ee6-4370-468d-8ebd-9436b6ff1924 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:44.535701 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0584da-3fd4-4b63-bae9-7e0684e3b710 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:44.536480 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0584da-3fd4-4b63-bae9-7e0684e3b710 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:44.536754 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0584da-3fd4-4b63-bae9-7e0684e3b710 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:44.537023 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0584da-3fd4-4b63-bae9-7e0684e3b710 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:44.543832 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ee0584da-3fd4-4b63-bae9-7e0684e3b710 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:44.568660 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0584da-3fd4-4b63-bae9-7e0684e3b710 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:44.570143 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0584da-3fd4-4b63-bae9-7e0684e3b710 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:44.609948 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3585/7195] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:10:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:10:44.851145 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6230ae-3e3a-4cea-a9f9-0a9c85cf69aa service glance] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:44.853166 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4e6230ae-3e3a-4cea-a9f9-0a9c85cf69aa service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:45.014360 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6230ae-3e3a-4cea-a9f9-0a9c85cf69aa service glance] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:45.024575 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071af11-3d07-4810-aede-a40d63170207 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:45.025569 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071af11-3d07-4810-aede-a40d63170207 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:45.026682 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071af11-3d07-4810-aede-a40d63170207 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:45.027564 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071af11-3d07-4810-aede-a40d63170207 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:45.036301 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7071af11-3d07-4810-aede-a40d63170207 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:45.202919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7071af11-3d07-4810-aede-a40d63170207 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:45.204564 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7071af11-3d07-4810-aede-a40d63170207 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:45.234016 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3611/7196] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:10:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:10:45.258715 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0584da-3fd4-4b63-bae9-7e0684e3b710 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:45.261129 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ee0584da-3fd4-4b63-bae9-7e0684e3b710 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:45.472271 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0584da-3fd4-4b63-bae9-7e0684e3b710 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:45.485938 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471bd17-694f-47e8-a10c-9e06d9081332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:45.486780 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471bd17-694f-47e8-a10c-9e06d9081332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:45.487255 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471bd17-694f-47e8-a10c-9e06d9081332 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:45.487534 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471bd17-694f-47e8-a10c-9e06d9081332 admin admin] PATH_INFO: `/v3/projects/c5538e30e5124b73b9b8af9b9441ecd8` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:45.491259 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471bd17-694f-47e8-a10c-9e06d9081332 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5538e30e5124b73b9b8af9b9441ecd8)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:45.506209 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471bd17-694f-47e8-a10c-9e06d9081332 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:45.625711 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b471bd17-694f-47e8-a10c-9e06d9081332 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5538e30e5124b73b9b8af9b9441ecd8', 'request_id': 'req-b471bd17-694f-47e8-a10c-9e06d9081332'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:45.649295 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b471bd17-694f-47e8-a10c-9e06d9081332 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5538e30e5124b73b9b8af9b9441ecd8', 'request_id': 'req-b471bd17-694f-47e8-a10c-9e06d9081332'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:45.664613 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b471bd17-694f-47e8-a10c-9e06d9081332 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5538e30e5124b73b9b8af9b9441ecd8', 'request_id': 'req-b471bd17-694f-47e8-a10c-9e06d9081332'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:45.708718 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b471bd17-694f-47e8-a10c-9e06d9081332 admin admin] The token cache is being invalidate because project c5538e30e5124b73b9b8af9b9441ecd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:10:45.709020 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b471bd17-694f-47e8-a10c-9e06d9081332 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:45.711486 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b471bd17-694f-47e8-a10c-9e06d9081332 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:45.715990 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3586/7197] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:10:45 2022] DELETE /identity/v3/projects/c5538e30e5124b73b9b8af9b9441ecd8 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:10:45.720839 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d863f6-d35e-4acd-a52b-965a0d836e7b None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:45.721380 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d863f6-d35e-4acd-a52b-965a0d836e7b None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:45.721821 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d863f6-d35e-4acd-a52b-965a0d836e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:45.780132 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-27d863f6-d35e-4acd-a52b-965a0d836e7b None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:10:45.781343 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-27d863f6-d35e-4acd-a52b-965a0d836e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:45.944097 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3612/7198] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:10:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:10:45.946603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465cd371-0d24-40ff-b0e0-2e618df6aa3f None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:45.946895 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465cd371-0d24-40ff-b0e0-2e618df6aa3f None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:45.947248 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465cd371-0d24-40ff-b0e0-2e618df6aa3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:45.988817 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-465cd371-0d24-40ff-b0e0-2e618df6aa3f None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:10:45.990101 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-465cd371-0d24-40ff-b0e0-2e618df6aa3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:46.023211 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3587/7199] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:10:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:10:46.024820 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d863f6-d35e-4acd-a52b-965a0d836e7b None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:46.044134 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d863f6-d35e-4acd-a52b-965a0d836e7b None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:46.068326 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a2428-b1e2-4476-b0d4-d5de4e3401c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:46.068977 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a2428-b1e2-4476-b0d4-d5de4e3401c1 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:46.069258 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a2428-b1e2-4476-b0d4-d5de4e3401c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:46.069531 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a2428-b1e2-4476-b0d4-d5de4e3401c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:46.070199 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a2428-b1e2-4476-b0d4-d5de4e3401c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:10:46.070504 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a2428-b1e2-4476-b0d4-d5de4e3401c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:46.072252 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a2428-b1e2-4476-b0d4-d5de4e3401c1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:46.108143 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3613/7200] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:10:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:10:46.113273 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465cd371-0d24-40ff-b0e0-2e618df6aa3f None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:46.134008 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465cd371-0d24-40ff-b0e0-2e618df6aa3f None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:46.141219 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e47fb3c-ae15-4aac-aad2-45a8feec71ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:46.141916 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47fb3c-ae15-4aac-aad2-45a8feec71ab admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:46.142136 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47fb3c-ae15-4aac-aad2-45a8feec71ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:46.142401 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47fb3c-ae15-4aac-aad2-45a8feec71ab admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:46.143306 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e47fb3c-ae15-4aac-aad2-45a8feec71ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:46.145423 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e47fb3c-ae15-4aac-aad2-45a8feec71ab admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:46.224518 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3588/7201] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:10:46 2022] POST /identity/v3/projects => generated 367 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:10:46.229791 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a2428-b1e2-4476-b0d4-d5de4e3401c1 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:46.246990 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a2428-b1e2-4476-b0d4-d5de4e3401c1 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:46.322728 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:46.440995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07031e-f080-4cd0-a30b-1cbac6ca0265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:46.442204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07031e-f080-4cd0-a30b-1cbac6ca0265 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:46.443550 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07031e-f080-4cd0-a30b-1cbac6ca0265 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:46.444009 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07031e-f080-4cd0-a30b-1cbac6ca0265 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:46.445151 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07031e-f080-4cd0-a30b-1cbac6ca0265 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:46.447363 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07031e-f080-4cd0-a30b-1cbac6ca0265 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:46.498520 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3614/7202] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:10:46 2022] POST /identity/v3/users => generated 284 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:10:46.505493 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e47fb3c-ae15-4aac-aad2-45a8feec71ab admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:46.535337 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e47fb3c-ae15-4aac-aad2-45a8feec71ab admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:46.550004 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425b579-6e18-4ab9-b846-242579a7e9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:46.550660 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425b579-6e18-4ab9-b846-242579a7e9d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:46.551003 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425b579-6e18-4ab9-b846-242579a7e9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:46.551409 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425b579-6e18-4ab9-b846-242579a7e9d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:46.552137 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5425b579-6e18-4ab9-b846-242579a7e9d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:46.560224 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5425b579-6e18-4ab9-b846-242579a7e9d5 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:46.580045 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3589/7203] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:10:46.583840 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07031e-f080-4cd0-a30b-1cbac6ca0265 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:46.622718 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07031e-f080-4cd0-a30b-1cbac6ca0265 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:46.634054 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77899f-580a-4d12-877f-794ed83825be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:46.634682 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77899f-580a-4d12-877f-794ed83825be admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:46.634961 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77899f-580a-4d12-877f-794ed83825be admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:46.637911 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77899f-580a-4d12-877f-794ed83825be admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:46.639057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77899f-580a-4d12-877f-794ed83825be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:46.641067 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77899f-580a-4d12-877f-794ed83825be admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:46.670877 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3615/7204] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:10:46.675364 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425b579-6e18-4ab9-b846-242579a7e9d5 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:46.690025 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425b579-6e18-4ab9-b846-242579a7e9d5 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:46.707875 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c49976-d0e1-4b34-8257-99132d09c493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:46.708644 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c49976-d0e1-4b34-8257-99132d09c493 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:46.709017 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c49976-d0e1-4b34-8257-99132d09c493 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:46.709462 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c49976-d0e1-4b34-8257-99132d09c493 admin admin] PATH_INFO: `/v3/projects/8ae4a995516844459ab1e574c0bcc896/users/cea7d770cf3d421e91a1b23b3d1dcace/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:46.729019 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c49976-d0e1-4b34-8257-99132d09c493 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ae4a995516844459ab1e574c0bcc896, user_id=cea7d770cf3d421e91a1b23b3d1dcace, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:46.733055 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c49976-d0e1-4b34-8257-99132d09c493 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:46.755552 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3590/7205] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:10:46 2022] PUT /identity/v3/projects/8ae4a995516844459ab1e574c0bcc896/users/cea7d770cf3d421e91a1b23b3d1dcace/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:10:46.767380 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da8d93-0b77-4f7c-b492-a76fee00ffab None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:46.768065 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da8d93-0b77-4f7c-b492-a76fee00ffab None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:46.768538 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da8d93-0b77-4f7c-b492-a76fee00ffab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:46.817115 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-f0da8d93-0b77-4f7c-b492-a76fee00ffab None None] MFA Rules not processed for user `cea7d770cf3d421e91a1b23b3d1dcace`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:10:46.818516 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f0da8d93-0b77-4f7c-b492-a76fee00ffab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:46.957941 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3616/7206] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:10:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:10:46.962075 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c49976-d0e1-4b34-8257-99132d09c493 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:46.980422 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:47.098047 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c49976-d0e1-4b34-8257-99132d09c493 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:47.124966 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7373c-ec75-47b0-91ae-5dc5c47f82db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:47.125607 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7373c-ec75-47b0-91ae-5dc5c47f82db admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:47.127504 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7373c-ec75-47b0-91ae-5dc5c47f82db admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:47.127959 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7373c-ec75-47b0-91ae-5dc5c47f82db admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:47.129234 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a7373c-ec75-47b0-91ae-5dc5c47f82db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:47.131422 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a7373c-ec75-47b0-91ae-5dc5c47f82db admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:47.181645 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3591/7207] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:10:46 2022] POST /identity/v3/projects => generated 367 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:10:47.186663 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da8d93-0b77-4f7c-b492-a76fee00ffab None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:47.205053 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da8d93-0b77-4f7c-b492-a76fee00ffab None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:47.420652 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fbd071-ad21-4142-a23c-3f7695682e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:47.422156 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbd071-ad21-4142-a23c-3f7695682e82 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:47.422439 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbd071-ad21-4142-a23c-3f7695682e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:47.422726 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbd071-ad21-4142-a23c-3f7695682e82 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:47.423415 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fbd071-ad21-4142-a23c-3f7695682e82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:47.439214 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fbd071-ad21-4142-a23c-3f7695682e82 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:47.489228 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3617/7208] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:10:47 2022] POST /identity/v3/users => generated 290 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:10:47.492966 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7373c-ec75-47b0-91ae-5dc5c47f82db admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:47.510927 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7373c-ec75-47b0-91ae-5dc5c47f82db admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:47.527826 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ca41aa-67fb-405f-ac83-5454b9a9199a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:47.528459 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca41aa-67fb-405f-ac83-5454b9a9199a admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:47.528734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca41aa-67fb-405f-ac83-5454b9a9199a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:47.529006 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca41aa-67fb-405f-ac83-5454b9a9199a admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:47.529660 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ca41aa-67fb-405f-ac83-5454b9a9199a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:47.536903 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ca41aa-67fb-405f-ac83-5454b9a9199a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:47.580621 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fbd071-ad21-4142-a23c-3f7695682e82 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:47.581655 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3592/7209] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:10:47.597480 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fbd071-ad21-4142-a23c-3f7695682e82 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:47.612629 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8781dd48-a2cc-4aab-b727-b78bb663863a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:47.613496 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781dd48-a2cc-4aab-b727-b78bb663863a admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:47.613880 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781dd48-a2cc-4aab-b727-b78bb663863a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:47.614282 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781dd48-a2cc-4aab-b727-b78bb663863a admin admin] PATH_INFO: `/v3/projects/2aaa3366326f4f2ba4a934f098080bc0/users/4327d62aafc84f70a86434764fd0a543/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:47.656315 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8781dd48-a2cc-4aab-b727-b78bb663863a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aaa3366326f4f2ba4a934f098080bc0, user_id=4327d62aafc84f70a86434764fd0a543, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:47.662650 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8781dd48-a2cc-4aab-b727-b78bb663863a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:47.686174 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:47.695777 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3618/7210] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:10:47 2022] PUT /identity/v3/projects/2aaa3366326f4f2ba4a934f098080bc0/users/4327d62aafc84f70a86434764fd0a543/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:10:47.699770 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ca41aa-67fb-405f-ac83-5454b9a9199a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:47.715082 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ca41aa-67fb-405f-ac83-5454b9a9199a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:47.910387 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81620f4e-36bf-447d-8dc7-2eaefff017a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:47.911614 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81620f4e-36bf-447d-8dc7-2eaefff017a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:47.912139 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81620f4e-36bf-447d-8dc7-2eaefff017a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:47.912605 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81620f4e-36bf-447d-8dc7-2eaefff017a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:47.913507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81620f4e-36bf-447d-8dc7-2eaefff017a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:47.915601 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81620f4e-36bf-447d-8dc7-2eaefff017a3 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:47.929720 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3593/7211] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:10:47.934238 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8781dd48-a2cc-4aab-b727-b78bb663863a admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:47.960345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8781dd48-a2cc-4aab-b727-b78bb663863a admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:47.984708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88529ca-7f13-4f20-a71d-6adea928469a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:47.985108 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88529ca-7f13-4f20-a71d-6adea928469a admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:47.985490 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88529ca-7f13-4f20-a71d-6adea928469a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:47.986366 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88529ca-7f13-4f20-a71d-6adea928469a admin admin] PATH_INFO: `/v3/projects/2aaa3366326f4f2ba4a934f098080bc0/users/4327d62aafc84f70a86434764fd0a543/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:47.988653 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88529ca-7f13-4f20-a71d-6adea928469a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aaa3366326f4f2ba4a934f098080bc0, user_id=4327d62aafc84f70a86434764fd0a543, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:47.991850 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88529ca-7f13-4f20-a71d-6adea928469a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:48.018294 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3619/7212] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:10:47 2022] PUT /identity/v3/projects/2aaa3366326f4f2ba4a934f098080bc0/users/4327d62aafc84f70a86434764fd0a543/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:10:48.029950 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa957115-87e6-4641-95c9-50102754fe16 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:48.030645 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa957115-87e6-4641-95c9-50102754fe16 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:48.031212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa957115-87e6-4641-95c9-50102754fe16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:48.086157 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-fa957115-87e6-4641-95c9-50102754fe16 None None] MFA Rules not processed for user `4327d62aafc84f70a86434764fd0a543`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:10:48.088024 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-fa957115-87e6-4641-95c9-50102754fe16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:48.327627 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3594/7213] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:10:48 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:10:48.341299 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88529ca-7f13-4f20-a71d-6adea928469a admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:48.344445 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e88529ca-7f13-4f20-a71d-6adea928469a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:48.514439 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88529ca-7f13-4f20-a71d-6adea928469a admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:48.523760 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d60d4-cb73-41fc-a0d9-f7ab7d9d3e74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:48.525020 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d60d4-cb73-41fc-a0d9-f7ab7d9d3e74 service cinder] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:48.525020 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d60d4-cb73-41fc-a0d9-f7ab7d9d3e74 service cinder] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:48.525290 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d60d4-cb73-41fc-a0d9-f7ab7d9d3e74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:48.537248 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d60d4-cb73-41fc-a0d9-f7ab7d9d3e74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:48.539798 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d60d4-cb73-41fc-a0d9-f7ab7d9d3e74 service cinder] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:48.554749 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3620/7214] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:10:48 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:10:48.769171 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa957115-87e6-4641-95c9-50102754fe16 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:48.790574 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa957115-87e6-4641-95c9-50102754fe16 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:48.795276 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d3cad-4e59-4f3c-b962-d2d8074fc9d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:48.796106 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d3cad-4e59-4f3c-b962-d2d8074fc9d7 service cinder] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:48.797085 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d3cad-4e59-4f3c-b962-d2d8074fc9d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:48.797532 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d3cad-4e59-4f3c-b962-d2d8074fc9d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:48.805969 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:48.935547 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d3cad-4e59-4f3c-b962-d2d8074fc9d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:48.937573 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d3cad-4e59-4f3c-b962-d2d8074fc9d7 service cinder] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:48.955977 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3595/7215] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:10:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:10:49.323797 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d60d4-cb73-41fc-a0d9-f7ab7d9d3e74 service cinder] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:49.325990 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-804d60d4-cb73-41fc-a0d9-f7ab7d9d3e74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:49.438924 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d60d4-cb73-41fc-a0d9-f7ab7d9d3e74 service cinder] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:49.447220 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09844d97-ef45-402d-84fc-9b6cc5f9c771 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:49.449258 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09844d97-ef45-402d-84fc-9b6cc5f9c771 service swift] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:49.449749 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09844d97-ef45-402d-84fc-9b6cc5f9c771 service swift] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:49.450209 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09844d97-ef45-402d-84fc-9b6cc5f9c771 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:49.466507 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-09844d97-ef45-402d-84fc-9b6cc5f9c771 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:49.583717 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09844d97-ef45-402d-84fc-9b6cc5f9c771 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:49.585892 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09844d97-ef45-402d-84fc-9b6cc5f9c771 service swift] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:49.619095 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3621/7216] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 16:10:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 665 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:10:54.122499 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d3cad-4e59-4f3c-b962-d2d8074fc9d7 service cinder] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:54.257642 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d3cad-4e59-4f3c-b962-d2d8074fc9d7 service cinder] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:54.281411 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc18984-0a2c-425b-9efa-17f2eab57a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:54.281769 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc18984-0a2c-425b-9efa-17f2eab57a1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:54.282207 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc18984-0a2c-425b-9efa-17f2eab57a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:54.283012 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc18984-0a2c-425b-9efa-17f2eab57a1c admin admin] PATH_INFO: `/v3/users/cea7d770cf3d421e91a1b23b3d1dcace` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:54.289097 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc18984-0a2c-425b-9efa-17f2eab57a1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cea7d770cf3d421e91a1b23b3d1dcace)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:54.292328 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc18984-0a2c-425b-9efa-17f2eab57a1c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:54.389816 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ebc18984-0a2c-425b-9efa-17f2eab57a1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cea7d770cf3d421e91a1b23b3d1dcace'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:54.391797 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ebc18984-0a2c-425b-9efa-17f2eab57a1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cea7d770cf3d421e91a1b23b3d1dcace'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:54.434895 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ebc18984-0a2c-425b-9efa-17f2eab57a1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cea7d770cf3d421e91a1b23b3d1dcace'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:54.467420 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ebc18984-0a2c-425b-9efa-17f2eab57a1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cea7d770cf3d421e91a1b23b3d1dcace'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:54.478661 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ebc18984-0a2c-425b-9efa-17f2eab57a1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cea7d770cf3d421e91a1b23b3d1dcace'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:54.496524 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3596/7217] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:10:54 2022] DELETE /identity/v3/users/cea7d770cf3d421e91a1b23b3d1dcace => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:10:54.497213 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28277196-035a-4ad0-99aa-cd32aab41f4c None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:54.497693 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28277196-035a-4ad0-99aa-cd32aab41f4c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:54.497848 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28277196-035a-4ad0-99aa-cd32aab41f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:54.548491 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-28277196-035a-4ad0-99aa-cd32aab41f4c None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:10:54.549817 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-28277196-035a-4ad0-99aa-cd32aab41f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:54.625701 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:54.711874 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3622/7218] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:10:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:10:54.741484 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc18984-0a2c-425b-9efa-17f2eab57a1c admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:54.743373 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ebc18984-0a2c-425b-9efa-17f2eab57a1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:54.818354 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:54.901634 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc18984-0a2c-425b-9efa-17f2eab57a1c admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:54.920772 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9186cb-3cdc-44d7-a04e-811b2c849e06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:54.921479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9186cb-3cdc-44d7-a04e-811b2c849e06 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:54.923201 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9186cb-3cdc-44d7-a04e-811b2c849e06 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:54.923484 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9186cb-3cdc-44d7-a04e-811b2c849e06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:54.952364 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9186cb-3cdc-44d7-a04e-811b2c849e06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:54.972272 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9186cb-3cdc-44d7-a04e-811b2c849e06 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:55.020013 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3597/7219] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:10:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:10:56.502527 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28277196-035a-4ad0-99aa-cd32aab41f4c None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:56.504818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-28277196-035a-4ad0-99aa-cd32aab41f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:56.555251 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28277196-035a-4ad0-99aa-cd32aab41f4c None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:56.570301 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7765468-b8a3-4de1-bfe1-6545a64f7327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:56.571268 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7765468-b8a3-4de1-bfe1-6545a64f7327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:56.571900 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7765468-b8a3-4de1-bfe1-6545a64f7327 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:56.572339 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7765468-b8a3-4de1-bfe1-6545a64f7327 admin admin] PATH_INFO: `/v3/projects/8ae4a995516844459ab1e574c0bcc896` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:56.574513 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7765468-b8a3-4de1-bfe1-6545a64f7327 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ae4a995516844459ab1e574c0bcc896)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:56.576804 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7765468-b8a3-4de1-bfe1-6545a64f7327 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:56.687392 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a7765468-b8a3-4de1-bfe1-6545a64f7327 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ae4a995516844459ab1e574c0bcc896', 'request_id': 'req-a7765468-b8a3-4de1-bfe1-6545a64f7327'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:56.694441 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a7765468-b8a3-4de1-bfe1-6545a64f7327 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ae4a995516844459ab1e574c0bcc896', 'request_id': 'req-a7765468-b8a3-4de1-bfe1-6545a64f7327'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:56.702443 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a7765468-b8a3-4de1-bfe1-6545a64f7327 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ae4a995516844459ab1e574c0bcc896', 'request_id': 'req-a7765468-b8a3-4de1-bfe1-6545a64f7327'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:56.718470 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a7765468-b8a3-4de1-bfe1-6545a64f7327 admin admin] The token cache is being invalidate because project 8ae4a995516844459ab1e574c0bcc896 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:10:56.719124 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a7765468-b8a3-4de1-bfe1-6545a64f7327 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:56.720240 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a7765468-b8a3-4de1-bfe1-6545a64f7327 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:56.722869 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3623/7220] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:10:56 2022] DELETE /identity/v3/projects/8ae4a995516844459ab1e574c0bcc896 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:10:56.726896 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9186cb-3cdc-44d7-a04e-811b2c849e06 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:56.754809 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9186cb-3cdc-44d7-a04e-811b2c849e06 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:56.875775 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce832ba-c13d-4966-8d45-ecedf1bb722c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:56.876444 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce832ba-c13d-4966-8d45-ecedf1bb722c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:56.876721 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce832ba-c13d-4966-8d45-ecedf1bb722c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:56.876991 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce832ba-c13d-4966-8d45-ecedf1bb722c admin admin] PATH_INFO: `/v3/users/4327d62aafc84f70a86434764fd0a543` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:56.880410 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce832ba-c13d-4966-8d45-ecedf1bb722c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4327d62aafc84f70a86434764fd0a543)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:56.885105 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce832ba-c13d-4966-8d45-ecedf1bb722c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:57.065069 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-dce832ba-c13d-4966-8d45-ecedf1bb722c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4327d62aafc84f70a86434764fd0a543'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:57.065691 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-dce832ba-c13d-4966-8d45-ecedf1bb722c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4327d62aafc84f70a86434764fd0a543'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:57.084195 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-dce832ba-c13d-4966-8d45-ecedf1bb722c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4327d62aafc84f70a86434764fd0a543'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:57.095275 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-dce832ba-c13d-4966-8d45-ecedf1bb722c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4327d62aafc84f70a86434764fd0a543'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:57.105997 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-dce832ba-c13d-4966-8d45-ecedf1bb722c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4327d62aafc84f70a86434764fd0a543'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:57.113339 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3598/7221] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:10:56 2022] DELETE /identity/v3/users/4327d62aafc84f70a86434764fd0a543 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:10:57.811768 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7765468-b8a3-4de1-bfe1-6545a64f7327 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:57.814601 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a7765468-b8a3-4de1-bfe1-6545a64f7327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:57.879044 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7765468-b8a3-4de1-bfe1-6545a64f7327 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:57.958360 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5189132-757d-43b7-a14a-73dc5c0c2395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:57.958989 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5189132-757d-43b7-a14a-73dc5c0c2395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:57.959477 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5189132-757d-43b7-a14a-73dc5c0c2395 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:57.960748 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5189132-757d-43b7-a14a-73dc5c0c2395 admin admin] PATH_INFO: `/v3/projects/2aaa3366326f4f2ba4a934f098080bc0` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:57.963667 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5189132-757d-43b7-a14a-73dc5c0c2395 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aaa3366326f4f2ba4a934f098080bc0)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:57.966969 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5189132-757d-43b7-a14a-73dc5c0c2395 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:58.037015 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b5189132-757d-43b7-a14a-73dc5c0c2395 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aaa3366326f4f2ba4a934f098080bc0', 'request_id': 'req-b5189132-757d-43b7-a14a-73dc5c0c2395'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:58.044720 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:58.059771 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b5189132-757d-43b7-a14a-73dc5c0c2395 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aaa3366326f4f2ba4a934f098080bc0', 'request_id': 'req-b5189132-757d-43b7-a14a-73dc5c0c2395'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:58.076050 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b5189132-757d-43b7-a14a-73dc5c0c2395 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aaa3366326f4f2ba4a934f098080bc0', 'request_id': 'req-b5189132-757d-43b7-a14a-73dc5c0c2395'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:58.111072 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b5189132-757d-43b7-a14a-73dc5c0c2395 admin admin] The token cache is being invalidate because project 2aaa3366326f4f2ba4a934f098080bc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:10:58.111849 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b5189132-757d-43b7-a14a-73dc5c0c2395 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:58.112950 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b5189132-757d-43b7-a14a-73dc5c0c2395 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:58.117098 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3624/7222] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:10:57 2022] DELETE /identity/v3/projects/2aaa3366326f4f2ba4a934f098080bc0 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:10:58.124646 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38214e-0fe7-4dfc-8c3b-43b4a55632bd None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:58.125251 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38214e-0fe7-4dfc-8c3b-43b4a55632bd None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:58.125251 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38214e-0fe7-4dfc-8c3b-43b4a55632bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:58.172934 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-ee38214e-0fe7-4dfc-8c3b-43b4a55632bd None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:10:58.174812 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ee38214e-0fe7-4dfc-8c3b-43b4a55632bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:58.263406 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:58.308424 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3599/7223] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:10:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:10:58.312244 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700c967-4cb6-4140-9657-c942a8afbf94 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:58.312532 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700c967-4cb6-4140-9657-c942a8afbf94 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:58.312807 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700c967-4cb6-4140-9657-c942a8afbf94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:58.336832 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-0700c967-4cb6-4140-9657-c942a8afbf94 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:10:58.338566 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0700c967-4cb6-4140-9657-c942a8afbf94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:58.360094 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38214e-0fe7-4dfc-8c3b-43b4a55632bd None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:58.371488 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3625/7224] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:10:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:10:58.372772 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38214e-0fe7-4dfc-8c3b-43b4a55632bd None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:58.389159 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eeb211-4828-46c2-9be4-9675aa22fc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:58.389964 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eeb211-4828-46c2-9be4-9675aa22fc66 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:58.390254 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eeb211-4828-46c2-9be4-9675aa22fc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:58.390772 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eeb211-4828-46c2-9be4-9675aa22fc66 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:58.391702 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eeb211-4828-46c2-9be4-9675aa22fc66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:10:58.392019 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eeb211-4828-46c2-9be4-9675aa22fc66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:58.395457 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eeb211-4828-46c2-9be4-9675aa22fc66 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:58.426240 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3600/7225] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:10:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:10:58.434474 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700c967-4cb6-4140-9657-c942a8afbf94 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:58.460929 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700c967-4cb6-4140-9657-c942a8afbf94 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:58.484753 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc3bc90-f24f-4029-b0b1-3182fc446e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:58.485982 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3bc90-f24f-4029-b0b1-3182fc446e54 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:58.486557 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3bc90-f24f-4029-b0b1-3182fc446e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:58.487210 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3bc90-f24f-4029-b0b1-3182fc446e54 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:58.488500 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc3bc90-f24f-4029-b0b1-3182fc446e54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:58.495759 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc3bc90-f24f-4029-b0b1-3182fc446e54 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:58.615302 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3626/7226] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:10:58 2022] POST /identity/v3/projects => generated 387 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:10:58.616582 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eeb211-4828-46c2-9be4-9675aa22fc66 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:58.637869 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eeb211-4828-46c2-9be4-9675aa22fc66 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:58.822491 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c976b-fc90-47d3-84c5-e0fcd8f4027c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:58.825092 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c976b-fc90-47d3-84c5-e0fcd8f4027c admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:58.828091 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c976b-fc90-47d3-84c5-e0fcd8f4027c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:58.828405 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c976b-fc90-47d3-84c5-e0fcd8f4027c admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:58.829102 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c976b-fc90-47d3-84c5-e0fcd8f4027c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:58.836625 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c976b-fc90-47d3-84c5-e0fcd8f4027c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:58.899212 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3601/7227] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:10:58 2022] POST /identity/v3/users => generated 294 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:10:58.903788 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc3bc90-f24f-4029-b0b1-3182fc446e54 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:58.942928 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc3bc90-f24f-4029-b0b1-3182fc446e54 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:58.960639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80966b18-96e2-40b0-a3b3-f0a3cd366531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:58.962101 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80966b18-96e2-40b0-a3b3-f0a3cd366531 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:58.962867 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80966b18-96e2-40b0-a3b3-f0a3cd366531 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:58.963837 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80966b18-96e2-40b0-a3b3-f0a3cd366531 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:58.964695 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80966b18-96e2-40b0-a3b3-f0a3cd366531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:58.966594 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80966b18-96e2-40b0-a3b3-f0a3cd366531 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:59.024438 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3627/7228] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:10:59.028440 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c976b-fc90-47d3-84c5-e0fcd8f4027c admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:59.047341 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c976b-fc90-47d3-84c5-e0fcd8f4027c admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:59.057178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a8102-2174-4392-a14f-a311879a50a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:59.057818 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a8102-2174-4392-a14f-a311879a50a7 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:59.058103 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a8102-2174-4392-a14f-a311879a50a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:59.058378 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a8102-2174-4392-a14f-a311879a50a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:59.059560 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a8102-2174-4392-a14f-a311879a50a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:59.062069 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a8102-2174-4392-a14f-a311879a50a7 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:59.076782 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3602/7229] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:10:59.081868 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80966b18-96e2-40b0-a3b3-f0a3cd366531 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:59.105842 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80966b18-96e2-40b0-a3b3-f0a3cd366531 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:59.117296 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296515a7-ec20-4f3f-ae4e-1be16eaaa388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:59.118384 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296515a7-ec20-4f3f-ae4e-1be16eaaa388 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:59.118828 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296515a7-ec20-4f3f-ae4e-1be16eaaa388 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:59.119408 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296515a7-ec20-4f3f-ae4e-1be16eaaa388 admin admin] PATH_INFO: `/v3/projects/96eac8629700410fb47b8edef3c6a2cc/users/1b5cd16daf5c43839a77f75083bb9bc2/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:59.158769 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296515a7-ec20-4f3f-ae4e-1be16eaaa388 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96eac8629700410fb47b8edef3c6a2cc, user_id=1b5cd16daf5c43839a77f75083bb9bc2, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:59.161955 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296515a7-ec20-4f3f-ae4e-1be16eaaa388 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:59.196048 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3628/7230] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:10:59 2022] PUT /identity/v3/projects/96eac8629700410fb47b8edef3c6a2cc/users/1b5cd16daf5c43839a77f75083bb9bc2/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:10:59.206349 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3311630-83ae-4bdc-8392-145608653a8b None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:59.206876 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3311630-83ae-4bdc-8392-145608653a8b None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:59.206994 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3311630-83ae-4bdc-8392-145608653a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:59.294014 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-d3311630-83ae-4bdc-8392-145608653a8b None None] MFA Rules not processed for user `1b5cd16daf5c43839a77f75083bb9bc2`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:10:59.296100 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d3311630-83ae-4bdc-8392-145608653a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:59.507465 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3603/7231] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:10:59 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:10:59.512453 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296515a7-ec20-4f3f-ae4e-1be16eaaa388 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:59.693453 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296515a7-ec20-4f3f-ae4e-1be16eaaa388 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:59.708843 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0106fd-2bb0-4959-be66-3079d89a7a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:59.709504 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0106fd-2bb0-4959-be66-3079d89a7a02 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:59.709764 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0106fd-2bb0-4959-be66-3079d89a7a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:59.710051 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0106fd-2bb0-4959-be66-3079d89a7a02 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:59.711342 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0106fd-2bb0-4959-be66-3079d89a7a02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:59.713499 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0106fd-2bb0-4959-be66-3079d89a7a02 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:59.803530 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3629/7232] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:10:59 2022] POST /identity/v3/projects => generated 385 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:10:59.808216 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3311630-83ae-4bdc-8392-145608653a8b None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:59.822828 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3311630-83ae-4bdc-8392-145608653a8b None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:59.963871 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:00.001819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce32bd-45f2-4fa3-895c-aab47c813856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:00.002561 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce32bd-45f2-4fa3-895c-aab47c813856 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:00.003111 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce32bd-45f2-4fa3-895c-aab47c813856 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:00.003480 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce32bd-45f2-4fa3-895c-aab47c813856 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:00.004288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce32bd-45f2-4fa3-895c-aab47c813856 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:00.009171 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce32bd-45f2-4fa3-895c-aab47c813856 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:00.067397 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3604/7233] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:10:59 2022] POST /identity/v3/users => generated 299 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:11:00.070995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0106fd-2bb0-4959-be66-3079d89a7a02 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:00.089494 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0106fd-2bb0-4959-be66-3079d89a7a02 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:00.102473 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4600775-a802-4274-a432-22eb055425c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:00.103150 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4600775-a802-4274-a432-22eb055425c7 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:00.103409 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4600775-a802-4274-a432-22eb055425c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:00.104468 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4600775-a802-4274-a432-22eb055425c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:00.105437 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4600775-a802-4274-a432-22eb055425c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:00.110688 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4600775-a802-4274-a432-22eb055425c7 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:00.154453 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3630/7234] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:11:00.155320 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce32bd-45f2-4fa3-895c-aab47c813856 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:00.174530 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce32bd-45f2-4fa3-895c-aab47c813856 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:00.182270 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874472d-6f58-44d4-adc4-3ae74fbc3342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:00.182992 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874472d-6f58-44d4-adc4-3ae74fbc3342 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:00.183305 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874472d-6f58-44d4-adc4-3ae74fbc3342 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:00.183580 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874472d-6f58-44d4-adc4-3ae74fbc3342 admin admin] PATH_INFO: `/v3/projects/cee6f544ad144af4b97ac7643ca8862b/users/43c7e20c4d4a4908bb1ce9263d3550bf/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:00.201861 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1874472d-6f58-44d4-adc4-3ae74fbc3342 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cee6f544ad144af4b97ac7643ca8862b, user_id=43c7e20c4d4a4908bb1ce9263d3550bf, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:00.205659 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1874472d-6f58-44d4-adc4-3ae74fbc3342 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:00.238321 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3605/7235] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:11:00 2022] PUT /identity/v3/projects/cee6f544ad144af4b97ac7643ca8862b/users/43c7e20c4d4a4908bb1ce9263d3550bf/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:11:00.241979 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4600775-a802-4274-a432-22eb055425c7 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:00.255789 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4600775-a802-4274-a432-22eb055425c7 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:00.331785 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:00.343517 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da85e19e-46d9-4e1a-83ed-eb9b590c0749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:00.352957 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85e19e-46d9-4e1a-83ed-eb9b590c0749 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:00.353480 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85e19e-46d9-4e1a-83ed-eb9b590c0749 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:00.354932 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85e19e-46d9-4e1a-83ed-eb9b590c0749 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:00.356822 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da85e19e-46d9-4e1a-83ed-eb9b590c0749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:00.369612 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da85e19e-46d9-4e1a-83ed-eb9b590c0749 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:00.408456 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3631/7236] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:11:00.412737 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874472d-6f58-44d4-adc4-3ae74fbc3342 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:00.427950 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874472d-6f58-44d4-adc4-3ae74fbc3342 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:00.436643 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8346a-e634-4f0b-9ab9-8760666b071a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:00.437562 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8346a-e634-4f0b-9ab9-8760666b071a admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:00.438152 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8346a-e634-4f0b-9ab9-8760666b071a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:00.438426 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8346a-e634-4f0b-9ab9-8760666b071a admin admin] PATH_INFO: `/v3/projects/cee6f544ad144af4b97ac7643ca8862b/users/43c7e20c4d4a4908bb1ce9263d3550bf/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:00.441537 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b8346a-e634-4f0b-9ab9-8760666b071a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cee6f544ad144af4b97ac7643ca8862b, user_id=43c7e20c4d4a4908bb1ce9263d3550bf, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:00.445012 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b8346a-e634-4f0b-9ab9-8760666b071a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:00.461022 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3606/7237] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:11:00 2022] PUT /identity/v3/projects/cee6f544ad144af4b97ac7643ca8862b/users/43c7e20c4d4a4908bb1ce9263d3550bf/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:11:00.471587 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2bd4ac-e231-4ef5-ae57-df39c46c71a6 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:00.472118 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2bd4ac-e231-4ef5-ae57-df39c46c71a6 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:00.472353 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2bd4ac-e231-4ef5-ae57-df39c46c71a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:00.514374 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-5d2bd4ac-e231-4ef5-ae57-df39c46c71a6 None None] MFA Rules not processed for user `43c7e20c4d4a4908bb1ce9263d3550bf`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:11:00.516445 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5d2bd4ac-e231-4ef5-ae57-df39c46c71a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:00.723133 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3632/7238] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:11:00 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:11:02.290593 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8346a-e634-4f0b-9ab9-8760666b071a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:02.293451 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-02b8346a-e634-4f0b-9ab9-8760666b071a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:02.519395 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8346a-e634-4f0b-9ab9-8760666b071a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:02.536310 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41e38e-9349-4a07-8654-d880e6a3262f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:02.537108 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41e38e-9349-4a07-8654-d880e6a3262f service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:02.537492 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41e38e-9349-4a07-8654-d880e6a3262f service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:02.537876 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41e38e-9349-4a07-8654-d880e6a3262f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:02.539928 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-bc41e38e-9349-4a07-8654-d880e6a3262f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:02.572899 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41e38e-9349-4a07-8654-d880e6a3262f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:02.576741 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41e38e-9349-4a07-8654-d880e6a3262f service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:02.637397 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3607/7239] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:11:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:11:03.280781 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2bd4ac-e231-4ef5-ae57-df39c46c71a6 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:03.282289 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5d2bd4ac-e231-4ef5-ae57-df39c46c71a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:03.360550 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2bd4ac-e231-4ef5-ae57-df39c46c71a6 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:03.365397 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4582ab-198e-4d83-a838-67da357e7f8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:03.366237 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4582ab-198e-4d83-a838-67da357e7f8d service cinder] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:03.366607 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4582ab-198e-4d83-a838-67da357e7f8d service cinder] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:03.366942 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4582ab-198e-4d83-a838-67da357e7f8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:03.377994 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4582ab-198e-4d83-a838-67da357e7f8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:03.379645 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4582ab-198e-4d83-a838-67da357e7f8d service cinder] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:03.403917 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3633/7240] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:11:03 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:11:03.712570 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41e38e-9349-4a07-8654-d880e6a3262f service placement] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:03.883749 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41e38e-9349-4a07-8654-d880e6a3262f service placement] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:03.895103 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a476d-33b5-428f-96cd-22ef9c12bfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:03.896204 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a476d-33b5-428f-96cd-22ef9c12bfb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:03.896579 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a476d-33b5-428f-96cd-22ef9c12bfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:03.896948 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a476d-33b5-428f-96cd-22ef9c12bfb1 admin admin] PATH_INFO: `/v3/users/1b5cd16daf5c43839a77f75083bb9bc2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:03.898222 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a476d-33b5-428f-96cd-22ef9c12bfb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b5cd16daf5c43839a77f75083bb9bc2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:03.907411 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a476d-33b5-428f-96cd-22ef9c12bfb1 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:03.951553 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:03.993159 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8d6a476d-33b5-428f-96cd-22ef9c12bfb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b5cd16daf5c43839a77f75083bb9bc2'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:03.994853 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8d6a476d-33b5-428f-96cd-22ef9c12bfb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b5cd16daf5c43839a77f75083bb9bc2'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:04.015535 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8d6a476d-33b5-428f-96cd-22ef9c12bfb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b5cd16daf5c43839a77f75083bb9bc2'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:04.028468 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8d6a476d-33b5-428f-96cd-22ef9c12bfb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b5cd16daf5c43839a77f75083bb9bc2'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:04.040726 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8d6a476d-33b5-428f-96cd-22ef9c12bfb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b5cd16daf5c43839a77f75083bb9bc2'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:04.050472 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3608/7241] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:11:03 2022] DELETE /identity/v3/users/1b5cd16daf5c43839a77f75083bb9bc2 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:11:04.055040 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188dac2-30d6-4db8-a881-2781771e0a60 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:04.058088 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188dac2-30d6-4db8-a881-2781771e0a60 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:04.059700 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188dac2-30d6-4db8-a881-2781771e0a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:04.121372 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-7188dac2-30d6-4db8-a881-2781771e0a60 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:11:04.126910 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7188dac2-30d6-4db8-a881-2781771e0a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:04.312594 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3634/7242] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:11:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:11:04.320212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a476d-33b5-428f-96cd-22ef9c12bfb1 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:04.322801 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8d6a476d-33b5-428f-96cd-22ef9c12bfb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:04.490939 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a476d-33b5-428f-96cd-22ef9c12bfb1 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:04.505321 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c6f5b-9401-4cb1-87a7-52b16e8de6f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:04.506156 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c6f5b-9401-4cb1-87a7-52b16e8de6f9 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:04.506642 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c6f5b-9401-4cb1-87a7-52b16e8de6f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:04.507096 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c6f5b-9401-4cb1-87a7-52b16e8de6f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:04.532819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c6f5b-9401-4cb1-87a7-52b16e8de6f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:04.535449 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c6f5b-9401-4cb1-87a7-52b16e8de6f9 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:04.560774 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3609/7243] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:11:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:11:05.831110 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7188dac2-30d6-4db8-a881-2781771e0a60 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:05.832627 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7188dac2-30d6-4db8-a881-2781771e0a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:05.873433 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7188dac2-30d6-4db8-a881-2781771e0a60 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:05.893304 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae626fe-723b-4121-b4e0-e8f72f6a884f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:05.894629 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae626fe-723b-4121-b4e0-e8f72f6a884f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:05.895106 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae626fe-723b-4121-b4e0-e8f72f6a884f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:05.895544 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae626fe-723b-4121-b4e0-e8f72f6a884f admin admin] PATH_INFO: `/v3/projects/96eac8629700410fb47b8edef3c6a2cc` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:05.897884 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae626fe-723b-4121-b4e0-e8f72f6a884f admin admin] RBAC: Authorizing `identity:delete_project(project_id=96eac8629700410fb47b8edef3c6a2cc)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:05.904342 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae626fe-723b-4121-b4e0-e8f72f6a884f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:05.950232 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:06.018192 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5ae626fe-723b-4121-b4e0-e8f72f6a884f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96eac8629700410fb47b8edef3c6a2cc', 'request_id': 'req-5ae626fe-723b-4121-b4e0-e8f72f6a884f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:06.026658 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5ae626fe-723b-4121-b4e0-e8f72f6a884f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96eac8629700410fb47b8edef3c6a2cc', 'request_id': 'req-5ae626fe-723b-4121-b4e0-e8f72f6a884f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:06.037307 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5ae626fe-723b-4121-b4e0-e8f72f6a884f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96eac8629700410fb47b8edef3c6a2cc', 'request_id': 'req-5ae626fe-723b-4121-b4e0-e8f72f6a884f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:06.072630 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5ae626fe-723b-4121-b4e0-e8f72f6a884f admin admin] The token cache is being invalidate because project 96eac8629700410fb47b8edef3c6a2cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:11:06.073136 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5ae626fe-723b-4121-b4e0-e8f72f6a884f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:06.073988 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5ae626fe-723b-4121-b4e0-e8f72f6a884f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:06.080242 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c6f5b-9401-4cb1-87a7-52b16e8de6f9 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:06.081317 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3635/7244] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:11:05 2022] DELETE /identity/v3/projects/96eac8629700410fb47b8edef3c6a2cc => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:11:06.106640 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c6f5b-9401-4cb1-87a7-52b16e8de6f9 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:06.270808 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baaff94-5d4c-4e1c-91b7-e3828ce26927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:06.272739 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baaff94-5d4c-4e1c-91b7-e3828ce26927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:06.273053 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baaff94-5d4c-4e1c-91b7-e3828ce26927 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:06.273333 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baaff94-5d4c-4e1c-91b7-e3828ce26927 admin admin] PATH_INFO: `/v3/users/43c7e20c4d4a4908bb1ce9263d3550bf` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:06.276848 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baaff94-5d4c-4e1c-91b7-e3828ce26927 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43c7e20c4d4a4908bb1ce9263d3550bf)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:06.283152 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baaff94-5d4c-4e1c-91b7-e3828ce26927 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:06.473373 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0baaff94-5d4c-4e1c-91b7-e3828ce26927 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43c7e20c4d4a4908bb1ce9263d3550bf'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:06.474810 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0baaff94-5d4c-4e1c-91b7-e3828ce26927 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43c7e20c4d4a4908bb1ce9263d3550bf'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:06.478679 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:06.503912 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0baaff94-5d4c-4e1c-91b7-e3828ce26927 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43c7e20c4d4a4908bb1ce9263d3550bf'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:06.528236 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0baaff94-5d4c-4e1c-91b7-e3828ce26927 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43c7e20c4d4a4908bb1ce9263d3550bf'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:06.540624 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0baaff94-5d4c-4e1c-91b7-e3828ce26927 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43c7e20c4d4a4908bb1ce9263d3550bf'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:06.555345 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3610/7245] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:11:06 2022] DELETE /identity/v3/users/43c7e20c4d4a4908bb1ce9263d3550bf => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:11:07.118086 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ef2b0-85fa-4a64-92dd-03f0b5f660ce None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:07.120737 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ef2b0-85fa-4a64-92dd-03f0b5f660ce None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:07.121761 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ef2b0-85fa-4a64-92dd-03f0b5f660ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:07.180807 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-bc7ef2b0-85fa-4a64-92dd-03f0b5f660ce None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:11:07.183115 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-bc7ef2b0-85fa-4a64-92dd-03f0b5f660ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:07.479803 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3636/7246] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 16:11:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:11:07.494546 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baaff94-5d4c-4e1c-91b7-e3828ce26927 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:07.499373 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0baaff94-5d4c-4e1c-91b7-e3828ce26927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:07.702407 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baaff94-5d4c-4e1c-91b7-e3828ce26927 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:07.714069 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e889f-de18-45d8-a2a3-516f96764ae0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:07.714718 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e889f-de18-45d8-a2a3-516f96764ae0 service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:07.714997 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e889f-de18-45d8-a2a3-516f96764ae0 service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:07.715296 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e889f-de18-45d8-a2a3-516f96764ae0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:07.737545 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639e889f-de18-45d8-a2a3-516f96764ae0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:07.739007 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639e889f-de18-45d8-a2a3-516f96764ae0 service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:07.767172 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3611/7247] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 16:11:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:11:09.877962 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7ef2b0-85fa-4a64-92dd-03f0b5f660ce None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:09.879506 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-bc7ef2b0-85fa-4a64-92dd-03f0b5f660ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:10.168879 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7ef2b0-85fa-4a64-92dd-03f0b5f660ce None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:10.190500 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4bd17-667e-49ac-8034-fd9dc884af0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:10.192793 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4bd17-667e-49ac-8034-fd9dc884af0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:10.194609 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4bd17-667e-49ac-8034-fd9dc884af0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:10.195354 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4bd17-667e-49ac-8034-fd9dc884af0d admin admin] PATH_INFO: `/v3/projects/cee6f544ad144af4b97ac7643ca8862b` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:10.199208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf4bd17-667e-49ac-8034-fd9dc884af0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cee6f544ad144af4b97ac7643ca8862b)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:10.206242 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf4bd17-667e-49ac-8034-fd9dc884af0d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:10.332358 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3cf4bd17-667e-49ac-8034-fd9dc884af0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cee6f544ad144af4b97ac7643ca8862b', 'request_id': 'req-3cf4bd17-667e-49ac-8034-fd9dc884af0d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:10.336467 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:10.368136 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3cf4bd17-667e-49ac-8034-fd9dc884af0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cee6f544ad144af4b97ac7643ca8862b', 'request_id': 'req-3cf4bd17-667e-49ac-8034-fd9dc884af0d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:10.393312 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3cf4bd17-667e-49ac-8034-fd9dc884af0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cee6f544ad144af4b97ac7643ca8862b', 'request_id': 'req-3cf4bd17-667e-49ac-8034-fd9dc884af0d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:10.466439 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3cf4bd17-667e-49ac-8034-fd9dc884af0d admin admin] The token cache is being invalidate because project cee6f544ad144af4b97ac7643ca8862b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:11:10.467016 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3cf4bd17-667e-49ac-8034-fd9dc884af0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:10.468275 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3cf4bd17-667e-49ac-8034-fd9dc884af0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:10.471218 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3637/7248] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:11:09 2022] DELETE /identity/v3/projects/cee6f544ad144af4b97ac7643ca8862b => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:11:10.476085 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e1394-5452-4015-9317-121a3bd87ab1 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:10.476608 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e1394-5452-4015-9317-121a3bd87ab1 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:10.477014 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e1394-5452-4015-9317-121a3bd87ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:10.519697 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-831e1394-5452-4015-9317-121a3bd87ab1 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:11:10.528246 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-831e1394-5452-4015-9317-121a3bd87ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:10.738576 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3612/7249] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:11:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:11:10.749801 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0f719-4fbe-482f-81ed-88af2274b9b0 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:10.752790 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0f719-4fbe-482f-81ed-88af2274b9b0 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:10.753244 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0f719-4fbe-482f-81ed-88af2274b9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:10.794485 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-7fe0f719-4fbe-482f-81ed-88af2274b9b0 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:11:10.795761 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7fe0f719-4fbe-482f-81ed-88af2274b9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:10.824965 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3638/7250] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:11:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:11:10.827211 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e1394-5452-4015-9317-121a3bd87ab1 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:10.866704 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e1394-5452-4015-9317-121a3bd87ab1 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:10.887500 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1afbbd-2329-4f50-b856-b96ec07eb4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:10.892242 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1afbbd-2329-4f50-b856-b96ec07eb4a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:10.897131 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1afbbd-2329-4f50-b856-b96ec07eb4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:10.897586 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1afbbd-2329-4f50-b856-b96ec07eb4a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:10.899404 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1afbbd-2329-4f50-b856-b96ec07eb4a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:11:10.916570 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1afbbd-2329-4f50-b856-b96ec07eb4a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:10.918357 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1afbbd-2329-4f50-b856-b96ec07eb4a9 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:10.962090 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe0f719-4fbe-482f-81ed-88af2274b9b0 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:10.962644 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3613/7251] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:11:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:11:10.983300 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe0f719-4fbe-482f-81ed-88af2274b9b0 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:11.005626 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1863616-b748-4883-be48-c9267bb5bd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:11.006284 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1863616-b748-4883-be48-c9267bb5bd97 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:11.006551 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1863616-b748-4883-be48-c9267bb5bd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:11.006823 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1863616-b748-4883-be48-c9267bb5bd97 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:11.007646 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1863616-b748-4883-be48-c9267bb5bd97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:11.009590 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1863616-b748-4883-be48-c9267bb5bd97 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:11.107610 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1afbbd-2329-4f50-b856-b96ec07eb4a9 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:11.116980 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3639/7252] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:11:10 2022] POST /identity/v3/projects => generated 367 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:11:11.124208 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1afbbd-2329-4f50-b856-b96ec07eb4a9 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:11.270616 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:11.317697 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfb166-eed5-4d76-b0e3-3ed90c1120eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:11.319328 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfb166-eed5-4d76-b0e3-3ed90c1120eb admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:11.319656 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfb166-eed5-4d76-b0e3-3ed90c1120eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:11.319923 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfb166-eed5-4d76-b0e3-3ed90c1120eb admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:11.320806 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cfb166-eed5-4d76-b0e3-3ed90c1120eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:11.324229 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cfb166-eed5-4d76-b0e3-3ed90c1120eb admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:11.415533 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1863616-b748-4883-be48-c9267bb5bd97 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:11.418067 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f1863616-b748-4883-be48-c9267bb5bd97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:11.466979 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1863616-b748-4883-be48-c9267bb5bd97 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:11.476659 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3614/7253] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:11:11 2022] POST /identity/v3/users => generated 284 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:11:11.478803 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfb166-eed5-4d76-b0e3-3ed90c1120eb admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:11.491996 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789bea64-e46d-4296-898b-3833b0ab0828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:11.492676 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bea64-e46d-4296-898b-3833b0ab0828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:11.492955 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bea64-e46d-4296-898b-3833b0ab0828 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:11.493273 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bea64-e46d-4296-898b-3833b0ab0828 admin admin] PATH_INFO: `/v3/users/4ed8abb8fd294c788f828524139b2e49` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:11.498397 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789bea64-e46d-4296-898b-3833b0ab0828 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ed8abb8fd294c788f828524139b2e49)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:11.502821 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789bea64-e46d-4296-898b-3833b0ab0828 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:11.512217 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfb166-eed5-4d76-b0e3-3ed90c1120eb admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:11.530317 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bededf9-8117-4715-b852-b36bb5f02aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:11.530956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bededf9-8117-4715-b852-b36bb5f02aad admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:11.531267 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bededf9-8117-4715-b852-b36bb5f02aad admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:11.531541 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bededf9-8117-4715-b852-b36bb5f02aad admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:11.532203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bededf9-8117-4715-b852-b36bb5f02aad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:11.533869 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bededf9-8117-4715-b852-b36bb5f02aad admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:11.584333 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3615/7254] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:11:11.591724 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bededf9-8117-4715-b852-b36bb5f02aad admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:11.645163 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bededf9-8117-4715-b852-b36bb5f02aad admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:11.671355 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c426f-4f7b-4a5f-b441-d0d2a7e8f1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:11.671355 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c426f-4f7b-4a5f-b441-d0d2a7e8f1e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:11.671713 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c426f-4f7b-4a5f-b441-d0d2a7e8f1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:11.671713 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c426f-4f7b-4a5f-b441-d0d2a7e8f1e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:11.672637 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76c426f-4f7b-4a5f-b441-d0d2a7e8f1e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:11.694967 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76c426f-4f7b-4a5f-b441-d0d2a7e8f1e9 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:11.736551 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-789bea64-e46d-4296-898b-3833b0ab0828 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ed8abb8fd294c788f828524139b2e49'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:11.738410 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-789bea64-e46d-4296-898b-3833b0ab0828 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ed8abb8fd294c788f828524139b2e49'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:11.743107 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3616/7255] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:11:11.753244 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d703c14-bce7-43a9-a734-27bd2d3916c2 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:11.755874 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d703c14-bce7-43a9-a734-27bd2d3916c2 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:11.758407 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d703c14-bce7-43a9-a734-27bd2d3916c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:11.778357 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-789bea64-e46d-4296-898b-3833b0ab0828 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ed8abb8fd294c788f828524139b2e49'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:11.794562 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-789bea64-e46d-4296-898b-3833b0ab0828 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ed8abb8fd294c788f828524139b2e49'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:11.795351 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-789bea64-e46d-4296-898b-3833b0ab0828 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ed8abb8fd294c788f828524139b2e49'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:11.797959 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-9d703c14-bce7-43a9-a734-27bd2d3916c2 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:11:11.800346 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9d703c14-bce7-43a9-a734-27bd2d3916c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:11.846903 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3640/7256] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:11:11 2022] DELETE /identity/v3/users/4ed8abb8fd294c788f828524139b2e49 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:11:11.846903 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789bea64-e46d-4296-898b-3833b0ab0828 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:11.847326 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-789bea64-e46d-4296-898b-3833b0ab0828 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:12.006914 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3617/7257] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 16:11:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:11:12.009612 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc8ea6-760b-4615-878c-1f9f96ac5417 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:12.010606 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc8ea6-760b-4615-878c-1f9f96ac5417 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:12.012496 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc8ea6-760b-4615-878c-1f9f96ac5417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:12.104840 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-1afc8ea6-760b-4615-878c-1f9f96ac5417 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:11:12.106085 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1afc8ea6-760b-4615-878c-1f9f96ac5417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:12.112086 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789bea64-e46d-4296-898b-3833b0ab0828 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:12.132940 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0f442-0ac1-4049-9208-dd780154654c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:12.133649 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0f442-0ac1-4049-9208-dd780154654c admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:12.133931 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0f442-0ac1-4049-9208-dd780154654c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:12.134208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0f442-0ac1-4049-9208-dd780154654c admin admin] PATH_INFO: `/v3/projects/850145162a26475cb493cd5480d55d86/users/625f7be4a74d459bb2f0081b263c071a/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:12.142443 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3618/7258] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:11:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:11:12.142761 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc8ea6-760b-4615-878c-1f9f96ac5417 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:12.144100 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1afc8ea6-760b-4615-878c-1f9f96ac5417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:12.179779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae0f442-0ac1-4049-9208-dd780154654c admin admin] RBAC: Authorizing `identity:create_grant(project_id=850145162a26475cb493cd5480d55d86, user_id=625f7be4a74d459bb2f0081b263c071a, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:12.184289 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae0f442-0ac1-4049-9208-dd780154654c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:12.211826 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3641/7259] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:11:11 2022] PUT /identity/v3/projects/850145162a26475cb493cd5480d55d86/users/625f7be4a74d459bb2f0081b263c071a/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:11:12.213518 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0f442-0ac1-4049-9208-dd780154654c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:12.224657 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-eae0f442-0ac1-4049-9208-dd780154654c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:12.236324 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=13,keystone:SELECT=83,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:12.384096 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc8ea6-760b-4615-878c-1f9f96ac5417 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:12.394577 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0f442-0ac1-4049-9208-dd780154654c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:12.409859 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00cfc2d-e985-4eb0-9e50-130d197c90e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:12.410830 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00cfc2d-e985-4eb0-9e50-130d197c90e0 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:12.411298 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00cfc2d-e985-4eb0-9e50-130d197c90e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:12.411735 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00cfc2d-e985-4eb0-9e50-130d197c90e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:12.505670 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:12.544722 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b1ca0-ee11-4182-8851-0a5f5271e8b0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:12.546047 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b1ca0-ee11-4182-8851-0a5f5271e8b0 service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:12.547213 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b1ca0-ee11-4182-8851-0a5f5271e8b0 service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:12.548078 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b1ca0-ee11-4182-8851-0a5f5271e8b0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:12.574236 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00cfc2d-e985-4eb0-9e50-130d197c90e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:12.585388 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00cfc2d-e985-4eb0-9e50-130d197c90e0 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:12.634375 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3642/7260] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:11:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:11:12.641043 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e02248-ebc9-480e-9e20-c22b7934f62c None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:12.641698 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e02248-ebc9-480e-9e20-c22b7934f62c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:12.642164 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e02248-ebc9-480e-9e20-c22b7934f62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:12.718942 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-73e02248-ebc9-480e-9e20-c22b7934f62c None None] MFA Rules not processed for user `625f7be4a74d459bb2f0081b263c071a`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:11:12.721176 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-73e02248-ebc9-480e-9e20-c22b7934f62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:12.738364 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72b1ca0-ee11-4182-8851-0a5f5271e8b0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:12.747087 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72b1ca0-ee11-4182-8851-0a5f5271e8b0 service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:12.766027 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3619/7261] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 16:11:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:11:12.914341 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b1ca0-ee11-4182-8851-0a5f5271e8b0 service swift] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:12.923163 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3643/7262] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:11:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:11:12.954060 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b1ca0-ee11-4182-8851-0a5f5271e8b0 service swift] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:12.988199 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027492c1-d68b-48da-b6c7-d5acb17da6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:12.998763 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027492c1-d68b-48da-b6c7-d5acb17da6eb admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:12.998763 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027492c1-d68b-48da-b6c7-d5acb17da6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:12.998763 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027492c1-d68b-48da-b6c7-d5acb17da6eb admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:13.012211 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027492c1-d68b-48da-b6c7-d5acb17da6eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:13.017629 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027492c1-d68b-48da-b6c7-d5acb17da6eb admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:13.153298 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3620/7263] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:11:12 2022] POST /identity/v3/projects => generated 367 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:11:13.157235 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e02248-ebc9-480e-9e20-c22b7934f62c None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:13.176409 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e02248-ebc9-480e-9e20-c22b7934f62c None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:13.237209 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:13.280550 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d01ab5-448b-436a-8568-9fc7113c3a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:13.281327 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d01ab5-448b-436a-8568-9fc7113c3a8d admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:13.281796 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d01ab5-448b-436a-8568-9fc7113c3a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:13.282193 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d01ab5-448b-436a-8568-9fc7113c3a8d admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:13.283050 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d01ab5-448b-436a-8568-9fc7113c3a8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:13.287438 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d01ab5-448b-436a-8568-9fc7113c3a8d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:13.340656 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3644/7264] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:11:13 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:11:13.344423 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027492c1-d68b-48da-b6c7-d5acb17da6eb admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:13.364026 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027492c1-d68b-48da-b6c7-d5acb17da6eb admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:13.382435 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81c8da-7b01-4401-b815-10af5fc3197b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:13.383204 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81c8da-7b01-4401-b815-10af5fc3197b admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:13.383614 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81c8da-7b01-4401-b815-10af5fc3197b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:13.383996 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81c8da-7b01-4401-b815-10af5fc3197b admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:13.385420 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b81c8da-7b01-4401-b815-10af5fc3197b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:13.387723 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b81c8da-7b01-4401-b815-10af5fc3197b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:13.411910 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3621/7265] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:11:13.415354 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d01ab5-448b-436a-8568-9fc7113c3a8d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:13.436619 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d01ab5-448b-436a-8568-9fc7113c3a8d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:13.475987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f87eb-d142-4a2b-b2d9-a49af2930f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:13.476972 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f87eb-d142-4a2b-b2d9-a49af2930f44 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:13.477411 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f87eb-d142-4a2b-b2d9-a49af2930f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:13.477887 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f87eb-d142-4a2b-b2d9-a49af2930f44 admin admin] PATH_INFO: `/v3/projects/b7a30b5fa6094086b8f82992a1bafae2/users/baeddcbaf3fe487fa24c08e41772bd2b/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:13.514678 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338f87eb-d142-4a2b-b2d9-a49af2930f44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7a30b5fa6094086b8f82992a1bafae2, user_id=baeddcbaf3fe487fa24c08e41772bd2b, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:13.518061 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338f87eb-d142-4a2b-b2d9-a49af2930f44 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:13.553723 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3645/7266] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:11:13 2022] PUT /identity/v3/projects/b7a30b5fa6094086b8f82992a1bafae2/users/baeddcbaf3fe487fa24c08e41772bd2b/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:11:13.558315 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81c8da-7b01-4401-b815-10af5fc3197b admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:13.575816 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81c8da-7b01-4401-b815-10af5fc3197b admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:13.763164 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c565a9-3df7-4b4f-9075-038857a2b595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:13.763722 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c565a9-3df7-4b4f-9075-038857a2b595 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:13.764004 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c565a9-3df7-4b4f-9075-038857a2b595 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:13.764278 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c565a9-3df7-4b4f-9075-038857a2b595 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:13.764941 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c565a9-3df7-4b4f-9075-038857a2b595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:13.766575 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c565a9-3df7-4b4f-9075-038857a2b595 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:13.803846 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3622/7267] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:11:13.805184 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f87eb-d142-4a2b-b2d9-a49af2930f44 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:13.827834 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f87eb-d142-4a2b-b2d9-a49af2930f44 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:13.862970 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bceb0d1-c6a3-428b-9745-d5b4efcdf5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:13.864011 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bceb0d1-c6a3-428b-9745-d5b4efcdf5b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:13.864486 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bceb0d1-c6a3-428b-9745-d5b4efcdf5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:13.864869 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bceb0d1-c6a3-428b-9745-d5b4efcdf5b4 admin admin] PATH_INFO: `/v3/projects/b7a30b5fa6094086b8f82992a1bafae2/users/baeddcbaf3fe487fa24c08e41772bd2b/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:13.880600 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bceb0d1-c6a3-428b-9745-d5b4efcdf5b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7a30b5fa6094086b8f82992a1bafae2, user_id=baeddcbaf3fe487fa24c08e41772bd2b, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:13.884172 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bceb0d1-c6a3-428b-9745-d5b4efcdf5b4 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:13.926167 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3646/7268] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:11:13 2022] PUT /identity/v3/projects/b7a30b5fa6094086b8f82992a1bafae2/users/baeddcbaf3fe487fa24c08e41772bd2b/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:11:13.936918 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd384f4a-1e6f-4e10-bee0-4d809fd371da None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:13.937213 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd384f4a-1e6f-4e10-bee0-4d809fd371da None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:13.937491 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd384f4a-1e6f-4e10-bee0-4d809fd371da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:14.096419 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-bd384f4a-1e6f-4e10-bee0-4d809fd371da None None] MFA Rules not processed for user `baeddcbaf3fe487fa24c08e41772bd2b`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:11:14.106834 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-bd384f4a-1e6f-4e10-bee0-4d809fd371da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:14.317733 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:14.391364 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3623/7269] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:11:13 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:11:14.404036 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bceb0d1-c6a3-428b-9745-d5b4efcdf5b4 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:14.406514 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0bceb0d1-c6a3-428b-9745-d5b4efcdf5b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:14.572473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd384f4a-1e6f-4e10-bee0-4d809fd371da None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:14.572473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-bd384f4a-1e6f-4e10-bee0-4d809fd371da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:14.623726 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bceb0d1-c6a3-428b-9745-d5b4efcdf5b4 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:14.651151 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5f43b-1bfb-4750-8b5f-6be75bffc2ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:14.651941 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5f43b-1bfb-4750-8b5f-6be75bffc2ad service cinder] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:14.652277 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5f43b-1bfb-4750-8b5f-6be75bffc2ad service cinder] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:14.652552 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5f43b-1bfb-4750-8b5f-6be75bffc2ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:14.685214 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d5f43b-1bfb-4750-8b5f-6be75bffc2ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:14.686676 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d5f43b-1bfb-4750-8b5f-6be75bffc2ad service cinder] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:14.717644 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3647/7270] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:11:14 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:11:14.777549 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd384f4a-1e6f-4e10-bee0-4d809fd371da None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:14.790501 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b399f-dc2e-49a8-a754-9c1f27d7f1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:14.791705 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b399f-dc2e-49a8-a754-9c1f27d7f1cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:14.792142 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b399f-dc2e-49a8-a754-9c1f27d7f1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:14.792632 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b399f-dc2e-49a8-a754-9c1f27d7f1cc admin admin] PATH_INFO: `/v3/projects/b5d27b7826ec4b03bf3be5ac255a69fd` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:14.795820 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853b399f-dc2e-49a8-a754-9c1f27d7f1cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5d27b7826ec4b03bf3be5ac255a69fd)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:14.799427 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853b399f-dc2e-49a8-a754-9c1f27d7f1cc admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:14.936220 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-853b399f-dc2e-49a8-a754-9c1f27d7f1cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5d27b7826ec4b03bf3be5ac255a69fd', 'request_id': 'req-853b399f-dc2e-49a8-a754-9c1f27d7f1cc'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:14.941801 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5f43b-1bfb-4750-8b5f-6be75bffc2ad service cinder] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:14.961054 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5f43b-1bfb-4750-8b5f-6be75bffc2ad service cinder] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:14.964300 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-853b399f-dc2e-49a8-a754-9c1f27d7f1cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5d27b7826ec4b03bf3be5ac255a69fd', 'request_id': 'req-853b399f-dc2e-49a8-a754-9c1f27d7f1cc'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:14.985200 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-853b399f-dc2e-49a8-a754-9c1f27d7f1cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5d27b7826ec4b03bf3be5ac255a69fd', 'request_id': 'req-853b399f-dc2e-49a8-a754-9c1f27d7f1cc'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:15.006185 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-853b399f-dc2e-49a8-a754-9c1f27d7f1cc admin admin] The token cache is being invalidate because project b5d27b7826ec4b03bf3be5ac255a69fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:11:15.006459 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-853b399f-dc2e-49a8-a754-9c1f27d7f1cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:15.007166 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-853b399f-dc2e-49a8-a754-9c1f27d7f1cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:15.013365 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3624/7271] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:11:14 2022] DELETE /identity/v3/projects/b5d27b7826ec4b03bf3be5ac255a69fd => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:11:15.016273 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c95b8-79de-4d07-b853-812ddea810ac None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:15.016446 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c95b8-79de-4d07-b853-812ddea810ac None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:15.016860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c95b8-79de-4d07-b853-812ddea810ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:15.063867 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-1c2c95b8-79de-4d07-b853-812ddea810ac None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:11:15.065292 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1c2c95b8-79de-4d07-b853-812ddea810ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:15.090340 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3ec52-9f5b-48c8-9841-a485533b5b0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:15.093705 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3ec52-9f5b-48c8-9841-a485533b5b0c service cinder] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:15.094104 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3ec52-9f5b-48c8-9841-a485533b5b0c service cinder] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:15.094454 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3ec52-9f5b-48c8-9841-a485533b5b0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:15.101392 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7ab3ec52-9f5b-48c8-9841-a485533b5b0c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:15.277787 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3625/7272] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:11:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:11:15.279420 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598291a-b41a-4522-aaa6-3b90de14bb23 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:15.279705 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598291a-b41a-4522-aaa6-3b90de14bb23 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:15.279982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598291a-b41a-4522-aaa6-3b90de14bb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:15.333003 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:15.345245 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab3ec52-9f5b-48c8-9841-a485533b5b0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:15.347300 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab3ec52-9f5b-48c8-9841-a485533b5b0c service cinder] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:15.348185 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-b598291a-b41a-4522-aaa6-3b90de14bb23 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:11:15.349760 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b598291a-b41a-4522-aaa6-3b90de14bb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:15.380099 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3648/7273] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:11:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:11:15.383835 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3626/7274] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:11:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:11:15.394745 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3ec52-9f5b-48c8-9841-a485533b5b0c service cinder] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:15.422620 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3ec52-9f5b-48c8-9841-a485533b5b0c service cinder] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:15.443630 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf570b0-3d24-4e2a-ae0e-1c6ee6ce0c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:15.444349 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf570b0-3d24-4e2a-ae0e-1c6ee6ce0c20 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:15.444636 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf570b0-3d24-4e2a-ae0e-1c6ee6ce0c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:15.444943 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf570b0-3d24-4e2a-ae0e-1c6ee6ce0c20 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:15.445561 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf570b0-3d24-4e2a-ae0e-1c6ee6ce0c20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:11:15.445924 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf570b0-3d24-4e2a-ae0e-1c6ee6ce0c20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:15.447628 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf570b0-3d24-4e2a-ae0e-1c6ee6ce0c20 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:15.496330 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3649/7275] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:11:15.503073 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598291a-b41a-4522-aaa6-3b90de14bb23 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:15.526415 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598291a-b41a-4522-aaa6-3b90de14bb23 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:15.546461 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60454939-b310-4194-892d-41c3dbcdef6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:15.547297 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60454939-b310-4194-892d-41c3dbcdef6e admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:15.547578 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60454939-b310-4194-892d-41c3dbcdef6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:15.547851 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60454939-b310-4194-892d-41c3dbcdef6e admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:15.548501 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60454939-b310-4194-892d-41c3dbcdef6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:15.550466 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60454939-b310-4194-892d-41c3dbcdef6e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:15.560223 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:15.653008 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3627/7276] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:11:15 2022] POST /identity/v3/projects => generated 375 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:11:15.655396 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf570b0-3d24-4e2a-ae0e-1c6ee6ce0c20 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:15.668193 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf570b0-3d24-4e2a-ae0e-1c6ee6ce0c20 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:16.007966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4be743-df77-4dc4-ac05-7811f2ff2a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:16.008620 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4be743-df77-4dc4-ac05-7811f2ff2a4c admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:16.008904 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4be743-df77-4dc4-ac05-7811f2ff2a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:16.009184 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4be743-df77-4dc4-ac05-7811f2ff2a4c admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:16.009995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4be743-df77-4dc4-ac05-7811f2ff2a4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:16.012531 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4be743-df77-4dc4-ac05-7811f2ff2a4c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:16.113706 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3650/7277] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:11:15 2022] POST /identity/v3/users => generated 288 bytes in 459 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:11:16.119038 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60454939-b310-4194-892d-41c3dbcdef6e admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:16.170242 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60454939-b310-4194-892d-41c3dbcdef6e admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:16.220353 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c08ed6-507b-4066-ba66-8f064a7a0d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:16.221170 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c08ed6-507b-4066-ba66-8f064a7a0d74 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:16.221731 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c08ed6-507b-4066-ba66-8f064a7a0d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:16.223586 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c08ed6-507b-4066-ba66-8f064a7a0d74 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:16.224378 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c08ed6-507b-4066-ba66-8f064a7a0d74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:16.231244 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c08ed6-507b-4066-ba66-8f064a7a0d74 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:16.271444 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3628/7278] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:11:16.285754 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4be743-df77-4dc4-ac05-7811f2ff2a4c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:16.348887 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4be743-df77-4dc4-ac05-7811f2ff2a4c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:16.372273 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf00ba5-fd4c-4210-be9f-0bd2fa9bd0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:16.373909 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf00ba5-fd4c-4210-be9f-0bd2fa9bd0b7 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:16.374485 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf00ba5-fd4c-4210-be9f-0bd2fa9bd0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:16.375093 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf00ba5-fd4c-4210-be9f-0bd2fa9bd0b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:16.376414 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf00ba5-fd4c-4210-be9f-0bd2fa9bd0b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:16.381854 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf00ba5-fd4c-4210-be9f-0bd2fa9bd0b7 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:16.419965 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c08ed6-507b-4066-ba66-8f064a7a0d74 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:16.426317 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3651/7279] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:11:16.436534 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c08ed6-507b-4066-ba66-8f064a7a0d74 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:16.455714 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3894f9-0aa3-4cb0-963c-1a4b28fc4cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:16.456413 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3894f9-0aa3-4cb0-963c-1a4b28fc4cd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:16.456690 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3894f9-0aa3-4cb0-963c-1a4b28fc4cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:16.456965 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3894f9-0aa3-4cb0-963c-1a4b28fc4cd1 admin admin] PATH_INFO: `/v3/projects/3238f7c32d3e401294b295b339173bff/users/cf022cacca3e4ef69052acaa9adfdac8/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:16.515678 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3894f9-0aa3-4cb0-963c-1a4b28fc4cd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3238f7c32d3e401294b295b339173bff, user_id=cf022cacca3e4ef69052acaa9adfdac8, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:16.519130 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3894f9-0aa3-4cb0-963c-1a4b28fc4cd1 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:16.566646 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3629/7280] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:11:16 2022] PUT /identity/v3/projects/3238f7c32d3e401294b295b339173bff/users/cf022cacca3e4ef69052acaa9adfdac8/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:11:16.578587 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956e943-c7c7-4d93-9ada-c6f9dd48d27f None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:16.578868 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956e943-c7c7-4d93-9ada-c6f9dd48d27f None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:16.579181 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956e943-c7c7-4d93-9ada-c6f9dd48d27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:16.662856 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-3956e943-c7c7-4d93-9ada-c6f9dd48d27f None None] MFA Rules not processed for user `cf022cacca3e4ef69052acaa9adfdac8`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:11:16.664206 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3956e943-c7c7-4d93-9ada-c6f9dd48d27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:16.820209 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3652/7281] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:11:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:11:16.832796 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3894f9-0aa3-4cb0-963c-1a4b28fc4cd1 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:16.835115 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-fd3894f9-0aa3-4cb0-963c-1a4b28fc4cd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:16.925767 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3894f9-0aa3-4cb0-963c-1a4b28fc4cd1 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:16.939421 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc501b-a92c-497b-8206-7a89485e799b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:16.940087 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc501b-a92c-497b-8206-7a89485e799b service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:16.940373 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc501b-a92c-497b-8206-7a89485e799b service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:16.940637 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc501b-a92c-497b-8206-7a89485e799b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:16.958495 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc501b-a92c-497b-8206-7a89485e799b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:16.959968 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc501b-a92c-497b-8206-7a89485e799b service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:16.984102 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3630/7282] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:11:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:11:18.391586 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956e943-c7c7-4d93-9ada-c6f9dd48d27f None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:18.523375 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:18.561522 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956e943-c7c7-4d93-9ada-c6f9dd48d27f None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:18.575237 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeded07-5209-45ff-a236-282f90e7a029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:18.576205 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeded07-5209-45ff-a236-282f90e7a029 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:18.576658 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeded07-5209-45ff-a236-282f90e7a029 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:18.577153 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeded07-5209-45ff-a236-282f90e7a029 admin admin] PATH_INFO: `/v3/users/cf022cacca3e4ef69052acaa9adfdac8` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:18.581566 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeded07-5209-45ff-a236-282f90e7a029 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf022cacca3e4ef69052acaa9adfdac8)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:18.607444 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeded07-5209-45ff-a236-282f90e7a029 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:18.739780 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0aeded07-5209-45ff-a236-282f90e7a029 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf022cacca3e4ef69052acaa9adfdac8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:18.741084 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0aeded07-5209-45ff-a236-282f90e7a029 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf022cacca3e4ef69052acaa9adfdac8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:18.763893 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0aeded07-5209-45ff-a236-282f90e7a029 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf022cacca3e4ef69052acaa9adfdac8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:18.799845 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0aeded07-5209-45ff-a236-282f90e7a029 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf022cacca3e4ef69052acaa9adfdac8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:18.800906 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0aeded07-5209-45ff-a236-282f90e7a029 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf022cacca3e4ef69052acaa9adfdac8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:18.899452 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3653/7283] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:11:18 2022] DELETE /identity/v3/users/cf022cacca3e4ef69052acaa9adfdac8 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:11:18.905628 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35724203-4cf9-43a6-92ca-49bed8e6bbbb None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:18.906142 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35724203-4cf9-43a6-92ca-49bed8e6bbbb None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:18.906142 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35724203-4cf9-43a6-92ca-49bed8e6bbbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:18.960262 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-35724203-4cf9-43a6-92ca-49bed8e6bbbb None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:11:18.963831 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-35724203-4cf9-43a6-92ca-49bed8e6bbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:19.154376 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3631/7284] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:11:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:11:19.214680 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeded07-5209-45ff-a236-282f90e7a029 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:19.216224 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0aeded07-5209-45ff-a236-282f90e7a029 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:19.503302 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeded07-5209-45ff-a236-282f90e7a029 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:19.613152 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0217b-83e9-4834-996c-89a699422daf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:19.613152 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0217b-83e9-4834-996c-89a699422daf service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:19.613152 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0217b-83e9-4834-996c-89a699422daf service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:19.613152 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0217b-83e9-4834-996c-89a699422daf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:19.724588 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0217b-83e9-4834-996c-89a699422daf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:19.724588 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0217b-83e9-4834-996c-89a699422daf service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:19.734099 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3654/7285] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:11:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:11:21.054910 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35724203-4cf9-43a6-92ca-49bed8e6bbbb None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:21.056395 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-35724203-4cf9-43a6-92ca-49bed8e6bbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:21.101046 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35724203-4cf9-43a6-92ca-49bed8e6bbbb None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:21.116991 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce11171-3e5d-41ed-a3d9-c38e6c8c8ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:21.117656 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce11171-3e5d-41ed-a3d9-c38e6c8c8ee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:21.118689 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce11171-3e5d-41ed-a3d9-c38e6c8c8ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:21.119083 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce11171-3e5d-41ed-a3d9-c38e6c8c8ee3 admin admin] PATH_INFO: `/v3/users/d6f8a74078404f08bbcacbeb5b915f36` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:21.120783 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce11171-3e5d-41ed-a3d9-c38e6c8c8ee3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6f8a74078404f08bbcacbeb5b915f36)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:21.122749 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce11171-3e5d-41ed-a3d9-c38e6c8c8ee3 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:21.219954 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0217b-83e9-4834-996c-89a699422daf service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:21.221689 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-13c0217b-83e9-4834-996c-89a699422daf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:21.271048 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0217b-83e9-4834-996c-89a699422daf service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:21.290182 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574b48e-3c6f-47cd-8e23-8bcc87bb3b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:21.302632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574b48e-3c6f-47cd-8e23-8bcc87bb3b5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:21.303537 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574b48e-3c6f-47cd-8e23-8bcc87bb3b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:21.306799 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574b48e-3c6f-47cd-8e23-8bcc87bb3b5f admin admin] PATH_INFO: `/v3/projects/3238f7c32d3e401294b295b339173bff` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:21.315227 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4574b48e-3c6f-47cd-8e23-8bcc87bb3b5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3238f7c32d3e401294b295b339173bff)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:21.317984 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4574b48e-3c6f-47cd-8e23-8bcc87bb3b5f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:21.349983 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2ce11171-3e5d-41ed-a3d9-c38e6c8c8ee3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6f8a74078404f08bbcacbeb5b915f36'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:21.352058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2ce11171-3e5d-41ed-a3d9-c38e6c8c8ee3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6f8a74078404f08bbcacbeb5b915f36'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:21.354938 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:21.469715 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2ce11171-3e5d-41ed-a3d9-c38e6c8c8ee3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6f8a74078404f08bbcacbeb5b915f36'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:21.499336 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2ce11171-3e5d-41ed-a3d9-c38e6c8c8ee3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6f8a74078404f08bbcacbeb5b915f36'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:21.527784 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2ce11171-3e5d-41ed-a3d9-c38e6c8c8ee3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6f8a74078404f08bbcacbeb5b915f36'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:21.564549 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3632/7286] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:11:21 2022] DELETE /identity/v3/users/d6f8a74078404f08bbcacbeb5b915f36 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:11:21.618533 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4574b48e-3c6f-47cd-8e23-8bcc87bb3b5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3238f7c32d3e401294b295b339173bff', 'request_id': 'req-4574b48e-3c6f-47cd-8e23-8bcc87bb3b5f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:21.662041 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4574b48e-3c6f-47cd-8e23-8bcc87bb3b5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3238f7c32d3e401294b295b339173bff', 'request_id': 'req-4574b48e-3c6f-47cd-8e23-8bcc87bb3b5f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:21.690759 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4574b48e-3c6f-47cd-8e23-8bcc87bb3b5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3238f7c32d3e401294b295b339173bff', 'request_id': 'req-4574b48e-3c6f-47cd-8e23-8bcc87bb3b5f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:21.708404 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:21.731201 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4574b48e-3c6f-47cd-8e23-8bcc87bb3b5f admin admin] The token cache is being invalidate because project 3238f7c32d3e401294b295b339173bff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:11:21.735380 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4574b48e-3c6f-47cd-8e23-8bcc87bb3b5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:21.736530 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4574b48e-3c6f-47cd-8e23-8bcc87bb3b5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:21.745325 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3655/7287] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:11:21 2022] DELETE /identity/v3/projects/3238f7c32d3e401294b295b339173bff => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:11:21.755165 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46507215-3a71-4a07-b326-7e022ad02871 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:21.755547 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46507215-3a71-4a07-b326-7e022ad02871 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:21.755797 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46507215-3a71-4a07-b326-7e022ad02871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:21.795493 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574b48e-3c6f-47cd-8e23-8bcc87bb3b5f admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:21.797633 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4574b48e-3c6f-47cd-8e23-8bcc87bb3b5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:21.817222 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-46507215-3a71-4a07-b326-7e022ad02871 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:11:21.823289 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-46507215-3a71-4a07-b326-7e022ad02871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:22.046123 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574b48e-3c6f-47cd-8e23-8bcc87bb3b5f admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:22.136515 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d11ff2-127b-4f0f-9134-52faec1f54cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:22.137719 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d11ff2-127b-4f0f-9134-52faec1f54cb service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:22.138130 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d11ff2-127b-4f0f-9134-52faec1f54cb service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:22.138711 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d11ff2-127b-4f0f-9134-52faec1f54cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:22.140872 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-00d11ff2-127b-4f0f-9134-52faec1f54cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:22.158559 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d11ff2-127b-4f0f-9134-52faec1f54cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:22.160653 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d11ff2-127b-4f0f-9134-52faec1f54cb service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:22.183583 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3656/7288] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:11:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:11:22.221953 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3633/7289] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:11:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:11:22.224052 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b39ae0-4c1f-490d-8910-5cfd6e24dcf7 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:22.224893 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b39ae0-4c1f-490d-8910-5cfd6e24dcf7 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:22.225535 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b39ae0-4c1f-490d-8910-5cfd6e24dcf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:22.268198 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-19b39ae0-4c1f-490d-8910-5cfd6e24dcf7 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:11:22.269893 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-19b39ae0-4c1f-490d-8910-5cfd6e24dcf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:22.280782 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3657/7290] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:11:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:11:22.287517 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46507215-3a71-4a07-b326-7e022ad02871 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:22.331225 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b39ae0-4c1f-490d-8910-5cfd6e24dcf7 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:22.335293 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-19b39ae0-4c1f-490d-8910-5cfd6e24dcf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:22.340098 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46507215-3a71-4a07-b326-7e022ad02871 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:22.372064 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4d747-0173-4eac-8168-85d15615af24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:22.372698 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4d747-0173-4eac-8168-85d15615af24 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:22.372983 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4d747-0173-4eac-8168-85d15615af24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:22.373247 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4d747-0173-4eac-8168-85d15615af24 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:22.373906 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af4d747-0173-4eac-8168-85d15615af24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:11:22.376614 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af4d747-0173-4eac-8168-85d15615af24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:22.405172 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af4d747-0173-4eac-8168-85d15615af24 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:22.417872 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b39ae0-4c1f-490d-8910-5cfd6e24dcf7 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:22.443819 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b0b5f-a7b0-4924-991d-0464b59125d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:22.444614 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b0b5f-a7b0-4924-991d-0464b59125d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:22.444898 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b0b5f-a7b0-4924-991d-0464b59125d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:22.445174 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b0b5f-a7b0-4924-991d-0464b59125d4 admin admin] PATH_INFO: `/v3/projects/86b55124150c4d06b81f03f7732310db` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:22.490028 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0b0b5f-a7b0-4924-991d-0464b59125d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86b55124150c4d06b81f03f7732310db)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:22.492029 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0b0b5f-a7b0-4924-991d-0464b59125d4 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:22.511530 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3634/7291] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:11:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:11:22.512530 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4d747-0173-4eac-8168-85d15615af24 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:22.555926 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4d747-0173-4eac-8168-85d15615af24 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:22.578105 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168cf1ab-bdc6-4a37-9c3f-43b67aea139c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:22.579290 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168cf1ab-bdc6-4a37-9c3f-43b67aea139c admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:22.579290 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168cf1ab-bdc6-4a37-9c3f-43b67aea139c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:22.580219 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168cf1ab-bdc6-4a37-9c3f-43b67aea139c admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:22.586804 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168cf1ab-bdc6-4a37-9c3f-43b67aea139c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:22.608648 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168cf1ab-bdc6-4a37-9c3f-43b67aea139c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:22.718158 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3635/7292] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:11:22 2022] POST /identity/v3/projects => generated 387 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:11:22.727916 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168cf1ab-bdc6-4a37-9c3f-43b67aea139c admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:22.800777 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6a0b0b5f-a7b0-4924-991d-0464b59125d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86b55124150c4d06b81f03f7732310db', 'request_id': 'req-6a0b0b5f-a7b0-4924-991d-0464b59125d4'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:22.824823 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6a0b0b5f-a7b0-4924-991d-0464b59125d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86b55124150c4d06b81f03f7732310db', 'request_id': 'req-6a0b0b5f-a7b0-4924-991d-0464b59125d4'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:22.859197 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6a0b0b5f-a7b0-4924-991d-0464b59125d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86b55124150c4d06b81f03f7732310db', 'request_id': 'req-6a0b0b5f-a7b0-4924-991d-0464b59125d4'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:22.917001 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6a0b0b5f-a7b0-4924-991d-0464b59125d4 admin admin] The token cache is being invalidate because project 86b55124150c4d06b81f03f7732310db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:11:22.917365 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6a0b0b5f-a7b0-4924-991d-0464b59125d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:22.917967 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6a0b0b5f-a7b0-4924-991d-0464b59125d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:22.920363 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3658/7293] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:11:22 2022] DELETE /identity/v3/projects/86b55124150c4d06b81f03f7732310db => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:11:22.924156 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b0b5f-a7b0-4924-991d-0464b59125d4 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:22.925445 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6a0b0b5f-a7b0-4924-991d-0464b59125d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:22.950830 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:23.049960 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168cf1ab-bdc6-4a37-9c3f-43b67aea139c admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:23.101407 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb428164-b553-461d-bf40-155f05cd3c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:23.108507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb428164-b553-461d-bf40-155f05cd3c0b admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:23.111448 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb428164-b553-461d-bf40-155f05cd3c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:23.111752 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb428164-b553-461d-bf40-155f05cd3c0b admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:23.112427 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb428164-b553-461d-bf40-155f05cd3c0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:23.114409 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb428164-b553-461d-bf40-155f05cd3c0b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:23.179084 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b0b5f-a7b0-4924-991d-0464b59125d4 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:23.200524 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3636/7294] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:11:22 2022] POST /identity/v3/users => generated 294 bytes in 477 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:11:23.204088 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb428164-b553-461d-bf40-155f05cd3c0b admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:23.205182 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb404c9d-7c8a-460a-96a3-524ef6ee8d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:23.207649 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-bb428164-b553-461d-bf40-155f05cd3c0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:23.208827 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb404c9d-7c8a-460a-96a3-524ef6ee8d99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:23.209129 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb404c9d-7c8a-460a-96a3-524ef6ee8d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:23.209499 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb404c9d-7c8a-460a-96a3-524ef6ee8d99 admin admin] PATH_INFO: `/v3/users/6726e156cfb9479bbcca0d6a88f39566` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:23.213784 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb404c9d-7c8a-460a-96a3-524ef6ee8d99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6726e156cfb9479bbcca0d6a88f39566)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:23.225914 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb404c9d-7c8a-460a-96a3-524ef6ee8d99 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:23.244520 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb428164-b553-461d-bf40-155f05cd3c0b admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:23.262400 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c81ad-57d0-47e6-8ed3-552b7fa26ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:23.263378 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c81ad-57d0-47e6-8ed3-552b7fa26ead admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:23.267116 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c81ad-57d0-47e6-8ed3-552b7fa26ead admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:23.267772 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c81ad-57d0-47e6-8ed3-552b7fa26ead admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:23.271096 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c81ad-57d0-47e6-8ed3-552b7fa26ead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:23.273645 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c81ad-57d0-47e6-8ed3-552b7fa26ead admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:23.314288 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3637/7295] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:11:23.315819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c81ad-57d0-47e6-8ed3-552b7fa26ead admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:23.343499 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c81ad-57d0-47e6-8ed3-552b7fa26ead admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:23.348938 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-eb404c9d-7c8a-460a-96a3-524ef6ee8d99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6726e156cfb9479bbcca0d6a88f39566'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:23.351312 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-eb404c9d-7c8a-460a-96a3-524ef6ee8d99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6726e156cfb9479bbcca0d6a88f39566'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:23.361033 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290c708-303d-4824-9dc9-45cab191f036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:23.361651 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290c708-303d-4824-9dc9-45cab191f036 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:23.361928 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290c708-303d-4824-9dc9-45cab191f036 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:23.362223 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290c708-303d-4824-9dc9-45cab191f036 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:23.362869 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d290c708-303d-4824-9dc9-45cab191f036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:23.365862 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d290c708-303d-4824-9dc9-45cab191f036 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:23.370979 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:23.379329 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-eb404c9d-7c8a-460a-96a3-524ef6ee8d99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6726e156cfb9479bbcca0d6a88f39566'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:23.399949 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-eb404c9d-7c8a-460a-96a3-524ef6ee8d99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6726e156cfb9479bbcca0d6a88f39566'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:23.402092 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-eb404c9d-7c8a-460a-96a3-524ef6ee8d99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6726e156cfb9479bbcca0d6a88f39566'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:23.402866 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3638/7296] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:11:23.410221 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290c708-303d-4824-9dc9-45cab191f036 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:23.428755 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d290c708-303d-4824-9dc9-45cab191f036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:23.480588 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290c708-303d-4824-9dc9-45cab191f036 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:23.490616 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a992c-36a8-4baf-9891-db9ecaa49e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:23.491406 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a992c-36a8-4baf-9891-db9ecaa49e31 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:23.491684 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a992c-36a8-4baf-9891-db9ecaa49e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:23.491960 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a992c-36a8-4baf-9891-db9ecaa49e31 admin admin] PATH_INFO: `/v3/projects/661af862f909430f882b1fe07586a3cd/users/76f01a4a9a454bb595db3b6411230103/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:23.535295 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a992c-36a8-4baf-9891-db9ecaa49e31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=661af862f909430f882b1fe07586a3cd, user_id=76f01a4a9a454bb595db3b6411230103, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:23.538339 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a992c-36a8-4baf-9891-db9ecaa49e31 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:23.540302 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3659/7297] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:11:22 2022] DELETE /identity/v3/users/6726e156cfb9479bbcca0d6a88f39566 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:11:23.568689 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3639/7298] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:11:23 2022] PUT /identity/v3/projects/661af862f909430f882b1fe07586a3cd/users/76f01a4a9a454bb595db3b6411230103/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:11:23.584823 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9199dae-ed09-4848-be03-852d593a977f None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:23.585659 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9199dae-ed09-4848-be03-852d593a977f None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:23.586178 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9199dae-ed09-4848-be03-852d593a977f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:23.713555 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-d9199dae-ed09-4848-be03-852d593a977f None None] MFA Rules not processed for user `76f01a4a9a454bb595db3b6411230103`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:11:23.715554 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d9199dae-ed09-4848-be03-852d593a977f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:23.912825 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3660/7299] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:11:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:11:23.917718 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a992c-36a8-4baf-9891-db9ecaa49e31 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:24.212671 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a992c-36a8-4baf-9891-db9ecaa49e31 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:24.239874 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0510f06-ed86-4a6e-8e57-0dd262fe39ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:24.240516 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0510f06-ed86-4a6e-8e57-0dd262fe39ac admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:24.240799 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0510f06-ed86-4a6e-8e57-0dd262fe39ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:24.241072 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0510f06-ed86-4a6e-8e57-0dd262fe39ac admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:24.241716 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0510f06-ed86-4a6e-8e57-0dd262fe39ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:24.250511 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0510f06-ed86-4a6e-8e57-0dd262fe39ac admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:24.335549 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3640/7300] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:11:23 2022] POST /identity/v3/projects => generated 387 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:11:24.336956 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9199dae-ed09-4848-be03-852d593a977f None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:24.376412 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9199dae-ed09-4848-be03-852d593a977f None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:24.428713 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:24.591716 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9bfbbd-fb46-4dd9-a0d8-bc3a40ee0895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:24.592356 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9bfbbd-fb46-4dd9-a0d8-bc3a40ee0895 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:24.592641 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9bfbbd-fb46-4dd9-a0d8-bc3a40ee0895 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:24.592921 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9bfbbd-fb46-4dd9-a0d8-bc3a40ee0895 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:24.593579 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9bfbbd-fb46-4dd9-a0d8-bc3a40ee0895 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:24.595583 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9bfbbd-fb46-4dd9-a0d8-bc3a40ee0895 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:24.649816 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3661/7301] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:11:24 2022] POST /identity/v3/users => generated 300 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:11:24.651941 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0510f06-ed86-4a6e-8e57-0dd262fe39ac admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:24.667963 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0510f06-ed86-4a6e-8e57-0dd262fe39ac admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:24.683839 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ab8a4-79e1-4bc6-91c8-926ba20a9a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:24.684488 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ab8a4-79e1-4bc6-91c8-926ba20a9a48 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:24.684770 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ab8a4-79e1-4bc6-91c8-926ba20a9a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:24.685049 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ab8a4-79e1-4bc6-91c8-926ba20a9a48 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:24.685711 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ab8a4-79e1-4bc6-91c8-926ba20a9a48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:24.695441 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ab8a4-79e1-4bc6-91c8-926ba20a9a48 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:24.750745 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3641/7302] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:11:24.754846 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9bfbbd-fb46-4dd9-a0d8-bc3a40ee0895 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:24.773489 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9bfbbd-fb46-4dd9-a0d8-bc3a40ee0895 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:24.782401 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7177d5-3340-4eb3-b3e4-027c6f457ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:24.783161 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7177d5-3340-4eb3-b3e4-027c6f457ef7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:24.783444 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7177d5-3340-4eb3-b3e4-027c6f457ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:24.783718 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7177d5-3340-4eb3-b3e4-027c6f457ef7 admin admin] PATH_INFO: `/v3/projects/2fece45c80104b76b8e58a218dfe40d9/users/874830a954de445e9fd9eae4abec1969/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:24.826888 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ab8a4-79e1-4bc6-91c8-926ba20a9a48 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:24.828809 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-bc0ab8a4-79e1-4bc6-91c8-926ba20a9a48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:24.841030 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7177d5-3340-4eb3-b3e4-027c6f457ef7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fece45c80104b76b8e58a218dfe40d9, user_id=874830a954de445e9fd9eae4abec1969, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:24.843695 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7177d5-3340-4eb3-b3e4-027c6f457ef7 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:24.862796 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ab8a4-79e1-4bc6-91c8-926ba20a9a48 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:24.881471 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d86676-ae71-41be-9f22-a4ae9d153b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:24.882106 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d86676-ae71-41be-9f22-a4ae9d153b06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:24.882412 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d86676-ae71-41be-9f22-a4ae9d153b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:24.882699 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d86676-ae71-41be-9f22-a4ae9d153b06 admin admin] PATH_INFO: `/v3/projects/e4d5ce8b0cc1426dacca8b2f631a5949` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:24.889285 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3662/7303] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:11:24 2022] PUT /identity/v3/projects/2fece45c80104b76b8e58a218dfe40d9/users/874830a954de445e9fd9eae4abec1969/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:11:24.890648 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7177d5-3340-4eb3-b3e4-027c6f457ef7 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:24.895323 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d86676-ae71-41be-9f22-a4ae9d153b06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4d5ce8b0cc1426dacca8b2f631a5949)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:24.897998 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d86676-ae71-41be-9f22-a4ae9d153b06 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:25.064026 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7177d5-3340-4eb3-b3e4-027c6f457ef7 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:25.066035 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-60d86676-ae71-41be-9f22-a4ae9d153b06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4d5ce8b0cc1426dacca8b2f631a5949', 'request_id': 'req-60d86676-ae71-41be-9f22-a4ae9d153b06'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:25.073977 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-60d86676-ae71-41be-9f22-a4ae9d153b06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4d5ce8b0cc1426dacca8b2f631a5949', 'request_id': 'req-60d86676-ae71-41be-9f22-a4ae9d153b06'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:25.096121 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-60d86676-ae71-41be-9f22-a4ae9d153b06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4d5ce8b0cc1426dacca8b2f631a5949', 'request_id': 'req-60d86676-ae71-41be-9f22-a4ae9d153b06'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:25.138617 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-60d86676-ae71-41be-9f22-a4ae9d153b06 admin admin] The token cache is being invalidate because project e4d5ce8b0cc1426dacca8b2f631a5949 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:11:25.139369 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-60d86676-ae71-41be-9f22-a4ae9d153b06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:25.140441 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-60d86676-ae71-41be-9f22-a4ae9d153b06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:25.142509 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3642/7304] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:11:24 2022] DELETE /identity/v3/projects/e4d5ce8b0cc1426dacca8b2f631a5949 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:11:25.406473 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a84924-254e-4c92-ae87-afd1eb7091fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:25.409001 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a84924-254e-4c92-ae87-afd1eb7091fa admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:25.409745 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a84924-254e-4c92-ae87-afd1eb7091fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:25.410429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a84924-254e-4c92-ae87-afd1eb7091fa admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:25.412248 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a84924-254e-4c92-ae87-afd1eb7091fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:25.427086 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a84924-254e-4c92-ae87-afd1eb7091fa admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:25.469021 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3663/7305] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 579 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:11:25.472971 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d86676-ae71-41be-9f22-a4ae9d153b06 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:25.475485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-60d86676-ae71-41be-9f22-a4ae9d153b06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:25.564960 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d86676-ae71-41be-9f22-a4ae9d153b06 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:25.586596 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b64c3a-7f5e-4440-9dc3-cd6422aa80bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:25.587530 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b64c3a-7f5e-4440-9dc3-cd6422aa80bd admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:25.588624 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b64c3a-7f5e-4440-9dc3-cd6422aa80bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:25.590796 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b64c3a-7f5e-4440-9dc3-cd6422aa80bd admin admin] PATH_INFO: `/v3/projects/2fece45c80104b76b8e58a218dfe40d9/users/874830a954de445e9fd9eae4abec1969/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:25.594058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b64c3a-7f5e-4440-9dc3-cd6422aa80bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fece45c80104b76b8e58a218dfe40d9, user_id=874830a954de445e9fd9eae4abec1969, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:25.599789 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b64c3a-7f5e-4440-9dc3-cd6422aa80bd admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:25.627803 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3643/7306] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:11:25 2022] PUT /identity/v3/projects/2fece45c80104b76b8e58a218dfe40d9/users/874830a954de445e9fd9eae4abec1969/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:11:25.644199 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfd6dc-2ea1-4d9a-800d-14a961ece5b9 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:25.644775 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfd6dc-2ea1-4d9a-800d-14a961ece5b9 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:25.645195 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfd6dc-2ea1-4d9a-800d-14a961ece5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:25.783878 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-fdbfd6dc-2ea1-4d9a-800d-14a961ece5b9 None None] MFA Rules not processed for user `874830a954de445e9fd9eae4abec1969`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:11:25.785181 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-fdbfd6dc-2ea1-4d9a-800d-14a961ece5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:25.825137 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:26.125800 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3664/7307] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:11:25 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 485 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:11:26.134303 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b64c3a-7f5e-4440-9dc3-cd6422aa80bd admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:26.137182 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b3b64c3a-7f5e-4440-9dc3-cd6422aa80bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:26.232189 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:26.387232 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b64c3a-7f5e-4440-9dc3-cd6422aa80bd admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:26.404906 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e5a0f-16d0-462d-8ffd-5677e5fb0bcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:26.405622 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e5a0f-16d0-462d-8ffd-5677e5fb0bcd service cinder] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:26.405904 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e5a0f-16d0-462d-8ffd-5677e5fb0bcd service cinder] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:26.406172 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e5a0f-16d0-462d-8ffd-5677e5fb0bcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:26.435888 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e5a0f-16d0-462d-8ffd-5677e5fb0bcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:26.437727 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e5a0f-16d0-462d-8ffd-5677e5fb0bcd service cinder] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:26.468834 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3644/7308] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:11:26 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:11:26.641833 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbfd6dc-2ea1-4d9a-800d-14a961ece5b9 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:26.885879 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbfd6dc-2ea1-4d9a-800d-14a961ece5b9 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:26.902516 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d63e31-9581-4c6e-a57b-1c8c907a76aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:26.903251 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d63e31-9581-4c6e-a57b-1c8c907a76aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:26.903533 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d63e31-9581-4c6e-a57b-1c8c907a76aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:26.903812 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d63e31-9581-4c6e-a57b-1c8c907a76aa admin admin] PATH_INFO: `/v3/users/76f01a4a9a454bb595db3b6411230103` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:26.906236 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d63e31-9581-4c6e-a57b-1c8c907a76aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=76f01a4a9a454bb595db3b6411230103)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:26.910207 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d63e31-9581-4c6e-a57b-1c8c907a76aa admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:27.052453 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d1d63e31-9581-4c6e-a57b-1c8c907a76aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76f01a4a9a454bb595db3b6411230103'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:27.053222 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d1d63e31-9581-4c6e-a57b-1c8c907a76aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76f01a4a9a454bb595db3b6411230103'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:27.080442 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d1d63e31-9581-4c6e-a57b-1c8c907a76aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76f01a4a9a454bb595db3b6411230103'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:27.101591 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d1d63e31-9581-4c6e-a57b-1c8c907a76aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76f01a4a9a454bb595db3b6411230103'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:27.103621 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d1d63e31-9581-4c6e-a57b-1c8c907a76aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76f01a4a9a454bb595db3b6411230103'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:27.152006 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3665/7309] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:11:26 2022] DELETE /identity/v3/users/76f01a4a9a454bb595db3b6411230103 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:11:27.155104 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f49963-ffdc-4bb4-9de4-fd350b9d3962 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:27.155591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f49963-ffdc-4bb4-9de4-fd350b9d3962 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:27.155842 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f49963-ffdc-4bb4-9de4-fd350b9d3962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:27.216178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-a1f49963-ffdc-4bb4-9de4-fd350b9d3962 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:11:27.223017 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a1f49963-ffdc-4bb4-9de4-fd350b9d3962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:27.390787 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3645/7310] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:11:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:11:27.404188 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d63e31-9581-4c6e-a57b-1c8c907a76aa admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:27.405592 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d1d63e31-9581-4c6e-a57b-1c8c907a76aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:27.520491 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:27.633494 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d63e31-9581-4c6e-a57b-1c8c907a76aa admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:27.644599 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d51bf-d3dc-4ef2-9511-11d1b12a475a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:27.652313 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d51bf-d3dc-4ef2-9511-11d1b12a475a service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:27.652881 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d51bf-d3dc-4ef2-9511-11d1b12a475a service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:27.653320 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d51bf-d3dc-4ef2-9511-11d1b12a475a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:27.685271 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d51bf-d3dc-4ef2-9511-11d1b12a475a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:27.687006 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d51bf-d3dc-4ef2-9511-11d1b12a475a service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:27.724515 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3666/7311] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:11:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:11:28.427308 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f49963-ffdc-4bb4-9de4-fd350b9d3962 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:28.429820 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a1f49963-ffdc-4bb4-9de4-fd350b9d3962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:28.460919 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f49963-ffdc-4bb4-9de4-fd350b9d3962 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:28.491133 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d09a3-974b-40f7-a8c6-d35c91a9fbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:28.495886 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d09a3-974b-40f7-a8c6-d35c91a9fbad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:28.496494 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d09a3-974b-40f7-a8c6-d35c91a9fbad admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:28.497812 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d09a3-974b-40f7-a8c6-d35c91a9fbad admin admin] PATH_INFO: `/v3/projects/661af862f909430f882b1fe07586a3cd` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:28.501188 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176d09a3-974b-40f7-a8c6-d35c91a9fbad admin admin] RBAC: Authorizing `identity:delete_project(project_id=661af862f909430f882b1fe07586a3cd)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:28.505998 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176d09a3-974b-40f7-a8c6-d35c91a9fbad admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:28.746397 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-176d09a3-974b-40f7-a8c6-d35c91a9fbad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '661af862f909430f882b1fe07586a3cd', 'request_id': 'req-176d09a3-974b-40f7-a8c6-d35c91a9fbad'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:28.821026 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-176d09a3-974b-40f7-a8c6-d35c91a9fbad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '661af862f909430f882b1fe07586a3cd', 'request_id': 'req-176d09a3-974b-40f7-a8c6-d35c91a9fbad'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:28.852866 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-176d09a3-974b-40f7-a8c6-d35c91a9fbad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '661af862f909430f882b1fe07586a3cd', 'request_id': 'req-176d09a3-974b-40f7-a8c6-d35c91a9fbad'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:28.871875 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-176d09a3-974b-40f7-a8c6-d35c91a9fbad admin admin] The token cache is being invalidate because project 661af862f909430f882b1fe07586a3cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:11:28.872505 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-176d09a3-974b-40f7-a8c6-d35c91a9fbad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:28.886932 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-176d09a3-974b-40f7-a8c6-d35c91a9fbad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:28.895333 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3646/7312] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:11:28 2022] DELETE /identity/v3/projects/661af862f909430f882b1fe07586a3cd => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:11:28.896459 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d51bf-d3dc-4ef2-9511-11d1b12a475a service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:28.928449 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d51bf-d3dc-4ef2-9511-11d1b12a475a service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:29.189251 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9beec5-5893-40bb-b946-412ca515d871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:29.190794 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9beec5-5893-40bb-b946-412ca515d871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:29.192193 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9beec5-5893-40bb-b946-412ca515d871 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:29.193305 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9beec5-5893-40bb-b946-412ca515d871 admin admin] PATH_INFO: `/v3/users/874830a954de445e9fd9eae4abec1969` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:29.195401 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9beec5-5893-40bb-b946-412ca515d871 admin admin] RBAC: Authorizing `identity:delete_user(user_id=874830a954de445e9fd9eae4abec1969)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:29.198170 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9beec5-5893-40bb-b946-412ca515d871 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:29.389159 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1a9beec5-5893-40bb-b946-412ca515d871 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '874830a954de445e9fd9eae4abec1969'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:29.389965 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1a9beec5-5893-40bb-b946-412ca515d871 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '874830a954de445e9fd9eae4abec1969'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:29.407098 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1a9beec5-5893-40bb-b946-412ca515d871 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '874830a954de445e9fd9eae4abec1969'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:29.426120 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1a9beec5-5893-40bb-b946-412ca515d871 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '874830a954de445e9fd9eae4abec1969'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:29.429889 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1a9beec5-5893-40bb-b946-412ca515d871 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '874830a954de445e9fd9eae4abec1969'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:29.514747 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3667/7313] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:11:28 2022] DELETE /identity/v3/users/874830a954de445e9fd9eae4abec1969 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:11:31.040856 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d09a3-974b-40f7-a8c6-d35c91a9fbad admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:31.047927 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-176d09a3-974b-40f7-a8c6-d35c91a9fbad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:31.112333 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d09a3-974b-40f7-a8c6-d35c91a9fbad admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:31.339753 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:31.379929 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f934093-c6c0-4ca5-913b-4c0caf4bfce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:31.384081 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f934093-c6c0-4ca5-913b-4c0caf4bfce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:31.386864 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f934093-c6c0-4ca5-913b-4c0caf4bfce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:31.387389 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f934093-c6c0-4ca5-913b-4c0caf4bfce1 admin admin] PATH_INFO: `/v3/projects/2fece45c80104b76b8e58a218dfe40d9` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:31.402525 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f934093-c6c0-4ca5-913b-4c0caf4bfce1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fece45c80104b76b8e58a218dfe40d9)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:31.409447 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f934093-c6c0-4ca5-913b-4c0caf4bfce1 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:31.559296 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8f934093-c6c0-4ca5-913b-4c0caf4bfce1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fece45c80104b76b8e58a218dfe40d9', 'request_id': 'req-8f934093-c6c0-4ca5-913b-4c0caf4bfce1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:31.592151 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8f934093-c6c0-4ca5-913b-4c0caf4bfce1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fece45c80104b76b8e58a218dfe40d9', 'request_id': 'req-8f934093-c6c0-4ca5-913b-4c0caf4bfce1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:31.604172 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8f934093-c6c0-4ca5-913b-4c0caf4bfce1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fece45c80104b76b8e58a218dfe40d9', 'request_id': 'req-8f934093-c6c0-4ca5-913b-4c0caf4bfce1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:31.640089 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8f934093-c6c0-4ca5-913b-4c0caf4bfce1 admin admin] The token cache is being invalidate because project 2fece45c80104b76b8e58a218dfe40d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:11:31.640729 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8f934093-c6c0-4ca5-913b-4c0caf4bfce1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:31.642115 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8f934093-c6c0-4ca5-913b-4c0caf4bfce1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:31.643466 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9beec5-5893-40bb-b946-412ca515d871 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:31.644779 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3647/7314] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:11:31 2022] DELETE /identity/v3/projects/2fece45c80104b76b8e58a218dfe40d9 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:11:31.645728 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1a9beec5-5893-40bb-b946-412ca515d871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:31.655217 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8dfada-6c10-48a5-a85f-37085489385c None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:31.655894 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8dfada-6c10-48a5-a85f-37085489385c None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:31.656402 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8dfada-6c10-48a5-a85f-37085489385c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:31.682679 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9beec5-5893-40bb-b946-412ca515d871 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:31.696871 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-ad8dfada-6c10-48a5-a85f-37085489385c None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:11:31.699258 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ad8dfada-6c10-48a5-a85f-37085489385c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:31.774127 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3648/7315] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:11:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:11:31.782361 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d97fe-a7fc-469d-8d5f-907e383207e2 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:31.782660 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d97fe-a7fc-469d-8d5f-907e383207e2 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:31.782942 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d97fe-a7fc-469d-8d5f-907e383207e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:31.826808 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:31.835484 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-7c4d97fe-a7fc-469d-8d5f-907e383207e2 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:11:31.839602 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7c4d97fe-a7fc-469d-8d5f-907e383207e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:31.862784 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed997f8-1b1b-4741-a94a-827ab7715c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:31.863493 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed997f8-1b1b-4741-a94a-827ab7715c39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:31.863785 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed997f8-1b1b-4741-a94a-827ab7715c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:31.864042 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed997f8-1b1b-4741-a94a-827ab7715c39 admin admin] PATH_INFO: `/v3/users/625f7be4a74d459bb2f0081b263c071a` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:31.866374 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3649/7316] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:11:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:11:31.866990 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed997f8-1b1b-4741-a94a-827ab7715c39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=625f7be4a74d459bb2f0081b263c071a)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:31.867286 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d97fe-a7fc-469d-8d5f-907e383207e2 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:31.869621 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed997f8-1b1b-4741-a94a-827ab7715c39 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:31.904798 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d97fe-a7fc-469d-8d5f-907e383207e2 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:31.921226 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed7f7b-a53f-4ec7-aac1-665f6bf83fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:31.921858 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed7f7b-a53f-4ec7-aac1-665f6bf83fdf admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:31.922138 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed7f7b-a53f-4ec7-aac1-665f6bf83fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:31.922663 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed7f7b-a53f-4ec7-aac1-665f6bf83fdf admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:31.923374 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed7f7b-a53f-4ec7-aac1-665f6bf83fdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:11:31.923765 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed7f7b-a53f-4ec7-aac1-665f6bf83fdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:31.925426 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed7f7b-a53f-4ec7-aac1-665f6bf83fdf admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:31.970222 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3650/7317] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:11:31.971144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed7f7b-a53f-4ec7-aac1-665f6bf83fdf admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:31.982803 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed7f7b-a53f-4ec7-aac1-665f6bf83fdf admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:31.991809 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f2b95-8c83-4995-b76b-b8c8060b0e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:31.992479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f2b95-8c83-4995-b76b-b8c8060b0e99 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:31.993077 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f2b95-8c83-4995-b76b-b8c8060b0e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:31.993384 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f2b95-8c83-4995-b76b-b8c8060b0e99 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:31.997263 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f2b95-8c83-4995-b76b-b8c8060b0e99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:31.997893 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f2b95-8c83-4995-b76b-b8c8060b0e99 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:32.012354 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fed997f8-1b1b-4741-a94a-827ab7715c39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '625f7be4a74d459bb2f0081b263c071a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:32.013080 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fed997f8-1b1b-4741-a94a-827ab7715c39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '625f7be4a74d459bb2f0081b263c071a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:32.033461 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fed997f8-1b1b-4741-a94a-827ab7715c39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '625f7be4a74d459bb2f0081b263c071a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:32.053154 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fed997f8-1b1b-4741-a94a-827ab7715c39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '625f7be4a74d459bb2f0081b263c071a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:32.054457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fed997f8-1b1b-4741-a94a-827ab7715c39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '625f7be4a74d459bb2f0081b263c071a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:32.065374 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3651/7318] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:11:31 2022] POST /identity/v3/projects => generated 407 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:11:32.067699 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f2b95-8c83-4995-b76b-b8c8060b0e99 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:32.082727 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-223f2b95-8c83-4995-b76b-b8c8060b0e99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:32.108029 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3668/7319] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:11:31 2022] DELETE /identity/v3/users/625f7be4a74d459bb2f0081b263c071a => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:11:32.113475 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d00792-aa23-48c3-adad-c3e719d12166 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:32.115209 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d00792-aa23-48c3-adad-c3e719d12166 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:32.116422 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d00792-aa23-48c3-adad-c3e719d12166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:32.153140 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-11d00792-aa23-48c3-adad-c3e719d12166 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:11:32.154587 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-11d00792-aa23-48c3-adad-c3e719d12166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:32.178745 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:32.286362 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f2b95-8c83-4995-b76b-b8c8060b0e99 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:32.315845 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3669/7320] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:11:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:11:32.331211 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d00792-aa23-48c3-adad-c3e719d12166 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:32.335108 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-11d00792-aa23-48c3-adad-c3e719d12166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:32.458143 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a75528-5d34-4b47-9f16-7c57964f134f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:32.458968 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a75528-5d34-4b47-9f16-7c57964f134f admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:32.461761 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a75528-5d34-4b47-9f16-7c57964f134f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:32.462323 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a75528-5d34-4b47-9f16-7c57964f134f admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:32.465326 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a75528-5d34-4b47-9f16-7c57964f134f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:32.472296 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a75528-5d34-4b47-9f16-7c57964f134f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:32.512845 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d00792-aa23-48c3-adad-c3e719d12166 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:32.519390 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3652/7321] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:11:32 2022] POST /identity/v3/users => generated 304 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:11:32.523284 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae32a55-7c06-4058-ab65-bb61e744a982 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:32.523920 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae32a55-7c06-4058-ab65-bb61e744a982 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:32.524185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae32a55-7c06-4058-ab65-bb61e744a982 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:32.524453 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae32a55-7c06-4058-ab65-bb61e744a982 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:32.534671 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a75528-5d34-4b47-9f16-7c57964f134f admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:32.562618 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a75528-5d34-4b47-9f16-7c57964f134f admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:32.569851 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae32a55-7c06-4058-ab65-bb61e744a982 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:32.574666 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae32a55-7c06-4058-ab65-bb61e744a982 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:32.591827 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728c2e3-2f1c-40d0-b337-101fd3a83980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:32.593024 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728c2e3-2f1c-40d0-b337-101fd3a83980 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:32.593661 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728c2e3-2f1c-40d0-b337-101fd3a83980 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:32.594284 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728c2e3-2f1c-40d0-b337-101fd3a83980 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:32.595786 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b728c2e3-2f1c-40d0-b337-101fd3a83980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:32.604271 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b728c2e3-2f1c-40d0-b337-101fd3a83980 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:32.614749 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3670/7322] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:11:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:11:32.632027 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3653/7323] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:11:32.633112 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae32a55-7c06-4058-ab65-bb61e744a982 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:32.656324 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae32a55-7c06-4058-ab65-bb61e744a982 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:32.669535 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db52059-2891-4350-86ee-ff20c7f5e475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:32.670878 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db52059-2891-4350-86ee-ff20c7f5e475 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:32.671185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db52059-2891-4350-86ee-ff20c7f5e475 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:32.671464 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db52059-2891-4350-86ee-ff20c7f5e475 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:32.677313 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db52059-2891-4350-86ee-ff20c7f5e475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:32.679624 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db52059-2891-4350-86ee-ff20c7f5e475 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:32.683889 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:32.732113 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3671/7324] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:11:32.733741 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728c2e3-2f1c-40d0-b337-101fd3a83980 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:32.753234 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728c2e3-2f1c-40d0-b337-101fd3a83980 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:32.796625 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01db4f-8ded-4db1-b0bd-05118d9d901f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:32.797576 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01db4f-8ded-4db1-b0bd-05118d9d901f admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:32.797854 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01db4f-8ded-4db1-b0bd-05118d9d901f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:32.798264 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01db4f-8ded-4db1-b0bd-05118d9d901f admin admin] PATH_INFO: `/v3/projects/f229da2611ab4ba89f16563600b81f3e/users/9543ad205f72443c8566a35bb27e1d53/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:32.890171 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce01db4f-8ded-4db1-b0bd-05118d9d901f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f229da2611ab4ba89f16563600b81f3e, user_id=9543ad205f72443c8566a35bb27e1d53, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:32.902116 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce01db4f-8ded-4db1-b0bd-05118d9d901f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:33.022623 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3654/7325] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:11:32 2022] PUT /identity/v3/projects/f229da2611ab4ba89f16563600b81f3e/users/9543ad205f72443c8566a35bb27e1d53/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:11:33.027692 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be849651-716a-43d4-9ece-71b841948ca3 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:33.028067 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be849651-716a-43d4-9ece-71b841948ca3 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:33.028386 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be849651-716a-43d4-9ece-71b841948ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:33.193885 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-be849651-716a-43d4-9ece-71b841948ca3 None None] MFA Rules not processed for user `9543ad205f72443c8566a35bb27e1d53`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:11:33.195160 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-be849651-716a-43d4-9ece-71b841948ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:33.391861 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3672/7326] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:11:33 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:11:33.397913 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01db4f-8ded-4db1-b0bd-05118d9d901f admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:33.576187 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01db4f-8ded-4db1-b0bd-05118d9d901f admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:33.582921 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be849651-716a-43d4-9ece-71b841948ca3 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:33.584372 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-be849651-716a-43d4-9ece-71b841948ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:33.601344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2164e-87ac-4864-9fce-beafb9700657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:33.602165 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2164e-87ac-4864-9fce-beafb9700657 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:33.602451 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2164e-87ac-4864-9fce-beafb9700657 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:33.602726 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2164e-87ac-4864-9fce-beafb9700657 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:33.603548 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e2164e-87ac-4864-9fce-beafb9700657 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:33.607838 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e2164e-87ac-4864-9fce-beafb9700657 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:33.626011 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be849651-716a-43d4-9ece-71b841948ca3 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:33.639836 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e461a0-6513-4a41-a61a-6158bb004f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:33.640510 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e461a0-6513-4a41-a61a-6158bb004f28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:33.640789 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e461a0-6513-4a41-a61a-6158bb004f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:33.641086 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e461a0-6513-4a41-a61a-6158bb004f28 admin admin] PATH_INFO: `/v3/projects/850145162a26475cb493cd5480d55d86` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:33.643779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e461a0-6513-4a41-a61a-6158bb004f28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=850145162a26475cb493cd5480d55d86)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:33.646387 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e461a0-6513-4a41-a61a-6158bb004f28 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:33.709588 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3655/7327] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:11:33 2022] POST /identity/v3/projects => generated 409 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:11:33.710786 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2164e-87ac-4864-9fce-beafb9700657 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:33.762042 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-37e461a0-6513-4a41-a61a-6158bb004f28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '850145162a26475cb493cd5480d55d86', 'request_id': 'req-37e461a0-6513-4a41-a61a-6158bb004f28'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:33.772671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-37e461a0-6513-4a41-a61a-6158bb004f28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '850145162a26475cb493cd5480d55d86', 'request_id': 'req-37e461a0-6513-4a41-a61a-6158bb004f28'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:33.794548 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:33.799545 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-37e461a0-6513-4a41-a61a-6158bb004f28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '850145162a26475cb493cd5480d55d86', 'request_id': 'req-37e461a0-6513-4a41-a61a-6158bb004f28'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:33.825745 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-37e461a0-6513-4a41-a61a-6158bb004f28 admin admin] The token cache is being invalidate because project 850145162a26475cb493cd5480d55d86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:11:33.826038 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-37e461a0-6513-4a41-a61a-6158bb004f28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:33.832011 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-37e461a0-6513-4a41-a61a-6158bb004f28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:33.845524 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3673/7328] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:11:33 2022] DELETE /identity/v3/projects/850145162a26475cb493cd5480d55d86 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:11:33.849999 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e461a0-6513-4a41-a61a-6158bb004f28 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:33.858480 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-37e461a0-6513-4a41-a61a-6158bb004f28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:33.985536 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2164e-87ac-4864-9fce-beafb9700657 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:34.061778 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e461a0-6513-4a41-a61a-6158bb004f28 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:34.093897 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66631e47-51c4-4d50-92eb-512f99515c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:34.094497 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66631e47-51c4-4d50-92eb-512f99515c47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:34.094778 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66631e47-51c4-4d50-92eb-512f99515c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:34.095081 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66631e47-51c4-4d50-92eb-512f99515c47 admin admin] PATH_INFO: `/v3/users/baeddcbaf3fe487fa24c08e41772bd2b` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:34.100509 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66631e47-51c4-4d50-92eb-512f99515c47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=baeddcbaf3fe487fa24c08e41772bd2b)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:34.109399 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66631e47-51c4-4d50-92eb-512f99515c47 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:34.168517 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9404185-4ebd-4632-b8cc-57c41f2068a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:34.169665 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9404185-4ebd-4632-b8cc-57c41f2068a7 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:34.169968 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9404185-4ebd-4632-b8cc-57c41f2068a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:34.170284 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9404185-4ebd-4632-b8cc-57c41f2068a7 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:34.171087 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9404185-4ebd-4632-b8cc-57c41f2068a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:34.173416 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:34.175833 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9404185-4ebd-4632-b8cc-57c41f2068a7 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:34.244968 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3656/7329] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:11:33 2022] POST /identity/v3/users => generated 311 bytes in 535 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:11:34.249791 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9404185-4ebd-4632-b8cc-57c41f2068a7 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:34.251684 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c9404185-4ebd-4632-b8cc-57c41f2068a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:34.278099 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9404185-4ebd-4632-b8cc-57c41f2068a7 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:34.289478 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-66631e47-51c4-4d50-92eb-512f99515c47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baeddcbaf3fe487fa24c08e41772bd2b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:34.290298 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-66631e47-51c4-4d50-92eb-512f99515c47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baeddcbaf3fe487fa24c08e41772bd2b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:34.297568 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65f01e-5359-43dd-9547-9c3e80e8cb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:34.298207 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65f01e-5359-43dd-9547-9c3e80e8cb33 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:34.298908 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65f01e-5359-43dd-9547-9c3e80e8cb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:34.298908 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65f01e-5359-43dd-9547-9c3e80e8cb33 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:34.299765 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e65f01e-5359-43dd-9547-9c3e80e8cb33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:34.301705 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e65f01e-5359-43dd-9547-9c3e80e8cb33 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:34.309675 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-66631e47-51c4-4d50-92eb-512f99515c47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baeddcbaf3fe487fa24c08e41772bd2b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:34.329191 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-66631e47-51c4-4d50-92eb-512f99515c47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baeddcbaf3fe487fa24c08e41772bd2b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:34.332020 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3657/7330] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:11:34.332900 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-66631e47-51c4-4d50-92eb-512f99515c47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baeddcbaf3fe487fa24c08e41772bd2b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:34.333446 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65f01e-5359-43dd-9547-9c3e80e8cb33 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:34.336888 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1e65f01e-5359-43dd-9547-9c3e80e8cb33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:34.392223 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3674/7331] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:11:33 2022] DELETE /identity/v3/users/baeddcbaf3fe487fa24c08e41772bd2b => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:11:34.409625 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65f01e-5359-43dd-9547-9c3e80e8cb33 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:34.611855 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eccb08f-7efd-4312-8d63-172253c8f446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:34.613624 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccb08f-7efd-4312-8d63-172253c8f446 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:34.614158 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccb08f-7efd-4312-8d63-172253c8f446 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:34.614605 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccb08f-7efd-4312-8d63-172253c8f446 admin admin] PATH_INFO: `/v3/projects/8577bd77e7ca4b55af3d6d3fba893c5d/users/f65e0002f7774e91a82163cfada882f1/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:34.646348 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eccb08f-7efd-4312-8d63-172253c8f446 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8577bd77e7ca4b55af3d6d3fba893c5d, user_id=f65e0002f7774e91a82163cfada882f1, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:34.652540 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eccb08f-7efd-4312-8d63-172253c8f446 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:34.694031 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3658/7332] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:11:34 2022] PUT /identity/v3/projects/8577bd77e7ca4b55af3d6d3fba893c5d/users/f65e0002f7774e91a82163cfada882f1/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:11:34.699125 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66631e47-51c4-4d50-92eb-512f99515c47 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:34.725388 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66631e47-51c4-4d50-92eb-512f99515c47 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:34.882694 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75042e-6130-4dbd-95d0-033f0ec73b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:34.883467 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75042e-6130-4dbd-95d0-033f0ec73b3f admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:34.883993 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75042e-6130-4dbd-95d0-033f0ec73b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:34.884388 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75042e-6130-4dbd-95d0-033f0ec73b3f admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:34.885185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a75042e-6130-4dbd-95d0-033f0ec73b3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:34.886924 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a75042e-6130-4dbd-95d0-033f0ec73b3f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:34.902612 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3675/7333] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:11:34.903822 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eccb08f-7efd-4312-8d63-172253c8f446 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:34.918546 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eccb08f-7efd-4312-8d63-172253c8f446 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:34.945683 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bbb9b1-b9e9-4e64-9eab-db47bd1a3247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:34.946391 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbb9b1-b9e9-4e64-9eab-db47bd1a3247 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:34.946671 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbb9b1-b9e9-4e64-9eab-db47bd1a3247 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:34.946946 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbb9b1-b9e9-4e64-9eab-db47bd1a3247 admin admin] PATH_INFO: `/v3/projects/8577bd77e7ca4b55af3d6d3fba893c5d/users/f65e0002f7774e91a82163cfada882f1/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:34.978925 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bbb9b1-b9e9-4e64-9eab-db47bd1a3247 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8577bd77e7ca4b55af3d6d3fba893c5d, user_id=f65e0002f7774e91a82163cfada882f1, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:34.992377 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bbb9b1-b9e9-4e64-9eab-db47bd1a3247 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:35.038284 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3659/7334] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:11:34 2022] PUT /identity/v3/projects/8577bd77e7ca4b55af3d6d3fba893c5d/users/f65e0002f7774e91a82163cfada882f1/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:11:35.049929 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21850c2b-328c-4167-aa92-2f642d198247 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:35.050235 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21850c2b-328c-4167-aa92-2f642d198247 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:35.050549 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21850c2b-328c-4167-aa92-2f642d198247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:35.105761 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-21850c2b-328c-4167-aa92-2f642d198247 None None] MFA Rules not processed for user `f65e0002f7774e91a82163cfada882f1`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:11:35.107755 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-21850c2b-328c-4167-aa92-2f642d198247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:35.115690 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bbb9b1-b9e9-4e64-9eab-db47bd1a3247 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:35.117727 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-92bbb9b1-b9e9-4e64-9eab-db47bd1a3247 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:35.185146 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:35.245781 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3676/7335] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:11:35 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:11:35.260372 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21850c2b-328c-4167-aa92-2f642d198247 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:35.262234 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-21850c2b-328c-4167-aa92-2f642d198247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:35.263706 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bbb9b1-b9e9-4e64-9eab-db47bd1a3247 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:35.269074 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb8bda8-83ca-4f1d-9904-f16e2b9048e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:35.269721 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8bda8-83ca-4f1d-9904-f16e2b9048e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:35.270001 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8bda8-83ca-4f1d-9904-f16e2b9048e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:35.270294 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8bda8-83ca-4f1d-9904-f16e2b9048e0 admin admin] PATH_INFO: `/v3/projects/b7a30b5fa6094086b8f82992a1bafae2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:35.271504 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb8bda8-83ca-4f1d-9904-f16e2b9048e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7a30b5fa6094086b8f82992a1bafae2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:35.273532 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb8bda8-83ca-4f1d-9904-f16e2b9048e0 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:35.300017 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:35.366440 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21850c2b-328c-4167-aa92-2f642d198247 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:35.391782 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2eb8bda8-83ca-4f1d-9904-f16e2b9048e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7a30b5fa6094086b8f82992a1bafae2', 'request_id': 'req-2eb8bda8-83ca-4f1d-9904-f16e2b9048e0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:35.402492 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2eb8bda8-83ca-4f1d-9904-f16e2b9048e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7a30b5fa6094086b8f82992a1bafae2', 'request_id': 'req-2eb8bda8-83ca-4f1d-9904-f16e2b9048e0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:35.426671 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2eb8bda8-83ca-4f1d-9904-f16e2b9048e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7a30b5fa6094086b8f82992a1bafae2', 'request_id': 'req-2eb8bda8-83ca-4f1d-9904-f16e2b9048e0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:35.460065 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e839e9-fd18-4495-86d9-6a13182abe5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:35.462035 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e839e9-fd18-4495-86d9-6a13182abe5c service cinder] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:35.463378 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e839e9-fd18-4495-86d9-6a13182abe5c service cinder] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:35.463850 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e839e9-fd18-4495-86d9-6a13182abe5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:35.472234 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2eb8bda8-83ca-4f1d-9904-f16e2b9048e0 admin admin] The token cache is being invalidate because project b7a30b5fa6094086b8f82992a1bafae2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:11:35.472645 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2eb8bda8-83ca-4f1d-9904-f16e2b9048e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:35.491656 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2eb8bda8-83ca-4f1d-9904-f16e2b9048e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:35.499798 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3660/7336] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:11:35 2022] DELETE /identity/v3/projects/b7a30b5fa6094086b8f82992a1bafae2 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:11:35.502803 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4c573-9fcc-4bf3-8927-88bc59b0758b None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:35.503352 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4c573-9fcc-4bf3-8927-88bc59b0758b None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:35.504114 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4c573-9fcc-4bf3-8927-88bc59b0758b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:35.557592 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e839e9-fd18-4495-86d9-6a13182abe5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:35.560455 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e839e9-fd18-4495-86d9-6a13182abe5c service cinder] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:35.577491 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-dfb4c573-9fcc-4bf3-8927-88bc59b0758b None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:11:35.579103 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-dfb4c573-9fcc-4bf3-8927-88bc59b0758b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:35.588167 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3677/7337] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:11:35 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:11:35.813314 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3661/7338] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:11:35.822830 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7fb74-66f7-4a96-8782-17e955d35ccd None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:35.823616 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7fb74-66f7-4a96-8782-17e955d35ccd None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:35.824006 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7fb74-66f7-4a96-8782-17e955d35ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:35.851764 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-20f7fb74-66f7-4a96-8782-17e955d35ccd None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:11:35.855232 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-20f7fb74-66f7-4a96-8782-17e955d35ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:35.887415 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3678/7339] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:11:35.888720 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb4c573-9fcc-4bf3-8927-88bc59b0758b None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:35.888837 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7fb74-66f7-4a96-8782-17e955d35ccd None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:35.889036 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-dfb4c573-9fcc-4bf3-8927-88bc59b0758b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:35.925682 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7fb74-66f7-4a96-8782-17e955d35ccd None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:35.931774 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1439b-b3a6-4e81-9bdf-b6ab78d4f1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:35.932901 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1439b-b3a6-4e81-9bdf-b6ab78d4f1eb admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:35.933191 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1439b-b3a6-4e81-9bdf-b6ab78d4f1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:35.933319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb4c573-9fcc-4bf3-8927-88bc59b0758b None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:35.933522 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1439b-b3a6-4e81-9bdf-b6ab78d4f1eb admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:35.934526 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f1439b-b3a6-4e81-9bdf-b6ab78d4f1eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:11:35.934957 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f1439b-b3a6-4e81-9bdf-b6ab78d4f1eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:35.936887 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f1439b-b3a6-4e81-9bdf-b6ab78d4f1eb admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:35.937161 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7a5a4-b638-4018-a8ac-b74ec7bd7637 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:35.937785 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7a5a4-b638-4018-a8ac-b74ec7bd7637 service cinder] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:35.938063 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7a5a4-b638-4018-a8ac-b74ec7bd7637 service cinder] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:35.938334 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7a5a4-b638-4018-a8ac-b74ec7bd7637 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:35.941092 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-88c7a5a4-b638-4018-a8ac-b74ec7bd7637 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:35.961547 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3679/7340] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:11:35.983088 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1439b-b3a6-4e81-9bdf-b6ab78d4f1eb admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:36.014645 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1439b-b3a6-4e81-9bdf-b6ab78d4f1eb admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:36.018363 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:36.024076 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f7bba-26c7-4ec4-9d7f-94fbb6ffdf55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:36.026478 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f7bba-26c7-4ec4-9d7f-94fbb6ffdf55 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:36.027223 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f7bba-26c7-4ec4-9d7f-94fbb6ffdf55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:36.028221 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f7bba-26c7-4ec4-9d7f-94fbb6ffdf55 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:36.028873 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660f7bba-26c7-4ec4-9d7f-94fbb6ffdf55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:36.031774 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660f7bba-26c7-4ec4-9d7f-94fbb6ffdf55 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:36.049824 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c7a5a4-b638-4018-a8ac-b74ec7bd7637 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:36.051555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c7a5a4-b638-4018-a8ac-b74ec7bd7637 service cinder] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:36.066604 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3662/7341] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:11:35 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:11:36.084003 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3680/7342] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:11:35 2022] POST /identity/v3/projects => generated 399 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:11:36.089230 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7a5a4-b638-4018-a8ac-b74ec7bd7637 service cinder] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:36.102153 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7a5a4-b638-4018-a8ac-b74ec7bd7637 service cinder] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:36.212028 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be19f7-ddc0-4f77-95f0-129e136bb292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:36.221523 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be19f7-ddc0-4f77-95f0-129e136bb292 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:36.223172 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be19f7-ddc0-4f77-95f0-129e136bb292 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:36.223660 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be19f7-ddc0-4f77-95f0-129e136bb292 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:36.225073 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be19f7-ddc0-4f77-95f0-129e136bb292 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:36.227588 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be19f7-ddc0-4f77-95f0-129e136bb292 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:36.288297 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3663/7343] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:11:36 2022] POST /identity/v3/users => generated 300 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:11:36.293769 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f7bba-26c7-4ec4-9d7f-94fbb6ffdf55 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:36.309317 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f7bba-26c7-4ec4-9d7f-94fbb6ffdf55 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:36.325849 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f816493-adb9-4ac0-8173-37d0d2a9e62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:36.325849 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f816493-adb9-4ac0-8173-37d0d2a9e62b admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:36.325849 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f816493-adb9-4ac0-8173-37d0d2a9e62b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:36.325849 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f816493-adb9-4ac0-8173-37d0d2a9e62b admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:36.326411 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f816493-adb9-4ac0-8173-37d0d2a9e62b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:36.326411 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f816493-adb9-4ac0-8173-37d0d2a9e62b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:36.374628 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3681/7344] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:11:36.378983 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be19f7-ddc0-4f77-95f0-129e136bb292 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:36.407107 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be19f7-ddc0-4f77-95f0-129e136bb292 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:36.429139 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55437d-1654-4633-9464-d5fec6ac6737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:36.429859 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55437d-1654-4633-9464-d5fec6ac6737 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:36.430345 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55437d-1654-4633-9464-d5fec6ac6737 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:36.430741 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55437d-1654-4633-9464-d5fec6ac6737 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:36.431474 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f55437d-1654-4633-9464-d5fec6ac6737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:36.433184 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f55437d-1654-4633-9464-d5fec6ac6737 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:36.474277 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3664/7345] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:11:36.475878 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f816493-adb9-4ac0-8173-37d0d2a9e62b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:36.502766 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f816493-adb9-4ac0-8173-37d0d2a9e62b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:36.515391 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf2250-1aaf-43f3-a05c-2ceae529cebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:36.516089 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf2250-1aaf-43f3-a05c-2ceae529cebf admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:36.519061 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf2250-1aaf-43f3-a05c-2ceae529cebf admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:36.519371 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf2250-1aaf-43f3-a05c-2ceae529cebf admin admin] PATH_INFO: `/v3/projects/84f3b3e86c7c422ca62bb2cb6a4f162e/users/69e408ea04644c4ba3ceec49fd91def6/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:36.568809 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf2250-1aaf-43f3-a05c-2ceae529cebf admin admin] RBAC: Authorizing `identity:create_grant(project_id=84f3b3e86c7c422ca62bb2cb6a4f162e, user_id=69e408ea04644c4ba3ceec49fd91def6, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:36.571574 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf2250-1aaf-43f3-a05c-2ceae529cebf admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:36.593862 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:36.620623 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3682/7346] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:11:36 2022] PUT /identity/v3/projects/84f3b3e86c7c422ca62bb2cb6a4f162e/users/69e408ea04644c4ba3ceec49fd91def6/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:11:36.623226 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d1396-cb9c-4be6-a0f6-f5f6e13c8442 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:36.623696 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d1396-cb9c-4be6-a0f6-f5f6e13c8442 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:36.624289 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d1396-cb9c-4be6-a0f6-f5f6e13c8442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:36.729722 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-d45d1396-cb9c-4be6-a0f6-f5f6e13c8442 None None] MFA Rules not processed for user `69e408ea04644c4ba3ceec49fd91def6`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:11:36.731158 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d45d1396-cb9c-4be6-a0f6-f5f6e13c8442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:36.924771 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3665/7347] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:11:36 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:11:36.948731 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf2250-1aaf-43f3-a05c-2ceae529cebf admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:36.950559 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a6bf2250-1aaf-43f3-a05c-2ceae529cebf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:37.236831 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf2250-1aaf-43f3-a05c-2ceae529cebf admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:37.255520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d8c62f-8018-4ffa-9c8f-33d80b269bec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:37.258574 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8c62f-8018-4ffa-9c8f-33d80b269bec service cinder] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:37.260952 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8c62f-8018-4ffa-9c8f-33d80b269bec service cinder] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:37.262394 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8c62f-8018-4ffa-9c8f-33d80b269bec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:37.299501 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d8c62f-8018-4ffa-9c8f-33d80b269bec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:37.305871 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d8c62f-8018-4ffa-9c8f-33d80b269bec service cinder] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:37.340473 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3683/7348] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:11:36 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:11:46.919239 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=73,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:47.324241 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=26 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:51.972739 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d1396-cb9c-4be6-a0f6-f5f6e13c8442 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:51.974222 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d45d1396-cb9c-4be6-a0f6-f5f6e13c8442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:52.182102 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d1396-cb9c-4be6-a0f6-f5f6e13c8442 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:52.188099 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b39bac-f588-4a5c-904b-95e943c8b02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:52.188769 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b39bac-f588-4a5c-904b-95e943c8b02f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:52.189088 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b39bac-f588-4a5c-904b-95e943c8b02f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:52.189353 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b39bac-f588-4a5c-904b-95e943c8b02f admin admin] PATH_INFO: `/v3/users/9543ad205f72443c8566a35bb27e1d53` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:52.190681 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b39bac-f588-4a5c-904b-95e943c8b02f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9543ad205f72443c8566a35bb27e1d53)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:52.193266 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b39bac-f588-4a5c-904b-95e943c8b02f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:52.341258 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-07b39bac-f588-4a5c-904b-95e943c8b02f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9543ad205f72443c8566a35bb27e1d53'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:52.342182 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-07b39bac-f588-4a5c-904b-95e943c8b02f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9543ad205f72443c8566a35bb27e1d53'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:52.432138 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-07b39bac-f588-4a5c-904b-95e943c8b02f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9543ad205f72443c8566a35bb27e1d53'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:52.475546 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-07b39bac-f588-4a5c-904b-95e943c8b02f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9543ad205f72443c8566a35bb27e1d53'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:52.510722 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-07b39bac-f588-4a5c-904b-95e943c8b02f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9543ad205f72443c8566a35bb27e1d53'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:52.543932 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3666/7349] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:11:51 2022] DELETE /identity/v3/users/9543ad205f72443c8566a35bb27e1d53 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:11:52.547059 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df39bb-b0f9-4743-9327-703693a29d81 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:52.547614 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df39bb-b0f9-4743-9327-703693a29d81 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:52.548502 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df39bb-b0f9-4743-9327-703693a29d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:52.621786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-64df39bb-b0f9-4743-9327-703693a29d81 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:11:52.623374 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-64df39bb-b0f9-4743-9327-703693a29d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:52.780797 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3684/7350] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:11:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:11:52.791511 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b39bac-f588-4a5c-904b-95e943c8b02f admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:52.793264 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-07b39bac-f588-4a5c-904b-95e943c8b02f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:52.992785 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b39bac-f588-4a5c-904b-95e943c8b02f admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:53.003014 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f4c01-ebc6-4ec2-9ccf-f7f34bdd741a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:53.003694 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f4c01-ebc6-4ec2-9ccf-f7f34bdd741a service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:53.003975 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f4c01-ebc6-4ec2-9ccf-f7f34bdd741a service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:53.004249 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f4c01-ebc6-4ec2-9ccf-f7f34bdd741a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:53.047442 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536f4c01-ebc6-4ec2-9ccf-f7f34bdd741a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:53.049215 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536f4c01-ebc6-4ec2-9ccf-f7f34bdd741a service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:53.087802 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3667/7351] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:11:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:11:53.568516 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df39bb-b0f9-4743-9327-703693a29d81 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:53.569980 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-64df39bb-b0f9-4743-9327-703693a29d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:53.626984 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df39bb-b0f9-4743-9327-703693a29d81 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:53.647055 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b5cc8-dfab-42c5-a5c8-e0cd86c474e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:53.651169 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b5cc8-dfab-42c5-a5c8-e0cd86c474e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:53.653802 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b5cc8-dfab-42c5-a5c8-e0cd86c474e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:53.654204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b5cc8-dfab-42c5-a5c8-e0cd86c474e9 admin admin] PATH_INFO: `/v3/users/69e408ea04644c4ba3ceec49fd91def6` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:53.656666 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b5cc8-dfab-42c5-a5c8-e0cd86c474e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69e408ea04644c4ba3ceec49fd91def6)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:53.661472 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b5cc8-dfab-42c5-a5c8-e0cd86c474e9 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:53.891565 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-178b5cc8-dfab-42c5-a5c8-e0cd86c474e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69e408ea04644c4ba3ceec49fd91def6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:53.894682 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-178b5cc8-dfab-42c5-a5c8-e0cd86c474e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69e408ea04644c4ba3ceec49fd91def6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:53.960424 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-178b5cc8-dfab-42c5-a5c8-e0cd86c474e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69e408ea04644c4ba3ceec49fd91def6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:53.984868 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-178b5cc8-dfab-42c5-a5c8-e0cd86c474e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69e408ea04644c4ba3ceec49fd91def6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:53.985656 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-178b5cc8-dfab-42c5-a5c8-e0cd86c474e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69e408ea04644c4ba3ceec49fd91def6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:54.033783 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3685/7352] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:11:53 2022] DELETE /identity/v3/users/69e408ea04644c4ba3ceec49fd91def6 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:11:54.038135 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ea639-71ec-4bf9-9c3f-4769c95e0536 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:54.038635 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ea639-71ec-4bf9-9c3f-4769c95e0536 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:54.039071 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ea639-71ec-4bf9-9c3f-4769c95e0536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:54.096936 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-b05ea639-71ec-4bf9-9c3f-4769c95e0536 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:11:54.098584 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b05ea639-71ec-4bf9-9c3f-4769c95e0536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:54.158279 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:54.244557 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b5cc8-dfab-42c5-a5c8-e0cd86c474e9 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:54.248708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-178b5cc8-dfab-42c5-a5c8-e0cd86c474e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:54.320008 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3668/7353] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:11:54.492768 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b5cc8-dfab-42c5-a5c8-e0cd86c474e9 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:54.507350 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900e7a2-be27-4ff6-8ccb-5d82196f506e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:54.509033 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900e7a2-be27-4ff6-8ccb-5d82196f506e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:54.510131 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900e7a2-be27-4ff6-8ccb-5d82196f506e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:54.513306 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900e7a2-be27-4ff6-8ccb-5d82196f506e admin admin] PATH_INFO: `/v3/projects/f229da2611ab4ba89f16563600b81f3e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:54.519631 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900e7a2-be27-4ff6-8ccb-5d82196f506e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f229da2611ab4ba89f16563600b81f3e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:54.524100 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900e7a2-be27-4ff6-8ccb-5d82196f506e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:54.569333 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:54.711046 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a900e7a2-be27-4ff6-8ccb-5d82196f506e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f229da2611ab4ba89f16563600b81f3e', 'request_id': 'req-a900e7a2-be27-4ff6-8ccb-5d82196f506e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:54.735911 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a900e7a2-be27-4ff6-8ccb-5d82196f506e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f229da2611ab4ba89f16563600b81f3e', 'request_id': 'req-a900e7a2-be27-4ff6-8ccb-5d82196f506e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:54.763250 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a900e7a2-be27-4ff6-8ccb-5d82196f506e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f229da2611ab4ba89f16563600b81f3e', 'request_id': 'req-a900e7a2-be27-4ff6-8ccb-5d82196f506e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:54.776530 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ea639-71ec-4bf9-9c3f-4769c95e0536 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:54.778273 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b05ea639-71ec-4bf9-9c3f-4769c95e0536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:54.786639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a900e7a2-be27-4ff6-8ccb-5d82196f506e admin admin] The token cache is being invalidate because project f229da2611ab4ba89f16563600b81f3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:11:54.787970 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a900e7a2-be27-4ff6-8ccb-5d82196f506e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:54.788932 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a900e7a2-be27-4ff6-8ccb-5d82196f506e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:54.796027 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3686/7354] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:11:54 2022] DELETE /identity/v3/projects/f229da2611ab4ba89f16563600b81f3e => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:11:54.797329 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900e7a2-be27-4ff6-8ccb-5d82196f506e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:54.800071 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a900e7a2-be27-4ff6-8ccb-5d82196f506e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:54.919488 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ea639-71ec-4bf9-9c3f-4769c95e0536 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:54.951360 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900e7a2-be27-4ff6-8ccb-5d82196f506e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:54.984699 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0cb2c5-feba-4a51-8849-b5109e4a7399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:54.985362 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0cb2c5-feba-4a51-8849-b5109e4a7399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:54.985640 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0cb2c5-feba-4a51-8849-b5109e4a7399 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:54.985923 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0cb2c5-feba-4a51-8849-b5109e4a7399 admin admin] PATH_INFO: `/v3/users/f65e0002f7774e91a82163cfada882f1` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:54.987160 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0cb2c5-feba-4a51-8849-b5109e4a7399 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f65e0002f7774e91a82163cfada882f1)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:54.989127 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0cb2c5-feba-4a51-8849-b5109e4a7399 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:55.049816 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccec49a-adb5-4ca6-8981-fede55f3cd37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:55.050735 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccec49a-adb5-4ca6-8981-fede55f3cd37 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:55.051545 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccec49a-adb5-4ca6-8981-fede55f3cd37 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:55.051946 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccec49a-adb5-4ca6-8981-fede55f3cd37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:55.059517 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2ccec49a-adb5-4ca6-8981-fede55f3cd37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:55.084673 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccec49a-adb5-4ca6-8981-fede55f3cd37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:55.085933 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-aa0cb2c5-feba-4a51-8849-b5109e4a7399 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f65e0002f7774e91a82163cfada882f1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:55.086660 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-aa0cb2c5-feba-4a51-8849-b5109e4a7399 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f65e0002f7774e91a82163cfada882f1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:55.088182 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccec49a-adb5-4ca6-8981-fede55f3cd37 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:55.101534 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-aa0cb2c5-feba-4a51-8849-b5109e4a7399 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f65e0002f7774e91a82163cfada882f1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:55.115749 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-aa0cb2c5-feba-4a51-8849-b5109e4a7399 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f65e0002f7774e91a82163cfada882f1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:55.121499 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-aa0cb2c5-feba-4a51-8849-b5109e4a7399 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f65e0002f7774e91a82163cfada882f1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:55.138701 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3669/7355] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:11:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:11:55.162579 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3687/7356] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:11:54 2022] DELETE /identity/v3/users/f65e0002f7774e91a82163cfada882f1 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:11:56.307113 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccec49a-adb5-4ca6-8981-fede55f3cd37 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:56.326973 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccec49a-adb5-4ca6-8981-fede55f3cd37 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:56.527860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4d5ed-4f8c-40b4-b397-9de155f001e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:56.528445 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4d5ed-4f8c-40b4-b397-9de155f001e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:56.529036 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4d5ed-4f8c-40b4-b397-9de155f001e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:56.529592 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4d5ed-4f8c-40b4-b397-9de155f001e4 admin admin] PATH_INFO: `/v3/projects/8577bd77e7ca4b55af3d6d3fba893c5d` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:56.540027 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad4d5ed-4f8c-40b4-b397-9de155f001e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8577bd77e7ca4b55af3d6d3fba893c5d)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:56.542629 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad4d5ed-4f8c-40b4-b397-9de155f001e4 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:56.601968 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:56.652898 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5ad4d5ed-4f8c-40b4-b397-9de155f001e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8577bd77e7ca4b55af3d6d3fba893c5d', 'request_id': 'req-5ad4d5ed-4f8c-40b4-b397-9de155f001e4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:56.666338 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5ad4d5ed-4f8c-40b4-b397-9de155f001e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8577bd77e7ca4b55af3d6d3fba893c5d', 'request_id': 'req-5ad4d5ed-4f8c-40b4-b397-9de155f001e4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:56.687760 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5ad4d5ed-4f8c-40b4-b397-9de155f001e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8577bd77e7ca4b55af3d6d3fba893c5d', 'request_id': 'req-5ad4d5ed-4f8c-40b4-b397-9de155f001e4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:56.720938 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5ad4d5ed-4f8c-40b4-b397-9de155f001e4 admin admin] The token cache is being invalidate because project 8577bd77e7ca4b55af3d6d3fba893c5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:11:56.723627 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5ad4d5ed-4f8c-40b4-b397-9de155f001e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:56.730056 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5ad4d5ed-4f8c-40b4-b397-9de155f001e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:56.734943 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3670/7357] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:11:56 2022] DELETE /identity/v3/projects/8577bd77e7ca4b55af3d6d3fba893c5d => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:11:56.745148 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddbf6b1-7a33-47c4-8b19-f8472e253678 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:56.745886 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddbf6b1-7a33-47c4-8b19-f8472e253678 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:56.746363 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddbf6b1-7a33-47c4-8b19-f8472e253678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:56.774315 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4d5ed-4f8c-40b4-b397-9de155f001e4 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:56.776402 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5ad4d5ed-4f8c-40b4-b397-9de155f001e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:56.804506 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-7ddbf6b1-7a33-47c4-8b19-f8472e253678 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:11:56.824488 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7ddbf6b1-7a33-47c4-8b19-f8472e253678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:56.886615 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:56.950108 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4d5ed-4f8c-40b4-b397-9de155f001e4 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:56.959452 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3688/7358] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:11:56.960542 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc16b6-0ec8-4b55-bc58-a325a575c458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:56.961277 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc16b6-0ec8-4b55-bc58-a325a575c458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:56.961564 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc16b6-0ec8-4b55-bc58-a325a575c458 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:56.961848 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc16b6-0ec8-4b55-bc58-a325a575c458 admin admin] PATH_INFO: `/v3/projects/84f3b3e86c7c422ca62bb2cb6a4f162e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:56.967534 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbc16b6-0ec8-4b55-bc58-a325a575c458 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84f3b3e86c7c422ca62bb2cb6a4f162e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:56.968689 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c78bc-39b1-4cd6-b1c9-6c83b4af801b None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:56.969149 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c78bc-39b1-4cd6-b1c9-6c83b4af801b None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:56.969519 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbc16b6-0ec8-4b55-bc58-a325a575c458 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:56.969762 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c78bc-39b1-4cd6-b1c9-6c83b4af801b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:56.996237 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-7e7c78bc-39b1-4cd6-b1c9-6c83b4af801b None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:11:56.997863 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7e7c78bc-39b1-4cd6-b1c9-6c83b4af801b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:57.008178 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3689/7359] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:11:57.013788 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c78bc-39b1-4cd6-b1c9-6c83b4af801b None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:57.026446 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c78bc-39b1-4cd6-b1c9-6c83b4af801b None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:57.034960 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b74f89-7233-44e4-a81e-2a5366617970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:57.036705 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b74f89-7233-44e4-a81e-2a5366617970 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:57.037008 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b74f89-7233-44e4-a81e-2a5366617970 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:57.037289 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b74f89-7233-44e4-a81e-2a5366617970 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:57.037962 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b74f89-7233-44e4-a81e-2a5366617970 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:11:57.038419 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b74f89-7233-44e4-a81e-2a5366617970 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:57.040505 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b74f89-7233-44e4-a81e-2a5366617970 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:57.057375 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3690/7360] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:11:57.063916 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b74f89-7233-44e4-a81e-2a5366617970 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:57.094731 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b74f89-7233-44e4-a81e-2a5366617970 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:57.110498 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6fbc16b6-0ec8-4b55-bc58-a325a575c458 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84f3b3e86c7c422ca62bb2cb6a4f162e', 'request_id': 'req-6fbc16b6-0ec8-4b55-bc58-a325a575c458'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:57.138969 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6fbc16b6-0ec8-4b55-bc58-a325a575c458 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84f3b3e86c7c422ca62bb2cb6a4f162e', 'request_id': 'req-6fbc16b6-0ec8-4b55-bc58-a325a575c458'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:57.158655 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6fbc16b6-0ec8-4b55-bc58-a325a575c458 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84f3b3e86c7c422ca62bb2cb6a4f162e', 'request_id': 'req-6fbc16b6-0ec8-4b55-bc58-a325a575c458'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:57.192922 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6fbc16b6-0ec8-4b55-bc58-a325a575c458 admin admin] The token cache is being invalidate because project 84f3b3e86c7c422ca62bb2cb6a4f162e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:11:57.193295 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6fbc16b6-0ec8-4b55-bc58-a325a575c458 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:57.194932 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6fbc16b6-0ec8-4b55-bc58-a325a575c458 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:57.203575 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3671/7361] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:11:56 2022] DELETE /identity/v3/projects/84f3b3e86c7c422ca62bb2cb6a4f162e => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:11:57.211060 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023f475-0f1c-4483-ac3b-1ec8d8f5a85e None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:57.211470 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023f475-0f1c-4483-ac3b-1ec8d8f5a85e None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:57.211966 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023f475-0f1c-4483-ac3b-1ec8d8f5a85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:57.272006 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-8023f475-0f1c-4483-ac3b-1ec8d8f5a85e None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:11:57.279865 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8023f475-0f1c-4483-ac3b-1ec8d8f5a85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:57.292457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3fbd3b-172a-4993-a6ca-b16da26ff6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:57.293104 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fbd3b-172a-4993-a6ca-b16da26ff6f9 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:57.293388 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fbd3b-172a-4993-a6ca-b16da26ff6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:57.293665 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fbd3b-172a-4993-a6ca-b16da26ff6f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:57.294314 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3fbd3b-172a-4993-a6ca-b16da26ff6f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:57.296294 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3fbd3b-172a-4993-a6ca-b16da26ff6f9 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:57.319996 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3672/7362] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:11:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:11:57.327677 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb6502-59e7-4214-bb22-6d6e921c5ab7 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:57.328109 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb6502-59e7-4214-bb22-6d6e921c5ab7 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:57.328492 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb6502-59e7-4214-bb22-6d6e921c5ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:57.387473 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3691/7363] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:11:57 2022] POST /identity/v3/projects => generated 385 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:11:57.388473 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3fbd3b-172a-4993-a6ca-b16da26ff6f9 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:57.395915 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9c3fbd3b-172a-4993-a6ca-b16da26ff6f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:57.408377 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-90fb6502-59e7-4214-bb22-6d6e921c5ab7 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:11:57.409802 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-90fb6502-59e7-4214-bb22-6d6e921c5ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:57.504302 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:57.588981 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3673/7364] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:11:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:11:57.593190 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb6502-59e7-4214-bb22-6d6e921c5ab7 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:57.605963 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb6502-59e7-4214-bb22-6d6e921c5ab7 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:57.613836 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb4836a-7e63-4837-9f23-5c76e2ace669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:57.615800 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4836a-7e63-4837-9f23-5c76e2ace669 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:57.616482 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4836a-7e63-4837-9f23-5c76e2ace669 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:57.616934 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4836a-7e63-4837-9f23-5c76e2ace669 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:57.618398 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb4836a-7e63-4837-9f23-5c76e2ace669 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:11:57.618888 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb4836a-7e63-4837-9f23-5c76e2ace669 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:57.623375 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb4836a-7e63-4837-9f23-5c76e2ace669 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:57.629487 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3fbd3b-172a-4993-a6ca-b16da26ff6f9 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:57.642561 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3674/7365] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:11:57.646753 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb4836a-7e63-4837-9f23-5c76e2ace669 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:57.654180 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073594b7-df14-434d-9feb-76f976128dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:57.654180 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073594b7-df14-434d-9feb-76f976128dd5 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:57.654523 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073594b7-df14-434d-9feb-76f976128dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:57.654638 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073594b7-df14-434d-9feb-76f976128dd5 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:57.655239 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073594b7-df14-434d-9feb-76f976128dd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:57.657472 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073594b7-df14-434d-9feb-76f976128dd5 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:57.669710 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb4836a-7e63-4837-9f23-5c76e2ace669 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:57.686077 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcdd802-5de9-47e5-8381-7369e2de9328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:57.687897 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdd802-5de9-47e5-8381-7369e2de9328 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:57.688181 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdd802-5de9-47e5-8381-7369e2de9328 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:57.689753 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdd802-5de9-47e5-8381-7369e2de9328 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:57.690452 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcdd802-5de9-47e5-8381-7369e2de9328 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:57.699814 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcdd802-5de9-47e5-8381-7369e2de9328 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:57.724286 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3692/7366] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:11:57 2022] POST /identity/v3/users => generated 293 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:11:57.725280 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073594b7-df14-434d-9feb-76f976128dd5 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:57.752319 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073594b7-df14-434d-9feb-76f976128dd5 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:57.768746 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e3d08-4c2c-4956-86d6-fcb4eaac94e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:57.769659 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e3d08-4c2c-4956-86d6-fcb4eaac94e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:57.770392 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e3d08-4c2c-4956-86d6-fcb4eaac94e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:57.770882 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e3d08-4c2c-4956-86d6-fcb4eaac94e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:57.771930 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e3d08-4c2c-4956-86d6-fcb4eaac94e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:57.774105 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e3d08-4c2c-4956-86d6-fcb4eaac94e3 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:57.793060 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3693/7367] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:11:57.794567 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e3d08-4c2c-4956-86d6-fcb4eaac94e3 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:57.814125 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3675/7368] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:11:57 2022] POST /identity/v3/projects => generated 379 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:11:57.818631 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcdd802-5de9-47e5-8381-7369e2de9328 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:57.825611 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e3d08-4c2c-4956-86d6-fcb4eaac94e3 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:57.841657 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:57.995096 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5465d67-96da-4603-bb5e-afc706198ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:57.996080 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5465d67-96da-4603-bb5e-afc706198ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:57.996369 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5465d67-96da-4603-bb5e-afc706198ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:57.996647 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5465d67-96da-4603-bb5e-afc706198ab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:57.997315 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5465d67-96da-4603-bb5e-afc706198ab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:57.998951 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5465d67-96da-4603-bb5e-afc706198ab5 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:58.019351 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcdd802-5de9-47e5-8381-7369e2de9328 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:58.034064 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3694/7369] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:11:58.035053 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5465d67-96da-4603-bb5e-afc706198ab5 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:58.039928 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9171a686-d4db-43f7-bda9-77dc0bea66d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:58.044840 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171a686-d4db-43f7-bda9-77dc0bea66d3 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:58.044840 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171a686-d4db-43f7-bda9-77dc0bea66d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:58.044840 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171a686-d4db-43f7-bda9-77dc0bea66d3 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:58.046756 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9171a686-d4db-43f7-bda9-77dc0bea66d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:58.049747 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9171a686-d4db-43f7-bda9-77dc0bea66d3 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:58.057477 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5465d67-96da-4603-bb5e-afc706198ab5 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:58.080779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc00d40-7133-4419-ae9f-58a41f2b9e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:58.081478 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc00d40-7133-4419-ae9f-58a41f2b9e89 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:58.081759 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc00d40-7133-4419-ae9f-58a41f2b9e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:58.082035 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc00d40-7133-4419-ae9f-58a41f2b9e89 admin admin] PATH_INFO: `/v3/projects/531f4951a05a45aaac87d16f99b76d65/users/29fd8c4b10d44fbc94e8d21e4aecec92/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:58.115435 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3676/7370] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:11:57 2022] POST /identity/v3/users => generated 290 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:11:58.120775 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc00d40-7133-4419-ae9f-58a41f2b9e89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=531f4951a05a45aaac87d16f99b76d65, user_id=29fd8c4b10d44fbc94e8d21e4aecec92, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:58.121406 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9171a686-d4db-43f7-bda9-77dc0bea66d3 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:58.123573 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc00d40-7133-4419-ae9f-58a41f2b9e89 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:58.152758 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3695/7371] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:11:58 2022] PUT /identity/v3/projects/531f4951a05a45aaac87d16f99b76d65/users/29fd8c4b10d44fbc94e8d21e4aecec92/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:11:58.154927 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9171a686-d4db-43f7-bda9-77dc0bea66d3 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:58.163650 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a097da-5d6b-4ab2-b654-a01c47f259e5 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:58.163847 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a097da-5d6b-4ab2-b654-a01c47f259e5 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:58.164079 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a097da-5d6b-4ab2-b654-a01c47f259e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:58.246351 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-22a097da-5d6b-4ab2-b654-a01c47f259e5 None None] MFA Rules not processed for user `29fd8c4b10d44fbc94e8d21e4aecec92`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:11:58.247372 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-22a097da-5d6b-4ab2-b654-a01c47f259e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:58.325107 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558318c1-72ec-49f1-813b-16b09499b061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:58.326019 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558318c1-72ec-49f1-813b-16b09499b061 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:58.327803 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558318c1-72ec-49f1-813b-16b09499b061 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:58.328207 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558318c1-72ec-49f1-813b-16b09499b061 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:58.328988 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558318c1-72ec-49f1-813b-16b09499b061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:58.330739 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558318c1-72ec-49f1-813b-16b09499b061 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:58.352659 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3677/7372] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:11:58.357925 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558318c1-72ec-49f1-813b-16b09499b061 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:58.366944 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3696/7373] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:11:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:11:58.368821 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a097da-5d6b-4ab2-b654-a01c47f259e5 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:58.382108 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558318c1-72ec-49f1-813b-16b09499b061 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:58.383601 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a097da-5d6b-4ab2-b654-a01c47f259e5 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:58.390320 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d40399f-3a58-4854-a5b9-a5bb48d45db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:58.391314 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956b54c-1540-4cfa-9969-96685b320f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:58.391532 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40399f-3a58-4854-a5b9-a5bb48d45db6 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:58.391972 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40399f-3a58-4854-a5b9-a5bb48d45db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:58.392279 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956b54c-1540-4cfa-9969-96685b320f73 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:58.392626 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40399f-3a58-4854-a5b9-a5bb48d45db6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:58.392781 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956b54c-1540-4cfa-9969-96685b320f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:58.393117 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956b54c-1540-4cfa-9969-96685b320f73 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:58.393884 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2956b54c-1540-4cfa-9969-96685b320f73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:58.394017 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d40399f-3a58-4854-a5b9-a5bb48d45db6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:58.396313 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2956b54c-1540-4cfa-9969-96685b320f73 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:58.396585 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d40399f-3a58-4854-a5b9-a5bb48d45db6 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:58.420458 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3678/7374] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:11:58.424865 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956b54c-1540-4cfa-9969-96685b320f73 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:58.435998 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3697/7375] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:11:58 2022] POST /identity/v3/projects => generated 381 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:11:58.440261 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d40399f-3a58-4854-a5b9-a5bb48d45db6 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:58.454876 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956b54c-1540-4cfa-9969-96685b320f73 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:58.477467 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:58.507276 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:58.527719 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d40399f-3a58-4854-a5b9-a5bb48d45db6 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:58.535252 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf83ab6-80b3-4d42-9cad-ea0ac2760cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:58.536164 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf83ab6-80b3-4d42-9cad-ea0ac2760cc6 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:58.536447 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf83ab6-80b3-4d42-9cad-ea0ac2760cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:58.536721 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf83ab6-80b3-4d42-9cad-ea0ac2760cc6 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:58.537369 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf83ab6-80b3-4d42-9cad-ea0ac2760cc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:58.540095 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf83ab6-80b3-4d42-9cad-ea0ac2760cc6 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:58.575459 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3698/7376] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:11:58 2022] POST /identity/v3/users => generated 297 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:11:58.576783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf83ab6-80b3-4d42-9cad-ea0ac2760cc6 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:58.580869 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ac7ab-548a-4017-8ad7-eebd83b4be0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:58.581564 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ac7ab-548a-4017-8ad7-eebd83b4be0b admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:58.581847 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ac7ab-548a-4017-8ad7-eebd83b4be0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:58.582123 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ac7ab-548a-4017-8ad7-eebd83b4be0b admin admin] PATH_INFO: `/v3/projects/f47facd299984b15bd4ee07e0d4bc61c/users/4715f9eef91a4527834c0bea2013c64e/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:58.589604 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf83ab6-80b3-4d42-9cad-ea0ac2760cc6 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:58.597086 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c7f47a-76f4-4e52-b5ab-76240359f9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:58.597717 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7f47a-76f4-4e52-b5ab-76240359f9b4 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:58.597994 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7f47a-76f4-4e52-b5ab-76240359f9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:58.598267 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7f47a-76f4-4e52-b5ab-76240359f9b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:58.599777 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c7f47a-76f4-4e52-b5ab-76240359f9b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:58.601901 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c7f47a-76f4-4e52-b5ab-76240359f9b4 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:58.617310 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ac7ab-548a-4017-8ad7-eebd83b4be0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f47facd299984b15bd4ee07e0d4bc61c, user_id=4715f9eef91a4527834c0bea2013c64e, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:58.620692 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ac7ab-548a-4017-8ad7-eebd83b4be0b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:58.621307 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3699/7377] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:11:58.622170 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c7f47a-76f4-4e52-b5ab-76240359f9b4 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:58.638459 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c7f47a-76f4-4e52-b5ab-76240359f9b4 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:58.657250 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b5c62-1963-4080-b237-e8bdaf99ce6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:58.658111 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b5c62-1963-4080-b237-e8bdaf99ce6c admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:58.658397 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b5c62-1963-4080-b237-e8bdaf99ce6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:58.658674 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b5c62-1963-4080-b237-e8bdaf99ce6c admin admin] PATH_INFO: `/v3/projects/51a373adc6004ec881db16fb1f631cf4/users/14ef6993d12f4a71bb8eecec66460348/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:58.663315 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3679/7378] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:11:58 2022] PUT /identity/v3/projects/f47facd299984b15bd4ee07e0d4bc61c/users/4715f9eef91a4527834c0bea2013c64e/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:11:58.664892 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18281ed-0286-4c07-8dee-0e28311f5cf8 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:58.665445 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18281ed-0286-4c07-8dee-0e28311f5cf8 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:58.667246 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18281ed-0286-4c07-8dee-0e28311f5cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:58.694541 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b5c62-1963-4080-b237-e8bdaf99ce6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=51a373adc6004ec881db16fb1f631cf4, user_id=14ef6993d12f4a71bb8eecec66460348, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:58.702060 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-e18281ed-0286-4c07-8dee-0e28311f5cf8 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:11:58.703856 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e18281ed-0286-4c07-8dee-0e28311f5cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:58.714889 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b5c62-1963-4080-b237-e8bdaf99ce6c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:58.770542 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3700/7379] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:11:58 2022] PUT /identity/v3/projects/51a373adc6004ec881db16fb1f631cf4/users/14ef6993d12f4a71bb8eecec66460348/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:11:58.775461 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b5c62-1963-4080-b237-e8bdaf99ce6c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:58.813261 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3680/7380] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:11:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:11:58.829474 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18281ed-0286-4c07-8dee-0e28311f5cf8 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:58.833121 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e18281ed-0286-4c07-8dee-0e28311f5cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:58.910314 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b5c62-1963-4080-b237-e8bdaf99ce6c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:58.923546 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0b42d-6df7-4c3a-8a83-0f76bc730cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:58.924615 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0b42d-6df7-4c3a-8a83-0f76bc730cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:58.925085 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0b42d-6df7-4c3a-8a83-0f76bc730cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:58.925623 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0b42d-6df7-4c3a-8a83-0f76bc730cd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:58.927157 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c0b42d-6df7-4c3a-8a83-0f76bc730cd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:58.932781 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c0b42d-6df7-4c3a-8a83-0f76bc730cd2 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:58.943301 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18281ed-0286-4c07-8dee-0e28311f5cf8 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:58.998042 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3701/7381] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:11:59.012035 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0b42d-6df7-4c3a-8a83-0f76bc730cd2 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:59.034338 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbaacc9-f016-481d-8022-92b3b82f36d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:59.035734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbaacc9-f016-481d-8022-92b3b82f36d8 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:59.035734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbaacc9-f016-481d-8022-92b3b82f36d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:59.035734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbaacc9-f016-481d-8022-92b3b82f36d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:59.048927 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbaacc9-f016-481d-8022-92b3b82f36d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:59.050446 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbaacc9-f016-481d-8022-92b3b82f36d8 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:59.052549 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0b42d-6df7-4c3a-8a83-0f76bc730cd2 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:59.057986 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:59.073445 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b62f6-ac0c-4ca8-9085-fba0dddd86c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:59.074435 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b62f6-ac0c-4ca8-9085-fba0dddd86c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:59.075995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b62f6-ac0c-4ca8-9085-fba0dddd86c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:59.076457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b62f6-ac0c-4ca8-9085-fba0dddd86c5 admin admin] PATH_INFO: `/v3/projects/51a373adc6004ec881db16fb1f631cf4/users/14ef6993d12f4a71bb8eecec66460348/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:59.077310 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3681/7382] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:11:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:11:59.079804 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b62f6-ac0c-4ca8-9085-fba0dddd86c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51a373adc6004ec881db16fb1f631cf4, user_id=14ef6993d12f4a71bb8eecec66460348, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:59.083164 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b62f6-ac0c-4ca8-9085-fba0dddd86c5 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:59.129690 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3403b5-c8c3-41f6-8b1d-03a72205b19d None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:59.130346 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3403b5-c8c3-41f6-8b1d-03a72205b19d None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:59.130867 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3403b5-c8c3-41f6-8b1d-03a72205b19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:59.141943 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3702/7383] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:11:59 2022] PUT /identity/v3/projects/51a373adc6004ec881db16fb1f631cf4/users/14ef6993d12f4a71bb8eecec66460348/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:11:59.208190 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-0a3403b5-c8c3-41f6-8b1d-03a72205b19d None None] MFA Rules not processed for user `14ef6993d12f4a71bb8eecec66460348`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:11:59.209769 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0a3403b5-c8c3-41f6-8b1d-03a72205b19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:59.362279 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3682/7384] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:11:59 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:11:59.374607 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b62f6-ac0c-4ca8-9085-fba0dddd86c5 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:59.377183 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d49b62f6-ac0c-4ca8-9085-fba0dddd86c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:59.503915 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b62f6-ac0c-4ca8-9085-fba0dddd86c5 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:59.511178 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e54fe6f-f981-4b41-9a32-bbb2946d08e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:59.511824 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54fe6f-f981-4b41-9a32-bbb2946d08e0 service cinder] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:59.512106 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54fe6f-f981-4b41-9a32-bbb2946d08e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:59.512441 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54fe6f-f981-4b41-9a32-bbb2946d08e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:59.600141 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:59.603614 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436c86b-45bc-4449-839f-72118ed27ae3 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:59.603996 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436c86b-45bc-4449-839f-72118ed27ae3 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:59.604694 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436c86b-45bc-4449-839f-72118ed27ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:59.638255 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-1436c86b-45bc-4449-839f-72118ed27ae3 None None] MFA Rules not processed for user `e1ce5d3d668743d5b8843936f77c0150`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:11:59.639519 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1436c86b-45bc-4449-839f-72118ed27ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:59.649783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e54fe6f-f981-4b41-9a32-bbb2946d08e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:59.652561 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e54fe6f-f981-4b41-9a32-bbb2946d08e0 service cinder] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:59.668468 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3703/7385] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:11:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:11:59.723575 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3683/7386] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:11:59 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:12:00.243091 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f56d8-7261-432b-b64f-03b12227e029 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:00.243091 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f56d8-7261-432b-b64f-03b12227e029 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:00.243091 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f56d8-7261-432b-b64f-03b12227e029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:00.319943 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a51f56d8-7261-432b-b64f-03b12227e029 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:12:00.324099 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a51f56d8-7261-432b-b64f-03b12227e029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:00.466301 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3704/7387] 10.222.0.83 () {58 vars in 967 bytes} [Mon Aug 29 16:12:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:12:00.494444 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436c86b-45bc-4449-839f-72118ed27ae3 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:00.496062 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1436c86b-45bc-4449-839f-72118ed27ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:00.611936 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436c86b-45bc-4449-839f-72118ed27ae3 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:00.635986 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c845d-e31b-424b-97e8-914cadd4fca6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:00.636730 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c845d-e31b-424b-97e8-914cadd4fca6 service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:00.637120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c845d-e31b-424b-97e8-914cadd4fca6 service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:00.637490 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c845d-e31b-424b-97e8-914cadd4fca6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:00.647583 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c845d-e31b-424b-97e8-914cadd4fca6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:00.649343 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c845d-e31b-424b-97e8-914cadd4fca6 service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:00.660811 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3684/7388] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 16:12:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:12:00.905025 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f56d8-7261-432b-b64f-03b12227e029 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:00.906678 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a51f56d8-7261-432b-b64f-03b12227e029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:01.013641 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f56d8-7261-432b-b64f-03b12227e029 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:01.020417 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8bd79b-c097-4b69-8547-ff1d551204ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:01.021345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bd79b-c097-4b69-8547-ff1d551204ca service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:01.022988 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bd79b-c097-4b69-8547-ff1d551204ca service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:01.024594 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bd79b-c097-4b69-8547-ff1d551204ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:01.028670 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-de8bd79b-c097-4b69-8547-ff1d551204ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:01.070443 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8bd79b-c097-4b69-8547-ff1d551204ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:01.076104 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8bd79b-c097-4b69-8547-ff1d551204ca service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:01.107220 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3705/7389] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:12:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:12:08.478582 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c845d-e31b-424b-97e8-914cadd4fca6 service swift] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:08.492604 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c845d-e31b-424b-97e8-914cadd4fca6 service swift] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:08.498478 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce87027-5023-4b67-a4a8-b5e473515a3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:08.499507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce87027-5023-4b67-a4a8-b5e473515a3d service cinder] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:08.500019 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce87027-5023-4b67-a4a8-b5e473515a3d service cinder] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:08.500539 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce87027-5023-4b67-a4a8-b5e473515a3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:08.513009 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce87027-5023-4b67-a4a8-b5e473515a3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:08.514745 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce87027-5023-4b67-a4a8-b5e473515a3d service cinder] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:08.529513 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3685/7390] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:12:08 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:12:09.637031 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dadaf4-2f8b-47e1-a5c1-f6eedb71d6e5 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:09.637567 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dadaf4-2f8b-47e1-a5c1-f6eedb71d6e5 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:09.637567 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dadaf4-2f8b-47e1-a5c1-f6eedb71d6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:09.687372 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-44dadaf4-2f8b-47e1-a5c1-f6eedb71d6e5 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:12:09.688602 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-44dadaf4-2f8b-47e1-a5c1-f6eedb71d6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:09.718390 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3706/7391] 10.222.0.83 () {58 vars in 967 bytes} [Mon Aug 29 16:12:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:12:09.726355 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce87027-5023-4b67-a4a8-b5e473515a3d service cinder] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:09.733539 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:09.754686 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce87027-5023-4b67-a4a8-b5e473515a3d service cinder] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:09.778128 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebcc911-1551-441f-91c9-1959a5e64f1a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:09.778785 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebcc911-1551-441f-91c9-1959a5e64f1a service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:09.779076 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebcc911-1551-441f-91c9-1959a5e64f1a service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:09.779529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebcc911-1551-441f-91c9-1959a5e64f1a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:09.812812 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebcc911-1551-441f-91c9-1959a5e64f1a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:09.814739 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebcc911-1551-441f-91c9-1959a5e64f1a service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:09.825418 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3686/7392] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 16:12:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:12:10.611076 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35fd60-1dee-46af-ae60-57bcfd34e2c0 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:10.611407 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35fd60-1dee-46af-ae60-57bcfd34e2c0 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:10.611633 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35fd60-1dee-46af-ae60-57bcfd34e2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:10.705133 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-ce35fd60-1dee-46af-ae60-57bcfd34e2c0 None None] MFA Rules not processed for user `4715f9eef91a4527834c0bea2013c64e`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:12:10.707657 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ce35fd60-1dee-46af-ae60-57bcfd34e2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:10.868366 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3707/7393] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:12:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:12:10.874704 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebcc911-1551-441f-91c9-1959a5e64f1a service swift] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:10.998538 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebcc911-1551-441f-91c9-1959a5e64f1a service swift] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:11.005180 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e8cac-93d5-4c86-88fe-a8a5352a3746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:11.005916 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e8cac-93d5-4c86-88fe-a8a5352a3746 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:11.006200 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e8cac-93d5-4c86-88fe-a8a5352a3746 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:11.006528 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e8cac-93d5-4c86-88fe-a8a5352a3746 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:11.007344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05e8cac-93d5-4c86-88fe-a8a5352a3746 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:11.011920 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05e8cac-93d5-4c86-88fe-a8a5352a3746 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:11.105212 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3687/7394] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:12:10 2022] POST /identity/v3/projects => generated 381 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:12:11.105869 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35fd60-1dee-46af-ae60-57bcfd34e2c0 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:11.120895 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35fd60-1dee-46af-ae60-57bcfd34e2c0 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:11.127715 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:11.227754 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c79ff5-b129-4ced-a9c0-140ad7d29cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:11.228893 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c79ff5-b129-4ced-a9c0-140ad7d29cba admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:11.229163 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c79ff5-b129-4ced-a9c0-140ad7d29cba admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:11.229438 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c79ff5-b129-4ced-a9c0-140ad7d29cba admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:11.230135 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c79ff5-b129-4ced-a9c0-140ad7d29cba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:11.232415 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c79ff5-b129-4ced-a9c0-140ad7d29cba admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:11.274403 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3708/7395] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:12:11 2022] POST /identity/v3/users => generated 297 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:12:11.278980 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e8cac-93d5-4c86-88fe-a8a5352a3746 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:11.296540 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e8cac-93d5-4c86-88fe-a8a5352a3746 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:11.302830 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08902991-a0d9-4343-99f6-6cebb1e85644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:11.303930 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08902991-a0d9-4343-99f6-6cebb1e85644 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:11.304234 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08902991-a0d9-4343-99f6-6cebb1e85644 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:11.304887 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08902991-a0d9-4343-99f6-6cebb1e85644 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:11.305684 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08902991-a0d9-4343-99f6-6cebb1e85644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:11.308995 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08902991-a0d9-4343-99f6-6cebb1e85644 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:11.324455 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3688/7396] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:12:11.330247 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c79ff5-b129-4ced-a9c0-140ad7d29cba admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:11.344611 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c79ff5-b129-4ced-a9c0-140ad7d29cba admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:11.351467 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b4444-7951-449d-bcc6-e5b7b5ac1bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:11.353724 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b4444-7951-449d-bcc6-e5b7b5ac1bc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:11.354381 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b4444-7951-449d-bcc6-e5b7b5ac1bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:11.354986 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b4444-7951-449d-bcc6-e5b7b5ac1bc4 admin admin] PATH_INFO: `/v3/projects/91fbd3c7dc4042f689b55b774b8f1af3/users/d5ecf2022a0a4a58b4b105f8e971d71e/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:11.398300 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511b4444-7951-449d-bcc6-e5b7b5ac1bc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91fbd3c7dc4042f689b55b774b8f1af3, user_id=d5ecf2022a0a4a58b4b105f8e971d71e, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:11.402420 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511b4444-7951-449d-bcc6-e5b7b5ac1bc4 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:11.425137 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3709/7397] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:12:11 2022] PUT /identity/v3/projects/91fbd3c7dc4042f689b55b774b8f1af3/users/d5ecf2022a0a4a58b4b105f8e971d71e/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:12:11.429120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08902991-a0d9-4343-99f6-6cebb1e85644 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:11.441547 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08902991-a0d9-4343-99f6-6cebb1e85644 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:11.585591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0959b65-c363-464a-bd1d-fad958ddafcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:11.586854 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0959b65-c363-464a-bd1d-fad958ddafcc admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:11.587948 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0959b65-c363-464a-bd1d-fad958ddafcc admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:11.588867 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0959b65-c363-464a-bd1d-fad958ddafcc admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:11.589909 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0959b65-c363-464a-bd1d-fad958ddafcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:11.592107 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0959b65-c363-464a-bd1d-fad958ddafcc admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:11.612303 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b4444-7951-449d-bcc6-e5b7b5ac1bc4 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:11.612566 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3689/7398] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:12:11.641166 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b4444-7951-449d-bcc6-e5b7b5ac1bc4 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:11.648252 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784372da-643c-448c-930f-ce355238d5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:11.650073 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784372da-643c-448c-930f-ce355238d5c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:11.651595 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784372da-643c-448c-930f-ce355238d5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:11.653720 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784372da-643c-448c-930f-ce355238d5c6 admin admin] PATH_INFO: `/v3/projects/91fbd3c7dc4042f689b55b774b8f1af3/users/d5ecf2022a0a4a58b4b105f8e971d71e/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:11.660038 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784372da-643c-448c-930f-ce355238d5c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91fbd3c7dc4042f689b55b774b8f1af3, user_id=d5ecf2022a0a4a58b4b105f8e971d71e, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:11.696417 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784372da-643c-448c-930f-ce355238d5c6 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:11.742006 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3710/7399] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:12:11 2022] PUT /identity/v3/projects/91fbd3c7dc4042f689b55b774b8f1af3/users/d5ecf2022a0a4a58b4b105f8e971d71e/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:12:12.159806 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0959b65-c363-464a-bd1d-fad958ddafcc admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:12.162989 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f0959b65-c363-464a-bd1d-fad958ddafcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:12.301842 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:12.328520 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0959b65-c363-464a-bd1d-fad958ddafcc admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:12.363925 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b35248-bd9e-42a4-960e-7e142ebe4911 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:12.364371 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b35248-bd9e-42a4-960e-7e142ebe4911 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:12.364826 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b35248-bd9e-42a4-960e-7e142ebe4911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:12.398588 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a7b35248-bd9e-42a4-960e-7e142ebe4911 None None] MFA Rules not processed for user `35cca2c3486c4389a04f6a20b8d567e9`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:12:12.400410 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a7b35248-bd9e-42a4-960e-7e142ebe4911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:12.498665 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848df1c0-e634-4cf2-ac2a-2ad0acb06869 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:12.499798 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848df1c0-e634-4cf2-ac2a-2ad0acb06869 service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:12.499798 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848df1c0-e634-4cf2-ac2a-2ad0acb06869 service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:12.501519 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848df1c0-e634-4cf2-ac2a-2ad0acb06869 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:12.512171 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-848df1c0-e634-4cf2-ac2a-2ad0acb06869 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:12.532070 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3711/7400] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:12:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:12:12.560527 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848df1c0-e634-4cf2-ac2a-2ad0acb06869 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:12.566389 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848df1c0-e634-4cf2-ac2a-2ad0acb06869 service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:12.628915 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3690/7401] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:12:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:12:22.507451 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=65,keystone:INSERT=5 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:22.608881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=30 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:26.256859 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f47a0-3379-4f66-b56d-907c94a936fa None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:26.257420 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f47a0-3379-4f66-b56d-907c94a936fa None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:26.257420 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f47a0-3379-4f66-b56d-907c94a936fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:26.357601 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-486f47a0-3379-4f66-b56d-907c94a936fa None None] MFA Rules not processed for user `d5ecf2022a0a4a58b4b105f8e971d71e`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:12:26.359041 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-486f47a0-3379-4f66-b56d-907c94a936fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:26.589114 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3712/7402] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:12:26 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:12:26.838193 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848df1c0-e634-4cf2-ac2a-2ad0acb06869 service placement] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:26.840467 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-848df1c0-e634-4cf2-ac2a-2ad0acb06869 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:27.005120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848df1c0-e634-4cf2-ac2a-2ad0acb06869 service placement] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:27.022208 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dbb94f-e176-40a7-a99a-36d0a80cccf7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:27.023063 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbb94f-e176-40a7-a99a-36d0a80cccf7 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:27.023469 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbb94f-e176-40a7-a99a-36d0a80cccf7 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:27.023877 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbb94f-e176-40a7-a99a-36d0a80cccf7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:27.045834 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dbb94f-e176-40a7-a99a-36d0a80cccf7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:27.047877 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dbb94f-e176-40a7-a99a-36d0a80cccf7 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:27.085455 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3691/7403] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:12:26 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:12:29.399102 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f47a0-3379-4f66-b56d-907c94a936fa None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:29.564029 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f47a0-3379-4f66-b56d-907c94a936fa None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:29.577993 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6014dc-13a0-4581-8662-4847ed70add0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:29.579112 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6014dc-13a0-4581-8662-4847ed70add0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:29.582935 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6014dc-13a0-4581-8662-4847ed70add0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:29.583880 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6014dc-13a0-4581-8662-4847ed70add0 admin admin] PATH_INFO: `/v3/users/29fd8c4b10d44fbc94e8d21e4aecec92` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:29.585986 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6014dc-13a0-4581-8662-4847ed70add0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29fd8c4b10d44fbc94e8d21e4aecec92)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:29.589688 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6014dc-13a0-4581-8662-4847ed70add0 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:29.710261 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0f6014dc-13a0-4581-8662-4847ed70add0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29fd8c4b10d44fbc94e8d21e4aecec92'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:29.710967 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0f6014dc-13a0-4581-8662-4847ed70add0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29fd8c4b10d44fbc94e8d21e4aecec92'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:29.726569 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0f6014dc-13a0-4581-8662-4847ed70add0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29fd8c4b10d44fbc94e8d21e4aecec92'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:29.756992 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0f6014dc-13a0-4581-8662-4847ed70add0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29fd8c4b10d44fbc94e8d21e4aecec92'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:29.760803 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0f6014dc-13a0-4581-8662-4847ed70add0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29fd8c4b10d44fbc94e8d21e4aecec92'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:29.804412 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3713/7404] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:12:29 2022] DELETE /identity/v3/users/29fd8c4b10d44fbc94e8d21e4aecec92 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:12:29.809329 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68380995-dc1c-443b-b7f1-707f427ee94d None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:29.810961 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68380995-dc1c-443b-b7f1-707f427ee94d None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:29.811606 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68380995-dc1c-443b-b7f1-707f427ee94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:29.863958 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-68380995-dc1c-443b-b7f1-707f427ee94d None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:12:29.865468 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-68380995-dc1c-443b-b7f1-707f427ee94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:30.056484 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3692/7405] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:12:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:12:30.126009 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6014dc-13a0-4581-8662-4847ed70add0 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:30.132984 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0f6014dc-13a0-4581-8662-4847ed70add0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:30.146929 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:30.296435 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6014dc-13a0-4581-8662-4847ed70add0 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:30.308968 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f74c0c-ec1f-459b-bba1-e3dc9b31bd28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:30.309636 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f74c0c-ec1f-459b-bba1-e3dc9b31bd28 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:30.309918 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f74c0c-ec1f-459b-bba1-e3dc9b31bd28 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:30.310197 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f74c0c-ec1f-459b-bba1-e3dc9b31bd28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:30.323948 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f74c0c-ec1f-459b-bba1-e3dc9b31bd28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:30.325688 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f74c0c-ec1f-459b-bba1-e3dc9b31bd28 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:30.368784 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3714/7406] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:12:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:12:32.174840 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68380995-dc1c-443b-b7f1-707f427ee94d None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:32.176476 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-68380995-dc1c-443b-b7f1-707f427ee94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:32.198380 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68380995-dc1c-443b-b7f1-707f427ee94d None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:32.211131 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68525a-2147-4ce9-9fe0-749cd4008a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:32.211968 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68525a-2147-4ce9-9fe0-749cd4008a0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:32.212594 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68525a-2147-4ce9-9fe0-749cd4008a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:32.212963 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68525a-2147-4ce9-9fe0-749cd4008a0e admin admin] PATH_INFO: `/v3/projects/531f4951a05a45aaac87d16f99b76d65` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:32.214246 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b68525a-2147-4ce9-9fe0-749cd4008a0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=531f4951a05a45aaac87d16f99b76d65)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:32.219042 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b68525a-2147-4ce9-9fe0-749cd4008a0e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:32.345050 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2b68525a-2147-4ce9-9fe0-749cd4008a0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '531f4951a05a45aaac87d16f99b76d65', 'request_id': 'req-2b68525a-2147-4ce9-9fe0-749cd4008a0e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:32.358516 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2b68525a-2147-4ce9-9fe0-749cd4008a0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '531f4951a05a45aaac87d16f99b76d65', 'request_id': 'req-2b68525a-2147-4ce9-9fe0-749cd4008a0e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:32.375345 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2b68525a-2147-4ce9-9fe0-749cd4008a0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '531f4951a05a45aaac87d16f99b76d65', 'request_id': 'req-2b68525a-2147-4ce9-9fe0-749cd4008a0e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:32.394465 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2b68525a-2147-4ce9-9fe0-749cd4008a0e admin admin] The token cache is being invalidate because project 531f4951a05a45aaac87d16f99b76d65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:12:32.400432 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2b68525a-2147-4ce9-9fe0-749cd4008a0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:32.413802 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2b68525a-2147-4ce9-9fe0-749cd4008a0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:32.423680 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3693/7407] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:12:32 2022] DELETE /identity/v3/projects/531f4951a05a45aaac87d16f99b76d65 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:12:32.427674 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f74c0c-ec1f-459b-bba1-e3dc9b31bd28 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:32.441339 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f74c0c-ec1f-459b-bba1-e3dc9b31bd28 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:32.580297 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056f165-ffda-4fe1-9db6-b897efb37bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:32.580977 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056f165-ffda-4fe1-9db6-b897efb37bc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:32.581263 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056f165-ffda-4fe1-9db6-b897efb37bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:32.581542 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056f165-ffda-4fe1-9db6-b897efb37bc7 admin admin] PATH_INFO: `/v3/users/14ef6993d12f4a71bb8eecec66460348` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:32.582888 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3056f165-ffda-4fe1-9db6-b897efb37bc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14ef6993d12f4a71bb8eecec66460348)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:32.585288 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3056f165-ffda-4fe1-9db6-b897efb37bc7 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:32.708298 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3056f165-ffda-4fe1-9db6-b897efb37bc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14ef6993d12f4a71bb8eecec66460348'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:32.709368 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3056f165-ffda-4fe1-9db6-b897efb37bc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14ef6993d12f4a71bb8eecec66460348'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:32.720918 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3056f165-ffda-4fe1-9db6-b897efb37bc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14ef6993d12f4a71bb8eecec66460348'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:32.744711 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3056f165-ffda-4fe1-9db6-b897efb37bc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14ef6993d12f4a71bb8eecec66460348'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:32.745642 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3056f165-ffda-4fe1-9db6-b897efb37bc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14ef6993d12f4a71bb8eecec66460348'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:32.830672 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3715/7408] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:12:32 2022] DELETE /identity/v3/users/14ef6993d12f4a71bb8eecec66460348 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:12:33.626916 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68525a-2147-4ce9-9fe0-749cd4008a0e admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:33.628611 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2b68525a-2147-4ce9-9fe0-749cd4008a0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:33.654664 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68525a-2147-4ce9-9fe0-749cd4008a0e admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:33.675832 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:33.832338 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d573f6df-1a16-40bd-8b63-037b105be6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:33.833177 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573f6df-1a16-40bd-8b63-037b105be6fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:33.833461 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573f6df-1a16-40bd-8b63-037b105be6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:33.833736 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573f6df-1a16-40bd-8b63-037b105be6fb admin admin] PATH_INFO: `/v3/projects/51a373adc6004ec881db16fb1f631cf4` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:33.835152 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d573f6df-1a16-40bd-8b63-037b105be6fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=51a373adc6004ec881db16fb1f631cf4)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:33.837187 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d573f6df-1a16-40bd-8b63-037b105be6fb admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:33.956881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d573f6df-1a16-40bd-8b63-037b105be6fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51a373adc6004ec881db16fb1f631cf4', 'request_id': 'req-d573f6df-1a16-40bd-8b63-037b105be6fb'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:33.967777 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d573f6df-1a16-40bd-8b63-037b105be6fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51a373adc6004ec881db16fb1f631cf4', 'request_id': 'req-d573f6df-1a16-40bd-8b63-037b105be6fb'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:33.979772 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d573f6df-1a16-40bd-8b63-037b105be6fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51a373adc6004ec881db16fb1f631cf4', 'request_id': 'req-d573f6df-1a16-40bd-8b63-037b105be6fb'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:34.007501 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d573f6df-1a16-40bd-8b63-037b105be6fb admin admin] The token cache is being invalidate because project 51a373adc6004ec881db16fb1f631cf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:12:34.007878 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d573f6df-1a16-40bd-8b63-037b105be6fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:34.008620 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d573f6df-1a16-40bd-8b63-037b105be6fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:34.018368 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3694/7409] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:12:33 2022] DELETE /identity/v3/projects/51a373adc6004ec881db16fb1f631cf4 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:12:34.024412 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d18c0a5-9394-4d3c-8464-dd6068ad3007 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:34.024949 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d18c0a5-9394-4d3c-8464-dd6068ad3007 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:34.025102 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d18c0a5-9394-4d3c-8464-dd6068ad3007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:34.061972 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-0d18c0a5-9394-4d3c-8464-dd6068ad3007 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:12:34.063216 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0d18c0a5-9394-4d3c-8464-dd6068ad3007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:34.095385 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:34.112386 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d573f6df-1a16-40bd-8b63-037b105be6fb admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:34.114328 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d573f6df-1a16-40bd-8b63-037b105be6fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:34.209217 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3716/7410] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:12:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:12:34.218427 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03537285-6599-41d2-a11f-3171fca6a6d0 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:34.218975 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03537285-6599-41d2-a11f-3171fca6a6d0 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:34.219479 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03537285-6599-41d2-a11f-3171fca6a6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:34.261429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-03537285-6599-41d2-a11f-3171fca6a6d0 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:12:34.263616 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-03537285-6599-41d2-a11f-3171fca6a6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:34.269325 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d573f6df-1a16-40bd-8b63-037b105be6fb admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:34.281809 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c6cf3e-60d8-4427-b6ed-b81497e15885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:34.282998 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3717/7411] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:12:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:12:34.283221 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6cf3e-60d8-4427-b6ed-b81497e15885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:34.283690 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6cf3e-60d8-4427-b6ed-b81497e15885 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:34.283968 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6cf3e-60d8-4427-b6ed-b81497e15885 admin admin] PATH_INFO: `/v3/users/c406cf9a10e043dbaf54abede459023a` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:34.285504 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03537285-6599-41d2-a11f-3171fca6a6d0 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:34.288676 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c6cf3e-60d8-4427-b6ed-b81497e15885 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c406cf9a10e043dbaf54abede459023a)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:34.291579 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c6cf3e-60d8-4427-b6ed-b81497e15885 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:34.303612 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03537285-6599-41d2-a11f-3171fca6a6d0 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:34.326726 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd26bc6-e00c-4da5-b462-8c362da8304a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:34.327548 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd26bc6-e00c-4da5-b462-8c362da8304a admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:34.327819 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd26bc6-e00c-4da5-b462-8c362da8304a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:34.328095 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd26bc6-e00c-4da5-b462-8c362da8304a admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:34.328835 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd26bc6-e00c-4da5-b462-8c362da8304a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:12:34.330814 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd26bc6-e00c-4da5-b462-8c362da8304a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:34.334910 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd26bc6-e00c-4da5-b462-8c362da8304a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:34.360913 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3718/7412] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:12:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:12:34.372578 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd26bc6-e00c-4da5-b462-8c362da8304a admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:34.401347 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:34.419752 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd26bc6-e00c-4da5-b462-8c362da8304a admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:34.435561 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d4c6cf3e-60d8-4427-b6ed-b81497e15885 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c406cf9a10e043dbaf54abede459023a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:34.439372 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d4c6cf3e-60d8-4427-b6ed-b81497e15885 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c406cf9a10e043dbaf54abede459023a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:34.441238 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b5dac-5dc2-4d8b-bbc5-ae8e0c314ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:34.443667 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b5dac-5dc2-4d8b-bbc5-ae8e0c314ea1 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:34.448057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b5dac-5dc2-4d8b-bbc5-ae8e0c314ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:34.448600 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b5dac-5dc2-4d8b-bbc5-ae8e0c314ea1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:34.450040 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891b5dac-5dc2-4d8b-bbc5-ae8e0c314ea1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:34.455927 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891b5dac-5dc2-4d8b-bbc5-ae8e0c314ea1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:34.481375 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d4c6cf3e-60d8-4427-b6ed-b81497e15885 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c406cf9a10e043dbaf54abede459023a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:34.494255 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d4c6cf3e-60d8-4427-b6ed-b81497e15885 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c406cf9a10e043dbaf54abede459023a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:34.509684 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d4c6cf3e-60d8-4427-b6ed-b81497e15885 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c406cf9a10e043dbaf54abede459023a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:34.518493 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3719/7413] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:12:34 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:12:34.522467 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b5dac-5dc2-4d8b-bbc5-ae8e0c314ea1 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:34.528502 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-891b5dac-5dc2-4d8b-bbc5-ae8e0c314ea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:34.530520 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3695/7414] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:12:34 2022] DELETE /identity/v3/users/c406cf9a10e043dbaf54abede459023a => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:12:34.536003 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd182034-6782-4753-9fda-84f84a087494 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:34.536501 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd182034-6782-4753-9fda-84f84a087494 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:34.536963 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd182034-6782-4753-9fda-84f84a087494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:34.583475 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-fd182034-6782-4753-9fda-84f84a087494 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:12:34.589252 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-fd182034-6782-4753-9fda-84f84a087494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:34.701782 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b5dac-5dc2-4d8b-bbc5-ae8e0c314ea1 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:34.764303 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3696/7415] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:12:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:12:34.809993 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd182034-6782-4753-9fda-84f84a087494 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:34.816784 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-fd182034-6782-4753-9fda-84f84a087494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:34.878769 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26c79c-aefe-4119-8837-162c0bc2aa71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:34.879688 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26c79c-aefe-4119-8837-162c0bc2aa71 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:34.880182 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26c79c-aefe-4119-8837-162c0bc2aa71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:34.880631 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26c79c-aefe-4119-8837-162c0bc2aa71 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:34.882768 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee26c79c-aefe-4119-8837-162c0bc2aa71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:34.888245 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee26c79c-aefe-4119-8837-162c0bc2aa71 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:34.944633 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3720/7416] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:12:34 2022] POST /identity/v3/users => generated 293 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:12:34.950512 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26c79c-aefe-4119-8837-162c0bc2aa71 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:34.971515 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26c79c-aefe-4119-8837-162c0bc2aa71 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:34.984314 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020a637-ee08-4a89-99e8-7236e571dc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:34.984551 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020a637-ee08-4a89-99e8-7236e571dc2e admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:34.984797 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020a637-ee08-4a89-99e8-7236e571dc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:34.985075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020a637-ee08-4a89-99e8-7236e571dc2e admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:34.985754 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f020a637-ee08-4a89-99e8-7236e571dc2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:34.987438 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f020a637-ee08-4a89-99e8-7236e571dc2e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:35.023949 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3721/7417] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:12:35.028853 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020a637-ee08-4a89-99e8-7236e571dc2e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:35.044590 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020a637-ee08-4a89-99e8-7236e571dc2e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:35.055244 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd182034-6782-4753-9fda-84f84a087494 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:35.062447 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c35354-cf78-4d54-a861-8b420c0ce6c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:35.063911 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c35354-cf78-4d54-a861-8b420c0ce6c8 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:35.064385 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c35354-cf78-4d54-a861-8b420c0ce6c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:35.064830 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c35354-cf78-4d54-a861-8b420c0ce6c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:35.067415 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbcd7ca-daf8-4e2c-99c6-f7aaa70a0bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:35.068059 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcd7ca-daf8-4e2c-99c6-f7aaa70a0bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:35.068394 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcd7ca-daf8-4e2c-99c6-f7aaa70a0bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:35.068671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcd7ca-daf8-4e2c-99c6-f7aaa70a0bb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:35.069324 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbcd7ca-daf8-4e2c-99c6-f7aaa70a0bb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:35.070983 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbcd7ca-daf8-4e2c-99c6-f7aaa70a0bb6 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:35.083375 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c35354-cf78-4d54-a861-8b420c0ce6c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:35.085166 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c35354-cf78-4d54-a861-8b420c0ce6c8 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:35.090786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:35.104086 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3697/7418] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:12:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:12:35.113668 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3722/7419] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:12:35.116215 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c35354-cf78-4d54-a861-8b420c0ce6c8 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:35.133572 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c35354-cf78-4d54-a861-8b420c0ce6c8 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:35.143288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ca227-37af-4be0-8cc9-5679f5395a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:35.147906 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ca227-37af-4be0-8cc9-5679f5395a6d admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:35.148479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ca227-37af-4be0-8cc9-5679f5395a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:35.148999 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ca227-37af-4be0-8cc9-5679f5395a6d admin admin] PATH_INFO: `/v3/projects/425a2a21617241b2a42e1e2fa143a7ec/users/629a7dfa4bea4860bcb6178f795594b0/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:35.197448 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81ca227-37af-4be0-8cc9-5679f5395a6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=425a2a21617241b2a42e1e2fa143a7ec, user_id=629a7dfa4bea4860bcb6178f795594b0, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:35.211234 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81ca227-37af-4be0-8cc9-5679f5395a6d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:35.297069 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3698/7420] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:12:35 2022] PUT /identity/v3/projects/425a2a21617241b2a42e1e2fa143a7ec/users/629a7dfa4bea4860bcb6178f795594b0/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:12:35.298985 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1d418-a7f2-4ea8-b078-d65f7d6a324c None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:35.299298 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1d418-a7f2-4ea8-b078-d65f7d6a324c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:35.299574 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1d418-a7f2-4ea8-b078-d65f7d6a324c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:35.362420 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-b0e1d418-a7f2-4ea8-b078-d65f7d6a324c None None] MFA Rules not processed for user `629a7dfa4bea4860bcb6178f795594b0`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:12:35.363676 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b0e1d418-a7f2-4ea8-b078-d65f7d6a324c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:35.542012 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3723/7421] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:12:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:12:35.558279 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ca227-37af-4be0-8cc9-5679f5395a6d admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:35.562144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d81ca227-37af-4be0-8cc9-5679f5395a6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:35.647632 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:35.669521 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ca227-37af-4be0-8cc9-5679f5395a6d admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:35.682947 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f355d-ef79-4967-b454-14b97e2e8fa2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:35.683997 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f355d-ef79-4967-b454-14b97e2e8fa2 service cinder] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:35.684203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f355d-ef79-4967-b454-14b97e2e8fa2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:35.684481 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f355d-ef79-4967-b454-14b97e2e8fa2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:35.716868 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f355d-ef79-4967-b454-14b97e2e8fa2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:35.718383 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f355d-ef79-4967-b454-14b97e2e8fa2 service cinder] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:35.748361 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3699/7422] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:12:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:12:35.777470 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1d418-a7f2-4ea8-b078-d65f7d6a324c None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:35.958418 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1d418-a7f2-4ea8-b078-d65f7d6a324c None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:35.972406 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f63c4-5456-43df-bbf0-dd6a5ec15a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:35.973064 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f63c4-5456-43df-bbf0-dd6a5ec15a2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:35.973344 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f63c4-5456-43df-bbf0-dd6a5ec15a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:35.973623 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f63c4-5456-43df-bbf0-dd6a5ec15a2f admin admin] PATH_INFO: `/v3/users/629a7dfa4bea4860bcb6178f795594b0` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:35.975583 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f63c4-5456-43df-bbf0-dd6a5ec15a2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=629a7dfa4bea4860bcb6178f795594b0)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:35.978446 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f63c4-5456-43df-bbf0-dd6a5ec15a2f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:36.105945 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e84f63c4-5456-43df-bbf0-dd6a5ec15a2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '629a7dfa4bea4860bcb6178f795594b0'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:36.106723 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e84f63c4-5456-43df-bbf0-dd6a5ec15a2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '629a7dfa4bea4860bcb6178f795594b0'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:36.119007 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e84f63c4-5456-43df-bbf0-dd6a5ec15a2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '629a7dfa4bea4860bcb6178f795594b0'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:36.139625 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e84f63c4-5456-43df-bbf0-dd6a5ec15a2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '629a7dfa4bea4860bcb6178f795594b0'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:36.141147 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e84f63c4-5456-43df-bbf0-dd6a5ec15a2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '629a7dfa4bea4860bcb6178f795594b0'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:36.178018 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3724/7423] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:12:35 2022] DELETE /identity/v3/users/629a7dfa4bea4860bcb6178f795594b0 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:12:36.183159 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53907d7-6e24-42ba-80f0-f60becfc129a None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:36.184028 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53907d7-6e24-42ba-80f0-f60becfc129a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:36.184482 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53907d7-6e24-42ba-80f0-f60becfc129a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:36.217934 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-a53907d7-6e24-42ba-80f0-f60becfc129a None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:12:36.219540 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a53907d7-6e24-42ba-80f0-f60becfc129a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:36.259314 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f63c4-5456-43df-bbf0-dd6a5ec15a2f admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:36.261114 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e84f63c4-5456-43df-bbf0-dd6a5ec15a2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:36.279310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:36.339259 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3700/7424] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:12:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:12:36.344699 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53907d7-6e24-42ba-80f0-f60becfc129a None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:36.346800 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a53907d7-6e24-42ba-80f0-f60becfc129a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:36.427410 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f63c4-5456-43df-bbf0-dd6a5ec15a2f admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:36.443049 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53907d7-6e24-42ba-80f0-f60becfc129a None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:36.465138 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eebc3aa-1c1f-418a-85b9-e835f91b5939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:36.465433 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209026e1-0c32-4431-a2fc-851cb7053656 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:36.465824 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebc3aa-1c1f-418a-85b9-e835f91b5939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:36.466113 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebc3aa-1c1f-418a-85b9-e835f91b5939 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:36.466388 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebc3aa-1c1f-418a-85b9-e835f91b5939 admin admin] PATH_INFO: `/v3/projects/61f119733900461392838359ec76959f` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:36.467512 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209026e1-0c32-4431-a2fc-851cb7053656 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:36.468444 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209026e1-0c32-4431-a2fc-851cb7053656 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:36.469472 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209026e1-0c32-4431-a2fc-851cb7053656 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:36.470846 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eebc3aa-1c1f-418a-85b9-e835f91b5939 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61f119733900461392838359ec76959f)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:36.472933 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eebc3aa-1c1f-418a-85b9-e835f91b5939 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:36.486781 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209026e1-0c32-4431-a2fc-851cb7053656 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:36.488998 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209026e1-0c32-4431-a2fc-851cb7053656 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:36.503767 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3701/7425] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:12:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:12:36.625813 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3eebc3aa-1c1f-418a-85b9-e835f91b5939 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61f119733900461392838359ec76959f', 'request_id': 'req-3eebc3aa-1c1f-418a-85b9-e835f91b5939'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:36.643470 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3eebc3aa-1c1f-418a-85b9-e835f91b5939 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61f119733900461392838359ec76959f', 'request_id': 'req-3eebc3aa-1c1f-418a-85b9-e835f91b5939'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:36.664830 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3eebc3aa-1c1f-418a-85b9-e835f91b5939 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61f119733900461392838359ec76959f', 'request_id': 'req-3eebc3aa-1c1f-418a-85b9-e835f91b5939'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:36.682977 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3eebc3aa-1c1f-418a-85b9-e835f91b5939 admin admin] The token cache is being invalidate because project 61f119733900461392838359ec76959f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:12:36.683540 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3eebc3aa-1c1f-418a-85b9-e835f91b5939 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:36.684428 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3eebc3aa-1c1f-418a-85b9-e835f91b5939 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:36.687400 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3725/7426] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:12:36 2022] DELETE /identity/v3/projects/61f119733900461392838359ec76959f => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:12:36.692606 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849bbf54-789c-4f4a-8d37-cb46366dcc3b None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:36.692935 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849bbf54-789c-4f4a-8d37-cb46366dcc3b None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:36.693288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849bbf54-789c-4f4a-8d37-cb46366dcc3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:36.729606 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-849bbf54-789c-4f4a-8d37-cb46366dcc3b None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:12:36.730860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-849bbf54-789c-4f4a-8d37-cb46366dcc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:36.824561 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3702/7427] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:12:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:12:36.826223 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2892825-d4f1-4635-83dc-7313132b107d None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:36.826511 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2892825-d4f1-4635-83dc-7313132b107d None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:36.826784 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2892825-d4f1-4635-83dc-7313132b107d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:36.875132 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-c2892825-d4f1-4635-83dc-7313132b107d None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:12:36.876711 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c2892825-d4f1-4635-83dc-7313132b107d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:36.886767 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3726/7428] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:12:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:12:36.891572 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849bbf54-789c-4f4a-8d37-cb46366dcc3b None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:36.910805 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849bbf54-789c-4f4a-8d37-cb46366dcc3b None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:36.919986 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ea58e-3470-4ef3-ba09-eff9960fa173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:36.920793 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ea58e-3470-4ef3-ba09-eff9960fa173 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:36.921079 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ea58e-3470-4ef3-ba09-eff9960fa173 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:36.921353 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ea58e-3470-4ef3-ba09-eff9960fa173 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:36.922049 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ea58e-3470-4ef3-ba09-eff9960fa173 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:12:36.922332 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ea58e-3470-4ef3-ba09-eff9960fa173 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:36.940171 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ea58e-3470-4ef3-ba09-eff9960fa173 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:36.959181 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3703/7429] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:12:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:12:36.960691 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2892825-d4f1-4635-83dc-7313132b107d None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:36.971287 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2892825-d4f1-4635-83dc-7313132b107d None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:36.984231 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8bd7a6-1e09-48fe-a978-9c3ecaf4824a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:36.984877 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8bd7a6-1e09-48fe-a978-9c3ecaf4824a admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:36.985158 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8bd7a6-1e09-48fe-a978-9c3ecaf4824a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:36.988717 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8bd7a6-1e09-48fe-a978-9c3ecaf4824a admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:36.989473 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8bd7a6-1e09-48fe-a978-9c3ecaf4824a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:36.996530 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8bd7a6-1e09-48fe-a978-9c3ecaf4824a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:37.099217 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3727/7430] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:12:36 2022] POST /identity/v3/projects => generated 373 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:12:37.102251 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ea58e-3470-4ef3-ba09-eff9960fa173 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:37.120431 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ea58e-3470-4ef3-ba09-eff9960fa173 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:37.150142 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:37.236166 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfd4ec-8202-4482-81c6-2d60b1bcc729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:37.236910 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfd4ec-8202-4482-81c6-2d60b1bcc729 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:37.237320 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8bd7a6-1e09-48fe-a978-9c3ecaf4824a admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:37.237726 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfd4ec-8202-4482-81c6-2d60b1bcc729 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:37.237726 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfd4ec-8202-4482-81c6-2d60b1bcc729 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:37.238552 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cfd4ec-8202-4482-81c6-2d60b1bcc729 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:37.239974 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-be8bd7a6-1e09-48fe-a978-9c3ecaf4824a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:37.242167 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cfd4ec-8202-4482-81c6-2d60b1bcc729 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:37.271201 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8bd7a6-1e09-48fe-a978-9c3ecaf4824a admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:37.284362 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3704/7431] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:12:37 2022] POST /identity/v3/users => generated 287 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:12:37.288296 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfd4ec-8202-4482-81c6-2d60b1bcc729 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:37.292764 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d6ae3-5b73-42bd-a4c9-c960a6f60636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:37.293657 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d6ae3-5b73-42bd-a4c9-c960a6f60636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:37.294125 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d6ae3-5b73-42bd-a4c9-c960a6f60636 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:37.294559 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d6ae3-5b73-42bd-a4c9-c960a6f60636 admin admin] PATH_INFO: `/v3/projects/425a2a21617241b2a42e1e2fa143a7ec` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:37.295967 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4d6ae3-5b73-42bd-a4c9-c960a6f60636 admin admin] RBAC: Authorizing `identity:delete_project(project_id=425a2a21617241b2a42e1e2fa143a7ec)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:37.298078 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4d6ae3-5b73-42bd-a4c9-c960a6f60636 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:37.302733 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfd4ec-8202-4482-81c6-2d60b1bcc729 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:37.315355 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402301f9-bd21-41c8-a858-fe09deb0dea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:37.316123 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402301f9-bd21-41c8-a858-fe09deb0dea3 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:37.316471 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402301f9-bd21-41c8-a858-fe09deb0dea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:37.316844 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402301f9-bd21-41c8-a858-fe09deb0dea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:37.317894 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402301f9-bd21-41c8-a858-fe09deb0dea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:37.319935 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402301f9-bd21-41c8-a858-fe09deb0dea3 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:37.339865 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3705/7432] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:12:37.344037 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402301f9-bd21-41c8-a858-fe09deb0dea3 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:37.359753 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402301f9-bd21-41c8-a858-fe09deb0dea3 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:37.362558 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ac4d6ae3-5b73-42bd-a4c9-c960a6f60636 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '425a2a21617241b2a42e1e2fa143a7ec', 'request_id': 'req-ac4d6ae3-5b73-42bd-a4c9-c960a6f60636'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:37.368960 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ac4d6ae3-5b73-42bd-a4c9-c960a6f60636 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '425a2a21617241b2a42e1e2fa143a7ec', 'request_id': 'req-ac4d6ae3-5b73-42bd-a4c9-c960a6f60636'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:37.377463 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ac4d6ae3-5b73-42bd-a4c9-c960a6f60636 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '425a2a21617241b2a42e1e2fa143a7ec', 'request_id': 'req-ac4d6ae3-5b73-42bd-a4c9-c960a6f60636'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:37.380443 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:37.399445 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ac4d6ae3-5b73-42bd-a4c9-c960a6f60636 admin admin] The token cache is being invalidate because project 425a2a21617241b2a42e1e2fa143a7ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:12:37.399857 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ac4d6ae3-5b73-42bd-a4c9-c960a6f60636 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:37.400555 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ac4d6ae3-5b73-42bd-a4c9-c960a6f60636 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:37.403822 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3728/7433] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:12:37 2022] DELETE /identity/v3/projects/425a2a21617241b2a42e1e2fa143a7ec => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:12:37.407688 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d134d2d-cf99-4637-b854-d0b0b65c7fe1 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:37.408026 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d134d2d-cf99-4637-b854-d0b0b65c7fe1 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:37.408302 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d134d2d-cf99-4637-b854-d0b0b65c7fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:37.434018 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-1d134d2d-cf99-4637-b854-d0b0b65c7fe1 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:12:37.435296 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1d134d2d-cf99-4637-b854-d0b0b65c7fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:37.474256 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998e497-b0f0-4154-b20b-11e6b0336cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:37.474950 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998e497-b0f0-4154-b20b-11e6b0336cba admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:37.475273 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998e497-b0f0-4154-b20b-11e6b0336cba admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:37.475593 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998e497-b0f0-4154-b20b-11e6b0336cba admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:37.476259 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0998e497-b0f0-4154-b20b-11e6b0336cba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:37.478142 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0998e497-b0f0-4154-b20b-11e6b0336cba admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:37.498249 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3706/7434] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:12:37.499351 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998e497-b0f0-4154-b20b-11e6b0336cba admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:37.502277 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0998e497-b0f0-4154-b20b-11e6b0336cba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:37.521518 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998e497-b0f0-4154-b20b-11e6b0336cba admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:37.528165 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beb8c39-527d-457c-aaeb-8012ab43f7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:37.529277 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb8c39-527d-457c-aaeb-8012ab43f7b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:37.529616 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb8c39-527d-457c-aaeb-8012ab43f7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:37.530611 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb8c39-527d-457c-aaeb-8012ab43f7b4 admin admin] PATH_INFO: `/v3/projects/194d3aa213384918be55cb78a064d069/users/b3cf02b0895c466083ceb64604e02327/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:37.555765 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beb8c39-527d-457c-aaeb-8012ab43f7b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=194d3aa213384918be55cb78a064d069, user_id=b3cf02b0895c466083ceb64604e02327, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:37.556685 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3729/7435] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:12:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:12:37.559013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beb8c39-527d-457c-aaeb-8012ab43f7b4 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:37.566585 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e6782-ff20-4d8a-a7fb-095ccdc3e642 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:37.567010 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e6782-ff20-4d8a-a7fb-095ccdc3e642 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:37.567436 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e6782-ff20-4d8a-a7fb-095ccdc3e642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:37.586765 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3707/7436] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:12:37 2022] PUT /identity/v3/projects/194d3aa213384918be55cb78a064d069/users/b3cf02b0895c466083ceb64604e02327/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:12:37.601103 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a64442-2f6e-4c01-8024-13ff715879b5 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:37.601380 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a64442-2f6e-4c01-8024-13ff715879b5 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:37.601653 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a64442-2f6e-4c01-8024-13ff715879b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:37.606473 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-b12e6782-ff20-4d8a-a7fb-095ccdc3e642 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:12:37.608554 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b12e6782-ff20-4d8a-a7fb-095ccdc3e642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:37.643795 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-57a64442-2f6e-4c01-8024-13ff715879b5 None None] MFA Rules not processed for user `b3cf02b0895c466083ceb64604e02327`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:12:37.645469 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-57a64442-2f6e-4c01-8024-13ff715879b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:37.756778 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3730/7437] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:12:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:12:37.760884 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e6782-ff20-4d8a-a7fb-095ccdc3e642 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:37.780448 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e6782-ff20-4d8a-a7fb-095ccdc3e642 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:37.790743 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:37.793684 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a97a30-7fb0-4516-b6fe-143f8406fe32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:37.794411 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a97a30-7fb0-4516-b6fe-143f8406fe32 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:37.794699 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a97a30-7fb0-4516-b6fe-143f8406fe32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:37.794976 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a97a30-7fb0-4516-b6fe-143f8406fe32 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:37.795674 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a97a30-7fb0-4516-b6fe-143f8406fe32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:12:37.795970 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a97a30-7fb0-4516-b6fe-143f8406fe32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:37.799044 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a97a30-7fb0-4516-b6fe-143f8406fe32 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:37.822509 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3708/7438] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:12:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:12:37.832862 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a64442-2f6e-4c01-8024-13ff715879b5 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:37.836488 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3731/7439] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:12:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:12:37.836728 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-57a64442-2f6e-4c01-8024-13ff715879b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:37.839620 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a97a30-7fb0-4516-b6fe-143f8406fe32 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:37.856966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a97a30-7fb0-4516-b6fe-143f8406fe32 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:37.863901 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8477fc-d3ae-4f1e-bec5-bb1ccfbaf0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:37.864830 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8477fc-d3ae-4f1e-bec5-bb1ccfbaf0d7 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:37.865430 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8477fc-d3ae-4f1e-bec5-bb1ccfbaf0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:37.865883 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8477fc-d3ae-4f1e-bec5-bb1ccfbaf0d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:37.866751 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8477fc-d3ae-4f1e-bec5-bb1ccfbaf0d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:37.872435 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8477fc-d3ae-4f1e-bec5-bb1ccfbaf0d7 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:37.929932 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3732/7440] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:12:37 2022] POST /identity/v3/projects => generated 377 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:12:37.933982 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8477fc-d3ae-4f1e-bec5-bb1ccfbaf0d7 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:37.961906 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a64442-2f6e-4c01-8024-13ff715879b5 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:38.055315 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8477fc-d3ae-4f1e-bec5-bb1ccfbaf0d7 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:38.064094 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526a165-3dad-45ef-aa2f-0834ed6148cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:38.066076 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056698d4-8f27-4822-a8cf-e6155c30bf8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:38.066925 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056698d4-8f27-4822-a8cf-e6155c30bf8a service cinder] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:38.067309 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056698d4-8f27-4822-a8cf-e6155c30bf8a service cinder] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:38.067630 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056698d4-8f27-4822-a8cf-e6155c30bf8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:38.067762 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526a165-3dad-45ef-aa2f-0834ed6148cf admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:38.068354 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526a165-3dad-45ef-aa2f-0834ed6148cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:38.068715 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526a165-3dad-45ef-aa2f-0834ed6148cf admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:38.070079 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526a165-3dad-45ef-aa2f-0834ed6148cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:38.073041 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526a165-3dad-45ef-aa2f-0834ed6148cf admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:38.083877 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:38.118842 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3733/7441] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:12:37 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:12:38.120500 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526a165-3dad-45ef-aa2f-0834ed6148cf admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:38.137040 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526a165-3dad-45ef-aa2f-0834ed6148cf admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:38.146223 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545bc2c1-7bcd-4f58-b6cc-54537639fff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:38.147523 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bc2c1-7bcd-4f58-b6cc-54537639fff5 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:38.147853 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bc2c1-7bcd-4f58-b6cc-54537639fff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:38.148119 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bc2c1-7bcd-4f58-b6cc-54537639fff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:38.148770 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545bc2c1-7bcd-4f58-b6cc-54537639fff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:38.153319 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545bc2c1-7bcd-4f58-b6cc-54537639fff5 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:38.171196 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056698d4-8f27-4822-a8cf-e6155c30bf8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:38.173396 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3734/7442] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:12:38.177799 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545bc2c1-7bcd-4f58-b6cc-54537639fff5 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:38.179216 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056698d4-8f27-4822-a8cf-e6155c30bf8a service cinder] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:38.190707 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545bc2c1-7bcd-4f58-b6cc-54537639fff5 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:38.197433 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36587b81-f5f7-4219-b79d-c58d812b5669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:38.198163 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36587b81-f5f7-4219-b79d-c58d812b5669 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:38.198620 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36587b81-f5f7-4219-b79d-c58d812b5669 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:38.199017 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36587b81-f5f7-4219-b79d-c58d812b5669 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:38.199772 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36587b81-f5f7-4219-b79d-c58d812b5669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:38.201301 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36587b81-f5f7-4219-b79d-c58d812b5669 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:38.204155 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3709/7443] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:12:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:12:38.218134 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3735/7444] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:12:38.221926 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056698d4-8f27-4822-a8cf-e6155c30bf8a service cinder] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:38.234974 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056698d4-8f27-4822-a8cf-e6155c30bf8a service cinder] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:38.240013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279a772-f473-4a3e-8a74-2b07a698c95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:38.240683 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279a772-f473-4a3e-8a74-2b07a698c95d admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:38.241141 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279a772-f473-4a3e-8a74-2b07a698c95d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:38.241593 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279a772-f473-4a3e-8a74-2b07a698c95d admin admin] PATH_INFO: `/v3/projects/d14a453454b34be6878326461de9dbb8/users/d8c6e1c4dbc64157818f973eb34d1766/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:38.265860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6279a772-f473-4a3e-8a74-2b07a698c95d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d14a453454b34be6878326461de9dbb8, user_id=d8c6e1c4dbc64157818f973eb34d1766, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:38.274005 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6279a772-f473-4a3e-8a74-2b07a698c95d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:38.307364 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3710/7445] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:12:38 2022] PUT /identity/v3/projects/d14a453454b34be6878326461de9dbb8/users/d8c6e1c4dbc64157818f973eb34d1766/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:12:38.309385 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546d864-2e6f-40c6-9456-542877fd65b9 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:38.309882 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546d864-2e6f-40c6-9456-542877fd65b9 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:38.310074 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546d864-2e6f-40c6-9456-542877fd65b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:38.348631 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-1546d864-2e6f-40c6-9456-542877fd65b9 None None] MFA Rules not processed for user `d8c6e1c4dbc64157818f973eb34d1766`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:12:38.349996 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1546d864-2e6f-40c6-9456-542877fd65b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:38.460650 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279a772-f473-4a3e-8a74-2b07a698c95d admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:38.465570 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6279a772-f473-4a3e-8a74-2b07a698c95d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:38.474616 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3736/7446] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:12:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:12:38.481207 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1546d864-2e6f-40c6-9456-542877fd65b9 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:38.543222 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:38.577399 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279a772-f473-4a3e-8a74-2b07a698c95d admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:38.584905 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d80866-d5a2-45c1-a601-75a569c11331 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:38.585537 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d80866-d5a2-45c1-a601-75a569c11331 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:38.585814 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d80866-d5a2-45c1-a601-75a569c11331 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:38.586080 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d80866-d5a2-45c1-a601-75a569c11331 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:38.591744 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d4d80866-d5a2-45c1-a601-75a569c11331 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:38.618248 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1546d864-2e6f-40c6-9456-542877fd65b9 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:38.628946 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dfb993-4689-4fc0-8356-c184a451d193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:38.629589 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfb993-4689-4fc0-8356-c184a451d193 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:38.629912 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfb993-4689-4fc0-8356-c184a451d193 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:38.630191 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfb993-4689-4fc0-8356-c184a451d193 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:38.631060 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dfb993-4689-4fc0-8356-c184a451d193 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:38.633186 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dfb993-4689-4fc0-8356-c184a451d193 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:38.675204 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3737/7447] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:12:38 2022] POST /identity/v3/projects => generated 375 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:12:38.679201 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dfb993-4689-4fc0-8356-c184a451d193 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:38.696881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d80866-d5a2-45c1-a601-75a569c11331 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:38.698608 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d80866-d5a2-45c1-a601-75a569c11331 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:38.714311 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3711/7448] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:12:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:12:38.755077 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:38.779447 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dfb993-4689-4fc0-8356-c184a451d193 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:38.793613 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9bcd2-7014-453e-b99c-13b50516bed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:38.794254 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9bcd2-7014-453e-b99c-13b50516bed0 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:38.794540 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9bcd2-7014-453e-b99c-13b50516bed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:38.794967 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9bcd2-7014-453e-b99c-13b50516bed0 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:38.795805 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab9bcd2-7014-453e-b99c-13b50516bed0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:38.798490 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab9bcd2-7014-453e-b99c-13b50516bed0 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:38.829274 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3738/7449] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:12:38 2022] POST /identity/v3/users => generated 288 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:12:38.833020 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d80866-d5a2-45c1-a601-75a569c11331 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:38.844340 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d80866-d5a2-45c1-a601-75a569c11331 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:38.850875 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f56097-4a25-4df9-8b36-a3961e4f1cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:38.851602 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f56097-4a25-4df9-8b36-a3961e4f1cab admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:38.851964 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f56097-4a25-4df9-8b36-a3961e4f1cab admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:38.852239 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f56097-4a25-4df9-8b36-a3961e4f1cab admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:38.853620 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f56097-4a25-4df9-8b36-a3961e4f1cab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:38.855564 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f56097-4a25-4df9-8b36-a3961e4f1cab admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:38.871398 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3712/7450] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:12:38.872530 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9bcd2-7014-453e-b99c-13b50516bed0 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:38.891382 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9bcd2-7014-453e-b99c-13b50516bed0 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:38.907347 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708979cb-4310-4fbe-b0da-e133f2508d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:38.908008 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708979cb-4310-4fbe-b0da-e133f2508d01 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:38.908356 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708979cb-4310-4fbe-b0da-e133f2508d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:38.908696 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708979cb-4310-4fbe-b0da-e133f2508d01 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:38.909636 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708979cb-4310-4fbe-b0da-e133f2508d01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:38.912474 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708979cb-4310-4fbe-b0da-e133f2508d01 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:38.938968 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3739/7451] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:12:38.943609 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f56097-4a25-4df9-8b36-a3961e4f1cab admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:38.961280 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f56097-4a25-4df9-8b36-a3961e4f1cab admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:38.967442 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58285d-778f-40f7-80c0-1f89eeebb6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:38.968291 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58285d-778f-40f7-80c0-1f89eeebb6f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:38.968666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58285d-778f-40f7-80c0-1f89eeebb6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:38.969071 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58285d-778f-40f7-80c0-1f89eeebb6f2 admin admin] PATH_INFO: `/v3/projects/b3afe348914447e28c720995f8b255a4/users/f9b8894b21664b2aa9e05db80e81656d/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:39.008169 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe58285d-778f-40f7-80c0-1f89eeebb6f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3afe348914447e28c720995f8b255a4, user_id=f9b8894b21664b2aa9e05db80e81656d, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:39.012481 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe58285d-778f-40f7-80c0-1f89eeebb6f2 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:39.053560 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3713/7452] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:12:38 2022] PUT /identity/v3/projects/b3afe348914447e28c720995f8b255a4/users/f9b8894b21664b2aa9e05db80e81656d/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:12:39.064558 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295333f-f5a3-47f1-bdbe-7c25c2a169e2 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:39.065399 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295333f-f5a3-47f1-bdbe-7c25c2a169e2 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:39.065954 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295333f-f5a3-47f1-bdbe-7c25c2a169e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:39.172047 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-c295333f-f5a3-47f1-bdbe-7c25c2a169e2 None None] MFA Rules not processed for user `f9b8894b21664b2aa9e05db80e81656d`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:12:39.173496 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c295333f-f5a3-47f1-bdbe-7c25c2a169e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:39.350579 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3740/7453] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:12:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:12:39.356559 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58285d-778f-40f7-80c0-1f89eeebb6f2 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:39.463885 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58285d-778f-40f7-80c0-1f89eeebb6f2 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:39.481197 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b9f44-39e4-488c-847a-79be1dd139fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:39.481834 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b9f44-39e4-488c-847a-79be1dd139fe admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:39.482105 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b9f44-39e4-488c-847a-79be1dd139fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:39.482379 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b9f44-39e4-488c-847a-79be1dd139fe admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:39.483048 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b9f44-39e4-488c-847a-79be1dd139fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:39.485243 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b9f44-39e4-488c-847a-79be1dd139fe admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:39.520496 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3714/7454] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:12:39 2022] POST /identity/v3/projects => generated 375 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:12:39.524344 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295333f-f5a3-47f1-bdbe-7c25c2a169e2 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:39.542401 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295333f-f5a3-47f1-bdbe-7c25c2a169e2 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:39.652904 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d6495-e5b2-4396-96c9-f7eb1b6f1120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:39.653835 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d6495-e5b2-4396-96c9-f7eb1b6f1120 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:39.654299 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d6495-e5b2-4396-96c9-f7eb1b6f1120 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:39.654874 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d6495-e5b2-4396-96c9-f7eb1b6f1120 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:39.663418 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8d6495-e5b2-4396-96c9-f7eb1b6f1120 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:39.666637 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8d6495-e5b2-4396-96c9-f7eb1b6f1120 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:39.704260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b9f44-39e4-488c-847a-79be1dd139fe admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:39.720787 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3741/7455] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:12:39 2022] POST /identity/v3/users => generated 294 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:12:39.723082 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b9f44-39e4-488c-847a-79be1dd139fe admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:39.730595 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944603c-bb93-4704-b224-dd8dab1ea858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:39.732410 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944603c-bb93-4704-b224-dd8dab1ea858 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:39.732897 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944603c-bb93-4704-b224-dd8dab1ea858 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:39.734293 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944603c-bb93-4704-b224-dd8dab1ea858 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:39.735180 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5944603c-bb93-4704-b224-dd8dab1ea858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:39.737469 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5944603c-bb93-4704-b224-dd8dab1ea858 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:39.763433 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d6495-e5b2-4396-96c9-f7eb1b6f1120 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:39.770718 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3715/7456] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:12:39.776052 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d6495-e5b2-4396-96c9-f7eb1b6f1120 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:39.780987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9cf6a-6f65-470c-88b7-684e7900af86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:39.781915 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9cf6a-6f65-470c-88b7-684e7900af86 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:39.782196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9cf6a-6f65-470c-88b7-684e7900af86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:39.782468 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9cf6a-6f65-470c-88b7-684e7900af86 admin admin] PATH_INFO: `/v3/projects/450e0a2cde064a4ea6e4a814786b9b1e/users/db8cdc6f3a364caeb65643f6e4a926e3/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:39.800540 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d9cf6a-6f65-470c-88b7-684e7900af86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=450e0a2cde064a4ea6e4a814786b9b1e, user_id=db8cdc6f3a364caeb65643f6e4a926e3, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:39.804107 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d9cf6a-6f65-470c-88b7-684e7900af86 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:39.836008 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3742/7457] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:12:39 2022] PUT /identity/v3/projects/450e0a2cde064a4ea6e4a814786b9b1e/users/db8cdc6f3a364caeb65643f6e4a926e3/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:12:39.837621 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944603c-bb93-4704-b224-dd8dab1ea858 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:39.851273 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944603c-bb93-4704-b224-dd8dab1ea858 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:39.904533 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:40.003473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1590ca-7ecf-4a7b-a1e6-6ce341a951d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:40.004101 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1590ca-7ecf-4a7b-a1e6-6ce341a951d0 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:40.004383 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1590ca-7ecf-4a7b-a1e6-6ce341a951d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:40.004656 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1590ca-7ecf-4a7b-a1e6-6ce341a951d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:40.005312 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1590ca-7ecf-4a7b-a1e6-6ce341a951d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:40.008132 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1590ca-7ecf-4a7b-a1e6-6ce341a951d0 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:40.042485 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3716/7458] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:12:40.043950 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9cf6a-6f65-470c-88b7-684e7900af86 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:40.061936 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9cf6a-6f65-470c-88b7-684e7900af86 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:40.080073 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93fb89a-40ff-4ef3-93e2-10dd37660f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:40.082718 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fb89a-40ff-4ef3-93e2-10dd37660f83 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:40.083309 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fb89a-40ff-4ef3-93e2-10dd37660f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:40.083778 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fb89a-40ff-4ef3-93e2-10dd37660f83 admin admin] PATH_INFO: `/v3/projects/450e0a2cde064a4ea6e4a814786b9b1e/users/db8cdc6f3a364caeb65643f6e4a926e3/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:40.090259 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93fb89a-40ff-4ef3-93e2-10dd37660f83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=450e0a2cde064a4ea6e4a814786b9b1e, user_id=db8cdc6f3a364caeb65643f6e4a926e3, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:40.095986 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93fb89a-40ff-4ef3-93e2-10dd37660f83 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:40.128861 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3743/7459] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:12:40 2022] PUT /identity/v3/projects/450e0a2cde064a4ea6e4a814786b9b1e/users/db8cdc6f3a364caeb65643f6e4a926e3/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:12:40.144425 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74418113-8d34-4abd-812b-c8b56662bd7e None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:40.144850 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74418113-8d34-4abd-812b-c8b56662bd7e None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:40.145311 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74418113-8d34-4abd-812b-c8b56662bd7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:40.180287 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-74418113-8d34-4abd-812b-c8b56662bd7e None None] MFA Rules not processed for user `db8cdc6f3a364caeb65643f6e4a926e3`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:12:40.182569 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-74418113-8d34-4abd-812b-c8b56662bd7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:40.275892 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3717/7460] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:12:40 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:12:40.288703 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93fb89a-40ff-4ef3-93e2-10dd37660f83 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:40.295117 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:40.374303 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93fb89a-40ff-4ef3-93e2-10dd37660f83 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:40.379849 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599ccda-afa4-4fa9-bcd0-d69dddc5bb6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:40.380976 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599ccda-afa4-4fa9-bcd0-d69dddc5bb6a service cinder] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:40.381460 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599ccda-afa4-4fa9-bcd0-d69dddc5bb6a service cinder] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:40.381893 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599ccda-afa4-4fa9-bcd0-d69dddc5bb6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:40.464345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1599ccda-afa4-4fa9-bcd0-d69dddc5bb6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:40.466988 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1599ccda-afa4-4fa9-bcd0-d69dddc5bb6a service cinder] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:40.487699 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3744/7461] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:12:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:12:42.673928 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74418113-8d34-4abd-812b-c8b56662bd7e None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:42.673928 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-74418113-8d34-4abd-812b-c8b56662bd7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:42.937267 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74418113-8d34-4abd-812b-c8b56662bd7e None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:42.948526 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1943a1b-026a-4524-8e2a-57aa2cd174dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:42.949192 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1943a1b-026a-4524-8e2a-57aa2cd174dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:42.949477 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1943a1b-026a-4524-8e2a-57aa2cd174dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:42.949756 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1943a1b-026a-4524-8e2a-57aa2cd174dc admin admin] PATH_INFO: `/v3/users/4715f9eef91a4527834c0bea2013c64e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:42.950942 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1943a1b-026a-4524-8e2a-57aa2cd174dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4715f9eef91a4527834c0bea2013c64e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:42.953664 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1943a1b-026a-4524-8e2a-57aa2cd174dc admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:43.029713 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b1943a1b-026a-4524-8e2a-57aa2cd174dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4715f9eef91a4527834c0bea2013c64e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:43.031345 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b1943a1b-026a-4524-8e2a-57aa2cd174dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4715f9eef91a4527834c0bea2013c64e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:43.034612 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:43.052993 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b1943a1b-026a-4524-8e2a-57aa2cd174dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4715f9eef91a4527834c0bea2013c64e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:43.064742 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b1943a1b-026a-4524-8e2a-57aa2cd174dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4715f9eef91a4527834c0bea2013c64e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:43.079635 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b1943a1b-026a-4524-8e2a-57aa2cd174dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4715f9eef91a4527834c0bea2013c64e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:43.104917 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3718/7462] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:12:42 2022] DELETE /identity/v3/users/4715f9eef91a4527834c0bea2013c64e => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:12:43.403926 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599ccda-afa4-4fa9-bcd0-d69dddc5bb6a service cinder] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:43.420471 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599ccda-afa4-4fa9-bcd0-d69dddc5bb6a service cinder] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:43.515154 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1943a1b-026a-4524-8e2a-57aa2cd174dc admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:43.516883 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b1943a1b-026a-4524-8e2a-57aa2cd174dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:43.525315 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85466b6a-b33f-4f10-b3ea-747cd237271f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:43.526504 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85466b6a-b33f-4f10-b3ea-747cd237271f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:43.526973 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85466b6a-b33f-4f10-b3ea-747cd237271f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:43.527534 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85466b6a-b33f-4f10-b3ea-747cd237271f admin admin] PATH_INFO: `/v3/projects/f47facd299984b15bd4ee07e0d4bc61c` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:43.529576 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85466b6a-b33f-4f10-b3ea-747cd237271f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f47facd299984b15bd4ee07e0d4bc61c)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:43.532716 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85466b6a-b33f-4f10-b3ea-747cd237271f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:43.622340 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1943a1b-026a-4524-8e2a-57aa2cd174dc admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:43.623358 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-85466b6a-b33f-4f10-b3ea-747cd237271f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f47facd299984b15bd4ee07e0d4bc61c', 'request_id': 'req-85466b6a-b33f-4f10-b3ea-747cd237271f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:43.631797 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-85466b6a-b33f-4f10-b3ea-747cd237271f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f47facd299984b15bd4ee07e0d4bc61c', 'request_id': 'req-85466b6a-b33f-4f10-b3ea-747cd237271f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:43.633300 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:43.644140 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-85466b6a-b33f-4f10-b3ea-747cd237271f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f47facd299984b15bd4ee07e0d4bc61c', 'request_id': 'req-85466b6a-b33f-4f10-b3ea-747cd237271f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:43.670525 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-85466b6a-b33f-4f10-b3ea-747cd237271f admin admin] The token cache is being invalidate because project f47facd299984b15bd4ee07e0d4bc61c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:12:43.671367 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-85466b6a-b33f-4f10-b3ea-747cd237271f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:43.672313 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-85466b6a-b33f-4f10-b3ea-747cd237271f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:43.674616 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3745/7463] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:12:43 2022] DELETE /identity/v3/projects/f47facd299984b15bd4ee07e0d4bc61c => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:12:43.680505 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85466b6a-b33f-4f10-b3ea-747cd237271f admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:43.683893 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-85466b6a-b33f-4f10-b3ea-747cd237271f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:43.700003 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f8a5cc-88df-4511-a300-de768f508010 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:43.700861 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8a5cc-88df-4511-a300-de768f508010 service cinder] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:43.701150 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8a5cc-88df-4511-a300-de768f508010 service cinder] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:43.701914 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8a5cc-88df-4511-a300-de768f508010 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:43.705220 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-51f8a5cc-88df-4511-a300-de768f508010 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:43.804349 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85466b6a-b33f-4f10-b3ea-747cd237271f admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:43.810432 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d0702f-81a8-42ea-8553-069fd7284192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:43.811457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0702f-81a8-42ea-8553-069fd7284192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:43.811786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0702f-81a8-42ea-8553-069fd7284192 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:43.812060 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0702f-81a8-42ea-8553-069fd7284192 admin admin] PATH_INFO: `/v3/users/d5ecf2022a0a4a58b4b105f8e971d71e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:43.813200 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d0702f-81a8-42ea-8553-069fd7284192 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5ecf2022a0a4a58b4b105f8e971d71e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:43.815399 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d0702f-81a8-42ea-8553-069fd7284192 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:43.818167 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f8a5cc-88df-4511-a300-de768f508010 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:43.819955 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f8a5cc-88df-4511-a300-de768f508010 service cinder] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:43.838238 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3719/7464] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:12:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:12:43.889549 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e3d0702f-81a8-42ea-8553-069fd7284192 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5ecf2022a0a4a58b4b105f8e971d71e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:43.890761 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e3d0702f-81a8-42ea-8553-069fd7284192 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5ecf2022a0a4a58b4b105f8e971d71e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:43.908109 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e3d0702f-81a8-42ea-8553-069fd7284192 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5ecf2022a0a4a58b4b105f8e971d71e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:43.920568 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e3d0702f-81a8-42ea-8553-069fd7284192 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5ecf2022a0a4a58b4b105f8e971d71e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:43.921557 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e3d0702f-81a8-42ea-8553-069fd7284192 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5ecf2022a0a4a58b4b105f8e971d71e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:43.949656 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3746/7465] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:12:43 2022] DELETE /identity/v3/users/d5ecf2022a0a4a58b4b105f8e971d71e => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:12:44.354504 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f8a5cc-88df-4511-a300-de768f508010 service cinder] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:44.369089 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f8a5cc-88df-4511-a300-de768f508010 service cinder] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:44.425343 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:44.512180 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194f974-f30a-4264-9bb1-5de66eaa4490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:44.517528 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194f974-f30a-4264-9bb1-5de66eaa4490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:44.518466 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194f974-f30a-4264-9bb1-5de66eaa4490 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:44.519332 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194f974-f30a-4264-9bb1-5de66eaa4490 admin admin] PATH_INFO: `/v3/projects/91fbd3c7dc4042f689b55b774b8f1af3` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:44.523039 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5194f974-f30a-4264-9bb1-5de66eaa4490 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91fbd3c7dc4042f689b55b774b8f1af3)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:44.528632 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5194f974-f30a-4264-9bb1-5de66eaa4490 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:44.554622 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d0702f-81a8-42ea-8553-069fd7284192 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:44.556894 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e3d0702f-81a8-42ea-8553-069fd7284192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:44.587873 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d0702f-81a8-42ea-8553-069fd7284192 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:44.600120 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed382acd-a23c-4fff-bb72-336de81563b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:44.600716 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed382acd-a23c-4fff-bb72-336de81563b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:44.601176 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed382acd-a23c-4fff-bb72-336de81563b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:44.601624 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed382acd-a23c-4fff-bb72-336de81563b9 admin admin] PATH_INFO: `/v3/users/f075974a803f46eda667db6d754453ba` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:44.604712 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed382acd-a23c-4fff-bb72-336de81563b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f075974a803f46eda667db6d754453ba)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:44.609138 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed382acd-a23c-4fff-bb72-336de81563b9 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:44.650880 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5194f974-f30a-4264-9bb1-5de66eaa4490 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91fbd3c7dc4042f689b55b774b8f1af3', 'request_id': 'req-5194f974-f30a-4264-9bb1-5de66eaa4490'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:44.674206 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5194f974-f30a-4264-9bb1-5de66eaa4490 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91fbd3c7dc4042f689b55b774b8f1af3', 'request_id': 'req-5194f974-f30a-4264-9bb1-5de66eaa4490'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:44.698374 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5194f974-f30a-4264-9bb1-5de66eaa4490 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91fbd3c7dc4042f689b55b774b8f1af3', 'request_id': 'req-5194f974-f30a-4264-9bb1-5de66eaa4490'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:44.716556 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5194f974-f30a-4264-9bb1-5de66eaa4490 admin admin] The token cache is being invalidate because project 91fbd3c7dc4042f689b55b774b8f1af3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:12:44.717403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5194f974-f30a-4264-9bb1-5de66eaa4490 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:44.718102 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5194f974-f30a-4264-9bb1-5de66eaa4490 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:44.718983 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ed382acd-a23c-4fff-bb72-336de81563b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f075974a803f46eda667db6d754453ba'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:44.720124 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ed382acd-a23c-4fff-bb72-336de81563b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f075974a803f46eda667db6d754453ba'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:44.731545 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3720/7466] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:12:44 2022] DELETE /identity/v3/projects/91fbd3c7dc4042f689b55b774b8f1af3 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:12:44.736327 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ed382acd-a23c-4fff-bb72-336de81563b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f075974a803f46eda667db6d754453ba'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:44.750530 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=78,keystone:INSERT=3,keystone:DELETE=19 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:44.754203 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ed382acd-a23c-4fff-bb72-336de81563b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f075974a803f46eda667db6d754453ba'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:44.756126 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ed382acd-a23c-4fff-bb72-336de81563b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f075974a803f46eda667db6d754453ba'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:44.804242 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3747/7467] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:12:44 2022] DELETE /identity/v3/users/f075974a803f46eda667db6d754453ba => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:12:44.922863 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194f974-f30a-4264-9bb1-5de66eaa4490 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:44.924849 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5194f974-f30a-4264-9bb1-5de66eaa4490 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:45.081062 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194f974-f30a-4264-9bb1-5de66eaa4490 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:45.145697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed382acd-a23c-4fff-bb72-336de81563b9 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:45.147296 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ed382acd-a23c-4fff-bb72-336de81563b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:45.215464 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884afe6a-038a-41f0-af96-f52ac25943fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:45.216182 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884afe6a-038a-41f0-af96-f52ac25943fd service cinder] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:45.216462 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884afe6a-038a-41f0-af96-f52ac25943fd service cinder] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:45.216735 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884afe6a-038a-41f0-af96-f52ac25943fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:45.219583 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-884afe6a-038a-41f0-af96-f52ac25943fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:45.294577 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed382acd-a23c-4fff-bb72-336de81563b9 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:45.302997 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:45.309693 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8973a415-343b-4b56-ab7c-2f00f45cc6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:45.310359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973a415-343b-4b56-ab7c-2f00f45cc6e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:45.310632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973a415-343b-4b56-ab7c-2f00f45cc6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:45.310897 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973a415-343b-4b56-ab7c-2f00f45cc6e3 admin admin] PATH_INFO: `/v3/projects/8cf22730fb014345a7ed2aeb866bbe61` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:45.312640 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8973a415-343b-4b56-ab7c-2f00f45cc6e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cf22730fb014345a7ed2aeb866bbe61)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:45.314243 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8973a415-343b-4b56-ab7c-2f00f45cc6e3 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:45.350564 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884afe6a-038a-41f0-af96-f52ac25943fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:45.352071 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884afe6a-038a-41f0-af96-f52ac25943fd service cinder] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:45.366149 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3721/7468] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:12:44 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:12:45.402217 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8973a415-343b-4b56-ab7c-2f00f45cc6e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cf22730fb014345a7ed2aeb866bbe61', 'request_id': 'req-8973a415-343b-4b56-ab7c-2f00f45cc6e3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:45.410472 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8973a415-343b-4b56-ab7c-2f00f45cc6e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cf22730fb014345a7ed2aeb866bbe61', 'request_id': 'req-8973a415-343b-4b56-ab7c-2f00f45cc6e3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:45.417599 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8973a415-343b-4b56-ab7c-2f00f45cc6e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cf22730fb014345a7ed2aeb866bbe61', 'request_id': 'req-8973a415-343b-4b56-ab7c-2f00f45cc6e3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:45.437787 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8973a415-343b-4b56-ab7c-2f00f45cc6e3 admin admin] The token cache is being invalidate because project 8cf22730fb014345a7ed2aeb866bbe61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:12:45.438213 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8973a415-343b-4b56-ab7c-2f00f45cc6e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:45.439900 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8973a415-343b-4b56-ab7c-2f00f45cc6e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:45.442494 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3748/7469] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:12:45 2022] DELETE /identity/v3/projects/8cf22730fb014345a7ed2aeb866bbe61 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:12:45.449241 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd24cc-a340-4342-833f-edb5e0f2d955 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:45.449740 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd24cc-a340-4342-833f-edb5e0f2d955 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:45.450398 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd24cc-a340-4342-833f-edb5e0f2d955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:45.506956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-aabd24cc-a340-4342-833f-edb5e0f2d955 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:12:45.512808 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-aabd24cc-a340-4342-833f-edb5e0f2d955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:45.672635 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3722/7470] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:12:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:12:45.681516 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701bc0c-352e-4d39-8d5e-84499178eb76 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:45.682244 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701bc0c-352e-4d39-8d5e-84499178eb76 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:45.682244 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701bc0c-352e-4d39-8d5e-84499178eb76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:45.711925 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-e701bc0c-352e-4d39-8d5e-84499178eb76 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:12:45.713862 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e701bc0c-352e-4d39-8d5e-84499178eb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:45.730306 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3749/7471] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:12:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:12:45.734286 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd24cc-a340-4342-833f-edb5e0f2d955 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:45.749861 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd24cc-a340-4342-833f-edb5e0f2d955 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:45.759795 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5910834c-ed84-4c7a-8f0a-dea8f93494c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:45.760430 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910834c-ed84-4c7a-8f0a-dea8f93494c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:45.760712 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910834c-ed84-4c7a-8f0a-dea8f93494c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:45.761047 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910834c-ed84-4c7a-8f0a-dea8f93494c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:45.762167 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5910834c-ed84-4c7a-8f0a-dea8f93494c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:12:45.762482 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5910834c-ed84-4c7a-8f0a-dea8f93494c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:45.764264 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5910834c-ed84-4c7a-8f0a-dea8f93494c4 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:45.789801 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3723/7472] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:12:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:12:45.791088 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701bc0c-352e-4d39-8d5e-84499178eb76 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:45.804376 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701bc0c-352e-4d39-8d5e-84499178eb76 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:45.813312 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559808c3-32fc-4d52-8dd7-abc8ffd7ea62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:45.814160 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559808c3-32fc-4d52-8dd7-abc8ffd7ea62 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:45.814503 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559808c3-32fc-4d52-8dd7-abc8ffd7ea62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:45.814503 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559808c3-32fc-4d52-8dd7-abc8ffd7ea62 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:45.817343 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559808c3-32fc-4d52-8dd7-abc8ffd7ea62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:45.819108 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559808c3-32fc-4d52-8dd7-abc8ffd7ea62 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:45.857501 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3750/7473] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:12:45 2022] POST /identity/v3/projects => generated 397 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:12:45.861545 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5910834c-ed84-4c7a-8f0a-dea8f93494c4 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:45.874051 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5910834c-ed84-4c7a-8f0a-dea8f93494c4 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:45.948491 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3914e3-7492-4dbd-880f-64dafd6d511a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:45.949204 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3914e3-7492-4dbd-880f-64dafd6d511a admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:45.949549 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3914e3-7492-4dbd-880f-64dafd6d511a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:45.950093 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3914e3-7492-4dbd-880f-64dafd6d511a admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:45.950591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3914e3-7492-4dbd-880f-64dafd6d511a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:45.952804 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3914e3-7492-4dbd-880f-64dafd6d511a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:45.979782 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3724/7474] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:12:45 2022] POST /identity/v3/users => generated 299 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:12:45.981415 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559808c3-32fc-4d52-8dd7-abc8ffd7ea62 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:45.994475 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559808c3-32fc-4d52-8dd7-abc8ffd7ea62 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:45.999314 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a052c6-6c3f-419e-b58a-e63251602b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:45.999985 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a052c6-6c3f-419e-b58a-e63251602b06 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:46.000330 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a052c6-6c3f-419e-b58a-e63251602b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:46.000669 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a052c6-6c3f-419e-b58a-e63251602b06 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:46.001376 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a052c6-6c3f-419e-b58a-e63251602b06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:46.003080 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a052c6-6c3f-419e-b58a-e63251602b06 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:46.013689 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3751/7475] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:12:46.017524 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3914e3-7492-4dbd-880f-64dafd6d511a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:46.028456 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3914e3-7492-4dbd-880f-64dafd6d511a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:46.033305 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fbe914-2753-46b6-a7da-341473e3871b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:46.033904 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fbe914-2753-46b6-a7da-341473e3871b admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:46.034300 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fbe914-2753-46b6-a7da-341473e3871b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:46.034580 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fbe914-2753-46b6-a7da-341473e3871b admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:46.035252 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fbe914-2753-46b6-a7da-341473e3871b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:46.036919 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fbe914-2753-46b6-a7da-341473e3871b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:46.050940 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3725/7476] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:12:46.055009 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a052c6-6c3f-419e-b58a-e63251602b06 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:46.065301 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a052c6-6c3f-419e-b58a-e63251602b06 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:46.069971 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623b0ca-d8ec-4831-9227-265cb57ad090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:46.070626 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623b0ca-d8ec-4831-9227-265cb57ad090 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:46.070902 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623b0ca-d8ec-4831-9227-265cb57ad090 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:46.071195 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623b0ca-d8ec-4831-9227-265cb57ad090 admin admin] PATH_INFO: `/v3/projects/ac255c28da36470cbc14243137e75fea/users/69af47f499d34232b8c857f5d2fdf91f/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:46.088219 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6623b0ca-d8ec-4831-9227-265cb57ad090 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac255c28da36470cbc14243137e75fea, user_id=69af47f499d34232b8c857f5d2fdf91f, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:46.090954 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6623b0ca-d8ec-4831-9227-265cb57ad090 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:46.105915 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3752/7477] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:12:46 2022] PUT /identity/v3/projects/ac255c28da36470cbc14243137e75fea/users/69af47f499d34232b8c857f5d2fdf91f/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:12:46.111081 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1caa8-68ec-47a2-9b70-abaa50f27cbf None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:46.111443 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1caa8-68ec-47a2-9b70-abaa50f27cbf None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:46.111786 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1caa8-68ec-47a2-9b70-abaa50f27cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:46.131173 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-72e1caa8-68ec-47a2-9b70-abaa50f27cbf None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:12:46.132373 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-72e1caa8-68ec-47a2-9b70-abaa50f27cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:46.168928 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:46.200354 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3726/7478] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:12:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:12:46.210132 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623b0ca-d8ec-4831-9227-265cb57ad090 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:46.211903 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6623b0ca-d8ec-4831-9227-265cb57ad090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:46.218838 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:46.279463 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623b0ca-d8ec-4831-9227-265cb57ad090 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:46.283203 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba8c0ea-b913-49b6-8e74-98e36e706934 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:46.283824 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8c0ea-b913-49b6-8e74-98e36e706934 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:46.284306 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8c0ea-b913-49b6-8e74-98e36e706934 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:46.284581 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8c0ea-b913-49b6-8e74-98e36e706934 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:46.296289 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba8c0ea-b913-49b6-8e74-98e36e706934 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:46.297754 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba8c0ea-b913-49b6-8e74-98e36e706934 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:46.308996 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3753/7479] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:12:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:12:48.636652 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e1caa8-68ec-47a2-9b70-abaa50f27cbf None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:48.678439 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e1caa8-68ec-47a2-9b70-abaa50f27cbf None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:48.690087 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66adbf3f-3435-4e98-b893-8a20237f77f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:48.690087 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66adbf3f-3435-4e98-b893-8a20237f77f6 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:48.699172 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66adbf3f-3435-4e98-b893-8a20237f77f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:48.699578 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66adbf3f-3435-4e98-b893-8a20237f77f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:48.704083 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-66adbf3f-3435-4e98-b893-8a20237f77f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:48.854067 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66adbf3f-3435-4e98-b893-8a20237f77f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:48.856512 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66adbf3f-3435-4e98-b893-8a20237f77f6 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:48.876833 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3727/7480] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:12:48 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:12:55.267572 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3e791-959a-41bb-a7c3-e4b5ec22f6ad None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:55.268072 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3e791-959a-41bb-a7c3-e4b5ec22f6ad None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:55.268277 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3e791-959a-41bb-a7c3-e4b5ec22f6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:55.381795 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-6ba3e791-959a-41bb-a7c3-e4b5ec22f6ad None None] MFA Rules not processed for user `69af47f499d34232b8c857f5d2fdf91f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:12:55.383503 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6ba3e791-959a-41bb-a7c3-e4b5ec22f6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:55.532973 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f858ddf-37b5-4b93-8743-413e1e6eae5b None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:55.533552 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f858ddf-37b5-4b93-8743-413e1e6eae5b None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:55.533682 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3754/7481] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:12:55 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:12:55.533783 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f858ddf-37b5-4b93-8743-413e1e6eae5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:55.574440 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-6f858ddf-37b5-4b93-8743-413e1e6eae5b None None] MFA Rules not processed for user `69af47f499d34232b8c857f5d2fdf91f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:12:55.576600 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6f858ddf-37b5-4b93-8743-413e1e6eae5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:55.598984 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3728/7482] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:12:55 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:12:55.611050 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba3e791-959a-41bb-a7c3-e4b5ec22f6ad None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:55.612631 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6ba3e791-959a-41bb-a7c3-e4b5ec22f6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:55.797344 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba3e791-959a-41bb-a7c3-e4b5ec22f6ad None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:55.815182 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da81a9d-de69-4167-aa7c-a1b73cfb3cdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:55.815845 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da81a9d-de69-4167-aa7c-a1b73cfb3cdd service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:55.816131 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da81a9d-de69-4167-aa7c-a1b73cfb3cdd service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:55.816408 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da81a9d-de69-4167-aa7c-a1b73cfb3cdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:55.839320 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da81a9d-de69-4167-aa7c-a1b73cfb3cdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:55.842772 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da81a9d-de69-4167-aa7c-a1b73cfb3cdd service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:55.865851 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3755/7483] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:12:55 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:12:55.895830 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f858ddf-37b5-4b93-8743-413e1e6eae5b None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:55.897623 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6f858ddf-37b5-4b93-8743-413e1e6eae5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:56.010017 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f858ddf-37b5-4b93-8743-413e1e6eae5b None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:56.013724 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d76e5-3f8b-482b-8823-ab7c9e9a210a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6b0f9835ed549cab91d684326be83fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:56.014338 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d76e5-3f8b-482b-8823-ab7c9e9a210a service glance] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:56.014616 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d76e5-3f8b-482b-8823-ab7c9e9a210a service glance] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:56.014884 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d76e5-3f8b-482b-8823-ab7c9e9a210a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:56.016692 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-463d76e5-3f8b-482b-8823-ab7c9e9a210a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:56.041552 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d76e5-3f8b-482b-8823-ab7c9e9a210a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:56.044088 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d76e5-3f8b-482b-8823-ab7c9e9a210a service glance] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:56.084797 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3729/7484] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:12:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:12:56.450756 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da81a9d-de69-4167-aa7c-a1b73cfb3cdd service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:56.454776 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1da81a9d-de69-4167-aa7c-a1b73cfb3cdd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:56.483241 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da81a9d-de69-4167-aa7c-a1b73cfb3cdd service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:56.496909 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d305c-4bd6-438e-98a7-30f65c591f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:56.499392 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d305c-4bd6-438e-98a7-30f65c591f95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:56.499694 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d305c-4bd6-438e-98a7-30f65c591f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:56.500259 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d305c-4bd6-438e-98a7-30f65c591f95 admin admin] PATH_INFO: `/v3/users/d8c6e1c4dbc64157818f973eb34d1766` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:56.502034 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d305c-4bd6-438e-98a7-30f65c591f95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8c6e1c4dbc64157818f973eb34d1766)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:56.507078 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d305c-4bd6-438e-98a7-30f65c591f95 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:56.551932 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d76e5-3f8b-482b-8823-ab7c9e9a210a service glance] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:56.582723 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d76e5-3f8b-482b-8823-ab7c9e9a210a service glance] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:56.594066 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:56.599805 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b990e-c402-458f-8cf5-49a077c43c4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:56.600448 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b990e-c402-458f-8cf5-49a077c43c4f service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:56.600725 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b990e-c402-458f-8cf5-49a077c43c4f service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:56.600997 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b990e-c402-458f-8cf5-49a077c43c4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:56.609344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2e4b990e-c402-458f-8cf5-49a077c43c4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:56.668283 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b990e-c402-458f-8cf5-49a077c43c4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:56.669767 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b990e-c402-458f-8cf5-49a077c43c4f service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:56.716405 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3c1d305c-4bd6-438e-98a7-30f65c591f95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8c6e1c4dbc64157818f973eb34d1766'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:56.717820 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3c1d305c-4bd6-438e-98a7-30f65c591f95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8c6e1c4dbc64157818f973eb34d1766'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:56.724202 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3730/7485] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:12:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:12:56.747617 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3c1d305c-4bd6-438e-98a7-30f65c591f95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8c6e1c4dbc64157818f973eb34d1766'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:56.761602 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3c1d305c-4bd6-438e-98a7-30f65c591f95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8c6e1c4dbc64157818f973eb34d1766'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:56.762991 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3c1d305c-4bd6-438e-98a7-30f65c591f95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8c6e1c4dbc64157818f973eb34d1766'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:56.817622 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e33850-af70-46ff-b7dc-f1ce847f5a0b None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:56.817846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e33850-af70-46ff-b7dc-f1ce847f5a0b None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:56.818138 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e33850-af70-46ff-b7dc-f1ce847f5a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:56.832951 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3756/7486] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:12:56 2022] DELETE /identity/v3/users/d8c6e1c4dbc64157818f973eb34d1766 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:12:56.863311 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-50e33850-af70-46ff-b7dc-f1ce847f5a0b None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:12:56.867939 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-50e33850-af70-46ff-b7dc-f1ce847f5a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:57.012494 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:57.035270 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3731/7487] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:12:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:12:57.053854 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d305c-4bd6-438e-98a7-30f65c591f95 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:57.055429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3c1d305c-4bd6-438e-98a7-30f65c591f95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:57.223575 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d305c-4bd6-438e-98a7-30f65c591f95 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:57.237124 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b515801b-f81c-42df-8e1c-e1c21ff2657e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:57.238773 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515801b-f81c-42df-8e1c-e1c21ff2657e service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:57.239191 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515801b-f81c-42df-8e1c-e1c21ff2657e service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:57.239560 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515801b-f81c-42df-8e1c-e1c21ff2657e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:57.261110 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b515801b-f81c-42df-8e1c-e1c21ff2657e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:57.263553 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b515801b-f81c-42df-8e1c-e1c21ff2657e service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:57.276261 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3757/7488] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:12:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:12:57.565800 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e33850-af70-46ff-b7dc-f1ce847f5a0b None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:57.587413 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e33850-af70-46ff-b7dc-f1ce847f5a0b None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:57.607394 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d926fd4-9dba-496d-a038-b31a2765a94e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:57.609318 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d926fd4-9dba-496d-a038-b31a2765a94e service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:57.609808 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d926fd4-9dba-496d-a038-b31a2765a94e service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:57.610452 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d926fd4-9dba-496d-a038-b31a2765a94e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:57.613468 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5d926fd4-9dba-496d-a038-b31a2765a94e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:57.841862 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d926fd4-9dba-496d-a038-b31a2765a94e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:57.853024 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b515801b-f81c-42df-8e1c-e1c21ff2657e service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:57.855779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b515801b-f81c-42df-8e1c-e1c21ff2657e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:57.862576 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d926fd4-9dba-496d-a038-b31a2765a94e service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:57.879903 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b515801b-f81c-42df-8e1c-e1c21ff2657e service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:57.895773 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a7d7b5-3aa5-45e9-9c5e-1a7f8179143d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:57.896812 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7d7b5-3aa5-45e9-9c5e-1a7f8179143d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:57.898359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7d7b5-3aa5-45e9-9c5e-1a7f8179143d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:57.898865 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7d7b5-3aa5-45e9-9c5e-1a7f8179143d admin admin] PATH_INFO: `/v3/projects/d14a453454b34be6878326461de9dbb8` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:57.903103 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a7d7b5-3aa5-45e9-9c5e-1a7f8179143d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d14a453454b34be6878326461de9dbb8)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:57.909421 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a7d7b5-3aa5-45e9-9c5e-1a7f8179143d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:57.911932 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3732/7489] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:12:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:12:58.018596 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-44a7d7b5-3aa5-45e9-9c5e-1a7f8179143d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd14a453454b34be6878326461de9dbb8', 'request_id': 'req-44a7d7b5-3aa5-45e9-9c5e-1a7f8179143d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:58.027236 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-44a7d7b5-3aa5-45e9-9c5e-1a7f8179143d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd14a453454b34be6878326461de9dbb8', 'request_id': 'req-44a7d7b5-3aa5-45e9-9c5e-1a7f8179143d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:58.039271 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-44a7d7b5-3aa5-45e9-9c5e-1a7f8179143d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd14a453454b34be6878326461de9dbb8', 'request_id': 'req-44a7d7b5-3aa5-45e9-9c5e-1a7f8179143d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:58.066835 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-44a7d7b5-3aa5-45e9-9c5e-1a7f8179143d admin admin] The token cache is being invalidate because project d14a453454b34be6878326461de9dbb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:12:58.068814 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-44a7d7b5-3aa5-45e9-9c5e-1a7f8179143d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:58.070273 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-44a7d7b5-3aa5-45e9-9c5e-1a7f8179143d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:58.074103 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3758/7490] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:12:57 2022] DELETE /identity/v3/projects/d14a453454b34be6878326461de9dbb8 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:12:58.077508 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d926fd4-9dba-496d-a038-b31a2765a94e service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:58.095412 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d926fd4-9dba-496d-a038-b31a2765a94e service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:58.193112 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018cf03d-24c9-4db0-8c8c-dbf10ddc9d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:58.194133 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cf03d-24c9-4db0-8c8c-dbf10ddc9d0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:58.194517 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cf03d-24c9-4db0-8c8c-dbf10ddc9d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:58.194806 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cf03d-24c9-4db0-8c8c-dbf10ddc9d0f admin admin] PATH_INFO: `/v3/users/f9b8894b21664b2aa9e05db80e81656d` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:58.197038 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018cf03d-24c9-4db0-8c8c-dbf10ddc9d0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9b8894b21664b2aa9e05db80e81656d)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:58.199070 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018cf03d-24c9-4db0-8c8c-dbf10ddc9d0f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:58.262988 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-018cf03d-24c9-4db0-8c8c-dbf10ddc9d0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9b8894b21664b2aa9e05db80e81656d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:58.263417 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-018cf03d-24c9-4db0-8c8c-dbf10ddc9d0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9b8894b21664b2aa9e05db80e81656d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:58.289418 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-018cf03d-24c9-4db0-8c8c-dbf10ddc9d0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9b8894b21664b2aa9e05db80e81656d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:58.303462 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-018cf03d-24c9-4db0-8c8c-dbf10ddc9d0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9b8894b21664b2aa9e05db80e81656d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:58.320566 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-018cf03d-24c9-4db0-8c8c-dbf10ddc9d0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9b8894b21664b2aa9e05db80e81656d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:58.330123 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3733/7491] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:12:58 2022] DELETE /identity/v3/users/f9b8894b21664b2aa9e05db80e81656d => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:12:58.933786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a7d7b5-3aa5-45e9-9c5e-1a7f8179143d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:58.935277 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-44a7d7b5-3aa5-45e9-9c5e-1a7f8179143d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:58.953968 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a7d7b5-3aa5-45e9-9c5e-1a7f8179143d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:58.981186 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:59.080893 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f3273-1ed4-49d1-8ddc-f6f3f0c2889a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:59.082325 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f3273-1ed4-49d1-8ddc-f6f3f0c2889a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:59.082675 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f3273-1ed4-49d1-8ddc-f6f3f0c2889a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:59.083063 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f3273-1ed4-49d1-8ddc-f6f3f0c2889a admin admin] PATH_INFO: `/v3/projects/b3afe348914447e28c720995f8b255a4` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:59.084511 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980f3273-1ed4-49d1-8ddc-f6f3f0c2889a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3afe348914447e28c720995f8b255a4)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:59.086773 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980f3273-1ed4-49d1-8ddc-f6f3f0c2889a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:59.193715 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-980f3273-1ed4-49d1-8ddc-f6f3f0c2889a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3afe348914447e28c720995f8b255a4', 'request_id': 'req-980f3273-1ed4-49d1-8ddc-f6f3f0c2889a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:59.209377 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-980f3273-1ed4-49d1-8ddc-f6f3f0c2889a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3afe348914447e28c720995f8b255a4', 'request_id': 'req-980f3273-1ed4-49d1-8ddc-f6f3f0c2889a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:59.220522 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-980f3273-1ed4-49d1-8ddc-f6f3f0c2889a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3afe348914447e28c720995f8b255a4', 'request_id': 'req-980f3273-1ed4-49d1-8ddc-f6f3f0c2889a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:59.244746 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-980f3273-1ed4-49d1-8ddc-f6f3f0c2889a admin admin] The token cache is being invalidate because project b3afe348914447e28c720995f8b255a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:12:59.258765 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-980f3273-1ed4-49d1-8ddc-f6f3f0c2889a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:59.263312 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-980f3273-1ed4-49d1-8ddc-f6f3f0c2889a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:59.269530 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3759/7492] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:12:58 2022] DELETE /identity/v3/projects/b3afe348914447e28c720995f8b255a4 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:12:59.273691 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018cf03d-24c9-4db0-8c8c-dbf10ddc9d0f admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:59.275419 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-018cf03d-24c9-4db0-8c8c-dbf10ddc9d0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:59.284260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:59.301501 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018cf03d-24c9-4db0-8c8c-dbf10ddc9d0f admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:59.468737 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7fa125-e5d6-4957-a50b-a153a24fa717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:59.469408 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7fa125-e5d6-4957-a50b-a153a24fa717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:59.469686 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7fa125-e5d6-4957-a50b-a153a24fa717 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:59.469960 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7fa125-e5d6-4957-a50b-a153a24fa717 admin admin] PATH_INFO: `/v3/users/db8cdc6f3a364caeb65643f6e4a926e3` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:59.471164 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7fa125-e5d6-4957-a50b-a153a24fa717 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db8cdc6f3a364caeb65643f6e4a926e3)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:59.473117 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7fa125-e5d6-4957-a50b-a153a24fa717 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:59.574612 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8e7fa125-e5d6-4957-a50b-a153a24fa717 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db8cdc6f3a364caeb65643f6e4a926e3'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:59.575399 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8e7fa125-e5d6-4957-a50b-a153a24fa717 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db8cdc6f3a364caeb65643f6e4a926e3'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:59.596087 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8e7fa125-e5d6-4957-a50b-a153a24fa717 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db8cdc6f3a364caeb65643f6e4a926e3'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:59.608704 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8e7fa125-e5d6-4957-a50b-a153a24fa717 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db8cdc6f3a364caeb65643f6e4a926e3'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:59.621099 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8e7fa125-e5d6-4957-a50b-a153a24fa717 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db8cdc6f3a364caeb65643f6e4a926e3'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:59.632080 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3734/7493] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:12:59 2022] DELETE /identity/v3/users/db8cdc6f3a364caeb65643f6e4a926e3 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:13:00.184823 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f3273-1ed4-49d1-8ddc-f6f3f0c2889a admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:00.186841 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-980f3273-1ed4-49d1-8ddc-f6f3f0c2889a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:00.222469 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f3273-1ed4-49d1-8ddc-f6f3f0c2889a admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:00.370005 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e34a91-37bc-4f29-b028-b8dd0aa1fd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:00.371347 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e34a91-37bc-4f29-b028-b8dd0aa1fd31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:00.371834 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e34a91-37bc-4f29-b028-b8dd0aa1fd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:00.372274 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e34a91-37bc-4f29-b028-b8dd0aa1fd31 admin admin] PATH_INFO: `/v3/projects/450e0a2cde064a4ea6e4a814786b9b1e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:00.378650 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e34a91-37bc-4f29-b028-b8dd0aa1fd31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=450e0a2cde064a4ea6e4a814786b9b1e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:00.381172 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e34a91-37bc-4f29-b028-b8dd0aa1fd31 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:00.468272 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-14e34a91-37bc-4f29-b028-b8dd0aa1fd31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '450e0a2cde064a4ea6e4a814786b9b1e', 'request_id': 'req-14e34a91-37bc-4f29-b028-b8dd0aa1fd31'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:13:00.471244 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:00.477224 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-14e34a91-37bc-4f29-b028-b8dd0aa1fd31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '450e0a2cde064a4ea6e4a814786b9b1e', 'request_id': 'req-14e34a91-37bc-4f29-b028-b8dd0aa1fd31'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:13:00.488886 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-14e34a91-37bc-4f29-b028-b8dd0aa1fd31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '450e0a2cde064a4ea6e4a814786b9b1e', 'request_id': 'req-14e34a91-37bc-4f29-b028-b8dd0aa1fd31'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:13:00.508202 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-14e34a91-37bc-4f29-b028-b8dd0aa1fd31 admin admin] The token cache is being invalidate because project 450e0a2cde064a4ea6e4a814786b9b1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:13:00.508637 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-14e34a91-37bc-4f29-b028-b8dd0aa1fd31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:13:00.512723 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-14e34a91-37bc-4f29-b028-b8dd0aa1fd31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:13:00.520764 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3760/7494] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:13:00 2022] DELETE /identity/v3/projects/450e0a2cde064a4ea6e4a814786b9b1e => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:13:00.524557 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c2e16-42f5-4c8a-a30e-f6f890a3aa09 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:00.526813 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c2e16-42f5-4c8a-a30e-f6f890a3aa09 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:00.527741 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c2e16-42f5-4c8a-a30e-f6f890a3aa09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:00.579538 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-f68c2e16-42f5-4c8a-a30e-f6f890a3aa09 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:13:00.580993 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f68c2e16-42f5-4c8a-a30e-f6f890a3aa09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:00.744533 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3735/7495] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:13:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:13:00.752236 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb4f33-8edd-4239-95b5-5909e63d519c None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:00.752545 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb4f33-8edd-4239-95b5-5909e63d519c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:00.752825 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb4f33-8edd-4239-95b5-5909e63d519c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:00.774895 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-84cb4f33-8edd-4239-95b5-5909e63d519c None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:13:00.776160 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-84cb4f33-8edd-4239-95b5-5909e63d519c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:00.785891 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3761/7496] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:13:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:13:00.791212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c2e16-42f5-4c8a-a30e-f6f890a3aa09 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:00.803472 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c2e16-42f5-4c8a-a30e-f6f890a3aa09 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:00.810319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f807ad3a-7a68-4192-9e1d-037819aae298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:00.811187 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807ad3a-7a68-4192-9e1d-037819aae298 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:00.811683 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807ad3a-7a68-4192-9e1d-037819aae298 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:00.812074 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807ad3a-7a68-4192-9e1d-037819aae298 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:00.812837 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f807ad3a-7a68-4192-9e1d-037819aae298 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:13:00.813274 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f807ad3a-7a68-4192-9e1d-037819aae298 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:00.814989 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f807ad3a-7a68-4192-9e1d-037819aae298 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:00.834829 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3736/7497] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:13:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:13:00.836242 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb4f33-8edd-4239-95b5-5909e63d519c None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:00.851538 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb4f33-8edd-4239-95b5-5909e63d519c None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:00.858444 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5541a-1544-478e-a777-0cb5bf34f8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:00.859705 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5541a-1544-478e-a777-0cb5bf34f8d8 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:00.862608 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5541a-1544-478e-a777-0cb5bf34f8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:00.862902 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5541a-1544-478e-a777-0cb5bf34f8d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:00.863599 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a5541a-1544-478e-a777-0cb5bf34f8d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:00.865799 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a5541a-1544-478e-a777-0cb5bf34f8d8 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:00.912715 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3762/7498] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:13:00 2022] POST /identity/v3/projects => generated 369 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:13:00.917919 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f807ad3a-7a68-4192-9e1d-037819aae298 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:00.936397 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f807ad3a-7a68-4192-9e1d-037819aae298 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:00.945374 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:01.033766 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed828681-babd-499e-9dff-82a1f98d9927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:01.034758 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed828681-babd-499e-9dff-82a1f98d9927 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:01.035310 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed828681-babd-499e-9dff-82a1f98d9927 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:01.035809 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed828681-babd-499e-9dff-82a1f98d9927 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:01.036669 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed828681-babd-499e-9dff-82a1f98d9927 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:01.038858 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed828681-babd-499e-9dff-82a1f98d9927 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:01.067788 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3737/7499] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:13:00 2022] POST /identity/v3/users => generated 285 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:13:01.071840 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5541a-1544-478e-a777-0cb5bf34f8d8 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:01.083746 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5541a-1544-478e-a777-0cb5bf34f8d8 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:01.092621 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef1d10-9a8b-41e0-9c94-1f5391ff6786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:01.093332 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef1d10-9a8b-41e0-9c94-1f5391ff6786 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:01.093676 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef1d10-9a8b-41e0-9c94-1f5391ff6786 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:01.094019 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef1d10-9a8b-41e0-9c94-1f5391ff6786 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:01.094753 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef1d10-9a8b-41e0-9c94-1f5391ff6786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:01.096491 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef1d10-9a8b-41e0-9c94-1f5391ff6786 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:01.115052 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3763/7500] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:13:01.115864 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed828681-babd-499e-9dff-82a1f98d9927 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:01.126260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed828681-babd-499e-9dff-82a1f98d9927 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:01.131410 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c22d2-689b-4195-895d-879c2426cffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:01.132122 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c22d2-689b-4195-895d-879c2426cffa admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:01.132461 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c22d2-689b-4195-895d-879c2426cffa admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:01.132806 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c22d2-689b-4195-895d-879c2426cffa admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:01.133514 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35c22d2-689b-4195-895d-879c2426cffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:01.135840 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35c22d2-689b-4195-895d-879c2426cffa admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:01.149982 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3738/7501] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:13:01.152980 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef1d10-9a8b-41e0-9c94-1f5391ff6786 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:01.163777 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef1d10-9a8b-41e0-9c94-1f5391ff6786 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:01.169591 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd68c3-9a65-4bd5-88ba-7911b92f0f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:01.170260 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd68c3-9a65-4bd5-88ba-7911b92f0f4e admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:01.170543 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd68c3-9a65-4bd5-88ba-7911b92f0f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:01.170816 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd68c3-9a65-4bd5-88ba-7911b92f0f4e admin admin] PATH_INFO: `/v3/projects/c0a840077ad6444fbb7fe478736313bc/users/dfb41defd884427b9e2c6dd9cbac02f5/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:01.188854 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cd68c3-9a65-4bd5-88ba-7911b92f0f4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0a840077ad6444fbb7fe478736313bc, user_id=dfb41defd884427b9e2c6dd9cbac02f5, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:01.191697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cd68c3-9a65-4bd5-88ba-7911b92f0f4e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:01.207750 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3764/7502] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:13:01 2022] PUT /identity/v3/projects/c0a840077ad6444fbb7fe478736313bc/users/dfb41defd884427b9e2c6dd9cbac02f5/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:13:01.219899 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f704d9c-3062-4e90-aa8c-fb8169b720f1 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:01.220358 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f704d9c-3062-4e90-aa8c-fb8169b720f1 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:01.220539 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f704d9c-3062-4e90-aa8c-fb8169b720f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:01.252941 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-4f704d9c-3062-4e90-aa8c-fb8169b720f1 None None] MFA Rules not processed for user `dfb41defd884427b9e2c6dd9cbac02f5`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:13:01.254347 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4f704d9c-3062-4e90-aa8c-fb8169b720f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:01.336202 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3739/7503] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:13:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:13:01.346266 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd68c3-9a65-4bd5-88ba-7911b92f0f4e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:01.348225 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-10cd68c3-9a65-4bd5-88ba-7911b92f0f4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:01.437188 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd68c3-9a65-4bd5-88ba-7911b92f0f4e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:01.441648 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b70d3b4-9b8c-4860-85be-e779621fcc2d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6b0f9835ed549cab91d684326be83fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:01.442272 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b70d3b4-9b8c-4860-85be-e779621fcc2d service glance] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:01.442548 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b70d3b4-9b8c-4860-85be-e779621fcc2d service glance] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:01.442820 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b70d3b4-9b8c-4860-85be-e779621fcc2d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:01.459885 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b70d3b4-9b8c-4860-85be-e779621fcc2d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:01.462633 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b70d3b4-9b8c-4860-85be-e779621fcc2d service glance] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:01.473533 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3765/7504] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:13:01 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:13:02.084695 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f704d9c-3062-4e90-aa8c-fb8169b720f1 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:02.086193 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4f704d9c-3062-4e90-aa8c-fb8169b720f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:02.172433 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f704d9c-3062-4e90-aa8c-fb8169b720f1 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:02.177904 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267267f-7841-49b1-a831-b04af3fec30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:02.178568 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267267f-7841-49b1-a831-b04af3fec30c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:02.178846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267267f-7841-49b1-a831-b04af3fec30c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:02.179199 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267267f-7841-49b1-a831-b04af3fec30c admin admin] PATH_INFO: `/v3/users/b3cf02b0895c466083ceb64604e02327` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:02.181624 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2267267f-7841-49b1-a831-b04af3fec30c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3cf02b0895c466083ceb64604e02327)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:02.183825 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2267267f-7841-49b1-a831-b04af3fec30c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:02.209255 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:02.256238 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2267267f-7841-49b1-a831-b04af3fec30c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3cf02b0895c466083ceb64604e02327'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:13:02.256992 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2267267f-7841-49b1-a831-b04af3fec30c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3cf02b0895c466083ceb64604e02327'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:13:02.270689 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2267267f-7841-49b1-a831-b04af3fec30c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3cf02b0895c466083ceb64604e02327'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:13:02.282258 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2267267f-7841-49b1-a831-b04af3fec30c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3cf02b0895c466083ceb64604e02327'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:13:02.294185 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2267267f-7841-49b1-a831-b04af3fec30c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3cf02b0895c466083ceb64604e02327'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:13:02.301546 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3740/7505] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:13:02 2022] DELETE /identity/v3/users/b3cf02b0895c466083ceb64604e02327 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:13:02.306920 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49fbffd-a40e-499e-81ce-dae010956958 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:02.309257 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49fbffd-a40e-499e-81ce-dae010956958 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:02.309931 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49fbffd-a40e-499e-81ce-dae010956958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:02.332905 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-f49fbffd-a40e-499e-81ce-dae010956958 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:13:02.334214 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f49fbffd-a40e-499e-81ce-dae010956958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:02.426842 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3766/7506] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:13:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:13:02.438508 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267267f-7841-49b1-a831-b04af3fec30c admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:02.440274 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2267267f-7841-49b1-a831-b04af3fec30c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:02.518681 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267267f-7841-49b1-a831-b04af3fec30c admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:02.524070 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74afb8e8-6fcb-41d2-99b6-c4d3487c301e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:02.524956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74afb8e8-6fcb-41d2-99b6-c4d3487c301e service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:02.524956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74afb8e8-6fcb-41d2-99b6-c4d3487c301e service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:02.525971 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74afb8e8-6fcb-41d2-99b6-c4d3487c301e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:02.545598 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74afb8e8-6fcb-41d2-99b6-c4d3487c301e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:02.547451 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74afb8e8-6fcb-41d2-99b6-c4d3487c301e service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:02.560996 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3741/7507] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:13:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:13:02.896768 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49fbffd-a40e-499e-81ce-dae010956958 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:02.898429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f49fbffd-a40e-499e-81ce-dae010956958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:02.912883 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49fbffd-a40e-499e-81ce-dae010956958 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:02.920075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09410b5a-97bd-42cd-9724-4fd8c62b4072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:02.920740 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09410b5a-97bd-42cd-9724-4fd8c62b4072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:02.921024 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09410b5a-97bd-42cd-9724-4fd8c62b4072 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:02.921296 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09410b5a-97bd-42cd-9724-4fd8c62b4072 admin admin] PATH_INFO: `/v3/projects/194d3aa213384918be55cb78a064d069` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:02.922502 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09410b5a-97bd-42cd-9724-4fd8c62b4072 admin admin] RBAC: Authorizing `identity:delete_project(project_id=194d3aa213384918be55cb78a064d069)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:02.924862 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09410b5a-97bd-42cd-9724-4fd8c62b4072 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:02.952493 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:02.999456 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-09410b5a-97bd-42cd-9724-4fd8c62b4072 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '194d3aa213384918be55cb78a064d069', 'request_id': 'req-09410b5a-97bd-42cd-9724-4fd8c62b4072'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:13:03.009413 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-09410b5a-97bd-42cd-9724-4fd8c62b4072 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '194d3aa213384918be55cb78a064d069', 'request_id': 'req-09410b5a-97bd-42cd-9724-4fd8c62b4072'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:13:03.016981 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-09410b5a-97bd-42cd-9724-4fd8c62b4072 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '194d3aa213384918be55cb78a064d069', 'request_id': 'req-09410b5a-97bd-42cd-9724-4fd8c62b4072'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:13:03.034103 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-09410b5a-97bd-42cd-9724-4fd8c62b4072 admin admin] The token cache is being invalidate because project 194d3aa213384918be55cb78a064d069 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:13:03.034409 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-09410b5a-97bd-42cd-9724-4fd8c62b4072 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:13:03.036277 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-09410b5a-97bd-42cd-9724-4fd8c62b4072 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:13:03.042115 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3767/7508] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:13:02 2022] DELETE /identity/v3/projects/194d3aa213384918be55cb78a064d069 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:13:03.044601 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc90911-e74a-4713-bf58-126f1eb59a68 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:03.044891 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc90911-e74a-4713-bf58-126f1eb59a68 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:03.045172 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc90911-e74a-4713-bf58-126f1eb59a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:03.095539 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-afc90911-e74a-4713-bf58-126f1eb59a68 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:13:03.097710 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-afc90911-e74a-4713-bf58-126f1eb59a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:03.173705 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3742/7509] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:13:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:13:03.183950 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b061c-70e5-4663-87e0-3fde43bd3bcd None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:03.184798 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b061c-70e5-4663-87e0-3fde43bd3bcd None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:03.184798 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b061c-70e5-4663-87e0-3fde43bd3bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:03.210559 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-fb9b061c-70e5-4663-87e0-3fde43bd3bcd None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:13:03.211877 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-fb9b061c-70e5-4663-87e0-3fde43bd3bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:03.224157 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3768/7510] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:13:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:13:03.230056 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc90911-e74a-4713-bf58-126f1eb59a68 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:03.242597 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc90911-e74a-4713-bf58-126f1eb59a68 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:03.252558 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd957f-9707-4d6b-8981-d8f7a1cc239d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:03.253889 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd957f-9707-4d6b-8981-d8f7a1cc239d admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:03.254166 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd957f-9707-4d6b-8981-d8f7a1cc239d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:03.254435 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd957f-9707-4d6b-8981-d8f7a1cc239d admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:03.255135 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd957f-9707-4d6b-8981-d8f7a1cc239d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:13:03.256337 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd957f-9707-4d6b-8981-d8f7a1cc239d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:03.258144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd957f-9707-4d6b-8981-d8f7a1cc239d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:03.272180 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3743/7511] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:13:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:13:03.276991 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b061c-70e5-4663-87e0-3fde43bd3bcd None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:03.288037 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b061c-70e5-4663-87e0-3fde43bd3bcd None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:03.293861 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ac8a6-aac4-43ec-a365-a83f0904ab40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:03.294480 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ac8a6-aac4-43ec-a365-a83f0904ab40 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:03.294894 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ac8a6-aac4-43ec-a365-a83f0904ab40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:03.295216 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ac8a6-aac4-43ec-a365-a83f0904ab40 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:03.295853 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52ac8a6-aac4-43ec-a365-a83f0904ab40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:03.298940 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52ac8a6-aac4-43ec-a365-a83f0904ab40 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:03.333283 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3769/7512] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:13:03 2022] POST /identity/v3/projects => generated 389 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:13:03.338086 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd957f-9707-4d6b-8981-d8f7a1cc239d admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:03.348713 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd957f-9707-4d6b-8981-d8f7a1cc239d admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:03.380238 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:03.424565 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643dad08-4d25-4da1-a85d-29448e4dcf84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:03.425603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643dad08-4d25-4da1-a85d-29448e4dcf84 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:03.425877 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643dad08-4d25-4da1-a85d-29448e4dcf84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:03.426146 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643dad08-4d25-4da1-a85d-29448e4dcf84 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:03.426781 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643dad08-4d25-4da1-a85d-29448e4dcf84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:03.428764 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643dad08-4d25-4da1-a85d-29448e4dcf84 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:03.454909 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3744/7513] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:13:03 2022] POST /identity/v3/users => generated 295 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:13:03.458632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ac8a6-aac4-43ec-a365-a83f0904ab40 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:03.471995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ac8a6-aac4-43ec-a365-a83f0904ab40 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:03.480196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274cf91-d1db-4121-a587-0b33e35998d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:03.481196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274cf91-d1db-4121-a587-0b33e35998d0 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:03.481775 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274cf91-d1db-4121-a587-0b33e35998d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:03.482120 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274cf91-d1db-4121-a587-0b33e35998d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:03.482908 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7274cf91-d1db-4121-a587-0b33e35998d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:03.484667 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7274cf91-d1db-4121-a587-0b33e35998d0 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:03.499219 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3770/7514] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:13:03.500442 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643dad08-4d25-4da1-a85d-29448e4dcf84 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:03.512057 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643dad08-4d25-4da1-a85d-29448e4dcf84 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:03.516896 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbead85b-88c9-43f2-8391-54471f7642a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:03.517507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbead85b-88c9-43f2-8391-54471f7642a8 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:03.517777 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbead85b-88c9-43f2-8391-54471f7642a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:03.518043 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbead85b-88c9-43f2-8391-54471f7642a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:03.518685 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbead85b-88c9-43f2-8391-54471f7642a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:03.520313 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbead85b-88c9-43f2-8391-54471f7642a8 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:03.533750 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3745/7515] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:13:03.538401 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274cf91-d1db-4121-a587-0b33e35998d0 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:03.552911 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274cf91-d1db-4121-a587-0b33e35998d0 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:03.559663 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283bfa9f-ecda-4a7e-9094-32dc1819f2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:03.560340 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283bfa9f-ecda-4a7e-9094-32dc1819f2f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:03.560665 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283bfa9f-ecda-4a7e-9094-32dc1819f2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:03.560964 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283bfa9f-ecda-4a7e-9094-32dc1819f2f3 admin admin] PATH_INFO: `/v3/projects/e8971b1ee2b842588adbd7dc5d7552a0/users/86ff3f40c7224251ae1346fc60f361f9/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:03.577142 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283bfa9f-ecda-4a7e-9094-32dc1819f2f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8971b1ee2b842588adbd7dc5d7552a0, user_id=86ff3f40c7224251ae1346fc60f361f9, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:03.580223 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283bfa9f-ecda-4a7e-9094-32dc1819f2f3 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:03.595367 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3771/7516] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:13:03 2022] PUT /identity/v3/projects/e8971b1ee2b842588adbd7dc5d7552a0/users/86ff3f40c7224251ae1346fc60f361f9/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:13:03.606476 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f02300-020e-499e-bff8-e65e47651bb0 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:03.606763 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f02300-020e-499e-bff8-e65e47651bb0 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:03.607095 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f02300-020e-499e-bff8-e65e47651bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:03.636719 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-32f02300-020e-499e-bff8-e65e47651bb0 None None] MFA Rules not processed for user `86ff3f40c7224251ae1346fc60f361f9`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:13:03.637942 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-32f02300-020e-499e-bff8-e65e47651bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:03.715212 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3746/7517] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:13:03 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:13:03.719714 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283bfa9f-ecda-4a7e-9094-32dc1819f2f3 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:03.807688 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283bfa9f-ecda-4a7e-9094-32dc1819f2f3 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:03.823313 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68f916-2917-4080-ab2e-f431cc8350db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:03.824096 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68f916-2917-4080-ab2e-f431cc8350db admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:03.824366 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68f916-2917-4080-ab2e-f431cc8350db admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:03.824663 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68f916-2917-4080-ab2e-f431cc8350db admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:03.825288 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea68f916-2917-4080-ab2e-f431cc8350db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:03.827899 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea68f916-2917-4080-ab2e-f431cc8350db admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:03.863470 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3772/7518] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:13:03 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:13:03.867195 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f02300-020e-499e-bff8-e65e47651bb0 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:03.881968 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f02300-020e-499e-bff8-e65e47651bb0 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:03.950875 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545895b-d765-4b93-9b51-a0de90ae573f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:03.951553 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545895b-d765-4b93-9b51-a0de90ae573f admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:03.951837 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545895b-d765-4b93-9b51-a0de90ae573f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:03.952111 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545895b-d765-4b93-9b51-a0de90ae573f admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:03.952746 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b545895b-d765-4b93-9b51-a0de90ae573f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:03.954695 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b545895b-d765-4b93-9b51-a0de90ae573f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:03.983084 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3747/7519] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:13:03 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:13:03.985528 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68f916-2917-4080-ab2e-f431cc8350db admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:03.997684 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68f916-2917-4080-ab2e-f431cc8350db admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:04.002938 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e1e24-5a78-4569-9f3e-579194d7c7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:04.003596 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e1e24-5a78-4569-9f3e-579194d7c7a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:04.003916 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e1e24-5a78-4569-9f3e-579194d7c7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:04.004180 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e1e24-5a78-4569-9f3e-579194d7c7a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:04.004838 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e1e24-5a78-4569-9f3e-579194d7c7a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:04.006432 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e1e24-5a78-4569-9f3e-579194d7c7a9 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:04.022735 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3773/7520] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:13:04.023951 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545895b-d765-4b93-9b51-a0de90ae573f admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:04.035288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545895b-d765-4b93-9b51-a0de90ae573f admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:04.040078 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a65ee81-3055-43fc-9337-cdf86ed73c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:04.040798 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65ee81-3055-43fc-9337-cdf86ed73c78 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:04.041082 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65ee81-3055-43fc-9337-cdf86ed73c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:04.041355 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65ee81-3055-43fc-9337-cdf86ed73c78 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:04.041997 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a65ee81-3055-43fc-9337-cdf86ed73c78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:04.043647 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a65ee81-3055-43fc-9337-cdf86ed73c78 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:04.059309 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3748/7521] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:13:04.060837 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e1e24-5a78-4569-9f3e-579194d7c7a9 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:04.071787 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e1e24-5a78-4569-9f3e-579194d7c7a9 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:04.080418 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fd877f-78af-4e65-b368-f47ca1a4d521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:04.081748 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd877f-78af-4e65-b368-f47ca1a4d521 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:04.083217 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd877f-78af-4e65-b368-f47ca1a4d521 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:04.083653 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd877f-78af-4e65-b368-f47ca1a4d521 admin admin] PATH_INFO: `/v3/projects/4cbefe49f14d460698d1271801b625d9/users/7e706be876af40be8a552950625dcf4b/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:04.100797 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:04.108220 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fd877f-78af-4e65-b368-f47ca1a4d521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cbefe49f14d460698d1271801b625d9, user_id=7e706be876af40be8a552950625dcf4b, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:04.111541 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fd877f-78af-4e65-b368-f47ca1a4d521 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:04.128190 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3774/7522] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:13:04 2022] PUT /identity/v3/projects/4cbefe49f14d460698d1271801b625d9/users/7e706be876af40be8a552950625dcf4b/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:13:04.140589 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1dc0e-f64f-4dbf-b716-8634e2604781 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:04.141123 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1dc0e-f64f-4dbf-b716-8634e2604781 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:04.141123 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1dc0e-f64f-4dbf-b716-8634e2604781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:04.176283 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:04.187422 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-4ff1dc0e-f64f-4dbf-b716-8634e2604781 None None] MFA Rules not processed for user `7e706be876af40be8a552950625dcf4b`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:13:04.188663 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4ff1dc0e-f64f-4dbf-b716-8634e2604781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:04.267929 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3749/7523] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:13:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:13:04.272838 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fd877f-78af-4e65-b368-f47ca1a4d521 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:04.356508 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fd877f-78af-4e65-b368-f47ca1a4d521 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:04.362715 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeeecf1-dce9-4ac3-9d66-dc241dc9f252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:04.363662 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeeecf1-dce9-4ac3-9d66-dc241dc9f252 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:04.364118 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeeecf1-dce9-4ac3-9d66-dc241dc9f252 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:04.364569 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeeecf1-dce9-4ac3-9d66-dc241dc9f252 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:04.365266 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeeecf1-dce9-4ac3-9d66-dc241dc9f252 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:04.367276 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeeecf1-dce9-4ac3-9d66-dc241dc9f252 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:04.401891 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3775/7524] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:13:04 2022] POST /identity/v3/projects => generated 387 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:13:04.406911 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1dc0e-f64f-4dbf-b716-8634e2604781 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:04.423151 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1dc0e-f64f-4dbf-b716-8634e2604781 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:04.497657 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564845b3-6025-46c9-bfa0-3f9cb993e589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:04.498270 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564845b3-6025-46c9-bfa0-3f9cb993e589 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:04.498550 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564845b3-6025-46c9-bfa0-3f9cb993e589 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:04.498823 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564845b3-6025-46c9-bfa0-3f9cb993e589 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:04.499544 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564845b3-6025-46c9-bfa0-3f9cb993e589 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:04.501579 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564845b3-6025-46c9-bfa0-3f9cb993e589 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:04.528235 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3750/7525] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:13:04 2022] POST /identity/v3/users => generated 300 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:13:04.529481 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeeecf1-dce9-4ac3-9d66-dc241dc9f252 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:04.543207 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeeecf1-dce9-4ac3-9d66-dc241dc9f252 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:04.548785 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0cf033-a167-465f-accc-b2371358b2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:04.549809 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0cf033-a167-465f-accc-b2371358b2fa admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:04.550198 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0cf033-a167-465f-accc-b2371358b2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:04.550546 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0cf033-a167-465f-accc-b2371358b2fa admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:04.551414 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0cf033-a167-465f-accc-b2371358b2fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:04.553242 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0cf033-a167-465f-accc-b2371358b2fa admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:04.568320 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3776/7526] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:13:04.572723 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564845b3-6025-46c9-bfa0-3f9cb993e589 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:04.588572 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564845b3-6025-46c9-bfa0-3f9cb993e589 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:04.593758 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b8d17-dad3-439e-af4b-128d9403de39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:04.594430 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b8d17-dad3-439e-af4b-128d9403de39 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:04.594707 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b8d17-dad3-439e-af4b-128d9403de39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:04.595006 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b8d17-dad3-439e-af4b-128d9403de39 admin admin] PATH_INFO: `/v3/projects/00c5f486cc50452e913c2e54517b9496/users/2b558a731c1d4b08b05a8bc05b784db9/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:04.614171 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42b8d17-dad3-439e-af4b-128d9403de39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00c5f486cc50452e913c2e54517b9496, user_id=2b558a731c1d4b08b05a8bc05b784db9, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:04.620414 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42b8d17-dad3-439e-af4b-128d9403de39 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:04.635578 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3751/7527] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:13:04 2022] PUT /identity/v3/projects/00c5f486cc50452e913c2e54517b9496/users/2b558a731c1d4b08b05a8bc05b784db9/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:13:04.640920 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0cf033-a167-465f-accc-b2371358b2fa admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:04.654901 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0cf033-a167-465f-accc-b2371358b2fa admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:04.719761 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a7faa-cc5f-4741-a65f-ee7b976cfa48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:04.720697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a7faa-cc5f-4741-a65f-ee7b976cfa48 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:04.720987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a7faa-cc5f-4741-a65f-ee7b976cfa48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:04.721258 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a7faa-cc5f-4741-a65f-ee7b976cfa48 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:04.721989 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a7faa-cc5f-4741-a65f-ee7b976cfa48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:04.724676 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a7faa-cc5f-4741-a65f-ee7b976cfa48 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:04.737546 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3777/7528] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:13:04.741378 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b8d17-dad3-439e-af4b-128d9403de39 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:04.759317 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b8d17-dad3-439e-af4b-128d9403de39 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:04.764819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20455a31-1a6c-4ec3-8535-c22d0bdba1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:04.766332 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20455a31-1a6c-4ec3-8535-c22d0bdba1d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:04.766332 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20455a31-1a6c-4ec3-8535-c22d0bdba1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:04.766332 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20455a31-1a6c-4ec3-8535-c22d0bdba1d8 admin admin] PATH_INFO: `/v3/projects/00c5f486cc50452e913c2e54517b9496/users/2b558a731c1d4b08b05a8bc05b784db9/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:04.771321 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20455a31-1a6c-4ec3-8535-c22d0bdba1d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00c5f486cc50452e913c2e54517b9496, user_id=2b558a731c1d4b08b05a8bc05b784db9, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:04.774881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20455a31-1a6c-4ec3-8535-c22d0bdba1d8 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:04.787868 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3752/7529] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:13:04 2022] PUT /identity/v3/projects/00c5f486cc50452e913c2e54517b9496/users/2b558a731c1d4b08b05a8bc05b784db9/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:13:04.801445 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65726a1d-9904-4d07-987e-5ee6cdaf3113 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:04.802050 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65726a1d-9904-4d07-987e-5ee6cdaf3113 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:04.802331 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65726a1d-9904-4d07-987e-5ee6cdaf3113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:04.838855 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-65726a1d-9904-4d07-987e-5ee6cdaf3113 None None] MFA Rules not processed for user `2b558a731c1d4b08b05a8bc05b784db9`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:13:04.840328 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-65726a1d-9904-4d07-987e-5ee6cdaf3113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:04.900384 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:04.926712 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3778/7530] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:13:04 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:13:04.941216 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20455a31-1a6c-4ec3-8535-c22d0bdba1d8 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:04.943141 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-20455a31-1a6c-4ec3-8535-c22d0bdba1d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:05.012703 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:05.041990 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20455a31-1a6c-4ec3-8535-c22d0bdba1d8 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:05.048798 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8e074-4aec-4c4c-bcfc-64f662cdde95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:05.049685 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8e074-4aec-4c4c-bcfc-64f662cdde95 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:05.050102 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8e074-4aec-4c4c-bcfc-64f662cdde95 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:05.050385 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8e074-4aec-4c4c-bcfc-64f662cdde95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:05.119937 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec8e074-4aec-4c4c-bcfc-64f662cdde95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:05.121652 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec8e074-4aec-4c4c-bcfc-64f662cdde95 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:05.134970 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3753/7531] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:13:04 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:13:08.673805 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65726a1d-9904-4d07-987e-5ee6cdaf3113 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:08.676973 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-65726a1d-9904-4d07-987e-5ee6cdaf3113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:08.854749 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65726a1d-9904-4d07-987e-5ee6cdaf3113 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:08.859698 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84f79d-fd66-49a3-832e-343dd911c16b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:08.860842 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84f79d-fd66-49a3-832e-343dd911c16b service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:08.861513 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84f79d-fd66-49a3-832e-343dd911c16b service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:08.862376 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84f79d-fd66-49a3-832e-343dd911c16b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:08.878930 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e84f79d-fd66-49a3-832e-343dd911c16b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:08.881270 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e84f79d-fd66-49a3-832e-343dd911c16b service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:08.898601 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3779/7532] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:13:08 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:13:15.127733 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=31 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:15.225815 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863fa58-594a-4bc5-bd6b-0caa555b53b5 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:15.226182 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863fa58-594a-4bc5-bd6b-0caa555b53b5 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:15.227016 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863fa58-594a-4bc5-bd6b-0caa555b53b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:15.262774 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-1863fa58-594a-4bc5-bd6b-0caa555b53b5 None None] MFA Rules not processed for user `86ff3f40c7224251ae1346fc60f361f9`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:13:15.265315 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1863fa58-594a-4bc5-bd6b-0caa555b53b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:15.291228 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3754/7533] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:13:15 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:13:18.890373 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=33 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:22.240936 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84f79d-fd66-49a3-832e-343dd911c16b service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:22.245353 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7e84f79d-fd66-49a3-832e-343dd911c16b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:22.365080 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84f79d-fd66-49a3-832e-343dd911c16b service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:22.370209 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863fa58-594a-4bc5-bd6b-0caa555b53b5 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:22.373987 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1863fa58-594a-4bc5-bd6b-0caa555b53b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:22.391176 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca4e76-c8e2-43db-b9da-4a8cd2c240b1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:22.394298 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca4e76-c8e2-43db-b9da-4a8cd2c240b1 service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:22.395345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca4e76-c8e2-43db-b9da-4a8cd2c240b1 service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:22.397100 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca4e76-c8e2-43db-b9da-4a8cd2c240b1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:22.401498 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5aca4e76-c8e2-43db-b9da-4a8cd2c240b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:22.436393 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca4e76-c8e2-43db-b9da-4a8cd2c240b1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:22.438874 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca4e76-c8e2-43db-b9da-4a8cd2c240b1 service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:22.470555 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3780/7534] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:13:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:13:22.520207 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863fa58-594a-4bc5-bd6b-0caa555b53b5 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:22.530821 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d43e0c-1f24-4f82-a415-09fb55a46b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:22.534832 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d43e0c-1f24-4f82-a415-09fb55a46b4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:22.535260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d43e0c-1f24-4f82-a415-09fb55a46b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:22.535465 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d43e0c-1f24-4f82-a415-09fb55a46b4e admin admin] PATH_INFO: `/v3/users/69af47f499d34232b8c857f5d2fdf91f` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:22.537601 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d43e0c-1f24-4f82-a415-09fb55a46b4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=69af47f499d34232b8c857f5d2fdf91f)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:22.540291 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d43e0c-1f24-4f82-a415-09fb55a46b4e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:22.606937 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-13d43e0c-1f24-4f82-a415-09fb55a46b4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69af47f499d34232b8c857f5d2fdf91f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:13:22.608474 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-13d43e0c-1f24-4f82-a415-09fb55a46b4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69af47f499d34232b8c857f5d2fdf91f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:13:22.628353 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-13d43e0c-1f24-4f82-a415-09fb55a46b4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69af47f499d34232b8c857f5d2fdf91f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:13:22.638329 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-13d43e0c-1f24-4f82-a415-09fb55a46b4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69af47f499d34232b8c857f5d2fdf91f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:13:22.646434 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-13d43e0c-1f24-4f82-a415-09fb55a46b4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69af47f499d34232b8c857f5d2fdf91f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:13:22.655157 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3755/7535] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:13:22 2022] DELETE /identity/v3/users/69af47f499d34232b8c857f5d2fdf91f => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:13:22.895245 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca4e76-c8e2-43db-b9da-4a8cd2c240b1 service placement] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:22.906776 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca4e76-c8e2-43db-b9da-4a8cd2c240b1 service placement] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:22.980196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207e6a5-15bd-4e9c-9436-112ac0efb678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:22.981032 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207e6a5-15bd-4e9c-9436-112ac0efb678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:22.981573 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207e6a5-15bd-4e9c-9436-112ac0efb678 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:22.981724 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207e6a5-15bd-4e9c-9436-112ac0efb678 admin admin] PATH_INFO: `/v3/projects/ac255c28da36470cbc14243137e75fea` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:22.982972 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1207e6a5-15bd-4e9c-9436-112ac0efb678 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac255c28da36470cbc14243137e75fea)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:22.985123 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1207e6a5-15bd-4e9c-9436-112ac0efb678 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:23.048942 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1207e6a5-15bd-4e9c-9436-112ac0efb678 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac255c28da36470cbc14243137e75fea', 'request_id': 'req-1207e6a5-15bd-4e9c-9436-112ac0efb678'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:13:23.056265 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1207e6a5-15bd-4e9c-9436-112ac0efb678 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac255c28da36470cbc14243137e75fea', 'request_id': 'req-1207e6a5-15bd-4e9c-9436-112ac0efb678'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:13:23.065914 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1207e6a5-15bd-4e9c-9436-112ac0efb678 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac255c28da36470cbc14243137e75fea', 'request_id': 'req-1207e6a5-15bd-4e9c-9436-112ac0efb678'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:13:23.096071 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1207e6a5-15bd-4e9c-9436-112ac0efb678 admin admin] The token cache is being invalidate because project ac255c28da36470cbc14243137e75fea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:13:23.096698 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1207e6a5-15bd-4e9c-9436-112ac0efb678 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:13:23.098130 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1207e6a5-15bd-4e9c-9436-112ac0efb678 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:13:23.100571 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3781/7536] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:13:22 2022] DELETE /identity/v3/projects/ac255c28da36470cbc14243137e75fea => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:13:23.107818 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f687dfa-cdfa-496c-be8a-e791a5cdb66f None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:23.109809 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f687dfa-cdfa-496c-be8a-e791a5cdb66f None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:23.110115 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f687dfa-cdfa-496c-be8a-e791a5cdb66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:23.135241 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-5f687dfa-cdfa-496c-be8a-e791a5cdb66f None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:13:23.136472 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5f687dfa-cdfa-496c-be8a-e791a5cdb66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:23.217827 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3756/7537] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:13:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:13:23.219795 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733a0cd-14cc-46d7-a8dc-26b06e60a0aa None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:23.220077 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733a0cd-14cc-46d7-a8dc-26b06e60a0aa None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:23.220357 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733a0cd-14cc-46d7-a8dc-26b06e60a0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:23.242669 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-6733a0cd-14cc-46d7-a8dc-26b06e60a0aa None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:13:23.244828 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6733a0cd-14cc-46d7-a8dc-26b06e60a0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:23.254476 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3782/7538] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:13:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:13:23.259232 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f687dfa-cdfa-496c-be8a-e791a5cdb66f None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:23.270393 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f687dfa-cdfa-496c-be8a-e791a5cdb66f None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:23.276727 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ebedf-c214-4457-9248-c639593042ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:23.277443 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ebedf-c214-4457-9248-c639593042ad admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:23.277795 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ebedf-c214-4457-9248-c639593042ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:23.278138 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ebedf-c214-4457-9248-c639593042ad admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:23.278872 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446ebedf-c214-4457-9248-c639593042ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:13:23.279274 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446ebedf-c214-4457-9248-c639593042ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:23.280976 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446ebedf-c214-4457-9248-c639593042ad admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:23.291436 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:23.303538 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733a0cd-14cc-46d7-a8dc-26b06e60a0aa None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:23.311309 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3757/7539] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:13:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:13:23.317686 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733a0cd-14cc-46d7-a8dc-26b06e60a0aa None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:23.323856 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282067dc-d532-479e-8bd6-38d657757e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:23.324683 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282067dc-d532-479e-8bd6-38d657757e96 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:23.325200 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282067dc-d532-479e-8bd6-38d657757e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:23.325660 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282067dc-d532-479e-8bd6-38d657757e96 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:23.326467 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282067dc-d532-479e-8bd6-38d657757e96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:23.328654 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282067dc-d532-479e-8bd6-38d657757e96 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:23.342120 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:23.367810 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3783/7540] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:13:23 2022] POST /identity/v3/projects => generated 395 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:13:23.369998 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ebedf-c214-4457-9248-c639593042ad admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:23.381052 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ebedf-c214-4457-9248-c639593042ad admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:23.454636 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99817ff-aa76-4ceb-a9ca-d09acbfdb9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:23.455938 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99817ff-aa76-4ceb-a9ca-d09acbfdb9a2 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:23.456359 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99817ff-aa76-4ceb-a9ca-d09acbfdb9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:23.456830 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99817ff-aa76-4ceb-a9ca-d09acbfdb9a2 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:23.457834 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99817ff-aa76-4ceb-a9ca-d09acbfdb9a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:23.462441 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99817ff-aa76-4ceb-a9ca-d09acbfdb9a2 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:23.492053 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282067dc-d532-479e-8bd6-38d657757e96 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:23.495302 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3758/7541] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:13:23 2022] POST /identity/v3/users => generated 298 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:13:23.506771 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282067dc-d532-479e-8bd6-38d657757e96 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:23.513444 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81392a7f-837e-4cd7-8590-fca34d3a2b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:23.514281 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81392a7f-837e-4cd7-8590-fca34d3a2b84 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:23.514579 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81392a7f-837e-4cd7-8590-fca34d3a2b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:23.516061 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81392a7f-837e-4cd7-8590-fca34d3a2b84 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:23.516061 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81392a7f-837e-4cd7-8590-fca34d3a2b84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:23.518499 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81392a7f-837e-4cd7-8590-fca34d3a2b84 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:23.536095 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99817ff-aa76-4ceb-a9ca-d09acbfdb9a2 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:23.543715 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3784/7542] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:13:23.548966 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99817ff-aa76-4ceb-a9ca-d09acbfdb9a2 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:23.554676 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11359d-63b7-4e68-9d2c-16ec12e387e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:23.556026 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11359d-63b7-4e68-9d2c-16ec12e387e7 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:23.556305 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11359d-63b7-4e68-9d2c-16ec12e387e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:23.557041 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11359d-63b7-4e68-9d2c-16ec12e387e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:23.557740 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b11359d-63b7-4e68-9d2c-16ec12e387e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:23.559531 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b11359d-63b7-4e68-9d2c-16ec12e387e7 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:23.573861 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3759/7543] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:13:23.578238 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81392a7f-837e-4cd7-8590-fca34d3a2b84 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:23.591712 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81392a7f-837e-4cd7-8590-fca34d3a2b84 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:23.602093 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673fa260-3695-44d9-89b5-d4dcc37ac67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:23.603492 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673fa260-3695-44d9-89b5-d4dcc37ac67c admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:23.603717 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673fa260-3695-44d9-89b5-d4dcc37ac67c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:23.603994 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673fa260-3695-44d9-89b5-d4dcc37ac67c admin admin] PATH_INFO: `/v3/projects/392f9e4adbf748c9a83ff7673fc77cb7/users/12de3ef79acd458baaec5e85570c8ae2/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:23.620859 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673fa260-3695-44d9-89b5-d4dcc37ac67c admin admin] RBAC: Authorizing `identity:create_grant(project_id=392f9e4adbf748c9a83ff7673fc77cb7, user_id=12de3ef79acd458baaec5e85570c8ae2, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:23.625569 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673fa260-3695-44d9-89b5-d4dcc37ac67c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:23.651140 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3785/7544] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:13:23 2022] PUT /identity/v3/projects/392f9e4adbf748c9a83ff7673fc77cb7/users/12de3ef79acd458baaec5e85570c8ae2/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:13:23.656297 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c86cca-6b8a-4831-8ee7-18eef46641e9 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:23.656583 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c86cca-6b8a-4831-8ee7-18eef46641e9 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:23.656856 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c86cca-6b8a-4831-8ee7-18eef46641e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:23.680253 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-c9c86cca-6b8a-4831-8ee7-18eef46641e9 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:13:23.683086 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c9c86cca-6b8a-4831-8ee7-18eef46641e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:23.772013 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3760/7545] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:13:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:13:23.795440 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673fa260-3695-44d9-89b5-d4dcc37ac67c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:23.797422 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-673fa260-3695-44d9-89b5-d4dcc37ac67c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:23.895666 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673fa260-3695-44d9-89b5-d4dcc37ac67c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:23.901092 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac4353-82f0-4950-889a-6243927e4cbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:23.901716 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac4353-82f0-4950-889a-6243927e4cbc service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:23.902086 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac4353-82f0-4950-889a-6243927e4cbc service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:23.902503 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac4353-82f0-4950-889a-6243927e4cbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:23.916851 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ac4353-82f0-4950-889a-6243927e4cbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:23.918435 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ac4353-82f0-4950-889a-6243927e4cbc service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:23.929695 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3786/7546] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:13:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:13:24.882292 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3c1f0-c277-4081-807d-76fffc3032f1 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:24.882292 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3c1f0-c277-4081-807d-76fffc3032f1 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:24.883225 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3c1f0-c277-4081-807d-76fffc3032f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:24.908195 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-4ce3c1f0-c277-4081-807d-76fffc3032f1 None None] MFA Rules not processed for user `884be770746c44d29f50c099613f08ed`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:13:24.909647 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4ce3c1f0-c277-4081-807d-76fffc3032f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:25.006364 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3761/7547] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:13:24 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:13:27.298399 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac4353-82f0-4950-889a-6243927e4cbc service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:27.300108 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-93ac4353-82f0-4950-889a-6243927e4cbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:27.327988 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac4353-82f0-4950-889a-6243927e4cbc service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:27.332586 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562110d6-aaff-43f3-896b-000102cad947 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:27.332832 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562110d6-aaff-43f3-896b-000102cad947 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:27.333114 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562110d6-aaff-43f3-896b-000102cad947 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:27.333385 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562110d6-aaff-43f3-896b-000102cad947 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:27.351939 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-562110d6-aaff-43f3-896b-000102cad947 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:27.480698 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562110d6-aaff-43f3-896b-000102cad947 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:27.482214 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562110d6-aaff-43f3-896b-000102cad947 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:27.496891 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3787/7548] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:13:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:13:30.706808 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3c1f0-c277-4081-807d-76fffc3032f1 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:30.750277 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3c1f0-c277-4081-807d-76fffc3032f1 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:30.766818 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384113e1-5ef7-4406-8976-3fdfeca82d78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:30.770420 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384113e1-5ef7-4406-8976-3fdfeca82d78 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:30.772394 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384113e1-5ef7-4406-8976-3fdfeca82d78 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:30.773268 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384113e1-5ef7-4406-8976-3fdfeca82d78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:30.780937 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-384113e1-5ef7-4406-8976-3fdfeca82d78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:30.838091 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384113e1-5ef7-4406-8976-3fdfeca82d78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:30.844398 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384113e1-5ef7-4406-8976-3fdfeca82d78 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:30.883094 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3762/7549] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:13:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:13:32.705726 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c3a4b-1bed-4dbe-850f-c4d692db1bfe None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:32.706568 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c3a4b-1bed-4dbe-850f-c4d692db1bfe None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:32.707056 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c3a4b-1bed-4dbe-850f-c4d692db1bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:32.775837 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a67c3a4b-1bed-4dbe-850f-c4d692db1bfe None None] MFA Rules not processed for user `12de3ef79acd458baaec5e85570c8ae2`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:13:32.777581 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a67c3a4b-1bed-4dbe-850f-c4d692db1bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:32.884359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:32.942895 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3788/7550] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:13:32 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:13:32.954486 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b36cc-e218-464d-97ff-ceceae272ba5 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:32.954982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b36cc-e218-464d-97ff-ceceae272ba5 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:32.955353 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b36cc-e218-464d-97ff-ceceae272ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:32.996038 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-0f2b36cc-e218-464d-97ff-ceceae272ba5 None None] MFA Rules not processed for user `12de3ef79acd458baaec5e85570c8ae2`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:13:32.999659 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0f2b36cc-e218-464d-97ff-ceceae272ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:33.017807 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3763/7551] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:13:32 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:13:33.272125 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c3a4b-1bed-4dbe-850f-c4d692db1bfe None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:33.273930 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a67c3a4b-1bed-4dbe-850f-c4d692db1bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:33.424524 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c3a4b-1bed-4dbe-850f-c4d692db1bfe None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:33.433509 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74718135-b0e7-4fa5-b7ae-f9590ac2be27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:33.434453 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74718135-b0e7-4fa5-b7ae-f9590ac2be27 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:33.434957 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74718135-b0e7-4fa5-b7ae-f9590ac2be27 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:33.436373 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74718135-b0e7-4fa5-b7ae-f9590ac2be27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:33.455311 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74718135-b0e7-4fa5-b7ae-f9590ac2be27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:33.455311 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74718135-b0e7-4fa5-b7ae-f9590ac2be27 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:33.465963 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3789/7552] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:13:33 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:13:33.904949 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b36cc-e218-464d-97ff-ceceae272ba5 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:33.906434 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0f2b36cc-e218-464d-97ff-ceceae272ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:33.936097 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:33.954352 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b36cc-e218-464d-97ff-ceceae272ba5 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:33.965917 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd7744-613a-42c7-8640-bd10c319449f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:33.967660 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd7744-613a-42c7-8640-bd10c319449f service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:33.969159 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd7744-613a-42c7-8640-bd10c319449f service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:33.969742 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd7744-613a-42c7-8640-bd10c319449f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:33.972503 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-abcd7744-613a-42c7-8640-bd10c319449f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:34.006912 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd7744-613a-42c7-8640-bd10c319449f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:34.009167 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd7744-613a-42c7-8640-bd10c319449f service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:34.039594 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3764/7553] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:13:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:13:43.460712 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=40 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:43.742276 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74718135-b0e7-4fa5-b7ae-f9590ac2be27 service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:43.759361 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74718135-b0e7-4fa5-b7ae-f9590ac2be27 service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:43.766036 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c827ebe-c6df-4e93-9f06-0fdce20413c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:43.766920 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c827ebe-c6df-4e93-9f06-0fdce20413c5 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:43.767481 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c827ebe-c6df-4e93-9f06-0fdce20413c5 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:43.768681 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c827ebe-c6df-4e93-9f06-0fdce20413c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:43.770803 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8c827ebe-c6df-4e93-9f06-0fdce20413c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:43.882789 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c827ebe-c6df-4e93-9f06-0fdce20413c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:43.884504 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c827ebe-c6df-4e93-9f06-0fdce20413c5 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:43.896709 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3790/7554] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:13:43 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:13:44.032893 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:45.106700 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd7744-613a-42c7-8640-bd10c319449f service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:45.109524 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-abcd7744-613a-42c7-8640-bd10c319449f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:45.229790 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd7744-613a-42c7-8640-bd10c319449f service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:45.240739 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4458730-1272-4fe9-b939-d8c57e43daf6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:45.245459 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4458730-1272-4fe9-b939-d8c57e43daf6 service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:45.245835 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4458730-1272-4fe9-b939-d8c57e43daf6 service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:45.246233 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4458730-1272-4fe9-b939-d8c57e43daf6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:45.254892 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f4458730-1272-4fe9-b939-d8c57e43daf6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:45.277826 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4458730-1272-4fe9-b939-d8c57e43daf6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:45.281913 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4458730-1272-4fe9-b939-d8c57e43daf6 service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:45.307344 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3765/7555] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:13:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:13:45.522056 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c827ebe-c6df-4e93-9f06-0fdce20413c5 service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:45.541880 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c827ebe-c6df-4e93-9f06-0fdce20413c5 service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:45.546868 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e3b9f-3000-4fa7-9a3e-6fcdc658f717 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:45.547742 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e3b9f-3000-4fa7-9a3e-6fcdc658f717 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:45.548061 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e3b9f-3000-4fa7-9a3e-6fcdc658f717 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:45.548333 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e3b9f-3000-4fa7-9a3e-6fcdc658f717 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:45.550435 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-207e3b9f-3000-4fa7-9a3e-6fcdc658f717 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:45.564691 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207e3b9f-3000-4fa7-9a3e-6fcdc658f717 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:45.566140 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207e3b9f-3000-4fa7-9a3e-6fcdc658f717 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:45.578692 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3791/7556] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:13:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:13:45.704351 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4458730-1272-4fe9-b939-d8c57e43daf6 service placement] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:45.719307 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4458730-1272-4fe9-b939-d8c57e43daf6 service placement] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:45.724128 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa9b63-4402-4fd2-93c8-225b99dff426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:45.724945 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa9b63-4402-4fd2-93c8-225b99dff426 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:45.725302 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa9b63-4402-4fd2-93c8-225b99dff426 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:45.725637 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa9b63-4402-4fd2-93c8-225b99dff426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:45.728470 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-17fa9b63-4402-4fd2-93c8-225b99dff426 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:45.769053 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa9b63-4402-4fd2-93c8-225b99dff426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:45.770730 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa9b63-4402-4fd2-93c8-225b99dff426 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:45.807486 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3766/7557] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:13:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:13:49.392282 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e3b9f-3000-4fa7-9a3e-6fcdc658f717 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:49.395079 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-207e3b9f-3000-4fa7-9a3e-6fcdc658f717 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:49.511374 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e3b9f-3000-4fa7-9a3e-6fcdc658f717 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:49.517679 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f118b6e-1cbb-4694-a54c-2e94f9090483 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:49.519411 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f118b6e-1cbb-4694-a54c-2e94f9090483 service swift] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:49.519714 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f118b6e-1cbb-4694-a54c-2e94f9090483 service swift] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:49.520144 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f118b6e-1cbb-4694-a54c-2e94f9090483 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:49.532355 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f118b6e-1cbb-4694-a54c-2e94f9090483 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:49.534663 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f118b6e-1cbb-4694-a54c-2e94f9090483 service swift] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:49.569114 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3792/7558] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 16:13:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:13:51.862527 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa9b63-4402-4fd2-93c8-225b99dff426 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:51.875131 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa9b63-4402-4fd2-93c8-225b99dff426 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:51.879317 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c756c-c31a-498e-bccf-5e313c3e27fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:51.879937 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c756c-c31a-498e-bccf-5e313c3e27fe service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:51.880374 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c756c-c31a-498e-bccf-5e313c3e27fe service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:51.880781 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c756c-c31a-498e-bccf-5e313c3e27fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:51.882619 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-974c756c-c31a-498e-bccf-5e313c3e27fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:51.896775 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c756c-c31a-498e-bccf-5e313c3e27fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:51.898221 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c756c-c31a-498e-bccf-5e313c3e27fe service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:51.909598 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3767/7559] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:13:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:13:55.992300 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f118b6e-1cbb-4694-a54c-2e94f9090483 service swift] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:56.011406 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f118b6e-1cbb-4694-a54c-2e94f9090483 service swift] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:56.017913 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ecf4c-f70e-4dbf-8448-e0e044c640f5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:56.018711 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ecf4c-f70e-4dbf-8448-e0e044c640f5 service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:56.019539 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ecf4c-f70e-4dbf-8448-e0e044c640f5 service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:56.019539 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ecf4c-f70e-4dbf-8448-e0e044c640f5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:56.021097 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ac1ecf4c-f70e-4dbf-8448-e0e044c640f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:56.037437 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ecf4c-f70e-4dbf-8448-e0e044c640f5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:56.038988 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ecf4c-f70e-4dbf-8448-e0e044c640f5 service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:56.062510 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3793/7560] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:13:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:14:01.541282 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c756c-c31a-498e-bccf-5e313c3e27fe service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:01.543006 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-974c756c-c31a-498e-bccf-5e313c3e27fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:01.563494 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c756c-c31a-498e-bccf-5e313c3e27fe service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:01.569968 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2158c-fb82-4601-acae-e3b9a88e26a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:01.570735 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2158c-fb82-4601-acae-e3b9a88e26a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:01.571018 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2158c-fb82-4601-acae-e3b9a88e26a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:01.571496 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2158c-fb82-4601-acae-e3b9a88e26a5 admin admin] PATH_INFO: `/v3/users/35cca2c3486c4389a04f6a20b8d567e9` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:01.572872 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2158c-fb82-4601-acae-e3b9a88e26a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35cca2c3486c4389a04f6a20b8d567e9)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:01.575375 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2158c-fb82-4601-acae-e3b9a88e26a5 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:01.643927 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-cfe2158c-fb82-4601-acae-e3b9a88e26a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35cca2c3486c4389a04f6a20b8d567e9'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:01.644588 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-cfe2158c-fb82-4601-acae-e3b9a88e26a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35cca2c3486c4389a04f6a20b8d567e9'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:01.659182 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-cfe2158c-fb82-4601-acae-e3b9a88e26a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35cca2c3486c4389a04f6a20b8d567e9'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:01.667920 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-cfe2158c-fb82-4601-acae-e3b9a88e26a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35cca2c3486c4389a04f6a20b8d567e9'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:01.683762 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-cfe2158c-fb82-4601-acae-e3b9a88e26a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35cca2c3486c4389a04f6a20b8d567e9'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:01.692373 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3768/7561] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:14:01 2022] DELETE /identity/v3/users/35cca2c3486c4389a04f6a20b8d567e9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:14:02.119387 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ecf4c-f70e-4dbf-8448-e0e044c640f5 service placement] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:02.130615 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ecf4c-f70e-4dbf-8448-e0e044c640f5 service placement] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:02.173411 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:02.189929 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e8a105-233c-460b-8717-54849b2812e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:02.190562 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8a105-233c-460b-8717-54849b2812e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:02.190841 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8a105-233c-460b-8717-54849b2812e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:02.191149 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8a105-233c-460b-8717-54849b2812e1 admin admin] PATH_INFO: `/v3/projects/7b07be353bbc481cbd35a4304501c57e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:02.192264 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e8a105-233c-460b-8717-54849b2812e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b07be353bbc481cbd35a4304501c57e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:02.194175 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e8a105-233c-460b-8717-54849b2812e1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:02.240684 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e2e8a105-233c-460b-8717-54849b2812e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b07be353bbc481cbd35a4304501c57e', 'request_id': 'req-e2e8a105-233c-460b-8717-54849b2812e1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:02.246346 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e2e8a105-233c-460b-8717-54849b2812e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b07be353bbc481cbd35a4304501c57e', 'request_id': 'req-e2e8a105-233c-460b-8717-54849b2812e1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:02.252506 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e2e8a105-233c-460b-8717-54849b2812e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b07be353bbc481cbd35a4304501c57e', 'request_id': 'req-e2e8a105-233c-460b-8717-54849b2812e1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:02.268273 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e2e8a105-233c-460b-8717-54849b2812e1 admin admin] The token cache is being invalidate because project 7b07be353bbc481cbd35a4304501c57e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:14:02.268563 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e2e8a105-233c-460b-8717-54849b2812e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:02.269208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e2e8a105-233c-460b-8717-54849b2812e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:02.270928 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3794/7562] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:14:02 2022] DELETE /identity/v3/projects/7b07be353bbc481cbd35a4304501c57e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:14:02.275681 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2158c-fb82-4601-acae-e3b9a88e26a5 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:02.277195 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-cfe2158c-fb82-4601-acae-e3b9a88e26a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:02.291797 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2158c-fb82-4601-acae-e3b9a88e26a5 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:02.328081 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:02.356669 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538e806-6c60-4d33-b1f4-330d2f6ac6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:02.357320 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538e806-6c60-4d33-b1f4-330d2f6ac6f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:02.357603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538e806-6c60-4d33-b1f4-330d2f6ac6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:02.357877 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538e806-6c60-4d33-b1f4-330d2f6ac6f6 admin admin] PATH_INFO: `/v3/users/0abe97082cd44d87b9fc6e51d21487c4` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:02.359048 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9538e806-6c60-4d33-b1f4-330d2f6ac6f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0abe97082cd44d87b9fc6e51d21487c4)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:02.361043 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9538e806-6c60-4d33-b1f4-330d2f6ac6f6 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:02.412745 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9538e806-6c60-4d33-b1f4-330d2f6ac6f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0abe97082cd44d87b9fc6e51d21487c4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:02.413447 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9538e806-6c60-4d33-b1f4-330d2f6ac6f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0abe97082cd44d87b9fc6e51d21487c4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:02.428157 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9538e806-6c60-4d33-b1f4-330d2f6ac6f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0abe97082cd44d87b9fc6e51d21487c4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:02.436666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9538e806-6c60-4d33-b1f4-330d2f6ac6f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0abe97082cd44d87b9fc6e51d21487c4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:02.447341 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9538e806-6c60-4d33-b1f4-330d2f6ac6f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0abe97082cd44d87b9fc6e51d21487c4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:02.454615 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3769/7563] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:14:02 2022] DELETE /identity/v3/users/0abe97082cd44d87b9fc6e51d21487c4 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:14:02.647983 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e8a105-233c-460b-8717-54849b2812e1 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:02.650842 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e2e8a105-233c-460b-8717-54849b2812e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:02.667778 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e8a105-233c-460b-8717-54849b2812e1 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:02.741398 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10312c3a-59a6-46c3-a416-f424c1210bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:02.742086 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10312c3a-59a6-46c3-a416-f424c1210bef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:02.742946 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10312c3a-59a6-46c3-a416-f424c1210bef admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:02.743253 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10312c3a-59a6-46c3-a416-f424c1210bef admin admin] PATH_INFO: `/v3/projects/c6203fa4f591453693b634904490286c` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:02.744657 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10312c3a-59a6-46c3-a416-f424c1210bef admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6203fa4f591453693b634904490286c)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:02.746792 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10312c3a-59a6-46c3-a416-f424c1210bef admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:02.806235 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-10312c3a-59a6-46c3-a416-f424c1210bef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6203fa4f591453693b634904490286c', 'request_id': 'req-10312c3a-59a6-46c3-a416-f424c1210bef'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:02.817177 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-10312c3a-59a6-46c3-a416-f424c1210bef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6203fa4f591453693b634904490286c', 'request_id': 'req-10312c3a-59a6-46c3-a416-f424c1210bef'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:02.825350 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-10312c3a-59a6-46c3-a416-f424c1210bef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6203fa4f591453693b634904490286c', 'request_id': 'req-10312c3a-59a6-46c3-a416-f424c1210bef'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:02.843895 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-10312c3a-59a6-46c3-a416-f424c1210bef admin admin] The token cache is being invalidate because project c6203fa4f591453693b634904490286c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:14:02.844310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-10312c3a-59a6-46c3-a416-f424c1210bef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:02.845075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-10312c3a-59a6-46c3-a416-f424c1210bef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:02.854709 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3795/7564] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:14:02 2022] DELETE /identity/v3/projects/c6203fa4f591453693b634904490286c => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:14:12.450135 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=37,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:12.839854 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:13.665299 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538e806-6c60-4d33-b1f4-330d2f6ac6f6 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:13.667357 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9538e806-6c60-4d33-b1f4-330d2f6ac6f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:13.691282 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538e806-6c60-4d33-b1f4-330d2f6ac6f6 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:13.912497 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a125d696-18ce-4359-a604-a1f841e82aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:13.922876 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125d696-18ce-4359-a604-a1f841e82aae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:13.923555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125d696-18ce-4359-a604-a1f841e82aae admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:13.924076 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125d696-18ce-4359-a604-a1f841e82aae admin admin] PATH_INFO: `/v3/users/dfb41defd884427b9e2c6dd9cbac02f5` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:13.928418 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a125d696-18ce-4359-a604-a1f841e82aae admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfb41defd884427b9e2c6dd9cbac02f5)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:13.938200 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a125d696-18ce-4359-a604-a1f841e82aae admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:14.042827 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a125d696-18ce-4359-a604-a1f841e82aae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfb41defd884427b9e2c6dd9cbac02f5'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:14.043601 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a125d696-18ce-4359-a604-a1f841e82aae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfb41defd884427b9e2c6dd9cbac02f5'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:14.062324 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a125d696-18ce-4359-a604-a1f841e82aae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfb41defd884427b9e2c6dd9cbac02f5'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:14.075606 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a125d696-18ce-4359-a604-a1f841e82aae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfb41defd884427b9e2c6dd9cbac02f5'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:14.090556 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a125d696-18ce-4359-a604-a1f841e82aae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfb41defd884427b9e2c6dd9cbac02f5'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:14.104032 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3770/7565] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:14:13 2022] DELETE /identity/v3/users/dfb41defd884427b9e2c6dd9cbac02f5 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:14:14.109423 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3718ae-4ad5-42d9-8cd5-f16a7b74dcde None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:14.109892 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3718ae-4ad5-42d9-8cd5-f16a7b74dcde None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:14.110141 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3718ae-4ad5-42d9-8cd5-f16a7b74dcde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:14.154797 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-3b3718ae-4ad5-42d9-8cd5-f16a7b74dcde None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:14:14.158681 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3b3718ae-4ad5-42d9-8cd5-f16a7b74dcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:14.328436 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3796/7566] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:14:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:14:14.373449 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a125d696-18ce-4359-a604-a1f841e82aae admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:14.379924 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a125d696-18ce-4359-a604-a1f841e82aae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:14.519176 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a125d696-18ce-4359-a604-a1f841e82aae admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:14.527402 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ff720-3d07-4c26-9878-3d25897f91ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:14.528052 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ff720-3d07-4c26-9878-3d25897f91ad service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:14.528333 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ff720-3d07-4c26-9878-3d25897f91ad service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:14.528609 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ff720-3d07-4c26-9878-3d25897f91ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:14.550324 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ff720-3d07-4c26-9878-3d25897f91ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:14.561289 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ff720-3d07-4c26-9878-3d25897f91ad service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:14.596713 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3771/7567] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:14:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:14:15.632748 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3718ae-4ad5-42d9-8cd5-f16a7b74dcde None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:15.634841 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3b3718ae-4ad5-42d9-8cd5-f16a7b74dcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:15.647918 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3718ae-4ad5-42d9-8cd5-f16a7b74dcde None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:15.654932 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab969d-68a4-4a7c-a54b-f16879ec7d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:15.655677 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab969d-68a4-4a7c-a54b-f16879ec7d0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:15.655954 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab969d-68a4-4a7c-a54b-f16879ec7d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:15.656222 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab969d-68a4-4a7c-a54b-f16879ec7d0a admin admin] PATH_INFO: `/v3/projects/c0a840077ad6444fbb7fe478736313bc` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:15.657408 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab969d-68a4-4a7c-a54b-f16879ec7d0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0a840077ad6444fbb7fe478736313bc)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:15.660362 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab969d-68a4-4a7c-a54b-f16879ec7d0a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:15.731461 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-acab969d-68a4-4a7c-a54b-f16879ec7d0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0a840077ad6444fbb7fe478736313bc', 'request_id': 'req-acab969d-68a4-4a7c-a54b-f16879ec7d0a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:15.741496 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-acab969d-68a4-4a7c-a54b-f16879ec7d0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0a840077ad6444fbb7fe478736313bc', 'request_id': 'req-acab969d-68a4-4a7c-a54b-f16879ec7d0a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:15.755137 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-acab969d-68a4-4a7c-a54b-f16879ec7d0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0a840077ad6444fbb7fe478736313bc', 'request_id': 'req-acab969d-68a4-4a7c-a54b-f16879ec7d0a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:15.782751 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-acab969d-68a4-4a7c-a54b-f16879ec7d0a admin admin] The token cache is being invalidate because project c0a840077ad6444fbb7fe478736313bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:14:15.783122 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-acab969d-68a4-4a7c-a54b-f16879ec7d0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:15.783958 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-acab969d-68a4-4a7c-a54b-f16879ec7d0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:15.786020 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3797/7568] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:14:15 2022] DELETE /identity/v3/projects/c0a840077ad6444fbb7fe478736313bc => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:14:15.791090 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69d59f-556f-44a3-a938-2c9aac6945e5 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:15.791952 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69d59f-556f-44a3-a938-2c9aac6945e5 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:15.792231 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69d59f-556f-44a3-a938-2c9aac6945e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:15.818727 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-4c69d59f-556f-44a3-a938-2c9aac6945e5 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:14:15.821149 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4c69d59f-556f-44a3-a938-2c9aac6945e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:15.847905 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:15.918591 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3772/7569] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:14:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:14:15.927980 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3b3b3-337f-4ffd-9915-6ea7a3c6f627 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:15.928644 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3b3b3-337f-4ffd-9915-6ea7a3c6f627 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:15.929057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3b3b3-337f-4ffd-9915-6ea7a3c6f627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:15.953220 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-24b3b3b3-337f-4ffd-9915-6ea7a3c6f627 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:14:15.954427 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-24b3b3b3-337f-4ffd-9915-6ea7a3c6f627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:15.963488 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3798/7570] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:14:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:14:15.968449 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c69d59f-556f-44a3-a938-2c9aac6945e5 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:15.983602 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c69d59f-556f-44a3-a938-2c9aac6945e5 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:15.998969 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf134f16-9317-4981-ac26-5e4fc12ee533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:15.999813 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf134f16-9317-4981-ac26-5e4fc12ee533 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:16.000267 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf134f16-9317-4981-ac26-5e4fc12ee533 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:16.000541 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf134f16-9317-4981-ac26-5e4fc12ee533 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:16.001426 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf134f16-9317-4981-ac26-5e4fc12ee533 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:14:16.003975 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf134f16-9317-4981-ac26-5e4fc12ee533 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:16.008873 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf134f16-9317-4981-ac26-5e4fc12ee533 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:16.027428 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3773/7571] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:14:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:14:16.032416 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3b3b3-337f-4ffd-9915-6ea7a3c6f627 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:16.043933 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3b3b3-337f-4ffd-9915-6ea7a3c6f627 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:16.051302 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d2868-60b8-4732-9eee-e2759f8a4739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:16.053569 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d2868-60b8-4732-9eee-e2759f8a4739 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:16.054387 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d2868-60b8-4732-9eee-e2759f8a4739 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:16.055376 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d2868-60b8-4732-9eee-e2759f8a4739 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:16.056338 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6d2868-60b8-4732-9eee-e2759f8a4739 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:16.058863 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6d2868-60b8-4732-9eee-e2759f8a4739 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:16.101392 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3799/7572] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:14:16 2022] POST /identity/v3/projects => generated 365 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:14:16.105188 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf134f16-9317-4981-ac26-5e4fc12ee533 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:16.116402 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf134f16-9317-4981-ac26-5e4fc12ee533 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:16.209192 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f3317-0e6a-4e83-9200-d1379bdb9c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:16.209836 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f3317-0e6a-4e83-9200-d1379bdb9c7c admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:16.210121 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f3317-0e6a-4e83-9200-d1379bdb9c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:16.210398 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f3317-0e6a-4e83-9200-d1379bdb9c7c admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:16.211212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f3317-0e6a-4e83-9200-d1379bdb9c7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:16.213484 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f3317-0e6a-4e83-9200-d1379bdb9c7c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:16.248706 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3774/7573] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:14:16 2022] POST /identity/v3/users => generated 283 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:14:16.249631 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d2868-60b8-4732-9eee-e2759f8a4739 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:16.262979 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d2868-60b8-4732-9eee-e2759f8a4739 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:16.269411 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f08b42-ce39-4275-8016-439dbd398731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:16.270093 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f08b42-ce39-4275-8016-439dbd398731 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:16.270375 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f08b42-ce39-4275-8016-439dbd398731 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:16.270646 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f08b42-ce39-4275-8016-439dbd398731 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:16.271347 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f08b42-ce39-4275-8016-439dbd398731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:16.273178 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f08b42-ce39-4275-8016-439dbd398731 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:16.285796 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3800/7574] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:14:16.290619 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f3317-0e6a-4e83-9200-d1379bdb9c7c admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:16.302401 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f3317-0e6a-4e83-9200-d1379bdb9c7c admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:16.309295 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e4fb4-bea7-42f2-9851-00d5de9d9c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:16.309947 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e4fb4-bea7-42f2-9851-00d5de9d9c9d admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:16.310232 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e4fb4-bea7-42f2-9851-00d5de9d9c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:16.310509 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e4fb4-bea7-42f2-9851-00d5de9d9c9d admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:16.311207 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361e4fb4-bea7-42f2-9851-00d5de9d9c9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:16.312898 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361e4fb4-bea7-42f2-9851-00d5de9d9c9d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:16.327872 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3775/7575] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:14:16.332040 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f08b42-ce39-4275-8016-439dbd398731 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:16.344228 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f08b42-ce39-4275-8016-439dbd398731 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:16.354567 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e72753-867f-4f76-9ef1-6ccf98979f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:16.355553 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e72753-867f-4f76-9ef1-6ccf98979f4c admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:16.355865 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e72753-867f-4f76-9ef1-6ccf98979f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:16.356233 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e72753-867f-4f76-9ef1-6ccf98979f4c admin admin] PATH_INFO: `/v3/projects/3bf23f9068104046a908a19feece73e1/users/37d8a1e078664d8d8e85d35291172599/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:16.386434 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e72753-867f-4f76-9ef1-6ccf98979f4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bf23f9068104046a908a19feece73e1, user_id=37d8a1e078664d8d8e85d35291172599, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:16.389362 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e72753-867f-4f76-9ef1-6ccf98979f4c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:16.445503 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3801/7576] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:14:16 2022] PUT /identity/v3/projects/3bf23f9068104046a908a19feece73e1/users/37d8a1e078664d8d8e85d35291172599/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:14:16.450694 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620ec33-bc81-47da-8535-2d4e1842c4f8 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:16.451378 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620ec33-bc81-47da-8535-2d4e1842c4f8 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:16.451825 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620ec33-bc81-47da-8535-2d4e1842c4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:16.490518 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-6620ec33-bc81-47da-8535-2d4e1842c4f8 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:14:16.493389 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6620ec33-bc81-47da-8535-2d4e1842c4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:16.639601 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3776/7577] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:14:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:14:16.652616 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e72753-867f-4f76-9ef1-6ccf98979f4c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:16.655431 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-30e72753-867f-4f76-9ef1-6ccf98979f4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:16.705229 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:16.782844 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e72753-867f-4f76-9ef1-6ccf98979f4c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:16.800944 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc88bc-25a1-4752-8c9b-b5cf9078bfba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:16.801660 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc88bc-25a1-4752-8c9b-b5cf9078bfba service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:16.802003 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc88bc-25a1-4752-8c9b-b5cf9078bfba service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:16.802345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc88bc-25a1-4752-8c9b-b5cf9078bfba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:16.815562 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcc88bc-25a1-4752-8c9b-b5cf9078bfba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:16.823712 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcc88bc-25a1-4752-8c9b-b5cf9078bfba service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:16.849419 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3802/7578] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:14:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:14:16.856422 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735e54f-5c9c-4ee4-a9b4-d212aaf9d861 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:16.856895 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735e54f-5c9c-4ee4-a9b4-d212aaf9d861 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:16.857104 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735e54f-5c9c-4ee4-a9b4-d212aaf9d861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:16.878428 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-5735e54f-5c9c-4ee4-a9b4-d212aaf9d861 None None] MFA Rules not processed for user `86ff3f40c7224251ae1346fc60f361f9`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:14:16.879707 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5735e54f-5c9c-4ee4-a9b4-d212aaf9d861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:16.912215 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:16.967419 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3777/7579] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:14:16 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:14:20.277080 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc88bc-25a1-4752-8c9b-b5cf9078bfba service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:20.278590 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0fcc88bc-25a1-4752-8c9b-b5cf9078bfba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:20.294316 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc88bc-25a1-4752-8c9b-b5cf9078bfba service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:20.298663 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb31b4-e399-4b1d-bb60-01bed5487e91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:20.299418 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb31b4-e399-4b1d-bb60-01bed5487e91 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:20.299785 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb31b4-e399-4b1d-bb60-01bed5487e91 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:20.300109 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb31b4-e399-4b1d-bb60-01bed5487e91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:20.302322 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-06fb31b4-e399-4b1d-bb60-01bed5487e91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:20.464072 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb31b4-e399-4b1d-bb60-01bed5487e91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:20.465562 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb31b4-e399-4b1d-bb60-01bed5487e91 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:20.489880 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3803/7580] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:14:20 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:14:22.456318 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735e54f-5c9c-4ee4-a9b4-d212aaf9d861 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:22.472541 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735e54f-5c9c-4ee4-a9b4-d212aaf9d861 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:22.484639 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84baff-210c-4836-a97b-1d0af6a58c03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:22.485375 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84baff-210c-4836-a97b-1d0af6a58c03 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:22.485719 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84baff-210c-4836-a97b-1d0af6a58c03 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:22.490586 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84baff-210c-4836-a97b-1d0af6a58c03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:22.493604 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7e84baff-210c-4836-a97b-1d0af6a58c03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:22.528522 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e84baff-210c-4836-a97b-1d0af6a58c03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:22.533346 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e84baff-210c-4836-a97b-1d0af6a58c03 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:22.575401 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3778/7581] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:14:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:14:24.076514 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb31b4-e399-4b1d-bb60-01bed5487e91 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:24.078295 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-06fb31b4-e399-4b1d-bb60-01bed5487e91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:24.224442 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb31b4-e399-4b1d-bb60-01bed5487e91 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:24.237224 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d1b86-b350-4f55-9233-391b845bbe34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:24.238817 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d1b86-b350-4f55-9233-391b845bbe34 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:24.239278 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d1b86-b350-4f55-9233-391b845bbe34 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:24.239692 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d1b86-b350-4f55-9233-391b845bbe34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:24.243955 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8c7d1b86-b350-4f55-9233-391b845bbe34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:24.269500 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d1b86-b350-4f55-9233-391b845bbe34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:24.274240 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d1b86-b350-4f55-9233-391b845bbe34 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:24.296823 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3804/7582] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:14:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:14:25.763480 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e209314-6a76-4d3a-b03f-467f09486aca None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:25.764331 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e209314-6a76-4d3a-b03f-467f09486aca None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:25.764758 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e209314-6a76-4d3a-b03f-467f09486aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:25.803504 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-3e209314-6a76-4d3a-b03f-467f09486aca None None] MFA Rules not processed for user `e1ce5d3d668743d5b8843936f77c0150`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:14:25.807980 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3e209314-6a76-4d3a-b03f-467f09486aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:25.884472 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3779/7583] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:14:25 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:14:31.482784 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6bf73-215a-400c-a507-02ec057d43c1 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:31.483254 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6bf73-215a-400c-a507-02ec057d43c1 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:31.483541 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6bf73-215a-400c-a507-02ec057d43c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:31.525475 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-e5f6bf73-215a-400c-a507-02ec057d43c1 None None] MFA Rules not processed for user `37d8a1e078664d8d8e85d35291172599`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:14:31.528580 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e5f6bf73-215a-400c-a507-02ec057d43c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:31.545995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:31.630259 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3805/7584] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:14:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:14:31.635008 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e209314-6a76-4d3a-b03f-467f09486aca None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:31.649058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e209314-6a76-4d3a-b03f-467f09486aca None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:31.657166 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492050f-e1cf-40e2-b34a-b1d2c5b740ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:31.657879 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492050f-e1cf-40e2-b34a-b1d2c5b740ba admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:31.658297 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492050f-e1cf-40e2-b34a-b1d2c5b740ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:31.658812 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492050f-e1cf-40e2-b34a-b1d2c5b740ba admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:31.659619 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b492050f-e1cf-40e2-b34a-b1d2c5b740ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:31.661990 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b492050f-e1cf-40e2-b34a-b1d2c5b740ba admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:31.686341 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3780/7585] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:14:31 2022] POST /identity/v3/users => generated 287 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:14:31.692309 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f6bf73-215a-400c-a507-02ec057d43c1 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:31.704735 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f6bf73-215a-400c-a507-02ec057d43c1 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:31.709334 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94244b5e-714a-4509-aae9-1e88d09cc02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:31.709953 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94244b5e-714a-4509-aae9-1e88d09cc02f admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:31.710394 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94244b5e-714a-4509-aae9-1e88d09cc02f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:31.710671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94244b5e-714a-4509-aae9-1e88d09cc02f admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:31.712310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94244b5e-714a-4509-aae9-1e88d09cc02f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:31.714591 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94244b5e-714a-4509-aae9-1e88d09cc02f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:31.729466 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3806/7586] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:14:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:14:31.730929 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492050f-e1cf-40e2-b34a-b1d2c5b740ba admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:31.749948 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492050f-e1cf-40e2-b34a-b1d2c5b740ba admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:31.754902 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be31ab17-83d3-4a72-8feb-149416ee9e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:31.755723 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31ab17-83d3-4a72-8feb-149416ee9e01 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:31.756021 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31ab17-83d3-4a72-8feb-149416ee9e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:31.756297 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31ab17-83d3-4a72-8feb-149416ee9e01 admin admin] PATH_INFO: `/v3/system/users/ff51d0e6276c42afb70199b4ba4367e1/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:31.777225 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be31ab17-83d3-4a72-8feb-149416ee9e01 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ff51d0e6276c42afb70199b4ba4367e1, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:31.778307 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-be31ab17-83d3-4a72-8feb-149416ee9e01 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:14:31.778307 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 16:14:31.778307 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 16:14:31.779939 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be31ab17-83d3-4a72-8feb-149416ee9e01 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:31.788744 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3781/7587] 10.222.0.83 () {60 vars in 1378 bytes} [Mon Aug 29 16:14:31 2022] PUT /identity/v3/system/users/ff51d0e6276c42afb70199b4ba4367e1/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:14:31.798911 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80395d99-40bc-4f91-a39a-213badcc99d7 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:31.799227 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80395d99-40bc-4f91-a39a-213badcc99d7 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:31.799500 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80395d99-40bc-4f91-a39a-213badcc99d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:31.829816 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-80395d99-40bc-4f91-a39a-213badcc99d7 None None] MFA Rules not processed for user `ff51d0e6276c42afb70199b4ba4367e1`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:14:31.831228 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-80395d99-40bc-4f91-a39a-213badcc99d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:31.924499 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3807/7588] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:14:31 2022] POST /identity/v3/auth/tokens => generated 2414 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 16:14:31.929468 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be31ab17-83d3-4a72-8feb-149416ee9e01 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:32.048220 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:32.083829 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be31ab17-83d3-4a72-8feb-149416ee9e01 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:32.121547 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6869971-9dd7-493c-a469-d9435d9e321e None tempest-ImageQuotaTest-235498477-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff51d0e6276c42afb70199b4ba4367e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:32.122168 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6869971-9dd7-493c-a469-d9435d9e321e None tempest-ImageQuotaTest-235498477-system-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:32.122451 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6869971-9dd7-493c-a469-d9435d9e321e None tempest-ImageQuotaTest-235498477-system-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:32.122725 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6869971-9dd7-493c-a469-d9435d9e321e None tempest-ImageQuotaTest-235498477-system-admin] PATH_INFO: `/v3/services` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:32.123394 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6869971-9dd7-493c-a469-d9435d9e321e None tempest-ImageQuotaTest-235498477-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:32.124776 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6869971-9dd7-493c-a469-d9435d9e321e None tempest-ImageQuotaTest-235498477-system-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:32.135709 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3782/7589] 10.222.0.83 () {58 vars in 1110 bytes} [Mon Aug 29 16:14:31 2022] GET /identity/v3/services => generated 2191 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:14:32.136919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80395d99-40bc-4f91-a39a-213badcc99d7 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:32.205558 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:32.243838 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80395d99-40bc-4f91-a39a-213badcc99d7 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:32.296041 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506ff6d-1fe7-42fb-9a54-146960fb023a None tempest-ImageQuotaTest-235498477-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff51d0e6276c42afb70199b4ba4367e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:32.296775 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506ff6d-1fe7-42fb-9a54-146960fb023a None tempest-ImageQuotaTest-235498477-system-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:32.297798 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506ff6d-1fe7-42fb-9a54-146960fb023a None tempest-ImageQuotaTest-235498477-system-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:32.298262 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506ff6d-1fe7-42fb-9a54-146960fb023a None tempest-ImageQuotaTest-235498477-system-admin] PATH_INFO: `/v3/limits` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:32.299049 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b506ff6d-1fe7-42fb-9a54-146960fb023a None tempest-ImageQuotaTest-235498477-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:32.301615 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b506ff6d-1fe7-42fb-9a54-146960fb023a None tempest-ImageQuotaTest-235498477-system-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:32.361692 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-b506ff6d-1fe7-42fb-9a54-146960fb023a None tempest-ImageQuotaTest-235498477-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Aug 29 16:14:32.361692 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:14:32.361692 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:14:32.361692 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:14:32.361692 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:14:32.361692 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:14:32.361692 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:14:32.361692 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:14:32.361692 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:14:32.361692 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:14:32.361692 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:14:32.361692 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:14:32.361692 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/limits.py", line 110, in post Aug 29 16:14:32.361692 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application refs = PROVIDERS.unified_limit_api.create_limits(limits) Aug 29 16:14:32.362728 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:14:32.362728 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:14:32.362728 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/core.py", line 116, in create_limits Aug 29 16:14:32.362728 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.driver.create_limits(limits) Aug 29 16:14:32.362728 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 16:14:32.362728 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 16:14:32.362728 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 260, in create_limits Aug 29 16:14:32.362728 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application target = self._check_and_fill_registered_limit_id(limit) Aug 29 16:14:32.362728 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 249, in _check_and_fill_registered_limit_id Aug 29 16:14:32.362728 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.NoLimitReference Aug 29 16:14:32.362728 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Aug 29 16:14:32.362728 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:14:32.364766 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3808/7590] 10.222.0.83 () {60 vars in 1126 bytes} [Mon Aug 29 16:14:32 2022] POST /identity/v3/limits => generated 124 bytes in 228 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 29 16:14:32.371183 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6869971-9dd7-493c-a469-d9435d9e321e None tempest-ImageQuotaTest-235498477-system-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:32.503698 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6869971-9dd7-493c-a469-d9435d9e321e None tempest-ImageQuotaTest-235498477-system-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:32.557241 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1ad56-e758-438b-b2b5-19d663ab503a None tempest-ImageQuotaTest-235498477-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff51d0e6276c42afb70199b4ba4367e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:32.557778 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1ad56-e758-438b-b2b5-19d663ab503a None tempest-ImageQuotaTest-235498477-system-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:32.558208 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1ad56-e758-438b-b2b5-19d663ab503a None tempest-ImageQuotaTest-235498477-system-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:32.558490 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1ad56-e758-438b-b2b5-19d663ab503a None tempest-ImageQuotaTest-235498477-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:32.559158 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db1ad56-e758-438b-b2b5-19d663ab503a None tempest-ImageQuotaTest-235498477-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:32.560259 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db1ad56-e758-438b-b2b5-19d663ab503a None tempest-ImageQuotaTest-235498477-system-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:32.568805 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3783/7591] 10.222.0.83 () {58 vars in 1137 bytes} [Mon Aug 29 16:14:32 2022] GET /identity/v3/registered_limits => generated 129 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:14:32.577202 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506ff6d-1fe7-42fb-9a54-146960fb023a None tempest-ImageQuotaTest-235498477-system-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:32.760026 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506ff6d-1fe7-42fb-9a54-146960fb023a None tempest-ImageQuotaTest-235498477-system-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:32.803498 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:32.826752 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4443cbd3-6563-4b3c-8506-fc846d2fd482 None tempest-ImageQuotaTest-235498477-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff51d0e6276c42afb70199b4ba4367e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:32.827550 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4443cbd3-6563-4b3c-8506-fc846d2fd482 None tempest-ImageQuotaTest-235498477-system-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:32.828075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4443cbd3-6563-4b3c-8506-fc846d2fd482 None tempest-ImageQuotaTest-235498477-system-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:32.828522 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4443cbd3-6563-4b3c-8506-fc846d2fd482 None tempest-ImageQuotaTest-235498477-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:32.829782 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4443cbd3-6563-4b3c-8506-fc846d2fd482 None tempest-ImageQuotaTest-235498477-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:32.831280 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4443cbd3-6563-4b3c-8506-fc846d2fd482 None tempest-ImageQuotaTest-235498477-system-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:32.842385 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3809/7592] 10.222.0.83 () {58 vars in 1137 bytes} [Mon Aug 29 16:14:32 2022] GET /identity/v3/registered_limits => generated 129 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:14:36.400482 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1ad56-e758-438b-b2b5-19d663ab503a None tempest-ImageQuotaTest-235498477-system-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:36.402399 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4db1ad56-e758-438b-b2b5-19d663ab503a None tempest-ImageQuotaTest-235498477-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:36.414797 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:36.427831 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1ad56-e758-438b-b2b5-19d663ab503a None tempest-ImageQuotaTest-235498477-system-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:36.434071 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391fa58e-fcdd-499c-9786-ce845dab7dda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:36.434786 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fa58e-fcdd-499c-9786-ce845dab7dda service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:36.435096 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fa58e-fcdd-499c-9786-ce845dab7dda service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:36.435516 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fa58e-fcdd-499c-9786-ce845dab7dda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:36.437329 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-391fa58e-fcdd-499c-9786-ce845dab7dda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:36.454555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391fa58e-fcdd-499c-9786-ce845dab7dda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:36.456377 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391fa58e-fcdd-499c-9786-ce845dab7dda service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:36.473503 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3784/7593] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:14:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:14:39.907121 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4443cbd3-6563-4b3c-8506-fc846d2fd482 None tempest-ImageQuotaTest-235498477-system-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:39.920583 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4443cbd3-6563-4b3c-8506-fc846d2fd482 None tempest-ImageQuotaTest-235498477-system-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:39.932166 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292db51-43d3-42ea-a8c7-db96e931c6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:39.933031 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292db51-43d3-42ea-a8c7-db96e931c6e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:39.933324 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292db51-43d3-42ea-a8c7-db96e931c6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:39.933613 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292db51-43d3-42ea-a8c7-db96e931c6e2 admin admin] PATH_INFO: `/v3/users/37d8a1e078664d8d8e85d35291172599` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:39.945987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d292db51-43d3-42ea-a8c7-db96e931c6e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37d8a1e078664d8d8e85d35291172599)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:39.948906 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d292db51-43d3-42ea-a8c7-db96e931c6e2 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:40.019583 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d292db51-43d3-42ea-a8c7-db96e931c6e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37d8a1e078664d8d8e85d35291172599'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:40.020256 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d292db51-43d3-42ea-a8c7-db96e931c6e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37d8a1e078664d8d8e85d35291172599'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:40.037505 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d292db51-43d3-42ea-a8c7-db96e931c6e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37d8a1e078664d8d8e85d35291172599'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:40.053287 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d292db51-43d3-42ea-a8c7-db96e931c6e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37d8a1e078664d8d8e85d35291172599'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:40.053727 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d292db51-43d3-42ea-a8c7-db96e931c6e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37d8a1e078664d8d8e85d35291172599'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:40.128585 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3810/7594] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:14:39 2022] DELETE /identity/v3/users/37d8a1e078664d8d8e85d35291172599 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:14:40.374798 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391fa58e-fcdd-499c-9786-ce845dab7dda service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:40.406993 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391fa58e-fcdd-499c-9786-ce845dab7dda service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:40.486273 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec93b0-9ff5-47b2-8ae7-f2939618f30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:40.486997 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec93b0-9ff5-47b2-8ae7-f2939618f30d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:40.487347 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec93b0-9ff5-47b2-8ae7-f2939618f30d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:40.487756 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec93b0-9ff5-47b2-8ae7-f2939618f30d admin admin] PATH_INFO: `/v3/projects/3bf23f9068104046a908a19feece73e1` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:40.489668 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ec93b0-9ff5-47b2-8ae7-f2939618f30d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bf23f9068104046a908a19feece73e1)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:40.491081 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ec93b0-9ff5-47b2-8ae7-f2939618f30d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:40.542109 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-58ec93b0-9ff5-47b2-8ae7-f2939618f30d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bf23f9068104046a908a19feece73e1', 'request_id': 'req-58ec93b0-9ff5-47b2-8ae7-f2939618f30d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:40.548308 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-58ec93b0-9ff5-47b2-8ae7-f2939618f30d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bf23f9068104046a908a19feece73e1', 'request_id': 'req-58ec93b0-9ff5-47b2-8ae7-f2939618f30d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:40.557916 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-58ec93b0-9ff5-47b2-8ae7-f2939618f30d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bf23f9068104046a908a19feece73e1', 'request_id': 'req-58ec93b0-9ff5-47b2-8ae7-f2939618f30d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:40.572480 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-58ec93b0-9ff5-47b2-8ae7-f2939618f30d admin admin] The token cache is being invalidate because project 3bf23f9068104046a908a19feece73e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:14:40.572762 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-58ec93b0-9ff5-47b2-8ae7-f2939618f30d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:40.573434 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-58ec93b0-9ff5-47b2-8ae7-f2939618f30d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:40.574974 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3785/7595] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:14:40 2022] DELETE /identity/v3/projects/3bf23f9068104046a908a19feece73e1 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:14:40.579118 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292db51-43d3-42ea-a8c7-db96e931c6e2 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:40.580534 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d292db51-43d3-42ea-a8c7-db96e931c6e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:40.594901 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292db51-43d3-42ea-a8c7-db96e931c6e2 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:40.652239 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ccaa5-5551-48bf-81bb-88fe4e11eb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:40.652902 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ccaa5-5551-48bf-81bb-88fe4e11eb01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:40.653180 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ccaa5-5551-48bf-81bb-88fe4e11eb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:40.653459 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ccaa5-5551-48bf-81bb-88fe4e11eb01 admin admin] PATH_INFO: `/v3/users/ff51d0e6276c42afb70199b4ba4367e1` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:40.654604 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ccaa5-5551-48bf-81bb-88fe4e11eb01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff51d0e6276c42afb70199b4ba4367e1)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:40.656581 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ccaa5-5551-48bf-81bb-88fe4e11eb01 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:40.718376 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2b9ccaa5-5551-48bf-81bb-88fe4e11eb01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff51d0e6276c42afb70199b4ba4367e1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:40.719074 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2b9ccaa5-5551-48bf-81bb-88fe4e11eb01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff51d0e6276c42afb70199b4ba4367e1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:40.720713 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:40.727410 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2b9ccaa5-5551-48bf-81bb-88fe4e11eb01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff51d0e6276c42afb70199b4ba4367e1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:40.735589 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2b9ccaa5-5551-48bf-81bb-88fe4e11eb01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff51d0e6276c42afb70199b4ba4367e1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:40.736223 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2b9ccaa5-5551-48bf-81bb-88fe4e11eb01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff51d0e6276c42afb70199b4ba4367e1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:40.755161 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3811/7596] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:14:40 2022] DELETE /identity/v3/users/ff51d0e6276c42afb70199b4ba4367e1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:14:41.409244 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec93b0-9ff5-47b2-8ae7-f2939618f30d admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:41.410796 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-58ec93b0-9ff5-47b2-8ae7-f2939618f30d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:41.424369 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec93b0-9ff5-47b2-8ae7-f2939618f30d admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:41.490300 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31aa9df-27c8-4d60-a142-ca9bfab05cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:41.491071 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31aa9df-27c8-4d60-a142-ca9bfab05cc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:41.491397 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31aa9df-27c8-4d60-a142-ca9bfab05cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:41.491676 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31aa9df-27c8-4d60-a142-ca9bfab05cc9 admin admin] PATH_INFO: `/v3/projects/None` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:41.501374 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31aa9df-27c8-4d60-a142-ca9bfab05cc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=None)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:41.503300 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31aa9df-27c8-4d60-a142-ca9bfab05cc9 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:41.516593 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-e31aa9df-27c8-4d60-a142-ca9bfab05cc9 admin admin] Could not find project: None.: keystone.exception.ProjectNotFound: Could not find project: None. Aug 29 16:14:41.516593 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:14:41.516593 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:14:41.516593 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:14:41.516593 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:14:41.516593 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:14:41.516593 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:14:41.516593 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:14:41.516593 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:14:41.516593 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:14:41.516593 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:14:41.516593 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:14:41.516593 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Aug 29 16:14:41.516593 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Aug 29 16:14:41.516593 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:14:41.516593 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:14:41.517537 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Aug 29 16:14:41.517537 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Aug 29 16:14:41.517537 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 16:14:41.517537 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 16:14:41.517537 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 16:14:41.517537 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 16:14:41.517537 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: None. Aug 29 16:14:41.517537 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:14:41.518198 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3786/7597] 10.222.0.83 () {58 vars in 1149 bytes} [Mon Aug 29 16:14:41 2022] DELETE /identity/v3/projects/None => generated 85 bytes in 109 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 16:14:48.526560 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ccaa5-5551-48bf-81bb-88fe4e11eb01 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:48.528152 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2b9ccaa5-5551-48bf-81bb-88fe4e11eb01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:48.543050 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ccaa5-5551-48bf-81bb-88fe4e11eb01 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:48.548840 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c71cdb9-f040-4763-8efc-2c09c25eed61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:48.549549 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71cdb9-f040-4763-8efc-2c09c25eed61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:48.549889 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71cdb9-f040-4763-8efc-2c09c25eed61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:48.550181 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71cdb9-f040-4763-8efc-2c09c25eed61 admin admin] PATH_INFO: `/v3/users/12de3ef79acd458baaec5e85570c8ae2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:48.551609 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c71cdb9-f040-4763-8efc-2c09c25eed61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12de3ef79acd458baaec5e85570c8ae2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:48.553533 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c71cdb9-f040-4763-8efc-2c09c25eed61 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:48.615353 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0c71cdb9-f040-4763-8efc-2c09c25eed61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12de3ef79acd458baaec5e85570c8ae2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:48.616141 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0c71cdb9-f040-4763-8efc-2c09c25eed61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12de3ef79acd458baaec5e85570c8ae2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:48.627881 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0c71cdb9-f040-4763-8efc-2c09c25eed61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12de3ef79acd458baaec5e85570c8ae2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:48.639758 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0c71cdb9-f040-4763-8efc-2c09c25eed61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12de3ef79acd458baaec5e85570c8ae2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:48.644019 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0c71cdb9-f040-4763-8efc-2c09c25eed61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12de3ef79acd458baaec5e85570c8ae2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:48.667597 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3812/7598] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:14:48 2022] DELETE /identity/v3/users/12de3ef79acd458baaec5e85570c8ae2 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:14:48.891535 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31aa9df-27c8-4d60-a142-ca9bfab05cc9 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:48.899695 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e31aa9df-27c8-4d60-a142-ca9bfab05cc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:48.922799 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31aa9df-27c8-4d60-a142-ca9bfab05cc9 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:48.935820 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:48.999655 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd3a8b-3101-4245-b207-aab05e7553b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:49.000301 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd3a8b-3101-4245-b207-aab05e7553b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:49.001242 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd3a8b-3101-4245-b207-aab05e7553b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:49.001602 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd3a8b-3101-4245-b207-aab05e7553b8 admin admin] PATH_INFO: `/v3/projects/392f9e4adbf748c9a83ff7673fc77cb7` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:49.003239 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd3a8b-3101-4245-b207-aab05e7553b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=392f9e4adbf748c9a83ff7673fc77cb7)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:49.005514 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd3a8b-3101-4245-b207-aab05e7553b8 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:49.090007 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-55dd3a8b-3101-4245-b207-aab05e7553b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '392f9e4adbf748c9a83ff7673fc77cb7', 'request_id': 'req-55dd3a8b-3101-4245-b207-aab05e7553b8'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:49.103674 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-55dd3a8b-3101-4245-b207-aab05e7553b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '392f9e4adbf748c9a83ff7673fc77cb7', 'request_id': 'req-55dd3a8b-3101-4245-b207-aab05e7553b8'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:49.114475 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-55dd3a8b-3101-4245-b207-aab05e7553b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '392f9e4adbf748c9a83ff7673fc77cb7', 'request_id': 'req-55dd3a8b-3101-4245-b207-aab05e7553b8'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:49.132240 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-55dd3a8b-3101-4245-b207-aab05e7553b8 admin admin] The token cache is being invalidate because project 392f9e4adbf748c9a83ff7673fc77cb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:14:49.132785 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-55dd3a8b-3101-4245-b207-aab05e7553b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:49.139325 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-55dd3a8b-3101-4245-b207-aab05e7553b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:49.139325 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3787/7599] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:14:48 2022] DELETE /identity/v3/projects/392f9e4adbf748c9a83ff7673fc77cb7 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:14:49.147068 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23eb31-de97-43cb-accc-284ce202316c None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:49.147485 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23eb31-de97-43cb-accc-284ce202316c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:49.147873 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23eb31-de97-43cb-accc-284ce202316c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:49.172718 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-cd23eb31-de97-43cb-accc-284ce202316c None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:14:49.174441 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-cd23eb31-de97-43cb-accc-284ce202316c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:49.247560 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3813/7600] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:14:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:14:49.255539 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e2375-f4d6-42b7-9368-c41707262650 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:49.255893 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e2375-f4d6-42b7-9368-c41707262650 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:49.256248 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e2375-f4d6-42b7-9368-c41707262650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:49.279630 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-b66e2375-f4d6-42b7-9368-c41707262650 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:14:49.280862 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b66e2375-f4d6-42b7-9368-c41707262650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:49.291548 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3788/7601] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:14:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:14:49.295988 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23eb31-de97-43cb-accc-284ce202316c None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:49.306862 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23eb31-de97-43cb-accc-284ce202316c None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:49.312102 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb88a87-69fa-4614-b619-792bc9c5bffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:49.312723 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb88a87-69fa-4614-b619-792bc9c5bffc admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:49.313005 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb88a87-69fa-4614-b619-792bc9c5bffc admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:49.313276 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb88a87-69fa-4614-b619-792bc9c5bffc admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:49.313930 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb88a87-69fa-4614-b619-792bc9c5bffc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:14:49.314234 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb88a87-69fa-4614-b619-792bc9c5bffc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:49.315889 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb88a87-69fa-4614-b619-792bc9c5bffc admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:49.331422 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3814/7602] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:14:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:14:49.332489 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e2375-f4d6-42b7-9368-c41707262650 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:49.343541 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e2375-f4d6-42b7-9368-c41707262650 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:49.348353 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e5ff29-5ef9-4830-964d-479f4eb4647e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:49.348971 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e5ff29-5ef9-4830-964d-479f4eb4647e admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:49.349252 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e5ff29-5ef9-4830-964d-479f4eb4647e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:49.349531 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e5ff29-5ef9-4830-964d-479f4eb4647e admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:49.350256 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e5ff29-5ef9-4830-964d-479f4eb4647e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:49.353306 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e5ff29-5ef9-4830-964d-479f4eb4647e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:49.384421 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3789/7603] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:14:49 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:14:49.386066 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb88a87-69fa-4614-b619-792bc9c5bffc admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:49.396932 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb88a87-69fa-4614-b619-792bc9c5bffc admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:49.419190 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:49.457919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d885925-d4cd-4cfc-b6f2-5a05a8b553db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:49.458533 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d885925-d4cd-4cfc-b6f2-5a05a8b553db admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:49.458813 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d885925-d4cd-4cfc-b6f2-5a05a8b553db admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:49.459168 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d885925-d4cd-4cfc-b6f2-5a05a8b553db admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:49.459754 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d885925-d4cd-4cfc-b6f2-5a05a8b553db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:49.461708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d885925-d4cd-4cfc-b6f2-5a05a8b553db admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:49.484270 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3815/7604] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:14:49 2022] POST /identity/v3/users => generated 284 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:14:49.487920 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e5ff29-5ef9-4830-964d-479f4eb4647e admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:49.499132 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e5ff29-5ef9-4830-964d-479f4eb4647e admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:49.504679 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3273b989-5a21-46a6-87eb-04107ea9d5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:49.505247 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3273b989-5a21-46a6-87eb-04107ea9d5b4 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:49.505530 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3273b989-5a21-46a6-87eb-04107ea9d5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:49.505806 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3273b989-5a21-46a6-87eb-04107ea9d5b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:49.506457 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3273b989-5a21-46a6-87eb-04107ea9d5b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:49.508207 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3273b989-5a21-46a6-87eb-04107ea9d5b4 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:49.518940 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3790/7605] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:14:49.522727 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d885925-d4cd-4cfc-b6f2-5a05a8b553db admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:49.533088 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d885925-d4cd-4cfc-b6f2-5a05a8b553db admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:49.537859 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f705b6-e912-4736-a277-f0a898e5604a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:49.538474 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f705b6-e912-4736-a277-f0a898e5604a admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:49.539310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f705b6-e912-4736-a277-f0a898e5604a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:49.539586 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f705b6-e912-4736-a277-f0a898e5604a admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:49.540228 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f705b6-e912-4736-a277-f0a898e5604a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:49.541837 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f705b6-e912-4736-a277-f0a898e5604a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:49.555203 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3816/7606] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:14:49.559469 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3273b989-5a21-46a6-87eb-04107ea9d5b4 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:49.569666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3273b989-5a21-46a6-87eb-04107ea9d5b4 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:49.575211 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea32dfa2-c579-490a-8c97-35755f796487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:49.575985 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32dfa2-c579-490a-8c97-35755f796487 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:49.576360 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32dfa2-c579-490a-8c97-35755f796487 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:49.576709 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32dfa2-c579-490a-8c97-35755f796487 admin admin] PATH_INFO: `/v3/projects/0d82685728d34330ba75d35e23065cb1/users/e667dee610ce46f4acf19997989172f0/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:49.593273 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea32dfa2-c579-490a-8c97-35755f796487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d82685728d34330ba75d35e23065cb1, user_id=e667dee610ce46f4acf19997989172f0, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:49.596057 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea32dfa2-c579-490a-8c97-35755f796487 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:49.610822 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3791/7607] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:14:49 2022] PUT /identity/v3/projects/0d82685728d34330ba75d35e23065cb1/users/e667dee610ce46f4acf19997989172f0/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:14:49.615646 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ff0b6-ffd6-403d-a3ba-f84420fa730c None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:49.615946 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ff0b6-ffd6-403d-a3ba-f84420fa730c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:49.616221 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ff0b6-ffd6-403d-a3ba-f84420fa730c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:49.637083 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-bf9ff0b6-ffd6-403d-a3ba-f84420fa730c None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:14:49.638605 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-bf9ff0b6-ffd6-403d-a3ba-f84420fa730c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:49.709807 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3817/7608] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:14:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:14:49.721649 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea32dfa2-c579-490a-8c97-35755f796487 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:49.723488 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ea32dfa2-c579-490a-8c97-35755f796487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:49.776330 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:49.795255 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea32dfa2-c579-490a-8c97-35755f796487 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:49.799175 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ee62c-b1b8-463e-8f1e-5833d49e4218 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:49.799830 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ee62c-b1b8-463e-8f1e-5833d49e4218 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:49.800113 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ee62c-b1b8-463e-8f1e-5833d49e4218 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:49.800388 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ee62c-b1b8-463e-8f1e-5833d49e4218 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:49.810328 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ee62c-b1b8-463e-8f1e-5833d49e4218 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:49.811867 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ee62c-b1b8-463e-8f1e-5833d49e4218 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:49.821907 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3792/7609] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:14:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:14:54.795827 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53379296-82fc-4d24-980c-0e6d79adac81 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:54.796422 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53379296-82fc-4d24-980c-0e6d79adac81 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:54.796546 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53379296-82fc-4d24-980c-0e6d79adac81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:54.854213 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-53379296-82fc-4d24-980c-0e6d79adac81 None None] MFA Rules not processed for user `e667dee610ce46f4acf19997989172f0`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:14:54.856027 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-53379296-82fc-4d24-980c-0e6d79adac81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:54.960357 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3818/7610] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:14:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:14:54.971773 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ebb50-0b45-41b4-b447-57ef746fa095 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:54.972590 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ebb50-0b45-41b4-b447-57ef746fa095 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:54.972590 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ebb50-0b45-41b4-b447-57ef746fa095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:55.006436 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-c38ebb50-0b45-41b4-b447-57ef746fa095 None None] MFA Rules not processed for user `e667dee610ce46f4acf19997989172f0`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:14:55.009138 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c38ebb50-0b45-41b4-b447-57ef746fa095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:55.018222 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3793/7611] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:14:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:14:55.030170 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53379296-82fc-4d24-980c-0e6d79adac81 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:55.031738 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-53379296-82fc-4d24-980c-0e6d79adac81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:55.089497 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:55.171514 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53379296-82fc-4d24-980c-0e6d79adac81 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:55.177753 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8dfe3-6a12-4b3e-93c7-853bb3ad196f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:55.181072 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8dfe3-6a12-4b3e-93c7-853bb3ad196f service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:55.181362 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8dfe3-6a12-4b3e-93c7-853bb3ad196f service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:55.181640 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8dfe3-6a12-4b3e-93c7-853bb3ad196f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:55.200349 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b8dfe3-6a12-4b3e-93c7-853bb3ad196f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:55.201979 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b8dfe3-6a12-4b3e-93c7-853bb3ad196f service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:55.216555 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3819/7612] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:14:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:14:57.434295 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ebb50-0b45-41b4-b447-57ef746fa095 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:57.437384 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c38ebb50-0b45-41b4-b447-57ef746fa095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:57.461173 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ebb50-0b45-41b4-b447-57ef746fa095 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:57.468856 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49680940-8193-46b5-a1cd-dab36493d635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:57.469728 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49680940-8193-46b5-a1cd-dab36493d635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:57.470150 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49680940-8193-46b5-a1cd-dab36493d635 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:57.470579 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49680940-8193-46b5-a1cd-dab36493d635 admin admin] PATH_INFO: `/v3/users/86ff3f40c7224251ae1346fc60f361f9` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:57.471974 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49680940-8193-46b5-a1cd-dab36493d635 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86ff3f40c7224251ae1346fc60f361f9)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:57.476008 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49680940-8193-46b5-a1cd-dab36493d635 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:57.546506 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-49680940-8193-46b5-a1cd-dab36493d635 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86ff3f40c7224251ae1346fc60f361f9'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:57.547748 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-49680940-8193-46b5-a1cd-dab36493d635 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86ff3f40c7224251ae1346fc60f361f9'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:57.565591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-49680940-8193-46b5-a1cd-dab36493d635 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86ff3f40c7224251ae1346fc60f361f9'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:57.575582 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-49680940-8193-46b5-a1cd-dab36493d635 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86ff3f40c7224251ae1346fc60f361f9'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:57.584701 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-49680940-8193-46b5-a1cd-dab36493d635 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86ff3f40c7224251ae1346fc60f361f9'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:57.594931 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3794/7613] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:14:57 2022] DELETE /identity/v3/users/86ff3f40c7224251ae1346fc60f361f9 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:14:57.597327 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986dfa3-3b9b-4743-b6c2-5aa70776e2c4 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:57.597769 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986dfa3-3b9b-4743-b6c2-5aa70776e2c4 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:57.597994 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986dfa3-3b9b-4743-b6c2-5aa70776e2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:57.624159 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-b986dfa3-3b9b-4743-b6c2-5aa70776e2c4 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:14:57.625585 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b986dfa3-3b9b-4743-b6c2-5aa70776e2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:57.719001 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3820/7614] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:14:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:14:57.729163 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49680940-8193-46b5-a1cd-dab36493d635 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:57.730694 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-49680940-8193-46b5-a1cd-dab36493d635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:57.833449 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49680940-8193-46b5-a1cd-dab36493d635 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:57.840549 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466be4bb-a58f-4a39-a095-5165407cce89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:57.842467 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466be4bb-a58f-4a39-a095-5165407cce89 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:57.842948 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466be4bb-a58f-4a39-a095-5165407cce89 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:57.843493 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466be4bb-a58f-4a39-a095-5165407cce89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:57.858145 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466be4bb-a58f-4a39-a095-5165407cce89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:57.859959 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466be4bb-a58f-4a39-a095-5165407cce89 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:57.871680 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3795/7615] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:14:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:14:58.089208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986dfa3-3b9b-4743-b6c2-5aa70776e2c4 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:58.090707 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b986dfa3-3b9b-4743-b6c2-5aa70776e2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:58.106560 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986dfa3-3b9b-4743-b6c2-5aa70776e2c4 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:58.112514 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf71b1c-5ec7-46e3-a088-c45706b01f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:58.113445 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf71b1c-5ec7-46e3-a088-c45706b01f6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:58.113939 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf71b1c-5ec7-46e3-a088-c45706b01f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:58.114260 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf71b1c-5ec7-46e3-a088-c45706b01f6c admin admin] PATH_INFO: `/v3/projects/e8971b1ee2b842588adbd7dc5d7552a0` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:58.115498 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf71b1c-5ec7-46e3-a088-c45706b01f6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8971b1ee2b842588adbd7dc5d7552a0)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:58.118277 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf71b1c-5ec7-46e3-a088-c45706b01f6c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:58.181413 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-dbf71b1c-5ec7-46e3-a088-c45706b01f6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8971b1ee2b842588adbd7dc5d7552a0', 'request_id': 'req-dbf71b1c-5ec7-46e3-a088-c45706b01f6c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:58.188969 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-dbf71b1c-5ec7-46e3-a088-c45706b01f6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8971b1ee2b842588adbd7dc5d7552a0', 'request_id': 'req-dbf71b1c-5ec7-46e3-a088-c45706b01f6c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:58.199725 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-dbf71b1c-5ec7-46e3-a088-c45706b01f6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8971b1ee2b842588adbd7dc5d7552a0', 'request_id': 'req-dbf71b1c-5ec7-46e3-a088-c45706b01f6c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:58.218721 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-dbf71b1c-5ec7-46e3-a088-c45706b01f6c admin admin] The token cache is being invalidate because project e8971b1ee2b842588adbd7dc5d7552a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:14:58.219042 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-dbf71b1c-5ec7-46e3-a088-c45706b01f6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:58.219718 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-dbf71b1c-5ec7-46e3-a088-c45706b01f6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:58.224158 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3821/7616] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:14:58 2022] DELETE /identity/v3/projects/e8971b1ee2b842588adbd7dc5d7552a0 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:14:58.225297 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466be4bb-a58f-4a39-a095-5165407cce89 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:58.236316 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466be4bb-a58f-4a39-a095-5165407cce89 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:58.382252 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:58.402646 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c28ad0-ffe6-4609-8453-5cbdcd53354e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:58.403566 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c28ad0-ffe6-4609-8453-5cbdcd53354e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:58.403875 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c28ad0-ffe6-4609-8453-5cbdcd53354e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:58.404155 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c28ad0-ffe6-4609-8453-5cbdcd53354e admin admin] PATH_INFO: `/v3/users/7e706be876af40be8a552950625dcf4b` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:58.406088 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c28ad0-ffe6-4609-8453-5cbdcd53354e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e706be876af40be8a552950625dcf4b)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:58.407695 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c28ad0-ffe6-4609-8453-5cbdcd53354e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:58.534084 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-60c28ad0-ffe6-4609-8453-5cbdcd53354e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e706be876af40be8a552950625dcf4b'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:58.535051 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-60c28ad0-ffe6-4609-8453-5cbdcd53354e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e706be876af40be8a552950625dcf4b'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:58.552530 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-60c28ad0-ffe6-4609-8453-5cbdcd53354e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e706be876af40be8a552950625dcf4b'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:58.564436 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-60c28ad0-ffe6-4609-8453-5cbdcd53354e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e706be876af40be8a552950625dcf4b'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:58.578856 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-60c28ad0-ffe6-4609-8453-5cbdcd53354e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e706be876af40be8a552950625dcf4b'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:58.587907 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3796/7617] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:14:58 2022] DELETE /identity/v3/users/7e706be876af40be8a552950625dcf4b => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:14:59.040330 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf71b1c-5ec7-46e3-a088-c45706b01f6c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:59.041944 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-dbf71b1c-5ec7-46e3-a088-c45706b01f6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:59.058128 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf71b1c-5ec7-46e3-a088-c45706b01f6c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:59.081048 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c28ad0-ffe6-4609-8453-5cbdcd53354e admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:59.082975 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-60c28ad0-ffe6-4609-8453-5cbdcd53354e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:59.171120 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:59.204599 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c89afcc-dc66-493a-8e10-3743c2861a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:59.207441 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89afcc-dc66-493a-8e10-3743c2861a5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:59.207831 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89afcc-dc66-493a-8e10-3743c2861a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:59.208032 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89afcc-dc66-493a-8e10-3743c2861a5e admin admin] PATH_INFO: `/v3/projects/4cbefe49f14d460698d1271801b625d9` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:59.209772 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c89afcc-dc66-493a-8e10-3743c2861a5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cbefe49f14d460698d1271801b625d9)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:59.213782 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c89afcc-dc66-493a-8e10-3743c2861a5e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:59.251163 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c28ad0-ffe6-4609-8453-5cbdcd53354e admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:59.264923 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59edc80e-5284-4681-ab88-eb587a087821 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:59.265948 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59edc80e-5284-4681-ab88-eb587a087821 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:59.266260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59edc80e-5284-4681-ab88-eb587a087821 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:59.266624 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59edc80e-5284-4681-ab88-eb587a087821 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:59.275166 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-59edc80e-5284-4681-ab88-eb587a087821 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:59.288325 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7c89afcc-dc66-493a-8e10-3743c2861a5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cbefe49f14d460698d1271801b625d9', 'request_id': 'req-7c89afcc-dc66-493a-8e10-3743c2861a5e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:59.306771 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7c89afcc-dc66-493a-8e10-3743c2861a5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cbefe49f14d460698d1271801b625d9', 'request_id': 'req-7c89afcc-dc66-493a-8e10-3743c2861a5e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:59.316216 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7c89afcc-dc66-493a-8e10-3743c2861a5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cbefe49f14d460698d1271801b625d9', 'request_id': 'req-7c89afcc-dc66-493a-8e10-3743c2861a5e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:59.348224 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7c89afcc-dc66-493a-8e10-3743c2861a5e admin admin] The token cache is being invalidate because project 4cbefe49f14d460698d1271801b625d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:14:59.348735 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7c89afcc-dc66-493a-8e10-3743c2861a5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:59.350044 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7c89afcc-dc66-493a-8e10-3743c2861a5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:59.357791 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3822/7618] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:14:59 2022] DELETE /identity/v3/projects/4cbefe49f14d460698d1271801b625d9 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:14:59.358990 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c89afcc-dc66-493a-8e10-3743c2861a5e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:59.361351 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7c89afcc-dc66-493a-8e10-3743c2861a5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:59.384262 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59edc80e-5284-4681-ab88-eb587a087821 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:59.386753 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59edc80e-5284-4681-ab88-eb587a087821 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:59.397725 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3797/7619] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:14:59 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:14:59.480610 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c89afcc-dc66-493a-8e10-3743c2861a5e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:59.486591 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f080b-abb5-4fa0-89d8-45156758bd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:59.487285 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f080b-abb5-4fa0-89d8-45156758bd9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:59.487567 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f080b-abb5-4fa0-89d8-45156758bd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:59.487841 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f080b-abb5-4fa0-89d8-45156758bd9b admin admin] PATH_INFO: `/v3/users/2b558a731c1d4b08b05a8bc05b784db9` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:59.489007 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f080b-abb5-4fa0-89d8-45156758bd9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b558a731c1d4b08b05a8bc05b784db9)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:59.491514 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f080b-abb5-4fa0-89d8-45156758bd9b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:59.592854 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8f9f080b-abb5-4fa0-89d8-45156758bd9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b558a731c1d4b08b05a8bc05b784db9'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:59.593972 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8f9f080b-abb5-4fa0-89d8-45156758bd9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b558a731c1d4b08b05a8bc05b784db9'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:59.609181 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8f9f080b-abb5-4fa0-89d8-45156758bd9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b558a731c1d4b08b05a8bc05b784db9'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:59.633731 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8f9f080b-abb5-4fa0-89d8-45156758bd9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b558a731c1d4b08b05a8bc05b784db9'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:59.634656 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8f9f080b-abb5-4fa0-89d8-45156758bd9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b558a731c1d4b08b05a8bc05b784db9'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:59.650366 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:59.679815 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3823/7620] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:14:59 2022] DELETE /identity/v3/users/2b558a731c1d4b08b05a8bc05b784db9 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:14:59.996132 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59edc80e-5284-4681-ab88-eb587a087821 service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:15:00.002804 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-59edc80e-5284-4681-ab88-eb587a087821 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:15:00.031327 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59edc80e-5284-4681-ab88-eb587a087821 service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:15:00.035783 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:00.111789 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108110c-6c6e-4633-9404-eeee38377378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:15:00.112445 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108110c-6c6e-4633-9404-eeee38377378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:15:00.112818 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108110c-6c6e-4633-9404-eeee38377378 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:15:00.113103 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108110c-6c6e-4633-9404-eeee38377378 admin admin] PATH_INFO: `/v3/projects/00c5f486cc50452e913c2e54517b9496` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:15:00.114265 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6108110c-6c6e-4633-9404-eeee38377378 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00c5f486cc50452e913c2e54517b9496)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:15:00.116453 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6108110c-6c6e-4633-9404-eeee38377378 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:15:00.175155 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6108110c-6c6e-4633-9404-eeee38377378 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00c5f486cc50452e913c2e54517b9496', 'request_id': 'req-6108110c-6c6e-4633-9404-eeee38377378'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:15:00.181813 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6108110c-6c6e-4633-9404-eeee38377378 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00c5f486cc50452e913c2e54517b9496', 'request_id': 'req-6108110c-6c6e-4633-9404-eeee38377378'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:15:00.190746 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6108110c-6c6e-4633-9404-eeee38377378 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00c5f486cc50452e913c2e54517b9496', 'request_id': 'req-6108110c-6c6e-4633-9404-eeee38377378'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:15:00.204381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6108110c-6c6e-4633-9404-eeee38377378 admin admin] The token cache is being invalidate because project 00c5f486cc50452e913c2e54517b9496 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:15:00.204675 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6108110c-6c6e-4633-9404-eeee38377378 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:15:00.205421 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6108110c-6c6e-4633-9404-eeee38377378 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:15:00.211180 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3798/7621] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:14:59 2022] DELETE /identity/v3/projects/00c5f486cc50452e913c2e54517b9496 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:15:00.213541 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939bc4b-7dd5-4471-bf9d-d84e19f402cd None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:15:00.213993 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939bc4b-7dd5-4471-bf9d-d84e19f402cd None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:15:00.214088 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939bc4b-7dd5-4471-bf9d-d84e19f402cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:15:00.236220 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-f939bc4b-7dd5-4471-bf9d-d84e19f402cd None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:15:00.237525 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f939bc4b-7dd5-4471-bf9d-d84e19f402cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:15:00.310160 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3824/7622] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:15:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:15:00.317859 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d164d75-328c-420f-876a-8abb046b5aaa None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:15:00.318494 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d164d75-328c-420f-876a-8abb046b5aaa None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:15:00.319173 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d164d75-328c-420f-876a-8abb046b5aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:15:00.343137 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-4d164d75-328c-420f-876a-8abb046b5aaa None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:15:00.345500 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4d164d75-328c-420f-876a-8abb046b5aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:15:00.358140 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3799/7623] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:15:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:15:00.359444 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f939bc4b-7dd5-4471-bf9d-d84e19f402cd None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:15:00.371348 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f939bc4b-7dd5-4471-bf9d-d84e19f402cd None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:15:00.376477 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc7cc2-f3a8-46f9-b346-f389c8f6e56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:15:00.377043 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc7cc2-f3a8-46f9-b346-f389c8f6e56e admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:15:00.377321 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc7cc2-f3a8-46f9-b346-f389c8f6e56e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:15:00.377593 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc7cc2-f3a8-46f9-b346-f389c8f6e56e admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:15:00.378245 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc7cc2-f3a8-46f9-b346-f389c8f6e56e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:15:00.378679 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc7cc2-f3a8-46f9-b346-f389c8f6e56e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:15:00.380335 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc7cc2-f3a8-46f9-b346-f389c8f6e56e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:15:00.396526 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3825/7624] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:15:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:15:00.401938 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d164d75-328c-420f-876a-8abb046b5aaa None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:15:00.420015 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d164d75-328c-420f-876a-8abb046b5aaa None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:15:00.425299 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d78bcd-bc7e-48b6-96b7-09c32dbf0bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:15:00.426289 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d78bcd-bc7e-48b6-96b7-09c32dbf0bec admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:15:00.430188 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d78bcd-bc7e-48b6-96b7-09c32dbf0bec admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:15:00.430492 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d78bcd-bc7e-48b6-96b7-09c32dbf0bec admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:15:00.431189 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d78bcd-bc7e-48b6-96b7-09c32dbf0bec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:15:00.433140 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d78bcd-bc7e-48b6-96b7-09c32dbf0bec admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:15:00.464019 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3800/7625] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:15:00 2022] POST /identity/v3/projects => generated 371 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:15:00.468176 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc7cc2-f3a8-46f9-b346-f389c8f6e56e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:15:00.480322 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc7cc2-f3a8-46f9-b346-f389c8f6e56e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:15:00.550045 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d48bc6-2908-4d65-97b7-88531277ba7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:15:00.550860 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d48bc6-2908-4d65-97b7-88531277ba7a admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:15:00.551314 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d48bc6-2908-4d65-97b7-88531277ba7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:15:00.551977 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d48bc6-2908-4d65-97b7-88531277ba7a admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:15:00.553283 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d48bc6-2908-4d65-97b7-88531277ba7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:15:00.556933 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d48bc6-2908-4d65-97b7-88531277ba7a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:15:00.582572 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3826/7626] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:15:00 2022] POST /identity/v3/users => generated 286 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:15:00.583901 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d78bcd-bc7e-48b6-96b7-09c32dbf0bec admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:15:00.595589 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d78bcd-bc7e-48b6-96b7-09c32dbf0bec admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:15:00.601379 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ef34c-916b-44f4-87e7-74a95be461b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:15:00.602060 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ef34c-916b-44f4-87e7-74a95be461b3 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:15:00.602397 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ef34c-916b-44f4-87e7-74a95be461b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:15:00.602702 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ef34c-916b-44f4-87e7-74a95be461b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:15:00.603439 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0ef34c-916b-44f4-87e7-74a95be461b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:15:00.605190 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0ef34c-916b-44f4-87e7-74a95be461b3 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:15:00.619100 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3801/7627] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:15:00.621163 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d48bc6-2908-4d65-97b7-88531277ba7a admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:15:00.631853 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d48bc6-2908-4d65-97b7-88531277ba7a admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:15:00.637747 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4088cf7-0f84-4070-a416-87a6b5372194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:15:00.638394 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4088cf7-0f84-4070-a416-87a6b5372194 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:15:00.638664 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4088cf7-0f84-4070-a416-87a6b5372194 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:15:00.638936 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4088cf7-0f84-4070-a416-87a6b5372194 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:15:00.639657 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4088cf7-0f84-4070-a416-87a6b5372194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:15:00.641271 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4088cf7-0f84-4070-a416-87a6b5372194 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:15:00.653538 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3827/7628] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:15:00.657806 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ef34c-916b-44f4-87e7-74a95be461b3 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:15:00.669400 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ef34c-916b-44f4-87e7-74a95be461b3 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:15:00.674240 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42449c42-dd84-47be-acd5-1702afede8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:15:00.674984 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42449c42-dd84-47be-acd5-1702afede8ec admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:15:00.675309 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42449c42-dd84-47be-acd5-1702afede8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:15:00.675584 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42449c42-dd84-47be-acd5-1702afede8ec admin admin] PATH_INFO: `/v3/projects/c91939ee21734b77890428f8d9a337be/users/5ffcf740d5ac459f8f624437ce64ab74/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:15:00.692976 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42449c42-dd84-47be-acd5-1702afede8ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=c91939ee21734b77890428f8d9a337be, user_id=5ffcf740d5ac459f8f624437ce64ab74, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:15:00.696016 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42449c42-dd84-47be-acd5-1702afede8ec admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:15:00.715679 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3802/7629] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:15:00 2022] PUT /identity/v3/projects/c91939ee21734b77890428f8d9a337be/users/5ffcf740d5ac459f8f624437ce64ab74/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:15:00.720977 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c4d02-1a54-44a3-ad43-e918f1cca747 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:15:00.721277 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c4d02-1a54-44a3-ad43-e918f1cca747 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:15:00.721539 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c4d02-1a54-44a3-ad43-e918f1cca747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:15:00.746859 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-0b3c4d02-1a54-44a3-ad43-e918f1cca747 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:15:00.748448 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0b3c4d02-1a54-44a3-ad43-e918f1cca747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:15:00.805271 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:00.822536 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3828/7630] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:15:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:15:00.827745 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42449c42-dd84-47be-acd5-1702afede8ec admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:15:00.829750 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-42449c42-dd84-47be-acd5-1702afede8ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:15:00.880608 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:00.918795 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42449c42-dd84-47be-acd5-1702afede8ec admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:15:00.924870 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4d2c7-cf2e-4b0d-90da-6071779c2827 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:15:00.925511 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4d2c7-cf2e-4b0d-90da-6071779c2827 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:15:00.925875 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4d2c7-cf2e-4b0d-90da-6071779c2827 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:15:00.926248 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4d2c7-cf2e-4b0d-90da-6071779c2827 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:15:00.939359 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec4d2c7-cf2e-4b0d-90da-6071779c2827 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:15:00.941016 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec4d2c7-cf2e-4b0d-90da-6071779c2827 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:15:00.956612 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3803/7631] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:15:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:15:06.009556 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61128c53-2257-4a6a-a376-493627e89644 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:15:06.010529 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61128c53-2257-4a6a-a376-493627e89644 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:15:06.010529 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61128c53-2257-4a6a-a376-493627e89644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:15:06.045328 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-61128c53-2257-4a6a-a376-493627e89644 None None] MFA Rules not processed for user `5ffcf740d5ac459f8f624437ce64ab74`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:15:06.046635 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-61128c53-2257-4a6a-a376-493627e89644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:15:06.126477 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3829/7632] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:15:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:15:06.130949 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4d2c7-cf2e-4b0d-90da-6071779c2827 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:15:06.145682 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4d2c7-cf2e-4b0d-90da-6071779c2827 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:15:06.151804 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc569c15-6077-4210-82a9-9cf0a00f8fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:15:06.152435 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc569c15-6077-4210-82a9-9cf0a00f8fff admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:15:06.153342 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc569c15-6077-4210-82a9-9cf0a00f8fff admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:15:06.153862 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc569c15-6077-4210-82a9-9cf0a00f8fff admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:15:06.154459 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc569c15-6077-4210-82a9-9cf0a00f8fff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:15:06.156392 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc569c15-6077-4210-82a9-9cf0a00f8fff admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:15:06.188586 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3804/7633] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:15:06 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:15:06.192619 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61128c53-2257-4a6a-a376-493627e89644 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:15:06.204655 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61128c53-2257-4a6a-a376-493627e89644 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:15:06.266781 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff10e6c9-c14c-442e-b183-e75a81b4a609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:15:06.267550 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10e6c9-c14c-442e-b183-e75a81b4a609 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:15:06.267832 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10e6c9-c14c-442e-b183-e75a81b4a609 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:15:06.268500 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10e6c9-c14c-442e-b183-e75a81b4a609 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:15:06.268755 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff10e6c9-c14c-442e-b183-e75a81b4a609 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:15:06.270697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff10e6c9-c14c-442e-b183-e75a81b4a609 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:15:06.294691 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3830/7634] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:15:06 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:15:06.298896 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc569c15-6077-4210-82a9-9cf0a00f8fff admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:15:06.309841 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc569c15-6077-4210-82a9-9cf0a00f8fff admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:15:06.317352 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282aa84-2c58-48fb-826f-3ec50c9d3efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:15:06.318045 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282aa84-2c58-48fb-826f-3ec50c9d3efe admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:15:06.318275 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282aa84-2c58-48fb-826f-3ec50c9d3efe admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:15:06.318552 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282aa84-2c58-48fb-826f-3ec50c9d3efe admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:15:06.319293 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0282aa84-2c58-48fb-826f-3ec50c9d3efe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:15:06.320976 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0282aa84-2c58-48fb-826f-3ec50c9d3efe admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:15:06.334254 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3805/7635] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:15:06.338739 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff10e6c9-c14c-442e-b183-e75a81b4a609 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:15:06.349012 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff10e6c9-c14c-442e-b183-e75a81b4a609 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:15:06.354471 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9545baf5-f963-4371-9aea-fc756f922f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:15:06.355167 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545baf5-f963-4371-9aea-fc756f922f33 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:15:06.355447 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545baf5-f963-4371-9aea-fc756f922f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:15:06.355718 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545baf5-f963-4371-9aea-fc756f922f33 admin admin] PATH_INFO: `/v3/projects/11ae71ce09c1464e886181510f2f689c/users/150e8c97bd4a489f8e1ec5bc306741e6/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:15:06.370522 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9545baf5-f963-4371-9aea-fc756f922f33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11ae71ce09c1464e886181510f2f689c, user_id=150e8c97bd4a489f8e1ec5bc306741e6, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:15:06.373239 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9545baf5-f963-4371-9aea-fc756f922f33 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:15:06.386831 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3831/7636] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:15:06 2022] PUT /identity/v3/projects/11ae71ce09c1464e886181510f2f689c/users/150e8c97bd4a489f8e1ec5bc306741e6/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:15:06.390729 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282aa84-2c58-48fb-826f-3ec50c9d3efe admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:15:06.401427 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282aa84-2c58-48fb-826f-3ec50c9d3efe admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:15:06.457887 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d16fe-8401-4670-a16a-f5c1ff7c7337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:15:06.458496 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d16fe-8401-4670-a16a-f5c1ff7c7337 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:15:06.458776 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d16fe-8401-4670-a16a-f5c1ff7c7337 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:15:06.459074 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d16fe-8401-4670-a16a-f5c1ff7c7337 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:15:06.459713 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d16fe-8401-4670-a16a-f5c1ff7c7337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:15:06.462099 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d16fe-8401-4670-a16a-f5c1ff7c7337 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:15:06.471911 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3806/7637] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:15:06.476147 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9545baf5-f963-4371-9aea-fc756f922f33 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:15:06.487538 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9545baf5-f963-4371-9aea-fc756f922f33 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:15:06.492786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c5e1e-9531-48f4-9036-81b6d997e070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:15:06.493638 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c5e1e-9531-48f4-9036-81b6d997e070 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:15:06.493892 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c5e1e-9531-48f4-9036-81b6d997e070 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:15:06.494164 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c5e1e-9531-48f4-9036-81b6d997e070 admin admin] PATH_INFO: `/v3/projects/11ae71ce09c1464e886181510f2f689c/users/150e8c97bd4a489f8e1ec5bc306741e6/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:15:06.496240 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5c5e1e-9531-48f4-9036-81b6d997e070 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11ae71ce09c1464e886181510f2f689c, user_id=150e8c97bd4a489f8e1ec5bc306741e6, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:15:06.499002 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5c5e1e-9531-48f4-9036-81b6d997e070 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:15:06.510038 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3832/7638] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:15:06 2022] PUT /identity/v3/projects/11ae71ce09c1464e886181510f2f689c/users/150e8c97bd4a489f8e1ec5bc306741e6/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:15:07.658834 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198c691-0406-4521-9cdd-3394fdac00d5 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:15:07.659622 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198c691-0406-4521-9cdd-3394fdac00d5 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:15:07.660002 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198c691-0406-4521-9cdd-3394fdac00d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:15:07.685924 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-0198c691-0406-4521-9cdd-3394fdac00d5 None None] MFA Rules not processed for user `e667dee610ce46f4acf19997989172f0`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:15:07.687837 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0198c691-0406-4521-9cdd-3394fdac00d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:15:07.783878 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3807/7639] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:15:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:15:08.676255 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c5e1e-9531-48f4-9036-81b6d997e070 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:15:08.678313 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-bd5c5e1e-9531-48f4-9036-81b6d997e070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:15:08.766923 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:08.831320 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c5e1e-9531-48f4-9036-81b6d997e070 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:15:08.843432 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1bf0de-bfcf-4251-bed7-eb3a16c494a2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:15:08.844082 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1bf0de-bfcf-4251-bed7-eb3a16c494a2 service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:15:08.844367 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1bf0de-bfcf-4251-bed7-eb3a16c494a2 service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:15:08.844650 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1bf0de-bfcf-4251-bed7-eb3a16c494a2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:15:08.848287 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ff1bf0de-bfcf-4251-bed7-eb3a16c494a2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:15:08.886079 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1bf0de-bfcf-4251-bed7-eb3a16c494a2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:15:08.887752 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1bf0de-bfcf-4251-bed7-eb3a16c494a2 service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:15:08.914936 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3833/7640] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:15:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:15:09.035075 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25893dd-92c6-47b7-843b-2ce985a3fcad None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:15:09.035592 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25893dd-92c6-47b7-843b-2ce985a3fcad None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:15:09.035592 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25893dd-92c6-47b7-843b-2ce985a3fcad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:15:09.062163 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-a25893dd-92c6-47b7-843b-2ce985a3fcad None None] MFA Rules not processed for user `e667dee610ce46f4acf19997989172f0`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:15:09.064208 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a25893dd-92c6-47b7-843b-2ce985a3fcad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:15:09.097227 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3808/7641] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:15:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:15:12.622631 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911e807-d00a-4ed5-878d-688d13047af7 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:15:12.623697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911e807-d00a-4ed5-878d-688d13047af7 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:15:12.623976 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911e807-d00a-4ed5-878d-688d13047af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:15:12.674027 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-6911e807-d00a-4ed5-878d-688d13047af7 None None] MFA Rules not processed for user `150e8c97bd4a489f8e1ec5bc306741e6`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:15:12.675868 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6911e807-d00a-4ed5-878d-688d13047af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:15:12.770978 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3834/7642] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:15:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:15:12.784603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25893dd-92c6-47b7-843b-2ce985a3fcad None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:15:12.786622 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a25893dd-92c6-47b7-843b-2ce985a3fcad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:15:12.840011 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:12.899297 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25893dd-92c6-47b7-843b-2ce985a3fcad None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:15:12.910221 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f487d2e-c442-48df-8cf3-be305b48d63d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:15:12.911604 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f487d2e-c442-48df-8cf3-be305b48d63d service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:15:12.912035 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f487d2e-c442-48df-8cf3-be305b48d63d service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:15:12.912494 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f487d2e-c442-48df-8cf3-be305b48d63d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:15:12.982394 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f487d2e-c442-48df-8cf3-be305b48d63d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:15:12.984907 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f487d2e-c442-48df-8cf3-be305b48d63d service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:15:12.996873 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3809/7643] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:15:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:15:14.562463 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af9157-1cc6-479e-8828-30b5a34cec1b None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:15:14.564801 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af9157-1cc6-479e-8828-30b5a34cec1b None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:15:14.565409 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af9157-1cc6-479e-8828-30b5a34cec1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:15:14.589520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-52af9157-1cc6-479e-8828-30b5a34cec1b None None] MFA Rules not processed for user `5ffcf740d5ac459f8f624437ce64ab74`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:15:14.591774 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-52af9157-1cc6-479e-8828-30b5a34cec1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:15:14.599847 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3835/7644] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:15:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:15:22.990662 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=39 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:24.583883 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=51 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:25.027715 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd4a5f-6195-4b7a-902f-05f7ccd2e71c None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:15:25.028191 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd4a5f-6195-4b7a-902f-05f7ccd2e71c None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:15:25.028290 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd4a5f-6195-4b7a-902f-05f7ccd2e71c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:15:25.049638 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-adbd4a5f-6195-4b7a-902f-05f7ccd2e71c None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:15:25.050861 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-adbd4a5f-6195-4b7a-902f-05f7ccd2e71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:15:25.114865 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3810/7645] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 16:15:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:15:25.167975 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af9157-1cc6-479e-8828-30b5a34cec1b None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:15:25.169417 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-52af9157-1cc6-479e-8828-30b5a34cec1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:15:25.250548 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af9157-1cc6-479e-8828-30b5a34cec1b None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:15:25.256140 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c9570-d295-4548-93dc-5929cd83c9bb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:15:25.256807 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c9570-d295-4548-93dc-5929cd83c9bb service swift] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:15:25.257083 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c9570-d295-4548-93dc-5929cd83c9bb service swift] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:15:25.257902 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c9570-d295-4548-93dc-5929cd83c9bb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:15:25.267947 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88c9570-d295-4548-93dc-5929cd83c9bb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:15:25.269524 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88c9570-d295-4548-93dc-5929cd83c9bb service swift] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:15:25.278988 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3836/7646] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 16:15:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:15:26.372695 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305fc1a-c365-4c07-92b9-1b0bcf05ccc5 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:15:26.373226 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305fc1a-c365-4c07-92b9-1b0bcf05ccc5 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:15:26.373226 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305fc1a-c365-4c07-92b9-1b0bcf05ccc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:15:26.394966 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-9305fc1a-c365-4c07-92b9-1b0bcf05ccc5 None None] MFA Rules not processed for user `e667dee610ce46f4acf19997989172f0`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:15:26.396892 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9305fc1a-c365-4c07-92b9-1b0bcf05ccc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:15:26.407626 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3811/7647] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:15:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:15:27.616014 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c9570-d295-4548-93dc-5929cd83c9bb service swift] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:15:27.778354 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c9570-d295-4548-93dc-5929cd83c9bb service swift] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:15:27.785120 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd09998a-3085-48d4-8198-e002b6634dbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:15:27.785992 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09998a-3085-48d4-8198-e002b6634dbf service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:15:27.786345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09998a-3085-48d4-8198-e002b6634dbf service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:15:27.786683 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09998a-3085-48d4-8198-e002b6634dbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:15:27.798256 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd09998a-3085-48d4-8198-e002b6634dbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:15:27.800127 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd09998a-3085-48d4-8198-e002b6634dbf service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:15:27.822868 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3837/7648] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:15:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:15:36.388485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=28 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:37.807479 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=58 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:42.748996 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305fc1a-c365-4c07-92b9-1b0bcf05ccc5 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:15:42.802586 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305fc1a-c365-4c07-92b9-1b0bcf05ccc5 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:15:42.809250 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25079326-cafc-4a65-88a2-6b56a649caa1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:15:42.810071 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25079326-cafc-4a65-88a2-6b56a649caa1 service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:15:42.810535 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25079326-cafc-4a65-88a2-6b56a649caa1 service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:15:42.810808 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25079326-cafc-4a65-88a2-6b56a649caa1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:15:42.813559 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-25079326-cafc-4a65-88a2-6b56a649caa1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:15:42.867969 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25079326-cafc-4a65-88a2-6b56a649caa1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:15:42.869673 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25079326-cafc-4a65-88a2-6b56a649caa1 service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:15:42.889577 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3812/7649] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:15:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:15:45.304753 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fa9fc-bc64-4e55-9153-7fa48a04ba9e None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:15:45.305268 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fa9fc-bc64-4e55-9153-7fa48a04ba9e None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:15:45.305374 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fa9fc-bc64-4e55-9153-7fa48a04ba9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:15:45.326460 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-cb0fa9fc-bc64-4e55-9153-7fa48a04ba9e None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:15:45.327765 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-cb0fa9fc-bc64-4e55-9153-7fa48a04ba9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:15:45.351286 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3838/7650] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 16:15:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:15:45.365055 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25079326-cafc-4a65-88a2-6b56a649caa1 service placement] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:15:45.393731 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25079326-cafc-4a65-88a2-6b56a649caa1 service placement] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:15:45.401217 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb18d8-f06d-4595-a28b-affecf288a9d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:15:45.402858 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb18d8-f06d-4595-a28b-affecf288a9d service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:15:45.403193 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb18d8-f06d-4595-a28b-affecf288a9d service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:15:45.403473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb18d8-f06d-4595-a28b-affecf288a9d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:15:45.412542 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb18d8-f06d-4595-a28b-affecf288a9d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:15:45.414171 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb18d8-f06d-4595-a28b-affecf288a9d service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:15:45.424382 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3813/7651] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 16:15:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:15:47.093981 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275553c9-fd8f-4898-9f24-87fd4ab402ca None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:15:47.094518 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275553c9-fd8f-4898-9f24-87fd4ab402ca None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:15:47.094518 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275553c9-fd8f-4898-9f24-87fd4ab402ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:15:47.116140 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-275553c9-fd8f-4898-9f24-87fd4ab402ca None None] MFA Rules not processed for user `e667dee610ce46f4acf19997989172f0`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:15:47.117651 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-275553c9-fd8f-4898-9f24-87fd4ab402ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:15:47.130292 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3839/7652] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:15:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:15:55.420581 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=38 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:57.110846 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=10 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:59.033624 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec68440-e560-4de7-98a6-205d3bad47bd None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:15:59.034160 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec68440-e560-4de7-98a6-205d3bad47bd None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:15:59.034282 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec68440-e560-4de7-98a6-205d3bad47bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:15:59.054837 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-3ec68440-e560-4de7-98a6-205d3bad47bd None None] MFA Rules not processed for user `e667dee610ce46f4acf19997989172f0`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:15:59.056096 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3ec68440-e560-4de7-98a6-205d3bad47bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:15:59.064252 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3814/7653] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:15:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:16:01.424817 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ffa55f-2198-406c-b02a-541b72f57461 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:01.425345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ffa55f-2198-406c-b02a-541b72f57461 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:01.425345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ffa55f-2198-406c-b02a-541b72f57461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:01.445806 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-15ffa55f-2198-406c-b02a-541b72f57461 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:16:01.447081 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-15ffa55f-2198-406c-b02a-541b72f57461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:01.456558 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3840/7654] 10.222.0.83 () {58 vars in 967 bytes} [Mon Aug 29 16:16:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:16:01.472173 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec68440-e560-4de7-98a6-205d3bad47bd None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:01.488001 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec68440-e560-4de7-98a6-205d3bad47bd None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:01.494787 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1eb7d2-cda8-4887-89ef-fd525af27fe4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:01.495447 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1eb7d2-cda8-4887-89ef-fd525af27fe4 service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:01.496065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1eb7d2-cda8-4887-89ef-fd525af27fe4 service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:01.496065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1eb7d2-cda8-4887-89ef-fd525af27fe4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:01.506324 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1eb7d2-cda8-4887-89ef-fd525af27fe4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:01.508016 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1eb7d2-cda8-4887-89ef-fd525af27fe4 service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:01.517345 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3815/7655] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 16:16:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 16:16:06.687925 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ffa55f-2198-406c-b02a-541b72f57461 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:06.711694 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ffa55f-2198-406c-b02a-541b72f57461 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:06.715425 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb9402-4e58-4543-b8c5-77d0e6eda6f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:06.716128 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb9402-4e58-4543-b8c5-77d0e6eda6f3 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:06.716402 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb9402-4e58-4543-b8c5-77d0e6eda6f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:06.716680 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb9402-4e58-4543-b8c5-77d0e6eda6f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:06.718520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1afb9402-4e58-4543-b8c5-77d0e6eda6f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:06.731047 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afb9402-4e58-4543-b8c5-77d0e6eda6f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:06.732985 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afb9402-4e58-4543-b8c5-77d0e6eda6f3 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:06.744520 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3841/7656] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:16:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:16:08.302357 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1eb7d2-cda8-4887-89ef-fd525af27fe4 service swift] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:08.304083 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6e1eb7d2-cda8-4887-89ef-fd525af27fe4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:08.346134 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1eb7d2-cda8-4887-89ef-fd525af27fe4 service swift] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:08.351310 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d952a7-e7d1-4677-b5d3-ba7d17435d4a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:08.351922 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d952a7-e7d1-4677-b5d3-ba7d17435d4a service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:08.352207 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d952a7-e7d1-4677-b5d3-ba7d17435d4a service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:08.352484 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d952a7-e7d1-4677-b5d3-ba7d17435d4a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:08.354317 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a6d952a7-e7d1-4677-b5d3-ba7d17435d4a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:08.369194 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d952a7-e7d1-4677-b5d3-ba7d17435d4a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:08.370835 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d952a7-e7d1-4677-b5d3-ba7d17435d4a service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:08.383591 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3816/7657] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:16:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:16:16.738514 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=13 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:18.376879 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=24 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:19.737949 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb9402-4e58-4543-b8c5-77d0e6eda6f3 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:19.740312 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1afb9402-4e58-4543-b8c5-77d0e6eda6f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:19.835345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb9402-4e58-4543-b8c5-77d0e6eda6f3 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:19.844215 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc9525-c41c-4010-b5c8-afb5bdbf8423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:19.845321 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc9525-c41c-4010-b5c8-afb5bdbf8423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:19.847385 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc9525-c41c-4010-b5c8-afb5bdbf8423 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:19.847907 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc9525-c41c-4010-b5c8-afb5bdbf8423 admin admin] PATH_INFO: `/v3/users/e1ce5d3d668743d5b8843936f77c0150` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:19.850232 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cc9525-c41c-4010-b5c8-afb5bdbf8423 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1ce5d3d668743d5b8843936f77c0150)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:19.853350 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cc9525-c41c-4010-b5c8-afb5bdbf8423 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:19.934526 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-42cc9525-c41c-4010-b5c8-afb5bdbf8423 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1ce5d3d668743d5b8843936f77c0150'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:19.935604 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-42cc9525-c41c-4010-b5c8-afb5bdbf8423 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1ce5d3d668743d5b8843936f77c0150'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:19.945200 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-42cc9525-c41c-4010-b5c8-afb5bdbf8423 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1ce5d3d668743d5b8843936f77c0150'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:19.955096 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-42cc9525-c41c-4010-b5c8-afb5bdbf8423 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1ce5d3d668743d5b8843936f77c0150'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:19.965284 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-42cc9525-c41c-4010-b5c8-afb5bdbf8423 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1ce5d3d668743d5b8843936f77c0150'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:19.992437 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3842/7658] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:16:19 2022] DELETE /identity/v3/users/e1ce5d3d668743d5b8843936f77c0150 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:16:19.997711 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0a82a-25a8-4461-afe7-f10268f86772 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:19.998212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0a82a-25a8-4461-afe7-f10268f86772 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:19.998288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0a82a-25a8-4461-afe7-f10268f86772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:20.021017 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-b0b0a82a-25a8-4461-afe7-f10268f86772 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:16:20.022272 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b0b0a82a-25a8-4461-afe7-f10268f86772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:20.094394 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3817/7659] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:16:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:16:20.101017 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc9525-c41c-4010-b5c8-afb5bdbf8423 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:20.102506 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-42cc9525-c41c-4010-b5c8-afb5bdbf8423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:20.170481 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc9525-c41c-4010-b5c8-afb5bdbf8423 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:20.174792 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0dfe3-50d6-4ea0-9512-fb6af42852ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:20.175457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0dfe3-50d6-4ea0-9512-fb6af42852ac service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:20.175762 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0dfe3-50d6-4ea0-9512-fb6af42852ac service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:20.176094 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0dfe3-50d6-4ea0-9512-fb6af42852ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:20.186399 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d0dfe3-50d6-4ea0-9512-fb6af42852ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:20.187868 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d0dfe3-50d6-4ea0-9512-fb6af42852ac service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:20.197404 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3843/7660] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:16:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:16:20.371463 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0a82a-25a8-4461-afe7-f10268f86772 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:20.373119 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b0b0a82a-25a8-4461-afe7-f10268f86772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:20.388941 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0a82a-25a8-4461-afe7-f10268f86772 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:20.393761 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1355a6-5f4d-4e9b-b4b5-52ea733f50cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:20.394407 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1355a6-5f4d-4e9b-b4b5-52ea733f50cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:20.394690 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1355a6-5f4d-4e9b-b4b5-52ea733f50cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:20.394961 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1355a6-5f4d-4e9b-b4b5-52ea733f50cb admin admin] PATH_INFO: `/v3/projects/18bd3c1e18644293a3cc974c300efd06` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:20.396329 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1355a6-5f4d-4e9b-b4b5-52ea733f50cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=18bd3c1e18644293a3cc974c300efd06)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:20.398135 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1355a6-5f4d-4e9b-b4b5-52ea733f50cb admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:20.448623 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5f1355a6-5f4d-4e9b-b4b5-52ea733f50cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18bd3c1e18644293a3cc974c300efd06', 'request_id': 'req-5f1355a6-5f4d-4e9b-b4b5-52ea733f50cb'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:20.454946 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5f1355a6-5f4d-4e9b-b4b5-52ea733f50cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18bd3c1e18644293a3cc974c300efd06', 'request_id': 'req-5f1355a6-5f4d-4e9b-b4b5-52ea733f50cb'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:20.463155 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5f1355a6-5f4d-4e9b-b4b5-52ea733f50cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18bd3c1e18644293a3cc974c300efd06', 'request_id': 'req-5f1355a6-5f4d-4e9b-b4b5-52ea733f50cb'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:20.477520 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5f1355a6-5f4d-4e9b-b4b5-52ea733f50cb admin admin] The token cache is being invalidate because project 18bd3c1e18644293a3cc974c300efd06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:16:20.477915 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5f1355a6-5f4d-4e9b-b4b5-52ea733f50cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:20.478569 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5f1355a6-5f4d-4e9b-b4b5-52ea733f50cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:20.480088 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3818/7661] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:16:20 2022] DELETE /identity/v3/projects/18bd3c1e18644293a3cc974c300efd06 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:16:20.485394 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0dfe3-50d6-4ea0-9512-fb6af42852ac service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:20.498003 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0dfe3-50d6-4ea0-9512-fb6af42852ac service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:20.510338 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:20.568610 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2485a628-0d99-4814-87c3-3f6c19849ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:20.569248 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485a628-0d99-4814-87c3-3f6c19849ed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:20.569521 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485a628-0d99-4814-87c3-3f6c19849ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:20.569785 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485a628-0d99-4814-87c3-3f6c19849ed0 admin admin] PATH_INFO: `/v3/users/eaf0b86011214b97b4f024c97dba2422` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:20.570913 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2485a628-0d99-4814-87c3-3f6c19849ed0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaf0b86011214b97b4f024c97dba2422)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:20.573181 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2485a628-0d99-4814-87c3-3f6c19849ed0 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:20.631721 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2485a628-0d99-4814-87c3-3f6c19849ed0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaf0b86011214b97b4f024c97dba2422'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:20.632379 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2485a628-0d99-4814-87c3-3f6c19849ed0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaf0b86011214b97b4f024c97dba2422'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:20.641593 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2485a628-0d99-4814-87c3-3f6c19849ed0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaf0b86011214b97b4f024c97dba2422'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:20.649399 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2485a628-0d99-4814-87c3-3f6c19849ed0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaf0b86011214b97b4f024c97dba2422'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:20.650169 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2485a628-0d99-4814-87c3-3f6c19849ed0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaf0b86011214b97b4f024c97dba2422'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:20.669140 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3844/7662] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:16:20 2022] DELETE /identity/v3/users/eaf0b86011214b97b4f024c97dba2422 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:16:20.846009 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1355a6-5f4d-4e9b-b4b5-52ea733f50cb admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:20.848301 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5f1355a6-5f4d-4e9b-b4b5-52ea733f50cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:20.871388 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1355a6-5f4d-4e9b-b4b5-52ea733f50cb admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:20.947176 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb0445-0a6c-49ae-9fb0-73e8703f82ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:20.947905 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb0445-0a6c-49ae-9fb0-73e8703f82ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:20.948186 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb0445-0a6c-49ae-9fb0-73e8703f82ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:20.948460 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb0445-0a6c-49ae-9fb0-73e8703f82ff admin admin] PATH_INFO: `/v3/projects/4555b1319975418da819b6e0eefb32cf` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:20.949601 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb0445-0a6c-49ae-9fb0-73e8703f82ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=4555b1319975418da819b6e0eefb32cf)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:20.952189 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb0445-0a6c-49ae-9fb0-73e8703f82ff admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:20.984507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:21.006844 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e5cb0445-0a6c-49ae-9fb0-73e8703f82ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4555b1319975418da819b6e0eefb32cf', 'request_id': 'req-e5cb0445-0a6c-49ae-9fb0-73e8703f82ff'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:21.014611 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e5cb0445-0a6c-49ae-9fb0-73e8703f82ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4555b1319975418da819b6e0eefb32cf', 'request_id': 'req-e5cb0445-0a6c-49ae-9fb0-73e8703f82ff'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:21.023904 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e5cb0445-0a6c-49ae-9fb0-73e8703f82ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4555b1319975418da819b6e0eefb32cf', 'request_id': 'req-e5cb0445-0a6c-49ae-9fb0-73e8703f82ff'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:21.036741 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e5cb0445-0a6c-49ae-9fb0-73e8703f82ff admin admin] The token cache is being invalidate because project 4555b1319975418da819b6e0eefb32cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:16:21.037033 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e5cb0445-0a6c-49ae-9fb0-73e8703f82ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:21.037700 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e5cb0445-0a6c-49ae-9fb0-73e8703f82ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:21.039520 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3819/7663] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:16:20 2022] DELETE /identity/v3/projects/4555b1319975418da819b6e0eefb32cf => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:16:21.047080 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c375bde-3609-429e-b84a-abda1ee490a1 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:21.047620 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c375bde-3609-429e-b84a-abda1ee490a1 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:21.047620 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c375bde-3609-429e-b84a-abda1ee490a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:21.082668 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-3c375bde-3609-429e-b84a-abda1ee490a1 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:16:21.083926 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3c375bde-3609-429e-b84a-abda1ee490a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:21.148118 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3845/7664] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:16:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:16:21.157585 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e0150-b971-41fe-b712-6608fa736aaa None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:21.157902 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e0150-b971-41fe-b712-6608fa736aaa None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:21.158180 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e0150-b971-41fe-b712-6608fa736aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:21.180268 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-6b6e0150-b971-41fe-b712-6608fa736aaa None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:16:21.181481 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6b6e0150-b971-41fe-b712-6608fa736aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:21.189960 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3820/7665] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:16:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:16:21.194436 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c375bde-3609-429e-b84a-abda1ee490a1 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:21.208031 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c375bde-3609-429e-b84a-abda1ee490a1 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:21.214203 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124fc0d-179c-4dc6-88b5-f5fbf37a3364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:21.214877 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124fc0d-179c-4dc6-88b5-f5fbf37a3364 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:21.216174 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124fc0d-179c-4dc6-88b5-f5fbf37a3364 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:21.216174 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124fc0d-179c-4dc6-88b5-f5fbf37a3364 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:21.216805 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9124fc0d-179c-4dc6-88b5-f5fbf37a3364 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:16:21.217161 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9124fc0d-179c-4dc6-88b5-f5fbf37a3364 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:21.218926 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9124fc0d-179c-4dc6-88b5-f5fbf37a3364 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:21.235178 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3846/7666] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:16:21.238053 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e0150-b971-41fe-b712-6608fa736aaa None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:21.248649 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e0150-b971-41fe-b712-6608fa736aaa None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:21.253750 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3f55c-0f9b-43c8-8f8a-634c135d9495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:21.254457 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3f55c-0f9b-43c8-8f8a-634c135d9495 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:21.254737 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3f55c-0f9b-43c8-8f8a-634c135d9495 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:21.255010 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3f55c-0f9b-43c8-8f8a-634c135d9495 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:21.255725 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf3f55c-0f9b-43c8-8f8a-634c135d9495 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:21.257733 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf3f55c-0f9b-43c8-8f8a-634c135d9495 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:21.288694 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3821/7667] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:16:21 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:16:21.293092 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124fc0d-179c-4dc6-88b5-f5fbf37a3364 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:21.304007 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124fc0d-179c-4dc6-88b5-f5fbf37a3364 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:21.313393 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:21.368611 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09ab9c-d7a2-4040-99aa-eaad943b5e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:21.369228 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09ab9c-d7a2-4040-99aa-eaad943b5e3d admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:21.369499 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09ab9c-d7a2-4040-99aa-eaad943b5e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:21.369769 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09ab9c-d7a2-4040-99aa-eaad943b5e3d admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:21.370411 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f09ab9c-d7a2-4040-99aa-eaad943b5e3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:21.372577 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f09ab9c-d7a2-4040-99aa-eaad943b5e3d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:21.394837 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3847/7668] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:16:21 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:16:21.399153 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3f55c-0f9b-43c8-8f8a-634c135d9495 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:21.410682 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3f55c-0f9b-43c8-8f8a-634c135d9495 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:21.415779 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b57eb-d94d-4ffd-a522-18ef799dd631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:21.416387 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b57eb-d94d-4ffd-a522-18ef799dd631 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:21.416667 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b57eb-d94d-4ffd-a522-18ef799dd631 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:21.416940 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b57eb-d94d-4ffd-a522-18ef799dd631 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:21.417580 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b57eb-d94d-4ffd-a522-18ef799dd631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:21.419292 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b57eb-d94d-4ffd-a522-18ef799dd631 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:21.430665 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3822/7669] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:16:21.434871 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09ab9c-d7a2-4040-99aa-eaad943b5e3d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:21.445806 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09ab9c-d7a2-4040-99aa-eaad943b5e3d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:21.451192 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e12fa-31a5-4123-b361-948d29246244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:21.451862 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e12fa-31a5-4123-b361-948d29246244 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:21.452179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e12fa-31a5-4123-b361-948d29246244 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:21.452481 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e12fa-31a5-4123-b361-948d29246244 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:21.453135 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3e12fa-31a5-4123-b361-948d29246244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:21.454803 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3e12fa-31a5-4123-b361-948d29246244 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:21.466271 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3848/7670] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:16:21.470813 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b57eb-d94d-4ffd-a522-18ef799dd631 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:21.481138 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b57eb-d94d-4ffd-a522-18ef799dd631 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:21.485979 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c671e2-6e39-4b60-aa0c-c3104d7fe674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:21.486571 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c671e2-6e39-4b60-aa0c-c3104d7fe674 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:21.486850 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c671e2-6e39-4b60-aa0c-c3104d7fe674 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:21.487156 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c671e2-6e39-4b60-aa0c-c3104d7fe674 admin admin] PATH_INFO: `/v3/projects/97a2ef4e55764b7f8893ae5915189388/users/8f5c116d3c0f4796b189c9f5ff98de65/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:21.502466 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c671e2-6e39-4b60-aa0c-c3104d7fe674 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97a2ef4e55764b7f8893ae5915189388, user_id=8f5c116d3c0f4796b189c9f5ff98de65, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:21.505177 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c671e2-6e39-4b60-aa0c-c3104d7fe674 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:21.519379 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3823/7671] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:16:21 2022] PUT /identity/v3/projects/97a2ef4e55764b7f8893ae5915189388/users/8f5c116d3c0f4796b189c9f5ff98de65/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:16:21.534085 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae6e5a-fde5-40fe-9041-2fde45d8c9f2 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:21.534367 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae6e5a-fde5-40fe-9041-2fde45d8c9f2 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:21.534836 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae6e5a-fde5-40fe-9041-2fde45d8c9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:21.564467 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-6eae6e5a-fde5-40fe-9041-2fde45d8c9f2 None None] MFA Rules not processed for user `8f5c116d3c0f4796b189c9f5ff98de65`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:16:21.565686 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6eae6e5a-fde5-40fe-9041-2fde45d8c9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:21.630986 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3849/7672] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:16:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:16:21.635721 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c671e2-6e39-4b60-aa0c-c3104d7fe674 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:21.685721 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1d966-0069-4aac-b7ea-a5d37bb0fbd9 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:21.686004 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1d966-0069-4aac-b7ea-a5d37bb0fbd9 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:21.686266 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1d966-0069-4aac-b7ea-a5d37bb0fbd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:21.706756 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c671e2-6e39-4b60-aa0c-c3104d7fe674 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:21.711764 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f0544-8aca-4433-9cc2-1b74ca521b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:21.711936 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-80f1d966-0069-4aac-b7ea-a5d37bb0fbd9 None None] MFA Rules not processed for user `e667dee610ce46f4acf19997989172f0`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:16:21.712401 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f0544-8aca-4433-9cc2-1b74ca521b31 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:21.712711 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f0544-8aca-4433-9cc2-1b74ca521b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:21.712985 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f0544-8aca-4433-9cc2-1b74ca521b31 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:21.713096 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-80f1d966-0069-4aac-b7ea-a5d37bb0fbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:21.713638 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554f0544-8aca-4433-9cc2-1b74ca521b31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:21.716285 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554f0544-8aca-4433-9cc2-1b74ca521b31 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:21.749173 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3824/7673] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:16:21 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:16:21.750208 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f0544-8aca-4433-9cc2-1b74ca521b31 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:21.776053 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3850/7674] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:16:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:16:21.790915 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:21.819377 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f0544-8aca-4433-9cc2-1b74ca521b31 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:21.824569 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d8b5ad-a250-41ad-99b0-1e3f3ed7492d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:21.825857 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d8b5ad-a250-41ad-99b0-1e3f3ed7492d admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:21.826134 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d8b5ad-a250-41ad-99b0-1e3f3ed7492d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:21.826408 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d8b5ad-a250-41ad-99b0-1e3f3ed7492d admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:21.827078 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d8b5ad-a250-41ad-99b0-1e3f3ed7492d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:21.829049 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d8b5ad-a250-41ad-99b0-1e3f3ed7492d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:21.852417 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3825/7675] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:16:21 2022] POST /identity/v3/users => generated 300 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:16:21.856752 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f1d966-0069-4aac-b7ea-a5d37bb0fbd9 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:21.869061 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f1d966-0069-4aac-b7ea-a5d37bb0fbd9 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:21.874576 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6f098-af9e-4daa-b48b-200c70598080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:21.875328 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6f098-af9e-4daa-b48b-200c70598080 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:21.875604 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6f098-af9e-4daa-b48b-200c70598080 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:21.875869 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6f098-af9e-4daa-b48b-200c70598080 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:21.876532 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6f098-af9e-4daa-b48b-200c70598080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:21.878201 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6f098-af9e-4daa-b48b-200c70598080 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:21.891052 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3851/7676] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:16:21.894432 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d8b5ad-a250-41ad-99b0-1e3f3ed7492d admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:21.905221 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d8b5ad-a250-41ad-99b0-1e3f3ed7492d admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:21.910912 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a59a6-aa45-433f-b5c9-234649beb457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:21.910912 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a59a6-aa45-433f-b5c9-234649beb457 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:21.910912 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a59a6-aa45-433f-b5c9-234649beb457 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:21.911261 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a59a6-aa45-433f-b5c9-234649beb457 admin admin] PATH_INFO: `/v3/projects/48abc8b3b9e84cc498ae558d6a1ad08a/users/22b546737d6f47c89952e5ed11610832/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:21.931359 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9a59a6-aa45-433f-b5c9-234649beb457 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48abc8b3b9e84cc498ae558d6a1ad08a, user_id=22b546737d6f47c89952e5ed11610832, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:21.934736 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9a59a6-aa45-433f-b5c9-234649beb457 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:21.949429 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3826/7677] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:16:21 2022] PUT /identity/v3/projects/48abc8b3b9e84cc498ae558d6a1ad08a/users/22b546737d6f47c89952e5ed11610832/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:16:21.960847 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8a693-9ac8-493b-97a2-5e0b8f962e77 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:21.961142 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8a693-9ac8-493b-97a2-5e0b8f962e77 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:21.961422 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8a693-9ac8-493b-97a2-5e0b8f962e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:21.989107 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:21.992512 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-56c8a693-9ac8-493b-97a2-5e0b8f962e77 None None] MFA Rules not processed for user `22b546737d6f47c89952e5ed11610832`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:16:21.994609 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-56c8a693-9ac8-493b-97a2-5e0b8f962e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:22.065855 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3852/7678] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:16:21 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:16:22.096817 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a59a6-aa45-433f-b5c9-234649beb457 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:22.098758 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3a9a59a6-aa45-433f-b5c9-234649beb457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:22.183344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a59a6-aa45-433f-b5c9-234649beb457 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:22.189390 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef433d-3549-454a-a299-7a5a5e552a77 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:22.190006 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef433d-3549-454a-a299-7a5a5e552a77 service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:22.190288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef433d-3549-454a-a299-7a5a5e552a77 service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:22.190554 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef433d-3549-454a-a299-7a5a5e552a77 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:22.198792 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef433d-3549-454a-a299-7a5a5e552a77 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:22.200472 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef433d-3549-454a-a299-7a5a5e552a77 service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:22.209142 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3827/7679] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 16:16:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 678 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:16:22.865181 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8a693-9ac8-493b-97a2-5e0b8f962e77 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:22.927160 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef433d-3549-454a-a299-7a5a5e552a77 service swift] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:22.929444 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-faef433d-3549-454a-a299-7a5a5e552a77 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:22.932382 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8a693-9ac8-493b-97a2-5e0b8f962e77 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:22.937401 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd76a06-b236-40b4-8f5d-6723aeafdf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:22.938050 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd76a06-b236-40b4-8f5d-6723aeafdf8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:22.938332 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd76a06-b236-40b4-8f5d-6723aeafdf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:22.938606 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd76a06-b236-40b4-8f5d-6723aeafdf8d admin admin] PATH_INFO: `/v3/users/8f5c116d3c0f4796b189c9f5ff98de65` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:22.939860 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd76a06-b236-40b4-8f5d-6723aeafdf8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f5c116d3c0f4796b189c9f5ff98de65)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:22.941852 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd76a06-b236-40b4-8f5d-6723aeafdf8d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:23.003649 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6bd76a06-b236-40b4-8f5d-6723aeafdf8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f5c116d3c0f4796b189c9f5ff98de65'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:23.004442 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6bd76a06-b236-40b4-8f5d-6723aeafdf8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f5c116d3c0f4796b189c9f5ff98de65'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:23.008705 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef433d-3549-454a-a299-7a5a5e552a77 service swift] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:23.012718 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6bd76a06-b236-40b4-8f5d-6723aeafdf8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f5c116d3c0f4796b189c9f5ff98de65'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:23.014858 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d73ae-75b4-4918-ace6-9f05cb8e2092 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:23.015524 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d73ae-75b4-4918-ace6-9f05cb8e2092 service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:23.015808 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d73ae-75b4-4918-ace6-9f05cb8e2092 service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:23.016086 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d73ae-75b4-4918-ace6-9f05cb8e2092 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:23.017892 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ab4d73ae-75b4-4918-ace6-9f05cb8e2092 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:23.020712 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6bd76a06-b236-40b4-8f5d-6723aeafdf8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f5c116d3c0f4796b189c9f5ff98de65'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:23.021412 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-6bd76a06-b236-40b4-8f5d-6723aeafdf8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f5c116d3c0f4796b189c9f5ff98de65'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:23.032628 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d73ae-75b4-4918-ace6-9f05cb8e2092 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:23.034232 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d73ae-75b4-4918-ace6-9f05cb8e2092 service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:23.039143 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3853/7680] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:16:22 2022] DELETE /identity/v3/users/8f5c116d3c0f4796b189c9f5ff98de65 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:16:23.044050 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebecf4da-f5ac-4031-9de6-c70b44eddf78 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:23.044339 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebecf4da-f5ac-4031-9de6-c70b44eddf78 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:23.044618 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebecf4da-f5ac-4031-9de6-c70b44eddf78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:23.049385 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3828/7681] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:16:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:16:23.069266 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-ebecf4da-f5ac-4031-9de6-c70b44eddf78 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:16:23.070484 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ebecf4da-f5ac-4031-9de6-c70b44eddf78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:23.088564 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:23.137161 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3854/7682] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:16:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:16:23.147652 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d73ae-75b4-4918-ace6-9f05cb8e2092 service placement] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:23.149435 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ab4d73ae-75b4-4918-ace6-9f05cb8e2092 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:23.175196 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:23.216487 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d73ae-75b4-4918-ace6-9f05cb8e2092 service placement] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:23.271560 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916605a-8c57-4669-b444-bb1ed9c14202 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:23.272084 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916605a-8c57-4669-b444-bb1ed9c14202 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:23.272362 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916605a-8c57-4669-b444-bb1ed9c14202 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:23.272630 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916605a-8c57-4669-b444-bb1ed9c14202 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:23.282460 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2916605a-8c57-4669-b444-bb1ed9c14202 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:23.284065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2916605a-8c57-4669-b444-bb1ed9c14202 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:23.293680 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3829/7683] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:16:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:16:23.626076 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebecf4da-f5ac-4031-9de6-c70b44eddf78 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:23.628337 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ebecf4da-f5ac-4031-9de6-c70b44eddf78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:23.655489 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebecf4da-f5ac-4031-9de6-c70b44eddf78 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:23.660237 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b54878-f042-4080-bf2a-9db59ba832ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:23.660907 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b54878-f042-4080-bf2a-9db59ba832ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:23.661190 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b54878-f042-4080-bf2a-9db59ba832ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:23.661470 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b54878-f042-4080-bf2a-9db59ba832ac admin admin] PATH_INFO: `/v3/projects/97a2ef4e55764b7f8893ae5915189388` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:23.662602 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b54878-f042-4080-bf2a-9db59ba832ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=97a2ef4e55764b7f8893ae5915189388)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:23.664620 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b54878-f042-4080-bf2a-9db59ba832ac admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:23.726625 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-38b54878-f042-4080-bf2a-9db59ba832ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97a2ef4e55764b7f8893ae5915189388', 'request_id': 'req-38b54878-f042-4080-bf2a-9db59ba832ac'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:23.734345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-38b54878-f042-4080-bf2a-9db59ba832ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97a2ef4e55764b7f8893ae5915189388', 'request_id': 'req-38b54878-f042-4080-bf2a-9db59ba832ac'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:23.744118 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-38b54878-f042-4080-bf2a-9db59ba832ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97a2ef4e55764b7f8893ae5915189388', 'request_id': 'req-38b54878-f042-4080-bf2a-9db59ba832ac'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:23.760542 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-38b54878-f042-4080-bf2a-9db59ba832ac admin admin] The token cache is being invalidate because project 97a2ef4e55764b7f8893ae5915189388 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:16:23.760834 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-38b54878-f042-4080-bf2a-9db59ba832ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:23.761633 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-38b54878-f042-4080-bf2a-9db59ba832ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:23.767787 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3855/7684] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:16:23 2022] DELETE /identity/v3/projects/97a2ef4e55764b7f8893ae5915189388 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:16:23.769041 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916605a-8c57-4669-b444-bb1ed9c14202 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:23.780627 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916605a-8c57-4669-b444-bb1ed9c14202 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:23.855904 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc39c55-311c-41b6-bd9c-cd23efd2351e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:23.856643 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc39c55-311c-41b6-bd9c-cd23efd2351e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:23.857125 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc39c55-311c-41b6-bd9c-cd23efd2351e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:23.857406 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc39c55-311c-41b6-bd9c-cd23efd2351e admin admin] PATH_INFO: `/v3/users/22b546737d6f47c89952e5ed11610832` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:23.859068 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc39c55-311c-41b6-bd9c-cd23efd2351e admin admin] RBAC: Authorizing `identity:delete_user(user_id=22b546737d6f47c89952e5ed11610832)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:23.860801 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc39c55-311c-41b6-bd9c-cd23efd2351e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:23.911979 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0bc39c55-311c-41b6-bd9c-cd23efd2351e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22b546737d6f47c89952e5ed11610832'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:23.912647 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0bc39c55-311c-41b6-bd9c-cd23efd2351e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22b546737d6f47c89952e5ed11610832'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:23.926415 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0bc39c55-311c-41b6-bd9c-cd23efd2351e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22b546737d6f47c89952e5ed11610832'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:23.934965 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0bc39c55-311c-41b6-bd9c-cd23efd2351e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22b546737d6f47c89952e5ed11610832'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:23.942749 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0bc39c55-311c-41b6-bd9c-cd23efd2351e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22b546737d6f47c89952e5ed11610832'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:23.944777 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:23.952049 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3830/7685] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:16:23 2022] DELETE /identity/v3/users/22b546737d6f47c89952e5ed11610832 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:16:24.258861 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b54878-f042-4080-bf2a-9db59ba832ac admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:24.260340 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-38b54878-f042-4080-bf2a-9db59ba832ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:24.276469 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b54878-f042-4080-bf2a-9db59ba832ac admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:24.341571 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7eac7d-25ea-4a3e-91cb-ad319ba8d09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:24.342220 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7eac7d-25ea-4a3e-91cb-ad319ba8d09d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:24.342500 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7eac7d-25ea-4a3e-91cb-ad319ba8d09d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:24.342772 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7eac7d-25ea-4a3e-91cb-ad319ba8d09d admin admin] PATH_INFO: `/v3/projects/48abc8b3b9e84cc498ae558d6a1ad08a` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:24.344067 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7eac7d-25ea-4a3e-91cb-ad319ba8d09d admin admin] RBAC: Authorizing `identity:delete_project(project_id=48abc8b3b9e84cc498ae558d6a1ad08a)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:24.346015 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7eac7d-25ea-4a3e-91cb-ad319ba8d09d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:24.395986 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:24.397524 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-bd7eac7d-25ea-4a3e-91cb-ad319ba8d09d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48abc8b3b9e84cc498ae558d6a1ad08a', 'request_id': 'req-bd7eac7d-25ea-4a3e-91cb-ad319ba8d09d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:24.405266 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-bd7eac7d-25ea-4a3e-91cb-ad319ba8d09d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48abc8b3b9e84cc498ae558d6a1ad08a', 'request_id': 'req-bd7eac7d-25ea-4a3e-91cb-ad319ba8d09d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:24.412970 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-bd7eac7d-25ea-4a3e-91cb-ad319ba8d09d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48abc8b3b9e84cc498ae558d6a1ad08a', 'request_id': 'req-bd7eac7d-25ea-4a3e-91cb-ad319ba8d09d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:24.427167 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-bd7eac7d-25ea-4a3e-91cb-ad319ba8d09d admin admin] The token cache is being invalidate because project 48abc8b3b9e84cc498ae558d6a1ad08a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:16:24.427560 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-bd7eac7d-25ea-4a3e-91cb-ad319ba8d09d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:24.428459 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-bd7eac7d-25ea-4a3e-91cb-ad319ba8d09d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:24.429977 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3856/7686] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:16:24 2022] DELETE /identity/v3/projects/48abc8b3b9e84cc498ae558d6a1ad08a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:16:33.956163 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:34.424175 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=7,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:37.076342 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5ea68-dad6-4065-82f1-09c40725950a None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:37.076342 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5ea68-dad6-4065-82f1-09c40725950a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:37.076342 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5ea68-dad6-4065-82f1-09c40725950a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:37.096711 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-34b5ea68-dad6-4065-82f1-09c40725950a None None] MFA Rules not processed for user `e667dee610ce46f4acf19997989172f0`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:16:37.098004 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-34b5ea68-dad6-4065-82f1-09c40725950a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:37.166042 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3831/7687] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:16:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:16:46.440989 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7eac7d-25ea-4a3e-91cb-ad319ba8d09d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:46.442836 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-bd7eac7d-25ea-4a3e-91cb-ad319ba8d09d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:46.518902 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7eac7d-25ea-4a3e-91cb-ad319ba8d09d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:46.522733 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc0571-94a7-4a5d-b2a0-745300e50c37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:46.523388 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc0571-94a7-4a5d-b2a0-745300e50c37 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:46.523694 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc0571-94a7-4a5d-b2a0-745300e50c37 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:46.524015 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc0571-94a7-4a5d-b2a0-745300e50c37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:46.525860 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a9cc0571-94a7-4a5d-b2a0-745300e50c37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:46.616155 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cc0571-94a7-4a5d-b2a0-745300e50c37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:46.617577 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cc0571-94a7-4a5d-b2a0-745300e50c37 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:46.629516 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3857/7688] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:16:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:16:47.157185 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=25 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:49.870788 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5ea68-dad6-4065-82f1-09c40725950a None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:49.873708 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-34b5ea68-dad6-4065-82f1-09c40725950a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:49.888704 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5ea68-dad6-4065-82f1-09c40725950a None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:49.895200 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ae037-520f-4ef8-acdf-255c13b8bba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:49.895844 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ae037-520f-4ef8-acdf-255c13b8bba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:49.896127 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ae037-520f-4ef8-acdf-255c13b8bba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:49.896404 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ae037-520f-4ef8-acdf-255c13b8bba9 admin admin] PATH_INFO: `/v3/users/884be770746c44d29f50c099613f08ed` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:49.897543 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ae037-520f-4ef8-acdf-255c13b8bba9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=884be770746c44d29f50c099613f08ed)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:49.899536 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ae037-520f-4ef8-acdf-255c13b8bba9 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:49.948021 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4f9ae037-520f-4ef8-acdf-255c13b8bba9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '884be770746c44d29f50c099613f08ed'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:49.948668 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4f9ae037-520f-4ef8-acdf-255c13b8bba9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '884be770746c44d29f50c099613f08ed'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:49.962281 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4f9ae037-520f-4ef8-acdf-255c13b8bba9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '884be770746c44d29f50c099613f08ed'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:49.971133 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4f9ae037-520f-4ef8-acdf-255c13b8bba9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '884be770746c44d29f50c099613f08ed'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:49.978128 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4f9ae037-520f-4ef8-acdf-255c13b8bba9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '884be770746c44d29f50c099613f08ed'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:49.985128 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3832/7689] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:16:49 2022] DELETE /identity/v3/users/884be770746c44d29f50c099613f08ed => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:16:50.170536 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc0571-94a7-4a5d-b2a0-745300e50c37 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:50.182750 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc0571-94a7-4a5d-b2a0-745300e50c37 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:50.249925 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc07dd-2da8-4606-be5a-5339872684e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:50.250564 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc07dd-2da8-4606-be5a-5339872684e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:50.250846 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc07dd-2da8-4606-be5a-5339872684e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:50.251152 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc07dd-2da8-4606-be5a-5339872684e8 admin admin] PATH_INFO: `/v3/projects/a32ab2f89fcf4b3ab01be67165388175` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:50.252296 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc07dd-2da8-4606-be5a-5339872684e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a32ab2f89fcf4b3ab01be67165388175)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:50.254211 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc07dd-2da8-4606-be5a-5339872684e8 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:50.280041 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:50.306844 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4fbc07dd-2da8-4606-be5a-5339872684e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a32ab2f89fcf4b3ab01be67165388175', 'request_id': 'req-4fbc07dd-2da8-4606-be5a-5339872684e8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:50.312712 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4fbc07dd-2da8-4606-be5a-5339872684e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a32ab2f89fcf4b3ab01be67165388175', 'request_id': 'req-4fbc07dd-2da8-4606-be5a-5339872684e8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:50.319851 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4fbc07dd-2da8-4606-be5a-5339872684e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a32ab2f89fcf4b3ab01be67165388175', 'request_id': 'req-4fbc07dd-2da8-4606-be5a-5339872684e8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:50.334039 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4fbc07dd-2da8-4606-be5a-5339872684e8 admin admin] The token cache is being invalidate because project a32ab2f89fcf4b3ab01be67165388175 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:16:50.334424 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4fbc07dd-2da8-4606-be5a-5339872684e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:50.335104 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4fbc07dd-2da8-4606-be5a-5339872684e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:50.336620 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3858/7690] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:16:50 2022] DELETE /identity/v3/projects/a32ab2f89fcf4b3ab01be67165388175 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:16:50.342013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169a31d-ff70-4f5c-9c77-79f7965f636b None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:50.342292 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169a31d-ff70-4f5c-9c77-79f7965f636b None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:50.342574 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169a31d-ff70-4f5c-9c77-79f7965f636b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:50.393765 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-f169a31d-ff70-4f5c-9c77-79f7965f636b None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:16:50.395155 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f169a31d-ff70-4f5c-9c77-79f7965f636b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:50.477546 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3833/7691] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:16:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:16:50.478965 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7f49a-32a8-4cc0-9f1c-4a3c82913d01 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:50.479280 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7f49a-32a8-4cc0-9f1c-4a3c82913d01 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:50.479556 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7f49a-32a8-4cc0-9f1c-4a3c82913d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:50.500242 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-b2f7f49a-32a8-4cc0-9f1c-4a3c82913d01 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:16:50.501449 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b2f7f49a-32a8-4cc0-9f1c-4a3c82913d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:50.509628 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3859/7692] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:16:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:16:50.514083 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169a31d-ff70-4f5c-9c77-79f7965f636b None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:50.524067 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169a31d-ff70-4f5c-9c77-79f7965f636b None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:50.529419 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79332a7-b1c1-43e2-b8bd-02a09e4ad70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:50.530038 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79332a7-b1c1-43e2-b8bd-02a09e4ad70a admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:50.530319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79332a7-b1c1-43e2-b8bd-02a09e4ad70a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:50.530617 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79332a7-b1c1-43e2-b8bd-02a09e4ad70a admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:50.531309 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79332a7-b1c1-43e2-b8bd-02a09e4ad70a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:16:50.531612 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79332a7-b1c1-43e2-b8bd-02a09e4ad70a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:50.533240 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79332a7-b1c1-43e2-b8bd-02a09e4ad70a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:50.549377 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3834/7693] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:16:50.550635 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f7f49a-32a8-4cc0-9f1c-4a3c82913d01 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:50.560983 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f7f49a-32a8-4cc0-9f1c-4a3c82913d01 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:50.565852 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16863c0-8c57-4719-9423-ddeb709514d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:50.566471 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16863c0-8c57-4719-9423-ddeb709514d2 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:50.566754 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16863c0-8c57-4719-9423-ddeb709514d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:50.567046 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16863c0-8c57-4719-9423-ddeb709514d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:50.567707 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16863c0-8c57-4719-9423-ddeb709514d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:50.569650 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16863c0-8c57-4719-9423-ddeb709514d2 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:50.602255 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3860/7694] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:16:50 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:16:50.603720 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79332a7-b1c1-43e2-b8bd-02a09e4ad70a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:50.614772 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79332a7-b1c1-43e2-b8bd-02a09e4ad70a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:50.654941 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:50.682572 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dfa287-524f-45cc-a4fb-c0d0381da2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:50.683224 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfa287-524f-45cc-a4fb-c0d0381da2d5 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:50.683506 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfa287-524f-45cc-a4fb-c0d0381da2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:50.683785 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfa287-524f-45cc-a4fb-c0d0381da2d5 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:50.684479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dfa287-524f-45cc-a4fb-c0d0381da2d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:50.686419 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dfa287-524f-45cc-a4fb-c0d0381da2d5 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:50.718346 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3835/7695] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:16:50 2022] POST /identity/v3/users => generated 284 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:16:50.722422 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16863c0-8c57-4719-9423-ddeb709514d2 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:50.734478 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16863c0-8c57-4719-9423-ddeb709514d2 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:50.740305 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c89c97-c7ab-430c-8273-ada7ada8d526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:50.741173 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c89c97-c7ab-430c-8273-ada7ada8d526 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:50.741507 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c89c97-c7ab-430c-8273-ada7ada8d526 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:50.741917 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c89c97-c7ab-430c-8273-ada7ada8d526 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:50.742565 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c89c97-c7ab-430c-8273-ada7ada8d526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:50.744360 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c89c97-c7ab-430c-8273-ada7ada8d526 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:50.756703 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3861/7696] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:16:50.760876 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dfa287-524f-45cc-a4fb-c0d0381da2d5 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:50.771781 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dfa287-524f-45cc-a4fb-c0d0381da2d5 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:50.776623 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc0020-eb52-4d8b-be47-2c7b3916715f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:50.777231 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc0020-eb52-4d8b-be47-2c7b3916715f admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:50.777511 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc0020-eb52-4d8b-be47-2c7b3916715f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:50.777786 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc0020-eb52-4d8b-be47-2c7b3916715f admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:50.778975 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbc0020-eb52-4d8b-be47-2c7b3916715f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:50.780680 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbc0020-eb52-4d8b-be47-2c7b3916715f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:50.791359 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3836/7697] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:16:50.796534 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c89c97-c7ab-430c-8273-ada7ada8d526 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:50.807169 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c89c97-c7ab-430c-8273-ada7ada8d526 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:50.812777 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c681d1-dce8-4139-95af-5ce482a95653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:50.813433 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c681d1-dce8-4139-95af-5ce482a95653 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:50.813720 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c681d1-dce8-4139-95af-5ce482a95653 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:50.813973 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c681d1-dce8-4139-95af-5ce482a95653 admin admin] PATH_INFO: `/v3/projects/c92abb5c2da14cafaa13dd2e512f6ae5/users/d312ee6092614c1d815bf83451890120/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:50.831045 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c681d1-dce8-4139-95af-5ce482a95653 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c92abb5c2da14cafaa13dd2e512f6ae5, user_id=d312ee6092614c1d815bf83451890120, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:50.833762 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c681d1-dce8-4139-95af-5ce482a95653 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:50.850053 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3862/7698] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:16:50 2022] PUT /identity/v3/projects/c92abb5c2da14cafaa13dd2e512f6ae5/users/d312ee6092614c1d815bf83451890120/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:16:50.862695 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc581e5a-6ce7-4d2b-9b4c-156d792378d1 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:50.863013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc581e5a-6ce7-4d2b-9b4c-156d792378d1 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:50.863345 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc581e5a-6ce7-4d2b-9b4c-156d792378d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:50.892973 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-dc581e5a-6ce7-4d2b-9b4c-156d792378d1 None None] MFA Rules not processed for user `d312ee6092614c1d815bf83451890120`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:16:50.894580 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-dc581e5a-6ce7-4d2b-9b4c-156d792378d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:50.975979 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3837/7699] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:16:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:16:50.980481 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c681d1-dce8-4139-95af-5ce482a95653 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:51.046145 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c681d1-dce8-4139-95af-5ce482a95653 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:51.050896 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc81e08-9b71-4147-aa27-31802c2fcb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:51.051535 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc81e08-9b71-4147-aa27-31802c2fcb77 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:51.051817 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc81e08-9b71-4147-aa27-31802c2fcb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:51.052092 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc81e08-9b71-4147-aa27-31802c2fcb77 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:51.052728 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc81e08-9b71-4147-aa27-31802c2fcb77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:51.054897 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc81e08-9b71-4147-aa27-31802c2fcb77 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:51.081275 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3863/7700] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:16:50 2022] POST /identity/v3/projects => generated 367 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:16:51.085382 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc581e5a-6ce7-4d2b-9b4c-156d792378d1 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:51.096764 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc581e5a-6ce7-4d2b-9b4c-156d792378d1 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:51.155513 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100523ef-bbef-4dd2-b190-34a935d8e332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:51.156127 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100523ef-bbef-4dd2-b190-34a935d8e332 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:51.156414 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100523ef-bbef-4dd2-b190-34a935d8e332 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:51.156690 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100523ef-bbef-4dd2-b190-34a935d8e332 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:51.157324 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100523ef-bbef-4dd2-b190-34a935d8e332 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:51.159288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100523ef-bbef-4dd2-b190-34a935d8e332 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:51.181633 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3838/7701] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:16:51 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:16:51.185935 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc81e08-9b71-4147-aa27-31802c2fcb77 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:51.196414 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc81e08-9b71-4147-aa27-31802c2fcb77 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:51.201785 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007232c2-bc84-4343-a9cd-b9970daad196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:51.202388 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007232c2-bc84-4343-a9cd-b9970daad196 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:51.202703 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007232c2-bc84-4343-a9cd-b9970daad196 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:51.203292 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007232c2-bc84-4343-a9cd-b9970daad196 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:51.203939 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007232c2-bc84-4343-a9cd-b9970daad196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:51.205536 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007232c2-bc84-4343-a9cd-b9970daad196 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:51.217041 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3864/7702] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:16:51.221157 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100523ef-bbef-4dd2-b190-34a935d8e332 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:51.231175 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100523ef-bbef-4dd2-b190-34a935d8e332 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:51.236483 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d61bce-6500-472a-8143-91b45ccd03a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:51.237129 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d61bce-6500-472a-8143-91b45ccd03a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:51.237405 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d61bce-6500-472a-8143-91b45ccd03a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:51.237674 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d61bce-6500-472a-8143-91b45ccd03a5 admin admin] PATH_INFO: `/v3/projects/d7cc2b49e47f4791aa57276f161c6603/users/3bd44dda6774491fb3edd01d2d9425d3/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:51.252675 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d61bce-6500-472a-8143-91b45ccd03a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7cc2b49e47f4791aa57276f161c6603, user_id=3bd44dda6774491fb3edd01d2d9425d3, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:51.255401 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d61bce-6500-472a-8143-91b45ccd03a5 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:51.268553 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3839/7703] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:16:51 2022] PUT /identity/v3/projects/d7cc2b49e47f4791aa57276f161c6603/users/3bd44dda6774491fb3edd01d2d9425d3/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:16:51.273598 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007232c2-bc84-4343-a9cd-b9970daad196 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:51.284436 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007232c2-bc84-4343-a9cd-b9970daad196 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:51.301571 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:51.344607 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77657fb-29d7-42c5-8c7c-e4622c201a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:51.345137 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77657fb-29d7-42c5-8c7c-e4622c201a38 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:51.345448 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77657fb-29d7-42c5-8c7c-e4622c201a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:51.345721 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77657fb-29d7-42c5-8c7c-e4622c201a38 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:51.346533 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77657fb-29d7-42c5-8c7c-e4622c201a38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:51.348175 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77657fb-29d7-42c5-8c7c-e4622c201a38 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:51.359077 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3865/7704] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:16:51.363298 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d61bce-6500-472a-8143-91b45ccd03a5 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:51.374288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d61bce-6500-472a-8143-91b45ccd03a5 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:51.379178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b362c3-2597-402f-bc2e-9af52f7f217c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:51.379842 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b362c3-2597-402f-bc2e-9af52f7f217c admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:51.380152 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b362c3-2597-402f-bc2e-9af52f7f217c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:51.380426 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b362c3-2597-402f-bc2e-9af52f7f217c admin admin] PATH_INFO: `/v3/projects/d7cc2b49e47f4791aa57276f161c6603/users/3bd44dda6774491fb3edd01d2d9425d3/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:51.382405 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b362c3-2597-402f-bc2e-9af52f7f217c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7cc2b49e47f4791aa57276f161c6603, user_id=3bd44dda6774491fb3edd01d2d9425d3, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:51.385126 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b362c3-2597-402f-bc2e-9af52f7f217c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:51.391154 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:51.396944 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3840/7705] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:16:51 2022] PUT /identity/v3/projects/d7cc2b49e47f4791aa57276f161c6603/users/3bd44dda6774491fb3edd01d2d9425d3/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:16:51.407808 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518839ed-1450-4d9a-a518-8c9919a2b159 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:51.408096 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518839ed-1450-4d9a-a518-8c9919a2b159 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:51.408371 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518839ed-1450-4d9a-a518-8c9919a2b159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:51.436433 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-518839ed-1450-4d9a-a518-8c9919a2b159 None None] MFA Rules not processed for user `3bd44dda6774491fb3edd01d2d9425d3`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:16:51.437295 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-518839ed-1450-4d9a-a518-8c9919a2b159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:51.505757 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3866/7706] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:16:51 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:16:51.511084 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b362c3-2597-402f-bc2e-9af52f7f217c admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:51.522608 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b362c3-2597-402f-bc2e-9af52f7f217c admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:51.527354 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84925384-c34a-43b2-b40d-26444a959e8a tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bd44dda6774491fb3edd01d2d9425d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7cc2b49e47f4791aa57276f161c6603', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:51.527972 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84925384-c34a-43b2-b40d-26444a959e8a tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:51.528862 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84925384-c34a-43b2-b40d-26444a959e8a tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:51.529145 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84925384-c34a-43b2-b40d-26444a959e8a tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] PATH_INFO: `/v3/services` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:51.529806 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84925384-c34a-43b2-b40d-26444a959e8a tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:51.532011 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84925384-c34a-43b2-b40d-26444a959e8a tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:51.547719 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3841/7707] 10.222.0.83 () {60 vars in 1152 bytes} [Mon Aug 29 16:16:51 2022] POST /identity/v3/services => generated 241 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:16:51.552012 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518839ed-1450-4d9a-a518-8c9919a2b159 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:51.562870 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518839ed-1450-4d9a-a518-8c9919a2b159 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:51.579041 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82008871-c1af-4b63-acd7-fcdffaf88ad8 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bd44dda6774491fb3edd01d2d9425d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7cc2b49e47f4791aa57276f161c6603', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:51.579679 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82008871-c1af-4b63-acd7-fcdffaf88ad8 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:51.579957 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82008871-c1af-4b63-acd7-fcdffaf88ad8 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:51.580223 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82008871-c1af-4b63-acd7-fcdffaf88ad8 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] PATH_INFO: `/v3/services/a2139de46a00496c97b860032dc39992` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:51.580799 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82008871-c1af-4b63-acd7-fcdffaf88ad8 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: Authorizing `identity:delete_service(service_id=a2139de46a00496c97b860032dc39992)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:51.582442 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82008871-c1af-4b63-acd7-fcdffaf88ad8 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:51.605038 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3867/7708] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:16:51 2022] DELETE /identity/v3/services/a2139de46a00496c97b860032dc39992 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:16:51.610288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84925384-c34a-43b2-b40d-26444a959e8a tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:51.620798 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84925384-c34a-43b2-b40d-26444a959e8a tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:51.635044 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa92573-4e1b-4a0a-b2a6-eea2a65b2386 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bd44dda6774491fb3edd01d2d9425d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7cc2b49e47f4791aa57276f161c6603', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:51.635657 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa92573-4e1b-4a0a-b2a6-eea2a65b2386 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:51.635932 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa92573-4e1b-4a0a-b2a6-eea2a65b2386 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:51.636198 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa92573-4e1b-4a0a-b2a6-eea2a65b2386 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] PATH_INFO: `/v3/services` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:51.636839 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa92573-4e1b-4a0a-b2a6-eea2a65b2386 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:51.639151 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa92573-4e1b-4a0a-b2a6-eea2a65b2386 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:51.653850 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3842/7709] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:16:51 2022] POST /identity/v3/services => generated 288 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:16:51.658213 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82008871-c1af-4b63-acd7-fcdffaf88ad8 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:51.668699 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82008871-c1af-4b63-acd7-fcdffaf88ad8 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:51.683879 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee428aa-c0c6-4550-9684-8ace103a2d4d tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bd44dda6774491fb3edd01d2d9425d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7cc2b49e47f4791aa57276f161c6603', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:51.684567 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee428aa-c0c6-4550-9684-8ace103a2d4d tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:51.684836 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee428aa-c0c6-4550-9684-8ace103a2d4d tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:51.685111 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee428aa-c0c6-4550-9684-8ace103a2d4d tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] PATH_INFO: `/v3/services/44a101be06894197bf33aa882c06b3eb` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:51.685769 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee428aa-c0c6-4550-9684-8ace103a2d4d tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: Authorizing `identity:update_service(service_id=44a101be06894197bf33aa882c06b3eb)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:51.686789 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-aee428aa-c0c6-4550-9684-8ace103a2d4d tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:16:51.686789 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 16:16:51.686789 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 16:16:51.687820 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee428aa-c0c6-4550-9684-8ace103a2d4d tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:51.705905 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3868/7710] 10.222.0.83 () {60 vars in 1252 bytes} [Mon Aug 29 16:16:51 2022] PATCH /identity/v3/services/44a101be06894197bf33aa882c06b3eb => generated 282 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:16:51.709971 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa92573-4e1b-4a0a-b2a6-eea2a65b2386 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:51.721704 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa92573-4e1b-4a0a-b2a6-eea2a65b2386 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:51.736969 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a21779-ba14-4f55-ae9d-8377cceb14cb tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bd44dda6774491fb3edd01d2d9425d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7cc2b49e47f4791aa57276f161c6603', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:51.737601 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a21779-ba14-4f55-ae9d-8377cceb14cb tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:51.737883 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a21779-ba14-4f55-ae9d-8377cceb14cb tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:51.738158 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a21779-ba14-4f55-ae9d-8377cceb14cb tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] PATH_INFO: `/v3/services/44a101be06894197bf33aa882c06b3eb` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:51.738743 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a21779-ba14-4f55-ae9d-8377cceb14cb tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: Authorizing `identity:get_service(service_id=44a101be06894197bf33aa882c06b3eb)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:51.739810 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-d9a21779-ba14-4f55-ae9d-8377cceb14cb tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:16:51.739810 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 16:16:51.739810 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 16:16:51.740698 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a21779-ba14-4f55-ae9d-8377cceb14cb tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:51.747825 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3843/7711] 10.222.0.83 () {58 vars in 1230 bytes} [Mon Aug 29 16:16:51 2022] GET /identity/v3/services/44a101be06894197bf33aa882c06b3eb => generated 282 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:16:51.751923 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee428aa-c0c6-4550-9684-8ace103a2d4d tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:51.762199 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee428aa-c0c6-4550-9684-8ace103a2d4d tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:51.767421 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1681b-922f-4fb6-9534-a53e8a1a70d9 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bd44dda6774491fb3edd01d2d9425d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7cc2b49e47f4791aa57276f161c6603', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:51.768039 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1681b-922f-4fb6-9534-a53e8a1a70d9 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:51.768312 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1681b-922f-4fb6-9534-a53e8a1a70d9 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:51.768579 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1681b-922f-4fb6-9534-a53e8a1a70d9 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] PATH_INFO: `/v3/services/44a101be06894197bf33aa882c06b3eb` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:51.769158 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de1681b-922f-4fb6-9534-a53e8a1a70d9 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: Authorizing `identity:delete_service(service_id=44a101be06894197bf33aa882c06b3eb)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:51.770738 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de1681b-922f-4fb6-9534-a53e8a1a70d9 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:51.791078 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3869/7712] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:16:51 2022] DELETE /identity/v3/services/44a101be06894197bf33aa882c06b3eb => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:16:51.795203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a21779-ba14-4f55-ae9d-8377cceb14cb tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:51.805726 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a21779-ba14-4f55-ae9d-8377cceb14cb tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:51.820646 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446cf76-9586-4fff-a306-9fcbe1a25d85 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bd44dda6774491fb3edd01d2d9425d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7cc2b49e47f4791aa57276f161c6603', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:51.821303 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446cf76-9586-4fff-a306-9fcbe1a25d85 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:51.821584 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446cf76-9586-4fff-a306-9fcbe1a25d85 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:51.821859 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446cf76-9586-4fff-a306-9fcbe1a25d85 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] PATH_INFO: `/v3/services/44a101be06894197bf33aa882c06b3eb` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:51.822471 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b446cf76-9586-4fff-a306-9fcbe1a25d85 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: Authorizing `identity:get_service(service_id=44a101be06894197bf33aa882c06b3eb)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:51.824166 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b446cf76-9586-4fff-a306-9fcbe1a25d85 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:51.834173 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-b446cf76-9586-4fff-a306-9fcbe1a25d85 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] Could not find service: 44a101be06894197bf33aa882c06b3eb.: keystone.exception.ServiceNotFound: Could not find service: 44a101be06894197bf33aa882c06b3eb. Aug 29 16:16:51.834173 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:16:51.834173 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 16:16:51.834173 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 16:16:51.834173 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 16:16:51.834173 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 16:16:51.834173 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 16:16:51.834173 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 16:16:51.834173 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 44a101be06894197bf33aa882c06b3eb. Aug 29 16:16:51.834173 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:16:51.834173 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 16:16:51.834173 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:16:51.834173 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:16:51.834173 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:16:51.834173 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:16:51.834173 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:16:51.835424 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:16:51.835424 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:16:51.835424 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:16:51.835424 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:16:51.835424 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:16:51.835424 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:16:51.835424 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:16:51.835424 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 16:16:51.835424 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 16:16:51.835424 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 16:16:51.835424 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 16:16:51.835424 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:16:51.835424 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:16:51.835424 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 16:16:51.835424 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 16:16:51.835424 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 16:16:51.835424 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 16:16:51.836427 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 16:16:51.836427 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 16:16:51.836427 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 16:16:51.836427 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 16:16:51.836427 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 16:16:51.836427 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 16:16:51.836427 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 16:16:51.836427 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 16:16:51.836427 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 16:16:51.836427 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 16:16:51.836427 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 16:16:51.836427 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 16:16:51.836427 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 44a101be06894197bf33aa882c06b3eb. Aug 29 16:16:51.836427 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:16:51.836427 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3844/7713] 10.222.0.83 () {58 vars in 1230 bytes} [Mon Aug 29 16:16:51 2022] GET /identity/v3/services/44a101be06894197bf33aa882c06b3eb => generated 113 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 16:16:51.840505 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1681b-922f-4fb6-9534-a53e8a1a70d9 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:51.851765 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1681b-922f-4fb6-9534-a53e8a1a70d9 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:51.857144 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c198bcd-376f-4784-8e68-36b9c6829851 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bd44dda6774491fb3edd01d2d9425d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7cc2b49e47f4791aa57276f161c6603', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:51.857718 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c198bcd-376f-4784-8e68-36b9c6829851 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:51.858018 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c198bcd-376f-4784-8e68-36b9c6829851 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:51.858292 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c198bcd-376f-4784-8e68-36b9c6829851 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] PATH_INFO: `/v3/services` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:51.858936 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c198bcd-376f-4784-8e68-36b9c6829851 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:51.860557 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c198bcd-376f-4784-8e68-36b9c6829851 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:51.876046 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3870/7714] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:16:51 2022] POST /identity/v3/services => generated 275 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:16:51.880082 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446cf76-9586-4fff-a306-9fcbe1a25d85 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:51.890641 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446cf76-9586-4fff-a306-9fcbe1a25d85 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:51.905893 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd81f86-fd58-403e-b443-cdda1ee5bf90 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bd44dda6774491fb3edd01d2d9425d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7cc2b49e47f4791aa57276f161c6603', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:51.906546 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd81f86-fd58-403e-b443-cdda1ee5bf90 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:51.906831 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd81f86-fd58-403e-b443-cdda1ee5bf90 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:51.907132 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd81f86-fd58-403e-b443-cdda1ee5bf90 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] PATH_INFO: `/v3/services` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:51.907780 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd81f86-fd58-403e-b443-cdda1ee5bf90 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:51.909366 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd81f86-fd58-403e-b443-cdda1ee5bf90 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:51.925373 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3845/7715] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:16:51 2022] POST /identity/v3/services => generated 274 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:16:51.929522 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c198bcd-376f-4784-8e68-36b9c6829851 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:51.947783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c198bcd-376f-4784-8e68-36b9c6829851 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:51.953606 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:51.967241 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc22a4-64a4-4079-9e9f-9ee76a79cb41 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bd44dda6774491fb3edd01d2d9425d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7cc2b49e47f4791aa57276f161c6603', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:51.968051 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc22a4-64a4-4079-9e9f-9ee76a79cb41 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:51.968522 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc22a4-64a4-4079-9e9f-9ee76a79cb41 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:51.969079 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc22a4-64a4-4079-9e9f-9ee76a79cb41 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] PATH_INFO: `/v3/services` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:51.969737 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc22a4-64a4-4079-9e9f-9ee76a79cb41 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:51.971405 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc22a4-64a4-4079-9e9f-9ee76a79cb41 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:51.992202 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3871/7716] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:16:51 2022] POST /identity/v3/services => generated 275 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:16:51.993538 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd81f86-fd58-403e-b443-cdda1ee5bf90 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:52.005178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd81f86-fd58-403e-b443-cdda1ee5bf90 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:52.020996 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ee3df-4e46-432d-90ec-faad1e5a6516 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bd44dda6774491fb3edd01d2d9425d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7cc2b49e47f4791aa57276f161c6603', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:52.021745 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ee3df-4e46-432d-90ec-faad1e5a6516 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:52.021877 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ee3df-4e46-432d-90ec-faad1e5a6516 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:52.022154 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ee3df-4e46-432d-90ec-faad1e5a6516 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] PATH_INFO: `/v3/services` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:52.022763 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784ee3df-4e46-432d-90ec-faad1e5a6516 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:52.023807 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-784ee3df-4e46-432d-90ec-faad1e5a6516 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:16:52.023807 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 16:16:52.023807 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 16:16:52.024695 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784ee3df-4e46-432d-90ec-faad1e5a6516 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:52.032889 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3846/7717] 10.222.0.83 () {58 vars in 1131 bytes} [Mon Aug 29 16:16:51 2022] GET /identity/v3/services => generated 2979 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:16:52.036919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc22a4-64a4-4079-9e9f-9ee76a79cb41 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:52.047541 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc22a4-64a4-4079-9e9f-9ee76a79cb41 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:52.052264 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796a943-a583-4084-a1c7-3f611cbc1e65 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bd44dda6774491fb3edd01d2d9425d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7cc2b49e47f4791aa57276f161c6603', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:52.052875 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796a943-a583-4084-a1c7-3f611cbc1e65 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:52.053157 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796a943-a583-4084-a1c7-3f611cbc1e65 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:52.053432 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796a943-a583-4084-a1c7-3f611cbc1e65 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] PATH_INFO: `/v3/services` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:52.054325 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4796a943-a583-4084-a1c7-3f611cbc1e65 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1617953085) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:16:52.054631 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4796a943-a583-4084-a1c7-3f611cbc1e65 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:52.055673 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-4796a943-a583-4084-a1c7-3f611cbc1e65 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:16:52.055673 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 16:16:52.055673 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 16:16:52.056702 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4796a943-a583-4084-a1c7-3f611cbc1e65 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:52.063082 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3872/7718] 10.222.0.83 () {58 vars in 1222 bytes} [Mon Aug 29 16:16:52 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1617953085 => generated 418 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:16:52.067248 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ee3df-4e46-432d-90ec-faad1e5a6516 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:52.078597 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ee3df-4e46-432d-90ec-faad1e5a6516 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:52.083413 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae51ab-752a-4e24-bc21-c5d093ee7c85 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bd44dda6774491fb3edd01d2d9425d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7cc2b49e47f4791aa57276f161c6603', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:52.084022 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae51ab-752a-4e24-bc21-c5d093ee7c85 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:52.093888 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae51ab-752a-4e24-bc21-c5d093ee7c85 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:52.093888 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae51ab-752a-4e24-bc21-c5d093ee7c85 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] PATH_INFO: `/v3/services` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:52.093888 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fae51ab-752a-4e24-bc21-c5d093ee7c85 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1198592600) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:16:52.093888 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fae51ab-752a-4e24-bc21-c5d093ee7c85 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:52.093888 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fae51ab-752a-4e24-bc21-c5d093ee7c85 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:52.094437 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3847/7719] 10.222.0.83 () {58 vars in 1222 bytes} [Mon Aug 29 16:16:52 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1198592600 => generated 417 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:16:52.097308 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796a943-a583-4084-a1c7-3f611cbc1e65 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:52.108239 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796a943-a583-4084-a1c7-3f611cbc1e65 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:52.112913 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c461060-e5af-40da-bdf4-473efbb3d024 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bd44dda6774491fb3edd01d2d9425d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7cc2b49e47f4791aa57276f161c6603', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:52.113514 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c461060-e5af-40da-bdf4-473efbb3d024 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:52.113794 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c461060-e5af-40da-bdf4-473efbb3d024 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:52.114069 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c461060-e5af-40da-bdf4-473efbb3d024 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] PATH_INFO: `/v3/services` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:52.114699 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c461060-e5af-40da-bdf4-473efbb3d024 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-2021638757) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:16:52.115002 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c461060-e5af-40da-bdf4-473efbb3d024 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:52.116641 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c461060-e5af-40da-bdf4-473efbb3d024 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:52.121734 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3873/7720] 10.222.0.83 () {58 vars in 1222 bytes} [Mon Aug 29 16:16:52 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-2021638757 => generated 418 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:16:52.125644 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae51ab-752a-4e24-bc21-c5d093ee7c85 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:52.135520 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae51ab-752a-4e24-bc21-c5d093ee7c85 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:52.141303 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7fbaf-585f-4e83-b5fd-c887d6df66fb tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bd44dda6774491fb3edd01d2d9425d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7cc2b49e47f4791aa57276f161c6603', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:52.141991 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7fbaf-585f-4e83-b5fd-c887d6df66fb tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:52.142273 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7fbaf-585f-4e83-b5fd-c887d6df66fb tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:52.142577 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7fbaf-585f-4e83-b5fd-c887d6df66fb tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] PATH_INFO: `/v3/services/260eda42d9434973a2f030b934f84025` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:52.143232 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a7fbaf-585f-4e83-b5fd-c887d6df66fb tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: Authorizing `identity:delete_service(service_id=260eda42d9434973a2f030b934f84025)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:52.144844 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a7fbaf-585f-4e83-b5fd-c887d6df66fb tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:52.166647 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3848/7721] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:16:52 2022] DELETE /identity/v3/services/260eda42d9434973a2f030b934f84025 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:16:52.171117 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c461060-e5af-40da-bdf4-473efbb3d024 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:52.181355 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c461060-e5af-40da-bdf4-473efbb3d024 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:52.195726 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb42685-e4e4-45a3-877c-0aece0b2be3f tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bd44dda6774491fb3edd01d2d9425d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7cc2b49e47f4791aa57276f161c6603', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:52.196357 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb42685-e4e4-45a3-877c-0aece0b2be3f tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:52.196639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb42685-e4e4-45a3-877c-0aece0b2be3f tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:52.196910 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb42685-e4e4-45a3-877c-0aece0b2be3f tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] PATH_INFO: `/v3/services/6d3449974e8543e1a73356f27d98ad7f` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:52.197483 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb42685-e4e4-45a3-877c-0aece0b2be3f tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: Authorizing `identity:delete_service(service_id=6d3449974e8543e1a73356f27d98ad7f)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:52.199120 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb42685-e4e4-45a3-877c-0aece0b2be3f tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:52.220623 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3874/7722] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:16:52 2022] DELETE /identity/v3/services/6d3449974e8543e1a73356f27d98ad7f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:16:52.224691 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7fbaf-585f-4e83-b5fd-c887d6df66fb tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:52.235239 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7fbaf-585f-4e83-b5fd-c887d6df66fb tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:52.250259 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e39f99-b846-4b43-b451-0a5016c1ca21 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bd44dda6774491fb3edd01d2d9425d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7cc2b49e47f4791aa57276f161c6603', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:52.250881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e39f99-b846-4b43-b451-0a5016c1ca21 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:52.251194 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e39f99-b846-4b43-b451-0a5016c1ca21 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:52.251470 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e39f99-b846-4b43-b451-0a5016c1ca21 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] PATH_INFO: `/v3/services/5c74613943114b2983be89197112117f` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:52.252051 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e39f99-b846-4b43-b451-0a5016c1ca21 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: Authorizing `identity:delete_service(service_id=5c74613943114b2983be89197112117f)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:52.253653 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e39f99-b846-4b43-b451-0a5016c1ca21 tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:52.274972 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3849/7723] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:16:52 2022] DELETE /identity/v3/services/5c74613943114b2983be89197112117f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:16:52.280916 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb42685-e4e4-45a3-877c-0aece0b2be3f tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:52.354396 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb42685-e4e4-45a3-877c-0aece0b2be3f tempest-ServicesTestJSON-453257825 tempest-ServicesTestJSON-453257825-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:52.369717 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aeb047-665f-47d3-b27d-c8bd83fe4a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:52.370278 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aeb047-665f-47d3-b27d-c8bd83fe4a1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:52.370554 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aeb047-665f-47d3-b27d-c8bd83fe4a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:52.370822 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aeb047-665f-47d3-b27d-c8bd83fe4a1f admin admin] PATH_INFO: `/v3/users/d312ee6092614c1d815bf83451890120` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:52.372039 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aeb047-665f-47d3-b27d-c8bd83fe4a1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d312ee6092614c1d815bf83451890120)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:52.374176 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aeb047-665f-47d3-b27d-c8bd83fe4a1f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:52.422861 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-09aeb047-665f-47d3-b27d-c8bd83fe4a1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd312ee6092614c1d815bf83451890120'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:52.423556 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-09aeb047-665f-47d3-b27d-c8bd83fe4a1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd312ee6092614c1d815bf83451890120'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:52.430936 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-09aeb047-665f-47d3-b27d-c8bd83fe4a1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd312ee6092614c1d815bf83451890120'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:52.438094 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-09aeb047-665f-47d3-b27d-c8bd83fe4a1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd312ee6092614c1d815bf83451890120'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:52.438747 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-09aeb047-665f-47d3-b27d-c8bd83fe4a1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd312ee6092614c1d815bf83451890120'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:52.449419 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:52.457999 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3875/7724] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:16:52 2022] DELETE /identity/v3/users/d312ee6092614c1d815bf83451890120 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:16:52.462442 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc6815-026a-4b8a-99ee-25c1cb514423 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:52.462742 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc6815-026a-4b8a-99ee-25c1cb514423 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:52.463000 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc6815-026a-4b8a-99ee-25c1cb514423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:52.483256 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-7fdc6815-026a-4b8a-99ee-25c1cb514423 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:16:52.484477 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7fdc6815-026a-4b8a-99ee-25c1cb514423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:52.523987 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:52.546926 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3850/7725] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:16:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:16:52.557562 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aeb047-665f-47d3-b27d-c8bd83fe4a1f admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:52.558972 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-09aeb047-665f-47d3-b27d-c8bd83fe4a1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:52.628833 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aeb047-665f-47d3-b27d-c8bd83fe4a1f admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:52.632469 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c5750-2948-42cf-8988-5f3276d3cc8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:52.633077 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c5750-2948-42cf-8988-5f3276d3cc8b service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:52.633354 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c5750-2948-42cf-8988-5f3276d3cc8b service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:52.633622 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c5750-2948-42cf-8988-5f3276d3cc8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:52.643863 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c5750-2948-42cf-8988-5f3276d3cc8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:52.645562 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c5750-2948-42cf-8988-5f3276d3cc8b service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:52.655394 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3876/7726] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:16:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:16:52.937529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc6815-026a-4b8a-99ee-25c1cb514423 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:52.939043 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7fdc6815-026a-4b8a-99ee-25c1cb514423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:52.952089 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc6815-026a-4b8a-99ee-25c1cb514423 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:52.956899 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277c120-9749-4b4f-bd16-ff0b32f1f494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:52.957533 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277c120-9749-4b4f-bd16-ff0b32f1f494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:52.957810 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277c120-9749-4b4f-bd16-ff0b32f1f494 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:52.958078 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277c120-9749-4b4f-bd16-ff0b32f1f494 admin admin] PATH_INFO: `/v3/projects/c92abb5c2da14cafaa13dd2e512f6ae5` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:52.959255 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b277c120-9749-4b4f-bd16-ff0b32f1f494 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c92abb5c2da14cafaa13dd2e512f6ae5)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:52.961180 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b277c120-9749-4b4f-bd16-ff0b32f1f494 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:53.009661 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b277c120-9749-4b4f-bd16-ff0b32f1f494 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c92abb5c2da14cafaa13dd2e512f6ae5', 'request_id': 'req-b277c120-9749-4b4f-bd16-ff0b32f1f494'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:53.015112 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b277c120-9749-4b4f-bd16-ff0b32f1f494 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c92abb5c2da14cafaa13dd2e512f6ae5', 'request_id': 'req-b277c120-9749-4b4f-bd16-ff0b32f1f494'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:53.022573 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b277c120-9749-4b4f-bd16-ff0b32f1f494 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c92abb5c2da14cafaa13dd2e512f6ae5', 'request_id': 'req-b277c120-9749-4b4f-bd16-ff0b32f1f494'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:53.033955 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b277c120-9749-4b4f-bd16-ff0b32f1f494 admin admin] The token cache is being invalidate because project c92abb5c2da14cafaa13dd2e512f6ae5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:16:53.034243 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b277c120-9749-4b4f-bd16-ff0b32f1f494 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:53.034880 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b277c120-9749-4b4f-bd16-ff0b32f1f494 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:53.036407 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3851/7727] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:16:52 2022] DELETE /identity/v3/projects/c92abb5c2da14cafaa13dd2e512f6ae5 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:16:53.040364 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c5750-2948-42cf-8988-5f3276d3cc8b service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:53.051212 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c5750-2948-42cf-8988-5f3276d3cc8b service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:53.109243 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d206f-66db-4ae4-900a-8ad369819785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:53.109893 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d206f-66db-4ae4-900a-8ad369819785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:53.110175 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d206f-66db-4ae4-900a-8ad369819785 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:53.110450 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d206f-66db-4ae4-900a-8ad369819785 admin admin] PATH_INFO: `/v3/users/3bd44dda6774491fb3edd01d2d9425d3` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:53.111665 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d206f-66db-4ae4-900a-8ad369819785 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bd44dda6774491fb3edd01d2d9425d3)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:53.114957 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d206f-66db-4ae4-900a-8ad369819785 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:53.173399 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f18d206f-66db-4ae4-900a-8ad369819785 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bd44dda6774491fb3edd01d2d9425d3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:53.174507 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f18d206f-66db-4ae4-900a-8ad369819785 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bd44dda6774491fb3edd01d2d9425d3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:53.182995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f18d206f-66db-4ae4-900a-8ad369819785 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bd44dda6774491fb3edd01d2d9425d3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:53.193331 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f18d206f-66db-4ae4-900a-8ad369819785 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bd44dda6774491fb3edd01d2d9425d3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:53.194123 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f18d206f-66db-4ae4-900a-8ad369819785 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bd44dda6774491fb3edd01d2d9425d3'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:53.212480 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3877/7728] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:16:53 2022] DELETE /identity/v3/users/3bd44dda6774491fb3edd01d2d9425d3 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:16:53.505723 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277c120-9749-4b4f-bd16-ff0b32f1f494 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:53.507179 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b277c120-9749-4b4f-bd16-ff0b32f1f494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:53.520229 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277c120-9749-4b4f-bd16-ff0b32f1f494 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:53.580909 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc233e8-a057-4551-bf5f-1fa4c3fec9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:53.581555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc233e8-a057-4551-bf5f-1fa4c3fec9c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:53.581838 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc233e8-a057-4551-bf5f-1fa4c3fec9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:53.582116 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc233e8-a057-4551-bf5f-1fa4c3fec9c1 admin admin] PATH_INFO: `/v3/projects/d7cc2b49e47f4791aa57276f161c6603` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:53.583293 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc233e8-a057-4551-bf5f-1fa4c3fec9c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7cc2b49e47f4791aa57276f161c6603)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:53.585230 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc233e8-a057-4551-bf5f-1fa4c3fec9c1 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:53.634575 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-efc233e8-a057-4551-bf5f-1fa4c3fec9c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7cc2b49e47f4791aa57276f161c6603', 'request_id': 'req-efc233e8-a057-4551-bf5f-1fa4c3fec9c1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:53.640705 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-efc233e8-a057-4551-bf5f-1fa4c3fec9c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7cc2b49e47f4791aa57276f161c6603', 'request_id': 'req-efc233e8-a057-4551-bf5f-1fa4c3fec9c1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:53.648127 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-efc233e8-a057-4551-bf5f-1fa4c3fec9c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7cc2b49e47f4791aa57276f161c6603', 'request_id': 'req-efc233e8-a057-4551-bf5f-1fa4c3fec9c1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:53.650563 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:53.661781 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-efc233e8-a057-4551-bf5f-1fa4c3fec9c1 admin admin] The token cache is being invalidate because project d7cc2b49e47f4791aa57276f161c6603 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:16:53.662255 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-efc233e8-a057-4551-bf5f-1fa4c3fec9c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:53.663270 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-efc233e8-a057-4551-bf5f-1fa4c3fec9c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:53.664779 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3852/7729] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:16:53 2022] DELETE /identity/v3/projects/d7cc2b49e47f4791aa57276f161c6603 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:16:53.670490 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5cf5a-4bd8-40d2-9b49-90b8dff6b3b6 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:53.670776 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5cf5a-4bd8-40d2-9b49-90b8dff6b3b6 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:53.671076 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5cf5a-4bd8-40d2-9b49-90b8dff6b3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:53.691283 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-65e5cf5a-4bd8-40d2-9b49-90b8dff6b3b6 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:16:53.692465 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-65e5cf5a-4bd8-40d2-9b49-90b8dff6b3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:53.696619 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:53.755146 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3878/7730] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:16:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:16:53.764938 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69415b-820a-4e0d-913b-e5885daac2f8 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:53.765217 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69415b-820a-4e0d-913b-e5885daac2f8 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:53.765486 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69415b-820a-4e0d-913b-e5885daac2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:53.786699 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-7c69415b-820a-4e0d-913b-e5885daac2f8 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:16:53.787917 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7c69415b-820a-4e0d-913b-e5885daac2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:53.796144 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3853/7731] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:16:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:16:53.800508 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e5cf5a-4bd8-40d2-9b49-90b8dff6b3b6 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:53.819997 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e5cf5a-4bd8-40d2-9b49-90b8dff6b3b6 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:53.829086 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ab8da-93d4-4c80-a3aa-061290a0537f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:53.829716 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ab8da-93d4-4c80-a3aa-061290a0537f admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:53.829997 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ab8da-93d4-4c80-a3aa-061290a0537f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:53.830267 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ab8da-93d4-4c80-a3aa-061290a0537f admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:53.830907 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ab8da-93d4-4c80-a3aa-061290a0537f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:16:53.831342 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ab8da-93d4-4c80-a3aa-061290a0537f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:53.832957 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ab8da-93d4-4c80-a3aa-061290a0537f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:53.845348 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3879/7732] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:16:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:16:53.849706 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69415b-820a-4e0d-913b-e5885daac2f8 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:53.859409 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69415b-820a-4e0d-913b-e5885daac2f8 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:53.864213 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b85c1-a622-49c9-9dae-98fe1088c781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:53.864810 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b85c1-a622-49c9-9dae-98fe1088c781 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:53.865084 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b85c1-a622-49c9-9dae-98fe1088c781 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:53.865352 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b85c1-a622-49c9-9dae-98fe1088c781 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:53.865985 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b85c1-a622-49c9-9dae-98fe1088c781 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:53.867920 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b85c1-a622-49c9-9dae-98fe1088c781 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:53.896801 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3854/7733] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:16:53 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:16:53.899784 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ab8da-93d4-4c80-a3aa-061290a0537f admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:53.910293 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ab8da-93d4-4c80-a3aa-061290a0537f admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:53.969028 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90d8cd-6467-4e20-b4a9-ac492ea780d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:53.969543 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90d8cd-6467-4e20-b4a9-ac492ea780d6 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:53.969817 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90d8cd-6467-4e20-b4a9-ac492ea780d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:53.970086 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90d8cd-6467-4e20-b4a9-ac492ea780d6 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:53.970703 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90d8cd-6467-4e20-b4a9-ac492ea780d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:53.972640 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90d8cd-6467-4e20-b4a9-ac492ea780d6 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:53.992820 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3880/7734] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:16:53 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:16:53.998006 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b85c1-a622-49c9-9dae-98fe1088c781 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:54.008429 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b85c1-a622-49c9-9dae-98fe1088c781 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:54.014068 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6970ef0-a081-4934-bc32-6963c77475c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:54.014700 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6970ef0-a081-4934-bc32-6963c77475c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:54.014983 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6970ef0-a081-4934-bc32-6963c77475c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:54.015323 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6970ef0-a081-4934-bc32-6963c77475c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:54.015997 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6970ef0-a081-4934-bc32-6963c77475c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:54.017649 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6970ef0-a081-4934-bc32-6963c77475c4 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:54.029129 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3855/7735] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:16:54.033047 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90d8cd-6467-4e20-b4a9-ac492ea780d6 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:54.043217 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90d8cd-6467-4e20-b4a9-ac492ea780d6 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:54.048523 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef093819-5c93-4287-813b-40ec8a015df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:54.049127 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef093819-5c93-4287-813b-40ec8a015df9 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:54.049406 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef093819-5c93-4287-813b-40ec8a015df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:54.049677 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef093819-5c93-4287-813b-40ec8a015df9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:54.050315 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef093819-5c93-4287-813b-40ec8a015df9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:54.051945 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef093819-5c93-4287-813b-40ec8a015df9 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:54.063450 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3881/7736] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:16:54.067601 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6970ef0-a081-4934-bc32-6963c77475c4 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:54.078196 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6970ef0-a081-4934-bc32-6963c77475c4 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:54.083137 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dbfe2c-fa72-4101-895c-6d62daa17d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:54.083796 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbfe2c-fa72-4101-895c-6d62daa17d8a admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:54.084079 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbfe2c-fa72-4101-895c-6d62daa17d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:54.084354 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbfe2c-fa72-4101-895c-6d62daa17d8a admin admin] PATH_INFO: `/v3/projects/8d7d0d65366f4d63ace6bdd9943a7da0/users/ebf9e4b8e913437692f834e19a3ec940/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:54.099773 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dbfe2c-fa72-4101-895c-6d62daa17d8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d7d0d65366f4d63ace6bdd9943a7da0, user_id=ebf9e4b8e913437692f834e19a3ec940, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:54.102493 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dbfe2c-fa72-4101-895c-6d62daa17d8a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:54.116055 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3856/7737] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:16:54 2022] PUT /identity/v3/projects/8d7d0d65366f4d63ace6bdd9943a7da0/users/ebf9e4b8e913437692f834e19a3ec940/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:16:54.126480 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0125d26-60ed-4de5-8c1c-97bf30eb7eaa None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:54.126771 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0125d26-60ed-4de5-8c1c-97bf30eb7eaa None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:54.127070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0125d26-60ed-4de5-8c1c-97bf30eb7eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:54.156186 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-e0125d26-60ed-4de5-8c1c-97bf30eb7eaa None None] MFA Rules not processed for user `ebf9e4b8e913437692f834e19a3ec940`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:16:54.157429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e0125d26-60ed-4de5-8c1c-97bf30eb7eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:54.221744 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3882/7738] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:16:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:16:54.226232 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dbfe2c-fa72-4101-895c-6d62daa17d8a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:54.290980 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dbfe2c-fa72-4101-895c-6d62daa17d8a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:54.296609 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea135bc3-2e32-4c25-bb3d-c8c6de7d5a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:54.297526 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea135bc3-2e32-4c25-bb3d-c8c6de7d5a21 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:54.297817 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea135bc3-2e32-4c25-bb3d-c8c6de7d5a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:54.298163 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea135bc3-2e32-4c25-bb3d-c8c6de7d5a21 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:54.298736 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea135bc3-2e32-4c25-bb3d-c8c6de7d5a21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:54.300687 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea135bc3-2e32-4c25-bb3d-c8c6de7d5a21 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:54.329321 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3857/7739] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:16:54 2022] POST /identity/v3/projects => generated 369 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:16:54.333497 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0125d26-60ed-4de5-8c1c-97bf30eb7eaa None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:54.340293 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:54.346098 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0125d26-60ed-4de5-8c1c-97bf30eb7eaa None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:54.410785 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82e4f1-2c19-4901-b8d3-230781db3748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:54.411430 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82e4f1-2c19-4901-b8d3-230781db3748 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:54.411706 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82e4f1-2c19-4901-b8d3-230781db3748 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:54.411982 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82e4f1-2c19-4901-b8d3-230781db3748 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:54.412619 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82e4f1-2c19-4901-b8d3-230781db3748 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:54.414555 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82e4f1-2c19-4901-b8d3-230781db3748 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:54.437137 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3883/7740] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:16:54 2022] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:16:54.440061 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea135bc3-2e32-4c25-bb3d-c8c6de7d5a21 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:54.451207 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea135bc3-2e32-4c25-bb3d-c8c6de7d5a21 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:54.456292 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a16b7-e1b3-4e94-9296-1fbebd6ce053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:54.456907 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a16b7-e1b3-4e94-9296-1fbebd6ce053 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:54.457191 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a16b7-e1b3-4e94-9296-1fbebd6ce053 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:54.457484 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a16b7-e1b3-4e94-9296-1fbebd6ce053 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:54.458172 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a16b7-e1b3-4e94-9296-1fbebd6ce053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:54.459901 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a16b7-e1b3-4e94-9296-1fbebd6ce053 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:54.472744 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3858/7741] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:16:54.476848 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82e4f1-2c19-4901-b8d3-230781db3748 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:54.486842 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82e4f1-2c19-4901-b8d3-230781db3748 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:54.491411 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a6032-6dd0-47b9-b09b-fd4ea8fce6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:54.492056 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a6032-6dd0-47b9-b09b-fd4ea8fce6ae admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:54.492331 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a6032-6dd0-47b9-b09b-fd4ea8fce6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:54.492600 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a6032-6dd0-47b9-b09b-fd4ea8fce6ae admin admin] PATH_INFO: `/v3/projects/6fc94baa192e493cb36e44df71f33256/users/6faee13a96fc41e49181c30c81eb00c7/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:54.507149 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2a6032-6dd0-47b9-b09b-fd4ea8fce6ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fc94baa192e493cb36e44df71f33256, user_id=6faee13a96fc41e49181c30c81eb00c7, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:54.509792 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2a6032-6dd0-47b9-b09b-fd4ea8fce6ae admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:54.523045 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3884/7742] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:16:54 2022] PUT /identity/v3/projects/6fc94baa192e493cb36e44df71f33256/users/6faee13a96fc41e49181c30c81eb00c7/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:16:54.526957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a16b7-e1b3-4e94-9296-1fbebd6ce053 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:54.537617 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a16b7-e1b3-4e94-9296-1fbebd6ce053 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:54.598548 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29a322-2c2f-4316-b9af-d88122db4f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:54.599203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29a322-2c2f-4316-b9af-d88122db4f60 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:54.599511 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29a322-2c2f-4316-b9af-d88122db4f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:54.599847 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29a322-2c2f-4316-b9af-d88122db4f60 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:54.600506 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb29a322-2c2f-4316-b9af-d88122db4f60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:54.602153 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb29a322-2c2f-4316-b9af-d88122db4f60 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:54.613059 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3859/7743] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:16:54.617137 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a6032-6dd0-47b9-b09b-fd4ea8fce6ae admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:54.628919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a6032-6dd0-47b9-b09b-fd4ea8fce6ae admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:54.633418 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846108c-3698-47ec-a8d6-357e15bfaffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:54.634078 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846108c-3698-47ec-a8d6-357e15bfaffe admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:54.634356 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846108c-3698-47ec-a8d6-357e15bfaffe admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:54.634630 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846108c-3698-47ec-a8d6-357e15bfaffe admin admin] PATH_INFO: `/v3/projects/6fc94baa192e493cb36e44df71f33256/users/6faee13a96fc41e49181c30c81eb00c7/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:54.636596 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f846108c-3698-47ec-a8d6-357e15bfaffe admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fc94baa192e493cb36e44df71f33256, user_id=6faee13a96fc41e49181c30c81eb00c7, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:54.639841 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f846108c-3698-47ec-a8d6-357e15bfaffe admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:54.650557 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3885/7744] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:16:54 2022] PUT /identity/v3/projects/6fc94baa192e493cb36e44df71f33256/users/6faee13a96fc41e49181c30c81eb00c7/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:16:54.661511 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a57f23-ac18-48f9-8fe3-20b619d8ca35 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:54.661793 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a57f23-ac18-48f9-8fe3-20b619d8ca35 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:54.662065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a57f23-ac18-48f9-8fe3-20b619d8ca35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:54.669837 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:54.692704 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-53a57f23-ac18-48f9-8fe3-20b619d8ca35 None None] MFA Rules not processed for user `6faee13a96fc41e49181c30c81eb00c7`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:16:54.693923 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-53a57f23-ac18-48f9-8fe3-20b619d8ca35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:54.764539 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3860/7745] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:16:54 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:16:54.769267 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846108c-3698-47ec-a8d6-357e15bfaffe admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:54.832108 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846108c-3698-47ec-a8d6-357e15bfaffe admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:54.836743 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac96815-ccfe-447d-ad4e-7b9b45bf21d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:54.837346 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac96815-ccfe-447d-ad4e-7b9b45bf21d8 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:54.837629 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac96815-ccfe-447d-ad4e-7b9b45bf21d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:54.837899 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac96815-ccfe-447d-ad4e-7b9b45bf21d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:54.838535 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac96815-ccfe-447d-ad4e-7b9b45bf21d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:54.840461 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac96815-ccfe-447d-ad4e-7b9b45bf21d8 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:54.868613 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3886/7746] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:16:54 2022] POST /identity/v3/projects => generated 369 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:16:54.873023 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a57f23-ac18-48f9-8fe3-20b619d8ca35 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:54.883498 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a57f23-ac18-48f9-8fe3-20b619d8ca35 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:54.941015 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be6bf82-8e0c-4bbd-93b0-f2b05b0c8ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:54.941627 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6bf82-8e0c-4bbd-93b0-f2b05b0c8ca9 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:54.941911 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6bf82-8e0c-4bbd-93b0-f2b05b0c8ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:54.942186 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6bf82-8e0c-4bbd-93b0-f2b05b0c8ca9 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:54.942817 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be6bf82-8e0c-4bbd-93b0-f2b05b0c8ca9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:54.945108 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be6bf82-8e0c-4bbd-93b0-f2b05b0c8ca9 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:54.967120 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3861/7747] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:16:54 2022] POST /identity/v3/users => generated 285 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:16:54.971196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac96815-ccfe-447d-ad4e-7b9b45bf21d8 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:54.982760 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac96815-ccfe-447d-ad4e-7b9b45bf21d8 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:54.987719 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741945ff-afcd-49fb-a618-1206e45c7ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:54.988324 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741945ff-afcd-49fb-a618-1206e45c7ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:54.988606 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741945ff-afcd-49fb-a618-1206e45c7ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:54.988881 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741945ff-afcd-49fb-a618-1206e45c7ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:54.989518 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741945ff-afcd-49fb-a618-1206e45c7ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:54.991173 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741945ff-afcd-49fb-a618-1206e45c7ec4 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:55.001783 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3887/7748] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:16:55.005690 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be6bf82-8e0c-4bbd-93b0-f2b05b0c8ca9 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:55.016003 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be6bf82-8e0c-4bbd-93b0-f2b05b0c8ca9 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:55.020631 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c11b26-7dde-45a0-95e7-3a3244bb03cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:55.021223 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c11b26-7dde-45a0-95e7-3a3244bb03cc admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:55.021505 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c11b26-7dde-45a0-95e7-3a3244bb03cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:55.021768 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c11b26-7dde-45a0-95e7-3a3244bb03cc admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:55.022407 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c11b26-7dde-45a0-95e7-3a3244bb03cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:55.024070 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c11b26-7dde-45a0-95e7-3a3244bb03cc admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:55.035067 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3862/7749] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:16:55.038986 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741945ff-afcd-49fb-a618-1206e45c7ec4 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:55.049911 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741945ff-afcd-49fb-a618-1206e45c7ec4 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:55.054878 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23667edb-ec34-4269-8142-8e1f76e38cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:55.055555 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23667edb-ec34-4269-8142-8e1f76e38cde admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:55.055831 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23667edb-ec34-4269-8142-8e1f76e38cde admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:55.056101 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23667edb-ec34-4269-8142-8e1f76e38cde admin admin] PATH_INFO: `/v3/projects/fe94c7578ea644ecaef5e81be96caaa0/users/3d3b52897b3644cc98eaa16221a3ef96/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:55.071486 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23667edb-ec34-4269-8142-8e1f76e38cde admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe94c7578ea644ecaef5e81be96caaa0, user_id=3d3b52897b3644cc98eaa16221a3ef96, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:55.074139 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23667edb-ec34-4269-8142-8e1f76e38cde admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:55.087553 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3888/7750] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:16:55 2022] PUT /identity/v3/projects/fe94c7578ea644ecaef5e81be96caaa0/users/3d3b52897b3644cc98eaa16221a3ef96/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:16:55.179607 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4381e9b-74d5-4bc7-bd02-09ebc317cd2e None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:55.179895 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4381e9b-74d5-4bc7-bd02-09ebc317cd2e None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:55.180172 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4381e9b-74d5-4bc7-bd02-09ebc317cd2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:55.209651 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-d4381e9b-74d5-4bc7-bd02-09ebc317cd2e None None] MFA Rules not processed for user `3d3b52897b3644cc98eaa16221a3ef96`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:16:55.210912 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d4381e9b-74d5-4bc7-bd02-09ebc317cd2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:55.267455 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:55.277426 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3863/7751] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:16:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:16:55.282803 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23667edb-ec34-4269-8142-8e1f76e38cde admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:55.291935 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:55.354973 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23667edb-ec34-4269-8142-8e1f76e38cde admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:55.359788 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae1d5a4-ff11-482d-a39c-d9189857d4d2 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:55.360402 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1d5a4-ff11-482d-a39c-d9189857d4d2 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:55.360687 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1d5a4-ff11-482d-a39c-d9189857d4d2 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:55.360959 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1d5a4-ff11-482d-a39c-d9189857d4d2 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:55.361619 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae1d5a4-ff11-482d-a39c-d9189857d4d2 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:55.363251 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae1d5a4-ff11-482d-a39c-d9189857d4d2 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:55.381828 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3889/7752] 10.222.0.83 () {60 vars in 1149 bytes} [Mon Aug 29 16:16:55 2022] POST /identity/v3/domains => generated 277 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:16:55.386058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4381e9b-74d5-4bc7-bd02-09ebc317cd2e None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:55.397919 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4381e9b-74d5-4bc7-bd02-09ebc317cd2e None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:55.454755 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e665aa-0c98-4be1-a588-2711118a34f3 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:55.455409 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e665aa-0c98-4be1-a588-2711118a34f3 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:55.455697 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e665aa-0c98-4be1-a588-2711118a34f3 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:55.455973 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e665aa-0c98-4be1-a588-2711118a34f3 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:55.456635 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e665aa-0c98-4be1-a588-2711118a34f3 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:55.458249 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e665aa-0c98-4be1-a588-2711118a34f3 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:55.477883 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3864/7753] 10.222.0.83 () {60 vars in 1143 bytes} [Mon Aug 29 16:16:55 2022] POST /identity/v3/roles => generated 240 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:16:55.479210 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae1d5a4-ff11-482d-a39c-d9189857d4d2 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:55.490958 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae1d5a4-ff11-482d-a39c-d9189857d4d2 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:55.495739 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d192271-eb87-43bf-8bb1-5a635a75b8fd tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:55.496510 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d192271-eb87-43bf-8bb1-5a635a75b8fd tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:55.497318 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d192271-eb87-43bf-8bb1-5a635a75b8fd tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:55.497754 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d192271-eb87-43bf-8bb1-5a635a75b8fd tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/domains/9978f198b64747f5b36c91c036c9bd1d/users/3d3b52897b3644cc98eaa16221a3ef96/roles/3fe83ec2a1354c5aae46cdcce5e5e46d` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:55.511194 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d192271-eb87-43bf-8bb1-5a635a75b8fd tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=9978f198b64747f5b36c91c036c9bd1d, user_id=3d3b52897b3644cc98eaa16221a3ef96, role_id=3fe83ec2a1354c5aae46cdcce5e5e46d)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:55.514859 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d192271-eb87-43bf-8bb1-5a635a75b8fd tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:55.529199 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3890/7754] 10.222.0.83 () {60 vars in 1480 bytes} [Mon Aug 29 16:16:55 2022] PUT /identity/v3/domains/9978f198b64747f5b36c91c036c9bd1d/users/3d3b52897b3644cc98eaa16221a3ef96/roles/3fe83ec2a1354c5aae46cdcce5e5e46d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:16:55.533180 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e665aa-0c98-4be1-a588-2711118a34f3 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:55.544148 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e665aa-0c98-4be1-a588-2711118a34f3 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:55.608614 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3318e5f-c59b-4cf9-88e0-5f3dbd4e2850 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:55.609235 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3318e5f-c59b-4cf9-88e0-5f3dbd4e2850 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:55.609516 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3318e5f-c59b-4cf9-88e0-5f3dbd4e2850 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:55.609797 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3318e5f-c59b-4cf9-88e0-5f3dbd4e2850 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:55.610469 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3318e5f-c59b-4cf9-88e0-5f3dbd4e2850 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:55.612138 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3318e5f-c59b-4cf9-88e0-5f3dbd4e2850 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:55.634041 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3865/7755] 10.222.0.83 () {60 vars in 1149 bytes} [Mon Aug 29 16:16:55 2022] POST /identity/v3/domains => generated 276 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:16:55.635417 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d192271-eb87-43bf-8bb1-5a635a75b8fd tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:55.647018 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d192271-eb87-43bf-8bb1-5a635a75b8fd tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:55.704510 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6884e952-46fc-4317-a3dd-9d2c1739a4f2 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:55.705123 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6884e952-46fc-4317-a3dd-9d2c1739a4f2 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:55.705402 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6884e952-46fc-4317-a3dd-9d2c1739a4f2 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:55.705679 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6884e952-46fc-4317-a3dd-9d2c1739a4f2 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:55.706359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6884e952-46fc-4317-a3dd-9d2c1739a4f2 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:55.707987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6884e952-46fc-4317-a3dd-9d2c1739a4f2 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:55.723252 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3891/7756] 10.222.0.83 () {60 vars in 1143 bytes} [Mon Aug 29 16:16:55 2022] POST /identity/v3/roles => generated 240 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:16:55.727295 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3318e5f-c59b-4cf9-88e0-5f3dbd4e2850 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:55.737846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3318e5f-c59b-4cf9-88e0-5f3dbd4e2850 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:55.742893 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b777b4-e28c-436a-bfa1-6ff7c2a9f412 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:55.743534 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b777b4-e28c-436a-bfa1-6ff7c2a9f412 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:55.743835 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b777b4-e28c-436a-bfa1-6ff7c2a9f412 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:55.744108 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b777b4-e28c-436a-bfa1-6ff7c2a9f412 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/groups` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:55.744877 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b777b4-e28c-436a-bfa1-6ff7c2a9f412 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:55.746688 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b777b4-e28c-436a-bfa1-6ff7c2a9f412 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:55.778123 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3866/7757] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:16:55 2022] POST /identity/v3/groups => generated 326 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:16:55.779352 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6884e952-46fc-4317-a3dd-9d2c1739a4f2 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:55.789174 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6884e952-46fc-4317-a3dd-9d2c1739a4f2 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:55.793847 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95ac73-2466-4073-a556-a04de29beab6 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:55.794530 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95ac73-2466-4073-a556-a04de29beab6 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:55.794804 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95ac73-2466-4073-a556-a04de29beab6 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:55.795116 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95ac73-2466-4073-a556-a04de29beab6 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/groups/f1d3d8e445af4a00883baa633b48793d/users/3d3b52897b3644cc98eaa16221a3ef96` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:55.800736 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad95ac73-2466-4073-a556-a04de29beab6 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=f1d3d8e445af4a00883baa633b48793d, user_id=3d3b52897b3644cc98eaa16221a3ef96)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:55.801829 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-ad95ac73-2466-4073-a556-a04de29beab6 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:16:55.801829 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 16:16:55.801829 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 16:16:55.803073 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad95ac73-2466-4073-a556-a04de29beab6 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:55.828230 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3892/7758] 10.222.0.83 () {60 vars in 1360 bytes} [Mon Aug 29 16:16:55 2022] PUT /identity/v3/groups/f1d3d8e445af4a00883baa633b48793d/users/3d3b52897b3644cc98eaa16221a3ef96 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:16:55.832601 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b777b4-e28c-436a-bfa1-6ff7c2a9f412 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:55.844168 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b777b4-e28c-436a-bfa1-6ff7c2a9f412 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:55.906582 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a849fd-e109-4ffe-883a-9e0ceda591a3 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:55.907283 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a849fd-e109-4ffe-883a-9e0ceda591a3 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:55.907569 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a849fd-e109-4ffe-883a-9e0ceda591a3 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:55.907846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a849fd-e109-4ffe-883a-9e0ceda591a3 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/domains/1ccea34746a9479780ef0eb9d0e73fbb/groups/f1d3d8e445af4a00883baa633b48793d/roles/f297da3b657d40cbbe1df4bbdb2207eb` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:55.910055 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a849fd-e109-4ffe-883a-9e0ceda591a3 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=1ccea34746a9479780ef0eb9d0e73fbb, group_id=f1d3d8e445af4a00883baa633b48793d, role_id=f297da3b657d40cbbe1df4bbdb2207eb)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:55.912760 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a849fd-e109-4ffe-883a-9e0ceda591a3 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:55.915802 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:55.928125 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3867/7759] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:16:55 2022] PUT /identity/v3/domains/1ccea34746a9479780ef0eb9d0e73fbb/groups/f1d3d8e445af4a00883baa633b48793d/roles/f297da3b657d40cbbe1df4bbdb2207eb => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:16:55.932600 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95ac73-2466-4073-a556-a04de29beab6 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:55.944196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95ac73-2466-4073-a556-a04de29beab6 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:55.988867 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:56.003116 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3092e-441a-4f85-866f-8c6188971fa8 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:56.003730 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3092e-441a-4f85-866f-8c6188971fa8 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:56.004015 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3092e-441a-4f85-866f-8c6188971fa8 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:56.004290 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3092e-441a-4f85-866f-8c6188971fa8 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:56.004966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec3092e-441a-4f85-866f-8c6188971fa8 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:56.006564 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec3092e-441a-4f85-866f-8c6188971fa8 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:56.021874 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3893/7760] 10.222.0.83 () {60 vars in 1149 bytes} [Mon Aug 29 16:16:55 2022] POST /identity/v3/domains => generated 277 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:16:56.026116 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a849fd-e109-4ffe-883a-9e0ceda591a3 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:56.036775 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a849fd-e109-4ffe-883a-9e0ceda591a3 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:56.094071 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d929c-0313-425e-86e1-be140e6e5c28 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:56.094684 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d929c-0313-425e-86e1-be140e6e5c28 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:56.094968 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d929c-0313-425e-86e1-be140e6e5c28 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:56.095271 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d929c-0313-425e-86e1-be140e6e5c28 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:56.095943 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494d929c-0313-425e-86e1-be140e6e5c28 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:56.097545 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494d929c-0313-425e-86e1-be140e6e5c28 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:56.115068 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3868/7761] 10.222.0.83 () {60 vars in 1143 bytes} [Mon Aug 29 16:16:56 2022] POST /identity/v3/roles => generated 240 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:16:56.118025 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3092e-441a-4f85-866f-8c6188971fa8 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:56.128939 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3092e-441a-4f85-866f-8c6188971fa8 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:56.133552 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b986a37-7767-4aa9-8b7b-a3d8b7de8564 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:56.134199 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b986a37-7767-4aa9-8b7b-a3d8b7de8564 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:56.134476 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b986a37-7767-4aa9-8b7b-a3d8b7de8564 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:56.134748 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b986a37-7767-4aa9-8b7b-a3d8b7de8564 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/domains/97e64f3516c84f1ea04ca45927a390bd/users/3d3b52897b3644cc98eaa16221a3ef96/roles/7f52ed12b72246a885917d5ecb7ae1d0` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:56.147566 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b986a37-7767-4aa9-8b7b-a3d8b7de8564 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=97e64f3516c84f1ea04ca45927a390bd, user_id=3d3b52897b3644cc98eaa16221a3ef96, role_id=7f52ed12b72246a885917d5ecb7ae1d0)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:56.150238 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b986a37-7767-4aa9-8b7b-a3d8b7de8564 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:56.163771 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3894/7762] 10.222.0.83 () {60 vars in 1480 bytes} [Mon Aug 29 16:16:56 2022] PUT /identity/v3/domains/97e64f3516c84f1ea04ca45927a390bd/users/3d3b52897b3644cc98eaa16221a3ef96/roles/7f52ed12b72246a885917d5ecb7ae1d0 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:16:56.168175 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d929c-0313-425e-86e1-be140e6e5c28 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:56.179356 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d929c-0313-425e-86e1-be140e6e5c28 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:56.237348 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae96961-ea24-4aed-bae4-40caf73b4d16 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:56.237991 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae96961-ea24-4aed-bae4-40caf73b4d16 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:56.238275 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae96961-ea24-4aed-bae4-40caf73b4d16 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:56.238584 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae96961-ea24-4aed-bae4-40caf73b4d16 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:56.239286 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae96961-ea24-4aed-bae4-40caf73b4d16 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:56.240896 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae96961-ea24-4aed-bae4-40caf73b4d16 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:56.258132 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3869/7763] 10.222.0.83 () {60 vars in 1149 bytes} [Mon Aug 29 16:16:56 2022] POST /identity/v3/domains => generated 277 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:16:56.262064 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b986a37-7767-4aa9-8b7b-a3d8b7de8564 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:56.272585 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b986a37-7767-4aa9-8b7b-a3d8b7de8564 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:56.331421 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da65326-3ff7-441c-ac7c-3226999c4f2e tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:56.332116 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da65326-3ff7-441c-ac7c-3226999c4f2e tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:56.332298 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da65326-3ff7-441c-ac7c-3226999c4f2e tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:56.332571 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da65326-3ff7-441c-ac7c-3226999c4f2e tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:56.333247 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da65326-3ff7-441c-ac7c-3226999c4f2e tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:56.334903 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da65326-3ff7-441c-ac7c-3226999c4f2e tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:56.354517 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3895/7764] 10.222.0.83 () {60 vars in 1143 bytes} [Mon Aug 29 16:16:56 2022] POST /identity/v3/roles => generated 239 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:16:56.355843 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae96961-ea24-4aed-bae4-40caf73b4d16 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:56.367530 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae96961-ea24-4aed-bae4-40caf73b4d16 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:56.373051 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f7c34-4a41-43d8-83b8-a68edeae205d tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:56.373961 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f7c34-4a41-43d8-83b8-a68edeae205d tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:56.373961 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f7c34-4a41-43d8-83b8-a68edeae205d tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:56.374214 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f7c34-4a41-43d8-83b8-a68edeae205d tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/groups` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:56.374883 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56f7c34-4a41-43d8-83b8-a68edeae205d tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:56.376858 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56f7c34-4a41-43d8-83b8-a68edeae205d tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:56.402484 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3870/7765] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:16:56 2022] POST /identity/v3/groups => generated 326 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:16:56.407299 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da65326-3ff7-441c-ac7c-3226999c4f2e tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:56.417277 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da65326-3ff7-441c-ac7c-3226999c4f2e tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:56.422528 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877cbb3c-9a08-429a-84c6-504504be896b tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:56.423198 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877cbb3c-9a08-429a-84c6-504504be896b tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:56.423477 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877cbb3c-9a08-429a-84c6-504504be896b tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:56.423753 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877cbb3c-9a08-429a-84c6-504504be896b tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/groups/6383e6d1d44c467fb1435d17dd809a4d/users/3d3b52897b3644cc98eaa16221a3ef96` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:56.429827 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877cbb3c-9a08-429a-84c6-504504be896b tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=6383e6d1d44c467fb1435d17dd809a4d, user_id=3d3b52897b3644cc98eaa16221a3ef96)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:56.431808 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877cbb3c-9a08-429a-84c6-504504be896b tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:56.455539 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3896/7766] 10.222.0.83 () {60 vars in 1360 bytes} [Mon Aug 29 16:16:56 2022] PUT /identity/v3/groups/6383e6d1d44c467fb1435d17dd809a4d/users/3d3b52897b3644cc98eaa16221a3ef96 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:16:56.459851 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f7c34-4a41-43d8-83b8-a68edeae205d tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:56.471380 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f7c34-4a41-43d8-83b8-a68edeae205d tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:56.529695 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1573a109-096b-45ac-8d2c-a5531e51bd59 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:56.530359 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573a109-096b-45ac-8d2c-a5531e51bd59 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:56.530640 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573a109-096b-45ac-8d2c-a5531e51bd59 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:56.530915 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573a109-096b-45ac-8d2c-a5531e51bd59 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/domains/6fb3d5ddc939415fa378f480513cf81f/groups/6383e6d1d44c467fb1435d17dd809a4d/roles/453cd328451348428760d7007211a804` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:56.533387 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1573a109-096b-45ac-8d2c-a5531e51bd59 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=6fb3d5ddc939415fa378f480513cf81f, group_id=6383e6d1d44c467fb1435d17dd809a4d, role_id=453cd328451348428760d7007211a804)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:56.536263 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1573a109-096b-45ac-8d2c-a5531e51bd59 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:56.540320 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:56.552325 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3871/7767] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:16:56 2022] PUT /identity/v3/domains/6fb3d5ddc939415fa378f480513cf81f/groups/6383e6d1d44c467fb1435d17dd809a4d/roles/453cd328451348428760d7007211a804 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:16:56.557570 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877cbb3c-9a08-429a-84c6-504504be896b tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:56.648290 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877cbb3c-9a08-429a-84c6-504504be896b tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:56.653259 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:56.746784 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a32c05-6406-4b88-8b6d-f3e8c7e7cec0 tempest-TokensV3TestJSON-1076142743 tempest-TokensV3TestJSON-1076142743-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3b52897b3644cc98eaa16221a3ef96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe94c7578ea644ecaef5e81be96caaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:56.748338 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a32c05-6406-4b88-8b6d-f3e8c7e7cec0 tempest-TokensV3TestJSON-1076142743 tempest-TokensV3TestJSON-1076142743-project] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:56.748700 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a32c05-6406-4b88-8b6d-f3e8c7e7cec0 tempest-TokensV3TestJSON-1076142743 tempest-TokensV3TestJSON-1076142743-project] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:56.749043 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a32c05-6406-4b88-8b6d-f3e8c7e7cec0 tempest-TokensV3TestJSON-1076142743 tempest-TokensV3TestJSON-1076142743-project] PATH_INFO: `/v3/auth/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:56.749725 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a32c05-6406-4b88-8b6d-f3e8c7e7cec0 tempest-TokensV3TestJSON-1076142743 tempest-TokensV3TestJSON-1076142743-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:56.750795 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a32c05-6406-4b88-8b6d-f3e8c7e7cec0 tempest-TokensV3TestJSON-1076142743 tempest-TokensV3TestJSON-1076142743-project] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:56.817587 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3897/7768] 10.222.0.83 () {58 vars in 1143 bytes} [Mon Aug 29 16:16:56 2022] GET /identity/v3/auth/domains => generated 1175 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:16:56.824714 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1573a109-096b-45ac-8d2c-a5531e51bd59 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:56.889175 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1573a109-096b-45ac-8d2c-a5531e51bd59 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:56.893822 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f0f05-b7ff-44f3-85c8-158e3a1e22fa tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:56.894488 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f0f05-b7ff-44f3-85c8-158e3a1e22fa tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:56.894773 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f0f05-b7ff-44f3-85c8-158e3a1e22fa tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:56.895077 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f0f05-b7ff-44f3-85c8-158e3a1e22fa tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/domains/6fb3d5ddc939415fa378f480513cf81f/groups/6383e6d1d44c467fb1435d17dd809a4d/roles/453cd328451348428760d7007211a804` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:56.897269 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f0f05-b7ff-44f3-85c8-158e3a1e22fa tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=6fb3d5ddc939415fa378f480513cf81f, group_id=6383e6d1d44c467fb1435d17dd809a4d, role_id=453cd328451348428760d7007211a804)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:56.899969 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f0f05-b7ff-44f3-85c8-158e3a1e22fa tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:56.906600 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4e8f0f05-b7ff-44f3-85c8-158e3a1e22fa tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invalidating the token cache because role 453cd328451348428760d7007211a804 was removed from group 6383e6d1d44c467fb1435d17dd809a4d on domain 6fb3d5ddc939415fa378f480513cf81f. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:16:56.906893 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4e8f0f05-b7ff-44f3-85c8-158e3a1e22fa tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:56.907615 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4e8f0f05-b7ff-44f3-85c8-158e3a1e22fa tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:56.921110 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3872/7769] 10.222.0.83 () {58 vars in 1467 bytes} [Mon Aug 29 16:16:56 2022] DELETE /identity/v3/domains/6fb3d5ddc939415fa378f480513cf81f/groups/6383e6d1d44c467fb1435d17dd809a4d/roles/453cd328451348428760d7007211a804 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:16:56.925303 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a32c05-6406-4b88-8b6d-f3e8c7e7cec0 tempest-TokensV3TestJSON-1076142743 tempest-TokensV3TestJSON-1076142743-project] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:56.927050 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-85a32c05-6406-4b88-8b6d-f3e8c7e7cec0 tempest-TokensV3TestJSON-1076142743 tempest-TokensV3TestJSON-1076142743-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:56.941463 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a32c05-6406-4b88-8b6d-f3e8c7e7cec0 tempest-TokensV3TestJSON-1076142743 tempest-TokensV3TestJSON-1076142743-project] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:56.998876 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f287a6-7e39-44e0-bc35-e67e68cf1bcb tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:56.999629 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f287a6-7e39-44e0-bc35-e67e68cf1bcb tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:56.999909 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f287a6-7e39-44e0-bc35-e67e68cf1bcb tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:57.000184 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f287a6-7e39-44e0-bc35-e67e68cf1bcb tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/groups/6383e6d1d44c467fb1435d17dd809a4d/users/3d3b52897b3644cc98eaa16221a3ef96` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:57.001809 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f287a6-7e39-44e0-bc35-e67e68cf1bcb tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=6383e6d1d44c467fb1435d17dd809a4d, user_id=3d3b52897b3644cc98eaa16221a3ef96)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:57.003752 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f287a6-7e39-44e0-bc35-e67e68cf1bcb tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:57.011315 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d2f287a6-7e39-44e0-bc35-e67e68cf1bcb tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '3d3b52897b3644cc98eaa16221a3ef96'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:57.025675 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3898/7770] 10.222.0.83 () {58 vars in 1344 bytes} [Mon Aug 29 16:16:56 2022] DELETE /identity/v3/groups/6383e6d1d44c467fb1435d17dd809a4d/users/3d3b52897b3644cc98eaa16221a3ef96 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:16:57.029830 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f0f05-b7ff-44f3-85c8-158e3a1e22fa tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:57.039845 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f0f05-b7ff-44f3-85c8-158e3a1e22fa tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:57.097443 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aacd9b-b81f-47ad-8fe3-c75f0d385f84 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:57.097996 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aacd9b-b81f-47ad-8fe3-c75f0d385f84 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:57.098281 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aacd9b-b81f-47ad-8fe3-c75f0d385f84 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:57.098558 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aacd9b-b81f-47ad-8fe3-c75f0d385f84 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/groups/6383e6d1d44c467fb1435d17dd809a4d` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:57.099767 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aacd9b-b81f-47ad-8fe3-c75f0d385f84 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorizing `identity:delete_group(group_id=6383e6d1d44c467fb1435d17dd809a4d)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:57.101688 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aacd9b-b81f-47ad-8fe3-c75f0d385f84 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:57.144915 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3873/7771] 10.222.0.83 () {58 vars in 1227 bytes} [Mon Aug 29 16:16:57 2022] DELETE /identity/v3/groups/6383e6d1d44c467fb1435d17dd809a4d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:16:57.149155 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f287a6-7e39-44e0-bc35-e67e68cf1bcb tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:57.159650 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f287a6-7e39-44e0-bc35-e67e68cf1bcb tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:57.164259 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:57.218263 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c96f42-f22e-442f-a673-ad550c0d4f86 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:57.218892 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c96f42-f22e-442f-a673-ad550c0d4f86 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:57.219203 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c96f42-f22e-442f-a673-ad550c0d4f86 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:57.219478 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c96f42-f22e-442f-a673-ad550c0d4f86 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/roles/453cd328451348428760d7007211a804` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:57.220873 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c96f42-f22e-442f-a673-ad550c0d4f86 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorizing `identity:delete_role(role_id=453cd328451348428760d7007211a804)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:57.222474 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c96f42-f22e-442f-a673-ad550c0d4f86 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:57.255427 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-16c96f42-f22e-442f-a673-ad550c0d4f86 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invalidating the token cache because role 453cd328451348428760d7007211a804 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:16:57.255748 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-16c96f42-f22e-442f-a673-ad550c0d4f86 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:57.256408 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-16c96f42-f22e-442f-a673-ad550c0d4f86 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:57.258176 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3899/7772] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:16:57 2022] DELETE /identity/v3/roles/453cd328451348428760d7007211a804 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:16:57.262420 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aacd9b-b81f-47ad-8fe3-c75f0d385f84 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:57.264898 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b2aacd9b-b81f-47ad-8fe3-c75f0d385f84 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:57.278851 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aacd9b-b81f-47ad-8fe3-c75f0d385f84 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:57.320300 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:57.337536 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a92cdc-4825-4aeb-9157-f6e66af18259 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:57.338178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a92cdc-4825-4aeb-9157-f6e66af18259 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:57.338460 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a92cdc-4825-4aeb-9157-f6e66af18259 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:57.338734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a92cdc-4825-4aeb-9157-f6e66af18259 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/domains/6fb3d5ddc939415fa378f480513cf81f` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:57.340025 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a92cdc-4825-4aeb-9157-f6e66af18259 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=6fb3d5ddc939415fa378f480513cf81f)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:57.342328 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a92cdc-4825-4aeb-9157-f6e66af18259 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:57.363747 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-60a92cdc-4825-4aeb-9157-f6e66af18259 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '6fb3d5ddc939415fa378f480513cf81f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:57.364393 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-60a92cdc-4825-4aeb-9157-f6e66af18259 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '6fb3d5ddc939415fa378f480513cf81f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:57.389429 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-60a92cdc-4825-4aeb-9157-f6e66af18259 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '6fb3d5ddc939415fa378f480513cf81f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:57.390060 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-60a92cdc-4825-4aeb-9157-f6e66af18259 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '6fb3d5ddc939415fa378f480513cf81f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:57.392501 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3874/7773] 10.222.0.83 () {60 vars in 1249 bytes} [Mon Aug 29 16:16:57 2022] PATCH /identity/v3/domains/6fb3d5ddc939415fa378f480513cf81f => generated 278 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:16:57.396736 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c96f42-f22e-442f-a673-ad550c0d4f86 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:57.407632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c96f42-f22e-442f-a673-ad550c0d4f86 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:57.463211 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec6b76-1256-4691-a49e-6a227095f317 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:57.463844 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec6b76-1256-4691-a49e-6a227095f317 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:57.464128 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec6b76-1256-4691-a49e-6a227095f317 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:57.464405 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec6b76-1256-4691-a49e-6a227095f317 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/domains/6fb3d5ddc939415fa378f480513cf81f` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:57.476142 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec6b76-1256-4691-a49e-6a227095f317 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=6fb3d5ddc939415fa378f480513cf81f)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:57.477763 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec6b76-1256-4691-a49e-6a227095f317 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:57.500332 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0cec6b76-1256-4691-a49e-6a227095f317 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '6fb3d5ddc939415fa378f480513cf81f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:57.509875 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0cec6b76-1256-4691-a49e-6a227095f317 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '6fb3d5ddc939415fa378f480513cf81f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:57.546550 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:57.550914 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0cec6b76-1256-4691-a49e-6a227095f317 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fb3d5ddc939415fa378f480513cf81f', 'request_id': 'req-0cec6b76-1256-4691-a49e-6a227095f317'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:57.557360 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0cec6b76-1256-4691-a49e-6a227095f317 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fb3d5ddc939415fa378f480513cf81f', 'request_id': 'req-0cec6b76-1256-4691-a49e-6a227095f317'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:57.564945 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0cec6b76-1256-4691-a49e-6a227095f317 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fb3d5ddc939415fa378f480513cf81f', 'request_id': 'req-0cec6b76-1256-4691-a49e-6a227095f317'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:57.578598 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0cec6b76-1256-4691-a49e-6a227095f317 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] The token cache is being invalidate because project 6fb3d5ddc939415fa378f480513cf81f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:16:57.578877 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0cec6b76-1256-4691-a49e-6a227095f317 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:57.579562 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0cec6b76-1256-4691-a49e-6a227095f317 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:57.587465 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0cec6b76-1256-4691-a49e-6a227095f317 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '6fb3d5ddc939415fa378f480513cf81f', 'request_id': 'req-0cec6b76-1256-4691-a49e-6a227095f317'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:57.588105 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0cec6b76-1256-4691-a49e-6a227095f317 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '6fb3d5ddc939415fa378f480513cf81f', 'request_id': 'req-0cec6b76-1256-4691-a49e-6a227095f317'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:57.588735 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0cec6b76-1256-4691-a49e-6a227095f317 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '6fb3d5ddc939415fa378f480513cf81f', 'request_id': 'req-0cec6b76-1256-4691-a49e-6a227095f317'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:57.597768 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3900/7774] 10.222.0.83 () {58 vars in 1230 bytes} [Mon Aug 29 16:16:57 2022] DELETE /identity/v3/domains/6fb3d5ddc939415fa378f480513cf81f => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:16:57.602060 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a92cdc-4825-4aeb-9157-f6e66af18259 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:57.603493 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-60a92cdc-4825-4aeb-9157-f6e66af18259 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:57.616034 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a92cdc-4825-4aeb-9157-f6e66af18259 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:57.674250 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c15aa-f105-47ce-95a8-8b51f0d3ee2e tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:57.674933 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c15aa-f105-47ce-95a8-8b51f0d3ee2e tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:57.675244 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c15aa-f105-47ce-95a8-8b51f0d3ee2e tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:57.675525 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c15aa-f105-47ce-95a8-8b51f0d3ee2e tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/domains/97e64f3516c84f1ea04ca45927a390bd/users/3d3b52897b3644cc98eaa16221a3ef96/roles/7f52ed12b72246a885917d5ecb7ae1d0` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:57.677712 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323c15aa-f105-47ce-95a8-8b51f0d3ee2e tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=97e64f3516c84f1ea04ca45927a390bd, user_id=3d3b52897b3644cc98eaa16221a3ef96, role_id=7f52ed12b72246a885917d5ecb7ae1d0)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:57.680952 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323c15aa-f105-47ce-95a8-8b51f0d3ee2e tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:57.687225 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-323c15aa-f105-47ce-95a8-8b51f0d3ee2e tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invalidating the token cache because role 7f52ed12b72246a885917d5ecb7ae1d0 was removed from user 3d3b52897b3644cc98eaa16221a3ef96 on domain 97e64f3516c84f1ea04ca45927a390bd. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:16:57.687516 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-323c15aa-f105-47ce-95a8-8b51f0d3ee2e tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:57.688262 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-323c15aa-f105-47ce-95a8-8b51f0d3ee2e tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:57.701577 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3875/7775] 10.222.0.83 () {58 vars in 1464 bytes} [Mon Aug 29 16:16:57 2022] DELETE /identity/v3/domains/97e64f3516c84f1ea04ca45927a390bd/users/3d3b52897b3644cc98eaa16221a3ef96/roles/7f52ed12b72246a885917d5ecb7ae1d0 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:16:57.705751 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec6b76-1256-4691-a49e-6a227095f317 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:57.707196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0cec6b76-1256-4691-a49e-6a227095f317 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:57.719963 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec6b76-1256-4691-a49e-6a227095f317 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:57.780284 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa28a04-5af5-4bc7-b813-4f6a4a824dea tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:57.780927 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa28a04-5af5-4bc7-b813-4f6a4a824dea tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:57.781212 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa28a04-5af5-4bc7-b813-4f6a4a824dea tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:57.781487 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa28a04-5af5-4bc7-b813-4f6a4a824dea tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/roles/7f52ed12b72246a885917d5ecb7ae1d0` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:57.782893 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa28a04-5af5-4bc7-b813-4f6a4a824dea tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7f52ed12b72246a885917d5ecb7ae1d0)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:57.784571 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa28a04-5af5-4bc7-b813-4f6a4a824dea tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:57.819291 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5fa28a04-5af5-4bc7-b813-4f6a4a824dea tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invalidating the token cache because role 7f52ed12b72246a885917d5ecb7ae1d0 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:16:57.819580 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5fa28a04-5af5-4bc7-b813-4f6a4a824dea tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:57.820250 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5fa28a04-5af5-4bc7-b813-4f6a4a824dea tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:57.822051 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3901/7776] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:16:57 2022] DELETE /identity/v3/roles/7f52ed12b72246a885917d5ecb7ae1d0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:16:57.826352 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c15aa-f105-47ce-95a8-8b51f0d3ee2e tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:57.827774 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-323c15aa-f105-47ce-95a8-8b51f0d3ee2e tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:57.841176 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c15aa-f105-47ce-95a8-8b51f0d3ee2e tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:57.899226 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a93695-a3f7-430a-9b3a-6b0c1d7a0a96 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:57.899779 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a93695-a3f7-430a-9b3a-6b0c1d7a0a96 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:57.900058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a93695-a3f7-430a-9b3a-6b0c1d7a0a96 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:57.900334 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a93695-a3f7-430a-9b3a-6b0c1d7a0a96 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/domains/97e64f3516c84f1ea04ca45927a390bd` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:57.901592 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a93695-a3f7-430a-9b3a-6b0c1d7a0a96 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=97e64f3516c84f1ea04ca45927a390bd)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:57.903818 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a93695-a3f7-430a-9b3a-6b0c1d7a0a96 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:57.925480 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-75a93695-a3f7-430a-9b3a-6b0c1d7a0a96 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '97e64f3516c84f1ea04ca45927a390bd'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:57.926225 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-75a93695-a3f7-430a-9b3a-6b0c1d7a0a96 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '97e64f3516c84f1ea04ca45927a390bd'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:57.953509 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-75a93695-a3f7-430a-9b3a-6b0c1d7a0a96 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '97e64f3516c84f1ea04ca45927a390bd'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:57.954205 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-75a93695-a3f7-430a-9b3a-6b0c1d7a0a96 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '97e64f3516c84f1ea04ca45927a390bd'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:57.959629 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3876/7777] 10.222.0.83 () {60 vars in 1249 bytes} [Mon Aug 29 16:16:57 2022] PATCH /identity/v3/domains/97e64f3516c84f1ea04ca45927a390bd => generated 278 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:16:57.960776 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa28a04-5af5-4bc7-b813-4f6a4a824dea tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:57.962266 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5fa28a04-5af5-4bc7-b813-4f6a4a824dea tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:57.976143 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa28a04-5af5-4bc7-b813-4f6a4a824dea tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:58.034607 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543990f0-0313-4022-bb29-20aa2dfd1425 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:58.035271 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543990f0-0313-4022-bb29-20aa2dfd1425 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:58.035553 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543990f0-0313-4022-bb29-20aa2dfd1425 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:58.035824 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543990f0-0313-4022-bb29-20aa2dfd1425 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/domains/97e64f3516c84f1ea04ca45927a390bd` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:58.046274 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543990f0-0313-4022-bb29-20aa2dfd1425 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=97e64f3516c84f1ea04ca45927a390bd)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:58.047931 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543990f0-0313-4022-bb29-20aa2dfd1425 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:58.058799 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:58.074321 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-543990f0-0313-4022-bb29-20aa2dfd1425 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '97e64f3516c84f1ea04ca45927a390bd'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:58.084916 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-543990f0-0313-4022-bb29-20aa2dfd1425 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '97e64f3516c84f1ea04ca45927a390bd'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:58.125870 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-543990f0-0313-4022-bb29-20aa2dfd1425 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97e64f3516c84f1ea04ca45927a390bd', 'request_id': 'req-543990f0-0313-4022-bb29-20aa2dfd1425'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:58.131527 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-543990f0-0313-4022-bb29-20aa2dfd1425 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97e64f3516c84f1ea04ca45927a390bd', 'request_id': 'req-543990f0-0313-4022-bb29-20aa2dfd1425'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:58.139877 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-543990f0-0313-4022-bb29-20aa2dfd1425 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97e64f3516c84f1ea04ca45927a390bd', 'request_id': 'req-543990f0-0313-4022-bb29-20aa2dfd1425'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:58.152645 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-543990f0-0313-4022-bb29-20aa2dfd1425 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] The token cache is being invalidate because project 97e64f3516c84f1ea04ca45927a390bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:16:58.152865 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-543990f0-0313-4022-bb29-20aa2dfd1425 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:58.154192 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-543990f0-0313-4022-bb29-20aa2dfd1425 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:58.161932 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-543990f0-0313-4022-bb29-20aa2dfd1425 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '97e64f3516c84f1ea04ca45927a390bd', 'request_id': 'req-543990f0-0313-4022-bb29-20aa2dfd1425'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:58.162588 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-543990f0-0313-4022-bb29-20aa2dfd1425 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '97e64f3516c84f1ea04ca45927a390bd', 'request_id': 'req-543990f0-0313-4022-bb29-20aa2dfd1425'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:58.163237 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-543990f0-0313-4022-bb29-20aa2dfd1425 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '97e64f3516c84f1ea04ca45927a390bd', 'request_id': 'req-543990f0-0313-4022-bb29-20aa2dfd1425'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:58.171701 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3902/7778] 10.222.0.83 () {58 vars in 1230 bytes} [Mon Aug 29 16:16:57 2022] DELETE /identity/v3/domains/97e64f3516c84f1ea04ca45927a390bd => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:16:58.175976 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a93695-a3f7-430a-9b3a-6b0c1d7a0a96 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:58.177425 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-75a93695-a3f7-430a-9b3a-6b0c1d7a0a96 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:58.186635 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:UPDATE=2,keystone:DELETE=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:58.190658 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a93695-a3f7-430a-9b3a-6b0c1d7a0a96 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:58.249907 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36e2b7-9a2f-4ec8-a4ae-3b68445fc87b tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:58.250570 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36e2b7-9a2f-4ec8-a4ae-3b68445fc87b tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:58.250849 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36e2b7-9a2f-4ec8-a4ae-3b68445fc87b tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:58.251170 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36e2b7-9a2f-4ec8-a4ae-3b68445fc87b tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/domains/1ccea34746a9479780ef0eb9d0e73fbb/groups/f1d3d8e445af4a00883baa633b48793d/roles/f297da3b657d40cbbe1df4bbdb2207eb` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:58.253300 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36e2b7-9a2f-4ec8-a4ae-3b68445fc87b tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=1ccea34746a9479780ef0eb9d0e73fbb, group_id=f1d3d8e445af4a00883baa633b48793d, role_id=f297da3b657d40cbbe1df4bbdb2207eb)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:58.256012 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36e2b7-9a2f-4ec8-a4ae-3b68445fc87b tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:58.261165 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-da36e2b7-9a2f-4ec8-a4ae-3b68445fc87b tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invalidating the token cache because role f297da3b657d40cbbe1df4bbdb2207eb was removed from group f1d3d8e445af4a00883baa633b48793d on domain 1ccea34746a9479780ef0eb9d0e73fbb. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:16:58.261451 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-da36e2b7-9a2f-4ec8-a4ae-3b68445fc87b tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:58.262087 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-da36e2b7-9a2f-4ec8-a4ae-3b68445fc87b tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:58.276180 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3877/7779] 10.222.0.83 () {58 vars in 1467 bytes} [Mon Aug 29 16:16:58 2022] DELETE /identity/v3/domains/1ccea34746a9479780ef0eb9d0e73fbb/groups/f1d3d8e445af4a00883baa633b48793d/roles/f297da3b657d40cbbe1df4bbdb2207eb => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:16:58.281098 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543990f0-0313-4022-bb29-20aa2dfd1425 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:58.282523 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-543990f0-0313-4022-bb29-20aa2dfd1425 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:58.294836 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543990f0-0313-4022-bb29-20aa2dfd1425 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:58.351342 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583344b-e1aa-4e70-a00f-eb17979a3501 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:58.351992 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583344b-e1aa-4e70-a00f-eb17979a3501 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:58.352276 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583344b-e1aa-4e70-a00f-eb17979a3501 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:58.352554 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583344b-e1aa-4e70-a00f-eb17979a3501 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/groups/f1d3d8e445af4a00883baa633b48793d/users/3d3b52897b3644cc98eaa16221a3ef96` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:58.354201 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d583344b-e1aa-4e70-a00f-eb17979a3501 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=f1d3d8e445af4a00883baa633b48793d, user_id=3d3b52897b3644cc98eaa16221a3ef96)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:58.356168 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d583344b-e1aa-4e70-a00f-eb17979a3501 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:58.363917 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d583344b-e1aa-4e70-a00f-eb17979a3501 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '3d3b52897b3644cc98eaa16221a3ef96'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:58.377185 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3903/7780] 10.222.0.83 () {58 vars in 1344 bytes} [Mon Aug 29 16:16:58 2022] DELETE /identity/v3/groups/f1d3d8e445af4a00883baa633b48793d/users/3d3b52897b3644cc98eaa16221a3ef96 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:16:58.381377 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36e2b7-9a2f-4ec8-a4ae-3b68445fc87b tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:58.382822 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-da36e2b7-9a2f-4ec8-a4ae-3b68445fc87b tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:58.395910 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36e2b7-9a2f-4ec8-a4ae-3b68445fc87b tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:58.452966 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993b571-6700-435e-9ac4-0644dd6c6cc4 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:58.453614 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993b571-6700-435e-9ac4-0644dd6c6cc4 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:58.453904 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993b571-6700-435e-9ac4-0644dd6c6cc4 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:58.454186 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993b571-6700-435e-9ac4-0644dd6c6cc4 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/groups/f1d3d8e445af4a00883baa633b48793d` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:58.455418 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0993b571-6700-435e-9ac4-0644dd6c6cc4 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorizing `identity:delete_group(group_id=f1d3d8e445af4a00883baa633b48793d)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:58.457344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0993b571-6700-435e-9ac4-0644dd6c6cc4 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:58.500692 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3878/7781] 10.222.0.83 () {58 vars in 1227 bytes} [Mon Aug 29 16:16:58 2022] DELETE /identity/v3/groups/f1d3d8e445af4a00883baa633b48793d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:16:58.504938 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583344b-e1aa-4e70-a00f-eb17979a3501 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:58.516433 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583344b-e1aa-4e70-a00f-eb17979a3501 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:58.555737 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:58.578772 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddeb95d-ebea-49a1-8639-24dbcc05fb4d tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:58.579749 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddeb95d-ebea-49a1-8639-24dbcc05fb4d tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:58.580037 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddeb95d-ebea-49a1-8639-24dbcc05fb4d tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:58.580313 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddeb95d-ebea-49a1-8639-24dbcc05fb4d tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/roles/f297da3b657d40cbbe1df4bbdb2207eb` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:58.581737 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddeb95d-ebea-49a1-8639-24dbcc05fb4d tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f297da3b657d40cbbe1df4bbdb2207eb)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:58.583381 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddeb95d-ebea-49a1-8639-24dbcc05fb4d tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:58.617819 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9ddeb95d-ebea-49a1-8639-24dbcc05fb4d tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invalidating the token cache because role f297da3b657d40cbbe1df4bbdb2207eb has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:16:58.618109 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9ddeb95d-ebea-49a1-8639-24dbcc05fb4d tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:58.618801 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9ddeb95d-ebea-49a1-8639-24dbcc05fb4d tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:58.620632 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3904/7782] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:16:58 2022] DELETE /identity/v3/roles/f297da3b657d40cbbe1df4bbdb2207eb => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:16:58.626481 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993b571-6700-435e-9ac4-0644dd6c6cc4 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:58.628785 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0993b571-6700-435e-9ac4-0644dd6c6cc4 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:58.642252 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993b571-6700-435e-9ac4-0644dd6c6cc4 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:58.691808 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:58.702208 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67b6c4-2ba8-4564-8b2b-2234c62948b7 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:58.702857 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67b6c4-2ba8-4564-8b2b-2234c62948b7 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:58.703227 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67b6c4-2ba8-4564-8b2b-2234c62948b7 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:58.703453 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67b6c4-2ba8-4564-8b2b-2234c62948b7 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/domains/1ccea34746a9479780ef0eb9d0e73fbb` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:58.704724 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67b6c4-2ba8-4564-8b2b-2234c62948b7 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=1ccea34746a9479780ef0eb9d0e73fbb)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:58.706368 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67b6c4-2ba8-4564-8b2b-2234c62948b7 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:58.728746 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4c67b6c4-2ba8-4564-8b2b-2234c62948b7 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '1ccea34746a9479780ef0eb9d0e73fbb'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:58.729471 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4c67b6c4-2ba8-4564-8b2b-2234c62948b7 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '1ccea34746a9479780ef0eb9d0e73fbb'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:58.755794 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4c67b6c4-2ba8-4564-8b2b-2234c62948b7 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '1ccea34746a9479780ef0eb9d0e73fbb'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:58.756431 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4c67b6c4-2ba8-4564-8b2b-2234c62948b7 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '1ccea34746a9479780ef0eb9d0e73fbb'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:58.759167 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3879/7783] 10.222.0.83 () {60 vars in 1249 bytes} [Mon Aug 29 16:16:58 2022] PATCH /identity/v3/domains/1ccea34746a9479780ef0eb9d0e73fbb => generated 277 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:16:58.763943 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddeb95d-ebea-49a1-8639-24dbcc05fb4d tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:58.774484 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddeb95d-ebea-49a1-8639-24dbcc05fb4d tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:58.830605 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce6250-f79d-4c8d-95ac-6735c9254a88 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:58.831259 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce6250-f79d-4c8d-95ac-6735c9254a88 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:58.831543 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce6250-f79d-4c8d-95ac-6735c9254a88 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:58.831818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce6250-f79d-4c8d-95ac-6735c9254a88 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/domains/1ccea34746a9479780ef0eb9d0e73fbb` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:58.842753 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce6250-f79d-4c8d-95ac-6735c9254a88 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=1ccea34746a9479780ef0eb9d0e73fbb)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:58.844485 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce6250-f79d-4c8d-95ac-6735c9254a88 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:58.871404 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b1ce6250-f79d-4c8d-95ac-6735c9254a88 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '1ccea34746a9479780ef0eb9d0e73fbb'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:58.882951 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b1ce6250-f79d-4c8d-95ac-6735c9254a88 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '1ccea34746a9479780ef0eb9d0e73fbb'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:58.923914 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b1ce6250-f79d-4c8d-95ac-6735c9254a88 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ccea34746a9479780ef0eb9d0e73fbb', 'request_id': 'req-b1ce6250-f79d-4c8d-95ac-6735c9254a88'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:58.930184 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b1ce6250-f79d-4c8d-95ac-6735c9254a88 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ccea34746a9479780ef0eb9d0e73fbb', 'request_id': 'req-b1ce6250-f79d-4c8d-95ac-6735c9254a88'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:58.940959 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b1ce6250-f79d-4c8d-95ac-6735c9254a88 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ccea34746a9479780ef0eb9d0e73fbb', 'request_id': 'req-b1ce6250-f79d-4c8d-95ac-6735c9254a88'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:58.954380 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b1ce6250-f79d-4c8d-95ac-6735c9254a88 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] The token cache is being invalidate because project 1ccea34746a9479780ef0eb9d0e73fbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:16:58.954606 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b1ce6250-f79d-4c8d-95ac-6735c9254a88 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:58.955301 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b1ce6250-f79d-4c8d-95ac-6735c9254a88 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:58.957450 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:58.964415 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b1ce6250-f79d-4c8d-95ac-6735c9254a88 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '1ccea34746a9479780ef0eb9d0e73fbb', 'request_id': 'req-b1ce6250-f79d-4c8d-95ac-6735c9254a88'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:58.965200 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b1ce6250-f79d-4c8d-95ac-6735c9254a88 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '1ccea34746a9479780ef0eb9d0e73fbb', 'request_id': 'req-b1ce6250-f79d-4c8d-95ac-6735c9254a88'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:58.965857 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b1ce6250-f79d-4c8d-95ac-6735c9254a88 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '1ccea34746a9479780ef0eb9d0e73fbb', 'request_id': 'req-b1ce6250-f79d-4c8d-95ac-6735c9254a88'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:58.974983 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3905/7784] 10.222.0.83 () {58 vars in 1230 bytes} [Mon Aug 29 16:16:58 2022] DELETE /identity/v3/domains/1ccea34746a9479780ef0eb9d0e73fbb => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:16:58.979339 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67b6c4-2ba8-4564-8b2b-2234c62948b7 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:58.980822 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4c67b6c4-2ba8-4564-8b2b-2234c62948b7 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:58.993754 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67b6c4-2ba8-4564-8b2b-2234c62948b7 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:59.053450 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc3d36d-1389-4875-833e-c4b8860c732b tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:59.054405 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc3d36d-1389-4875-833e-c4b8860c732b tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:59.054689 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc3d36d-1389-4875-833e-c4b8860c732b tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:59.054967 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc3d36d-1389-4875-833e-c4b8860c732b tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/domains/9978f198b64747f5b36c91c036c9bd1d/users/3d3b52897b3644cc98eaa16221a3ef96/roles/3fe83ec2a1354c5aae46cdcce5e5e46d` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:59.057265 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc3d36d-1389-4875-833e-c4b8860c732b tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=9978f198b64747f5b36c91c036c9bd1d, user_id=3d3b52897b3644cc98eaa16221a3ef96, role_id=3fe83ec2a1354c5aae46cdcce5e5e46d)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:59.060756 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc3d36d-1389-4875-833e-c4b8860c732b tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:59.068069 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3dc3d36d-1389-4875-833e-c4b8860c732b tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invalidating the token cache because role 3fe83ec2a1354c5aae46cdcce5e5e46d was removed from user 3d3b52897b3644cc98eaa16221a3ef96 on domain 9978f198b64747f5b36c91c036c9bd1d. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:16:59.068368 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3dc3d36d-1389-4875-833e-c4b8860c732b tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:59.069088 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3dc3d36d-1389-4875-833e-c4b8860c732b tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:59.082924 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3880/7785] 10.222.0.83 () {58 vars in 1464 bytes} [Mon Aug 29 16:16:58 2022] DELETE /identity/v3/domains/9978f198b64747f5b36c91c036c9bd1d/users/3d3b52897b3644cc98eaa16221a3ef96/roles/3fe83ec2a1354c5aae46cdcce5e5e46d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:16:59.087474 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce6250-f79d-4c8d-95ac-6735c9254a88 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:59.089081 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b1ce6250-f79d-4c8d-95ac-6735c9254a88 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:59.101871 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce6250-f79d-4c8d-95ac-6735c9254a88 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:59.166099 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c0dbd-bda3-47c1-9000-9e5c2bcdbbd6 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:59.166733 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c0dbd-bda3-47c1-9000-9e5c2bcdbbd6 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:59.167012 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c0dbd-bda3-47c1-9000-9e5c2bcdbbd6 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:59.167309 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c0dbd-bda3-47c1-9000-9e5c2bcdbbd6 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/roles/3fe83ec2a1354c5aae46cdcce5e5e46d` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:59.169246 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1c0dbd-bda3-47c1-9000-9e5c2bcdbbd6 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3fe83ec2a1354c5aae46cdcce5e5e46d)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:59.171396 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1c0dbd-bda3-47c1-9000-9e5c2bcdbbd6 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:59.211512 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-bb1c0dbd-bda3-47c1-9000-9e5c2bcdbbd6 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invalidating the token cache because role 3fe83ec2a1354c5aae46cdcce5e5e46d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:16:59.211755 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-bb1c0dbd-bda3-47c1-9000-9e5c2bcdbbd6 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:59.212419 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-bb1c0dbd-bda3-47c1-9000-9e5c2bcdbbd6 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:59.214303 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3906/7786] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:16:59 2022] DELETE /identity/v3/roles/3fe83ec2a1354c5aae46cdcce5e5e46d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:16:59.218807 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc3d36d-1389-4875-833e-c4b8860c732b tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:59.220327 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3dc3d36d-1389-4875-833e-c4b8860c732b tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:59.233466 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc3d36d-1389-4875-833e-c4b8860c732b tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:59.291460 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8fc50f-c73f-436d-ba19-a92f67d9ecc0 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:59.292100 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8fc50f-c73f-436d-ba19-a92f67d9ecc0 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:59.292384 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8fc50f-c73f-436d-ba19-a92f67d9ecc0 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:59.292661 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8fc50f-c73f-436d-ba19-a92f67d9ecc0 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/domains/9978f198b64747f5b36c91c036c9bd1d` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:59.294590 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8fc50f-c73f-436d-ba19-a92f67d9ecc0 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=9978f198b64747f5b36c91c036c9bd1d)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:59.296233 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8fc50f-c73f-436d-ba19-a92f67d9ecc0 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:59.317322 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ed8fc50f-c73f-436d-ba19-a92f67d9ecc0 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '9978f198b64747f5b36c91c036c9bd1d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:59.318030 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ed8fc50f-c73f-436d-ba19-a92f67d9ecc0 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '9978f198b64747f5b36c91c036c9bd1d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:59.344048 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ed8fc50f-c73f-436d-ba19-a92f67d9ecc0 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '9978f198b64747f5b36c91c036c9bd1d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:59.344689 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ed8fc50f-c73f-436d-ba19-a92f67d9ecc0 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '9978f198b64747f5b36c91c036c9bd1d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:59.347138 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3881/7787] 10.222.0.83 () {60 vars in 1249 bytes} [Mon Aug 29 16:16:59 2022] PATCH /identity/v3/domains/9978f198b64747f5b36c91c036c9bd1d => generated 278 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:16:59.351191 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c0dbd-bda3-47c1-9000-9e5c2bcdbbd6 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:59.352573 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-bb1c0dbd-bda3-47c1-9000-9e5c2bcdbbd6 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:59.365720 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c0dbd-bda3-47c1-9000-9e5c2bcdbbd6 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:59.421974 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20190ed9-d9c6-4283-b017-caaf5ec707ed tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:59.422608 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20190ed9-d9c6-4283-b017-caaf5ec707ed tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:59.422892 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20190ed9-d9c6-4283-b017-caaf5ec707ed tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:59.423211 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20190ed9-d9c6-4283-b017-caaf5ec707ed tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/domains/9978f198b64747f5b36c91c036c9bd1d` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:59.433799 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20190ed9-d9c6-4283-b017-caaf5ec707ed tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=9978f198b64747f5b36c91c036c9bd1d)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:59.435477 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20190ed9-d9c6-4283-b017-caaf5ec707ed tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:59.457154 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-20190ed9-d9c6-4283-b017-caaf5ec707ed tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '9978f198b64747f5b36c91c036c9bd1d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:59.467624 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-20190ed9-d9c6-4283-b017-caaf5ec707ed tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '9978f198b64747f5b36c91c036c9bd1d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:59.477689 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=7,keystone:SELECT=93 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:59.507316 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-20190ed9-d9c6-4283-b017-caaf5ec707ed tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9978f198b64747f5b36c91c036c9bd1d', 'request_id': 'req-20190ed9-d9c6-4283-b017-caaf5ec707ed'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:59.513005 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-20190ed9-d9c6-4283-b017-caaf5ec707ed tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9978f198b64747f5b36c91c036c9bd1d', 'request_id': 'req-20190ed9-d9c6-4283-b017-caaf5ec707ed'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:59.519495 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-20190ed9-d9c6-4283-b017-caaf5ec707ed tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9978f198b64747f5b36c91c036c9bd1d', 'request_id': 'req-20190ed9-d9c6-4283-b017-caaf5ec707ed'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:59.532794 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-20190ed9-d9c6-4283-b017-caaf5ec707ed tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] The token cache is being invalidate because project 9978f198b64747f5b36c91c036c9bd1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:16:59.533085 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-20190ed9-d9c6-4283-b017-caaf5ec707ed tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:59.533740 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-20190ed9-d9c6-4283-b017-caaf5ec707ed tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:59.541236 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-20190ed9-d9c6-4283-b017-caaf5ec707ed tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '9978f198b64747f5b36c91c036c9bd1d', 'request_id': 'req-20190ed9-d9c6-4283-b017-caaf5ec707ed'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:59.541888 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-20190ed9-d9c6-4283-b017-caaf5ec707ed tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '9978f198b64747f5b36c91c036c9bd1d', 'request_id': 'req-20190ed9-d9c6-4283-b017-caaf5ec707ed'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:59.542867 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-20190ed9-d9c6-4283-b017-caaf5ec707ed tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '9978f198b64747f5b36c91c036c9bd1d', 'request_id': 'req-20190ed9-d9c6-4283-b017-caaf5ec707ed'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:59.551364 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3907/7788] 10.222.0.83 () {58 vars in 1230 bytes} [Mon Aug 29 16:16:59 2022] DELETE /identity/v3/domains/9978f198b64747f5b36c91c036c9bd1d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:16:59.558194 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8fc50f-c73f-436d-ba19-a92f67d9ecc0 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:59.559781 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ed8fc50f-c73f-436d-ba19-a92f67d9ecc0 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:59.572755 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8fc50f-c73f-436d-ba19-a92f67d9ecc0 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:59.582293 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:UPDATE=2,keystone:DELETE=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:59.633257 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee136cd-edfc-4f6d-a082-9925812ac21d tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:59.633873 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee136cd-edfc-4f6d-a082-9925812ac21d tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:59.634154 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee136cd-edfc-4f6d-a082-9925812ac21d tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:59.634435 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee136cd-edfc-4f6d-a082-9925812ac21d tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:59.635108 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee136cd-edfc-4f6d-a082-9925812ac21d tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:59.636721 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee136cd-edfc-4f6d-a082-9925812ac21d tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:59.647254 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3882/7789] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:16:59.651510 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20190ed9-d9c6-4283-b017-caaf5ec707ed tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:59.652911 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-20190ed9-d9c6-4283-b017-caaf5ec707ed tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:59.665915 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20190ed9-d9c6-4283-b017-caaf5ec707ed tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:59.671120 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f8d0b-7d81-486c-959e-dbe46abba0e2 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:59.671779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f8d0b-7d81-486c-959e-dbe46abba0e2 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:59.672059 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f8d0b-7d81-486c-959e-dbe46abba0e2 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:59.672332 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f8d0b-7d81-486c-959e-dbe46abba0e2 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/projects/8d7d0d65366f4d63ace6bdd9943a7da0/users/6faee13a96fc41e49181c30c81eb00c7/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:59.674267 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f8d0b-7d81-486c-959e-dbe46abba0e2 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorizing `identity:create_grant(project_id=8d7d0d65366f4d63ace6bdd9943a7da0, user_id=6faee13a96fc41e49181c30c81eb00c7, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:59.676958 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f8d0b-7d81-486c-959e-dbe46abba0e2 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:59.690447 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3908/7790] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:16:59 2022] PUT /identity/v3/projects/8d7d0d65366f4d63ace6bdd9943a7da0/users/6faee13a96fc41e49181c30c81eb00c7/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:16:59.694585 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee136cd-edfc-4f6d-a082-9925812ac21d tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:59.705731 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee136cd-edfc-4f6d-a082-9925812ac21d tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:59.766829 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb1cb7-4c92-4dd5-83e2-7773d538a38d tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:59.767381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb1cb7-4c92-4dd5-83e2-7773d538a38d tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:59.767663 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb1cb7-4c92-4dd5-83e2-7773d538a38d tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:59.767936 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb1cb7-4c92-4dd5-83e2-7773d538a38d tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:59.768506 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb1cb7-4c92-4dd5-83e2-7773d538a38d tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:59.769577 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb1cb7-4c92-4dd5-83e2-7773d538a38d tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:59.812331 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3883/7791] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 16:16:59 2022] GET /identity/v3/auth/projects => generated 826 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:16:59.816652 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f8d0b-7d81-486c-959e-dbe46abba0e2 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:59.827776 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f8d0b-7d81-486c-959e-dbe46abba0e2 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:59.832427 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc57fc5-5662-4472-88bc-24c675f01141 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:59.833077 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc57fc5-5662-4472-88bc-24c675f01141 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:59.833357 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc57fc5-5662-4472-88bc-24c675f01141 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:59.833628 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc57fc5-5662-4472-88bc-24c675f01141 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/projects/8d7d0d65366f4d63ace6bdd9943a7da0/users/6faee13a96fc41e49181c30c81eb00c7/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:59.835546 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc57fc5-5662-4472-88bc-24c675f01141 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=8d7d0d65366f4d63ace6bdd9943a7da0, user_id=6faee13a96fc41e49181c30c81eb00c7, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:59.838207 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc57fc5-5662-4472-88bc-24c675f01141 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:59.844498 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4bc57fc5-5662-4472-88bc-24c675f01141 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invalidating the token cache because role 4bb2bbb7bb544610877949fc933504d2 was removed from user 6faee13a96fc41e49181c30c81eb00c7 on project 8d7d0d65366f4d63ace6bdd9943a7da0. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:16:59.844787 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4bc57fc5-5662-4472-88bc-24c675f01141 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:59.845481 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4bc57fc5-5662-4472-88bc-24c675f01141 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:16:59.858364 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3909/7792] 10.222.0.83 () {58 vars in 1467 bytes} [Mon Aug 29 16:16:59 2022] DELETE /identity/v3/projects/8d7d0d65366f4d63ace6bdd9943a7da0/users/6faee13a96fc41e49181c30c81eb00c7/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:16:59.863732 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb1cb7-4c92-4dd5-83e2-7773d538a38d tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:59.865503 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2ceb1cb7-4c92-4dd5-83e2-7773d538a38d tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:59.878498 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb1cb7-4c92-4dd5-83e2-7773d538a38d tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:59.936059 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834aade9-e298-4b8b-9cf1-20ac640a2a91 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:59.936666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834aade9-e298-4b8b-9cf1-20ac640a2a91 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:59.936947 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834aade9-e298-4b8b-9cf1-20ac640a2a91 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:59.937219 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834aade9-e298-4b8b-9cf1-20ac640a2a91 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:59.937844 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834aade9-e298-4b8b-9cf1-20ac640a2a91 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:59.939786 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834aade9-e298-4b8b-9cf1-20ac640a2a91 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:59.957186 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:59.966727 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3884/7793] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:16:59 2022] POST /identity/v3/users => generated 321 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:16:59.967935 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc57fc5-5662-4472-88bc-24c675f01141 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:59.978376 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc57fc5-5662-4472-88bc-24c675f01141 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:59.982968 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607bd1a6-279c-460e-affb-fbbc40682fcc tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:59.983594 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bd1a6-279c-460e-affb-fbbc40682fcc tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:59.983870 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bd1a6-279c-460e-affb-fbbc40682fcc tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:59.984138 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bd1a6-279c-460e-affb-fbbc40682fcc tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:59.984756 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607bd1a6-279c-460e-affb-fbbc40682fcc tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:59.986651 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607bd1a6-279c-460e-affb-fbbc40682fcc tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:00.016144 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3910/7794] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:16:59 2022] POST /identity/v3/projects => generated 362 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:17:00.020408 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834aade9-e298-4b8b-9cf1-20ac640a2a91 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:00.031233 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834aade9-e298-4b8b-9cf1-20ac640a2a91 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:00.089319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947061f-5bbf-4953-9973-4f189ba4a8d6 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:00.089972 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947061f-5bbf-4953-9973-4f189ba4a8d6 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:00.090260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947061f-5bbf-4953-9973-4f189ba4a8d6 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:00.090544 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947061f-5bbf-4953-9973-4f189ba4a8d6 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:00.091603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947061f-5bbf-4953-9973-4f189ba4a8d6 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:00.093518 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947061f-5bbf-4953-9973-4f189ba4a8d6 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:00.120314 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3885/7795] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:17:00 2022] POST /identity/v3/projects => generated 363 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:17:00.124855 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607bd1a6-279c-460e-affb-fbbc40682fcc tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:00.135261 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607bd1a6-279c-460e-affb-fbbc40682fcc tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:00.192859 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21661d9-81be-4e11-9f07-d42e1421d3c0 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:00.193467 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21661d9-81be-4e11-9f07-d42e1421d3c0 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:00.193747 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21661d9-81be-4e11-9f07-d42e1421d3c0 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:00.194021 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21661d9-81be-4e11-9f07-d42e1421d3c0 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:00.194674 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21661d9-81be-4e11-9f07-d42e1421d3c0 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:00.196291 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21661d9-81be-4e11-9f07-d42e1421d3c0 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:00.212695 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3911/7796] 10.222.0.83 () {60 vars in 1143 bytes} [Mon Aug 29 16:17:00 2022] POST /identity/v3/roles => generated 239 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:17:00.216946 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947061f-5bbf-4953-9973-4f189ba4a8d6 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:00.227275 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947061f-5bbf-4953-9973-4f189ba4a8d6 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:00.232405 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915e7e2-7113-4a3b-92a9-fb64b3d35fa0 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:00.233238 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915e7e2-7113-4a3b-92a9-fb64b3d35fa0 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:00.233518 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915e7e2-7113-4a3b-92a9-fb64b3d35fa0 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:00.233795 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915e7e2-7113-4a3b-92a9-fb64b3d35fa0 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/projects/0344e4ad62e14cd7afc6760188f27f3b/users/78a223e251454ab29a98368a7acc57a0/roles/9661e60c247c41bda0618b8393649441` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:00.250700 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c915e7e2-7113-4a3b-92a9-fb64b3d35fa0 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0344e4ad62e14cd7afc6760188f27f3b, user_id=78a223e251454ab29a98368a7acc57a0, role_id=9661e60c247c41bda0618b8393649441)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:00.253400 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c915e7e2-7113-4a3b-92a9-fb64b3d35fa0 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:00.267408 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3886/7797] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:17:00 2022] PUT /identity/v3/projects/0344e4ad62e14cd7afc6760188f27f3b/users/78a223e251454ab29a98368a7acc57a0/roles/9661e60c247c41bda0618b8393649441 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:00.271786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21661d9-81be-4e11-9f07-d42e1421d3c0 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:00.282111 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21661d9-81be-4e11-9f07-d42e1421d3c0 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:00.308624 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:00.346972 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627acd8f-6ec1-4d5c-80b4-cbb2a6c1ff60 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:00.347701 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627acd8f-6ec1-4d5c-80b4-cbb2a6c1ff60 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:00.347985 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627acd8f-6ec1-4d5c-80b4-cbb2a6c1ff60 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:00.348263 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627acd8f-6ec1-4d5c-80b4-cbb2a6c1ff60 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/projects/09f2533e0fc64df8b769c8c0fbb027f7/users/78a223e251454ab29a98368a7acc57a0/roles/9661e60c247c41bda0618b8393649441` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:00.350571 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627acd8f-6ec1-4d5c-80b4-cbb2a6c1ff60 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorizing `identity:create_grant(project_id=09f2533e0fc64df8b769c8c0fbb027f7, user_id=78a223e251454ab29a98368a7acc57a0, role_id=9661e60c247c41bda0618b8393649441)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:00.353311 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627acd8f-6ec1-4d5c-80b4-cbb2a6c1ff60 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:00.367922 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3912/7798] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:17:00 2022] PUT /identity/v3/projects/09f2533e0fc64df8b769c8c0fbb027f7/users/78a223e251454ab29a98368a7acc57a0/roles/9661e60c247c41bda0618b8393649441 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:17:00.372534 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9cfd38-2565-468d-b66c-42e791729447 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:00.372808 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9cfd38-2565-468d-b66c-42e791729447 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:00.373043 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9cfd38-2565-468d-b66c-42e791729447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:00.399880 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-dd9cfd38-2565-468d-b66c-42e791729447 None None] MFA Rules not processed for user `78a223e251454ab29a98368a7acc57a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:00.401072 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-dd9cfd38-2565-468d-b66c-42e791729447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:00.404803 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3887/7799] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:00 2022] POST /identity/v3/auth/tokens => generated 334 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 16:17:00.409260 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97023dff-2444-42bb-9d5b-1c2113725bc5 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:00.409579 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97023dff-2444-42bb-9d5b-1c2113725bc5 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:00.409890 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97023dff-2444-42bb-9d5b-1c2113725bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:00.420992 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-97023dff-2444-42bb-9d5b-1c2113725bc5 None None] MFA Rules not processed for user `78a223e251454ab29a98368a7acc57a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:00.422109 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-97023dff-2444-42bb-9d5b-1c2113725bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:00.483325 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3913/7800] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:00 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Aug 29 16:17:00.487693 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9cfd38-2565-468d-b66c-42e791729447 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:00.551580 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9cfd38-2565-468d-b66c-42e791729447 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:00.556698 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a397d9e-de14-44ad-8a0f-f4afb8c204c7 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:00.557476 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a397d9e-de14-44ad-8a0f-f4afb8c204c7 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:00.557829 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a397d9e-de14-44ad-8a0f-f4afb8c204c7 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:00.558188 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a397d9e-de14-44ad-8a0f-f4afb8c204c7 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:00.566067 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a397d9e-de14-44ad-8a0f-f4afb8c204c7 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:00.568049 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a397d9e-de14-44ad-8a0f-f4afb8c204c7 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:00.584578 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3888/7801] 10.222.0.83 () {56 vars in 1308 bytes} [Mon Aug 29 16:17:00 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:00.589089 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133e5cc-2362-4ffb-ba09-5438100b928b None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:00.589544 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133e5cc-2362-4ffb-ba09-5438100b928b None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:00.589636 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133e5cc-2362-4ffb-ba09-5438100b928b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:00.601688 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-2133e5cc-2362-4ffb-ba09-5438100b928b None None] MFA Rules not processed for user `78a223e251454ab29a98368a7acc57a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:00.602838 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2133e5cc-2362-4ffb-ba09-5438100b928b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:00.664880 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3914/7802] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:00 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Aug 29 16:17:00.669551 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a397d9e-de14-44ad-8a0f-f4afb8c204c7 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:00.679784 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a397d9e-de14-44ad-8a0f-f4afb8c204c7 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:00.684775 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad07c52-0de1-41b8-9337-531207f1078f tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:00.685575 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad07c52-0de1-41b8-9337-531207f1078f tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:00.685859 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad07c52-0de1-41b8-9337-531207f1078f tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:00.686225 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad07c52-0de1-41b8-9337-531207f1078f tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/roles/9661e60c247c41bda0618b8393649441` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:00.687662 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad07c52-0de1-41b8-9337-531207f1078f tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorizing `identity:delete_role(role_id=9661e60c247c41bda0618b8393649441)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:00.689291 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad07c52-0de1-41b8-9337-531207f1078f tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:00.717896 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:00.729961 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-cad07c52-0de1-41b8-9337-531207f1078f tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invalidating the token cache because role 9661e60c247c41bda0618b8393649441 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:17:00.730254 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-cad07c52-0de1-41b8-9337-531207f1078f tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:00.730984 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-cad07c52-0de1-41b8-9337-531207f1078f tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:00.732895 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3889/7803] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:17:00 2022] DELETE /identity/v3/roles/9661e60c247c41bda0618b8393649441 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:00.737044 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2133e5cc-2362-4ffb-ba09-5438100b928b None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:00.749440 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2133e5cc-2362-4ffb-ba09-5438100b928b None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:00.805854 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be084142-a8d2-4d93-af18-eb78f181335b tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:00.806406 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be084142-a8d2-4d93-af18-eb78f181335b tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:00.806686 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be084142-a8d2-4d93-af18-eb78f181335b tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:00.806957 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be084142-a8d2-4d93-af18-eb78f181335b tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/projects/09f2533e0fc64df8b769c8c0fbb027f7` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:00.808157 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be084142-a8d2-4d93-af18-eb78f181335b tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorizing `identity:delete_project(project_id=09f2533e0fc64df8b769c8c0fbb027f7)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:00.810726 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be084142-a8d2-4d93-af18-eb78f181335b tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:00.818674 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:00.858499 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-be084142-a8d2-4d93-af18-eb78f181335b tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09f2533e0fc64df8b769c8c0fbb027f7', 'request_id': 'req-be084142-a8d2-4d93-af18-eb78f181335b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:00.863946 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-be084142-a8d2-4d93-af18-eb78f181335b tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09f2533e0fc64df8b769c8c0fbb027f7', 'request_id': 'req-be084142-a8d2-4d93-af18-eb78f181335b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:00.869939 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-be084142-a8d2-4d93-af18-eb78f181335b tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09f2533e0fc64df8b769c8c0fbb027f7', 'request_id': 'req-be084142-a8d2-4d93-af18-eb78f181335b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:00.883132 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-be084142-a8d2-4d93-af18-eb78f181335b tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] The token cache is being invalidate because project 09f2533e0fc64df8b769c8c0fbb027f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:17:00.883421 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-be084142-a8d2-4d93-af18-eb78f181335b tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:00.884053 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-be084142-a8d2-4d93-af18-eb78f181335b tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:00.885548 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3915/7804] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:17:00 2022] DELETE /identity/v3/projects/09f2533e0fc64df8b769c8c0fbb027f7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:00.890665 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad07c52-0de1-41b8-9337-531207f1078f tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:00.892187 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-cad07c52-0de1-41b8-9337-531207f1078f tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:00.906419 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad07c52-0de1-41b8-9337-531207f1078f tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:00.963428 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27d35d-c648-4c4d-ae3b-4a3e6b112cee tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:00.964059 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27d35d-c648-4c4d-ae3b-4a3e6b112cee tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:00.964339 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27d35d-c648-4c4d-ae3b-4a3e6b112cee tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:00.964613 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27d35d-c648-4c4d-ae3b-4a3e6b112cee tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/projects/09f2533e0fc64df8b769c8c0fbb027f7` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:00.971832 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d27d35d-c648-4c4d-ae3b-4a3e6b112cee tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorizing `identity:delete_project(project_id=09f2533e0fc64df8b769c8c0fbb027f7)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:00.973713 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d27d35d-c648-4c4d-ae3b-4a3e6b112cee tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:00.984712 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-6d27d35d-c648-4c4d-ae3b-4a3e6b112cee tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Could not find project: 09f2533e0fc64df8b769c8c0fbb027f7.: keystone.exception.ProjectNotFound: Could not find project: 09f2533e0fc64df8b769c8c0fbb027f7. Aug 29 16:17:00.984712 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:17:00.984712 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:17:00.984712 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:17:00.984712 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:17:00.984712 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:17:00.984712 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:17:00.984712 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:17:00.984712 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:17:00.984712 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:17:00.984712 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:17:00.984712 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:17:00.984712 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Aug 29 16:17:00.984712 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Aug 29 16:17:00.985801 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:17:00.985801 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:17:00.985801 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Aug 29 16:17:00.985801 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Aug 29 16:17:00.985801 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 16:17:00.985801 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 16:17:00.985801 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 16:17:00.985801 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 16:17:00.985801 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 09f2533e0fc64df8b769c8c0fbb027f7. Aug 29 16:17:00.985801 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:17:00.985801 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3890/7805] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:17:00 2022] DELETE /identity/v3/projects/09f2533e0fc64df8b769c8c0fbb027f7 => generated 113 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 16:17:00.990181 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be084142-a8d2-4d93-af18-eb78f181335b tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:00.991661 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-be084142-a8d2-4d93-af18-eb78f181335b tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:01.005432 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be084142-a8d2-4d93-af18-eb78f181335b tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:01.010146 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0925f5ee-fbab-4733-8715-78020fb0611a tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:01.010777 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925f5ee-fbab-4733-8715-78020fb0611a tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:01.011086 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925f5ee-fbab-4733-8715-78020fb0611a tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:01.011366 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925f5ee-fbab-4733-8715-78020fb0611a tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/projects/0344e4ad62e14cd7afc6760188f27f3b` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:01.013138 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0925f5ee-fbab-4733-8715-78020fb0611a tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0344e4ad62e14cd7afc6760188f27f3b)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:01.015214 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0925f5ee-fbab-4733-8715-78020fb0611a tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:01.061915 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0925f5ee-fbab-4733-8715-78020fb0611a tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0344e4ad62e14cd7afc6760188f27f3b', 'request_id': 'req-0925f5ee-fbab-4733-8715-78020fb0611a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:01.067390 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0925f5ee-fbab-4733-8715-78020fb0611a tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0344e4ad62e14cd7afc6760188f27f3b', 'request_id': 'req-0925f5ee-fbab-4733-8715-78020fb0611a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:01.073553 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0925f5ee-fbab-4733-8715-78020fb0611a tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0344e4ad62e14cd7afc6760188f27f3b', 'request_id': 'req-0925f5ee-fbab-4733-8715-78020fb0611a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:01.087046 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0925f5ee-fbab-4733-8715-78020fb0611a tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] The token cache is being invalidate because project 0344e4ad62e14cd7afc6760188f27f3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:17:01.087339 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0925f5ee-fbab-4733-8715-78020fb0611a tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:01.087982 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0925f5ee-fbab-4733-8715-78020fb0611a tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:01.089699 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3916/7806] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:17:00 2022] DELETE /identity/v3/projects/0344e4ad62e14cd7afc6760188f27f3b => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:01.093695 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27d35d-c648-4c4d-ae3b-4a3e6b112cee tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:01.095467 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6d27d35d-c648-4c4d-ae3b-4a3e6b112cee tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:01.109024 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27d35d-c648-4c4d-ae3b-4a3e6b112cee tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:01.165500 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3ad42-e56c-447b-b61e-e51ba190e00c tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:01.166136 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3ad42-e56c-447b-b61e-e51ba190e00c tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:01.166430 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3ad42-e56c-447b-b61e-e51ba190e00c tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:01.166711 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3ad42-e56c-447b-b61e-e51ba190e00c tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/users/78a223e251454ab29a98368a7acc57a0` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:01.167888 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf3ad42-e56c-447b-b61e-e51ba190e00c tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorizing `identity:delete_user(user_id=78a223e251454ab29a98368a7acc57a0)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:01.170610 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf3ad42-e56c-447b-b61e-e51ba190e00c tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:01.215612 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9bf3ad42-e56c-447b-b61e-e51ba190e00c tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78a223e251454ab29a98368a7acc57a0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:01.216386 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9bf3ad42-e56c-447b-b61e-e51ba190e00c tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78a223e251454ab29a98368a7acc57a0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:01.228812 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9bf3ad42-e56c-447b-b61e-e51ba190e00c tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78a223e251454ab29a98368a7acc57a0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:01.237004 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9bf3ad42-e56c-447b-b61e-e51ba190e00c tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78a223e251454ab29a98368a7acc57a0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:01.244065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9bf3ad42-e56c-447b-b61e-e51ba190e00c tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78a223e251454ab29a98368a7acc57a0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:01.250665 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3891/7807] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:17:01 2022] DELETE /identity/v3/users/78a223e251454ab29a98368a7acc57a0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:01.255781 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0925f5ee-fbab-4733-8715-78020fb0611a tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:01.265727 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0925f5ee-fbab-4733-8715-78020fb0611a tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:01.323070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b860435-e24b-494f-b013-37279cef1833 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:01.323625 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b860435-e24b-494f-b013-37279cef1833 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:01.323908 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b860435-e24b-494f-b013-37279cef1833 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:01.324185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b860435-e24b-494f-b013-37279cef1833 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/domains/6fb3d5ddc939415fa378f480513cf81f` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:01.331640 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b860435-e24b-494f-b013-37279cef1833 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 16:17:01.336595 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-4b860435-e24b-494f-b013-37279cef1833 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Could not find domain: 6fb3d5ddc939415fa378f480513cf81f.: keystone.exception.DomainNotFound: Could not find domain: 6fb3d5ddc939415fa378f480513cf81f. Aug 29 16:17:01.336595 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:17:01.336595 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 29 16:17:01.336595 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 29 16:17:01.336595 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 16:17:01.336595 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 16:17:01.336595 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 16:17:01.336595 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 16:17:01.336595 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 6fb3d5ddc939415fa378f480513cf81f. Aug 29 16:17:01.336595 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:17:01.336595 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 16:17:01.336595 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:17:01.336595 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:17:01.336595 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:17:01.336595 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:17:01.336595 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:17:01.337762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:17:01.337762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:17:01.337762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:17:01.337762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:17:01.337762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:17:01.337762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:17:01.337762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:17:01.337762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 29 16:17:01.337762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 29 16:17:01.337762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 16:17:01.337762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 16:17:01.337762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 16:17:01.337762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 16:17:01.337762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:17:01.337762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:17:01.337762 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 16:17:01.338919 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 16:17:01.338919 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 16:17:01.338919 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 16:17:01.338919 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 16:17:01.338919 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 16:17:01.338919 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 16:17:01.338919 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 16:17:01.338919 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 16:17:01.338919 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 16:17:01.338919 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 16:17:01.338919 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 16:17:01.338919 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 16:17:01.338919 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 16:17:01.338919 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 29 16:17:01.338919 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 16:17:01.338919 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 6fb3d5ddc939415fa378f480513cf81f. Aug 29 16:17:01.338919 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:17:01.340147 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3917/7808] 10.222.0.83 () {60 vars in 1249 bytes} [Mon Aug 29 16:17:01 2022] PATCH /identity/v3/domains/6fb3d5ddc939415fa378f480513cf81f => generated 112 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 16:17:01.344526 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3ad42-e56c-447b-b61e-e51ba190e00c tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:01.345952 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9bf3ad42-e56c-447b-b61e-e51ba190e00c tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:01.359214 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3ad42-e56c-447b-b61e-e51ba190e00c tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:01.363872 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86575ba7-9715-49f9-ba6f-3ea91813da42 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:01.364550 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86575ba7-9715-49f9-ba6f-3ea91813da42 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:01.364832 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86575ba7-9715-49f9-ba6f-3ea91813da42 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:01.365109 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86575ba7-9715-49f9-ba6f-3ea91813da42 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/domains/97e64f3516c84f1ea04ca45927a390bd` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:01.367531 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:01.374483 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86575ba7-9715-49f9-ba6f-3ea91813da42 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 16:17:01.380354 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-86575ba7-9715-49f9-ba6f-3ea91813da42 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Could not find domain: 97e64f3516c84f1ea04ca45927a390bd.: keystone.exception.DomainNotFound: Could not find domain: 97e64f3516c84f1ea04ca45927a390bd. Aug 29 16:17:01.380354 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:17:01.380354 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 29 16:17:01.380354 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 29 16:17:01.380354 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 16:17:01.380354 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 16:17:01.380354 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 16:17:01.380354 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 16:17:01.380354 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 97e64f3516c84f1ea04ca45927a390bd. Aug 29 16:17:01.380354 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:17:01.380354 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 16:17:01.380354 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:17:01.380354 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:17:01.380354 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:17:01.380354 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:17:01.380354 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:17:01.381807 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:17:01.381807 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:17:01.381807 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:17:01.381807 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:17:01.381807 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:17:01.381807 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:17:01.381807 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:17:01.381807 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 29 16:17:01.381807 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 29 16:17:01.381807 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 16:17:01.381807 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 16:17:01.381807 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 16:17:01.381807 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 16:17:01.381807 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:17:01.381807 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:17:01.381807 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 16:17:01.383060 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 16:17:01.383060 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 16:17:01.383060 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 16:17:01.383060 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 16:17:01.383060 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 16:17:01.383060 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 16:17:01.383060 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 16:17:01.383060 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 16:17:01.383060 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 16:17:01.383060 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 16:17:01.383060 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 16:17:01.383060 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 16:17:01.383060 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 16:17:01.383060 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 29 16:17:01.383060 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 16:17:01.383060 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 97e64f3516c84f1ea04ca45927a390bd. Aug 29 16:17:01.383060 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:17:01.384029 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3892/7809] 10.222.0.83 () {60 vars in 1249 bytes} [Mon Aug 29 16:17:01 2022] PATCH /identity/v3/domains/97e64f3516c84f1ea04ca45927a390bd => generated 112 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 16:17:01.386723 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b860435-e24b-494f-b013-37279cef1833 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:01.396784 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b860435-e24b-494f-b013-37279cef1833 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:01.401466 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64aa32a-59c6-49b8-8ba0-10e1eb06bd65 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:01.402089 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64aa32a-59c6-49b8-8ba0-10e1eb06bd65 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:01.402371 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64aa32a-59c6-49b8-8ba0-10e1eb06bd65 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:01.402646 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64aa32a-59c6-49b8-8ba0-10e1eb06bd65 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/domains/1ccea34746a9479780ef0eb9d0e73fbb` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:01.410259 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64aa32a-59c6-49b8-8ba0-10e1eb06bd65 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 16:17:01.415962 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-a64aa32a-59c6-49b8-8ba0-10e1eb06bd65 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Could not find domain: 1ccea34746a9479780ef0eb9d0e73fbb.: keystone.exception.DomainNotFound: Could not find domain: 1ccea34746a9479780ef0eb9d0e73fbb. Aug 29 16:17:01.415962 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:17:01.415962 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 29 16:17:01.415962 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 29 16:17:01.415962 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 16:17:01.415962 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 16:17:01.415962 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 16:17:01.415962 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 16:17:01.415962 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 1ccea34746a9479780ef0eb9d0e73fbb. Aug 29 16:17:01.415962 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:17:01.415962 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 16:17:01.415962 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:17:01.415962 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:17:01.415962 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:17:01.415962 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:17:01.415962 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:17:01.417116 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:17:01.417116 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:17:01.417116 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:17:01.417116 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:17:01.417116 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:17:01.417116 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:17:01.417116 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:17:01.417116 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 29 16:17:01.417116 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 29 16:17:01.417116 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 16:17:01.417116 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 16:17:01.417116 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 16:17:01.417116 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 16:17:01.417116 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:17:01.417116 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:17:01.417116 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 16:17:01.418001 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 16:17:01.418001 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 16:17:01.418001 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 16:17:01.418001 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 16:17:01.418001 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 16:17:01.418001 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 16:17:01.418001 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 16:17:01.418001 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 16:17:01.418001 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 16:17:01.418001 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 16:17:01.418001 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 16:17:01.418001 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 16:17:01.418001 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 16:17:01.418001 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 29 16:17:01.418001 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 16:17:01.418001 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 1ccea34746a9479780ef0eb9d0e73fbb. Aug 29 16:17:01.418001 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:17:01.419571 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3918/7810] 10.222.0.83 () {60 vars in 1249 bytes} [Mon Aug 29 16:17:01 2022] PATCH /identity/v3/domains/1ccea34746a9479780ef0eb9d0e73fbb => generated 112 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 16:17:01.421744 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86575ba7-9715-49f9-ba6f-3ea91813da42 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:01.433362 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86575ba7-9715-49f9-ba6f-3ea91813da42 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:01.439129 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c94878-137e-4968-8fd5-ebf110a7c485 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6faee13a96fc41e49181c30c81eb00c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc94baa192e493cb36e44df71f33256', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:01.439773 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c94878-137e-4968-8fd5-ebf110a7c485 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:01.440057 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c94878-137e-4968-8fd5-ebf110a7c485 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:01.440336 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c94878-137e-4968-8fd5-ebf110a7c485 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] PATH_INFO: `/v3/domains/9978f198b64747f5b36c91c036c9bd1d` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:01.447726 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c94878-137e-4968-8fd5-ebf110a7c485 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 16:17:01.453027 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-25c94878-137e-4968-8fd5-ebf110a7c485 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Could not find domain: 9978f198b64747f5b36c91c036c9bd1d.: keystone.exception.DomainNotFound: Could not find domain: 9978f198b64747f5b36c91c036c9bd1d. Aug 29 16:17:01.453027 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:17:01.453027 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 29 16:17:01.453027 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 29 16:17:01.453027 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 16:17:01.453027 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 16:17:01.453027 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 16:17:01.453027 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 16:17:01.453027 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 9978f198b64747f5b36c91c036c9bd1d. Aug 29 16:17:01.453027 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:17:01.453027 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 16:17:01.453027 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:17:01.453027 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:17:01.453027 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:17:01.453027 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:17:01.453027 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:17:01.454202 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:17:01.454202 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:17:01.454202 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:17:01.454202 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:17:01.454202 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:17:01.454202 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:17:01.454202 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:17:01.454202 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 29 16:17:01.454202 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 29 16:17:01.454202 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 16:17:01.454202 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 16:17:01.454202 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 16:17:01.454202 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 16:17:01.454202 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:17:01.454202 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:17:01.454202 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 16:17:01.455176 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 16:17:01.455176 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 16:17:01.455176 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 16:17:01.455176 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 16:17:01.455176 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 16:17:01.455176 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 16:17:01.455176 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 16:17:01.455176 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 16:17:01.455176 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 16:17:01.455176 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 16:17:01.455176 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 16:17:01.455176 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 16:17:01.455176 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 16:17:01.455176 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 29 16:17:01.455176 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 16:17:01.455176 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 9978f198b64747f5b36c91c036c9bd1d. Aug 29 16:17:01.455176 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:17:01.456137 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3893/7811] 10.222.0.83 () {60 vars in 1249 bytes} [Mon Aug 29 16:17:01 2022] PATCH /identity/v3/domains/9978f198b64747f5b36c91c036c9bd1d => generated 112 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 16:17:01.458280 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64aa32a-59c6-49b8-8ba0-10e1eb06bd65 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:01.460031 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a64aa32a-59c6-49b8-8ba0-10e1eb06bd65 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:01.472188 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:01.532961 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64aa32a-59c6-49b8-8ba0-10e1eb06bd65 tempest-TokensV3TestJSON-1727555928 tempest-TokensV3TestJSON-1727555928-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:01.537660 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce05ee-c40c-41fa-bf8e-11357927e657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:01.538295 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce05ee-c40c-41fa-bf8e-11357927e657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:01.538578 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce05ee-c40c-41fa-bf8e-11357927e657 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:01.538856 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce05ee-c40c-41fa-bf8e-11357927e657 admin admin] PATH_INFO: `/v3/users/ebf9e4b8e913437692f834e19a3ec940` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:01.540051 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce05ee-c40c-41fa-bf8e-11357927e657 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebf9e4b8e913437692f834e19a3ec940)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:01.542002 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce05ee-c40c-41fa-bf8e-11357927e657 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:01.592354 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8dce05ee-c40c-41fa-bf8e-11357927e657 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebf9e4b8e913437692f834e19a3ec940'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:01.592968 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8dce05ee-c40c-41fa-bf8e-11357927e657 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebf9e4b8e913437692f834e19a3ec940'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:01.600866 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8dce05ee-c40c-41fa-bf8e-11357927e657 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebf9e4b8e913437692f834e19a3ec940'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:01.608600 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8dce05ee-c40c-41fa-bf8e-11357927e657 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebf9e4b8e913437692f834e19a3ec940'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:01.609275 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8dce05ee-c40c-41fa-bf8e-11357927e657 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebf9e4b8e913437692f834e19a3ec940'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:01.626592 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3919/7812] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:17:01 2022] DELETE /identity/v3/users/ebf9e4b8e913437692f834e19a3ec940 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:17:01.631127 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91484f-613a-491a-bdf6-60c4452df357 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:01.631414 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91484f-613a-491a-bdf6-60c4452df357 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:01.631733 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91484f-613a-491a-bdf6-60c4452df357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:01.650810 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-4a91484f-613a-491a-bdf6-60c4452df357 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:01.652047 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4a91484f-613a-491a-bdf6-60c4452df357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:01.714022 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3894/7813] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:17:01.724305 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce05ee-c40c-41fa-bf8e-11357927e657 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:01.725712 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8dce05ee-c40c-41fa-bf8e-11357927e657 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:01.789247 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce05ee-c40c-41fa-bf8e-11357927e657 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:01.792955 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3214c9-9b5b-496a-81c8-7ce7fc49073b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:01.793568 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3214c9-9b5b-496a-81c8-7ce7fc49073b service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:01.794462 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3214c9-9b5b-496a-81c8-7ce7fc49073b service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:01.794825 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3214c9-9b5b-496a-81c8-7ce7fc49073b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:01.803821 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3214c9-9b5b-496a-81c8-7ce7fc49073b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:01.805507 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3214c9-9b5b-496a-81c8-7ce7fc49073b service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:01.815433 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3920/7814] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:17:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:17:02.094676 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a91484f-613a-491a-bdf6-60c4452df357 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:02.096206 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4a91484f-613a-491a-bdf6-60c4452df357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:02.109577 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a91484f-613a-491a-bdf6-60c4452df357 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:02.114390 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b23c9-be5b-4757-b9d2-edc30cfa670d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:02.115071 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b23c9-be5b-4757-b9d2-edc30cfa670d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:02.115356 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b23c9-be5b-4757-b9d2-edc30cfa670d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:02.115630 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b23c9-be5b-4757-b9d2-edc30cfa670d admin admin] PATH_INFO: `/v3/projects/8d7d0d65366f4d63ace6bdd9943a7da0` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:02.116762 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0b23c9-be5b-4757-b9d2-edc30cfa670d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d7d0d65366f4d63ace6bdd9943a7da0)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:02.118716 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0b23c9-be5b-4757-b9d2-edc30cfa670d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:02.168310 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7f0b23c9-be5b-4757-b9d2-edc30cfa670d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d7d0d65366f4d63ace6bdd9943a7da0', 'request_id': 'req-7f0b23c9-be5b-4757-b9d2-edc30cfa670d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:02.174965 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7f0b23c9-be5b-4757-b9d2-edc30cfa670d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d7d0d65366f4d63ace6bdd9943a7da0', 'request_id': 'req-7f0b23c9-be5b-4757-b9d2-edc30cfa670d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:02.182615 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7f0b23c9-be5b-4757-b9d2-edc30cfa670d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d7d0d65366f4d63ace6bdd9943a7da0', 'request_id': 'req-7f0b23c9-be5b-4757-b9d2-edc30cfa670d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:02.194758 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7f0b23c9-be5b-4757-b9d2-edc30cfa670d admin admin] The token cache is being invalidate because project 8d7d0d65366f4d63ace6bdd9943a7da0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:17:02.195076 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7f0b23c9-be5b-4757-b9d2-edc30cfa670d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:02.195722 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7f0b23c9-be5b-4757-b9d2-edc30cfa670d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:02.197222 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3895/7815] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:17:02 2022] DELETE /identity/v3/projects/8d7d0d65366f4d63ace6bdd9943a7da0 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:02.201374 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3214c9-9b5b-496a-81c8-7ce7fc49073b service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:02.211777 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3214c9-9b5b-496a-81c8-7ce7fc49073b service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:02.241523 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:02.273861 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1d995-a36f-4ae2-8e5e-6bdc84f98f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:02.274605 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1d995-a36f-4ae2-8e5e-6bdc84f98f17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:02.274879 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1d995-a36f-4ae2-8e5e-6bdc84f98f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:02.275196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1d995-a36f-4ae2-8e5e-6bdc84f98f17 admin admin] PATH_INFO: `/v3/users/6faee13a96fc41e49181c30c81eb00c7` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:02.276348 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e1d995-a36f-4ae2-8e5e-6bdc84f98f17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6faee13a96fc41e49181c30c81eb00c7)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:02.279930 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e1d995-a36f-4ae2-8e5e-6bdc84f98f17 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:02.330507 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-08e1d995-a36f-4ae2-8e5e-6bdc84f98f17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6faee13a96fc41e49181c30c81eb00c7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:02.331195 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-08e1d995-a36f-4ae2-8e5e-6bdc84f98f17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6faee13a96fc41e49181c30c81eb00c7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:02.339533 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-08e1d995-a36f-4ae2-8e5e-6bdc84f98f17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6faee13a96fc41e49181c30c81eb00c7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:02.347201 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-08e1d995-a36f-4ae2-8e5e-6bdc84f98f17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6faee13a96fc41e49181c30c81eb00c7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:02.347850 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-08e1d995-a36f-4ae2-8e5e-6bdc84f98f17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6faee13a96fc41e49181c30c81eb00c7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:02.365356 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3921/7816] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:17:02 2022] DELETE /identity/v3/users/6faee13a96fc41e49181c30c81eb00c7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:17:02.657290 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b23c9-be5b-4757-b9d2-edc30cfa670d admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:02.658797 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7f0b23c9-be5b-4757-b9d2-edc30cfa670d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:02.673778 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b23c9-be5b-4757-b9d2-edc30cfa670d admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:02.741592 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c20f6c-5043-4658-96a5-16ac2b4be315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:02.742238 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c20f6c-5043-4658-96a5-16ac2b4be315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:02.742520 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c20f6c-5043-4658-96a5-16ac2b4be315 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:02.742823 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c20f6c-5043-4658-96a5-16ac2b4be315 admin admin] PATH_INFO: `/v3/projects/6fc94baa192e493cb36e44df71f33256` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:02.744018 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c20f6c-5043-4658-96a5-16ac2b4be315 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fc94baa192e493cb36e44df71f33256)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:02.745957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c20f6c-5043-4658-96a5-16ac2b4be315 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:02.763651 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:02.795723 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c0c20f6c-5043-4658-96a5-16ac2b4be315 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fc94baa192e493cb36e44df71f33256', 'request_id': 'req-c0c20f6c-5043-4658-96a5-16ac2b4be315'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:02.801330 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c0c20f6c-5043-4658-96a5-16ac2b4be315 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fc94baa192e493cb36e44df71f33256', 'request_id': 'req-c0c20f6c-5043-4658-96a5-16ac2b4be315'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:02.808834 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c0c20f6c-5043-4658-96a5-16ac2b4be315 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fc94baa192e493cb36e44df71f33256', 'request_id': 'req-c0c20f6c-5043-4658-96a5-16ac2b4be315'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:02.820627 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c0c20f6c-5043-4658-96a5-16ac2b4be315 admin admin] The token cache is being invalidate because project 6fc94baa192e493cb36e44df71f33256 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:17:02.820918 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c0c20f6c-5043-4658-96a5-16ac2b4be315 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:02.821557 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c0c20f6c-5043-4658-96a5-16ac2b4be315 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:02.823116 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3896/7817] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:17:02 2022] DELETE /identity/v3/projects/6fc94baa192e493cb36e44df71f33256 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:02.827382 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1d995-a36f-4ae2-8e5e-6bdc84f98f17 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:02.828820 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-08e1d995-a36f-4ae2-8e5e-6bdc84f98f17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:02.842172 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1d995-a36f-4ae2-8e5e-6bdc84f98f17 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:02.899685 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e9c2a-3357-450e-bec6-61bcd346be36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:02.900323 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e9c2a-3357-450e-bec6-61bcd346be36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:02.900605 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e9c2a-3357-450e-bec6-61bcd346be36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:02.900930 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e9c2a-3357-450e-bec6-61bcd346be36 admin admin] PATH_INFO: `/v3/users/3d3b52897b3644cc98eaa16221a3ef96` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:02.902058 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e9c2a-3357-450e-bec6-61bcd346be36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d3b52897b3644cc98eaa16221a3ef96)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:02.904164 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e9c2a-3357-450e-bec6-61bcd346be36 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:02.953099 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fd3e9c2a-3357-450e-bec6-61bcd346be36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d3b52897b3644cc98eaa16221a3ef96'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:02.953775 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fd3e9c2a-3357-450e-bec6-61bcd346be36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d3b52897b3644cc98eaa16221a3ef96'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:02.957478 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:02.963341 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fd3e9c2a-3357-450e-bec6-61bcd346be36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d3b52897b3644cc98eaa16221a3ef96'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:02.982209 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fd3e9c2a-3357-450e-bec6-61bcd346be36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d3b52897b3644cc98eaa16221a3ef96'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:02.982953 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fd3e9c2a-3357-450e-bec6-61bcd346be36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d3b52897b3644cc98eaa16221a3ef96'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:03.001120 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3922/7818] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:17:02 2022] DELETE /identity/v3/users/3d3b52897b3644cc98eaa16221a3ef96 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:17:03.280435 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c20f6c-5043-4658-96a5-16ac2b4be315 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:03.282025 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c0c20f6c-5043-4658-96a5-16ac2b4be315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:03.295579 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c20f6c-5043-4658-96a5-16ac2b4be315 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:03.354769 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44eea44-9937-46f7-a833-95b30d1cdc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:03.355439 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44eea44-9937-46f7-a833-95b30d1cdc25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:03.355719 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44eea44-9937-46f7-a833-95b30d1cdc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:03.355995 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44eea44-9937-46f7-a833-95b30d1cdc25 admin admin] PATH_INFO: `/v3/projects/fe94c7578ea644ecaef5e81be96caaa0` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:03.357770 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44eea44-9937-46f7-a833-95b30d1cdc25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe94c7578ea644ecaef5e81be96caaa0)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:03.359746 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44eea44-9937-46f7-a833-95b30d1cdc25 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:03.408746 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a44eea44-9937-46f7-a833-95b30d1cdc25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe94c7578ea644ecaef5e81be96caaa0', 'request_id': 'req-a44eea44-9937-46f7-a833-95b30d1cdc25'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:03.414343 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a44eea44-9937-46f7-a833-95b30d1cdc25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe94c7578ea644ecaef5e81be96caaa0', 'request_id': 'req-a44eea44-9937-46f7-a833-95b30d1cdc25'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:03.422935 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a44eea44-9937-46f7-a833-95b30d1cdc25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe94c7578ea644ecaef5e81be96caaa0', 'request_id': 'req-a44eea44-9937-46f7-a833-95b30d1cdc25'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:03.434307 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a44eea44-9937-46f7-a833-95b30d1cdc25 admin admin] The token cache is being invalidate because project fe94c7578ea644ecaef5e81be96caaa0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:17:03.435198 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a44eea44-9937-46f7-a833-95b30d1cdc25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:03.436044 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a44eea44-9937-46f7-a833-95b30d1cdc25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:03.437401 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3897/7819] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:17:03 2022] DELETE /identity/v3/projects/fe94c7578ea644ecaef5e81be96caaa0 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:03.442304 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ec48e-c1a3-469a-bb6c-fc430ffdfd23 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:03.442599 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ec48e-c1a3-469a-bb6c-fc430ffdfd23 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:03.442881 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ec48e-c1a3-469a-bb6c-fc430ffdfd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:03.462211 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-b32ec48e-c1a3-469a-bb6c-fc430ffdfd23 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:03.463522 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b32ec48e-c1a3-469a-bb6c-fc430ffdfd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:03.522556 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3923/7820] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:17:03.530430 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df877392-8ca0-4a1e-8a95-ee0b2b09a920 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:03.530714 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df877392-8ca0-4a1e-8a95-ee0b2b09a920 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:03.530990 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df877392-8ca0-4a1e-8a95-ee0b2b09a920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:03.551570 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-df877392-8ca0-4a1e-8a95-ee0b2b09a920 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:03.552778 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-df877392-8ca0-4a1e-8a95-ee0b2b09a920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:03.563441 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3898/7821] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:17:03.567724 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32ec48e-c1a3-469a-bb6c-fc430ffdfd23 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:03.578316 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32ec48e-c1a3-469a-bb6c-fc430ffdfd23 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:03.582981 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c7754-95b0-4b69-aae6-ae078d4c32f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:03.583613 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c7754-95b0-4b69-aae6-ae078d4c32f2 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:03.583896 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c7754-95b0-4b69-aae6-ae078d4c32f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:03.584171 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c7754-95b0-4b69-aae6-ae078d4c32f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:03.584824 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c7754-95b0-4b69-aae6-ae078d4c32f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:17:03.585128 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c7754-95b0-4b69-aae6-ae078d4c32f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:03.586730 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c7754-95b0-4b69-aae6-ae078d4c32f2 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:03.598982 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3924/7822] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:17:03.603545 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df877392-8ca0-4a1e-8a95-ee0b2b09a920 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:03.613252 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df877392-8ca0-4a1e-8a95-ee0b2b09a920 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:03.617996 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff62eb-664e-4c75-a752-8fd4b491fc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:03.618758 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff62eb-664e-4c75-a752-8fd4b491fc50 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:03.619067 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff62eb-664e-4c75-a752-8fd4b491fc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:03.619345 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff62eb-664e-4c75-a752-8fd4b491fc50 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:03.619986 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff62eb-664e-4c75-a752-8fd4b491fc50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:03.621987 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff62eb-664e-4c75-a752-8fd4b491fc50 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:03.650264 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3899/7823] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:17:03 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:17:03.655280 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c7754-95b0-4b69-aae6-ae078d4c32f2 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:03.665451 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c7754-95b0-4b69-aae6-ae078d4c32f2 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:03.724124 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac5aa6-8ab5-4eb7-b11f-4601078b3cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:03.724737 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac5aa6-8ab5-4eb7-b11f-4601078b3cf7 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:03.725013 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac5aa6-8ab5-4eb7-b11f-4601078b3cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:03.725282 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac5aa6-8ab5-4eb7-b11f-4601078b3cf7 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:03.725901 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ac5aa6-8ab5-4eb7-b11f-4601078b3cf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:03.727847 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ac5aa6-8ab5-4eb7-b11f-4601078b3cf7 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:03.751887 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3925/7824] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:17:03 2022] POST /identity/v3/users => generated 285 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:17:03.756091 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff62eb-664e-4c75-a752-8fd4b491fc50 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:03.764136 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:03.768384 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff62eb-664e-4c75-a752-8fd4b491fc50 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:03.774696 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b965a-ab93-4cd7-b400-e33952c92192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:03.775371 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b965a-ab93-4cd7-b400-e33952c92192 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:03.775912 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b965a-ab93-4cd7-b400-e33952c92192 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:03.776507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b965a-ab93-4cd7-b400-e33952c92192 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:03.777632 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b965a-ab93-4cd7-b400-e33952c92192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:03.779374 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b965a-ab93-4cd7-b400-e33952c92192 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:03.790374 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3900/7825] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:17:03.794695 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac5aa6-8ab5-4eb7-b11f-4601078b3cf7 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:03.805058 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac5aa6-8ab5-4eb7-b11f-4601078b3cf7 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:03.810268 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e748d90-88f8-479a-a30f-733abce485ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:03.810929 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e748d90-88f8-479a-a30f-733abce485ff admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:03.811241 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e748d90-88f8-479a-a30f-733abce485ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:03.811549 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e748d90-88f8-479a-a30f-733abce485ff admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:03.812155 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e748d90-88f8-479a-a30f-733abce485ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:03.813781 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e748d90-88f8-479a-a30f-733abce485ff admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:03.829187 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3926/7826] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:17:03.830140 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b965a-ab93-4cd7-b400-e33952c92192 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:03.840316 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b965a-ab93-4cd7-b400-e33952c92192 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:03.846112 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac81b5e-0f1d-4bf5-ba69-aded1b0520ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:03.847166 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac81b5e-0f1d-4bf5-ba69-aded1b0520ef admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:03.847444 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac81b5e-0f1d-4bf5-ba69-aded1b0520ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:03.847815 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac81b5e-0f1d-4bf5-ba69-aded1b0520ef admin admin] PATH_INFO: `/v3/projects/ccd9c5a5dc0a4a27b0d93f2af4e64974/users/6f4f5930398640d68b078899672e2a8e/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:03.876881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac81b5e-0f1d-4bf5-ba69-aded1b0520ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccd9c5a5dc0a4a27b0d93f2af4e64974, user_id=6f4f5930398640d68b078899672e2a8e, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:03.880488 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac81b5e-0f1d-4bf5-ba69-aded1b0520ef admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:03.898426 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3901/7827] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:17:03 2022] PUT /identity/v3/projects/ccd9c5a5dc0a4a27b0d93f2af4e64974/users/6f4f5930398640d68b078899672e2a8e/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:17:03.911007 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06686d78-f033-4732-a526-4c683f3df52d None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:03.911324 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06686d78-f033-4732-a526-4c683f3df52d None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:03.911595 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06686d78-f033-4732-a526-4c683f3df52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:03.951642 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-06686d78-f033-4732-a526-4c683f3df52d None None] MFA Rules not processed for user `6f4f5930398640d68b078899672e2a8e`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:03.952840 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-06686d78-f033-4732-a526-4c683f3df52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:03.976685 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:04.018848 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3927/7828] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:17:04.023524 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac81b5e-0f1d-4bf5-ba69-aded1b0520ef admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:04.086726 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac81b5e-0f1d-4bf5-ba69-aded1b0520ef admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:04.091435 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461679e-2bc4-4a4e-9688-de1dc7c0b8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:04.092035 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461679e-2bc4-4a4e-9688-de1dc7c0b8e3 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:04.092313 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461679e-2bc4-4a4e-9688-de1dc7c0b8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:04.092585 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461679e-2bc4-4a4e-9688-de1dc7c0b8e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:04.093203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f461679e-2bc4-4a4e-9688-de1dc7c0b8e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:04.095134 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f461679e-2bc4-4a4e-9688-de1dc7c0b8e3 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:04.121686 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3902/7829] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:17:04 2022] POST /identity/v3/projects => generated 369 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:17:04.126141 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06686d78-f033-4732-a526-4c683f3df52d None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:04.137185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06686d78-f033-4732-a526-4c683f3df52d None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:04.196745 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aae1c0-dfb3-4b66-895b-0d2dafd62f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:04.197358 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aae1c0-dfb3-4b66-895b-0d2dafd62f71 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:04.197640 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aae1c0-dfb3-4b66-895b-0d2dafd62f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:04.197912 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aae1c0-dfb3-4b66-895b-0d2dafd62f71 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:04.198548 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aae1c0-dfb3-4b66-895b-0d2dafd62f71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:04.200522 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aae1c0-dfb3-4b66-895b-0d2dafd62f71 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:04.222479 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3928/7830] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:17:04 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:17:04.226813 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461679e-2bc4-4a4e-9688-de1dc7c0b8e3 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:04.238183 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461679e-2bc4-4a4e-9688-de1dc7c0b8e3 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:04.242881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd93f1e-78ef-445d-b232-8462cb7d1723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:04.243511 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd93f1e-78ef-445d-b232-8462cb7d1723 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:04.243792 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd93f1e-78ef-445d-b232-8462cb7d1723 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:04.244081 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd93f1e-78ef-445d-b232-8462cb7d1723 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:04.244781 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd93f1e-78ef-445d-b232-8462cb7d1723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:04.246377 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd93f1e-78ef-445d-b232-8462cb7d1723 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:04.258039 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3903/7831] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:17:04.261933 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aae1c0-dfb3-4b66-895b-0d2dafd62f71 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:04.272056 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aae1c0-dfb3-4b66-895b-0d2dafd62f71 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:04.277003 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c038db-4c51-40b7-9124-dfacc3de7606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:04.277662 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c038db-4c51-40b7-9124-dfacc3de7606 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:04.277943 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c038db-4c51-40b7-9124-dfacc3de7606 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:04.278431 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c038db-4c51-40b7-9124-dfacc3de7606 admin admin] PATH_INFO: `/v3/projects/11b52eae19c04aec95a51dfb0a7895da/users/590f6c0e16e44826bcd83ac06b12ca63/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:04.293005 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c038db-4c51-40b7-9124-dfacc3de7606 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11b52eae19c04aec95a51dfb0a7895da, user_id=590f6c0e16e44826bcd83ac06b12ca63, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:04.296395 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c038db-4c51-40b7-9124-dfacc3de7606 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:04.309193 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3929/7832] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:17:04 2022] PUT /identity/v3/projects/11b52eae19c04aec95a51dfb0a7895da/users/590f6c0e16e44826bcd83ac06b12ca63/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:17:04.313921 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd93f1e-78ef-445d-b232-8462cb7d1723 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:04.323967 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd93f1e-78ef-445d-b232-8462cb7d1723 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:04.382061 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad5823c-8acf-40af-8d85-5925a8c3fae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:04.382604 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad5823c-8acf-40af-8d85-5925a8c3fae7 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:04.382876 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad5823c-8acf-40af-8d85-5925a8c3fae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:04.383188 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad5823c-8acf-40af-8d85-5925a8c3fae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:04.383835 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad5823c-8acf-40af-8d85-5925a8c3fae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:04.385439 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad5823c-8acf-40af-8d85-5925a8c3fae7 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:04.396422 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3904/7833] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:17:04.400531 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c038db-4c51-40b7-9124-dfacc3de7606 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:04.411690 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c038db-4c51-40b7-9124-dfacc3de7606 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:04.416340 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ff64f-5c33-4953-a4e8-6445917d1a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:04.416992 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ff64f-5c33-4953-a4e8-6445917d1a5d admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:04.417271 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ff64f-5c33-4953-a4e8-6445917d1a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:04.417544 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ff64f-5c33-4953-a4e8-6445917d1a5d admin admin] PATH_INFO: `/v3/projects/11b52eae19c04aec95a51dfb0a7895da/users/590f6c0e16e44826bcd83ac06b12ca63/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:04.419765 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ff64f-5c33-4953-a4e8-6445917d1a5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=11b52eae19c04aec95a51dfb0a7895da, user_id=590f6c0e16e44826bcd83ac06b12ca63, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:04.422404 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ff64f-5c33-4953-a4e8-6445917d1a5d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:04.432857 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3930/7834] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:17:04 2022] PUT /identity/v3/projects/11b52eae19c04aec95a51dfb0a7895da/users/590f6c0e16e44826bcd83ac06b12ca63/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:04.443214 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eef038-48d0-458d-bb2b-dcca000d1097 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:04.443496 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eef038-48d0-458d-bb2b-dcca000d1097 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:04.443770 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eef038-48d0-458d-bb2b-dcca000d1097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:04.472616 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-94eef038-48d0-458d-bb2b-dcca000d1097 None None] MFA Rules not processed for user `590f6c0e16e44826bcd83ac06b12ca63`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:04.473812 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-94eef038-48d0-458d-bb2b-dcca000d1097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:04.502333 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:04.542763 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3905/7835] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:04 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:17:04.548165 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ff64f-5c33-4953-a4e8-6445917d1a5d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:04.561210 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ff64f-5c33-4953-a4e8-6445917d1a5d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:04.565920 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c10f43-66c7-4175-af62-6b373777d070 tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '590f6c0e16e44826bcd83ac06b12ca63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b52eae19c04aec95a51dfb0a7895da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:04.566541 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c10f43-66c7-4175-af62-6b373777d070 tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:04.566825 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c10f43-66c7-4175-af62-6b373777d070 tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:04.567137 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c10f43-66c7-4175-af62-6b373777d070 tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:04.567775 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c10f43-66c7-4175-af62-6b373777d070 tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:04.569621 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c10f43-66c7-4175-af62-6b373777d070 tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:04.603140 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3931/7836] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:17:04 2022] POST /identity/v3/projects => generated 358 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:17:04.607424 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eef038-48d0-458d-bb2b-dcca000d1097 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:04.616900 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eef038-48d0-458d-bb2b-dcca000d1097 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:04.677492 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520541ae-c9bb-4343-92d7-18c17a83f196 tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '590f6c0e16e44826bcd83ac06b12ca63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b52eae19c04aec95a51dfb0a7895da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:04.678020 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520541ae-c9bb-4343-92d7-18c17a83f196 tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:04.678310 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520541ae-c9bb-4343-92d7-18c17a83f196 tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:04.678586 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520541ae-c9bb-4343-92d7-18c17a83f196 tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:04.679639 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520541ae-c9bb-4343-92d7-18c17a83f196 tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:04.681723 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520541ae-c9bb-4343-92d7-18c17a83f196 tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:04.713525 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3906/7837] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:17:04 2022] POST /identity/v3/users => generated 371 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:17:04.717900 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c10f43-66c7-4175-af62-6b373777d070 tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:04.728524 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c10f43-66c7-4175-af62-6b373777d070 tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:04.733235 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2104e15-c60b-437f-8922-90f9dc22d096 tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '590f6c0e16e44826bcd83ac06b12ca63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b52eae19c04aec95a51dfb0a7895da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:04.733843 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2104e15-c60b-437f-8922-90f9dc22d096 tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:04.734123 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2104e15-c60b-437f-8922-90f9dc22d096 tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:04.734397 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2104e15-c60b-437f-8922-90f9dc22d096 tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:04.735135 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2104e15-c60b-437f-8922-90f9dc22d096 tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:17:04.735440 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2104e15-c60b-437f-8922-90f9dc22d096 tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:04.737467 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2104e15-c60b-437f-8922-90f9dc22d096 tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:04.764900 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3932/7838] 10.222.0.83 () {58 vars in 1157 bytes} [Mon Aug 29 16:17:04 2022] GET /identity/v3/users?domain_id=default => generated 6589 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:17:04.769318 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520541ae-c9bb-4343-92d7-18c17a83f196 tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:04.780527 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520541ae-c9bb-4343-92d7-18c17a83f196 tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:04.785368 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1f1c5-bab2-4d7c-bc65-cedd99b611b6 tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '590f6c0e16e44826bcd83ac06b12ca63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b52eae19c04aec95a51dfb0a7895da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:04.785997 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1f1c5-bab2-4d7c-bc65-cedd99b611b6 tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:04.786280 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1f1c5-bab2-4d7c-bc65-cedd99b611b6 tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:04.786559 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1f1c5-bab2-4d7c-bc65-cedd99b611b6 tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] PATH_INFO: `/v3/users/c39a617db6ed4aa2981e71168e2e7e54` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:04.801548 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da1f1c5-bab2-4d7c-bc65-cedd99b611b6 tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] RBAC: Authorizing `identity:update_user(user_id=c39a617db6ed4aa2981e71168e2e7e54)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:04.803698 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da1f1c5-bab2-4d7c-bc65-cedd99b611b6 tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:04.834349 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5da1f1c5-bab2-4d7c-bc65-cedd99b611b6 tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c39a617db6ed4aa2981e71168e2e7e54'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:04.842659 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5da1f1c5-bab2-4d7c-bc65-cedd99b611b6 tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] Invalidating the token cache because user c39a617db6ed4aa2981e71168e2e7e54 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:17:04.842972 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5da1f1c5-bab2-4d7c-bc65-cedd99b611b6 tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:04.843709 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5da1f1c5-bab2-4d7c-bc65-cedd99b611b6 tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:04.845604 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3907/7839] 10.222.0.83 () {60 vars in 1244 bytes} [Mon Aug 29 16:17:04 2022] PATCH /identity/v3/users/c39a617db6ed4aa2981e71168e2e7e54 => generated 485 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:17:04.850275 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a2eb1-b49d-4bbe-9ce8-0a703443bccd None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:04.850736 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a2eb1-b49d-4bbe-9ce8-0a703443bccd None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:04.850830 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a2eb1-b49d-4bbe-9ce8-0a703443bccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:04.866819 n-d-836830-13 devstack@keystone.service[82149]: WARNING keystone.auth.plugins.core [None req-868a2eb1-b49d-4bbe-9ce8-0a703443bccd None None] User is disabled: c39a617db6ed4aa2981e71168e2e7e54: AssertionError: User is disabled: c39a617db6ed4aa2981e71168e2e7e54 Aug 29 16:17:04.874155 n-d-836830-13 devstack@keystone.service[82149]: WARNING keystone.server.flask.application [None req-868a2eb1-b49d-4bbe-9ce8-0a703443bccd None None] Authorization failed. The request you have made requires authentication. from 10.222.0.83: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 29 16:17:04.875554 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3933/7840] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:04 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 26 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 29 16:17:04.879734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1f1c5-bab2-4d7c-bc65-cedd99b611b6 tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:04.881313 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5da1f1c5-bab2-4d7c-bc65-cedd99b611b6 tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:04.894676 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1f1c5-bab2-4d7c-bc65-cedd99b611b6 tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:04.899431 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee190a-1e10-44f8-842a-66840f6a494a tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '590f6c0e16e44826bcd83ac06b12ca63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b52eae19c04aec95a51dfb0a7895da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:04.900063 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee190a-1e10-44f8-842a-66840f6a494a tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:04.900373 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee190a-1e10-44f8-842a-66840f6a494a tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:04.900614 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee190a-1e10-44f8-842a-66840f6a494a tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] PATH_INFO: `/v3/users/c39a617db6ed4aa2981e71168e2e7e54` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:04.914593 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ee190a-1e10-44f8-842a-66840f6a494a tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c39a617db6ed4aa2981e71168e2e7e54)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:04.916568 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ee190a-1e10-44f8-842a-66840f6a494a tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:04.968822 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-71ee190a-1e10-44f8-842a-66840f6a494a tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c39a617db6ed4aa2981e71168e2e7e54'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:04.969613 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-71ee190a-1e10-44f8-842a-66840f6a494a tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c39a617db6ed4aa2981e71168e2e7e54'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:04.977854 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:UPDATE=1,keystone:DELETE=9 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:04.984329 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-71ee190a-1e10-44f8-842a-66840f6a494a tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c39a617db6ed4aa2981e71168e2e7e54'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:04.995285 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-71ee190a-1e10-44f8-842a-66840f6a494a tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c39a617db6ed4aa2981e71168e2e7e54'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:05.004642 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-71ee190a-1e10-44f8-842a-66840f6a494a tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c39a617db6ed4aa2981e71168e2e7e54'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:05.010860 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3908/7841] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:17:04 2022] DELETE /identity/v3/users/c39a617db6ed4aa2981e71168e2e7e54 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:05.015877 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a2eb1-b49d-4bbe-9ce8-0a703443bccd None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:05.017755 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-868a2eb1-b49d-4bbe-9ce8-0a703443bccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:05.061058 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:05.089296 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a2eb1-b49d-4bbe-9ce8-0a703443bccd None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:05.094925 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f88552-8f7d-4c47-8963-f210fcc26c4c tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '590f6c0e16e44826bcd83ac06b12ca63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b52eae19c04aec95a51dfb0a7895da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:05.095655 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f88552-8f7d-4c47-8963-f210fcc26c4c tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:05.096286 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f88552-8f7d-4c47-8963-f210fcc26c4c tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:05.096629 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f88552-8f7d-4c47-8963-f210fcc26c4c tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] PATH_INFO: `/v3/projects/5b647d5078e14b898c7cd1a9518df9ea` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:05.097853 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f88552-8f7d-4c47-8963-f210fcc26c4c tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5b647d5078e14b898c7cd1a9518df9ea)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:05.099911 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f88552-8f7d-4c47-8963-f210fcc26c4c tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:05.147144 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b9f88552-8f7d-4c47-8963-f210fcc26c4c tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b647d5078e14b898c7cd1a9518df9ea', 'request_id': 'req-b9f88552-8f7d-4c47-8963-f210fcc26c4c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:05.152568 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b9f88552-8f7d-4c47-8963-f210fcc26c4c tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b647d5078e14b898c7cd1a9518df9ea', 'request_id': 'req-b9f88552-8f7d-4c47-8963-f210fcc26c4c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:05.159861 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b9f88552-8f7d-4c47-8963-f210fcc26c4c tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b647d5078e14b898c7cd1a9518df9ea', 'request_id': 'req-b9f88552-8f7d-4c47-8963-f210fcc26c4c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:05.172382 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b9f88552-8f7d-4c47-8963-f210fcc26c4c tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] The token cache is being invalidate because project 5b647d5078e14b898c7cd1a9518df9ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:17:05.172673 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b9f88552-8f7d-4c47-8963-f210fcc26c4c tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:05.173430 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b9f88552-8f7d-4c47-8963-f210fcc26c4c tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:05.175035 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3934/7842] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:17:05 2022] DELETE /identity/v3/projects/5b647d5078e14b898c7cd1a9518df9ea => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:17:05.180748 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee190a-1e10-44f8-842a-66840f6a494a tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:05.191111 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee190a-1e10-44f8-842a-66840f6a494a tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:05.248613 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefdf4fc-9dd7-4905-aeb7-f05e31a09a5f tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '590f6c0e16e44826bcd83ac06b12ca63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b52eae19c04aec95a51dfb0a7895da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:05.249139 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdf4fc-9dd7-4905-aeb7-f05e31a09a5f tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:05.249427 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdf4fc-9dd7-4905-aeb7-f05e31a09a5f tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:05.249703 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdf4fc-9dd7-4905-aeb7-f05e31a09a5f tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:05.250353 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefdf4fc-9dd7-4905-aeb7-f05e31a09a5f tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:05.252311 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefdf4fc-9dd7-4905-aeb7-f05e31a09a5f tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:05.267185 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-aefdf4fc-9dd7-4905-aeb7-f05e31a09a5f tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] Could not find domain: 0609cb436b804b678f5c4172c249dbc9.: keystone.exception.DomainNotFound: Could not find domain: 0609cb436b804b678f5c4172c249dbc9. Aug 29 16:17:05.267185 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:17:05.267185 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 29 16:17:05.267185 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 29 16:17:05.267185 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 16:17:05.267185 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 16:17:05.267185 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 16:17:05.267185 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 16:17:05.267185 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 0609cb436b804b678f5c4172c249dbc9. Aug 29 16:17:05.267185 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:17:05.267185 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 16:17:05.267185 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:17:05.267185 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:17:05.267185 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:17:05.267185 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:17:05.267185 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:17:05.268423 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:17:05.268423 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:17:05.268423 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:17:05.268423 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:17:05.268423 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:17:05.268423 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:17:05.268423 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:17:05.268423 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 29 16:17:05.268423 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 29 16:17:05.268423 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:17:05.268423 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:17:05.268423 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 16:17:05.268423 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 16:17:05.268423 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 16:17:05.268423 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 16:17:05.268423 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 987, in create_user Aug 29 16:17:05.268423 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_domain(domain_id) Aug 29 16:17:05.269595 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:17:05.269595 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:17:05.269595 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 16:17:05.269595 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 16:17:05.269595 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 16:17:05.269595 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 16:17:05.269595 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 16:17:05.269595 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 16:17:05.269595 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 16:17:05.269595 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 16:17:05.269595 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 16:17:05.269595 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 16:17:05.269595 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 16:17:05.269595 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 16:17:05.269595 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 16:17:05.269595 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 16:17:05.269595 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 29 16:17:05.270733 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 16:17:05.270733 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 0609cb436b804b678f5c4172c249dbc9. Aug 29 16:17:05.270733 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:17:05.272863 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3909/7843] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:17:05 2022] POST /identity/v3/users => generated 112 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 16:17:05.274299 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f88552-8f7d-4c47-8963-f210fcc26c4c tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:05.275782 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b9f88552-8f7d-4c47-8963-f210fcc26c4c tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:05.347842 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f88552-8f7d-4c47-8963-f210fcc26c4c tempest-UsersNegativeTest-266695003 tempest-UsersNegativeTest-266695003-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:05.352631 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab5ca1-995d-4218-addf-d73bb69e6b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:05.353299 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab5ca1-995d-4218-addf-d73bb69e6b20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:05.353578 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab5ca1-995d-4218-addf-d73bb69e6b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:05.353853 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab5ca1-995d-4218-addf-d73bb69e6b20 admin admin] PATH_INFO: `/v3/users/6f4f5930398640d68b078899672e2a8e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:05.354993 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab5ca1-995d-4218-addf-d73bb69e6b20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f4f5930398640d68b078899672e2a8e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:05.357688 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab5ca1-995d-4218-addf-d73bb69e6b20 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:05.406652 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7fab5ca1-995d-4218-addf-d73bb69e6b20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f4f5930398640d68b078899672e2a8e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:05.407341 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7fab5ca1-995d-4218-addf-d73bb69e6b20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f4f5930398640d68b078899672e2a8e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:05.414963 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7fab5ca1-995d-4218-addf-d73bb69e6b20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f4f5930398640d68b078899672e2a8e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:05.423645 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7fab5ca1-995d-4218-addf-d73bb69e6b20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f4f5930398640d68b078899672e2a8e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:05.424303 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7fab5ca1-995d-4218-addf-d73bb69e6b20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f4f5930398640d68b078899672e2a8e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:05.429628 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:05.442940 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3935/7844] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:17:05 2022] DELETE /identity/v3/users/6f4f5930398640d68b078899672e2a8e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:05.447537 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9b8df-3db4-4ac3-b8a1-85c794222707 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:05.447826 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9b8df-3db4-4ac3-b8a1-85c794222707 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:05.448105 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9b8df-3db4-4ac3-b8a1-85c794222707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:05.468184 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-8ef9b8df-3db4-4ac3-b8a1-85c794222707 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:05.469368 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8ef9b8df-3db4-4ac3-b8a1-85c794222707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:05.526849 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3910/7845] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:17:05.537206 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab5ca1-995d-4218-addf-d73bb69e6b20 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:05.538583 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7fab5ca1-995d-4218-addf-d73bb69e6b20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:05.601232 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab5ca1-995d-4218-addf-d73bb69e6b20 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:05.604832 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d594e-2c0e-49a3-9247-0e33ce2f297d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:05.605467 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d594e-2c0e-49a3-9247-0e33ce2f297d service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:05.605740 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d594e-2c0e-49a3-9247-0e33ce2f297d service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:05.606009 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d594e-2c0e-49a3-9247-0e33ce2f297d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:05.616488 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d594e-2c0e-49a3-9247-0e33ce2f297d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:05.617973 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d594e-2c0e-49a3-9247-0e33ce2f297d service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:05.628364 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3936/7846] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:17:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:17:05.903753 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef9b8df-3db4-4ac3-b8a1-85c794222707 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:05.907250 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8ef9b8df-3db4-4ac3-b8a1-85c794222707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:05.930033 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef9b8df-3db4-4ac3-b8a1-85c794222707 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:05.934981 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335dfb53-b466-40d2-b5d0-c3170b78fe49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:05.936330 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335dfb53-b466-40d2-b5d0-c3170b78fe49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:05.936882 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335dfb53-b466-40d2-b5d0-c3170b78fe49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:05.936882 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335dfb53-b466-40d2-b5d0-c3170b78fe49 admin admin] PATH_INFO: `/v3/projects/ccd9c5a5dc0a4a27b0d93f2af4e64974` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:05.938259 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335dfb53-b466-40d2-b5d0-c3170b78fe49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccd9c5a5dc0a4a27b0d93f2af4e64974)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:05.940256 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335dfb53-b466-40d2-b5d0-c3170b78fe49 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:05.991863 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-335dfb53-b466-40d2-b5d0-c3170b78fe49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccd9c5a5dc0a4a27b0d93f2af4e64974', 'request_id': 'req-335dfb53-b466-40d2-b5d0-c3170b78fe49'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:05.997300 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-335dfb53-b466-40d2-b5d0-c3170b78fe49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccd9c5a5dc0a4a27b0d93f2af4e64974', 'request_id': 'req-335dfb53-b466-40d2-b5d0-c3170b78fe49'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:06.004473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-335dfb53-b466-40d2-b5d0-c3170b78fe49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccd9c5a5dc0a4a27b0d93f2af4e64974', 'request_id': 'req-335dfb53-b466-40d2-b5d0-c3170b78fe49'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:06.011703 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:06.017432 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-335dfb53-b466-40d2-b5d0-c3170b78fe49 admin admin] The token cache is being invalidate because project ccd9c5a5dc0a4a27b0d93f2af4e64974 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:17:06.017942 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-335dfb53-b466-40d2-b5d0-c3170b78fe49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:06.019080 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-335dfb53-b466-40d2-b5d0-c3170b78fe49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:06.021095 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3911/7847] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:17:05 2022] DELETE /identity/v3/projects/ccd9c5a5dc0a4a27b0d93f2af4e64974 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:06.025255 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d594e-2c0e-49a3-9247-0e33ce2f297d service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:06.035961 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d594e-2c0e-49a3-9247-0e33ce2f297d service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:06.094525 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3ad03-a49c-4b58-8559-46af4e39876e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:06.095239 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3ad03-a49c-4b58-8559-46af4e39876e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:06.095532 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3ad03-a49c-4b58-8559-46af4e39876e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:06.095807 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3ad03-a49c-4b58-8559-46af4e39876e admin admin] PATH_INFO: `/v3/users/590f6c0e16e44826bcd83ac06b12ca63` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:06.096935 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e3ad03-a49c-4b58-8559-46af4e39876e admin admin] RBAC: Authorizing `identity:delete_user(user_id=590f6c0e16e44826bcd83ac06b12ca63)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:06.098864 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e3ad03-a49c-4b58-8559-46af4e39876e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:06.149017 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a2e3ad03-a49c-4b58-8559-46af4e39876e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '590f6c0e16e44826bcd83ac06b12ca63'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:06.149670 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a2e3ad03-a49c-4b58-8559-46af4e39876e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '590f6c0e16e44826bcd83ac06b12ca63'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:06.158654 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a2e3ad03-a49c-4b58-8559-46af4e39876e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '590f6c0e16e44826bcd83ac06b12ca63'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:06.165799 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a2e3ad03-a49c-4b58-8559-46af4e39876e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '590f6c0e16e44826bcd83ac06b12ca63'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:06.166569 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a2e3ad03-a49c-4b58-8559-46af4e39876e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '590f6c0e16e44826bcd83ac06b12ca63'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:06.185912 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3937/7848] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:17:06 2022] DELETE /identity/v3/users/590f6c0e16e44826bcd83ac06b12ca63 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:06.466210 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335dfb53-b466-40d2-b5d0-c3170b78fe49 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:06.468362 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-335dfb53-b466-40d2-b5d0-c3170b78fe49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:06.486014 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335dfb53-b466-40d2-b5d0-c3170b78fe49 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:06.543148 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a75e4-f287-44a7-bfe3-d000ce0d5afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:06.543705 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a75e4-f287-44a7-bfe3-d000ce0d5afd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:06.543985 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a75e4-f287-44a7-bfe3-d000ce0d5afd admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:06.544258 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a75e4-f287-44a7-bfe3-d000ce0d5afd admin admin] PATH_INFO: `/v3/projects/11b52eae19c04aec95a51dfb0a7895da` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:06.545914 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a75e4-f287-44a7-bfe3-d000ce0d5afd admin admin] RBAC: Authorizing `identity:delete_project(project_id=11b52eae19c04aec95a51dfb0a7895da)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:06.547865 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a75e4-f287-44a7-bfe3-d000ce0d5afd admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:06.595248 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f49a75e4-f287-44a7-bfe3-d000ce0d5afd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11b52eae19c04aec95a51dfb0a7895da', 'request_id': 'req-f49a75e4-f287-44a7-bfe3-d000ce0d5afd'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:06.600768 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f49a75e4-f287-44a7-bfe3-d000ce0d5afd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11b52eae19c04aec95a51dfb0a7895da', 'request_id': 'req-f49a75e4-f287-44a7-bfe3-d000ce0d5afd'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:06.608729 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f49a75e4-f287-44a7-bfe3-d000ce0d5afd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11b52eae19c04aec95a51dfb0a7895da', 'request_id': 'req-f49a75e4-f287-44a7-bfe3-d000ce0d5afd'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:06.619847 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f49a75e4-f287-44a7-bfe3-d000ce0d5afd admin admin] The token cache is being invalidate because project 11b52eae19c04aec95a51dfb0a7895da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:17:06.620137 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f49a75e4-f287-44a7-bfe3-d000ce0d5afd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:06.620798 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f49a75e4-f287-44a7-bfe3-d000ce0d5afd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:06.622285 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3912/7849] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:17:06 2022] DELETE /identity/v3/projects/11b52eae19c04aec95a51dfb0a7895da => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:06.628603 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b9c9e-9eed-4b9f-ac70-ee16096f8501 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:06.628887 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b9c9e-9eed-4b9f-ac70-ee16096f8501 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:06.629155 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b9c9e-9eed-4b9f-ac70-ee16096f8501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:06.650015 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-394b9c9e-9eed-4b9f-ac70-ee16096f8501 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:06.651290 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-394b9c9e-9eed-4b9f-ac70-ee16096f8501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:06.655671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:06.717431 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3938/7850] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:17:06.726529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b5cf4-02c8-4b78-aaae-7342921c94d2 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:06.726821 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b5cf4-02c8-4b78-aaae-7342921c94d2 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:06.727141 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b5cf4-02c8-4b78-aaae-7342921c94d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:06.748262 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-376b5cf4-02c8-4b78-aaae-7342921c94d2 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:06.749632 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-376b5cf4-02c8-4b78-aaae-7342921c94d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:06.757721 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3913/7851] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:17:06.762104 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b9c9e-9eed-4b9f-ac70-ee16096f8501 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:06.772232 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b9c9e-9eed-4b9f-ac70-ee16096f8501 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:06.776870 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf1eb7e-890b-4d4d-addc-fbc84a407d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:06.777472 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf1eb7e-890b-4d4d-addc-fbc84a407d6d admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:06.777752 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf1eb7e-890b-4d4d-addc-fbc84a407d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:06.778024 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf1eb7e-890b-4d4d-addc-fbc84a407d6d admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:06.778670 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf1eb7e-890b-4d4d-addc-fbc84a407d6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:17:06.779503 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf1eb7e-890b-4d4d-addc-fbc84a407d6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:06.781218 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf1eb7e-890b-4d4d-addc-fbc84a407d6d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:06.792928 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3939/7852] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:17:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:17:06.798214 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b5cf4-02c8-4b78-aaae-7342921c94d2 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:06.807802 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b5cf4-02c8-4b78-aaae-7342921c94d2 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:06.812872 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9612778-4b46-4282-8783-5b5192a0d9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:06.813516 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9612778-4b46-4282-8783-5b5192a0d9f2 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:06.813796 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9612778-4b46-4282-8783-5b5192a0d9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:06.814071 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9612778-4b46-4282-8783-5b5192a0d9f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:06.814708 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9612778-4b46-4282-8783-5b5192a0d9f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:06.816658 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9612778-4b46-4282-8783-5b5192a0d9f2 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:06.845145 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3914/7853] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:17:06 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:17:06.849525 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf1eb7e-890b-4d4d-addc-fbc84a407d6d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:06.860447 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf1eb7e-890b-4d4d-addc-fbc84a407d6d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:06.915688 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378beb6c-fe71-445d-b51c-9f31d1014375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:06.916317 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378beb6c-fe71-445d-b51c-9f31d1014375 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:06.916621 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378beb6c-fe71-445d-b51c-9f31d1014375 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:06.916914 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378beb6c-fe71-445d-b51c-9f31d1014375 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:06.917567 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378beb6c-fe71-445d-b51c-9f31d1014375 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:06.919510 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378beb6c-fe71-445d-b51c-9f31d1014375 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:06.942516 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3940/7854] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:17:06 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:17:06.948184 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9612778-4b46-4282-8783-5b5192a0d9f2 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:06.961079 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9612778-4b46-4282-8783-5b5192a0d9f2 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:06.965700 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2ecdf-bff0-44eb-aa65-ddf2ef3fa725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:06.966292 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2ecdf-bff0-44eb-aa65-ddf2ef3fa725 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:06.967197 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2ecdf-bff0-44eb-aa65-ddf2ef3fa725 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:06.967546 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2ecdf-bff0-44eb-aa65-ddf2ef3fa725 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:06.968369 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac2ecdf-bff0-44eb-aa65-ddf2ef3fa725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:06.970059 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac2ecdf-bff0-44eb-aa65-ddf2ef3fa725 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:06.980088 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3915/7855] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:17:06.985291 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378beb6c-fe71-445d-b51c-9f31d1014375 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:06.995527 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378beb6c-fe71-445d-b51c-9f31d1014375 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:07.000562 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d336e48-fd48-4b56-acf2-eafc3d7048c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:07.001157 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d336e48-fd48-4b56-acf2-eafc3d7048c7 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:07.001431 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d336e48-fd48-4b56-acf2-eafc3d7048c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:07.001698 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d336e48-fd48-4b56-acf2-eafc3d7048c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:07.002362 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d336e48-fd48-4b56-acf2-eafc3d7048c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:07.004144 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d336e48-fd48-4b56-acf2-eafc3d7048c7 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:07.015336 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3941/7856] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:17:07.019581 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2ecdf-bff0-44eb-aa65-ddf2ef3fa725 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:07.030448 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2ecdf-bff0-44eb-aa65-ddf2ef3fa725 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:07.035115 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b636b62d-ac3b-42be-9830-ae9e8b354163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:07.035759 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b636b62d-ac3b-42be-9830-ae9e8b354163 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:07.036035 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b636b62d-ac3b-42be-9830-ae9e8b354163 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:07.036420 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b636b62d-ac3b-42be-9830-ae9e8b354163 admin admin] PATH_INFO: `/v3/projects/ddb9612734d945c4b8e2a3f6a5fdf5be/users/561074e92f9e4b6c829d92fc5e3bbcc1/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:07.051609 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b636b62d-ac3b-42be-9830-ae9e8b354163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddb9612734d945c4b8e2a3f6a5fdf5be, user_id=561074e92f9e4b6c829d92fc5e3bbcc1, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:07.054438 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b636b62d-ac3b-42be-9830-ae9e8b354163 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:07.067228 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3916/7857] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:17:07 2022] PUT /identity/v3/projects/ddb9612734d945c4b8e2a3f6a5fdf5be/users/561074e92f9e4b6c829d92fc5e3bbcc1/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:07.079491 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e5cf8-e382-4cc8-ab2e-a6ec02ee38c2 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:07.080021 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e5cf8-e382-4cc8-ab2e-a6ec02ee38c2 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:07.080021 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e5cf8-e382-4cc8-ab2e-a6ec02ee38c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:07.108960 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-d20e5cf8-e382-4cc8-ab2e-a6ec02ee38c2 None None] MFA Rules not processed for user `561074e92f9e4b6c829d92fc5e3bbcc1`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:07.110167 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d20e5cf8-e382-4cc8-ab2e-a6ec02ee38c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:07.175545 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3942/7858] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:17:07.180308 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b636b62d-ac3b-42be-9830-ae9e8b354163 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:07.207737 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:07.244447 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b636b62d-ac3b-42be-9830-ae9e8b354163 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:07.249176 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5dc9e-5cd1-498c-93e6-223703fd3fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:07.249778 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5dc9e-5cd1-498c-93e6-223703fd3fd3 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:07.250054 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5dc9e-5cd1-498c-93e6-223703fd3fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:07.250324 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5dc9e-5cd1-498c-93e6-223703fd3fd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:07.250965 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb5dc9e-5cd1-498c-93e6-223703fd3fd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:07.252889 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb5dc9e-5cd1-498c-93e6-223703fd3fd3 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:07.279787 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3917/7859] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:17:07 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:17:07.283921 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e5cf8-e382-4cc8-ab2e-a6ec02ee38c2 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:07.290627 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:07.295746 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e5cf8-e382-4cc8-ab2e-a6ec02ee38c2 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:07.355663 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f266ce9-5963-48bb-b73a-9b31c517f0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:07.356285 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f266ce9-5963-48bb-b73a-9b31c517f0d3 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:07.356564 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f266ce9-5963-48bb-b73a-9b31c517f0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:07.356842 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f266ce9-5963-48bb-b73a-9b31c517f0d3 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:07.357626 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f266ce9-5963-48bb-b73a-9b31c517f0d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:07.359646 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f266ce9-5963-48bb-b73a-9b31c517f0d3 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:07.383581 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3943/7860] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:17:07 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:17:07.387562 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5dc9e-5cd1-498c-93e6-223703fd3fd3 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:07.398829 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5dc9e-5cd1-498c-93e6-223703fd3fd3 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:07.406237 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cfbbac-3182-48b0-bcce-3c6c4f086de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:07.406857 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cfbbac-3182-48b0-bcce-3c6c4f086de0 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:07.407180 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cfbbac-3182-48b0-bcce-3c6c4f086de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:07.407460 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cfbbac-3182-48b0-bcce-3c6c4f086de0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:07.408112 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cfbbac-3182-48b0-bcce-3c6c4f086de0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:07.409765 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cfbbac-3182-48b0-bcce-3c6c4f086de0 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:07.424098 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3918/7861] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:17:07.425329 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f266ce9-5963-48bb-b73a-9b31c517f0d3 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:07.435988 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f266ce9-5963-48bb-b73a-9b31c517f0d3 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:07.441051 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a014f17-ff50-4bb6-bf55-a63a8090a110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:07.441943 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a014f17-ff50-4bb6-bf55-a63a8090a110 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:07.442327 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a014f17-ff50-4bb6-bf55-a63a8090a110 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:07.442608 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a014f17-ff50-4bb6-bf55-a63a8090a110 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:07.443288 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a014f17-ff50-4bb6-bf55-a63a8090a110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:07.444902 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a014f17-ff50-4bb6-bf55-a63a8090a110 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:07.456475 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3944/7862] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:17:07.460665 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cfbbac-3182-48b0-bcce-3c6c4f086de0 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:07.471845 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cfbbac-3182-48b0-bcce-3c6c4f086de0 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:07.476629 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11466de2-f38a-4f3f-b140-309f48c19659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:07.477284 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11466de2-f38a-4f3f-b140-309f48c19659 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:07.477579 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11466de2-f38a-4f3f-b140-309f48c19659 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:07.477892 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11466de2-f38a-4f3f-b140-309f48c19659 admin admin] PATH_INFO: `/v3/projects/37ec44e6efc1400d921a79c6630a9608/users/8a9506e462f547fe85618c622063f2d4/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:07.493039 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11466de2-f38a-4f3f-b140-309f48c19659 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37ec44e6efc1400d921a79c6630a9608, user_id=8a9506e462f547fe85618c622063f2d4, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:07.495770 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11466de2-f38a-4f3f-b140-309f48c19659 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:07.509741 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3919/7863] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:17:07 2022] PUT /identity/v3/projects/37ec44e6efc1400d921a79c6630a9608/users/8a9506e462f547fe85618c622063f2d4/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:07.520727 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea5d4b-c93e-4b7f-8762-442c31a1ff49 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:07.521022 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea5d4b-c93e-4b7f-8762-442c31a1ff49 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:07.521302 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea5d4b-c93e-4b7f-8762-442c31a1ff49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:07.548927 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-e8ea5d4b-c93e-4b7f-8762-442c31a1ff49 None None] MFA Rules not processed for user `8a9506e462f547fe85618c622063f2d4`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:07.550128 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e8ea5d4b-c93e-4b7f-8762-442c31a1ff49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:07.616501 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3945/7864] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:17:07.629200 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11466de2-f38a-4f3f-b140-309f48c19659 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:07.630932 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-11466de2-f38a-4f3f-b140-309f48c19659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:07.713098 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11466de2-f38a-4f3f-b140-309f48c19659 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:07.717028 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d5b8d-fae8-46c0-be99-08d6a1fcd25f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6b0f9835ed549cab91d684326be83fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:07.717757 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d5b8d-fae8-46c0-be99-08d6a1fcd25f service glance] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:07.718039 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d5b8d-fae8-46c0-be99-08d6a1fcd25f service glance] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:07.718312 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d5b8d-fae8-46c0-be99-08d6a1fcd25f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:07.776258 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d5b8d-fae8-46c0-be99-08d6a1fcd25f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:07.777814 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d5b8d-fae8-46c0-be99-08d6a1fcd25f service glance] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:07.789524 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3920/7865] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:17:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:17:07.902597 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea5d4b-c93e-4b7f-8762-442c31a1ff49 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:07.915457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea5d4b-c93e-4b7f-8762-442c31a1ff49 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:07.919281 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f5316-4d26-4ce8-8f92-8e6d77b05ff4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6b0f9835ed549cab91d684326be83fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:07.920104 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f5316-4d26-4ce8-8f92-8e6d77b05ff4 service glance] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:07.920512 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f5316-4d26-4ce8-8f92-8e6d77b05ff4 service glance] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:07.920897 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f5316-4d26-4ce8-8f92-8e6d77b05ff4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:07.929461 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f5316-4d26-4ce8-8f92-8e6d77b05ff4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:07.930901 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f5316-4d26-4ce8-8f92-8e6d77b05ff4 service glance] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:07.939834 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3946/7866] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:17:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:17:08.269638 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d5b8d-fae8-46c0-be99-08d6a1fcd25f service glance] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:08.279384 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:08.334896 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d5b8d-fae8-46c0-be99-08d6a1fcd25f service glance] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:08.339584 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea223d76-d044-4a80-b396-f14a69a920af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:08.340214 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea223d76-d044-4a80-b396-f14a69a920af admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:08.340494 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea223d76-d044-4a80-b396-f14a69a920af admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:08.340770 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea223d76-d044-4a80-b396-f14a69a920af admin admin] PATH_INFO: `/v3/users/561074e92f9e4b6c829d92fc5e3bbcc1` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:08.342577 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea223d76-d044-4a80-b396-f14a69a920af admin admin] RBAC: Authorizing `identity:delete_user(user_id=561074e92f9e4b6c829d92fc5e3bbcc1)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:08.344538 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea223d76-d044-4a80-b396-f14a69a920af admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:08.394119 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ea223d76-d044-4a80-b396-f14a69a920af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '561074e92f9e4b6c829d92fc5e3bbcc1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:08.394799 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ea223d76-d044-4a80-b396-f14a69a920af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '561074e92f9e4b6c829d92fc5e3bbcc1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:08.408192 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ea223d76-d044-4a80-b396-f14a69a920af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '561074e92f9e4b6c829d92fc5e3bbcc1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:08.415381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ea223d76-d044-4a80-b396-f14a69a920af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '561074e92f9e4b6c829d92fc5e3bbcc1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:08.423142 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ea223d76-d044-4a80-b396-f14a69a920af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '561074e92f9e4b6c829d92fc5e3bbcc1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:08.429411 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3921/7867] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:17:08 2022] DELETE /identity/v3/users/561074e92f9e4b6c829d92fc5e3bbcc1 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:08.434055 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b897e8-fe6f-4d0f-aaf4-1897d9e6d221 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:08.434523 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b897e8-fe6f-4d0f-aaf4-1897d9e6d221 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:08.434621 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b897e8-fe6f-4d0f-aaf4-1897d9e6d221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:08.453435 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-c0b897e8-fe6f-4d0f-aaf4-1897d9e6d221 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:08.454623 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c0b897e8-fe6f-4d0f-aaf4-1897d9e6d221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:08.509357 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:08.518057 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3947/7868] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:17:08.527307 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea223d76-d044-4a80-b396-f14a69a920af admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:08.528728 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ea223d76-d044-4a80-b396-f14a69a920af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:08.595520 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea223d76-d044-4a80-b396-f14a69a920af admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:08.599323 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc7073-e6d3-4be5-b7b8-82469607c3ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:08.599940 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc7073-e6d3-4be5-b7b8-82469607c3ea service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:08.600223 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc7073-e6d3-4be5-b7b8-82469607c3ea service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:08.600501 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc7073-e6d3-4be5-b7b8-82469607c3ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:08.611081 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc7073-e6d3-4be5-b7b8-82469607c3ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:08.612547 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc7073-e6d3-4be5-b7b8-82469607c3ea service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:08.622442 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3922/7869] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:17:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:17:08.910166 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b897e8-fe6f-4d0f-aaf4-1897d9e6d221 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:08.911656 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c0b897e8-fe6f-4d0f-aaf4-1897d9e6d221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:08.924696 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b897e8-fe6f-4d0f-aaf4-1897d9e6d221 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:08.929506 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28664905-2506-480a-a069-4f7a03d5cdb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:08.930147 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28664905-2506-480a-a069-4f7a03d5cdb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:08.930428 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28664905-2506-480a-a069-4f7a03d5cdb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:08.930700 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28664905-2506-480a-a069-4f7a03d5cdb1 admin admin] PATH_INFO: `/v3/projects/ddb9612734d945c4b8e2a3f6a5fdf5be` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:08.931868 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28664905-2506-480a-a069-4f7a03d5cdb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddb9612734d945c4b8e2a3f6a5fdf5be)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:08.933795 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28664905-2506-480a-a069-4f7a03d5cdb1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:08.984386 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-28664905-2506-480a-a069-4f7a03d5cdb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddb9612734d945c4b8e2a3f6a5fdf5be', 'request_id': 'req-28664905-2506-480a-a069-4f7a03d5cdb1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:08.990159 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-28664905-2506-480a-a069-4f7a03d5cdb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddb9612734d945c4b8e2a3f6a5fdf5be', 'request_id': 'req-28664905-2506-480a-a069-4f7a03d5cdb1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:08.996404 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-28664905-2506-480a-a069-4f7a03d5cdb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddb9612734d945c4b8e2a3f6a5fdf5be', 'request_id': 'req-28664905-2506-480a-a069-4f7a03d5cdb1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:09.008976 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-28664905-2506-480a-a069-4f7a03d5cdb1 admin admin] The token cache is being invalidate because project ddb9612734d945c4b8e2a3f6a5fdf5be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:17:09.009262 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-28664905-2506-480a-a069-4f7a03d5cdb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:09.009884 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-28664905-2506-480a-a069-4f7a03d5cdb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:09.011471 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3948/7870] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:17:08 2022] DELETE /identity/v3/projects/ddb9612734d945c4b8e2a3f6a5fdf5be => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:09.016426 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc7073-e6d3-4be5-b7b8-82469607c3ea service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:09.026058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc7073-e6d3-4be5-b7b8-82469607c3ea service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:09.055418 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:09.086832 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c63d1-9e1f-4415-8045-0e4ecd21a356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:09.087509 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c63d1-9e1f-4415-8045-0e4ecd21a356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:09.087795 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c63d1-9e1f-4415-8045-0e4ecd21a356 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:09.088068 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c63d1-9e1f-4415-8045-0e4ecd21a356 admin admin] PATH_INFO: `/v3/users/8a9506e462f547fe85618c622063f2d4` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:09.089201 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c63d1-9e1f-4415-8045-0e4ecd21a356 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a9506e462f547fe85618c622063f2d4)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:09.091175 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c63d1-9e1f-4415-8045-0e4ecd21a356 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:09.138582 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-bc9c63d1-9e1f-4415-8045-0e4ecd21a356 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a9506e462f547fe85618c622063f2d4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:09.139447 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-bc9c63d1-9e1f-4415-8045-0e4ecd21a356 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a9506e462f547fe85618c622063f2d4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:09.153034 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-bc9c63d1-9e1f-4415-8045-0e4ecd21a356 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a9506e462f547fe85618c622063f2d4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:09.160338 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-bc9c63d1-9e1f-4415-8045-0e4ecd21a356 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a9506e462f547fe85618c622063f2d4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:09.167461 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-bc9c63d1-9e1f-4415-8045-0e4ecd21a356 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a9506e462f547fe85618c622063f2d4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:09.174115 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3923/7871] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:17:09 2022] DELETE /identity/v3/users/8a9506e462f547fe85618c622063f2d4 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:09.467524 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28664905-2506-480a-a069-4f7a03d5cdb1 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:09.469432 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-28664905-2506-480a-a069-4f7a03d5cdb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:09.483497 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28664905-2506-480a-a069-4f7a03d5cdb1 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:09.540796 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40798e-41c6-49e3-9d61-e542566a8c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:09.541430 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40798e-41c6-49e3-9d61-e542566a8c7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:09.541728 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40798e-41c6-49e3-9d61-e542566a8c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:09.542016 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40798e-41c6-49e3-9d61-e542566a8c7f admin admin] PATH_INFO: `/v3/projects/37ec44e6efc1400d921a79c6630a9608` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:09.543203 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a40798e-41c6-49e3-9d61-e542566a8c7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=37ec44e6efc1400d921a79c6630a9608)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:09.545145 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a40798e-41c6-49e3-9d61-e542566a8c7f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:09.593651 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2a40798e-41c6-49e3-9d61-e542566a8c7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37ec44e6efc1400d921a79c6630a9608', 'request_id': 'req-2a40798e-41c6-49e3-9d61-e542566a8c7f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:09.599036 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2a40798e-41c6-49e3-9d61-e542566a8c7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37ec44e6efc1400d921a79c6630a9608', 'request_id': 'req-2a40798e-41c6-49e3-9d61-e542566a8c7f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:09.605018 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2a40798e-41c6-49e3-9d61-e542566a8c7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37ec44e6efc1400d921a79c6630a9608', 'request_id': 'req-2a40798e-41c6-49e3-9d61-e542566a8c7f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:09.617688 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2a40798e-41c6-49e3-9d61-e542566a8c7f admin admin] The token cache is being invalidate because project 37ec44e6efc1400d921a79c6630a9608 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:17:09.617977 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2a40798e-41c6-49e3-9d61-e542566a8c7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:09.618607 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-2a40798e-41c6-49e3-9d61-e542566a8c7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:09.620140 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3949/7872] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:17:09 2022] DELETE /identity/v3/projects/37ec44e6efc1400d921a79c6630a9608 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:09.626516 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f6895-01e1-43f4-ab1a-cb56b241d617 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:09.626995 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f6895-01e1-43f4-ab1a-cb56b241d617 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:09.627136 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f6895-01e1-43f4-ab1a-cb56b241d617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:09.647266 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-2a7f6895-01e1-43f4-ab1a-cb56b241d617 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:09.648478 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2a7f6895-01e1-43f4-ab1a-cb56b241d617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:09.714489 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3924/7873] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:17:09.723748 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef5ff0-84ea-4fcb-9cc3-bffc7f5d3312 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:09.724030 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef5ff0-84ea-4fcb-9cc3-bffc7f5d3312 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:09.724335 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef5ff0-84ea-4fcb-9cc3-bffc7f5d3312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:09.749736 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a7ef5ff0-84ea-4fcb-9cc3-bffc7f5d3312 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:09.751004 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a7ef5ff0-84ea-4fcb-9cc3-bffc7f5d3312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:09.759202 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3950/7874] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:17:09.764085 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f6895-01e1-43f4-ab1a-cb56b241d617 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:09.774387 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f6895-01e1-43f4-ab1a-cb56b241d617 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:09.779310 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d8ed1-0889-48f8-997d-d19464806028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:09.780092 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d8ed1-0889-48f8-997d-d19464806028 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:09.780381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d8ed1-0889-48f8-997d-d19464806028 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:09.780658 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d8ed1-0889-48f8-997d-d19464806028 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:09.781328 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80d8ed1-0889-48f8-997d-d19464806028 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:17:09.781639 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80d8ed1-0889-48f8-997d-d19464806028 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:09.783318 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80d8ed1-0889-48f8-997d-d19464806028 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:09.796370 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3925/7875] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:17:09.800650 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef5ff0-84ea-4fcb-9cc3-bffc7f5d3312 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:09.811625 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef5ff0-84ea-4fcb-9cc3-bffc7f5d3312 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:09.816485 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c092e66-2a2c-4473-8c50-140221e0ff13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:09.817095 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c092e66-2a2c-4473-8c50-140221e0ff13 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:09.817372 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c092e66-2a2c-4473-8c50-140221e0ff13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:09.817638 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c092e66-2a2c-4473-8c50-140221e0ff13 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:09.818265 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c092e66-2a2c-4473-8c50-140221e0ff13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:09.820199 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c092e66-2a2c-4473-8c50-140221e0ff13 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:09.824848 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:09.854041 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3951/7876] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:17:09 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:17:09.855857 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d8ed1-0889-48f8-997d-d19464806028 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:09.866345 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d8ed1-0889-48f8-997d-d19464806028 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:09.899713 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:09.924564 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2a8a4-20b3-4930-a514-d51a301bf711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:09.925180 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2a8a4-20b3-4930-a514-d51a301bf711 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:09.925461 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2a8a4-20b3-4930-a514-d51a301bf711 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:09.925734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2a8a4-20b3-4930-a514-d51a301bf711 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:09.926368 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea2a8a4-20b3-4930-a514-d51a301bf711 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:09.928315 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea2a8a4-20b3-4930-a514-d51a301bf711 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:09.950116 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3926/7877] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:17:09 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:17:09.955260 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c092e66-2a2c-4473-8c50-140221e0ff13 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:09.965596 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c092e66-2a2c-4473-8c50-140221e0ff13 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:09.970377 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9d70b-3204-4c9d-a5fb-b2745418f80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:09.970975 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9d70b-3204-4c9d-a5fb-b2745418f80f admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:09.971282 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9d70b-3204-4c9d-a5fb-b2745418f80f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:09.971553 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9d70b-3204-4c9d-a5fb-b2745418f80f admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:09.972187 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9d70b-3204-4c9d-a5fb-b2745418f80f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:09.973826 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9d70b-3204-4c9d-a5fb-b2745418f80f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:09.984108 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3952/7878] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:17:09.988194 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2a8a4-20b3-4930-a514-d51a301bf711 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:09.999140 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2a8a4-20b3-4930-a514-d51a301bf711 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:10.003912 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e389ba2-72b3-4712-adf1-09cc99da6dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:10.004517 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e389ba2-72b3-4712-adf1-09cc99da6dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:10.004800 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e389ba2-72b3-4712-adf1-09cc99da6dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:10.005079 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e389ba2-72b3-4712-adf1-09cc99da6dd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:10.005728 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e389ba2-72b3-4712-adf1-09cc99da6dd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:10.007378 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e389ba2-72b3-4712-adf1-09cc99da6dd3 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:10.018823 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3927/7879] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:17:10.022921 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9d70b-3204-4c9d-a5fb-b2745418f80f admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:10.032984 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9d70b-3204-4c9d-a5fb-b2745418f80f admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:10.037584 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf6b709-a69e-4fef-a48e-3f98ab10746b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:10.038228 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6b709-a69e-4fef-a48e-3f98ab10746b admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:10.038513 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6b709-a69e-4fef-a48e-3f98ab10746b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:10.038782 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6b709-a69e-4fef-a48e-3f98ab10746b admin admin] PATH_INFO: `/v3/projects/e202601e15db461d9eed4282a75273be/users/1bc6fcb9654c45c99ec2e97d13b155a9/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:10.053239 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf6b709-a69e-4fef-a48e-3f98ab10746b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e202601e15db461d9eed4282a75273be, user_id=1bc6fcb9654c45c99ec2e97d13b155a9, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:10.056183 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf6b709-a69e-4fef-a48e-3f98ab10746b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:10.069879 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3953/7880] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:17:10 2022] PUT /identity/v3/projects/e202601e15db461d9eed4282a75273be/users/1bc6fcb9654c45c99ec2e97d13b155a9/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:10.083192 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e5a84-75a7-4b8f-af9c-081300822145 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:10.083479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e5a84-75a7-4b8f-af9c-081300822145 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:10.083753 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e5a84-75a7-4b8f-af9c-081300822145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:10.111628 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-b40e5a84-75a7-4b8f-af9c-081300822145 None None] MFA Rules not processed for user `1bc6fcb9654c45c99ec2e97d13b155a9`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:10.112854 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b40e5a84-75a7-4b8f-af9c-081300822145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:10.180413 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3928/7881] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:17:10.185131 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf6b709-a69e-4fef-a48e-3f98ab10746b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:10.246618 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf6b709-a69e-4fef-a48e-3f98ab10746b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:10.252330 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce2132-c0cf-4d80-a315-ff5b4dce8c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:10.252930 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce2132-c0cf-4d80-a315-ff5b4dce8c42 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:10.253208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce2132-c0cf-4d80-a315-ff5b4dce8c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:10.253478 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce2132-c0cf-4d80-a315-ff5b4dce8c42 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:10.254104 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce2132-c0cf-4d80-a315-ff5b4dce8c42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:10.256042 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce2132-c0cf-4d80-a315-ff5b4dce8c42 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:10.281743 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3954/7882] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:17:10 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:17:10.285775 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e5a84-75a7-4b8f-af9c-081300822145 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:10.297186 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e5a84-75a7-4b8f-af9c-081300822145 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:10.354340 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4060993-dcb2-4e55-93a6-625f726000e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:10.354968 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4060993-dcb2-4e55-93a6-625f726000e5 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:10.355276 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4060993-dcb2-4e55-93a6-625f726000e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:10.355551 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4060993-dcb2-4e55-93a6-625f726000e5 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:10.356201 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4060993-dcb2-4e55-93a6-625f726000e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:10.358812 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4060993-dcb2-4e55-93a6-625f726000e5 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:10.380905 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3929/7883] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:17:10 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:17:10.384914 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce2132-c0cf-4d80-a315-ff5b4dce8c42 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:10.395785 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce2132-c0cf-4d80-a315-ff5b4dce8c42 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:10.400501 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5aeeca-67a4-4689-a84c-e30752c4b282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:10.401102 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5aeeca-67a4-4689-a84c-e30752c4b282 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:10.401381 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5aeeca-67a4-4689-a84c-e30752c4b282 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:10.401647 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5aeeca-67a4-4689-a84c-e30752c4b282 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:10.402322 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5aeeca-67a4-4689-a84c-e30752c4b282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:10.404024 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5aeeca-67a4-4689-a84c-e30752c4b282 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:10.415100 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3955/7884] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:17:10.419232 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4060993-dcb2-4e55-93a6-625f726000e5 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:10.430385 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4060993-dcb2-4e55-93a6-625f726000e5 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:10.436758 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bcbd53-d8d2-44b5-9d0e-c5f6e4243690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:10.437427 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcbd53-d8d2-44b5-9d0e-c5f6e4243690 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:10.437703 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcbd53-d8d2-44b5-9d0e-c5f6e4243690 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:10.437974 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcbd53-d8d2-44b5-9d0e-c5f6e4243690 admin admin] PATH_INFO: `/v3/projects/9607e22b511b4968bd95a85933790404/users/2d5cd3fdad994b3695a68cea8537a98d/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:10.454327 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bcbd53-d8d2-44b5-9d0e-c5f6e4243690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9607e22b511b4968bd95a85933790404, user_id=2d5cd3fdad994b3695a68cea8537a98d, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:10.457016 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bcbd53-d8d2-44b5-9d0e-c5f6e4243690 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:10.470168 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3930/7885] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:17:10 2022] PUT /identity/v3/projects/9607e22b511b4968bd95a85933790404/users/2d5cd3fdad994b3695a68cea8537a98d/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:10.474219 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5aeeca-67a4-4689-a84c-e30752c4b282 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:10.485481 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5aeeca-67a4-4689-a84c-e30752c4b282 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:10.541322 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35baf5-3e95-45ce-bc65-fd862cf451e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:10.541852 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35baf5-3e95-45ce-bc65-fd862cf451e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:10.542130 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35baf5-3e95-45ce-bc65-fd862cf451e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:10.542405 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35baf5-3e95-45ce-bc65-fd862cf451e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:10.543066 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c35baf5-3e95-45ce-bc65-fd862cf451e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:10.545267 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c35baf5-3e95-45ce-bc65-fd862cf451e1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:10.555263 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3956/7886] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:17:10.560064 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bcbd53-d8d2-44b5-9d0e-c5f6e4243690 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:10.571300 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bcbd53-d8d2-44b5-9d0e-c5f6e4243690 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:10.576212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41afac43-e2b7-4e62-b3ae-75522da77699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:10.577062 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41afac43-e2b7-4e62-b3ae-75522da77699 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:10.577349 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41afac43-e2b7-4e62-b3ae-75522da77699 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:10.577630 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41afac43-e2b7-4e62-b3ae-75522da77699 admin admin] PATH_INFO: `/v3/projects/9607e22b511b4968bd95a85933790404/users/2d5cd3fdad994b3695a68cea8537a98d/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:10.579646 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41afac43-e2b7-4e62-b3ae-75522da77699 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9607e22b511b4968bd95a85933790404, user_id=2d5cd3fdad994b3695a68cea8537a98d, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:10.582375 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41afac43-e2b7-4e62-b3ae-75522da77699 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:10.588053 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:10.594812 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3931/7887] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:17:10 2022] PUT /identity/v3/projects/9607e22b511b4968bd95a85933790404/users/2d5cd3fdad994b3695a68cea8537a98d/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:17:10.604891 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e91e9-29c2-40b6-85c3-d488d5e61380 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:10.605180 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e91e9-29c2-40b6-85c3-d488d5e61380 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:10.605452 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e91e9-29c2-40b6-85c3-d488d5e61380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:10.633476 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-7e3e91e9-29c2-40b6-85c3-d488d5e61380 None None] MFA Rules not processed for user `2d5cd3fdad994b3695a68cea8537a98d`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:10.634685 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7e3e91e9-29c2-40b6-85c3-d488d5e61380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:10.642951 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:10.707707 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3957/7888] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:10 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:17:10.719696 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41afac43-e2b7-4e62-b3ae-75522da77699 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:10.721535 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-41afac43-e2b7-4e62-b3ae-75522da77699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:10.784156 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41afac43-e2b7-4e62-b3ae-75522da77699 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:10.787860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf12efc-24e7-43e4-831a-896b21644f7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:10.788460 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf12efc-24e7-43e4-831a-896b21644f7e service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:10.788735 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf12efc-24e7-43e4-831a-896b21644f7e service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:10.789002 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf12efc-24e7-43e4-831a-896b21644f7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:10.798753 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf12efc-24e7-43e4-831a-896b21644f7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:10.800139 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf12efc-24e7-43e4-831a-896b21644f7e service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:10.809670 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3932/7889] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:17:10 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:17:16.357585 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e91e9-29c2-40b6-85c3-d488d5e61380 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:16.368526 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e91e9-29c2-40b6-85c3-d488d5e61380 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:16.373734 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e502f4-2af1-4c75-9ffa-42772143210c tempest-RoutersIpV6AdminTest-673439435 tempest-RoutersIpV6AdminTest-673439435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d5cd3fdad994b3695a68cea8537a98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9607e22b511b4968bd95a85933790404', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:16.374463 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e502f4-2af1-4c75-9ffa-42772143210c tempest-RoutersIpV6AdminTest-673439435 tempest-RoutersIpV6AdminTest-673439435-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:16.374752 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e502f4-2af1-4c75-9ffa-42772143210c tempest-RoutersIpV6AdminTest-673439435 tempest-RoutersIpV6AdminTest-673439435-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:16.375061 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e502f4-2af1-4c75-9ffa-42772143210c tempest-RoutersIpV6AdminTest-673439435 tempest-RoutersIpV6AdminTest-673439435-project-admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:16.375966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e502f4-2af1-4c75-9ffa-42772143210c tempest-RoutersIpV6AdminTest-673439435 tempest-RoutersIpV6AdminTest-673439435-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:17:16.376337 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e502f4-2af1-4c75-9ffa-42772143210c tempest-RoutersIpV6AdminTest-673439435 tempest-RoutersIpV6AdminTest-673439435-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:16.378101 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e502f4-2af1-4c75-9ffa-42772143210c tempest-RoutersIpV6AdminTest-673439435 tempest-RoutersIpV6AdminTest-673439435-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:16.393480 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3958/7890] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:17:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:17:16.397836 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf12efc-24e7-43e4-831a-896b21644f7e service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:16.408629 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf12efc-24e7-43e4-831a-896b21644f7e service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:16.415093 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3279ab9-8830-4190-b157-59c0657abfc4 tempest-RoutersIpV6AdminTest-673439435 tempest-RoutersIpV6AdminTest-673439435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d5cd3fdad994b3695a68cea8537a98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9607e22b511b4968bd95a85933790404', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:16.415932 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3279ab9-8830-4190-b157-59c0657abfc4 tempest-RoutersIpV6AdminTest-673439435 tempest-RoutersIpV6AdminTest-673439435-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:16.416383 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3279ab9-8830-4190-b157-59c0657abfc4 tempest-RoutersIpV6AdminTest-673439435 tempest-RoutersIpV6AdminTest-673439435-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:16.416956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3279ab9-8830-4190-b157-59c0657abfc4 tempest-RoutersIpV6AdminTest-673439435 tempest-RoutersIpV6AdminTest-673439435-project-admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:16.417622 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3279ab9-8830-4190-b157-59c0657abfc4 tempest-RoutersIpV6AdminTest-673439435 tempest-RoutersIpV6AdminTest-673439435-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:16.419689 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3279ab9-8830-4190-b157-59c0657abfc4 tempest-RoutersIpV6AdminTest-673439435 tempest-RoutersIpV6AdminTest-673439435-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:16.449490 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3933/7891] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:17:16 2022] POST /identity/v3/projects => generated 348 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:17:16.456255 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e502f4-2af1-4c75-9ffa-42772143210c tempest-RoutersIpV6AdminTest-673439435 tempest-RoutersIpV6AdminTest-673439435-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:16.465834 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e502f4-2af1-4c75-9ffa-42772143210c tempest-RoutersIpV6AdminTest-673439435 tempest-RoutersIpV6AdminTest-673439435-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:16.526477 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06bac67-9b6a-45ca-8fc8-4dc8d2e91ebb tempest-RoutersIpV6AdminTest-673439435 tempest-RoutersIpV6AdminTest-673439435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d5cd3fdad994b3695a68cea8537a98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9607e22b511b4968bd95a85933790404', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:16.527013 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bac67-9b6a-45ca-8fc8-4dc8d2e91ebb tempest-RoutersIpV6AdminTest-673439435 tempest-RoutersIpV6AdminTest-673439435-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:16.527325 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bac67-9b6a-45ca-8fc8-4dc8d2e91ebb tempest-RoutersIpV6AdminTest-673439435 tempest-RoutersIpV6AdminTest-673439435-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:16.527601 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bac67-9b6a-45ca-8fc8-4dc8d2e91ebb tempest-RoutersIpV6AdminTest-673439435 tempest-RoutersIpV6AdminTest-673439435-project-admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:16.528254 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06bac67-9b6a-45ca-8fc8-4dc8d2e91ebb tempest-RoutersIpV6AdminTest-673439435 tempest-RoutersIpV6AdminTest-673439435-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:17:16.528563 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06bac67-9b6a-45ca-8fc8-4dc8d2e91ebb tempest-RoutersIpV6AdminTest-673439435 tempest-RoutersIpV6AdminTest-673439435-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:16.530186 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06bac67-9b6a-45ca-8fc8-4dc8d2e91ebb tempest-RoutersIpV6AdminTest-673439435 tempest-RoutersIpV6AdminTest-673439435-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:16.543126 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3959/7892] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:17:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:17:16.953333 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3279ab9-8830-4190-b157-59c0657abfc4 tempest-RoutersIpV6AdminTest-673439435 tempest-RoutersIpV6AdminTest-673439435-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:16.970941 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3279ab9-8830-4190-b157-59c0657abfc4 tempest-RoutersIpV6AdminTest-673439435 tempest-RoutersIpV6AdminTest-673439435-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:16.975838 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880315a-280c-4c75-bebe-006a5d4f8e22 tempest-RoutersIpV6AdminTest-673439435 tempest-RoutersIpV6AdminTest-673439435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d5cd3fdad994b3695a68cea8537a98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9607e22b511b4968bd95a85933790404', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:16.976465 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880315a-280c-4c75-bebe-006a5d4f8e22 tempest-RoutersIpV6AdminTest-673439435 tempest-RoutersIpV6AdminTest-673439435-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:16.976831 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880315a-280c-4c75-bebe-006a5d4f8e22 tempest-RoutersIpV6AdminTest-673439435 tempest-RoutersIpV6AdminTest-673439435-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:16.977110 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880315a-280c-4c75-bebe-006a5d4f8e22 tempest-RoutersIpV6AdminTest-673439435 tempest-RoutersIpV6AdminTest-673439435-project-admin] PATH_INFO: `/v3/projects/0005e917d5214fb38da80702967e2e6e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:16.978554 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880315a-280c-4c75-bebe-006a5d4f8e22 tempest-RoutersIpV6AdminTest-673439435 tempest-RoutersIpV6AdminTest-673439435-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0005e917d5214fb38da80702967e2e6e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:16.980495 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880315a-280c-4c75-bebe-006a5d4f8e22 tempest-RoutersIpV6AdminTest-673439435 tempest-RoutersIpV6AdminTest-673439435-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:17.029624 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8880315a-280c-4c75-bebe-006a5d4f8e22 tempest-RoutersIpV6AdminTest-673439435 tempest-RoutersIpV6AdminTest-673439435-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0005e917d5214fb38da80702967e2e6e', 'request_id': 'req-8880315a-280c-4c75-bebe-006a5d4f8e22'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:17.035730 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8880315a-280c-4c75-bebe-006a5d4f8e22 tempest-RoutersIpV6AdminTest-673439435 tempest-RoutersIpV6AdminTest-673439435-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0005e917d5214fb38da80702967e2e6e', 'request_id': 'req-8880315a-280c-4c75-bebe-006a5d4f8e22'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:17.043283 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8880315a-280c-4c75-bebe-006a5d4f8e22 tempest-RoutersIpV6AdminTest-673439435 tempest-RoutersIpV6AdminTest-673439435-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0005e917d5214fb38da80702967e2e6e', 'request_id': 'req-8880315a-280c-4c75-bebe-006a5d4f8e22'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:17.057059 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8880315a-280c-4c75-bebe-006a5d4f8e22 tempest-RoutersIpV6AdminTest-673439435 tempest-RoutersIpV6AdminTest-673439435-project-admin] The token cache is being invalidate because project 0005e917d5214fb38da80702967e2e6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:17:17.057350 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8880315a-280c-4c75-bebe-006a5d4f8e22 tempest-RoutersIpV6AdminTest-673439435 tempest-RoutersIpV6AdminTest-673439435-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:17.058023 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8880315a-280c-4c75-bebe-006a5d4f8e22 tempest-RoutersIpV6AdminTest-673439435 tempest-RoutersIpV6AdminTest-673439435-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:17.059595 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3934/7893] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:17:16 2022] DELETE /identity/v3/projects/0005e917d5214fb38da80702967e2e6e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:17.071832 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06bac67-9b6a-45ca-8fc8-4dc8d2e91ebb tempest-RoutersIpV6AdminTest-673439435 tempest-RoutersIpV6AdminTest-673439435-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:17.073615 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a06bac67-9b6a-45ca-8fc8-4dc8d2e91ebb tempest-RoutersIpV6AdminTest-673439435 tempest-RoutersIpV6AdminTest-673439435-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:17.142670 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06bac67-9b6a-45ca-8fc8-4dc8d2e91ebb tempest-RoutersIpV6AdminTest-673439435 tempest-RoutersIpV6AdminTest-673439435-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:17.184436 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:17.194048 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bdee34-d455-4ecf-86aa-b597b7b10fb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:17.194688 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bdee34-d455-4ecf-86aa-b597b7b10fb8 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:17.194945 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bdee34-d455-4ecf-86aa-b597b7b10fb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:17.195355 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bdee34-d455-4ecf-86aa-b597b7b10fb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:17.197195 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-65bdee34-d455-4ecf-86aa-b597b7b10fb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:17.259417 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bdee34-d455-4ecf-86aa-b597b7b10fb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:17.260868 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bdee34-d455-4ecf-86aa-b597b7b10fb8 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:17.270616 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3960/7894] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:17:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:17:27.053602 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=63,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:27.266422 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=29 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:30.807009 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880315a-280c-4c75-bebe-006a5d4f8e22 tempest-RoutersIpV6AdminTest-673439435 tempest-RoutersIpV6AdminTest-673439435-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:30.809046 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8880315a-280c-4c75-bebe-006a5d4f8e22 tempest-RoutersIpV6AdminTest-673439435 tempest-RoutersIpV6AdminTest-673439435-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:30.891384 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880315a-280c-4c75-bebe-006a5d4f8e22 tempest-RoutersIpV6AdminTest-673439435 tempest-RoutersIpV6AdminTest-673439435-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:30.896103 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e926ba2a-8654-4cb8-8d85-5a80f363077b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:30.896785 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926ba2a-8654-4cb8-8d85-5a80f363077b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:30.897066 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926ba2a-8654-4cb8-8d85-5a80f363077b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:30.897340 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926ba2a-8654-4cb8-8d85-5a80f363077b admin admin] PATH_INFO: `/v3/users/e667dee610ce46f4acf19997989172f0` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:30.898495 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e926ba2a-8654-4cb8-8d85-5a80f363077b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e667dee610ce46f4acf19997989172f0)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:30.901310 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e926ba2a-8654-4cb8-8d85-5a80f363077b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:30.973759 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e926ba2a-8654-4cb8-8d85-5a80f363077b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e667dee610ce46f4acf19997989172f0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:30.974863 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e926ba2a-8654-4cb8-8d85-5a80f363077b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e667dee610ce46f4acf19997989172f0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:30.987413 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e926ba2a-8654-4cb8-8d85-5a80f363077b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e667dee610ce46f4acf19997989172f0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:30.999184 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e926ba2a-8654-4cb8-8d85-5a80f363077b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e667dee610ce46f4acf19997989172f0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:31.008120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e926ba2a-8654-4cb8-8d85-5a80f363077b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e667dee610ce46f4acf19997989172f0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:31.015775 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3935/7895] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:17:30 2022] DELETE /identity/v3/users/e667dee610ce46f4acf19997989172f0 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:31.195771 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bdee34-d455-4ecf-86aa-b597b7b10fb8 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:31.209047 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bdee34-d455-4ecf-86aa-b597b7b10fb8 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:31.272843 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc98935-dbe2-4c23-a8ca-7cb753bd6947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:31.273547 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc98935-dbe2-4c23-a8ca-7cb753bd6947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:31.273914 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc98935-dbe2-4c23-a8ca-7cb753bd6947 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:31.274259 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc98935-dbe2-4c23-a8ca-7cb753bd6947 admin admin] PATH_INFO: `/v3/projects/0d82685728d34330ba75d35e23065cb1` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:31.275430 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc98935-dbe2-4c23-a8ca-7cb753bd6947 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d82685728d34330ba75d35e23065cb1)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:31.277340 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc98935-dbe2-4c23-a8ca-7cb753bd6947 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:31.329484 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3fc98935-dbe2-4c23-a8ca-7cb753bd6947 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d82685728d34330ba75d35e23065cb1', 'request_id': 'req-3fc98935-dbe2-4c23-a8ca-7cb753bd6947'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:31.335632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3fc98935-dbe2-4c23-a8ca-7cb753bd6947 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d82685728d34330ba75d35e23065cb1', 'request_id': 'req-3fc98935-dbe2-4c23-a8ca-7cb753bd6947'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:31.341932 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3fc98935-dbe2-4c23-a8ca-7cb753bd6947 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d82685728d34330ba75d35e23065cb1', 'request_id': 'req-3fc98935-dbe2-4c23-a8ca-7cb753bd6947'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:31.354921 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3fc98935-dbe2-4c23-a8ca-7cb753bd6947 admin admin] The token cache is being invalidate because project 0d82685728d34330ba75d35e23065cb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:17:31.355239 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3fc98935-dbe2-4c23-a8ca-7cb753bd6947 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:31.355881 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3fc98935-dbe2-4c23-a8ca-7cb753bd6947 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:31.358240 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3961/7896] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:17:31 2022] DELETE /identity/v3/projects/0d82685728d34330ba75d35e23065cb1 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:31.363683 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ef6c8-7de9-48bd-92cc-c2af17fdd7ab None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:31.363972 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ef6c8-7de9-48bd-92cc-c2af17fdd7ab None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:31.364246 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ef6c8-7de9-48bd-92cc-c2af17fdd7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:31.384569 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-5f6ef6c8-7de9-48bd-92cc-c2af17fdd7ab None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:31.385782 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5f6ef6c8-7de9-48bd-92cc-c2af17fdd7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:31.458937 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3936/7897] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:17:31.460659 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d171b5e-d3b4-45fe-a882-21386b0a00cd None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:31.460948 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d171b5e-d3b4-45fe-a882-21386b0a00cd None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:31.461276 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d171b5e-d3b4-45fe-a882-21386b0a00cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:31.482024 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-3d171b5e-d3b4-45fe-a882-21386b0a00cd None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:31.483815 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3d171b5e-d3b4-45fe-a882-21386b0a00cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:31.492032 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3962/7898] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:17:31.496475 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ef6c8-7de9-48bd-92cc-c2af17fdd7ab None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:31.507805 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ef6c8-7de9-48bd-92cc-c2af17fdd7ab None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:31.512781 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660a930-2252-4c56-9bed-709eae8abad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:31.513982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660a930-2252-4c56-9bed-709eae8abad4 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:31.514482 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660a930-2252-4c56-9bed-709eae8abad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:31.514981 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660a930-2252-4c56-9bed-709eae8abad4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:31.515712 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0660a930-2252-4c56-9bed-709eae8abad4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:17:31.516021 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0660a930-2252-4c56-9bed-709eae8abad4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:31.517647 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0660a930-2252-4c56-9bed-709eae8abad4 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:31.536257 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3937/7899] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:17:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:17:31.537287 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d171b5e-d3b4-45fe-a882-21386b0a00cd None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:31.546799 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d171b5e-d3b4-45fe-a882-21386b0a00cd None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:31.551570 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117b853-1199-46e4-86cd-e2f5ca60c425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:31.552181 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117b853-1199-46e4-86cd-e2f5ca60c425 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:31.552458 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117b853-1199-46e4-86cd-e2f5ca60c425 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:31.552728 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117b853-1199-46e4-86cd-e2f5ca60c425 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:31.553369 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9117b853-1199-46e4-86cd-e2f5ca60c425 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:31.555640 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9117b853-1199-46e4-86cd-e2f5ca60c425 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:31.588574 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3963/7900] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:17:31 2022] POST /identity/v3/projects => generated 389 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:17:31.590059 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660a930-2252-4c56-9bed-709eae8abad4 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:31.602554 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660a930-2252-4c56-9bed-709eae8abad4 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:31.606848 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:31.668201 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb300f-03a4-4133-bc0b-2419510cd664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:31.668815 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb300f-03a4-4133-bc0b-2419510cd664 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:31.669091 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb300f-03a4-4133-bc0b-2419510cd664 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:31.669363 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb300f-03a4-4133-bc0b-2419510cd664 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:31.670207 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbb300f-03a4-4133-bc0b-2419510cd664 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:31.672149 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbb300f-03a4-4133-bc0b-2419510cd664 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:31.696719 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3938/7901] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:17:31 2022] POST /identity/v3/users => generated 295 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:17:31.701463 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117b853-1199-46e4-86cd-e2f5ca60c425 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:31.713112 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117b853-1199-46e4-86cd-e2f5ca60c425 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:31.718515 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c9a80-05d3-48d3-b951-be259b67fcd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:31.719240 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c9a80-05d3-48d3-b951-be259b67fcd7 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:31.719582 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c9a80-05d3-48d3-b951-be259b67fcd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:31.719919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c9a80-05d3-48d3-b951-be259b67fcd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:31.720628 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c9a80-05d3-48d3-b951-be259b67fcd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:31.722294 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c9a80-05d3-48d3-b951-be259b67fcd7 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:31.732966 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3964/7902] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:17:31.737123 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb300f-03a4-4133-bc0b-2419510cd664 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:31.748538 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb300f-03a4-4133-bc0b-2419510cd664 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:31.753451 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc2cce9-79dd-4276-a141-d1dc2b53c2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:31.754225 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2cce9-79dd-4276-a141-d1dc2b53c2bb admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:31.754622 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2cce9-79dd-4276-a141-d1dc2b53c2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:31.754925 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2cce9-79dd-4276-a141-d1dc2b53c2bb admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:31.755762 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc2cce9-79dd-4276-a141-d1dc2b53c2bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:31.757774 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc2cce9-79dd-4276-a141-d1dc2b53c2bb admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:31.770102 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3939/7903] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:17:31.774201 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c9a80-05d3-48d3-b951-be259b67fcd7 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:31.784880 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c9a80-05d3-48d3-b951-be259b67fcd7 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:31.789670 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71522e-2637-4782-b136-c1a78ee0b30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:31.790282 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71522e-2637-4782-b136-c1a78ee0b30d admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:31.790593 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71522e-2637-4782-b136-c1a78ee0b30d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:31.790861 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71522e-2637-4782-b136-c1a78ee0b30d admin admin] PATH_INFO: `/v3/projects/ba0b1d6df9c24ccb9a274d107d08781f/users/e40f1e3fce49495b803eae3cc7ac8df0/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:31.806497 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b71522e-2637-4782-b136-c1a78ee0b30d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba0b1d6df9c24ccb9a274d107d08781f, user_id=e40f1e3fce49495b803eae3cc7ac8df0, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:31.809182 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b71522e-2637-4782-b136-c1a78ee0b30d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:31.823111 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3965/7904] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:17:31 2022] PUT /identity/v3/projects/ba0b1d6df9c24ccb9a274d107d08781f/users/e40f1e3fce49495b803eae3cc7ac8df0/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:31.833822 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478db8d-c480-4f73-ab8d-82c7d1d5a00e None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:31.834588 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478db8d-c480-4f73-ab8d-82c7d1d5a00e None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:31.834588 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478db8d-c480-4f73-ab8d-82c7d1d5a00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:31.863449 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-e478db8d-c480-4f73-ab8d-82c7d1d5a00e None None] MFA Rules not processed for user `e40f1e3fce49495b803eae3cc7ac8df0`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:31.864655 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e478db8d-c480-4f73-ab8d-82c7d1d5a00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:31.936162 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3940/7905] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:31 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:17:31.942013 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71522e-2637-4782-b136-c1a78ee0b30d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:31.978662 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:32.014730 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71522e-2637-4782-b136-c1a78ee0b30d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:32.019724 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a92fa-d817-417b-b9ef-0aec30eac839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:32.020572 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a92fa-d817-417b-b9ef-0aec30eac839 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:32.020741 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a92fa-d817-417b-b9ef-0aec30eac839 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:32.021067 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a92fa-d817-417b-b9ef-0aec30eac839 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:32.021720 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a92fa-d817-417b-b9ef-0aec30eac839 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:32.023712 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a92fa-d817-417b-b9ef-0aec30eac839 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:32.053263 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3966/7906] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:17:31 2022] POST /identity/v3/projects => generated 391 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:17:32.057610 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478db8d-c480-4f73-ab8d-82c7d1d5a00e None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:32.069539 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478db8d-c480-4f73-ab8d-82c7d1d5a00e None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:32.130455 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d41169-bcbb-4d5d-970f-59ede00ffdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:32.131234 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d41169-bcbb-4d5d-970f-59ede00ffdec admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:32.131583 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d41169-bcbb-4d5d-970f-59ede00ffdec admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:32.131924 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d41169-bcbb-4d5d-970f-59ede00ffdec admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:32.132637 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d41169-bcbb-4d5d-970f-59ede00ffdec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:32.134576 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d41169-bcbb-4d5d-970f-59ede00ffdec admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:32.159373 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3941/7907] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:17:32 2022] POST /identity/v3/users => generated 302 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:17:32.160557 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a92fa-d817-417b-b9ef-0aec30eac839 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:32.171935 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a92fa-d817-417b-b9ef-0aec30eac839 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:32.176747 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9fb1c4-ef19-4c81-8b19-b7b7e4a6c082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:32.177366 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fb1c4-ef19-4c81-8b19-b7b7e4a6c082 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:32.177649 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fb1c4-ef19-4c81-8b19-b7b7e4a6c082 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:32.177924 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fb1c4-ef19-4c81-8b19-b7b7e4a6c082 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:32.178574 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9fb1c4-ef19-4c81-8b19-b7b7e4a6c082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:32.180510 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9fb1c4-ef19-4c81-8b19-b7b7e4a6c082 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:32.191973 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3967/7908] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:17:32.196209 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d41169-bcbb-4d5d-970f-59ede00ffdec admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:32.202813 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:32.206971 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d41169-bcbb-4d5d-970f-59ede00ffdec admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:32.213645 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23a79a-c657-4b0e-86bb-4053a8296f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:32.214312 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23a79a-c657-4b0e-86bb-4053a8296f02 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:32.214596 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23a79a-c657-4b0e-86bb-4053a8296f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:32.214875 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23a79a-c657-4b0e-86bb-4053a8296f02 admin admin] PATH_INFO: `/v3/projects/ee5fc354cbdb4508a89c8a878d8f913a/users/662bc109d6e3404fb7dcd6f912c13e63/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:32.231909 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df23a79a-c657-4b0e-86bb-4053a8296f02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee5fc354cbdb4508a89c8a878d8f913a, user_id=662bc109d6e3404fb7dcd6f912c13e63, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:32.235211 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df23a79a-c657-4b0e-86bb-4053a8296f02 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:32.249283 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3942/7909] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:17:32 2022] PUT /identity/v3/projects/ee5fc354cbdb4508a89c8a878d8f913a/users/662bc109d6e3404fb7dcd6f912c13e63/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:32.253495 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9fb1c4-ef19-4c81-8b19-b7b7e4a6c082 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:32.263830 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9fb1c4-ef19-4c81-8b19-b7b7e4a6c082 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:32.322858 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670acc1-2113-4385-82fc-0ffd621b0eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:32.323499 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670acc1-2113-4385-82fc-0ffd621b0eaa admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:32.323804 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670acc1-2113-4385-82fc-0ffd621b0eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:32.324067 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670acc1-2113-4385-82fc-0ffd621b0eaa admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:32.324724 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f670acc1-2113-4385-82fc-0ffd621b0eaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:32.326855 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f670acc1-2113-4385-82fc-0ffd621b0eaa admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:32.337319 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3968/7910] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:17:32.342370 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23a79a-c657-4b0e-86bb-4053a8296f02 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:32.352774 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23a79a-c657-4b0e-86bb-4053a8296f02 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:32.358364 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f959eea-4393-4d6c-a818-7faacfdb06fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:32.359066 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f959eea-4393-4d6c-a818-7faacfdb06fc admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:32.359334 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f959eea-4393-4d6c-a818-7faacfdb06fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:32.359606 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f959eea-4393-4d6c-a818-7faacfdb06fc admin admin] PATH_INFO: `/v3/projects/ee5fc354cbdb4508a89c8a878d8f913a/users/662bc109d6e3404fb7dcd6f912c13e63/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:32.361532 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f959eea-4393-4d6c-a818-7faacfdb06fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee5fc354cbdb4508a89c8a878d8f913a, user_id=662bc109d6e3404fb7dcd6f912c13e63, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:32.364182 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f959eea-4393-4d6c-a818-7faacfdb06fc admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:32.375416 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3943/7911] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:17:32 2022] PUT /identity/v3/projects/ee5fc354cbdb4508a89c8a878d8f913a/users/662bc109d6e3404fb7dcd6f912c13e63/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:17:32.387125 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee8193-ecfb-4f64-a31c-a4adce40786d None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:32.387410 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee8193-ecfb-4f64-a31c-a4adce40786d None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:32.387686 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee8193-ecfb-4f64-a31c-a4adce40786d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:32.418327 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-88ee8193-ecfb-4f64-a31c-a4adce40786d None None] MFA Rules not processed for user `662bc109d6e3404fb7dcd6f912c13e63`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:32.420267 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-88ee8193-ecfb-4f64-a31c-a4adce40786d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:32.493033 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3969/7912] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:32 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:17:32.499147 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f959eea-4393-4d6c-a818-7faacfdb06fc admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:32.509744 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f959eea-4393-4d6c-a818-7faacfdb06fc admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:32.515979 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9fedad-710a-4f0c-9252-930eee36ce5c tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:32.516798 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fedad-710a-4f0c-9252-930eee36ce5c tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:32.517080 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fedad-710a-4f0c-9252-930eee36ce5c tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:32.517356 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fedad-710a-4f0c-9252-930eee36ce5c tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:32.518044 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9fedad-710a-4f0c-9252-930eee36ce5c tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:32.519851 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9fedad-710a-4f0c-9252-930eee36ce5c tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:32.539712 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3944/7913] 10.222.0.83 () {60 vars in 1149 bytes} [Mon Aug 29 16:17:32 2022] POST /identity/v3/domains => generated 275 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:17:32.541516 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee8193-ecfb-4f64-a31c-a4adce40786d None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:32.551928 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee8193-ecfb-4f64-a31c-a4adce40786d None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:32.571517 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:32.615411 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dcd82a-6d8e-40c1-a125-690ec91b23c4 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:32.616053 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dcd82a-6d8e-40c1-a125-690ec91b23c4 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:32.616335 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dcd82a-6d8e-40c1-a125-690ec91b23c4 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:32.616607 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dcd82a-6d8e-40c1-a125-690ec91b23c4 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/c4f3d5d230fd46c290026f28a00ae2bd/config` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:32.617295 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dcd82a-6d8e-40c1-a125-690ec91b23c4 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=c4f3d5d230fd46c290026f28a00ae2bd)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:32.618336 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-05dcd82a-6d8e-40c1-a125-690ec91b23c4 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:17:32.618336 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 16:17:32.618336 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 16:17:32.619237 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dcd82a-6d8e-40c1-a125-690ec91b23c4 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:32.659987 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3970/7914] 10.222.0.83 () {60 vars in 1269 bytes} [Mon Aug 29 16:17:32 2022] PUT /identity/v3/domains/c4f3d5d230fd46c290026f28a00ae2bd/config => generated 138 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:17:32.662980 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9fedad-710a-4f0c-9252-930eee36ce5c tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:32.675208 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9fedad-710a-4f0c-9252-930eee36ce5c tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:32.680695 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fdefb5-b98c-45c7-8db7-c7e5c6947959 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:32.681420 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fdefb5-b98c-45c7-8db7-c7e5c6947959 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:32.681706 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fdefb5-b98c-45c7-8db7-c7e5c6947959 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:32.682020 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fdefb5-b98c-45c7-8db7-c7e5c6947959 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/c4f3d5d230fd46c290026f28a00ae2bd/config/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:32.683231 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fdefb5-b98c-45c7-8db7-c7e5c6947959 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=c4f3d5d230fd46c290026f28a00ae2bd, group=identity)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:32.684326 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-83fdefb5-b98c-45c7-8db7-c7e5c6947959 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:17:32.684326 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 16:17:32.684326 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 16:17:32.685933 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fdefb5-b98c-45c7-8db7-c7e5c6947959 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:32.696549 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3945/7915] 10.222.0.83 () {58 vars in 1275 bytes} [Mon Aug 29 16:17:32 2022] GET /identity/v3/domains/c4f3d5d230fd46c290026f28a00ae2bd/config/identity => generated 45 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 29 16:17:32.697782 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dcd82a-6d8e-40c1-a125-690ec91b23c4 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:32.709716 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dcd82a-6d8e-40c1-a125-690ec91b23c4 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:32.716422 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5b457-3880-4693-af53-061ec65bc557 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:32.717213 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5b457-3880-4693-af53-061ec65bc557 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:32.717617 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5b457-3880-4693-af53-061ec65bc557 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:32.718031 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5b457-3880-4693-af53-061ec65bc557 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/c4f3d5d230fd46c290026f28a00ae2bd/config/identity/driver` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:32.719542 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5b457-3880-4693-af53-061ec65bc557 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=c4f3d5d230fd46c290026f28a00ae2bd, group=identity, option=driver)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:32.720598 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-7fa5b457-3880-4693-af53-061ec65bc557 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:17:32.720598 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 16:17:32.720598 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 16:17:32.721496 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5b457-3880-4693-af53-061ec65bc557 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:32.730633 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3971/7916] 10.222.0.83 () {58 vars in 1296 bytes} [Mon Aug 29 16:17:32 2022] GET /identity/v3/domains/c4f3d5d230fd46c290026f28a00ae2bd/config/identity/driver => generated 31 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 16:17:32.732394 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fdefb5-b98c-45c7-8db7-c7e5c6947959 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:32.743716 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fdefb5-b98c-45c7-8db7-c7e5c6947959 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:32.749647 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2945981-db7b-4bea-bce1-16704c8c7c2e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:32.750336 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2945981-db7b-4bea-bce1-16704c8c7c2e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:32.750616 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2945981-db7b-4bea-bce1-16704c8c7c2e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:32.750892 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2945981-db7b-4bea-bce1-16704c8c7c2e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/c4f3d5d230fd46c290026f28a00ae2bd/config/ldap` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:32.752070 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2945981-db7b-4bea-bce1-16704c8c7c2e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=c4f3d5d230fd46c290026f28a00ae2bd, group=ldap)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:32.753765 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2945981-db7b-4bea-bce1-16704c8c7c2e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:32.759481 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3946/7917] 10.222.0.83 () {58 vars in 1263 bytes} [Mon Aug 29 16:17:32 2022] GET /identity/v3/domains/c4f3d5d230fd46c290026f28a00ae2bd/config/ldap => generated 106 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:17:32.763699 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5b457-3880-4693-af53-061ec65bc557 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:32.773976 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5b457-3880-4693-af53-061ec65bc557 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:32.778824 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1048a2-23b2-43af-ba2e-26fb21fa6091 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:32.779801 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1048a2-23b2-43af-ba2e-26fb21fa6091 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:32.780015 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1048a2-23b2-43af-ba2e-26fb21fa6091 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:32.780120 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1048a2-23b2-43af-ba2e-26fb21fa6091 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/c4f3d5d230fd46c290026f28a00ae2bd/config/ldap/url` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:32.781295 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1048a2-23b2-43af-ba2e-26fb21fa6091 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=c4f3d5d230fd46c290026f28a00ae2bd, group=ldap, option=url)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:32.782905 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1048a2-23b2-43af-ba2e-26fb21fa6091 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:32.788058 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3972/7918] 10.222.0.83 () {58 vars in 1275 bytes} [Mon Aug 29 16:17:32 2022] GET /identity/v3/domains/c4f3d5d230fd46c290026f28a00ae2bd/config/ldap/url => generated 46 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 16:17:32.792131 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2945981-db7b-4bea-bce1-16704c8c7c2e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:32.803271 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2945981-db7b-4bea-bce1-16704c8c7c2e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:32.808371 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaff56c-dfe0-48ed-8fd5-759ad2c67fe8 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:32.809012 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaff56c-dfe0-48ed-8fd5-759ad2c67fe8 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:32.809291 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaff56c-dfe0-48ed-8fd5-759ad2c67fe8 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:32.809561 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaff56c-dfe0-48ed-8fd5-759ad2c67fe8 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/c4f3d5d230fd46c290026f28a00ae2bd/config/ldap/user_tree_dn` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:32.811667 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaff56c-dfe0-48ed-8fd5-759ad2c67fe8 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=c4f3d5d230fd46c290026f28a00ae2bd, group=ldap, option=user_tree_dn)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:32.813288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaff56c-dfe0-48ed-8fd5-759ad2c67fe8 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:32.822704 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3947/7919] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:17:32 2022] GET /identity/v3/domains/c4f3d5d230fd46c290026f28a00ae2bd/config/ldap/user_tree_dn => generated 63 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 29 16:17:32.823880 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1048a2-23b2-43af-ba2e-26fb21fa6091 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:32.834666 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1048a2-23b2-43af-ba2e-26fb21fa6091 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:32.839619 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ac275-4ac6-47f2-872f-ba457eaa9418 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:32.840254 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ac275-4ac6-47f2-872f-ba457eaa9418 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:32.840543 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ac275-4ac6-47f2-872f-ba457eaa9418 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:32.840817 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ac275-4ac6-47f2-872f-ba457eaa9418 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/c4f3d5d230fd46c290026f28a00ae2bd/config` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:32.841510 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12ac275-4ac6-47f2-872f-ba457eaa9418 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=c4f3d5d230fd46c290026f28a00ae2bd)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:32.842514 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-e12ac275-4ac6-47f2-872f-ba457eaa9418 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:17:32.842514 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 16:17:32.842514 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 16:17:32.843443 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12ac275-4ac6-47f2-872f-ba457eaa9418 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:32.852471 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3973/7920] 10.222.0.83 () {58 vars in 1251 bytes} [Mon Aug 29 16:17:32 2022] DELETE /identity/v3/domains/c4f3d5d230fd46c290026f28a00ae2bd/config => generated 0 bytes in 29 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:17:32.856806 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaff56c-dfe0-48ed-8fd5-759ad2c67fe8 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:32.867927 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaff56c-dfe0-48ed-8fd5-759ad2c67fe8 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:32.873641 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e32f1c-a375-47be-9c98-7f928de2d337 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:32.874381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e32f1c-a375-47be-9c98-7f928de2d337 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:32.874662 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e32f1c-a375-47be-9c98-7f928de2d337 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:32.874939 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e32f1c-a375-47be-9c98-7f928de2d337 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/c4f3d5d230fd46c290026f28a00ae2bd` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:32.876283 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e32f1c-a375-47be-9c98-7f928de2d337 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=c4f3d5d230fd46c290026f28a00ae2bd)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:32.877902 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e32f1c-a375-47be-9c98-7f928de2d337 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:32.899791 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-86e32f1c-a375-47be-9c98-7f928de2d337 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'c4f3d5d230fd46c290026f28a00ae2bd'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:32.900531 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-86e32f1c-a375-47be-9c98-7f928de2d337 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'c4f3d5d230fd46c290026f28a00ae2bd'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:32.930838 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-86e32f1c-a375-47be-9c98-7f928de2d337 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'c4f3d5d230fd46c290026f28a00ae2bd'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:32.931501 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-86e32f1c-a375-47be-9c98-7f928de2d337 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'c4f3d5d230fd46c290026f28a00ae2bd'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:32.937984 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3948/7921] 10.222.0.83 () {60 vars in 1249 bytes} [Mon Aug 29 16:17:32 2022] PATCH /identity/v3/domains/c4f3d5d230fd46c290026f28a00ae2bd => generated 276 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:17:32.939169 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ac275-4ac6-47f2-872f-ba457eaa9418 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:32.940872 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e12ac275-4ac6-47f2-872f-ba457eaa9418 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:32.954040 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ac275-4ac6-47f2-872f-ba457eaa9418 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:33.011822 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96456dd8-6c71-4b3b-8e78-0aae09a4f6e1 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:33.012453 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96456dd8-6c71-4b3b-8e78-0aae09a4f6e1 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:33.012727 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96456dd8-6c71-4b3b-8e78-0aae09a4f6e1 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:33.012993 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96456dd8-6c71-4b3b-8e78-0aae09a4f6e1 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/c4f3d5d230fd46c290026f28a00ae2bd` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:33.024839 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96456dd8-6c71-4b3b-8e78-0aae09a4f6e1 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=c4f3d5d230fd46c290026f28a00ae2bd)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:33.026502 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96456dd8-6c71-4b3b-8e78-0aae09a4f6e1 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:33.050608 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-96456dd8-6c71-4b3b-8e78-0aae09a4f6e1 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'c4f3d5d230fd46c290026f28a00ae2bd'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:33.061630 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-96456dd8-6c71-4b3b-8e78-0aae09a4f6e1 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'c4f3d5d230fd46c290026f28a00ae2bd'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:33.094296 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:33.106780 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-96456dd8-6c71-4b3b-8e78-0aae09a4f6e1 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4f3d5d230fd46c290026f28a00ae2bd', 'request_id': 'req-96456dd8-6c71-4b3b-8e78-0aae09a4f6e1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:33.113240 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-96456dd8-6c71-4b3b-8e78-0aae09a4f6e1 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4f3d5d230fd46c290026f28a00ae2bd', 'request_id': 'req-96456dd8-6c71-4b3b-8e78-0aae09a4f6e1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:33.120120 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-96456dd8-6c71-4b3b-8e78-0aae09a4f6e1 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4f3d5d230fd46c290026f28a00ae2bd', 'request_id': 'req-96456dd8-6c71-4b3b-8e78-0aae09a4f6e1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:33.132479 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-96456dd8-6c71-4b3b-8e78-0aae09a4f6e1 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] The token cache is being invalidate because project c4f3d5d230fd46c290026f28a00ae2bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:17:33.132805 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-96456dd8-6c71-4b3b-8e78-0aae09a4f6e1 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:33.133460 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-96456dd8-6c71-4b3b-8e78-0aae09a4f6e1 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:33.142014 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-96456dd8-6c71-4b3b-8e78-0aae09a4f6e1 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'c4f3d5d230fd46c290026f28a00ae2bd', 'request_id': 'req-96456dd8-6c71-4b3b-8e78-0aae09a4f6e1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:33.142841 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-96456dd8-6c71-4b3b-8e78-0aae09a4f6e1 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'c4f3d5d230fd46c290026f28a00ae2bd', 'request_id': 'req-96456dd8-6c71-4b3b-8e78-0aae09a4f6e1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:33.143611 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-96456dd8-6c71-4b3b-8e78-0aae09a4f6e1 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'c4f3d5d230fd46c290026f28a00ae2bd', 'request_id': 'req-96456dd8-6c71-4b3b-8e78-0aae09a4f6e1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:33.151957 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3974/7922] 10.222.0.83 () {58 vars in 1230 bytes} [Mon Aug 29 16:17:32 2022] DELETE /identity/v3/domains/c4f3d5d230fd46c290026f28a00ae2bd => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:17:33.157605 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e32f1c-a375-47be-9c98-7f928de2d337 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:33.167635 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e32f1c-a375-47be-9c98-7f928de2d337 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:33.229376 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f480209-4461-4890-93d0-9fcf91d532ee tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:33.230196 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f480209-4461-4890-93d0-9fcf91d532ee tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:33.230489 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f480209-4461-4890-93d0-9fcf91d532ee tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:33.230763 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f480209-4461-4890-93d0-9fcf91d532ee tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:33.233481 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f480209-4461-4890-93d0-9fcf91d532ee tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:33.235161 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f480209-4461-4890-93d0-9fcf91d532ee tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:33.255793 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3949/7923] 10.222.0.83 () {60 vars in 1149 bytes} [Mon Aug 29 16:17:33 2022] POST /identity/v3/domains => generated 277 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:17:33.256968 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96456dd8-6c71-4b3b-8e78-0aae09a4f6e1 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:33.258739 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-96456dd8-6c71-4b3b-8e78-0aae09a4f6e1 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:33.272834 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96456dd8-6c71-4b3b-8e78-0aae09a4f6e1 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:33.344026 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e80f6-b3c2-4ecf-b47d-9d7e0cbbd924 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:33.344739 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e80f6-b3c2-4ecf-b47d-9d7e0cbbd924 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:33.344966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e80f6-b3c2-4ecf-b47d-9d7e0cbbd924 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:33.345242 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e80f6-b3c2-4ecf-b47d-9d7e0cbbd924 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/04230967cd10495fa8c944d86c371011/config` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:33.345945 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e80f6-b3c2-4ecf-b47d-9d7e0cbbd924 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=04230967cd10495fa8c944d86c371011)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:33.347601 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e80f6-b3c2-4ecf-b47d-9d7e0cbbd924 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:33.378910 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3975/7924] 10.222.0.83 () {60 vars in 1269 bytes} [Mon Aug 29 16:17:33 2022] PUT /identity/v3/domains/04230967cd10495fa8c944d86c371011/config => generated 138 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:17:33.383364 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f480209-4461-4890-93d0-9fcf91d532ee tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:33.394191 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f480209-4461-4890-93d0-9fcf91d532ee tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:33.399187 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a3dae-eebf-45c5-b29e-621ed8c94f71 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:33.399585 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a3dae-eebf-45c5-b29e-621ed8c94f71 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:33.399869 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a3dae-eebf-45c5-b29e-621ed8c94f71 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:33.400145 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a3dae-eebf-45c5-b29e-621ed8c94f71 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/04230967cd10495fa8c944d86c371011/config` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:33.400838 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756a3dae-eebf-45c5-b29e-621ed8c94f71 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=04230967cd10495fa8c944d86c371011)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:33.401862 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-756a3dae-eebf-45c5-b29e-621ed8c94f71 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:17:33.401862 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 16:17:33.401862 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 16:17:33.402756 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756a3dae-eebf-45c5-b29e-621ed8c94f71 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:33.436323 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3950/7925] 10.222.0.83 () {60 vars in 1271 bytes} [Mon Aug 29 16:17:33 2022] PATCH /identity/v3/domains/04230967cd10495fa8c944d86c371011/config => generated 142 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:17:33.437632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e80f6-b3c2-4ecf-b47d-9d7e0cbbd924 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:33.447696 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e80f6-b3c2-4ecf-b47d-9d7e0cbbd924 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:33.453295 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec7389-dc4f-4e29-ba66-28bfd3498ae4 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:33.453934 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec7389-dc4f-4e29-ba66-28bfd3498ae4 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:33.454215 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec7389-dc4f-4e29-ba66-28bfd3498ae4 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:33.454489 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec7389-dc4f-4e29-ba66-28bfd3498ae4 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/04230967cd10495fa8c944d86c371011/config` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:33.455653 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec7389-dc4f-4e29-ba66-28bfd3498ae4 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=04230967cd10495fa8c944d86c371011)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:33.457267 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec7389-dc4f-4e29-ba66-28bfd3498ae4 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:33.462136 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3976/7926] 10.222.0.83 () {58 vars in 1248 bytes} [Mon Aug 29 16:17:33 2022] GET /identity/v3/domains/04230967cd10495fa8c944d86c371011/config => generated 142 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:17:33.466899 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a3dae-eebf-45c5-b29e-621ed8c94f71 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:33.477542 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a3dae-eebf-45c5-b29e-621ed8c94f71 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:33.482483 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d95eba-f403-4d61-9106-bb2d36add541 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:33.483297 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d95eba-f403-4d61-9106-bb2d36add541 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:33.483587 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d95eba-f403-4d61-9106-bb2d36add541 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:33.483865 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d95eba-f403-4d61-9106-bb2d36add541 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/04230967cd10495fa8c944d86c371011/config` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:33.484491 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d95eba-f403-4d61-9106-bb2d36add541 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=04230967cd10495fa8c944d86c371011)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:33.485517 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-d0d95eba-f403-4d61-9106-bb2d36add541 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:17:33.485517 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 16:17:33.485517 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 16:17:33.486417 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d95eba-f403-4d61-9106-bb2d36add541 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:33.489353 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=85,keystone:INSERT=7,keystone:UPDATE=1,keystone:DELETE=7 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:33.500393 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3951/7927] 10.222.0.83 () {58 vars in 1251 bytes} [Mon Aug 29 16:17:33 2022] DELETE /identity/v3/domains/04230967cd10495fa8c944d86c371011/config => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:17:33.504578 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec7389-dc4f-4e29-ba66-28bfd3498ae4 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:33.515681 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec7389-dc4f-4e29-ba66-28bfd3498ae4 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:33.520674 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadcb032-0ef9-4f23-b3cd-ae4885ca3447 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:33.521544 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadcb032-0ef9-4f23-b3cd-ae4885ca3447 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:33.522000 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadcb032-0ef9-4f23-b3cd-ae4885ca3447 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:33.522282 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadcb032-0ef9-4f23-b3cd-ae4885ca3447 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/04230967cd10495fa8c944d86c371011/config` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:33.523515 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadcb032-0ef9-4f23-b3cd-ae4885ca3447 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=04230967cd10495fa8c944d86c371011)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:33.525155 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadcb032-0ef9-4f23-b3cd-ae4885ca3447 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:33.534678 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-cadcb032-0ef9-4f23-b3cd-ae4885ca3447 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Could not find any options in domain configuration for domain 04230967cd10495fa8c944d86c371011.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 04230967cd10495fa8c944d86c371011. Aug 29 16:17:33.534678 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:17:33.534678 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:17:33.534678 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:17:33.534678 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:17:33.534678 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:17:33.534678 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:17:33.534678 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:17:33.534678 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:17:33.534678 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:17:33.534678 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:17:33.534678 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:17:33.534678 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Aug 29 16:17:33.535848 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Aug 29 16:17:33.535848 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Aug 29 16:17:33.535848 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Aug 29 16:17:33.535848 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:17:33.535848 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:17:33.535848 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Aug 29 16:17:33.535848 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Aug 29 16:17:33.535848 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 04230967cd10495fa8c944d86c371011. Aug 29 16:17:33.535848 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:17:33.536431 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3977/7928] 10.222.0.83 () {58 vars in 1248 bytes} [Mon Aug 29 16:17:33 2022] GET /identity/v3/domains/04230967cd10495fa8c944d86c371011/config => generated 151 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 16:17:33.540225 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d95eba-f403-4d61-9106-bb2d36add541 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:33.551438 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d95eba-f403-4d61-9106-bb2d36add541 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:33.556524 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c514fd57-309d-42a1-9d80-e446de04771e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:33.557271 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514fd57-309d-42a1-9d80-e446de04771e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:33.557611 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514fd57-309d-42a1-9d80-e446de04771e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:33.557951 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514fd57-309d-42a1-9d80-e446de04771e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/04230967cd10495fa8c944d86c371011/config` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:33.558757 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c514fd57-309d-42a1-9d80-e446de04771e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=04230967cd10495fa8c944d86c371011)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:33.560879 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c514fd57-309d-42a1-9d80-e446de04771e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:33.567499 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3952/7929] 10.222.0.83 () {58 vars in 1251 bytes} [Mon Aug 29 16:17:33 2022] DELETE /identity/v3/domains/04230967cd10495fa8c944d86c371011/config => generated 0 bytes in 28 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:33.572311 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadcb032-0ef9-4f23-b3cd-ae4885ca3447 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:33.583625 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadcb032-0ef9-4f23-b3cd-ae4885ca3447 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:33.588392 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c8135e-cf9e-424d-96b7-43a0073b7378 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:33.589018 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c8135e-cf9e-424d-96b7-43a0073b7378 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:33.589300 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c8135e-cf9e-424d-96b7-43a0073b7378 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:33.589578 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c8135e-cf9e-424d-96b7-43a0073b7378 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/04230967cd10495fa8c944d86c371011` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:33.590835 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c8135e-cf9e-424d-96b7-43a0073b7378 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=04230967cd10495fa8c944d86c371011)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:33.593298 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c8135e-cf9e-424d-96b7-43a0073b7378 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:33.617563 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a4c8135e-cf9e-424d-96b7-43a0073b7378 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '04230967cd10495fa8c944d86c371011'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:33.618226 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a4c8135e-cf9e-424d-96b7-43a0073b7378 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '04230967cd10495fa8c944d86c371011'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:33.644508 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a4c8135e-cf9e-424d-96b7-43a0073b7378 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '04230967cd10495fa8c944d86c371011'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:33.645169 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a4c8135e-cf9e-424d-96b7-43a0073b7378 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '04230967cd10495fa8c944d86c371011'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:33.647618 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3978/7930] 10.222.0.83 () {60 vars in 1249 bytes} [Mon Aug 29 16:17:33 2022] PATCH /identity/v3/domains/04230967cd10495fa8c944d86c371011 => generated 278 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:17:33.651735 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c514fd57-309d-42a1-9d80-e446de04771e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:33.653466 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c514fd57-309d-42a1-9d80-e446de04771e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:33.666880 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c514fd57-309d-42a1-9d80-e446de04771e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:33.727790 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd4e2e-e12e-4adc-9360-7cf8011d0d7a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:33.728430 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd4e2e-e12e-4adc-9360-7cf8011d0d7a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:33.728711 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd4e2e-e12e-4adc-9360-7cf8011d0d7a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:33.728984 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd4e2e-e12e-4adc-9360-7cf8011d0d7a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/04230967cd10495fa8c944d86c371011` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:33.748800 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd4e2e-e12e-4adc-9360-7cf8011d0d7a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=04230967cd10495fa8c944d86c371011)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:33.750498 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd4e2e-e12e-4adc-9360-7cf8011d0d7a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:33.775660 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3fcd4e2e-e12e-4adc-9360-7cf8011d0d7a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '04230967cd10495fa8c944d86c371011'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:33.780300 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3fcd4e2e-e12e-4adc-9360-7cf8011d0d7a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '04230967cd10495fa8c944d86c371011'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:33.829320 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3fcd4e2e-e12e-4adc-9360-7cf8011d0d7a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04230967cd10495fa8c944d86c371011', 'request_id': 'req-3fcd4e2e-e12e-4adc-9360-7cf8011d0d7a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:33.835083 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3fcd4e2e-e12e-4adc-9360-7cf8011d0d7a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04230967cd10495fa8c944d86c371011', 'request_id': 'req-3fcd4e2e-e12e-4adc-9360-7cf8011d0d7a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:33.844678 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3fcd4e2e-e12e-4adc-9360-7cf8011d0d7a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04230967cd10495fa8c944d86c371011', 'request_id': 'req-3fcd4e2e-e12e-4adc-9360-7cf8011d0d7a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:33.858854 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3fcd4e2e-e12e-4adc-9360-7cf8011d0d7a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] The token cache is being invalidate because project 04230967cd10495fa8c944d86c371011 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:17:33.859752 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3fcd4e2e-e12e-4adc-9360-7cf8011d0d7a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:33.859865 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3fcd4e2e-e12e-4adc-9360-7cf8011d0d7a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:33.868183 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3fcd4e2e-e12e-4adc-9360-7cf8011d0d7a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '04230967cd10495fa8c944d86c371011', 'request_id': 'req-3fcd4e2e-e12e-4adc-9360-7cf8011d0d7a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:33.868794 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3fcd4e2e-e12e-4adc-9360-7cf8011d0d7a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '04230967cd10495fa8c944d86c371011', 'request_id': 'req-3fcd4e2e-e12e-4adc-9360-7cf8011d0d7a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:33.869423 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3fcd4e2e-e12e-4adc-9360-7cf8011d0d7a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '04230967cd10495fa8c944d86c371011', 'request_id': 'req-3fcd4e2e-e12e-4adc-9360-7cf8011d0d7a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:33.877880 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3953/7931] 10.222.0.83 () {58 vars in 1230 bytes} [Mon Aug 29 16:17:33 2022] DELETE /identity/v3/domains/04230967cd10495fa8c944d86c371011 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:17:33.883477 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c8135e-cf9e-424d-96b7-43a0073b7378 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:33.893271 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c8135e-cf9e-424d-96b7-43a0073b7378 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:33.906070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:33.962465 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a975e37-562e-4866-915e-7ba2a63ecafc tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:33.963108 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a975e37-562e-4866-915e-7ba2a63ecafc tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:33.963393 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a975e37-562e-4866-915e-7ba2a63ecafc tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:33.963669 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a975e37-562e-4866-915e-7ba2a63ecafc tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:33.964338 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a975e37-562e-4866-915e-7ba2a63ecafc tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:33.965952 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a975e37-562e-4866-915e-7ba2a63ecafc tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:33.983165 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3979/7932] 10.222.0.83 () {60 vars in 1149 bytes} [Mon Aug 29 16:17:33 2022] POST /identity/v3/domains => generated 276 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:17:33.987448 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd4e2e-e12e-4adc-9360-7cf8011d0d7a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:33.988955 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3fcd4e2e-e12e-4adc-9360-7cf8011d0d7a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:34.002769 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd4e2e-e12e-4adc-9360-7cf8011d0d7a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:34.025109 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:34.066094 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d56de7-69e9-404b-ba40-08eb70c28b41 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:34.066742 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d56de7-69e9-404b-ba40-08eb70c28b41 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:34.067053 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d56de7-69e9-404b-ba40-08eb70c28b41 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:34.067320 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d56de7-69e9-404b-ba40-08eb70c28b41 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/3198c6c8228d4778876f8d7cc678f4ba/config` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:34.068002 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d56de7-69e9-404b-ba40-08eb70c28b41 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=3198c6c8228d4778876f8d7cc678f4ba)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:34.069030 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-f2d56de7-69e9-404b-ba40-08eb70c28b41 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:17:34.069030 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 16:17:34.069030 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 16:17:34.069914 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d56de7-69e9-404b-ba40-08eb70c28b41 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:34.105910 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3954/7933] 10.222.0.83 () {60 vars in 1269 bytes} [Mon Aug 29 16:17:33 2022] PUT /identity/v3/domains/3198c6c8228d4778876f8d7cc678f4ba/config => generated 138 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:17:34.110359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a975e37-562e-4866-915e-7ba2a63ecafc tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:34.125753 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a975e37-562e-4866-915e-7ba2a63ecafc tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:34.130491 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f78a1-c87d-4097-b922-c53dc3767c97 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:34.131248 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f78a1-c87d-4097-b922-c53dc3767c97 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:34.131617 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f78a1-c87d-4097-b922-c53dc3767c97 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:34.131951 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f78a1-c87d-4097-b922-c53dc3767c97 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/3198c6c8228d4778876f8d7cc678f4ba/config/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:34.132717 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273f78a1-c87d-4097-b922-c53dc3767c97 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=3198c6c8228d4778876f8d7cc678f4ba, group=identity)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:34.133795 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-273f78a1-c87d-4097-b922-c53dc3767c97 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:17:34.133795 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 16:17:34.133795 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 16:17:34.134871 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273f78a1-c87d-4097-b922-c53dc3767c97 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:34.170457 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3980/7934] 10.222.0.83 () {60 vars in 1297 bytes} [Mon Aug 29 16:17:34 2022] PATCH /identity/v3/domains/3198c6c8228d4778876f8d7cc678f4ba/config/identity => generated 176 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:17:34.174760 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d56de7-69e9-404b-ba40-08eb70c28b41 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:34.186812 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d56de7-69e9-404b-ba40-08eb70c28b41 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:34.191905 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81715391-5ebb-408a-a210-5a343d4b6d66 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:34.192580 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81715391-5ebb-408a-a210-5a343d4b6d66 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:34.192866 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81715391-5ebb-408a-a210-5a343d4b6d66 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:34.193152 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81715391-5ebb-408a-a210-5a343d4b6d66 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/3198c6c8228d4778876f8d7cc678f4ba/config/identity/driver` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:34.193831 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81715391-5ebb-408a-a210-5a343d4b6d66 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=3198c6c8228d4778876f8d7cc678f4ba, group=identity, option=driver)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:34.195492 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81715391-5ebb-408a-a210-5a343d4b6d66 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:34.219046 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3955/7935] 10.222.0.83 () {60 vars in 1318 bytes} [Mon Aug 29 16:17:34 2022] PATCH /identity/v3/domains/3198c6c8228d4778876f8d7cc678f4ba/config/identity/driver => generated 177 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:17:34.222995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f78a1-c87d-4097-b922-c53dc3767c97 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:34.233695 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f78a1-c87d-4097-b922-c53dc3767c97 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:34.238373 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bab327-a4ae-46ee-aedd-5b280bbb9e9d tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:34.239050 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bab327-a4ae-46ee-aedd-5b280bbb9e9d tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:34.239498 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bab327-a4ae-46ee-aedd-5b280bbb9e9d tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:34.239778 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bab327-a4ae-46ee-aedd-5b280bbb9e9d tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/3198c6c8228d4778876f8d7cc678f4ba/config/identity/driver` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:34.240378 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bab327-a4ae-46ee-aedd-5b280bbb9e9d tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=3198c6c8228d4778876f8d7cc678f4ba, group=identity, option=driver)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:34.241989 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bab327-a4ae-46ee-aedd-5b280bbb9e9d tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:34.259650 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3981/7936] 10.222.0.83 () {58 vars in 1299 bytes} [Mon Aug 29 16:17:34 2022] DELETE /identity/v3/domains/3198c6c8228d4778876f8d7cc678f4ba/config/identity/driver => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:17:34.264305 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81715391-5ebb-408a-a210-5a343d4b6d66 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:34.274657 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81715391-5ebb-408a-a210-5a343d4b6d66 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:34.280075 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4215e64f-4570-45c1-b23c-cbd9bbcc60ba tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:34.280815 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215e64f-4570-45c1-b23c-cbd9bbcc60ba tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:34.281166 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215e64f-4570-45c1-b23c-cbd9bbcc60ba tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:34.281510 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215e64f-4570-45c1-b23c-cbd9bbcc60ba tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/3198c6c8228d4778876f8d7cc678f4ba/config/identity/driver` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:34.283427 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4215e64f-4570-45c1-b23c-cbd9bbcc60ba tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=3198c6c8228d4778876f8d7cc678f4ba, group=identity, option=driver)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:34.286488 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4215e64f-4570-45c1-b23c-cbd9bbcc60ba tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:34.296615 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-4215e64f-4570-45c1-b23c-cbd9bbcc60ba tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Could not find option driver in group identity in domain configuration for domain 3198c6c8228d4778876f8d7cc678f4ba.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 3198c6c8228d4778876f8d7cc678f4ba. Aug 29 16:17:34.296615 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:17:34.296615 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:17:34.296615 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:17:34.296615 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:17:34.296615 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:17:34.296615 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:17:34.296615 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:17:34.296615 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:17:34.296615 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:17:34.296615 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:17:34.296615 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:17:34.296615 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Aug 29 16:17:34.297658 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Aug 29 16:17:34.297658 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Aug 29 16:17:34.297658 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Aug 29 16:17:34.297658 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:17:34.297658 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:17:34.297658 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Aug 29 16:17:34.297658 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Aug 29 16:17:34.297658 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 3198c6c8228d4778876f8d7cc678f4ba. Aug 29 16:17:34.297658 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:17:34.298239 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3956/7937] 10.222.0.83 () {58 vars in 1296 bytes} [Mon Aug 29 16:17:34 2022] GET /identity/v3/domains/3198c6c8228d4778876f8d7cc678f4ba/config/identity/driver => generated 171 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 16:17:34.301933 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bab327-a4ae-46ee-aedd-5b280bbb9e9d tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:34.313482 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bab327-a4ae-46ee-aedd-5b280bbb9e9d tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:34.318293 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa590be-50ad-43d9-a73a-ac453586bb21 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:34.319000 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa590be-50ad-43d9-a73a-ac453586bb21 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:34.319356 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa590be-50ad-43d9-a73a-ac453586bb21 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:34.319668 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa590be-50ad-43d9-a73a-ac453586bb21 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/3198c6c8228d4778876f8d7cc678f4ba/config/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:34.320548 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa590be-50ad-43d9-a73a-ac453586bb21 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=3198c6c8228d4778876f8d7cc678f4ba, group=identity)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:34.322308 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa590be-50ad-43d9-a73a-ac453586bb21 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:34.345495 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3982/7938] 10.222.0.83 () {58 vars in 1278 bytes} [Mon Aug 29 16:17:34 2022] DELETE /identity/v3/domains/3198c6c8228d4778876f8d7cc678f4ba/config/identity => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:17:34.349840 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4215e64f-4570-45c1-b23c-cbd9bbcc60ba tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:34.364268 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4215e64f-4570-45c1-b23c-cbd9bbcc60ba tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:34.370580 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e10df1-4464-4f19-abf6-ce91ed97f521 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:34.371388 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e10df1-4464-4f19-abf6-ce91ed97f521 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:34.371750 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e10df1-4464-4f19-abf6-ce91ed97f521 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:34.372119 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e10df1-4464-4f19-abf6-ce91ed97f521 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/3198c6c8228d4778876f8d7cc678f4ba/config/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:34.374195 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e10df1-4464-4f19-abf6-ce91ed97f521 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=3198c6c8228d4778876f8d7cc678f4ba, group=identity)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:34.375929 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e10df1-4464-4f19-abf6-ce91ed97f521 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:34.385273 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-47e10df1-4464-4f19-abf6-ce91ed97f521 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Could not find group identity in domain configuration for domain 3198c6c8228d4778876f8d7cc678f4ba.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 3198c6c8228d4778876f8d7cc678f4ba. Aug 29 16:17:34.385273 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:17:34.385273 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:17:34.385273 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:17:34.385273 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:17:34.385273 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:17:34.385273 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:17:34.385273 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:17:34.385273 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:17:34.385273 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:17:34.385273 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:17:34.385273 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:17:34.385273 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Aug 29 16:17:34.386328 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Aug 29 16:17:34.386328 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Aug 29 16:17:34.386328 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Aug 29 16:17:34.386328 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:17:34.386328 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:17:34.386328 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Aug 29 16:17:34.386328 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Aug 29 16:17:34.386328 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 3198c6c8228d4778876f8d7cc678f4ba. Aug 29 16:17:34.386328 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:17:34.390354 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3957/7939] 10.222.0.83 () {58 vars in 1275 bytes} [Mon Aug 29 16:17:34 2022] GET /identity/v3/domains/3198c6c8228d4778876f8d7cc678f4ba/config/identity => generated 154 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 29 16:17:34.390918 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa590be-50ad-43d9-a73a-ac453586bb21 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:34.401085 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa590be-50ad-43d9-a73a-ac453586bb21 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:34.406406 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c070204-3277-4691-8d73-dd7c8e00e50a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:34.407222 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c070204-3277-4691-8d73-dd7c8e00e50a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:34.407571 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c070204-3277-4691-8d73-dd7c8e00e50a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:34.407936 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c070204-3277-4691-8d73-dd7c8e00e50a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/3198c6c8228d4778876f8d7cc678f4ba/config` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:34.408637 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c070204-3277-4691-8d73-dd7c8e00e50a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=3198c6c8228d4778876f8d7cc678f4ba)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:34.410321 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c070204-3277-4691-8d73-dd7c8e00e50a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:34.420716 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3983/7940] 10.222.0.83 () {58 vars in 1251 bytes} [Mon Aug 29 16:17:34 2022] DELETE /identity/v3/domains/3198c6c8228d4778876f8d7cc678f4ba/config => generated 0 bytes in 30 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:17:34.424966 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e10df1-4464-4f19-abf6-ce91ed97f521 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:34.436880 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e10df1-4464-4f19-abf6-ce91ed97f521 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:34.442310 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add6d57-74c2-47ec-b8a8-06ff28f4793a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:34.442958 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add6d57-74c2-47ec-b8a8-06ff28f4793a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:34.443276 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add6d57-74c2-47ec-b8a8-06ff28f4793a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:34.443648 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add6d57-74c2-47ec-b8a8-06ff28f4793a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/3198c6c8228d4778876f8d7cc678f4ba` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:34.444925 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6add6d57-74c2-47ec-b8a8-06ff28f4793a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=3198c6c8228d4778876f8d7cc678f4ba)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:34.446534 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6add6d57-74c2-47ec-b8a8-06ff28f4793a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:34.469225 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6add6d57-74c2-47ec-b8a8-06ff28f4793a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '3198c6c8228d4778876f8d7cc678f4ba'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:34.469999 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6add6d57-74c2-47ec-b8a8-06ff28f4793a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '3198c6c8228d4778876f8d7cc678f4ba'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:34.496587 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6add6d57-74c2-47ec-b8a8-06ff28f4793a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '3198c6c8228d4778876f8d7cc678f4ba'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:34.497202 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6add6d57-74c2-47ec-b8a8-06ff28f4793a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '3198c6c8228d4778876f8d7cc678f4ba'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:34.504565 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3958/7941] 10.222.0.83 () {60 vars in 1249 bytes} [Mon Aug 29 16:17:34 2022] PATCH /identity/v3/domains/3198c6c8228d4778876f8d7cc678f4ba => generated 277 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:17:34.505754 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c070204-3277-4691-8d73-dd7c8e00e50a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:34.507667 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5c070204-3277-4691-8d73-dd7c8e00e50a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:34.522172 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c070204-3277-4691-8d73-dd7c8e00e50a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:34.589848 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c2dc5-e40d-4ebb-ac2c-c6867aca911d tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:34.590504 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c2dc5-e40d-4ebb-ac2c-c6867aca911d tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:34.590790 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c2dc5-e40d-4ebb-ac2c-c6867aca911d tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:34.591094 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c2dc5-e40d-4ebb-ac2c-c6867aca911d tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/3198c6c8228d4778876f8d7cc678f4ba` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:34.604309 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863c2dc5-e40d-4ebb-ac2c-c6867aca911d tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=3198c6c8228d4778876f8d7cc678f4ba)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:34.605965 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863c2dc5-e40d-4ebb-ac2c-c6867aca911d tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:34.632062 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:34.636993 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-863c2dc5-e40d-4ebb-ac2c-c6867aca911d tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '3198c6c8228d4778876f8d7cc678f4ba'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:34.650869 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-863c2dc5-e40d-4ebb-ac2c-c6867aca911d tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '3198c6c8228d4778876f8d7cc678f4ba'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:34.693816 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-863c2dc5-e40d-4ebb-ac2c-c6867aca911d tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3198c6c8228d4778876f8d7cc678f4ba', 'request_id': 'req-863c2dc5-e40d-4ebb-ac2c-c6867aca911d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:34.702038 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-863c2dc5-e40d-4ebb-ac2c-c6867aca911d tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3198c6c8228d4778876f8d7cc678f4ba', 'request_id': 'req-863c2dc5-e40d-4ebb-ac2c-c6867aca911d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:34.710784 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-863c2dc5-e40d-4ebb-ac2c-c6867aca911d tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3198c6c8228d4778876f8d7cc678f4ba', 'request_id': 'req-863c2dc5-e40d-4ebb-ac2c-c6867aca911d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:34.724575 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-863c2dc5-e40d-4ebb-ac2c-c6867aca911d tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] The token cache is being invalidate because project 3198c6c8228d4778876f8d7cc678f4ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:17:34.724867 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-863c2dc5-e40d-4ebb-ac2c-c6867aca911d tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:34.725585 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-863c2dc5-e40d-4ebb-ac2c-c6867aca911d tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:34.734101 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-863c2dc5-e40d-4ebb-ac2c-c6867aca911d tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '3198c6c8228d4778876f8d7cc678f4ba', 'request_id': 'req-863c2dc5-e40d-4ebb-ac2c-c6867aca911d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:34.734813 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-863c2dc5-e40d-4ebb-ac2c-c6867aca911d tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '3198c6c8228d4778876f8d7cc678f4ba', 'request_id': 'req-863c2dc5-e40d-4ebb-ac2c-c6867aca911d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:34.735494 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-863c2dc5-e40d-4ebb-ac2c-c6867aca911d tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '3198c6c8228d4778876f8d7cc678f4ba', 'request_id': 'req-863c2dc5-e40d-4ebb-ac2c-c6867aca911d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:34.744598 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3984/7942] 10.222.0.83 () {58 vars in 1230 bytes} [Mon Aug 29 16:17:34 2022] DELETE /identity/v3/domains/3198c6c8228d4778876f8d7cc678f4ba => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:34.750599 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add6d57-74c2-47ec-b8a8-06ff28f4793a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:34.761241 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add6d57-74c2-47ec-b8a8-06ff28f4793a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:34.819912 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1868023-c858-42e7-86d5-02cf0e1d384f tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:34.820529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1868023-c858-42e7-86d5-02cf0e1d384f tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:34.820807 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1868023-c858-42e7-86d5-02cf0e1d384f tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:34.821083 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1868023-c858-42e7-86d5-02cf0e1d384f tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:34.821653 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1868023-c858-42e7-86d5-02cf0e1d384f tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:34.822664 n-d-836830-13 devstack@keystone.service[82148]: WARNING py.warnings [None req-d1868023-c858-42e7-86d5-02cf0e1d384f tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:17:34.822664 n-d-836830-13 devstack@keystone.service[82148]: warnings.warn(msg) Aug 29 16:17:34.822664 n-d-836830-13 devstack@keystone.service[82148]: Aug 29 16:17:34.823701 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1868023-c858-42e7-86d5-02cf0e1d384f tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:34.828730 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3959/7943] 10.222.0.83 () {58 vars in 1173 bytes} [Mon Aug 29 16:17:34 2022] GET /identity/v3/domains/config/default => generated 1527 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:17:34.833206 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c2dc5-e40d-4ebb-ac2c-c6867aca911d tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:34.834705 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-863c2dc5-e40d-4ebb-ac2c-c6867aca911d tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:34.847792 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c2dc5-e40d-4ebb-ac2c-c6867aca911d tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:34.853045 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf5a077-4396-4ee5-9ce5-9de01fcdda6a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:34.853769 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5a077-4396-4ee5-9ce5-9de01fcdda6a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:34.853978 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5a077-4396-4ee5-9ce5-9de01fcdda6a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:34.854269 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5a077-4396-4ee5-9ce5-9de01fcdda6a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:34.854843 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf5a077-4396-4ee5-9ce5-9de01fcdda6a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:34.855896 n-d-836830-13 devstack@keystone.service[82149]: WARNING py.warnings [None req-6cf5a077-4396-4ee5-9ce5-9de01fcdda6a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 16:17:34.855896 n-d-836830-13 devstack@keystone.service[82149]: warnings.warn(msg) Aug 29 16:17:34.855896 n-d-836830-13 devstack@keystone.service[82149]: Aug 29 16:17:34.857301 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf5a077-4396-4ee5-9ce5-9de01fcdda6a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:34.859146 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3985/7944] 10.222.0.83 () {58 vars in 1200 bytes} [Mon Aug 29 16:17:34 2022] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 16:17:34.863733 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1868023-c858-42e7-86d5-02cf0e1d384f tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:34.874895 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1868023-c858-42e7-86d5-02cf0e1d384f tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:34.879813 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c7a6bd-db3e-48bc-9696-aab334f36c83 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:34.880468 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7a6bd-db3e-48bc-9696-aab334f36c83 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:34.880747 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7a6bd-db3e-48bc-9696-aab334f36c83 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:34.881022 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7a6bd-db3e-48bc-9696-aab334f36c83 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:34.881732 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c7a6bd-db3e-48bc-9696-aab334f36c83 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:34.883486 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c7a6bd-db3e-48bc-9696-aab334f36c83 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:34.884521 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3960/7945] 10.222.0.83 () {58 vars in 1221 bytes} [Mon Aug 29 16:17:34 2022] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 16:17:34.888742 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf5a077-4396-4ee5-9ce5-9de01fcdda6a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:34.898929 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf5a077-4396-4ee5-9ce5-9de01fcdda6a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:34.903635 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741ca17-7f83-4ac1-9adc-a7e9b4d7b122 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:34.904558 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741ca17-7f83-4ac1-9adc-a7e9b4d7b122 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:34.904839 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741ca17-7f83-4ac1-9adc-a7e9b4d7b122 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:34.905112 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741ca17-7f83-4ac1-9adc-a7e9b4d7b122 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:34.905694 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5741ca17-7f83-4ac1-9adc-a7e9b4d7b122 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:34.907325 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5741ca17-7f83-4ac1-9adc-a7e9b4d7b122 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:34.908561 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3986/7946] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:17:34 2022] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 16:17:34.912412 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c7a6bd-db3e-48bc-9696-aab334f36c83 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:34.923454 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c7a6bd-db3e-48bc-9696-aab334f36c83 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:34.929435 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc039a-649f-471d-bfeb-b7874d02b713 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:34.930368 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc039a-649f-471d-bfeb-b7874d02b713 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:34.930651 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc039a-649f-471d-bfeb-b7874d02b713 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:34.930926 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc039a-649f-471d-bfeb-b7874d02b713 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:34.931544 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc039a-649f-471d-bfeb-b7874d02b713 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:34.933146 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc039a-649f-471d-bfeb-b7874d02b713 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:34.934676 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3961/7947] 10.222.0.83 () {58 vars in 1188 bytes} [Mon Aug 29 16:17:34 2022] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:17:34.939401 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741ca17-7f83-4ac1-9adc-a7e9b4d7b122 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:34.949471 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741ca17-7f83-4ac1-9adc-a7e9b4d7b122 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:34.954270 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a20785-5254-44d6-ba99-ebb6a2f2b753 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:34.954914 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a20785-5254-44d6-ba99-ebb6a2f2b753 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:34.955223 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a20785-5254-44d6-ba99-ebb6a2f2b753 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:34.955495 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a20785-5254-44d6-ba99-ebb6a2f2b753 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:34.956105 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a20785-5254-44d6-ba99-ebb6a2f2b753 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:34.957700 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a20785-5254-44d6-ba99-ebb6a2f2b753 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:34.958878 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3987/7948] 10.222.0.83 () {58 vars in 1200 bytes} [Mon Aug 29 16:17:34 2022] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 16:17:34.963816 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc039a-649f-471d-bfeb-b7874d02b713 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:34.970265 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:34.974297 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc039a-649f-471d-bfeb-b7874d02b713 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:34.980276 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dcaffb-3417-4e61-911f-882732842661 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:34.981007 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcaffb-3417-4e61-911f-882732842661 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:34.981545 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcaffb-3417-4e61-911f-882732842661 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:34.982709 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcaffb-3417-4e61-911f-882732842661 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:34.983763 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dcaffb-3417-4e61-911f-882732842661 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:34.985652 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dcaffb-3417-4e61-911f-882732842661 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:34.989793 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3962/7949] 10.222.0.83 () {58 vars in 1203 bytes} [Mon Aug 29 16:17:34 2022] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 16:17:34.990918 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a20785-5254-44d6-ba99-ebb6a2f2b753 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:35.002444 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a20785-5254-44d6-ba99-ebb6a2f2b753 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:35.007244 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615e2e5-6759-40f4-8495-a76c02d77202 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:35.007894 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615e2e5-6759-40f4-8495-a76c02d77202 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:35.008177 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615e2e5-6759-40f4-8495-a76c02d77202 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:35.008445 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615e2e5-6759-40f4-8495-a76c02d77202 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:35.009032 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0615e2e5-6759-40f4-8495-a76c02d77202 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:35.010649 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0615e2e5-6759-40f4-8495-a76c02d77202 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:35.011862 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3988/7950] 10.222.0.83 () {58 vars in 1209 bytes} [Mon Aug 29 16:17:34 2022] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 29 16:17:35.016137 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dcaffb-3417-4e61-911f-882732842661 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:35.026311 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dcaffb-3417-4e61-911f-882732842661 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:35.031602 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb554442-df58-4aa0-a70e-f621dbc02637 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:35.032275 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb554442-df58-4aa0-a70e-f621dbc02637 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:35.032558 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb554442-df58-4aa0-a70e-f621dbc02637 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:35.032831 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb554442-df58-4aa0-a70e-f621dbc02637 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:35.033419 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb554442-df58-4aa0-a70e-f621dbc02637 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:35.035043 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb554442-df58-4aa0-a70e-f621dbc02637 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:35.036135 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3963/7951] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:17:35 2022] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 16:17:35.040091 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615e2e5-6759-40f4-8495-a76c02d77202 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:35.051586 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615e2e5-6759-40f4-8495-a76c02d77202 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:35.056739 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a743f4c-43df-477a-bca1-1d7cf5d1566d tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:35.057388 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a743f4c-43df-477a-bca1-1d7cf5d1566d tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:35.057670 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a743f4c-43df-477a-bca1-1d7cf5d1566d tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:35.057947 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a743f4c-43df-477a-bca1-1d7cf5d1566d tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:35.058536 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a743f4c-43df-477a-bca1-1d7cf5d1566d tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:35.060777 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a743f4c-43df-477a-bca1-1d7cf5d1566d tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:35.062081 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3989/7952] 10.222.0.83 () {58 vars in 1218 bytes} [Mon Aug 29 16:17:35 2022] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 16:17:35.066270 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb554442-df58-4aa0-a70e-f621dbc02637 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:35.077318 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb554442-df58-4aa0-a70e-f621dbc02637 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:35.082276 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767eb3cf-b7c8-490a-a716-1429ddc5131f tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:35.083056 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767eb3cf-b7c8-490a-a716-1429ddc5131f tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:35.083340 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767eb3cf-b7c8-490a-a716-1429ddc5131f tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:35.083616 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767eb3cf-b7c8-490a-a716-1429ddc5131f tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:35.084230 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767eb3cf-b7c8-490a-a716-1429ddc5131f tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:35.085864 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767eb3cf-b7c8-490a-a716-1429ddc5131f tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:35.087160 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3964/7953] 10.222.0.83 () {58 vars in 1248 bytes} [Mon Aug 29 16:17:35 2022] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 29 16:17:35.091128 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a743f4c-43df-477a-bca1-1d7cf5d1566d tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:35.101699 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a743f4c-43df-477a-bca1-1d7cf5d1566d tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:35.107426 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867e591-d292-4cb7-82e2-5d9a775b9cd4 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:35.108129 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867e591-d292-4cb7-82e2-5d9a775b9cd4 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:35.108760 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867e591-d292-4cb7-82e2-5d9a775b9cd4 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:35.108760 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867e591-d292-4cb7-82e2-5d9a775b9cd4 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:35.109216 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b867e591-d292-4cb7-82e2-5d9a775b9cd4 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:35.110814 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b867e591-d292-4cb7-82e2-5d9a775b9cd4 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:35.112044 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3990/7954] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:17:35 2022] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 29 16:17:35.116022 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767eb3cf-b7c8-490a-a716-1429ddc5131f tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:35.127281 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767eb3cf-b7c8-490a-a716-1429ddc5131f tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:35.132099 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45215e-7371-4f32-8467-a90e80c222cc tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:35.132747 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45215e-7371-4f32-8467-a90e80c222cc tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:35.133025 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45215e-7371-4f32-8467-a90e80c222cc tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:35.133300 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45215e-7371-4f32-8467-a90e80c222cc tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:35.133945 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d45215e-7371-4f32-8467-a90e80c222cc tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:35.135627 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d45215e-7371-4f32-8467-a90e80c222cc tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:35.136780 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3965/7955] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:35 2022] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 16:17:35.141003 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867e591-d292-4cb7-82e2-5d9a775b9cd4 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:35.151324 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867e591-d292-4cb7-82e2-5d9a775b9cd4 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:35.157342 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76cc71-7dca-41d5-88cd-7fbec84ac7d3 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:35.158016 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76cc71-7dca-41d5-88cd-7fbec84ac7d3 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:35.158303 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76cc71-7dca-41d5-88cd-7fbec84ac7d3 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:35.158579 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76cc71-7dca-41d5-88cd-7fbec84ac7d3 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:35.159207 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be76cc71-7dca-41d5-88cd-7fbec84ac7d3 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:35.160813 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be76cc71-7dca-41d5-88cd-7fbec84ac7d3 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:35.164874 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3991/7956] 10.222.0.83 () {58 vars in 1227 bytes} [Mon Aug 29 16:17:35 2022] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 16:17:35.166166 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45215e-7371-4f32-8467-a90e80c222cc tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:35.177413 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45215e-7371-4f32-8467-a90e80c222cc tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:35.182758 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0164f0a7-e1f7-4081-bc9e-046a806d3068 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:35.183584 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0164f0a7-e1f7-4081-bc9e-046a806d3068 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:35.183935 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0164f0a7-e1f7-4081-bc9e-046a806d3068 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:35.184280 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0164f0a7-e1f7-4081-bc9e-046a806d3068 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:35.184877 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0164f0a7-e1f7-4081-bc9e-046a806d3068 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:35.187292 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0164f0a7-e1f7-4081-bc9e-046a806d3068 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:35.188563 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3966/7957] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:17:35 2022] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 16:17:35.192373 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76cc71-7dca-41d5-88cd-7fbec84ac7d3 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:35.202589 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76cc71-7dca-41d5-88cd-7fbec84ac7d3 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:35.207240 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1541fdaa-8ccc-4130-9748-5402608387f5 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:35.207881 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541fdaa-8ccc-4130-9748-5402608387f5 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:35.208163 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541fdaa-8ccc-4130-9748-5402608387f5 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:35.208436 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541fdaa-8ccc-4130-9748-5402608387f5 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:35.209014 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1541fdaa-8ccc-4130-9748-5402608387f5 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:35.210606 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1541fdaa-8ccc-4130-9748-5402608387f5 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:35.214592 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3992/7958] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:17:35 2022] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 16:17:35.216017 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0164f0a7-e1f7-4081-bc9e-046a806d3068 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:35.227740 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0164f0a7-e1f7-4081-bc9e-046a806d3068 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:35.233125 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18130614-2f69-4c0b-ac8c-3d041ef16487 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:35.233786 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18130614-2f69-4c0b-ac8c-3d041ef16487 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:35.234047 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18130614-2f69-4c0b-ac8c-3d041ef16487 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:35.234322 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18130614-2f69-4c0b-ac8c-3d041ef16487 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:35.234923 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18130614-2f69-4c0b-ac8c-3d041ef16487 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:35.236580 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18130614-2f69-4c0b-ac8c-3d041ef16487 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:35.237693 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3967/7959] 10.222.0.83 () {58 vars in 1242 bytes} [Mon Aug 29 16:17:35 2022] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 16:17:35.241736 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1541fdaa-8ccc-4130-9748-5402608387f5 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:35.253121 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1541fdaa-8ccc-4130-9748-5402608387f5 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:35.257763 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a62cb-9ee1-4094-a732-5f1f6fdfa62e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:35.258412 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a62cb-9ee1-4094-a732-5f1f6fdfa62e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:35.258691 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a62cb-9ee1-4094-a732-5f1f6fdfa62e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:35.258996 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a62cb-9ee1-4094-a732-5f1f6fdfa62e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:35.259583 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a62cb-9ee1-4094-a732-5f1f6fdfa62e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:35.261166 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a62cb-9ee1-4094-a732-5f1f6fdfa62e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:35.262355 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3993/7960] 10.222.0.83 () {58 vars in 1248 bytes} [Mon Aug 29 16:17:35 2022] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 29 16:17:35.267165 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18130614-2f69-4c0b-ac8c-3d041ef16487 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:35.277231 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18130614-2f69-4c0b-ac8c-3d041ef16487 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:35.282184 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944478d8-d041-499a-9552-faa3dc08637b tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:35.282831 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944478d8-d041-499a-9552-faa3dc08637b tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:35.283150 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944478d8-d041-499a-9552-faa3dc08637b tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:35.283423 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944478d8-d041-499a-9552-faa3dc08637b tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:35.284007 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944478d8-d041-499a-9552-faa3dc08637b tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:35.285599 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944478d8-d041-499a-9552-faa3dc08637b tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:35.286688 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3968/7961] 10.222.0.83 () {58 vars in 1248 bytes} [Mon Aug 29 16:17:35 2022] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 29 16:17:35.290658 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a62cb-9ee1-4094-a732-5f1f6fdfa62e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:35.301112 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a62cb-9ee1-4094-a732-5f1f6fdfa62e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:35.306454 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778a5c5-64e3-493f-9678-40923ccef915 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:35.307130 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778a5c5-64e3-493f-9678-40923ccef915 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:35.307410 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778a5c5-64e3-493f-9678-40923ccef915 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:35.307684 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778a5c5-64e3-493f-9678-40923ccef915 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:35.308272 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3778a5c5-64e3-493f-9678-40923ccef915 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:35.312041 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3778a5c5-64e3-493f-9678-40923ccef915 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:35.313435 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3994/7962] 10.222.0.83 () {58 vars in 1269 bytes} [Mon Aug 29 16:17:35 2022] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 16:17:35.317629 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944478d8-d041-499a-9552-faa3dc08637b tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:35.328798 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944478d8-d041-499a-9552-faa3dc08637b tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:35.333909 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46269346-602f-44a8-938e-23c6e59d2197 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:35.334593 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46269346-602f-44a8-938e-23c6e59d2197 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:35.334889 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46269346-602f-44a8-938e-23c6e59d2197 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:35.335644 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46269346-602f-44a8-938e-23c6e59d2197 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:35.335854 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46269346-602f-44a8-938e-23c6e59d2197 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:35.337572 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46269346-602f-44a8-938e-23c6e59d2197 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:35.338741 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3969/7963] 10.222.0.83 () {58 vars in 1248 bytes} [Mon Aug 29 16:17:35 2022] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 16:17:35.343376 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778a5c5-64e3-493f-9678-40923ccef915 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:35.353935 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778a5c5-64e3-493f-9678-40923ccef915 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:35.359120 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5787c-2b33-425b-a2d2-e330da1443a2 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:35.359805 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5787c-2b33-425b-a2d2-e330da1443a2 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:35.360042 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5787c-2b33-425b-a2d2-e330da1443a2 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:35.360316 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5787c-2b33-425b-a2d2-e330da1443a2 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:35.360950 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe5787c-2b33-425b-a2d2-e330da1443a2 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:35.362861 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe5787c-2b33-425b-a2d2-e330da1443a2 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:35.366882 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3995/7964] 10.222.0.83 () {58 vars in 1257 bytes} [Mon Aug 29 16:17:35 2022] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 16:17:35.368118 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46269346-602f-44a8-938e-23c6e59d2197 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:35.379582 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46269346-602f-44a8-938e-23c6e59d2197 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:35.385281 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15476c83-4a83-434a-b01a-164d3217f6a5 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:35.386082 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15476c83-4a83-434a-b01a-164d3217f6a5 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:35.386329 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15476c83-4a83-434a-b01a-164d3217f6a5 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:35.386706 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15476c83-4a83-434a-b01a-164d3217f6a5 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:35.387325 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15476c83-4a83-434a-b01a-164d3217f6a5 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:35.390085 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15476c83-4a83-434a-b01a-164d3217f6a5 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:35.391680 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3970/7965] 10.222.0.83 () {58 vars in 1248 bytes} [Mon Aug 29 16:17:35 2022] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 16:17:35.395897 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5787c-2b33-425b-a2d2-e330da1443a2 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:35.406268 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5787c-2b33-425b-a2d2-e330da1443a2 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:35.410900 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e07f6a-54c9-49ee-bef7-bf430117daff tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:35.411583 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e07f6a-54c9-49ee-bef7-bf430117daff tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:35.411862 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e07f6a-54c9-49ee-bef7-bf430117daff tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:35.412137 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e07f6a-54c9-49ee-bef7-bf430117daff tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:35.412842 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e07f6a-54c9-49ee-bef7-bf430117daff tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:35.415603 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e07f6a-54c9-49ee-bef7-bf430117daff tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:35.417147 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3996/7966] 10.222.0.83 () {58 vars in 1242 bytes} [Mon Aug 29 16:17:35 2022] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 29 16:17:35.421034 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15476c83-4a83-434a-b01a-164d3217f6a5 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:35.432202 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15476c83-4a83-434a-b01a-164d3217f6a5 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:35.438096 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb1134-bb9e-4364-93e9-2eb703fdce4b tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:35.438749 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb1134-bb9e-4364-93e9-2eb703fdce4b tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:35.439062 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb1134-bb9e-4364-93e9-2eb703fdce4b tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:35.439356 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb1134-bb9e-4364-93e9-2eb703fdce4b tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:35.439946 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb1134-bb9e-4364-93e9-2eb703fdce4b tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:35.441579 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb1134-bb9e-4364-93e9-2eb703fdce4b tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:35.442860 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3971/7967] 10.222.0.83 () {58 vars in 1251 bytes} [Mon Aug 29 16:17:35 2022] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 16:17:35.446748 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e07f6a-54c9-49ee-bef7-bf430117daff tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:35.457536 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e07f6a-54c9-49ee-bef7-bf430117daff tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:35.462129 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65765f5-eca8-41ab-af76-8ec4fdbc011e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:35.462762 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65765f5-eca8-41ab-af76-8ec4fdbc011e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:35.463088 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65765f5-eca8-41ab-af76-8ec4fdbc011e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:35.463369 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65765f5-eca8-41ab-af76-8ec4fdbc011e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:35.463949 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65765f5-eca8-41ab-af76-8ec4fdbc011e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:35.465517 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65765f5-eca8-41ab-af76-8ec4fdbc011e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:35.467277 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3997/7968] 10.222.0.83 () {58 vars in 1254 bytes} [Mon Aug 29 16:17:35 2022] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 16:17:35.471285 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb1134-bb9e-4364-93e9-2eb703fdce4b tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:35.481326 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb1134-bb9e-4364-93e9-2eb703fdce4b tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:35.486816 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e6e25c-6cdb-4e9e-bfae-c7cfd48a0353 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:35.487500 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6e25c-6cdb-4e9e-bfae-c7cfd48a0353 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:35.487780 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6e25c-6cdb-4e9e-bfae-c7cfd48a0353 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:35.488055 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6e25c-6cdb-4e9e-bfae-c7cfd48a0353 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:35.488646 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e6e25c-6cdb-4e9e-bfae-c7cfd48a0353 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:35.490254 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e6e25c-6cdb-4e9e-bfae-c7cfd48a0353 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:35.494393 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3972/7969] 10.222.0.83 () {58 vars in 1290 bytes} [Mon Aug 29 16:17:35 2022] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 16:17:35.495463 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65765f5-eca8-41ab-af76-8ec4fdbc011e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:35.506211 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65765f5-eca8-41ab-af76-8ec4fdbc011e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:35.510953 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4289e20-aa1c-4ce9-b8f9-682679ee1534 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:35.511645 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4289e20-aa1c-4ce9-b8f9-682679ee1534 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:35.511923 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4289e20-aa1c-4ce9-b8f9-682679ee1534 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:35.512193 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4289e20-aa1c-4ce9-b8f9-682679ee1534 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:35.512775 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4289e20-aa1c-4ce9-b8f9-682679ee1534 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:35.515634 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4289e20-aa1c-4ce9-b8f9-682679ee1534 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:35.516866 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3998/7970] 10.222.0.83 () {58 vars in 1257 bytes} [Mon Aug 29 16:17:35 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 16:17:35.520807 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e6e25c-6cdb-4e9e-bfae-c7cfd48a0353 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:35.532663 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e6e25c-6cdb-4e9e-bfae-c7cfd48a0353 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:35.539423 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b2647-0b4c-4ab4-b1e2-dac76028ebb4 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:35.539738 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b2647-0b4c-4ab4-b1e2-dac76028ebb4 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:35.540208 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b2647-0b4c-4ab4-b1e2-dac76028ebb4 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:35.540556 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b2647-0b4c-4ab4-b1e2-dac76028ebb4 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:35.541632 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59b2647-0b4c-4ab4-b1e2-dac76028ebb4 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:35.542818 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59b2647-0b4c-4ab4-b1e2-dac76028ebb4 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:35.544423 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3973/7971] 10.222.0.83 () {58 vars in 1266 bytes} [Mon Aug 29 16:17:35 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 16:17:35.549026 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4289e20-aa1c-4ce9-b8f9-682679ee1534 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:35.559743 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4289e20-aa1c-4ce9-b8f9-682679ee1534 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:35.565639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de69a2-3280-4f44-bf51-f7fb7dfaa074 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:35.566287 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de69a2-3280-4f44-bf51-f7fb7dfaa074 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:35.566575 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de69a2-3280-4f44-bf51-f7fb7dfaa074 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:35.566838 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de69a2-3280-4f44-bf51-f7fb7dfaa074 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:35.567463 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de69a2-3280-4f44-bf51-f7fb7dfaa074 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:35.569053 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de69a2-3280-4f44-bf51-f7fb7dfaa074 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:35.570224 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 3999/7972] 10.222.0.83 () {58 vars in 1308 bytes} [Mon Aug 29 16:17:35 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 16:17:35.574274 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b2647-0b4c-4ab4-b1e2-dac76028ebb4 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:35.585725 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b2647-0b4c-4ab4-b1e2-dac76028ebb4 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:35.590637 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b8cfd9-fb3a-4207-a925-a9bfe2b5d91c tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:35.591423 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8cfd9-fb3a-4207-a925-a9bfe2b5d91c tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:35.591712 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8cfd9-fb3a-4207-a925-a9bfe2b5d91c tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:35.592287 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8cfd9-fb3a-4207-a925-a9bfe2b5d91c tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:35.593121 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b8cfd9-fb3a-4207-a925-a9bfe2b5d91c tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:35.594741 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b8cfd9-fb3a-4207-a925-a9bfe2b5d91c tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:35.595900 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3974/7973] 10.222.0.83 () {58 vars in 1290 bytes} [Mon Aug 29 16:17:35 2022] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 16:17:35.599878 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de69a2-3280-4f44-bf51-f7fb7dfaa074 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:35.611159 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de69a2-3280-4f44-bf51-f7fb7dfaa074 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:35.615817 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc8ce7-5805-4cdc-ac3e-4218e96d573e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:35.616453 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc8ce7-5805-4cdc-ac3e-4218e96d573e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:35.616731 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc8ce7-5805-4cdc-ac3e-4218e96d573e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:35.617001 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc8ce7-5805-4cdc-ac3e-4218e96d573e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:35.617582 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc8ce7-5805-4cdc-ac3e-4218e96d573e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:35.619207 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc8ce7-5805-4cdc-ac3e-4218e96d573e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:35.620386 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4000/7974] 10.222.0.83 () {58 vars in 1230 bytes} [Mon Aug 29 16:17:35 2022] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 29 16:17:35.625577 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b8cfd9-fb3a-4207-a925-a9bfe2b5d91c tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:35.635893 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b8cfd9-fb3a-4207-a925-a9bfe2b5d91c tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:35.641528 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68954f-addc-4b99-bda6-5293d3eb4196 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:35.642260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68954f-addc-4b99-bda6-5293d3eb4196 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:35.642631 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68954f-addc-4b99-bda6-5293d3eb4196 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:35.642976 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68954f-addc-4b99-bda6-5293d3eb4196 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:35.643728 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab68954f-addc-4b99-bda6-5293d3eb4196 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:35.645330 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab68954f-addc-4b99-bda6-5293d3eb4196 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:35.646461 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3975/7975] 10.222.0.83 () {58 vars in 1227 bytes} [Mon Aug 29 16:17:35 2022] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 16:17:35.650438 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc8ce7-5805-4cdc-ac3e-4218e96d573e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:35.661536 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc8ce7-5805-4cdc-ac3e-4218e96d573e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:35.666139 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7218ec7-5d6b-4b46-9aff-88cf51edae6a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:35.666786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7218ec7-5d6b-4b46-9aff-88cf51edae6a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:35.667094 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7218ec7-5d6b-4b46-9aff-88cf51edae6a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:35.667377 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7218ec7-5d6b-4b46-9aff-88cf51edae6a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:35.667966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7218ec7-5d6b-4b46-9aff-88cf51edae6a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:35.670177 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7218ec7-5d6b-4b46-9aff-88cf51edae6a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:35.671700 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4001/7976] 10.222.0.83 () {58 vars in 1242 bytes} [Mon Aug 29 16:17:35 2022] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 16:17:35.675567 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68954f-addc-4b99-bda6-5293d3eb4196 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:35.686724 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68954f-addc-4b99-bda6-5293d3eb4196 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:35.695927 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f36db6-0c0d-4d7d-bb65-1be87b51496c tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:35.696697 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f36db6-0c0d-4d7d-bb65-1be87b51496c tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:35.697049 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f36db6-0c0d-4d7d-bb65-1be87b51496c tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:35.697393 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f36db6-0c0d-4d7d-bb65-1be87b51496c tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:35.697993 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f36db6-0c0d-4d7d-bb65-1be87b51496c tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:35.699732 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f36db6-0c0d-4d7d-bb65-1be87b51496c tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:35.705013 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3976/7977] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 29 16:17:35 2022] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 29 16:17:35.712936 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7218ec7-5d6b-4b46-9aff-88cf51edae6a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:35.723991 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7218ec7-5d6b-4b46-9aff-88cf51edae6a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:35.728885 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4329f0a-59e3-4c9e-b031-ebbc097b31b7 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:35.729575 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4329f0a-59e3-4c9e-b031-ebbc097b31b7 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:35.729859 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4329f0a-59e3-4c9e-b031-ebbc097b31b7 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:35.730136 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4329f0a-59e3-4c9e-b031-ebbc097b31b7 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:35.730759 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4329f0a-59e3-4c9e-b031-ebbc097b31b7 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:35.732975 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4329f0a-59e3-4c9e-b031-ebbc097b31b7 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:35.734285 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4002/7978] 10.222.0.83 () {58 vars in 1251 bytes} [Mon Aug 29 16:17:35 2022] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 29 16:17:35.738832 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f36db6-0c0d-4d7d-bb65-1be87b51496c tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:35.750865 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f36db6-0c0d-4d7d-bb65-1be87b51496c tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:35.755610 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee5c529-6bd8-4838-9c68-1c467c9002d9 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:35.756260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5c529-6bd8-4838-9c68-1c467c9002d9 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:35.756543 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5c529-6bd8-4838-9c68-1c467c9002d9 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:35.756824 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5c529-6bd8-4838-9c68-1c467c9002d9 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:35.757449 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee5c529-6bd8-4838-9c68-1c467c9002d9 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:35.759211 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee5c529-6bd8-4838-9c68-1c467c9002d9 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:35.760307 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3977/7979] 10.222.0.83 () {58 vars in 1254 bytes} [Mon Aug 29 16:17:35 2022] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 16:17:35.764336 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4329f0a-59e3-4c9e-b031-ebbc097b31b7 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:35.774505 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4329f0a-59e3-4c9e-b031-ebbc097b31b7 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:35.779144 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3abd05-9a0e-4956-aae0-40bd59fbcba2 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:35.779786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3abd05-9a0e-4956-aae0-40bd59fbcba2 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:35.780068 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3abd05-9a0e-4956-aae0-40bd59fbcba2 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:35.780343 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3abd05-9a0e-4956-aae0-40bd59fbcba2 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:35.780937 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3abd05-9a0e-4956-aae0-40bd59fbcba2 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:35.782579 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3abd05-9a0e-4956-aae0-40bd59fbcba2 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:35.786612 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4003/7980] 10.222.0.83 () {58 vars in 1257 bytes} [Mon Aug 29 16:17:35 2022] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 16:17:35.787807 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee5c529-6bd8-4838-9c68-1c467c9002d9 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:35.798885 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee5c529-6bd8-4838-9c68-1c467c9002d9 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:35.803804 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeea516-0de7-46f5-8a7a-5aeaba770ee1 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:35.804462 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeea516-0de7-46f5-8a7a-5aeaba770ee1 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:35.805004 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeea516-0de7-46f5-8a7a-5aeaba770ee1 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:35.805285 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeea516-0de7-46f5-8a7a-5aeaba770ee1 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:35.805878 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeea516-0de7-46f5-8a7a-5aeaba770ee1 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:35.807536 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeea516-0de7-46f5-8a7a-5aeaba770ee1 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:35.811410 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3978/7981] 10.222.0.83 () {58 vars in 1251 bytes} [Mon Aug 29 16:17:35 2022] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 16:17:35.813472 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3abd05-9a0e-4956-aae0-40bd59fbcba2 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:35.823776 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3abd05-9a0e-4956-aae0-40bd59fbcba2 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:35.828978 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce86a0b-1dcc-4327-bc31-5c670ca9b467 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:35.829626 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce86a0b-1dcc-4327-bc31-5c670ca9b467 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:35.829907 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce86a0b-1dcc-4327-bc31-5c670ca9b467 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:35.830183 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce86a0b-1dcc-4327-bc31-5c670ca9b467 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:35.830774 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce86a0b-1dcc-4327-bc31-5c670ca9b467 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:35.832428 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce86a0b-1dcc-4327-bc31-5c670ca9b467 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:35.833623 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4004/7982] 10.222.0.83 () {58 vars in 1257 bytes} [Mon Aug 29 16:17:35 2022] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 29 16:17:35.837631 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeea516-0de7-46f5-8a7a-5aeaba770ee1 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:35.847670 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeea516-0de7-46f5-8a7a-5aeaba770ee1 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:35.852608 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77cbefd-8c9e-4938-a79b-7e24f891ab70 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:35.853260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77cbefd-8c9e-4938-a79b-7e24f891ab70 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:35.853541 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77cbefd-8c9e-4938-a79b-7e24f891ab70 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:35.853816 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77cbefd-8c9e-4938-a79b-7e24f891ab70 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:35.854410 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77cbefd-8c9e-4938-a79b-7e24f891ab70 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:35.856047 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77cbefd-8c9e-4938-a79b-7e24f891ab70 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:35.857827 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3979/7983] 10.222.0.83 () {58 vars in 1293 bytes} [Mon Aug 29 16:17:35 2022] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 16:17:35.862366 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce86a0b-1dcc-4327-bc31-5c670ca9b467 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:35.872208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce86a0b-1dcc-4327-bc31-5c670ca9b467 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:35.877994 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c285094-4c12-4562-b43b-dc4a8d1b9614 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:35.878784 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c285094-4c12-4562-b43b-dc4a8d1b9614 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:35.879163 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c285094-4c12-4562-b43b-dc4a8d1b9614 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:35.879510 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c285094-4c12-4562-b43b-dc4a8d1b9614 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:35.880111 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c285094-4c12-4562-b43b-dc4a8d1b9614 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:35.881711 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c285094-4c12-4562-b43b-dc4a8d1b9614 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:35.882917 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4005/7984] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:17:35 2022] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 16:17:35.887010 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77cbefd-8c9e-4938-a79b-7e24f891ab70 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:35.897876 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77cbefd-8c9e-4938-a79b-7e24f891ab70 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:35.902699 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89779d33-c5e3-4d7e-8a63-6f8aa764669e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:35.903373 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89779d33-c5e3-4d7e-8a63-6f8aa764669e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:35.903661 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89779d33-c5e3-4d7e-8a63-6f8aa764669e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:35.903990 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89779d33-c5e3-4d7e-8a63-6f8aa764669e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:35.904943 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89779d33-c5e3-4d7e-8a63-6f8aa764669e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:35.906554 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89779d33-c5e3-4d7e-8a63-6f8aa764669e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:35.907876 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3980/7985] 10.222.0.83 () {58 vars in 1230 bytes} [Mon Aug 29 16:17:35 2022] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 16:17:35.911770 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c285094-4c12-4562-b43b-dc4a8d1b9614 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:35.922903 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c285094-4c12-4562-b43b-dc4a8d1b9614 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:35.930086 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33d691-9c60-4994-8aee-3f652913311a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:35.930740 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33d691-9c60-4994-8aee-3f652913311a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:35.931017 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33d691-9c60-4994-8aee-3f652913311a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:35.931311 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33d691-9c60-4994-8aee-3f652913311a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:35.931895 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33d691-9c60-4994-8aee-3f652913311a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:35.933534 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33d691-9c60-4994-8aee-3f652913311a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:35.934912 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4006/7986] 10.222.0.83 () {58 vars in 1212 bytes} [Mon Aug 29 16:17:35 2022] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 16:17:35.939372 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89779d33-c5e3-4d7e-8a63-6f8aa764669e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:35.951261 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89779d33-c5e3-4d7e-8a63-6f8aa764669e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:35.956801 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049234e6-0118-4c59-aba9-ad8ca561c578 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:35.957486 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049234e6-0118-4c59-aba9-ad8ca561c578 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:35.957794 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049234e6-0118-4c59-aba9-ad8ca561c578 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:35.958070 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049234e6-0118-4c59-aba9-ad8ca561c578 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:35.958662 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049234e6-0118-4c59-aba9-ad8ca561c578 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:35.960290 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049234e6-0118-4c59-aba9-ad8ca561c578 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:35.961560 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3981/7987] 10.222.0.83 () {58 vars in 1227 bytes} [Mon Aug 29 16:17:35 2022] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 16:17:35.965440 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33d691-9c60-4994-8aee-3f652913311a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:35.976357 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33d691-9c60-4994-8aee-3f652913311a tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:35.981443 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97792c6-6071-46c1-8636-6bb8ebb8983e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:35.982814 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97792c6-6071-46c1-8636-6bb8ebb8983e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:35.983127 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97792c6-6071-46c1-8636-6bb8ebb8983e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:35.983995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97792c6-6071-46c1-8636-6bb8ebb8983e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:35.984347 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97792c6-6071-46c1-8636-6bb8ebb8983e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:35.985993 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97792c6-6071-46c1-8636-6bb8ebb8983e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:35.989951 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4007/7988] 10.222.0.83 () {58 vars in 1215 bytes} [Mon Aug 29 16:17:35 2022] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 16:17:35.990929 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049234e6-0118-4c59-aba9-ad8ca561c578 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:36.001336 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049234e6-0118-4c59-aba9-ad8ca561c578 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:36.006227 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc9446-e174-48ad-a56f-acce79aac252 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:36.006902 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc9446-e174-48ad-a56f-acce79aac252 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:36.007224 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc9446-e174-48ad-a56f-acce79aac252 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:36.007507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc9446-e174-48ad-a56f-acce79aac252 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:36.008130 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc9446-e174-48ad-a56f-acce79aac252 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:36.009760 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc9446-e174-48ad-a56f-acce79aac252 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:36.014389 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3982/7989] 10.222.0.83 () {58 vars in 1218 bytes} [Mon Aug 29 16:17:35 2022] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 29 16:17:36.015634 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97792c6-6071-46c1-8636-6bb8ebb8983e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:36.026115 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97792c6-6071-46c1-8636-6bb8ebb8983e tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:36.031801 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f65b4d4-46cf-426b-a69f-19781af4e932 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:36.032455 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65b4d4-46cf-426b-a69f-19781af4e932 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:36.032737 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65b4d4-46cf-426b-a69f-19781af4e932 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:36.033015 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65b4d4-46cf-426b-a69f-19781af4e932 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:36.033602 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f65b4d4-46cf-426b-a69f-19781af4e932 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:36.035278 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f65b4d4-46cf-426b-a69f-19781af4e932 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:36.039930 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4008/7990] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:17:36 2022] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 16:17:36.041105 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc9446-e174-48ad-a56f-acce79aac252 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:36.052780 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc9446-e174-48ad-a56f-acce79aac252 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:36.058778 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d20094-86ee-43c3-a68f-9a82bded23b6 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:36.059740 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d20094-86ee-43c3-a68f-9a82bded23b6 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:36.060354 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d20094-86ee-43c3-a68f-9a82bded23b6 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:36.060858 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d20094-86ee-43c3-a68f-9a82bded23b6 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:36.061804 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d20094-86ee-43c3-a68f-9a82bded23b6 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:36.063749 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d20094-86ee-43c3-a68f-9a82bded23b6 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:36.068640 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3983/7991] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:17:36 2022] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 16:17:36.069983 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f65b4d4-46cf-426b-a69f-19781af4e932 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:36.080516 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f65b4d4-46cf-426b-a69f-19781af4e932 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:36.085596 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d5990-7bfe-4215-a6ca-c0669c98fff1 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:36.086359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d5990-7bfe-4215-a6ca-c0669c98fff1 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:36.086722 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d5990-7bfe-4215-a6ca-c0669c98fff1 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:36.087002 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d5990-7bfe-4215-a6ca-c0669c98fff1 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:36.087627 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432d5990-7bfe-4215-a6ca-c0669c98fff1 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:36.089266 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432d5990-7bfe-4215-a6ca-c0669c98fff1 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:36.090476 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4009/7992] 10.222.0.83 () {58 vars in 1260 bytes} [Mon Aug 29 16:17:36 2022] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 16:17:36.095175 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d20094-86ee-43c3-a68f-9a82bded23b6 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:36.105688 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d20094-86ee-43c3-a68f-9a82bded23b6 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:36.111139 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111228d-9add-4f25-a22e-18032fa42b84 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:36.111791 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111228d-9add-4f25-a22e-18032fa42b84 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:36.112077 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111228d-9add-4f25-a22e-18032fa42b84 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:36.112358 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111228d-9add-4f25-a22e-18032fa42b84 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:36.112953 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111228d-9add-4f25-a22e-18032fa42b84 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:36.114562 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111228d-9add-4f25-a22e-18032fa42b84 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:36.118534 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3984/7993] 10.222.0.83 () {58 vars in 1263 bytes} [Mon Aug 29 16:17:36 2022] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 16:17:36.119752 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d5990-7bfe-4215-a6ca-c0669c98fff1 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:36.130942 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d5990-7bfe-4215-a6ca-c0669c98fff1 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:36.135907 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c75364-8beb-4b9f-8373-c95c66b69650 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:36.136623 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c75364-8beb-4b9f-8373-c95c66b69650 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:36.136930 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c75364-8beb-4b9f-8373-c95c66b69650 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:36.137260 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c75364-8beb-4b9f-8373-c95c66b69650 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:36.137790 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c75364-8beb-4b9f-8373-c95c66b69650 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:36.139891 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c75364-8beb-4b9f-8373-c95c66b69650 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:36.141079 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4010/7994] 10.222.0.83 () {58 vars in 1230 bytes} [Mon Aug 29 16:17:36 2022] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 16:17:36.145286 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111228d-9add-4f25-a22e-18032fa42b84 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:36.156966 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111228d-9add-4f25-a22e-18032fa42b84 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:36.161677 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415b8c2-98d5-49f8-88b4-9a488ffd571c tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:36.162324 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415b8c2-98d5-49f8-88b4-9a488ffd571c tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:36.162605 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415b8c2-98d5-49f8-88b4-9a488ffd571c tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:36.162880 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415b8c2-98d5-49f8-88b4-9a488ffd571c tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:36.163521 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415b8c2-98d5-49f8-88b4-9a488ffd571c tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:36.165110 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415b8c2-98d5-49f8-88b4-9a488ffd571c tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:36.169108 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3985/7995] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:17:36 2022] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 29 16:17:36.170964 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c75364-8beb-4b9f-8373-c95c66b69650 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:36.181560 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c75364-8beb-4b9f-8373-c95c66b69650 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:36.186435 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ebaa8-1c78-47a8-8fba-140911adcaee tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:36.187149 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ebaa8-1c78-47a8-8fba-140911adcaee tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:36.187434 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ebaa8-1c78-47a8-8fba-140911adcaee tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:36.187707 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ebaa8-1c78-47a8-8fba-140911adcaee tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:36.188305 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721ebaa8-1c78-47a8-8fba-140911adcaee tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:36.189910 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721ebaa8-1c78-47a8-8fba-140911adcaee tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:36.195570 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4011/7996] 10.222.0.83 () {58 vars in 1278 bytes} [Mon Aug 29 16:17:36 2022] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 29 16:17:36.196769 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415b8c2-98d5-49f8-88b4-9a488ffd571c tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:36.207432 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415b8c2-98d5-49f8-88b4-9a488ffd571c tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:36.212177 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099ed3b-656d-483c-b236-887285ab7c20 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:36.212872 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099ed3b-656d-483c-b236-887285ab7c20 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:36.213216 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099ed3b-656d-483c-b236-887285ab7c20 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:36.213554 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099ed3b-656d-483c-b236-887285ab7c20 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/3198c6c8228d4778876f8d7cc678f4ba` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:36.221753 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8099ed3b-656d-483c-b236-887285ab7c20 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 16:17:36.226938 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-8099ed3b-656d-483c-b236-887285ab7c20 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Could not find domain: 3198c6c8228d4778876f8d7cc678f4ba.: keystone.exception.DomainNotFound: Could not find domain: 3198c6c8228d4778876f8d7cc678f4ba. Aug 29 16:17:36.226938 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:17:36.226938 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 29 16:17:36.226938 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 29 16:17:36.226938 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 16:17:36.226938 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 16:17:36.226938 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 16:17:36.226938 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 16:17:36.226938 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 3198c6c8228d4778876f8d7cc678f4ba. Aug 29 16:17:36.226938 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:17:36.226938 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 16:17:36.226938 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:17:36.226938 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:17:36.226938 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:17:36.226938 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:17:36.228104 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:17:36.228104 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:17:36.228104 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:17:36.228104 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:17:36.228104 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:17:36.228104 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:17:36.228104 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:17:36.228104 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:17:36.228104 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 29 16:17:36.228104 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 29 16:17:36.228104 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 16:17:36.228104 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 16:17:36.228104 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 16:17:36.228104 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 16:17:36.228104 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:17:36.228104 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:17:36.233096 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 16:17:36.233096 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 16:17:36.233096 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 16:17:36.233096 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 16:17:36.233096 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 16:17:36.233096 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 16:17:36.233096 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 16:17:36.233096 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 16:17:36.233096 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 16:17:36.233096 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 16:17:36.233096 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 16:17:36.233096 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 16:17:36.233096 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 16:17:36.233096 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 16:17:36.233096 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 29 16:17:36.233096 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 16:17:36.233096 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 3198c6c8228d4778876f8d7cc678f4ba. Aug 29 16:17:36.234752 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:17:36.234752 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3986/7997] 10.222.0.83 () {60 vars in 1249 bytes} [Mon Aug 29 16:17:36 2022] PATCH /identity/v3/domains/3198c6c8228d4778876f8d7cc678f4ba => generated 112 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 16:17:36.234927 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ebaa8-1c78-47a8-8fba-140911adcaee tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:36.240902 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:36.244993 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ebaa8-1c78-47a8-8fba-140911adcaee tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:36.252466 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b022a155-4e01-4561-b305-395ff3558ec2 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:36.253938 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022a155-4e01-4561-b305-395ff3558ec2 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:36.253938 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022a155-4e01-4561-b305-395ff3558ec2 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:36.254156 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022a155-4e01-4561-b305-395ff3558ec2 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/04230967cd10495fa8c944d86c371011` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:36.261849 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b022a155-4e01-4561-b305-395ff3558ec2 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 16:17:36.272867 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-b022a155-4e01-4561-b305-395ff3558ec2 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Could not find domain: 04230967cd10495fa8c944d86c371011.: keystone.exception.DomainNotFound: Could not find domain: 04230967cd10495fa8c944d86c371011. Aug 29 16:17:36.272867 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:17:36.272867 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 29 16:17:36.272867 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 29 16:17:36.272867 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 16:17:36.272867 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 16:17:36.272867 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 16:17:36.272867 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 16:17:36.272867 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 04230967cd10495fa8c944d86c371011. Aug 29 16:17:36.272867 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:17:36.272867 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 16:17:36.272867 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:17:36.272867 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:17:36.272867 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:17:36.272867 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:17:36.274428 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:17:36.274428 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:17:36.274428 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:17:36.274428 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:17:36.274428 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:17:36.274428 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:17:36.274428 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:17:36.274428 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:17:36.274428 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 29 16:17:36.274428 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 29 16:17:36.274428 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 16:17:36.274428 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 16:17:36.274428 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 16:17:36.274428 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 16:17:36.274428 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:17:36.274428 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:17:36.275578 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 16:17:36.275578 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 16:17:36.275578 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 16:17:36.275578 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 16:17:36.275578 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 16:17:36.275578 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 16:17:36.275578 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 16:17:36.275578 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 16:17:36.275578 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 16:17:36.275578 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 16:17:36.275578 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 16:17:36.275578 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 16:17:36.275578 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 16:17:36.275578 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 16:17:36.275578 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 29 16:17:36.275578 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 16:17:36.275578 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 04230967cd10495fa8c944d86c371011. Aug 29 16:17:36.276720 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:17:36.276720 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4012/7998] 10.222.0.83 () {60 vars in 1249 bytes} [Mon Aug 29 16:17:36 2022] PATCH /identity/v3/domains/04230967cd10495fa8c944d86c371011 => generated 112 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 16:17:36.276860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099ed3b-656d-483c-b236-887285ab7c20 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:36.285172 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099ed3b-656d-483c-b236-887285ab7c20 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:36.290191 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba8275-0141-41a7-be70-77a8afae70a4 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '662bc109d6e3404fb7dcd6f912c13e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee5fc354cbdb4508a89c8a878d8f913a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:36.290893 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba8275-0141-41a7-be70-77a8afae70a4 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:36.291252 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba8275-0141-41a7-be70-77a8afae70a4 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:36.291522 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba8275-0141-41a7-be70-77a8afae70a4 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] PATH_INFO: `/v3/domains/c4f3d5d230fd46c290026f28a00ae2bd` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:36.300469 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ba8275-0141-41a7-be70-77a8afae70a4 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 16:17:36.305881 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-32ba8275-0141-41a7-be70-77a8afae70a4 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Could not find domain: c4f3d5d230fd46c290026f28a00ae2bd.: keystone.exception.DomainNotFound: Could not find domain: c4f3d5d230fd46c290026f28a00ae2bd. Aug 29 16:17:36.305881 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:17:36.305881 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 29 16:17:36.305881 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 29 16:17:36.305881 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 16:17:36.305881 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 16:17:36.305881 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 16:17:36.305881 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 16:17:36.305881 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: c4f3d5d230fd46c290026f28a00ae2bd. Aug 29 16:17:36.305881 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:17:36.305881 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 16:17:36.305881 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:17:36.305881 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:17:36.305881 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:17:36.305881 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:17:36.310036 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:17:36.310036 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:17:36.310036 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:17:36.310036 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:17:36.310036 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:17:36.310036 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:17:36.310036 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:17:36.310036 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:17:36.310036 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 29 16:17:36.310036 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 29 16:17:36.310036 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 16:17:36.310036 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 16:17:36.310036 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 16:17:36.310036 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 16:17:36.310036 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:17:36.310036 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:17:36.311138 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 16:17:36.311138 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 16:17:36.311138 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 16:17:36.311138 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 16:17:36.311138 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 16:17:36.311138 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 16:17:36.311138 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 16:17:36.311138 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 16:17:36.311138 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 16:17:36.311138 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 16:17:36.311138 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 16:17:36.311138 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 16:17:36.311138 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 16:17:36.311138 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 16:17:36.311138 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 29 16:17:36.311138 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 16:17:36.311138 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: c4f3d5d230fd46c290026f28a00ae2bd. Aug 29 16:17:36.312341 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:17:36.312341 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3987/7999] 10.222.0.83 () {60 vars in 1249 bytes} [Mon Aug 29 16:17:36 2022] PATCH /identity/v3/domains/c4f3d5d230fd46c290026f28a00ae2bd => generated 112 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 29 16:17:36.312475 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b022a155-4e01-4561-b305-395ff3558ec2 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:36.313762 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b022a155-4e01-4561-b305-395ff3558ec2 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:36.394187 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b022a155-4e01-4561-b305-395ff3558ec2 tempest-DomainConfigurationTestJSON-2103983838 tempest-DomainConfigurationTestJSON-2103983838-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:36.398858 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8850d2-b35c-4c68-b4f4-568eabd57537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:36.399531 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8850d2-b35c-4c68-b4f4-568eabd57537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:36.399809 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8850d2-b35c-4c68-b4f4-568eabd57537 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:36.400083 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8850d2-b35c-4c68-b4f4-568eabd57537 admin admin] PATH_INFO: `/v3/users/e40f1e3fce49495b803eae3cc7ac8df0` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:36.401241 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8850d2-b35c-4c68-b4f4-568eabd57537 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e40f1e3fce49495b803eae3cc7ac8df0)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:36.403212 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8850d2-b35c-4c68-b4f4-568eabd57537 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:36.455126 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5b8850d2-b35c-4c68-b4f4-568eabd57537 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e40f1e3fce49495b803eae3cc7ac8df0'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:36.455954 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5b8850d2-b35c-4c68-b4f4-568eabd57537 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e40f1e3fce49495b803eae3cc7ac8df0'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:36.463593 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5b8850d2-b35c-4c68-b4f4-568eabd57537 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e40f1e3fce49495b803eae3cc7ac8df0'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:36.471924 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5b8850d2-b35c-4c68-b4f4-568eabd57537 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e40f1e3fce49495b803eae3cc7ac8df0'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:36.472840 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5b8850d2-b35c-4c68-b4f4-568eabd57537 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e40f1e3fce49495b803eae3cc7ac8df0'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:36.492105 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4013/8000] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:17:36 2022] DELETE /identity/v3/users/e40f1e3fce49495b803eae3cc7ac8df0 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:36.496722 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9f3b6-9c85-40a3-b263-119b9c2a2c5f None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:36.497008 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9f3b6-9c85-40a3-b263-119b9c2a2c5f None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:36.497301 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9f3b6-9c85-40a3-b263-119b9c2a2c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:36.516989 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-a0e9f3b6-9c85-40a3-b263-119b9c2a2c5f None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:36.518196 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a0e9f3b6-9c85-40a3-b263-119b9c2a2c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:36.587651 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3988/8001] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:17:36.598311 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8850d2-b35c-4c68-b4f4-568eabd57537 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:36.599729 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5b8850d2-b35c-4c68-b4f4-568eabd57537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:36.661297 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8850d2-b35c-4c68-b4f4-568eabd57537 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:36.665218 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12f56a-708b-4fce-ade5-9d2c87f2fc4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:36.665847 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12f56a-708b-4fce-ade5-9d2c87f2fc4b service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:36.666132 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12f56a-708b-4fce-ade5-9d2c87f2fc4b service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:36.666406 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12f56a-708b-4fce-ade5-9d2c87f2fc4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:36.676356 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e12f56a-708b-4fce-ade5-9d2c87f2fc4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:36.677794 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e12f56a-708b-4fce-ade5-9d2c87f2fc4b service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:36.688103 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4014/8002] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:17:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:17:36.981962 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e9f3b6-9c85-40a3-b263-119b9c2a2c5f None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:36.984072 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a0e9f3b6-9c85-40a3-b263-119b9c2a2c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:37.008840 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e9f3b6-9c85-40a3-b263-119b9c2a2c5f None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:37.014999 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef8917e-47a9-4abd-b083-21d1a1add31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:37.015685 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef8917e-47a9-4abd-b083-21d1a1add31a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:37.015966 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef8917e-47a9-4abd-b083-21d1a1add31a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:37.016238 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef8917e-47a9-4abd-b083-21d1a1add31a admin admin] PATH_INFO: `/v3/projects/ba0b1d6df9c24ccb9a274d107d08781f` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:37.017470 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef8917e-47a9-4abd-b083-21d1a1add31a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba0b1d6df9c24ccb9a274d107d08781f)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:37.019473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef8917e-47a9-4abd-b083-21d1a1add31a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:37.060720 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:37.071525 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fef8917e-47a9-4abd-b083-21d1a1add31a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba0b1d6df9c24ccb9a274d107d08781f', 'request_id': 'req-fef8917e-47a9-4abd-b083-21d1a1add31a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:37.078097 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fef8917e-47a9-4abd-b083-21d1a1add31a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba0b1d6df9c24ccb9a274d107d08781f', 'request_id': 'req-fef8917e-47a9-4abd-b083-21d1a1add31a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:37.085720 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fef8917e-47a9-4abd-b083-21d1a1add31a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba0b1d6df9c24ccb9a274d107d08781f', 'request_id': 'req-fef8917e-47a9-4abd-b083-21d1a1add31a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:37.098624 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fef8917e-47a9-4abd-b083-21d1a1add31a admin admin] The token cache is being invalidate because project ba0b1d6df9c24ccb9a274d107d08781f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:17:37.098964 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fef8917e-47a9-4abd-b083-21d1a1add31a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:37.099658 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fef8917e-47a9-4abd-b083-21d1a1add31a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:37.101191 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3989/8003] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:17:36 2022] DELETE /identity/v3/projects/ba0b1d6df9c24ccb9a274d107d08781f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:37.105188 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12f56a-708b-4fce-ade5-9d2c87f2fc4b service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:37.117002 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12f56a-708b-4fce-ade5-9d2c87f2fc4b service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:37.132231 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:37.185783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4f494-ff67-47a4-ad9f-b746a754e54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:37.186445 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4f494-ff67-47a4-ad9f-b746a754e54d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:37.186726 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4f494-ff67-47a4-ad9f-b746a754e54d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:37.187000 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4f494-ff67-47a4-ad9f-b746a754e54d admin admin] PATH_INFO: `/v3/users/662bc109d6e3404fb7dcd6f912c13e63` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:37.188275 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de4f494-ff67-47a4-ad9f-b746a754e54d admin admin] RBAC: Authorizing `identity:delete_user(user_id=662bc109d6e3404fb7dcd6f912c13e63)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:37.190247 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de4f494-ff67-47a4-ad9f-b746a754e54d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:37.240539 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3de4f494-ff67-47a4-ad9f-b746a754e54d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '662bc109d6e3404fb7dcd6f912c13e63'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:37.241323 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3de4f494-ff67-47a4-ad9f-b746a754e54d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '662bc109d6e3404fb7dcd6f912c13e63'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:37.249309 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3de4f494-ff67-47a4-ad9f-b746a754e54d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '662bc109d6e3404fb7dcd6f912c13e63'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:37.256682 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3de4f494-ff67-47a4-ad9f-b746a754e54d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '662bc109d6e3404fb7dcd6f912c13e63'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:37.257409 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3de4f494-ff67-47a4-ad9f-b746a754e54d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '662bc109d6e3404fb7dcd6f912c13e63'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:37.277259 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4015/8004] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:17:37 2022] DELETE /identity/v3/users/662bc109d6e3404fb7dcd6f912c13e63 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:37.579924 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef8917e-47a9-4abd-b083-21d1a1add31a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:37.581555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-fef8917e-47a9-4abd-b083-21d1a1add31a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:37.604499 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef8917e-47a9-4abd-b083-21d1a1add31a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:37.667119 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13033350-76d1-416b-a9be-d1708fd43055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:37.667797 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13033350-76d1-416b-a9be-d1708fd43055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:37.668076 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13033350-76d1-416b-a9be-d1708fd43055 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:37.668349 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13033350-76d1-416b-a9be-d1708fd43055 admin admin] PATH_INFO: `/v3/projects/ee5fc354cbdb4508a89c8a878d8f913a` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:37.669658 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13033350-76d1-416b-a9be-d1708fd43055 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee5fc354cbdb4508a89c8a878d8f913a)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:37.671645 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13033350-76d1-416b-a9be-d1708fd43055 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:37.723506 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-13033350-76d1-416b-a9be-d1708fd43055 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee5fc354cbdb4508a89c8a878d8f913a', 'request_id': 'req-13033350-76d1-416b-a9be-d1708fd43055'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:37.729426 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-13033350-76d1-416b-a9be-d1708fd43055 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee5fc354cbdb4508a89c8a878d8f913a', 'request_id': 'req-13033350-76d1-416b-a9be-d1708fd43055'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:37.737076 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-13033350-76d1-416b-a9be-d1708fd43055 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee5fc354cbdb4508a89c8a878d8f913a', 'request_id': 'req-13033350-76d1-416b-a9be-d1708fd43055'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:37.751412 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-13033350-76d1-416b-a9be-d1708fd43055 admin admin] The token cache is being invalidate because project ee5fc354cbdb4508a89c8a878d8f913a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:17:37.751703 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-13033350-76d1-416b-a9be-d1708fd43055 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:37.752373 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-13033350-76d1-416b-a9be-d1708fd43055 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:37.754154 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3990/8005] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:17:37 2022] DELETE /identity/v3/projects/ee5fc354cbdb4508a89c8a878d8f913a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:37.758852 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a56cba-96d0-4743-9f7b-ee8e07733e44 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:37.759194 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a56cba-96d0-4743-9f7b-ee8e07733e44 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:37.759475 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a56cba-96d0-4743-9f7b-ee8e07733e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:37.781496 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-e7a56cba-96d0-4743-9f7b-ee8e07733e44 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:37.782902 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e7a56cba-96d0-4743-9f7b-ee8e07733e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:37.845745 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4016/8006] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:17:37.853537 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fcb8f-6a89-45ac-ace9-4cbee9a2011c None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:37.853860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fcb8f-6a89-45ac-ace9-4cbee9a2011c None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:37.854090 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fcb8f-6a89-45ac-ace9-4cbee9a2011c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:37.877074 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-e56fcb8f-6a89-45ac-ace9-4cbee9a2011c None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:37.878349 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e56fcb8f-6a89-45ac-ace9-4cbee9a2011c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:37.887861 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3991/8007] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:17:37.892345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a56cba-96d0-4743-9f7b-ee8e07733e44 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:37.902451 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a56cba-96d0-4743-9f7b-ee8e07733e44 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:37.908736 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374cf3c-9e38-4ce4-861b-a2546080b65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:37.909452 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374cf3c-9e38-4ce4-861b-a2546080b65e admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:37.909819 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374cf3c-9e38-4ce4-861b-a2546080b65e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:37.910492 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374cf3c-9e38-4ce4-861b-a2546080b65e admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:37.910876 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a374cf3c-9e38-4ce4-861b-a2546080b65e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:17:37.911275 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a374cf3c-9e38-4ce4-861b-a2546080b65e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:37.913368 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a374cf3c-9e38-4ce4-861b-a2546080b65e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:37.926759 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4017/8008] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:17:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:17:37.931585 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fcb8f-6a89-45ac-ace9-4cbee9a2011c None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:37.943045 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fcb8f-6a89-45ac-ace9-4cbee9a2011c None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:37.948130 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd61703-137b-4012-bdb0-e0f9ade948f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:37.949155 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd61703-137b-4012-bdb0-e0f9ade948f3 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:37.949367 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd61703-137b-4012-bdb0-e0f9ade948f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:37.949647 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd61703-137b-4012-bdb0-e0f9ade948f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:37.953370 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd61703-137b-4012-bdb0-e0f9ade948f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:37.955369 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd61703-137b-4012-bdb0-e0f9ade948f3 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:37.987287 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3992/8009] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:17:37 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:17:37.991474 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374cf3c-9e38-4ce4-861b-a2546080b65e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:38.003795 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374cf3c-9e38-4ce4-861b-a2546080b65e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:38.025249 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:38.066594 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7575de-73b9-4ad3-a76c-b7e20ae4390e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:38.067254 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7575de-73b9-4ad3-a76c-b7e20ae4390e admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:38.067536 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7575de-73b9-4ad3-a76c-b7e20ae4390e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:38.067808 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7575de-73b9-4ad3-a76c-b7e20ae4390e admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:38.068440 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7575de-73b9-4ad3-a76c-b7e20ae4390e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:38.070363 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7575de-73b9-4ad3-a76c-b7e20ae4390e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:38.093105 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4018/8010] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:17:37 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:17:38.097142 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd61703-137b-4012-bdb0-e0f9ade948f3 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:38.108881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd61703-137b-4012-bdb0-e0f9ade948f3 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:38.113603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747b0c9-2ecf-47e9-8379-63378d48ab16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:38.114206 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747b0c9-2ecf-47e9-8379-63378d48ab16 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:38.114484 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747b0c9-2ecf-47e9-8379-63378d48ab16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:38.114756 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747b0c9-2ecf-47e9-8379-63378d48ab16 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:38.115436 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6747b0c9-2ecf-47e9-8379-63378d48ab16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:38.117036 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6747b0c9-2ecf-47e9-8379-63378d48ab16 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:38.129490 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3993/8011] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:17:38.133879 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7575de-73b9-4ad3-a76c-b7e20ae4390e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:38.146063 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7575de-73b9-4ad3-a76c-b7e20ae4390e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:38.150781 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da8bee4-fba8-4a05-96f2-2aa89a873641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:38.151556 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8bee4-fba8-4a05-96f2-2aa89a873641 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:38.151845 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8bee4-fba8-4a05-96f2-2aa89a873641 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:38.152119 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8bee4-fba8-4a05-96f2-2aa89a873641 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:38.152796 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da8bee4-fba8-4a05-96f2-2aa89a873641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:38.155237 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da8bee4-fba8-4a05-96f2-2aa89a873641 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:38.166342 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4019/8012] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:17:38.170745 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747b0c9-2ecf-47e9-8379-63378d48ab16 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:38.181906 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747b0c9-2ecf-47e9-8379-63378d48ab16 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:38.187829 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33711edf-af5b-4d32-ad5a-b91dafe553bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:38.188503 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33711edf-af5b-4d32-ad5a-b91dafe553bc admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:38.188805 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33711edf-af5b-4d32-ad5a-b91dafe553bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:38.189077 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33711edf-af5b-4d32-ad5a-b91dafe553bc admin admin] PATH_INFO: `/v3/projects/ea21793e98644c4683e5def96220e42a/users/8a187654433e4aadb79abc9897f56c76/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:38.203270 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:38.207205 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33711edf-af5b-4d32-ad5a-b91dafe553bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea21793e98644c4683e5def96220e42a, user_id=8a187654433e4aadb79abc9897f56c76, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:38.210634 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33711edf-af5b-4d32-ad5a-b91dafe553bc admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:38.227935 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3994/8013] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:17:38 2022] PUT /identity/v3/projects/ea21793e98644c4683e5def96220e42a/users/8a187654433e4aadb79abc9897f56c76/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:38.239826 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e733e-0719-46a9-878e-09c647ffbccb None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:38.240121 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e733e-0719-46a9-878e-09c647ffbccb None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:38.240421 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e733e-0719-46a9-878e-09c647ffbccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:38.270534 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-cb2e733e-0719-46a9-878e-09c647ffbccb None None] MFA Rules not processed for user `8a187654433e4aadb79abc9897f56c76`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:38.271794 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-cb2e733e-0719-46a9-878e-09c647ffbccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:38.340238 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4020/8014] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:17:38.346014 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33711edf-af5b-4d32-ad5a-b91dafe553bc admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:38.411984 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33711edf-af5b-4d32-ad5a-b91dafe553bc admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:38.416864 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90304e4a-f654-4d05-8cdc-aa98bf0008e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:38.417491 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90304e4a-f654-4d05-8cdc-aa98bf0008e0 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:38.417773 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90304e4a-f654-4d05-8cdc-aa98bf0008e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:38.418050 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90304e4a-f654-4d05-8cdc-aa98bf0008e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:38.418730 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90304e4a-f654-4d05-8cdc-aa98bf0008e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:38.421565 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90304e4a-f654-4d05-8cdc-aa98bf0008e0 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:38.452729 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3995/8015] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:17:38 2022] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:17:38.456615 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e733e-0719-46a9-878e-09c647ffbccb None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:38.468783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e733e-0719-46a9-878e-09c647ffbccb None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:38.530678 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc6c24-6fb5-4b8c-b7cf-a9b758783b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:38.531141 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc6c24-6fb5-4b8c-b7cf-a9b758783b16 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:38.531418 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc6c24-6fb5-4b8c-b7cf-a9b758783b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:38.531685 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc6c24-6fb5-4b8c-b7cf-a9b758783b16 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:38.532336 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dc6c24-6fb5-4b8c-b7cf-a9b758783b16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:38.534282 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dc6c24-6fb5-4b8c-b7cf-a9b758783b16 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:38.560713 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4021/8016] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:17:38 2022] POST /identity/v3/users => generated 297 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:17:38.562502 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90304e4a-f654-4d05-8cdc-aa98bf0008e0 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:38.573750 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90304e4a-f654-4d05-8cdc-aa98bf0008e0 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:38.579660 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ab1ee-4ccd-45d3-9889-67f8ddb1266a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:38.580286 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ab1ee-4ccd-45d3-9889-67f8ddb1266a admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:38.580561 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ab1ee-4ccd-45d3-9889-67f8ddb1266a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:38.580836 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ab1ee-4ccd-45d3-9889-67f8ddb1266a admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:38.581487 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8ab1ee-4ccd-45d3-9889-67f8ddb1266a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:38.583123 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8ab1ee-4ccd-45d3-9889-67f8ddb1266a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:38.598275 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3996/8017] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:17:38.599558 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc6c24-6fb5-4b8c-b7cf-a9b758783b16 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:38.611282 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc6c24-6fb5-4b8c-b7cf-a9b758783b16 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:38.616049 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336389fe-b533-459d-97d4-607e3c37e19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:38.616727 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336389fe-b533-459d-97d4-607e3c37e19f admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:38.617005 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336389fe-b533-459d-97d4-607e3c37e19f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:38.617273 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336389fe-b533-459d-97d4-607e3c37e19f admin admin] PATH_INFO: `/v3/projects/ec98720dbf7f4101add8a4eed8124ec2/users/aa08cad3d52746df8ce80b136426b9bd/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:38.634994 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336389fe-b533-459d-97d4-607e3c37e19f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec98720dbf7f4101add8a4eed8124ec2, user_id=aa08cad3d52746df8ce80b136426b9bd, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:38.637697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336389fe-b533-459d-97d4-607e3c37e19f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:38.647387 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:38.657668 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4022/8018] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:17:38 2022] PUT /identity/v3/projects/ec98720dbf7f4101add8a4eed8124ec2/users/aa08cad3d52746df8ce80b136426b9bd/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:38.661814 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ab1ee-4ccd-45d3-9889-67f8ddb1266a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:38.673709 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ab1ee-4ccd-45d3-9889-67f8ddb1266a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:38.737965 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270afeb4-a599-4684-9f21-1e8e52cd02fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:38.738587 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270afeb4-a599-4684-9f21-1e8e52cd02fa admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:38.738867 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270afeb4-a599-4684-9f21-1e8e52cd02fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:38.739237 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270afeb4-a599-4684-9f21-1e8e52cd02fa admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:38.744958 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270afeb4-a599-4684-9f21-1e8e52cd02fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:38.744958 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270afeb4-a599-4684-9f21-1e8e52cd02fa admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:38.754225 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3997/8019] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:17:38.758221 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336389fe-b533-459d-97d4-607e3c37e19f admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:38.768712 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336389fe-b533-459d-97d4-607e3c37e19f admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:38.773376 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b069361e-9ca0-4edf-aa7f-9d10b4ee248c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:38.774033 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069361e-9ca0-4edf-aa7f-9d10b4ee248c admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:38.774312 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069361e-9ca0-4edf-aa7f-9d10b4ee248c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:38.774582 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069361e-9ca0-4edf-aa7f-9d10b4ee248c admin admin] PATH_INFO: `/v3/projects/ec98720dbf7f4101add8a4eed8124ec2/users/aa08cad3d52746df8ce80b136426b9bd/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:38.776551 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b069361e-9ca0-4edf-aa7f-9d10b4ee248c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec98720dbf7f4101add8a4eed8124ec2, user_id=aa08cad3d52746df8ce80b136426b9bd, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:38.779705 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b069361e-9ca0-4edf-aa7f-9d10b4ee248c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:38.790733 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4023/8020] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:17:38 2022] PUT /identity/v3/projects/ec98720dbf7f4101add8a4eed8124ec2/users/aa08cad3d52746df8ce80b136426b9bd/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:38.801587 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9330b-ab37-4fb2-8104-813d1a988c0c None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:38.801877 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9330b-ab37-4fb2-8104-813d1a988c0c None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:38.802155 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9330b-ab37-4fb2-8104-813d1a988c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:38.831821 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-b5c9330b-ab37-4fb2-8104-813d1a988c0c None None] MFA Rules not processed for user `aa08cad3d52746df8ce80b136426b9bd`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:38.833048 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b5c9330b-ab37-4fb2-8104-813d1a988c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:38.887209 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:38.910159 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3998/8021] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:38 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:17:38.915415 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b069361e-9ca0-4edf-aa7f-9d10b4ee248c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:38.928677 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b069361e-9ca0-4edf-aa7f-9d10b4ee248c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:38.934228 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe5f60-e30f-4e23-8a37-beacab6753b3 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa08cad3d52746df8ce80b136426b9bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec98720dbf7f4101add8a4eed8124ec2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:38.934678 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe5f60-e30f-4e23-8a37-beacab6753b3 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:38.935645 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe5f60-e30f-4e23-8a37-beacab6753b3 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:38.935967 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe5f60-e30f-4e23-8a37-beacab6753b3 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:38.936680 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffe5f60-e30f-4e23-8a37-beacab6753b3 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:38.938284 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffe5f60-e30f-4e23-8a37-beacab6753b3 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:38.948286 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-bffe5f60-e30f-4e23-8a37-beacab6753b3 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Invalid input for field 'name': '' is too short Aug 29 16:17:38.948286 n-d-836830-13 devstack@keystone.service[82149]: Failed validating 'minLength' in schema['properties']['name']: Aug 29 16:17:38.948286 n-d-836830-13 devstack@keystone.service[82149]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 29 16:17:38.948286 n-d-836830-13 devstack@keystone.service[82149]: On instance['name']: Aug 29 16:17:38.948286 n-d-836830-13 devstack@keystone.service[82149]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Aug 29 16:17:38.948286 n-d-836830-13 devstack@keystone.service[82149]: Failed validating 'minLength' in schema['properties']['name']: Aug 29 16:17:38.948286 n-d-836830-13 devstack@keystone.service[82149]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 29 16:17:38.948286 n-d-836830-13 devstack@keystone.service[82149]: On instance['name']: Aug 29 16:17:38.948286 n-d-836830-13 devstack@keystone.service[82149]: '' Aug 29 16:17:38.948286 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:17:38.948286 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 29 16:17:38.948286 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 29 16:17:38.948286 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 16:17:38.948286 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise error Aug 29 16:17:38.948286 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Aug 29 16:17:38.948286 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:17:38.948286 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Aug 29 16:17:38.948286 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 29 16:17:38.948286 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:17:38.948286 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application On instance['name']: Aug 29 16:17:38.948286 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application '' Aug 29 16:17:38.948286 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:17:38.948286 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 16:17:38.949963 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:17:38.949963 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:17:38.949963 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:17:38.949963 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:17:38.949963 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:17:38.949963 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:17:38.949963 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:17:38.949963 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:17:38.949963 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:17:38.949963 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:17:38.949963 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:17:38.949963 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:17:38.949963 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Aug 29 16:17:38.949963 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Aug 29 16:17:38.949963 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 29 16:17:38.949963 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 29 16:17:38.949963 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 29 16:17:38.951152 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 29 16:17:38.951152 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Aug 29 16:17:38.951152 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:17:38.951152 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Aug 29 16:17:38.951152 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 29 16:17:38.951152 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:17:38.951152 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application On instance['name']: Aug 29 16:17:38.951152 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application '' Aug 29 16:17:38.951152 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:17:38.951152 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4024/8022] 10.222.0.83 () {60 vars in 1149 bytes} [Mon Aug 29 16:17:38 2022] POST /identity/v3/domains => generated 283 bytes in 34 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 29 16:17:38.955246 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c9330b-ab37-4fb2-8104-813d1a988c0c None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:38.964543 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c9330b-ab37-4fb2-8104-813d1a988c0c None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:38.970012 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48442cb-e238-4898-9a40-0ace8da27b06 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa08cad3d52746df8ce80b136426b9bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec98720dbf7f4101add8a4eed8124ec2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:38.970617 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48442cb-e238-4898-9a40-0ace8da27b06 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:38.970897 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48442cb-e238-4898-9a40-0ace8da27b06 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:38.971211 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48442cb-e238-4898-9a40-0ace8da27b06 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:38.971886 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48442cb-e238-4898-9a40-0ace8da27b06 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:38.973475 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48442cb-e238-4898-9a40-0ace8da27b06 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:38.980586 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-e48442cb-e238-4898-9a40-0ace8da27b06 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 16:17:38.980586 n-d-836830-13 devstack@keystone.service[82148]: Failed validating 'maxLength' in schema['properties']['name']: Aug 29 16:17:38.980586 n-d-836830-13 devstack@keystone.service[82148]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 29 16:17:38.980586 n-d-836830-13 devstack@keystone.service[82148]: On instance['name']: Aug 29 16:17:38.980586 n-d-836830-13 devstack@keystone.service[82148]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 16:17:38.980586 n-d-836830-13 devstack@keystone.service[82148]: Failed validating 'maxLength' in schema['properties']['name']: Aug 29 16:17:38.980586 n-d-836830-13 devstack@keystone.service[82148]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 29 16:17:38.980586 n-d-836830-13 devstack@keystone.service[82148]: On instance['name']: Aug 29 16:17:38.980586 n-d-836830-13 devstack@keystone.service[82148]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 29 16:17:38.980586 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:17:38.980586 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 29 16:17:38.980586 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 29 16:17:38.980586 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 16:17:38.980586 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise error Aug 29 16:17:38.980586 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 16:17:38.980586 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:17:38.980586 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Aug 29 16:17:38.980586 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 29 16:17:38.980586 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:17:38.982575 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application On instance['name']: Aug 29 16:17:38.982575 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 29 16:17:38.982575 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:17:38.982575 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 16:17:38.982575 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:17:38.982575 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:17:38.982575 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:17:38.982575 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:17:38.982575 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:17:38.982575 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:17:38.982575 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:17:38.982575 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:17:38.982575 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:17:38.982575 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:17:38.982575 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:17:38.982575 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:17:38.982575 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Aug 29 16:17:38.982575 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Aug 29 16:17:38.984245 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 29 16:17:38.984245 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 29 16:17:38.984245 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 29 16:17:38.984245 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 29 16:17:38.984245 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 16:17:38.984245 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:17:38.984245 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Aug 29 16:17:38.984245 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 29 16:17:38.984245 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:17:38.984245 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application On instance['name']: Aug 29 16:17:38.984245 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 29 16:17:38.984245 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:17:38.984245 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 3999/8023] 10.222.0.83 () {60 vars in 1149 bytes} [Mon Aug 29 16:17:38 2022] POST /identity/v3/domains => generated 412 bytes in 27 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 29 16:17:38.987126 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe5f60-e30f-4e23-8a37-beacab6753b3 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:38.997453 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe5f60-e30f-4e23-8a37-beacab6753b3 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:39.004183 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e586e-4fc1-47fb-a4de-2a2b6d85dc0d tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa08cad3d52746df8ce80b136426b9bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec98720dbf7f4101add8a4eed8124ec2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:39.004800 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e586e-4fc1-47fb-a4de-2a2b6d85dc0d tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:39.005085 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e586e-4fc1-47fb-a4de-2a2b6d85dc0d tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:39.005361 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e586e-4fc1-47fb-a4de-2a2b6d85dc0d tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:39.006087 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e586e-4fc1-47fb-a4de-2a2b6d85dc0d tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:39.007733 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e586e-4fc1-47fb-a4de-2a2b6d85dc0d tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:39.029617 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4025/8024] 10.222.0.83 () {60 vars in 1149 bytes} [Mon Aug 29 16:17:38 2022] POST /identity/v3/domains => generated 276 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:17:39.030869 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48442cb-e238-4898-9a40-0ace8da27b06 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:39.042485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48442cb-e238-4898-9a40-0ace8da27b06 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:39.104313 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930e32d-d643-420a-bad3-7a1d8a4d5511 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa08cad3d52746df8ce80b136426b9bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec98720dbf7f4101add8a4eed8124ec2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:39.104956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930e32d-d643-420a-bad3-7a1d8a4d5511 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:39.105242 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930e32d-d643-420a-bad3-7a1d8a4d5511 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:39.105524 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930e32d-d643-420a-bad3-7a1d8a4d5511 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] PATH_INFO: `/v3/domains/74f45f78b94649e4a0029451b74cdd90` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:39.117273 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e930e32d-d643-420a-bad3-7a1d8a4d5511 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=74f45f78b94649e4a0029451b74cdd90)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:39.119101 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e930e32d-d643-420a-bad3-7a1d8a4d5511 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:39.135519 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-e930e32d-d643-420a-bad3-7a1d8a4d5511 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Aug 29 16:17:39.135519 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:17:39.135519 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:17:39.135519 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:17:39.135519 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:17:39.135519 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:17:39.135519 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:17:39.135519 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:17:39.135519 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:17:39.135519 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:17:39.135519 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:17:39.135519 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:17:39.135519 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 151, in delete Aug 29 16:17:39.135519 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_domain( Aug 29 16:17:39.136700 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:17:39.136700 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:17:39.136700 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 802, in delete_domain Aug 29 16:17:39.136700 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application self._delete_domain(domain, initiator) Aug 29 16:17:39.136700 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 815, in _delete_domain Aug 29 16:17:39.136700 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Aug 29 16:17:39.136700 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Aug 29 16:17:39.136700 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:17:39.137242 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4000/8025] 10.222.0.83 () {58 vars in 1230 bytes} [Mon Aug 29 16:17:39 2022] DELETE /identity/v3/domains/74f45f78b94649e4a0029451b74cdd90 => generated 120 bytes in 106 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 29 16:17:39.142026 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e586e-4fc1-47fb-a4de-2a2b6d85dc0d tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:39.154940 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e586e-4fc1-47fb-a4de-2a2b6d85dc0d tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:39.159707 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd245d75-55f0-4a4e-a8ad-aceba4bbdd93 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa08cad3d52746df8ce80b136426b9bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec98720dbf7f4101add8a4eed8124ec2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:39.160342 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd245d75-55f0-4a4e-a8ad-aceba4bbdd93 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:39.160622 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd245d75-55f0-4a4e-a8ad-aceba4bbdd93 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:39.160893 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd245d75-55f0-4a4e-a8ad-aceba4bbdd93 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] PATH_INFO: `/v3/domains/74f45f78b94649e4a0029451b74cdd90` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:39.162120 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd245d75-55f0-4a4e-a8ad-aceba4bbdd93 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=74f45f78b94649e4a0029451b74cdd90)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:39.163749 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd245d75-55f0-4a4e-a8ad-aceba4bbdd93 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:39.186268 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-dd245d75-55f0-4a4e-a8ad-aceba4bbdd93 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '74f45f78b94649e4a0029451b74cdd90'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:39.187124 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-dd245d75-55f0-4a4e-a8ad-aceba4bbdd93 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '74f45f78b94649e4a0029451b74cdd90'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:39.213046 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-dd245d75-55f0-4a4e-a8ad-aceba4bbdd93 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '74f45f78b94649e4a0029451b74cdd90'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:39.213682 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-dd245d75-55f0-4a4e-a8ad-aceba4bbdd93 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '74f45f78b94649e4a0029451b74cdd90'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:39.216116 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4026/8026] 10.222.0.83 () {60 vars in 1249 bytes} [Mon Aug 29 16:17:39 2022] PATCH /identity/v3/domains/74f45f78b94649e4a0029451b74cdd90 => generated 277 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:17:39.220692 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930e32d-d643-420a-bad3-7a1d8a4d5511 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:39.222436 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e930e32d-d643-420a-bad3-7a1d8a4d5511 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:39.235940 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930e32d-d643-420a-bad3-7a1d8a4d5511 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:39.303265 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50131f-dd0e-424c-a3f2-fe059388eb26 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa08cad3d52746df8ce80b136426b9bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec98720dbf7f4101add8a4eed8124ec2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:39.304016 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50131f-dd0e-424c-a3f2-fe059388eb26 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:39.304376 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50131f-dd0e-424c-a3f2-fe059388eb26 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:39.304901 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50131f-dd0e-424c-a3f2-fe059388eb26 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] PATH_INFO: `/v3/domains/74f45f78b94649e4a0029451b74cdd90` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:39.318790 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa50131f-dd0e-424c-a3f2-fe059388eb26 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=74f45f78b94649e4a0029451b74cdd90)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:39.320539 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa50131f-dd0e-424c-a3f2-fe059388eb26 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:39.345749 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-aa50131f-dd0e-424c-a3f2-fe059388eb26 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '74f45f78b94649e4a0029451b74cdd90'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:39.350109 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-aa50131f-dd0e-424c-a3f2-fe059388eb26 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '74f45f78b94649e4a0029451b74cdd90'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:39.396824 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:39.412110 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-aa50131f-dd0e-424c-a3f2-fe059388eb26 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74f45f78b94649e4a0029451b74cdd90', 'request_id': 'req-aa50131f-dd0e-424c-a3f2-fe059388eb26'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:39.417795 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-aa50131f-dd0e-424c-a3f2-fe059388eb26 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74f45f78b94649e4a0029451b74cdd90', 'request_id': 'req-aa50131f-dd0e-424c-a3f2-fe059388eb26'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:39.428177 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-aa50131f-dd0e-424c-a3f2-fe059388eb26 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74f45f78b94649e4a0029451b74cdd90', 'request_id': 'req-aa50131f-dd0e-424c-a3f2-fe059388eb26'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:39.442927 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-aa50131f-dd0e-424c-a3f2-fe059388eb26 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] The token cache is being invalidate because project 74f45f78b94649e4a0029451b74cdd90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:17:39.443248 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-aa50131f-dd0e-424c-a3f2-fe059388eb26 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:39.443930 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-aa50131f-dd0e-424c-a3f2-fe059388eb26 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:39.451652 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-aa50131f-dd0e-424c-a3f2-fe059388eb26 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '74f45f78b94649e4a0029451b74cdd90', 'request_id': 'req-aa50131f-dd0e-424c-a3f2-fe059388eb26'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:39.452303 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-aa50131f-dd0e-424c-a3f2-fe059388eb26 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '74f45f78b94649e4a0029451b74cdd90', 'request_id': 'req-aa50131f-dd0e-424c-a3f2-fe059388eb26'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:39.452924 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-aa50131f-dd0e-424c-a3f2-fe059388eb26 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '74f45f78b94649e4a0029451b74cdd90', 'request_id': 'req-aa50131f-dd0e-424c-a3f2-fe059388eb26'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:39.461647 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4001/8027] 10.222.0.83 () {58 vars in 1230 bytes} [Mon Aug 29 16:17:39 2022] DELETE /identity/v3/domains/74f45f78b94649e4a0029451b74cdd90 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:39.466802 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd245d75-55f0-4a4e-a8ad-aceba4bbdd93 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:39.477413 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd245d75-55f0-4a4e-a8ad-aceba4bbdd93 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:39.537825 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fa176-ddd6-4081-818d-7814cea9e20f tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa08cad3d52746df8ce80b136426b9bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec98720dbf7f4101add8a4eed8124ec2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:39.538476 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fa176-ddd6-4081-818d-7814cea9e20f tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:39.538771 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fa176-ddd6-4081-818d-7814cea9e20f tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:39.539093 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fa176-ddd6-4081-818d-7814cea9e20f tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] PATH_INFO: `/v3/domains/fa0f973e7fd9459e8d3a5438ffbf2e5d` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:39.546767 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328fa176-ddd6-4081-818d-7814cea9e20f tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 16:17:39.551720 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-328fa176-ddd6-4081-818d-7814cea9e20f tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Could not find domain: fa0f973e7fd9459e8d3a5438ffbf2e5d.: keystone.exception.DomainNotFound: Could not find domain: fa0f973e7fd9459e8d3a5438ffbf2e5d. Aug 29 16:17:39.551720 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:17:39.551720 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 29 16:17:39.551720 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 29 16:17:39.551720 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 16:17:39.551720 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 16:17:39.551720 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 16:17:39.551720 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 16:17:39.551720 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: fa0f973e7fd9459e8d3a5438ffbf2e5d. Aug 29 16:17:39.551720 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:17:39.551720 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 16:17:39.551720 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:17:39.551720 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:17:39.551720 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:17:39.551720 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:17:39.552833 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:17:39.552833 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:17:39.552833 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:17:39.552833 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:17:39.552833 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:17:39.552833 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:17:39.552833 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:17:39.552833 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:17:39.552833 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 150, in delete Aug 29 16:17:39.552833 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_domain') Aug 29 16:17:39.552833 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 16:17:39.552833 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 16:17:39.552833 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 16:17:39.552833 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 16:17:39.552833 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:17:39.552833 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:17:39.553865 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 16:17:39.553865 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 16:17:39.553865 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 16:17:39.553865 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 16:17:39.553865 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 16:17:39.553865 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application with Lock( Aug 29 16:17:39.553865 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 16:17:39.553865 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self._enter() Aug 29 16:17:39.553865 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 16:17:39.553865 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 16:17:39.553865 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 16:17:39.553865 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.creator() Aug 29 16:17:39.553865 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 16:17:39.553865 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application created_value = creator( Aug 29 16:17:39.553865 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 29 16:17:39.553865 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 16:17:39.553865 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: fa0f973e7fd9459e8d3a5438ffbf2e5d. Aug 29 16:17:39.555163 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:17:39.555163 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4027/8028] 10.222.0.83 () {58 vars in 1230 bytes} [Mon Aug 29 16:17:39 2022] DELETE /identity/v3/domains/fa0f973e7fd9459e8d3a5438ffbf2e5d => generated 112 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 16:17:39.558707 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50131f-dd0e-424c-a3f2-fe059388eb26 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:39.561300 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-aa50131f-dd0e-424c-a3f2-fe059388eb26 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:39.574435 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50131f-dd0e-424c-a3f2-fe059388eb26 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:39.580573 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c8698-66fb-4282-8c84-6ad5aaf32c07 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa08cad3d52746df8ce80b136426b9bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec98720dbf7f4101add8a4eed8124ec2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:39.581303 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c8698-66fb-4282-8c84-6ad5aaf32c07 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:39.581587 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c8698-66fb-4282-8c84-6ad5aaf32c07 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:39.581887 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c8698-66fb-4282-8c84-6ad5aaf32c07 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:39.582555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c8698-66fb-4282-8c84-6ad5aaf32c07 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:39.584214 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c8698-66fb-4282-8c84-6ad5aaf32c07 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:39.602627 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4002/8029] 10.222.0.83 () {60 vars in 1149 bytes} [Mon Aug 29 16:17:39 2022] POST /identity/v3/domains => generated 251 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:17:39.607427 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fa176-ddd6-4081-818d-7814cea9e20f tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:39.617881 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fa176-ddd6-4081-818d-7814cea9e20f tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:39.680287 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd2601-e7ff-4a4b-a900-a731ada18261 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa08cad3d52746df8ce80b136426b9bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec98720dbf7f4101add8a4eed8124ec2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:39.680887 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd2601-e7ff-4a4b-a900-a731ada18261 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:39.681172 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd2601-e7ff-4a4b-a900-a731ada18261 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:39.681566 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd2601-e7ff-4a4b-a900-a731ada18261 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:39.682234 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd2601-e7ff-4a4b-a900-a731ada18261 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:39.683871 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd2601-e7ff-4a4b-a900-a731ada18261 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:39.692202 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.sql.core [None req-5bbd2601-e7ff-4a4b-a900-a731ada18261 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-91601974' for key 'project.ixu_project_name_domain_id'") Aug 29 16:17:39.692202 n-d-836830-13 devstack@keystone.service[82149]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 29 16:17:39.692202 n-d-836830-13 devstack@keystone.service[82149]: [parameters: {'id': '9fb521aefa0143c98c6fafaa6e48d866', 'name': 'tempest-domain-dup-91601974', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Aug 29 16:17:39.692202 n-d-836830-13 devstack@keystone.service[82149]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82149) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 16:17:39.715426 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [None req-5bbd2601-e7ff-4a4b-a900-a731ada18261 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-91601974.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-91601974. Aug 29 16:17:39.715426 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:17:39.715426 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 16:17:39.715426 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 16:17:39.715426 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 16:17:39.715426 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 16:17:39.715426 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 16:17:39.715426 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 16:17:39.715426 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 16:17:39.715426 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application conn.query(q) Aug 29 16:17:39.715426 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 16:17:39.715426 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 16:17:39.715426 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 16:17:39.717039 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application result.read() Aug 29 16:17:39.717039 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 16:17:39.717039 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 16:17:39.717039 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 16:17:39.717039 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 16:17:39.717039 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 16:17:39.717039 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 16:17:39.717039 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 16:17:39.717039 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 16:17:39.717039 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-tempest-domain-dup-91601974' for key 'project.ixu_project_name_domain_id'") Aug 29 16:17:39.717039 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:17:39.717039 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 16:17:39.717039 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:17:39.717039 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:17:39.717039 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 16:17:39.717039 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 16:17:39.717039 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 29 16:17:39.717039 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 29 16:17:39.718337 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 16:17:39.718337 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application next(self.gen) Aug 29 16:17:39.718337 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 16:17:39.718337 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application yield resource Aug 29 16:17:39.718337 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 16:17:39.718337 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application next(self.gen) Aug 29 16:17:39.718337 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 16:17:39.718337 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 16:17:39.718337 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 16:17:39.718337 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 16:17:39.718337 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 16:17:39.718337 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise self.value Aug 29 16:17:39.718337 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 16:17:39.718337 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 16:17:39.718337 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 16:17:39.718337 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application session.commit() Aug 29 16:17:39.718337 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 16:17:39.719497 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 16:17:39.719497 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 16:17:39.719497 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 16:17:39.719497 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 16:17:39.719497 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self.session.flush() Aug 29 16:17:39.719497 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 16:17:39.719497 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 16:17:39.719497 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 16:17:39.719497 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 16:17:39.719497 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 16:17:39.719497 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application compat.raise_( Aug 29 16:17:39.719497 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 16:17:39.719497 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception Aug 29 16:17:39.719497 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 16:17:39.719497 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 16:17:39.719497 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 16:17:39.719497 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 16:17:39.720501 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 16:17:39.720501 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 16:17:39.720501 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 16:17:39.720501 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 16:17:39.720501 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 29 16:17:39.720501 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 29 16:17:39.720501 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 16:17:39.720501 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 16:17:39.720501 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 16:17:39.720501 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 16:17:39.720501 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 16:17:39.720501 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 16:17:39.720501 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 16:17:39.720501 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 16:17:39.720501 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 16:17:39.721468 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 16:17:39.721468 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 16:17:39.721468 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception Aug 29 16:17:39.721468 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 16:17:39.721468 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 16:17:39.721468 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 16:17:39.721468 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 16:17:39.721468 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 16:17:39.721468 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 16:17:39.721468 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 16:17:39.721468 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application conn.query(q) Aug 29 16:17:39.721468 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 16:17:39.721468 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 16:17:39.721468 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 16:17:39.721468 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application result.read() Aug 29 16:17:39.721468 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 16:17:39.721468 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 16:17:39.722715 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 16:17:39.722715 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 16:17:39.722715 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 16:17:39.722715 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 16:17:39.722715 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 16:17:39.722715 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 16:17:39.722715 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-91601974' for key 'project.ixu_project_name_domain_id'") Aug 29 16:17:39.722715 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 29 16:17:39.722715 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application [parameters: {'id': '9fb521aefa0143c98c6fafaa6e48d866', 'name': 'tempest-domain-dup-91601974', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Aug 29 16:17:39.722715 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 16:17:39.722715 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:17:39.722715 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 16:17:39.722715 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:17:39.722715 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:17:39.723773 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 29 16:17:39.723773 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 29 16:17:39.723773 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 16:17:39.723773 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 16:17:39.723773 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-domain-dup-91601974. Aug 29 16:17:39.723773 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:17:39.723773 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 16:17:39.723773 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:17:39.723773 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:17:39.723773 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:17:39.723773 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:17:39.723773 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:17:39.723773 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:17:39.723773 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:17:39.723773 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:17:39.723773 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:17:39.723773 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:17:39.725174 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:17:39.725174 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:17:39.725174 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Aug 29 16:17:39.725174 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Aug 29 16:17:39.725174 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:17:39.725174 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:17:39.725174 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Aug 29 16:17:39.725174 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Aug 29 16:17:39.725174 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:17:39.725174 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:17:39.725174 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 29 16:17:39.725174 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 29 16:17:39.725174 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-91601974. Aug 29 16:17:39.725174 n-d-836830-13 devstack@keystone.service[82149]: ERROR keystone.server.flask.application Aug 29 16:17:39.725174 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4028/8030] 10.222.0.83 () {60 vars in 1149 bytes} [Mon Aug 29 16:17:39 2022] POST /identity/v3/domains => generated 210 bytes in 111 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 29 16:17:39.726176 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c8698-66fb-4282-8c84-6ad5aaf32c07 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:39.734202 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c8698-66fb-4282-8c84-6ad5aaf32c07 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:39.740459 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26e294-1630-4884-a663-45a59414b4fa tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa08cad3d52746df8ce80b136426b9bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec98720dbf7f4101add8a4eed8124ec2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:39.741222 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26e294-1630-4884-a663-45a59414b4fa tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:39.741926 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26e294-1630-4884-a663-45a59414b4fa tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:39.741926 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26e294-1630-4884-a663-45a59414b4fa tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] PATH_INFO: `/v3/domains/c9745819e86147659297927875d4a278` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:39.754940 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab26e294-1630-4884-a663-45a59414b4fa tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=c9745819e86147659297927875d4a278)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:39.756795 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab26e294-1630-4884-a663-45a59414b4fa tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:39.779911 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ab26e294-1630-4884-a663-45a59414b4fa tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'c9745819e86147659297927875d4a278'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:39.780750 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ab26e294-1630-4884-a663-45a59414b4fa tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'c9745819e86147659297927875d4a278'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:39.807261 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ab26e294-1630-4884-a663-45a59414b4fa tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'c9745819e86147659297927875d4a278'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:39.807836 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ab26e294-1630-4884-a663-45a59414b4fa tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'c9745819e86147659297927875d4a278'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:39.810825 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4003/8031] 10.222.0.83 () {60 vars in 1249 bytes} [Mon Aug 29 16:17:39 2022] PATCH /identity/v3/domains/c9745819e86147659297927875d4a278 => generated 252 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:17:39.816448 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd2601-e7ff-4a4b-a900-a731ada18261 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:39.818282 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5bbd2601-e7ff-4a4b-a900-a731ada18261 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:39.831663 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd2601-e7ff-4a4b-a900-a731ada18261 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:39.851807 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:39.895614 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71123f36-62f0-49ed-a067-5cc3ebbf839c tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa08cad3d52746df8ce80b136426b9bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec98720dbf7f4101add8a4eed8124ec2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:39.896396 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71123f36-62f0-49ed-a067-5cc3ebbf839c tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:39.896785 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71123f36-62f0-49ed-a067-5cc3ebbf839c tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:39.897256 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71123f36-62f0-49ed-a067-5cc3ebbf839c tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] PATH_INFO: `/v3/domains/c9745819e86147659297927875d4a278` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:39.910617 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71123f36-62f0-49ed-a067-5cc3ebbf839c tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=c9745819e86147659297927875d4a278)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:39.912310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71123f36-62f0-49ed-a067-5cc3ebbf839c tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:39.936232 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-71123f36-62f0-49ed-a067-5cc3ebbf839c tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'c9745819e86147659297927875d4a278'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:39.945757 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-71123f36-62f0-49ed-a067-5cc3ebbf839c tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'c9745819e86147659297927875d4a278'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:39.986498 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-71123f36-62f0-49ed-a067-5cc3ebbf839c tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9745819e86147659297927875d4a278', 'request_id': 'req-71123f36-62f0-49ed-a067-5cc3ebbf839c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:39.992164 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-71123f36-62f0-49ed-a067-5cc3ebbf839c tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9745819e86147659297927875d4a278', 'request_id': 'req-71123f36-62f0-49ed-a067-5cc3ebbf839c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:39.999382 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-71123f36-62f0-49ed-a067-5cc3ebbf839c tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9745819e86147659297927875d4a278', 'request_id': 'req-71123f36-62f0-49ed-a067-5cc3ebbf839c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:40.015713 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-71123f36-62f0-49ed-a067-5cc3ebbf839c tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] The token cache is being invalidate because project c9745819e86147659297927875d4a278 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:17:40.016096 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-71123f36-62f0-49ed-a067-5cc3ebbf839c tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:40.016938 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-71123f36-62f0-49ed-a067-5cc3ebbf839c tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:40.024904 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-71123f36-62f0-49ed-a067-5cc3ebbf839c tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'c9745819e86147659297927875d4a278', 'request_id': 'req-71123f36-62f0-49ed-a067-5cc3ebbf839c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:40.025580 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-71123f36-62f0-49ed-a067-5cc3ebbf839c tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'c9745819e86147659297927875d4a278', 'request_id': 'req-71123f36-62f0-49ed-a067-5cc3ebbf839c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:40.026215 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-71123f36-62f0-49ed-a067-5cc3ebbf839c tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'c9745819e86147659297927875d4a278', 'request_id': 'req-71123f36-62f0-49ed-a067-5cc3ebbf839c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:40.034930 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4029/8032] 10.222.0.83 () {58 vars in 1230 bytes} [Mon Aug 29 16:17:39 2022] DELETE /identity/v3/domains/c9745819e86147659297927875d4a278 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:40.040188 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26e294-1630-4884-a663-45a59414b4fa tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:40.050840 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26e294-1630-4884-a663-45a59414b4fa tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:40.115002 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e145871-c51b-4c3d-9c1a-6f7f78dab298 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa08cad3d52746df8ce80b136426b9bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec98720dbf7f4101add8a4eed8124ec2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:40.115689 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e145871-c51b-4c3d-9c1a-6f7f78dab298 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:40.115973 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e145871-c51b-4c3d-9c1a-6f7f78dab298 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:40.116247 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e145871-c51b-4c3d-9c1a-6f7f78dab298 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] PATH_INFO: `/v3/domains/74f45f78b94649e4a0029451b74cdd90` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:40.124030 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e145871-c51b-4c3d-9c1a-6f7f78dab298 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 16:17:40.129710 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application [None req-7e145871-c51b-4c3d-9c1a-6f7f78dab298 tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Could not find domain: 74f45f78b94649e4a0029451b74cdd90.: keystone.exception.DomainNotFound: Could not find domain: 74f45f78b94649e4a0029451b74cdd90. Aug 29 16:17:40.129710 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:17:40.129710 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 29 16:17:40.129710 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 29 16:17:40.129710 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 16:17:40.129710 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 16:17:40.129710 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 16:17:40.129710 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 16:17:40.129710 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 74f45f78b94649e4a0029451b74cdd90. Aug 29 16:17:40.129710 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:17:40.129710 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 16:17:40.129710 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:17:40.129710 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:17:40.129710 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:17:40.129710 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:17:40.130863 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:17:40.130863 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:17:40.130863 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:17:40.130863 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:17:40.130863 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:17:40.130863 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:17:40.130863 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:17:40.130863 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:17:40.130863 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 29 16:17:40.130863 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 29 16:17:40.130863 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 16:17:40.130863 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 16:17:40.130863 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 16:17:40.130863 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 16:17:40.130863 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:17:40.130863 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:17:40.131914 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 16:17:40.131914 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 16:17:40.131914 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 16:17:40.131914 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 16:17:40.131914 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 16:17:40.131914 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application with Lock( Aug 29 16:17:40.131914 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 16:17:40.131914 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self._enter() Aug 29 16:17:40.131914 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 16:17:40.131914 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 16:17:40.131914 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 16:17:40.131914 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application return self.creator() Aug 29 16:17:40.131914 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 16:17:40.131914 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application created_value = creator( Aug 29 16:17:40.131914 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 29 16:17:40.131914 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 16:17:40.131914 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 74f45f78b94649e4a0029451b74cdd90. Aug 29 16:17:40.132920 n-d-836830-13 devstack@keystone.service[82148]: ERROR keystone.server.flask.application Aug 29 16:17:40.132920 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4004/8033] 10.222.0.83 () {60 vars in 1249 bytes} [Mon Aug 29 16:17:40 2022] PATCH /identity/v3/domains/74f45f78b94649e4a0029451b74cdd90 => generated 112 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 16:17:40.134947 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71123f36-62f0-49ed-a067-5cc3ebbf839c tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:40.136415 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-71123f36-62f0-49ed-a067-5cc3ebbf839c tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:40.210047 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71123f36-62f0-49ed-a067-5cc3ebbf839c tempest-DomainsNegativeTestJSON-382522308 tempest-DomainsNegativeTestJSON-382522308-project-admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:40.214751 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fabf5ba-db15-4e48-8731-6bb8fe240770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:40.215414 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fabf5ba-db15-4e48-8731-6bb8fe240770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:40.215697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fabf5ba-db15-4e48-8731-6bb8fe240770 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:40.215969 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fabf5ba-db15-4e48-8731-6bb8fe240770 admin admin] PATH_INFO: `/v3/users/8a187654433e4aadb79abc9897f56c76` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:40.217868 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fabf5ba-db15-4e48-8731-6bb8fe240770 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a187654433e4aadb79abc9897f56c76)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:40.219951 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fabf5ba-db15-4e48-8731-6bb8fe240770 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:40.221571 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:40.273105 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0fabf5ba-db15-4e48-8731-6bb8fe240770 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a187654433e4aadb79abc9897f56c76'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:40.273773 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0fabf5ba-db15-4e48-8731-6bb8fe240770 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a187654433e4aadb79abc9897f56c76'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:40.283431 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0fabf5ba-db15-4e48-8731-6bb8fe240770 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a187654433e4aadb79abc9897f56c76'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:40.290750 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0fabf5ba-db15-4e48-8731-6bb8fe240770 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a187654433e4aadb79abc9897f56c76'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:40.291463 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0fabf5ba-db15-4e48-8731-6bb8fe240770 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a187654433e4aadb79abc9897f56c76'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:40.311426 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4030/8034] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:17:40 2022] DELETE /identity/v3/users/8a187654433e4aadb79abc9897f56c76 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:40.317324 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aab206-dda0-421e-8aaf-d794f5b5d4eb None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:40.317616 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aab206-dda0-421e-8aaf-d794f5b5d4eb None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:40.317897 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aab206-dda0-421e-8aaf-d794f5b5d4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:40.340106 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-c2aab206-dda0-421e-8aaf-d794f5b5d4eb None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:40.341927 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c2aab206-dda0-421e-8aaf-d794f5b5d4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:40.379954 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:40.411915 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4005/8035] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:17:40.422142 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fabf5ba-db15-4e48-8731-6bb8fe240770 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:40.423862 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0fabf5ba-db15-4e48-8731-6bb8fe240770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:40.491503 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fabf5ba-db15-4e48-8731-6bb8fe240770 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:40.495183 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c23e5f-94fa-43f7-be93-6d51ba159f52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:40.495788 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c23e5f-94fa-43f7-be93-6d51ba159f52 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:40.496064 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c23e5f-94fa-43f7-be93-6d51ba159f52 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:40.496337 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c23e5f-94fa-43f7-be93-6d51ba159f52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:40.506249 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c23e5f-94fa-43f7-be93-6d51ba159f52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:40.507721 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c23e5f-94fa-43f7-be93-6d51ba159f52 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:40.518163 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4031/8036] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:17:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:17:41.037829 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aab206-dda0-421e-8aaf-d794f5b5d4eb None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:41.039551 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c2aab206-dda0-421e-8aaf-d794f5b5d4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:41.054384 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aab206-dda0-421e-8aaf-d794f5b5d4eb None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:41.062741 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35fd0da-1390-4eb1-8f8d-ba451f0a813f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:41.063727 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35fd0da-1390-4eb1-8f8d-ba451f0a813f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:41.064014 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35fd0da-1390-4eb1-8f8d-ba451f0a813f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:41.064870 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35fd0da-1390-4eb1-8f8d-ba451f0a813f admin admin] PATH_INFO: `/v3/projects/ea21793e98644c4683e5def96220e42a` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:41.066158 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35fd0da-1390-4eb1-8f8d-ba451f0a813f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea21793e98644c4683e5def96220e42a)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:41.068132 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35fd0da-1390-4eb1-8f8d-ba451f0a813f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:41.122023 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c35fd0da-1390-4eb1-8f8d-ba451f0a813f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea21793e98644c4683e5def96220e42a', 'request_id': 'req-c35fd0da-1390-4eb1-8f8d-ba451f0a813f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:41.128508 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c35fd0da-1390-4eb1-8f8d-ba451f0a813f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea21793e98644c4683e5def96220e42a', 'request_id': 'req-c35fd0da-1390-4eb1-8f8d-ba451f0a813f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:41.137590 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c35fd0da-1390-4eb1-8f8d-ba451f0a813f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea21793e98644c4683e5def96220e42a', 'request_id': 'req-c35fd0da-1390-4eb1-8f8d-ba451f0a813f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:41.150412 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c35fd0da-1390-4eb1-8f8d-ba451f0a813f admin admin] The token cache is being invalidate because project ea21793e98644c4683e5def96220e42a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:17:41.150705 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c35fd0da-1390-4eb1-8f8d-ba451f0a813f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:41.151426 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c35fd0da-1390-4eb1-8f8d-ba451f0a813f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:41.152927 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4006/8037] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:17:41 2022] DELETE /identity/v3/projects/ea21793e98644c4683e5def96220e42a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:41.157587 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c23e5f-94fa-43f7-be93-6d51ba159f52 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:41.167299 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c23e5f-94fa-43f7-be93-6d51ba159f52 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:41.229228 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a1ce5-294d-4ff9-bd37-4b2029d554ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:41.229874 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a1ce5-294d-4ff9-bd37-4b2029d554ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:41.230198 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a1ce5-294d-4ff9-bd37-4b2029d554ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:41.230425 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a1ce5-294d-4ff9-bd37-4b2029d554ce admin admin] PATH_INFO: `/v3/users/aa08cad3d52746df8ce80b136426b9bd` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:41.231651 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93a1ce5-294d-4ff9-bd37-4b2029d554ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa08cad3d52746df8ce80b136426b9bd)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:41.234177 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93a1ce5-294d-4ff9-bd37-4b2029d554ce admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:41.261706 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:41.300630 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f93a1ce5-294d-4ff9-bd37-4b2029d554ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa08cad3d52746df8ce80b136426b9bd'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:41.301450 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f93a1ce5-294d-4ff9-bd37-4b2029d554ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa08cad3d52746df8ce80b136426b9bd'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:41.316087 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f93a1ce5-294d-4ff9-bd37-4b2029d554ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa08cad3d52746df8ce80b136426b9bd'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:41.331631 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f93a1ce5-294d-4ff9-bd37-4b2029d554ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa08cad3d52746df8ce80b136426b9bd'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:41.332400 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f93a1ce5-294d-4ff9-bd37-4b2029d554ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa08cad3d52746df8ce80b136426b9bd'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:41.369338 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4032/8038] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:17:41 2022] DELETE /identity/v3/users/aa08cad3d52746df8ce80b136426b9bd => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:41.840118 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35fd0da-1390-4eb1-8f8d-ba451f0a813f admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:41.841819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c35fd0da-1390-4eb1-8f8d-ba451f0a813f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:41.854605 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35fd0da-1390-4eb1-8f8d-ba451f0a813f admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:41.926178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c51d299-cac8-4040-848b-208ec1884ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:41.926777 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51d299-cac8-4040-848b-208ec1884ee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:41.927096 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51d299-cac8-4040-848b-208ec1884ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:41.927399 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51d299-cac8-4040-848b-208ec1884ee6 admin admin] PATH_INFO: `/v3/projects/ec98720dbf7f4101add8a4eed8124ec2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:41.928816 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c51d299-cac8-4040-848b-208ec1884ee6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec98720dbf7f4101add8a4eed8124ec2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:41.931325 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c51d299-cac8-4040-848b-208ec1884ee6 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:41.990985 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1c51d299-cac8-4040-848b-208ec1884ee6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec98720dbf7f4101add8a4eed8124ec2', 'request_id': 'req-1c51d299-cac8-4040-848b-208ec1884ee6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:41.996536 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1c51d299-cac8-4040-848b-208ec1884ee6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec98720dbf7f4101add8a4eed8124ec2', 'request_id': 'req-1c51d299-cac8-4040-848b-208ec1884ee6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:42.005401 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1c51d299-cac8-4040-848b-208ec1884ee6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec98720dbf7f4101add8a4eed8124ec2', 'request_id': 'req-1c51d299-cac8-4040-848b-208ec1884ee6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:42.006657 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:42.022156 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1c51d299-cac8-4040-848b-208ec1884ee6 admin admin] The token cache is being invalidate because project ec98720dbf7f4101add8a4eed8124ec2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:17:42.022444 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1c51d299-cac8-4040-848b-208ec1884ee6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:42.023161 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1c51d299-cac8-4040-848b-208ec1884ee6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:42.024727 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4007/8039] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:17:41 2022] DELETE /identity/v3/projects/ec98720dbf7f4101add8a4eed8124ec2 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:42.032650 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac2eaf-2ec6-4eb3-aacd-c64ef2f0ab47 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:42.033319 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac2eaf-2ec6-4eb3-aacd-c64ef2f0ab47 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:42.033319 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac2eaf-2ec6-4eb3-aacd-c64ef2f0ab47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:42.056563 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-e5ac2eaf-2ec6-4eb3-aacd-c64ef2f0ab47 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:42.056563 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e5ac2eaf-2ec6-4eb3-aacd-c64ef2f0ab47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:42.138791 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4033/8040] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:17:42.146957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5151ad-36fd-4b16-a47f-d1c2692b781f None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:42.147839 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5151ad-36fd-4b16-a47f-d1c2692b781f None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:42.148291 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5151ad-36fd-4b16-a47f-d1c2692b781f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:42.174280 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-9c5151ad-36fd-4b16-a47f-d1c2692b781f None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:42.175568 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9c5151ad-36fd-4b16-a47f-d1c2692b781f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:42.184130 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4008/8041] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:17:42.188848 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac2eaf-2ec6-4eb3-aacd-c64ef2f0ab47 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:42.198567 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac2eaf-2ec6-4eb3-aacd-c64ef2f0ab47 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:42.204726 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a4198-13f3-4ca2-8610-94d8931973dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:42.205454 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a4198-13f3-4ca2-8610-94d8931973dd admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:42.205736 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a4198-13f3-4ca2-8610-94d8931973dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:42.206003 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a4198-13f3-4ca2-8610-94d8931973dd admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:42.206646 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a4198-13f3-4ca2-8610-94d8931973dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:17:42.206941 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a4198-13f3-4ca2-8610-94d8931973dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:42.208672 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a4198-13f3-4ca2-8610-94d8931973dd admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:42.220583 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4034/8042] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:17:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:17:42.225024 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5151ad-36fd-4b16-a47f-d1c2692b781f None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:42.234642 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5151ad-36fd-4b16-a47f-d1c2692b781f None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:42.239854 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4077acf-26da-40d1-b02a-f5e1a45d3163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:42.240466 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4077acf-26da-40d1-b02a-f5e1a45d3163 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:42.240743 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4077acf-26da-40d1-b02a-f5e1a45d3163 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:42.241014 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4077acf-26da-40d1-b02a-f5e1a45d3163 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:42.241663 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4077acf-26da-40d1-b02a-f5e1a45d3163 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:42.243620 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4077acf-26da-40d1-b02a-f5e1a45d3163 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:42.273181 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4009/8043] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:17:42 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:17:42.277258 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a4198-13f3-4ca2-8610-94d8931973dd admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:42.287724 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a4198-13f3-4ca2-8610-94d8931973dd admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:42.346768 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c25b1-af96-4053-a26a-b592c3c68504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:42.347421 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c25b1-af96-4053-a26a-b592c3c68504 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:42.347701 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c25b1-af96-4053-a26a-b592c3c68504 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:42.347974 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c25b1-af96-4053-a26a-b592c3c68504 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:42.348619 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c25b1-af96-4053-a26a-b592c3c68504 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:42.350547 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c25b1-af96-4053-a26a-b592c3c68504 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:42.373698 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4035/8044] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:17:42 2022] POST /identity/v3/users => generated 285 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:17:42.378080 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4077acf-26da-40d1-b02a-f5e1a45d3163 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:42.390126 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4077acf-26da-40d1-b02a-f5e1a45d3163 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:42.395545 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef859a-821b-4808-a617-47abe21396e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:42.396197 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef859a-821b-4808-a617-47abe21396e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:42.396477 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef859a-821b-4808-a617-47abe21396e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:42.396749 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef859a-821b-4808-a617-47abe21396e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:42.397408 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef859a-821b-4808-a617-47abe21396e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:42.399033 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef859a-821b-4808-a617-47abe21396e1 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:42.415672 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4010/8045] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:17:42.421199 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c25b1-af96-4053-a26a-b592c3c68504 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:42.432851 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c25b1-af96-4053-a26a-b592c3c68504 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:42.439051 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f08fd7-59e9-432d-a54e-f9149359e9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:42.439824 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f08fd7-59e9-432d-a54e-f9149359e9b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:42.440099 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f08fd7-59e9-432d-a54e-f9149359e9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:42.440366 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f08fd7-59e9-432d-a54e-f9149359e9b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:42.440999 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f08fd7-59e9-432d-a54e-f9149359e9b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:42.442629 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f08fd7-59e9-432d-a54e-f9149359e9b2 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:42.463088 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4036/8046] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:17:42.464288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef859a-821b-4808-a617-47abe21396e1 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:42.476629 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef859a-821b-4808-a617-47abe21396e1 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:42.482217 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee2a26-693c-4d85-90b4-b0f0882dddb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:42.483208 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee2a26-693c-4d85-90b4-b0f0882dddb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:42.483560 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee2a26-693c-4d85-90b4-b0f0882dddb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:42.483941 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee2a26-693c-4d85-90b4-b0f0882dddb2 admin admin] PATH_INFO: `/v3/projects/0bed7b1ec16248d8b4f5b2b2aaaf942e/users/668138c079414c1f82b17303e3add3ab/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:42.499644 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ee2a26-693c-4d85-90b4-b0f0882dddb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bed7b1ec16248d8b4f5b2b2aaaf942e, user_id=668138c079414c1f82b17303e3add3ab, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:42.502418 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ee2a26-693c-4d85-90b4-b0f0882dddb2 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:42.516550 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4011/8047] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:17:42 2022] PUT /identity/v3/projects/0bed7b1ec16248d8b4f5b2b2aaaf942e/users/668138c079414c1f82b17303e3add3ab/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:42.611792 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611002cf-acc1-4ed4-bb07-44d4ebc3a17c None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:42.612078 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611002cf-acc1-4ed4-bb07-44d4ebc3a17c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:42.612352 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611002cf-acc1-4ed4-bb07-44d4ebc3a17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:42.626478 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:42.645540 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-611002cf-acc1-4ed4-bb07-44d4ebc3a17c None None] MFA Rules not processed for user `668138c079414c1f82b17303e3add3ab`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:42.646771 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-611002cf-acc1-4ed4-bb07-44d4ebc3a17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:42.716842 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4037/8048] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:17:42.722161 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee2a26-693c-4d85-90b4-b0f0882dddb2 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:42.734021 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee2a26-693c-4d85-90b4-b0f0882dddb2 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:42.739356 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f72b8b-bfb4-470e-bb4d-8eb74951a195 tempest-TestApiDiscovery-1140289030 tempest-TestApiDiscovery-1140289030-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '668138c079414c1f82b17303e3add3ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bed7b1ec16248d8b4f5b2b2aaaf942e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:42.740179 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f72b8b-bfb4-470e-bb4d-8eb74951a195 tempest-TestApiDiscovery-1140289030 tempest-TestApiDiscovery-1140289030-project] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:42.740464 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f72b8b-bfb4-470e-bb4d-8eb74951a195 tempest-TestApiDiscovery-1140289030 tempest-TestApiDiscovery-1140289030-project] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:42.740749 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f72b8b-bfb4-470e-bb4d-8eb74951a195 tempest-TestApiDiscovery-1140289030 tempest-TestApiDiscovery-1140289030-project] PATH_INFO: `/v3` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:42.743060 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4012/8049] 10.222.0.83 () {58 vars in 1104 bytes} [Mon Aug 29 16:17:42 2022] GET /identity/v3 => generated 255 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:17:42.748460 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611002cf-acc1-4ed4-bb07-44d4ebc3a17c None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:42.758167 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611002cf-acc1-4ed4-bb07-44d4ebc3a17c None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:42.762526 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef80d4a-0ec7-4bcb-87a3-9bee347054da tempest-TestApiDiscovery-1140289030 tempest-TestApiDiscovery-1140289030-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '668138c079414c1f82b17303e3add3ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bed7b1ec16248d8b4f5b2b2aaaf942e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:42.763361 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef80d4a-0ec7-4bcb-87a3-9bee347054da tempest-TestApiDiscovery-1140289030 tempest-TestApiDiscovery-1140289030-project] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:42.763654 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef80d4a-0ec7-4bcb-87a3-9bee347054da tempest-TestApiDiscovery-1140289030 tempest-TestApiDiscovery-1140289030-project] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:42.763926 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef80d4a-0ec7-4bcb-87a3-9bee347054da tempest-TestApiDiscovery-1140289030 tempest-TestApiDiscovery-1140289030-project] PATH_INFO: `/v3` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:42.769336 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4038/8050] 10.222.0.83 () {58 vars in 1104 bytes} [Mon Aug 29 16:17:42 2022] GET /identity/v3 => generated 255 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:17:42.771687 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f72b8b-bfb4-470e-bb4d-8eb74951a195 tempest-TestApiDiscovery-1140289030 tempest-TestApiDiscovery-1140289030-project] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:42.782109 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f72b8b-bfb4-470e-bb4d-8eb74951a195 tempest-TestApiDiscovery-1140289030 tempest-TestApiDiscovery-1140289030-project] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:42.786488 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ca478-2e82-4e35-8899-7842436fc8eb tempest-TestApiDiscovery-1140289030 tempest-TestApiDiscovery-1140289030-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '668138c079414c1f82b17303e3add3ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bed7b1ec16248d8b4f5b2b2aaaf942e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:42.787214 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ca478-2e82-4e35-8899-7842436fc8eb tempest-TestApiDiscovery-1140289030 tempest-TestApiDiscovery-1140289030-project] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:42.787506 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ca478-2e82-4e35-8899-7842436fc8eb tempest-TestApiDiscovery-1140289030 tempest-TestApiDiscovery-1140289030-project] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:42.787791 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ca478-2e82-4e35-8899-7842436fc8eb tempest-TestApiDiscovery-1140289030 tempest-TestApiDiscovery-1140289030-project] PATH_INFO: `/v3` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:42.793173 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4013/8051] 10.222.0.83 () {58 vars in 1104 bytes} [Mon Aug 29 16:17:42 2022] GET /identity/v3 => generated 255 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:17:42.795712 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f5d30-3591-4ed1-9e68-4a5ead5aca27 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:42.796069 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f5d30-3591-4ed1-9e68-4a5ead5aca27 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:42.796352 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f5d30-3591-4ed1-9e68-4a5ead5aca27 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:42.797842 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4039/8052] 10.222.0.83 () {56 vars in 895 bytes} [Mon Aug 29 16:17:42 2022] GET /identity/ => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 16:17:42.802582 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a73ac-60bc-4d4f-a97e-cc85bed3cd45 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:42.802956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a73ac-60bc-4d4f-a97e-cc85bed3cd45 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:42.803327 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a73ac-60bc-4d4f-a97e-cc85bed3cd45 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:42.805021 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4014/8053] 10.222.0.83 () {56 vars in 895 bytes} [Mon Aug 29 16:17:42 2022] GET /identity/ => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 16:17:42.809155 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f5d30-3591-4ed1-9e68-4a5ead5aca27 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:42.880583 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f5d30-3591-4ed1-9e68-4a5ead5aca27 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:42.885199 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e55054-f76f-4e7b-b71f-affab502ce1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:42.885830 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e55054-f76f-4e7b-b71f-affab502ce1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:42.886107 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e55054-f76f-4e7b-b71f-affab502ce1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:42.886380 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e55054-f76f-4e7b-b71f-affab502ce1b admin admin] PATH_INFO: `/v3/users/668138c079414c1f82b17303e3add3ab` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:42.887548 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e55054-f76f-4e7b-b71f-affab502ce1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=668138c079414c1f82b17303e3add3ab)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:42.889613 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e55054-f76f-4e7b-b71f-affab502ce1b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:42.941110 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e4e55054-f76f-4e7b-b71f-affab502ce1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '668138c079414c1f82b17303e3add3ab'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:42.941801 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e4e55054-f76f-4e7b-b71f-affab502ce1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '668138c079414c1f82b17303e3add3ab'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:42.949150 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e4e55054-f76f-4e7b-b71f-affab502ce1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '668138c079414c1f82b17303e3add3ab'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:42.956918 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e4e55054-f76f-4e7b-b71f-affab502ce1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '668138c079414c1f82b17303e3add3ab'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:42.957555 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e4e55054-f76f-4e7b-b71f-affab502ce1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '668138c079414c1f82b17303e3add3ab'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:42.983162 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4040/8054] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:17:42 2022] DELETE /identity/v3/users/668138c079414c1f82b17303e3add3ab => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:42.984095 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8959e59-8142-4721-a522-83eca2e58c59 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:42.984573 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8959e59-8142-4721-a522-83eca2e58c59 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:42.984855 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8959e59-8142-4721-a522-83eca2e58c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:43.005970 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-b8959e59-8142-4721-a522-83eca2e58c59 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:43.007323 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b8959e59-8142-4721-a522-83eca2e58c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:43.072493 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4015/8055] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:17:43.082794 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e55054-f76f-4e7b-b71f-affab502ce1b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:43.084325 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e4e55054-f76f-4e7b-b71f-affab502ce1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:43.098466 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:43.149740 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e55054-f76f-4e7b-b71f-affab502ce1b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:43.153419 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b8baa-f8a8-46e6-a02a-1308e1f604ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:43.154620 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b8baa-f8a8-46e6-a02a-1308e1f604ae service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:43.155082 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b8baa-f8a8-46e6-a02a-1308e1f604ae service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:43.155355 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b8baa-f8a8-46e6-a02a-1308e1f604ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:43.164696 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69b8baa-f8a8-46e6-a02a-1308e1f604ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:43.166153 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69b8baa-f8a8-46e6-a02a-1308e1f604ae service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:43.176785 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4041/8056] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:17:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:17:43.476095 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8959e59-8142-4721-a522-83eca2e58c59 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:43.477688 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b8959e59-8142-4721-a522-83eca2e58c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:43.493034 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8959e59-8142-4721-a522-83eca2e58c59 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:43.499825 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2441b-f2a0-4a88-a028-e9e21ca4b131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:43.500631 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2441b-f2a0-4a88-a028-e9e21ca4b131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:43.500984 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2441b-f2a0-4a88-a028-e9e21ca4b131 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:43.501330 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2441b-f2a0-4a88-a028-e9e21ca4b131 admin admin] PATH_INFO: `/v3/projects/0bed7b1ec16248d8b4f5b2b2aaaf942e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:43.503208 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f2441b-f2a0-4a88-a028-e9e21ca4b131 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bed7b1ec16248d8b4f5b2b2aaaf942e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:43.506115 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f2441b-f2a0-4a88-a028-e9e21ca4b131 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:43.563680 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-37f2441b-f2a0-4a88-a028-e9e21ca4b131 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bed7b1ec16248d8b4f5b2b2aaaf942e', 'request_id': 'req-37f2441b-f2a0-4a88-a028-e9e21ca4b131'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:43.571882 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-37f2441b-f2a0-4a88-a028-e9e21ca4b131 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bed7b1ec16248d8b4f5b2b2aaaf942e', 'request_id': 'req-37f2441b-f2a0-4a88-a028-e9e21ca4b131'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:43.583211 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-37f2441b-f2a0-4a88-a028-e9e21ca4b131 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bed7b1ec16248d8b4f5b2b2aaaf942e', 'request_id': 'req-37f2441b-f2a0-4a88-a028-e9e21ca4b131'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:43.598583 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-37f2441b-f2a0-4a88-a028-e9e21ca4b131 admin admin] The token cache is being invalidate because project 0bed7b1ec16248d8b4f5b2b2aaaf942e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:17:43.599011 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-37f2441b-f2a0-4a88-a028-e9e21ca4b131 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:43.599825 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-37f2441b-f2a0-4a88-a028-e9e21ca4b131 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:43.601745 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4016/8057] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:17:43 2022] DELETE /identity/v3/projects/0bed7b1ec16248d8b4f5b2b2aaaf942e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:43.609705 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6e006-6774-42c5-9e9f-6186784b5d61 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:43.609994 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6e006-6774-42c5-9e9f-6186784b5d61 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:43.610274 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6e006-6774-42c5-9e9f-6186784b5d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:43.632998 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-d9f6e006-6774-42c5-9e9f-6186784b5d61 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:43.634176 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d9f6e006-6774-42c5-9e9f-6186784b5d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:43.723426 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4042/8058] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:17:43.725923 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e6da6-c434-4189-8300-10494e20641e None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:43.726413 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e6da6-c434-4189-8300-10494e20641e None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:43.726758 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e6da6-c434-4189-8300-10494e20641e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:43.735804 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:43.750817 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-852e6da6-c434-4189-8300-10494e20641e None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:43.752479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-852e6da6-c434-4189-8300-10494e20641e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:43.761420 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4017/8059] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:17:43.766390 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6e006-6774-42c5-9e9f-6186784b5d61 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:43.776212 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6e006-6774-42c5-9e9f-6186784b5d61 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:43.781231 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9866c4e9-f99c-4f09-ac24-a9d46faa3e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:43.781847 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866c4e9-f99c-4f09-ac24-a9d46faa3e67 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:43.782131 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866c4e9-f99c-4f09-ac24-a9d46faa3e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:43.782407 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866c4e9-f99c-4f09-ac24-a9d46faa3e67 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:43.783096 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9866c4e9-f99c-4f09-ac24-a9d46faa3e67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:17:43.783406 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9866c4e9-f99c-4f09-ac24-a9d46faa3e67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:43.785069 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9866c4e9-f99c-4f09-ac24-a9d46faa3e67 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:43.801031 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4043/8060] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:17:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:17:43.802376 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e6da6-c434-4189-8300-10494e20641e None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:43.812988 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e6da6-c434-4189-8300-10494e20641e None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:43.817910 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d368eb-e128-442b-a044-5ed33ab25e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:43.818528 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d368eb-e128-442b-a044-5ed33ab25e3c admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:43.819006 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d368eb-e128-442b-a044-5ed33ab25e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:43.819353 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d368eb-e128-442b-a044-5ed33ab25e3c admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:43.820115 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d368eb-e128-442b-a044-5ed33ab25e3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:43.821941 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d368eb-e128-442b-a044-5ed33ab25e3c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:43.854202 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4018/8061] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:17:43 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:17:43.859145 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9866c4e9-f99c-4f09-ac24-a9d46faa3e67 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:43.869689 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9866c4e9-f99c-4f09-ac24-a9d46faa3e67 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:43.940197 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949a892-de28-4707-8c0d-7a5b8271882b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:43.940852 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949a892-de28-4707-8c0d-7a5b8271882b admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:43.941180 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949a892-de28-4707-8c0d-7a5b8271882b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:43.941413 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949a892-de28-4707-8c0d-7a5b8271882b admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:43.942056 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d949a892-de28-4707-8c0d-7a5b8271882b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:43.945810 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d949a892-de28-4707-8c0d-7a5b8271882b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:43.970817 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4044/8062] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:17:43 2022] POST /identity/v3/users => generated 286 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:17:43.973124 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d368eb-e128-442b-a044-5ed33ab25e3c admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:43.984380 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d368eb-e128-442b-a044-5ed33ab25e3c admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:43.990203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f9b05-af31-478d-a1fc-cd1b48777080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:43.990203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f9b05-af31-478d-a1fc-cd1b48777080 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:43.990203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f9b05-af31-478d-a1fc-cd1b48777080 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:43.990844 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f9b05-af31-478d-a1fc-cd1b48777080 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:43.991160 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f9b05-af31-478d-a1fc-cd1b48777080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:43.993102 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f9b05-af31-478d-a1fc-cd1b48777080 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:44.007144 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4019/8063] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:17:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:17:44.008647 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949a892-de28-4707-8c0d-7a5b8271882b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:44.019076 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949a892-de28-4707-8c0d-7a5b8271882b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:44.023992 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0135aec-a8f3-42cd-bfe0-f06547e173dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:44.024602 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0135aec-a8f3-42cd-bfe0-f06547e173dd admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:44.024876 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0135aec-a8f3-42cd-bfe0-f06547e173dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:44.025146 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0135aec-a8f3-42cd-bfe0-f06547e173dd admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:44.025790 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0135aec-a8f3-42cd-bfe0-f06547e173dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:44.027440 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0135aec-a8f3-42cd-bfe0-f06547e173dd admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:44.040351 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4045/8064] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:17:44.045017 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f9b05-af31-478d-a1fc-cd1b48777080 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:44.062019 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f9b05-af31-478d-a1fc-cd1b48777080 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:44.066863 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d795c7-71f9-4010-beea-87faeef4efae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:44.067572 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d795c7-71f9-4010-beea-87faeef4efae admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:44.067854 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d795c7-71f9-4010-beea-87faeef4efae admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:44.068131 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d795c7-71f9-4010-beea-87faeef4efae admin admin] PATH_INFO: `/v3/projects/098c6f7375234072b582f853eedbada1/users/cbf9f39437f645b59b5dc8d9a76101c2/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:44.085014 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d795c7-71f9-4010-beea-87faeef4efae admin admin] RBAC: Authorizing `identity:create_grant(project_id=098c6f7375234072b582f853eedbada1, user_id=cbf9f39437f645b59b5dc8d9a76101c2, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:44.087738 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d795c7-71f9-4010-beea-87faeef4efae admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:44.102533 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4020/8065] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:17:44 2022] PUT /identity/v3/projects/098c6f7375234072b582f853eedbada1/users/cbf9f39437f645b59b5dc8d9a76101c2/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:17:44.113466 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4983b-f54d-4490-92c0-64e7767e7d33 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:44.113970 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4983b-f54d-4490-92c0-64e7767e7d33 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:44.114098 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4983b-f54d-4490-92c0-64e7767e7d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:44.145853 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-cfe4983b-f54d-4490-92c0-64e7767e7d33 None None] MFA Rules not processed for user `cbf9f39437f645b59b5dc8d9a76101c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:44.147190 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-cfe4983b-f54d-4490-92c0-64e7767e7d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:44.163198 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:44.224364 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4046/8066] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:17:44.237273 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d795c7-71f9-4010-beea-87faeef4efae admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:44.239003 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a3d795c7-71f9-4010-beea-87faeef4efae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:44.300760 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d795c7-71f9-4010-beea-87faeef4efae admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:44.304548 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b471da-faba-43f4-9f98-6081a87dbd43 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6b0f9835ed549cab91d684326be83fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:44.305414 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b471da-faba-43f4-9f98-6081a87dbd43 service glance] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:44.305719 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b471da-faba-43f4-9f98-6081a87dbd43 service glance] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:44.305991 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b471da-faba-43f4-9f98-6081a87dbd43 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:44.315952 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b471da-faba-43f4-9f98-6081a87dbd43 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:44.317453 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b471da-faba-43f4-9f98-6081a87dbd43 service glance] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:44.327602 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4021/8067] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:17:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:17:44.539766 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe4983b-f54d-4490-92c0-64e7767e7d33 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:44.541236 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-cfe4983b-f54d-4490-92c0-64e7767e7d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:44.612880 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe4983b-f54d-4490-92c0-64e7767e7d33 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:44.617860 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7026d-5810-4ee1-8603-5ba6d074df22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:44.618500 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7026d-5810-4ee1-8603-5ba6d074df22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:44.618781 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7026d-5810-4ee1-8603-5ba6d074df22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:44.619108 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7026d-5810-4ee1-8603-5ba6d074df22 admin admin] PATH_INFO: `/v3/users/1bc6fcb9654c45c99ec2e97d13b155a9` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:44.620252 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe7026d-5810-4ee1-8603-5ba6d074df22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bc6fcb9654c45c99ec2e97d13b155a9)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:44.623521 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe7026d-5810-4ee1-8603-5ba6d074df22 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:44.681812 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ebe7026d-5810-4ee1-8603-5ba6d074df22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bc6fcb9654c45c99ec2e97d13b155a9'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:44.682488 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ebe7026d-5810-4ee1-8603-5ba6d074df22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bc6fcb9654c45c99ec2e97d13b155a9'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:44.693184 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ebe7026d-5810-4ee1-8603-5ba6d074df22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bc6fcb9654c45c99ec2e97d13b155a9'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:44.699336 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ebe7026d-5810-4ee1-8603-5ba6d074df22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bc6fcb9654c45c99ec2e97d13b155a9'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:44.700110 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ebe7026d-5810-4ee1-8603-5ba6d074df22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bc6fcb9654c45c99ec2e97d13b155a9'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:44.724250 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4047/8068] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:17:44 2022] DELETE /identity/v3/users/1bc6fcb9654c45c99ec2e97d13b155a9 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:44.729011 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef5ca8-decb-4b4a-a028-6c734a283a5b None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:44.729517 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef5ca8-decb-4b4a-a028-6c734a283a5b None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:44.729797 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef5ca8-decb-4b4a-a028-6c734a283a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:44.756402 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-a6ef5ca8-decb-4b4a-a028-6c734a283a5b None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:44.757612 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a6ef5ca8-decb-4b4a-a028-6c734a283a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:44.824255 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4022/8069] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:17:44.834494 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7026d-5810-4ee1-8603-5ba6d074df22 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:44.835919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ebe7026d-5810-4ee1-8603-5ba6d074df22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:44.869022 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:44.900783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7026d-5810-4ee1-8603-5ba6d074df22 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:44.905191 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ce501-91fb-41a2-b8dd-3db83b8aea7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:44.905794 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ce501-91fb-41a2-b8dd-3db83b8aea7e service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:44.906073 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ce501-91fb-41a2-b8dd-3db83b8aea7e service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:44.906345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ce501-91fb-41a2-b8dd-3db83b8aea7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:44.916620 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ce501-91fb-41a2-b8dd-3db83b8aea7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:44.918351 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ce501-91fb-41a2-b8dd-3db83b8aea7e service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:44.930616 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4048/8070] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:17:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:17:45.105918 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef5ca8-decb-4b4a-a028-6c734a283a5b None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:45.107557 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a6ef5ca8-decb-4b4a-a028-6c734a283a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:45.120215 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef5ca8-decb-4b4a-a028-6c734a283a5b None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:45.126239 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392946e-12ac-421b-964a-2ca260e69017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:45.126899 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392946e-12ac-421b-964a-2ca260e69017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:45.127287 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392946e-12ac-421b-964a-2ca260e69017 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:45.127565 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392946e-12ac-421b-964a-2ca260e69017 admin admin] PATH_INFO: `/v3/users/cbf9f39437f645b59b5dc8d9a76101c2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:45.128717 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392946e-12ac-421b-964a-2ca260e69017 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbf9f39437f645b59b5dc8d9a76101c2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:45.130661 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392946e-12ac-421b-964a-2ca260e69017 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:45.176523 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:45.183710 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4392946e-12ac-421b-964a-2ca260e69017 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbf9f39437f645b59b5dc8d9a76101c2'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:45.184597 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4392946e-12ac-421b-964a-2ca260e69017 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbf9f39437f645b59b5dc8d9a76101c2'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:45.197857 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4392946e-12ac-421b-964a-2ca260e69017 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbf9f39437f645b59b5dc8d9a76101c2'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:45.208275 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4392946e-12ac-421b-964a-2ca260e69017 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbf9f39437f645b59b5dc8d9a76101c2'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:45.216297 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4392946e-12ac-421b-964a-2ca260e69017 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbf9f39437f645b59b5dc8d9a76101c2'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:45.223205 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4023/8071] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:17:45 2022] DELETE /identity/v3/users/cbf9f39437f645b59b5dc8d9a76101c2 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:45.227698 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ad407-bd2e-4bc7-8ed6-67b3097ccdf7 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:45.228189 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ad407-bd2e-4bc7-8ed6-67b3097ccdf7 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:45.228284 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ad407-bd2e-4bc7-8ed6-67b3097ccdf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:45.234913 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392946e-12ac-421b-964a-2ca260e69017 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:45.236557 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4392946e-12ac-421b-964a-2ca260e69017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:45.252265 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-679ad407-bd2e-4bc7-8ed6-67b3097ccdf7 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:45.253481 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-679ad407-bd2e-4bc7-8ed6-67b3097ccdf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:45.306163 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392946e-12ac-421b-964a-2ca260e69017 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:45.312241 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14dbe2-63e2-43f3-b556-3f33fd8a5723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:45.312905 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14dbe2-63e2-43f3-b556-3f33fd8a5723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:45.313194 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14dbe2-63e2-43f3-b556-3f33fd8a5723 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:45.313471 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14dbe2-63e2-43f3-b556-3f33fd8a5723 admin admin] PATH_INFO: `/v3/projects/e202601e15db461d9eed4282a75273be` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:45.314646 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b14dbe2-63e2-43f3-b556-3f33fd8a5723 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e202601e15db461d9eed4282a75273be)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:45.316660 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b14dbe2-63e2-43f3-b556-3f33fd8a5723 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:45.320502 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4049/8072] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:17:45.332326 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ad407-bd2e-4bc7-8ed6-67b3097ccdf7 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:45.334355 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-679ad407-bd2e-4bc7-8ed6-67b3097ccdf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:45.381439 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0b14dbe2-63e2-43f3-b556-3f33fd8a5723 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e202601e15db461d9eed4282a75273be', 'request_id': 'req-0b14dbe2-63e2-43f3-b556-3f33fd8a5723'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:45.392312 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0b14dbe2-63e2-43f3-b556-3f33fd8a5723 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e202601e15db461d9eed4282a75273be', 'request_id': 'req-0b14dbe2-63e2-43f3-b556-3f33fd8a5723'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:45.403966 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0b14dbe2-63e2-43f3-b556-3f33fd8a5723 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e202601e15db461d9eed4282a75273be', 'request_id': 'req-0b14dbe2-63e2-43f3-b556-3f33fd8a5723'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:45.415942 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0b14dbe2-63e2-43f3-b556-3f33fd8a5723 admin admin] The token cache is being invalidate because project e202601e15db461d9eed4282a75273be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:17:45.416280 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0b14dbe2-63e2-43f3-b556-3f33fd8a5723 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:45.416937 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0b14dbe2-63e2-43f3-b556-3f33fd8a5723 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:45.418785 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4024/8073] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:17:45 2022] DELETE /identity/v3/projects/e202601e15db461d9eed4282a75273be => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:17:45.423135 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14dbe2-63e2-43f3-b556-3f33fd8a5723 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:45.423438 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ad407-bd2e-4bc7-8ed6-67b3097ccdf7 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:45.424555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0b14dbe2-63e2-43f3-b556-3f33fd8a5723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:45.477516 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f2264c-9f68-4dea-87f9-855c131ef8d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:45.477797 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:45.478584 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2264c-9f68-4dea-87f9-855c131ef8d6 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:45.478848 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2264c-9f68-4dea-87f9-855c131ef8d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:45.479222 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2264c-9f68-4dea-87f9-855c131ef8d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:45.481162 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-73f2264c-9f68-4dea-87f9-855c131ef8d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:45.498153 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14dbe2-63e2-43f3-b556-3f33fd8a5723 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:45.503220 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b1009-31a7-4707-b844-911ea89c50d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:45.503853 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b1009-31a7-4707-b844-911ea89c50d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:45.504134 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b1009-31a7-4707-b844-911ea89c50d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:45.504408 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b1009-31a7-4707-b844-911ea89c50d1 admin admin] PATH_INFO: `/v3/users/2d5cd3fdad994b3695a68cea8537a98d` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:45.505562 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b1009-31a7-4707-b844-911ea89c50d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d5cd3fdad994b3695a68cea8537a98d)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:45.507532 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b1009-31a7-4707-b844-911ea89c50d1 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:45.526826 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:45.550511 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f2264c-9f68-4dea-87f9-855c131ef8d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:45.552058 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f2264c-9f68-4dea-87f9-855c131ef8d6 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:45.557397 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-af6b1009-31a7-4707-b844-911ea89c50d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d5cd3fdad994b3695a68cea8537a98d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:45.558332 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-af6b1009-31a7-4707-b844-911ea89c50d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d5cd3fdad994b3695a68cea8537a98d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:45.562718 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4050/8074] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:17:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:17:45.572177 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-af6b1009-31a7-4707-b844-911ea89c50d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d5cd3fdad994b3695a68cea8537a98d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:45.580387 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-af6b1009-31a7-4707-b844-911ea89c50d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d5cd3fdad994b3695a68cea8537a98d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:45.587997 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-af6b1009-31a7-4707-b844-911ea89c50d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d5cd3fdad994b3695a68cea8537a98d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:45.595070 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4025/8075] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:17:45 2022] DELETE /identity/v3/users/2d5cd3fdad994b3695a68cea8537a98d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:17:45.844389 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f2264c-9f68-4dea-87f9-855c131ef8d6 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:45.862818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f2264c-9f68-4dea-87f9-855c131ef8d6 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:45.900221 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b1009-31a7-4707-b844-911ea89c50d1 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:45.901873 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-af6b1009-31a7-4707-b844-911ea89c50d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:45.946521 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3126f80-0cd6-4872-a90e-ac2bb92f7de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:45.947660 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3126f80-0cd6-4872-a90e-ac2bb92f7de6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:45.947839 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3126f80-0cd6-4872-a90e-ac2bb92f7de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:45.948216 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3126f80-0cd6-4872-a90e-ac2bb92f7de6 admin admin] PATH_INFO: `/v3/projects/9607e22b511b4968bd95a85933790404` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:45.949741 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3126f80-0cd6-4872-a90e-ac2bb92f7de6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9607e22b511b4968bd95a85933790404)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:45.953287 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3126f80-0cd6-4872-a90e-ac2bb92f7de6 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:45.990667 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b1009-31a7-4707-b844-911ea89c50d1 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:46.002882 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a3126f80-0cd6-4872-a90e-ac2bb92f7de6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9607e22b511b4968bd95a85933790404', 'request_id': 'req-a3126f80-0cd6-4872-a90e-ac2bb92f7de6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:46.008563 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a3126f80-0cd6-4872-a90e-ac2bb92f7de6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9607e22b511b4968bd95a85933790404', 'request_id': 'req-a3126f80-0cd6-4872-a90e-ac2bb92f7de6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:46.015781 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a3126f80-0cd6-4872-a90e-ac2bb92f7de6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9607e22b511b4968bd95a85933790404', 'request_id': 'req-a3126f80-0cd6-4872-a90e-ac2bb92f7de6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:46.029578 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a3126f80-0cd6-4872-a90e-ac2bb92f7de6 admin admin] The token cache is being invalidate because project 9607e22b511b4968bd95a85933790404 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:17:46.029871 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a3126f80-0cd6-4872-a90e-ac2bb92f7de6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:46.030530 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a3126f80-0cd6-4872-a90e-ac2bb92f7de6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:46.032288 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4051/8076] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:17:45 2022] DELETE /identity/v3/projects/9607e22b511b4968bd95a85933790404 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:46.036851 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c926c84-7078-4188-b1ea-02469806ab65 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:46.037390 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c926c84-7078-4188-b1ea-02469806ab65 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:46.037390 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c926c84-7078-4188-b1ea-02469806ab65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:46.053224 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327955da-89f2-42c7-9a5d-c5e734def390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:46.053941 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327955da-89f2-42c7-9a5d-c5e734def390 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:46.054219 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327955da-89f2-42c7-9a5d-c5e734def390 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:46.054490 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327955da-89f2-42c7-9a5d-c5e734def390 admin admin] PATH_INFO: `/v3/projects/098c6f7375234072b582f853eedbada1` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:46.056023 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327955da-89f2-42c7-9a5d-c5e734def390 admin admin] RBAC: Authorizing `identity:delete_project(project_id=098c6f7375234072b582f853eedbada1)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:46.057927 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327955da-89f2-42c7-9a5d-c5e734def390 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:46.059417 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-5c926c84-7078-4188-b1ea-02469806ab65 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:46.061452 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5c926c84-7078-4188-b1ea-02469806ab65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:46.071722 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4052/8077] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:17:46.076640 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:46.080492 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cad2f-24b8-4236-9746-ebe5d2412ed4 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:46.080827 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cad2f-24b8-4236-9746-ebe5d2412ed4 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:46.081133 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cad2f-24b8-4236-9746-ebe5d2412ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:46.103435 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-901cad2f-24b8-4236-9746-ebe5d2412ed4 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:46.107520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-901cad2f-24b8-4236-9746-ebe5d2412ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:46.111182 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-327955da-89f2-42c7-9a5d-c5e734def390 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '098c6f7375234072b582f853eedbada1', 'request_id': 'req-327955da-89f2-42c7-9a5d-c5e734def390'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:46.116739 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-327955da-89f2-42c7-9a5d-c5e734def390 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '098c6f7375234072b582f853eedbada1', 'request_id': 'req-327955da-89f2-42c7-9a5d-c5e734def390'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:46.125811 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-327955da-89f2-42c7-9a5d-c5e734def390 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '098c6f7375234072b582f853eedbada1', 'request_id': 'req-327955da-89f2-42c7-9a5d-c5e734def390'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:46.137487 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-327955da-89f2-42c7-9a5d-c5e734def390 admin admin] The token cache is being invalidate because project 098c6f7375234072b582f853eedbada1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:17:46.137781 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-327955da-89f2-42c7-9a5d-c5e734def390 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:46.138637 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-327955da-89f2-42c7-9a5d-c5e734def390 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:46.140377 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4026/8078] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:17:45 2022] DELETE /identity/v3/projects/098c6f7375234072b582f853eedbada1 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:46.145368 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c16dc9-1154-4e15-b27e-016bec3321bd None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:46.145666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c16dc9-1154-4e15-b27e-016bec3321bd None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:46.145944 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c16dc9-1154-4e15-b27e-016bec3321bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:46.166549 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-a5c16dc9-1154-4e15-b27e-016bec3321bd None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:46.167784 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a5c16dc9-1154-4e15-b27e-016bec3321bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:46.170403 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4053/8079] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:17:46.174761 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901cad2f-24b8-4236-9746-ebe5d2412ed4 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:46.177056 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4027/8080] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:17:46.179045 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:46.184338 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901cad2f-24b8-4236-9746-ebe5d2412ed4 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:46.187532 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6033b-f27e-4130-a9d9-de055db7cd41 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:46.187817 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6033b-f27e-4130-a9d9-de055db7cd41 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:46.188087 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6033b-f27e-4130-a9d9-de055db7cd41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:46.191219 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2ef9f-7d16-4e40-994b-6e1fc46a9896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:46.191971 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2ef9f-7d16-4e40-994b-6e1fc46a9896 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:46.192310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2ef9f-7d16-4e40-994b-6e1fc46a9896 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:46.193384 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2ef9f-7d16-4e40-994b-6e1fc46a9896 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:46.194237 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a2ef9f-7d16-4e40-994b-6e1fc46a9896 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:17:46.194722 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a2ef9f-7d16-4e40-994b-6e1fc46a9896 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:46.196935 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a2ef9f-7d16-4e40-994b-6e1fc46a9896 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:46.208024 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-7aa6033b-f27e-4130-a9d9-de055db7cd41 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:46.208921 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4054/8081] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:17:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:17:46.209344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7aa6033b-f27e-4130-a9d9-de055db7cd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:46.213217 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2ef9f-7d16-4e40-994b-6e1fc46a9896 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:46.217875 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4028/8082] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:17:46.221953 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa6033b-f27e-4130-a9d9-de055db7cd41 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:46.223394 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2ef9f-7d16-4e40-994b-6e1fc46a9896 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:46.228223 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b198dca-6cfd-4aa6-893e-4b13a86ad30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:46.228792 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b198dca-6cfd-4aa6-893e-4b13a86ad30f admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:46.229068 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b198dca-6cfd-4aa6-893e-4b13a86ad30f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:46.229336 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b198dca-6cfd-4aa6-893e-4b13a86ad30f admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:46.229952 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b198dca-6cfd-4aa6-893e-4b13a86ad30f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:46.230916 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa6033b-f27e-4130-a9d9-de055db7cd41 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:46.232531 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b198dca-6cfd-4aa6-893e-4b13a86ad30f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:46.236504 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a2477d-0960-42f4-8f67-72ed7764ca88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:46.237115 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2477d-0960-42f4-8f67-72ed7764ca88 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:46.238396 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2477d-0960-42f4-8f67-72ed7764ca88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:46.238678 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2477d-0960-42f4-8f67-72ed7764ca88 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:46.239379 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a2477d-0960-42f4-8f67-72ed7764ca88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:17:46.239688 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a2477d-0960-42f4-8f67-72ed7764ca88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:46.241300 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a2477d-0960-42f4-8f67-72ed7764ca88 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:46.259114 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4029/8083] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:17:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:17:46.260239 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a2477d-0960-42f4-8f67-72ed7764ca88 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:46.264131 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4055/8084] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:17:46 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:17:46.265094 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b198dca-6cfd-4aa6-893e-4b13a86ad30f admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:46.271080 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a2477d-0960-42f4-8f67-72ed7764ca88 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:46.328379 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861bba1c-21c0-4c07-a933-4a366516a4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:46.328991 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bba1c-21c0-4c07-a933-4a366516a4db admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:46.329275 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bba1c-21c0-4c07-a933-4a366516a4db admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:46.329557 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bba1c-21c0-4c07-a933-4a366516a4db admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:46.329831 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b198dca-6cfd-4aa6-893e-4b13a86ad30f admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:46.330189 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861bba1c-21c0-4c07-a933-4a366516a4db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:46.332142 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861bba1c-21c0-4c07-a933-4a366516a4db admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:46.334773 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8052a62-b4db-4f4f-891d-d5ab361708f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:46.335486 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8052a62-b4db-4f4f-891d-d5ab361708f3 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:46.335842 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8052a62-b4db-4f4f-891d-d5ab361708f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:46.336186 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8052a62-b4db-4f4f-891d-d5ab361708f3 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:46.336877 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8052a62-b4db-4f4f-891d-d5ab361708f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:46.338854 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8052a62-b4db-4f4f-891d-d5ab361708f3 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:46.364382 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4030/8085] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:17:46 2022] POST /identity/v3/projects => generated 365 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:17:46.364571 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4056/8086] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:17:46 2022] POST /identity/v3/users => generated 285 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:17:46.365471 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861bba1c-21c0-4c07-a933-4a366516a4db admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:46.366534 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8052a62-b4db-4f4f-891d-d5ab361708f3 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:46.376853 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8052a62-b4db-4f4f-891d-d5ab361708f3 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:46.430177 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861bba1c-21c0-4c07-a933-4a366516a4db admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:46.435592 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4209b37f-7c8e-4ed6-85b7-b8e173b32c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:46.436151 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec4ad1-bc95-4cb9-8cf0-8b8820356fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:46.436316 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209b37f-7c8e-4ed6-85b7-b8e173b32c7b admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:46.436606 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209b37f-7c8e-4ed6-85b7-b8e173b32c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:46.436759 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec4ad1-bc95-4cb9-8cf0-8b8820356fed admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:46.436865 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209b37f-7c8e-4ed6-85b7-b8e173b32c7b admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:46.437045 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec4ad1-bc95-4cb9-8cf0-8b8820356fed admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:46.437319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec4ad1-bc95-4cb9-8cf0-8b8820356fed admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:46.437599 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4209b37f-7c8e-4ed6-85b7-b8e173b32c7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:46.437951 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ec4ad1-bc95-4cb9-8cf0-8b8820356fed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:46.439436 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4209b37f-7c8e-4ed6-85b7-b8e173b32c7b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:46.439894 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ec4ad1-bc95-4cb9-8cf0-8b8820356fed admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:46.449065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:46.450417 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4057/8087] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:17:46.454483 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4209b37f-7c8e-4ed6-85b7-b8e173b32c7b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:46.466832 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4031/8088] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:17:46 2022] POST /identity/v3/users => generated 283 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:17:46.469841 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4209b37f-7c8e-4ed6-85b7-b8e173b32c7b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:46.470681 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec4ad1-bc95-4cb9-8cf0-8b8820356fed admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:46.475000 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c3c03-aa8b-4f50-8a3c-19aed3679d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:46.475644 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c3c03-aa8b-4f50-8a3c-19aed3679d46 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:46.475911 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c3c03-aa8b-4f50-8a3c-19aed3679d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:46.476185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c3c03-aa8b-4f50-8a3c-19aed3679d46 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:46.477184 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522c3c03-aa8b-4f50-8a3c-19aed3679d46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:46.478428 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522c3c03-aa8b-4f50-8a3c-19aed3679d46 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:46.480420 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec4ad1-bc95-4cb9-8cf0-8b8820356fed admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:46.486886 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8fe43-e5bd-4e67-94a3-dfe2769805d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:46.487644 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8fe43-e5bd-4e67-94a3-dfe2769805d8 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:46.487984 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8fe43-e5bd-4e67-94a3-dfe2769805d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:46.488327 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8fe43-e5bd-4e67-94a3-dfe2769805d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:46.489037 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf8fe43-e5bd-4e67-94a3-dfe2769805d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:46.490067 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4058/8089] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:17:46.491113 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf8fe43-e5bd-4e67-94a3-dfe2769805d8 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:46.494151 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c3c03-aa8b-4f50-8a3c-19aed3679d46 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:46.504200 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c3c03-aa8b-4f50-8a3c-19aed3679d46 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:46.504365 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4032/8090] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:17:46.508391 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8fe43-e5bd-4e67-94a3-dfe2769805d8 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:46.508926 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd463b-4d6d-444f-aaa4-4abc152adaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:46.509581 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd463b-4d6d-444f-aaa4-4abc152adaa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:46.509856 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd463b-4d6d-444f-aaa4-4abc152adaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:46.510126 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd463b-4d6d-444f-aaa4-4abc152adaa9 admin admin] PATH_INFO: `/v3/projects/ab5b30085c0f4426a6b806214e212f14/users/3b301a1bf29d40219d2790badbb1c688/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:46.518731 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8fe43-e5bd-4e67-94a3-dfe2769805d8 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:46.523698 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1130a2-afb5-4c6f-89ce-732493a8eaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:46.524400 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1130a2-afb5-4c6f-89ce-732493a8eaf3 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:46.524775 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1130a2-afb5-4c6f-89ce-732493a8eaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:46.525052 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcd463b-4d6d-444f-aaa4-4abc152adaa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab5b30085c0f4426a6b806214e212f14, user_id=3b301a1bf29d40219d2790badbb1c688, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:46.525174 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1130a2-afb5-4c6f-89ce-732493a8eaf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:46.525911 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1130a2-afb5-4c6f-89ce-732493a8eaf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:46.527601 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1130a2-afb5-4c6f-89ce-732493a8eaf3 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:46.527744 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcd463b-4d6d-444f-aaa4-4abc152adaa9 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:46.540468 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4033/8091] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:17:46.542763 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4059/8092] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:17:46 2022] PUT /identity/v3/projects/ab5b30085c0f4426a6b806214e212f14/users/3b301a1bf29d40219d2790badbb1c688/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:17:46.545697 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1130a2-afb5-4c6f-89ce-732493a8eaf3 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:46.554673 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1446f5-4c70-4b6b-a80b-1dcc026db8e5 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:46.555352 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1446f5-4c70-4b6b-a80b-1dcc026db8e5 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:46.555637 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1446f5-4c70-4b6b-a80b-1dcc026db8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:46.555930 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1130a2-afb5-4c6f-89ce-732493a8eaf3 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:46.586541 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-bb1446f5-4c70-4b6b-a80b-1dcc026db8e5 None None] MFA Rules not processed for user `3b301a1bf29d40219d2790badbb1c688`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:46.587803 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-bb1446f5-4c70-4b6b-a80b-1dcc026db8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:46.593818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:46.618397 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa7359e-db4c-470b-ab26-18fdd5d63774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:46.618971 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7359e-db4c-470b-ab26-18fdd5d63774 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:46.619280 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7359e-db4c-470b-ab26-18fdd5d63774 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:46.619557 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7359e-db4c-470b-ab26-18fdd5d63774 admin admin] PATH_INFO: `/v3/projects/d4ef81c814994a1391ba8d5af6627f09/users/75aa3280d42e47aabfeda7e54db14f89/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:46.634320 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa7359e-db4c-470b-ab26-18fdd5d63774 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4ef81c814994a1391ba8d5af6627f09, user_id=75aa3280d42e47aabfeda7e54db14f89, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:46.637199 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa7359e-db4c-470b-ab26-18fdd5d63774 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:46.650572 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4034/8093] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:17:46 2022] PUT /identity/v3/projects/d4ef81c814994a1391ba8d5af6627f09/users/75aa3280d42e47aabfeda7e54db14f89/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:17:46.658280 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4060/8094] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:17:46.661627 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d6d7c-8c70-4773-a08f-ce10d61b14f9 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:46.662328 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d6d7c-8c70-4773-a08f-ce10d61b14f9 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:46.662328 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d6d7c-8c70-4773-a08f-ce10d61b14f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:46.667952 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1446f5-4c70-4b6b-a80b-1dcc026db8e5 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:46.669372 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-bb1446f5-4c70-4b6b-a80b-1dcc026db8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:46.692953 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-7b3d6d7c-8c70-4773-a08f-ce10d61b14f9 None None] MFA Rules not processed for user `75aa3280d42e47aabfeda7e54db14f89`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:46.694178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7b3d6d7c-8c70-4773-a08f-ce10d61b14f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:46.736861 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1446f5-4c70-4b6b-a80b-1dcc026db8e5 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:46.761287 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4035/8095] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:17:46.772872 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d6d7c-8c70-4773-a08f-ce10d61b14f9 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:46.774310 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7b3d6d7c-8c70-4773-a08f-ce10d61b14f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:46.789198 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d6144-aae7-47d7-b4de-e135942ced54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:46.789817 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d6144-aae7-47d7-b4de-e135942ced54 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:46.790093 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d6144-aae7-47d7-b4de-e135942ced54 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:46.790362 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d6144-aae7-47d7-b4de-e135942ced54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:46.826352 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:46.842096 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d6d7c-8c70-4773-a08f-ce10d61b14f9 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:46.846101 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe8109-766e-468f-a4bf-f5b63d6ef371 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6b0f9835ed549cab91d684326be83fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:46.846740 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe8109-766e-468f-a4bf-f5b63d6ef371 service glance] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:46.847040 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe8109-766e-468f-a4bf-f5b63d6ef371 service glance] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:46.847404 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe8109-766e-468f-a4bf-f5b63d6ef371 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:46.853929 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d6144-aae7-47d7-b4de-e135942ced54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:46.855492 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d6144-aae7-47d7-b4de-e135942ced54 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:46.855995 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe8109-766e-468f-a4bf-f5b63d6ef371 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:46.857471 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe8109-766e-468f-a4bf-f5b63d6ef371 service glance] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:46.865192 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4061/8096] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:17:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:17:46.866545 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4036/8097] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:17:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:17:47.255929 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d6144-aae7-47d7-b4de-e135942ced54 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:47.278455 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:47.328338 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d6144-aae7-47d7-b4de-e135942ced54 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:47.333075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc88ad8-1938-4f98-a836-257df827ffa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:47.333780 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc88ad8-1938-4f98-a836-257df827ffa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:47.334067 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc88ad8-1938-4f98-a836-257df827ffa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:47.334340 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc88ad8-1938-4f98-a836-257df827ffa9 admin admin] PATH_INFO: `/v3/users/75aa3280d42e47aabfeda7e54db14f89` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:47.335512 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc88ad8-1938-4f98-a836-257df827ffa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75aa3280d42e47aabfeda7e54db14f89)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:47.337446 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc88ad8-1938-4f98-a836-257df827ffa9 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:47.385478 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5dc88ad8-1938-4f98-a836-257df827ffa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75aa3280d42e47aabfeda7e54db14f89'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:47.386482 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5dc88ad8-1938-4f98-a836-257df827ffa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75aa3280d42e47aabfeda7e54db14f89'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:47.394987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5dc88ad8-1938-4f98-a836-257df827ffa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75aa3280d42e47aabfeda7e54db14f89'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:47.402805 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5dc88ad8-1938-4f98-a836-257df827ffa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75aa3280d42e47aabfeda7e54db14f89'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:47.403775 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5dc88ad8-1938-4f98-a836-257df827ffa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75aa3280d42e47aabfeda7e54db14f89'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:47.421892 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4062/8098] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:17:47 2022] DELETE /identity/v3/users/75aa3280d42e47aabfeda7e54db14f89 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:17:47.426441 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2f4dc-f785-4fe1-a522-22d254c7747d None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:47.426907 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2f4dc-f785-4fe1-a522-22d254c7747d None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:47.427045 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2f4dc-f785-4fe1-a522-22d254c7747d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:47.447901 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-dbf2f4dc-f785-4fe1-a522-22d254c7747d None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:47.449108 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-dbf2f4dc-f785-4fe1-a522-22d254c7747d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:47.511427 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4037/8099] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:17:47.521852 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc88ad8-1938-4f98-a836-257df827ffa9 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:47.523352 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5dc88ad8-1938-4f98-a836-257df827ffa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:47.586278 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc88ad8-1938-4f98-a836-257df827ffa9 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:47.590017 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ea7b5-e1ca-411f-ac79-b1bfe882f5f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:47.590627 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ea7b5-e1ca-411f-ac79-b1bfe882f5f2 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:47.590936 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ea7b5-e1ca-411f-ac79-b1bfe882f5f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:47.591304 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ea7b5-e1ca-411f-ac79-b1bfe882f5f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:47.601035 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ea7b5-e1ca-411f-ac79-b1bfe882f5f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:47.602475 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ea7b5-e1ca-411f-ac79-b1bfe882f5f2 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:47.613323 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4063/8100] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:17:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:17:47.897438 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf2f4dc-f785-4fe1-a522-22d254c7747d None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:47.899731 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-dbf2f4dc-f785-4fe1-a522-22d254c7747d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:47.915037 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf2f4dc-f785-4fe1-a522-22d254c7747d None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:47.921344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d16a8c8-0a93-4e8d-a9e0-36ad30ba0854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:47.922307 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16a8c8-0a93-4e8d-a9e0-36ad30ba0854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:47.922569 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16a8c8-0a93-4e8d-a9e0-36ad30ba0854 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:47.923046 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16a8c8-0a93-4e8d-a9e0-36ad30ba0854 admin admin] PATH_INFO: `/v3/projects/d4ef81c814994a1391ba8d5af6627f09` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:47.924410 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d16a8c8-0a93-4e8d-a9e0-36ad30ba0854 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4ef81c814994a1391ba8d5af6627f09)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:47.926499 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d16a8c8-0a93-4e8d-a9e0-36ad30ba0854 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:47.977435 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2d16a8c8-0a93-4e8d-a9e0-36ad30ba0854 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4ef81c814994a1391ba8d5af6627f09', 'request_id': 'req-2d16a8c8-0a93-4e8d-a9e0-36ad30ba0854'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:47.984354 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2d16a8c8-0a93-4e8d-a9e0-36ad30ba0854 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4ef81c814994a1391ba8d5af6627f09', 'request_id': 'req-2d16a8c8-0a93-4e8d-a9e0-36ad30ba0854'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:47.991376 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2d16a8c8-0a93-4e8d-a9e0-36ad30ba0854 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4ef81c814994a1391ba8d5af6627f09', 'request_id': 'req-2d16a8c8-0a93-4e8d-a9e0-36ad30ba0854'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:48.002948 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2d16a8c8-0a93-4e8d-a9e0-36ad30ba0854 admin admin] The token cache is being invalidate because project d4ef81c814994a1391ba8d5af6627f09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:17:48.003280 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2d16a8c8-0a93-4e8d-a9e0-36ad30ba0854 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:48.003958 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-2d16a8c8-0a93-4e8d-a9e0-36ad30ba0854 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:48.005728 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4038/8101] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:17:47 2022] DELETE /identity/v3/projects/d4ef81c814994a1391ba8d5af6627f09 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:48.010419 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec84df1-5523-4a49-a5dc-d9e7d4a21c75 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:48.010701 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec84df1-5523-4a49-a5dc-d9e7d4a21c75 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:48.010996 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec84df1-5523-4a49-a5dc-d9e7d4a21c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:48.031930 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-dec84df1-5523-4a49-a5dc-d9e7d4a21c75 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:48.033127 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-dec84df1-5523-4a49-a5dc-d9e7d4a21c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:48.067168 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:48.095673 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4064/8102] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:17:48.103332 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95196bf7-8c03-454b-8019-5ca1aa7915ad None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:48.103604 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95196bf7-8c03-454b-8019-5ca1aa7915ad None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:48.103876 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95196bf7-8c03-454b-8019-5ca1aa7915ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:48.124329 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-95196bf7-8c03-454b-8019-5ca1aa7915ad None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:48.125553 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-95196bf7-8c03-454b-8019-5ca1aa7915ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:48.133628 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4039/8103] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:17:48.137761 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec84df1-5523-4a49-a5dc-d9e7d4a21c75 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:48.147838 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec84df1-5523-4a49-a5dc-d9e7d4a21c75 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:48.152433 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c2d4c9-dda9-4ede-92e7-7090b1eda76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:48.153032 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2d4c9-dda9-4ede-92e7-7090b1eda76d admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:48.153311 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2d4c9-dda9-4ede-92e7-7090b1eda76d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:48.154107 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2d4c9-dda9-4ede-92e7-7090b1eda76d admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:48.155088 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c2d4c9-dda9-4ede-92e7-7090b1eda76d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:17:48.155402 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c2d4c9-dda9-4ede-92e7-7090b1eda76d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:48.157001 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c2d4c9-dda9-4ede-92e7-7090b1eda76d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:48.168759 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4065/8104] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:17:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:17:48.173816 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95196bf7-8c03-454b-8019-5ca1aa7915ad None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:48.183353 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95196bf7-8c03-454b-8019-5ca1aa7915ad None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:48.188372 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2465cdf-bf6f-419c-9836-ed6390ff9b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:48.188967 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2465cdf-bf6f-419c-9836-ed6390ff9b57 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:48.189241 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2465cdf-bf6f-419c-9836-ed6390ff9b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:48.189510 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2465cdf-bf6f-419c-9836-ed6390ff9b57 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:48.190140 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2465cdf-bf6f-419c-9836-ed6390ff9b57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:48.192072 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2465cdf-bf6f-419c-9836-ed6390ff9b57 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:48.223418 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4040/8105] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:17:48 2022] POST /identity/v3/projects => generated 359 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:17:48.224547 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c2d4c9-dda9-4ede-92e7-7090b1eda76d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:48.235883 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c2d4c9-dda9-4ede-92e7-7090b1eda76d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:48.292896 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004bd6b-5f5c-416c-a29f-f07bf8452d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:48.293554 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004bd6b-5f5c-416c-a29f-f07bf8452d17 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:48.293770 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004bd6b-5f5c-416c-a29f-f07bf8452d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:48.294045 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004bd6b-5f5c-416c-a29f-f07bf8452d17 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:48.295374 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c004bd6b-5f5c-416c-a29f-f07bf8452d17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:48.297343 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c004bd6b-5f5c-416c-a29f-f07bf8452d17 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:48.322362 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4066/8106] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:17:48 2022] POST /identity/v3/users => generated 280 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:17:48.323567 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2465cdf-bf6f-419c-9836-ed6390ff9b57 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:48.334636 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2465cdf-bf6f-419c-9836-ed6390ff9b57 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:48.339374 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c2e39-d635-4bff-a9b8-89202671b7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:48.339978 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c2e39-d635-4bff-a9b8-89202671b7e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:48.340262 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c2e39-d635-4bff-a9b8-89202671b7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:48.340649 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c2e39-d635-4bff-a9b8-89202671b7e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:48.342636 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7c2e39-d635-4bff-a9b8-89202671b7e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:48.344297 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7c2e39-d635-4bff-a9b8-89202671b7e4 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:48.357300 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4041/8107] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:17:48.358658 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004bd6b-5f5c-416c-a29f-f07bf8452d17 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:48.368712 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004bd6b-5f5c-416c-a29f-f07bf8452d17 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:48.373622 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f6158c-8a79-45d1-bd7f-08ee1ab015ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:48.374247 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6158c-8a79-45d1-bd7f-08ee1ab015ea admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:48.374632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6158c-8a79-45d1-bd7f-08ee1ab015ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:48.374910 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6158c-8a79-45d1-bd7f-08ee1ab015ea admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:48.375446 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f6158c-8a79-45d1-bd7f-08ee1ab015ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:48.377087 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f6158c-8a79-45d1-bd7f-08ee1ab015ea admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:48.390238 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4067/8108] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:17:48.394493 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c2e39-d635-4bff-a9b8-89202671b7e4 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:48.406207 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c2e39-d635-4bff-a9b8-89202671b7e4 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:48.411319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d77946-a2d2-4c80-9528-4731c6549a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:48.412023 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d77946-a2d2-4c80-9528-4731c6549a8a admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:48.412302 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d77946-a2d2-4c80-9528-4731c6549a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:48.412609 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d77946-a2d2-4c80-9528-4731c6549a8a admin admin] PATH_INFO: `/v3/projects/47382ed79f9e4fcaab019e1001356cd3/users/f5ca364674eb4a049d0f9ca80dc5826f/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:48.430774 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d77946-a2d2-4c80-9528-4731c6549a8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=47382ed79f9e4fcaab019e1001356cd3, user_id=f5ca364674eb4a049d0f9ca80dc5826f, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:48.433446 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d77946-a2d2-4c80-9528-4731c6549a8a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:48.448792 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4042/8109] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:17:48 2022] PUT /identity/v3/projects/47382ed79f9e4fcaab019e1001356cd3/users/f5ca364674eb4a049d0f9ca80dc5826f/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:48.461108 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6415559-fd92-4f7f-b328-ec5e439d3754 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:48.461571 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6415559-fd92-4f7f-b328-ec5e439d3754 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:48.461847 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6415559-fd92-4f7f-b328-ec5e439d3754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:48.489833 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-c6415559-fd92-4f7f-b328-ec5e439d3754 None None] MFA Rules not processed for user `f5ca364674eb4a049d0f9ca80dc5826f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:48.491057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c6415559-fd92-4f7f-b328-ec5e439d3754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:48.557214 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4068/8110] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:48 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:17:48.570455 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d77946-a2d2-4c80-9528-4731c6549a8a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:48.577318 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:48.636647 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d77946-a2d2-4c80-9528-4731c6549a8a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:48.642127 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4ea83-0a56-4565-acb6-8619e56f4179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:48.642790 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4ea83-0a56-4565-acb6-8619e56f4179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:48.643093 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4ea83-0a56-4565-acb6-8619e56f4179 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:48.643370 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4ea83-0a56-4565-acb6-8619e56f4179 admin admin] PATH_INFO: `/v3/users/f5ca364674eb4a049d0f9ca80dc5826f` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:48.644542 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c4ea83-0a56-4565-acb6-8619e56f4179 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5ca364674eb4a049d0f9ca80dc5826f)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:48.646478 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c4ea83-0a56-4565-acb6-8619e56f4179 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:48.695731 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-53c4ea83-0a56-4565-acb6-8619e56f4179 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5ca364674eb4a049d0f9ca80dc5826f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:48.696418 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-53c4ea83-0a56-4565-acb6-8619e56f4179 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5ca364674eb4a049d0f9ca80dc5826f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:48.709250 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-53c4ea83-0a56-4565-acb6-8619e56f4179 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5ca364674eb4a049d0f9ca80dc5826f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:48.717708 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-53c4ea83-0a56-4565-acb6-8619e56f4179 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5ca364674eb4a049d0f9ca80dc5826f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:48.725059 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-53c4ea83-0a56-4565-acb6-8619e56f4179 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5ca364674eb4a049d0f9ca80dc5826f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:48.731002 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4043/8111] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:17:48 2022] DELETE /identity/v3/users/f5ca364674eb4a049d0f9ca80dc5826f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:48.735931 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db38f97-13f4-440d-9b58-32848ac78df0 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:48.736216 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db38f97-13f4-440d-9b58-32848ac78df0 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:48.736486 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db38f97-13f4-440d-9b58-32848ac78df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:48.758079 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-5db38f97-13f4-440d-9b58-32848ac78df0 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:48.759315 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5db38f97-13f4-440d-9b58-32848ac78df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:48.791422 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:48.823862 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4069/8112] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:17:48.834305 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4ea83-0a56-4565-acb6-8619e56f4179 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:48.835730 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-53c4ea83-0a56-4565-acb6-8619e56f4179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:48.895294 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4ea83-0a56-4565-acb6-8619e56f4179 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:48.899240 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df602b43-83fc-435f-8dc2-9ecf51ab2495 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:48.899884 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df602b43-83fc-435f-8dc2-9ecf51ab2495 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:48.900164 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df602b43-83fc-435f-8dc2-9ecf51ab2495 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:48.900436 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df602b43-83fc-435f-8dc2-9ecf51ab2495 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:48.910288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df602b43-83fc-435f-8dc2-9ecf51ab2495 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:48.911756 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df602b43-83fc-435f-8dc2-9ecf51ab2495 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:48.921925 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4044/8113] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:17:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:17:49.202771 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db38f97-13f4-440d-9b58-32848ac78df0 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:49.204374 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5db38f97-13f4-440d-9b58-32848ac78df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:49.218818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db38f97-13f4-440d-9b58-32848ac78df0 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:49.224181 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82261b3f-cde4-42cf-b6fd-34579916b582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:49.224937 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82261b3f-cde4-42cf-b6fd-34579916b582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:49.225316 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82261b3f-cde4-42cf-b6fd-34579916b582 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:49.225690 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82261b3f-cde4-42cf-b6fd-34579916b582 admin admin] PATH_INFO: `/v3/projects/47382ed79f9e4fcaab019e1001356cd3` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:49.226919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82261b3f-cde4-42cf-b6fd-34579916b582 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47382ed79f9e4fcaab019e1001356cd3)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:49.229116 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82261b3f-cde4-42cf-b6fd-34579916b582 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:49.281665 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-82261b3f-cde4-42cf-b6fd-34579916b582 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47382ed79f9e4fcaab019e1001356cd3', 'request_id': 'req-82261b3f-cde4-42cf-b6fd-34579916b582'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:49.287271 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-82261b3f-cde4-42cf-b6fd-34579916b582 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47382ed79f9e4fcaab019e1001356cd3', 'request_id': 'req-82261b3f-cde4-42cf-b6fd-34579916b582'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:49.293847 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-82261b3f-cde4-42cf-b6fd-34579916b582 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47382ed79f9e4fcaab019e1001356cd3', 'request_id': 'req-82261b3f-cde4-42cf-b6fd-34579916b582'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:49.307784 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-82261b3f-cde4-42cf-b6fd-34579916b582 admin admin] The token cache is being invalidate because project 47382ed79f9e4fcaab019e1001356cd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:17:49.308074 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-82261b3f-cde4-42cf-b6fd-34579916b582 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:49.308702 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-82261b3f-cde4-42cf-b6fd-34579916b582 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:49.310986 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4070/8114] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:17:49 2022] DELETE /identity/v3/projects/47382ed79f9e4fcaab019e1001356cd3 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:49.316364 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e418305-3c3d-44c7-884e-b6867489921a None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:49.316655 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e418305-3c3d-44c7-884e-b6867489921a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:49.316928 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e418305-3c3d-44c7-884e-b6867489921a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:49.338295 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-9e418305-3c3d-44c7-884e-b6867489921a None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:49.339566 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9e418305-3c3d-44c7-884e-b6867489921a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:49.361722 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:49.407609 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4045/8115] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:17:49.415243 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f0a19-99e4-430e-ae32-6915a6f1b056 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:49.415530 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f0a19-99e4-430e-ae32-6915a6f1b056 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:49.415805 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f0a19-99e4-430e-ae32-6915a6f1b056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:49.437842 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-065f0a19-99e4-430e-ae32-6915a6f1b056 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:49.439081 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-065f0a19-99e4-430e-ae32-6915a6f1b056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:49.447000 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4071/8116] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:17:49.451476 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e418305-3c3d-44c7-884e-b6867489921a None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:49.461806 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e418305-3c3d-44c7-884e-b6867489921a None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:49.467194 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be5634-6e70-40d7-840e-e05d214d34f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:49.467605 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be5634-6e70-40d7-840e-e05d214d34f0 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:49.467893 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be5634-6e70-40d7-840e-e05d214d34f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:49.468161 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be5634-6e70-40d7-840e-e05d214d34f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:49.468810 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8be5634-6e70-40d7-840e-e05d214d34f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:17:49.469113 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8be5634-6e70-40d7-840e-e05d214d34f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:49.470731 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8be5634-6e70-40d7-840e-e05d214d34f0 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:49.483438 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4046/8117] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:17:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:17:49.487888 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f0a19-99e4-430e-ae32-6915a6f1b056 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:49.497121 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f0a19-99e4-430e-ae32-6915a6f1b056 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:49.502243 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f59e286-d005-4cf1-a133-121d2ffd7ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:49.502840 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59e286-d005-4cf1-a133-121d2ffd7ea6 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:49.503145 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59e286-d005-4cf1-a133-121d2ffd7ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:49.503415 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59e286-d005-4cf1-a133-121d2ffd7ea6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:49.504136 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f59e286-d005-4cf1-a133-121d2ffd7ea6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:49.506090 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f59e286-d005-4cf1-a133-121d2ffd7ea6 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:49.535239 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4072/8118] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:17:49 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:17:49.538763 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be5634-6e70-40d7-840e-e05d214d34f0 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:49.550433 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be5634-6e70-40d7-840e-e05d214d34f0 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:49.610642 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4c005-f810-47ff-86b5-56d8a04ce529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:49.611574 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4c005-f810-47ff-86b5-56d8a04ce529 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:49.611850 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4c005-f810-47ff-86b5-56d8a04ce529 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:49.612121 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4c005-f810-47ff-86b5-56d8a04ce529 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:49.612751 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf4c005-f810-47ff-86b5-56d8a04ce529 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:49.614701 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf4c005-f810-47ff-86b5-56d8a04ce529 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:49.639712 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4047/8119] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:17:49 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:17:49.641007 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f59e286-d005-4cf1-a133-121d2ffd7ea6 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:49.652009 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f59e286-d005-4cf1-a133-121d2ffd7ea6 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:49.658148 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016824bc-44c9-4242-8a6e-c3c30ae947e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:49.658756 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016824bc-44c9-4242-8a6e-c3c30ae947e5 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:49.659054 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016824bc-44c9-4242-8a6e-c3c30ae947e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:49.659454 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016824bc-44c9-4242-8a6e-c3c30ae947e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:49.660106 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016824bc-44c9-4242-8a6e-c3c30ae947e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:49.661700 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016824bc-44c9-4242-8a6e-c3c30ae947e5 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:49.672887 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4073/8120] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:17:49.677211 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4c005-f810-47ff-86b5-56d8a04ce529 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:49.688120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4c005-f810-47ff-86b5-56d8a04ce529 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:49.692716 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c26227-b2bb-4d16-abf1-abd0a9886ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:49.693314 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c26227-b2bb-4d16-abf1-abd0a9886ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:49.693589 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c26227-b2bb-4d16-abf1-abd0a9886ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:49.693857 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c26227-b2bb-4d16-abf1-abd0a9886ee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:49.694498 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c26227-b2bb-4d16-abf1-abd0a9886ee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:49.696143 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c26227-b2bb-4d16-abf1-abd0a9886ee9 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:49.713315 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4048/8121] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:17:49.717617 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016824bc-44c9-4242-8a6e-c3c30ae947e5 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:49.727575 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016824bc-44c9-4242-8a6e-c3c30ae947e5 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:49.732096 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24efed21-8d05-42c2-956c-aa57cd65daf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:49.732740 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efed21-8d05-42c2-956c-aa57cd65daf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:49.733011 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efed21-8d05-42c2-956c-aa57cd65daf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:49.733279 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efed21-8d05-42c2-956c-aa57cd65daf4 admin admin] PATH_INFO: `/v3/projects/399731441cad4d84ba56e6b66c292e68/users/3d823bd922ce4408a6bf9d0ad828c2bc/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:49.752298 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24efed21-8d05-42c2-956c-aa57cd65daf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=399731441cad4d84ba56e6b66c292e68, user_id=3d823bd922ce4408a6bf9d0ad828c2bc, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:49.754993 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24efed21-8d05-42c2-956c-aa57cd65daf4 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:49.769442 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4074/8122] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:17:49 2022] PUT /identity/v3/projects/399731441cad4d84ba56e6b66c292e68/users/3d823bd922ce4408a6bf9d0ad828c2bc/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:17:49.780195 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315456c3-b2ef-46c6-ba98-c484d44b0ad5 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:49.780587 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315456c3-b2ef-46c6-ba98-c484d44b0ad5 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:49.780752 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315456c3-b2ef-46c6-ba98-c484d44b0ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:49.808581 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-315456c3-b2ef-46c6-ba98-c484d44b0ad5 None None] MFA Rules not processed for user `3d823bd922ce4408a6bf9d0ad828c2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:49.809716 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-315456c3-b2ef-46c6-ba98-c484d44b0ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:49.876668 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4049/8123] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:17:49.881222 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24efed21-8d05-42c2-956c-aa57cd65daf4 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:49.939560 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:49.946361 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24efed21-8d05-42c2-956c-aa57cd65daf4 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:49.952599 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eff2ef-e01c-4609-bbf7-d983818dfd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:49.953286 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eff2ef-e01c-4609-bbf7-d983818dfd99 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:49.953644 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eff2ef-e01c-4609-bbf7-d983818dfd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:49.953989 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eff2ef-e01c-4609-bbf7-d983818dfd99 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:49.954703 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eff2ef-e01c-4609-bbf7-d983818dfd99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:49.956750 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eff2ef-e01c-4609-bbf7-d983818dfd99 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:49.987223 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4075/8124] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:17:49 2022] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:17:49.988453 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315456c3-b2ef-46c6-ba98-c484d44b0ad5 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:50.000152 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315456c3-b2ef-46c6-ba98-c484d44b0ad5 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:50.018240 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:50.062845 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc7511-81b7-4ea6-8d04-5caffffa7d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:50.063411 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc7511-81b7-4ea6-8d04-5caffffa7d8e admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:50.063690 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc7511-81b7-4ea6-8d04-5caffffa7d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:50.063961 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc7511-81b7-4ea6-8d04-5caffffa7d8e admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:50.064595 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc7511-81b7-4ea6-8d04-5caffffa7d8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:50.066560 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc7511-81b7-4ea6-8d04-5caffffa7d8e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:50.090272 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4050/8125] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:17:49 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:17:50.095854 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eff2ef-e01c-4609-bbf7-d983818dfd99 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:50.106180 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eff2ef-e01c-4609-bbf7-d983818dfd99 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:50.111329 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529bebd-3d91-4f3d-9572-1a952974dbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:50.111929 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529bebd-3d91-4f3d-9572-1a952974dbcd admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:50.112206 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529bebd-3d91-4f3d-9572-1a952974dbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:50.112481 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529bebd-3d91-4f3d-9572-1a952974dbcd admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:50.113119 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529bebd-3d91-4f3d-9572-1a952974dbcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:50.114716 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529bebd-3d91-4f3d-9572-1a952974dbcd admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:50.125495 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4076/8126] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:17:50.129965 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc7511-81b7-4ea6-8d04-5caffffa7d8e admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:50.140876 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc7511-81b7-4ea6-8d04-5caffffa7d8e admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:50.145702 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437efe3-d098-4daf-8a25-602fdfb05d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:50.146363 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437efe3-d098-4daf-8a25-602fdfb05d67 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:50.146674 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437efe3-d098-4daf-8a25-602fdfb05d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:50.146984 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437efe3-d098-4daf-8a25-602fdfb05d67 admin admin] PATH_INFO: `/v3/projects/e432c716f6b244a38d433eeea1c63480/users/60873eb2f7a24c3cbe41b9b7d7a728dc/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:50.162815 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7437efe3-d098-4daf-8a25-602fdfb05d67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e432c716f6b244a38d433eeea1c63480, user_id=60873eb2f7a24c3cbe41b9b7d7a728dc, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:50.165512 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7437efe3-d098-4daf-8a25-602fdfb05d67 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:50.178775 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4051/8127] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:17:50 2022] PUT /identity/v3/projects/e432c716f6b244a38d433eeea1c63480/users/60873eb2f7a24c3cbe41b9b7d7a728dc/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:50.183127 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529bebd-3d91-4f3d-9572-1a952974dbcd admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:50.193519 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529bebd-3d91-4f3d-9572-1a952974dbcd admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:50.251302 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb2a1b-6285-4fef-85c1-0735a6b252a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:50.251912 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb2a1b-6285-4fef-85c1-0735a6b252a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:50.252204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb2a1b-6285-4fef-85c1-0735a6b252a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:50.252466 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb2a1b-6285-4fef-85c1-0735a6b252a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:50.253106 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cb2a1b-6285-4fef-85c1-0735a6b252a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:50.254707 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cb2a1b-6285-4fef-85c1-0735a6b252a9 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:50.265971 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4077/8128] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:17:50.269895 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437efe3-d098-4daf-8a25-602fdfb05d67 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:50.281641 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437efe3-d098-4daf-8a25-602fdfb05d67 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:50.286218 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f26c16-65bc-462c-aecf-ffc176e6287c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:50.286860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f26c16-65bc-462c-aecf-ffc176e6287c admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:50.287282 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f26c16-65bc-462c-aecf-ffc176e6287c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:50.287555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f26c16-65bc-462c-aecf-ffc176e6287c admin admin] PATH_INFO: `/v3/projects/e432c716f6b244a38d433eeea1c63480/users/60873eb2f7a24c3cbe41b9b7d7a728dc/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:50.289603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f26c16-65bc-462c-aecf-ffc176e6287c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e432c716f6b244a38d433eeea1c63480, user_id=60873eb2f7a24c3cbe41b9b7d7a728dc, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:50.292311 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f26c16-65bc-462c-aecf-ffc176e6287c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:50.302511 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4052/8129] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:17:50 2022] PUT /identity/v3/projects/e432c716f6b244a38d433eeea1c63480/users/60873eb2f7a24c3cbe41b9b7d7a728dc/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:17:50.315391 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f19342-2e41-45d9-b8c0-603849d57ef8 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:50.315868 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f19342-2e41-45d9-b8c0-603849d57ef8 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:50.315962 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f19342-2e41-45d9-b8c0-603849d57ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:50.344289 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-f0f19342-2e41-45d9-b8c0-603849d57ef8 None None] MFA Rules not processed for user `60873eb2f7a24c3cbe41b9b7d7a728dc`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:50.345471 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f0f19342-2e41-45d9-b8c0-603849d57ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:50.414212 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4078/8130] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:17:50.424551 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f26c16-65bc-462c-aecf-ffc176e6287c admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:50.426252 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-80f26c16-65bc-462c-aecf-ffc176e6287c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:50.490108 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f26c16-65bc-462c-aecf-ffc176e6287c admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:50.493907 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec8437-5239-41bf-93cf-fefcdf71a50e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:50.494580 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec8437-5239-41bf-93cf-fefcdf71a50e service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:50.494857 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec8437-5239-41bf-93cf-fefcdf71a50e service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:50.495159 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec8437-5239-41bf-93cf-fefcdf71a50e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:50.505514 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ec8437-5239-41bf-93cf-fefcdf71a50e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:50.506953 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ec8437-5239-41bf-93cf-fefcdf71a50e service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:50.517433 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4053/8131] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:17:50 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:17:52.230041 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f19342-2e41-45d9-b8c0-603849d57ef8 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:52.290968 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:52.309351 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f19342-2e41-45d9-b8c0-603849d57ef8 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:52.316503 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156320b2-72be-4ff6-95c9-024d2a878198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:52.317630 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156320b2-72be-4ff6-95c9-024d2a878198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:52.318572 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156320b2-72be-4ff6-95c9-024d2a878198 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:52.318572 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156320b2-72be-4ff6-95c9-024d2a878198 admin admin] PATH_INFO: `/v3/users/3d823bd922ce4408a6bf9d0ad828c2bc` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:52.320462 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156320b2-72be-4ff6-95c9-024d2a878198 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d823bd922ce4408a6bf9d0ad828c2bc)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:52.322310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156320b2-72be-4ff6-95c9-024d2a878198 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:52.383178 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-156320b2-72be-4ff6-95c9-024d2a878198 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d823bd922ce4408a6bf9d0ad828c2bc'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:52.383860 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-156320b2-72be-4ff6-95c9-024d2a878198 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d823bd922ce4408a6bf9d0ad828c2bc'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:52.393922 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-156320b2-72be-4ff6-95c9-024d2a878198 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d823bd922ce4408a6bf9d0ad828c2bc'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:52.401653 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-156320b2-72be-4ff6-95c9-024d2a878198 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d823bd922ce4408a6bf9d0ad828c2bc'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:52.402369 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-156320b2-72be-4ff6-95c9-024d2a878198 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d823bd922ce4408a6bf9d0ad828c2bc'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:52.421603 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4079/8132] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:17:52 2022] DELETE /identity/v3/users/3d823bd922ce4408a6bf9d0ad828c2bc => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:52.425952 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44f16a-307a-46f5-8b71-cb4679ea4faf None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:52.426756 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44f16a-307a-46f5-8b71-cb4679ea4faf None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:52.427062 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44f16a-307a-46f5-8b71-cb4679ea4faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:52.446860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-2c44f16a-307a-46f5-8b71-cb4679ea4faf None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:52.448308 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2c44f16a-307a-46f5-8b71-cb4679ea4faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:52.518956 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4054/8133] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:17:52.528356 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156320b2-72be-4ff6-95c9-024d2a878198 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:52.530487 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-156320b2-72be-4ff6-95c9-024d2a878198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:52.634678 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156320b2-72be-4ff6-95c9-024d2a878198 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:52.640751 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92248164-35e3-4b6b-b084-b017440362ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:52.642360 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92248164-35e3-4b6b-b084-b017440362ee service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:52.643217 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92248164-35e3-4b6b-b084-b017440362ee service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:52.643688 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92248164-35e3-4b6b-b084-b017440362ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:52.662722 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92248164-35e3-4b6b-b084-b017440362ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:52.665358 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92248164-35e3-4b6b-b084-b017440362ee service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:52.683117 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4080/8134] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:17:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:17:53.104076 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44f16a-307a-46f5-8b71-cb4679ea4faf None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:53.105591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2c44f16a-307a-46f5-8b71-cb4679ea4faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:53.123824 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44f16a-307a-46f5-8b71-cb4679ea4faf None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:53.131182 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b9b0ec-3ae9-4bec-8919-be77816ed9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:53.131842 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9b0ec-3ae9-4bec-8919-be77816ed9b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:53.132144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9b0ec-3ae9-4bec-8919-be77816ed9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:53.132424 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9b0ec-3ae9-4bec-8919-be77816ed9b6 admin admin] PATH_INFO: `/v3/projects/399731441cad4d84ba56e6b66c292e68` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:53.133584 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b9b0ec-3ae9-4bec-8919-be77816ed9b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=399731441cad4d84ba56e6b66c292e68)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:53.135577 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b9b0ec-3ae9-4bec-8919-be77816ed9b6 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:53.149079 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:53.191628 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-56b9b0ec-3ae9-4bec-8919-be77816ed9b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '399731441cad4d84ba56e6b66c292e68', 'request_id': 'req-56b9b0ec-3ae9-4bec-8919-be77816ed9b6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:53.197672 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-56b9b0ec-3ae9-4bec-8919-be77816ed9b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '399731441cad4d84ba56e6b66c292e68', 'request_id': 'req-56b9b0ec-3ae9-4bec-8919-be77816ed9b6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:53.207048 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-56b9b0ec-3ae9-4bec-8919-be77816ed9b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '399731441cad4d84ba56e6b66c292e68', 'request_id': 'req-56b9b0ec-3ae9-4bec-8919-be77816ed9b6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:53.220289 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-56b9b0ec-3ae9-4bec-8919-be77816ed9b6 admin admin] The token cache is being invalidate because project 399731441cad4d84ba56e6b66c292e68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:17:53.220578 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-56b9b0ec-3ae9-4bec-8919-be77816ed9b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:53.221251 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-56b9b0ec-3ae9-4bec-8919-be77816ed9b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:53.223079 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4055/8135] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:17:53 2022] DELETE /identity/v3/projects/399731441cad4d84ba56e6b66c292e68 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:53.226960 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92248164-35e3-4b6b-b084-b017440362ee service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:53.237239 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92248164-35e3-4b6b-b084-b017440362ee service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:53.300569 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402270f-5121-4cee-801c-dc9e70055fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:53.301782 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402270f-5121-4cee-801c-dc9e70055fd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:53.302060 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402270f-5121-4cee-801c-dc9e70055fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:53.302337 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402270f-5121-4cee-801c-dc9e70055fd2 admin admin] PATH_INFO: `/v3/users/60873eb2f7a24c3cbe41b9b7d7a728dc` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:53.303500 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3402270f-5121-4cee-801c-dc9e70055fd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60873eb2f7a24c3cbe41b9b7d7a728dc)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:53.305979 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3402270f-5121-4cee-801c-dc9e70055fd2 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:53.336784 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:53.390534 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3402270f-5121-4cee-801c-dc9e70055fd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60873eb2f7a24c3cbe41b9b7d7a728dc'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:53.391338 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3402270f-5121-4cee-801c-dc9e70055fd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60873eb2f7a24c3cbe41b9b7d7a728dc'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:53.402704 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3402270f-5121-4cee-801c-dc9e70055fd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60873eb2f7a24c3cbe41b9b7d7a728dc'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:53.422156 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3402270f-5121-4cee-801c-dc9e70055fd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60873eb2f7a24c3cbe41b9b7d7a728dc'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:53.423935 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-3402270f-5121-4cee-801c-dc9e70055fd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60873eb2f7a24c3cbe41b9b7d7a728dc'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:53.462852 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4081/8136] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:17:53 2022] DELETE /identity/v3/users/60873eb2f7a24c3cbe41b9b7d7a728dc => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:17:53.816811 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b9b0ec-3ae9-4bec-8919-be77816ed9b6 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:53.818625 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-56b9b0ec-3ae9-4bec-8919-be77816ed9b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:53.836688 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b9b0ec-3ae9-4bec-8919-be77816ed9b6 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:53.917930 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1fb13-b4d6-46fc-ad24-2228abbd7e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:53.918764 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1fb13-b4d6-46fc-ad24-2228abbd7e83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:53.918948 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1fb13-b4d6-46fc-ad24-2228abbd7e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:53.920019 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1fb13-b4d6-46fc-ad24-2228abbd7e83 admin admin] PATH_INFO: `/v3/projects/e432c716f6b244a38d433eeea1c63480` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:53.921131 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd1fb13-b4d6-46fc-ad24-2228abbd7e83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e432c716f6b244a38d433eeea1c63480)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:53.924295 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd1fb13-b4d6-46fc-ad24-2228abbd7e83 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:53.991078 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ecd1fb13-b4d6-46fc-ad24-2228abbd7e83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e432c716f6b244a38d433eeea1c63480', 'request_id': 'req-ecd1fb13-b4d6-46fc-ad24-2228abbd7e83'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:54.001217 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ecd1fb13-b4d6-46fc-ad24-2228abbd7e83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e432c716f6b244a38d433eeea1c63480', 'request_id': 'req-ecd1fb13-b4d6-46fc-ad24-2228abbd7e83'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:54.010706 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ecd1fb13-b4d6-46fc-ad24-2228abbd7e83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e432c716f6b244a38d433eeea1c63480', 'request_id': 'req-ecd1fb13-b4d6-46fc-ad24-2228abbd7e83'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:54.025603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ecd1fb13-b4d6-46fc-ad24-2228abbd7e83 admin admin] The token cache is being invalidate because project e432c716f6b244a38d433eeea1c63480 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:17:54.026012 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ecd1fb13-b4d6-46fc-ad24-2228abbd7e83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:54.027174 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ecd1fb13-b4d6-46fc-ad24-2228abbd7e83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:54.032184 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4056/8137] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:17:53 2022] DELETE /identity/v3/projects/e432c716f6b244a38d433eeea1c63480 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:54.033847 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11756f8-e155-4430-9e74-b1a8e938d04f None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:54.034139 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11756f8-e155-4430-9e74-b1a8e938d04f None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:54.034414 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11756f8-e155-4430-9e74-b1a8e938d04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:54.059070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-b11756f8-e155-4430-9e74-b1a8e938d04f None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:54.061374 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b11756f8-e155-4430-9e74-b1a8e938d04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:54.142156 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4082/8138] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:17:54.153592 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378da8c7-35d2-4e9f-b594-c97d5713baa9 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:54.154279 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378da8c7-35d2-4e9f-b594-c97d5713baa9 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:54.154817 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378da8c7-35d2-4e9f-b594-c97d5713baa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:54.178814 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-378da8c7-35d2-4e9f-b594-c97d5713baa9 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:54.180372 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-378da8c7-35d2-4e9f-b594-c97d5713baa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:54.189553 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4057/8139] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:17:54.193883 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11756f8-e155-4430-9e74-b1a8e938d04f None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:54.207845 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11756f8-e155-4430-9e74-b1a8e938d04f None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:54.217367 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24179e9-37f4-41c4-bca8-b6ed2008f7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:54.218085 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24179e9-37f4-41c4-bca8-b6ed2008f7b5 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:54.218424 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24179e9-37f4-41c4-bca8-b6ed2008f7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:54.218781 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24179e9-37f4-41c4-bca8-b6ed2008f7b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:54.219600 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24179e9-37f4-41c4-bca8-b6ed2008f7b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:17:54.219961 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24179e9-37f4-41c4-bca8-b6ed2008f7b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:54.222477 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24179e9-37f4-41c4-bca8-b6ed2008f7b5 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:54.239629 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4083/8140] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:17:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:17:54.244355 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378da8c7-35d2-4e9f-b594-c97d5713baa9 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:54.255295 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378da8c7-35d2-4e9f-b594-c97d5713baa9 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:54.261662 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ff939-6acf-4c2b-975f-3fe3168333b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:54.262385 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ff939-6acf-4c2b-975f-3fe3168333b7 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:54.262773 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ff939-6acf-4c2b-975f-3fe3168333b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:54.263220 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ff939-6acf-4c2b-975f-3fe3168333b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:54.264752 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423ff939-6acf-4c2b-975f-3fe3168333b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:54.267057 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423ff939-6acf-4c2b-975f-3fe3168333b7 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:54.299490 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:54.319816 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4058/8141] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:17:54 2022] POST /identity/v3/projects => generated 407 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:17:54.323784 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24179e9-37f4-41c4-bca8-b6ed2008f7b5 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:54.335364 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24179e9-37f4-41c4-bca8-b6ed2008f7b5 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:54.396622 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb633e0b-db13-4f67-8d43-d8371bb417a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:54.397124 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb633e0b-db13-4f67-8d43-d8371bb417a3 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:54.397400 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb633e0b-db13-4f67-8d43-d8371bb417a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:54.397672 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb633e0b-db13-4f67-8d43-d8371bb417a3 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:54.398323 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb633e0b-db13-4f67-8d43-d8371bb417a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:54.400324 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb633e0b-db13-4f67-8d43-d8371bb417a3 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:54.426964 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4084/8142] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:17:54 2022] POST /identity/v3/users => generated 304 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:17:54.428190 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ff939-6acf-4c2b-975f-3fe3168333b7 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:54.439713 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ff939-6acf-4c2b-975f-3fe3168333b7 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:54.444731 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7bbcb-b63e-43bb-8305-c5a90e589b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:54.445377 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7bbcb-b63e-43bb-8305-c5a90e589b0c admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:54.445758 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7bbcb-b63e-43bb-8305-c5a90e589b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:54.446122 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7bbcb-b63e-43bb-8305-c5a90e589b0c admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:54.446774 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e7bbcb-b63e-43bb-8305-c5a90e589b0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:54.448389 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e7bbcb-b63e-43bb-8305-c5a90e589b0c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:54.461917 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4059/8143] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:17:54.463447 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb633e0b-db13-4f67-8d43-d8371bb417a3 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:54.474586 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb633e0b-db13-4f67-8d43-d8371bb417a3 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:54.479884 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0947382b-81a0-4d1d-ae51-cf6f1da83e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:54.480499 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947382b-81a0-4d1d-ae51-cf6f1da83e35 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:54.480785 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947382b-81a0-4d1d-ae51-cf6f1da83e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:54.481060 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947382b-81a0-4d1d-ae51-cf6f1da83e35 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:54.482200 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0947382b-81a0-4d1d-ae51-cf6f1da83e35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:54.484250 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0947382b-81a0-4d1d-ae51-cf6f1da83e35 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:54.486574 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:54.498232 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4085/8144] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:17:54.502247 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7bbcb-b63e-43bb-8305-c5a90e589b0c admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:54.512694 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7bbcb-b63e-43bb-8305-c5a90e589b0c admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:54.518236 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171db2e-88cb-4009-83b1-715072ba6405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:54.519122 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171db2e-88cb-4009-83b1-715072ba6405 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:54.519560 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171db2e-88cb-4009-83b1-715072ba6405 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:54.519833 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171db2e-88cb-4009-83b1-715072ba6405 admin admin] PATH_INFO: `/v3/projects/cf64ceb54a7b456d9337007f6e57e595/users/f32ea6028b51485984d6d52b9d49687f/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:54.537258 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1171db2e-88cb-4009-83b1-715072ba6405 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf64ceb54a7b456d9337007f6e57e595, user_id=f32ea6028b51485984d6d52b9d49687f, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:54.540425 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1171db2e-88cb-4009-83b1-715072ba6405 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:54.554809 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4060/8145] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:17:54 2022] PUT /identity/v3/projects/cf64ceb54a7b456d9337007f6e57e595/users/f32ea6028b51485984d6d52b9d49687f/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:54.568102 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd04856-d6a6-4d5f-be43-e565d5ae15d8 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:54.568385 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd04856-d6a6-4d5f-be43-e565d5ae15d8 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:54.568742 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd04856-d6a6-4d5f-be43-e565d5ae15d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:54.599410 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-8fd04856-d6a6-4d5f-be43-e565d5ae15d8 None None] MFA Rules not processed for user `f32ea6028b51485984d6d52b9d49687f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:54.600641 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8fd04856-d6a6-4d5f-be43-e565d5ae15d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:54.684885 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4086/8146] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:54 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:17:54.687058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171db2e-88cb-4009-83b1-715072ba6405 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:54.780341 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171db2e-88cb-4009-83b1-715072ba6405 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:54.792299 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca2d2f-9f04-4c9f-81b1-79efa0cff2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:54.793013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca2d2f-9f04-4c9f-81b1-79efa0cff2ff admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:54.793291 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca2d2f-9f04-4c9f-81b1-79efa0cff2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:54.793563 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca2d2f-9f04-4c9f-81b1-79efa0cff2ff admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:54.794986 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eca2d2f-9f04-4c9f-81b1-79efa0cff2ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:54.797273 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eca2d2f-9f04-4c9f-81b1-79efa0cff2ff admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:54.837249 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4061/8147] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:17:54 2022] POST /identity/v3/projects => generated 407 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:17:54.841882 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd04856-d6a6-4d5f-be43-e565d5ae15d8 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:54.853833 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd04856-d6a6-4d5f-be43-e565d5ae15d8 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:54.922805 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19366f79-40d6-4c48-abdd-f6a61e51c631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:54.923505 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19366f79-40d6-4c48-abdd-f6a61e51c631 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:54.923783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19366f79-40d6-4c48-abdd-f6a61e51c631 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:54.924053 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19366f79-40d6-4c48-abdd-f6a61e51c631 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:54.924692 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19366f79-40d6-4c48-abdd-f6a61e51c631 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:54.926626 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19366f79-40d6-4c48-abdd-f6a61e51c631 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:54.958655 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4087/8148] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:17:54 2022] POST /identity/v3/users => generated 310 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:17:54.959915 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca2d2f-9f04-4c9f-81b1-79efa0cff2ff admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:54.973537 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca2d2f-9f04-4c9f-81b1-79efa0cff2ff admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:54.982929 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0e3dbc-7cb7-4b57-b9a8-3a0b741e0881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:54.983850 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e3dbc-7cb7-4b57-b9a8-3a0b741e0881 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:54.985668 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e3dbc-7cb7-4b57-b9a8-3a0b741e0881 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:54.986023 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e3dbc-7cb7-4b57-b9a8-3a0b741e0881 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:54.987595 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0e3dbc-7cb7-4b57-b9a8-3a0b741e0881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:54.988701 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0e3dbc-7cb7-4b57-b9a8-3a0b741e0881 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:55.007653 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4062/8149] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:17:55.009039 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19366f79-40d6-4c48-abdd-f6a61e51c631 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:55.021154 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19366f79-40d6-4c48-abdd-f6a61e51c631 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:55.026713 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2fc3e-9004-40b5-bdf3-5087eb754d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:55.027762 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2fc3e-9004-40b5-bdf3-5087eb754d8f admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:55.028262 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2fc3e-9004-40b5-bdf3-5087eb754d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:55.029067 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2fc3e-9004-40b5-bdf3-5087eb754d8f admin admin] PATH_INFO: `/v3/projects/07863c49e7ed46ad817f8fc5fcd3748e/users/df59c036115540ea9a7fc1fb5b5c3283/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:55.048226 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2fc3e-9004-40b5-bdf3-5087eb754d8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=07863c49e7ed46ad817f8fc5fcd3748e, user_id=df59c036115540ea9a7fc1fb5b5c3283, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:55.051672 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2fc3e-9004-40b5-bdf3-5087eb754d8f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:55.073816 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4088/8150] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:17:55 2022] PUT /identity/v3/projects/07863c49e7ed46ad817f8fc5fcd3748e/users/df59c036115540ea9a7fc1fb5b5c3283/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:55.078868 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0e3dbc-7cb7-4b57-b9a8-3a0b741e0881 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:55.092104 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0e3dbc-7cb7-4b57-b9a8-3a0b741e0881 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:55.168713 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6adc6d-b028-4a70-9638-7c780a503a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:55.169954 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6adc6d-b028-4a70-9638-7c780a503a1a admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:55.170379 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6adc6d-b028-4a70-9638-7c780a503a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:55.170759 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6adc6d-b028-4a70-9638-7c780a503a1a admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:55.171690 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6adc6d-b028-4a70-9638-7c780a503a1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:55.174181 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6adc6d-b028-4a70-9638-7c780a503a1a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:55.191127 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4063/8151] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:17:55.193850 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2fc3e-9004-40b5-bdf3-5087eb754d8f admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:55.206614 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2fc3e-9004-40b5-bdf3-5087eb754d8f admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:55.212313 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf111ed-4fcb-4a07-8fc8-bbd623cc1e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:55.212715 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf111ed-4fcb-4a07-8fc8-bbd623cc1e46 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:55.213088 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf111ed-4fcb-4a07-8fc8-bbd623cc1e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:55.213679 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf111ed-4fcb-4a07-8fc8-bbd623cc1e46 admin admin] PATH_INFO: `/v3/projects/07863c49e7ed46ad817f8fc5fcd3748e/users/df59c036115540ea9a7fc1fb5b5c3283/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:55.217854 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf111ed-4fcb-4a07-8fc8-bbd623cc1e46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07863c49e7ed46ad817f8fc5fcd3748e, user_id=df59c036115540ea9a7fc1fb5b5c3283, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:55.220981 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf111ed-4fcb-4a07-8fc8-bbd623cc1e46 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:55.233520 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4089/8152] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:17:55 2022] PUT /identity/v3/projects/07863c49e7ed46ad817f8fc5fcd3748e/users/df59c036115540ea9a7fc1fb5b5c3283/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:55.243694 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff175fd-b2a9-48ec-98e4-c5dab40ade46 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:55.244004 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff175fd-b2a9-48ec-98e4-c5dab40ade46 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:55.244311 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff175fd-b2a9-48ec-98e4-c5dab40ade46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:55.279431 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-9ff175fd-b2a9-48ec-98e4-c5dab40ade46 None None] MFA Rules not processed for user `df59c036115540ea9a7fc1fb5b5c3283`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:55.283326 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9ff175fd-b2a9-48ec-98e4-c5dab40ade46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:55.306987 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:55.380276 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4064/8153] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:17:55 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:17:55.393510 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf111ed-4fcb-4a07-8fc8-bbd623cc1e46 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:55.395583 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9cf111ed-4fcb-4a07-8fc8-bbd623cc1e46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:55.472889 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:55.493877 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf111ed-4fcb-4a07-8fc8-bbd623cc1e46 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:55.498931 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ddf0d-0788-4e34-a056-d72f1c528b8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:55.499643 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ddf0d-0788-4e34-a056-d72f1c528b8c service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:55.499921 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ddf0d-0788-4e34-a056-d72f1c528b8c service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:55.500194 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ddf0d-0788-4e34-a056-d72f1c528b8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:55.585249 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ddf0d-0788-4e34-a056-d72f1c528b8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:55.586844 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ddf0d-0788-4e34-a056-d72f1c528b8c service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:55.601801 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4090/8154] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:17:55 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:17:55.999928 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff175fd-b2a9-48ec-98e4-c5dab40ade46 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:56.004123 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9ff175fd-b2a9-48ec-98e4-c5dab40ade46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:56.156076 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff175fd-b2a9-48ec-98e4-c5dab40ade46 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:56.163170 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad6e67-c1fa-4ad0-8050-41a96ca3c8c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:56.164052 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad6e67-c1fa-4ad0-8050-41a96ca3c8c5 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:56.165242 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad6e67-c1fa-4ad0-8050-41a96ca3c8c5 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:56.165242 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad6e67-c1fa-4ad0-8050-41a96ca3c8c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:56.174155 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad6e67-c1fa-4ad0-8050-41a96ca3c8c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:56.176059 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad6e67-c1fa-4ad0-8050-41a96ca3c8c5 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:56.187328 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4065/8155] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:17:55 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:18:02.474288 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ddf0d-0788-4e34-a056-d72f1c528b8c service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:18:02.549712 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ddf0d-0788-4e34-a056-d72f1c528b8c service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:18:02.557211 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e5706-bd3e-4083-8530-9352ccd1d710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:18:02.557873 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e5706-bd3e-4083-8530-9352ccd1d710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:02.558150 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e5706-bd3e-4083-8530-9352ccd1d710 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:02.558424 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e5706-bd3e-4083-8530-9352ccd1d710 admin admin] PATH_INFO: `/v3/users/f32ea6028b51485984d6d52b9d49687f` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:02.559589 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e5706-bd3e-4083-8530-9352ccd1d710 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f32ea6028b51485984d6d52b9d49687f)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:18:02.562960 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e5706-bd3e-4083-8530-9352ccd1d710 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:18:02.623401 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-782e5706-bd3e-4083-8530-9352ccd1d710 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f32ea6028b51485984d6d52b9d49687f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:18:02.624493 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-782e5706-bd3e-4083-8530-9352ccd1d710 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f32ea6028b51485984d6d52b9d49687f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:18:02.633828 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-782e5706-bd3e-4083-8530-9352ccd1d710 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f32ea6028b51485984d6d52b9d49687f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:18:02.643535 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-782e5706-bd3e-4083-8530-9352ccd1d710 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f32ea6028b51485984d6d52b9d49687f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:18:02.644271 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-782e5706-bd3e-4083-8530-9352ccd1d710 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f32ea6028b51485984d6d52b9d49687f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:18:02.663663 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4091/8156] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:18:02 2022] DELETE /identity/v3/users/f32ea6028b51485984d6d52b9d49687f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:18:02.668220 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b7681-f906-45fd-89d0-f0581fea70e9 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:02.668733 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b7681-f906-45fd-89d0-f0581fea70e9 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:02.668843 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b7681-f906-45fd-89d0-f0581fea70e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:02.690030 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-ef4b7681-f906-45fd-89d0-f0581fea70e9 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:18:02.691941 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ef4b7681-f906-45fd-89d0-f0581fea70e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:18:02.755152 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4066/8157] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:18:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:18:02.765404 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e5706-bd3e-4083-8530-9352ccd1d710 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:18:02.766818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-782e5706-bd3e-4083-8530-9352ccd1d710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:18:02.781967 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:18:02.832965 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e5706-bd3e-4083-8530-9352ccd1d710 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:18:02.836651 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d82d8-1fff-402b-acda-13a67d3b39c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:18:02.837262 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d82d8-1fff-402b-acda-13a67d3b39c9 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:02.837539 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d82d8-1fff-402b-acda-13a67d3b39c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:02.837807 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d82d8-1fff-402b-acda-13a67d3b39c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:02.848143 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5d82d8-1fff-402b-acda-13a67d3b39c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:18:02.849581 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5d82d8-1fff-402b-acda-13a67d3b39c9 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:18:02.859530 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4092/8158] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:18:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:18:03.043378 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b7681-f906-45fd-89d0-f0581fea70e9 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:18:03.044944 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ef4b7681-f906-45fd-89d0-f0581fea70e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:18:03.060826 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b7681-f906-45fd-89d0-f0581fea70e9 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:18:03.067494 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989cb15c-57ea-47cd-a92f-577681b60a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:18:03.068342 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cb15c-57ea-47cd-a92f-577681b60a58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:03.068738 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cb15c-57ea-47cd-a92f-577681b60a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:03.069135 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cb15c-57ea-47cd-a92f-577681b60a58 admin admin] PATH_INFO: `/v3/projects/cf64ceb54a7b456d9337007f6e57e595` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:03.070616 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989cb15c-57ea-47cd-a92f-577681b60a58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf64ceb54a7b456d9337007f6e57e595)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:18:03.072660 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989cb15c-57ea-47cd-a92f-577681b60a58 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:18:03.082301 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:18:03.122804 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-989cb15c-57ea-47cd-a92f-577681b60a58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf64ceb54a7b456d9337007f6e57e595', 'request_id': 'req-989cb15c-57ea-47cd-a92f-577681b60a58'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:18:03.128662 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-989cb15c-57ea-47cd-a92f-577681b60a58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf64ceb54a7b456d9337007f6e57e595', 'request_id': 'req-989cb15c-57ea-47cd-a92f-577681b60a58'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:18:03.135893 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-989cb15c-57ea-47cd-a92f-577681b60a58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf64ceb54a7b456d9337007f6e57e595', 'request_id': 'req-989cb15c-57ea-47cd-a92f-577681b60a58'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:18:03.148401 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-989cb15c-57ea-47cd-a92f-577681b60a58 admin admin] The token cache is being invalidate because project cf64ceb54a7b456d9337007f6e57e595 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:18:03.148692 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-989cb15c-57ea-47cd-a92f-577681b60a58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:18:03.149335 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-989cb15c-57ea-47cd-a92f-577681b60a58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:18:03.150883 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4067/8159] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:18:03 2022] DELETE /identity/v3/projects/cf64ceb54a7b456d9337007f6e57e595 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:18:03.155242 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d82d8-1fff-402b-acda-13a67d3b39c9 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:18:03.165078 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d82d8-1fff-402b-acda-13a67d3b39c9 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:18:03.225706 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e67905-e16f-4ce6-ad3a-0ca6b37ea4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:18:03.226366 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e67905-e16f-4ce6-ad3a-0ca6b37ea4dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:03.226644 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e67905-e16f-4ce6-ad3a-0ca6b37ea4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:03.226918 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e67905-e16f-4ce6-ad3a-0ca6b37ea4dc admin admin] PATH_INFO: `/v3/users/df59c036115540ea9a7fc1fb5b5c3283` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:03.228159 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e67905-e16f-4ce6-ad3a-0ca6b37ea4dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=df59c036115540ea9a7fc1fb5b5c3283)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:18:03.230125 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e67905-e16f-4ce6-ad3a-0ca6b37ea4dc admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:18:03.283941 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-37e67905-e16f-4ce6-ad3a-0ca6b37ea4dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df59c036115540ea9a7fc1fb5b5c3283'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:18:03.284631 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-37e67905-e16f-4ce6-ad3a-0ca6b37ea4dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df59c036115540ea9a7fc1fb5b5c3283'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:18:03.294797 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-37e67905-e16f-4ce6-ad3a-0ca6b37ea4dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df59c036115540ea9a7fc1fb5b5c3283'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:18:03.303298 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-37e67905-e16f-4ce6-ad3a-0ca6b37ea4dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df59c036115540ea9a7fc1fb5b5c3283'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:18:03.304056 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-37e67905-e16f-4ce6-ad3a-0ca6b37ea4dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df59c036115540ea9a7fc1fb5b5c3283'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:18:03.323328 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4093/8160] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:18:03 2022] DELETE /identity/v3/users/df59c036115540ea9a7fc1fb5b5c3283 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:18:03.536065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989cb15c-57ea-47cd-a92f-577681b60a58 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:18:03.537845 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-989cb15c-57ea-47cd-a92f-577681b60a58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:18:03.563429 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989cb15c-57ea-47cd-a92f-577681b60a58 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:18:03.625034 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42fc4e2-67d2-4e9d-bd16-a539f245c015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:18:03.625639 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fc4e2-67d2-4e9d-bd16-a539f245c015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:03.625917 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fc4e2-67d2-4e9d-bd16-a539f245c015 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:03.626190 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fc4e2-67d2-4e9d-bd16-a539f245c015 admin admin] PATH_INFO: `/v3/projects/07863c49e7ed46ad817f8fc5fcd3748e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:03.627449 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42fc4e2-67d2-4e9d-bd16-a539f245c015 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07863c49e7ed46ad817f8fc5fcd3748e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:18:03.629355 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42fc4e2-67d2-4e9d-bd16-a539f245c015 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:18:03.678765 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d42fc4e2-67d2-4e9d-bd16-a539f245c015 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07863c49e7ed46ad817f8fc5fcd3748e', 'request_id': 'req-d42fc4e2-67d2-4e9d-bd16-a539f245c015'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:18:03.684939 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d42fc4e2-67d2-4e9d-bd16-a539f245c015 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07863c49e7ed46ad817f8fc5fcd3748e', 'request_id': 'req-d42fc4e2-67d2-4e9d-bd16-a539f245c015'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:18:03.692578 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d42fc4e2-67d2-4e9d-bd16-a539f245c015 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07863c49e7ed46ad817f8fc5fcd3748e', 'request_id': 'req-d42fc4e2-67d2-4e9d-bd16-a539f245c015'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:18:03.706459 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d42fc4e2-67d2-4e9d-bd16-a539f245c015 admin admin] The token cache is being invalidate because project 07863c49e7ed46ad817f8fc5fcd3748e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:18:03.707457 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d42fc4e2-67d2-4e9d-bd16-a539f245c015 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:18:03.707558 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d42fc4e2-67d2-4e9d-bd16-a539f245c015 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:18:03.709342 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4068/8161] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:18:03 2022] DELETE /identity/v3/projects/07863c49e7ed46ad817f8fc5fcd3748e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:18:03.714507 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ef6a1-4cde-414a-aeab-7e6319d98e0e None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:03.714966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ef6a1-4cde-414a-aeab-7e6319d98e0e None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:03.715151 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ef6a1-4cde-414a-aeab-7e6319d98e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:03.736080 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-343ef6a1-4cde-414a-aeab-7e6319d98e0e None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:18:03.737287 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-343ef6a1-4cde-414a-aeab-7e6319d98e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:18:03.774757 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:18:03.807424 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4094/8162] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:18:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:18:03.816135 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46784f-fecd-4f9e-bdd2-79cb9dc36b14 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:03.816423 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46784f-fecd-4f9e-bdd2-79cb9dc36b14 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:03.816698 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46784f-fecd-4f9e-bdd2-79cb9dc36b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:03.837644 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-5f46784f-fecd-4f9e-bdd2-79cb9dc36b14 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:18:03.838854 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5f46784f-fecd-4f9e-bdd2-79cb9dc36b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:18:03.848224 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4069/8163] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:18:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:18:03.853451 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ef6a1-4cde-414a-aeab-7e6319d98e0e None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:18:03.864162 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ef6a1-4cde-414a-aeab-7e6319d98e0e None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:18:03.869342 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af4dc9-d6ef-4f8a-a9b0-72582ae793f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:18:03.869957 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af4dc9-d6ef-4f8a-a9b0-72582ae793f8 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:03.870241 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af4dc9-d6ef-4f8a-a9b0-72582ae793f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:03.870513 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af4dc9-d6ef-4f8a-a9b0-72582ae793f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:03.871205 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9af4dc9-d6ef-4f8a-a9b0-72582ae793f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:18:03.871508 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9af4dc9-d6ef-4f8a-a9b0-72582ae793f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:18:03.874231 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9af4dc9-d6ef-4f8a-a9b0-72582ae793f8 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:18:03.891333 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4095/8164] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:18:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:18:03.892505 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46784f-fecd-4f9e-bdd2-79cb9dc36b14 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:18:03.901943 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46784f-fecd-4f9e-bdd2-79cb9dc36b14 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:18:03.907845 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca980a-8acd-4cea-8bc0-0f4b3909a144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:18:03.908451 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca980a-8acd-4cea-8bc0-0f4b3909a144 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:03.908725 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca980a-8acd-4cea-8bc0-0f4b3909a144 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:03.908995 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca980a-8acd-4cea-8bc0-0f4b3909a144 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:03.909625 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca980a-8acd-4cea-8bc0-0f4b3909a144 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:18:03.911581 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca980a-8acd-4cea-8bc0-0f4b3909a144 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:18:03.933642 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:18:03.943831 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4070/8165] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:18:03 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:18:03.947359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af4dc9-d6ef-4f8a-a9b0-72582ae793f8 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:18:03.957562 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af4dc9-d6ef-4f8a-a9b0-72582ae793f8 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:18:04.033872 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05853e36-8f80-48d5-8607-63bc55895e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:18:04.034508 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05853e36-8f80-48d5-8607-63bc55895e1b admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:04.034853 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05853e36-8f80-48d5-8607-63bc55895e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:04.035062 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05853e36-8f80-48d5-8607-63bc55895e1b admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:04.035722 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05853e36-8f80-48d5-8607-63bc55895e1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:18:04.037648 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05853e36-8f80-48d5-8607-63bc55895e1b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:18:04.063143 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4096/8166] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:18:03 2022] POST /identity/v3/users => generated 294 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:18:04.064950 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca980a-8acd-4cea-8bc0-0f4b3909a144 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:18:04.077378 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca980a-8acd-4cea-8bc0-0f4b3909a144 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:18:04.082588 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf8285-17db-409a-94c2-929c0407d091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:18:04.083259 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf8285-17db-409a-94c2-929c0407d091 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:04.083592 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf8285-17db-409a-94c2-929c0407d091 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:04.083852 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf8285-17db-409a-94c2-929c0407d091 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:04.084539 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf8285-17db-409a-94c2-929c0407d091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:18:04.086263 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf8285-17db-409a-94c2-929c0407d091 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:18:04.100979 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4071/8167] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:18:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:18:04.102050 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05853e36-8f80-48d5-8607-63bc55895e1b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:18:04.113799 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05853e36-8f80-48d5-8607-63bc55895e1b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:18:04.119087 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078980bb-e5c2-41ac-9695-ef1f1c333e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:18:04.119693 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078980bb-e5c2-41ac-9695-ef1f1c333e93 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:04.119975 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078980bb-e5c2-41ac-9695-ef1f1c333e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:04.120251 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078980bb-e5c2-41ac-9695-ef1f1c333e93 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:04.120933 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078980bb-e5c2-41ac-9695-ef1f1c333e93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:18:04.122819 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078980bb-e5c2-41ac-9695-ef1f1c333e93 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:18:04.138710 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4097/8168] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:18:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:18:04.140278 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf8285-17db-409a-94c2-929c0407d091 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:18:04.155465 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf8285-17db-409a-94c2-929c0407d091 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:18:04.160235 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1b785-b0d2-42ec-8840-0cd3fe8c87b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:18:04.160902 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1b785-b0d2-42ec-8840-0cd3fe8c87b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:04.161231 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1b785-b0d2-42ec-8840-0cd3fe8c87b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:04.161481 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1b785-b0d2-42ec-8840-0cd3fe8c87b7 admin admin] PATH_INFO: `/v3/projects/80e6e6462b89418faad96d67d2cf3952/users/c3240d8fcdf8449c9b8242f61cd0150d/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:04.178458 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1b785-b0d2-42ec-8840-0cd3fe8c87b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80e6e6462b89418faad96d67d2cf3952, user_id=c3240d8fcdf8449c9b8242f61cd0150d, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:18:04.181444 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1b785-b0d2-42ec-8840-0cd3fe8c87b7 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:18:04.196634 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4072/8169] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:18:04 2022] PUT /identity/v3/projects/80e6e6462b89418faad96d67d2cf3952/users/c3240d8fcdf8449c9b8242f61cd0150d/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:18:04.209020 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd2ebe-309a-4454-87e7-06036af7d1b5 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:04.209306 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd2ebe-309a-4454-87e7-06036af7d1b5 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:04.209577 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd2ebe-309a-4454-87e7-06036af7d1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:04.241289 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-94cd2ebe-309a-4454-87e7-06036af7d1b5 None None] MFA Rules not processed for user `c3240d8fcdf8449c9b8242f61cd0150d`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:18:04.242572 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-94cd2ebe-309a-4454-87e7-06036af7d1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:18:04.316081 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4098/8170] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:18:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:18:04.327459 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1b785-b0d2-42ec-8840-0cd3fe8c87b7 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:18:04.329764 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-25c1b785-b0d2-42ec-8840-0cd3fe8c87b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:18:04.394782 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1b785-b0d2-42ec-8840-0cd3fe8c87b7 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:18:04.398611 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a84482-1e68-4afd-9d71-d75608a8453b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:18:04.399260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a84482-1e68-4afd-9d71-d75608a8453b service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:04.399694 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a84482-1e68-4afd-9d71-d75608a8453b service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:04.399968 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a84482-1e68-4afd-9d71-d75608a8453b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:04.415849 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a84482-1e68-4afd-9d71-d75608a8453b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:18:04.417325 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a84482-1e68-4afd-9d71-d75608a8453b service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:18:04.427625 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4073/8171] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:18:04 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:18:14.312996 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=83,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:18:14.423400 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=42,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:18:17.599605 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd2ebe-309a-4454-87e7-06036af7d1b5 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:18:17.709629 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd2ebe-309a-4454-87e7-06036af7d1b5 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:18:17.715865 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d7fc6-9132-4f21-bcd8-228ea093bc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:18:17.716791 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d7fc6-9132-4f21-bcd8-228ea093bc4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:17.717232 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d7fc6-9132-4f21-bcd8-228ea093bc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:17.717577 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d7fc6-9132-4f21-bcd8-228ea093bc4e admin admin] PATH_INFO: `/v3/users/c3240d8fcdf8449c9b8242f61cd0150d` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:17.718974 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30d7fc6-9132-4f21-bcd8-228ea093bc4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3240d8fcdf8449c9b8242f61cd0150d)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:18:17.721285 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30d7fc6-9132-4f21-bcd8-228ea093bc4e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:18:17.797186 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e30d7fc6-9132-4f21-bcd8-228ea093bc4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3240d8fcdf8449c9b8242f61cd0150d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:18:17.798316 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e30d7fc6-9132-4f21-bcd8-228ea093bc4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3240d8fcdf8449c9b8242f61cd0150d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:18:17.811793 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e30d7fc6-9132-4f21-bcd8-228ea093bc4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3240d8fcdf8449c9b8242f61cd0150d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:18:17.820612 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e30d7fc6-9132-4f21-bcd8-228ea093bc4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3240d8fcdf8449c9b8242f61cd0150d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:18:17.821565 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e30d7fc6-9132-4f21-bcd8-228ea093bc4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3240d8fcdf8449c9b8242f61cd0150d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:18:17.855610 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4099/8172] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:18:17 2022] DELETE /identity/v3/users/c3240d8fcdf8449c9b8242f61cd0150d => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:18:17.856701 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c1f79-d414-4bc3-bdb9-a30483d0e9fd None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:17.857210 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c1f79-d414-4bc3-bdb9-a30483d0e9fd None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:17.857558 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c1f79-d414-4bc3-bdb9-a30483d0e9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:17.896868 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-689c1f79-d414-4bc3-bdb9-a30483d0e9fd None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:18:17.898390 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-689c1f79-d414-4bc3-bdb9-a30483d0e9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:18:17.990514 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4074/8173] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:18:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:18:17.997959 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d7fc6-9132-4f21-bcd8-228ea093bc4e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:18:18.000006 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e30d7fc6-9132-4f21-bcd8-228ea093bc4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:18:18.073842 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d7fc6-9132-4f21-bcd8-228ea093bc4e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:18:18.079900 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fcf4aa-ab49-4340-883f-8c890020552d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:18:18.080706 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcf4aa-ab49-4340-883f-8c890020552d service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:18.081060 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcf4aa-ab49-4340-883f-8c890020552d service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:18.081402 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcf4aa-ab49-4340-883f-8c890020552d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:18.094439 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fcf4aa-ab49-4340-883f-8c890020552d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:18:18.096068 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fcf4aa-ab49-4340-883f-8c890020552d service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:18:18.109826 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4100/8174] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:18:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:18:18.370636 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689c1f79-d414-4bc3-bdb9-a30483d0e9fd None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:18:18.373085 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-689c1f79-d414-4bc3-bdb9-a30483d0e9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:18:18.403490 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689c1f79-d414-4bc3-bdb9-a30483d0e9fd None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:18:18.411308 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c32d11-79e0-40ea-8829-67417f7fabc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:18:18.412022 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c32d11-79e0-40ea-8829-67417f7fabc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:18.412307 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c32d11-79e0-40ea-8829-67417f7fabc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:18.412588 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c32d11-79e0-40ea-8829-67417f7fabc8 admin admin] PATH_INFO: `/v3/projects/80e6e6462b89418faad96d67d2cf3952` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:18.413800 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c32d11-79e0-40ea-8829-67417f7fabc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80e6e6462b89418faad96d67d2cf3952)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:18:18.415870 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c32d11-79e0-40ea-8829-67417f7fabc8 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:18:18.472173 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e3c32d11-79e0-40ea-8829-67417f7fabc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80e6e6462b89418faad96d67d2cf3952', 'request_id': 'req-e3c32d11-79e0-40ea-8829-67417f7fabc8'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:18:18.478249 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e3c32d11-79e0-40ea-8829-67417f7fabc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80e6e6462b89418faad96d67d2cf3952', 'request_id': 'req-e3c32d11-79e0-40ea-8829-67417f7fabc8'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:18:18.487634 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e3c32d11-79e0-40ea-8829-67417f7fabc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80e6e6462b89418faad96d67d2cf3952', 'request_id': 'req-e3c32d11-79e0-40ea-8829-67417f7fabc8'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:18:18.500452 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e3c32d11-79e0-40ea-8829-67417f7fabc8 admin admin] The token cache is being invalidate because project 80e6e6462b89418faad96d67d2cf3952 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:18:18.500793 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e3c32d11-79e0-40ea-8829-67417f7fabc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:18:18.501456 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e3c32d11-79e0-40ea-8829-67417f7fabc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:18:18.503079 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4075/8175] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:18:18 2022] DELETE /identity/v3/projects/80e6e6462b89418faad96d67d2cf3952 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:18:18.507920 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2312c27-3293-49a8-a3c1-b944f22ce5a8 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:18.508211 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2312c27-3293-49a8-a3c1-b944f22ce5a8 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:18.508488 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2312c27-3293-49a8-a3c1-b944f22ce5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:18.528638 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a2312c27-3293-49a8-a3c1-b944f22ce5a8 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:18:18.529886 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a2312c27-3293-49a8-a3c1-b944f22ce5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:18:18.547874 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:18:18.596129 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4101/8176] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:18:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:18:18.604007 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259ff7a-ee56-4403-97f8-d92cd84e48f6 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:18.604296 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259ff7a-ee56-4403-97f8-d92cd84e48f6 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:18.604574 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259ff7a-ee56-4403-97f8-d92cd84e48f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:18.625770 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-5259ff7a-ee56-4403-97f8-d92cd84e48f6 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:18:18.626997 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5259ff7a-ee56-4403-97f8-d92cd84e48f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:18:18.635310 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4076/8177] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:18:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:18:18.640424 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2312c27-3293-49a8-a3c1-b944f22ce5a8 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:18:18.650300 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2312c27-3293-49a8-a3c1-b944f22ce5a8 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:18:18.655808 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c76734-304c-4293-a098-6b1bd02a1c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:18:18.656273 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c76734-304c-4293-a098-6b1bd02a1c75 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:18.656547 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c76734-304c-4293-a098-6b1bd02a1c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:18.656813 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c76734-304c-4293-a098-6b1bd02a1c75 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:18.657460 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c76734-304c-4293-a098-6b1bd02a1c75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:18:18.657761 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c76734-304c-4293-a098-6b1bd02a1c75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:18:18.659498 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c76734-304c-4293-a098-6b1bd02a1c75 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:18:18.677857 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4102/8178] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:18:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:18:18.678969 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259ff7a-ee56-4403-97f8-d92cd84e48f6 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:18:18.688982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259ff7a-ee56-4403-97f8-d92cd84e48f6 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:18:18.693741 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41361dc6-203b-4d89-ba9e-6c1f5774f925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:18:18.694349 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41361dc6-203b-4d89-ba9e-6c1f5774f925 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:18.694631 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41361dc6-203b-4d89-ba9e-6c1f5774f925 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:18.694909 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41361dc6-203b-4d89-ba9e-6c1f5774f925 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:18.695624 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41361dc6-203b-4d89-ba9e-6c1f5774f925 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:18:18.697560 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41361dc6-203b-4d89-ba9e-6c1f5774f925 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:18:18.726525 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4077/8179] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:18:18 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:18:18.731181 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c76734-304c-4293-a098-6b1bd02a1c75 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:18:18.742458 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c76734-304c-4293-a098-6b1bd02a1c75 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:18:18.810938 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c07e138-8b9e-4cef-9377-22cdd85710ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:18:18.811785 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07e138-8b9e-4cef-9377-22cdd85710ae admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:18.812139 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07e138-8b9e-4cef-9377-22cdd85710ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:18.812466 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07e138-8b9e-4cef-9377-22cdd85710ae admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:18.814031 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c07e138-8b9e-4cef-9377-22cdd85710ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:18:18.816117 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c07e138-8b9e-4cef-9377-22cdd85710ae admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:18:18.839815 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4103/8180] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:18:18 2022] POST /identity/v3/users => generated 283 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:18:18.845125 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41361dc6-203b-4d89-ba9e-6c1f5774f925 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:18:18.861729 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41361dc6-203b-4d89-ba9e-6c1f5774f925 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:18:18.866826 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4370b9-89e6-4ae3-8288-992729d4702c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:18:18.867679 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4370b9-89e6-4ae3-8288-992729d4702c admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:18.868146 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4370b9-89e6-4ae3-8288-992729d4702c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:18.869199 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4370b9-89e6-4ae3-8288-992729d4702c admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:18.869862 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4370b9-89e6-4ae3-8288-992729d4702c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:18:18.871720 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4370b9-89e6-4ae3-8288-992729d4702c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:18:18.884644 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4078/8181] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:18:18.888676 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c07e138-8b9e-4cef-9377-22cdd85710ae admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:18:18.900401 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c07e138-8b9e-4cef-9377-22cdd85710ae admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:18:18.906281 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd272b5c-c368-4174-a087-f99d1b277d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:18:18.907087 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd272b5c-c368-4174-a087-f99d1b277d48 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:18.907390 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd272b5c-c368-4174-a087-f99d1b277d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:18.908310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd272b5c-c368-4174-a087-f99d1b277d48 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:18.908965 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd272b5c-c368-4174-a087-f99d1b277d48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:18:18.910876 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd272b5c-c368-4174-a087-f99d1b277d48 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:18:18.925266 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4104/8182] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:18:18.929549 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4370b9-89e6-4ae3-8288-992729d4702c admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:18:18.940806 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4370b9-89e6-4ae3-8288-992729d4702c admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:18:18.948620 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47156c74-3601-4f46-a729-c352ba6fcb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:18:18.950970 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47156c74-3601-4f46-a729-c352ba6fcb7a admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:18.951577 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47156c74-3601-4f46-a729-c352ba6fcb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:18.952088 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47156c74-3601-4f46-a729-c352ba6fcb7a admin admin] PATH_INFO: `/v3/projects/5060ec48b9a7486b8a4bf246fb621b9e/users/a794a2205d09446a8c08b5138f011908/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:18.967963 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47156c74-3601-4f46-a729-c352ba6fcb7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5060ec48b9a7486b8a4bf246fb621b9e, user_id=a794a2205d09446a8c08b5138f011908, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:18:18.970733 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47156c74-3601-4f46-a729-c352ba6fcb7a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:18:18.986548 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4079/8183] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:18:18 2022] PUT /identity/v3/projects/5060ec48b9a7486b8a4bf246fb621b9e/users/a794a2205d09446a8c08b5138f011908/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:18:18.997009 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8207c59-ef7b-461b-bf00-58d0128f9757 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:18.998134 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8207c59-ef7b-461b-bf00-58d0128f9757 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:18.998849 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8207c59-ef7b-461b-bf00-58d0128f9757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:19.031156 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-e8207c59-ef7b-461b-bf00-58d0128f9757 None None] MFA Rules not processed for user `a794a2205d09446a8c08b5138f011908`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:18:19.032405 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e8207c59-ef7b-461b-bf00-58d0128f9757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:18:19.108513 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4105/8184] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:18:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:18:19.115414 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47156c74-3601-4f46-a729-c352ba6fcb7a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:18:19.117549 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-47156c74-3601-4f46-a729-c352ba6fcb7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:18:19.160195 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:18:19.208523 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47156c74-3601-4f46-a729-c352ba6fcb7a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:18:19.213124 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adaa27d-4bd6-45fc-adb7-5f13051e285a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:18:19.213856 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adaa27d-4bd6-45fc-adb7-5f13051e285a service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:19.214247 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adaa27d-4bd6-45fc-adb7-5f13051e285a service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:19.214633 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adaa27d-4bd6-45fc-adb7-5f13051e285a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:19.224681 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adaa27d-4bd6-45fc-adb7-5f13051e285a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:18:19.228729 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adaa27d-4bd6-45fc-adb7-5f13051e285a service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:18:19.239149 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4080/8185] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:18:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:18:20.530949 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8207c59-ef7b-461b-bf00-58d0128f9757 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:18:20.532949 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e8207c59-ef7b-461b-bf00-58d0128f9757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:18:20.557476 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:18:20.615271 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8207c59-ef7b-461b-bf00-58d0128f9757 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:18:20.621000 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34f978-a91c-4828-8d90-1b4f66aaba2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:18:20.623234 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34f978-a91c-4828-8d90-1b4f66aaba2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:20.623718 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34f978-a91c-4828-8d90-1b4f66aaba2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:20.624268 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34f978-a91c-4828-8d90-1b4f66aaba2b admin admin] PATH_INFO: `/v3/users/3b301a1bf29d40219d2790badbb1c688` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:20.625703 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e34f978-a91c-4828-8d90-1b4f66aaba2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b301a1bf29d40219d2790badbb1c688)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:18:20.627906 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e34f978-a91c-4828-8d90-1b4f66aaba2b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:18:20.686785 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7e34f978-a91c-4828-8d90-1b4f66aaba2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b301a1bf29d40219d2790badbb1c688'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:18:20.688528 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7e34f978-a91c-4828-8d90-1b4f66aaba2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b301a1bf29d40219d2790badbb1c688'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:18:20.696333 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7e34f978-a91c-4828-8d90-1b4f66aaba2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b301a1bf29d40219d2790badbb1c688'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:18:20.704475 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7e34f978-a91c-4828-8d90-1b4f66aaba2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b301a1bf29d40219d2790badbb1c688'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:18:20.705210 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7e34f978-a91c-4828-8d90-1b4f66aaba2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b301a1bf29d40219d2790badbb1c688'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:18:20.730746 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4106/8186] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:18:20 2022] DELETE /identity/v3/users/3b301a1bf29d40219d2790badbb1c688 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:18:20.734016 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84509bba-6141-482c-98be-294700cba151 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:20.734016 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84509bba-6141-482c-98be-294700cba151 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:20.734656 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84509bba-6141-482c-98be-294700cba151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:20.759561 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-84509bba-6141-482c-98be-294700cba151 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:18:20.760779 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-84509bba-6141-482c-98be-294700cba151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:18:20.832736 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4081/8187] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:18:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:18:20.843111 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34f978-a91c-4828-8d90-1b4f66aaba2b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:18:20.845006 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7e34f978-a91c-4828-8d90-1b4f66aaba2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:18:20.912731 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34f978-a91c-4828-8d90-1b4f66aaba2b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:18:20.916544 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6941b-8f76-468d-aab5-826e35a05bad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:18:20.917178 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6941b-8f76-468d-aab5-826e35a05bad service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:20.917504 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6941b-8f76-468d-aab5-826e35a05bad service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:20.917750 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6941b-8f76-468d-aab5-826e35a05bad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:20.929385 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c6941b-8f76-468d-aab5-826e35a05bad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:18:20.931344 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c6941b-8f76-468d-aab5-826e35a05bad service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:18:20.945781 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4107/8188] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:18:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:18:21.148926 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84509bba-6141-482c-98be-294700cba151 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:18:21.150733 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-84509bba-6141-482c-98be-294700cba151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:18:21.174245 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84509bba-6141-482c-98be-294700cba151 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:18:21.182589 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c7d4e-6b7d-47d8-b604-a7c5b2561dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:18:21.183553 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c7d4e-6b7d-47d8-b604-a7c5b2561dc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:21.183990 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c7d4e-6b7d-47d8-b604-a7c5b2561dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:21.184418 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c7d4e-6b7d-47d8-b604-a7c5b2561dc0 admin admin] PATH_INFO: `/v3/projects/ab5b30085c0f4426a6b806214e212f14` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:21.186433 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c7d4e-6b7d-47d8-b604-a7c5b2561dc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab5b30085c0f4426a6b806214e212f14)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:18:21.189520 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c7d4e-6b7d-47d8-b604-a7c5b2561dc0 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:18:21.264601 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f11c7d4e-6b7d-47d8-b604-a7c5b2561dc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab5b30085c0f4426a6b806214e212f14', 'request_id': 'req-f11c7d4e-6b7d-47d8-b604-a7c5b2561dc0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:18:21.273711 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f11c7d4e-6b7d-47d8-b604-a7c5b2561dc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab5b30085c0f4426a6b806214e212f14', 'request_id': 'req-f11c7d4e-6b7d-47d8-b604-a7c5b2561dc0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:18:21.295014 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f11c7d4e-6b7d-47d8-b604-a7c5b2561dc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab5b30085c0f4426a6b806214e212f14', 'request_id': 'req-f11c7d4e-6b7d-47d8-b604-a7c5b2561dc0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:18:21.311917 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f11c7d4e-6b7d-47d8-b604-a7c5b2561dc0 admin admin] The token cache is being invalidate because project ab5b30085c0f4426a6b806214e212f14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:18:21.312448 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f11c7d4e-6b7d-47d8-b604-a7c5b2561dc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:18:21.314443 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f11c7d4e-6b7d-47d8-b604-a7c5b2561dc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:18:21.316892 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4082/8189] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:18:21 2022] DELETE /identity/v3/projects/ab5b30085c0f4426a6b806214e212f14 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:18:21.321760 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbde522-a52f-405c-82fa-35cafd65b48c None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:21.322046 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbde522-a52f-405c-82fa-35cafd65b48c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:21.322356 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbde522-a52f-405c-82fa-35cafd65b48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:21.353677 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-ccbde522-a52f-405c-82fa-35cafd65b48c None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:18:21.355049 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ccbde522-a52f-405c-82fa-35cafd65b48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:18:21.437057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:18:21.662466 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4108/8190] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:18:21.671329 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3fe7d-2191-4d39-8ad9-40fc18cce624 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:21.671329 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3fe7d-2191-4d39-8ad9-40fc18cce624 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:21.671329 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3fe7d-2191-4d39-8ad9-40fc18cce624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:21.693121 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-03f3fe7d-2191-4d39-8ad9-40fc18cce624 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:18:21.694370 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-03f3fe7d-2191-4d39-8ad9-40fc18cce624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:18:21.709952 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4083/8191] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:18:21.713795 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbde522-a52f-405c-82fa-35cafd65b48c None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:18:21.724743 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbde522-a52f-405c-82fa-35cafd65b48c None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:18:21.729577 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5379c2a-32e7-46bb-9bd4-3cb4baa77969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:18:21.730206 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5379c2a-32e7-46bb-9bd4-3cb4baa77969 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:21.730485 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5379c2a-32e7-46bb-9bd4-3cb4baa77969 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:21.730928 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5379c2a-32e7-46bb-9bd4-3cb4baa77969 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:21.732328 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5379c2a-32e7-46bb-9bd4-3cb4baa77969 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:18:21.732808 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5379c2a-32e7-46bb-9bd4-3cb4baa77969 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:18:21.735831 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5379c2a-32e7-46bb-9bd4-3cb4baa77969 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:18:21.757887 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4109/8192] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:18:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:18:21.762400 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f3fe7d-2191-4d39-8ad9-40fc18cce624 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:18:21.775658 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f3fe7d-2191-4d39-8ad9-40fc18cce624 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:18:21.784218 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95968597-7bb0-4363-8d3d-1bddc11869d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:18:21.785304 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95968597-7bb0-4363-8d3d-1bddc11869d4 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:21.785585 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95968597-7bb0-4363-8d3d-1bddc11869d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:21.785862 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95968597-7bb0-4363-8d3d-1bddc11869d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:21.786517 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95968597-7bb0-4363-8d3d-1bddc11869d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:18:21.789000 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95968597-7bb0-4363-8d3d-1bddc11869d4 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:18:21.827282 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4084/8193] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:18:21 2022] POST /identity/v3/projects => generated 383 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:18:21.828416 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5379c2a-32e7-46bb-9bd4-3cb4baa77969 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:18:21.841595 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5379c2a-32e7-46bb-9bd4-3cb4baa77969 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:18:21.936769 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634b5750-c69c-43ce-9a37-e9b633a9f739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:18:21.940968 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b5750-c69c-43ce-9a37-e9b633a9f739 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:21.941536 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b5750-c69c-43ce-9a37-e9b633a9f739 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:21.941991 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b5750-c69c-43ce-9a37-e9b633a9f739 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:21.942846 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634b5750-c69c-43ce-9a37-e9b633a9f739 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:18:21.945348 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634b5750-c69c-43ce-9a37-e9b633a9f739 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:18:21.977192 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95968597-7bb0-4363-8d3d-1bddc11869d4 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:18:21.979131 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4110/8194] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:18:21 2022] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:18:22.000085 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95968597-7bb0-4363-8d3d-1bddc11869d4 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:18:22.021083 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdffe84-a4ac-4f23-80db-8620c7089a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:18:22.022477 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdffe84-a4ac-4f23-80db-8620c7089a93 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:22.023173 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdffe84-a4ac-4f23-80db-8620c7089a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:22.023801 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdffe84-a4ac-4f23-80db-8620c7089a93 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:22.024734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdffe84-a4ac-4f23-80db-8620c7089a93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:18:22.027555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdffe84-a4ac-4f23-80db-8620c7089a93 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:18:22.050923 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4085/8195] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:18:22.051815 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634b5750-c69c-43ce-9a37-e9b633a9f739 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:18:22.070785 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634b5750-c69c-43ce-9a37-e9b633a9f739 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:18:22.076179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8073e93e-69e6-4153-973b-b51115fd7d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:18:22.077204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073e93e-69e6-4153-973b-b51115fd7d8e admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:22.077338 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073e93e-69e6-4153-973b-b51115fd7d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:22.077729 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073e93e-69e6-4153-973b-b51115fd7d8e admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:22.078409 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8073e93e-69e6-4153-973b-b51115fd7d8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:18:22.080703 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8073e93e-69e6-4153-973b-b51115fd7d8e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:18:22.098772 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4111/8196] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:18:22.099872 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdffe84-a4ac-4f23-80db-8620c7089a93 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:18:22.118178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdffe84-a4ac-4f23-80db-8620c7089a93 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:18:22.127473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec229b74-495c-460d-bfe2-e51f4d3c3cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:18:22.128866 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec229b74-495c-460d-bfe2-e51f4d3c3cf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:22.130803 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec229b74-495c-460d-bfe2-e51f4d3c3cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:22.131285 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec229b74-495c-460d-bfe2-e51f4d3c3cf9 admin admin] PATH_INFO: `/v3/projects/f04067a87acc44aba63e63d21d177e7d/users/be6587b0a1ea4069a66003fc1a842b65/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:22.135759 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:18:22.160358 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec229b74-495c-460d-bfe2-e51f4d3c3cf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f04067a87acc44aba63e63d21d177e7d, user_id=be6587b0a1ea4069a66003fc1a842b65, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:18:22.167647 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec229b74-495c-460d-bfe2-e51f4d3c3cf9 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:18:22.191197 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4086/8197] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:18:22 2022] PUT /identity/v3/projects/f04067a87acc44aba63e63d21d177e7d/users/be6587b0a1ea4069a66003fc1a842b65/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:18:22.200004 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083e484-40e9-4d03-98ae-add9747ca24b None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:22.201115 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083e484-40e9-4d03-98ae-add9747ca24b None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:22.201499 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083e484-40e9-4d03-98ae-add9747ca24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:22.239925 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-d083e484-40e9-4d03-98ae-add9747ca24b None None] MFA Rules not processed for user `be6587b0a1ea4069a66003fc1a842b65`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:18:22.241744 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d083e484-40e9-4d03-98ae-add9747ca24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:18:22.350511 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4112/8198] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:18:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:18:22.365407 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec229b74-495c-460d-bfe2-e51f4d3c3cf9 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:18:22.367960 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ec229b74-495c-460d-bfe2-e51f4d3c3cf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:18:22.479397 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec229b74-495c-460d-bfe2-e51f4d3c3cf9 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:18:22.484770 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153fbcbf-6c12-44f4-b28b-324269ee2817 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:18:22.485472 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fbcbf-6c12-44f4-b28b-324269ee2817 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:22.485689 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fbcbf-6c12-44f4-b28b-324269ee2817 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:22.486569 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fbcbf-6c12-44f4-b28b-324269ee2817 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:22.518851 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153fbcbf-6c12-44f4-b28b-324269ee2817 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:18:22.520579 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153fbcbf-6c12-44f4-b28b-324269ee2817 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:18:22.531235 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4087/8199] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:18:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:18:22.985809 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d083e484-40e9-4d03-98ae-add9747ca24b None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:18:23.035977 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:18:23.069637 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d083e484-40e9-4d03-98ae-add9747ca24b None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:18:23.078170 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7665f-9f82-413f-a15f-8984f674d68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:18:23.078982 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7665f-9f82-413f-a15f-8984f674d68d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:23.079546 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7665f-9f82-413f-a15f-8984f674d68d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:23.079779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7665f-9f82-413f-a15f-8984f674d68d admin admin] PATH_INFO: `/v3/users/be6587b0a1ea4069a66003fc1a842b65` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:23.081114 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a7665f-9f82-413f-a15f-8984f674d68d admin admin] RBAC: Authorizing `identity:delete_user(user_id=be6587b0a1ea4069a66003fc1a842b65)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:18:23.083505 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a7665f-9f82-413f-a15f-8984f674d68d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:18:23.156381 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-08a7665f-9f82-413f-a15f-8984f674d68d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be6587b0a1ea4069a66003fc1a842b65'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:18:23.157733 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-08a7665f-9f82-413f-a15f-8984f674d68d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be6587b0a1ea4069a66003fc1a842b65'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:18:23.166756 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-08a7665f-9f82-413f-a15f-8984f674d68d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be6587b0a1ea4069a66003fc1a842b65'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:18:23.176343 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-08a7665f-9f82-413f-a15f-8984f674d68d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be6587b0a1ea4069a66003fc1a842b65'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:18:23.177036 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-08a7665f-9f82-413f-a15f-8984f674d68d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be6587b0a1ea4069a66003fc1a842b65'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:18:23.204124 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4113/8200] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:18:22 2022] DELETE /identity/v3/users/be6587b0a1ea4069a66003fc1a842b65 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:18:23.206279 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89abf63-751d-429a-93e4-52d4b322dc73 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:23.207929 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89abf63-751d-429a-93e4-52d4b322dc73 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:23.208433 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89abf63-751d-429a-93e4-52d4b322dc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:23.236052 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-a89abf63-751d-429a-93e4-52d4b322dc73 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:18:23.238517 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a89abf63-751d-429a-93e4-52d4b322dc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:18:23.353170 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4088/8201] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:18:23.361548 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7665f-9f82-413f-a15f-8984f674d68d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:18:23.364109 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-08a7665f-9f82-413f-a15f-8984f674d68d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:18:23.464777 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7665f-9f82-413f-a15f-8984f674d68d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:18:23.472494 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de8d606-e88d-4ffb-873a-b0f1d0f8a8ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:18:23.473245 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8d606-e88d-4ffb-873a-b0f1d0f8a8ad service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:23.473612 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8d606-e88d-4ffb-873a-b0f1d0f8a8ad service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:23.473972 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8d606-e88d-4ffb-873a-b0f1d0f8a8ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:23.487816 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de8d606-e88d-4ffb-873a-b0f1d0f8a8ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:18:23.490953 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de8d606-e88d-4ffb-873a-b0f1d0f8a8ad service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:18:23.504775 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4114/8202] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:18:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:18:23.903836 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89abf63-751d-429a-93e4-52d4b322dc73 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:18:23.905344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a89abf63-751d-429a-93e4-52d4b322dc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:18:23.938030 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89abf63-751d-429a-93e4-52d4b322dc73 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:18:23.946720 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae25394-0bb0-45c6-b149-98d20899a951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:18:23.947405 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae25394-0bb0-45c6-b149-98d20899a951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:23.947690 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae25394-0bb0-45c6-b149-98d20899a951 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:23.947967 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae25394-0bb0-45c6-b149-98d20899a951 admin admin] PATH_INFO: `/v3/projects/f04067a87acc44aba63e63d21d177e7d` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:23.949129 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae25394-0bb0-45c6-b149-98d20899a951 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f04067a87acc44aba63e63d21d177e7d)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:18:23.952044 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae25394-0bb0-45c6-b149-98d20899a951 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:18:24.021383 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8ae25394-0bb0-45c6-b149-98d20899a951 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f04067a87acc44aba63e63d21d177e7d', 'request_id': 'req-8ae25394-0bb0-45c6-b149-98d20899a951'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:18:24.027581 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8ae25394-0bb0-45c6-b149-98d20899a951 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f04067a87acc44aba63e63d21d177e7d', 'request_id': 'req-8ae25394-0bb0-45c6-b149-98d20899a951'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:18:24.044492 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8ae25394-0bb0-45c6-b149-98d20899a951 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f04067a87acc44aba63e63d21d177e7d', 'request_id': 'req-8ae25394-0bb0-45c6-b149-98d20899a951'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:18:24.060446 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8ae25394-0bb0-45c6-b149-98d20899a951 admin admin] The token cache is being invalidate because project f04067a87acc44aba63e63d21d177e7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:18:24.061345 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8ae25394-0bb0-45c6-b149-98d20899a951 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:18:24.062182 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8ae25394-0bb0-45c6-b149-98d20899a951 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:18:24.064109 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4089/8203] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:18:23 2022] DELETE /identity/v3/projects/f04067a87acc44aba63e63d21d177e7d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:18:24.068854 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0878cd4-1718-4495-9cef-686ef4083e27 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:24.069712 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0878cd4-1718-4495-9cef-686ef4083e27 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:24.070206 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0878cd4-1718-4495-9cef-686ef4083e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:24.094257 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a0878cd4-1718-4495-9cef-686ef4083e27 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:18:24.095990 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a0878cd4-1718-4495-9cef-686ef4083e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:18:24.185860 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:18:24.207987 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4115/8204] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:18:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:18:24.210952 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88971e3e-a23c-487c-8425-eaf6f7fae6c4 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:24.211499 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88971e3e-a23c-487c-8425-eaf6f7fae6c4 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:24.211593 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88971e3e-a23c-487c-8425-eaf6f7fae6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:24.236439 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-88971e3e-a23c-487c-8425-eaf6f7fae6c4 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:18:24.237946 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-88971e3e-a23c-487c-8425-eaf6f7fae6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:18:24.246893 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4090/8205] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:18:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:18:24.251583 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0878cd4-1718-4495-9cef-686ef4083e27 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:18:24.265527 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0878cd4-1718-4495-9cef-686ef4083e27 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:18:24.271127 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c50cd-d67e-4072-9c28-12de5c463c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:18:24.271771 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c50cd-d67e-4072-9c28-12de5c463c10 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:24.272043 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c50cd-d67e-4072-9c28-12de5c463c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:24.272303 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c50cd-d67e-4072-9c28-12de5c463c10 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:24.272971 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c50cd-d67e-4072-9c28-12de5c463c10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:18:24.273255 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c50cd-d67e-4072-9c28-12de5c463c10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:18:24.275079 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c50cd-d67e-4072-9c28-12de5c463c10 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:18:24.295720 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4116/8206] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:18:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:18:24.299723 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88971e3e-a23c-487c-8425-eaf6f7fae6c4 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:18:24.310473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:18:24.320987 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88971e3e-a23c-487c-8425-eaf6f7fae6c4 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:18:24.329340 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200ac78-515e-4a20-bc39-5acdf67c381a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:18:24.330443 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200ac78-515e-4a20-bc39-5acdf67c381a admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:24.331120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200ac78-515e-4a20-bc39-5acdf67c381a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:24.331628 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200ac78-515e-4a20-bc39-5acdf67c381a admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:24.332746 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5200ac78-515e-4a20-bc39-5acdf67c381a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:18:24.335084 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5200ac78-515e-4a20-bc39-5acdf67c381a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:18:24.376591 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4091/8207] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:18:24 2022] POST /identity/v3/projects => generated 359 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:18:24.380373 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c50cd-d67e-4072-9c28-12de5c463c10 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:18:24.398506 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c50cd-d67e-4072-9c28-12de5c463c10 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:18:24.482127 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bceb63f-bc1c-4611-a2ac-17ad3859e936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:18:24.482930 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bceb63f-bc1c-4611-a2ac-17ad3859e936 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:24.483457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bceb63f-bc1c-4611-a2ac-17ad3859e936 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:24.483881 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bceb63f-bc1c-4611-a2ac-17ad3859e936 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:24.484541 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bceb63f-bc1c-4611-a2ac-17ad3859e936 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:18:24.486481 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bceb63f-bc1c-4611-a2ac-17ad3859e936 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:18:24.511353 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4117/8208] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:18:24 2022] POST /identity/v3/users => generated 280 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:18:24.515705 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200ac78-515e-4a20-bc39-5acdf67c381a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:18:24.526063 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200ac78-515e-4a20-bc39-5acdf67c381a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:18:24.532021 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a30907-217d-4df6-bb5b-5cef2b2251eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:18:24.532637 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a30907-217d-4df6-bb5b-5cef2b2251eb admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:24.532919 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a30907-217d-4df6-bb5b-5cef2b2251eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:24.533193 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a30907-217d-4df6-bb5b-5cef2b2251eb admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:24.533847 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a30907-217d-4df6-bb5b-5cef2b2251eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:18:24.535500 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a30907-217d-4df6-bb5b-5cef2b2251eb admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:18:24.547284 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4092/8209] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:18:24.551275 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bceb63f-bc1c-4611-a2ac-17ad3859e936 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:18:24.562417 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bceb63f-bc1c-4611-a2ac-17ad3859e936 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:18:24.568010 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ab2d4-63d9-493f-a2d3-0275b3b185e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:18:24.568625 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ab2d4-63d9-493f-a2d3-0275b3b185e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:24.568908 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ab2d4-63d9-493f-a2d3-0275b3b185e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:24.569194 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ab2d4-63d9-493f-a2d3-0275b3b185e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:24.569982 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918ab2d4-63d9-493f-a2d3-0275b3b185e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:18:24.571640 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918ab2d4-63d9-493f-a2d3-0275b3b185e4 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:18:24.583546 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4118/8210] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:18:24.587719 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a30907-217d-4df6-bb5b-5cef2b2251eb admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:18:24.598967 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a30907-217d-4df6-bb5b-5cef2b2251eb admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:18:24.604765 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9536f-21cb-416c-9706-742fe5d2def5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:18:24.605497 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9536f-21cb-416c-9706-742fe5d2def5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:24.605652 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9536f-21cb-416c-9706-742fe5d2def5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:24.605925 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9536f-21cb-416c-9706-742fe5d2def5 admin admin] PATH_INFO: `/v3/projects/22db29f69075499b8ce4769fd63de4e3/users/9f48cc8bc9e149d1b430ba2e8eb4e9ac/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:24.625431 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df9536f-21cb-416c-9706-742fe5d2def5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22db29f69075499b8ce4769fd63de4e3, user_id=9f48cc8bc9e149d1b430ba2e8eb4e9ac, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:18:24.628340 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df9536f-21cb-416c-9706-742fe5d2def5 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:18:24.643910 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4093/8211] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:18:24 2022] PUT /identity/v3/projects/22db29f69075499b8ce4769fd63de4e3/users/9f48cc8bc9e149d1b430ba2e8eb4e9ac/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:18:24.655056 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81a822-e603-4302-862a-73e910dcf13b None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:24.655056 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81a822-e603-4302-862a-73e910dcf13b None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:24.655056 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81a822-e603-4302-862a-73e910dcf13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:24.687926 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-aa81a822-e603-4302-862a-73e910dcf13b None None] MFA Rules not processed for user `9f48cc8bc9e149d1b430ba2e8eb4e9ac`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:18:24.689187 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-aa81a822-e603-4302-862a-73e910dcf13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:18:24.758020 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4119/8212] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:18:24 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:18:24.768614 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9536f-21cb-416c-9706-742fe5d2def5 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:18:24.770652 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5df9536f-21cb-416c-9706-742fe5d2def5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:18:24.835567 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9536f-21cb-416c-9706-742fe5d2def5 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:18:24.839341 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73e74d-5e50-47c0-82c1-1f44f3bb333d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:18:24.839951 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73e74d-5e50-47c0-82c1-1f44f3bb333d service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:24.840232 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73e74d-5e50-47c0-82c1-1f44f3bb333d service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:24.840506 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73e74d-5e50-47c0-82c1-1f44f3bb333d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:24.850450 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f73e74d-5e50-47c0-82c1-1f44f3bb333d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:18:24.851926 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f73e74d-5e50-47c0-82c1-1f44f3bb333d service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:18:24.861606 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4094/8213] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:18:24 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:18:32.133601 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81a822-e603-4302-862a-73e910dcf13b None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:18:32.135419 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-aa81a822-e603-4302-862a-73e910dcf13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:18:32.199345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:18:32.238514 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81a822-e603-4302-862a-73e910dcf13b None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:18:32.243944 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d7454-e2a3-46b1-b1ab-292ea37ab683 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:18:32.244670 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d7454-e2a3-46b1-b1ab-292ea37ab683 service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:32.245053 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d7454-e2a3-46b1-b1ab-292ea37ab683 service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:32.245426 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d7454-e2a3-46b1-b1ab-292ea37ab683 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:32.247660 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-120d7454-e2a3-46b1-b1ab-292ea37ab683 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:18:32.263659 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120d7454-e2a3-46b1-b1ab-292ea37ab683 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:18:32.265326 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120d7454-e2a3-46b1-b1ab-292ea37ab683 service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:18:32.283163 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4120/8214] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:18:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:18:34.857500 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=49,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:18:42.276612 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=12 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:18:58.404904 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73e74d-5e50-47c0-82c1-1f44f3bb333d service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:18:58.424994 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73e74d-5e50-47c0-82c1-1f44f3bb333d service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:18:58.432986 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ebdb4c-854e-4241-b482-ef72a9aa30b1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:18:58.433985 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ebdb4c-854e-4241-b482-ef72a9aa30b1 service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:58.434768 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ebdb4c-854e-4241-b482-ef72a9aa30b1 service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:58.435338 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ebdb4c-854e-4241-b482-ef72a9aa30b1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:58.437454 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-55ebdb4c-854e-4241-b482-ef72a9aa30b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:18:58.463649 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ebdb4c-854e-4241-b482-ef72a9aa30b1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:18:58.465421 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ebdb4c-854e-4241-b482-ef72a9aa30b1 service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:18:58.485291 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4095/8215] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:18:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:19:08.473006 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=6 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:19:17.666269 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d7454-e2a3-46b1-b1ab-292ea37ab683 service placement] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:19:17.667939 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-120d7454-e2a3-46b1-b1ab-292ea37ab683 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:19:17.697889 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d7454-e2a3-46b1-b1ab-292ea37ab683 service placement] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:19:17.713498 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ce31b-ad20-4e8c-b865-4a03d75ca981 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:19:17.715063 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ce31b-ad20-4e8c-b865-4a03d75ca981 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:17.715771 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ce31b-ad20-4e8c-b865-4a03d75ca981 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:17.716892 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ce31b-ad20-4e8c-b865-4a03d75ca981 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:17.719200 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f86ce31b-ad20-4e8c-b865-4a03d75ca981 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:19:17.738044 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ce31b-ad20-4e8c-b865-4a03d75ca981 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:19:17.740082 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ce31b-ad20-4e8c-b865-4a03d75ca981 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:19:17.758052 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4121/8216] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:19:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:19:27.745565 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=6 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:19:35.789389 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ebdb4c-854e-4241-b482-ef72a9aa30b1 service placement] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:19:35.790625 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-55ebdb4c-854e-4241-b482-ef72a9aa30b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:19:35.874020 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ebdb4c-854e-4241-b482-ef72a9aa30b1 service placement] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:19:35.878866 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ff82a-911d-4bc4-ab7b-f6001de3776e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:19:35.879551 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ff82a-911d-4bc4-ab7b-f6001de3776e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:35.879829 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ff82a-911d-4bc4-ab7b-f6001de3776e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:35.880100 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ff82a-911d-4bc4-ab7b-f6001de3776e admin admin] PATH_INFO: `/v3/users/a794a2205d09446a8c08b5138f011908` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:35.881238 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ff82a-911d-4bc4-ab7b-f6001de3776e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a794a2205d09446a8c08b5138f011908)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:19:35.883198 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ff82a-911d-4bc4-ab7b-f6001de3776e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:19:35.948352 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8c0ff82a-911d-4bc4-ab7b-f6001de3776e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a794a2205d09446a8c08b5138f011908'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:19:35.949262 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8c0ff82a-911d-4bc4-ab7b-f6001de3776e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a794a2205d09446a8c08b5138f011908'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:19:35.968650 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8c0ff82a-911d-4bc4-ab7b-f6001de3776e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a794a2205d09446a8c08b5138f011908'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:19:35.978098 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8c0ff82a-911d-4bc4-ab7b-f6001de3776e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a794a2205d09446a8c08b5138f011908'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:19:35.989047 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8c0ff82a-911d-4bc4-ab7b-f6001de3776e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a794a2205d09446a8c08b5138f011908'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:19:36.004359 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4096/8217] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:19:35 2022] DELETE /identity/v3/users/a794a2205d09446a8c08b5138f011908 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:19:36.006251 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da6f714-c548-41ad-b47b-8730e5ada1b7 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:36.007343 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da6f714-c548-41ad-b47b-8730e5ada1b7 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:36.007822 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da6f714-c548-41ad-b47b-8730e5ada1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:36.038644 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-9da6f714-c548-41ad-b47b-8730e5ada1b7 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:19:36.040678 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9da6f714-c548-41ad-b47b-8730e5ada1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:19:36.143643 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4122/8218] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:19:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:19:36.154682 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ff82a-911d-4bc4-ab7b-f6001de3776e admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:19:36.156161 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8c0ff82a-911d-4bc4-ab7b-f6001de3776e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:19:36.238554 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ff82a-911d-4bc4-ab7b-f6001de3776e admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:19:36.242378 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea705cf-f68b-47dc-ad0d-c496083464d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:19:36.243001 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea705cf-f68b-47dc-ad0d-c496083464d4 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:36.243318 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea705cf-f68b-47dc-ad0d-c496083464d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:36.243591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea705cf-f68b-47dc-ad0d-c496083464d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:36.254880 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea705cf-f68b-47dc-ad0d-c496083464d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:19:36.256490 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea705cf-f68b-47dc-ad0d-c496083464d4 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:19:36.271559 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4097/8219] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:19:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:19:36.613659 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da6f714-c548-41ad-b47b-8730e5ada1b7 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:19:36.617270 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9da6f714-c548-41ad-b47b-8730e5ada1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:19:36.647110 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da6f714-c548-41ad-b47b-8730e5ada1b7 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:19:36.652691 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da05217b-e6c6-4ce4-8ffe-87e94a433666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:19:36.654190 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05217b-e6c6-4ce4-8ffe-87e94a433666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:36.654488 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05217b-e6c6-4ce4-8ffe-87e94a433666 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:36.655686 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05217b-e6c6-4ce4-8ffe-87e94a433666 admin admin] PATH_INFO: `/v3/projects/5060ec48b9a7486b8a4bf246fb621b9e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:36.656955 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da05217b-e6c6-4ce4-8ffe-87e94a433666 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5060ec48b9a7486b8a4bf246fb621b9e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:19:36.658889 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da05217b-e6c6-4ce4-8ffe-87e94a433666 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:19:36.728786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-da05217b-e6c6-4ce4-8ffe-87e94a433666 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5060ec48b9a7486b8a4bf246fb621b9e', 'request_id': 'req-da05217b-e6c6-4ce4-8ffe-87e94a433666'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:19:36.745688 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-da05217b-e6c6-4ce4-8ffe-87e94a433666 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5060ec48b9a7486b8a4bf246fb621b9e', 'request_id': 'req-da05217b-e6c6-4ce4-8ffe-87e94a433666'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:19:36.754688 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-da05217b-e6c6-4ce4-8ffe-87e94a433666 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5060ec48b9a7486b8a4bf246fb621b9e', 'request_id': 'req-da05217b-e6c6-4ce4-8ffe-87e94a433666'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:19:36.769191 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-da05217b-e6c6-4ce4-8ffe-87e94a433666 admin admin] The token cache is being invalidate because project 5060ec48b9a7486b8a4bf246fb621b9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:19:36.769479 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-da05217b-e6c6-4ce4-8ffe-87e94a433666 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:19:36.770120 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-da05217b-e6c6-4ce4-8ffe-87e94a433666 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:19:36.771666 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4123/8220] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:19:36 2022] DELETE /identity/v3/projects/5060ec48b9a7486b8a4bf246fb621b9e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:19:36.776685 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb639a1-3a99-4fe6-be7c-b1102a8c6c53 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:36.777160 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb639a1-3a99-4fe6-be7c-b1102a8c6c53 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:36.777458 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb639a1-3a99-4fe6-be7c-b1102a8c6c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:36.798420 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-2bb639a1-3a99-4fe6-be7c-b1102a8c6c53 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:19:36.799811 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2bb639a1-3a99-4fe6-be7c-b1102a8c6c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:19:36.820598 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:19:36.868471 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4098/8221] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:19:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:19:36.878551 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd246051-0371-4fd6-bef4-cca4258de703 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:36.878835 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd246051-0371-4fd6-bef4-cca4258de703 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:36.879146 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd246051-0371-4fd6-bef4-cca4258de703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:36.899875 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-fd246051-0371-4fd6-bef4-cca4258de703 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:19:36.901077 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-fd246051-0371-4fd6-bef4-cca4258de703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:19:36.909851 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4124/8222] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:19:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:19:36.914228 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb639a1-3a99-4fe6-be7c-b1102a8c6c53 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:19:36.925003 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb639a1-3a99-4fe6-be7c-b1102a8c6c53 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:19:36.934089 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded2fea-bf85-4d72-a8ea-2b0025fab8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:19:36.934716 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded2fea-bf85-4d72-a8ea-2b0025fab8e5 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:36.934997 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded2fea-bf85-4d72-a8ea-2b0025fab8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:36.935297 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded2fea-bf85-4d72-a8ea-2b0025fab8e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:36.936231 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded2fea-bf85-4d72-a8ea-2b0025fab8e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:19:36.936687 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded2fea-bf85-4d72-a8ea-2b0025fab8e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:19:36.938556 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded2fea-bf85-4d72-a8ea-2b0025fab8e5 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:19:36.952113 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4099/8223] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:19:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:19:36.956700 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd246051-0371-4fd6-bef4-cca4258de703 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:19:36.966894 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd246051-0371-4fd6-bef4-cca4258de703 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:19:36.971801 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ada8a-f53b-4ae2-aa1c-1d38561d464c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:19:36.972415 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ada8a-f53b-4ae2-aa1c-1d38561d464c admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:36.972692 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ada8a-f53b-4ae2-aa1c-1d38561d464c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:36.972961 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ada8a-f53b-4ae2-aa1c-1d38561d464c admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:36.973609 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614ada8a-f53b-4ae2-aa1c-1d38561d464c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:19:36.975596 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614ada8a-f53b-4ae2-aa1c-1d38561d464c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:19:37.006586 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4125/8224] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:19:36 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:19:37.010911 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded2fea-bf85-4d72-a8ea-2b0025fab8e5 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:19:37.021073 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded2fea-bf85-4d72-a8ea-2b0025fab8e5 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:19:37.082465 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01063831-0064-4562-b261-f6cd0b4f65cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:19:37.083002 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01063831-0064-4562-b261-f6cd0b4f65cd admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:37.083314 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01063831-0064-4562-b261-f6cd0b4f65cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:37.083592 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01063831-0064-4562-b261-f6cd0b4f65cd admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:37.084229 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01063831-0064-4562-b261-f6cd0b4f65cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:19:37.086195 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01063831-0064-4562-b261-f6cd0b4f65cd admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:19:37.109423 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4100/8225] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:19:37 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:19:37.113338 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ada8a-f53b-4ae2-aa1c-1d38561d464c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:19:37.123824 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ada8a-f53b-4ae2-aa1c-1d38561d464c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:19:37.128681 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8455c2cd-4a91-47c8-aa1b-67c3273510ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:19:37.129303 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455c2cd-4a91-47c8-aa1b-67c3273510ee admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:37.129582 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455c2cd-4a91-47c8-aa1b-67c3273510ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:37.130053 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455c2cd-4a91-47c8-aa1b-67c3273510ee admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:37.130700 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8455c2cd-4a91-47c8-aa1b-67c3273510ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:19:37.132443 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8455c2cd-4a91-47c8-aa1b-67c3273510ee admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:19:37.143565 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4126/8226] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:19:37.147658 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01063831-0064-4562-b261-f6cd0b4f65cd admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:19:37.158697 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01063831-0064-4562-b261-f6cd0b4f65cd admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:19:37.163428 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827038be-d5d0-49a8-b74a-9b7ffe1c409f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:19:37.164035 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827038be-d5d0-49a8-b74a-9b7ffe1c409f admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:37.164321 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827038be-d5d0-49a8-b74a-9b7ffe1c409f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:37.164592 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827038be-d5d0-49a8-b74a-9b7ffe1c409f admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:37.165237 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827038be-d5d0-49a8-b74a-9b7ffe1c409f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:19:37.166989 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827038be-d5d0-49a8-b74a-9b7ffe1c409f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:19:37.178870 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4101/8227] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:19:37.183466 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8455c2cd-4a91-47c8-aa1b-67c3273510ee admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:19:37.193478 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8455c2cd-4a91-47c8-aa1b-67c3273510ee admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:19:37.198194 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb23938-de9d-4140-8148-62b247449cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:19:37.199044 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb23938-de9d-4140-8148-62b247449cf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:37.199347 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb23938-de9d-4140-8148-62b247449cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:37.200215 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb23938-de9d-4140-8148-62b247449cf2 admin admin] PATH_INFO: `/v3/projects/e0e385c08847496b80608548ab7321ee/users/32dff34a93a940fabd96c6981266a8aa/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:37.214735 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb23938-de9d-4140-8148-62b247449cf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0e385c08847496b80608548ab7321ee, user_id=32dff34a93a940fabd96c6981266a8aa, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:19:37.218298 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb23938-de9d-4140-8148-62b247449cf2 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:19:37.235627 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4127/8228] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:19:37 2022] PUT /identity/v3/projects/e0e385c08847496b80608548ab7321ee/users/32dff34a93a940fabd96c6981266a8aa/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:19:37.245718 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394b37e-1b7c-40c9-aa00-a5cbb8f21b97 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:37.246071 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394b37e-1b7c-40c9-aa00-a5cbb8f21b97 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:37.246431 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394b37e-1b7c-40c9-aa00-a5cbb8f21b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:37.279048 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-3394b37e-1b7c-40c9-aa00-a5cbb8f21b97 None None] MFA Rules not processed for user `32dff34a93a940fabd96c6981266a8aa`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:19:37.280397 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3394b37e-1b7c-40c9-aa00-a5cbb8f21b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:19:37.349450 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4102/8229] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:19:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:19:37.353819 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb23938-de9d-4140-8148-62b247449cf2 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:19:37.379940 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:19:37.433466 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb23938-de9d-4140-8148-62b247449cf2 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:19:37.439683 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dec203-6171-4f6e-9449-0f5c7ec2fc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:19:37.440333 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dec203-6171-4f6e-9449-0f5c7ec2fc47 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:37.440598 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dec203-6171-4f6e-9449-0f5c7ec2fc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:37.440874 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dec203-6171-4f6e-9449-0f5c7ec2fc47 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:37.441528 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dec203-6171-4f6e-9449-0f5c7ec2fc47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:19:37.443496 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dec203-6171-4f6e-9449-0f5c7ec2fc47 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:19:37.477966 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4128/8230] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:19:37 2022] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:19:37.479178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394b37e-1b7c-40c9-aa00-a5cbb8f21b97 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:19:37.491582 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394b37e-1b7c-40c9-aa00-a5cbb8f21b97 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:19:37.507432 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:19:37.569351 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c40b00-3cf3-4660-bae0-ed018efb248c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:19:37.569976 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c40b00-3cf3-4660-bae0-ed018efb248c admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:37.570259 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c40b00-3cf3-4660-bae0-ed018efb248c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:37.570538 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c40b00-3cf3-4660-bae0-ed018efb248c admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:37.571581 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c40b00-3cf3-4660-bae0-ed018efb248c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:19:37.573766 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c40b00-3cf3-4660-bae0-ed018efb248c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:19:37.598894 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4103/8231] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:19:37 2022] POST /identity/v3/users => generated 294 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:19:37.602777 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dec203-6171-4f6e-9449-0f5c7ec2fc47 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:19:37.613401 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dec203-6171-4f6e-9449-0f5c7ec2fc47 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:19:37.618148 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c47c32-6d2a-478a-bd6a-e492c45c682e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:19:37.618753 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c47c32-6d2a-478a-bd6a-e492c45c682e admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:37.619042 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c47c32-6d2a-478a-bd6a-e492c45c682e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:37.619328 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c47c32-6d2a-478a-bd6a-e492c45c682e admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:37.619994 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c47c32-6d2a-478a-bd6a-e492c45c682e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:19:37.622218 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c47c32-6d2a-478a-bd6a-e492c45c682e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:19:37.633320 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4129/8232] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:19:37.638457 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c40b00-3cf3-4660-bae0-ed018efb248c admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:19:37.648568 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c40b00-3cf3-4660-bae0-ed018efb248c admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:19:37.653311 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738cb0e3-c570-4578-98b2-9ae63afe0654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:19:37.653984 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738cb0e3-c570-4578-98b2-9ae63afe0654 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:37.654245 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738cb0e3-c570-4578-98b2-9ae63afe0654 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:37.654520 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738cb0e3-c570-4578-98b2-9ae63afe0654 admin admin] PATH_INFO: `/v3/projects/7b6884f613244845bb7a2caab48aa7ad/users/4d7f8a26d62f4d8cbe24a173c1915d3d/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:37.669778 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738cb0e3-c570-4578-98b2-9ae63afe0654 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b6884f613244845bb7a2caab48aa7ad, user_id=4d7f8a26d62f4d8cbe24a173c1915d3d, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:19:37.672571 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738cb0e3-c570-4578-98b2-9ae63afe0654 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:19:37.690267 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4104/8233] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:19:37 2022] PUT /identity/v3/projects/7b6884f613244845bb7a2caab48aa7ad/users/4d7f8a26d62f4d8cbe24a173c1915d3d/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:19:37.691465 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c47c32-6d2a-478a-bd6a-e492c45c682e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:19:37.702767 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c47c32-6d2a-478a-bd6a-e492c45c682e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:19:37.768563 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30095dd0-c59d-4364-bd80-db421207907a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:19:37.769191 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30095dd0-c59d-4364-bd80-db421207907a admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:37.769787 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30095dd0-c59d-4364-bd80-db421207907a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:37.769787 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30095dd0-c59d-4364-bd80-db421207907a admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:37.770363 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30095dd0-c59d-4364-bd80-db421207907a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:19:37.772013 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30095dd0-c59d-4364-bd80-db421207907a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:19:37.782966 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4130/8234] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:19:37.787264 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738cb0e3-c570-4578-98b2-9ae63afe0654 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:19:37.799819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738cb0e3-c570-4578-98b2-9ae63afe0654 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:19:37.804983 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f5359-18bf-43d7-9c52-828c2d7e5346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:19:37.806006 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f5359-18bf-43d7-9c52-828c2d7e5346 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:37.806006 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f5359-18bf-43d7-9c52-828c2d7e5346 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:37.806422 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f5359-18bf-43d7-9c52-828c2d7e5346 admin admin] PATH_INFO: `/v3/projects/7b6884f613244845bb7a2caab48aa7ad/users/4d7f8a26d62f4d8cbe24a173c1915d3d/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:37.810017 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23f5359-18bf-43d7-9c52-828c2d7e5346 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b6884f613244845bb7a2caab48aa7ad, user_id=4d7f8a26d62f4d8cbe24a173c1915d3d, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:19:37.813406 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23f5359-18bf-43d7-9c52-828c2d7e5346 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:19:37.829938 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4105/8235] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:19:37 2022] PUT /identity/v3/projects/7b6884f613244845bb7a2caab48aa7ad/users/4d7f8a26d62f4d8cbe24a173c1915d3d/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:19:37.841495 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e64e1-2433-459d-8cb7-3759f6a1fb16 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:37.841769 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e64e1-2433-459d-8cb7-3759f6a1fb16 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:37.842048 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e64e1-2433-459d-8cb7-3759f6a1fb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:37.874171 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-874e64e1-2433-459d-8cb7-3759f6a1fb16 None None] MFA Rules not processed for user `4d7f8a26d62f4d8cbe24a173c1915d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:19:37.875481 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-874e64e1-2433-459d-8cb7-3759f6a1fb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:19:37.964052 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4131/8236] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:19:37 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:19:37.969490 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f5359-18bf-43d7-9c52-828c2d7e5346 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:19:37.971984 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d23f5359-18bf-43d7-9c52-828c2d7e5346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:19:38.083200 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f5359-18bf-43d7-9c52-828c2d7e5346 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:19:38.088616 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b4d2db-d1fe-4c4c-b2f6-84d56f6f12d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:19:38.089344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4d2db-d1fe-4c4c-b2f6-84d56f6f12d2 service cinder] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:38.089726 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4d2db-d1fe-4c4c-b2f6-84d56f6f12d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:38.090448 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4d2db-d1fe-4c4c-b2f6-84d56f6f12d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:38.179769 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b4d2db-d1fe-4c4c-b2f6-84d56f6f12d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:19:38.181294 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b4d2db-d1fe-4c4c-b2f6-84d56f6f12d2 service cinder] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:19:38.196241 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4106/8237] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:19:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:19:41.876921 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e64e1-2433-459d-8cb7-3759f6a1fb16 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:19:41.878157 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-874e64e1-2433-459d-8cb7-3759f6a1fb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:19:41.899057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:19:41.920634 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b4d2db-d1fe-4c4c-b2f6-84d56f6f12d2 service cinder] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:19:41.922923 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-72b4d2db-d1fe-4c4c-b2f6-84d56f6f12d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:19:41.931049 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:19:41.938148 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b4d2db-d1fe-4c4c-b2f6-84d56f6f12d2 service cinder] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:19:41.946148 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2892305-13bd-43a2-83c8-bc66f91c8240 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:19:41.947212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2892305-13bd-43a2-83c8-bc66f91c8240 service cinder] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:41.947380 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2892305-13bd-43a2-83c8-bc66f91c8240 service cinder] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:41.947727 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2892305-13bd-43a2-83c8-bc66f91c8240 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:41.958828 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e64e1-2433-459d-8cb7-3759f6a1fb16 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:19:41.959258 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2892305-13bd-43a2-83c8-bc66f91c8240 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:19:41.960709 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2892305-13bd-43a2-83c8-bc66f91c8240 service cinder] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:19:41.963835 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f1cbcd-2d50-4efc-a304-b537f63e3945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:19:41.964627 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1cbcd-2d50-4efc-a304-b537f63e3945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:41.965695 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1cbcd-2d50-4efc-a304-b537f63e3945 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:41.966301 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1cbcd-2d50-4efc-a304-b537f63e3945 admin admin] PATH_INFO: `/v3/users/9f48cc8bc9e149d1b430ba2e8eb4e9ac` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:41.968037 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f1cbcd-2d50-4efc-a304-b537f63e3945 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f48cc8bc9e149d1b430ba2e8eb4e9ac)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:19:41.970106 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f1cbcd-2d50-4efc-a304-b537f63e3945 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:19:41.971770 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4107/8238] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:19:41 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:19:42.019309 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-19f1cbcd-2d50-4efc-a304-b537f63e3945 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f48cc8bc9e149d1b430ba2e8eb4e9ac'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:19:42.019980 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-19f1cbcd-2d50-4efc-a304-b537f63e3945 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f48cc8bc9e149d1b430ba2e8eb4e9ac'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:19:42.028793 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-19f1cbcd-2d50-4efc-a304-b537f63e3945 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f48cc8bc9e149d1b430ba2e8eb4e9ac'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:19:42.036268 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-19f1cbcd-2d50-4efc-a304-b537f63e3945 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f48cc8bc9e149d1b430ba2e8eb4e9ac'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:19:42.036890 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-19f1cbcd-2d50-4efc-a304-b537f63e3945 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f48cc8bc9e149d1b430ba2e8eb4e9ac'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:19:42.055060 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4132/8239] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:19:41 2022] DELETE /identity/v3/users/9f48cc8bc9e149d1b430ba2e8eb4e9ac => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:19:42.060335 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f80c39-6ab8-4daf-b75b-9ce15da0c976 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:42.060620 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f80c39-6ab8-4daf-b75b-9ce15da0c976 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:42.060893 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f80c39-6ab8-4daf-b75b-9ce15da0c976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:42.090250 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-99f80c39-6ab8-4daf-b75b-9ce15da0c976 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:19:42.091779 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-99f80c39-6ab8-4daf-b75b-9ce15da0c976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:19:42.181780 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4108/8240] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:19:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:19:42.191429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f1cbcd-2d50-4efc-a304-b537f63e3945 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:19:42.192855 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-19f1cbcd-2d50-4efc-a304-b537f63e3945 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:19:42.275716 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f1cbcd-2d50-4efc-a304-b537f63e3945 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:19:42.280239 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a179bc7-6b7b-4f4b-85f4-542f7bead52b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:19:42.280871 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a179bc7-6b7b-4f4b-85f4-542f7bead52b service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:42.281143 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a179bc7-6b7b-4f4b-85f4-542f7bead52b service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:42.281413 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a179bc7-6b7b-4f4b-85f4-542f7bead52b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:42.292448 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a179bc7-6b7b-4f4b-85f4-542f7bead52b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:19:42.294378 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a179bc7-6b7b-4f4b-85f4-542f7bead52b service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:19:42.306679 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4133/8241] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:19:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:19:42.511274 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f80c39-6ab8-4daf-b75b-9ce15da0c976 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:19:42.514144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-99f80c39-6ab8-4daf-b75b-9ce15da0c976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:19:42.528432 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f80c39-6ab8-4daf-b75b-9ce15da0c976 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:19:42.535793 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08541b85-fff7-4e54-ac58-1766648fdf74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:19:42.536571 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08541b85-fff7-4e54-ac58-1766648fdf74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:42.536952 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08541b85-fff7-4e54-ac58-1766648fdf74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:42.537341 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08541b85-fff7-4e54-ac58-1766648fdf74 admin admin] PATH_INFO: `/v3/projects/22db29f69075499b8ce4769fd63de4e3` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:42.538655 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08541b85-fff7-4e54-ac58-1766648fdf74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22db29f69075499b8ce4769fd63de4e3)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:19:42.540880 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08541b85-fff7-4e54-ac58-1766648fdf74 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:19:42.602136 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-08541b85-fff7-4e54-ac58-1766648fdf74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22db29f69075499b8ce4769fd63de4e3', 'request_id': 'req-08541b85-fff7-4e54-ac58-1766648fdf74'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:19:42.608441 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-08541b85-fff7-4e54-ac58-1766648fdf74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22db29f69075499b8ce4769fd63de4e3', 'request_id': 'req-08541b85-fff7-4e54-ac58-1766648fdf74'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:19:42.616650 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-08541b85-fff7-4e54-ac58-1766648fdf74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22db29f69075499b8ce4769fd63de4e3', 'request_id': 'req-08541b85-fff7-4e54-ac58-1766648fdf74'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:19:42.631124 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-08541b85-fff7-4e54-ac58-1766648fdf74 admin admin] The token cache is being invalidate because project 22db29f69075499b8ce4769fd63de4e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:19:42.632096 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-08541b85-fff7-4e54-ac58-1766648fdf74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:19:42.632998 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-08541b85-fff7-4e54-ac58-1766648fdf74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:19:42.634622 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4109/8242] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:19:42 2022] DELETE /identity/v3/projects/22db29f69075499b8ce4769fd63de4e3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:19:42.640376 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452a748-5e92-4bf9-abf7-613da1f20243 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:42.640785 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452a748-5e92-4bf9-abf7-613da1f20243 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:42.641125 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452a748-5e92-4bf9-abf7-613da1f20243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:42.662030 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-6452a748-5e92-4bf9-abf7-613da1f20243 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:19:42.663416 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6452a748-5e92-4bf9-abf7-613da1f20243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:19:42.699650 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:19:42.728583 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4134/8243] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:19:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:19:42.738210 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b6be9-fabe-4ddd-a755-af365f9af212 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:42.738505 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b6be9-fabe-4ddd-a755-af365f9af212 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:42.738789 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b6be9-fabe-4ddd-a755-af365f9af212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:42.760530 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-5d2b6be9-fabe-4ddd-a755-af365f9af212 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:19:42.761751 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5d2b6be9-fabe-4ddd-a755-af365f9af212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:19:42.771135 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4110/8244] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:19:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:19:42.774643 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6452a748-5e92-4bf9-abf7-613da1f20243 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:19:42.785333 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6452a748-5e92-4bf9-abf7-613da1f20243 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:19:42.789867 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c44274-8475-498d-8ef9-0216e03a4624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:19:42.790472 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c44274-8475-498d-8ef9-0216e03a4624 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:42.790746 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c44274-8475-498d-8ef9-0216e03a4624 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:42.791012 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c44274-8475-498d-8ef9-0216e03a4624 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:42.791688 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c44274-8475-498d-8ef9-0216e03a4624 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:19:42.791970 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c44274-8475-498d-8ef9-0216e03a4624 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:19:42.794213 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c44274-8475-498d-8ef9-0216e03a4624 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:19:42.805913 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4135/8245] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:19:42.811367 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b6be9-fabe-4ddd-a755-af365f9af212 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:19:42.821003 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b6be9-fabe-4ddd-a755-af365f9af212 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:19:42.826621 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c279464-0630-496f-8f9a-cbbe5c090a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:19:42.827294 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c279464-0630-496f-8f9a-cbbe5c090a84 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:42.827694 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c279464-0630-496f-8f9a-cbbe5c090a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:42.827976 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c279464-0630-496f-8f9a-cbbe5c090a84 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:42.828613 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c279464-0630-496f-8f9a-cbbe5c090a84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:19:42.830535 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c279464-0630-496f-8f9a-cbbe5c090a84 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:19:42.860884 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4111/8246] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:19:42 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:19:42.862021 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c44274-8475-498d-8ef9-0216e03a4624 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:19:42.872682 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c44274-8475-498d-8ef9-0216e03a4624 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:19:42.933099 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f42f3-87e1-4b09-80e6-ce2d84230b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:19:42.933768 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f42f3-87e1-4b09-80e6-ce2d84230b5d admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:42.934041 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f42f3-87e1-4b09-80e6-ce2d84230b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:42.934314 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f42f3-87e1-4b09-80e6-ce2d84230b5d admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:42.935077 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f42f3-87e1-4b09-80e6-ce2d84230b5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:19:42.936982 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f42f3-87e1-4b09-80e6-ce2d84230b5d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:19:42.957295 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4136/8247] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:19:42 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:19:42.961444 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c279464-0630-496f-8f9a-cbbe5c090a84 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:19:42.972790 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c279464-0630-496f-8f9a-cbbe5c090a84 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:19:42.977902 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f724649f-dd55-4a6a-94d1-74f48915ae26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:19:42.978530 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724649f-dd55-4a6a-94d1-74f48915ae26 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:42.978811 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724649f-dd55-4a6a-94d1-74f48915ae26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:42.979115 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724649f-dd55-4a6a-94d1-74f48915ae26 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:42.979776 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f724649f-dd55-4a6a-94d1-74f48915ae26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:19:42.982088 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f724649f-dd55-4a6a-94d1-74f48915ae26 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:19:42.993867 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4112/8248] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:19:42.998708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f42f3-87e1-4b09-80e6-ce2d84230b5d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:19:43.011718 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f42f3-87e1-4b09-80e6-ce2d84230b5d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:19:43.017808 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272ba07-b153-4338-9a99-2f38b84b6064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:19:43.018623 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272ba07-b153-4338-9a99-2f38b84b6064 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:43.018909 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272ba07-b153-4338-9a99-2f38b84b6064 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:43.019217 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272ba07-b153-4338-9a99-2f38b84b6064 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:43.019883 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0272ba07-b153-4338-9a99-2f38b84b6064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:19:43.021742 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0272ba07-b153-4338-9a99-2f38b84b6064 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:19:43.034275 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4137/8249] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:19:43.038577 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f724649f-dd55-4a6a-94d1-74f48915ae26 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:19:43.049639 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f724649f-dd55-4a6a-94d1-74f48915ae26 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:19:43.054406 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b791755-5703-4764-9772-419399fab769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:19:43.055103 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b791755-5703-4764-9772-419399fab769 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:43.055385 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b791755-5703-4764-9772-419399fab769 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:43.055657 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b791755-5703-4764-9772-419399fab769 admin admin] PATH_INFO: `/v3/projects/3e13a8eb8ed14a7197c6acd8ddd1edf5/users/b0c7636c80254442be6d9e8951360cf7/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:43.072040 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b791755-5703-4764-9772-419399fab769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e13a8eb8ed14a7197c6acd8ddd1edf5, user_id=b0c7636c80254442be6d9e8951360cf7, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:19:43.075740 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b791755-5703-4764-9772-419399fab769 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:19:43.089515 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4113/8250] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:19:43 2022] PUT /identity/v3/projects/3e13a8eb8ed14a7197c6acd8ddd1edf5/users/b0c7636c80254442be6d9e8951360cf7/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:19:43.100351 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a26723-5b01-433d-8103-99351ec9ebb9 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:43.100634 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a26723-5b01-433d-8103-99351ec9ebb9 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:43.100905 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a26723-5b01-433d-8103-99351ec9ebb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:43.130259 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a0a26723-5b01-433d-8103-99351ec9ebb9 None None] MFA Rules not processed for user `b0c7636c80254442be6d9e8951360cf7`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:19:43.131534 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a0a26723-5b01-433d-8103-99351ec9ebb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:19:43.200348 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4138/8251] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:19:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:19:43.210459 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b791755-5703-4764-9772-419399fab769 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:19:43.212200 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3b791755-5703-4764-9772-419399fab769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:19:43.226527 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:19:43.277323 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b791755-5703-4764-9772-419399fab769 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:19:43.282328 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a065311-37e9-4afd-a016-a96098fe0391 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:19:43.282943 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a065311-37e9-4afd-a016-a96098fe0391 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:43.283254 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a065311-37e9-4afd-a016-a96098fe0391 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:43.283531 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a065311-37e9-4afd-a016-a96098fe0391 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:43.292408 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a065311-37e9-4afd-a016-a96098fe0391 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:19:43.293843 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a065311-37e9-4afd-a016-a96098fe0391 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:19:43.303400 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4114/8252] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:19:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:19:53.196847 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=82,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:19:53.299213 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=21 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:19:57.349154 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a26723-5b01-433d-8103-99351ec9ebb9 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:19:57.419605 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a26723-5b01-433d-8103-99351ec9ebb9 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:19:57.424157 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e74ab-6d57-4b23-86fb-7017c799066f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:19:57.424906 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e74ab-6d57-4b23-86fb-7017c799066f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:57.425185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e74ab-6d57-4b23-86fb-7017c799066f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:57.425454 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e74ab-6d57-4b23-86fb-7017c799066f admin admin] PATH_INFO: `/v3/users/b0c7636c80254442be6d9e8951360cf7` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:57.426564 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e74ab-6d57-4b23-86fb-7017c799066f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0c7636c80254442be6d9e8951360cf7)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:19:57.428502 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e74ab-6d57-4b23-86fb-7017c799066f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:19:57.477723 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9a5e74ab-6d57-4b23-86fb-7017c799066f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0c7636c80254442be6d9e8951360cf7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:19:57.478443 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9a5e74ab-6d57-4b23-86fb-7017c799066f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0c7636c80254442be6d9e8951360cf7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:19:57.487707 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9a5e74ab-6d57-4b23-86fb-7017c799066f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0c7636c80254442be6d9e8951360cf7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:19:57.495656 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9a5e74ab-6d57-4b23-86fb-7017c799066f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0c7636c80254442be6d9e8951360cf7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:19:57.497004 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9a5e74ab-6d57-4b23-86fb-7017c799066f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0c7636c80254442be6d9e8951360cf7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:19:57.521437 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4139/8253] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:19:57 2022] DELETE /identity/v3/users/b0c7636c80254442be6d9e8951360cf7 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:19:57.526004 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857e542-0637-465d-8316-b95889ff6cb5 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:57.526465 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857e542-0637-465d-8316-b95889ff6cb5 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:57.526560 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857e542-0637-465d-8316-b95889ff6cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:57.547081 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-4857e542-0637-465d-8316-b95889ff6cb5 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:19:57.548237 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4857e542-0637-465d-8316-b95889ff6cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:19:57.616568 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4115/8254] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:19:57.627453 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e74ab-6d57-4b23-86fb-7017c799066f admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:19:57.628960 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9a5e74ab-6d57-4b23-86fb-7017c799066f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:19:57.729127 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e74ab-6d57-4b23-86fb-7017c799066f admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:19:57.733773 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26bb161-2e96-4466-b70f-b8690bd4ecf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:19:57.734663 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bb161-2e96-4466-b70f-b8690bd4ecf1 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:57.746065 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bb161-2e96-4466-b70f-b8690bd4ecf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:57.746943 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bb161-2e96-4466-b70f-b8690bd4ecf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:57.759195 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26bb161-2e96-4466-b70f-b8690bd4ecf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:19:57.760654 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26bb161-2e96-4466-b70f-b8690bd4ecf1 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:19:57.780514 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4140/8255] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:19:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:19:57.972076 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857e542-0637-465d-8316-b95889ff6cb5 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:19:57.973594 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4857e542-0637-465d-8316-b95889ff6cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:19:57.986905 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857e542-0637-465d-8316-b95889ff6cb5 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:19:57.991682 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ce74f-cf4b-48f0-9e27-988812ff2e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:19:57.992323 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ce74f-cf4b-48f0-9e27-988812ff2e8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:57.992608 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ce74f-cf4b-48f0-9e27-988812ff2e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:57.992879 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ce74f-cf4b-48f0-9e27-988812ff2e8b admin admin] PATH_INFO: `/v3/projects/3e13a8eb8ed14a7197c6acd8ddd1edf5` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:57.994004 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45ce74f-cf4b-48f0-9e27-988812ff2e8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e13a8eb8ed14a7197c6acd8ddd1edf5)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:19:57.996011 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45ce74f-cf4b-48f0-9e27-988812ff2e8b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:19:58.044418 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f45ce74f-cf4b-48f0-9e27-988812ff2e8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e13a8eb8ed14a7197c6acd8ddd1edf5', 'request_id': 'req-f45ce74f-cf4b-48f0-9e27-988812ff2e8b'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:19:58.049851 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f45ce74f-cf4b-48f0-9e27-988812ff2e8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e13a8eb8ed14a7197c6acd8ddd1edf5', 'request_id': 'req-f45ce74f-cf4b-48f0-9e27-988812ff2e8b'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:19:58.056499 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f45ce74f-cf4b-48f0-9e27-988812ff2e8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e13a8eb8ed14a7197c6acd8ddd1edf5', 'request_id': 'req-f45ce74f-cf4b-48f0-9e27-988812ff2e8b'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:19:58.068204 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f45ce74f-cf4b-48f0-9e27-988812ff2e8b admin admin] The token cache is being invalidate because project 3e13a8eb8ed14a7197c6acd8ddd1edf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:19:58.068492 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f45ce74f-cf4b-48f0-9e27-988812ff2e8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:19:58.069132 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f45ce74f-cf4b-48f0-9e27-988812ff2e8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:19:58.070635 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4116/8256] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:19:57 2022] DELETE /identity/v3/projects/3e13a8eb8ed14a7197c6acd8ddd1edf5 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:19:58.076079 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b875e-973b-470f-9cf1-4cac009591b8 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:58.076361 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b875e-973b-470f-9cf1-4cac009591b8 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:58.076634 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b875e-973b-470f-9cf1-4cac009591b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:58.097212 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-6e2b875e-973b-470f-9cf1-4cac009591b8 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:19:58.098343 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6e2b875e-973b-470f-9cf1-4cac009591b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:19:58.115476 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:19:58.159885 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4141/8257] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:19:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:19:58.167568 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc5e6e-31d9-4de2-a7ee-b49d6bfce267 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:58.167913 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc5e6e-31d9-4de2-a7ee-b49d6bfce267 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:58.168510 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc5e6e-31d9-4de2-a7ee-b49d6bfce267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:58.188201 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-3ddc5e6e-31d9-4de2-a7ee-b49d6bfce267 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:19:58.189394 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3ddc5e6e-31d9-4de2-a7ee-b49d6bfce267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:19:58.197215 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4117/8258] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:19:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:19:58.202442 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b875e-973b-470f-9cf1-4cac009591b8 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:19:58.212163 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b875e-973b-470f-9cf1-4cac009591b8 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:19:58.217868 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f69ad2a-6af1-49e3-aa6f-897f929e01e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:19:58.218467 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69ad2a-6af1-49e3-aa6f-897f929e01e0 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:58.218747 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69ad2a-6af1-49e3-aa6f-897f929e01e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:58.219045 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69ad2a-6af1-49e3-aa6f-897f929e01e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:58.219697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f69ad2a-6af1-49e3-aa6f-897f929e01e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:19:58.220002 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f69ad2a-6af1-49e3-aa6f-897f929e01e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:19:58.221601 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f69ad2a-6af1-49e3-aa6f-897f929e01e0 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:19:58.233768 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4142/8259] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:19:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:19:58.238136 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc5e6e-31d9-4de2-a7ee-b49d6bfce267 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:19:58.247615 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc5e6e-31d9-4de2-a7ee-b49d6bfce267 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:19:58.252458 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e9b2b-6f65-4614-82f4-f08408ca1231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:19:58.253187 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e9b2b-6f65-4614-82f4-f08408ca1231 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:58.253473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e9b2b-6f65-4614-82f4-f08408ca1231 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:58.253745 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e9b2b-6f65-4614-82f4-f08408ca1231 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:58.254421 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e9b2b-6f65-4614-82f4-f08408ca1231 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:19:58.256375 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e9b2b-6f65-4614-82f4-f08408ca1231 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:19:58.285139 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4118/8260] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:19:58 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:19:58.289367 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f69ad2a-6af1-49e3-aa6f-897f929e01e0 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:19:58.299430 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f69ad2a-6af1-49e3-aa6f-897f929e01e0 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:19:58.359271 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d498b-798b-4012-b84b-2c9206212e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:19:58.360435 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d498b-798b-4012-b84b-2c9206212e5a admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:58.360780 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d498b-798b-4012-b84b-2c9206212e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:58.361063 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d498b-798b-4012-b84b-2c9206212e5a admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:58.361732 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d498b-798b-4012-b84b-2c9206212e5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:19:58.363727 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d498b-798b-4012-b84b-2c9206212e5a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:19:58.390046 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4143/8261] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:19:58 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:19:58.391353 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e9b2b-6f65-4614-82f4-f08408ca1231 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:19:58.401634 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e9b2b-6f65-4614-82f4-f08408ca1231 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:19:58.408080 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e429bd-beda-4c4b-8a3a-79f0a8b8f50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:19:58.408746 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e429bd-beda-4c4b-8a3a-79f0a8b8f50f admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:58.409084 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e429bd-beda-4c4b-8a3a-79f0a8b8f50f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:58.409414 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e429bd-beda-4c4b-8a3a-79f0a8b8f50f admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:58.410137 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e429bd-beda-4c4b-8a3a-79f0a8b8f50f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:19:58.412181 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e429bd-beda-4c4b-8a3a-79f0a8b8f50f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:19:58.426349 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4119/8262] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:19:58.430732 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d498b-798b-4012-b84b-2c9206212e5a admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:19:58.443230 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d498b-798b-4012-b84b-2c9206212e5a admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:19:58.448979 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36520ee5-9147-485d-a77a-340fd4e7bd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:19:58.450277 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36520ee5-9147-485d-a77a-340fd4e7bd98 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:58.450638 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36520ee5-9147-485d-a77a-340fd4e7bd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:58.450997 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36520ee5-9147-485d-a77a-340fd4e7bd98 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:58.451687 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36520ee5-9147-485d-a77a-340fd4e7bd98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:19:58.453296 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36520ee5-9147-485d-a77a-340fd4e7bd98 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:19:58.467163 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4144/8263] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:19:58.470173 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e429bd-beda-4c4b-8a3a-79f0a8b8f50f admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:19:58.483478 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e429bd-beda-4c4b-8a3a-79f0a8b8f50f admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:19:58.488297 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d347b-74aa-4093-9dde-0d79f6b61f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:19:58.488966 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d347b-74aa-4093-9dde-0d79f6b61f1e admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:58.489250 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d347b-74aa-4093-9dde-0d79f6b61f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:58.489529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d347b-74aa-4093-9dde-0d79f6b61f1e admin admin] PATH_INFO: `/v3/projects/845b573b15584afc84ca42030004472b/users/569ae6d0888c457595c80f2a3b9f0a0f/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:58.507796 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226d347b-74aa-4093-9dde-0d79f6b61f1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=845b573b15584afc84ca42030004472b, user_id=569ae6d0888c457595c80f2a3b9f0a0f, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:19:58.510559 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226d347b-74aa-4093-9dde-0d79f6b61f1e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:19:58.526109 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4120/8264] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:19:58 2022] PUT /identity/v3/projects/845b573b15584afc84ca42030004472b/users/569ae6d0888c457595c80f2a3b9f0a0f/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:19:58.537209 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844ec73-7619-49e0-8139-eaaed6b40c20 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:58.537600 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844ec73-7619-49e0-8139-eaaed6b40c20 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:58.537946 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844ec73-7619-49e0-8139-eaaed6b40c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:58.572810 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-1844ec73-7619-49e0-8139-eaaed6b40c20 None None] MFA Rules not processed for user `569ae6d0888c457595c80f2a3b9f0a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:19:58.575186 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1844ec73-7619-49e0-8139-eaaed6b40c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:19:58.647938 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4145/8265] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:19:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:19:58.658863 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d347b-74aa-4093-9dde-0d79f6b61f1e admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:19:58.660627 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-226d347b-74aa-4093-9dde-0d79f6b61f1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:19:58.687173 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:19:58.731701 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d347b-74aa-4093-9dde-0d79f6b61f1e admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:19:58.735879 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c02b5-5e32-4b36-a864-4f9166845bb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:19:58.736520 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c02b5-5e32-4b36-a864-4f9166845bb3 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:58.736822 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c02b5-5e32-4b36-a864-4f9166845bb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:58.737090 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c02b5-5e32-4b36-a864-4f9166845bb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:58.750284 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149c02b5-5e32-4b36-a864-4f9166845bb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:19:58.751916 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149c02b5-5e32-4b36-a864-4f9166845bb3 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:19:58.763899 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4121/8266] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:19:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:19:58.777629 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1844ec73-7619-49e0-8139-eaaed6b40c20 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:19:58.798779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:19:58.850021 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1844ec73-7619-49e0-8139-eaaed6b40c20 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:19:58.854595 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8f7a3-c59f-42ee-b318-9f3b2ee1e58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:19:58.855412 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8f7a3-c59f-42ee-b318-9f3b2ee1e58a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:58.856214 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8f7a3-c59f-42ee-b318-9f3b2ee1e58a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:58.856524 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8f7a3-c59f-42ee-b318-9f3b2ee1e58a admin admin] PATH_INFO: `/v3/users/569ae6d0888c457595c80f2a3b9f0a0f` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:58.857748 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa8f7a3-c59f-42ee-b318-9f3b2ee1e58a admin admin] RBAC: Authorizing `identity:delete_user(user_id=569ae6d0888c457595c80f2a3b9f0a0f)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:19:58.859828 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa8f7a3-c59f-42ee-b318-9f3b2ee1e58a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:19:58.910293 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8aa8f7a3-c59f-42ee-b318-9f3b2ee1e58a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '569ae6d0888c457595c80f2a3b9f0a0f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:19:58.910886 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8aa8f7a3-c59f-42ee-b318-9f3b2ee1e58a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '569ae6d0888c457595c80f2a3b9f0a0f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:19:58.920010 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8aa8f7a3-c59f-42ee-b318-9f3b2ee1e58a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '569ae6d0888c457595c80f2a3b9f0a0f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:19:58.927516 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8aa8f7a3-c59f-42ee-b318-9f3b2ee1e58a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '569ae6d0888c457595c80f2a3b9f0a0f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:19:58.928254 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8aa8f7a3-c59f-42ee-b318-9f3b2ee1e58a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '569ae6d0888c457595c80f2a3b9f0a0f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:19:58.947728 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4146/8267] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:19:58 2022] DELETE /identity/v3/users/569ae6d0888c457595c80f2a3b9f0a0f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:19:58.952450 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273623c-57bc-4f60-98a4-29ef8d4e6c5b None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:58.952825 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273623c-57bc-4f60-98a4-29ef8d4e6c5b None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:58.953105 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273623c-57bc-4f60-98a4-29ef8d4e6c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:58.973673 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-b273623c-57bc-4f60-98a4-29ef8d4e6c5b None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:19:58.974976 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b273623c-57bc-4f60-98a4-29ef8d4e6c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:19:59.038040 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4122/8268] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:19:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:19:59.049282 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8f7a3-c59f-42ee-b318-9f3b2ee1e58a admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:19:59.050798 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8aa8f7a3-c59f-42ee-b318-9f3b2ee1e58a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:19:59.117271 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8f7a3-c59f-42ee-b318-9f3b2ee1e58a admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:19:59.122171 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878dc732-3172-4e19-9e03-8680e49e2826 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:19:59.122768 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878dc732-3172-4e19-9e03-8680e49e2826 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:59.123073 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878dc732-3172-4e19-9e03-8680e49e2826 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:59.123346 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878dc732-3172-4e19-9e03-8680e49e2826 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:59.133303 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878dc732-3172-4e19-9e03-8680e49e2826 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:19:59.134755 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878dc732-3172-4e19-9e03-8680e49e2826 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:19:59.146856 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4147/8269] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:19:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:19:59.497106 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273623c-57bc-4f60-98a4-29ef8d4e6c5b None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:19:59.498570 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b273623c-57bc-4f60-98a4-29ef8d4e6c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:19:59.517845 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273623c-57bc-4f60-98a4-29ef8d4e6c5b None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:19:59.523079 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d5de1-7297-4ac0-b4bc-22decc306a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:19:59.523740 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d5de1-7297-4ac0-b4bc-22decc306a1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:59.524022 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d5de1-7297-4ac0-b4bc-22decc306a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:59.524292 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d5de1-7297-4ac0-b4bc-22decc306a1c admin admin] PATH_INFO: `/v3/projects/845b573b15584afc84ca42030004472b` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:59.525441 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d5de1-7297-4ac0-b4bc-22decc306a1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=845b573b15584afc84ca42030004472b)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:19:59.527590 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d5de1-7297-4ac0-b4bc-22decc306a1c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:19:59.578784 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ef7d5de1-7297-4ac0-b4bc-22decc306a1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '845b573b15584afc84ca42030004472b', 'request_id': 'req-ef7d5de1-7297-4ac0-b4bc-22decc306a1c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:19:59.584345 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ef7d5de1-7297-4ac0-b4bc-22decc306a1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '845b573b15584afc84ca42030004472b', 'request_id': 'req-ef7d5de1-7297-4ac0-b4bc-22decc306a1c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:19:59.592011 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ef7d5de1-7297-4ac0-b4bc-22decc306a1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '845b573b15584afc84ca42030004472b', 'request_id': 'req-ef7d5de1-7297-4ac0-b4bc-22decc306a1c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:19:59.605957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ef7d5de1-7297-4ac0-b4bc-22decc306a1c admin admin] The token cache is being invalidate because project 845b573b15584afc84ca42030004472b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:19:59.606509 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ef7d5de1-7297-4ac0-b4bc-22decc306a1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:19:59.607336 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ef7d5de1-7297-4ac0-b4bc-22decc306a1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:19:59.609062 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4123/8270] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:19:59 2022] DELETE /identity/v3/projects/845b573b15584afc84ca42030004472b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:19:59.613879 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230be407-7d13-4fab-ba7f-1c62a8be1e73 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:59.614359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230be407-7d13-4fab-ba7f-1c62a8be1e73 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:59.614539 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230be407-7d13-4fab-ba7f-1c62a8be1e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:59.636358 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-230be407-7d13-4fab-ba7f-1c62a8be1e73 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:19:59.638361 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-230be407-7d13-4fab-ba7f-1c62a8be1e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:19:59.682421 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:19:59.714291 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4148/8271] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:19:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:19:59.722296 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f1b8b-e4d8-4ca1-a37d-25c1205a399b None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:59.722677 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f1b8b-e4d8-4ca1-a37d-25c1205a399b None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:59.723032 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f1b8b-e4d8-4ca1-a37d-25c1205a399b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:59.745222 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-879f1b8b-e4d8-4ca1-a37d-25c1205a399b None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:19:59.747079 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-879f1b8b-e4d8-4ca1-a37d-25c1205a399b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:19:59.756096 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4124/8272] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:19:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:19:59.760304 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230be407-7d13-4fab-ba7f-1c62a8be1e73 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:19:59.771594 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230be407-7d13-4fab-ba7f-1c62a8be1e73 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:19:59.776522 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02b696-00ff-455e-a3a8-faa0e19c669d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:19:59.777446 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02b696-00ff-455e-a3a8-faa0e19c669d admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:59.777947 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02b696-00ff-455e-a3a8-faa0e19c669d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:59.778413 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02b696-00ff-455e-a3a8-faa0e19c669d admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:59.779193 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf02b696-00ff-455e-a3a8-faa0e19c669d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:19:59.779564 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf02b696-00ff-455e-a3a8-faa0e19c669d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:19:59.781545 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf02b696-00ff-455e-a3a8-faa0e19c669d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:19:59.797156 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4149/8273] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:19:59.801509 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f1b8b-e4d8-4ca1-a37d-25c1205a399b None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:19:59.813623 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f1b8b-e4d8-4ca1-a37d-25c1205a399b None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:19:59.819885 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d532f-7416-4ba0-bd24-c34abf0aeb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:19:59.820610 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d532f-7416-4ba0-bd24-c34abf0aeb6d admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:59.820957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d532f-7416-4ba0-bd24-c34abf0aeb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:59.821300 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d532f-7416-4ba0-bd24-c34abf0aeb6d admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:59.822054 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0d532f-7416-4ba0-bd24-c34abf0aeb6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:19:59.824108 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0d532f-7416-4ba0-bd24-c34abf0aeb6d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:19:59.859807 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4125/8274] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:19:59 2022] POST /identity/v3/projects => generated 371 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:19:59.863835 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02b696-00ff-455e-a3a8-faa0e19c669d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:19:59.884639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02b696-00ff-455e-a3a8-faa0e19c669d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:19:59.948133 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297a50b-b4b1-40ee-ade7-b895216e15f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:19:59.948750 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297a50b-b4b1-40ee-ade7-b895216e15f5 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:59.949027 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297a50b-b4b1-40ee-ade7-b895216e15f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:59.949977 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297a50b-b4b1-40ee-ade7-b895216e15f5 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:59.950713 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6297a50b-b4b1-40ee-ade7-b895216e15f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:19:59.952710 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6297a50b-b4b1-40ee-ade7-b895216e15f5 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:19:59.976417 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4150/8275] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:19:59 2022] POST /identity/v3/users => generated 286 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:19:59.980862 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d532f-7416-4ba0-bd24-c34abf0aeb6d admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:19:59.992365 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d532f-7416-4ba0-bd24-c34abf0aeb6d admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:19:59.998205 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e6f14-3e14-4942-a5a7-53d04faf9e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:19:59.998823 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e6f14-3e14-4942-a5a7-53d04faf9e60 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:59.999135 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e6f14-3e14-4942-a5a7-53d04faf9e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:59.999406 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e6f14-3e14-4942-a5a7-53d04faf9e60 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:00.000050 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232e6f14-3e14-4942-a5a7-53d04faf9e60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:00.001652 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232e6f14-3e14-4942-a5a7-53d04faf9e60 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:00.012529 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4126/8276] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:20:00.016647 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297a50b-b4b1-40ee-ade7-b895216e15f5 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:00.026541 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297a50b-b4b1-40ee-ade7-b895216e15f5 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:00.031454 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b80e237-b260-49fb-be31-6e31839e7287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:00.032048 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80e237-b260-49fb-be31-6e31839e7287 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:00.032322 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80e237-b260-49fb-be31-6e31839e7287 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:00.032590 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80e237-b260-49fb-be31-6e31839e7287 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:00.033221 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b80e237-b260-49fb-be31-6e31839e7287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:00.034803 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b80e237-b260-49fb-be31-6e31839e7287 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:00.051131 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4151/8277] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:20:00.055604 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e6f14-3e14-4942-a5a7-53d04faf9e60 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:00.067998 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e6f14-3e14-4942-a5a7-53d04faf9e60 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:00.072984 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44301b8-3c57-48c5-a079-882bf5db013a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:00.073675 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44301b8-3c57-48c5-a079-882bf5db013a admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:00.073978 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44301b8-3c57-48c5-a079-882bf5db013a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:00.074881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44301b8-3c57-48c5-a079-882bf5db013a admin admin] PATH_INFO: `/v3/projects/1879494586a741e7ae96f7286ec14e7c/users/8add6dc01da24eefba8cd77ef16ae26d/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:00.077534 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:00.099456 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44301b8-3c57-48c5-a079-882bf5db013a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1879494586a741e7ae96f7286ec14e7c, user_id=8add6dc01da24eefba8cd77ef16ae26d, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:00.101781 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44301b8-3c57-48c5-a079-882bf5db013a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:00.117042 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4127/8278] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:20:00 2022] PUT /identity/v3/projects/1879494586a741e7ae96f7286ec14e7c/users/8add6dc01da24eefba8cd77ef16ae26d/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:20:00.127545 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95016e-d9c9-445a-aaa6-41f0e3079fd2 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:00.127813 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95016e-d9c9-445a-aaa6-41f0e3079fd2 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:00.128084 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95016e-d9c9-445a-aaa6-41f0e3079fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:00.158090 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-ed95016e-d9c9-445a-aaa6-41f0e3079fd2 None None] MFA Rules not processed for user `8add6dc01da24eefba8cd77ef16ae26d`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:00.159478 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ed95016e-d9c9-445a-aaa6-41f0e3079fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:00.231375 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4152/8279] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:20:00.235757 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44301b8-3c57-48c5-a079-882bf5db013a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:00.303642 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44301b8-3c57-48c5-a079-882bf5db013a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:00.309027 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452cd2c3-f090-497d-89c8-547985e6fe0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:00.309659 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452cd2c3-f090-497d-89c8-547985e6fe0f admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:00.310056 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452cd2c3-f090-497d-89c8-547985e6fe0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:00.310219 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452cd2c3-f090-497d-89c8-547985e6fe0f admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:00.310858 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452cd2c3-f090-497d-89c8-547985e6fe0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:00.312845 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452cd2c3-f090-497d-89c8-547985e6fe0f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:00.341995 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4128/8280] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:20:00 2022] POST /identity/v3/projects => generated 371 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:20:00.346230 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed95016e-d9c9-445a-aaa6-41f0e3079fd2 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:00.357996 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed95016e-d9c9-445a-aaa6-41f0e3079fd2 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:00.391796 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:00.417895 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e30e08-2e97-4a80-9b4a-725e94c488d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:00.419238 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e30e08-2e97-4a80-9b4a-725e94c488d5 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:00.419958 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e30e08-2e97-4a80-9b4a-725e94c488d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:00.419958 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e30e08-2e97-4a80-9b4a-725e94c488d5 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:00.420550 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e30e08-2e97-4a80-9b4a-725e94c488d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:00.422518 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e30e08-2e97-4a80-9b4a-725e94c488d5 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:00.449072 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4153/8281] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:20:00 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:20:00.450392 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452cd2c3-f090-497d-89c8-547985e6fe0f admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:00.461339 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452cd2c3-f090-497d-89c8-547985e6fe0f admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:00.466075 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103fb350-580a-4283-b062-cbaeece95133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:00.466676 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103fb350-580a-4283-b062-cbaeece95133 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:00.466958 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103fb350-580a-4283-b062-cbaeece95133 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:00.467260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103fb350-580a-4283-b062-cbaeece95133 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:00.467914 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103fb350-580a-4283-b062-cbaeece95133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:00.469521 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103fb350-580a-4283-b062-cbaeece95133 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:00.482225 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4129/8282] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:20:00.487292 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e30e08-2e97-4a80-9b4a-725e94c488d5 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:00.498174 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e30e08-2e97-4a80-9b4a-725e94c488d5 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:00.502778 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf34a96-fc28-4306-856b-1e02d5976f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:00.503467 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf34a96-fc28-4306-856b-1e02d5976f70 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:00.503743 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf34a96-fc28-4306-856b-1e02d5976f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:00.504014 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf34a96-fc28-4306-856b-1e02d5976f70 admin admin] PATH_INFO: `/v3/projects/7031eee936ed4439be60ede7b800eaf6/users/7cb327f316e941ada7d545c302a91042/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:00.518629 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf34a96-fc28-4306-856b-1e02d5976f70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7031eee936ed4439be60ede7b800eaf6, user_id=7cb327f316e941ada7d545c302a91042, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:00.521336 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf34a96-fc28-4306-856b-1e02d5976f70 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:00.534132 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4154/8283] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:20:00 2022] PUT /identity/v3/projects/7031eee936ed4439be60ede7b800eaf6/users/7cb327f316e941ada7d545c302a91042/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:20:00.538068 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103fb350-580a-4283-b062-cbaeece95133 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:00.548976 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103fb350-580a-4283-b062-cbaeece95133 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:00.608375 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc8b06-932c-4077-a9f5-3be11f791fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:00.608989 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc8b06-932c-4077-a9f5-3be11f791fba admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:00.609269 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc8b06-932c-4077-a9f5-3be11f791fba admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:00.609547 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc8b06-932c-4077-a9f5-3be11f791fba admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:00.610189 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abc8b06-932c-4077-a9f5-3be11f791fba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:00.611827 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abc8b06-932c-4077-a9f5-3be11f791fba admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:00.621866 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4130/8284] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:20:00.626034 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf34a96-fc28-4306-856b-1e02d5976f70 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:00.637395 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf34a96-fc28-4306-856b-1e02d5976f70 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:00.642351 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56422f8-fa16-4f14-bb76-3ff593b6b500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:00.643011 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56422f8-fa16-4f14-bb76-3ff593b6b500 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:00.643327 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56422f8-fa16-4f14-bb76-3ff593b6b500 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:00.643596 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56422f8-fa16-4f14-bb76-3ff593b6b500 admin admin] PATH_INFO: `/v3/projects/7031eee936ed4439be60ede7b800eaf6/users/7cb327f316e941ada7d545c302a91042/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:00.645545 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56422f8-fa16-4f14-bb76-3ff593b6b500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7031eee936ed4439be60ede7b800eaf6, user_id=7cb327f316e941ada7d545c302a91042, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:00.648542 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56422f8-fa16-4f14-bb76-3ff593b6b500 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:00.662565 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4155/8285] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:20:00 2022] PUT /identity/v3/projects/7031eee936ed4439be60ede7b800eaf6/users/7cb327f316e941ada7d545c302a91042/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:20:00.763167 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678e8d5-132b-4477-9ac6-d5a944ec66ca None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:00.763542 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678e8d5-132b-4477-9ac6-d5a944ec66ca None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:00.764077 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678e8d5-132b-4477-9ac6-d5a944ec66ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:00.798632 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-9678e8d5-132b-4477-9ac6-d5a944ec66ca None None] MFA Rules not processed for user `7cb327f316e941ada7d545c302a91042`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:00.798632 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9678e8d5-132b-4477-9ac6-d5a944ec66ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:00.843011 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:00.874930 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4131/8286] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:00 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:20:00.886459 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56422f8-fa16-4f14-bb76-3ff593b6b500 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:00.888206 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f56422f8-fa16-4f14-bb76-3ff593b6b500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:00.953692 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56422f8-fa16-4f14-bb76-3ff593b6b500 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:00.957331 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8a49c2-17cb-4962-bc93-ce6c44715c49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:00.957941 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a49c2-17cb-4962-bc93-ce6c44715c49 service cinder] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:00.958217 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a49c2-17cb-4962-bc93-ce6c44715c49 service cinder] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:00.958484 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a49c2-17cb-4962-bc93-ce6c44715c49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:00.970908 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8a49c2-17cb-4962-bc93-ce6c44715c49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:00.972400 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8a49c2-17cb-4962-bc93-ce6c44715c49 service cinder] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:00.982909 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4156/8287] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:20:00 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:20:01.397471 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678e8d5-132b-4477-9ac6-d5a944ec66ca None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:01.464792 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678e8d5-132b-4477-9ac6-d5a944ec66ca None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:01.470721 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09678f77-2c52-483c-a26e-e92d4a69f68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:01.471557 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09678f77-2c52-483c-a26e-e92d4a69f68c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:01.471956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09678f77-2c52-483c-a26e-e92d4a69f68c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:01.472343 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09678f77-2c52-483c-a26e-e92d4a69f68c admin admin] PATH_INFO: `/v3/users/8add6dc01da24eefba8cd77ef16ae26d` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:01.473810 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09678f77-2c52-483c-a26e-e92d4a69f68c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8add6dc01da24eefba8cd77ef16ae26d)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:01.475848 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09678f77-2c52-483c-a26e-e92d4a69f68c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:01.532580 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-09678f77-2c52-483c-a26e-e92d4a69f68c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8add6dc01da24eefba8cd77ef16ae26d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:01.533252 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-09678f77-2c52-483c-a26e-e92d4a69f68c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8add6dc01da24eefba8cd77ef16ae26d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:01.546233 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-09678f77-2c52-483c-a26e-e92d4a69f68c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8add6dc01da24eefba8cd77ef16ae26d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:01.554645 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-09678f77-2c52-483c-a26e-e92d4a69f68c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8add6dc01da24eefba8cd77ef16ae26d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:01.564210 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-09678f77-2c52-483c-a26e-e92d4a69f68c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8add6dc01da24eefba8cd77ef16ae26d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:01.570334 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4132/8288] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:20:01 2022] DELETE /identity/v3/users/8add6dc01da24eefba8cd77ef16ae26d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:20:01.575990 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba47586-1952-4d9b-a3ff-a238a7ecf2f2 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:01.576317 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba47586-1952-4d9b-a3ff-a238a7ecf2f2 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:01.576725 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba47586-1952-4d9b-a3ff-a238a7ecf2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:01.597331 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-dba47586-1952-4d9b-a3ff-a238a7ecf2f2 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:01.598518 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-dba47586-1952-4d9b-a3ff-a238a7ecf2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:01.660172 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4157/8289] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:20:01.672159 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09678f77-2c52-483c-a26e-e92d4a69f68c admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:01.673677 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-09678f77-2c52-483c-a26e-e92d4a69f68c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:01.740914 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09678f77-2c52-483c-a26e-e92d4a69f68c admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:01.750068 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fcd5bc-62aa-454b-9c64-5fc0ddde8dd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:01.750697 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcd5bc-62aa-454b-9c64-5fc0ddde8dd6 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:01.751015 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcd5bc-62aa-454b-9c64-5fc0ddde8dd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:01.751336 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcd5bc-62aa-454b-9c64-5fc0ddde8dd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:01.761666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fcd5bc-62aa-454b-9c64-5fc0ddde8dd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:01.764132 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fcd5bc-62aa-454b-9c64-5fc0ddde8dd6 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:01.769935 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:01.785010 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4133/8290] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:20:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:20:02.064452 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba47586-1952-4d9b-a3ff-a238a7ecf2f2 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:02.066218 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-dba47586-1952-4d9b-a3ff-a238a7ecf2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:02.088804 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba47586-1952-4d9b-a3ff-a238a7ecf2f2 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:02.095637 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a2375a-ef0d-4796-ba51-9f9a10683026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:02.096286 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2375a-ef0d-4796-ba51-9f9a10683026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:02.096585 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2375a-ef0d-4796-ba51-9f9a10683026 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:02.096814 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2375a-ef0d-4796-ba51-9f9a10683026 admin admin] PATH_INFO: `/v3/projects/1879494586a741e7ae96f7286ec14e7c` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:02.098004 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a2375a-ef0d-4796-ba51-9f9a10683026 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1879494586a741e7ae96f7286ec14e7c)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:02.099872 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a2375a-ef0d-4796-ba51-9f9a10683026 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:02.136277 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:02.156188 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d5a2375a-ef0d-4796-ba51-9f9a10683026 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1879494586a741e7ae96f7286ec14e7c', 'request_id': 'req-d5a2375a-ef0d-4796-ba51-9f9a10683026'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:02.161940 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d5a2375a-ef0d-4796-ba51-9f9a10683026 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1879494586a741e7ae96f7286ec14e7c', 'request_id': 'req-d5a2375a-ef0d-4796-ba51-9f9a10683026'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:02.169054 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d5a2375a-ef0d-4796-ba51-9f9a10683026 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1879494586a741e7ae96f7286ec14e7c', 'request_id': 'req-d5a2375a-ef0d-4796-ba51-9f9a10683026'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:02.182191 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d5a2375a-ef0d-4796-ba51-9f9a10683026 admin admin] The token cache is being invalidate because project 1879494586a741e7ae96f7286ec14e7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:20:02.182482 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d5a2375a-ef0d-4796-ba51-9f9a10683026 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:02.183560 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d5a2375a-ef0d-4796-ba51-9f9a10683026 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:02.186038 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4158/8291] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:20:02 2022] DELETE /identity/v3/projects/1879494586a741e7ae96f7286ec14e7c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:20:02.189854 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fcd5bc-62aa-454b-9c64-5fc0ddde8dd6 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:02.200558 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fcd5bc-62aa-454b-9c64-5fc0ddde8dd6 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:02.267995 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d34766-7f8c-406b-b2ed-befb57cb9851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:02.268834 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d34766-7f8c-406b-b2ed-befb57cb9851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:02.269217 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d34766-7f8c-406b-b2ed-befb57cb9851 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:02.269606 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d34766-7f8c-406b-b2ed-befb57cb9851 admin admin] PATH_INFO: `/v3/users/7cb327f316e941ada7d545c302a91042` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:02.270803 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d34766-7f8c-406b-b2ed-befb57cb9851 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cb327f316e941ada7d545c302a91042)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:02.272847 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d34766-7f8c-406b-b2ed-befb57cb9851 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:02.331065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-33d34766-7f8c-406b-b2ed-befb57cb9851 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cb327f316e941ada7d545c302a91042'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:02.331734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-33d34766-7f8c-406b-b2ed-befb57cb9851 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cb327f316e941ada7d545c302a91042'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:02.348613 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-33d34766-7f8c-406b-b2ed-befb57cb9851 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cb327f316e941ada7d545c302a91042'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:02.357011 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-33d34766-7f8c-406b-b2ed-befb57cb9851 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cb327f316e941ada7d545c302a91042'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:02.365278 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-33d34766-7f8c-406b-b2ed-befb57cb9851 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cb327f316e941ada7d545c302a91042'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:02.371589 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4134/8292] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:20:02 2022] DELETE /identity/v3/users/7cb327f316e941ada7d545c302a91042 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:20:02.671950 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a2375a-ef0d-4796-ba51-9f9a10683026 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:02.673517 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d5a2375a-ef0d-4796-ba51-9f9a10683026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:02.693445 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a2375a-ef0d-4796-ba51-9f9a10683026 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:02.760702 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc4fb8-f9c7-438a-861f-088c97658c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:02.761340 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc4fb8-f9c7-438a-861f-088c97658c3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:02.761620 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc4fb8-f9c7-438a-861f-088c97658c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:02.761892 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc4fb8-f9c7-438a-861f-088c97658c3a admin admin] PATH_INFO: `/v3/projects/7031eee936ed4439be60ede7b800eaf6` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:02.763135 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc4fb8-f9c7-438a-861f-088c97658c3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7031eee936ed4439be60ede7b800eaf6)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:02.765166 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc4fb8-f9c7-438a-861f-088c97658c3a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:02.812417 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-dbfc4fb8-f9c7-438a-861f-088c97658c3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7031eee936ed4439be60ede7b800eaf6', 'request_id': 'req-dbfc4fb8-f9c7-438a-861f-088c97658c3a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:02.817731 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-dbfc4fb8-f9c7-438a-861f-088c97658c3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7031eee936ed4439be60ede7b800eaf6', 'request_id': 'req-dbfc4fb8-f9c7-438a-861f-088c97658c3a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:02.823764 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-dbfc4fb8-f9c7-438a-861f-088c97658c3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7031eee936ed4439be60ede7b800eaf6', 'request_id': 'req-dbfc4fb8-f9c7-438a-861f-088c97658c3a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:02.836767 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-dbfc4fb8-f9c7-438a-861f-088c97658c3a admin admin] The token cache is being invalidate because project 7031eee936ed4439be60ede7b800eaf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:20:02.837131 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-dbfc4fb8-f9c7-438a-861f-088c97658c3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:02.837788 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-dbfc4fb8-f9c7-438a-861f-088c97658c3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:02.839363 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4159/8293] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:20:02 2022] DELETE /identity/v3/projects/7031eee936ed4439be60ede7b800eaf6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:20:02.844586 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad0ff5-3ccb-452c-aa2a-d7db890b5cb2 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:02.845057 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad0ff5-3ccb-452c-aa2a-d7db890b5cb2 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:02.845162 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad0ff5-3ccb-452c-aa2a-d7db890b5cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:02.865224 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-d8ad0ff5-3ccb-452c-aa2a-d7db890b5cb2 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:02.866435 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d8ad0ff5-3ccb-452c-aa2a-d7db890b5cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:02.927597 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4135/8294] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:20:02.936518 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a544a-c347-4be2-81ab-83bbf1b2c896 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:02.936801 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a544a-c347-4be2-81ab-83bbf1b2c896 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:02.937075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a544a-c347-4be2-81ab-83bbf1b2c896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:02.956725 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-d91a544a-c347-4be2-81ab-83bbf1b2c896 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:02.957913 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d91a544a-c347-4be2-81ab-83bbf1b2c896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:02.967099 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4160/8295] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:20:02.971552 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad0ff5-3ccb-452c-aa2a-d7db890b5cb2 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:02.982547 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad0ff5-3ccb-452c-aa2a-d7db890b5cb2 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:02.987256 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605699a7-048f-44e3-9b0f-11d886b3b5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:02.987865 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605699a7-048f-44e3-9b0f-11d886b3b5e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:02.988145 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605699a7-048f-44e3-9b0f-11d886b3b5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:02.988419 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605699a7-048f-44e3-9b0f-11d886b3b5e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:02.989071 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605699a7-048f-44e3-9b0f-11d886b3b5e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:20:02.989375 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605699a7-048f-44e3-9b0f-11d886b3b5e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:02.990986 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605699a7-048f-44e3-9b0f-11d886b3b5e6 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:03.002746 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4136/8296] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:20:03.007262 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a544a-c347-4be2-81ab-83bbf1b2c896 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:03.016509 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a544a-c347-4be2-81ab-83bbf1b2c896 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:03.021198 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a0f86-eeba-42aa-97de-3cfa98c73a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:03.021818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a0f86-eeba-42aa-97de-3cfa98c73a35 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:03.022080 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a0f86-eeba-42aa-97de-3cfa98c73a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:03.022353 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a0f86-eeba-42aa-97de-3cfa98c73a35 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:03.022988 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747a0f86-eeba-42aa-97de-3cfa98c73a35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:03.024919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747a0f86-eeba-42aa-97de-3cfa98c73a35 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:03.053541 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4161/8297] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:20:03 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:20:03.058062 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605699a7-048f-44e3-9b0f-11d886b3b5e6 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:03.068498 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605699a7-048f-44e3-9b0f-11d886b3b5e6 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:03.072042 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:03.128694 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5bd0a-ef41-4169-b837-9a9cee0566cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:03.129298 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5bd0a-ef41-4169-b837-9a9cee0566cc admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:03.129572 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5bd0a-ef41-4169-b837-9a9cee0566cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:03.129836 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5bd0a-ef41-4169-b837-9a9cee0566cc admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:03.130493 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb5bd0a-ef41-4169-b837-9a9cee0566cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:03.132865 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb5bd0a-ef41-4169-b837-9a9cee0566cc admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:03.154441 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4137/8298] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:20:03 2022] POST /identity/v3/users => generated 283 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:20:03.158690 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a0f86-eeba-42aa-97de-3cfa98c73a35 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:03.169704 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a0f86-eeba-42aa-97de-3cfa98c73a35 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:03.174387 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27bc627-a782-4fde-a312-3584470c68de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:03.174985 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27bc627-a782-4fde-a312-3584470c68de admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:03.175293 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27bc627-a782-4fde-a312-3584470c68de admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:03.175560 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27bc627-a782-4fde-a312-3584470c68de admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:03.176198 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27bc627-a782-4fde-a312-3584470c68de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:03.177775 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27bc627-a782-4fde-a312-3584470c68de admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:03.188192 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4162/8299] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:20:03.192405 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5bd0a-ef41-4169-b837-9a9cee0566cc admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:03.202795 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5bd0a-ef41-4169-b837-9a9cee0566cc admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:03.207703 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74436084-7735-40aa-a2b0-15490aec75b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:03.208272 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74436084-7735-40aa-a2b0-15490aec75b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:03.208572 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74436084-7735-40aa-a2b0-15490aec75b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:03.208812 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74436084-7735-40aa-a2b0-15490aec75b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:03.209455 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74436084-7735-40aa-a2b0-15490aec75b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:03.211123 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74436084-7735-40aa-a2b0-15490aec75b2 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:03.227821 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4138/8300] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:20:03.228810 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27bc627-a782-4fde-a312-3584470c68de admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:03.236549 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:03.240747 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27bc627-a782-4fde-a312-3584470c68de admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:03.247825 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747acbab-44a0-402f-b84f-cf798d5b74ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:03.248496 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747acbab-44a0-402f-b84f-cf798d5b74ed admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:03.249052 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747acbab-44a0-402f-b84f-cf798d5b74ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:03.249546 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747acbab-44a0-402f-b84f-cf798d5b74ed admin admin] PATH_INFO: `/v3/projects/786b021bd90e42dd8f5299b5410ab025/users/4f05eb0b85c24c368fd2737712d7262d/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:03.265625 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747acbab-44a0-402f-b84f-cf798d5b74ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=786b021bd90e42dd8f5299b5410ab025, user_id=4f05eb0b85c24c368fd2737712d7262d, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:03.268395 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747acbab-44a0-402f-b84f-cf798d5b74ed admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:03.287107 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4163/8301] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:20:03 2022] PUT /identity/v3/projects/786b021bd90e42dd8f5299b5410ab025/users/4f05eb0b85c24c368fd2737712d7262d/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:20:03.297264 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e8880-d759-4b1d-a17e-49836b47a73d None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:03.297549 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e8880-d759-4b1d-a17e-49836b47a73d None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:03.297821 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e8880-d759-4b1d-a17e-49836b47a73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:03.337844 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-eb9e8880-d759-4b1d-a17e-49836b47a73d None None] MFA Rules not processed for user `4f05eb0b85c24c368fd2737712d7262d`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:03.339115 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-eb9e8880-d759-4b1d-a17e-49836b47a73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:03.414852 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4139/8302] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:20:03.419789 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747acbab-44a0-402f-b84f-cf798d5b74ed admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:03.483251 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747acbab-44a0-402f-b84f-cf798d5b74ed admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:03.488025 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73521f6d-8361-477a-a27b-9d67881c5f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:03.488630 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73521f6d-8361-477a-a27b-9d67881c5f14 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:03.488905 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73521f6d-8361-477a-a27b-9d67881c5f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:03.489181 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73521f6d-8361-477a-a27b-9d67881c5f14 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:03.489803 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73521f6d-8361-477a-a27b-9d67881c5f14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:03.491746 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73521f6d-8361-477a-a27b-9d67881c5f14 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:03.522879 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4164/8303] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:20:03 2022] POST /identity/v3/projects => generated 363 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:20:03.524113 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e8880-d759-4b1d-a17e-49836b47a73d None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:03.535943 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e8880-d759-4b1d-a17e-49836b47a73d None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:03.595653 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb4fc3-f61a-4fcc-adea-cf0f61de48d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:03.596180 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb4fc3-f61a-4fcc-adea-cf0f61de48d5 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:03.596464 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb4fc3-f61a-4fcc-adea-cf0f61de48d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:03.596724 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb4fc3-f61a-4fcc-adea-cf0f61de48d5 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:03.597368 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb4fc3-f61a-4fcc-adea-cf0f61de48d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:03.599314 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb4fc3-f61a-4fcc-adea-cf0f61de48d5 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:03.620889 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4140/8304] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:20:03 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:20:03.625031 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73521f6d-8361-477a-a27b-9d67881c5f14 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:03.635701 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73521f6d-8361-477a-a27b-9d67881c5f14 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:03.641291 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8337c305-b40c-4c1b-a1f0-1dc47e068ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:03.641896 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8337c305-b40c-4c1b-a1f0-1dc47e068ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:03.642191 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8337c305-b40c-4c1b-a1f0-1dc47e068ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:03.642449 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8337c305-b40c-4c1b-a1f0-1dc47e068ac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:03.643118 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8337c305-b40c-4c1b-a1f0-1dc47e068ac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:03.644723 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8337c305-b40c-4c1b-a1f0-1dc47e068ac2 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:03.656433 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4165/8305] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:20:03.660775 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb4fc3-f61a-4fcc-adea-cf0f61de48d5 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:03.667209 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:03.671954 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb4fc3-f61a-4fcc-adea-cf0f61de48d5 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:03.677543 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344fd29-4794-4627-9923-737b1146b462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:03.678230 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344fd29-4794-4627-9923-737b1146b462 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:03.678512 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344fd29-4794-4627-9923-737b1146b462 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:03.678790 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344fd29-4794-4627-9923-737b1146b462 admin admin] PATH_INFO: `/v3/projects/fe9dd91a827549fc982f3133eb912b29/users/964277045ffe4db19b89458459c250f1/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:03.694829 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344fd29-4794-4627-9923-737b1146b462 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe9dd91a827549fc982f3133eb912b29, user_id=964277045ffe4db19b89458459c250f1, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:03.697531 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344fd29-4794-4627-9923-737b1146b462 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:03.715849 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4141/8306] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:20:03 2022] PUT /identity/v3/projects/fe9dd91a827549fc982f3133eb912b29/users/964277045ffe4db19b89458459c250f1/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:20:03.720127 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8337c305-b40c-4c1b-a1f0-1dc47e068ac2 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:03.730283 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8337c305-b40c-4c1b-a1f0-1dc47e068ac2 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:03.787385 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eeda63-30ab-4502-bd89-d79219d12b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:03.788001 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eeda63-30ab-4502-bd89-d79219d12b3c admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:03.788278 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eeda63-30ab-4502-bd89-d79219d12b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:03.788550 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eeda63-30ab-4502-bd89-d79219d12b3c admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:03.789186 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eeda63-30ab-4502-bd89-d79219d12b3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:03.790781 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eeda63-30ab-4502-bd89-d79219d12b3c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:03.801469 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4166/8307] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:20:03.805710 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344fd29-4794-4627-9923-737b1146b462 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:03.817813 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344fd29-4794-4627-9923-737b1146b462 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:03.822494 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc3d76-15ca-480a-8a67-7e7161a6c4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:03.823203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc3d76-15ca-480a-8a67-7e7161a6c4d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:03.823483 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc3d76-15ca-480a-8a67-7e7161a6c4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:03.823755 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc3d76-15ca-480a-8a67-7e7161a6c4d5 admin admin] PATH_INFO: `/v3/projects/fe9dd91a827549fc982f3133eb912b29/users/964277045ffe4db19b89458459c250f1/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:03.826625 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc3d76-15ca-480a-8a67-7e7161a6c4d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe9dd91a827549fc982f3133eb912b29, user_id=964277045ffe4db19b89458459c250f1, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:03.829326 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc3d76-15ca-480a-8a67-7e7161a6c4d5 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:03.839452 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4142/8308] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:20:03 2022] PUT /identity/v3/projects/fe9dd91a827549fc982f3133eb912b29/users/964277045ffe4db19b89458459c250f1/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:20:03.849592 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd556f-e352-48dc-ab00-45f716b2bec8 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:03.849814 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd556f-e352-48dc-ab00-45f716b2bec8 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:03.850088 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd556f-e352-48dc-ab00-45f716b2bec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:03.881196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-f2bd556f-e352-48dc-ab00-45f716b2bec8 None None] MFA Rules not processed for user `964277045ffe4db19b89458459c250f1`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:03.882470 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f2bd556f-e352-48dc-ab00-45f716b2bec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:03.926076 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:03.958869 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4167/8309] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:03 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:20:03.970521 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc3d76-15ca-480a-8a67-7e7161a6c4d5 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:03.972493 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b7dc3d76-15ca-480a-8a67-7e7161a6c4d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:04.036436 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc3d76-15ca-480a-8a67-7e7161a6c4d5 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:04.040187 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd85b246-9ebb-4a24-ac01-41726e8b38d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:04.040799 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd85b246-9ebb-4a24-ac01-41726e8b38d8 service cinder] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:04.041081 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd85b246-9ebb-4a24-ac01-41726e8b38d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:04.041355 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd85b246-9ebb-4a24-ac01-41726e8b38d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:04.051141 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd85b246-9ebb-4a24-ac01-41726e8b38d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:04.052589 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd85b246-9ebb-4a24-ac01-41726e8b38d8 service cinder] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:04.063715 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4143/8310] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:20:03 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:20:04.515170 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd556f-e352-48dc-ab00-45f716b2bec8 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:04.585674 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd556f-e352-48dc-ab00-45f716b2bec8 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:04.591753 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472fe20-815e-42d4-8bbc-4ced973bb08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:04.592481 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472fe20-815e-42d4-8bbc-4ced973bb08e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:04.592822 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472fe20-815e-42d4-8bbc-4ced973bb08e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:04.593154 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472fe20-815e-42d4-8bbc-4ced973bb08e admin admin] PATH_INFO: `/v3/users/4f05eb0b85c24c368fd2737712d7262d` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:04.594443 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e472fe20-815e-42d4-8bbc-4ced973bb08e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f05eb0b85c24c368fd2737712d7262d)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:04.596475 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e472fe20-815e-42d4-8bbc-4ced973bb08e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:04.647288 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e472fe20-815e-42d4-8bbc-4ced973bb08e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f05eb0b85c24c368fd2737712d7262d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:04.647987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e472fe20-815e-42d4-8bbc-4ced973bb08e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f05eb0b85c24c368fd2737712d7262d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:04.656245 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e472fe20-815e-42d4-8bbc-4ced973bb08e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f05eb0b85c24c368fd2737712d7262d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:04.663342 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e472fe20-815e-42d4-8bbc-4ced973bb08e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f05eb0b85c24c368fd2737712d7262d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:04.663985 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-e472fe20-815e-42d4-8bbc-4ced973bb08e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f05eb0b85c24c368fd2737712d7262d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:04.682109 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4168/8311] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:20:04 2022] DELETE /identity/v3/users/4f05eb0b85c24c368fd2737712d7262d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:20:04.687191 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ae524-306f-4367-a97a-8f794ca3beca None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:04.687483 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ae524-306f-4367-a97a-8f794ca3beca None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:04.687792 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ae524-306f-4367-a97a-8f794ca3beca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:04.710120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-236ae524-306f-4367-a97a-8f794ca3beca None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:04.711462 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-236ae524-306f-4367-a97a-8f794ca3beca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:04.788276 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4144/8312] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:20:04.799199 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472fe20-815e-42d4-8bbc-4ced973bb08e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:04.800759 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e472fe20-815e-42d4-8bbc-4ced973bb08e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:04.865249 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472fe20-815e-42d4-8bbc-4ced973bb08e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:04.868996 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417cb89-2516-40dd-90bb-65564768c180 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:04.869609 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417cb89-2516-40dd-90bb-65564768c180 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:04.869891 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417cb89-2516-40dd-90bb-65564768c180 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:04.870163 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417cb89-2516-40dd-90bb-65564768c180 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:04.879640 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8417cb89-2516-40dd-90bb-65564768c180 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:04.881075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8417cb89-2516-40dd-90bb-65564768c180 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:04.885017 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:04.893219 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4169/8313] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:20:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:20:05.188386 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ae524-306f-4367-a97a-8f794ca3beca None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:05.189984 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-236ae524-306f-4367-a97a-8f794ca3beca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:05.208878 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ae524-306f-4367-a97a-8f794ca3beca None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:05.213822 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e90683-361d-40e6-a0bd-8af73d755ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:05.214596 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e90683-361d-40e6-a0bd-8af73d755ada admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:05.215578 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e90683-361d-40e6-a0bd-8af73d755ada admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:05.215895 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e90683-361d-40e6-a0bd-8af73d755ada admin admin] PATH_INFO: `/v3/projects/786b021bd90e42dd8f5299b5410ab025` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:05.217637 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e90683-361d-40e6-a0bd-8af73d755ada admin admin] RBAC: Authorizing `identity:delete_project(project_id=786b021bd90e42dd8f5299b5410ab025)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:05.219526 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e90683-361d-40e6-a0bd-8af73d755ada admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:05.270810 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d1e90683-361d-40e6-a0bd-8af73d755ada admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '786b021bd90e42dd8f5299b5410ab025', 'request_id': 'req-d1e90683-361d-40e6-a0bd-8af73d755ada'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:05.276914 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d1e90683-361d-40e6-a0bd-8af73d755ada admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '786b021bd90e42dd8f5299b5410ab025', 'request_id': 'req-d1e90683-361d-40e6-a0bd-8af73d755ada'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:05.285018 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d1e90683-361d-40e6-a0bd-8af73d755ada admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '786b021bd90e42dd8f5299b5410ab025', 'request_id': 'req-d1e90683-361d-40e6-a0bd-8af73d755ada'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:05.286390 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:05.299051 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d1e90683-361d-40e6-a0bd-8af73d755ada admin admin] The token cache is being invalidate because project 786b021bd90e42dd8f5299b5410ab025 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:20:05.299582 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d1e90683-361d-40e6-a0bd-8af73d755ada admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:05.300776 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d1e90683-361d-40e6-a0bd-8af73d755ada admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:05.302369 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4145/8314] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:20:05 2022] DELETE /identity/v3/projects/786b021bd90e42dd8f5299b5410ab025 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:20:05.306442 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417cb89-2516-40dd-90bb-65564768c180 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:05.317690 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417cb89-2516-40dd-90bb-65564768c180 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:05.377379 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd53bb34-90a0-4c88-9508-28ee80884733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:05.378128 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53bb34-90a0-4c88-9508-28ee80884733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:05.378472 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53bb34-90a0-4c88-9508-28ee80884733 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:05.378816 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53bb34-90a0-4c88-9508-28ee80884733 admin admin] PATH_INFO: `/v3/users/964277045ffe4db19b89458459c250f1` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:05.380094 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd53bb34-90a0-4c88-9508-28ee80884733 admin admin] RBAC: Authorizing `identity:delete_user(user_id=964277045ffe4db19b89458459c250f1)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:05.382101 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd53bb34-90a0-4c88-9508-28ee80884733 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:05.427851 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e90683-361d-40e6-a0bd-8af73d755ada admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:05.429802 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d1e90683-361d-40e6-a0bd-8af73d755ada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:05.445366 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e90683-361d-40e6-a0bd-8af73d755ada admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:05.447226 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-cd53bb34-90a0-4c88-9508-28ee80884733 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '964277045ffe4db19b89458459c250f1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:05.447899 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-cd53bb34-90a0-4c88-9508-28ee80884733 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '964277045ffe4db19b89458459c250f1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:05.450885 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ffd61-0352-4fc8-88b2-40417d8a29ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:05.451604 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ffd61-0352-4fc8-88b2-40417d8a29ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:05.451886 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ffd61-0352-4fc8-88b2-40417d8a29ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:05.452160 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ffd61-0352-4fc8-88b2-40417d8a29ac admin admin] PATH_INFO: `/v3/users/32dff34a93a940fabd96c6981266a8aa` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:05.453335 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0ffd61-0352-4fc8-88b2-40417d8a29ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=32dff34a93a940fabd96c6981266a8aa)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:05.455390 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0ffd61-0352-4fc8-88b2-40417d8a29ac admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:05.458591 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-cd53bb34-90a0-4c88-9508-28ee80884733 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '964277045ffe4db19b89458459c250f1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:05.467157 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-cd53bb34-90a0-4c88-9508-28ee80884733 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '964277045ffe4db19b89458459c250f1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:05.467892 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-cd53bb34-90a0-4c88-9508-28ee80884733 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '964277045ffe4db19b89458459c250f1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:05.489592 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4170/8315] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:20:05 2022] DELETE /identity/v3/users/964277045ffe4db19b89458459c250f1 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:20:05.518378 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0c0ffd61-0352-4fc8-88b2-40417d8a29ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32dff34a93a940fabd96c6981266a8aa'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:05.519372 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0c0ffd61-0352-4fc8-88b2-40417d8a29ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32dff34a93a940fabd96c6981266a8aa'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:05.535939 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0c0ffd61-0352-4fc8-88b2-40417d8a29ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32dff34a93a940fabd96c6981266a8aa'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:05.545963 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0c0ffd61-0352-4fc8-88b2-40417d8a29ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32dff34a93a940fabd96c6981266a8aa'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:05.555953 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0c0ffd61-0352-4fc8-88b2-40417d8a29ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32dff34a93a940fabd96c6981266a8aa'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:05.563998 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4146/8316] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:20:05 2022] DELETE /identity/v3/users/32dff34a93a940fabd96c6981266a8aa => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:20:05.569956 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38641cdc-62cd-4137-b434-bc00a7f7fa68 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:05.570591 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38641cdc-62cd-4137-b434-bc00a7f7fa68 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:05.570920 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38641cdc-62cd-4137-b434-bc00a7f7fa68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:05.598501 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-38641cdc-62cd-4137-b434-bc00a7f7fa68 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:05.599773 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-38641cdc-62cd-4137-b434-bc00a7f7fa68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:05.666637 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4171/8317] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:20:05.678367 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ffd61-0352-4fc8-88b2-40417d8a29ac admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:05.679922 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0c0ffd61-0352-4fc8-88b2-40417d8a29ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:05.760386 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ffd61-0352-4fc8-88b2-40417d8a29ac admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:05.764571 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c047b-79de-47d8-b041-2b7317e2027e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:05.765415 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c047b-79de-47d8-b041-2b7317e2027e service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:05.765800 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c047b-79de-47d8-b041-2b7317e2027e service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:05.766197 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c047b-79de-47d8-b041-2b7317e2027e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:05.776942 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c047b-79de-47d8-b041-2b7317e2027e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:05.778582 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c047b-79de-47d8-b041-2b7317e2027e service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:05.789603 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4147/8318] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:20:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:20:05.842317 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38641cdc-62cd-4137-b434-bc00a7f7fa68 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:05.843790 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-38641cdc-62cd-4137-b434-bc00a7f7fa68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:05.856496 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38641cdc-62cd-4137-b434-bc00a7f7fa68 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:05.866278 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1777508-dcbe-4dc4-82c8-f099649162e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:05.866972 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1777508-dcbe-4dc4-82c8-f099649162e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:05.867269 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1777508-dcbe-4dc4-82c8-f099649162e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:05.867520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1777508-dcbe-4dc4-82c8-f099649162e7 admin admin] PATH_INFO: `/v3/projects/fe9dd91a827549fc982f3133eb912b29` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:05.868659 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1777508-dcbe-4dc4-82c8-f099649162e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe9dd91a827549fc982f3133eb912b29)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:05.870623 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1777508-dcbe-4dc4-82c8-f099649162e7 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:05.884519 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:05.936404 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d1777508-dcbe-4dc4-82c8-f099649162e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe9dd91a827549fc982f3133eb912b29', 'request_id': 'req-d1777508-dcbe-4dc4-82c8-f099649162e7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:05.950347 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d1777508-dcbe-4dc4-82c8-f099649162e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe9dd91a827549fc982f3133eb912b29', 'request_id': 'req-d1777508-dcbe-4dc4-82c8-f099649162e7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:05.961682 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d1777508-dcbe-4dc4-82c8-f099649162e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe9dd91a827549fc982f3133eb912b29', 'request_id': 'req-d1777508-dcbe-4dc4-82c8-f099649162e7'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:05.979763 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d1777508-dcbe-4dc4-82c8-f099649162e7 admin admin] The token cache is being invalidate because project fe9dd91a827549fc982f3133eb912b29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:20:05.980207 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d1777508-dcbe-4dc4-82c8-f099649162e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:05.981593 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d1777508-dcbe-4dc4-82c8-f099649162e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:05.983969 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4172/8319] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:20:05 2022] DELETE /identity/v3/projects/fe9dd91a827549fc982f3133eb912b29 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:20:05.988734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff450d04-56b4-440b-a98a-655f9d90f26a None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:05.989029 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff450d04-56b4-440b-a98a-655f9d90f26a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:05.989308 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff450d04-56b4-440b-a98a-655f9d90f26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:06.026371 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-ff450d04-56b4-440b-a98a-655f9d90f26a None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:06.027638 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ff450d04-56b4-440b-a98a-655f9d90f26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:06.111055 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4148/8320] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:20:06.114123 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f20b2e-edbb-449e-a189-21c25b72e509 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:06.114411 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f20b2e-edbb-449e-a189-21c25b72e509 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:06.114685 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f20b2e-edbb-449e-a189-21c25b72e509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:06.131987 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff450d04-56b4-440b-a98a-655f9d90f26a None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:06.133593 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ff450d04-56b4-440b-a98a-655f9d90f26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:06.136989 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a3f20b2e-edbb-449e-a189-21c25b72e509 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:06.138190 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a3f20b2e-edbb-449e-a189-21c25b72e509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:06.146927 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4173/8321] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:20:06.151108 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f20b2e-edbb-449e-a189-21c25b72e509 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:06.153393 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff450d04-56b4-440b-a98a-655f9d90f26a None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:06.159091 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1825cb-02c0-45b9-8777-2487ff5092e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:06.159730 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1825cb-02c0-45b9-8777-2487ff5092e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:06.160008 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1825cb-02c0-45b9-8777-2487ff5092e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:06.160330 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1825cb-02c0-45b9-8777-2487ff5092e0 admin admin] PATH_INFO: `/v3/projects/e0e385c08847496b80608548ab7321ee` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:06.161741 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1825cb-02c0-45b9-8777-2487ff5092e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0e385c08847496b80608548ab7321ee)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:06.163079 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f20b2e-edbb-449e-a189-21c25b72e509 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:06.163699 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1825cb-02c0-45b9-8777-2487ff5092e0 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:06.167448 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:06.169463 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a291a-7315-434d-b00e-50cc6a64153b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:06.170177 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a291a-7315-434d-b00e-50cc6a64153b admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:06.170629 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a291a-7315-434d-b00e-50cc6a64153b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:06.170908 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a291a-7315-434d-b00e-50cc6a64153b admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:06.171660 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a291a-7315-434d-b00e-50cc6a64153b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:20:06.171962 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a291a-7315-434d-b00e-50cc6a64153b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:06.173960 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a291a-7315-434d-b00e-50cc6a64153b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:06.189664 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4174/8322] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:20:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:20:06.194055 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a291a-7315-434d-b00e-50cc6a64153b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:06.204649 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a291a-7315-434d-b00e-50cc6a64153b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:06.211146 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac2068-57cb-48ae-95db-5a325ee87d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:06.212236 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac2068-57cb-48ae-95db-5a325ee87d91 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:06.212846 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac2068-57cb-48ae-95db-5a325ee87d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:06.213372 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac2068-57cb-48ae-95db-5a325ee87d91 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:06.214179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac2068-57cb-48ae-95db-5a325ee87d91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:06.217830 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac2068-57cb-48ae-95db-5a325ee87d91 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:06.229866 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ad1825cb-02c0-45b9-8777-2487ff5092e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0e385c08847496b80608548ab7321ee', 'request_id': 'req-ad1825cb-02c0-45b9-8777-2487ff5092e0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:06.237640 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ad1825cb-02c0-45b9-8777-2487ff5092e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0e385c08847496b80608548ab7321ee', 'request_id': 'req-ad1825cb-02c0-45b9-8777-2487ff5092e0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:06.245814 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ad1825cb-02c0-45b9-8777-2487ff5092e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0e385c08847496b80608548ab7321ee', 'request_id': 'req-ad1825cb-02c0-45b9-8777-2487ff5092e0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:06.250783 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4175/8323] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:20:06 2022] POST /identity/v3/projects => generated 363 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:20:06.254937 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac2068-57cb-48ae-95db-5a325ee87d91 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:06.261171 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ad1825cb-02c0-45b9-8777-2487ff5092e0 admin admin] The token cache is being invalidate because project e0e385c08847496b80608548ab7321ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:20:06.261675 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ad1825cb-02c0-45b9-8777-2487ff5092e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:06.262502 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ad1825cb-02c0-45b9-8777-2487ff5092e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:06.264926 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4149/8324] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:20:06 2022] DELETE /identity/v3/projects/e0e385c08847496b80608548ab7321ee => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:20:06.268637 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1825cb-02c0-45b9-8777-2487ff5092e0 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:06.270313 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ad1825cb-02c0-45b9-8777-2487ff5092e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:06.333270 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac2068-57cb-48ae-95db-5a325ee87d91 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:06.338307 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6769c-0a9c-433f-8ac8-3e49b5453d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:06.339118 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6769c-0a9c-433f-8ac8-3e49b5453d68 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:06.339398 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6769c-0a9c-433f-8ac8-3e49b5453d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:06.339666 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6769c-0a9c-433f-8ac8-3e49b5453d68 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:06.340940 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d6769c-0a9c-433f-8ac8-3e49b5453d68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:06.342863 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d6769c-0a9c-433f-8ac8-3e49b5453d68 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:06.346791 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1825cb-02c0-45b9-8777-2487ff5092e0 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:06.351717 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f07f0-d073-4d13-9c08-cfd28124e3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:06.352427 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f07f0-d073-4d13-9c08-cfd28124e3a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:06.352774 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f07f0-d073-4d13-9c08-cfd28124e3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:06.353345 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f07f0-d073-4d13-9c08-cfd28124e3a1 admin admin] PATH_INFO: `/v3/users/4d7f8a26d62f4d8cbe24a173c1915d3d` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:06.354237 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f07f0-d073-4d13-9c08-cfd28124e3a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d7f8a26d62f4d8cbe24a173c1915d3d)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:06.356911 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f07f0-d073-4d13-9c08-cfd28124e3a1 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:06.370592 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4176/8325] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:20:06 2022] POST /identity/v3/users => generated 282 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:20:06.372138 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6769c-0a9c-433f-8ac8-3e49b5453d68 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:06.376190 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-79d6769c-0a9c-433f-8ac8-3e49b5453d68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:06.392178 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6769c-0a9c-433f-8ac8-3e49b5453d68 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:06.398721 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e77ab2-f042-4746-9793-19ac62cc037d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:06.399348 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e77ab2-f042-4746-9793-19ac62cc037d admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:06.399691 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e77ab2-f042-4746-9793-19ac62cc037d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:06.400030 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e77ab2-f042-4746-9793-19ac62cc037d admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:06.400744 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e77ab2-f042-4746-9793-19ac62cc037d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:06.403406 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e77ab2-f042-4746-9793-19ac62cc037d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:06.412145 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b75f07f0-d073-4d13-9c08-cfd28124e3a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d7f8a26d62f4d8cbe24a173c1915d3d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:06.412907 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b75f07f0-d073-4d13-9c08-cfd28124e3a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d7f8a26d62f4d8cbe24a173c1915d3d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:06.415637 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4177/8326] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:20:06.420798 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e77ab2-f042-4746-9793-19ac62cc037d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:06.431454 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e77ab2-f042-4746-9793-19ac62cc037d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:06.431626 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b75f07f0-d073-4d13-9c08-cfd28124e3a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d7f8a26d62f4d8cbe24a173c1915d3d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:06.437731 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1ae96c-f89c-4071-977a-2bafb100c0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:06.438465 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ae96c-f89c-4071-977a-2bafb100c0f3 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:06.438778 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ae96c-f89c-4071-977a-2bafb100c0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:06.439090 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ae96c-f89c-4071-977a-2bafb100c0f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:06.439845 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1ae96c-f89c-4071-977a-2bafb100c0f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:06.441604 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1ae96c-f89c-4071-977a-2bafb100c0f3 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:06.441988 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b75f07f0-d073-4d13-9c08-cfd28124e3a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d7f8a26d62f4d8cbe24a173c1915d3d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:06.452082 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b75f07f0-d073-4d13-9c08-cfd28124e3a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d7f8a26d62f4d8cbe24a173c1915d3d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:06.454305 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4178/8327] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:20:06.458389 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1ae96c-f89c-4071-977a-2bafb100c0f3 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:06.460346 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-cb1ae96c-f89c-4071-977a-2bafb100c0f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:06.462533 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4150/8328] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:20:06 2022] DELETE /identity/v3/users/4d7f8a26d62f4d8cbe24a173c1915d3d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:20:06.478510 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1ae96c-f89c-4071-977a-2bafb100c0f3 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:06.504879 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:06.546238 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055044ab-bda4-4943-ad41-e1dd615002f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:06.546975 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055044ab-bda4-4943-ad41-e1dd615002f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:06.547290 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055044ab-bda4-4943-ad41-e1dd615002f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:06.547561 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055044ab-bda4-4943-ad41-e1dd615002f9 admin admin] PATH_INFO: `/v3/projects/8373ccb4377c419a93b8fdea44458293/users/a281f43e984f4ea89741edd30254375a/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:06.567259 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055044ab-bda4-4943-ad41-e1dd615002f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8373ccb4377c419a93b8fdea44458293, user_id=a281f43e984f4ea89741edd30254375a, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:06.570551 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055044ab-bda4-4943-ad41-e1dd615002f9 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:06.591089 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4179/8329] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:20:06 2022] PUT /identity/v3/projects/8373ccb4377c419a93b8fdea44458293/users/a281f43e984f4ea89741edd30254375a/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:20:06.602571 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25131e8-93fc-4db3-b72d-64b279cacf92 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:06.602908 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25131e8-93fc-4db3-b72d-64b279cacf92 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:06.603175 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25131e8-93fc-4db3-b72d-64b279cacf92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:06.632591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:06.653670 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-f25131e8-93fc-4db3-b72d-64b279cacf92 None None] MFA Rules not processed for user `a281f43e984f4ea89741edd30254375a`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:06.657411 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f25131e8-93fc-4db3-b72d-64b279cacf92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:06.735038 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4151/8330] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:20:06.739533 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055044ab-bda4-4943-ad41-e1dd615002f9 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:06.779865 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25131e8-93fc-4db3-b72d-64b279cacf92 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:06.781506 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f25131e8-93fc-4db3-b72d-64b279cacf92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:06.815115 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055044ab-bda4-4943-ad41-e1dd615002f9 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:06.820657 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd6c93b-1287-4cb4-b810-b3486d9a4240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:06.821347 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6c93b-1287-4cb4-b810-b3486d9a4240 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:06.821696 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6c93b-1287-4cb4-b810-b3486d9a4240 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:06.822035 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6c93b-1287-4cb4-b810-b3486d9a4240 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:06.822740 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd6c93b-1287-4cb4-b810-b3486d9a4240 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:06.825570 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd6c93b-1287-4cb4-b810-b3486d9a4240 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:06.858317 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4180/8331] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:20:06 2022] POST /identity/v3/projects => generated 365 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:20:06.859412 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd6c93b-1287-4cb4-b810-b3486d9a4240 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:06.859962 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25131e8-93fc-4db3-b72d-64b279cacf92 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:06.919609 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199db7fa-42f5-4b5a-b3f4-034a9cf0a163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:06.920125 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199db7fa-42f5-4b5a-b3f4-034a9cf0a163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:06.920368 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199db7fa-42f5-4b5a-b3f4-034a9cf0a163 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:06.920627 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199db7fa-42f5-4b5a-b3f4-034a9cf0a163 admin admin] PATH_INFO: `/v3/projects/7b6884f613244845bb7a2caab48aa7ad` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:06.922166 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199db7fa-42f5-4b5a-b3f4-034a9cf0a163 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b6884f613244845bb7a2caab48aa7ad)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:06.924284 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199db7fa-42f5-4b5a-b3f4-034a9cf0a163 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:06.924946 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd6c93b-1287-4cb4-b810-b3486d9a4240 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:06.929700 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae16a2-6208-40ca-9962-01ed9280392a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:06.930308 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae16a2-6208-40ca-9962-01ed9280392a admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:06.930587 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae16a2-6208-40ca-9962-01ed9280392a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:06.930890 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae16a2-6208-40ca-9962-01ed9280392a admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:06.931573 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae16a2-6208-40ca-9962-01ed9280392a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:06.934005 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae16a2-6208-40ca-9962-01ed9280392a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:06.957630 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4181/8332] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:20:06 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:20:06.961551 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae16a2-6208-40ca-9962-01ed9280392a admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:06.974963 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae16a2-6208-40ca-9962-01ed9280392a admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:06.983586 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-199db7fa-42f5-4b5a-b3f4-034a9cf0a163 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b6884f613244845bb7a2caab48aa7ad', 'request_id': 'req-199db7fa-42f5-4b5a-b3f4-034a9cf0a163'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:06.984785 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:06.990244 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-199db7fa-42f5-4b5a-b3f4-034a9cf0a163 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b6884f613244845bb7a2caab48aa7ad', 'request_id': 'req-199db7fa-42f5-4b5a-b3f4-034a9cf0a163'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:06.997919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:06.999219 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-199db7fa-42f5-4b5a-b3f4-034a9cf0a163 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b6884f613244845bb7a2caab48aa7ad', 'request_id': 'req-199db7fa-42f5-4b5a-b3f4-034a9cf0a163'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:07.012119 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-199db7fa-42f5-4b5a-b3f4-034a9cf0a163 admin admin] The token cache is being invalidate because project 7b6884f613244845bb7a2caab48aa7ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:20:07.012556 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-199db7fa-42f5-4b5a-b3f4-034a9cf0a163 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:07.013222 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-199db7fa-42f5-4b5a-b3f4-034a9cf0a163 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:07.014742 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4152/8333] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:20:06 2022] DELETE /identity/v3/projects/7b6884f613244845bb7a2caab48aa7ad => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:20:07.020064 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4d4ff-2d5a-4296-bebc-1b65fce401e7 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:07.020343 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4d4ff-2d5a-4296-bebc-1b65fce401e7 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:07.020614 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4d4ff-2d5a-4296-bebc-1b65fce401e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:07.036549 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b547d37-33bf-43d5-b4ba-2cbb5c2552be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:07.037164 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b547d37-33bf-43d5-b4ba-2cbb5c2552be admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:07.037441 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b547d37-33bf-43d5-b4ba-2cbb5c2552be admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:07.037720 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b547d37-33bf-43d5-b4ba-2cbb5c2552be admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:07.038357 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b547d37-33bf-43d5-b4ba-2cbb5c2552be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:07.040012 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b547d37-33bf-43d5-b4ba-2cbb5c2552be admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:07.041517 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-8ba4d4ff-2d5a-4296-bebc-1b65fce401e7 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:07.042736 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8ba4d4ff-2d5a-4296-bebc-1b65fce401e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:07.050919 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4182/8334] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:20:07.058331 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4153/8335] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:20:07.058476 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b547d37-33bf-43d5-b4ba-2cbb5c2552be admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:07.058476 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6b547d37-33bf-43d5-b4ba-2cbb5c2552be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:07.059938 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2deaf-d2d8-4d04-9371-c2c147a8e324 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:07.060287 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2deaf-d2d8-4d04-9371-c2c147a8e324 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:07.060635 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2deaf-d2d8-4d04-9371-c2c147a8e324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:07.070777 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b547d37-33bf-43d5-b4ba-2cbb5c2552be admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:07.076827 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63120617-d53e-4615-9e07-6f7a293f2066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:07.077861 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63120617-d53e-4615-9e07-6f7a293f2066 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:07.078155 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63120617-d53e-4615-9e07-6f7a293f2066 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:07.078497 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63120617-d53e-4615-9e07-6f7a293f2066 admin admin] PATH_INFO: `/v3/projects/9534f4f9386c464194ef1b535b1aa43e/users/a4717741e8bb459788bb927b2cb4cf7d/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:07.082190 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-88e2deaf-d2d8-4d04-9371-c2c147a8e324 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:07.083449 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-88e2deaf-d2d8-4d04-9371-c2c147a8e324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:07.092535 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4154/8336] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:20:07.094916 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63120617-d53e-4615-9e07-6f7a293f2066 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9534f4f9386c464194ef1b535b1aa43e, user_id=a4717741e8bb459788bb927b2cb4cf7d, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:07.096798 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e2deaf-d2d8-4d04-9371-c2c147a8e324 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:07.097716 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63120617-d53e-4615-9e07-6f7a293f2066 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:07.106715 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e2deaf-d2d8-4d04-9371-c2c147a8e324 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:07.112534 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4183/8337] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:20:07 2022] PUT /identity/v3/projects/9534f4f9386c464194ef1b535b1aa43e/users/a4717741e8bb459788bb927b2cb4cf7d/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:20:07.116456 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63120617-d53e-4615-9e07-6f7a293f2066 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:07.165863 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb431e-72e0-4267-b463-80c024d70ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:07.166631 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb431e-72e0-4267-b463-80c024d70ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:07.167088 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb431e-72e0-4267-b463-80c024d70ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:07.167372 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb431e-72e0-4267-b463-80c024d70ef9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:07.168075 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb431e-72e0-4267-b463-80c024d70ef9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:20:07.168374 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb431e-72e0-4267-b463-80c024d70ef9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:07.170042 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb431e-72e0-4267-b463-80c024d70ef9 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:07.179708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63120617-d53e-4615-9e07-6f7a293f2066 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:07.185384 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4155/8338] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:20:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:20:07.185557 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70944b-51d6-4c5f-aabb-6a76464c3b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:07.185782 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70944b-51d6-4c5f-aabb-6a76464c3b0e admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:07.186070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70944b-51d6-4c5f-aabb-6a76464c3b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:07.186347 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70944b-51d6-4c5f-aabb-6a76464c3b0e admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:07.186507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb431e-72e0-4267-b463-80c024d70ef9 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:07.187000 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa70944b-51d6-4c5f-aabb-6a76464c3b0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:07.188678 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa70944b-51d6-4c5f-aabb-6a76464c3b0e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:07.196266 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb431e-72e0-4267-b463-80c024d70ef9 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:07.199039 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4184/8339] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:20:07.201773 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75353f8d-0bc5-4c1f-8738-26a244276fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:07.202380 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75353f8d-0bc5-4c1f-8738-26a244276fec admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:07.202663 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75353f8d-0bc5-4c1f-8738-26a244276fec admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:07.202938 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75353f8d-0bc5-4c1f-8738-26a244276fec admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:07.203592 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70944b-51d6-4c5f-aabb-6a76464c3b0e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:07.203705 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75353f8d-0bc5-4c1f-8738-26a244276fec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:07.205522 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75353f8d-0bc5-4c1f-8738-26a244276fec admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:07.213518 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70944b-51d6-4c5f-aabb-6a76464c3b0e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:07.219788 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3db1b-2573-4403-806e-1c34b9f83dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:07.220452 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3db1b-2573-4403-806e-1c34b9f83dc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:07.220727 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3db1b-2573-4403-806e-1c34b9f83dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:07.221004 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3db1b-2573-4403-806e-1c34b9f83dc0 admin admin] PATH_INFO: `/v3/projects/9534f4f9386c464194ef1b535b1aa43e/users/a4717741e8bb459788bb927b2cb4cf7d/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:07.222965 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef3db1b-2573-4403-806e-1c34b9f83dc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9534f4f9386c464194ef1b535b1aa43e, user_id=a4717741e8bb459788bb927b2cb4cf7d, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:07.225771 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef3db1b-2573-4403-806e-1c34b9f83dc0 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:07.234521 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4156/8340] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:20:07 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:20:07.237097 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4185/8341] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:20:07 2022] PUT /identity/v3/projects/9534f4f9386c464194ef1b535b1aa43e/users/a4717741e8bb459788bb927b2cb4cf7d/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:20:07.242656 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75353f8d-0bc5-4c1f-8738-26a244276fec admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:07.247643 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba17977-0bd7-4259-806a-311d84f01647 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:07.247643 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba17977-0bd7-4259-806a-311d84f01647 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:07.247643 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba17977-0bd7-4259-806a-311d84f01647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:07.276893 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-cba17977-0bd7-4259-806a-311d84f01647 None None] MFA Rules not processed for user `a4717741e8bb459788bb927b2cb4cf7d`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:07.278886 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-cba17977-0bd7-4259-806a-311d84f01647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:07.307508 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75353f8d-0bc5-4c1f-8738-26a244276fec admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:07.313166 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd0c4b-08b5-4d96-b4d9-400e866c2b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:07.313781 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd0c4b-08b5-4d96-b4d9-400e866c2b21 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:07.314067 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd0c4b-08b5-4d96-b4d9-400e866c2b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:07.314344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd0c4b-08b5-4d96-b4d9-400e866c2b21 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:07.314987 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcd0c4b-08b5-4d96-b4d9-400e866c2b21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:07.317180 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcd0c4b-08b5-4d96-b4d9-400e866c2b21 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:07.340653 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4157/8342] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:20:07 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:20:07.344691 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd0c4b-08b5-4d96-b4d9-400e866c2b21 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:07.351175 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4186/8343] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:07 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:20:07.355723 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd0c4b-08b5-4d96-b4d9-400e866c2b21 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:07.360698 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abef1ba-7236-407f-9863-842d8d8c7e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:07.361307 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abef1ba-7236-407f-9863-842d8d8c7e5a admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:07.361666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abef1ba-7236-407f-9863-842d8d8c7e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:07.361954 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abef1ba-7236-407f-9863-842d8d8c7e5a admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:07.362607 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abef1ba-7236-407f-9863-842d8d8c7e5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:07.362733 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba17977-0bd7-4259-806a-311d84f01647 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:07.364009 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-cba17977-0bd7-4259-806a-311d84f01647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:07.364249 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abef1ba-7236-407f-9863-842d8d8c7e5a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:07.370402 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:07.375733 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4158/8344] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:20:07.380330 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abef1ba-7236-407f-9863-842d8d8c7e5a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:07.391752 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abef1ba-7236-407f-9863-842d8d8c7e5a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:07.396470 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56c65c-05e7-4957-9d7f-72e4857f45f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:07.397061 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56c65c-05e7-4957-9d7f-72e4857f45f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:07.397390 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56c65c-05e7-4957-9d7f-72e4857f45f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:07.397660 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56c65c-05e7-4957-9d7f-72e4857f45f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:07.398293 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56c65c-05e7-4957-9d7f-72e4857f45f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:07.400035 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56c65c-05e7-4957-9d7f-72e4857f45f7 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:07.411264 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4159/8345] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:20:07.415502 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56c65c-05e7-4957-9d7f-72e4857f45f7 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:07.422146 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:DELETE=3,keystone:SELECT=92,keystone:INSERT=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:07.425866 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56c65c-05e7-4957-9d7f-72e4857f45f7 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:07.428561 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba17977-0bd7-4259-806a-311d84f01647 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:07.431992 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14baab-0e91-4c9f-a0b5-2e339d464803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:07.432666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14baab-0e91-4c9f-a0b5-2e339d464803 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:07.433193 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3506097-e955-4c92-9da5-6888ea4ae5d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:07.433336 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14baab-0e91-4c9f-a0b5-2e339d464803 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:07.433538 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14baab-0e91-4c9f-a0b5-2e339d464803 admin admin] PATH_INFO: `/v3/projects/4879d8e4c70b425ead18349791888030/users/83ee089d37714630aff52bd0998310ad/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:07.434030 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3506097-e955-4c92-9da5-6888ea4ae5d3 service cinder] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:07.434465 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3506097-e955-4c92-9da5-6888ea4ae5d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:07.434747 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3506097-e955-4c92-9da5-6888ea4ae5d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:07.444498 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3506097-e955-4c92-9da5-6888ea4ae5d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:07.446091 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3506097-e955-4c92-9da5-6888ea4ae5d3 service cinder] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:07.450744 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14baab-0e91-4c9f-a0b5-2e339d464803 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4879d8e4c70b425ead18349791888030, user_id=83ee089d37714630aff52bd0998310ad, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:07.453464 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14baab-0e91-4c9f-a0b5-2e339d464803 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:07.456865 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4187/8346] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:20:07 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:20:07.467815 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4160/8347] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:20:07 2022] PUT /identity/v3/projects/4879d8e4c70b425ead18349791888030/users/83ee089d37714630aff52bd0998310ad/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:20:07.479987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc87cbd-de89-435e-bec4-354c851245e0 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:07.480293 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc87cbd-de89-435e-bec4-354c851245e0 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:07.480679 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc87cbd-de89-435e-bec4-354c851245e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:07.510975 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-fbc87cbd-de89-435e-bec4-354c851245e0 None None] MFA Rules not processed for user `83ee089d37714630aff52bd0998310ad`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:07.513337 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-fbc87cbd-de89-435e-bec4-354c851245e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:07.536099 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14baab-0e91-4c9f-a0b5-2e339d464803 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:07.587644 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4188/8348] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:20:07.588688 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc87cbd-de89-435e-bec4-354c851245e0 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:07.596807 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14baab-0e91-4c9f-a0b5-2e339d464803 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:07.600698 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567584ca-cc99-4fbe-89a7-d8a24913b21d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:07.601333 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567584ca-cc99-4fbe-89a7-d8a24913b21d service cinder] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:07.601608 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567584ca-cc99-4fbe-89a7-d8a24913b21d service cinder] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:07.602000 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567584ca-cc99-4fbe-89a7-d8a24913b21d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:07.603786 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-567584ca-cc99-4fbe-89a7-d8a24913b21d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:07.653390 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc87cbd-de89-435e-bec4-354c851245e0 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:07.658083 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f3a1a2-163d-4948-8912-d8499e99550f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:07.658690 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3a1a2-163d-4948-8912-d8499e99550f admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:07.658977 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3a1a2-163d-4948-8912-d8499e99550f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:07.659274 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3a1a2-163d-4948-8912-d8499e99550f admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:07.659897 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f3a1a2-163d-4948-8912-d8499e99550f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:07.661793 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f3a1a2-163d-4948-8912-d8499e99550f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:07.669689 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567584ca-cc99-4fbe-89a7-d8a24913b21d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:07.671190 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567584ca-cc99-4fbe-89a7-d8a24913b21d service cinder] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:07.680642 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4161/8349] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:20:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:20:07.693379 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4189/8350] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:20:07 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:20:07.697514 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567584ca-cc99-4fbe-89a7-d8a24913b21d service cinder] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:07.709353 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567584ca-cc99-4fbe-89a7-d8a24913b21d service cinder] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:07.771094 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2247f95-f732-4005-bb40-a8413a3bdea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:07.771711 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2247f95-f732-4005-bb40-a8413a3bdea3 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:07.771998 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2247f95-f732-4005-bb40-a8413a3bdea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:07.772268 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2247f95-f732-4005-bb40-a8413a3bdea3 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:07.772948 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2247f95-f732-4005-bb40-a8413a3bdea3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:07.775066 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2247f95-f732-4005-bb40-a8413a3bdea3 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:07.800470 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4162/8351] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:20:07 2022] POST /identity/v3/users => generated 298 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:20:07.804606 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f3a1a2-163d-4948-8912-d8499e99550f admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:07.817999 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f3a1a2-163d-4948-8912-d8499e99550f admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:07.828511 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672da54a-c24e-4f77-b641-a826d20df88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:07.829230 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672da54a-c24e-4f77-b641-a826d20df88a admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:07.829578 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672da54a-c24e-4f77-b641-a826d20df88a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:07.829916 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672da54a-c24e-4f77-b641-a826d20df88a admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:07.830562 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672da54a-c24e-4f77-b641-a826d20df88a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:07.832217 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672da54a-c24e-4f77-b641-a826d20df88a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:07.843944 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4190/8352] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:20:07.848376 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2247f95-f732-4005-bb40-a8413a3bdea3 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:07.859246 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2247f95-f732-4005-bb40-a8413a3bdea3 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:07.864741 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9bedc-054e-41f5-9ddb-627f834a0a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:07.865532 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9bedc-054e-41f5-9ddb-627f834a0a68 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:07.866037 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9bedc-054e-41f5-9ddb-627f834a0a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:07.866325 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9bedc-054e-41f5-9ddb-627f834a0a68 admin admin] PATH_INFO: `/v3/projects/d91599cefda64ce886e16e412470bed4/users/3e3591785ce3490b8f8468b3efcce845/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:07.882932 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a9bedc-054e-41f5-9ddb-627f834a0a68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d91599cefda64ce886e16e412470bed4, user_id=3e3591785ce3490b8f8468b3efcce845, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:07.885643 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a9bedc-054e-41f5-9ddb-627f834a0a68 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:07.894836 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:07.899756 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4163/8353] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:20:07 2022] PUT /identity/v3/projects/d91599cefda64ce886e16e412470bed4/users/3e3591785ce3490b8f8468b3efcce845/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:20:07.904623 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672da54a-c24e-4f77-b641-a826d20df88a admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:07.914940 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672da54a-c24e-4f77-b641-a826d20df88a admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:07.922997 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:07.974154 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2294b-335a-4fb0-b762-83e786374fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:07.974766 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2294b-335a-4fb0-b762-83e786374fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:07.975174 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2294b-335a-4fb0-b762-83e786374fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:07.975418 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2294b-335a-4fb0-b762-83e786374fb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:07.976324 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed2294b-335a-4fb0-b762-83e786374fb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:07.978184 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed2294b-335a-4fb0-b762-83e786374fb4 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:07.989780 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4191/8354] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:20:07.994092 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9bedc-054e-41f5-9ddb-627f834a0a68 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:08.004652 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9bedc-054e-41f5-9ddb-627f834a0a68 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:08.009241 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305eaf49-105e-4bba-a7f8-b07e070b8004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:08.009899 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305eaf49-105e-4bba-a7f8-b07e070b8004 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:08.010158 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305eaf49-105e-4bba-a7f8-b07e070b8004 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:08.010432 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305eaf49-105e-4bba-a7f8-b07e070b8004 admin admin] PATH_INFO: `/v3/projects/d91599cefda64ce886e16e412470bed4/users/3e3591785ce3490b8f8468b3efcce845/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:08.013149 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305eaf49-105e-4bba-a7f8-b07e070b8004 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d91599cefda64ce886e16e412470bed4, user_id=3e3591785ce3490b8f8468b3efcce845, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:08.015819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305eaf49-105e-4bba-a7f8-b07e070b8004 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:08.026201 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4164/8355] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:20:07 2022] PUT /identity/v3/projects/d91599cefda64ce886e16e412470bed4/users/3e3591785ce3490b8f8468b3efcce845/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:20:08.038233 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103ba8b-2b98-4834-ae48-caa4fec3ea3d None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:08.038523 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103ba8b-2b98-4834-ae48-caa4fec3ea3d None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:08.038800 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103ba8b-2b98-4834-ae48-caa4fec3ea3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:08.067102 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-9103ba8b-2b98-4834-ae48-caa4fec3ea3d None None] MFA Rules not processed for user `3e3591785ce3490b8f8468b3efcce845`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:08.068316 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9103ba8b-2b98-4834-ae48-caa4fec3ea3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:08.138241 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4192/8356] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:08 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:20:08.149613 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305eaf49-105e-4bba-a7f8-b07e070b8004 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:08.208607 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305eaf49-105e-4bba-a7f8-b07e070b8004 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:08.212374 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b7832-17a4-42fd-948d-c13c43422e06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:08.212980 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b7832-17a4-42fd-948d-c13c43422e06 service cinder] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:08.213261 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b7832-17a4-42fd-948d-c13c43422e06 service cinder] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:08.213536 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b7832-17a4-42fd-948d-c13c43422e06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:08.223415 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b7832-17a4-42fd-948d-c13c43422e06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:08.224852 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b7832-17a4-42fd-948d-c13c43422e06 service cinder] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:08.234341 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4165/8357] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:20:08 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:20:08.306819 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103ba8b-2b98-4834-ae48-caa4fec3ea3d None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:08.320047 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103ba8b-2b98-4834-ae48-caa4fec3ea3d None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:08.323654 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3cf648-647e-422a-abf2-0faac8ff54d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:08.324845 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3cf648-647e-422a-abf2-0faac8ff54d8 service cinder] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:08.325144 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3cf648-647e-422a-abf2-0faac8ff54d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:08.325472 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3cf648-647e-422a-abf2-0faac8ff54d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:08.382535 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3cf648-647e-422a-abf2-0faac8ff54d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:08.384039 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3cf648-647e-422a-abf2-0faac8ff54d8 service cinder] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:08.393681 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4193/8358] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:20:08 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:20:08.664153 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b7832-17a4-42fd-948d-c13c43422e06 service cinder] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:08.727491 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b7832-17a4-42fd-948d-c13c43422e06 service cinder] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:08.732771 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ae1ce-4de7-4954-8972-2615488d829f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:08.733412 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ae1ce-4de7-4954-8972-2615488d829f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:08.733701 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ae1ce-4de7-4954-8972-2615488d829f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:08.733970 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ae1ce-4de7-4954-8972-2615488d829f admin admin] PATH_INFO: `/v3/users/83ee089d37714630aff52bd0998310ad` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:08.735134 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ae1ce-4de7-4954-8972-2615488d829f admin admin] RBAC: Authorizing `identity:delete_user(user_id=83ee089d37714630aff52bd0998310ad)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:08.737063 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ae1ce-4de7-4954-8972-2615488d829f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:08.783809 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-688ae1ce-4de7-4954-8972-2615488d829f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83ee089d37714630aff52bd0998310ad'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:08.784387 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-688ae1ce-4de7-4954-8972-2615488d829f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83ee089d37714630aff52bd0998310ad'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:08.796704 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-688ae1ce-4de7-4954-8972-2615488d829f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83ee089d37714630aff52bd0998310ad'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:08.803295 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-688ae1ce-4de7-4954-8972-2615488d829f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83ee089d37714630aff52bd0998310ad'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:08.811234 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-688ae1ce-4de7-4954-8972-2615488d829f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83ee089d37714630aff52bd0998310ad'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:08.817036 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4166/8359] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:20:08 2022] DELETE /identity/v3/users/83ee089d37714630aff52bd0998310ad => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:20:08.821519 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50d2a7-9e17-478b-a507-111bb34290dc None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:08.821808 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50d2a7-9e17-478b-a507-111bb34290dc None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:08.822086 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50d2a7-9e17-478b-a507-111bb34290dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:08.843221 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-af50d2a7-9e17-478b-a507-111bb34290dc None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:08.844442 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-af50d2a7-9e17-478b-a507-111bb34290dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:08.872062 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:08.907548 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4194/8360] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:20:08.917024 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ae1ce-4de7-4954-8972-2615488d829f admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:08.919153 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-688ae1ce-4de7-4954-8972-2615488d829f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:08.930819 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:08.987752 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ae1ce-4de7-4954-8972-2615488d829f admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:08.991817 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f011bf-cef4-4f83-a426-87c444194199 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:08.992614 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f011bf-cef4-4f83-a426-87c444194199 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:08.992903 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f011bf-cef4-4f83-a426-87c444194199 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:08.993180 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f011bf-cef4-4f83-a426-87c444194199 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:09.004282 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f011bf-cef4-4f83-a426-87c444194199 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:09.005725 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f011bf-cef4-4f83-a426-87c444194199 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:09.016422 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4167/8361] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:20:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:20:09.329284 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50d2a7-9e17-478b-a507-111bb34290dc None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:09.331101 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-af50d2a7-9e17-478b-a507-111bb34290dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:09.344749 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50d2a7-9e17-478b-a507-111bb34290dc None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:09.350840 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47805004-a4a0-4b5c-ae54-3f4ab21afaa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:09.351615 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47805004-a4a0-4b5c-ae54-3f4ab21afaa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:09.351958 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47805004-a4a0-4b5c-ae54-3f4ab21afaa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:09.352298 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47805004-a4a0-4b5c-ae54-3f4ab21afaa0 admin admin] PATH_INFO: `/v3/projects/4879d8e4c70b425ead18349791888030` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:09.353514 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47805004-a4a0-4b5c-ae54-3f4ab21afaa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4879d8e4c70b425ead18349791888030)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:09.355655 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47805004-a4a0-4b5c-ae54-3f4ab21afaa0 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:09.409897 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-47805004-a4a0-4b5c-ae54-3f4ab21afaa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4879d8e4c70b425ead18349791888030', 'request_id': 'req-47805004-a4a0-4b5c-ae54-3f4ab21afaa0'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:09.416358 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-47805004-a4a0-4b5c-ae54-3f4ab21afaa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4879d8e4c70b425ead18349791888030', 'request_id': 'req-47805004-a4a0-4b5c-ae54-3f4ab21afaa0'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:09.423222 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-47805004-a4a0-4b5c-ae54-3f4ab21afaa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4879d8e4c70b425ead18349791888030', 'request_id': 'req-47805004-a4a0-4b5c-ae54-3f4ab21afaa0'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:09.437378 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-47805004-a4a0-4b5c-ae54-3f4ab21afaa0 admin admin] The token cache is being invalidate because project 4879d8e4c70b425ead18349791888030 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:20:09.437677 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-47805004-a4a0-4b5c-ae54-3f4ab21afaa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:09.438331 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-47805004-a4a0-4b5c-ae54-3f4ab21afaa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:09.439927 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4195/8362] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:20:09 2022] DELETE /identity/v3/projects/4879d8e4c70b425ead18349791888030 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:20:09.444066 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f011bf-cef4-4f83-a426-87c444194199 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:09.454742 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f011bf-cef4-4f83-a426-87c444194199 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:09.514367 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca170e-0acb-4095-999c-744a31a59691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:09.515181 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca170e-0acb-4095-999c-744a31a59691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:09.515469 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca170e-0acb-4095-999c-744a31a59691 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:09.515745 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca170e-0acb-4095-999c-744a31a59691 admin admin] PATH_INFO: `/v3/users/3e3591785ce3490b8f8468b3efcce845` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:09.516980 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca170e-0acb-4095-999c-744a31a59691 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e3591785ce3490b8f8468b3efcce845)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:09.519117 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca170e-0acb-4095-999c-744a31a59691 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:09.567945 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-cbca170e-0acb-4095-999c-744a31a59691 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e3591785ce3490b8f8468b3efcce845'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:09.568663 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-cbca170e-0acb-4095-999c-744a31a59691 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e3591785ce3490b8f8468b3efcce845'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:09.583203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-cbca170e-0acb-4095-999c-744a31a59691 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e3591785ce3490b8f8468b3efcce845'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:09.592563 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-cbca170e-0acb-4095-999c-744a31a59691 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e3591785ce3490b8f8468b3efcce845'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:09.600125 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-cbca170e-0acb-4095-999c-744a31a59691 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e3591785ce3490b8f8468b3efcce845'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:09.606634 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4168/8363] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:20:09 2022] DELETE /identity/v3/users/3e3591785ce3490b8f8468b3efcce845 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:20:09.888100 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47805004-a4a0-4b5c-ae54-3f4ab21afaa0 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:09.889539 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-47805004-a4a0-4b5c-ae54-3f4ab21afaa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:09.902539 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47805004-a4a0-4b5c-ae54-3f4ab21afaa0 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:09.970568 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008849c6-3c69-4029-a27f-9603bee1cbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:09.971278 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008849c6-3c69-4029-a27f-9603bee1cbd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:09.971521 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008849c6-3c69-4029-a27f-9603bee1cbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:09.971793 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008849c6-3c69-4029-a27f-9603bee1cbd2 admin admin] PATH_INFO: `/v3/projects/d91599cefda64ce886e16e412470bed4` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:09.972947 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008849c6-3c69-4029-a27f-9603bee1cbd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d91599cefda64ce886e16e412470bed4)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:09.975094 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008849c6-3c69-4029-a27f-9603bee1cbd2 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:10.027812 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-008849c6-3c69-4029-a27f-9603bee1cbd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd91599cefda64ce886e16e412470bed4', 'request_id': 'req-008849c6-3c69-4029-a27f-9603bee1cbd2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:10.032594 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:10.034081 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-008849c6-3c69-4029-a27f-9603bee1cbd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd91599cefda64ce886e16e412470bed4', 'request_id': 'req-008849c6-3c69-4029-a27f-9603bee1cbd2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:10.043202 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-008849c6-3c69-4029-a27f-9603bee1cbd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd91599cefda64ce886e16e412470bed4', 'request_id': 'req-008849c6-3c69-4029-a27f-9603bee1cbd2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:10.055932 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-008849c6-3c69-4029-a27f-9603bee1cbd2 admin admin] The token cache is being invalidate because project d91599cefda64ce886e16e412470bed4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:20:10.056237 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-008849c6-3c69-4029-a27f-9603bee1cbd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:10.056858 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-008849c6-3c69-4029-a27f-9603bee1cbd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:10.059459 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4196/8364] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:20:09 2022] DELETE /identity/v3/projects/d91599cefda64ce886e16e412470bed4 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:20:10.064294 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45fc65-417d-4725-ac78-aa65474c640f None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:10.065171 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45fc65-417d-4725-ac78-aa65474c640f None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:10.065599 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45fc65-417d-4725-ac78-aa65474c640f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:10.087323 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-3e45fc65-417d-4725-ac78-aa65474c640f None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:10.088449 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3e45fc65-417d-4725-ac78-aa65474c640f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:10.115586 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:10.154027 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4169/8365] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:20:10.162173 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bd481-7717-4d25-9f42-5c9d30969c46 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:10.162544 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bd481-7717-4d25-9f42-5c9d30969c46 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:10.162906 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bd481-7717-4d25-9f42-5c9d30969c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:10.186660 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-f36bd481-7717-4d25-9f42-5c9d30969c46 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:10.187982 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f36bd481-7717-4d25-9f42-5c9d30969c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:10.197170 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4197/8366] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:20:10.201554 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e45fc65-417d-4725-ac78-aa65474c640f None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:10.212344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e45fc65-417d-4725-ac78-aa65474c640f None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:10.218880 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077be4c-36fe-4399-9fa2-baa09d53921d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:10.219651 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077be4c-36fe-4399-9fa2-baa09d53921d admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:10.219931 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077be4c-36fe-4399-9fa2-baa09d53921d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:10.220202 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077be4c-36fe-4399-9fa2-baa09d53921d admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:10.220917 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5077be4c-36fe-4399-9fa2-baa09d53921d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:20:10.221159 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5077be4c-36fe-4399-9fa2-baa09d53921d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:10.223320 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5077be4c-36fe-4399-9fa2-baa09d53921d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:10.236619 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4170/8367] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:20:10.240936 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36bd481-7717-4d25-9f42-5c9d30969c46 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:10.251641 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36bd481-7717-4d25-9f42-5c9d30969c46 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:10.256401 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc736db4-2d9b-46d6-8224-4d0f5c221a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:10.257009 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc736db4-2d9b-46d6-8224-4d0f5c221a1c admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:10.257288 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc736db4-2d9b-46d6-8224-4d0f5c221a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:10.257559 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc736db4-2d9b-46d6-8224-4d0f5c221a1c admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:10.258182 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc736db4-2d9b-46d6-8224-4d0f5c221a1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:10.260210 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc736db4-2d9b-46d6-8224-4d0f5c221a1c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:10.292155 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4198/8368] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:20:10 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:20:10.293884 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077be4c-36fe-4399-9fa2-baa09d53921d admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:10.304688 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077be4c-36fe-4399-9fa2-baa09d53921d admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:10.368242 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8fd6f1-107e-4d80-8fcb-d24555f087fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:10.368859 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fd6f1-107e-4d80-8fcb-d24555f087fb admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:10.369139 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fd6f1-107e-4d80-8fcb-d24555f087fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:10.369430 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fd6f1-107e-4d80-8fcb-d24555f087fb admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:10.370049 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8fd6f1-107e-4d80-8fcb-d24555f087fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:10.372120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8fd6f1-107e-4d80-8fcb-d24555f087fb admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:10.398081 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4171/8369] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:20:10 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:20:10.403510 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc736db4-2d9b-46d6-8224-4d0f5c221a1c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:10.417089 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc736db4-2d9b-46d6-8224-4d0f5c221a1c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:10.424911 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee7c1e-3349-4c65-aa37-f4d1568479bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:10.425675 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee7c1e-3349-4c65-aa37-f4d1568479bc admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:10.426051 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee7c1e-3349-4c65-aa37-f4d1568479bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:10.426422 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee7c1e-3349-4c65-aa37-f4d1568479bc admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:10.427807 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ee7c1e-3349-4c65-aa37-f4d1568479bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:10.430284 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ee7c1e-3349-4c65-aa37-f4d1568479bc admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:10.446976 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4199/8370] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:20:10.448587 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8fd6f1-107e-4d80-8fcb-d24555f087fb admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:10.459877 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8fd6f1-107e-4d80-8fcb-d24555f087fb admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:10.465590 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac1e2d-72ca-4208-bba1-d7c4a103e33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:10.466470 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac1e2d-72ca-4208-bba1-d7c4a103e33a admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:10.466833 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac1e2d-72ca-4208-bba1-d7c4a103e33a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:10.467250 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac1e2d-72ca-4208-bba1-d7c4a103e33a admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:10.467930 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac1e2d-72ca-4208-bba1-d7c4a103e33a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:10.470619 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac1e2d-72ca-4208-bba1-d7c4a103e33a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:10.479261 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee7c1e-3349-4c65-aa37-f4d1568479bc admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:10.482359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-26ee7c1e-3349-4c65-aa37-f4d1568479bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:10.491621 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4172/8371] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:20:10.492575 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac1e2d-72ca-4208-bba1-d7c4a103e33a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:10.497732 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee7c1e-3349-4c65-aa37-f4d1568479bc admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:10.502709 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c5cce-5afd-4f7c-8bc5-a89df018d42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:10.503411 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c5cce-5afd-4f7c-8bc5-a89df018d42c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:10.503552 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac1e2d-72ca-4208-bba1-d7c4a103e33a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:10.503693 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c5cce-5afd-4f7c-8bc5-a89df018d42c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:10.503968 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c5cce-5afd-4f7c-8bc5-a89df018d42c admin admin] PATH_INFO: `/v3/users/a281f43e984f4ea89741edd30254375a` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:10.505107 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c5cce-5afd-4f7c-8bc5-a89df018d42c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a281f43e984f4ea89741edd30254375a)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:10.507111 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c5cce-5afd-4f7c-8bc5-a89df018d42c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:10.508513 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efc6625-ec44-4860-8aa5-c5f6fe5a0489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:10.509224 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc6625-ec44-4860-8aa5-c5f6fe5a0489 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:10.509562 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc6625-ec44-4860-8aa5-c5f6fe5a0489 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:10.509898 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc6625-ec44-4860-8aa5-c5f6fe5a0489 admin admin] PATH_INFO: `/v3/projects/e179bddac6054163810a29f41fa012d8/users/924dd5d0b31749c2b1bbb30c1386e215/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:10.525927 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efc6625-ec44-4860-8aa5-c5f6fe5a0489 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e179bddac6054163810a29f41fa012d8, user_id=924dd5d0b31749c2b1bbb30c1386e215, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:10.529078 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efc6625-ec44-4860-8aa5-c5f6fe5a0489 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:10.543598 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4173/8372] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:20:10 2022] PUT /identity/v3/projects/e179bddac6054163810a29f41fa012d8/users/924dd5d0b31749c2b1bbb30c1386e215/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:20:10.556077 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910191eb-98bf-471c-935d-0490aaa709fd None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:10.556368 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910191eb-98bf-471c-935d-0490aaa709fd None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:10.556762 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910191eb-98bf-471c-935d-0490aaa709fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:10.560478 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-705c5cce-5afd-4f7c-8bc5-a89df018d42c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a281f43e984f4ea89741edd30254375a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:10.561021 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-705c5cce-5afd-4f7c-8bc5-a89df018d42c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a281f43e984f4ea89741edd30254375a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:10.571017 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-705c5cce-5afd-4f7c-8bc5-a89df018d42c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a281f43e984f4ea89741edd30254375a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:10.582230 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-705c5cce-5afd-4f7c-8bc5-a89df018d42c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a281f43e984f4ea89741edd30254375a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:10.583203 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-705c5cce-5afd-4f7c-8bc5-a89df018d42c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a281f43e984f4ea89741edd30254375a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:10.589335 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-910191eb-98bf-471c-935d-0490aaa709fd None None] MFA Rules not processed for user `924dd5d0b31749c2b1bbb30c1386e215`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:10.590639 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-910191eb-98bf-471c-935d-0490aaa709fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:10.608506 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4200/8373] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:20:10 2022] DELETE /identity/v3/users/a281f43e984f4ea89741edd30254375a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:20:10.610074 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7a9df-4b29-433a-b9e3-a5babcbe66ce None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:10.610373 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7a9df-4b29-433a-b9e3-a5babcbe66ce None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:10.610649 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7a9df-4b29-433a-b9e3-a5babcbe66ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:10.634162 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-1dd7a9df-4b29-433a-b9e3-a5babcbe66ce None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:10.635459 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1dd7a9df-4b29-433a-b9e3-a5babcbe66ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:10.677312 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4174/8374] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:20:10.689779 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910191eb-98bf-471c-935d-0490aaa709fd None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:10.691343 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-910191eb-98bf-471c-935d-0490aaa709fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:10.696936 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:10.706628 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4201/8375] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:20:10.715993 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7a9df-4b29-433a-b9e3-a5babcbe66ce None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:10.717332 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1dd7a9df-4b29-433a-b9e3-a5babcbe66ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:10.737749 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=86,keystone:INSERT=3,keystone:DELETE=11 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:10.763683 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910191eb-98bf-471c-935d-0490aaa709fd None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:10.786485 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7a9df-4b29-433a-b9e3-a5babcbe66ce None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:10.790671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bed704-26db-4d4d-9635-af2fba9cec21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:10.791320 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bed704-26db-4d4d-9635-af2fba9cec21 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:10.791630 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bed704-26db-4d4d-9635-af2fba9cec21 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:10.791904 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bed704-26db-4d4d-9635-af2fba9cec21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:10.801314 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bed704-26db-4d4d-9635-af2fba9cec21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:10.802754 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bed704-26db-4d4d-9635-af2fba9cec21 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:10.813790 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4202/8376] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:20:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:20:10.814256 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5997d3c-68f8-4a99-8302-6f4dfac35b3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:10.814880 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5997d3c-68f8-4a99-8302-6f4dfac35b3e service cinder] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:10.815247 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5997d3c-68f8-4a99-8302-6f4dfac35b3e service cinder] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:10.815528 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5997d3c-68f8-4a99-8302-6f4dfac35b3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:10.876333 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5997d3c-68f8-4a99-8302-6f4dfac35b3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:10.878045 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5997d3c-68f8-4a99-8302-6f4dfac35b3e service cinder] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:10.887462 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4175/8377] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:20:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:20:11.109364 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bed704-26db-4d4d-9635-af2fba9cec21 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:11.111010 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-38bed704-26db-4d4d-9635-af2fba9cec21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:11.125826 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bed704-26db-4d4d-9635-af2fba9cec21 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:11.132800 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe333cc4-7a67-4b7e-bdf2-1945724e26e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:11.147726 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe333cc4-7a67-4b7e-bdf2-1945724e26e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:11.147726 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe333cc4-7a67-4b7e-bdf2-1945724e26e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:11.147726 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe333cc4-7a67-4b7e-bdf2-1945724e26e0 admin admin] PATH_INFO: `/v3/projects/8373ccb4377c419a93b8fdea44458293` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:11.147726 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe333cc4-7a67-4b7e-bdf2-1945724e26e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8373ccb4377c419a93b8fdea44458293)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:11.148697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe333cc4-7a67-4b7e-bdf2-1945724e26e0 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:11.216600 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fe333cc4-7a67-4b7e-bdf2-1945724e26e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8373ccb4377c419a93b8fdea44458293', 'request_id': 'req-fe333cc4-7a67-4b7e-bdf2-1945724e26e0'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:11.222426 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fe333cc4-7a67-4b7e-bdf2-1945724e26e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8373ccb4377c419a93b8fdea44458293', 'request_id': 'req-fe333cc4-7a67-4b7e-bdf2-1945724e26e0'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:11.228712 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fe333cc4-7a67-4b7e-bdf2-1945724e26e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8373ccb4377c419a93b8fdea44458293', 'request_id': 'req-fe333cc4-7a67-4b7e-bdf2-1945724e26e0'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:11.242694 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fe333cc4-7a67-4b7e-bdf2-1945724e26e0 admin admin] The token cache is being invalidate because project 8373ccb4377c419a93b8fdea44458293 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:20:11.242978 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fe333cc4-7a67-4b7e-bdf2-1945724e26e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:11.243633 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-fe333cc4-7a67-4b7e-bdf2-1945724e26e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:11.245134 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4203/8378] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:20:11 2022] DELETE /identity/v3/projects/8373ccb4377c419a93b8fdea44458293 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:20:11.250036 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5997d3c-68f8-4a99-8302-6f4dfac35b3e service cinder] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:11.261628 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5997d3c-68f8-4a99-8302-6f4dfac35b3e service cinder] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:11.321720 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5284f8a3-ea40-424c-bdf8-a945ba1f609d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:11.322451 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284f8a3-ea40-424c-bdf8-a945ba1f609d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:11.322802 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284f8a3-ea40-424c-bdf8-a945ba1f609d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:11.323185 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284f8a3-ea40-424c-bdf8-a945ba1f609d admin admin] PATH_INFO: `/v3/users/a4717741e8bb459788bb927b2cb4cf7d` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:11.325097 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5284f8a3-ea40-424c-bdf8-a945ba1f609d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4717741e8bb459788bb927b2cb4cf7d)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:11.327483 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5284f8a3-ea40-424c-bdf8-a945ba1f609d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:11.341217 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:11.377810 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5284f8a3-ea40-424c-bdf8-a945ba1f609d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4717741e8bb459788bb927b2cb4cf7d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:11.378677 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5284f8a3-ea40-424c-bdf8-a945ba1f609d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4717741e8bb459788bb927b2cb4cf7d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:11.394658 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5284f8a3-ea40-424c-bdf8-a945ba1f609d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4717741e8bb459788bb927b2cb4cf7d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:11.403462 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5284f8a3-ea40-424c-bdf8-a945ba1f609d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4717741e8bb459788bb927b2cb4cf7d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:11.412125 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-5284f8a3-ea40-424c-bdf8-a945ba1f609d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4717741e8bb459788bb927b2cb4cf7d'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:11.418322 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4176/8379] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:20:11 2022] DELETE /identity/v3/users/a4717741e8bb459788bb927b2cb4cf7d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:20:11.719520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe333cc4-7a67-4b7e-bdf2-1945724e26e0 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:11.721384 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-fe333cc4-7a67-4b7e-bdf2-1945724e26e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:11.741743 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe333cc4-7a67-4b7e-bdf2-1945724e26e0 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:11.824864 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5008c19e-a733-47fe-b3d6-d7e0807b5ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:11.825555 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008c19e-a733-47fe-b3d6-d7e0807b5ed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:11.825823 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008c19e-a733-47fe-b3d6-d7e0807b5ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:11.826069 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008c19e-a733-47fe-b3d6-d7e0807b5ed0 admin admin] PATH_INFO: `/v3/projects/9534f4f9386c464194ef1b535b1aa43e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:11.827410 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5008c19e-a733-47fe-b3d6-d7e0807b5ed0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9534f4f9386c464194ef1b535b1aa43e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:11.829443 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5008c19e-a733-47fe-b3d6-d7e0807b5ed0 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:11.887328 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:11.891998 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5008c19e-a733-47fe-b3d6-d7e0807b5ed0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9534f4f9386c464194ef1b535b1aa43e', 'request_id': 'req-5008c19e-a733-47fe-b3d6-d7e0807b5ed0'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:11.898719 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5008c19e-a733-47fe-b3d6-d7e0807b5ed0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9534f4f9386c464194ef1b535b1aa43e', 'request_id': 'req-5008c19e-a733-47fe-b3d6-d7e0807b5ed0'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:11.908985 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5008c19e-a733-47fe-b3d6-d7e0807b5ed0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9534f4f9386c464194ef1b535b1aa43e', 'request_id': 'req-5008c19e-a733-47fe-b3d6-d7e0807b5ed0'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:11.932101 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5008c19e-a733-47fe-b3d6-d7e0807b5ed0 admin admin] The token cache is being invalidate because project 9534f4f9386c464194ef1b535b1aa43e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:20:11.932397 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5008c19e-a733-47fe-b3d6-d7e0807b5ed0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:11.933605 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-5008c19e-a733-47fe-b3d6-d7e0807b5ed0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:11.935732 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4204/8380] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:20:11 2022] DELETE /identity/v3/projects/9534f4f9386c464194ef1b535b1aa43e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:20:11.941829 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa9b9b-c185-47ee-a95a-784993647cb0 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:11.942661 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa9b9b-c185-47ee-a95a-784993647cb0 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:11.942917 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa9b9b-c185-47ee-a95a-784993647cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:11.970139 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-efaa9b9b-c185-47ee-a95a-784993647cb0 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:11.972525 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-efaa9b9b-c185-47ee-a95a-784993647cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:11.983289 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5008c19e-a733-47fe-b3d6-d7e0807b5ed0 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:11.985302 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5008c19e-a733-47fe-b3d6-d7e0807b5ed0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:12.056168 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4177/8381] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:20:12.065579 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c68483-0adb-411b-b110-ef95d7ed19b5 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:12.065870 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c68483-0adb-411b-b110-ef95d7ed19b5 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:12.066229 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c68483-0adb-411b-b110-ef95d7ed19b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:12.077288 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5008c19e-a733-47fe-b3d6-d7e0807b5ed0 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:12.081860 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c40bea-2899-47a7-9485-1ec9b94c843c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:12.082493 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c40bea-2899-47a7-9485-1ec9b94c843c service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:12.082775 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c40bea-2899-47a7-9485-1ec9b94c843c service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:12.083206 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c40bea-2899-47a7-9485-1ec9b94c843c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:12.084972 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-93c40bea-2899-47a7-9485-1ec9b94c843c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:12.094702 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-64c68483-0adb-411b-b110-ef95d7ed19b5 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:12.096207 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-64c68483-0adb-411b-b110-ef95d7ed19b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:12.107333 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4178/8382] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:20:12.111274 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c68483-0adb-411b-b110-ef95d7ed19b5 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:12.120716 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c68483-0adb-411b-b110-ef95d7ed19b5 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:12.125742 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe04d33-a68c-47ff-814b-247fe7c1d558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:12.126353 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe04d33-a68c-47ff-814b-247fe7c1d558 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:12.126639 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe04d33-a68c-47ff-814b-247fe7c1d558 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:12.126909 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe04d33-a68c-47ff-814b-247fe7c1d558 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:12.127627 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe04d33-a68c-47ff-814b-247fe7c1d558 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:20:12.127930 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe04d33-a68c-47ff-814b-247fe7c1d558 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:12.129535 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe04d33-a68c-47ff-814b-247fe7c1d558 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:12.142942 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4179/8383] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:20:12.147735 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe04d33-a68c-47ff-814b-247fe7c1d558 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:12.159423 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe04d33-a68c-47ff-814b-247fe7c1d558 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:12.165160 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2884c-f8ba-45b0-9785-3b7804824483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:12.165774 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2884c-f8ba-45b0-9785-3b7804824483 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:12.166062 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2884c-f8ba-45b0-9785-3b7804824483 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:12.166322 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2884c-f8ba-45b0-9785-3b7804824483 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:12.167187 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a2884c-f8ba-45b0-9785-3b7804824483 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:12.169788 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a2884c-f8ba-45b0-9785-3b7804824483 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:12.175188 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c40bea-2899-47a7-9485-1ec9b94c843c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:12.176651 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c40bea-2899-47a7-9485-1ec9b94c843c service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:12.192027 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4205/8384] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:20:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:20:12.198308 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4180/8385] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:20:12 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:20:12.203049 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c40bea-2899-47a7-9485-1ec9b94c843c service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:12.213657 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c40bea-2899-47a7-9485-1ec9b94c843c service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:12.279699 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5ad3c-abe1-4551-bdf5-cee466c96ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:12.280324 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5ad3c-abe1-4551-bdf5-cee466c96ea7 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:12.280603 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5ad3c-abe1-4551-bdf5-cee466c96ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:12.280902 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5ad3c-abe1-4551-bdf5-cee466c96ea7 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:12.281537 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb5ad3c-abe1-4551-bdf5-cee466c96ea7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:12.283506 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb5ad3c-abe1-4551-bdf5-cee466c96ea7 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:12.307616 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4206/8386] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:20:12 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:20:12.312317 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2884c-f8ba-45b0-9785-3b7804824483 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:12.325237 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2884c-f8ba-45b0-9785-3b7804824483 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:12.330336 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f42ab-1956-4332-b428-60826868dfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:12.331047 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f42ab-1956-4332-b428-60826868dfa9 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:12.331418 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f42ab-1956-4332-b428-60826868dfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:12.331841 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f42ab-1956-4332-b428-60826868dfa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:12.332497 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f42ab-1956-4332-b428-60826868dfa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:12.334103 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f42ab-1956-4332-b428-60826868dfa9 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:12.348858 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4181/8387] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:20:12.350109 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5ad3c-abe1-4551-bdf5-cee466c96ea7 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:12.357698 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:12.361640 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5ad3c-abe1-4551-bdf5-cee466c96ea7 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:12.372304 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8d611-2f65-4c8e-9f29-cce4fbad069b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:12.372922 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8d611-2f65-4c8e-9f29-cce4fbad069b admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:12.373229 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8d611-2f65-4c8e-9f29-cce4fbad069b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:12.373507 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8d611-2f65-4c8e-9f29-cce4fbad069b admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:12.374149 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c8d611-2f65-4c8e-9f29-cce4fbad069b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:12.376055 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c8d611-2f65-4c8e-9f29-cce4fbad069b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:12.392091 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4207/8388] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:20:12.393344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f42ab-1956-4332-b428-60826868dfa9 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:12.404685 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f42ab-1956-4332-b428-60826868dfa9 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:12.409524 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03519ffd-9f8a-49be-ab16-a674901e048f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:12.410129 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03519ffd-9f8a-49be-ab16-a674901e048f admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:12.410408 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03519ffd-9f8a-49be-ab16-a674901e048f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:12.410811 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03519ffd-9f8a-49be-ab16-a674901e048f admin admin] PATH_INFO: `/v3/projects/68ffdd23ad1b49169664e57e4203f3fb/users/b9b120f9d5704273871868b1924955c1/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:12.427667 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03519ffd-9f8a-49be-ab16-a674901e048f admin admin] RBAC: Authorizing `identity:create_grant(project_id=68ffdd23ad1b49169664e57e4203f3fb, user_id=b9b120f9d5704273871868b1924955c1, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:12.432010 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03519ffd-9f8a-49be-ab16-a674901e048f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:12.457808 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4182/8389] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:20:12 2022] PUT /identity/v3/projects/68ffdd23ad1b49169664e57e4203f3fb/users/b9b120f9d5704273871868b1924955c1/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:20:12.459519 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fae43-1a13-420b-9e1e-130cb72ba2ad None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:12.459743 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fae43-1a13-420b-9e1e-130cb72ba2ad None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:12.460015 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fae43-1a13-420b-9e1e-130cb72ba2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:12.499985 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-609fae43-1a13-420b-9e1e-130cb72ba2ad None None] MFA Rules not processed for user `b9b120f9d5704273871868b1924955c1`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:12.501216 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-609fae43-1a13-420b-9e1e-130cb72ba2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:12.572070 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4208/8390] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:20:12.578093 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03519ffd-9f8a-49be-ab16-a674901e048f admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:12.599080 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:12.648505 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03519ffd-9f8a-49be-ab16-a674901e048f admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:12.653933 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d98978-a585-4fc0-b346-aacaec38c09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:12.654540 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d98978-a585-4fc0-b346-aacaec38c09d admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:12.654817 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d98978-a585-4fc0-b346-aacaec38c09d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:12.655122 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d98978-a585-4fc0-b346-aacaec38c09d admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:12.655762 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d98978-a585-4fc0-b346-aacaec38c09d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:12.657732 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d98978-a585-4fc0-b346-aacaec38c09d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:12.690204 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4183/8391] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:20:12 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:20:12.691429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609fae43-1a13-420b-9e1e-130cb72ba2ad None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:12.703413 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609fae43-1a13-420b-9e1e-130cb72ba2ad None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:12.765176 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e87e2-da9e-46ff-abfb-c2acb6005d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:12.765795 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e87e2-da9e-46ff-abfb-c2acb6005d2c admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:12.766073 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e87e2-da9e-46ff-abfb-c2acb6005d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:12.766346 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e87e2-da9e-46ff-abfb-c2acb6005d2c admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:12.766984 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e87e2-da9e-46ff-abfb-c2acb6005d2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:12.768938 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e87e2-da9e-46ff-abfb-c2acb6005d2c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:12.791943 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4209/8392] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:20:12 2022] POST /identity/v3/users => generated 298 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:20:12.796635 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d98978-a585-4fc0-b346-aacaec38c09d admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:12.807402 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d98978-a585-4fc0-b346-aacaec38c09d admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:12.812735 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abf221-f107-40b1-95e5-010ad146abb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:12.813418 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abf221-f107-40b1-95e5-010ad146abb6 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:12.813786 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abf221-f107-40b1-95e5-010ad146abb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:12.814095 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abf221-f107-40b1-95e5-010ad146abb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:12.814745 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52abf221-f107-40b1-95e5-010ad146abb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:12.816544 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52abf221-f107-40b1-95e5-010ad146abb6 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:12.827904 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4184/8393] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:20:12.831915 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e87e2-da9e-46ff-abfb-c2acb6005d2c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:12.842807 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e87e2-da9e-46ff-abfb-c2acb6005d2c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:12.847591 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b21b21-1aad-4177-9d0e-11b64de67dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:12.848245 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b21b21-1aad-4177-9d0e-11b64de67dd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:12.848520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b21b21-1aad-4177-9d0e-11b64de67dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:12.848790 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b21b21-1aad-4177-9d0e-11b64de67dd0 admin admin] PATH_INFO: `/v3/projects/d2f8f4d559f445979be93b8e66304531/users/d9f2a9946aa04a5bb35227014074f1ea/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:12.864234 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b21b21-1aad-4177-9d0e-11b64de67dd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2f8f4d559f445979be93b8e66304531, user_id=d9f2a9946aa04a5bb35227014074f1ea, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:12.866885 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b21b21-1aad-4177-9d0e-11b64de67dd0 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:12.882051 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4210/8394] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:20:12 2022] PUT /identity/v3/projects/d2f8f4d559f445979be93b8e66304531/users/d9f2a9946aa04a5bb35227014074f1ea/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:20:12.886188 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abf221-f107-40b1-95e5-010ad146abb6 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:12.896436 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abf221-f107-40b1-95e5-010ad146abb6 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:12.956253 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed71d7-96ae-4472-a1b4-36de26e3c0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:12.956794 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed71d7-96ae-4472-a1b4-36de26e3c0e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:12.957077 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed71d7-96ae-4472-a1b4-36de26e3c0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:12.957356 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed71d7-96ae-4472-a1b4-36de26e3c0e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:12.958012 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ed71d7-96ae-4472-a1b4-36de26e3c0e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:12.959673 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ed71d7-96ae-4472-a1b4-36de26e3c0e9 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:12.973109 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4185/8395] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:20:12.974263 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b21b21-1aad-4177-9d0e-11b64de67dd0 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:12.985649 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b21b21-1aad-4177-9d0e-11b64de67dd0 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:12.990649 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666d7ff-95d1-44b5-8b71-a10bc42d1847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:12.991363 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666d7ff-95d1-44b5-8b71-a10bc42d1847 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:12.991701 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666d7ff-95d1-44b5-8b71-a10bc42d1847 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:12.991951 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666d7ff-95d1-44b5-8b71-a10bc42d1847 admin admin] PATH_INFO: `/v3/projects/d2f8f4d559f445979be93b8e66304531/users/d9f2a9946aa04a5bb35227014074f1ea/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:12.994042 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666d7ff-95d1-44b5-8b71-a10bc42d1847 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2f8f4d559f445979be93b8e66304531, user_id=d9f2a9946aa04a5bb35227014074f1ea, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:12.997834 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666d7ff-95d1-44b5-8b71-a10bc42d1847 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:13.009191 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4211/8396] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:20:12 2022] PUT /identity/v3/projects/d2f8f4d559f445979be93b8e66304531/users/d9f2a9946aa04a5bb35227014074f1ea/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:20:13.020242 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8807a-0af2-4da1-b75b-bffe6237e90b None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:13.020529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8807a-0af2-4da1-b75b-bffe6237e90b None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:13.020811 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8807a-0af2-4da1-b75b-bffe6237e90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:13.051637 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-cfc8807a-0af2-4da1-b75b-bffe6237e90b None None] MFA Rules not processed for user `d9f2a9946aa04a5bb35227014074f1ea`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:13.052865 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-cfc8807a-0af2-4da1-b75b-bffe6237e90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:13.130566 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4186/8397] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:13 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:20:13.143452 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666d7ff-95d1-44b5-8b71-a10bc42d1847 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:13.145208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e666d7ff-95d1-44b5-8b71-a10bc42d1847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:13.160641 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8807a-0af2-4da1-b75b-bffe6237e90b None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:13.162168 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-cfc8807a-0af2-4da1-b75b-bffe6237e90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:13.178128 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:13.190593 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:13.214591 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666d7ff-95d1-44b5-8b71-a10bc42d1847 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:13.220769 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add6eff9-32cd-4917-810f-6d2d05d3db36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:13.221392 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6eff9-32cd-4917-810f-6d2d05d3db36 service cinder] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:13.221680 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6eff9-32cd-4917-810f-6d2d05d3db36 service cinder] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:13.221941 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6eff9-32cd-4917-810f-6d2d05d3db36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:13.233743 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8807a-0af2-4da1-b75b-bffe6237e90b None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:13.238209 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dbcc11-4651-4569-b480-7315f23b422e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:13.238773 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbcc11-4651-4569-b480-7315f23b422e service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:13.239077 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbcc11-4651-4569-b480-7315f23b422e service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:13.239350 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbcc11-4651-4569-b480-7315f23b422e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:13.241380 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-66dbcc11-4651-4569-b480-7315f23b422e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:13.287479 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add6eff9-32cd-4917-810f-6d2d05d3db36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:13.288914 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add6eff9-32cd-4917-810f-6d2d05d3db36 service cinder] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:13.299524 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4212/8398] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:20:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:20:13.309977 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dbcc11-4651-4569-b480-7315f23b422e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:13.311564 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dbcc11-4651-4569-b480-7315f23b422e service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:13.331139 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4187/8399] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:20:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:20:13.462527 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add6eff9-32cd-4917-810f-6d2d05d3db36 service cinder] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:13.481188 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add6eff9-32cd-4917-810f-6d2d05d3db36 service cinder] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:13.485616 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108786aa-8ffd-45f0-91fa-65835f6c0f83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:13.486410 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108786aa-8ffd-45f0-91fa-65835f6c0f83 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:13.489023 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108786aa-8ffd-45f0-91fa-65835f6c0f83 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:13.489308 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108786aa-8ffd-45f0-91fa-65835f6c0f83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:13.492253 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-108786aa-8ffd-45f0-91fa-65835f6c0f83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:13.623815 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108786aa-8ffd-45f0-91fa-65835f6c0f83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:13.625538 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108786aa-8ffd-45f0-91fa-65835f6c0f83 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:13.641934 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4213/8400] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:20:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:20:14.874746 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dbcc11-4651-4569-b480-7315f23b422e service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:14.874746 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-66dbcc11-4651-4569-b480-7315f23b422e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:14.916326 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dbcc11-4651-4569-b480-7315f23b422e service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:14.941178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757c0e7-ce13-45ab-b826-de373366a95e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:14.941991 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757c0e7-ce13-45ab-b826-de373366a95e service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:14.942378 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757c0e7-ce13-45ab-b826-de373366a95e service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:14.942759 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757c0e7-ce13-45ab-b826-de373366a95e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:14.948593 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5757c0e7-ce13-45ab-b826-de373366a95e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:14.990945 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5757c0e7-ce13-45ab-b826-de373366a95e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:14.994716 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5757c0e7-ce13-45ab-b826-de373366a95e service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:15.027170 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4188/8401] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:20:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:20:17.294639 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108786aa-8ffd-45f0-91fa-65835f6c0f83 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:17.303392 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-108786aa-8ffd-45f0-91fa-65835f6c0f83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:17.322458 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108786aa-8ffd-45f0-91fa-65835f6c0f83 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:17.334716 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0458c8a0-0c7e-4ac9-980a-afc417f775b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:17.335426 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458c8a0-0c7e-4ac9-980a-afc417f775b3 service cinder] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:17.335681 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458c8a0-0c7e-4ac9-980a-afc417f775b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:17.336065 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458c8a0-0c7e-4ac9-980a-afc417f775b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:17.346978 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0458c8a0-0c7e-4ac9-980a-afc417f775b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:17.354342 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0458c8a0-0c7e-4ac9-980a-afc417f775b3 service cinder] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:17.359712 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757c0e7-ce13-45ab-b826-de373366a95e service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:17.362700 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4214/8402] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:20:17 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:20:17.380296 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757c0e7-ce13-45ab-b826-de373366a95e service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:17.385428 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ecf084-fc8c-45be-bcef-4dc9ba21abbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:17.387378 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ecf084-fc8c-45be-bcef-4dc9ba21abbd service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:17.387845 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ecf084-fc8c-45be-bcef-4dc9ba21abbd service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:17.388962 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ecf084-fc8c-45be-bcef-4dc9ba21abbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:17.392505 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d9ecf084-fc8c-45be-bcef-4dc9ba21abbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:17.480243 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ecf084-fc8c-45be-bcef-4dc9ba21abbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:17.482172 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ecf084-fc8c-45be-bcef-4dc9ba21abbd service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:17.492913 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4189/8403] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:20:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:20:25.774567 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0458c8a0-0c7e-4ac9-980a-afc417f775b3 service cinder] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:25.776589 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0458c8a0-0c7e-4ac9-980a-afc417f775b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:25.793849 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0458c8a0-0c7e-4ac9-980a-afc417f775b3 service cinder] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:25.798637 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0ba53-366e-4dd2-853b-f378c5d9dc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:25.799370 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0ba53-366e-4dd2-853b-f378c5d9dc95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:25.799744 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0ba53-366e-4dd2-853b-f378c5d9dc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:25.800189 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0ba53-366e-4dd2-853b-f378c5d9dc95 admin admin] PATH_INFO: `/v3/users/5ffcf740d5ac459f8f624437ce64ab74` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:25.801427 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e0ba53-366e-4dd2-853b-f378c5d9dc95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ffcf740d5ac459f8f624437ce64ab74)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:25.803472 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e0ba53-366e-4dd2-853b-f378c5d9dc95 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:25.858422 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-83e0ba53-366e-4dd2-853b-f378c5d9dc95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ffcf740d5ac459f8f624437ce64ab74'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:25.858996 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-83e0ba53-366e-4dd2-853b-f378c5d9dc95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ffcf740d5ac459f8f624437ce64ab74'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:25.867220 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-83e0ba53-366e-4dd2-853b-f378c5d9dc95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ffcf740d5ac459f8f624437ce64ab74'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:25.869281 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:25.875681 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-83e0ba53-366e-4dd2-853b-f378c5d9dc95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ffcf740d5ac459f8f624437ce64ab74'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:25.876427 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-83e0ba53-366e-4dd2-853b-f378c5d9dc95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ffcf740d5ac459f8f624437ce64ab74'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:25.899641 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4215/8404] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:20:25 2022] DELETE /identity/v3/users/5ffcf740d5ac459f8f624437ce64ab74 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:20:26.097675 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ecf084-fc8c-45be-bcef-4dc9ba21abbd service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:26.115362 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ecf084-fc8c-45be-bcef-4dc9ba21abbd service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:26.163575 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:26.190409 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3214a6d-50ef-4975-8fcf-1e6a59398187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:26.191113 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3214a6d-50ef-4975-8fcf-1e6a59398187 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:26.191456 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3214a6d-50ef-4975-8fcf-1e6a59398187 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:26.191736 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3214a6d-50ef-4975-8fcf-1e6a59398187 admin admin] PATH_INFO: `/v3/projects/c91939ee21734b77890428f8d9a337be` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:26.192955 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3214a6d-50ef-4975-8fcf-1e6a59398187 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c91939ee21734b77890428f8d9a337be)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:26.195232 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3214a6d-50ef-4975-8fcf-1e6a59398187 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:26.264145 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a3214a6d-50ef-4975-8fcf-1e6a59398187 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c91939ee21734b77890428f8d9a337be', 'request_id': 'req-a3214a6d-50ef-4975-8fcf-1e6a59398187'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:26.275101 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a3214a6d-50ef-4975-8fcf-1e6a59398187 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c91939ee21734b77890428f8d9a337be', 'request_id': 'req-a3214a6d-50ef-4975-8fcf-1e6a59398187'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:26.286706 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a3214a6d-50ef-4975-8fcf-1e6a59398187 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c91939ee21734b77890428f8d9a337be', 'request_id': 'req-a3214a6d-50ef-4975-8fcf-1e6a59398187'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:26.299914 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a3214a6d-50ef-4975-8fcf-1e6a59398187 admin admin] The token cache is being invalidate because project c91939ee21734b77890428f8d9a337be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:20:26.300214 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a3214a6d-50ef-4975-8fcf-1e6a59398187 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:26.301381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a3214a6d-50ef-4975-8fcf-1e6a59398187 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:26.303123 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4190/8405] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:20:26 2022] DELETE /identity/v3/projects/c91939ee21734b77890428f8d9a337be => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:20:26.307387 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0ba53-366e-4dd2-853b-f378c5d9dc95 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:26.311407 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-83e0ba53-366e-4dd2-853b-f378c5d9dc95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:26.336866 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0ba53-366e-4dd2-853b-f378c5d9dc95 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:26.418593 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e137a9-1a99-4c82-a2ad-b74f8ef16151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:26.419863 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e137a9-1a99-4c82-a2ad-b74f8ef16151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:26.420288 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e137a9-1a99-4c82-a2ad-b74f8ef16151 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:26.420713 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e137a9-1a99-4c82-a2ad-b74f8ef16151 admin admin] PATH_INFO: `/v3/users/150e8c97bd4a489f8e1ec5bc306741e6` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:26.422323 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e137a9-1a99-4c82-a2ad-b74f8ef16151 admin admin] RBAC: Authorizing `identity:delete_user(user_id=150e8c97bd4a489f8e1ec5bc306741e6)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:26.424779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e137a9-1a99-4c82-a2ad-b74f8ef16151 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:26.517261 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3214a6d-50ef-4975-8fcf-1e6a59398187 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:26.518965 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a3214a6d-50ef-4975-8fcf-1e6a59398187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:26.539998 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3214a6d-50ef-4975-8fcf-1e6a59398187 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:26.553216 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-66e137a9-1a99-4c82-a2ad-b74f8ef16151 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '150e8c97bd4a489f8e1ec5bc306741e6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:26.554165 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3552ce7-03a9-405b-b6e5-6a5e49b73b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:26.554820 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3552ce7-03a9-405b-b6e5-6a5e49b73b52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:26.555160 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3552ce7-03a9-405b-b6e5-6a5e49b73b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:26.555476 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3552ce7-03a9-405b-b6e5-6a5e49b73b52 admin admin] PATH_INFO: `/v3/users/b9b120f9d5704273871868b1924955c1` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:26.556543 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-66e137a9-1a99-4c82-a2ad-b74f8ef16151 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '150e8c97bd4a489f8e1ec5bc306741e6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:26.559753 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3552ce7-03a9-405b-b6e5-6a5e49b73b52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9b120f9d5704273871868b1924955c1)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:26.561735 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3552ce7-03a9-405b-b6e5-6a5e49b73b52 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:26.577528 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-66e137a9-1a99-4c82-a2ad-b74f8ef16151 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '150e8c97bd4a489f8e1ec5bc306741e6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:26.587533 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-66e137a9-1a99-4c82-a2ad-b74f8ef16151 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '150e8c97bd4a489f8e1ec5bc306741e6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:26.588623 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-66e137a9-1a99-4c82-a2ad-b74f8ef16151 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '150e8c97bd4a489f8e1ec5bc306741e6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:26.631897 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4216/8406] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:20:26 2022] DELETE /identity/v3/users/150e8c97bd4a489f8e1ec5bc306741e6 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:20:26.669640 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d3552ce7-03a9-405b-b6e5-6a5e49b73b52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9b120f9d5704273871868b1924955c1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:26.670419 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d3552ce7-03a9-405b-b6e5-6a5e49b73b52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9b120f9d5704273871868b1924955c1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:26.695173 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d3552ce7-03a9-405b-b6e5-6a5e49b73b52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9b120f9d5704273871868b1924955c1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:26.723351 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d3552ce7-03a9-405b-b6e5-6a5e49b73b52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9b120f9d5704273871868b1924955c1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:26.736912 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d3552ce7-03a9-405b-b6e5-6a5e49b73b52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9b120f9d5704273871868b1924955c1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:26.751833 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4191/8407] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:20:26 2022] DELETE /identity/v3/users/b9b120f9d5704273871868b1924955c1 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:20:26.754186 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4dd902-15f2-4068-8f87-f4531d8cf72d None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:26.754478 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4dd902-15f2-4068-8f87-f4531d8cf72d None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:26.754755 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4dd902-15f2-4068-8f87-f4531d8cf72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:26.790149 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-ae4dd902-15f2-4068-8f87-f4531d8cf72d None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:26.791481 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ae4dd902-15f2-4068-8f87-f4531d8cf72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:26.891919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:26.906240 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4217/8408] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:20:26.924158 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3552ce7-03a9-405b-b6e5-6a5e49b73b52 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:26.925644 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d3552ce7-03a9-405b-b6e5-6a5e49b73b52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:26.993430 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4dd902-15f2-4068-8f87-f4531d8cf72d None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:26.995129 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ae4dd902-15f2-4068-8f87-f4531d8cf72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:26.999901 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:27.014398 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4dd902-15f2-4068-8f87-f4531d8cf72d None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:27.029825 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e12d09-1263-4b6e-80fa-e1667aa67468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:27.030357 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e12d09-1263-4b6e-80fa-e1667aa67468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:27.030668 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e12d09-1263-4b6e-80fa-e1667aa67468 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:27.031932 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e12d09-1263-4b6e-80fa-e1667aa67468 admin admin] PATH_INFO: `/v3/projects/11ae71ce09c1464e886181510f2f689c` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:27.040241 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e12d09-1263-4b6e-80fa-e1667aa67468 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11ae71ce09c1464e886181510f2f689c)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:27.044931 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3552ce7-03a9-405b-b6e5-6a5e49b73b52 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:27.046668 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e12d09-1263-4b6e-80fa-e1667aa67468 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:27.054422 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9949fde-21c8-41ec-854d-9e73a907c404 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:27.055098 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9949fde-21c8-41ec-854d-9e73a907c404 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:27.055385 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9949fde-21c8-41ec-854d-9e73a907c404 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:27.055646 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9949fde-21c8-41ec-854d-9e73a907c404 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:27.096217 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9949fde-21c8-41ec-854d-9e73a907c404 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:27.100159 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9949fde-21c8-41ec-854d-9e73a907c404 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:27.138065 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4192/8409] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:20:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:20:27.139427 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b8e12d09-1263-4b6e-80fa-e1667aa67468 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11ae71ce09c1464e886181510f2f689c', 'request_id': 'req-b8e12d09-1263-4b6e-80fa-e1667aa67468'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:27.147063 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b8e12d09-1263-4b6e-80fa-e1667aa67468 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11ae71ce09c1464e886181510f2f689c', 'request_id': 'req-b8e12d09-1263-4b6e-80fa-e1667aa67468'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:27.155660 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b8e12d09-1263-4b6e-80fa-e1667aa67468 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11ae71ce09c1464e886181510f2f689c', 'request_id': 'req-b8e12d09-1263-4b6e-80fa-e1667aa67468'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:27.175934 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b8e12d09-1263-4b6e-80fa-e1667aa67468 admin admin] The token cache is being invalidate because project 11ae71ce09c1464e886181510f2f689c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:20:27.177089 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b8e12d09-1263-4b6e-80fa-e1667aa67468 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:27.178500 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b8e12d09-1263-4b6e-80fa-e1667aa67468 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:27.181353 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4218/8410] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:20:26 2022] DELETE /identity/v3/projects/11ae71ce09c1464e886181510f2f689c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:20:27.187263 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c5343-6a20-46b9-b8ed-c1778a24d30d None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:27.187553 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c5343-6a20-46b9-b8ed-c1778a24d30d None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:27.187885 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c5343-6a20-46b9-b8ed-c1778a24d30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:27.212736 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-c06c5343-6a20-46b9-b8ed-c1778a24d30d None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:27.214005 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c06c5343-6a20-46b9-b8ed-c1778a24d30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:27.299757 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4193/8411] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:20:27.301977 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426f118-c8c3-4214-883b-3080a2595ae4 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:27.302674 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426f118-c8c3-4214-883b-3080a2595ae4 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:27.303187 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426f118-c8c3-4214-883b-3080a2595ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:27.356681 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-d426f118-c8c3-4214-883b-3080a2595ae4 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:27.357921 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d426f118-c8c3-4214-883b-3080a2595ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:27.373874 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4219/8412] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:20:27.378914 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c5343-6a20-46b9-b8ed-c1778a24d30d None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:27.393805 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c5343-6a20-46b9-b8ed-c1778a24d30d None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:27.401217 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9944ec6-299d-420e-9c77-ad56fddc3276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:27.402909 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9944ec6-299d-420e-9c77-ad56fddc3276 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:27.403231 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9944ec6-299d-420e-9c77-ad56fddc3276 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:27.403698 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9944ec6-299d-420e-9c77-ad56fddc3276 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:27.404836 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9944ec6-299d-420e-9c77-ad56fddc3276 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:20:27.405355 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9944ec6-299d-420e-9c77-ad56fddc3276 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:27.408410 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9944ec6-299d-420e-9c77-ad56fddc3276 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:27.429658 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4194/8413] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:20:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:20:27.435009 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426f118-c8c3-4214-883b-3080a2595ae4 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:27.444720 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426f118-c8c3-4214-883b-3080a2595ae4 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:27.453556 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf7275-4bca-4e85-bde3-08af070a6df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:27.454206 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf7275-4bca-4e85-bde3-08af070a6df5 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:27.454489 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf7275-4bca-4e85-bde3-08af070a6df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:27.454762 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf7275-4bca-4e85-bde3-08af070a6df5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:27.455617 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf7275-4bca-4e85-bde3-08af070a6df5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:27.457799 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf7275-4bca-4e85-bde3-08af070a6df5 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:27.500523 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4220/8414] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:20:27 2022] POST /identity/v3/projects => generated 377 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:20:27.502534 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9944ec6-299d-420e-9c77-ad56fddc3276 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:27.516439 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9944ec6-299d-420e-9c77-ad56fddc3276 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:27.548064 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf7275-4bca-4e85-bde3-08af070a6df5 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:27.550033 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-71bf7275-4bca-4e85-bde3-08af070a6df5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:27.641178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72039c2b-7795-4c13-a144-ec10a2d3d6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:27.642466 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72039c2b-7795-4c13-a144-ec10a2d3d6df admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:27.642965 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72039c2b-7795-4c13-a144-ec10a2d3d6df admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:27.643479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72039c2b-7795-4c13-a144-ec10a2d3d6df admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:27.644544 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72039c2b-7795-4c13-a144-ec10a2d3d6df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:27.645496 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf7275-4bca-4e85-bde3-08af070a6df5 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:27.647488 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72039c2b-7795-4c13-a144-ec10a2d3d6df admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:27.650483 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac4e45-7c6e-494d-a767-d8074875c1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:27.651479 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac4e45-7c6e-494d-a767-d8074875c1f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:27.651696 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac4e45-7c6e-494d-a767-d8074875c1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:27.652237 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac4e45-7c6e-494d-a767-d8074875c1f9 admin admin] PATH_INFO: `/v3/projects/68ffdd23ad1b49169664e57e4203f3fb` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:27.654343 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ac4e45-7c6e-494d-a767-d8074875c1f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68ffdd23ad1b49169664e57e4203f3fb)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:27.656536 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ac4e45-7c6e-494d-a767-d8074875c1f9 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:27.678685 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4195/8415] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:20:27 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:20:27.683094 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72039c2b-7795-4c13-a144-ec10a2d3d6df admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:27.696519 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72039c2b-7795-4c13-a144-ec10a2d3d6df admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:27.703101 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa19baf-3ab0-488c-ac7a-8558d5986b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:27.703516 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa19baf-3ab0-488c-ac7a-8558d5986b1e admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:27.703842 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa19baf-3ab0-488c-ac7a-8558d5986b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:27.704216 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa19baf-3ab0-488c-ac7a-8558d5986b1e admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:27.704884 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa19baf-3ab0-488c-ac7a-8558d5986b1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:27.706820 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa19baf-3ab0-488c-ac7a-8558d5986b1e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:27.720214 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-93ac4e45-7c6e-494d-a767-d8074875c1f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68ffdd23ad1b49169664e57e4203f3fb', 'request_id': 'req-93ac4e45-7c6e-494d-a767-d8074875c1f9'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:27.721607 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:27.721954 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4196/8416] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:20:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:20:27.727279 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa19baf-3ab0-488c-ac7a-8558d5986b1e admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:27.728328 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-93ac4e45-7c6e-494d-a767-d8074875c1f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68ffdd23ad1b49169664e57e4203f3fb', 'request_id': 'req-93ac4e45-7c6e-494d-a767-d8074875c1f9'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:27.737136 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-93ac4e45-7c6e-494d-a767-d8074875c1f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68ffdd23ad1b49169664e57e4203f3fb', 'request_id': 'req-93ac4e45-7c6e-494d-a767-d8074875c1f9'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:27.740515 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa19baf-3ab0-488c-ac7a-8558d5986b1e admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:27.769937 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-93ac4e45-7c6e-494d-a767-d8074875c1f9 admin admin] The token cache is being invalidate because project 68ffdd23ad1b49169664e57e4203f3fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:20:27.770621 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-93ac4e45-7c6e-494d-a767-d8074875c1f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:27.771659 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-93ac4e45-7c6e-494d-a767-d8074875c1f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:27.774903 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4221/8417] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:20:27 2022] DELETE /identity/v3/projects/68ffdd23ad1b49169664e57e4203f3fb => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:20:27.780179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac4e45-7c6e-494d-a767-d8074875c1f9 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:27.783593 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-93ac4e45-7c6e-494d-a767-d8074875c1f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:27.810485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:27.840643 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a65e1e-ebff-4ef1-b166-024e43374c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:27.843724 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a65e1e-ebff-4ef1-b166-024e43374c18 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:27.844010 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a65e1e-ebff-4ef1-b166-024e43374c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:27.844288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a65e1e-ebff-4ef1-b166-024e43374c18 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:27.847226 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a65e1e-ebff-4ef1-b166-024e43374c18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:27.850339 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a65e1e-ebff-4ef1-b166-024e43374c18 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:27.863184 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4197/8418] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:20:27 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:20:27.869522 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a65e1e-ebff-4ef1-b166-024e43374c18 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:27.871000 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-96a65e1e-ebff-4ef1-b166-024e43374c18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:27.886345 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a65e1e-ebff-4ef1-b166-024e43374c18 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:27.891297 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14ff11-47fb-420e-8f59-277919d2fd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:27.891979 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14ff11-47fb-420e-8f59-277919d2fd53 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:27.892261 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14ff11-47fb-420e-8f59-277919d2fd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:27.892539 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14ff11-47fb-420e-8f59-277919d2fd53 admin admin] PATH_INFO: `/v3/projects/3e4f468e4b694771b47f56110a9ed798/users/616303b5564840e3bb07d4c9c22c2049/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:27.895983 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac4e45-7c6e-494d-a767-d8074875c1f9 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:27.901824 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d79848-ff11-43b9-bb2e-7a5bce03abc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:27.903243 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d79848-ff11-43b9-bb2e-7a5bce03abc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:27.905225 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d79848-ff11-43b9-bb2e-7a5bce03abc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:27.905828 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d79848-ff11-43b9-bb2e-7a5bce03abc1 admin admin] PATH_INFO: `/v3/users/d9f2a9946aa04a5bb35227014074f1ea` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:27.908246 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d79848-ff11-43b9-bb2e-7a5bce03abc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9f2a9946aa04a5bb35227014074f1ea)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:27.912909 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d79848-ff11-43b9-bb2e-7a5bce03abc1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:27.945917 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc14ff11-47fb-420e-8f59-277919d2fd53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e4f468e4b694771b47f56110a9ed798, user_id=616303b5564840e3bb07d4c9c22c2049, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:27.949978 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc14ff11-47fb-420e-8f59-277919d2fd53 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:27.973175 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4198/8419] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:20:27 2022] PUT /identity/v3/projects/3e4f468e4b694771b47f56110a9ed798/users/616303b5564840e3bb07d4c9c22c2049/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:20:27.978004 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b03ea-3977-4f92-bc2c-000d7e34a425 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:27.978296 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b03ea-3977-4f92-bc2c-000d7e34a425 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:27.978573 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b03ea-3977-4f92-bc2c-000d7e34a425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:28.007502 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-fb4b03ea-3977-4f92-bc2c-000d7e34a425 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:28.008739 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-fb4b03ea-3977-4f92-bc2c-000d7e34a425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:28.057239 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-78d79848-ff11-43b9-bb2e-7a5bce03abc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9f2a9946aa04a5bb35227014074f1ea'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:28.059843 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-78d79848-ff11-43b9-bb2e-7a5bce03abc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9f2a9946aa04a5bb35227014074f1ea'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:28.071266 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-78d79848-ff11-43b9-bb2e-7a5bce03abc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9f2a9946aa04a5bb35227014074f1ea'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:28.081690 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-78d79848-ff11-43b9-bb2e-7a5bce03abc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9f2a9946aa04a5bb35227014074f1ea'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:28.082368 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-78d79848-ff11-43b9-bb2e-7a5bce03abc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9f2a9946aa04a5bb35227014074f1ea'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:28.096163 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4199/8420] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:20:28.104740 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4222/8421] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:20:27 2022] DELETE /identity/v3/users/d9f2a9946aa04a5bb35227014074f1ea => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:20:28.108470 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b03ea-3977-4f92-bc2c-000d7e34a425 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:28.112307 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-fb4b03ea-3977-4f92-bc2c-000d7e34a425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:28.193854 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b03ea-3977-4f92-bc2c-000d7e34a425 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:28.252991 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13450b6c-6f5d-4db0-a978-e8da89648b7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:28.253607 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13450b6c-6f5d-4db0-a978-e8da89648b7d service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:28.253890 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13450b6c-6f5d-4db0-a978-e8da89648b7d service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:28.254165 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13450b6c-6f5d-4db0-a978-e8da89648b7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:28.441500 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:28.447357 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d79848-ff11-43b9-bb2e-7a5bce03abc1 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:28.449576 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-78d79848-ff11-43b9-bb2e-7a5bce03abc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:28.499791 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13450b6c-6f5d-4db0-a978-e8da89648b7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:28.501745 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13450b6c-6f5d-4db0-a978-e8da89648b7d service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:28.516136 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4200/8422] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:20:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:20:28.523828 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:28.529200 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d79848-ff11-43b9-bb2e-7a5bce03abc1 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:28.542878 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c311403-41eb-468e-9a0c-7bf63be3e74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:28.544172 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c311403-41eb-468e-9a0c-7bf63be3e74b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:28.545564 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c311403-41eb-468e-9a0c-7bf63be3e74b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:28.545870 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c311403-41eb-468e-9a0c-7bf63be3e74b admin admin] PATH_INFO: `/v3/projects/d2f8f4d559f445979be93b8e66304531` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:28.547523 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c311403-41eb-468e-9a0c-7bf63be3e74b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2f8f4d559f445979be93b8e66304531)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:28.549528 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c311403-41eb-468e-9a0c-7bf63be3e74b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:28.624454 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9c311403-41eb-468e-9a0c-7bf63be3e74b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2f8f4d559f445979be93b8e66304531', 'request_id': 'req-9c311403-41eb-468e-9a0c-7bf63be3e74b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:28.631867 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9c311403-41eb-468e-9a0c-7bf63be3e74b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2f8f4d559f445979be93b8e66304531', 'request_id': 'req-9c311403-41eb-468e-9a0c-7bf63be3e74b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:28.640203 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9c311403-41eb-468e-9a0c-7bf63be3e74b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2f8f4d559f445979be93b8e66304531', 'request_id': 'req-9c311403-41eb-468e-9a0c-7bf63be3e74b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:28.656803 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9c311403-41eb-468e-9a0c-7bf63be3e74b admin admin] The token cache is being invalidate because project d2f8f4d559f445979be93b8e66304531 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:20:28.657139 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9c311403-41eb-468e-9a0c-7bf63be3e74b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:28.657886 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9c311403-41eb-468e-9a0c-7bf63be3e74b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:28.660013 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4223/8423] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:20:28 2022] DELETE /identity/v3/projects/d2f8f4d559f445979be93b8e66304531 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:20:28.665923 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e702be-9f39-4830-9e56-6698ae288187 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:28.666574 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e702be-9f39-4830-9e56-6698ae288187 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:28.666948 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e702be-9f39-4830-9e56-6698ae288187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:28.709549 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-24e702be-9f39-4830-9e56-6698ae288187 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:28.714321 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-24e702be-9f39-4830-9e56-6698ae288187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:28.798915 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4201/8424] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:20:28.816017 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076e884-bd6c-4ee1-bdff-27e20ddc8c91 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:28.816433 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076e884-bd6c-4ee1-bdff-27e20ddc8c91 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:28.816786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076e884-bd6c-4ee1-bdff-27e20ddc8c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:28.844509 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-e076e884-bd6c-4ee1-bdff-27e20ddc8c91 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:28.846043 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e076e884-bd6c-4ee1-bdff-27e20ddc8c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:28.855909 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4224/8425] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:20:28.862916 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e702be-9f39-4830-9e56-6698ae288187 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:28.876685 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e702be-9f39-4830-9e56-6698ae288187 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:28.890426 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4deeca-93ed-4b15-85ec-46e1c7493729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:28.890426 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4deeca-93ed-4b15-85ec-46e1c7493729 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:28.890426 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4deeca-93ed-4b15-85ec-46e1c7493729 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:28.890426 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4deeca-93ed-4b15-85ec-46e1c7493729 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:28.890906 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4deeca-93ed-4b15-85ec-46e1c7493729 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:20:28.890906 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4deeca-93ed-4b15-85ec-46e1c7493729 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:28.890906 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4deeca-93ed-4b15-85ec-46e1c7493729 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:28.902511 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4202/8426] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:20:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:20:28.906923 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076e884-bd6c-4ee1-bdff-27e20ddc8c91 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:28.917094 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076e884-bd6c-4ee1-bdff-27e20ddc8c91 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:28.931013 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284f11a0-09a9-4cfa-8b76-5149556c2360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:28.931821 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f11a0-09a9-4cfa-8b76-5149556c2360 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:28.932189 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f11a0-09a9-4cfa-8b76-5149556c2360 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:28.932539 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f11a0-09a9-4cfa-8b76-5149556c2360 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:28.934640 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284f11a0-09a9-4cfa-8b76-5149556c2360 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:28.936281 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284f11a0-09a9-4cfa-8b76-5149556c2360 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:28.982715 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4225/8427] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:20:28 2022] POST /identity/v3/projects => generated 385 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:20:28.983766 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4deeca-93ed-4b15-85ec-46e1c7493729 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:28.997264 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4deeca-93ed-4b15-85ec-46e1c7493729 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:29.068437 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a744c8b-7c08-467d-92f7-cebdf17feebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:29.069134 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a744c8b-7c08-467d-92f7-cebdf17feebd admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:29.069487 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a744c8b-7c08-467d-92f7-cebdf17feebd admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:29.069832 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a744c8b-7c08-467d-92f7-cebdf17feebd admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:29.070611 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a744c8b-7c08-467d-92f7-cebdf17feebd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:29.072643 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a744c8b-7c08-467d-92f7-cebdf17feebd admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:29.097239 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4203/8428] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:20:28 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:20:29.101527 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284f11a0-09a9-4cfa-8b76-5149556c2360 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:29.114001 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284f11a0-09a9-4cfa-8b76-5149556c2360 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:29.119561 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7004e3-1a43-4271-9889-33f1e44e7691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:29.120314 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7004e3-1a43-4271-9889-33f1e44e7691 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:29.120925 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7004e3-1a43-4271-9889-33f1e44e7691 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:29.121918 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7004e3-1a43-4271-9889-33f1e44e7691 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:29.122983 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7004e3-1a43-4271-9889-33f1e44e7691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:29.124944 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7004e3-1a43-4271-9889-33f1e44e7691 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:29.139753 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4226/8429] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:20:29.143489 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a744c8b-7c08-467d-92f7-cebdf17feebd admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:29.157437 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a744c8b-7c08-467d-92f7-cebdf17feebd admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:29.163964 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f7235-633e-49fc-8d16-5a0a28ab9c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:29.164678 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f7235-633e-49fc-8d16-5a0a28ab9c62 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:29.165013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f7235-633e-49fc-8d16-5a0a28ab9c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:29.165285 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f7235-633e-49fc-8d16-5a0a28ab9c62 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:29.166110 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1f7235-633e-49fc-8d16-5a0a28ab9c62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:29.168014 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1f7235-633e-49fc-8d16-5a0a28ab9c62 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:29.178944 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4204/8430] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:20:29.183470 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7004e3-1a43-4271-9889-33f1e44e7691 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:29.194539 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7004e3-1a43-4271-9889-33f1e44e7691 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:29.200120 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c15446-9c15-4f8a-949e-2d6ac63c760f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:29.200804 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c15446-9c15-4f8a-949e-2d6ac63c760f admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:29.201099 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c15446-9c15-4f8a-949e-2d6ac63c760f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:29.201362 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c15446-9c15-4f8a-949e-2d6ac63c760f admin admin] PATH_INFO: `/v3/projects/f64e062090ab496e88701cf6835d7d10/users/3cfe939370fe4c4e99961bd0cf4f690f/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:29.219238 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c15446-9c15-4f8a-949e-2d6ac63c760f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f64e062090ab496e88701cf6835d7d10, user_id=3cfe939370fe4c4e99961bd0cf4f690f, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:29.221898 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c15446-9c15-4f8a-949e-2d6ac63c760f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:29.239786 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4227/8431] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:20:29 2022] PUT /identity/v3/projects/f64e062090ab496e88701cf6835d7d10/users/3cfe939370fe4c4e99961bd0cf4f690f/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:20:29.250749 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e62b6-0cc6-4591-bd5c-77d4e7ddc240 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:29.250937 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e62b6-0cc6-4591-bd5c-77d4e7ddc240 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:29.251242 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e62b6-0cc6-4591-bd5c-77d4e7ddc240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:29.284758 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-425e62b6-0cc6-4591-bd5c-77d4e7ddc240 None None] MFA Rules not processed for user `3cfe939370fe4c4e99961bd0cf4f690f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:29.286093 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-425e62b6-0cc6-4591-bd5c-77d4e7ddc240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:29.310649 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:29.382174 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4205/8432] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:20:29.387541 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c15446-9c15-4f8a-949e-2d6ac63c760f admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:29.478397 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c15446-9c15-4f8a-949e-2d6ac63c760f admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:29.485386 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52700dcf-691d-48b9-9539-7ad23e2b3ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:29.486071 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52700dcf-691d-48b9-9539-7ad23e2b3ec6 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:29.486345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52700dcf-691d-48b9-9539-7ad23e2b3ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:29.486672 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52700dcf-691d-48b9-9539-7ad23e2b3ec6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:29.487434 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52700dcf-691d-48b9-9539-7ad23e2b3ec6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:29.490872 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52700dcf-691d-48b9-9539-7ad23e2b3ec6 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:29.526747 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4228/8433] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:20:29 2022] POST /identity/v3/projects => generated 387 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:20:29.530349 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e62b6-0cc6-4591-bd5c-77d4e7ddc240 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:29.543225 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e62b6-0cc6-4591-bd5c-77d4e7ddc240 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:29.622972 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d77b80-ed93-405c-8cda-45326ad39ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:29.623709 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d77b80-ed93-405c-8cda-45326ad39ea4 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:29.624008 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d77b80-ed93-405c-8cda-45326ad39ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:29.624286 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d77b80-ed93-405c-8cda-45326ad39ea4 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:29.624952 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d77b80-ed93-405c-8cda-45326ad39ea4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:29.626964 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d77b80-ed93-405c-8cda-45326ad39ea4 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:29.658526 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4206/8434] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:20:29 2022] POST /identity/v3/users => generated 294 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:20:29.660232 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52700dcf-691d-48b9-9539-7ad23e2b3ec6 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:29.680725 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52700dcf-691d-48b9-9539-7ad23e2b3ec6 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:29.688642 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60312732-8a3e-44d7-a87b-d672ffdd4246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:29.689822 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60312732-8a3e-44d7-a87b-d672ffdd4246 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:29.690201 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60312732-8a3e-44d7-a87b-d672ffdd4246 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:29.690542 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60312732-8a3e-44d7-a87b-d672ffdd4246 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:29.691882 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60312732-8a3e-44d7-a87b-d672ffdd4246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:29.694531 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60312732-8a3e-44d7-a87b-d672ffdd4246 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:29.698140 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:29.720327 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4229/8435] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:20:29.721930 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d77b80-ed93-405c-8cda-45326ad39ea4 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:29.737650 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d77b80-ed93-405c-8cda-45326ad39ea4 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:29.754951 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61626078-f33b-466d-9e5f-adec93dc3554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:29.755627 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61626078-f33b-466d-9e5f-adec93dc3554 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:29.755892 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61626078-f33b-466d-9e5f-adec93dc3554 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:29.756159 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61626078-f33b-466d-9e5f-adec93dc3554 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:29.756808 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61626078-f33b-466d-9e5f-adec93dc3554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:29.758653 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61626078-f33b-466d-9e5f-adec93dc3554 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:29.776221 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4207/8436] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:20:29.781492 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60312732-8a3e-44d7-a87b-d672ffdd4246 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:29.799672 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60312732-8a3e-44d7-a87b-d672ffdd4246 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:29.805214 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21febd-5c56-41bf-8367-d1e86fdbf6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:29.806067 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21febd-5c56-41bf-8367-d1e86fdbf6ad admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:29.806442 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21febd-5c56-41bf-8367-d1e86fdbf6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:29.806808 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21febd-5c56-41bf-8367-d1e86fdbf6ad admin admin] PATH_INFO: `/v3/projects/85c0a1941a204913afe2c543a47b3e54/users/1748817538254458aeb33027fbc63f20/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:29.830624 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f21febd-5c56-41bf-8367-d1e86fdbf6ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=85c0a1941a204913afe2c543a47b3e54, user_id=1748817538254458aeb33027fbc63f20, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:29.833766 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f21febd-5c56-41bf-8367-d1e86fdbf6ad admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:29.852743 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4230/8437] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:20:29 2022] PUT /identity/v3/projects/85c0a1941a204913afe2c543a47b3e54/users/1748817538254458aeb33027fbc63f20/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:20:29.865274 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ee765-2fc4-4f52-b079-bceac13e16f5 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:29.865604 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ee765-2fc4-4f52-b079-bceac13e16f5 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:29.865893 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ee765-2fc4-4f52-b079-bceac13e16f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:29.925781 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-8f5ee765-2fc4-4f52-b079-bceac13e16f5 None None] MFA Rules not processed for user `1748817538254458aeb33027fbc63f20`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:29.928205 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8f5ee765-2fc4-4f52-b079-bceac13e16f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:30.057340 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4208/8438] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:20:30.063449 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21febd-5c56-41bf-8367-d1e86fdbf6ad admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:30.204218 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21febd-5c56-41bf-8367-d1e86fdbf6ad admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:30.209487 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74275871-b5ad-4fa4-b5ac-47d54c8e073a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:30.210194 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74275871-b5ad-4fa4-b5ac-47d54c8e073a admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:30.210470 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74275871-b5ad-4fa4-b5ac-47d54c8e073a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:30.210854 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74275871-b5ad-4fa4-b5ac-47d54c8e073a admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:30.215939 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74275871-b5ad-4fa4-b5ac-47d54c8e073a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:30.219538 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74275871-b5ad-4fa4-b5ac-47d54c8e073a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:30.269328 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4231/8439] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:20:30 2022] POST /identity/v3/projects => generated 387 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:20:30.273401 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5ee765-2fc4-4f52-b079-bceac13e16f5 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:30.288209 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5ee765-2fc4-4f52-b079-bceac13e16f5 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:30.334750 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:30.428883 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3df0ef-ec65-4074-8571-81fa85642844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:30.429602 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3df0ef-ec65-4074-8571-81fa85642844 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:30.429966 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3df0ef-ec65-4074-8571-81fa85642844 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:30.430348 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3df0ef-ec65-4074-8571-81fa85642844 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:30.431258 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3df0ef-ec65-4074-8571-81fa85642844 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:30.433741 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3df0ef-ec65-4074-8571-81fa85642844 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:30.489911 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4209/8440] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:20:30 2022] POST /identity/v3/users => generated 300 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:20:30.494485 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74275871-b5ad-4fa4-b5ac-47d54c8e073a admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:30.507997 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74275871-b5ad-4fa4-b5ac-47d54c8e073a admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:30.520642 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da5cd46-eed4-4a89-8afd-8dd6e2c8d6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:30.521558 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5cd46-eed4-4a89-8afd-8dd6e2c8d6f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:30.521840 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5cd46-eed4-4a89-8afd-8dd6e2c8d6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:30.522116 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5cd46-eed4-4a89-8afd-8dd6e2c8d6f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:30.522774 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da5cd46-eed4-4a89-8afd-8dd6e2c8d6f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:30.524462 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da5cd46-eed4-4a89-8afd-8dd6e2c8d6f6 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:30.542414 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4232/8441] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:20:30.546729 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3df0ef-ec65-4074-8571-81fa85642844 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:30.557930 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3df0ef-ec65-4074-8571-81fa85642844 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:30.580437 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7e28a-4bce-416d-a373-cf5479358255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:30.581692 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7e28a-4bce-416d-a373-cf5479358255 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:30.582773 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7e28a-4bce-416d-a373-cf5479358255 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:30.583290 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7e28a-4bce-416d-a373-cf5479358255 admin admin] PATH_INFO: `/v3/projects/03b971af9ab54d0b91d7b9fc5f220edf/users/54dd8468821349b89e0cb5a0f9ba9ec8/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:30.611891 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f7e28a-4bce-416d-a373-cf5479358255 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03b971af9ab54d0b91d7b9fc5f220edf, user_id=54dd8468821349b89e0cb5a0f9ba9ec8, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:30.614959 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f7e28a-4bce-416d-a373-cf5479358255 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:30.634176 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4210/8442] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:20:30 2022] PUT /identity/v3/projects/03b971af9ab54d0b91d7b9fc5f220edf/users/54dd8468821349b89e0cb5a0f9ba9ec8/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:20:30.638542 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da5cd46-eed4-4a89-8afd-8dd6e2c8d6f6 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:30.649654 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da5cd46-eed4-4a89-8afd-8dd6e2c8d6f6 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:30.754565 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae18f7-4922-4023-bd6d-e784ae698b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:30.755469 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae18f7-4922-4023-bd6d-e784ae698b1a admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:30.755826 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae18f7-4922-4023-bd6d-e784ae698b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:30.756167 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae18f7-4922-4023-bd6d-e784ae698b1a admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:30.756893 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae18f7-4922-4023-bd6d-e784ae698b1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:30.758654 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae18f7-4922-4023-bd6d-e784ae698b1a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:30.775923 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7e28a-4bce-416d-a373-cf5479358255 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:30.784996 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4233/8443] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:20:30.790858 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7e28a-4bce-416d-a373-cf5479358255 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:30.797108 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197f928-4a6e-4f07-b80b-7338dadf12b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:30.797956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197f928-4a6e-4f07-b80b-7338dadf12b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:30.798326 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197f928-4a6e-4f07-b80b-7338dadf12b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:30.798699 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197f928-4a6e-4f07-b80b-7338dadf12b3 admin admin] PATH_INFO: `/v3/projects/03b971af9ab54d0b91d7b9fc5f220edf/users/54dd8468821349b89e0cb5a0f9ba9ec8/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:30.801167 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6197f928-4a6e-4f07-b80b-7338dadf12b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03b971af9ab54d0b91d7b9fc5f220edf, user_id=54dd8468821349b89e0cb5a0f9ba9ec8, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:30.804078 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6197f928-4a6e-4f07-b80b-7338dadf12b3 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:30.818373 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4211/8444] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:20:30 2022] PUT /identity/v3/projects/03b971af9ab54d0b91d7b9fc5f220edf/users/54dd8468821349b89e0cb5a0f9ba9ec8/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:20:30.830648 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffd4c4-30ea-40b9-b50b-562b3b4eae71 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:30.831005 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffd4c4-30ea-40b9-b50b-562b3b4eae71 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:30.831393 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffd4c4-30ea-40b9-b50b-562b3b4eae71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:30.874953 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-ffffd4c4-30ea-40b9-b50b-562b3b4eae71 None None] MFA Rules not processed for user `54dd8468821349b89e0cb5a0f9ba9ec8`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:30.876823 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ffffd4c4-30ea-40b9-b50b-562b3b4eae71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:30.920790 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:30.975552 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4234/8445] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:30 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:20:30.987957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197f928-4a6e-4f07-b80b-7338dadf12b3 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:30.989979 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6197f928-4a6e-4f07-b80b-7338dadf12b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:31.085785 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197f928-4a6e-4f07-b80b-7338dadf12b3 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:31.091870 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c984d83a-a8f4-4307-9bec-a5450cfb6262 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:31.092706 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984d83a-a8f4-4307-9bec-a5450cfb6262 service cinder] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:31.093111 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984d83a-a8f4-4307-9bec-a5450cfb6262 service cinder] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:31.093498 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984d83a-a8f4-4307-9bec-a5450cfb6262 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:31.108939 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c984d83a-a8f4-4307-9bec-a5450cfb6262 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:31.111220 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c984d83a-a8f4-4307-9bec-a5450cfb6262 service cinder] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:31.127895 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4212/8446] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:20:30 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:20:31.895254 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffffd4c4-30ea-40b9-b50b-562b3b4eae71 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:31.898731 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ffffd4c4-30ea-40b9-b50b-562b3b4eae71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:31.916217 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffffd4c4-30ea-40b9-b50b-562b3b4eae71 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:31.922547 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d23ba-e4f0-43bc-8d4e-28665623ca40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:31.923881 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d23ba-e4f0-43bc-8d4e-28665623ca40 service cinder] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:31.924348 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d23ba-e4f0-43bc-8d4e-28665623ca40 service cinder] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:31.924899 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d23ba-e4f0-43bc-8d4e-28665623ca40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:32.022105 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d23ba-e4f0-43bc-8d4e-28665623ca40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:32.023660 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d23ba-e4f0-43bc-8d4e-28665623ca40 service cinder] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:32.044726 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4235/8447] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:20:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:20:34.477943 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ea92f-258f-444f-9222-8a7f328bb8be None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:34.478502 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ea92f-258f-444f-9222-8a7f328bb8be None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:34.478502 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ea92f-258f-444f-9222-8a7f328bb8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:34.531002 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-a95ea92f-258f-444f-9222-8a7f328bb8be None None] MFA Rules not processed for user `616303b5564840e3bb07d4c9c22c2049`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:34.532413 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a95ea92f-258f-444f-9222-8a7f328bb8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:34.699700 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4213/8448] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:20:34.703891 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d23ba-e4f0-43bc-8d4e-28665623ca40 service cinder] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:34.705447 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c56d23ba-e4f0-43bc-8d4e-28665623ca40 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:34.896914 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d23ba-e4f0-43bc-8d4e-28665623ca40 service cinder] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:34.913289 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea2823-0582-45d4-81be-bc097ca1526b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:34.914388 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea2823-0582-45d4-81be-bc097ca1526b admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:34.914790 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea2823-0582-45d4-81be-bc097ca1526b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:34.915223 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea2823-0582-45d4-81be-bc097ca1526b admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:34.915985 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ea2823-0582-45d4-81be-bc097ca1526b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:34.918728 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ea2823-0582-45d4-81be-bc097ca1526b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:34.967287 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4236/8449] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:20:34 2022] POST /identity/v3/projects => generated 377 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:20:34.970028 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ea92f-258f-444f-9222-8a7f328bb8be None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:34.984152 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ea92f-258f-444f-9222-8a7f328bb8be None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:35.006671 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:35.088826 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0bef8-5793-4914-bf05-6fef9fff011a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:35.089794 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0bef8-5793-4914-bf05-6fef9fff011a admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:35.090078 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0bef8-5793-4914-bf05-6fef9fff011a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:35.090430 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0bef8-5793-4914-bf05-6fef9fff011a admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:35.091378 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee0bef8-5793-4914-bf05-6fef9fff011a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:35.093733 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee0bef8-5793-4914-bf05-6fef9fff011a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:35.123093 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4214/8450] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:20:34 2022] POST /identity/v3/users => generated 295 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:20:35.128046 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea2823-0582-45d4-81be-bc097ca1526b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:35.138681 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea2823-0582-45d4-81be-bc097ca1526b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:35.143866 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b0acc-124a-4e06-8a60-66cee55fefc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:35.144728 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b0acc-124a-4e06-8a60-66cee55fefc0 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:35.144728 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b0acc-124a-4e06-8a60-66cee55fefc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:35.144940 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b0acc-124a-4e06-8a60-66cee55fefc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:35.145617 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b0acc-124a-4e06-8a60-66cee55fefc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:35.147308 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b0acc-124a-4e06-8a60-66cee55fefc0 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:35.158868 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4237/8451] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:20:35.162753 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0bef8-5793-4914-bf05-6fef9fff011a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:35.177992 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0bef8-5793-4914-bf05-6fef9fff011a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:35.186169 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47073da1-d8d7-4590-85ec-359d7a34dade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:35.188655 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47073da1-d8d7-4590-85ec-359d7a34dade admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:35.188655 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47073da1-d8d7-4590-85ec-359d7a34dade admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:35.188655 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47073da1-d8d7-4590-85ec-359d7a34dade admin admin] PATH_INFO: `/v3/projects/2844a4b0a0794140aac9ac2df848b2e7/users/75438d3173174cbe8fd050148fb8c764/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:35.207383 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47073da1-d8d7-4590-85ec-359d7a34dade admin admin] RBAC: Authorizing `identity:create_grant(project_id=2844a4b0a0794140aac9ac2df848b2e7, user_id=75438d3173174cbe8fd050148fb8c764, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:35.209507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47073da1-d8d7-4590-85ec-359d7a34dade admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:35.229896 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4215/8452] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:20:35 2022] PUT /identity/v3/projects/2844a4b0a0794140aac9ac2df848b2e7/users/75438d3173174cbe8fd050148fb8c764/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:20:35.231999 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b0acc-124a-4e06-8a60-66cee55fefc0 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:35.251710 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b0acc-124a-4e06-8a60-66cee55fefc0 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:35.314751 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:35.346299 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49630f5-629a-4498-ae04-58bacd922c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:35.346932 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49630f5-629a-4498-ae04-58bacd922c35 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:35.347382 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49630f5-629a-4498-ae04-58bacd922c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:35.347661 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49630f5-629a-4498-ae04-58bacd922c35 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:35.348324 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49630f5-629a-4498-ae04-58bacd922c35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:35.350100 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49630f5-629a-4498-ae04-58bacd922c35 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:35.390018 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4238/8453] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:20:35.394242 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47073da1-d8d7-4590-85ec-359d7a34dade admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:35.410649 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47073da1-d8d7-4590-85ec-359d7a34dade admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:35.416453 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe980c8-1d17-4f43-bd4b-e3526aed90c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:35.417125 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe980c8-1d17-4f43-bd4b-e3526aed90c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:35.417382 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe980c8-1d17-4f43-bd4b-e3526aed90c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:35.417698 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe980c8-1d17-4f43-bd4b-e3526aed90c3 admin admin] PATH_INFO: `/v3/projects/2844a4b0a0794140aac9ac2df848b2e7/users/75438d3173174cbe8fd050148fb8c764/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:35.420336 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe980c8-1d17-4f43-bd4b-e3526aed90c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2844a4b0a0794140aac9ac2df848b2e7, user_id=75438d3173174cbe8fd050148fb8c764, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:35.423448 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe980c8-1d17-4f43-bd4b-e3526aed90c3 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:35.443327 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4216/8454] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:20:35 2022] PUT /identity/v3/projects/2844a4b0a0794140aac9ac2df848b2e7/users/75438d3173174cbe8fd050148fb8c764/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:20:41.455079 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49630f5-629a-4498-ae04-58bacd922c35 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:41.541006 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49630f5-629a-4498-ae04-58bacd922c35 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:41.643726 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c703f78-7680-4aba-98a0-c3b9ef3a18b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:41.645487 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c703f78-7680-4aba-98a0-c3b9ef3a18b5 service cinder] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:41.645974 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c703f78-7680-4aba-98a0-c3b9ef3a18b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:41.646457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c703f78-7680-4aba-98a0-c3b9ef3a18b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:41.752603 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c703f78-7680-4aba-98a0-c3b9ef3a18b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:41.754285 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c703f78-7680-4aba-98a0-c3b9ef3a18b5 service cinder] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:41.769097 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4239/8455] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:20:41 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:20:42.439511 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f70eb8-a45e-4d22-8e24-d97a0f6e7fb3 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:42.440687 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f70eb8-a45e-4d22-8e24-d97a0f6e7fb3 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:42.441012 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f70eb8-a45e-4d22-8e24-d97a0f6e7fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:42.485813 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-53f70eb8-a45e-4d22-8e24-d97a0f6e7fb3 None None] MFA Rules not processed for user `75438d3173174cbe8fd050148fb8c764`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:42.487676 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-53f70eb8-a45e-4d22-8e24-d97a0f6e7fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:42.607219 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4217/8456] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:42 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:20:42.624936 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c703f78-7680-4aba-98a0-c3b9ef3a18b5 service cinder] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:42.673158 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c703f78-7680-4aba-98a0-c3b9ef3a18b5 service cinder] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:42.691726 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce09223c-52ab-4033-ac61-540e75c72c18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:42.692363 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09223c-52ab-4033-ac61-540e75c72c18 service cinder] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:42.693122 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09223c-52ab-4033-ac61-540e75c72c18 service cinder] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:42.700173 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09223c-52ab-4033-ac61-540e75c72c18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:42.744125 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce09223c-52ab-4033-ac61-540e75c72c18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:42.747885 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce09223c-52ab-4033-ac61-540e75c72c18 service cinder] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:42.770820 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4240/8457] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:20:42 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:20:42.948078 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f70eb8-a45e-4d22-8e24-d97a0f6e7fb3 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:42.964434 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f70eb8-a45e-4d22-8e24-d97a0f6e7fb3 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:42.970420 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e5a0b-e24f-43db-a733-9943ee1aab61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:42.971211 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e5a0b-e24f-43db-a733-9943ee1aab61 service cinder] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:42.971502 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e5a0b-e24f-43db-a733-9943ee1aab61 service cinder] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:42.971779 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e5a0b-e24f-43db-a733-9943ee1aab61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:43.053266 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:43.068002 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e5a0b-e24f-43db-a733-9943ee1aab61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:43.070104 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e5a0b-e24f-43db-a733-9943ee1aab61 service cinder] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:43.081425 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4218/8458] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:20:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:20:44.759551 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d0506-dfc5-4b41-b040-e9ebadfe84e1 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:44.759997 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d0506-dfc5-4b41-b040-e9ebadfe84e1 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:44.759997 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d0506-dfc5-4b41-b040-e9ebadfe84e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:44.798614 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-486d0506-dfc5-4b41-b040-e9ebadfe84e1 None None] MFA Rules not processed for user `616303b5564840e3bb07d4c9c22c2049`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:44.799866 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-486d0506-dfc5-4b41-b040-e9ebadfe84e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:44.807470 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4241/8459] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:20:45.123074 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e5a0b-e24f-43db-a733-9943ee1aab61 service cinder] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:45.124763 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7d6e5a0b-e24f-43db-a733-9943ee1aab61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:45.221327 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e5a0b-e24f-43db-a733-9943ee1aab61 service cinder] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:45.225599 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3cf18c-9fd1-45d0-a3f0-c452bd96cbe5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:45.226222 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3cf18c-9fd1-45d0-a3f0-c452bd96cbe5 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:45.226502 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3cf18c-9fd1-45d0-a3f0-c452bd96cbe5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:45.226758 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3cf18c-9fd1-45d0-a3f0-c452bd96cbe5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:45.228696 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ff3cf18c-9fd1-45d0-a3f0-c452bd96cbe5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:45.266908 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3cf18c-9fd1-45d0-a3f0-c452bd96cbe5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:45.268540 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3cf18c-9fd1-45d0-a3f0-c452bd96cbe5 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:45.296418 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4219/8460] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:20:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:20:45.833640 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d0506-dfc5-4b41-b040-e9ebadfe84e1 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:45.835264 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-486d0506-dfc5-4b41-b040-e9ebadfe84e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:45.881810 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:45.979861 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d0506-dfc5-4b41-b040-e9ebadfe84e1 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:45.985860 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275cf40-4f05-4ca3-a3d5-93b2994a55ab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:45.986964 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275cf40-4f05-4ca3-a3d5-93b2994a55ab service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:45.987431 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275cf40-4f05-4ca3-a3d5-93b2994a55ab service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:45.987887 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275cf40-4f05-4ca3-a3d5-93b2994a55ab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:45.990168 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7275cf40-4f05-4ca3-a3d5-93b2994a55ab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:46.015913 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275cf40-4f05-4ca3-a3d5-93b2994a55ab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:46.017999 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275cf40-4f05-4ca3-a3d5-93b2994a55ab service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:46.032263 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4242/8461] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:20:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:20:47.090409 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3cf18c-9fd1-45d0-a3f0-c452bd96cbe5 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:47.164142 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3cf18c-9fd1-45d0-a3f0-c452bd96cbe5 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:47.169213 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07af922-1ad9-4e9b-bbec-b80a273cd00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:47.170152 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07af922-1ad9-4e9b-bbec-b80a273cd00e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:47.170610 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07af922-1ad9-4e9b-bbec-b80a273cd00e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:47.171939 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07af922-1ad9-4e9b-bbec-b80a273cd00e admin admin] PATH_INFO: `/v3/users/3cfe939370fe4c4e99961bd0cf4f690f` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:47.174359 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07af922-1ad9-4e9b-bbec-b80a273cd00e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cfe939370fe4c4e99961bd0cf4f690f)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:47.178235 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07af922-1ad9-4e9b-bbec-b80a273cd00e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:47.249528 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c07af922-1ad9-4e9b-bbec-b80a273cd00e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cfe939370fe4c4e99961bd0cf4f690f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:47.250251 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c07af922-1ad9-4e9b-bbec-b80a273cd00e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cfe939370fe4c4e99961bd0cf4f690f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:47.265563 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c07af922-1ad9-4e9b-bbec-b80a273cd00e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cfe939370fe4c4e99961bd0cf4f690f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:47.275228 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c07af922-1ad9-4e9b-bbec-b80a273cd00e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cfe939370fe4c4e99961bd0cf4f690f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:47.296768 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-c07af922-1ad9-4e9b-bbec-b80a273cd00e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cfe939370fe4c4e99961bd0cf4f690f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:47.304048 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4220/8462] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:20:47 2022] DELETE /identity/v3/users/3cfe939370fe4c4e99961bd0cf4f690f => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:20:47.310040 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744310b-2646-4423-b275-78c25e51233f None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:47.310040 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744310b-2646-4423-b275-78c25e51233f None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:47.310673 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744310b-2646-4423-b275-78c25e51233f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:47.331507 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-6744310b-2646-4423-b275-78c25e51233f None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:47.333046 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6744310b-2646-4423-b275-78c25e51233f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:47.413118 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4243/8463] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:20:47.428404 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07af922-1ad9-4e9b-bbec-b80a273cd00e admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:47.430377 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c07af922-1ad9-4e9b-bbec-b80a273cd00e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:47.447065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:47.506069 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07af922-1ad9-4e9b-bbec-b80a273cd00e admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:47.516463 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a090d22-869e-435f-a064-a7760fadd66b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:47.517247 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a090d22-869e-435f-a064-a7760fadd66b service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:47.517554 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a090d22-869e-435f-a064-a7760fadd66b service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:47.517920 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a090d22-869e-435f-a064-a7760fadd66b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:47.535846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a090d22-869e-435f-a064-a7760fadd66b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:47.537438 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a090d22-869e-435f-a064-a7760fadd66b service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:47.549543 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4221/8464] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:20:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:20:47.967529 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6744310b-2646-4423-b275-78c25e51233f None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:47.969438 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6744310b-2646-4423-b275-78c25e51233f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:47.997548 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6744310b-2646-4423-b275-78c25e51233f None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:48.012858 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57dc57-3f17-4c65-b0eb-f2bdecd29e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:48.014319 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57dc57-3f17-4c65-b0eb-f2bdecd29e5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:48.014782 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57dc57-3f17-4c65-b0eb-f2bdecd29e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:48.015278 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57dc57-3f17-4c65-b0eb-f2bdecd29e5c admin admin] PATH_INFO: `/v3/projects/f64e062090ab496e88701cf6835d7d10` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:48.022416 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e57dc57-3f17-4c65-b0eb-f2bdecd29e5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f64e062090ab496e88701cf6835d7d10)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:48.024946 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e57dc57-3f17-4c65-b0eb-f2bdecd29e5c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:48.161153 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0e57dc57-3f17-4c65-b0eb-f2bdecd29e5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f64e062090ab496e88701cf6835d7d10', 'request_id': 'req-0e57dc57-3f17-4c65-b0eb-f2bdecd29e5c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:48.169727 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0e57dc57-3f17-4c65-b0eb-f2bdecd29e5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f64e062090ab496e88701cf6835d7d10', 'request_id': 'req-0e57dc57-3f17-4c65-b0eb-f2bdecd29e5c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:48.179881 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0e57dc57-3f17-4c65-b0eb-f2bdecd29e5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f64e062090ab496e88701cf6835d7d10', 'request_id': 'req-0e57dc57-3f17-4c65-b0eb-f2bdecd29e5c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:48.209601 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0e57dc57-3f17-4c65-b0eb-f2bdecd29e5c admin admin] The token cache is being invalidate because project f64e062090ab496e88701cf6835d7d10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:20:48.209809 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0e57dc57-3f17-4c65-b0eb-f2bdecd29e5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:48.211118 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0e57dc57-3f17-4c65-b0eb-f2bdecd29e5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:48.213194 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4244/8465] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:20:47 2022] DELETE /identity/v3/projects/f64e062090ab496e88701cf6835d7d10 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:20:48.217288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a090d22-869e-435f-a064-a7760fadd66b service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:48.231212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a090d22-869e-435f-a064-a7760fadd66b service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:48.389494 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72728764-de2c-4b8e-a1c2-318d12b46661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:48.390397 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72728764-de2c-4b8e-a1c2-318d12b46661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:48.390767 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72728764-de2c-4b8e-a1c2-318d12b46661 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:48.391231 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72728764-de2c-4b8e-a1c2-318d12b46661 admin admin] PATH_INFO: `/v3/users/1748817538254458aeb33027fbc63f20` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:48.392909 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72728764-de2c-4b8e-a1c2-318d12b46661 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1748817538254458aeb33027fbc63f20)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:48.395688 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72728764-de2c-4b8e-a1c2-318d12b46661 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:48.504236 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-72728764-de2c-4b8e-a1c2-318d12b46661 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1748817538254458aeb33027fbc63f20'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:48.508079 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-72728764-de2c-4b8e-a1c2-318d12b46661 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1748817538254458aeb33027fbc63f20'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:48.542013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-72728764-de2c-4b8e-a1c2-318d12b46661 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1748817538254458aeb33027fbc63f20'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:48.577799 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-72728764-de2c-4b8e-a1c2-318d12b46661 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1748817538254458aeb33027fbc63f20'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:48.592719 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-72728764-de2c-4b8e-a1c2-318d12b46661 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1748817538254458aeb33027fbc63f20'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:48.611457 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4222/8466] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:20:48 2022] DELETE /identity/v3/users/1748817538254458aeb33027fbc63f20 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:20:49.116623 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57dc57-3f17-4c65-b0eb-f2bdecd29e5c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:49.118110 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0e57dc57-3f17-4c65-b0eb-f2bdecd29e5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:49.164326 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72728764-de2c-4b8e-a1c2-318d12b46661 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:49.165787 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-72728764-de2c-4b8e-a1c2-318d12b46661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:49.240439 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:49.260628 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:49.278616 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57dc57-3f17-4c65-b0eb-f2bdecd29e5c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:49.337775 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72728764-de2c-4b8e-a1c2-318d12b46661 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:49.349101 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420781d1-a1c2-49d7-bbb2-7fcf251a13d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:49.350135 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420781d1-a1c2-49d7-bbb2-7fcf251a13d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:49.350609 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420781d1-a1c2-49d7-bbb2-7fcf251a13d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:49.351068 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420781d1-a1c2-49d7-bbb2-7fcf251a13d1 admin admin] PATH_INFO: `/v3/projects/85c0a1941a204913afe2c543a47b3e54` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:49.352531 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420781d1-a1c2-49d7-bbb2-7fcf251a13d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85c0a1941a204913afe2c543a47b3e54)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:49.357194 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420781d1-a1c2-49d7-bbb2-7fcf251a13d1 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:49.384384 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93a944-07d0-4014-890f-4fab261fba7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:49.385471 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93a944-07d0-4014-890f-4fab261fba7b service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:49.386114 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93a944-07d0-4014-890f-4fab261fba7b service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:49.387230 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93a944-07d0-4014-890f-4fab261fba7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:49.391269 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ae93a944-07d0-4014-890f-4fab261fba7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:49.424294 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae93a944-07d0-4014-890f-4fab261fba7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:49.426664 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae93a944-07d0-4014-890f-4fab261fba7b service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:49.452808 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4245/8467] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:20:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:20:49.475420 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-420781d1-a1c2-49d7-bbb2-7fcf251a13d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85c0a1941a204913afe2c543a47b3e54', 'request_id': 'req-420781d1-a1c2-49d7-bbb2-7fcf251a13d1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:49.484925 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-420781d1-a1c2-49d7-bbb2-7fcf251a13d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85c0a1941a204913afe2c543a47b3e54', 'request_id': 'req-420781d1-a1c2-49d7-bbb2-7fcf251a13d1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:49.502222 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-420781d1-a1c2-49d7-bbb2-7fcf251a13d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85c0a1941a204913afe2c543a47b3e54', 'request_id': 'req-420781d1-a1c2-49d7-bbb2-7fcf251a13d1'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:49.520378 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-420781d1-a1c2-49d7-bbb2-7fcf251a13d1 admin admin] The token cache is being invalidate because project 85c0a1941a204913afe2c543a47b3e54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:20:49.520950 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-420781d1-a1c2-49d7-bbb2-7fcf251a13d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:49.521810 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-420781d1-a1c2-49d7-bbb2-7fcf251a13d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:49.523814 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4223/8468] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:20:49 2022] DELETE /identity/v3/projects/85c0a1941a204913afe2c543a47b3e54 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:20:49.529024 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93a944-07d0-4014-890f-4fab261fba7b service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:49.542061 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93a944-07d0-4014-890f-4fab261fba7b service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:49.639058 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c40ee-fd36-4f98-83d8-942feddc0942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:49.640078 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c40ee-fd36-4f98-83d8-942feddc0942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:49.640367 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c40ee-fd36-4f98-83d8-942feddc0942 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:49.640647 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c40ee-fd36-4f98-83d8-942feddc0942 admin admin] PATH_INFO: `/v3/users/54dd8468821349b89e0cb5a0f9ba9ec8` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:49.642979 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9c40ee-fd36-4f98-83d8-942feddc0942 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54dd8468821349b89e0cb5a0f9ba9ec8)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:49.648619 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9c40ee-fd36-4f98-83d8-942feddc0942 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:49.749650 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-be9c40ee-fd36-4f98-83d8-942feddc0942 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54dd8468821349b89e0cb5a0f9ba9ec8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:49.751730 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-be9c40ee-fd36-4f98-83d8-942feddc0942 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54dd8468821349b89e0cb5a0f9ba9ec8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:49.767283 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420781d1-a1c2-49d7-bbb2-7fcf251a13d1 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:49.768823 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-420781d1-a1c2-49d7-bbb2-7fcf251a13d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:49.785841 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420781d1-a1c2-49d7-bbb2-7fcf251a13d1 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:49.795357 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-be9c40ee-fd36-4f98-83d8-942feddc0942 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54dd8468821349b89e0cb5a0f9ba9ec8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:49.809055 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-be9c40ee-fd36-4f98-83d8-942feddc0942 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54dd8468821349b89e0cb5a0f9ba9ec8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:49.809593 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328eb67e-e0db-41dd-9087-81332cd3f89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:49.810153 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328eb67e-e0db-41dd-9087-81332cd3f89d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:49.810292 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-be9c40ee-fd36-4f98-83d8-942feddc0942 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54dd8468821349b89e0cb5a0f9ba9ec8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:49.812029 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328eb67e-e0db-41dd-9087-81332cd3f89d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:49.812501 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328eb67e-e0db-41dd-9087-81332cd3f89d admin admin] PATH_INFO: `/v3/users/924dd5d0b31749c2b1bbb30c1386e215` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:49.815957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328eb67e-e0db-41dd-9087-81332cd3f89d admin admin] RBAC: Authorizing `identity:delete_user(user_id=924dd5d0b31749c2b1bbb30c1386e215)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:49.820353 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328eb67e-e0db-41dd-9087-81332cd3f89d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:49.849568 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4246/8469] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:20:49 2022] DELETE /identity/v3/users/54dd8468821349b89e0cb5a0f9ba9ec8 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:20:49.907419 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-328eb67e-e0db-41dd-9087-81332cd3f89d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '924dd5d0b31749c2b1bbb30c1386e215'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:49.908500 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-328eb67e-e0db-41dd-9087-81332cd3f89d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '924dd5d0b31749c2b1bbb30c1386e215'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:49.926194 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-328eb67e-e0db-41dd-9087-81332cd3f89d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '924dd5d0b31749c2b1bbb30c1386e215'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:49.941235 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-328eb67e-e0db-41dd-9087-81332cd3f89d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '924dd5d0b31749c2b1bbb30c1386e215'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:49.960972 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-328eb67e-e0db-41dd-9087-81332cd3f89d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '924dd5d0b31749c2b1bbb30c1386e215'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:49.977741 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4224/8470] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:20:49 2022] DELETE /identity/v3/users/924dd5d0b31749c2b1bbb30c1386e215 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:20:49.983641 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed30694-19a1-4222-b9f9-cc990ea99aab None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:49.984027 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed30694-19a1-4222-b9f9-cc990ea99aab None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:49.984695 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed30694-19a1-4222-b9f9-cc990ea99aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:50.025725 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-9ed30694-19a1-4222-b9f9-cc990ea99aab None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:50.027997 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9ed30694-19a1-4222-b9f9-cc990ea99aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:50.050201 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:50.122079 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4247/8471] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:20:50.137665 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328eb67e-e0db-41dd-9087-81332cd3f89d admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:50.139199 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-328eb67e-e0db-41dd-9087-81332cd3f89d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:50.261038 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:50.310449 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328eb67e-e0db-41dd-9087-81332cd3f89d admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:50.320022 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c57a79-2c17-42b0-8ca4-bb230c25c554 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:50.320662 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c57a79-2c17-42b0-8ca4-bb230c25c554 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:50.320943 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c57a79-2c17-42b0-8ca4-bb230c25c554 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:50.321216 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c57a79-2c17-42b0-8ca4-bb230c25c554 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:50.342959 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c57a79-2c17-42b0-8ca4-bb230c25c554 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:50.344485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c57a79-2c17-42b0-8ca4-bb230c25c554 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:50.370383 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4225/8472] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:20:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:20:50.425353 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed30694-19a1-4222-b9f9-cc990ea99aab None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:50.426985 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9ed30694-19a1-4222-b9f9-cc990ea99aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:50.447940 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed30694-19a1-4222-b9f9-cc990ea99aab None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:50.474950 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d8cf4-06d2-4a44-b1c7-a5042dccf1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:50.476389 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d8cf4-06d2-4a44-b1c7-a5042dccf1c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:50.476683 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d8cf4-06d2-4a44-b1c7-a5042dccf1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:50.476955 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d8cf4-06d2-4a44-b1c7-a5042dccf1c9 admin admin] PATH_INFO: `/v3/projects/03b971af9ab54d0b91d7b9fc5f220edf` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:50.482587 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d8cf4-06d2-4a44-b1c7-a5042dccf1c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03b971af9ab54d0b91d7b9fc5f220edf)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:50.488321 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d8cf4-06d2-4a44-b1c7-a5042dccf1c9 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:50.650092 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7b8d8cf4-06d2-4a44-b1c7-a5042dccf1c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03b971af9ab54d0b91d7b9fc5f220edf', 'request_id': 'req-7b8d8cf4-06d2-4a44-b1c7-a5042dccf1c9'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:50.671920 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7b8d8cf4-06d2-4a44-b1c7-a5042dccf1c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03b971af9ab54d0b91d7b9fc5f220edf', 'request_id': 'req-7b8d8cf4-06d2-4a44-b1c7-a5042dccf1c9'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:50.685509 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7b8d8cf4-06d2-4a44-b1c7-a5042dccf1c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03b971af9ab54d0b91d7b9fc5f220edf', 'request_id': 'req-7b8d8cf4-06d2-4a44-b1c7-a5042dccf1c9'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:50.741069 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7b8d8cf4-06d2-4a44-b1c7-a5042dccf1c9 admin admin] The token cache is being invalidate because project 03b971af9ab54d0b91d7b9fc5f220edf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:20:50.741400 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7b8d8cf4-06d2-4a44-b1c7-a5042dccf1c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:50.745280 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-7b8d8cf4-06d2-4a44-b1c7-a5042dccf1c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:50.747320 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4248/8473] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:20:50 2022] DELETE /identity/v3/projects/03b971af9ab54d0b91d7b9fc5f220edf => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:20:50.753148 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52be2c1-eb6b-4bdf-bde4-4ee1d9e8f899 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:50.753467 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52be2c1-eb6b-4bdf-bde4-4ee1d9e8f899 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:50.753712 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52be2c1-eb6b-4bdf-bde4-4ee1d9e8f899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:50.804060 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-e52be2c1-eb6b-4bdf-bde4-4ee1d9e8f899 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:50.807058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e52be2c1-eb6b-4bdf-bde4-4ee1d9e8f899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:50.915302 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4226/8474] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:20:50.925004 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5b4ab-05c8-4856-ba73-82695b0568e7 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:50.925898 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5b4ab-05c8-4856-ba73-82695b0568e7 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:50.925898 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5b4ab-05c8-4856-ba73-82695b0568e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:50.965143 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-03c5b4ab-05c8-4856-ba73-82695b0568e7 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:50.970406 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-03c5b4ab-05c8-4856-ba73-82695b0568e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:50.998420 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4249/8475] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:20:51.002946 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52be2c1-eb6b-4bdf-bde4-4ee1d9e8f899 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:51.020633 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52be2c1-eb6b-4bdf-bde4-4ee1d9e8f899 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:51.031586 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f4212-bb32-4f53-868d-3db512366196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:51.032874 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f4212-bb32-4f53-868d-3db512366196 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:51.033139 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f4212-bb32-4f53-868d-3db512366196 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:51.033614 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f4212-bb32-4f53-868d-3db512366196 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:51.034696 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748f4212-bb32-4f53-868d-3db512366196 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:20:51.034984 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748f4212-bb32-4f53-868d-3db512366196 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:51.038290 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748f4212-bb32-4f53-868d-3db512366196 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:51.059194 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4227/8476] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:20:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:20:51.061041 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5b4ab-05c8-4856-ba73-82695b0568e7 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:51.074629 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5b4ab-05c8-4856-ba73-82695b0568e7 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:51.078916 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f4212-bb32-4f53-868d-3db512366196 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:51.081553 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-748f4212-bb32-4f53-868d-3db512366196 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:51.091205 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9468c6-2325-43f8-87c8-62d7cd44adde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:51.093773 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9468c6-2325-43f8-87c8-62d7cd44adde admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:51.094176 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9468c6-2325-43f8-87c8-62d7cd44adde admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:51.095139 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9468c6-2325-43f8-87c8-62d7cd44adde admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:51.096975 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9468c6-2325-43f8-87c8-62d7cd44adde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:51.111669 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9468c6-2325-43f8-87c8-62d7cd44adde admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:51.123258 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f4212-bb32-4f53-868d-3db512366196 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:51.130882 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963c4a39-f89f-46fe-a718-2950b6f44681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:51.132178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c4a39-f89f-46fe-a718-2950b6f44681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:51.132450 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c4a39-f89f-46fe-a718-2950b6f44681 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:51.132809 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c4a39-f89f-46fe-a718-2950b6f44681 admin admin] PATH_INFO: `/v3/projects/e179bddac6054163810a29f41fa012d8` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:51.134129 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963c4a39-f89f-46fe-a718-2950b6f44681 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e179bddac6054163810a29f41fa012d8)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:51.136230 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963c4a39-f89f-46fe-a718-2950b6f44681 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:51.157778 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4250/8477] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:20:51 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:20:51.162895 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9468c6-2325-43f8-87c8-62d7cd44adde admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:51.202372 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-963c4a39-f89f-46fe-a718-2950b6f44681 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e179bddac6054163810a29f41fa012d8', 'request_id': 'req-963c4a39-f89f-46fe-a718-2950b6f44681'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:51.208897 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-963c4a39-f89f-46fe-a718-2950b6f44681 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e179bddac6054163810a29f41fa012d8', 'request_id': 'req-963c4a39-f89f-46fe-a718-2950b6f44681'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:51.220895 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-963c4a39-f89f-46fe-a718-2950b6f44681 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e179bddac6054163810a29f41fa012d8', 'request_id': 'req-963c4a39-f89f-46fe-a718-2950b6f44681'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:51.237793 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-963c4a39-f89f-46fe-a718-2950b6f44681 admin admin] The token cache is being invalidate because project e179bddac6054163810a29f41fa012d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:20:51.238081 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-963c4a39-f89f-46fe-a718-2950b6f44681 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:51.238779 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-963c4a39-f89f-46fe-a718-2950b6f44681 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:51.241460 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4228/8478] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:20:51 2022] DELETE /identity/v3/projects/e179bddac6054163810a29f41fa012d8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:20:51.247469 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9db35-0399-4efe-8493-50eabfa78d12 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:51.247811 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9db35-0399-4efe-8493-50eabfa78d12 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:51.248089 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9db35-0399-4efe-8493-50eabfa78d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:51.263153 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9468c6-2325-43f8-87c8-62d7cd44adde admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:51.275072 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-cce9db35-0399-4efe-8493-50eabfa78d12 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:51.276784 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-cce9db35-0399-4efe-8493-50eabfa78d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:51.290369 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:51.340784 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:51.345219 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e12a17f-dfd0-432f-90e1-39e0e813de17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:51.346099 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12a17f-dfd0-432f-90e1-39e0e813de17 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:51.346563 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12a17f-dfd0-432f-90e1-39e0e813de17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:51.346987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12a17f-dfd0-432f-90e1-39e0e813de17 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:51.348274 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e12a17f-dfd0-432f-90e1-39e0e813de17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:51.350604 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e12a17f-dfd0-432f-90e1-39e0e813de17 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:51.360426 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4229/8479] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:20:51.368423 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fc530-8910-4c5c-a944-8e1ef72f999d None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:51.368621 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fc530-8910-4c5c-a944-8e1ef72f999d None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:51.368899 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fc530-8910-4c5c-a944-8e1ef72f999d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:51.391114 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-204fc530-8910-4c5c-a944-8e1ef72f999d None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:51.392361 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-204fc530-8910-4c5c-a944-8e1ef72f999d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:51.397187 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4251/8480] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:20:51 2022] POST /identity/v3/users => generated 294 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:20:51.401092 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e12a17f-dfd0-432f-90e1-39e0e813de17 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:51.402980 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2e12a17f-dfd0-432f-90e1-39e0e813de17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:51.407174 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4230/8481] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:20:51.409315 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204fc530-8910-4c5c-a944-8e1ef72f999d None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:51.419378 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e12a17f-dfd0-432f-90e1-39e0e813de17 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:51.421748 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204fc530-8910-4c5c-a944-8e1ef72f999d None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:51.425174 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2becd97-8eb2-46dd-9583-6703e6924a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:51.425935 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2becd97-8eb2-46dd-9583-6703e6924a05 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:51.426373 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2becd97-8eb2-46dd-9583-6703e6924a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:51.426751 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2becd97-8eb2-46dd-9583-6703e6924a05 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:51.427545 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2becd97-8eb2-46dd-9583-6703e6924a05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:51.428445 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07685164-7cc0-4a8d-a71a-3940243e6f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:51.429069 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07685164-7cc0-4a8d-a71a-3940243e6f02 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:51.429346 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07685164-7cc0-4a8d-a71a-3940243e6f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:51.429620 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07685164-7cc0-4a8d-a71a-3940243e6f02 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:51.430076 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2becd97-8eb2-46dd-9583-6703e6924a05 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:51.430500 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07685164-7cc0-4a8d-a71a-3940243e6f02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:20:51.430809 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07685164-7cc0-4a8d-a71a-3940243e6f02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:51.432688 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07685164-7cc0-4a8d-a71a-3940243e6f02 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:51.445014 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4252/8482] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:20:51.448109 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4231/8483] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:20:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:20:51.452286 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2becd97-8eb2-46dd-9583-6703e6924a05 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:51.452516 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07685164-7cc0-4a8d-a71a-3940243e6f02 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:51.463473 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2becd97-8eb2-46dd-9583-6703e6924a05 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:51.465856 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07685164-7cc0-4a8d-a71a-3940243e6f02 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:51.468812 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404d20a-a1ba-4e92-ba8d-390113da28ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:51.469646 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404d20a-a1ba-4e92-ba8d-390113da28ad admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:51.470000 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404d20a-a1ba-4e92-ba8d-390113da28ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:51.470339 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404d20a-a1ba-4e92-ba8d-390113da28ad admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:51.471237 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b404d20a-a1ba-4e92-ba8d-390113da28ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:51.471616 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a02d7d-d854-4e52-a73a-58170b1d7c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:51.472319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a02d7d-d854-4e52-a73a-58170b1d7c7e admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:51.472852 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a02d7d-d854-4e52-a73a-58170b1d7c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:51.473314 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a02d7d-d854-4e52-a73a-58170b1d7c7e admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:51.473554 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b404d20a-a1ba-4e92-ba8d-390113da28ad admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:51.474318 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a02d7d-d854-4e52-a73a-58170b1d7c7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:51.478234 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a02d7d-d854-4e52-a73a-58170b1d7c7e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:51.492268 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4253/8484] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:20:51.496581 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404d20a-a1ba-4e92-ba8d-390113da28ad admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:51.511156 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404d20a-a1ba-4e92-ba8d-390113da28ad admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:51.519199 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e0e293-a176-4c3b-a3b6-b72add38f21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:51.520100 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0e293-a176-4c3b-a3b6-b72add38f21e admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:51.520479 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0e293-a176-4c3b-a3b6-b72add38f21e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:51.520624 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4232/8485] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:20:51 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:20:51.521089 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0e293-a176-4c3b-a3b6-b72add38f21e admin admin] PATH_INFO: `/v3/projects/9aa35a93aa5e460d9d604fa0ecf3f688/users/680c902531f9482287374f39c9fb5fb6/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:51.524665 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a02d7d-d854-4e52-a73a-58170b1d7c7e admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:51.540829 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e0e293-a176-4c3b-a3b6-b72add38f21e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aa35a93aa5e460d9d604fa0ecf3f688, user_id=680c902531f9482287374f39c9fb5fb6, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:51.545671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e0e293-a176-4c3b-a3b6-b72add38f21e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:51.565330 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4254/8486] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:20:51 2022] PUT /identity/v3/projects/9aa35a93aa5e460d9d604fa0ecf3f688/users/680c902531f9482287374f39c9fb5fb6/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:20:51.578227 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a289725-166c-429e-b9bd-2c45c34ee463 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:51.578587 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a289725-166c-429e-b9bd-2c45c34ee463 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:51.578934 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a289725-166c-429e-b9bd-2c45c34ee463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:51.624712 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a02d7d-d854-4e52-a73a-58170b1d7c7e admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:51.632050 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-6a289725-166c-429e-b9bd-2c45c34ee463 None None] MFA Rules not processed for user `680c902531f9482287374f39c9fb5fb6`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:51.633351 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6a289725-166c-429e-b9bd-2c45c34ee463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:51.712504 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f015446b-7a6e-4530-a8ea-66abb4cfc8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:51.713388 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015446b-7a6e-4530-a8ea-66abb4cfc8ce admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:51.713730 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015446b-7a6e-4530-a8ea-66abb4cfc8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:51.714065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015446b-7a6e-4530-a8ea-66abb4cfc8ce admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:51.715498 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f015446b-7a6e-4530-a8ea-66abb4cfc8ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:51.719141 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f015446b-7a6e-4530-a8ea-66abb4cfc8ce admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:51.724966 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4255/8487] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:51 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:20:51.729508 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a289725-166c-429e-b9bd-2c45c34ee463 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:51.749300 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a289725-166c-429e-b9bd-2c45c34ee463 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:51.756091 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08e1c3-c7df-48da-ac8e-2fdf1448e00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:51.757204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08e1c3-c7df-48da-ac8e-2fdf1448e00d admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:51.757646 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08e1c3-c7df-48da-ac8e-2fdf1448e00d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:51.758173 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08e1c3-c7df-48da-ac8e-2fdf1448e00d admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:51.759007 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d08e1c3-c7df-48da-ac8e-2fdf1448e00d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:51.761562 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d08e1c3-c7df-48da-ac8e-2fdf1448e00d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:51.767120 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4233/8488] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:20:51 2022] POST /identity/v3/users => generated 293 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:20:51.769606 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f015446b-7a6e-4530-a8ea-66abb4cfc8ce admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:51.790281 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f015446b-7a6e-4530-a8ea-66abb4cfc8ce admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:51.798353 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444f8ba-5359-4abf-8827-b07ae0f9a95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:51.799116 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444f8ba-5359-4abf-8827-b07ae0f9a95d admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:51.799371 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444f8ba-5359-4abf-8827-b07ae0f9a95d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:51.799586 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444f8ba-5359-4abf-8827-b07ae0f9a95d admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:51.800247 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444f8ba-5359-4abf-8827-b07ae0f9a95d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:51.802940 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444f8ba-5359-4abf-8827-b07ae0f9a95d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:51.810945 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4256/8489] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:20:51 2022] POST /identity/v3/projects => generated 387 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:20:51.814522 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08e1c3-c7df-48da-ac8e-2fdf1448e00d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:51.816995 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4234/8490] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:20:51.824367 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444f8ba-5359-4abf-8827-b07ae0f9a95d admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:51.835289 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444f8ba-5359-4abf-8827-b07ae0f9a95d admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:51.859050 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:51.885805 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:51.898175 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08e1c3-c7df-48da-ac8e-2fdf1448e00d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:51.904334 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a6cfe-2319-42f0-9cf4-629c300aa88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:51.905154 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a6cfe-2319-42f0-9cf4-629c300aa88c admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:51.905482 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a6cfe-2319-42f0-9cf4-629c300aa88c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:51.906052 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a6cfe-2319-42f0-9cf4-629c300aa88c admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:51.906384 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6a6cfe-2319-42f0-9cf4-629c300aa88c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:51.908368 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6a6cfe-2319-42f0-9cf4-629c300aa88c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:51.914949 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac69468c-bfe4-4db3-9676-28668fd027e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:51.915610 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69468c-bfe4-4db3-9676-28668fd027e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:51.915893 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69468c-bfe4-4db3-9676-28668fd027e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:51.916317 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69468c-bfe4-4db3-9676-28668fd027e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:51.916981 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac69468c-bfe4-4db3-9676-28668fd027e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:51.919242 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac69468c-bfe4-4db3-9676-28668fd027e3 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:51.931120 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4235/8491] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:20:51.934628 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4257/8492] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:20:51 2022] POST /identity/v3/users => generated 300 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:20:51.935848 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac69468c-bfe4-4db3-9676-28668fd027e3 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:51.938785 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a6cfe-2319-42f0-9cf4-629c300aa88c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:51.947702 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac69468c-bfe4-4db3-9676-28668fd027e3 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:51.950721 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a6cfe-2319-42f0-9cf4-629c300aa88c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:51.953067 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2809bd-1f6a-4bb8-9bfd-dc39d85dfdab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:51.954060 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2809bd-1f6a-4bb8-9bfd-dc39d85dfdab admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:51.954408 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2809bd-1f6a-4bb8-9bfd-dc39d85dfdab admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:51.954891 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2809bd-1f6a-4bb8-9bfd-dc39d85dfdab admin admin] PATH_INFO: `/v3/projects/336b1b4087d040338c011a9a1c6d5786/users/83042a23e63c46088d33571d28c30261/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:51.957293 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e87f3-0258-41ec-80f2-3b626f8287bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:51.958160 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e87f3-0258-41ec-80f2-3b626f8287bd admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:51.958719 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e87f3-0258-41ec-80f2-3b626f8287bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:51.958991 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e87f3-0258-41ec-80f2-3b626f8287bd admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:51.959828 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030e87f3-0258-41ec-80f2-3b626f8287bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:51.961738 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030e87f3-0258-41ec-80f2-3b626f8287bd admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:51.973619 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2809bd-1f6a-4bb8-9bfd-dc39d85dfdab admin admin] RBAC: Authorizing `identity:create_grant(project_id=336b1b4087d040338c011a9a1c6d5786, user_id=83042a23e63c46088d33571d28c30261, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:51.974617 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4258/8493] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:20:51.978206 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2809bd-1f6a-4bb8-9bfd-dc39d85dfdab admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:51.978550 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e87f3-0258-41ec-80f2-3b626f8287bd admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:51.993806 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e87f3-0258-41ec-80f2-3b626f8287bd admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:51.999108 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4236/8494] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:20:51 2022] PUT /identity/v3/projects/336b1b4087d040338c011a9a1c6d5786/users/83042a23e63c46088d33571d28c30261/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:20:52.010475 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755f9fc-4855-4702-a421-05bdadba1950 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:52.010763 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755f9fc-4855-4702-a421-05bdadba1950 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:52.011069 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755f9fc-4855-4702-a421-05bdadba1950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:52.048727 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-b755f9fc-4855-4702-a421-05bdadba1950 None None] MFA Rules not processed for user `83042a23e63c46088d33571d28c30261`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:52.050866 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b755f9fc-4855-4702-a421-05bdadba1950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:52.106506 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca41ad-bb55-4d42-a4ad-e1b88a3da166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:52.107226 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca41ad-bb55-4d42-a4ad-e1b88a3da166 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:52.107511 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca41ad-bb55-4d42-a4ad-e1b88a3da166 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:52.107791 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca41ad-bb55-4d42-a4ad-e1b88a3da166 admin admin] PATH_INFO: `/v3/projects/834d2f734f184a888cc380cb660e6c18/users/0babf34d0cfe44349629005bb22ca496/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:52.138600 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4237/8495] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:20:52.143254 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755f9fc-4855-4702-a421-05bdadba1950 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:52.156872 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca41ad-bb55-4d42-a4ad-e1b88a3da166 admin admin] RBAC: Authorizing `identity:create_grant(project_id=834d2f734f184a888cc380cb660e6c18, user_id=0babf34d0cfe44349629005bb22ca496, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:52.159943 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca41ad-bb55-4d42-a4ad-e1b88a3da166 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:52.168003 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755f9fc-4855-4702-a421-05bdadba1950 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:52.178046 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4259/8496] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:20:51 2022] PUT /identity/v3/projects/834d2f734f184a888cc380cb660e6c18/users/0babf34d0cfe44349629005bb22ca496/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:20:52.181938 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca41ad-bb55-4d42-a4ad-e1b88a3da166 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:52.184416 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e68e4-75a6-4350-a291-874552c70940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:52.185050 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e68e4-75a6-4350-a291-874552c70940 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:52.185375 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e68e4-75a6-4350-a291-874552c70940 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:52.185657 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e68e4-75a6-4350-a291-874552c70940 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:52.186301 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58e68e4-75a6-4350-a291-874552c70940 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:52.188344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58e68e4-75a6-4350-a291-874552c70940 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:52.223389 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4238/8497] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:20:52 2022] POST /identity/v3/projects => generated 381 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:20:52.225206 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e68e4-75a6-4350-a291-874552c70940 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:52.268721 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca41ad-bb55-4d42-a4ad-e1b88a3da166 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:52.320812 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e68e4-75a6-4350-a291-874552c70940 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:52.328574 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb46487-7dd4-4028-9444-4853f4bf78b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:52.329729 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb46487-7dd4-4028-9444-4853f4bf78b0 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:52.330294 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb46487-7dd4-4028-9444-4853f4bf78b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:52.337097 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb46487-7dd4-4028-9444-4853f4bf78b0 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:52.337919 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb46487-7dd4-4028-9444-4853f4bf78b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:52.341083 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb46487-7dd4-4028-9444-4853f4bf78b0 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:52.345638 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:52.368325 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d159a46-2d34-4015-968b-1bf2681deec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:52.369979 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d159a46-2d34-4015-968b-1bf2681deec2 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:52.370423 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d159a46-2d34-4015-968b-1bf2681deec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:52.371176 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d159a46-2d34-4015-968b-1bf2681deec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:52.372177 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d159a46-2d34-4015-968b-1bf2681deec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:52.374268 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d159a46-2d34-4015-968b-1bf2681deec2 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:52.380038 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4239/8498] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:20:52 2022] POST /identity/v3/users => generated 291 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:20:52.381444 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb46487-7dd4-4028-9444-4853f4bf78b0 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:52.388226 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4260/8499] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:20:52.389586 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:52.392164 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d159a46-2d34-4015-968b-1bf2681deec2 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:52.394689 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb46487-7dd4-4028-9444-4853f4bf78b0 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:52.404666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ea08d-85bc-4103-947c-679e301641d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:52.405680 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ea08d-85bc-4103-947c-679e301641d9 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:52.406278 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ea08d-85bc-4103-947c-679e301641d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:52.406726 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ea08d-85bc-4103-947c-679e301641d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:52.408273 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ea08d-85bc-4103-947c-679e301641d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:52.408424 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d159a46-2d34-4015-968b-1bf2681deec2 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:52.413682 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a083bfc5-7c3d-48b7-a7f0-52f1184f4a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:52.414416 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083bfc5-7c3d-48b7-a7f0-52f1184f4a89 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:52.414700 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083bfc5-7c3d-48b7-a7f0-52f1184f4a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:52.414976 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083bfc5-7c3d-48b7-a7f0-52f1184f4a89 admin admin] PATH_INFO: `/v3/projects/834d2f734f184a888cc380cb660e6c18/users/0babf34d0cfe44349629005bb22ca496/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:52.417327 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a083bfc5-7c3d-48b7-a7f0-52f1184f4a89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=834d2f734f184a888cc380cb660e6c18, user_id=0babf34d0cfe44349629005bb22ca496, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:52.420270 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a083bfc5-7c3d-48b7-a7f0-52f1184f4a89 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:52.424439 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ea08d-85bc-4103-947c-679e301641d9 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:52.437496 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4240/8500] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:20:52.442312 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4261/8501] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:20:52 2022] PUT /identity/v3/projects/834d2f734f184a888cc380cb660e6c18/users/0babf34d0cfe44349629005bb22ca496/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:20:52.452098 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ea08d-85bc-4103-947c-679e301641d9 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:52.454802 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85f5fd-7223-45a6-b0a9-5e726f8913ad None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:52.455124 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85f5fd-7223-45a6-b0a9-5e726f8913ad None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:52.455402 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85f5fd-7223-45a6-b0a9-5e726f8913ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:52.463800 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ea08d-85bc-4103-947c-679e301641d9 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:52.488089 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-bb85f5fd-7223-45a6-b0a9-5e726f8913ad None None] MFA Rules not processed for user `0babf34d0cfe44349629005bb22ca496`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:52.489478 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-bb85f5fd-7223-45a6-b0a9-5e726f8913ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:52.531510 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4615da-589f-4621-92bc-1b22ddb246c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:52.532284 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4615da-589f-4621-92bc-1b22ddb246c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:52.532655 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4615da-589f-4621-92bc-1b22ddb246c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:52.533028 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4615da-589f-4621-92bc-1b22ddb246c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:52.533738 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4615da-589f-4621-92bc-1b22ddb246c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:52.535433 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4615da-589f-4621-92bc-1b22ddb246c8 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:52.546757 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4241/8502] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:20:52.551159 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4615da-589f-4621-92bc-1b22ddb246c8 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:52.563148 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4615da-589f-4621-92bc-1b22ddb246c8 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:52.567568 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4262/8503] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:52 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:20:52.574817 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b74a97-b640-4a9c-8843-d1161686a1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:52.576167 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b74a97-b640-4a9c-8843-d1161686a1f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:52.576448 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b74a97-b640-4a9c-8843-d1161686a1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:52.576720 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b74a97-b640-4a9c-8843-d1161686a1f0 admin admin] PATH_INFO: `/v3/projects/1bb9cebd14aa4eef8deab6d26d81499f/users/c76a89ffd3b349278da4a300247430d6/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:52.580074 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb85f5fd-7223-45a6-b0a9-5e726f8913ad None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:52.581498 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-bb85f5fd-7223-45a6-b0a9-5e726f8913ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:52.595958 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b74a97-b640-4a9c-8843-d1161686a1f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bb9cebd14aa4eef8deab6d26d81499f, user_id=c76a89ffd3b349278da4a300247430d6, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:52.598999 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b74a97-b640-4a9c-8843-d1161686a1f0 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:52.615757 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4242/8504] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:20:52 2022] PUT /identity/v3/projects/1bb9cebd14aa4eef8deab6d26d81499f/users/c76a89ffd3b349278da4a300247430d6/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:20:52.627485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6992b-8971-4fcb-962e-c068c6b1e8e5 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:52.627772 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6992b-8971-4fcb-962e-c068c6b1e8e5 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:52.628048 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6992b-8971-4fcb-962e-c068c6b1e8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:52.658579 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb85f5fd-7223-45a6-b0a9-5e726f8913ad None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:52.665288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-29e6992b-8971-4fcb-962e-c068c6b1e8e5 None None] MFA Rules not processed for user `c76a89ffd3b349278da4a300247430d6`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:52.666536 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-29e6992b-8971-4fcb-962e-c068c6b1e8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:52.723126 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6338dfc-cf7d-46b4-9e59-4e91bf8f844d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:52.724172 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6338dfc-cf7d-46b4-9e59-4e91bf8f844d service cinder] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:52.724753 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6338dfc-cf7d-46b4-9e59-4e91bf8f844d service cinder] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:52.725294 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6338dfc-cf7d-46b4-9e59-4e91bf8f844d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:52.742211 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4243/8505] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:20:52.747625 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6992b-8971-4fcb-962e-c068c6b1e8e5 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:52.752311 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:52.803260 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6338dfc-cf7d-46b4-9e59-4e91bf8f844d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:52.804997 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6338dfc-cf7d-46b4-9e59-4e91bf8f844d service cinder] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:52.815354 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:52.817396 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4263/8506] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:20:52 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:20:52.821619 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6992b-8971-4fcb-962e-c068c6b1e8e5 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:52.829242 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bdcd53-10ee-4eaa-ab65-25a41eec3e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:52.830127 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bdcd53-10ee-4eaa-ab65-25a41eec3e24 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:52.830519 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bdcd53-10ee-4eaa-ab65-25a41eec3e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:52.830975 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bdcd53-10ee-4eaa-ab65-25a41eec3e24 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:52.831768 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bdcd53-10ee-4eaa-ab65-25a41eec3e24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:52.833858 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bdcd53-10ee-4eaa-ab65-25a41eec3e24 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:52.868785 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4244/8507] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:20:52 2022] POST /identity/v3/projects => generated 385 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:20:52.873873 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6338dfc-cf7d-46b4-9e59-4e91bf8f844d service cinder] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:52.884886 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6338dfc-cf7d-46b4-9e59-4e91bf8f844d service cinder] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:52.960482 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c44dea-3494-42f2-a86b-e2c697380ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:52.961129 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c44dea-3494-42f2-a86b-e2c697380ed6 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:52.961482 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c44dea-3494-42f2-a86b-e2c697380ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:52.961794 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c44dea-3494-42f2-a86b-e2c697380ed6 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:52.962431 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c44dea-3494-42f2-a86b-e2c697380ed6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:52.964393 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c44dea-3494-42f2-a86b-e2c697380ed6 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:52.970980 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bdcd53-10ee-4eaa-ab65-25a41eec3e24 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:52.982383 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bdcd53-10ee-4eaa-ab65-25a41eec3e24 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:52.987876 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8075f015-ba84-42f0-aa89-72a99c6586da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:52.988734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8075f015-ba84-42f0-aa89-72a99c6586da admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:52.989175 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8075f015-ba84-42f0-aa89-72a99c6586da admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:52.989782 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4264/8508] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:20:52 2022] POST /identity/v3/users => generated 299 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:20:52.990050 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8075f015-ba84-42f0-aa89-72a99c6586da admin admin] PATH_INFO: `/v3/users/680c902531f9482287374f39c9fb5fb6` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:52.993348 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8075f015-ba84-42f0-aa89-72a99c6586da admin admin] RBAC: Authorizing `identity:delete_user(user_id=680c902531f9482287374f39c9fb5fb6)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:52.995319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8075f015-ba84-42f0-aa89-72a99c6586da admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:52.997174 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c44dea-3494-42f2-a86b-e2c697380ed6 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:53.007182 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c44dea-3494-42f2-a86b-e2c697380ed6 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:53.012437 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083cfa90-aba1-436b-8d83-1f6dcf42262d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:53.013163 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083cfa90-aba1-436b-8d83-1f6dcf42262d admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:53.013541 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083cfa90-aba1-436b-8d83-1f6dcf42262d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:53.013932 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083cfa90-aba1-436b-8d83-1f6dcf42262d admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:53.014676 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083cfa90-aba1-436b-8d83-1f6dcf42262d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:53.016506 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083cfa90-aba1-436b-8d83-1f6dcf42262d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:53.029059 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4265/8509] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:20:53.033317 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083cfa90-aba1-436b-8d83-1f6dcf42262d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:53.044419 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083cfa90-aba1-436b-8d83-1f6dcf42262d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:53.050966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68501a-a8bf-480f-a3a7-89cad52ff35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:53.051718 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68501a-a8bf-480f-a3a7-89cad52ff35e admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:53.051997 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68501a-a8bf-480f-a3a7-89cad52ff35e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:53.052273 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68501a-a8bf-480f-a3a7-89cad52ff35e admin admin] PATH_INFO: `/v3/projects/10a5ff3f3aeb40e5bfae5d959d477d3d/users/ab592fd8c4aa46b4addb5b3765ff3b12/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:53.053130 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8075f015-ba84-42f0-aa89-72a99c6586da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '680c902531f9482287374f39c9fb5fb6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:53.053834 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8075f015-ba84-42f0-aa89-72a99c6586da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '680c902531f9482287374f39c9fb5fb6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:53.070225 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8075f015-ba84-42f0-aa89-72a99c6586da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '680c902531f9482287374f39c9fb5fb6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:53.070554 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b68501a-a8bf-480f-a3a7-89cad52ff35e admin admin] RBAC: Authorizing `identity:create_grant(project_id=10a5ff3f3aeb40e5bfae5d959d477d3d, user_id=ab592fd8c4aa46b4addb5b3765ff3b12, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:53.073237 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b68501a-a8bf-480f-a3a7-89cad52ff35e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:53.080683 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8075f015-ba84-42f0-aa89-72a99c6586da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '680c902531f9482287374f39c9fb5fb6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:53.088748 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8075f015-ba84-42f0-aa89-72a99c6586da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '680c902531f9482287374f39c9fb5fb6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:53.090728 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4266/8510] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:20:53 2022] PUT /identity/v3/projects/10a5ff3f3aeb40e5bfae5d959d477d3d/users/ab592fd8c4aa46b4addb5b3765ff3b12/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:20:53.094266 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68501a-a8bf-480f-a3a7-89cad52ff35e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:53.095954 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8b68501a-a8bf-480f-a3a7-89cad52ff35e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:53.097058 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4245/8511] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:20:52 2022] DELETE /identity/v3/users/680c902531f9482287374f39c9fb5fb6 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:20:53.101038 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1886a7-4c35-4cda-a66c-d2df6218739a None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:53.101417 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1886a7-4c35-4cda-a66c-d2df6218739a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:53.101878 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1886a7-4c35-4cda-a66c-d2df6218739a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:53.125401 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-db1886a7-4c35-4cda-a66c-d2df6218739a None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:53.126953 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-db1886a7-4c35-4cda-a66c-d2df6218739a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:53.172878 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68501a-a8bf-480f-a3a7-89cad52ff35e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:53.188088 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:53.190568 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4246/8512] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:20:53.201628 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1886a7-4c35-4cda-a66c-d2df6218739a None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:53.203010 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-db1886a7-4c35-4cda-a66c-d2df6218739a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:53.250236 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f935c90-5354-4a1c-9f14-85baf0806cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:53.251253 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f935c90-5354-4a1c-9f14-85baf0806cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:53.251697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f935c90-5354-4a1c-9f14-85baf0806cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:53.252130 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f935c90-5354-4a1c-9f14-85baf0806cc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:53.252934 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f935c90-5354-4a1c-9f14-85baf0806cc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:53.254713 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f935c90-5354-4a1c-9f14-85baf0806cc4 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:53.266912 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4267/8513] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:20:53.270557 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1886a7-4c35-4cda-a66c-d2df6218739a None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:53.270875 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f935c90-5354-4a1c-9f14-85baf0806cc4 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:53.274362 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770937f9-566f-4cac-a487-be86098a5afc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:53.274979 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770937f9-566f-4cac-a487-be86098a5afc service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:53.275285 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770937f9-566f-4cac-a487-be86098a5afc service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:53.275556 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770937f9-566f-4cac-a487-be86098a5afc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:53.283743 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:53.284008 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f935c90-5354-4a1c-9f14-85baf0806cc4 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:53.286818 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770937f9-566f-4cac-a487-be86098a5afc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:53.288997 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770937f9-566f-4cac-a487-be86098a5afc service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:53.289602 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad77c75-0876-419d-8e32-623678c98121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:53.290297 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad77c75-0876-419d-8e32-623678c98121 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:53.290579 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad77c75-0876-419d-8e32-623678c98121 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:53.290856 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad77c75-0876-419d-8e32-623678c98121 admin admin] PATH_INFO: `/v3/projects/10a5ff3f3aeb40e5bfae5d959d477d3d/users/ab592fd8c4aa46b4addb5b3765ff3b12/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:53.293806 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad77c75-0876-419d-8e32-623678c98121 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10a5ff3f3aeb40e5bfae5d959d477d3d, user_id=ab592fd8c4aa46b4addb5b3765ff3b12, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:53.296525 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad77c75-0876-419d-8e32-623678c98121 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:53.304084 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4247/8514] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:20:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:20:53.308060 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4268/8515] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:20:53 2022] PUT /identity/v3/projects/10a5ff3f3aeb40e5bfae5d959d477d3d/users/ab592fd8c4aa46b4addb5b3765ff3b12/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:20:53.318841 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0c811-b729-47ca-8178-f87e3b8e817b None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:53.319174 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0c811-b729-47ca-8178-f87e3b8e817b None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:53.319591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0c811-b729-47ca-8178-f87e3b8e817b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:53.350844 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-76a0c811-b729-47ca-8178-f87e3b8e817b None None] MFA Rules not processed for user `ab592fd8c4aa46b4addb5b3765ff3b12`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:53.352561 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-76a0c811-b729-47ca-8178-f87e3b8e817b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:53.439217 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4248/8516] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:53 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:20:53.452310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad77c75-0876-419d-8e32-623678c98121 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:53.454247 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7ad77c75-0876-419d-8e32-623678c98121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:53.559189 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad77c75-0876-419d-8e32-623678c98121 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:53.572303 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a38b35-2b27-4a40-8840-da15803530df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:53.572945 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a38b35-2b27-4a40-8840-da15803530df service cinder] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:53.573468 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a38b35-2b27-4a40-8840-da15803530df service cinder] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:53.573802 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a38b35-2b27-4a40-8840-da15803530df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:53.578613 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-27a38b35-2b27-4a40-8840-da15803530df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:53.654059 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a0c811-b729-47ca-8178-f87e3b8e817b None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:53.655615 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-76a0c811-b729-47ca-8178-f87e3b8e817b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:53.696086 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a38b35-2b27-4a40-8840-da15803530df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:53.703561 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a38b35-2b27-4a40-8840-da15803530df service cinder] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:53.719638 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4269/8517] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:20:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:20:53.763070 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a0c811-b729-47ca-8178-f87e3b8e817b None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:53.767948 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15780e-5c47-4ef4-815f-2af9581b1ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:53.768679 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15780e-5c47-4ef4-815f-2af9581b1ee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:53.769027 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15780e-5c47-4ef4-815f-2af9581b1ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:53.769368 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15780e-5c47-4ef4-815f-2af9581b1ee6 admin admin] PATH_INFO: `/v3/projects/9aa35a93aa5e460d9d604fa0ecf3f688` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:53.770577 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b15780e-5c47-4ef4-815f-2af9581b1ee6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aa35a93aa5e460d9d604fa0ecf3f688)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:53.772657 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b15780e-5c47-4ef4-815f-2af9581b1ee6 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:53.827185 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0b15780e-5c47-4ef4-815f-2af9581b1ee6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aa35a93aa5e460d9d604fa0ecf3f688', 'request_id': 'req-0b15780e-5c47-4ef4-815f-2af9581b1ee6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:53.837879 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0b15780e-5c47-4ef4-815f-2af9581b1ee6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aa35a93aa5e460d9d604fa0ecf3f688', 'request_id': 'req-0b15780e-5c47-4ef4-815f-2af9581b1ee6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:53.847738 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0b15780e-5c47-4ef4-815f-2af9581b1ee6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aa35a93aa5e460d9d604fa0ecf3f688', 'request_id': 'req-0b15780e-5c47-4ef4-815f-2af9581b1ee6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:53.864001 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0b15780e-5c47-4ef4-815f-2af9581b1ee6 admin admin] The token cache is being invalidate because project 9aa35a93aa5e460d9d604fa0ecf3f688 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:20:53.864383 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0b15780e-5c47-4ef4-815f-2af9581b1ee6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:53.865193 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0b15780e-5c47-4ef4-815f-2af9581b1ee6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:53.867005 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4249/8518] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:20:53 2022] DELETE /identity/v3/projects/9aa35a93aa5e460d9d604fa0ecf3f688 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:20:53.874099 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a38b35-2b27-4a40-8840-da15803530df service cinder] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:53.889499 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a38b35-2b27-4a40-8840-da15803530df service cinder] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:53.951055 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:53.960275 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f7d29f-115c-41f2-a8e3-6957eed242f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:53.961148 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7d29f-115c-41f2-a8e3-6957eed242f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:53.961616 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7d29f-115c-41f2-a8e3-6957eed242f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:53.961983 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7d29f-115c-41f2-a8e3-6957eed242f0 admin admin] PATH_INFO: `/v3/users/0babf34d0cfe44349629005bb22ca496` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:53.963291 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f7d29f-115c-41f2-a8e3-6957eed242f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0babf34d0cfe44349629005bb22ca496)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:53.966482 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f7d29f-115c-41f2-a8e3-6957eed242f0 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:54.033899 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-34f7d29f-115c-41f2-a8e3-6957eed242f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0babf34d0cfe44349629005bb22ca496'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:54.034978 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-34f7d29f-115c-41f2-a8e3-6957eed242f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0babf34d0cfe44349629005bb22ca496'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:54.044891 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-34f7d29f-115c-41f2-a8e3-6957eed242f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0babf34d0cfe44349629005bb22ca496'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:54.055626 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-34f7d29f-115c-41f2-a8e3-6957eed242f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0babf34d0cfe44349629005bb22ca496'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:54.056429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-34f7d29f-115c-41f2-a8e3-6957eed242f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0babf34d0cfe44349629005bb22ca496'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:54.083359 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4270/8519] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:20:53 2022] DELETE /identity/v3/users/0babf34d0cfe44349629005bb22ca496 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:20:54.392331 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15780e-5c47-4ef4-815f-2af9581b1ee6 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:54.394478 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0b15780e-5c47-4ef4-815f-2af9581b1ee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:54.419265 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15780e-5c47-4ef4-815f-2af9581b1ee6 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:54.429596 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:54.495007 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe187d06-0a49-4a61-b224-8d59e7129f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:54.495798 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe187d06-0a49-4a61-b224-8d59e7129f53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:54.496205 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe187d06-0a49-4a61-b224-8d59e7129f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:54.496414 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe187d06-0a49-4a61-b224-8d59e7129f53 admin admin] PATH_INFO: `/v3/projects/834d2f734f184a888cc380cb660e6c18` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:54.497777 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe187d06-0a49-4a61-b224-8d59e7129f53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=834d2f734f184a888cc380cb660e6c18)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:54.499920 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe187d06-0a49-4a61-b224-8d59e7129f53 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:54.565483 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fe187d06-0a49-4a61-b224-8d59e7129f53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '834d2f734f184a888cc380cb660e6c18', 'request_id': 'req-fe187d06-0a49-4a61-b224-8d59e7129f53'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:54.571785 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fe187d06-0a49-4a61-b224-8d59e7129f53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '834d2f734f184a888cc380cb660e6c18', 'request_id': 'req-fe187d06-0a49-4a61-b224-8d59e7129f53'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:54.582231 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fe187d06-0a49-4a61-b224-8d59e7129f53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '834d2f734f184a888cc380cb660e6c18', 'request_id': 'req-fe187d06-0a49-4a61-b224-8d59e7129f53'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:54.599914 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fe187d06-0a49-4a61-b224-8d59e7129f53 admin admin] The token cache is being invalidate because project 834d2f734f184a888cc380cb660e6c18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:20:54.600202 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fe187d06-0a49-4a61-b224-8d59e7129f53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:54.600869 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-fe187d06-0a49-4a61-b224-8d59e7129f53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:20:54.602618 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4250/8520] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:20:54 2022] DELETE /identity/v3/projects/834d2f734f184a888cc380cb660e6c18 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:20:54.607722 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c472a36-9da2-4794-b3fc-ca33fa02b059 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:54.608243 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c472a36-9da2-4794-b3fc-ca33fa02b059 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:54.608341 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c472a36-9da2-4794-b3fc-ca33fa02b059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:54.632204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-3c472a36-9da2-4794-b3fc-ca33fa02b059 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:54.633989 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3c472a36-9da2-4794-b3fc-ca33fa02b059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:54.718695 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4271/8521] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:20:54.728021 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b07e2-359a-49d9-b585-63ac671308de None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:54.733403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b07e2-359a-49d9-b585-63ac671308de None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:54.733784 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b07e2-359a-49d9-b585-63ac671308de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:54.762048 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-8d6b07e2-359a-49d9-b585-63ac671308de None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:54.763691 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8d6b07e2-359a-49d9-b585-63ac671308de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:54.774685 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4251/8522] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:20:54.780414 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c472a36-9da2-4794-b3fc-ca33fa02b059 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:54.796705 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c472a36-9da2-4794-b3fc-ca33fa02b059 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:54.803741 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df1cdcd-21c5-4990-9316-22efbba04033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:54.804464 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1cdcd-21c5-4990-9316-22efbba04033 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:54.804807 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1cdcd-21c5-4990-9316-22efbba04033 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:54.805158 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1cdcd-21c5-4990-9316-22efbba04033 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:54.806402 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df1cdcd-21c5-4990-9316-22efbba04033 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:20:54.806789 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df1cdcd-21c5-4990-9316-22efbba04033 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:54.809471 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df1cdcd-21c5-4990-9316-22efbba04033 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:54.827106 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4272/8523] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:20:54.831869 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b07e2-359a-49d9-b585-63ac671308de None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:54.844240 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b07e2-359a-49d9-b585-63ac671308de None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:54.855078 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c8932a-73b1-4c5c-afb5-82e12c38c704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:54.855760 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8932a-73b1-4c5c-afb5-82e12c38c704 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:54.857215 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8932a-73b1-4c5c-afb5-82e12c38c704 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:54.857215 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8932a-73b1-4c5c-afb5-82e12c38c704 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:54.858430 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c8932a-73b1-4c5c-afb5-82e12c38c704 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:54.860606 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c8932a-73b1-4c5c-afb5-82e12c38c704 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:54.901434 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4252/8524] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:20:54 2022] POST /identity/v3/projects => generated 379 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:20:54.903687 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df1cdcd-21c5-4990-9316-22efbba04033 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:54.914662 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df1cdcd-21c5-4990-9316-22efbba04033 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:54.986477 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd0d18c-dad3-4a6b-887f-d8dfc719b1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:54.987227 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0d18c-dad3-4a6b-887f-d8dfc719b1e4 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:54.987653 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0d18c-dad3-4a6b-887f-d8dfc719b1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:54.987982 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0d18c-dad3-4a6b-887f-d8dfc719b1e4 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:54.988680 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd0d18c-dad3-4a6b-887f-d8dfc719b1e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:54.990638 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd0d18c-dad3-4a6b-887f-d8dfc719b1e4 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:55.004338 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:55.019161 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4273/8525] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:20:54 2022] POST /identity/v3/users => generated 290 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:20:55.023342 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c8932a-73b1-4c5c-afb5-82e12c38c704 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:55.033844 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c8932a-73b1-4c5c-afb5-82e12c38c704 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:55.038484 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f30fe8b-ef84-4483-8854-6d0e315e01a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:55.039105 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30fe8b-ef84-4483-8854-6d0e315e01a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:55.039385 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30fe8b-ef84-4483-8854-6d0e315e01a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:55.039655 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30fe8b-ef84-4483-8854-6d0e315e01a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:55.040377 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f30fe8b-ef84-4483-8854-6d0e315e01a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:55.041972 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f30fe8b-ef84-4483-8854-6d0e315e01a2 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:55.054879 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4253/8526] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:20:55.059930 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd0d18c-dad3-4a6b-887f-d8dfc719b1e4 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:55.070061 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd0d18c-dad3-4a6b-887f-d8dfc719b1e4 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:55.076803 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1553b471-7a66-4dc9-87ee-4d2ea5061e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:55.077495 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553b471-7a66-4dc9-87ee-4d2ea5061e41 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:55.077774 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553b471-7a66-4dc9-87ee-4d2ea5061e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:55.078051 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553b471-7a66-4dc9-87ee-4d2ea5061e41 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:55.078700 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1553b471-7a66-4dc9-87ee-4d2ea5061e41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:55.080661 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1553b471-7a66-4dc9-87ee-4d2ea5061e41 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:55.094911 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4274/8527] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:20:55.096295 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f30fe8b-ef84-4483-8854-6d0e315e01a2 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:55.107640 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f30fe8b-ef84-4483-8854-6d0e315e01a2 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:55.112554 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f549a0-3702-44c6-811f-0cf9c9da1cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:55.113214 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f549a0-3702-44c6-811f-0cf9c9da1cd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:55.113495 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f549a0-3702-44c6-811f-0cf9c9da1cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:55.113767 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f549a0-3702-44c6-811f-0cf9c9da1cd5 admin admin] PATH_INFO: `/v3/projects/e1ebf70a25b6429ba76730ab74ea9d0d/users/1cd0dc7d69bf4475881dca4d8dc6989f/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:55.131769 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f549a0-3702-44c6-811f-0cf9c9da1cd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1ebf70a25b6429ba76730ab74ea9d0d, user_id=1cd0dc7d69bf4475881dca4d8dc6989f, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:55.134696 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f549a0-3702-44c6-811f-0cf9c9da1cd5 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:55.149099 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4254/8528] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:20:55 2022] PUT /identity/v3/projects/e1ebf70a25b6429ba76730ab74ea9d0d/users/1cd0dc7d69bf4475881dca4d8dc6989f/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:20:55.160216 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6610b19-0ead-4b7e-9b44-3bc8640db242 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:55.160503 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6610b19-0ead-4b7e-9b44-3bc8640db242 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:55.160778 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6610b19-0ead-4b7e-9b44-3bc8640db242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:55.191331 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a6610b19-0ead-4b7e-9b44-3bc8640db242 None None] MFA Rules not processed for user `1cd0dc7d69bf4475881dca4d8dc6989f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:55.192576 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a6610b19-0ead-4b7e-9b44-3bc8640db242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:55.258713 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f549a0-3702-44c6-811f-0cf9c9da1cd5 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:55.260555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-56f549a0-3702-44c6-811f-0cf9c9da1cd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:55.265786 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4275/8529] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:20:55.270161 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6610b19-0ead-4b7e-9b44-3bc8640db242 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:55.305202 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:55.328184 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f549a0-3702-44c6-811f-0cf9c9da1cd5 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:55.331998 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b766b4-7a62-4176-b7e4-8e325ecc2248 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:55.332616 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b766b4-7a62-4176-b7e4-8e325ecc2248 service cinder] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:55.332899 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b766b4-7a62-4176-b7e4-8e325ecc2248 service cinder] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:55.333180 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b766b4-7a62-4176-b7e4-8e325ecc2248 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:55.334962 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d6b766b4-7a62-4176-b7e4-8e325ecc2248 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:55.335166 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6610b19-0ead-4b7e-9b44-3bc8640db242 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:55.340443 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb09a4b-22cc-4ba4-95f6-4e5c3d687de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:55.341081 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb09a4b-22cc-4ba4-95f6-4e5c3d687de4 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:55.341361 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb09a4b-22cc-4ba4-95f6-4e5c3d687de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:55.341631 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb09a4b-22cc-4ba4-95f6-4e5c3d687de4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:55.342259 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb09a4b-22cc-4ba4-95f6-4e5c3d687de4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:55.344213 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb09a4b-22cc-4ba4-95f6-4e5c3d687de4 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:55.374419 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4276/8530] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:20:55 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:20:55.378615 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb09a4b-22cc-4ba4-95f6-4e5c3d687de4 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:55.398197 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b766b4-7a62-4176-b7e4-8e325ecc2248 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:55.399690 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b766b4-7a62-4176-b7e4-8e325ecc2248 service cinder] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:55.409577 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4255/8531] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:20:55 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:20:55.437010 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:55.442755 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb09a4b-22cc-4ba4-95f6-4e5c3d687de4 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:55.449407 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad12001-3da6-4fd6-97e1-7ee9a2ff0e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:55.450042 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad12001-3da6-4fd6-97e1-7ee9a2ff0e59 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:55.450316 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad12001-3da6-4fd6-97e1-7ee9a2ff0e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:55.450587 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad12001-3da6-4fd6-97e1-7ee9a2ff0e59 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:55.451302 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad12001-3da6-4fd6-97e1-7ee9a2ff0e59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:55.453329 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad12001-3da6-4fd6-97e1-7ee9a2ff0e59 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:55.479611 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4277/8532] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:20:55 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:20:55.480820 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b766b4-7a62-4176-b7e4-8e325ecc2248 service cinder] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:55.492245 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b766b4-7a62-4176-b7e4-8e325ecc2248 service cinder] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:55.498368 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5feba2-0af1-4eea-b88c-df77d09c4027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:55.499009 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5feba2-0af1-4eea-b88c-df77d09c4027 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:55.499333 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5feba2-0af1-4eea-b88c-df77d09c4027 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:55.499612 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5feba2-0af1-4eea-b88c-df77d09c4027 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:55.500262 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5feba2-0af1-4eea-b88c-df77d09c4027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:55.501902 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5feba2-0af1-4eea-b88c-df77d09c4027 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:55.514838 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4256/8533] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:20:55.517394 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad12001-3da6-4fd6-97e1-7ee9a2ff0e59 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:55.530121 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad12001-3da6-4fd6-97e1-7ee9a2ff0e59 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:55.534891 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d933c4-9245-42d8-9372-34b391ad53e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:55.535533 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d933c4-9245-42d8-9372-34b391ad53e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:55.535816 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d933c4-9245-42d8-9372-34b391ad53e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:55.536089 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d933c4-9245-42d8-9372-34b391ad53e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:55.536736 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d933c4-9245-42d8-9372-34b391ad53e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:55.538328 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d933c4-9245-42d8-9372-34b391ad53e2 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:55.550992 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4278/8534] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:20:55.554005 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5feba2-0af1-4eea-b88c-df77d09c4027 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:55.568250 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5feba2-0af1-4eea-b88c-df77d09c4027 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:55.573324 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f6f59c-c331-49de-b38c-93f9d45643c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:55.574546 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6f59c-c331-49de-b38c-93f9d45643c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:55.574824 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6f59c-c331-49de-b38c-93f9d45643c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:55.575128 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6f59c-c331-49de-b38c-93f9d45643c6 admin admin] PATH_INFO: `/v3/projects/747a0ba1309e4ff689d1c3fae06daa7d/users/164435f917c5450fb8b05591aa41b40d/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:55.592737 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f6f59c-c331-49de-b38c-93f9d45643c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=747a0ba1309e4ff689d1c3fae06daa7d, user_id=164435f917c5450fb8b05591aa41b40d, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:55.594867 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f6f59c-c331-49de-b38c-93f9d45643c6 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:55.609297 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4257/8535] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:20:55 2022] PUT /identity/v3/projects/747a0ba1309e4ff689d1c3fae06daa7d/users/164435f917c5450fb8b05591aa41b40d/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:20:55.619867 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb69be-f87d-41e1-a23a-ebb01c459a55 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:55.620361 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb69be-f87d-41e1-a23a-ebb01c459a55 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:55.620508 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb69be-f87d-41e1-a23a-ebb01c459a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:55.649591 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-edbb69be-f87d-41e1-a23a-ebb01c459a55 None None] MFA Rules not processed for user `164435f917c5450fb8b05591aa41b40d`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:55.650796 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-edbb69be-f87d-41e1-a23a-ebb01c459a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:55.728119 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4279/8536] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:20:55.729695 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f6f59c-c331-49de-b38c-93f9d45643c6 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:55.798489 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f6f59c-c331-49de-b38c-93f9d45643c6 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:55.803875 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fffe0-fed4-4dad-bb46-8a6d1bd315fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:55.804488 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fffe0-fed4-4dad-bb46-8a6d1bd315fb admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:55.804820 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fffe0-fed4-4dad-bb46-8a6d1bd315fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:55.805091 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fffe0-fed4-4dad-bb46-8a6d1bd315fb admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:55.805720 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74fffe0-fed4-4dad-bb46-8a6d1bd315fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:55.807648 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74fffe0-fed4-4dad-bb46-8a6d1bd315fb admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:55.840479 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4258/8537] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:20:55 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:20:55.841657 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb69be-f87d-41e1-a23a-ebb01c459a55 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:55.852907 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb69be-f87d-41e1-a23a-ebb01c459a55 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:55.918352 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6deb7c-08fe-4d67-8f24-780937ac4e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:55.918971 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6deb7c-08fe-4d67-8f24-780937ac4e4c admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:55.919287 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6deb7c-08fe-4d67-8f24-780937ac4e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:55.919563 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6deb7c-08fe-4d67-8f24-780937ac4e4c admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:55.920201 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6deb7c-08fe-4d67-8f24-780937ac4e4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:55.922134 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6deb7c-08fe-4d67-8f24-780937ac4e4c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:55.944612 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4280/8538] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:20:55 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:20:55.949460 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fffe0-fed4-4dad-bb46-8a6d1bd315fb admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:55.960968 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fffe0-fed4-4dad-bb46-8a6d1bd315fb admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:55.970393 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c21de-9374-4511-9e9a-7b6247a1f211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:55.971013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c21de-9374-4511-9e9a-7b6247a1f211 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:55.971324 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c21de-9374-4511-9e9a-7b6247a1f211 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:55.971595 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c21de-9374-4511-9e9a-7b6247a1f211 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:55.972339 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c21de-9374-4511-9e9a-7b6247a1f211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:55.974131 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c21de-9374-4511-9e9a-7b6247a1f211 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:55.977745 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6deb7c-08fe-4d67-8f24-780937ac4e4c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:55.987386 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4259/8539] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:20:55.992022 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c21de-9374-4511-9e9a-7b6247a1f211 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:56.004432 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c21de-9374-4511-9e9a-7b6247a1f211 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:56.012404 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f93c5-7731-408e-919d-f5fd03a9194c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:56.013281 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f93c5-7731-408e-919d-f5fd03a9194c admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:56.014638 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f93c5-7731-408e-919d-f5fd03a9194c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:56.014931 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f93c5-7731-408e-919d-f5fd03a9194c admin admin] PATH_INFO: `/v3/projects/690a881b0b994aab89011189eec0e3ce/users/0cef8b45b66c4424a29a8308b9e1d5e0/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:56.035155 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f93c5-7731-408e-919d-f5fd03a9194c admin admin] RBAC: Authorizing `identity:create_grant(project_id=690a881b0b994aab89011189eec0e3ce, user_id=0cef8b45b66c4424a29a8308b9e1d5e0, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:56.037891 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f93c5-7731-408e-919d-f5fd03a9194c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:56.048334 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6deb7c-08fe-4d67-8f24-780937ac4e4c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:56.055084 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4260/8540] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:20:55 2022] PUT /identity/v3/projects/690a881b0b994aab89011189eec0e3ce/users/0cef8b45b66c4424a29a8308b9e1d5e0/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:20:56.055559 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:56.060247 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f93c5-7731-408e-919d-f5fd03a9194c admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:56.070008 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:56.117303 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94099d2e-5d95-4429-8bf3-914570f9a706 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:56.118213 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94099d2e-5d95-4429-8bf3-914570f9a706 service cinder] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:56.118496 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94099d2e-5d95-4429-8bf3-914570f9a706 service cinder] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:56.118766 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94099d2e-5d95-4429-8bf3-914570f9a706 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:56.122580 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-94099d2e-5d95-4429-8bf3-914570f9a706 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:56.141270 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f93c5-7731-408e-919d-f5fd03a9194c admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:56.146376 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c05ba-484c-479a-a193-9ed66ed366f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:56.146992 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c05ba-484c-479a-a193-9ed66ed366f0 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:56.147303 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c05ba-484c-479a-a193-9ed66ed366f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:56.147584 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c05ba-484c-479a-a193-9ed66ed366f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:56.148234 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94c05ba-484c-479a-a193-9ed66ed366f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:56.149853 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94c05ba-484c-479a-a193-9ed66ed366f0 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:56.164012 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4261/8541] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:20:56.165282 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c05ba-484c-479a-a193-9ed66ed366f0 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:56.178939 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c05ba-484c-479a-a193-9ed66ed366f0 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:56.184913 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b05ce72-3a84-42c1-8de1-e5885b1c0b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:56.185708 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05ce72-3a84-42c1-8de1-e5885b1c0b51 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:56.186098 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05ce72-3a84-42c1-8de1-e5885b1c0b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:56.186519 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05ce72-3a84-42c1-8de1-e5885b1c0b51 admin admin] PATH_INFO: `/v3/projects/690a881b0b994aab89011189eec0e3ce/users/0cef8b45b66c4424a29a8308b9e1d5e0/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:56.188617 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b05ce72-3a84-42c1-8de1-e5885b1c0b51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=690a881b0b994aab89011189eec0e3ce, user_id=0cef8b45b66c4424a29a8308b9e1d5e0, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:56.191390 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b05ce72-3a84-42c1-8de1-e5885b1c0b51 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:56.203858 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94099d2e-5d95-4429-8bf3-914570f9a706 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:56.204180 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4262/8542] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:20:56 2022] PUT /identity/v3/projects/690a881b0b994aab89011189eec0e3ce/users/0cef8b45b66c4424a29a8308b9e1d5e0/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:20:56.205583 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94099d2e-5d95-4429-8bf3-914570f9a706 service cinder] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:56.216448 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4281/8543] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:20:55 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:20:56.219572 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08cbb1-6411-424b-b34a-cf7c46d68d07 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:56.219865 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08cbb1-6411-424b-b34a-cf7c46d68d07 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:56.220143 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08cbb1-6411-424b-b34a-cf7c46d68d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:56.248708 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-4e08cbb1-6411-424b-b34a-cf7c46d68d07 None None] MFA Rules not processed for user `0cef8b45b66c4424a29a8308b9e1d5e0`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:20:56.250021 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4e08cbb1-6411-424b-b34a-cf7c46d68d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:56.346440 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4263/8544] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:20:56 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:20:56.357881 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94099d2e-5d95-4429-8bf3-914570f9a706 service cinder] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:56.369549 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94099d2e-5d95-4429-8bf3-914570f9a706 service cinder] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:56.431648 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29284f08-ccd9-46a4-92ec-82e6b944d0d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:56.432297 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29284f08-ccd9-46a4-92ec-82e6b944d0d8 service cinder] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:56.432579 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29284f08-ccd9-46a4-92ec-82e6b944d0d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:56.432853 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29284f08-ccd9-46a4-92ec-82e6b944d0d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:56.443913 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29284f08-ccd9-46a4-92ec-82e6b944d0d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:56.445355 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29284f08-ccd9-46a4-92ec-82e6b944d0d8 service cinder] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:56.456293 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4282/8545] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:20:56 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:20:56.498635 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08cbb1-6411-424b-b34a-cf7c46d68d07 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:56.500143 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4e08cbb1-6411-424b-b34a-cf7c46d68d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:56.515827 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08cbb1-6411-424b-b34a-cf7c46d68d07 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:56.519728 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f014b8-e21d-46d5-9eb8-e7b59ebe6db5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:56.520410 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f014b8-e21d-46d5-9eb8-e7b59ebe6db5 service cinder] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:56.520753 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f014b8-e21d-46d5-9eb8-e7b59ebe6db5 service cinder] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:56.521091 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f014b8-e21d-46d5-9eb8-e7b59ebe6db5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:56.585620 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f014b8-e21d-46d5-9eb8-e7b59ebe6db5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:56.587717 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f014b8-e21d-46d5-9eb8-e7b59ebe6db5 service cinder] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:56.600760 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4264/8546] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:20:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:21:00.659217 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29284f08-ccd9-46a4-92ec-82e6b944d0d8 service cinder] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:00.732120 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29284f08-ccd9-46a4-92ec-82e6b944d0d8 service cinder] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:00.736455 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b538cecf-c80a-475f-9a65-0b8b0b2390d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:00.737097 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538cecf-c80a-475f-9a65-0b8b0b2390d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:00.737378 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538cecf-c80a-475f-9a65-0b8b0b2390d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:00.737654 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538cecf-c80a-475f-9a65-0b8b0b2390d9 admin admin] PATH_INFO: `/v3/users/1cd0dc7d69bf4475881dca4d8dc6989f` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:00.738800 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b538cecf-c80a-475f-9a65-0b8b0b2390d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cd0dc7d69bf4475881dca4d8dc6989f)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:00.744256 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b538cecf-c80a-475f-9a65-0b8b0b2390d9 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:00.747716 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:00.804092 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b538cecf-c80a-475f-9a65-0b8b0b2390d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cd0dc7d69bf4475881dca4d8dc6989f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:00.805084 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b538cecf-c80a-475f-9a65-0b8b0b2390d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cd0dc7d69bf4475881dca4d8dc6989f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:00.815840 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b538cecf-c80a-475f-9a65-0b8b0b2390d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cd0dc7d69bf4475881dca4d8dc6989f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:00.823796 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b538cecf-c80a-475f-9a65-0b8b0b2390d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cd0dc7d69bf4475881dca4d8dc6989f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:00.824594 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b538cecf-c80a-475f-9a65-0b8b0b2390d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cd0dc7d69bf4475881dca4d8dc6989f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:00.846507 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4283/8547] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:21:00 2022] DELETE /identity/v3/users/1cd0dc7d69bf4475881dca4d8dc6989f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:21:00.850793 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b822523-1942-44af-be42-cfee709c8ec2 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:00.851384 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b822523-1942-44af-be42-cfee709c8ec2 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:00.851384 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b822523-1942-44af-be42-cfee709c8ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:00.873053 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-6b822523-1942-44af-be42-cfee709c8ec2 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:21:00.874288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6b822523-1942-44af-be42-cfee709c8ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:00.884191 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:00.954296 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4265/8548] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:21:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:21:00.964896 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b538cecf-c80a-475f-9a65-0b8b0b2390d9 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:00.966896 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b538cecf-c80a-475f-9a65-0b8b0b2390d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:01.045779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b538cecf-c80a-475f-9a65-0b8b0b2390d9 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:01.049593 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ed140-830e-4f65-b40b-1622c0ae452a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:01.050242 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ed140-830e-4f65-b40b-1622c0ae452a service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:01.050520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ed140-830e-4f65-b40b-1622c0ae452a service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:01.050793 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ed140-830e-4f65-b40b-1622c0ae452a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:01.061918 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ed140-830e-4f65-b40b-1622c0ae452a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:01.063492 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ed140-830e-4f65-b40b-1622c0ae452a service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:01.073596 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4284/8549] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:21:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:21:01.398549 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b822523-1942-44af-be42-cfee709c8ec2 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:01.400099 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6b822523-1942-44af-be42-cfee709c8ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:01.413187 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b822523-1942-44af-be42-cfee709c8ec2 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:01.425554 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b82e702-a147-49b3-a986-ba3834e26992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:01.426708 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82e702-a147-49b3-a986-ba3834e26992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:01.427262 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82e702-a147-49b3-a986-ba3834e26992 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:01.428170 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82e702-a147-49b3-a986-ba3834e26992 admin admin] PATH_INFO: `/v3/projects/e1ebf70a25b6429ba76730ab74ea9d0d` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:01.430314 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b82e702-a147-49b3-a986-ba3834e26992 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1ebf70a25b6429ba76730ab74ea9d0d)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:01.432771 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b82e702-a147-49b3-a986-ba3834e26992 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:01.500622 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7b82e702-a147-49b3-a986-ba3834e26992 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1ebf70a25b6429ba76730ab74ea9d0d', 'request_id': 'req-7b82e702-a147-49b3-a986-ba3834e26992'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:01.506613 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7b82e702-a147-49b3-a986-ba3834e26992 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1ebf70a25b6429ba76730ab74ea9d0d', 'request_id': 'req-7b82e702-a147-49b3-a986-ba3834e26992'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:01.516166 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7b82e702-a147-49b3-a986-ba3834e26992 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1ebf70a25b6429ba76730ab74ea9d0d', 'request_id': 'req-7b82e702-a147-49b3-a986-ba3834e26992'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:01.529585 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7b82e702-a147-49b3-a986-ba3834e26992 admin admin] The token cache is being invalidate because project e1ebf70a25b6429ba76730ab74ea9d0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:21:01.529970 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7b82e702-a147-49b3-a986-ba3834e26992 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:01.530572 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7b82e702-a147-49b3-a986-ba3834e26992 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:01.532348 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4266/8550] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:21:01 2022] DELETE /identity/v3/projects/e1ebf70a25b6429ba76730ab74ea9d0d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:21:01.536680 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ed140-830e-4f65-b40b-1622c0ae452a service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:01.550447 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ed140-830e-4f65-b40b-1622c0ae452a service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:01.619915 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec9142-5db8-488c-9ae4-391b022edb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:01.621070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec9142-5db8-488c-9ae4-391b022edb2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:01.621351 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec9142-5db8-488c-9ae4-391b022edb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:01.621613 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec9142-5db8-488c-9ae4-391b022edb2c admin admin] PATH_INFO: `/v3/users/164435f917c5450fb8b05591aa41b40d` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:01.622915 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec9142-5db8-488c-9ae4-391b022edb2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=164435f917c5450fb8b05591aa41b40d)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:01.624873 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec9142-5db8-488c-9ae4-391b022edb2c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:01.657110 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:01.681899 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-80ec9142-5db8-488c-9ae4-391b022edb2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '164435f917c5450fb8b05591aa41b40d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:01.682999 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-80ec9142-5db8-488c-9ae4-391b022edb2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '164435f917c5450fb8b05591aa41b40d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:01.692664 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-80ec9142-5db8-488c-9ae4-391b022edb2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '164435f917c5450fb8b05591aa41b40d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:01.702867 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-80ec9142-5db8-488c-9ae4-391b022edb2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '164435f917c5450fb8b05591aa41b40d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:01.703694 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-80ec9142-5db8-488c-9ae4-391b022edb2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '164435f917c5450fb8b05591aa41b40d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:01.726092 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4285/8551] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:21:01 2022] DELETE /identity/v3/users/164435f917c5450fb8b05591aa41b40d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:21:02.029467 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b82e702-a147-49b3-a986-ba3834e26992 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:02.031014 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7b82e702-a147-49b3-a986-ba3834e26992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:02.049076 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b82e702-a147-49b3-a986-ba3834e26992 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:02.133576 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5054474-872e-49e5-8715-b303865ff398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:02.134239 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5054474-872e-49e5-8715-b303865ff398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:02.134521 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5054474-872e-49e5-8715-b303865ff398 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:02.134798 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5054474-872e-49e5-8715-b303865ff398 admin admin] PATH_INFO: `/v3/projects/747a0ba1309e4ff689d1c3fae06daa7d` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:02.137811 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5054474-872e-49e5-8715-b303865ff398 admin admin] RBAC: Authorizing `identity:delete_project(project_id=747a0ba1309e4ff689d1c3fae06daa7d)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:02.139868 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5054474-872e-49e5-8715-b303865ff398 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:02.193136 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:02.202754 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e5054474-872e-49e5-8715-b303865ff398 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '747a0ba1309e4ff689d1c3fae06daa7d', 'request_id': 'req-e5054474-872e-49e5-8715-b303865ff398'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:02.209414 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e5054474-872e-49e5-8715-b303865ff398 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '747a0ba1309e4ff689d1c3fae06daa7d', 'request_id': 'req-e5054474-872e-49e5-8715-b303865ff398'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:02.220107 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e5054474-872e-49e5-8715-b303865ff398 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '747a0ba1309e4ff689d1c3fae06daa7d', 'request_id': 'req-e5054474-872e-49e5-8715-b303865ff398'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:02.237341 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e5054474-872e-49e5-8715-b303865ff398 admin admin] The token cache is being invalidate because project 747a0ba1309e4ff689d1c3fae06daa7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:21:02.237668 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e5054474-872e-49e5-8715-b303865ff398 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:02.238350 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e5054474-872e-49e5-8715-b303865ff398 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:02.239956 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4267/8552] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:21:02 2022] DELETE /identity/v3/projects/747a0ba1309e4ff689d1c3fae06daa7d => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:21:02.248552 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec9142-5db8-488c-9ae4-391b022edb2c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:02.249986 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-80ec9142-5db8-488c-9ae4-391b022edb2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:02.264121 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec9142-5db8-488c-9ae4-391b022edb2c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:02.347515 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4076e0-6d87-4fbe-9861-6c031ce0ca95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:02.348257 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4076e0-6d87-4fbe-9861-6c031ce0ca95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:02.348596 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4076e0-6d87-4fbe-9861-6c031ce0ca95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:02.348929 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4076e0-6d87-4fbe-9861-6c031ce0ca95 admin admin] PATH_INFO: `/v3/users/0cef8b45b66c4424a29a8308b9e1d5e0` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:02.350193 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4076e0-6d87-4fbe-9861-6c031ce0ca95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cef8b45b66c4424a29a8308b9e1d5e0)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:02.350633 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5054474-872e-49e5-8715-b303865ff398 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:02.352241 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4076e0-6d87-4fbe-9861-6c031ce0ca95 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:02.352382 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e5054474-872e-49e5-8715-b303865ff398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:02.367633 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5054474-872e-49e5-8715-b303865ff398 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:02.373564 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b681d1f-98f1-4885-8493-4512097e4b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:02.374512 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b681d1f-98f1-4885-8493-4512097e4b4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:02.374958 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b681d1f-98f1-4885-8493-4512097e4b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:02.375423 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b681d1f-98f1-4885-8493-4512097e4b4c admin admin] PATH_INFO: `/v3/users/83042a23e63c46088d33571d28c30261` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:02.377216 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b681d1f-98f1-4885-8493-4512097e4b4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=83042a23e63c46088d33571d28c30261)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:02.379543 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b681d1f-98f1-4885-8493-4512097e4b4c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:02.410155 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4e4076e0-6d87-4fbe-9861-6c031ce0ca95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cef8b45b66c4424a29a8308b9e1d5e0'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:02.411066 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4e4076e0-6d87-4fbe-9861-6c031ce0ca95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cef8b45b66c4424a29a8308b9e1d5e0'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:02.420357 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4e4076e0-6d87-4fbe-9861-6c031ce0ca95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cef8b45b66c4424a29a8308b9e1d5e0'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:02.428557 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4e4076e0-6d87-4fbe-9861-6c031ce0ca95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cef8b45b66c4424a29a8308b9e1d5e0'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:02.429230 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4e4076e0-6d87-4fbe-9861-6c031ce0ca95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cef8b45b66c4424a29a8308b9e1d5e0'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:02.441214 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9b681d1f-98f1-4885-8493-4512097e4b4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83042a23e63c46088d33571d28c30261'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:02.442080 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9b681d1f-98f1-4885-8493-4512097e4b4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83042a23e63c46088d33571d28c30261'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:02.450245 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4286/8553] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:21:02 2022] DELETE /identity/v3/users/0cef8b45b66c4424a29a8308b9e1d5e0 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:21:02.457430 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9b681d1f-98f1-4885-8493-4512097e4b4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83042a23e63c46088d33571d28c30261'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:02.467523 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9b681d1f-98f1-4885-8493-4512097e4b4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83042a23e63c46088d33571d28c30261'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:02.476327 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9b681d1f-98f1-4885-8493-4512097e4b4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83042a23e63c46088d33571d28c30261'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:02.483929 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4268/8554] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:21:02 2022] DELETE /identity/v3/users/83042a23e63c46088d33571d28c30261 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:21:02.488709 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb8813-4769-4acd-a705-63935dac0327 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:02.489099 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb8813-4769-4acd-a705-63935dac0327 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:02.489473 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb8813-4769-4acd-a705-63935dac0327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:02.510852 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-c7fb8813-4769-4acd-a705-63935dac0327 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:21:02.512361 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c7fb8813-4769-4acd-a705-63935dac0327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:02.534644 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:02.596472 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4287/8555] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:21:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:21:02.607156 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b681d1f-98f1-4885-8493-4512097e4b4c admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:02.608593 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9b681d1f-98f1-4885-8493-4512097e4b4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:02.682450 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b681d1f-98f1-4885-8493-4512097e4b4c admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:02.687106 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fc114-9c30-4e31-beae-9b476c614479 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:02.688109 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fc114-9c30-4e31-beae-9b476c614479 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:02.688109 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fc114-9c30-4e31-beae-9b476c614479 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:02.688330 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fc114-9c30-4e31-beae-9b476c614479 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:02.703562 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6fc114-9c30-4e31-beae-9b476c614479 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:02.703562 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6fc114-9c30-4e31-beae-9b476c614479 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:02.716317 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4269/8556] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:21:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:21:02.772167 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb8813-4769-4acd-a705-63935dac0327 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:02.774286 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c7fb8813-4769-4acd-a705-63935dac0327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:02.788567 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb8813-4769-4acd-a705-63935dac0327 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:02.795227 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b8522-0414-437d-bf93-2d8c46d0b257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:02.795896 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b8522-0414-437d-bf93-2d8c46d0b257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:02.796202 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b8522-0414-437d-bf93-2d8c46d0b257 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:02.796479 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b8522-0414-437d-bf93-2d8c46d0b257 admin admin] PATH_INFO: `/v3/projects/690a881b0b994aab89011189eec0e3ce` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:02.797676 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9b8522-0414-437d-bf93-2d8c46d0b257 admin admin] RBAC: Authorizing `identity:delete_project(project_id=690a881b0b994aab89011189eec0e3ce)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:02.799785 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9b8522-0414-437d-bf93-2d8c46d0b257 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:02.868715 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0f9b8522-0414-437d-bf93-2d8c46d0b257 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '690a881b0b994aab89011189eec0e3ce', 'request_id': 'req-0f9b8522-0414-437d-bf93-2d8c46d0b257'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:02.876998 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0f9b8522-0414-437d-bf93-2d8c46d0b257 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '690a881b0b994aab89011189eec0e3ce', 'request_id': 'req-0f9b8522-0414-437d-bf93-2d8c46d0b257'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:02.891329 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0f9b8522-0414-437d-bf93-2d8c46d0b257 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '690a881b0b994aab89011189eec0e3ce', 'request_id': 'req-0f9b8522-0414-437d-bf93-2d8c46d0b257'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:02.911237 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0f9b8522-0414-437d-bf93-2d8c46d0b257 admin admin] The token cache is being invalidate because project 690a881b0b994aab89011189eec0e3ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:21:02.911807 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0f9b8522-0414-437d-bf93-2d8c46d0b257 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:02.913222 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-0f9b8522-0414-437d-bf93-2d8c46d0b257 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:02.915964 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4288/8557] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:21:02 2022] DELETE /identity/v3/projects/690a881b0b994aab89011189eec0e3ce => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:21:02.923779 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f93df-1938-467d-9244-d71d2204569e None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:02.924083 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f93df-1938-467d-9244-d71d2204569e None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:02.924378 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f93df-1938-467d-9244-d71d2204569e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:02.946349 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-fa6f93df-1938-467d-9244-d71d2204569e None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:21:02.947627 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-fa6f93df-1938-467d-9244-d71d2204569e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:02.991591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:03.029178 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4270/8558] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:21:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:21:03.037964 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11491744-68b4-4002-b380-8fd7acb9dc17 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:03.039250 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11491744-68b4-4002-b380-8fd7acb9dc17 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:03.039705 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11491744-68b4-4002-b380-8fd7acb9dc17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:03.053613 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f93df-1938-467d-9244-d71d2204569e None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:03.056176 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-fa6f93df-1938-467d-9244-d71d2204569e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:03.063875 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-11491744-68b4-4002-b380-8fd7acb9dc17 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:21:03.065224 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-11491744-68b4-4002-b380-8fd7acb9dc17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:03.080760 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f93df-1938-467d-9244-d71d2204569e None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:03.086092 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4289/8559] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:21:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:21:03.090245 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11491744-68b4-4002-b380-8fd7acb9dc17 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:03.095513 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ecce42-e08a-4a3f-b82a-fa65fbfb8238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:03.096182 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecce42-e08a-4a3f-b82a-fa65fbfb8238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:03.096463 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecce42-e08a-4a3f-b82a-fa65fbfb8238 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:03.096732 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecce42-e08a-4a3f-b82a-fa65fbfb8238 admin admin] PATH_INFO: `/v3/projects/336b1b4087d040338c011a9a1c6d5786` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:03.098448 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ecce42-e08a-4a3f-b82a-fa65fbfb8238 admin admin] RBAC: Authorizing `identity:delete_project(project_id=336b1b4087d040338c011a9a1c6d5786)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:03.101339 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ecce42-e08a-4a3f-b82a-fa65fbfb8238 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:03.101797 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11491744-68b4-4002-b380-8fd7acb9dc17 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:03.107480 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458d3c7-2caa-44d0-a207-3807a55113f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:03.108092 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458d3c7-2caa-44d0-a207-3807a55113f0 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:03.108394 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458d3c7-2caa-44d0-a207-3807a55113f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:03.109157 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458d3c7-2caa-44d0-a207-3807a55113f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:03.109811 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3458d3c7-2caa-44d0-a207-3807a55113f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:21:03.110107 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3458d3c7-2caa-44d0-a207-3807a55113f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:03.112168 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3458d3c7-2caa-44d0-a207-3807a55113f0 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:03.127472 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4290/8560] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:21:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:21:03.130474 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458d3c7-2caa-44d0-a207-3807a55113f0 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:03.145852 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458d3c7-2caa-44d0-a207-3807a55113f0 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:03.160336 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b6ecce42-e08a-4a3f-b82a-fa65fbfb8238 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '336b1b4087d040338c011a9a1c6d5786', 'request_id': 'req-b6ecce42-e08a-4a3f-b82a-fa65fbfb8238'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:03.168045 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b6ecce42-e08a-4a3f-b82a-fa65fbfb8238 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '336b1b4087d040338c011a9a1c6d5786', 'request_id': 'req-b6ecce42-e08a-4a3f-b82a-fa65fbfb8238'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:03.177944 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b6ecce42-e08a-4a3f-b82a-fa65fbfb8238 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '336b1b4087d040338c011a9a1c6d5786', 'request_id': 'req-b6ecce42-e08a-4a3f-b82a-fa65fbfb8238'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:03.193317 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b6ecce42-e08a-4a3f-b82a-fa65fbfb8238 admin admin] The token cache is being invalidate because project 336b1b4087d040338c011a9a1c6d5786 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:21:03.193940 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b6ecce42-e08a-4a3f-b82a-fa65fbfb8238 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:03.194937 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-b6ecce42-e08a-4a3f-b82a-fa65fbfb8238 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:03.197035 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4271/8561] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:21:03 2022] DELETE /identity/v3/projects/336b1b4087d040338c011a9a1c6d5786 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:21:03.201499 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ecce42-e08a-4a3f-b82a-fa65fbfb8238 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:03.203453 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b6ecce42-e08a-4a3f-b82a-fa65fbfb8238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:03.210943 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55623b91-99d4-43c7-a7d2-2ebd7dd3dbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:03.212017 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55623b91-99d4-43c7-a7d2-2ebd7dd3dbab admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:03.212322 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55623b91-99d4-43c7-a7d2-2ebd7dd3dbab admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:03.212596 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55623b91-99d4-43c7-a7d2-2ebd7dd3dbab admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:03.213231 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55623b91-99d4-43c7-a7d2-2ebd7dd3dbab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:03.216235 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55623b91-99d4-43c7-a7d2-2ebd7dd3dbab admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:03.253993 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4291/8562] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:21:03 2022] POST /identity/v3/projects => generated 381 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:21:03.256899 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55623b91-99d4-43c7-a7d2-2ebd7dd3dbab admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:03.259768 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-55623b91-99d4-43c7-a7d2-2ebd7dd3dbab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:03.276895 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:03.297837 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ecce42-e08a-4a3f-b82a-fa65fbfb8238 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:03.348650 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55623b91-99d4-43c7-a7d2-2ebd7dd3dbab admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:03.353941 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74817d9-07f6-458f-b7ff-b61e7ebda685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:03.354566 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74817d9-07f6-458f-b7ff-b61e7ebda685 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:03.355839 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74817d9-07f6-458f-b7ff-b61e7ebda685 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:03.356129 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74817d9-07f6-458f-b7ff-b61e7ebda685 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:03.357226 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74817d9-07f6-458f-b7ff-b61e7ebda685 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:03.359518 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74817d9-07f6-458f-b7ff-b61e7ebda685 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:03.374902 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6f98e-214a-4ec5-82d4-39f982b52ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:03.376064 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6f98e-214a-4ec5-82d4-39f982b52ac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:03.376463 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6f98e-214a-4ec5-82d4-39f982b52ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:03.376823 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6f98e-214a-4ec5-82d4-39f982b52ac9 admin admin] PATH_INFO: `/v3/users/c76a89ffd3b349278da4a300247430d6` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:03.378559 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a6f98e-214a-4ec5-82d4-39f982b52ac9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c76a89ffd3b349278da4a300247430d6)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:03.381095 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a6f98e-214a-4ec5-82d4-39f982b52ac9 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:03.387771 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4292/8563] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:21:03 2022] POST /identity/v3/users => generated 291 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:21:03.391467 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74817d9-07f6-458f-b7ff-b61e7ebda685 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:03.399081 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:03.406624 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74817d9-07f6-458f-b7ff-b61e7ebda685 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:03.413734 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b48fea-e5da-4278-89c3-0a0dee3e4189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:03.414492 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b48fea-e5da-4278-89c3-0a0dee3e4189 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:03.414877 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b48fea-e5da-4278-89c3-0a0dee3e4189 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:03.415231 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b48fea-e5da-4278-89c3-0a0dee3e4189 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:03.415975 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b48fea-e5da-4278-89c3-0a0dee3e4189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:03.418657 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b48fea-e5da-4278-89c3-0a0dee3e4189 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:03.442904 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4293/8564] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:21:03.448499 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b48fea-e5da-4278-89c3-0a0dee3e4189 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:03.450435 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-47a6f98e-214a-4ec5-82d4-39f982b52ac9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c76a89ffd3b349278da4a300247430d6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:03.451359 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-47a6f98e-214a-4ec5-82d4-39f982b52ac9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c76a89ffd3b349278da4a300247430d6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:03.462266 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b48fea-e5da-4278-89c3-0a0dee3e4189 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:03.469459 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7408e51-9bcb-4647-bda9-934f8d989ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:03.470088 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7408e51-9bcb-4647-bda9-934f8d989ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:03.470358 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7408e51-9bcb-4647-bda9-934f8d989ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:03.470685 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7408e51-9bcb-4647-bda9-934f8d989ba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:03.471292 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7408e51-9bcb-4647-bda9-934f8d989ba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:03.471800 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-47a6f98e-214a-4ec5-82d4-39f982b52ac9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c76a89ffd3b349278da4a300247430d6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:03.472945 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7408e51-9bcb-4647-bda9-934f8d989ba9 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:03.483618 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-47a6f98e-214a-4ec5-82d4-39f982b52ac9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c76a89ffd3b349278da4a300247430d6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:03.487675 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4294/8565] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:21:03.491870 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7408e51-9bcb-4647-bda9-934f8d989ba9 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:03.498484 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-47a6f98e-214a-4ec5-82d4-39f982b52ac9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c76a89ffd3b349278da4a300247430d6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:03.505284 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4272/8566] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:21:03 2022] DELETE /identity/v3/users/c76a89ffd3b349278da4a300247430d6 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:21:03.508965 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7408e51-9bcb-4647-bda9-934f8d989ba9 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:03.577745 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de309e-bb94-4861-996e-5328566dc1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:03.578453 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de309e-bb94-4861-996e-5328566dc1bd admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:03.578733 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de309e-bb94-4861-996e-5328566dc1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:03.579096 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de309e-bb94-4861-996e-5328566dc1bd admin admin] PATH_INFO: `/v3/projects/67fcf87130244dba8dc124c6e3706218/users/608e0bb1207044db9a38756ff974e98e/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:03.597996 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49de309e-bb94-4861-996e-5328566dc1bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=67fcf87130244dba8dc124c6e3706218, user_id=608e0bb1207044db9a38756ff974e98e, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:03.600857 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49de309e-bb94-4861-996e-5328566dc1bd admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:03.615386 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4295/8567] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:21:03 2022] PUT /identity/v3/projects/67fcf87130244dba8dc124c6e3706218/users/608e0bb1207044db9a38756ff974e98e/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:21:03.628680 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0a036-97ab-419b-926b-dbbcb034beb1 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:03.628971 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0a036-97ab-419b-926b-dbbcb034beb1 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:03.629231 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0a036-97ab-419b-926b-dbbcb034beb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:03.658274 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-8dc0a036-97ab-419b-926b-dbbcb034beb1 None None] MFA Rules not processed for user `608e0bb1207044db9a38756ff974e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:21:03.659521 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8dc0a036-97ab-419b-926b-dbbcb034beb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:03.742466 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4273/8568] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:21:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:21:03.746394 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de309e-bb94-4861-996e-5328566dc1bd admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:03.748319 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-49de309e-bb94-4861-996e-5328566dc1bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:03.804408 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc0a036-97ab-419b-926b-dbbcb034beb1 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:03.818243 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8dc0a036-97ab-419b-926b-dbbcb034beb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:03.823498 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de309e-bb94-4861-996e-5328566dc1bd admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:03.829575 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037eea62-eb03-415c-8f1a-2d43c1f0c82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:03.830203 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037eea62-eb03-415c-8f1a-2d43c1f0c82f admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:03.830482 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037eea62-eb03-415c-8f1a-2d43c1f0c82f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:03.830786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037eea62-eb03-415c-8f1a-2d43c1f0c82f admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:03.831419 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037eea62-eb03-415c-8f1a-2d43c1f0c82f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:03.833428 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037eea62-eb03-415c-8f1a-2d43c1f0c82f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:03.840546 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:03.843064 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc0a036-97ab-419b-926b-dbbcb034beb1 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:03.849678 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a93550-cac2-4f9f-a6d1-8092bc7947d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:03.850448 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a93550-cac2-4f9f-a6d1-8092bc7947d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:03.850737 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a93550-cac2-4f9f-a6d1-8092bc7947d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:03.851087 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a93550-cac2-4f9f-a6d1-8092bc7947d2 admin admin] PATH_INFO: `/v3/projects/1bb9cebd14aa4eef8deab6d26d81499f` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:03.852385 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a93550-cac2-4f9f-a6d1-8092bc7947d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bb9cebd14aa4eef8deab6d26d81499f)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:03.855529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a93550-cac2-4f9f-a6d1-8092bc7947d2 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:03.871507 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4296/8569] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:21:03 2022] POST /identity/v3/projects => generated 381 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:21:03.875589 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037eea62-eb03-415c-8f1a-2d43c1f0c82f admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:03.924378 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-26a93550-cac2-4f9f-a6d1-8092bc7947d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bb9cebd14aa4eef8deab6d26d81499f', 'request_id': 'req-26a93550-cac2-4f9f-a6d1-8092bc7947d2'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:03.931177 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-26a93550-cac2-4f9f-a6d1-8092bc7947d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bb9cebd14aa4eef8deab6d26d81499f', 'request_id': 'req-26a93550-cac2-4f9f-a6d1-8092bc7947d2'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:03.941949 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-26a93550-cac2-4f9f-a6d1-8092bc7947d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bb9cebd14aa4eef8deab6d26d81499f', 'request_id': 'req-26a93550-cac2-4f9f-a6d1-8092bc7947d2'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:03.956213 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-26a93550-cac2-4f9f-a6d1-8092bc7947d2 admin admin] The token cache is being invalidate because project 1bb9cebd14aa4eef8deab6d26d81499f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:21:03.956509 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-26a93550-cac2-4f9f-a6d1-8092bc7947d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:03.957207 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-26a93550-cac2-4f9f-a6d1-8092bc7947d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:03.958748 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4274/8570] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:21:03 2022] DELETE /identity/v3/projects/1bb9cebd14aa4eef8deab6d26d81499f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:21:03.962639 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a93550-cac2-4f9f-a6d1-8092bc7947d2 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:03.962985 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037eea62-eb03-415c-8f1a-2d43c1f0c82f admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:03.965509 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-26a93550-cac2-4f9f-a6d1-8092bc7947d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:03.976145 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:04.030742 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6e3b4-7121-41e4-ac8c-b61b18896bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:04.031566 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6e3b4-7121-41e4-ac8c-b61b18896bdd admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:04.031912 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6e3b4-7121-41e4-ac8c-b61b18896bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:04.032303 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6e3b4-7121-41e4-ac8c-b61b18896bdd admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:04.033078 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e6e3b4-7121-41e4-ac8c-b61b18896bdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:04.035478 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e6e3b4-7121-41e4-ac8c-b61b18896bdd admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:04.049142 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a93550-cac2-4f9f-a6d1-8092bc7947d2 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:04.054859 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357d172-8637-483b-b175-d8e078d8232f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:04.055613 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357d172-8637-483b-b175-d8e078d8232f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:04.056343 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357d172-8637-483b-b175-d8e078d8232f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:04.056343 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357d172-8637-483b-b175-d8e078d8232f admin admin] PATH_INFO: `/v3/users/ab592fd8c4aa46b4addb5b3765ff3b12` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:04.057528 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357d172-8637-483b-b175-d8e078d8232f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab592fd8c4aa46b4addb5b3765ff3b12)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:04.060371 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357d172-8637-483b-b175-d8e078d8232f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:04.060939 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4297/8571] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:21:03 2022] POST /identity/v3/users => generated 297 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:21:04.064651 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6e3b4-7121-41e4-ac8c-b61b18896bdd admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:04.066394 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b7e6e3b4-7121-41e4-ac8c-b61b18896bdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:04.080857 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6e3b4-7121-41e4-ac8c-b61b18896bdd admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:04.086587 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353438a-6a75-46ea-963f-1f38463bfb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:04.087139 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353438a-6a75-46ea-963f-1f38463bfb9a admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:04.087532 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353438a-6a75-46ea-963f-1f38463bfb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:04.087811 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353438a-6a75-46ea-963f-1f38463bfb9a admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:04.088584 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c353438a-6a75-46ea-963f-1f38463bfb9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:04.090984 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c353438a-6a75-46ea-963f-1f38463bfb9a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:04.103993 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4298/8572] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:21:04.108697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353438a-6a75-46ea-963f-1f38463bfb9a admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:04.115931 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0357d172-8637-483b-b175-d8e078d8232f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab592fd8c4aa46b4addb5b3765ff3b12'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:04.116807 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0357d172-8637-483b-b175-d8e078d8232f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab592fd8c4aa46b4addb5b3765ff3b12'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:04.122044 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353438a-6a75-46ea-963f-1f38463bfb9a admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:04.127229 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630577bf-8549-4a0e-a722-0b51b5dd74f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:04.128017 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630577bf-8549-4a0e-a722-0b51b5dd74f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:04.128296 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630577bf-8549-4a0e-a722-0b51b5dd74f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:04.128570 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630577bf-8549-4a0e-a722-0b51b5dd74f2 admin admin] PATH_INFO: `/v3/projects/35002e1a2a244d209a49669088b1d697/users/9bfe100e0bad49a698a21e123ebe1960/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:04.129765 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0357d172-8637-483b-b175-d8e078d8232f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab592fd8c4aa46b4addb5b3765ff3b12'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:04.138924 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0357d172-8637-483b-b175-d8e078d8232f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab592fd8c4aa46b4addb5b3765ff3b12'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:04.147910 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-0357d172-8637-483b-b175-d8e078d8232f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab592fd8c4aa46b4addb5b3765ff3b12'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:04.150354 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630577bf-8549-4a0e-a722-0b51b5dd74f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35002e1a2a244d209a49669088b1d697, user_id=9bfe100e0bad49a698a21e123ebe1960, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:04.153622 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630577bf-8549-4a0e-a722-0b51b5dd74f2 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:04.156978 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4275/8573] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:21:03 2022] DELETE /identity/v3/users/ab592fd8c4aa46b4addb5b3765ff3b12 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:21:04.175677 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4299/8574] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:21:04 2022] PUT /identity/v3/projects/35002e1a2a244d209a49669088b1d697/users/9bfe100e0bad49a698a21e123ebe1960/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:21:04.179742 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357d172-8637-483b-b175-d8e078d8232f admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:04.181371 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0357d172-8637-483b-b175-d8e078d8232f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:04.264179 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357d172-8637-483b-b175-d8e078d8232f admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:04.297114 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:04.329087 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ebedf3-b15f-486e-906a-8fe0a35950de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:04.329749 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebedf3-b15f-486e-906a-8fe0a35950de admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:04.330030 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebedf3-b15f-486e-906a-8fe0a35950de admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:04.330305 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebedf3-b15f-486e-906a-8fe0a35950de admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:04.331050 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ebedf3-b15f-486e-906a-8fe0a35950de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:04.333005 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ebedf3-b15f-486e-906a-8fe0a35950de admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:04.347058 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4276/8575] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:21:04.349867 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630577bf-8549-4a0e-a722-0b51b5dd74f2 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:04.361041 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630577bf-8549-4a0e-a722-0b51b5dd74f2 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:04.366159 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a9709-3aec-4444-af45-69eb57f7bc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:04.366949 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a9709-3aec-4444-af45-69eb57f7bc7d admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:04.367276 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a9709-3aec-4444-af45-69eb57f7bc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:04.367556 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a9709-3aec-4444-af45-69eb57f7bc7d admin admin] PATH_INFO: `/v3/projects/35002e1a2a244d209a49669088b1d697/users/9bfe100e0bad49a698a21e123ebe1960/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:04.369521 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a9709-3aec-4444-af45-69eb57f7bc7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=35002e1a2a244d209a49669088b1d697, user_id=9bfe100e0bad49a698a21e123ebe1960, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:04.373433 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a9709-3aec-4444-af45-69eb57f7bc7d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:04.385092 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4300/8576] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:21:04 2022] PUT /identity/v3/projects/35002e1a2a244d209a49669088b1d697/users/9bfe100e0bad49a698a21e123ebe1960/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:21:04.396725 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572eff52-5c28-491a-9b32-d882ff78d6ac None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:04.397016 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572eff52-5c28-491a-9b32-d882ff78d6ac None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:04.397286 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572eff52-5c28-491a-9b32-d882ff78d6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:04.427083 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-572eff52-5c28-491a-9b32-d882ff78d6ac None None] MFA Rules not processed for user `9bfe100e0bad49a698a21e123ebe1960`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:21:04.428110 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-572eff52-5c28-491a-9b32-d882ff78d6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:04.459303 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a9709-3aec-4444-af45-69eb57f7bc7d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:04.461135 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9e5a9709-3aec-4444-af45-69eb57f7bc7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:04.524137 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4277/8577] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:21:04 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:21:04.529810 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:04.537759 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572eff52-5c28-491a-9b32-d882ff78d6ac None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:04.539488 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-572eff52-5c28-491a-9b32-d882ff78d6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:04.566856 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a9709-3aec-4444-af45-69eb57f7bc7d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:04.572269 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1114b4ef-a59e-4af1-a28d-e6b54200fe6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:04.574252 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114b4ef-a59e-4af1-a28d-e6b54200fe6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:04.574599 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114b4ef-a59e-4af1-a28d-e6b54200fe6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:04.574864 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114b4ef-a59e-4af1-a28d-e6b54200fe6b admin admin] PATH_INFO: `/v3/projects/10a5ff3f3aeb40e5bfae5d959d477d3d` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:04.576296 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1114b4ef-a59e-4af1-a28d-e6b54200fe6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=10a5ff3f3aeb40e5bfae5d959d477d3d)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:04.579475 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1114b4ef-a59e-4af1-a28d-e6b54200fe6b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:04.624665 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572eff52-5c28-491a-9b32-d882ff78d6ac None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:04.629317 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd45080-e0b0-453f-bdbc-a10138cdbe62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:04.629550 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd45080-e0b0-453f-bdbc-a10138cdbe62 service cinder] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:04.629832 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd45080-e0b0-453f-bdbc-a10138cdbe62 service cinder] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:04.630113 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd45080-e0b0-453f-bdbc-a10138cdbe62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:04.643875 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd45080-e0b0-453f-bdbc-a10138cdbe62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:04.645538 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd45080-e0b0-453f-bdbc-a10138cdbe62 service cinder] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:04.654220 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1114b4ef-a59e-4af1-a28d-e6b54200fe6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10a5ff3f3aeb40e5bfae5d959d477d3d', 'request_id': 'req-1114b4ef-a59e-4af1-a28d-e6b54200fe6b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:04.658971 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4278/8578] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:21:04 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:21:04.660650 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1114b4ef-a59e-4af1-a28d-e6b54200fe6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10a5ff3f3aeb40e5bfae5d959d477d3d', 'request_id': 'req-1114b4ef-a59e-4af1-a28d-e6b54200fe6b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:04.669121 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1114b4ef-a59e-4af1-a28d-e6b54200fe6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10a5ff3f3aeb40e5bfae5d959d477d3d', 'request_id': 'req-1114b4ef-a59e-4af1-a28d-e6b54200fe6b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:04.696672 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1114b4ef-a59e-4af1-a28d-e6b54200fe6b admin admin] The token cache is being invalidate because project 10a5ff3f3aeb40e5bfae5d959d477d3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:21:04.696966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1114b4ef-a59e-4af1-a28d-e6b54200fe6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:04.702809 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1114b4ef-a59e-4af1-a28d-e6b54200fe6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:04.702809 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4301/8579] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:21:04 2022] DELETE /identity/v3/projects/10a5ff3f3aeb40e5bfae5d959d477d3d => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:21:04.706890 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d3717-8172-45ca-959f-972fdbaf2c61 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:04.707803 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d3717-8172-45ca-959f-972fdbaf2c61 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:04.707803 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d3717-8172-45ca-959f-972fdbaf2c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:04.730655 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-7c1d3717-8172-45ca-959f-972fdbaf2c61 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:21:04.731941 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7c1d3717-8172-45ca-959f-972fdbaf2c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:04.794194 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:04.806346 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4279/8580] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:21:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:21:04.907259 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1fc9b-a080-4a27-a2db-b216547ee5a1 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:04.907739 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1fc9b-a080-4a27-a2db-b216547ee5a1 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:04.907852 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1fc9b-a080-4a27-a2db-b216547ee5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:04.935542 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-daf1fc9b-a080-4a27-a2db-b216547ee5a1 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:21:04.935542 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-daf1fc9b-a080-4a27-a2db-b216547ee5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:04.941656 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4302/8581] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:21:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:21:04.945696 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d3717-8172-45ca-959f-972fdbaf2c61 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:04.956276 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d3717-8172-45ca-959f-972fdbaf2c61 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:04.961020 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ce636-ac18-4693-92be-e922bcc0affb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:04.961627 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ce636-ac18-4693-92be-e922bcc0affb admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:04.961908 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ce636-ac18-4693-92be-e922bcc0affb admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:04.962183 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ce636-ac18-4693-92be-e922bcc0affb admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:04.962834 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ce636-ac18-4693-92be-e922bcc0affb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:21:04.963211 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ce636-ac18-4693-92be-e922bcc0affb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:04.965077 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ce636-ac18-4693-92be-e922bcc0affb admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:04.979105 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4280/8582] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:21:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:21:04.983122 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf1fc9b-a080-4a27-a2db-b216547ee5a1 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:04.992515 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf1fc9b-a080-4a27-a2db-b216547ee5a1 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:04.997915 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc3f23-3a9c-4da3-9735-6ea2dfabd76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:04.998376 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc3f23-3a9c-4da3-9735-6ea2dfabd76d admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:04.998654 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc3f23-3a9c-4da3-9735-6ea2dfabd76d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:04.998924 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc3f23-3a9c-4da3-9735-6ea2dfabd76d admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:04.999887 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc3f23-3a9c-4da3-9735-6ea2dfabd76d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:05.001808 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc3f23-3a9c-4da3-9735-6ea2dfabd76d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:05.035593 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4303/8583] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:21:04 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:21:05.036892 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ce636-ac18-4693-92be-e922bcc0affb admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:05.048656 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ce636-ac18-4693-92be-e922bcc0affb admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:05.112048 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43354c-569a-4cfe-8bb3-f3e516ec7347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:05.112684 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc3f23-3a9c-4da3-9735-6ea2dfabd76d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:05.112809 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43354c-569a-4cfe-8bb3-f3e516ec7347 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:05.112907 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43354c-569a-4cfe-8bb3-f3e516ec7347 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:05.113184 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43354c-569a-4cfe-8bb3-f3e516ec7347 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:05.113827 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a43354c-569a-4cfe-8bb3-f3e516ec7347 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:05.114296 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a8fc3f23-3a9c-4da3-9735-6ea2dfabd76d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:05.115783 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a43354c-569a-4cfe-8bb3-f3e516ec7347 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:05.128387 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc3f23-3a9c-4da3-9735-6ea2dfabd76d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:05.134066 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e80dd-a697-49c5-be50-d882e1eb6d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:05.134694 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e80dd-a697-49c5-be50-d882e1eb6d12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:05.134970 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e80dd-a697-49c5-be50-d882e1eb6d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:05.135270 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e80dd-a697-49c5-be50-d882e1eb6d12 admin admin] PATH_INFO: `/v3/users/608e0bb1207044db9a38756ff974e98e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:05.136424 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11e80dd-a697-49c5-be50-d882e1eb6d12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=608e0bb1207044db9a38756ff974e98e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:05.138353 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11e80dd-a697-49c5-be50-d882e1eb6d12 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:05.138839 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4281/8584] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:21:05 2022] POST /identity/v3/users => generated 286 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:21:05.142796 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43354c-569a-4cfe-8bb3-f3e516ec7347 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:05.153313 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43354c-569a-4cfe-8bb3-f3e516ec7347 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:05.158382 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5392e-93ed-42ef-9cc4-a431d013f0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:05.158992 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5392e-93ed-42ef-9cc4-a431d013f0b0 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:05.159307 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5392e-93ed-42ef-9cc4-a431d013f0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:05.159582 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5392e-93ed-42ef-9cc4-a431d013f0b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:05.160227 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb5392e-93ed-42ef-9cc4-a431d013f0b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:05.162146 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb5392e-93ed-42ef-9cc4-a431d013f0b0 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:05.176128 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4282/8585] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:21:05.180158 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5392e-93ed-42ef-9cc4-a431d013f0b0 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:05.189819 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a11e80dd-a697-49c5-be50-d882e1eb6d12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '608e0bb1207044db9a38756ff974e98e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:05.190502 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a11e80dd-a697-49c5-be50-d882e1eb6d12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '608e0bb1207044db9a38756ff974e98e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:05.191503 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5392e-93ed-42ef-9cc4-a431d013f0b0 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:05.197125 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f56e573-6e2d-4afc-889b-1e278422a05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:05.197485 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a11e80dd-a697-49c5-be50-d882e1eb6d12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '608e0bb1207044db9a38756ff974e98e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:05.197865 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56e573-6e2d-4afc-889b-1e278422a05c admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:05.198287 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56e573-6e2d-4afc-889b-1e278422a05c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:05.198574 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56e573-6e2d-4afc-889b-1e278422a05c admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:05.199286 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f56e573-6e2d-4afc-889b-1e278422a05c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:05.200894 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f56e573-6e2d-4afc-889b-1e278422a05c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:05.205173 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a11e80dd-a697-49c5-be50-d882e1eb6d12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '608e0bb1207044db9a38756ff974e98e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:05.205940 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a11e80dd-a697-49c5-be50-d882e1eb6d12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '608e0bb1207044db9a38756ff974e98e'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:05.211090 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4283/8586] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:21:05.215937 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f56e573-6e2d-4afc-889b-1e278422a05c admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:05.217868 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1f56e573-6e2d-4afc-889b-1e278422a05c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:05.225219 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4304/8587] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:21:05 2022] DELETE /identity/v3/users/608e0bb1207044db9a38756ff974e98e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:21:05.229442 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee776a6-c2e6-4ea3-a4fe-ca5535c1c7d4 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:05.229723 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee776a6-c2e6-4ea3-a4fe-ca5535c1c7d4 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:05.230145 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee776a6-c2e6-4ea3-a4fe-ca5535c1c7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:05.231623 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f56e573-6e2d-4afc-889b-1e278422a05c admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:05.252133 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-fee776a6-c2e6-4ea3-a4fe-ca5535c1c7d4 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:21:05.253944 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-fee776a6-c2e6-4ea3-a4fe-ca5535c1c7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:05.258863 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:05.295348 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de4a09-2aeb-4e7c-9471-f410ece7285c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:05.296053 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de4a09-2aeb-4e7c-9471-f410ece7285c admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:05.296332 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de4a09-2aeb-4e7c-9471-f410ece7285c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:05.296604 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de4a09-2aeb-4e7c-9471-f410ece7285c admin admin] PATH_INFO: `/v3/projects/ca4ac1309d784d33b4122f0976435304/users/ee4a3df1fa254fcab2514d25c1d2bc77/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:05.312439 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2de4a09-2aeb-4e7c-9471-f410ece7285c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca4ac1309d784d33b4122f0976435304, user_id=ee4a3df1fa254fcab2514d25c1d2bc77, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:05.315191 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2de4a09-2aeb-4e7c-9471-f410ece7285c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:05.317063 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4305/8588] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:21:05.328669 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee776a6-c2e6-4ea3-a4fe-ca5535c1c7d4 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:05.330006 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4284/8589] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:21:05 2022] PUT /identity/v3/projects/ca4ac1309d784d33b4122f0976435304/users/ee4a3df1fa254fcab2514d25c1d2bc77/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:21:05.330140 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-fee776a6-c2e6-4ea3-a4fe-ca5535c1c7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:05.340262 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040e650-f049-499a-beeb-8114ffae896a None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:05.340550 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040e650-f049-499a-beeb-8114ffae896a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:05.340829 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040e650-f049-499a-beeb-8114ffae896a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:05.368615 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-3040e650-f049-499a-beeb-8114ffae896a None None] MFA Rules not processed for user `ee4a3df1fa254fcab2514d25c1d2bc77`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:21:05.369829 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3040e650-f049-499a-beeb-8114ffae896a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:05.389975 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee776a6-c2e6-4ea3-a4fe-ca5535c1c7d4 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:05.392967 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:05.441985 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446f135-736a-4a9f-9ebb-a3045f94f418 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:05.442473 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4285/8590] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:21:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:21:05.442618 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446f135-736a-4a9f-9ebb-a3045f94f418 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:05.442967 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446f135-736a-4a9f-9ebb-a3045f94f418 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:05.443338 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446f135-736a-4a9f-9ebb-a3045f94f418 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:05.454290 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040e650-f049-499a-beeb-8114ffae896a None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:05.455766 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3040e650-f049-499a-beeb-8114ffae896a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:05.508191 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0446f135-736a-4a9f-9ebb-a3045f94f418 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:05.509660 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0446f135-736a-4a9f-9ebb-a3045f94f418 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:05.519162 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040e650-f049-499a-beeb-8114ffae896a None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:05.520367 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4306/8591] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:21:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:21:05.522985 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a002aba-c4d9-4d97-ae1d-80db94eb6d7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:05.523620 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a002aba-c4d9-4d97-ae1d-80db94eb6d7e service cinder] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:05.523900 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a002aba-c4d9-4d97-ae1d-80db94eb6d7e service cinder] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:05.524178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a002aba-c4d9-4d97-ae1d-80db94eb6d7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:05.534175 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a002aba-c4d9-4d97-ae1d-80db94eb6d7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:05.535656 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a002aba-c4d9-4d97-ae1d-80db94eb6d7e service cinder] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:05.545363 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4286/8592] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:21:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:21:05.830178 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446f135-736a-4a9f-9ebb-a3045f94f418 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:05.831754 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0446f135-736a-4a9f-9ebb-a3045f94f418 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:05.847739 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446f135-736a-4a9f-9ebb-a3045f94f418 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:05.852526 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f6c56-0cac-43d4-b4f5-fe89060fd18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:05.853172 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f6c56-0cac-43d4-b4f5-fe89060fd18b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:05.853609 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f6c56-0cac-43d4-b4f5-fe89060fd18b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:05.853915 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f6c56-0cac-43d4-b4f5-fe89060fd18b admin admin] PATH_INFO: `/v3/projects/67fcf87130244dba8dc124c6e3706218` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:05.855117 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f6c56-0cac-43d4-b4f5-fe89060fd18b admin admin] RBAC: Authorizing `identity:delete_project(project_id=67fcf87130244dba8dc124c6e3706218)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:05.857312 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f6c56-0cac-43d4-b4f5-fe89060fd18b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:05.871749 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:05.929166 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a63f6c56-0cac-43d4-b4f5-fe89060fd18b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67fcf87130244dba8dc124c6e3706218', 'request_id': 'req-a63f6c56-0cac-43d4-b4f5-fe89060fd18b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:05.937531 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a63f6c56-0cac-43d4-b4f5-fe89060fd18b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67fcf87130244dba8dc124c6e3706218', 'request_id': 'req-a63f6c56-0cac-43d4-b4f5-fe89060fd18b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:05.948359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a63f6c56-0cac-43d4-b4f5-fe89060fd18b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67fcf87130244dba8dc124c6e3706218', 'request_id': 'req-a63f6c56-0cac-43d4-b4f5-fe89060fd18b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:05.970628 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a63f6c56-0cac-43d4-b4f5-fe89060fd18b admin admin] The token cache is being invalidate because project 67fcf87130244dba8dc124c6e3706218 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:21:05.970992 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a63f6c56-0cac-43d4-b4f5-fe89060fd18b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:05.971629 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a63f6c56-0cac-43d4-b4f5-fe89060fd18b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:05.973462 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4307/8593] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:21:05 2022] DELETE /identity/v3/projects/67fcf87130244dba8dc124c6e3706218 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:21:05.978745 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a002aba-c4d9-4d97-ae1d-80db94eb6d7e service cinder] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:05.992962 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a002aba-c4d9-4d97-ae1d-80db94eb6d7e service cinder] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:06.072813 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04c584-ba7b-42dd-aed7-a90792f3fa0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:06.073463 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04c584-ba7b-42dd-aed7-a90792f3fa0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:06.073777 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04c584-ba7b-42dd-aed7-a90792f3fa0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:06.074051 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04c584-ba7b-42dd-aed7-a90792f3fa0d admin admin] PATH_INFO: `/v3/users/9bfe100e0bad49a698a21e123ebe1960` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:06.076546 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04c584-ba7b-42dd-aed7-a90792f3fa0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bfe100e0bad49a698a21e123ebe1960)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:06.078327 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04c584-ba7b-42dd-aed7-a90792f3fa0d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:06.126146 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f6c56-0cac-43d4-b4f5-fe89060fd18b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:06.128500 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a63f6c56-0cac-43d4-b4f5-fe89060fd18b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:06.142213 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-cc04c584-ba7b-42dd-aed7-a90792f3fa0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bfe100e0bad49a698a21e123ebe1960'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:06.144402 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-cc04c584-ba7b-42dd-aed7-a90792f3fa0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bfe100e0bad49a698a21e123ebe1960'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:06.165564 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-cc04c584-ba7b-42dd-aed7-a90792f3fa0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bfe100e0bad49a698a21e123ebe1960'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:06.168304 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:06.177158 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-cc04c584-ba7b-42dd-aed7-a90792f3fa0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bfe100e0bad49a698a21e123ebe1960'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:06.188870 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-cc04c584-ba7b-42dd-aed7-a90792f3fa0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bfe100e0bad49a698a21e123ebe1960'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:06.201600 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4287/8594] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:21:05 2022] DELETE /identity/v3/users/9bfe100e0bad49a698a21e123ebe1960 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:21:06.237659 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f6c56-0cac-43d4-b4f5-fe89060fd18b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:06.319344 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af8329e-cea4-44ed-a7ac-c9d173895764 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:06.320062 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8329e-cea4-44ed-a7ac-c9d173895764 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:06.320411 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8329e-cea4-44ed-a7ac-c9d173895764 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:06.320876 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8329e-cea4-44ed-a7ac-c9d173895764 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:06.322703 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1af8329e-cea4-44ed-a7ac-c9d173895764 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:06.339411 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af8329e-cea4-44ed-a7ac-c9d173895764 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:06.341203 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af8329e-cea4-44ed-a7ac-c9d173895764 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:06.356243 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4308/8595] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:21:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:21:06.505384 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04c584-ba7b-42dd-aed7-a90792f3fa0d admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:06.506824 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-cc04c584-ba7b-42dd-aed7-a90792f3fa0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:06.599959 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04c584-ba7b-42dd-aed7-a90792f3fa0d admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:06.605497 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f049fb34-7801-42fe-befb-a771ff5b4e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:06.606117 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049fb34-7801-42fe-befb-a771ff5b4e04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:06.606410 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049fb34-7801-42fe-befb-a771ff5b4e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:06.606788 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049fb34-7801-42fe-befb-a771ff5b4e04 admin admin] PATH_INFO: `/v3/projects/35002e1a2a244d209a49669088b1d697` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:06.608288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f049fb34-7801-42fe-befb-a771ff5b4e04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35002e1a2a244d209a49669088b1d697)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:06.610292 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f049fb34-7801-42fe-befb-a771ff5b4e04 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:06.668836 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f049fb34-7801-42fe-befb-a771ff5b4e04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35002e1a2a244d209a49669088b1d697', 'request_id': 'req-f049fb34-7801-42fe-befb-a771ff5b4e04'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:06.676084 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f049fb34-7801-42fe-befb-a771ff5b4e04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35002e1a2a244d209a49669088b1d697', 'request_id': 'req-f049fb34-7801-42fe-befb-a771ff5b4e04'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:06.686926 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f049fb34-7801-42fe-befb-a771ff5b4e04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35002e1a2a244d209a49669088b1d697', 'request_id': 'req-f049fb34-7801-42fe-befb-a771ff5b4e04'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:06.699916 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f049fb34-7801-42fe-befb-a771ff5b4e04 admin admin] The token cache is being invalidate because project 35002e1a2a244d209a49669088b1d697 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:21:06.700586 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f049fb34-7801-42fe-befb-a771ff5b4e04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:06.701496 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-f049fb34-7801-42fe-befb-a771ff5b4e04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:06.703383 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4288/8596] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:21:06 2022] DELETE /identity/v3/projects/35002e1a2a244d209a49669088b1d697 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:21:06.708487 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87e172-ad68-4c48-93ca-db720ef02519 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:06.708710 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87e172-ad68-4c48-93ca-db720ef02519 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:06.708987 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87e172-ad68-4c48-93ca-db720ef02519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:06.730966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-5a87e172-ad68-4c48-93ca-db720ef02519 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:21:06.732279 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5a87e172-ad68-4c48-93ca-db720ef02519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:06.752807 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:06.801012 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4309/8597] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:21:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:21:06.810113 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cca4b-8357-402e-afe7-e00079a02d79 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:06.810400 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cca4b-8357-402e-afe7-e00079a02d79 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:06.810673 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cca4b-8357-402e-afe7-e00079a02d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:06.832072 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-448cca4b-8357-402e-afe7-e00079a02d79 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:21:06.833296 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-448cca4b-8357-402e-afe7-e00079a02d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:06.842445 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4289/8598] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:21:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:21:06.846787 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87e172-ad68-4c48-93ca-db720ef02519 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:06.858207 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87e172-ad68-4c48-93ca-db720ef02519 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:06.863488 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb277dcd-b4a3-41e4-8b01-173420bea3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:06.864113 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb277dcd-b4a3-41e4-8b01-173420bea3af admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:06.864394 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb277dcd-b4a3-41e4-8b01-173420bea3af admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:06.864667 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb277dcd-b4a3-41e4-8b01-173420bea3af admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:06.865316 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb277dcd-b4a3-41e4-8b01-173420bea3af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:21:06.865644 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb277dcd-b4a3-41e4-8b01-173420bea3af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:06.867305 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb277dcd-b4a3-41e4-8b01-173420bea3af admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:06.880652 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4310/8599] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:21:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:21:06.885255 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448cca4b-8357-402e-afe7-e00079a02d79 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:06.895601 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448cca4b-8357-402e-afe7-e00079a02d79 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:06.900454 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9aa5ae-ef50-4281-a95e-d5596b5bcca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:06.901059 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9aa5ae-ef50-4281-a95e-d5596b5bcca6 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:06.901495 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9aa5ae-ef50-4281-a95e-d5596b5bcca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:06.901895 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9aa5ae-ef50-4281-a95e-d5596b5bcca6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:06.902537 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9aa5ae-ef50-4281-a95e-d5596b5bcca6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:06.904479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9aa5ae-ef50-4281-a95e-d5596b5bcca6 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:06.935482 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4290/8600] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:21:06 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:21:06.939791 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb277dcd-b4a3-41e4-8b01-173420bea3af admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:06.951509 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb277dcd-b4a3-41e4-8b01-173420bea3af admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:07.004128 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a9715-26ba-448c-b58e-0aa02479afa6 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:07.004424 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a9715-26ba-448c-b58e-0aa02479afa6 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:07.004706 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a9715-26ba-448c-b58e-0aa02479afa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:07.023457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c7abb-7f9d-4413-bccc-7f8e2a8b68a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:07.024295 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c7abb-7f9d-4413-bccc-7f8e2a8b68a6 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:07.024644 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c7abb-7f9d-4413-bccc-7f8e2a8b68a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:07.024992 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c7abb-7f9d-4413-bccc-7f8e2a8b68a6 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:07.025909 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c7abb-7f9d-4413-bccc-7f8e2a8b68a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:07.026019 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-f14a9715-26ba-448c-b58e-0aa02479afa6 None None] MFA Rules not processed for user `ee4a3df1fa254fcab2514d25c1d2bc77`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:21:07.027526 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f14a9715-26ba-448c-b58e-0aa02479afa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:07.028183 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c7abb-7f9d-4413-bccc-7f8e2a8b68a6 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:07.052993 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4311/8601] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:21:06 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:21:07.057515 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c7abb-7f9d-4413-bccc-7f8e2a8b68a6 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:07.072139 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c7abb-7f9d-4413-bccc-7f8e2a8b68a6 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:07.076074 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:07.081025 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7604f5ee-5efe-4309-94d2-96ca9208f4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:07.081687 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604f5ee-5efe-4309-94d2-96ca9208f4c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:07.082060 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604f5ee-5efe-4309-94d2-96ca9208f4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:07.082339 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604f5ee-5efe-4309-94d2-96ca9208f4c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:07.083767 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7604f5ee-5efe-4309-94d2-96ca9208f4c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:07.085396 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7604f5ee-5efe-4309-94d2-96ca9208f4c8 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:07.093261 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4291/8602] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:21:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:21:07.097540 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4312/8603] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:21:07.107645 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a9715-26ba-448c-b58e-0aa02479afa6 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:07.118711 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a9715-26ba-448c-b58e-0aa02479afa6 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:07.125158 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab815453-15e8-4041-96ec-53b5fe4fcfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:07.125781 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab815453-15e8-4041-96ec-53b5fe4fcfdc admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:07.126065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab815453-15e8-4041-96ec-53b5fe4fcfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:07.126339 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab815453-15e8-4041-96ec-53b5fe4fcfdc admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:07.126994 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab815453-15e8-4041-96ec-53b5fe4fcfdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:07.128745 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab815453-15e8-4041-96ec-53b5fe4fcfdc admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:07.143513 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4292/8604] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:21:07.145352 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7604f5ee-5efe-4309-94d2-96ca9208f4c8 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:07.158103 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7604f5ee-5efe-4309-94d2-96ca9208f4c8 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:07.162854 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70bdc42-2411-42a5-b510-89953aa66476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:07.163542 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bdc42-2411-42a5-b510-89953aa66476 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:07.163860 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bdc42-2411-42a5-b510-89953aa66476 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:07.164132 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bdc42-2411-42a5-b510-89953aa66476 admin admin] PATH_INFO: `/v3/projects/8683e6b5ed984fe7bb4d68fdd24a59c7/users/e5d5b76f9fb9445fbdffee6b61806a26/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:07.180923 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70bdc42-2411-42a5-b510-89953aa66476 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8683e6b5ed984fe7bb4d68fdd24a59c7, user_id=e5d5b76f9fb9445fbdffee6b61806a26, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:07.184826 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70bdc42-2411-42a5-b510-89953aa66476 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:07.199427 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4313/8605] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:21:07 2022] PUT /identity/v3/projects/8683e6b5ed984fe7bb4d68fdd24a59c7/users/e5d5b76f9fb9445fbdffee6b61806a26/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:21:07.210769 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d16bf-2b77-4af8-97c1-9188357bd5ce None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:07.210986 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d16bf-2b77-4af8-97c1-9188357bd5ce None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:07.211273 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d16bf-2b77-4af8-97c1-9188357bd5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:07.242135 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-885d16bf-2b77-4af8-97c1-9188357bd5ce None None] MFA Rules not processed for user `e5d5b76f9fb9445fbdffee6b61806a26`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:21:07.243404 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-885d16bf-2b77-4af8-97c1-9188357bd5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:07.316662 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4293/8606] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:21:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:21:07.327897 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70bdc42-2411-42a5-b510-89953aa66476 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:07.329611 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e70bdc42-2411-42a5-b510-89953aa66476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:07.391860 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70bdc42-2411-42a5-b510-89953aa66476 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:07.395814 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88579f0-c189-4a37-9f4f-82b54eacfe83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:07.396375 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88579f0-c189-4a37-9f4f-82b54eacfe83 service cinder] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:07.396653 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88579f0-c189-4a37-9f4f-82b54eacfe83 service cinder] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:07.396983 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88579f0-c189-4a37-9f4f-82b54eacfe83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:07.406862 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88579f0-c189-4a37-9f4f-82b54eacfe83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:07.408344 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88579f0-c189-4a37-9f4f-82b54eacfe83 service cinder] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:07.418160 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4314/8607] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:21:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:21:08.149420 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d16bf-2b77-4af8-97c1-9188357bd5ce None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:08.152893 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-885d16bf-2b77-4af8-97c1-9188357bd5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:08.245036 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d16bf-2b77-4af8-97c1-9188357bd5ce None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:08.251757 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878c781-018a-44dd-a782-c41b0640981a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:08.252387 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878c781-018a-44dd-a782-c41b0640981a service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:08.252686 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878c781-018a-44dd-a782-c41b0640981a service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:08.252937 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878c781-018a-44dd-a782-c41b0640981a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:08.254737 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e878c781-018a-44dd-a782-c41b0640981a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:08.269867 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e878c781-018a-44dd-a782-c41b0640981a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:08.271521 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e878c781-018a-44dd-a782-c41b0640981a service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:08.286872 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4294/8608] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:21:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:21:16.009783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88579f0-c189-4a37-9f4f-82b54eacfe83 service cinder] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:16.023652 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:16.093501 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88579f0-c189-4a37-9f4f-82b54eacfe83 service cinder] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:16.098446 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7dc434-3e47-46ba-8deb-050640abb9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:16.099224 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7dc434-3e47-46ba-8deb-050640abb9a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:16.099566 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7dc434-3e47-46ba-8deb-050640abb9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:16.099910 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7dc434-3e47-46ba-8deb-050640abb9a5 admin admin] PATH_INFO: `/v3/users/e5d5b76f9fb9445fbdffee6b61806a26` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:16.101103 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7dc434-3e47-46ba-8deb-050640abb9a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5d5b76f9fb9445fbdffee6b61806a26)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:16.103136 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7dc434-3e47-46ba-8deb-050640abb9a5 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:16.156057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-dd7dc434-3e47-46ba-8deb-050640abb9a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5d5b76f9fb9445fbdffee6b61806a26'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:16.157028 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-dd7dc434-3e47-46ba-8deb-050640abb9a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5d5b76f9fb9445fbdffee6b61806a26'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:16.164473 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-dd7dc434-3e47-46ba-8deb-050640abb9a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5d5b76f9fb9445fbdffee6b61806a26'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:16.172774 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-dd7dc434-3e47-46ba-8deb-050640abb9a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5d5b76f9fb9445fbdffee6b61806a26'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:16.173429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-dd7dc434-3e47-46ba-8deb-050640abb9a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5d5b76f9fb9445fbdffee6b61806a26'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:16.192949 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4315/8609] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:21:16 2022] DELETE /identity/v3/users/e5d5b76f9fb9445fbdffee6b61806a26 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:21:16.197340 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdc314-def2-4ae0-830f-bcd0e6383373 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:16.197833 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdc314-def2-4ae0-830f-bcd0e6383373 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:16.197922 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdc314-def2-4ae0-830f-bcd0e6383373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:16.220153 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-dbcdc314-def2-4ae0-830f-bcd0e6383373 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:21:16.221358 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-dbcdc314-def2-4ae0-830f-bcd0e6383373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:16.284371 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:16.302394 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4295/8610] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:21:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:21:16.303275 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7dc434-3e47-46ba-8deb-050640abb9a5 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:16.305565 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-dd7dc434-3e47-46ba-8deb-050640abb9a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:16.383989 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7dc434-3e47-46ba-8deb-050640abb9a5 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:16.391472 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6517a470-fda4-44a5-83a7-262d525ba131 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:16.392373 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517a470-fda4-44a5-83a7-262d525ba131 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:16.392730 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517a470-fda4-44a5-83a7-262d525ba131 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:16.393073 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517a470-fda4-44a5-83a7-262d525ba131 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:16.412928 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6517a470-fda4-44a5-83a7-262d525ba131 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:16.412928 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6517a470-fda4-44a5-83a7-262d525ba131 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:16.417194 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4316/8611] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:21:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:21:16.738644 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcdc314-def2-4ae0-830f-bcd0e6383373 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:16.740333 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-dbcdc314-def2-4ae0-830f-bcd0e6383373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:16.755498 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcdc314-def2-4ae0-830f-bcd0e6383373 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:16.773816 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4a150-5d39-4386-ad6b-ab089b1d48f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:16.774471 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4a150-5d39-4386-ad6b-ab089b1d48f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:16.774734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4a150-5d39-4386-ad6b-ab089b1d48f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:16.775003 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4a150-5d39-4386-ad6b-ab089b1d48f9 admin admin] PATH_INFO: `/v3/projects/8683e6b5ed984fe7bb4d68fdd24a59c7` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:16.776198 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a4a150-5d39-4386-ad6b-ab089b1d48f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8683e6b5ed984fe7bb4d68fdd24a59c7)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:16.778250 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a4a150-5d39-4386-ad6b-ab089b1d48f9 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:16.853952 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-57a4a150-5d39-4386-ad6b-ab089b1d48f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8683e6b5ed984fe7bb4d68fdd24a59c7', 'request_id': 'req-57a4a150-5d39-4386-ad6b-ab089b1d48f9'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:16.861611 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-57a4a150-5d39-4386-ad6b-ab089b1d48f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8683e6b5ed984fe7bb4d68fdd24a59c7', 'request_id': 'req-57a4a150-5d39-4386-ad6b-ab089b1d48f9'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:16.884866 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-57a4a150-5d39-4386-ad6b-ab089b1d48f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8683e6b5ed984fe7bb4d68fdd24a59c7', 'request_id': 'req-57a4a150-5d39-4386-ad6b-ab089b1d48f9'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:16.899314 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-57a4a150-5d39-4386-ad6b-ab089b1d48f9 admin admin] The token cache is being invalidate because project 8683e6b5ed984fe7bb4d68fdd24a59c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:21:16.899639 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-57a4a150-5d39-4386-ad6b-ab089b1d48f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:16.900321 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-57a4a150-5d39-4386-ad6b-ab089b1d48f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:16.902039 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4296/8612] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:21:16 2022] DELETE /identity/v3/projects/8683e6b5ed984fe7bb4d68fdd24a59c7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:21:16.907036 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a75220-43f9-4b07-89c1-5c5f5294b545 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:16.907347 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a75220-43f9-4b07-89c1-5c5f5294b545 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:16.907618 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a75220-43f9-4b07-89c1-5c5f5294b545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:16.930757 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-42a75220-43f9-4b07-89c1-5c5f5294b545 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:21:16.932003 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-42a75220-43f9-4b07-89c1-5c5f5294b545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:16.960177 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:17.008460 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4317/8613] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:21:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:21:17.010172 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e93701-9215-4407-9631-3dcd1b1f3e25 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:17.010463 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e93701-9215-4407-9631-3dcd1b1f3e25 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:17.010738 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e93701-9215-4407-9631-3dcd1b1f3e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:17.033032 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-68e93701-9215-4407-9631-3dcd1b1f3e25 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:21:17.034260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-68e93701-9215-4407-9631-3dcd1b1f3e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:17.046556 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4297/8614] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:21:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:21:17.047786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a75220-43f9-4b07-89c1-5c5f5294b545 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:17.058352 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a75220-43f9-4b07-89c1-5c5f5294b545 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:17.064091 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba0a95-6801-44f8-b35c-c263cee65d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:17.064724 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba0a95-6801-44f8-b35c-c263cee65d04 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:17.065067 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba0a95-6801-44f8-b35c-c263cee65d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:17.065260 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba0a95-6801-44f8-b35c-c263cee65d04 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:17.065917 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ba0a95-6801-44f8-b35c-c263cee65d04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:21:17.066219 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ba0a95-6801-44f8-b35c-c263cee65d04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:17.067935 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ba0a95-6801-44f8-b35c-c263cee65d04 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:17.086483 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4318/8615] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:21:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:21:17.087641 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e93701-9215-4407-9631-3dcd1b1f3e25 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:17.097681 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e93701-9215-4407-9631-3dcd1b1f3e25 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:17.102446 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4676b655-4a7a-4e85-98db-ef49e524940d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:17.103078 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676b655-4a7a-4e85-98db-ef49e524940d admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:17.103364 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676b655-4a7a-4e85-98db-ef49e524940d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:17.103634 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676b655-4a7a-4e85-98db-ef49e524940d admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:17.104266 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4676b655-4a7a-4e85-98db-ef49e524940d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:17.107050 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4676b655-4a7a-4e85-98db-ef49e524940d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:17.135195 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4298/8616] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:21:17 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:21:17.139716 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba0a95-6801-44f8-b35c-c263cee65d04 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:17.150511 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba0a95-6801-44f8-b35c-c263cee65d04 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:17.224054 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db82be5-960f-43c9-a776-52cfc601c069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:17.224647 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db82be5-960f-43c9-a776-52cfc601c069 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:17.224937 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db82be5-960f-43c9-a776-52cfc601c069 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:17.225537 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db82be5-960f-43c9-a776-52cfc601c069 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:17.226101 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db82be5-960f-43c9-a776-52cfc601c069 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:17.228342 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db82be5-960f-43c9-a776-52cfc601c069 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:17.256185 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4319/8617] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:21:17 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:21:17.257505 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4676b655-4a7a-4e85-98db-ef49e524940d admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:17.269606 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4676b655-4a7a-4e85-98db-ef49e524940d admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:17.274617 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d383db-8837-46db-b783-ab8fcdd51df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:17.275265 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d383db-8837-46db-b783-ab8fcdd51df4 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:17.275545 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d383db-8837-46db-b783-ab8fcdd51df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:17.275817 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d383db-8837-46db-b783-ab8fcdd51df4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:17.276462 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d383db-8837-46db-b783-ab8fcdd51df4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:17.278103 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d383db-8837-46db-b783-ab8fcdd51df4 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:17.288844 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4299/8618] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:21:17.292895 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db82be5-960f-43c9-a776-52cfc601c069 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:17.305193 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db82be5-960f-43c9-a776-52cfc601c069 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:17.312912 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2923b0b-dafc-400e-9f96-7bc1f5e7ce38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:17.313801 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2923b0b-dafc-400e-9f96-7bc1f5e7ce38 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:17.314083 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2923b0b-dafc-400e-9f96-7bc1f5e7ce38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:17.314356 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2923b0b-dafc-400e-9f96-7bc1f5e7ce38 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:17.315066 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2923b0b-dafc-400e-9f96-7bc1f5e7ce38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:17.316719 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2923b0b-dafc-400e-9f96-7bc1f5e7ce38 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:17.329461 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4320/8619] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:21:17.333515 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d383db-8837-46db-b783-ab8fcdd51df4 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:17.344626 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d383db-8837-46db-b783-ab8fcdd51df4 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:17.349578 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0678c1a-ebf5-4ef8-9364-b068f1421363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:17.350381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0678c1a-ebf5-4ef8-9364-b068f1421363 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:17.350731 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0678c1a-ebf5-4ef8-9364-b068f1421363 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:17.351109 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0678c1a-ebf5-4ef8-9364-b068f1421363 admin admin] PATH_INFO: `/v3/projects/b1e791ce1092424db8f0d5fcafec9344/users/7aa7d50db1624ad3a75b17759d9600fe/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:17.369367 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0678c1a-ebf5-4ef8-9364-b068f1421363 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1e791ce1092424db8f0d5fcafec9344, user_id=7aa7d50db1624ad3a75b17759d9600fe, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:17.372483 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0678c1a-ebf5-4ef8-9364-b068f1421363 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:17.388519 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4300/8620] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:21:17 2022] PUT /identity/v3/projects/b1e791ce1092424db8f0d5fcafec9344/users/7aa7d50db1624ad3a75b17759d9600fe/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:21:17.398701 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e594e9-ee6a-4107-88a5-d6a6984e7082 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:17.398984 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e594e9-ee6a-4107-88a5-d6a6984e7082 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:17.399306 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e594e9-ee6a-4107-88a5-d6a6984e7082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:17.430881 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-c2e594e9-ee6a-4107-88a5-d6a6984e7082 None None] MFA Rules not processed for user `7aa7d50db1624ad3a75b17759d9600fe`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:21:17.432083 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c2e594e9-ee6a-4107-88a5-d6a6984e7082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:17.519270 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4321/8621] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:21:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:21:17.523388 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0678c1a-ebf5-4ef8-9364-b068f1421363 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:17.525245 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d0678c1a-ebf5-4ef8-9364-b068f1421363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:17.590515 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0678c1a-ebf5-4ef8-9364-b068f1421363 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:17.596573 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e5da0-3d4c-4a53-945f-affca3804271 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:17.598657 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e5da0-3d4c-4a53-945f-affca3804271 service cinder] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:17.598657 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e5da0-3d4c-4a53-945f-affca3804271 service cinder] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:17.598657 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e5da0-3d4c-4a53-945f-affca3804271 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:17.610865 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3e5da0-3d4c-4a53-945f-affca3804271 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:17.612247 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3e5da0-3d4c-4a53-945f-affca3804271 service cinder] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:17.622709 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4301/8622] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:21:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:21:21.490837 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e594e9-ee6a-4107-88a5-d6a6984e7082 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:21.522430 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:21.569726 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e594e9-ee6a-4107-88a5-d6a6984e7082 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:21.581949 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be50c119-cc67-4d03-a8b6-3e1de194c382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:21.583108 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be50c119-cc67-4d03-a8b6-3e1de194c382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:21.583402 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be50c119-cc67-4d03-a8b6-3e1de194c382 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:21.583681 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be50c119-cc67-4d03-a8b6-3e1de194c382 admin admin] PATH_INFO: `/v3/users/7aa7d50db1624ad3a75b17759d9600fe` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:21.584925 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be50c119-cc67-4d03-a8b6-3e1de194c382 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7aa7d50db1624ad3a75b17759d9600fe)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:21.588474 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be50c119-cc67-4d03-a8b6-3e1de194c382 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:21.656923 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-be50c119-cc67-4d03-a8b6-3e1de194c382 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7aa7d50db1624ad3a75b17759d9600fe'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:21.657658 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-be50c119-cc67-4d03-a8b6-3e1de194c382 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7aa7d50db1624ad3a75b17759d9600fe'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:21.666394 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-be50c119-cc67-4d03-a8b6-3e1de194c382 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7aa7d50db1624ad3a75b17759d9600fe'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:21.677482 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-be50c119-cc67-4d03-a8b6-3e1de194c382 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7aa7d50db1624ad3a75b17759d9600fe'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:21.678316 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-be50c119-cc67-4d03-a8b6-3e1de194c382 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7aa7d50db1624ad3a75b17759d9600fe'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:21.707766 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4322/8623] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:21:21 2022] DELETE /identity/v3/users/7aa7d50db1624ad3a75b17759d9600fe => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:21:21.712684 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee3153-9fd5-46a4-96dd-0c5f5e29794b None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:21.713281 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee3153-9fd5-46a4-96dd-0c5f5e29794b None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:21.713560 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee3153-9fd5-46a4-96dd-0c5f5e29794b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:21.738762 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-c3ee3153-9fd5-46a4-96dd-0c5f5e29794b None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:21:21.748845 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c3ee3153-9fd5-46a4-96dd-0c5f5e29794b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:21.768329 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:21.827363 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4302/8624] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:21:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:21:21.831355 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be50c119-cc67-4d03-a8b6-3e1de194c382 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:21.833165 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-be50c119-cc67-4d03-a8b6-3e1de194c382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:21.908866 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be50c119-cc67-4d03-a8b6-3e1de194c382 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:21.914036 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79b638-e102-4b1a-bda7-1d602b83302e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:21.914918 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79b638-e102-4b1a-bda7-1d602b83302e service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:21.915433 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79b638-e102-4b1a-bda7-1d602b83302e service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:21.916107 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79b638-e102-4b1a-bda7-1d602b83302e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:21.929308 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab79b638-e102-4b1a-bda7-1d602b83302e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:21.931629 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab79b638-e102-4b1a-bda7-1d602b83302e service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:21.951795 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4323/8625] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:21:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:21:22.421995 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee3153-9fd5-46a4-96dd-0c5f5e29794b None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:22.424027 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c3ee3153-9fd5-46a4-96dd-0c5f5e29794b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:22.444146 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee3153-9fd5-46a4-96dd-0c5f5e29794b None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:22.478747 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99386566-d13e-45ec-a98f-8382dd448536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:22.481424 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99386566-d13e-45ec-a98f-8382dd448536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:22.483309 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99386566-d13e-45ec-a98f-8382dd448536 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:22.484646 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99386566-d13e-45ec-a98f-8382dd448536 admin admin] PATH_INFO: `/v3/projects/b1e791ce1092424db8f0d5fcafec9344` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:22.486849 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99386566-d13e-45ec-a98f-8382dd448536 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1e791ce1092424db8f0d5fcafec9344)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:22.492563 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99386566-d13e-45ec-a98f-8382dd448536 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:22.605055 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-99386566-d13e-45ec-a98f-8382dd448536 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1e791ce1092424db8f0d5fcafec9344', 'request_id': 'req-99386566-d13e-45ec-a98f-8382dd448536'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:22.615057 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-99386566-d13e-45ec-a98f-8382dd448536 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1e791ce1092424db8f0d5fcafec9344', 'request_id': 'req-99386566-d13e-45ec-a98f-8382dd448536'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:22.629921 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-99386566-d13e-45ec-a98f-8382dd448536 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1e791ce1092424db8f0d5fcafec9344', 'request_id': 'req-99386566-d13e-45ec-a98f-8382dd448536'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:22.650473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-99386566-d13e-45ec-a98f-8382dd448536 admin admin] The token cache is being invalidate because project b1e791ce1092424db8f0d5fcafec9344 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:21:22.650952 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-99386566-d13e-45ec-a98f-8382dd448536 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:22.652062 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-99386566-d13e-45ec-a98f-8382dd448536 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:21:22.655109 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4303/8626] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:21:22 2022] DELETE /identity/v3/projects/b1e791ce1092424db8f0d5fcafec9344 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:21:22.661397 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f35f2-530d-4736-aca5-24576543b0b9 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:22.662400 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f35f2-530d-4736-aca5-24576543b0b9 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:22.662888 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f35f2-530d-4736-aca5-24576543b0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:22.708158 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-6f5f35f2-530d-4736-aca5-24576543b0b9 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:21:22.709915 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6f5f35f2-530d-4736-aca5-24576543b0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:22.829792 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:22.891923 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4324/8627] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:21:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:21:23.014465 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b87cb-b684-4adc-96c1-ef19c32ca5fc None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:23.016237 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b87cb-b684-4adc-96c1-ef19c32ca5fc None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:23.016237 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b87cb-b684-4adc-96c1-ef19c32ca5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:23.055943 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-697b87cb-b684-4adc-96c1-ef19c32ca5fc None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:21:23.058620 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-697b87cb-b684-4adc-96c1-ef19c32ca5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:23.090786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f35f2-530d-4736-aca5-24576543b0b9 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:23.096202 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4304/8628] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:21:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:21:23.111772 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f35f2-530d-4736-aca5-24576543b0b9 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:23.124568 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136aa57-eea3-4190-bb11-07b2f680da24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:23.126030 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136aa57-eea3-4190-bb11-07b2f680da24 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:23.126342 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136aa57-eea3-4190-bb11-07b2f680da24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:23.126659 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136aa57-eea3-4190-bb11-07b2f680da24 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:23.127456 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2136aa57-eea3-4190-bb11-07b2f680da24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:21:23.127765 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2136aa57-eea3-4190-bb11-07b2f680da24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:23.129446 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2136aa57-eea3-4190-bb11-07b2f680da24 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:23.149310 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4325/8629] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:21:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:21:23.154149 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b87cb-b684-4adc-96c1-ef19c32ca5fc None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:23.164787 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b87cb-b684-4adc-96c1-ef19c32ca5fc None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:23.170572 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c55d54-ba5f-4a84-add4-d1a9c182d923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:23.171506 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c55d54-ba5f-4a84-add4-d1a9c182d923 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:23.171948 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c55d54-ba5f-4a84-add4-d1a9c182d923 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:23.172381 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c55d54-ba5f-4a84-add4-d1a9c182d923 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:23.173464 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c55d54-ba5f-4a84-add4-d1a9c182d923 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:23.175796 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c55d54-ba5f-4a84-add4-d1a9c182d923 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:23.216218 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4305/8630] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:21:23 2022] POST /identity/v3/projects => generated 375 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:21:23.220883 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136aa57-eea3-4190-bb11-07b2f680da24 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:23.236966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136aa57-eea3-4190-bb11-07b2f680da24 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:23.316400 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a94bbe-4558-4c6a-9892-c47ea1bc780e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:23.317529 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a94bbe-4558-4c6a-9892-c47ea1bc780e admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:23.317971 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a94bbe-4558-4c6a-9892-c47ea1bc780e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:23.318498 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a94bbe-4558-4c6a-9892-c47ea1bc780e admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:23.319546 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a94bbe-4558-4c6a-9892-c47ea1bc780e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:23.321781 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a94bbe-4558-4c6a-9892-c47ea1bc780e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:23.352345 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4326/8631] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:21:23 2022] POST /identity/v3/users => generated 288 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:21:23.356477 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c55d54-ba5f-4a84-add4-d1a9c182d923 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:23.370121 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c55d54-ba5f-4a84-add4-d1a9c182d923 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:23.377858 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bdcd6b-d282-4c33-a509-36437a3bbf9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:23.378790 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdcd6b-d282-4c33-a509-36437a3bbf9a admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:23.379324 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdcd6b-d282-4c33-a509-36437a3bbf9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:23.379901 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdcd6b-d282-4c33-a509-36437a3bbf9a admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:23.380904 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bdcd6b-d282-4c33-a509-36437a3bbf9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:23.384466 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bdcd6b-d282-4c33-a509-36437a3bbf9a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:23.397264 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4306/8632] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:21:23.401947 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a94bbe-4558-4c6a-9892-c47ea1bc780e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:23.416137 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a94bbe-4558-4c6a-9892-c47ea1bc780e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:23.425345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c122e-aa39-40f9-aae4-8b2576df0d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:23.425975 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c122e-aa39-40f9-aae4-8b2576df0d2c admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:23.426307 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c122e-aa39-40f9-aae4-8b2576df0d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:23.426732 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c122e-aa39-40f9-aae4-8b2576df0d2c admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:23.428772 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c122e-aa39-40f9-aae4-8b2576df0d2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:23.430569 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c122e-aa39-40f9-aae4-8b2576df0d2c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:23.450767 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4327/8633] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:21:23.451974 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bdcd6b-d282-4c33-a509-36437a3bbf9a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:23.462544 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bdcd6b-d282-4c33-a509-36437a3bbf9a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:23.477297 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d75ac-9549-4448-97ce-f23b6f1ca06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:23.478013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d75ac-9549-4448-97ce-f23b6f1ca06b admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:23.478299 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d75ac-9549-4448-97ce-f23b6f1ca06b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:23.478585 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d75ac-9549-4448-97ce-f23b6f1ca06b admin admin] PATH_INFO: `/v3/projects/c3d414b7ad0443c18d025560cafaab30/users/fdb719a577de458895b29d1017c094f6/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:23.497609 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d75ac-9549-4448-97ce-f23b6f1ca06b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3d414b7ad0443c18d025560cafaab30, user_id=fdb719a577de458895b29d1017c094f6, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:23.501608 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d75ac-9549-4448-97ce-f23b6f1ca06b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:23.527455 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4307/8634] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:21:23 2022] PUT /identity/v3/projects/c3d414b7ad0443c18d025560cafaab30/users/fdb719a577de458895b29d1017c094f6/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:21:23.531918 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cd4f6-2707-4b79-8570-c50cd4bb089c None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:23.532221 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cd4f6-2707-4b79-8570-c50cd4bb089c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:23.532500 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cd4f6-2707-4b79-8570-c50cd4bb089c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:23.566708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-8f1cd4f6-2707-4b79-8570-c50cd4bb089c None None] MFA Rules not processed for user `fdb719a577de458895b29d1017c094f6`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:21:23.568001 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8f1cd4f6-2707-4b79-8570-c50cd4bb089c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:23.642304 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4328/8635] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:21:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:21:23.646867 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d75ac-9549-4448-97ce-f23b6f1ca06b admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:23.697825 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:23.727055 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d75ac-9549-4448-97ce-f23b6f1ca06b admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:23.733672 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac55d39-5ff1-4aea-a6c1-909f679fe84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:23.734313 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac55d39-5ff1-4aea-a6c1-909f679fe84f admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:23.734884 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac55d39-5ff1-4aea-a6c1-909f679fe84f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:23.735185 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac55d39-5ff1-4aea-a6c1-909f679fe84f admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:23.735831 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac55d39-5ff1-4aea-a6c1-909f679fe84f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:23.737768 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac55d39-5ff1-4aea-a6c1-909f679fe84f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:23.773420 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4308/8636] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:21:23 2022] POST /identity/v3/projects => generated 375 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:21:23.777953 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1cd4f6-2707-4b79-8570-c50cd4bb089c None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:23.791503 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1cd4f6-2707-4b79-8570-c50cd4bb089c None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:23.853500 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:23.874929 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4b8f9-25c5-4ef8-ac0a-c6da31b77bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:23.875615 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4b8f9-25c5-4ef8-ac0a-c6da31b77bbd admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:23.875890 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4b8f9-25c5-4ef8-ac0a-c6da31b77bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:23.876155 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4b8f9-25c5-4ef8-ac0a-c6da31b77bbd admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:23.876790 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c4b8f9-25c5-4ef8-ac0a-c6da31b77bbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:23.878818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c4b8f9-25c5-4ef8-ac0a-c6da31b77bbd admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:23.910489 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4329/8637] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:21:23 2022] POST /identity/v3/users => generated 294 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:21:23.910710 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac55d39-5ff1-4aea-a6c1-909f679fe84f admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:23.926371 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac55d39-5ff1-4aea-a6c1-909f679fe84f admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:23.932140 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dabc5f-783b-4d5d-b7f6-d4aba86a265a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:23.933737 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dabc5f-783b-4d5d-b7f6-d4aba86a265a admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:23.934083 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dabc5f-783b-4d5d-b7f6-d4aba86a265a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:23.934812 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dabc5f-783b-4d5d-b7f6-d4aba86a265a admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:23.935690 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dabc5f-783b-4d5d-b7f6-d4aba86a265a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:23.937409 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dabc5f-783b-4d5d-b7f6-d4aba86a265a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:23.952461 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4309/8638] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:21:23.956518 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4b8f9-25c5-4ef8-ac0a-c6da31b77bbd admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:23.968683 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4b8f9-25c5-4ef8-ac0a-c6da31b77bbd admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:23.974130 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6bac35-18b2-42cb-9634-5776aa0ee2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:23.974912 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6bac35-18b2-42cb-9634-5776aa0ee2f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:23.975208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6bac35-18b2-42cb-9634-5776aa0ee2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:23.975496 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6bac35-18b2-42cb-9634-5776aa0ee2f2 admin admin] PATH_INFO: `/v3/projects/e886a25cab9d40b5a876bb0d910ebf5d/users/2c05523ce41d4237908c42031049731a/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:23.994486 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6bac35-18b2-42cb-9634-5776aa0ee2f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e886a25cab9d40b5a876bb0d910ebf5d, user_id=2c05523ce41d4237908c42031049731a, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:23.998513 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6bac35-18b2-42cb-9634-5776aa0ee2f2 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:24.015420 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4330/8639] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:21:23 2022] PUT /identity/v3/projects/e886a25cab9d40b5a876bb0d910ebf5d/users/2c05523ce41d4237908c42031049731a/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:21:24.019284 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dabc5f-783b-4d5d-b7f6-d4aba86a265a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:24.035509 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dabc5f-783b-4d5d-b7f6-d4aba86a265a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:24.104052 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b8d5f-7d10-4d72-83ae-7d2e9b0774f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:24.104602 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b8d5f-7d10-4d72-83ae-7d2e9b0774f4 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:24.105087 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b8d5f-7d10-4d72-83ae-7d2e9b0774f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:24.105370 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b8d5f-7d10-4d72-83ae-7d2e9b0774f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:24.106095 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9b8d5f-7d10-4d72-83ae-7d2e9b0774f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:24.107754 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9b8d5f-7d10-4d72-83ae-7d2e9b0774f4 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:24.119059 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4310/8640] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:21:24.123641 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6bac35-18b2-42cb-9634-5776aa0ee2f2 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:24.135432 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6bac35-18b2-42cb-9634-5776aa0ee2f2 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:24.141798 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2ee5e-2de6-41aa-a1ae-88ec83a45ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:24.142697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2ee5e-2de6-41aa-a1ae-88ec83a45ba9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:24.142979 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2ee5e-2de6-41aa-a1ae-88ec83a45ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:24.143289 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2ee5e-2de6-41aa-a1ae-88ec83a45ba9 admin admin] PATH_INFO: `/v3/projects/e886a25cab9d40b5a876bb0d910ebf5d/users/2c05523ce41d4237908c42031049731a/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:24.144223 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87345fcb-bb78-4ab3-bdf8-253b106b2d36 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:24.144604 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87345fcb-bb78-4ab3-bdf8-253b106b2d36 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:24.144962 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87345fcb-bb78-4ab3-bdf8-253b106b2d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:24.145469 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2ee5e-2de6-41aa-a1ae-88ec83a45ba9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e886a25cab9d40b5a876bb0d910ebf5d, user_id=2c05523ce41d4237908c42031049731a, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:24.148189 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2ee5e-2de6-41aa-a1ae-88ec83a45ba9 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:24.160436 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4331/8641] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:21:24 2022] PUT /identity/v3/projects/e886a25cab9d40b5a876bb0d910ebf5d/users/2c05523ce41d4237908c42031049731a/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:21:24.171944 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe5eea-fd56-4f76-adde-4cec7682aa34 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:24.172207 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe5eea-fd56-4f76-adde-4cec7682aa34 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:24.172807 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe5eea-fd56-4f76-adde-4cec7682aa34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:24.175507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-87345fcb-bb78-4ab3-bdf8-253b106b2d36 None None] MFA Rules not processed for user `616303b5564840e3bb07d4c9c22c2049`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:21:24.177294 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-87345fcb-bb78-4ab3-bdf8-253b106b2d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:24.206170 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-b3fe5eea-fd56-4f76-adde-4cec7682aa34 None None] MFA Rules not processed for user `2c05523ce41d4237908c42031049731a`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:21:24.207576 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b3fe5eea-fd56-4f76-adde-4cec7682aa34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:24.240266 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4311/8642] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:21:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:21:24.290496 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4332/8643] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:21:24 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:21:24.303369 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87345fcb-bb78-4ab3-bdf8-253b106b2d36 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:24.305750 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-87345fcb-bb78-4ab3-bdf8-253b106b2d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:24.378604 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87345fcb-bb78-4ab3-bdf8-253b106b2d36 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:24.382671 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583eaaa9-d7c6-4c3b-8542-7ff0b7e8f824 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:24.383328 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583eaaa9-d7c6-4c3b-8542-7ff0b7e8f824 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:24.383647 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583eaaa9-d7c6-4c3b-8542-7ff0b7e8f824 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:24.383925 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583eaaa9-d7c6-4c3b-8542-7ff0b7e8f824 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:24.397068 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:24.462739 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583eaaa9-d7c6-4c3b-8542-7ff0b7e8f824 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:24.464444 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583eaaa9-d7c6-4c3b-8542-7ff0b7e8f824 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:24.476614 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4312/8644] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:21:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:21:24.552190 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe5eea-fd56-4f76-adde-4cec7682aa34 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:24.553675 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b3fe5eea-fd56-4f76-adde-4cec7682aa34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:24.571160 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe5eea-fd56-4f76-adde-4cec7682aa34 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:24.575652 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc76d00-01f1-4cbb-8325-c526e20ed6e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:24.576305 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc76d00-01f1-4cbb-8325-c526e20ed6e1 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:24.576590 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc76d00-01f1-4cbb-8325-c526e20ed6e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:24.576862 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc76d00-01f1-4cbb-8325-c526e20ed6e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:24.578956 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8cc76d00-01f1-4cbb-8325-c526e20ed6e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:24.596790 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc76d00-01f1-4cbb-8325-c526e20ed6e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:24.598673 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc76d00-01f1-4cbb-8325-c526e20ed6e1 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:24.612334 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4333/8645] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:21:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:21:25.676673 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583eaaa9-d7c6-4c3b-8542-7ff0b7e8f824 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:25.678195 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-583eaaa9-d7c6-4c3b-8542-7ff0b7e8f824 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:25.760439 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583eaaa9-d7c6-4c3b-8542-7ff0b7e8f824 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:25.766387 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8425d49d-9017-4095-afa9-49682be02da4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:25.767006 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425d49d-9017-4095-afa9-49682be02da4 service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:25.767316 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425d49d-9017-4095-afa9-49682be02da4 service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:25.767719 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425d49d-9017-4095-afa9-49682be02da4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:25.769521 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8425d49d-9017-4095-afa9-49682be02da4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:25.784232 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8425d49d-9017-4095-afa9-49682be02da4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:25.785990 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8425d49d-9017-4095-afa9-49682be02da4 service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:25.799663 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4313/8646] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:21:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:21:26.790469 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc76d00-01f1-4cbb-8325-c526e20ed6e1 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:26.805014 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc76d00-01f1-4cbb-8325-c526e20ed6e1 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:26.810102 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8eca4c-fb5e-49b9-9571-d89e54551834 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:26.810727 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8eca4c-fb5e-49b9-9571-d89e54551834 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:26.811011 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8eca4c-fb5e-49b9-9571-d89e54551834 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:26.811401 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8eca4c-fb5e-49b9-9571-d89e54551834 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:26.824083 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8eca4c-fb5e-49b9-9571-d89e54551834 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:26.826309 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8eca4c-fb5e-49b9-9571-d89e54551834 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:26.839313 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4334/8647] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:21:26 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:21:34.573809 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a991f-0344-410a-ba43-23d5ce7803e9 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:34.574323 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a991f-0344-410a-ba43-23d5ce7803e9 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:34.578527 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a991f-0344-410a-ba43-23d5ce7803e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:34.606735 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-940a991f-0344-410a-ba43-23d5ce7803e9 None None] MFA Rules not processed for user `fdb719a577de458895b29d1017c094f6`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:21:34.608440 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-940a991f-0344-410a-ba43-23d5ce7803e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:34.622707 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4314/8648] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:21:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:21:36.833243 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=71,keystone:INSERT=5 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:44.599568 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=57 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:48.279654 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8eca4c-fb5e-49b9-9571-d89e54551834 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:48.281238 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8d8eca4c-fb5e-49b9-9571-d89e54551834 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:48.372348 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8eca4c-fb5e-49b9-9571-d89e54551834 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:48.378015 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e063c2b-9a7d-453d-b44e-37d26f311a5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:48.378632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e063c2b-9a7d-453d-b44e-37d26f311a5a service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:48.378908 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e063c2b-9a7d-453d-b44e-37d26f311a5a service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:48.379206 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e063c2b-9a7d-453d-b44e-37d26f311a5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:48.380974 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2e063c2b-9a7d-453d-b44e-37d26f311a5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:48.397292 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e063c2b-9a7d-453d-b44e-37d26f311a5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:48.398913 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e063c2b-9a7d-453d-b44e-37d26f311a5a service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:48.414065 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4335/8649] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:21:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:21:49.259881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a991f-0344-410a-ba43-23d5ce7803e9 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:49.262482 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-940a991f-0344-410a-ba43-23d5ce7803e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:49.398946 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a991f-0344-410a-ba43-23d5ce7803e9 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:49.405409 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565b9d2-acdc-44ee-891a-12d80dfe4e8a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:49.406039 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565b9d2-acdc-44ee-891a-12d80dfe4e8a service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:49.406825 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565b9d2-acdc-44ee-891a-12d80dfe4e8a service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:49.406825 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565b9d2-acdc-44ee-891a-12d80dfe4e8a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:49.408471 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5565b9d2-acdc-44ee-891a-12d80dfe4e8a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:49.474272 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5565b9d2-acdc-44ee-891a-12d80dfe4e8a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:49.476050 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5565b9d2-acdc-44ee-891a-12d80dfe4e8a service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:49.492827 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4315/8650] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 16:21:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 657 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:21:58.406339 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=34 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:59.483501 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=63 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:22:19.910913 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6f255-8623-4364-8366-2ee34da33bff None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:22:19.911588 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6f255-8623-4364-8366-2ee34da33bff None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:22:19.911588 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6f255-8623-4364-8366-2ee34da33bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:22:19.932968 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-f5d6f255-8623-4364-8366-2ee34da33bff None None] MFA Rules not processed for user `616303b5564840e3bb07d4c9c22c2049`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:22:19.934300 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f5d6f255-8623-4364-8366-2ee34da33bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:22:19.941657 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4336/8651] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:22:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:22:25.359988 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c296c9a-2dcd-478b-8b2e-09178f1f0e0b None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:22:25.360480 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c296c9a-2dcd-478b-8b2e-09178f1f0e0b None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:22:25.360574 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c296c9a-2dcd-478b-8b2e-09178f1f0e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:22:25.385176 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-1c296c9a-2dcd-478b-8b2e-09178f1f0e0b None None] MFA Rules not processed for user `fdb719a577de458895b29d1017c094f6`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:22:25.392568 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1c296c9a-2dcd-478b-8b2e-09178f1f0e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:22:25.402033 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4316/8652] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:22:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:22:29.926527 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:22:35.376972 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:23:27.387512 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04dfda-3405-40db-9910-a974ef2ea21d None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:23:27.388104 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04dfda-3405-40db-9910-a974ef2ea21d None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:23:27.388104 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04dfda-3405-40db-9910-a974ef2ea21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:23:27.428373 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-9a04dfda-3405-40db-9910-a974ef2ea21d None None] MFA Rules not processed for user `fdb719a577de458895b29d1017c094f6`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:23:27.429599 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9a04dfda-3405-40db-9910-a974ef2ea21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:23:27.439963 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4337/8653] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:23:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:23:33.463088 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1974fe7-0804-421d-ab1a-7ec112de6a4e None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:23:33.464246 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1974fe7-0804-421d-ab1a-7ec112de6a4e None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:23:33.464371 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1974fe7-0804-421d-ab1a-7ec112de6a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:23:33.483756 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-d1974fe7-0804-421d-ab1a-7ec112de6a4e None None] MFA Rules not processed for user `616303b5564840e3bb07d4c9c22c2049`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:23:33.484977 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d1974fe7-0804-421d-ab1a-7ec112de6a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:23:33.492278 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4317/8654] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:23:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:23:37.411085 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:23:43.477822 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:23:55.896767 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd2584-1056-4802-9c1d-2c28e863804b None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:23:55.897285 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd2584-1056-4802-9c1d-2c28e863804b None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:23:55.897285 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd2584-1056-4802-9c1d-2c28e863804b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:23:55.966818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-97dd2584-1056-4802-9c1d-2c28e863804b None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:23:55.968004 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-97dd2584-1056-4802-9c1d-2c28e863804b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:23:56.060738 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4338/8655] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 16:23:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:23:56.116714 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1974fe7-0804-421d-ab1a-7ec112de6a4e None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:23:56.133950 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1974fe7-0804-421d-ab1a-7ec112de6a4e None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:23:56.140064 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82add0a-4416-4bf4-b3ad-1f0bfd7779df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:23:56.141002 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82add0a-4416-4bf4-b3ad-1f0bfd7779df service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:23:56.141353 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82add0a-4416-4bf4-b3ad-1f0bfd7779df service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:23:56.141711 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82add0a-4416-4bf4-b3ad-1f0bfd7779df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:23:56.151720 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82add0a-4416-4bf4-b3ad-1f0bfd7779df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:23:56.153309 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82add0a-4416-4bf4-b3ad-1f0bfd7779df service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:23:56.163550 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4318/8656] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 16:23:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:23:57.459585 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64d9f3-86ab-42a8-baac-aff5809254a5 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:23:57.460093 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64d9f3-86ab-42a8-baac-aff5809254a5 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:23:57.460093 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64d9f3-86ab-42a8-baac-aff5809254a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:23:57.480607 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-fa64d9f3-86ab-42a8-baac-aff5809254a5 None None] MFA Rules not processed for user `616303b5564840e3bb07d4c9c22c2049`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:23:57.481855 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-fa64d9f3-86ab-42a8-baac-aff5809254a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:23:57.488968 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4339/8657] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:23:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:24:06.159999 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=6 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:24:07.474668 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=47 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:24:20.419560 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82add0a-4416-4bf4-b3ad-1f0bfd7779df service swift] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:24:20.437912 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82add0a-4416-4bf4-b3ad-1f0bfd7779df service swift] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:24:20.445120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1ff2b-aa3b-4d39-bc65-636f2da3f39b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:24:20.446197 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1ff2b-aa3b-4d39-bc65-636f2da3f39b service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:20.446983 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1ff2b-aa3b-4d39-bc65-636f2da3f39b service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:20.447881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1ff2b-aa3b-4d39-bc65-636f2da3f39b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:20.450467 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-56d1ff2b-aa3b-4d39-bc65-636f2da3f39b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:24:20.475276 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1ff2b-aa3b-4d39-bc65-636f2da3f39b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:24:20.478113 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1ff2b-aa3b-4d39-bc65-636f2da3f39b service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:24:20.509063 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4319/8658] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:24:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:24:20.522287 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa64d9f3-86ab-42a8-baac-aff5809254a5 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:24:20.613496 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa64d9f3-86ab-42a8-baac-aff5809254a5 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:24:20.620899 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad610a93-f40d-4ecb-a508-b034d8b48366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:24:20.621651 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad610a93-f40d-4ecb-a508-b034d8b48366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:20.621926 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad610a93-f40d-4ecb-a508-b034d8b48366 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:20.622240 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad610a93-f40d-4ecb-a508-b034d8b48366 admin admin] PATH_INFO: `/v3/users/fdb719a577de458895b29d1017c094f6` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:20.623613 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad610a93-f40d-4ecb-a508-b034d8b48366 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdb719a577de458895b29d1017c094f6)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:24:20.625842 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad610a93-f40d-4ecb-a508-b034d8b48366 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:24:20.709204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ad610a93-f40d-4ecb-a508-b034d8b48366 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdb719a577de458895b29d1017c094f6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:24:20.710349 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ad610a93-f40d-4ecb-a508-b034d8b48366 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdb719a577de458895b29d1017c094f6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:24:20.721476 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ad610a93-f40d-4ecb-a508-b034d8b48366 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdb719a577de458895b29d1017c094f6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:24:20.734407 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ad610a93-f40d-4ecb-a508-b034d8b48366 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdb719a577de458895b29d1017c094f6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:24:20.735330 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-ad610a93-f40d-4ecb-a508-b034d8b48366 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdb719a577de458895b29d1017c094f6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:24:20.772743 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4340/8659] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:24:20 2022] DELETE /identity/v3/users/fdb719a577de458895b29d1017c094f6 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:24:20.777671 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20414a2e-6c42-4fcc-abda-14c0f091f80c None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:20.778679 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20414a2e-6c42-4fcc-abda-14c0f091f80c None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:20.778679 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20414a2e-6c42-4fcc-abda-14c0f091f80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:20.819379 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-20414a2e-6c42-4fcc-abda-14c0f091f80c None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:24:20.824069 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-20414a2e-6c42-4fcc-abda-14c0f091f80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:24:20.913447 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4320/8660] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:24:20.924627 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad610a93-f40d-4ecb-a508-b034d8b48366 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:24:20.926104 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ad610a93-f40d-4ecb-a508-b034d8b48366 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:24:20.993208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad610a93-f40d-4ecb-a508-b034d8b48366 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:24:20.997334 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642721f-cb8c-4948-868a-ac6f328e75ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:24:20.997932 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642721f-cb8c-4948-868a-ac6f328e75ac service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:20.998170 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642721f-cb8c-4948-868a-ac6f328e75ac service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:20.998494 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642721f-cb8c-4948-868a-ac6f328e75ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:21.008009 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3642721f-cb8c-4948-868a-ac6f328e75ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:24:21.009452 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3642721f-cb8c-4948-868a-ac6f328e75ac service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:24:21.020019 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4341/8661] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:24:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:24:21.210179 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20414a2e-6c42-4fcc-abda-14c0f091f80c None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:24:21.211836 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-20414a2e-6c42-4fcc-abda-14c0f091f80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:24:21.225102 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20414a2e-6c42-4fcc-abda-14c0f091f80c None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:24:21.231100 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e5df9-9136-41b3-ba5a-379bc375794f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:24:21.231814 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e5df9-9136-41b3-ba5a-379bc375794f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:21.232091 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e5df9-9136-41b3-ba5a-379bc375794f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:21.232365 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e5df9-9136-41b3-ba5a-379bc375794f admin admin] PATH_INFO: `/v3/projects/c3d414b7ad0443c18d025560cafaab30` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:21.233648 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599e5df9-9136-41b3-ba5a-379bc375794f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3d414b7ad0443c18d025560cafaab30)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:24:21.235659 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599e5df9-9136-41b3-ba5a-379bc375794f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:24:21.285411 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-599e5df9-9136-41b3-ba5a-379bc375794f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3d414b7ad0443c18d025560cafaab30', 'request_id': 'req-599e5df9-9136-41b3-ba5a-379bc375794f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:24:21.291244 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-599e5df9-9136-41b3-ba5a-379bc375794f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3d414b7ad0443c18d025560cafaab30', 'request_id': 'req-599e5df9-9136-41b3-ba5a-379bc375794f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:24:21.299428 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-599e5df9-9136-41b3-ba5a-379bc375794f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3d414b7ad0443c18d025560cafaab30', 'request_id': 'req-599e5df9-9136-41b3-ba5a-379bc375794f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:24:21.310963 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-599e5df9-9136-41b3-ba5a-379bc375794f admin admin] The token cache is being invalidate because project c3d414b7ad0443c18d025560cafaab30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:24:21.311290 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-599e5df9-9136-41b3-ba5a-379bc375794f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:24:21.311929 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-599e5df9-9136-41b3-ba5a-379bc375794f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:24:21.313688 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4321/8662] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:24:21 2022] DELETE /identity/v3/projects/c3d414b7ad0443c18d025560cafaab30 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:24:21.317706 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642721f-cb8c-4948-868a-ac6f328e75ac service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:24:21.327909 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642721f-cb8c-4948-868a-ac6f328e75ac service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:24:21.346919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:24:21.390774 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56ca45-2e70-475d-8baf-6cd910e9f065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:24:21.391453 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56ca45-2e70-475d-8baf-6cd910e9f065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:21.391746 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56ca45-2e70-475d-8baf-6cd910e9f065 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:21.392017 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56ca45-2e70-475d-8baf-6cd910e9f065 admin admin] PATH_INFO: `/v3/users/2c05523ce41d4237908c42031049731a` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:21.393151 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a56ca45-2e70-475d-8baf-6cd910e9f065 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c05523ce41d4237908c42031049731a)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:24:21.395147 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a56ca45-2e70-475d-8baf-6cd910e9f065 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:24:21.447074 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1a56ca45-2e70-475d-8baf-6cd910e9f065 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c05523ce41d4237908c42031049731a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:24:21.448592 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1a56ca45-2e70-475d-8baf-6cd910e9f065 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c05523ce41d4237908c42031049731a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:24:21.457243 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1a56ca45-2e70-475d-8baf-6cd910e9f065 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c05523ce41d4237908c42031049731a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:24:21.466644 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1a56ca45-2e70-475d-8baf-6cd910e9f065 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c05523ce41d4237908c42031049731a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:24:21.467384 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1a56ca45-2e70-475d-8baf-6cd910e9f065 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c05523ce41d4237908c42031049731a'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:24:21.486904 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4342/8663] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:24:21 2022] DELETE /identity/v3/users/2c05523ce41d4237908c42031049731a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:24:21.780335 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e5df9-9136-41b3-ba5a-379bc375794f admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:24:21.782065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-599e5df9-9136-41b3-ba5a-379bc375794f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:24:21.797192 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e5df9-9136-41b3-ba5a-379bc375794f admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:24:21.858721 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd52f60d-98ec-4666-a14e-f90c77de3259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:24:21.859383 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52f60d-98ec-4666-a14e-f90c77de3259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:21.859662 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52f60d-98ec-4666-a14e-f90c77de3259 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:21.859930 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52f60d-98ec-4666-a14e-f90c77de3259 admin admin] PATH_INFO: `/v3/projects/e886a25cab9d40b5a876bb0d910ebf5d` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:21.861059 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd52f60d-98ec-4666-a14e-f90c77de3259 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e886a25cab9d40b5a876bb0d910ebf5d)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:24:21.862961 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd52f60d-98ec-4666-a14e-f90c77de3259 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:24:21.874533 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:24:21.910435 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-cd52f60d-98ec-4666-a14e-f90c77de3259 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e886a25cab9d40b5a876bb0d910ebf5d', 'request_id': 'req-cd52f60d-98ec-4666-a14e-f90c77de3259'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:24:21.917141 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-cd52f60d-98ec-4666-a14e-f90c77de3259 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e886a25cab9d40b5a876bb0d910ebf5d', 'request_id': 'req-cd52f60d-98ec-4666-a14e-f90c77de3259'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:24:21.925159 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-cd52f60d-98ec-4666-a14e-f90c77de3259 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e886a25cab9d40b5a876bb0d910ebf5d', 'request_id': 'req-cd52f60d-98ec-4666-a14e-f90c77de3259'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:24:21.939279 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-cd52f60d-98ec-4666-a14e-f90c77de3259 admin admin] The token cache is being invalidate because project e886a25cab9d40b5a876bb0d910ebf5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:24:21.939578 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-cd52f60d-98ec-4666-a14e-f90c77de3259 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:24:21.940269 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-cd52f60d-98ec-4666-a14e-f90c77de3259 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:24:21.941812 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4322/8664] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:24:21 2022] DELETE /identity/v3/projects/e886a25cab9d40b5a876bb0d910ebf5d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:24:26.385268 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56ca45-2e70-475d-8baf-6cd910e9f065 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:24:26.387655 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1a56ca45-2e70-475d-8baf-6cd910e9f065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:24:26.507686 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56ca45-2e70-475d-8baf-6cd910e9f065 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:24:26.567676 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31812d3-80d2-423c-aeb6-e9916afab8d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:24:26.568453 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31812d3-80d2-423c-aeb6-e9916afab8d3 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:26.568866 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31812d3-80d2-423c-aeb6-e9916afab8d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:26.569180 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31812d3-80d2-423c-aeb6-e9916afab8d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:26.571294 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b31812d3-80d2-423c-aeb6-e9916afab8d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:24:26.587850 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31812d3-80d2-423c-aeb6-e9916afab8d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:24:26.591608 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31812d3-80d2-423c-aeb6-e9916afab8d3 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:24:26.599813 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:24:26.623093 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4343/8665] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:24:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:24:31.935485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=19,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:24:54.383366 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44818c3b-cb95-4595-923c-e7beb8fa50ae None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:54.383913 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44818c3b-cb95-4595-923c-e7beb8fa50ae None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:54.383913 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44818c3b-cb95-4595-923c-e7beb8fa50ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:54.405680 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-44818c3b-cb95-4595-923c-e7beb8fa50ae None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:24:54.406925 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-44818c3b-cb95-4595-923c-e7beb8fa50ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:24:54.470548 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4323/8666] 10.222.0.83 () {58 vars in 967 bytes} [Mon Aug 29 16:24:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:24:54.484133 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31812d3-80d2-423c-aeb6-e9916afab8d3 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:24:54.486311 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b31812d3-80d2-423c-aeb6-e9916afab8d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:24:54.568359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31812d3-80d2-423c-aeb6-e9916afab8d3 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:24:54.574382 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb6790-e1c6-4989-8d68-27c74389d84d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:24:54.575002 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb6790-e1c6-4989-8d68-27c74389d84d service swift] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:54.575329 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb6790-e1c6-4989-8d68-27c74389d84d service swift] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:54.575609 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb6790-e1c6-4989-8d68-27c74389d84d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:54.585721 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb6790-e1c6-4989-8d68-27c74389d84d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:24:54.587352 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb6790-e1c6-4989-8d68-27c74389d84d service swift] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:24:54.598022 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4344/8667] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 16:24:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:25:04.461673 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=25 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:25:04.594079 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=32 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:25:12.682488 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b24787-4d60-46b7-a236-ac41ce118dd5 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:25:12.683567 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b24787-4d60-46b7-a236-ac41ce118dd5 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:25:12.683567 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b24787-4d60-46b7-a236-ac41ce118dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:25:12.704105 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-f5b24787-4d60-46b7-a236-ac41ce118dd5 None None] MFA Rules not processed for user `616303b5564840e3bb07d4c9c22c2049`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:25:12.705451 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f5b24787-4d60-46b7-a236-ac41ce118dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:25:12.766332 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4324/8668] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:25:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:25:12.816601 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb6790-e1c6-4989-8d68-27c74389d84d service swift] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:25:12.818024 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b6bb6790-e1c6-4989-8d68-27c74389d84d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:25:12.881934 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb6790-e1c6-4989-8d68-27c74389d84d service swift] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:25:12.886112 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428ce1f-8201-4815-826f-146f66c9d6b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:25:12.886787 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428ce1f-8201-4815-826f-146f66c9d6b2 service cinder] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:25:12.887166 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428ce1f-8201-4815-826f-146f66c9d6b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:25:12.887499 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428ce1f-8201-4815-826f-146f66c9d6b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:25:12.889297 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0428ce1f-8201-4815-826f-146f66c9d6b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:25:12.975258 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0428ce1f-8201-4815-826f-146f66c9d6b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:25:12.976731 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0428ce1f-8201-4815-826f-146f66c9d6b2 service cinder] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:25:12.993091 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4345/8669] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:25:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:25:13.796133 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b24787-4d60-46b7-a236-ac41ce118dd5 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:25:13.798127 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f5b24787-4d60-46b7-a236-ac41ce118dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:25:13.815208 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b24787-4d60-46b7-a236-ac41ce118dd5 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:25:13.820013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab5e470-87ed-4266-9a87-7d9790262666 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:25:13.820945 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5e470-87ed-4266-9a87-7d9790262666 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:25:13.821605 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5e470-87ed-4266-9a87-7d9790262666 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:25:13.822072 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5e470-87ed-4266-9a87-7d9790262666 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:25:13.825667 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-eab5e470-87ed-4266-9a87-7d9790262666 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:25:13.846258 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab5e470-87ed-4266-9a87-7d9790262666 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:25:13.847761 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab5e470-87ed-4266-9a87-7d9790262666 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:25:13.862922 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4325/8670] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:25:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:25:16.758185 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428ce1f-8201-4815-826f-146f66c9d6b2 service cinder] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:25:16.760306 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0428ce1f-8201-4815-826f-146f66c9d6b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:25:16.794488 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428ce1f-8201-4815-826f-146f66c9d6b2 service cinder] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:25:16.807463 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce5732a-34ae-4e2b-8757-f975a0fed416 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:25:16.808389 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5732a-34ae-4e2b-8757-f975a0fed416 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:25:16.808874 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5732a-34ae-4e2b-8757-f975a0fed416 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:25:16.809152 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5732a-34ae-4e2b-8757-f975a0fed416 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:25:16.812963 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8ce5732a-34ae-4e2b-8757-f975a0fed416 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:25:16.846104 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce5732a-34ae-4e2b-8757-f975a0fed416 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:25:16.847876 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce5732a-34ae-4e2b-8757-f975a0fed416 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:25:16.875376 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4346/8671] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:25:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:25:23.854874 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=31 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:25:26.862668 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=60 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:26:05.730377 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab5e470-87ed-4266-9a87-7d9790262666 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:26:05.756440 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab5e470-87ed-4266-9a87-7d9790262666 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:26:05.760181 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed77b58-5798-4c6a-99fe-ade4f198b445 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:26:05.760865 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed77b58-5798-4c6a-99fe-ade4f198b445 service cinder] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:26:05.761148 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed77b58-5798-4c6a-99fe-ade4f198b445 service cinder] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:26:05.761419 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed77b58-5798-4c6a-99fe-ade4f198b445 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:26:05.763209 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9ed77b58-5798-4c6a-99fe-ade4f198b445 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:26:05.853561 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed77b58-5798-4c6a-99fe-ade4f198b445 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:26:05.855718 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed77b58-5798-4c6a-99fe-ade4f198b445 service cinder] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:26:05.864927 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4326/8672] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:26:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:26:15.860673 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=43 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:26:17.250672 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce5732a-34ae-4e2b-8757-f975a0fed416 service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:26:17.253472 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8ce5732a-34ae-4e2b-8757-f975a0fed416 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:26:17.396156 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce5732a-34ae-4e2b-8757-f975a0fed416 service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:26:17.402437 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af13d7a7-2c7b-47f3-a3cd-ddf30803f1c1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:26:17.403117 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13d7a7-2c7b-47f3-a3cd-ddf30803f1c1 service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:26:17.403402 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13d7a7-2c7b-47f3-a3cd-ddf30803f1c1 service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:26:17.403693 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13d7a7-2c7b-47f3-a3cd-ddf30803f1c1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:26:17.405514 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-af13d7a7-2c7b-47f3-a3cd-ddf30803f1c1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:26:17.420569 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af13d7a7-2c7b-47f3-a3cd-ddf30803f1c1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:26:17.422084 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af13d7a7-2c7b-47f3-a3cd-ddf30803f1c1 service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:26:17.435410 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4347/8673] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:26:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:26:17.737119 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed77b58-5798-4c6a-99fe-ade4f198b445 service cinder] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:26:17.738536 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9ed77b58-5798-4c6a-99fe-ade4f198b445 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:26:17.809071 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed77b58-5798-4c6a-99fe-ade4f198b445 service cinder] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:26:17.814097 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b048b7-7318-437a-bde7-a5dddb43ec23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:26:17.814768 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b048b7-7318-437a-bde7-a5dddb43ec23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:26:17.815067 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b048b7-7318-437a-bde7-a5dddb43ec23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:26:17.815344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b048b7-7318-437a-bde7-a5dddb43ec23 admin admin] PATH_INFO: `/v3/users/ee4a3df1fa254fcab2514d25c1d2bc77` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:26:17.816768 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b048b7-7318-437a-bde7-a5dddb43ec23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee4a3df1fa254fcab2514d25c1d2bc77)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:26:17.818733 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b048b7-7318-437a-bde7-a5dddb43ec23 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:26:17.877239 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a8b048b7-7318-437a-bde7-a5dddb43ec23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee4a3df1fa254fcab2514d25c1d2bc77'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:26:17.878007 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a8b048b7-7318-437a-bde7-a5dddb43ec23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee4a3df1fa254fcab2514d25c1d2bc77'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:26:17.892011 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a8b048b7-7318-437a-bde7-a5dddb43ec23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee4a3df1fa254fcab2514d25c1d2bc77'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:26:17.903486 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a8b048b7-7318-437a-bde7-a5dddb43ec23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee4a3df1fa254fcab2514d25c1d2bc77'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:26:17.911045 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a8b048b7-7318-437a-bde7-a5dddb43ec23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee4a3df1fa254fcab2514d25c1d2bc77'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:26:17.917986 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4327/8674] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:26:17 2022] DELETE /identity/v3/users/ee4a3df1fa254fcab2514d25c1d2bc77 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:26:17.922666 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8cd508-5d93-4777-a97d-fa9571003316 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:26:17.922953 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8cd508-5d93-4777-a97d-fa9571003316 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:26:17.923274 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8cd508-5d93-4777-a97d-fa9571003316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:26:17.943195 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-ae8cd508-5d93-4777-a97d-fa9571003316 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:26:17.944400 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ae8cd508-5d93-4777-a97d-fa9571003316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:26:18.006455 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4348/8675] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:26:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:26:18.016284 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76e9ff-c1bb-4343-afaf-7fe3bf1db707 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:26:18.016569 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76e9ff-c1bb-4343-afaf-7fe3bf1db707 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:26:18.016842 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76e9ff-c1bb-4343-afaf-7fe3bf1db707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:26:18.057393 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-aa76e9ff-c1bb-4343-afaf-7fe3bf1db707 None None] MFA Rules not processed for user `9a84bb38f6454574897120223b8fc140`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:26:18.058688 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-aa76e9ff-c1bb-4343-afaf-7fe3bf1db707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:26:18.114100 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4328/8676] 10.222.0.83 () {58 vars in 1062 bytes} [Mon Aug 29 16:26:18 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:26:18.119830 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8cd508-5d93-4777-a97d-fa9571003316 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:26:18.129899 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8cd508-5d93-4777-a97d-fa9571003316 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:26:18.133595 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e976a-a073-46e2-9430-a0f9c5aaa10b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:26:18.134202 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e976a-a073-46e2-9430-a0f9c5aaa10b service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:26:18.134482 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e976a-a073-46e2-9430-a0f9c5aaa10b service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:26:18.134757 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e976a-a073-46e2-9430-a0f9c5aaa10b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:26:18.144930 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e976a-a073-46e2-9430-a0f9c5aaa10b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:26:18.146381 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e976a-a073-46e2-9430-a0f9c5aaa10b service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:26:18.157260 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4349/8677] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:26:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:26:18.334252 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76e9ff-c1bb-4343-afaf-7fe3bf1db707 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:26:18.336553 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-aa76e9ff-c1bb-4343-afaf-7fe3bf1db707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:26:18.354718 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76e9ff-c1bb-4343-afaf-7fe3bf1db707 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:26:18.367399 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce61d60d-4b4c-41be-b7db-967f3490131b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:26:18.368062 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61d60d-4b4c-41be-b7db-967f3490131b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:26:18.368340 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61d60d-4b4c-41be-b7db-967f3490131b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:26:18.368610 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61d60d-4b4c-41be-b7db-967f3490131b admin admin] PATH_INFO: `/v3/projects/ca4ac1309d784d33b4122f0976435304` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:26:18.369820 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce61d60d-4b4c-41be-b7db-967f3490131b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca4ac1309d784d33b4122f0976435304)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:26:18.372782 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce61d60d-4b4c-41be-b7db-967f3490131b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:26:18.384570 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:26:18.428693 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ce61d60d-4b4c-41be-b7db-967f3490131b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca4ac1309d784d33b4122f0976435304', 'request_id': 'req-ce61d60d-4b4c-41be-b7db-967f3490131b'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:26:18.438024 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ce61d60d-4b4c-41be-b7db-967f3490131b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca4ac1309d784d33b4122f0976435304', 'request_id': 'req-ce61d60d-4b4c-41be-b7db-967f3490131b'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:26:18.447206 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ce61d60d-4b4c-41be-b7db-967f3490131b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca4ac1309d784d33b4122f0976435304', 'request_id': 'req-ce61d60d-4b4c-41be-b7db-967f3490131b'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:26:18.460000 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ce61d60d-4b4c-41be-b7db-967f3490131b admin admin] The token cache is being invalidate because project ca4ac1309d784d33b4122f0976435304 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:26:18.460197 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ce61d60d-4b4c-41be-b7db-967f3490131b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:26:18.460888 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ce61d60d-4b4c-41be-b7db-967f3490131b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:26:18.462457 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4329/8678] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:26:18 2022] DELETE /identity/v3/projects/ca4ac1309d784d33b4122f0976435304 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:26:18.468499 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31832387-a078-4fcd-9f35-9d996e93399a None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:26:18.468966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31832387-a078-4fcd-9f35-9d996e93399a None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:26:18.469196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31832387-a078-4fcd-9f35-9d996e93399a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:26:18.491406 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-31832387-a078-4fcd-9f35-9d996e93399a None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:26:18.492798 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-31832387-a078-4fcd-9f35-9d996e93399a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:26:18.507175 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:26:18.556862 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4350/8679] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:26:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:26:18.565133 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf2758-5794-4274-aa57-5b55ddd69b5f None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:26:18.565423 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf2758-5794-4274-aa57-5b55ddd69b5f None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:26:18.565953 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf2758-5794-4274-aa57-5b55ddd69b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:26:18.586823 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-79cf2758-5794-4274-aa57-5b55ddd69b5f None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:26:18.588090 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-79cf2758-5794-4274-aa57-5b55ddd69b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:26:18.596923 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4330/8680] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:26:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:26:18.600974 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31832387-a078-4fcd-9f35-9d996e93399a None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:26:18.610926 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31832387-a078-4fcd-9f35-9d996e93399a None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:26:18.615609 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b1dcc9-08af-443f-8763-7f748cbaea41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:26:18.616212 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b1dcc9-08af-443f-8763-7f748cbaea41 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:26:18.616491 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b1dcc9-08af-443f-8763-7f748cbaea41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:26:18.616761 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b1dcc9-08af-443f-8763-7f748cbaea41 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:26:18.617415 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b1dcc9-08af-443f-8763-7f748cbaea41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:26:18.617718 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b1dcc9-08af-443f-8763-7f748cbaea41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:26:18.619399 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b1dcc9-08af-443f-8763-7f748cbaea41 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:26:18.632691 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4351/8681] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:26:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:26:18.637617 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cf2758-5794-4274-aa57-5b55ddd69b5f None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:26:18.647001 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cf2758-5794-4274-aa57-5b55ddd69b5f None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:26:18.651741 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa501b-ee00-4e84-99a5-e51f86a01e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:26:18.652339 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa501b-ee00-4e84-99a5-e51f86a01e3f admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:26:18.652641 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa501b-ee00-4e84-99a5-e51f86a01e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:26:18.652912 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa501b-ee00-4e84-99a5-e51f86a01e3f admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:26:18.653541 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa501b-ee00-4e84-99a5-e51f86a01e3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:26:18.655479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa501b-ee00-4e84-99a5-e51f86a01e3f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:26:18.682257 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4331/8682] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:26:18 2022] POST /identity/v3/projects => generated 363 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:26:18.686862 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b1dcc9-08af-443f-8763-7f748cbaea41 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:26:18.697571 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b1dcc9-08af-443f-8763-7f748cbaea41 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:26:18.759403 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b791172-9d6c-45a0-bfa5-ff831fda1d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:26:18.759928 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b791172-9d6c-45a0-bfa5-ff831fda1d29 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:26:18.760204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b791172-9d6c-45a0-bfa5-ff831fda1d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:26:18.761131 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b791172-9d6c-45a0-bfa5-ff831fda1d29 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:26:18.761768 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b791172-9d6c-45a0-bfa5-ff831fda1d29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:26:18.763729 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b791172-9d6c-45a0-bfa5-ff831fda1d29 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:26:18.784922 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4352/8683] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:26:18 2022] POST /identity/v3/users => generated 282 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:26:18.789041 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa501b-ee00-4e84-99a5-e51f86a01e3f admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:26:18.799695 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa501b-ee00-4e84-99a5-e51f86a01e3f admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:26:18.804370 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c412f4-aa6b-4aa6-852c-d3fffe1f3d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:26:18.804974 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c412f4-aa6b-4aa6-852c-d3fffe1f3d8c admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:26:18.805254 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c412f4-aa6b-4aa6-852c-d3fffe1f3d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:26:18.805525 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c412f4-aa6b-4aa6-852c-d3fffe1f3d8c admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:26:18.806166 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c412f4-aa6b-4aa6-852c-d3fffe1f3d8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:26:18.808322 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c412f4-aa6b-4aa6-852c-d3fffe1f3d8c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:26:18.819389 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4332/8684] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:26:18.824052 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b791172-9d6c-45a0-bfa5-ff831fda1d29 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:26:18.834641 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b791172-9d6c-45a0-bfa5-ff831fda1d29 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:26:18.839598 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5b080-937e-405c-b2be-6925d6370d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:26:18.840245 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5b080-937e-405c-b2be-6925d6370d37 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:26:18.840516 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5b080-937e-405c-b2be-6925d6370d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:26:18.840789 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5b080-937e-405c-b2be-6925d6370d37 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:26:18.841436 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e5b080-937e-405c-b2be-6925d6370d37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:26:18.843065 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e5b080-937e-405c-b2be-6925d6370d37 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:26:18.853202 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4353/8685] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:26:18.858181 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c412f4-aa6b-4aa6-852c-d3fffe1f3d8c admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:26:18.868246 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c412f4-aa6b-4aa6-852c-d3fffe1f3d8c admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:26:18.873562 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5086b1c-0be1-4034-bfd1-4e0e4bc287dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:26:18.874254 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5086b1c-0be1-4034-bfd1-4e0e4bc287dc admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:26:18.874588 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5086b1c-0be1-4034-bfd1-4e0e4bc287dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:26:18.874901 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5086b1c-0be1-4034-bfd1-4e0e4bc287dc admin admin] PATH_INFO: `/v3/projects/feb393ae71b0437587ca25cd7665cb4f/users/c197b840b47744f8bfd5922658b78810/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:26:18.889487 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5086b1c-0be1-4034-bfd1-4e0e4bc287dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=feb393ae71b0437587ca25cd7665cb4f, user_id=c197b840b47744f8bfd5922658b78810, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:26:18.892334 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5086b1c-0be1-4034-bfd1-4e0e4bc287dc admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:26:18.905421 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4333/8686] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:26:18 2022] PUT /identity/v3/projects/feb393ae71b0437587ca25cd7665cb4f/users/c197b840b47744f8bfd5922658b78810/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:26:18.918040 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0f1e3-15ab-421c-9a93-f028b260791f None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:26:18.918326 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0f1e3-15ab-421c-9a93-f028b260791f None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:26:18.918602 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0f1e3-15ab-421c-9a93-f028b260791f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:26:18.947530 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-baf0f1e3-15ab-421c-9a93-f028b260791f None None] MFA Rules not processed for user `c197b840b47744f8bfd5922658b78810`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:26:18.948929 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-baf0f1e3-15ab-421c-9a93-f028b260791f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:26:19.014377 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4354/8687] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:26:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:26:19.025627 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5086b1c-0be1-4034-bfd1-4e0e4bc287dc admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:26:19.027543 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a5086b1c-0be1-4034-bfd1-4e0e4bc287dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:26:19.089365 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5086b1c-0be1-4034-bfd1-4e0e4bc287dc admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:26:19.092702 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddfe0ea-bb03-405f-88f3-a0fe95e1b61b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:26:19.093312 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddfe0ea-bb03-405f-88f3-a0fe95e1b61b service cinder] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:26:19.093587 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddfe0ea-bb03-405f-88f3-a0fe95e1b61b service cinder] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:26:19.093861 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddfe0ea-bb03-405f-88f3-a0fe95e1b61b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:26:19.102294 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddfe0ea-bb03-405f-88f3-a0fe95e1b61b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:26:19.103744 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddfe0ea-bb03-405f-88f3-a0fe95e1b61b service cinder] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:26:19.113224 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4334/8688] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:26:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:26:29.011332 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=91,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:26:29.109143 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=73,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:26:35.227562 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0f1e3-15ab-421c-9a93-f028b260791f None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:26:35.229005 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-baf0f1e3-15ab-421c-9a93-f028b260791f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:26:35.312851 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0f1e3-15ab-421c-9a93-f028b260791f None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:26:35.318746 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec24b35-7715-41b6-8203-f96867b48ae8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:26:35.319400 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec24b35-7715-41b6-8203-f96867b48ae8 service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:26:35.319679 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec24b35-7715-41b6-8203-f96867b48ae8 service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:26:35.320051 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec24b35-7715-41b6-8203-f96867b48ae8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:26:35.322167 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1ec24b35-7715-41b6-8203-f96867b48ae8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:26:35.337774 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec24b35-7715-41b6-8203-f96867b48ae8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:26:35.339988 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec24b35-7715-41b6-8203-f96867b48ae8 service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:26:35.353524 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4355/8689] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:26:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:26:45.346126 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=32 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:27:08.158068 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddfe0ea-bb03-405f-88f3-a0fe95e1b61b service cinder] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:08.244060 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddfe0ea-bb03-405f-88f3-a0fe95e1b61b service cinder] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:08.248879 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be16403-8edc-4ead-9ff7-e288c4aa7aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:08.249578 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be16403-8edc-4ead-9ff7-e288c4aa7aa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:08.249858 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be16403-8edc-4ead-9ff7-e288c4aa7aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:08.250132 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be16403-8edc-4ead-9ff7-e288c4aa7aa7 admin admin] PATH_INFO: `/v3/users/c197b840b47744f8bfd5922658b78810` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:08.251290 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be16403-8edc-4ead-9ff7-e288c4aa7aa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c197b840b47744f8bfd5922658b78810)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:08.253229 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be16403-8edc-4ead-9ff7-e288c4aa7aa7 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:08.303301 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1be16403-8edc-4ead-9ff7-e288c4aa7aa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c197b840b47744f8bfd5922658b78810'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:27:08.303960 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1be16403-8edc-4ead-9ff7-e288c4aa7aa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c197b840b47744f8bfd5922658b78810'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:27:08.317888 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1be16403-8edc-4ead-9ff7-e288c4aa7aa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c197b840b47744f8bfd5922658b78810'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:27:08.327397 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1be16403-8edc-4ead-9ff7-e288c4aa7aa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c197b840b47744f8bfd5922658b78810'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:27:08.335165 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-1be16403-8edc-4ead-9ff7-e288c4aa7aa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c197b840b47744f8bfd5922658b78810'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:27:08.345500 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4335/8690] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:27:08 2022] DELETE /identity/v3/users/c197b840b47744f8bfd5922658b78810 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:27:08.346916 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354cecc1-fdb7-4239-9b10-3c67784d0cbc None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:08.347392 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354cecc1-fdb7-4239-9b10-3c67784d0cbc None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:08.347902 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354cecc1-fdb7-4239-9b10-3c67784d0cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:08.388618 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-354cecc1-fdb7-4239-9b10-3c67784d0cbc None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:27:08.389817 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-354cecc1-fdb7-4239-9b10-3c67784d0cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:27:08.452060 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4356/8691] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:27:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:27:08.461325 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea48e8e-19a6-4455-a1c8-931c2e8c73cf None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:08.461620 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea48e8e-19a6-4455-a1c8-931c2e8c73cf None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:08.461898 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea48e8e-19a6-4455-a1c8-931c2e8c73cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:08.507627 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-aea48e8e-19a6-4455-a1c8-931c2e8c73cf None None] MFA Rules not processed for user `9a84bb38f6454574897120223b8fc140`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:27:08.508796 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-aea48e8e-19a6-4455-a1c8-931c2e8c73cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:27:08.551841 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:27:08.579102 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4336/8692] 10.222.0.83 () {58 vars in 1062 bytes} [Mon Aug 29 16:27:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:27:08.584976 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354cecc1-fdb7-4239-9b10-3c67784d0cbc None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:08.596101 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354cecc1-fdb7-4239-9b10-3c67784d0cbc None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:08.599961 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf3f926-13db-4d45-8be2-fa86bdbe9ceb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:08.600726 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3f926-13db-4d45-8be2-fa86bdbe9ceb service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:08.601005 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3f926-13db-4d45-8be2-fa86bdbe9ceb service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:08.601277 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3f926-13db-4d45-8be2-fa86bdbe9ceb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:08.611575 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf3f926-13db-4d45-8be2-fa86bdbe9ceb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:08.613025 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf3f926-13db-4d45-8be2-fa86bdbe9ceb service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:08.623010 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4357/8693] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:27:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:27:08.920187 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea48e8e-19a6-4455-a1c8-931c2e8c73cf None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:08.921828 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-aea48e8e-19a6-4455-a1c8-931c2e8c73cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:27:08.941414 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea48e8e-19a6-4455-a1c8-931c2e8c73cf None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:08.947409 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f9cd1-1121-4a5e-9a97-f39c0142af10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:08.948280 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f9cd1-1121-4a5e-9a97-f39c0142af10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:08.948655 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f9cd1-1121-4a5e-9a97-f39c0142af10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:08.948986 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f9cd1-1121-4a5e-9a97-f39c0142af10 admin admin] PATH_INFO: `/v3/projects/feb393ae71b0437587ca25cd7665cb4f` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:08.950879 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f9cd1-1121-4a5e-9a97-f39c0142af10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=feb393ae71b0437587ca25cd7665cb4f)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:08.953087 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f9cd1-1121-4a5e-9a97-f39c0142af10 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:09.009326 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-308f9cd1-1121-4a5e-9a97-f39c0142af10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'feb393ae71b0437587ca25cd7665cb4f', 'request_id': 'req-308f9cd1-1121-4a5e-9a97-f39c0142af10'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:27:09.015684 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-308f9cd1-1121-4a5e-9a97-f39c0142af10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'feb393ae71b0437587ca25cd7665cb4f', 'request_id': 'req-308f9cd1-1121-4a5e-9a97-f39c0142af10'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:27:09.023982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-308f9cd1-1121-4a5e-9a97-f39c0142af10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'feb393ae71b0437587ca25cd7665cb4f', 'request_id': 'req-308f9cd1-1121-4a5e-9a97-f39c0142af10'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:27:09.038162 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-308f9cd1-1121-4a5e-9a97-f39c0142af10 admin admin] The token cache is being invalidate because project feb393ae71b0437587ca25cd7665cb4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:27:09.038455 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-308f9cd1-1121-4a5e-9a97-f39c0142af10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:27:09.039238 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-308f9cd1-1121-4a5e-9a97-f39c0142af10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:27:09.040788 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4337/8694] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:27:08 2022] DELETE /identity/v3/projects/feb393ae71b0437587ca25cd7665cb4f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:27:09.047605 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc92e7-ffc0-4312-b006-66eafb767225 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:09.047895 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc92e7-ffc0-4312-b006-66eafb767225 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:09.048170 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc92e7-ffc0-4312-b006-66eafb767225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:09.089232 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-3edc92e7-ffc0-4312-b006-66eafb767225 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:27:09.091241 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3edc92e7-ffc0-4312-b006-66eafb767225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:27:09.158513 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4358/8695] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:27:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:27:09.168570 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a6094-6c8b-4fd8-b8b4-7368531ecf95 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:09.169359 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a6094-6c8b-4fd8-b8b4-7368531ecf95 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:09.169359 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a6094-6c8b-4fd8-b8b4-7368531ecf95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:09.191187 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-4d2a6094-6c8b-4fd8-b8b4-7368531ecf95 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:27:09.192769 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4d2a6094-6c8b-4fd8-b8b4-7368531ecf95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:27:09.203297 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4338/8696] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:27:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:27:09.207906 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc92e7-ffc0-4312-b006-66eafb767225 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:09.221650 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc92e7-ffc0-4312-b006-66eafb767225 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:09.227175 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd603ea-60d9-4879-bf93-c9e085e78fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:09.227892 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd603ea-60d9-4879-bf93-c9e085e78fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:09.228225 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd603ea-60d9-4879-bf93-c9e085e78fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:09.228539 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd603ea-60d9-4879-bf93-c9e085e78fe7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:09.229332 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd603ea-60d9-4879-bf93-c9e085e78fe7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:27:09.229690 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd603ea-60d9-4879-bf93-c9e085e78fe7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:09.232509 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd603ea-60d9-4879-bf93-c9e085e78fe7 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:09.247178 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4359/8697] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:27:09.252293 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a6094-6c8b-4fd8-b8b4-7368531ecf95 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:09.262903 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a6094-6c8b-4fd8-b8b4-7368531ecf95 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:09.268197 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583ec78-140b-4b70-9f46-2dd2977321ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:09.268844 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583ec78-140b-4b70-9f46-2dd2977321ba admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:09.269128 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583ec78-140b-4b70-9f46-2dd2977321ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:09.269440 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583ec78-140b-4b70-9f46-2dd2977321ba admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:09.270287 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9583ec78-140b-4b70-9f46-2dd2977321ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:09.272384 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9583ec78-140b-4b70-9f46-2dd2977321ba admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:09.303576 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4339/8698] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:27:09 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:27:09.308802 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd603ea-60d9-4879-bf93-c9e085e78fe7 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:09.319764 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd603ea-60d9-4879-bf93-c9e085e78fe7 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:09.364723 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:27:09.382877 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54c906-7028-4372-aa5b-23f4e5c9650c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:09.383660 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54c906-7028-4372-aa5b-23f4e5c9650c admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:09.384043 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54c906-7028-4372-aa5b-23f4e5c9650c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:09.384329 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54c906-7028-4372-aa5b-23f4e5c9650c admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:09.385023 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba54c906-7028-4372-aa5b-23f4e5c9650c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:09.387257 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba54c906-7028-4372-aa5b-23f4e5c9650c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:09.409822 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4360/8699] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:27:09 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:27:09.414452 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583ec78-140b-4b70-9f46-2dd2977321ba admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:09.427965 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583ec78-140b-4b70-9f46-2dd2977321ba admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:09.435452 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b2cb2-5007-47fe-8cfa-0193b796b476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:09.436238 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b2cb2-5007-47fe-8cfa-0193b796b476 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:09.436579 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b2cb2-5007-47fe-8cfa-0193b796b476 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:09.436855 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b2cb2-5007-47fe-8cfa-0193b796b476 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:09.437693 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b2cb2-5007-47fe-8cfa-0193b796b476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:09.439593 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b2cb2-5007-47fe-8cfa-0193b796b476 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:09.451995 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4340/8700] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:27:09.456809 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54c906-7028-4372-aa5b-23f4e5c9650c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:09.468390 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54c906-7028-4372-aa5b-23f4e5c9650c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:09.473505 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0636a2-d0e6-4533-b0a5-9a182cf24b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:09.474106 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0636a2-d0e6-4533-b0a5-9a182cf24b91 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:09.474382 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0636a2-d0e6-4533-b0a5-9a182cf24b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:09.474649 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0636a2-d0e6-4533-b0a5-9a182cf24b91 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:09.475351 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0636a2-d0e6-4533-b0a5-9a182cf24b91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:09.477096 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0636a2-d0e6-4533-b0a5-9a182cf24b91 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:09.490141 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4361/8701] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:27:09.494794 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b2cb2-5007-47fe-8cfa-0193b796b476 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:09.505374 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b2cb2-5007-47fe-8cfa-0193b796b476 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:09.510122 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690591f-0720-49d4-ac7b-f4ca73503bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:09.510767 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690591f-0720-49d4-ac7b-f4ca73503bfe admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:09.511119 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690591f-0720-49d4-ac7b-f4ca73503bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:09.511390 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690591f-0720-49d4-ac7b-f4ca73503bfe admin admin] PATH_INFO: `/v3/projects/f1327a9ca6fc44248dc68409e7b0e408/users/e6ac434fe9e8467f8a43a9ebd90f9a6d/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:09.526127 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5690591f-0720-49d4-ac7b-f4ca73503bfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1327a9ca6fc44248dc68409e7b0e408, user_id=e6ac434fe9e8467f8a43a9ebd90f9a6d, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:09.529692 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5690591f-0720-49d4-ac7b-f4ca73503bfe admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:09.542100 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4341/8702] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:27:09 2022] PUT /identity/v3/projects/f1327a9ca6fc44248dc68409e7b0e408/users/e6ac434fe9e8467f8a43a9ebd90f9a6d/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:27:09.553408 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e6e59-5ee5-457c-a68b-85c7f1386435 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:09.553787 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e6e59-5ee5-457c-a68b-85c7f1386435 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:09.554003 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e6e59-5ee5-457c-a68b-85c7f1386435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:09.582078 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-b22e6e59-5ee5-457c-a68b-85c7f1386435 None None] MFA Rules not processed for user `e6ac434fe9e8467f8a43a9ebd90f9a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:27:09.583290 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b22e6e59-5ee5-457c-a68b-85c7f1386435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:27:09.651246 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4362/8703] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:27:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:27:09.662948 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690591f-0720-49d4-ac7b-f4ca73503bfe admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:09.664664 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5690591f-0720-49d4-ac7b-f4ca73503bfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:27:09.731385 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690591f-0720-49d4-ac7b-f4ca73503bfe admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:09.735104 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc37e62-93e9-4e30-87d3-0b6949dec688 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:09.735721 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc37e62-93e9-4e30-87d3-0b6949dec688 service cinder] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:09.736000 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc37e62-93e9-4e30-87d3-0b6949dec688 service cinder] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:09.736271 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc37e62-93e9-4e30-87d3-0b6949dec688 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:09.745183 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc37e62-93e9-4e30-87d3-0b6949dec688 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:09.746794 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc37e62-93e9-4e30-87d3-0b6949dec688 service cinder] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:09.755846 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4342/8704] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:27:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:27:09.780550 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e6e59-5ee5-457c-a68b-85c7f1386435 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:09.846248 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e6e59-5ee5-457c-a68b-85c7f1386435 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:09.850829 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a81b88-82b6-4795-891b-99cf240a08c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:09.851505 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a81b88-82b6-4795-891b-99cf240a08c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:09.851785 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a81b88-82b6-4795-891b-99cf240a08c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:09.852059 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a81b88-82b6-4795-891b-99cf240a08c6 admin admin] PATH_INFO: `/v3/users/e6ac434fe9e8467f8a43a9ebd90f9a6d` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:09.853222 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a81b88-82b6-4795-891b-99cf240a08c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6ac434fe9e8467f8a43a9ebd90f9a6d)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:09.855255 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a81b88-82b6-4795-891b-99cf240a08c6 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:09.901710 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-73a81b88-82b6-4795-891b-99cf240a08c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6ac434fe9e8467f8a43a9ebd90f9a6d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:27:09.903136 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-73a81b88-82b6-4795-891b-99cf240a08c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6ac434fe9e8467f8a43a9ebd90f9a6d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:27:09.907177 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:27:09.910956 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-73a81b88-82b6-4795-891b-99cf240a08c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6ac434fe9e8467f8a43a9ebd90f9a6d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:27:09.920141 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-73a81b88-82b6-4795-891b-99cf240a08c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6ac434fe9e8467f8a43a9ebd90f9a6d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:27:09.920801 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-73a81b88-82b6-4795-891b-99cf240a08c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6ac434fe9e8467f8a43a9ebd90f9a6d'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:27:09.938335 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4363/8705] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:27:09 2022] DELETE /identity/v3/users/e6ac434fe9e8467f8a43a9ebd90f9a6d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:27:09.943278 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf947d-2a84-487c-8d5f-af4647236886 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:09.943566 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf947d-2a84-487c-8d5f-af4647236886 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:09.943840 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf947d-2a84-487c-8d5f-af4647236886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:09.952390 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:27:09.966799 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-d8bf947d-2a84-487c-8d5f-af4647236886 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:27:09.968028 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d8bf947d-2a84-487c-8d5f-af4647236886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:27:10.033829 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4343/8706] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:27:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:27:10.044250 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a81b88-82b6-4795-891b-99cf240a08c6 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:10.045830 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-73a81b88-82b6-4795-891b-99cf240a08c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:27:10.110262 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a81b88-82b6-4795-891b-99cf240a08c6 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:10.114374 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706eb8b-eb7b-491d-b282-d9e12ec8b80b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:10.115093 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706eb8b-eb7b-491d-b282-d9e12ec8b80b service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:10.115389 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706eb8b-eb7b-491d-b282-d9e12ec8b80b service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:10.115687 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706eb8b-eb7b-491d-b282-d9e12ec8b80b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:10.126224 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6706eb8b-eb7b-491d-b282-d9e12ec8b80b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:10.127704 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6706eb8b-eb7b-491d-b282-d9e12ec8b80b service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:10.137890 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4364/8707] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:27:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:27:10.416594 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bf947d-2a84-487c-8d5f-af4647236886 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:10.418373 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d8bf947d-2a84-487c-8d5f-af4647236886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:27:10.437619 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bf947d-2a84-487c-8d5f-af4647236886 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:10.444079 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c3294-e7fd-49b4-ba40-2862a8abe795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:10.445222 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c3294-e7fd-49b4-ba40-2862a8abe795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:10.445652 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c3294-e7fd-49b4-ba40-2862a8abe795 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:10.445845 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c3294-e7fd-49b4-ba40-2862a8abe795 admin admin] PATH_INFO: `/v3/projects/f1327a9ca6fc44248dc68409e7b0e408` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:10.447534 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c3294-e7fd-49b4-ba40-2862a8abe795 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1327a9ca6fc44248dc68409e7b0e408)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:10.450423 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c3294-e7fd-49b4-ba40-2862a8abe795 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:10.498567 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-980c3294-e7fd-49b4-ba40-2862a8abe795 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1327a9ca6fc44248dc68409e7b0e408', 'request_id': 'req-980c3294-e7fd-49b4-ba40-2862a8abe795'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:27:10.504616 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-980c3294-e7fd-49b4-ba40-2862a8abe795 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1327a9ca6fc44248dc68409e7b0e408', 'request_id': 'req-980c3294-e7fd-49b4-ba40-2862a8abe795'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:27:10.512000 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-980c3294-e7fd-49b4-ba40-2862a8abe795 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1327a9ca6fc44248dc68409e7b0e408', 'request_id': 'req-980c3294-e7fd-49b4-ba40-2862a8abe795'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:27:10.523483 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-980c3294-e7fd-49b4-ba40-2862a8abe795 admin admin] The token cache is being invalidate because project f1327a9ca6fc44248dc68409e7b0e408 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:27:10.523921 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-980c3294-e7fd-49b4-ba40-2862a8abe795 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:27:10.524823 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-980c3294-e7fd-49b4-ba40-2862a8abe795 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:27:10.526821 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4344/8708] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:27:10 2022] DELETE /identity/v3/projects/f1327a9ca6fc44248dc68409e7b0e408 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:27:10.532427 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957dca8-ebbe-4639-af14-f73ea47cc0da None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:10.532913 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957dca8-ebbe-4639-af14-f73ea47cc0da None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:10.533066 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957dca8-ebbe-4639-af14-f73ea47cc0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:10.557444 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-e957dca8-ebbe-4639-af14-f73ea47cc0da None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:27:10.560369 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e957dca8-ebbe-4639-af14-f73ea47cc0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:27:10.629924 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4365/8709] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:27:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:27:10.637858 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25958f06-44d4-4b99-9120-20e900e1cb44 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:10.638144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25958f06-44d4-4b99-9120-20e900e1cb44 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:10.638423 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25958f06-44d4-4b99-9120-20e900e1cb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:10.658472 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-25958f06-44d4-4b99-9120-20e900e1cb44 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:27:10.659772 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-25958f06-44d4-4b99-9120-20e900e1cb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:27:10.668210 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4345/8710] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:27:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:27:10.672603 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957dca8-ebbe-4639-af14-f73ea47cc0da None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:10.683485 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957dca8-ebbe-4639-af14-f73ea47cc0da None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:10.688911 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f02113-9425-43a2-a60f-3c3d6b4c255c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:10.689514 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f02113-9425-43a2-a60f-3c3d6b4c255c admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:10.689795 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f02113-9425-43a2-a60f-3c3d6b4c255c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:10.690071 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f02113-9425-43a2-a60f-3c3d6b4c255c admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:10.690716 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f02113-9425-43a2-a60f-3c3d6b4c255c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:27:10.691046 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f02113-9425-43a2-a60f-3c3d6b4c255c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:10.692939 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f02113-9425-43a2-a60f-3c3d6b4c255c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:10.710387 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4366/8711] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:27:10.711364 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25958f06-44d4-4b99-9120-20e900e1cb44 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:10.722173 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25958f06-44d4-4b99-9120-20e900e1cb44 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:10.727838 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13083865-07ba-47be-829c-2c7d77a8fe4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:10.728579 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13083865-07ba-47be-829c-2c7d77a8fe4c admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:10.728879 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13083865-07ba-47be-829c-2c7d77a8fe4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:10.729157 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13083865-07ba-47be-829c-2c7d77a8fe4c admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:10.729984 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13083865-07ba-47be-829c-2c7d77a8fe4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:10.732758 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13083865-07ba-47be-829c-2c7d77a8fe4c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:10.761475 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4346/8712] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:27:10 2022] POST /identity/v3/projects => generated 391 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:27:10.765691 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f02113-9425-43a2-a60f-3c3d6b4c255c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:10.775861 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f02113-9425-43a2-a60f-3c3d6b4c255c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:10.834891 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a5a005-e01b-4cac-8034-7ce0bcf05653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:10.835529 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5a005-e01b-4cac-8034-7ce0bcf05653 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:10.835812 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5a005-e01b-4cac-8034-7ce0bcf05653 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:10.836086 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5a005-e01b-4cac-8034-7ce0bcf05653 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:10.836724 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a5a005-e01b-4cac-8034-7ce0bcf05653 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:10.838644 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a5a005-e01b-4cac-8034-7ce0bcf05653 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:10.847229 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:27:10.861638 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4367/8713] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:27:10 2022] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:27:10.865823 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13083865-07ba-47be-829c-2c7d77a8fe4c admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:10.876372 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13083865-07ba-47be-829c-2c7d77a8fe4c admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:10.881044 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4fe316-841a-4692-a486-2c2e759338dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:10.881643 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fe316-841a-4692-a486-2c2e759338dc admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:10.881920 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fe316-841a-4692-a486-2c2e759338dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:10.882188 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fe316-841a-4692-a486-2c2e759338dc admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:10.882828 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4fe316-841a-4692-a486-2c2e759338dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:10.884586 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4fe316-841a-4692-a486-2c2e759338dc admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:10.895484 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4347/8714] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:27:10.899670 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a5a005-e01b-4cac-8034-7ce0bcf05653 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:10.910679 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a5a005-e01b-4cac-8034-7ce0bcf05653 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:10.915252 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa978ddd-d243-4753-9f57-018d8f361c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:10.915852 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa978ddd-d243-4753-9f57-018d8f361c5d admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:10.916132 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa978ddd-d243-4753-9f57-018d8f361c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:10.916405 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa978ddd-d243-4753-9f57-018d8f361c5d admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:10.917045 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa978ddd-d243-4753-9f57-018d8f361c5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:10.918651 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa978ddd-d243-4753-9f57-018d8f361c5d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:10.929399 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4368/8715] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:27:10.934208 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4fe316-841a-4692-a486-2c2e759338dc admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:10.944725 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4fe316-841a-4692-a486-2c2e759338dc admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:10.950079 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75eda4-e420-482e-a4ce-64c19fbcf824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:10.950823 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75eda4-e420-482e-a4ce-64c19fbcf824 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:10.951141 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75eda4-e420-482e-a4ce-64c19fbcf824 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:10.951429 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75eda4-e420-482e-a4ce-64c19fbcf824 admin admin] PATH_INFO: `/v3/projects/b469c210c0ca4582abbaf85d4b12ae1e/users/3f782ee92f5d4996920ba7e6a071827c/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:10.967207 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e75eda4-e420-482e-a4ce-64c19fbcf824 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b469c210c0ca4582abbaf85d4b12ae1e, user_id=3f782ee92f5d4996920ba7e6a071827c, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:10.969864 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e75eda4-e420-482e-a4ce-64c19fbcf824 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:10.983959 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4348/8716] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:27:10 2022] PUT /identity/v3/projects/b469c210c0ca4582abbaf85d4b12ae1e/users/3f782ee92f5d4996920ba7e6a071827c/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:27:10.995079 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da251794-6d0a-4649-97e5-b2bd5ddca177 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:10.995373 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da251794-6d0a-4649-97e5-b2bd5ddca177 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:10.995646 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da251794-6d0a-4649-97e5-b2bd5ddca177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:11.024482 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-da251794-6d0a-4649-97e5-b2bd5ddca177 None None] MFA Rules not processed for user `3f782ee92f5d4996920ba7e6a071827c`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:27:11.025722 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-da251794-6d0a-4649-97e5-b2bd5ddca177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:27:11.091462 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4369/8717] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:27:10 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:27:11.101803 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414d8fb-9f91-46ba-bf78-78c019f0b6a1 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:11.102091 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414d8fb-9f91-46ba-bf78-78c019f0b6a1 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:11.102398 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414d8fb-9f91-46ba-bf78-78c019f0b6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:11.140806 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-a414d8fb-9f91-46ba-bf78-78c019f0b6a1 None None] MFA Rules not processed for user `fd42634b2795427cba6614c53491ded2`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:27:11.142022 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a414d8fb-9f91-46ba-bf78-78c019f0b6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:27:11.147288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:27:11.194211 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4349/8718] 10.222.0.83 () {58 vars in 1061 bytes} [Mon Aug 29 16:27:11 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:27:11.200441 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da251794-6d0a-4649-97e5-b2bd5ddca177 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:11.209907 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da251794-6d0a-4649-97e5-b2bd5ddca177 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:11.213535 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999fad27-e5ba-42a4-a2de-90408a7a1289 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:11.214134 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999fad27-e5ba-42a4-a2de-90408a7a1289 service cinder] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:11.214414 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999fad27-e5ba-42a4-a2de-90408a7a1289 service cinder] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:11.215326 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999fad27-e5ba-42a4-a2de-90408a7a1289 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:11.225220 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999fad27-e5ba-42a4-a2de-90408a7a1289 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:11.226660 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999fad27-e5ba-42a4-a2de-90408a7a1289 service cinder] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:11.236429 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4370/8719] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:27:11 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:27:21.188174 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=18 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:27:21.232250 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:INSERT=3,keystone:SELECT=45 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:27:28.755487 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a414d8fb-9f91-46ba-bf78-78c019f0b6a1 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:28.826956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a414d8fb-9f91-46ba-bf78-78c019f0b6a1 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:28.831954 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec5097-3bf4-4fa3-91d9-9aee7982c7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:28.832739 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec5097-3bf4-4fa3-91d9-9aee7982c7d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:28.832922 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec5097-3bf4-4fa3-91d9-9aee7982c7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:28.833715 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec5097-3bf4-4fa3-91d9-9aee7982c7d2 admin admin] PATH_INFO: `/v3/users/3f782ee92f5d4996920ba7e6a071827c` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:28.834399 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec5097-3bf4-4fa3-91d9-9aee7982c7d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f782ee92f5d4996920ba7e6a071827c)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:28.836389 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec5097-3bf4-4fa3-91d9-9aee7982c7d2 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:28.891122 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6cec5097-3bf4-4fa3-91d9-9aee7982c7d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f782ee92f5d4996920ba7e6a071827c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:27:28.891773 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6cec5097-3bf4-4fa3-91d9-9aee7982c7d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f782ee92f5d4996920ba7e6a071827c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:27:28.904766 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6cec5097-3bf4-4fa3-91d9-9aee7982c7d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f782ee92f5d4996920ba7e6a071827c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:27:28.912426 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6cec5097-3bf4-4fa3-91d9-9aee7982c7d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f782ee92f5d4996920ba7e6a071827c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:27:28.920885 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6cec5097-3bf4-4fa3-91d9-9aee7982c7d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f782ee92f5d4996920ba7e6a071827c'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:27:28.927042 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4350/8720] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:27:28 2022] DELETE /identity/v3/users/3f782ee92f5d4996920ba7e6a071827c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:27:28.931638 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626d1d6-0821-4aaf-a84e-92a135e25749 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:28.932124 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626d1d6-0821-4aaf-a84e-92a135e25749 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:28.932356 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626d1d6-0821-4aaf-a84e-92a135e25749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:28.953095 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-1626d1d6-0821-4aaf-a84e-92a135e25749 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:27:28.954365 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1626d1d6-0821-4aaf-a84e-92a135e25749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:27:29.014874 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4371/8721] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:27:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:27:29.024657 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec5097-3bf4-4fa3-91d9-9aee7982c7d2 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:29.026194 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6cec5097-3bf4-4fa3-91d9-9aee7982c7d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:27:29.086313 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec5097-3bf4-4fa3-91d9-9aee7982c7d2 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:29.090035 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5080a-0270-4620-81f6-f69d57ea46a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:29.090648 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5080a-0270-4620-81f6-f69d57ea46a7 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:29.091202 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5080a-0270-4620-81f6-f69d57ea46a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:29.091491 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5080a-0270-4620-81f6-f69d57ea46a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:29.100826 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd5080a-0270-4620-81f6-f69d57ea46a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:29.102412 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd5080a-0270-4620-81f6-f69d57ea46a7 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:29.113024 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4351/8722] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:27:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:27:29.405012 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626d1d6-0821-4aaf-a84e-92a135e25749 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:29.406490 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1626d1d6-0821-4aaf-a84e-92a135e25749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:27:29.420790 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626d1d6-0821-4aaf-a84e-92a135e25749 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:29.425704 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7c188-7876-4b0a-9c11-3e342db86cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:29.426350 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7c188-7876-4b0a-9c11-3e342db86cfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:29.426624 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7c188-7876-4b0a-9c11-3e342db86cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:29.426892 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7c188-7876-4b0a-9c11-3e342db86cfb admin admin] PATH_INFO: `/v3/projects/b469c210c0ca4582abbaf85d4b12ae1e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:29.428051 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d7c188-7876-4b0a-9c11-3e342db86cfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b469c210c0ca4582abbaf85d4b12ae1e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:29.429996 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d7c188-7876-4b0a-9c11-3e342db86cfb admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:29.483239 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c3d7c188-7876-4b0a-9c11-3e342db86cfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b469c210c0ca4582abbaf85d4b12ae1e', 'request_id': 'req-c3d7c188-7876-4b0a-9c11-3e342db86cfb'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:27:29.488912 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c3d7c188-7876-4b0a-9c11-3e342db86cfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b469c210c0ca4582abbaf85d4b12ae1e', 'request_id': 'req-c3d7c188-7876-4b0a-9c11-3e342db86cfb'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:27:29.495242 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c3d7c188-7876-4b0a-9c11-3e342db86cfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b469c210c0ca4582abbaf85d4b12ae1e', 'request_id': 'req-c3d7c188-7876-4b0a-9c11-3e342db86cfb'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:27:29.508681 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c3d7c188-7876-4b0a-9c11-3e342db86cfb admin admin] The token cache is being invalidate because project b469c210c0ca4582abbaf85d4b12ae1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:27:29.509052 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c3d7c188-7876-4b0a-9c11-3e342db86cfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:27:29.509757 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c3d7c188-7876-4b0a-9c11-3e342db86cfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:27:29.511472 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4372/8723] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:27:29 2022] DELETE /identity/v3/projects/b469c210c0ca4582abbaf85d4b12ae1e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:27:29.516710 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b2295-a640-418d-9710-c01aa85acfb1 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:29.517173 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b2295-a640-418d-9710-c01aa85acfb1 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:29.517442 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b2295-a640-418d-9710-c01aa85acfb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:29.538377 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-721b2295-a640-418d-9710-c01aa85acfb1 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:27:29.539627 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-721b2295-a640-418d-9710-c01aa85acfb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:27:29.558949 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:27:29.607725 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4352/8724] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:27:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:27:29.615532 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046b4f8-f99d-40f8-b2af-5c32d93672e5 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:29.615829 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046b4f8-f99d-40f8-b2af-5c32d93672e5 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:29.616224 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046b4f8-f99d-40f8-b2af-5c32d93672e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:29.640657 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-d046b4f8-f99d-40f8-b2af-5c32d93672e5 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:27:29.642129 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d046b4f8-f99d-40f8-b2af-5c32d93672e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:27:29.650375 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4373/8725] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:27:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:27:29.655479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b2295-a640-418d-9710-c01aa85acfb1 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:29.665526 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b2295-a640-418d-9710-c01aa85acfb1 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:29.671015 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297cc2a7-be59-4876-bb95-dca172a9e87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:29.671655 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297cc2a7-be59-4876-bb95-dca172a9e87c admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:29.671991 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297cc2a7-be59-4876-bb95-dca172a9e87c admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:29.672263 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297cc2a7-be59-4876-bb95-dca172a9e87c admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:29.672907 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297cc2a7-be59-4876-bb95-dca172a9e87c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:27:29.673234 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297cc2a7-be59-4876-bb95-dca172a9e87c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:29.674848 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297cc2a7-be59-4876-bb95-dca172a9e87c admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:29.687528 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4353/8726] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:27:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:27:29.692111 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d046b4f8-f99d-40f8-b2af-5c32d93672e5 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:29.702750 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d046b4f8-f99d-40f8-b2af-5c32d93672e5 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:29.707641 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbfd34f-1afe-4610-9b19-80631acc67d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:29.708258 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfd34f-1afe-4610-9b19-80631acc67d1 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:29.708529 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfd34f-1afe-4610-9b19-80631acc67d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:29.708793 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfd34f-1afe-4610-9b19-80631acc67d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:29.709434 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbfd34f-1afe-4610-9b19-80631acc67d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:29.711362 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbfd34f-1afe-4610-9b19-80631acc67d1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:29.741468 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4374/8727] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:27:29 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:27:29.745946 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297cc2a7-be59-4876-bb95-dca172a9e87c admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:29.757456 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297cc2a7-be59-4876-bb95-dca172a9e87c admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:29.821952 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ed4b4-b16a-49af-9112-b7eb808c7bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:29.822561 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ed4b4-b16a-49af-9112-b7eb808c7bf2 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:29.822836 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ed4b4-b16a-49af-9112-b7eb808c7bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:29.823127 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ed4b4-b16a-49af-9112-b7eb808c7bf2 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:29.823759 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6ed4b4-b16a-49af-9112-b7eb808c7bf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:29.826568 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6ed4b4-b16a-49af-9112-b7eb808c7bf2 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:29.850854 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4354/8728] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:27:29 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:27:29.852673 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbfd34f-1afe-4610-9b19-80631acc67d1 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:29.863232 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbfd34f-1afe-4610-9b19-80631acc67d1 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:29.867826 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef93d3-e982-491f-826a-3dafa3adc3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:29.868427 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef93d3-e982-491f-826a-3dafa3adc3ef admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:29.868716 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef93d3-e982-491f-826a-3dafa3adc3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:29.868984 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef93d3-e982-491f-826a-3dafa3adc3ef admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:29.869621 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ef93d3-e982-491f-826a-3dafa3adc3ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:29.871252 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ef93d3-e982-491f-826a-3dafa3adc3ef admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:29.881786 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4375/8729] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:27:29.885727 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ed4b4-b16a-49af-9112-b7eb808c7bf2 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:29.896341 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ed4b4-b16a-49af-9112-b7eb808c7bf2 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:29.900973 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969966c-84a1-437f-ba59-0efc6a820422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:29.901568 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969966c-84a1-437f-ba59-0efc6a820422 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:29.901846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969966c-84a1-437f-ba59-0efc6a820422 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:29.902119 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969966c-84a1-437f-ba59-0efc6a820422 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:29.902759 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3969966c-84a1-437f-ba59-0efc6a820422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:29.905257 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3969966c-84a1-437f-ba59-0efc6a820422 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:29.916077 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4355/8730] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:27:29.922942 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef93d3-e982-491f-826a-3dafa3adc3ef admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:29.933159 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef93d3-e982-491f-826a-3dafa3adc3ef admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:29.937975 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ca6ef-d09f-4517-b69e-6fb039a48c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:29.938626 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ca6ef-d09f-4517-b69e-6fb039a48c24 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:29.938902 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ca6ef-d09f-4517-b69e-6fb039a48c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:29.939214 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ca6ef-d09f-4517-b69e-6fb039a48c24 admin admin] PATH_INFO: `/v3/projects/3a00d97a45164577a2e90b6083515f3a/users/75ce0c0a463b435690258f9b9958b3de/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:29.955086 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ca6ef-d09f-4517-b69e-6fb039a48c24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a00d97a45164577a2e90b6083515f3a, user_id=75ce0c0a463b435690258f9b9958b3de, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:29.957807 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ca6ef-d09f-4517-b69e-6fb039a48c24 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:29.972442 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4376/8731] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:27:29 2022] PUT /identity/v3/projects/3a00d97a45164577a2e90b6083515f3a/users/75ce0c0a463b435690258f9b9958b3de/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:27:29.977504 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35522125-d818-437f-b6f0-cb186a7d0808 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:29.977884 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35522125-d818-437f-b6f0-cb186a7d0808 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:29.978226 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35522125-d818-437f-b6f0-cb186a7d0808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:29.998043 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-35522125-d818-437f-b6f0-cb186a7d0808 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:27:29.999279 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-35522125-d818-437f-b6f0-cb186a7d0808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:27:30.057661 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4356/8732] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:27:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:27:30.068190 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ca6ef-d09f-4517-b69e-6fb039a48c24 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:30.069929 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a51ca6ef-d09f-4517-b69e-6fb039a48c24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:27:30.092297 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:27:30.129873 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ca6ef-d09f-4517-b69e-6fb039a48c24 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:30.133563 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1fb1b-a1d8-4a4c-846d-10b056703dcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:30.134167 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1fb1b-a1d8-4a4c-846d-10b056703dcf service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:30.134444 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1fb1b-a1d8-4a4c-846d-10b056703dcf service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:30.134716 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1fb1b-a1d8-4a4c-846d-10b056703dcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:30.144657 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1fb1b-a1d8-4a4c-846d-10b056703dcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:30.146117 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1fb1b-a1d8-4a4c-846d-10b056703dcf service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:30.155687 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4377/8733] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:27:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:27:31.144064 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25264d3b-8648-4fd1-b13a-cfa9befaf733 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:31.144585 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25264d3b-8648-4fd1-b13a-cfa9befaf733 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:31.144668 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25264d3b-8648-4fd1-b13a-cfa9befaf733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:31.176673 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-25264d3b-8648-4fd1-b13a-cfa9befaf733 None None] MFA Rules not processed for user `75ce0c0a463b435690258f9b9958b3de`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:27:31.177926 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-25264d3b-8648-4fd1-b13a-cfa9befaf733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:27:31.195637 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:27:31.248492 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4357/8734] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:27:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:27:31.254061 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1fb1b-a1d8-4a4c-846d-10b056703dcf service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:31.264458 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1fb1b-a1d8-4a4c-846d-10b056703dcf service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:31.269079 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5361fe9f-680a-4d90-b8f6-045154e8ae33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:31.269689 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361fe9f-680a-4d90-b8f6-045154e8ae33 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:31.269969 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361fe9f-680a-4d90-b8f6-045154e8ae33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:31.270239 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361fe9f-680a-4d90-b8f6-045154e8ae33 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:31.270883 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5361fe9f-680a-4d90-b8f6-045154e8ae33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:31.272839 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5361fe9f-680a-4d90-b8f6-045154e8ae33 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:31.305248 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4378/8735] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:27:31 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:27:31.306641 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25264d3b-8648-4fd1-b13a-cfa9befaf733 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:31.318676 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25264d3b-8648-4fd1-b13a-cfa9befaf733 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:31.375215 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a0208-383c-4733-a4c3-5fee2f167acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:31.375829 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a0208-383c-4733-a4c3-5fee2f167acb admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:31.376114 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a0208-383c-4733-a4c3-5fee2f167acb admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:31.376388 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a0208-383c-4733-a4c3-5fee2f167acb admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:31.377012 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148a0208-383c-4733-a4c3-5fee2f167acb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:31.378933 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148a0208-383c-4733-a4c3-5fee2f167acb admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:31.399701 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4358/8736] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:27:31 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:27:31.403892 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5361fe9f-680a-4d90-b8f6-045154e8ae33 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:31.414202 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5361fe9f-680a-4d90-b8f6-045154e8ae33 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:31.419513 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7073b157-55e9-4b7c-9e9d-5dabacdebf98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:31.420183 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073b157-55e9-4b7c-9e9d-5dabacdebf98 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:31.420463 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073b157-55e9-4b7c-9e9d-5dabacdebf98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:31.420765 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073b157-55e9-4b7c-9e9d-5dabacdebf98 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:31.421413 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7073b157-55e9-4b7c-9e9d-5dabacdebf98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:31.423212 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7073b157-55e9-4b7c-9e9d-5dabacdebf98 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:31.434023 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4379/8737] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:27:31.440004 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a0208-383c-4733-a4c3-5fee2f167acb admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:31.450787 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a0208-383c-4733-a4c3-5fee2f167acb admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:31.455550 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b09756-cdc5-4320-88c0-59d7578621cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:31.456202 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b09756-cdc5-4320-88c0-59d7578621cd admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:31.456483 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b09756-cdc5-4320-88c0-59d7578621cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:31.456763 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b09756-cdc5-4320-88c0-59d7578621cd admin admin] PATH_INFO: `/v3/projects/9359710623f44f49bde656447cca1df0/users/c08afedc0e9346ccaa6fd7884048ab14/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:31.472188 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b09756-cdc5-4320-88c0-59d7578621cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9359710623f44f49bde656447cca1df0, user_id=c08afedc0e9346ccaa6fd7884048ab14, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:31.474910 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b09756-cdc5-4320-88c0-59d7578621cd admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:31.488852 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4359/8738] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:27:31 2022] PUT /identity/v3/projects/9359710623f44f49bde656447cca1df0/users/c08afedc0e9346ccaa6fd7884048ab14/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:27:31.492936 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7073b157-55e9-4b7c-9e9d-5dabacdebf98 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:31.504043 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7073b157-55e9-4b7c-9e9d-5dabacdebf98 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:31.562323 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a4473-410e-4b27-a0a4-3b352e3171bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:31.562882 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a4473-410e-4b27-a0a4-3b352e3171bc admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:31.563163 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a4473-410e-4b27-a0a4-3b352e3171bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:31.563454 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a4473-410e-4b27-a0a4-3b352e3171bc admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:31.564091 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a4473-410e-4b27-a0a4-3b352e3171bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:31.565748 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a4473-410e-4b27-a0a4-3b352e3171bc admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:31.578010 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4380/8739] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:27:31.581260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b09756-cdc5-4320-88c0-59d7578621cd admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:31.585361 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a4473-410e-4b27-a0a4-3b352e3171bc admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:31.587449 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-cb8a4473-410e-4b27-a0a4-3b352e3171bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:27:31.594454 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b09756-cdc5-4320-88c0-59d7578621cd admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:31.602005 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3132699-6607-442d-a0d7-16d9a3607c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:31.602685 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3132699-6607-442d-a0d7-16d9a3607c4b admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:31.602964 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3132699-6607-442d-a0d7-16d9a3607c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:31.603294 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3132699-6607-442d-a0d7-16d9a3607c4b admin admin] PATH_INFO: `/v3/projects/9359710623f44f49bde656447cca1df0/users/c08afedc0e9346ccaa6fd7884048ab14/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:31.605271 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3132699-6607-442d-a0d7-16d9a3607c4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9359710623f44f49bde656447cca1df0, user_id=c08afedc0e9346ccaa6fd7884048ab14, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:31.608844 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3132699-6607-442d-a0d7-16d9a3607c4b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:31.620002 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4360/8740] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:27:31 2022] PUT /identity/v3/projects/9359710623f44f49bde656447cca1df0/users/c08afedc0e9346ccaa6fd7884048ab14/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:27:31.674301 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a4473-410e-4b27-a0a4-3b352e3171bc admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:31.696126 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:27:31.750957 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2dd18-df53-4578-bb01-1887dc42d5ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:31.751642 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2dd18-df53-4578-bb01-1887dc42d5ca service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:31.751919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2dd18-df53-4578-bb01-1887dc42d5ca service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:31.752188 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2dd18-df53-4578-bb01-1887dc42d5ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:31.754217 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-88b2dd18-df53-4578-bb01-1887dc42d5ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:27:31.820780 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b2dd18-df53-4578-bb01-1887dc42d5ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:31.822470 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b2dd18-df53-4578-bb01-1887dc42d5ca service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:31.833226 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4381/8741] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:27:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:27:32.432243 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a41cd-37ab-4e56-a008-3303ee7eedd5 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:32.432784 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a41cd-37ab-4e56-a008-3303ee7eedd5 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:32.432784 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a41cd-37ab-4e56-a008-3303ee7eedd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:32.461079 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-0e1a41cd-37ab-4e56-a008-3303ee7eedd5 None None] MFA Rules not processed for user `c08afedc0e9346ccaa6fd7884048ab14`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:27:32.462336 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0e1a41cd-37ab-4e56-a008-3303ee7eedd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:27:32.523242 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:27:32.534186 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4361/8742] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:27:32 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:27:32.545295 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9e931-1955-4d82-a36e-c4cf2404087d None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:32.545900 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9e931-1955-4d82-a36e-c4cf2404087d None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:32.545981 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9e931-1955-4d82-a36e-c4cf2404087d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:32.565899 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-75e9e931-1955-4d82-a36e-c4cf2404087d None None] MFA Rules not processed for user `75ce0c0a463b435690258f9b9958b3de`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:27:32.567597 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-75e9e931-1955-4d82-a36e-c4cf2404087d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:27:32.629288 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4382/8743] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:27:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:27:32.642350 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a41cd-37ab-4e56-a008-3303ee7eedd5 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:32.657879 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a41cd-37ab-4e56-a008-3303ee7eedd5 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:32.663437 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f95042-04c0-497a-b25e-5c82e60c79e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:32.664049 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f95042-04c0-497a-b25e-5c82e60c79e8 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:32.664326 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f95042-04c0-497a-b25e-5c82e60c79e8 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:32.664600 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f95042-04c0-497a-b25e-5c82e60c79e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:32.672907 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f95042-04c0-497a-b25e-5c82e60c79e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:32.674500 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f95042-04c0-497a-b25e-5c82e60c79e8 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:32.683468 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4362/8744] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:27:32 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:27:32.917735 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e9e931-1955-4d82-a36e-c4cf2404087d None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:32.919700 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-75e9e931-1955-4d82-a36e-c4cf2404087d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:27:32.976941 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e9e931-1955-4d82-a36e-c4cf2404087d None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:32.980488 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da199525-92b0-4d10-8bfd-469cbc2a26f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:32.981089 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da199525-92b0-4d10-8bfd-469cbc2a26f0 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:32.981912 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da199525-92b0-4d10-8bfd-469cbc2a26f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:32.982316 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da199525-92b0-4d10-8bfd-469cbc2a26f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:32.984279 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-da199525-92b0-4d10-8bfd-469cbc2a26f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:27:32.996071 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da199525-92b0-4d10-8bfd-469cbc2a26f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:32.998548 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da199525-92b0-4d10-8bfd-469cbc2a26f0 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:33.009077 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4383/8745] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:27:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:27:33.326708 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162bfe9-a7cd-4211-acbe-e3e4f612f62b None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:33.327288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162bfe9-a7cd-4211-acbe-e3e4f612f62b None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:33.327639 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162bfe9-a7cd-4211-acbe-e3e4f612f62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:33.375646 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-2162bfe9-a7cd-4211-acbe-e3e4f612f62b None None] MFA Rules not processed for user `c190fa4a280c41c684130e069bee99eb`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:27:33.376873 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2162bfe9-a7cd-4211-acbe-e3e4f612f62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:27:33.449820 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4363/8746] 10.222.0.83 () {58 vars in 1018 bytes} [Mon Aug 29 16:27:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:27:33.463014 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da199525-92b0-4d10-8bfd-469cbc2a26f0 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:33.464508 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-da199525-92b0-4d10-8bfd-469cbc2a26f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:27:33.482894 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da199525-92b0-4d10-8bfd-469cbc2a26f0 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:33.488076 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188f34d-982e-4e3e-bbb5-ff9c1a680c6e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:33.488675 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188f34d-982e-4e3e-bbb5-ff9c1a680c6e service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:33.488956 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188f34d-982e-4e3e-bbb5-ff9c1a680c6e service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:33.489229 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188f34d-982e-4e3e-bbb5-ff9c1a680c6e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:33.495549 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:27:33.498439 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0188f34d-982e-4e3e-bbb5-ff9c1a680c6e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:33.500486 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0188f34d-982e-4e3e-bbb5-ff9c1a680c6e service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:33.511113 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4384/8747] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:27:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:27:35.982088 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2162bfe9-a7cd-4211-acbe-e3e4f612f62b None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:35.992096 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2162bfe9-a7cd-4211-acbe-e3e4f612f62b None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:35.995907 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64bbb8-5336-458c-bba9-46ea04035ff1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:35.996525 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64bbb8-5336-458c-bba9-46ea04035ff1 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:35.996809 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64bbb8-5336-458c-bba9-46ea04035ff1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:35.997631 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64bbb8-5336-458c-bba9-46ea04035ff1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:35.999482 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2b64bbb8-5336-458c-bba9-46ea04035ff1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:27:36.012264 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b64bbb8-5336-458c-bba9-46ea04035ff1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:36.013717 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b64bbb8-5336-458c-bba9-46ea04035ff1 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:36.024551 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4364/8748] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:27:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:27:40.203653 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2724833-2806-474e-8dc5-dea2b9167418 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:40.204186 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2724833-2806-474e-8dc5-dea2b9167418 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:40.204186 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2724833-2806-474e-8dc5-dea2b9167418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:40.224846 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-c2724833-2806-474e-8dc5-dea2b9167418 None None] MFA Rules not processed for user `616303b5564840e3bb07d4c9c22c2049`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:27:40.226045 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c2724833-2806-474e-8dc5-dea2b9167418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:27:40.233563 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4385/8749] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:27:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:27:40.566353 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64bbb8-5336-458c-bba9-46ea04035ff1 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:40.575624 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64bbb8-5336-458c-bba9-46ea04035ff1 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:40.580720 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74353376-2820-46ac-b46b-eae258f3ecac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:40.581471 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74353376-2820-46ac-b46b-eae258f3ecac service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:40.581855 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74353376-2820-46ac-b46b-eae258f3ecac service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:40.582234 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74353376-2820-46ac-b46b-eae258f3ecac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:40.584173 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-74353376-2820-46ac-b46b-eae258f3ecac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:27:40.597818 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74353376-2820-46ac-b46b-eae258f3ecac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:40.599324 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74353376-2820-46ac-b46b-eae258f3ecac service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:40.611351 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4365/8750] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:27:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:27:41.074720 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f8fb5-b0e3-41d3-ba7c-a22077cd09d3 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:41.075012 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f8fb5-b0e3-41d3-ba7c-a22077cd09d3 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:41.075335 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f8fb5-b0e3-41d3-ba7c-a22077cd09d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:41.096914 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-d59f8fb5-b0e3-41d3-ba7c-a22077cd09d3 None None] MFA Rules not processed for user `c190fa4a280c41c684130e069bee99eb`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:27:41.098111 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d59f8fb5-b0e3-41d3-ba7c-a22077cd09d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:27:41.106681 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4386/8751] 10.222.0.83 () {58 vars in 1018 bytes} [Mon Aug 29 16:27:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:27:41.118427 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74353376-2820-46ac-b46b-eae258f3ecac service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:41.134103 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74353376-2820-46ac-b46b-eae258f3ecac service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:41.139794 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c57a5-da9e-4fd0-ba01-25ae2d8d9140 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:41.140400 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c57a5-da9e-4fd0-ba01-25ae2d8d9140 service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:41.140681 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c57a5-da9e-4fd0-ba01-25ae2d8d9140 service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:41.140953 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c57a5-da9e-4fd0-ba01-25ae2d8d9140 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:41.149799 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c57a5-da9e-4fd0-ba01-25ae2d8d9140 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:41.151440 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c57a5-da9e-4fd0-ba01-25ae2d8d9140 service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:41.162180 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4366/8752] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:27:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:27:42.039461 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f8fb5-b0e3-41d3-ba7c-a22077cd09d3 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:42.057328 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f8fb5-b0e3-41d3-ba7c-a22077cd09d3 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:42.064368 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1061b30-1073-4244-9bfb-5523570d068f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:42.065127 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1061b30-1073-4244-9bfb-5523570d068f service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:42.065467 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1061b30-1073-4244-9bfb-5523570d068f service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:42.065805 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1061b30-1073-4244-9bfb-5523570d068f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:42.067896 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c1061b30-1073-4244-9bfb-5523570d068f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:27:42.089694 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1061b30-1073-4244-9bfb-5523570d068f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:42.091470 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1061b30-1073-4244-9bfb-5523570d068f service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:42.113051 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4387/8753] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:27:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:27:51.158215 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=61 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:27:52.098668 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=14 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:27:57.701822 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c57a5-da9e-4fd0-ba01-25ae2d8d9140 service placement] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:57.773465 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c57a5-da9e-4fd0-ba01-25ae2d8d9140 service placement] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:57.778392 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea52a0aa-8f39-4117-8207-372004ebc661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:57.779046 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52a0aa-8f39-4117-8207-372004ebc661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:57.779338 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52a0aa-8f39-4117-8207-372004ebc661 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:57.779645 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52a0aa-8f39-4117-8207-372004ebc661 admin admin] PATH_INFO: `/v3/users/75ce0c0a463b435690258f9b9958b3de` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:57.781252 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea52a0aa-8f39-4117-8207-372004ebc661 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75ce0c0a463b435690258f9b9958b3de)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:57.783320 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea52a0aa-8f39-4117-8207-372004ebc661 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:57.832947 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ea52a0aa-8f39-4117-8207-372004ebc661 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75ce0c0a463b435690258f9b9958b3de'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:27:57.833829 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ea52a0aa-8f39-4117-8207-372004ebc661 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75ce0c0a463b435690258f9b9958b3de'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:27:57.846256 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ea52a0aa-8f39-4117-8207-372004ebc661 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75ce0c0a463b435690258f9b9958b3de'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:27:57.854771 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ea52a0aa-8f39-4117-8207-372004ebc661 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75ce0c0a463b435690258f9b9958b3de'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:27:57.863507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ea52a0aa-8f39-4117-8207-372004ebc661 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75ce0c0a463b435690258f9b9958b3de'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:27:57.871188 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4367/8754] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:27:57 2022] DELETE /identity/v3/users/75ce0c0a463b435690258f9b9958b3de => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:27:58.052651 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1061b30-1073-4244-9bfb-5523570d068f service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:58.064373 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1061b30-1073-4244-9bfb-5523570d068f service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:58.124048 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb1a88-9750-48f8-bb88-cc429a90f87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:58.125610 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb1a88-9750-48f8-bb88-cc429a90f87c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:58.126106 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb1a88-9750-48f8-bb88-cc429a90f87c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:58.126551 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb1a88-9750-48f8-bb88-cc429a90f87c admin admin] PATH_INFO: `/v3/projects/3a00d97a45164577a2e90b6083515f3a` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:58.131596 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb1a88-9750-48f8-bb88-cc429a90f87c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a00d97a45164577a2e90b6083515f3a)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:58.134489 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb1a88-9750-48f8-bb88-cc429a90f87c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:58.186702 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f6eb1a88-9750-48f8-bb88-cc429a90f87c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a00d97a45164577a2e90b6083515f3a', 'request_id': 'req-f6eb1a88-9750-48f8-bb88-cc429a90f87c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:27:58.193528 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f6eb1a88-9750-48f8-bb88-cc429a90f87c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a00d97a45164577a2e90b6083515f3a', 'request_id': 'req-f6eb1a88-9750-48f8-bb88-cc429a90f87c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:27:58.199749 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f6eb1a88-9750-48f8-bb88-cc429a90f87c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a00d97a45164577a2e90b6083515f3a', 'request_id': 'req-f6eb1a88-9750-48f8-bb88-cc429a90f87c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:27:58.212845 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f6eb1a88-9750-48f8-bb88-cc429a90f87c admin admin] The token cache is being invalidate because project 3a00d97a45164577a2e90b6083515f3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:27:58.213130 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f6eb1a88-9750-48f8-bb88-cc429a90f87c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:27:58.213762 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f6eb1a88-9750-48f8-bb88-cc429a90f87c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:27:58.215351 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4388/8755] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:27:58 2022] DELETE /identity/v3/projects/3a00d97a45164577a2e90b6083515f3a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:27:58.219474 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea52a0aa-8f39-4117-8207-372004ebc661 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:58.220965 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ea52a0aa-8f39-4117-8207-372004ebc661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:27:58.234747 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea52a0aa-8f39-4117-8207-372004ebc661 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:58.291097 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a297c09b-c607-4402-92c2-34aab7198c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:58.291734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297c09b-c607-4402-92c2-34aab7198c97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:58.292011 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297c09b-c607-4402-92c2-34aab7198c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:58.292281 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297c09b-c607-4402-92c2-34aab7198c97 admin admin] PATH_INFO: `/v3/users/c08afedc0e9346ccaa6fd7884048ab14` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:58.293406 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a297c09b-c607-4402-92c2-34aab7198c97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c08afedc0e9346ccaa6fd7884048ab14)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:58.295368 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a297c09b-c607-4402-92c2-34aab7198c97 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:58.319215 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:27:58.348651 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a297c09b-c607-4402-92c2-34aab7198c97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c08afedc0e9346ccaa6fd7884048ab14'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:27:58.349244 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a297c09b-c607-4402-92c2-34aab7198c97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c08afedc0e9346ccaa6fd7884048ab14'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:27:58.363866 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a297c09b-c607-4402-92c2-34aab7198c97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c08afedc0e9346ccaa6fd7884048ab14'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:27:58.372012 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a297c09b-c607-4402-92c2-34aab7198c97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c08afedc0e9346ccaa6fd7884048ab14'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:27:58.381564 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a297c09b-c607-4402-92c2-34aab7198c97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c08afedc0e9346ccaa6fd7884048ab14'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:27:58.387713 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4368/8756] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:27:58 2022] DELETE /identity/v3/users/c08afedc0e9346ccaa6fd7884048ab14 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:27:58.574196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb1a88-9750-48f8-bb88-cc429a90f87c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:58.575959 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f6eb1a88-9750-48f8-bb88-cc429a90f87c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:27:58.590327 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb1a88-9750-48f8-bb88-cc429a90f87c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:58.650148 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185f765-24b8-4682-bb69-cbb45f4d772b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:58.650809 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185f765-24b8-4682-bb69-cbb45f4d772b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:58.651117 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185f765-24b8-4682-bb69-cbb45f4d772b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:58.651391 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185f765-24b8-4682-bb69-cbb45f4d772b admin admin] PATH_INFO: `/v3/projects/9359710623f44f49bde656447cca1df0` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:58.652503 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9185f765-24b8-4682-bb69-cbb45f4d772b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9359710623f44f49bde656447cca1df0)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:58.654421 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9185f765-24b8-4682-bb69-cbb45f4d772b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:58.689924 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:27:58.704548 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9185f765-24b8-4682-bb69-cbb45f4d772b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9359710623f44f49bde656447cca1df0', 'request_id': 'req-9185f765-24b8-4682-bb69-cbb45f4d772b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:27:58.710365 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9185f765-24b8-4682-bb69-cbb45f4d772b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9359710623f44f49bde656447cca1df0', 'request_id': 'req-9185f765-24b8-4682-bb69-cbb45f4d772b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:27:58.716706 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9185f765-24b8-4682-bb69-cbb45f4d772b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9359710623f44f49bde656447cca1df0', 'request_id': 'req-9185f765-24b8-4682-bb69-cbb45f4d772b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:27:58.733614 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9185f765-24b8-4682-bb69-cbb45f4d772b admin admin] The token cache is being invalidate because project 9359710623f44f49bde656447cca1df0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:27:58.733973 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9185f765-24b8-4682-bb69-cbb45f4d772b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:27:58.734831 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-9185f765-24b8-4682-bb69-cbb45f4d772b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:27:58.736648 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4389/8757] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:27:58 2022] DELETE /identity/v3/projects/9359710623f44f49bde656447cca1df0 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:27:59.321264 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a297c09b-c607-4402-92c2-34aab7198c97 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:59.322983 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a297c09b-c607-4402-92c2-34aab7198c97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:27:59.386034 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a297c09b-c607-4402-92c2-34aab7198c97 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:59.434989 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3cd33-74cd-41ec-adbb-b12d0b865f4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:59.435634 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3cd33-74cd-41ec-adbb-b12d0b865f4b service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:59.435913 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3cd33-74cd-41ec-adbb-b12d0b865f4b service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:59.436188 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3cd33-74cd-41ec-adbb-b12d0b865f4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:59.438167 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5ad3cd33-74cd-41ec-adbb-b12d0b865f4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:27:59.502070 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad3cd33-74cd-41ec-adbb-b12d0b865f4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:59.503436 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad3cd33-74cd-41ec-adbb-b12d0b865f4b service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:59.513311 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4369/8758] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:27:59 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:28:01.099907 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185f765-24b8-4682-bb69-cbb45f4d772b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:28:01.101332 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9185f765-24b8-4682-bb69-cbb45f4d772b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:28:01.216321 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185f765-24b8-4682-bb69-cbb45f4d772b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:28:01.221951 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9fb98a-8e98-416c-a3ab-fd47d18218cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:28:01.222594 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fb98a-8e98-416c-a3ab-fd47d18218cf service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:28:01.222871 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fb98a-8e98-416c-a3ab-fd47d18218cf service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:28:01.223190 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fb98a-8e98-416c-a3ab-fd47d18218cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:28:01.224977 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6f9fb98a-8e98-416c-a3ab-fd47d18218cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:28:01.241645 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9fb98a-8e98-416c-a3ab-fd47d18218cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:28:01.243285 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9fb98a-8e98-416c-a3ab-fd47d18218cf service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:28:01.257469 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4390/8759] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:28:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:28:09.508864 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:28:11.249501 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=58,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:29:27.982887 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3cd33-74cd-41ec-adbb-b12d0b865f4b service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:29:27.984281 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5ad3cd33-74cd-41ec-adbb-b12d0b865f4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:29:27.995542 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3cd33-74cd-41ec-adbb-b12d0b865f4b service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:29:27.999207 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8ff34-ac4f-495c-98b5-d27055be3dbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:29:27.999808 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8ff34-ac4f-495c-98b5-d27055be3dbd service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:29:28.000090 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8ff34-ac4f-495c-98b5-d27055be3dbd service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:29:28.000365 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8ff34-ac4f-495c-98b5-d27055be3dbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:29:28.002053 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a4b8ff34-ac4f-495c-98b5-d27055be3dbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:29:28.014067 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8ff34-ac4f-495c-98b5-d27055be3dbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:29:28.015544 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8ff34-ac4f-495c-98b5-d27055be3dbd service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:29:28.025982 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4370/8760] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:29:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:29:38.019943 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=6 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:29:51.365834 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa248f-774a-44b3-8fe8-37349599385c None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:29:51.366351 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa248f-774a-44b3-8fe8-37349599385c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:29:51.366443 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa248f-774a-44b3-8fe8-37349599385c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:29:51.386647 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a2aa248f-774a-44b3-8fe8-37349599385c None None] MFA Rules not processed for user `616303b5564840e3bb07d4c9c22c2049`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:29:51.387874 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a2aa248f-774a-44b3-8fe8-37349599385c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:29:51.442156 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4391/8761] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:29:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:30:01.435526 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=25 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:31:22.202956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8ff34-ac4f-495c-98b5-d27055be3dbd service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:31:22.204400 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a4b8ff34-ac4f-495c-98b5-d27055be3dbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:31:22.286280 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8ff34-ac4f-495c-98b5-d27055be3dbd service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:31:22.292348 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b8482-cd39-4d55-b37f-bde471473f39 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:31:22.292958 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b8482-cd39-4d55-b37f-bde471473f39 service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:31:22.293238 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b8482-cd39-4d55-b37f-bde471473f39 service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:31:22.293513 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b8482-cd39-4d55-b37f-bde471473f39 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:31:22.295276 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-909b8482-cd39-4d55-b37f-bde471473f39 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:31:22.309536 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b8482-cd39-4d55-b37f-bde471473f39 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:31:22.311155 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b8482-cd39-4d55-b37f-bde471473f39 service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:31:22.323910 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4371/8762] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:31:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:31:32.316918 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=36 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:31:42.233404 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa248f-774a-44b3-8fe8-37349599385c None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:31:42.234818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a2aa248f-774a-44b3-8fe8-37349599385c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:31:42.253232 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa248f-774a-44b3-8fe8-37349599385c None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:31:42.258419 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf90d5-5e61-4e76-b310-cb636974c1e1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:31:42.259361 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf90d5-5e61-4e76-b310-cb636974c1e1 service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:31:42.259599 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf90d5-5e61-4e76-b310-cb636974c1e1 service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:31:42.259765 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf90d5-5e61-4e76-b310-cb636974c1e1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:31:42.261520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-09cf90d5-5e61-4e76-b310-cb636974c1e1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:31:42.276457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf90d5-5e61-4e76-b310-cb636974c1e1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:31:42.278061 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf90d5-5e61-4e76-b310-cb636974c1e1 service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:31:42.291709 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4392/8763] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:31:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:31:42.708140 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b8482-cd39-4d55-b37f-bde471473f39 service placement] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:31:42.718212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b8482-cd39-4d55-b37f-bde471473f39 service placement] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:31:42.721829 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5a4dc-c20c-4d75-95d9-735c93b4b8bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:31:42.722424 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5a4dc-c20c-4d75-95d9-735c93b4b8bd service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:31:42.722699 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5a4dc-c20c-4d75-95d9-735c93b4b8bd service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:31:42.722965 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5a4dc-c20c-4d75-95d9-735c93b4b8bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:31:42.724691 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b3b5a4dc-c20c-4d75-95d9-735c93b4b8bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:31:42.742615 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5a4dc-c20c-4d75-95d9-735c93b4b8bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:31:42.744271 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5a4dc-c20c-4d75-95d9-735c93b4b8bd service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:31:42.759648 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4372/8764] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:31:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:31:43.946059 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf90d5-5e61-4e76-b310-cb636974c1e1 service placement] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:31:43.948814 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-09cf90d5-5e61-4e76-b310-cb636974c1e1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:31:43.960090 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf90d5-5e61-4e76-b310-cb636974c1e1 service placement] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:31:43.964659 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad5e43-5b94-4f5b-849d-335c0a321292 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:31:43.965258 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad5e43-5b94-4f5b-849d-335c0a321292 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:31:43.965540 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad5e43-5b94-4f5b-849d-335c0a321292 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:31:43.965813 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad5e43-5b94-4f5b-849d-335c0a321292 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:31:43.967540 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d2ad5e43-5b94-4f5b-849d-335c0a321292 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:31:43.983367 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad5e43-5b94-4f5b-849d-335c0a321292 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:31:43.984791 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad5e43-5b94-4f5b-849d-335c0a321292 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:31:44.001262 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4393/8765] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:31:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:31:52.753236 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=6 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:31:53.991047 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=12 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:31:59.154732 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5a4dc-c20c-4d75-95d9-735c93b4b8bd service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:31:59.169624 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5a4dc-c20c-4d75-95d9-735c93b4b8bd service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:31:59.176165 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bfea57-2404-464f-ba9f-a7fe1a0d0ba0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:31:59.176787 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bfea57-2404-464f-ba9f-a7fe1a0d0ba0 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:31:59.177068 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bfea57-2404-464f-ba9f-a7fe1a0d0ba0 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:31:59.177343 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bfea57-2404-464f-ba9f-a7fe1a0d0ba0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:31:59.179344 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-89bfea57-2404-464f-ba9f-a7fe1a0d0ba0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:31:59.195870 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bfea57-2404-464f-ba9f-a7fe1a0d0ba0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:31:59.198518 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bfea57-2404-464f-ba9f-a7fe1a0d0ba0 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:31:59.216699 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4373/8766] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:31:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:32:07.974506 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad5e43-5b94-4f5b-849d-335c0a321292 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:07.985309 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad5e43-5b94-4f5b-849d-335c0a321292 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:07.991740 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d9d15-8b64-490c-b4ea-3bd7a870363a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:07.992843 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d9d15-8b64-490c-b4ea-3bd7a870363a service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:07.993843 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d9d15-8b64-490c-b4ea-3bd7a870363a service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:07.994449 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d9d15-8b64-490c-b4ea-3bd7a870363a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:07.996540 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a30d9d15-8b64-490c-b4ea-3bd7a870363a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:32:08.070330 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30d9d15-8b64-490c-b4ea-3bd7a870363a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:08.071945 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30d9d15-8b64-490c-b4ea-3bd7a870363a service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:08.082659 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4394/8767] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:32:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:32:09.205189 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=6 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:11.327876 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bfea57-2404-464f-ba9f-a7fe1a0d0ba0 service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:11.354755 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bfea57-2404-464f-ba9f-a7fe1a0d0ba0 service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:11.362250 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21703d74-6929-4596-97bf-edd424e1c5f0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:11.363122 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21703d74-6929-4596-97bf-edd424e1c5f0 service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:11.363767 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21703d74-6929-4596-97bf-edd424e1c5f0 service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:11.363900 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21703d74-6929-4596-97bf-edd424e1c5f0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:11.365908 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-21703d74-6929-4596-97bf-edd424e1c5f0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:32:11.386498 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21703d74-6929-4596-97bf-edd424e1c5f0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:11.388530 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21703d74-6929-4596-97bf-edd424e1c5f0 service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:11.417207 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4374/8768] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:32:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:32:14.638394 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d9d15-8b64-490c-b4ea-3bd7a870363a service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:14.640545 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a30d9d15-8b64-490c-b4ea-3bd7a870363a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:32:14.653863 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d9d15-8b64-490c-b4ea-3bd7a870363a service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:14.658619 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f8f29f-80c7-41ad-a6c5-899df3f91673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:14.659297 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8f29f-80c7-41ad-a6c5-899df3f91673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:14.659581 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8f29f-80c7-41ad-a6c5-899df3f91673 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:14.659883 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8f29f-80c7-41ad-a6c5-899df3f91673 admin admin] PATH_INFO: `/v3/users/616303b5564840e3bb07d4c9c22c2049` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:14.674734 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f8f29f-80c7-41ad-a6c5-899df3f91673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=616303b5564840e3bb07d4c9c22c2049)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:14.676729 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f8f29f-80c7-41ad-a6c5-899df3f91673 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:14.725697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-86f8f29f-80c7-41ad-a6c5-899df3f91673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '616303b5564840e3bb07d4c9c22c2049'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:14.726379 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-86f8f29f-80c7-41ad-a6c5-899df3f91673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '616303b5564840e3bb07d4c9c22c2049'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:14.734477 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-86f8f29f-80c7-41ad-a6c5-899df3f91673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '616303b5564840e3bb07d4c9c22c2049'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:14.741610 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-86f8f29f-80c7-41ad-a6c5-899df3f91673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '616303b5564840e3bb07d4c9c22c2049'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:14.742221 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-86f8f29f-80c7-41ad-a6c5-899df3f91673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '616303b5564840e3bb07d4c9c22c2049'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:14.760821 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4395/8769] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:32:14 2022] DELETE /identity/v3/users/616303b5564840e3bb07d4c9c22c2049 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:32:14.937845 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21703d74-6929-4596-97bf-edd424e1c5f0 service placement] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:14.949303 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21703d74-6929-4596-97bf-edd424e1c5f0 service placement] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:15.013341 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7d1a3-e94d-41cd-96ff-f7f7063f6ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:15.013998 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7d1a3-e94d-41cd-96ff-f7f7063f6ae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:15.014281 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7d1a3-e94d-41cd-96ff-f7f7063f6ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:15.014556 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7d1a3-e94d-41cd-96ff-f7f7063f6ae4 admin admin] PATH_INFO: `/v3/projects/3e4f468e4b694771b47f56110a9ed798` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:15.026684 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae7d1a3-e94d-41cd-96ff-f7f7063f6ae4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e4f468e4b694771b47f56110a9ed798)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:15.028658 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae7d1a3-e94d-41cd-96ff-f7f7063f6ae4 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:15.074874 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3ae7d1a3-e94d-41cd-96ff-f7f7063f6ae4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e4f468e4b694771b47f56110a9ed798', 'request_id': 'req-3ae7d1a3-e94d-41cd-96ff-f7f7063f6ae4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:15.080525 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3ae7d1a3-e94d-41cd-96ff-f7f7063f6ae4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e4f468e4b694771b47f56110a9ed798', 'request_id': 'req-3ae7d1a3-e94d-41cd-96ff-f7f7063f6ae4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:15.088688 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3ae7d1a3-e94d-41cd-96ff-f7f7063f6ae4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e4f468e4b694771b47f56110a9ed798', 'request_id': 'req-3ae7d1a3-e94d-41cd-96ff-f7f7063f6ae4'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:15.100692 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3ae7d1a3-e94d-41cd-96ff-f7f7063f6ae4 admin admin] The token cache is being invalidate because project 3e4f468e4b694771b47f56110a9ed798 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:32:15.100692 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3ae7d1a3-e94d-41cd-96ff-f7f7063f6ae4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:15.101729 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3ae7d1a3-e94d-41cd-96ff-f7f7063f6ae4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:15.104337 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4375/8770] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:32:14 2022] DELETE /identity/v3/projects/3e4f468e4b694771b47f56110a9ed798 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:32:15.108426 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f8f29f-80c7-41ad-a6c5-899df3f91673 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:15.109919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-86f8f29f-80c7-41ad-a6c5-899df3f91673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:32:15.123403 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f8f29f-80c7-41ad-a6c5-899df3f91673 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:15.174817 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:15.182525 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07bf031-5a2a-4e6c-a71a-066569000575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:15.183214 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07bf031-5a2a-4e6c-a71a-066569000575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:15.183930 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07bf031-5a2a-4e6c-a71a-066569000575 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:15.184224 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07bf031-5a2a-4e6c-a71a-066569000575 admin admin] PATH_INFO: `/v3/users/75438d3173174cbe8fd050148fb8c764` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:15.199917 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07bf031-5a2a-4e6c-a71a-066569000575 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75438d3173174cbe8fd050148fb8c764)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:15.201867 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07bf031-5a2a-4e6c-a71a-066569000575 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:15.247381 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f07bf031-5a2a-4e6c-a71a-066569000575 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75438d3173174cbe8fd050148fb8c764'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:15.248052 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f07bf031-5a2a-4e6c-a71a-066569000575 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75438d3173174cbe8fd050148fb8c764'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:15.257658 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f07bf031-5a2a-4e6c-a71a-066569000575 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75438d3173174cbe8fd050148fb8c764'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:15.265796 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f07bf031-5a2a-4e6c-a71a-066569000575 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75438d3173174cbe8fd050148fb8c764'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:15.266468 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-f07bf031-5a2a-4e6c-a71a-066569000575 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75438d3173174cbe8fd050148fb8c764'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:15.284439 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4396/8771] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:32:15 2022] DELETE /identity/v3/users/75438d3173174cbe8fd050148fb8c764 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:32:15.453700 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7d1a3-e94d-41cd-96ff-f7f7063f6ae4 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:15.455319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3ae7d1a3-e94d-41cd-96ff-f7f7063f6ae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:32:15.470270 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7d1a3-e94d-41cd-96ff-f7f7063f6ae4 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:15.529580 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39520ebb-d799-4974-8ee4-3724ea1313b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:15.530224 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39520ebb-d799-4974-8ee4-3724ea1313b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:15.530503 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39520ebb-d799-4974-8ee4-3724ea1313b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:15.530777 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39520ebb-d799-4974-8ee4-3724ea1313b5 admin admin] PATH_INFO: `/v3/projects/2844a4b0a0794140aac9ac2df848b2e7` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:15.542367 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39520ebb-d799-4974-8ee4-3724ea1313b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2844a4b0a0794140aac9ac2df848b2e7)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:15.544204 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39520ebb-d799-4974-8ee4-3724ea1313b5 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:15.545599 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:15.592558 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-39520ebb-d799-4974-8ee4-3724ea1313b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2844a4b0a0794140aac9ac2df848b2e7', 'request_id': 'req-39520ebb-d799-4974-8ee4-3724ea1313b5'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:15.598257 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-39520ebb-d799-4974-8ee4-3724ea1313b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2844a4b0a0794140aac9ac2df848b2e7', 'request_id': 'req-39520ebb-d799-4974-8ee4-3724ea1313b5'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:15.606419 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-39520ebb-d799-4974-8ee4-3724ea1313b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2844a4b0a0794140aac9ac2df848b2e7', 'request_id': 'req-39520ebb-d799-4974-8ee4-3724ea1313b5'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:15.618140 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-39520ebb-d799-4974-8ee4-3724ea1313b5 admin admin] The token cache is being invalidate because project 2844a4b0a0794140aac9ac2df848b2e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:32:15.618427 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-39520ebb-d799-4974-8ee4-3724ea1313b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:15.619196 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-39520ebb-d799-4974-8ee4-3724ea1313b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:15.620714 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4376/8772] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:32:15 2022] DELETE /identity/v3/projects/2844a4b0a0794140aac9ac2df848b2e7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:32:24.967666 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ab450-3580-45b1-a812-5dfcc6eaebb8 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:24.968183 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ab450-3580-45b1-a812-5dfcc6eaebb8 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:24.968183 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ab450-3580-45b1-a812-5dfcc6eaebb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:24.987699 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-987ab450-3580-45b1-a812-5dfcc6eaebb8 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:32:24.988899 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-987ab450-3580-45b1-a812-5dfcc6eaebb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:32:25.049180 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4397/8773] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:32:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:32:25.058674 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754d06e-baa7-4f7e-a655-416e3b91fec4 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:25.059199 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754d06e-baa7-4f7e-a655-416e3b91fec4 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:25.059301 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754d06e-baa7-4f7e-a655-416e3b91fec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:25.079480 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-0754d06e-baa7-4f7e-a655-416e3b91fec4 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:32:25.080737 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0754d06e-baa7-4f7e-a655-416e3b91fec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:32:25.089564 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4377/8774] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:32:25.094251 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ab450-3580-45b1-a812-5dfcc6eaebb8 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:25.104186 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ab450-3580-45b1-a812-5dfcc6eaebb8 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:25.108739 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0882346d-f56c-4930-8eec-049e2b7825a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:25.109337 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882346d-f56c-4930-8eec-049e2b7825a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:25.109616 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882346d-f56c-4930-8eec-049e2b7825a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:25.109886 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882346d-f56c-4930-8eec-049e2b7825a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:25.110531 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0882346d-f56c-4930-8eec-049e2b7825a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:32:25.110831 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0882346d-f56c-4930-8eec-049e2b7825a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:25.112474 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0882346d-f56c-4930-8eec-049e2b7825a9 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:25.124144 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4398/8775] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:32:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:32:25.132650 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754d06e-baa7-4f7e-a655-416e3b91fec4 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:25.142969 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754d06e-baa7-4f7e-a655-416e3b91fec4 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:25.147736 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7ed77-04fd-4e6c-990d-e9526992c7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:25.148346 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7ed77-04fd-4e6c-990d-e9526992c7bc admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:25.148625 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7ed77-04fd-4e6c-990d-e9526992c7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:25.148896 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7ed77-04fd-4e6c-990d-e9526992c7bc admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:25.150379 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7ed77-04fd-4e6c-990d-e9526992c7bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:25.152389 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7ed77-04fd-4e6c-990d-e9526992c7bc admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:25.189050 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4378/8776] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:32:25 2022] POST /identity/v3/projects => generated 391 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:32:25.193357 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0882346d-f56c-4930-8eec-049e2b7825a9 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:25.205386 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0882346d-f56c-4930-8eec-049e2b7825a9 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:25.252662 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:25.264729 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a70397c-43df-4133-b7fd-568638390c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:25.265352 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70397c-43df-4133-b7fd-568638390c8a admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:25.265612 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70397c-43df-4133-b7fd-568638390c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:25.265883 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70397c-43df-4133-b7fd-568638390c8a admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:25.266517 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a70397c-43df-4133-b7fd-568638390c8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:25.268464 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a70397c-43df-4133-b7fd-568638390c8a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:25.290472 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4399/8777] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:32:25 2022] POST /identity/v3/users => generated 296 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:32:25.294617 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7ed77-04fd-4e6c-990d-e9526992c7bc admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:25.304965 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7ed77-04fd-4e6c-990d-e9526992c7bc admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:25.310161 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589e04b-2164-41d6-940e-08e265b6023d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:25.310758 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589e04b-2164-41d6-940e-08e265b6023d admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:25.311059 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589e04b-2164-41d6-940e-08e265b6023d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:25.311337 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589e04b-2164-41d6-940e-08e265b6023d admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:25.311989 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2589e04b-2164-41d6-940e-08e265b6023d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:25.313571 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2589e04b-2164-41d6-940e-08e265b6023d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:25.324894 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4379/8778] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:32:25.328635 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a70397c-43df-4133-b7fd-568638390c8a admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:25.338684 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a70397c-43df-4133-b7fd-568638390c8a admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:25.343293 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8f38f-b7a3-44a5-a376-34f7a04defe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:25.343890 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8f38f-b7a3-44a5-a376-34f7a04defe8 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:25.344168 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8f38f-b7a3-44a5-a376-34f7a04defe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:25.344440 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8f38f-b7a3-44a5-a376-34f7a04defe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:25.345082 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de8f38f-b7a3-44a5-a376-34f7a04defe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:25.346673 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de8f38f-b7a3-44a5-a376-34f7a04defe8 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:25.357440 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4400/8779] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:32:25.361569 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589e04b-2164-41d6-940e-08e265b6023d admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:25.372334 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589e04b-2164-41d6-940e-08e265b6023d admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:25.377224 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876dd35-b504-4512-83b9-0665f490b5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:25.377875 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876dd35-b504-4512-83b9-0665f490b5da admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:25.378157 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876dd35-b504-4512-83b9-0665f490b5da admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:25.378432 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876dd35-b504-4512-83b9-0665f490b5da admin admin] PATH_INFO: `/v3/projects/30da8aecfbd64d1b9b6516c51d133d9f/users/7ec5f550e4dc42ed9b7de24a22259cfd/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:25.395337 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1876dd35-b504-4512-83b9-0665f490b5da admin admin] RBAC: Authorizing `identity:create_grant(project_id=30da8aecfbd64d1b9b6516c51d133d9f, user_id=7ec5f550e4dc42ed9b7de24a22259cfd, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:25.397991 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1876dd35-b504-4512-83b9-0665f490b5da admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:25.410972 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4380/8780] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:32:25 2022] PUT /identity/v3/projects/30da8aecfbd64d1b9b6516c51d133d9f/users/7ec5f550e4dc42ed9b7de24a22259cfd/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:32:25.424360 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1b5f2-d35b-4e2c-bd77-4cbbe1537503 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:25.424640 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1b5f2-d35b-4e2c-bd77-4cbbe1537503 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:25.424935 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1b5f2-d35b-4e2c-bd77-4cbbe1537503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:25.453628 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-75b1b5f2-d35b-4e2c-bd77-4cbbe1537503 None None] MFA Rules not processed for user `7ec5f550e4dc42ed9b7de24a22259cfd`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:32:25.454806 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-75b1b5f2-d35b-4e2c-bd77-4cbbe1537503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:32:25.521238 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4401/8781] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:32:25 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:32:25.525784 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876dd35-b504-4512-83b9-0665f490b5da admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:25.588043 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876dd35-b504-4512-83b9-0665f490b5da admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:25.592842 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b3a46-6c8c-49cf-8d9a-2650e9c2f0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:25.593449 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b3a46-6c8c-49cf-8d9a-2650e9c2f0e4 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:25.593732 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b3a46-6c8c-49cf-8d9a-2650e9c2f0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:25.594005 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b3a46-6c8c-49cf-8d9a-2650e9c2f0e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:25.594645 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593b3a46-6c8c-49cf-8d9a-2650e9c2f0e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:25.596605 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593b3a46-6c8c-49cf-8d9a-2650e9c2f0e4 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:25.624489 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4381/8782] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:32:25 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:32:25.628646 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b1b5f2-d35b-4e2c-bd77-4cbbe1537503 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:25.641770 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b1b5f2-d35b-4e2c-bd77-4cbbe1537503 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:25.699687 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a24a49-6628-47e7-8cbc-6f6989be7b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:25.700308 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a24a49-6628-47e7-8cbc-6f6989be7b95 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:25.700586 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a24a49-6628-47e7-8cbc-6f6989be7b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:25.700856 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a24a49-6628-47e7-8cbc-6f6989be7b95 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:25.701484 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a24a49-6628-47e7-8cbc-6f6989be7b95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:25.703443 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a24a49-6628-47e7-8cbc-6f6989be7b95 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:25.724777 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4402/8783] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:32:25 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:32:25.729860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b3a46-6c8c-49cf-8d9a-2650e9c2f0e4 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:25.735446 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:25.741850 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b3a46-6c8c-49cf-8d9a-2650e9c2f0e4 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:25.748417 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430a6f6-f5ac-480b-8c5b-7da1262facfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:25.749020 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430a6f6-f5ac-480b-8c5b-7da1262facfe admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:25.749303 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430a6f6-f5ac-480b-8c5b-7da1262facfe admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:25.749582 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430a6f6-f5ac-480b-8c5b-7da1262facfe admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:25.750233 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c430a6f6-f5ac-480b-8c5b-7da1262facfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:25.751903 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c430a6f6-f5ac-480b-8c5b-7da1262facfe admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:25.763046 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4382/8784] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:32:25.767249 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a24a49-6628-47e7-8cbc-6f6989be7b95 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:25.777722 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a24a49-6628-47e7-8cbc-6f6989be7b95 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:25.782283 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f3ace-8f53-488d-b139-f5f4b2b8b056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:25.782939 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f3ace-8f53-488d-b139-f5f4b2b8b056 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:25.783249 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f3ace-8f53-488d-b139-f5f4b2b8b056 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:25.783526 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f3ace-8f53-488d-b139-f5f4b2b8b056 admin admin] PATH_INFO: `/v3/projects/6d98629c1b6e4c47a74fa2d6da83f47e/users/873ca821b87f41eda08246e7a98432b6/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:25.798790 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f3ace-8f53-488d-b139-f5f4b2b8b056 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d98629c1b6e4c47a74fa2d6da83f47e, user_id=873ca821b87f41eda08246e7a98432b6, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:25.801497 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f3ace-8f53-488d-b139-f5f4b2b8b056 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:25.816130 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4403/8785] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:32:25 2022] PUT /identity/v3/projects/6d98629c1b6e4c47a74fa2d6da83f47e/users/873ca821b87f41eda08246e7a98432b6/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:32:25.820185 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430a6f6-f5ac-480b-8c5b-7da1262facfe admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:25.830707 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430a6f6-f5ac-480b-8c5b-7da1262facfe admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:25.886864 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6a472-9095-4be8-b487-c27ac31e78ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:25.887503 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6a472-9095-4be8-b487-c27ac31e78ca admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:25.887804 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6a472-9095-4be8-b487-c27ac31e78ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:25.888077 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6a472-9095-4be8-b487-c27ac31e78ca admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:25.888712 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c6a472-9095-4be8-b487-c27ac31e78ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:25.890348 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c6a472-9095-4be8-b487-c27ac31e78ca admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:25.900399 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4383/8786] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:32:25.904656 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f3ace-8f53-488d-b139-f5f4b2b8b056 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:25.915594 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f3ace-8f53-488d-b139-f5f4b2b8b056 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:25.920277 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ddf05-7ec5-433f-8716-d893b45c9f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:25.920927 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ddf05-7ec5-433f-8716-d893b45c9f0e admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:25.921206 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ddf05-7ec5-433f-8716-d893b45c9f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:25.921480 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ddf05-7ec5-433f-8716-d893b45c9f0e admin admin] PATH_INFO: `/v3/projects/6d98629c1b6e4c47a74fa2d6da83f47e/users/873ca821b87f41eda08246e7a98432b6/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:25.923429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ddf05-7ec5-433f-8716-d893b45c9f0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d98629c1b6e4c47a74fa2d6da83f47e, user_id=873ca821b87f41eda08246e7a98432b6, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:25.926135 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ddf05-7ec5-433f-8716-d893b45c9f0e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:25.936928 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4404/8787] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:32:25 2022] PUT /identity/v3/projects/6d98629c1b6e4c47a74fa2d6da83f47e/users/873ca821b87f41eda08246e7a98432b6/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:32:25.947037 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97185cc7-6e04-4757-8951-40684f035890 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:25.947322 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97185cc7-6e04-4757-8951-40684f035890 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:25.947744 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97185cc7-6e04-4757-8951-40684f035890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:25.975492 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-97185cc7-6e04-4757-8951-40684f035890 None None] MFA Rules not processed for user `873ca821b87f41eda08246e7a98432b6`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:32:25.976686 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-97185cc7-6e04-4757-8951-40684f035890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:32:26.047965 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4384/8788] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:32:25 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:32:26.061577 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcae7b5-793a-4e70-9baa-edb402f76cac None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:26.062124 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcae7b5-793a-4e70-9baa-edb402f76cac None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:26.062124 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcae7b5-793a-4e70-9baa-edb402f76cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:26.081588 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-fdcae7b5-793a-4e70-9baa-edb402f76cac None None] MFA Rules not processed for user `7ec5f550e4dc42ed9b7de24a22259cfd`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:32:26.082786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-fdcae7b5-793a-4e70-9baa-edb402f76cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:32:26.088674 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:26.140133 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4405/8789] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:32:26 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:32:26.155547 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97185cc7-6e04-4757-8951-40684f035890 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:26.157720 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-97185cc7-6e04-4757-8951-40684f035890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:32:26.236563 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97185cc7-6e04-4757-8951-40684f035890 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:26.242174 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23507c-1c53-4357-8d1a-724a6a653c83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:26.242778 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23507c-1c53-4357-8d1a-724a6a653c83 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:26.243148 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23507c-1c53-4357-8d1a-724a6a653c83 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:26.243427 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23507c-1c53-4357-8d1a-724a6a653c83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:26.251403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc23507c-1c53-4357-8d1a-724a6a653c83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:26.253028 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc23507c-1c53-4357-8d1a-724a6a653c83 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:26.257025 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=100 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:26.264241 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4385/8790] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:32:26 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:32:36.133222 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcae7b5-793a-4e70-9baa-edb402f76cac None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:36.134472 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=20 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:36.135996 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-fdcae7b5-793a-4e70-9baa-edb402f76cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:32:36.155602 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcae7b5-793a-4e70-9baa-edb402f76cac None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:36.161148 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b68573-5dc7-41dc-a19c-11dde07f077e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:36.161757 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b68573-5dc7-41dc-a19c-11dde07f077e service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:36.162036 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b68573-5dc7-41dc-a19c-11dde07f077e service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:36.162308 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b68573-5dc7-41dc-a19c-11dde07f077e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:36.171343 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b68573-5dc7-41dc-a19c-11dde07f077e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:36.172935 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b68573-5dc7-41dc-a19c-11dde07f077e service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:36.182612 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4406/8791] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:32:36 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:32:36.198148 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070eccb-bf0d-4f4f-a1d3-7bfbf4efdcc6 None None] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:36.198622 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070eccb-bf0d-4f4f-a1d3-7bfbf4efdcc6 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:36.198725 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070eccb-bf0d-4f4f-a1d3-7bfbf4efdcc6 None None] PATH_INFO: `/` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:36.200317 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4386/8792] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 16:32:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 16:32:36.204916 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b68573-5dc7-41dc-a19c-11dde07f077e service nova] Authenticating service token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 16:32:36.219651 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b68573-5dc7-41dc-a19c-11dde07f077e service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:36.228346 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b68573-5dc7-41dc-a19c-11dde07f077e service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:36.233059 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64495db2-1549-430e-b3b4-853e4ea3c8f1 tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '873ca821b87f41eda08246e7a98432b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d98629c1b6e4c47a74fa2d6da83f47e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:36.233687 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64495db2-1549-430e-b3b4-853e4ea3c8f1 tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:36.233968 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64495db2-1549-430e-b3b4-853e4ea3c8f1 tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:36.234244 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64495db2-1549-430e-b3b4-853e4ea3c8f1 tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] PATH_INFO: `/v3/projects/6d98629c1b6e4c47a74fa2d6da83f47e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:36.235404 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64495db2-1549-430e-b3b4-853e4ea3c8f1 tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] RBAC: Authorizing `identity:get_project(project_id=6d98629c1b6e4c47a74fa2d6da83f47e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:36.237195 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64495db2-1549-430e-b3b4-853e4ea3c8f1 tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:36.238853 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4407/8793] 10.222.0.83 () {58 vars in 1443 bytes} [Mon Aug 29 16:32:36 2022] GET /identity/v3/projects/6d98629c1b6e4c47a74fa2d6da83f47e => generated 387 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:32:36.262799 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:36.397524 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5070eccb-bf0d-4f4f-a1d3-7bfbf4efdcc6 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:36.399517 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5070eccb-bf0d-4f4f-a1d3-7bfbf4efdcc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:32:36.458748 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5070eccb-bf0d-4f4f-a1d3-7bfbf4efdcc6 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:36.462596 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282eea2-af4e-44a8-9d5b-38cceb4b983d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:36.463233 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282eea2-af4e-44a8-9d5b-38cceb4b983d service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:36.463516 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282eea2-af4e-44a8-9d5b-38cceb4b983d service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:36.463791 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282eea2-af4e-44a8-9d5b-38cceb4b983d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:36.465525 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b282eea2-af4e-44a8-9d5b-38cceb4b983d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:32:36.478396 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282eea2-af4e-44a8-9d5b-38cceb4b983d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:36.479790 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282eea2-af4e-44a8-9d5b-38cceb4b983d service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:36.490355 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4387/8794] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:32:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:32:36.662437 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a067007-78b8-4dd7-8b33-a2e115cd6897 None None] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:36.662725 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a067007-78b8-4dd7-8b33-a2e115cd6897 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:36.663001 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a067007-78b8-4dd7-8b33-a2e115cd6897 None None] PATH_INFO: `/` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:36.664373 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4408/8795] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 16:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 16:32:36.669906 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282eea2-af4e-44a8-9d5b-38cceb4b983d service neutron] Authenticating service token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 16:32:36.685907 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282eea2-af4e-44a8-9d5b-38cceb4b983d service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:36.695394 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282eea2-af4e-44a8-9d5b-38cceb4b983d service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:36.700467 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e70992-3c31-4678-b185-6143cc1d73ec tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '873ca821b87f41eda08246e7a98432b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d98629c1b6e4c47a74fa2d6da83f47e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:36.701100 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e70992-3c31-4678-b185-6143cc1d73ec tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:36.701383 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e70992-3c31-4678-b185-6143cc1d73ec tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:36.701691 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e70992-3c31-4678-b185-6143cc1d73ec tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] PATH_INFO: `/v3/projects/6d98629c1b6e4c47a74fa2d6da83f47e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:36.702847 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e70992-3c31-4678-b185-6143cc1d73ec tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] RBAC: Authorizing `identity:get_project(project_id=6d98629c1b6e4c47a74fa2d6da83f47e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:36.705413 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e70992-3c31-4678-b185-6143cc1d73ec tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:36.706754 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4388/8796] 10.222.0.83 () {58 vars in 1443 bytes} [Mon Aug 29 16:32:36 2022] GET /identity/v3/projects/6d98629c1b6e4c47a74fa2d6da83f47e => generated 387 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:32:39.628791 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a067007-78b8-4dd7-8b33-a2e115cd6897 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:39.692678 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a067007-78b8-4dd7-8b33-a2e115cd6897 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:39.697787 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043feb22-7ff6-4fc2-9114-3f18668e8fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:39.698421 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043feb22-7ff6-4fc2-9114-3f18668e8fcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:39.698697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043feb22-7ff6-4fc2-9114-3f18668e8fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:39.699232 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043feb22-7ff6-4fc2-9114-3f18668e8fcf admin admin] PATH_INFO: `/v3/users/7ec5f550e4dc42ed9b7de24a22259cfd` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:39.700402 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043feb22-7ff6-4fc2-9114-3f18668e8fcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ec5f550e4dc42ed9b7de24a22259cfd)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:39.702335 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043feb22-7ff6-4fc2-9114-3f18668e8fcf admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:39.749188 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-043feb22-7ff6-4fc2-9114-3f18668e8fcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ec5f550e4dc42ed9b7de24a22259cfd'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:39.749874 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-043feb22-7ff6-4fc2-9114-3f18668e8fcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ec5f550e4dc42ed9b7de24a22259cfd'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:39.757665 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-043feb22-7ff6-4fc2-9114-3f18668e8fcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ec5f550e4dc42ed9b7de24a22259cfd'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:39.765432 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-043feb22-7ff6-4fc2-9114-3f18668e8fcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ec5f550e4dc42ed9b7de24a22259cfd'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:39.766122 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-043feb22-7ff6-4fc2-9114-3f18668e8fcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ec5f550e4dc42ed9b7de24a22259cfd'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:39.792777 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4409/8797] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:32:39 2022] DELETE /identity/v3/users/7ec5f550e4dc42ed9b7de24a22259cfd => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:32:39.797435 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa62e6-b3a8-4405-b3df-ac4d37cc0978 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:39.797913 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa62e6-b3a8-4405-b3df-ac4d37cc0978 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:39.798011 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa62e6-b3a8-4405-b3df-ac4d37cc0978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:39.818529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-bafa62e6-b3a8-4405-b3df-ac4d37cc0978 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:32:39.819775 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-bafa62e6-b3a8-4405-b3df-ac4d37cc0978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:32:39.880363 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4389/8798] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:32:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:32:39.890952 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043feb22-7ff6-4fc2-9114-3f18668e8fcf admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:39.892401 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-043feb22-7ff6-4fc2-9114-3f18668e8fcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:32:39.950913 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043feb22-7ff6-4fc2-9114-3f18668e8fcf admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:39.954592 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ebd74-52c2-4451-9e9c-344ee853b22b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:39.955226 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ebd74-52c2-4451-9e9c-344ee853b22b service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:39.955505 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ebd74-52c2-4451-9e9c-344ee853b22b service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:39.955776 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ebd74-52c2-4451-9e9c-344ee853b22b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:39.965364 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909ebd74-52c2-4451-9e9c-344ee853b22b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:39.966802 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909ebd74-52c2-4451-9e9c-344ee853b22b service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:39.971752 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:39.976861 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4410/8799] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:32:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:32:40.153610 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa62e6-b3a8-4405-b3df-ac4d37cc0978 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:40.155118 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-bafa62e6-b3a8-4405-b3df-ac4d37cc0978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:32:40.169569 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa62e6-b3a8-4405-b3df-ac4d37cc0978 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:40.174430 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93ac1b-31f7-43ce-a283-489cc8ddce2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:40.175131 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93ac1b-31f7-43ce-a283-489cc8ddce2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:40.175412 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93ac1b-31f7-43ce-a283-489cc8ddce2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:40.175689 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93ac1b-31f7-43ce-a283-489cc8ddce2a admin admin] PATH_INFO: `/v3/projects/30da8aecfbd64d1b9b6516c51d133d9f` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:40.176846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a93ac1b-31f7-43ce-a283-489cc8ddce2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=30da8aecfbd64d1b9b6516c51d133d9f)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:40.178916 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a93ac1b-31f7-43ce-a283-489cc8ddce2a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:40.228977 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4a93ac1b-31f7-43ce-a283-489cc8ddce2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30da8aecfbd64d1b9b6516c51d133d9f', 'request_id': 'req-4a93ac1b-31f7-43ce-a283-489cc8ddce2a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:40.234957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4a93ac1b-31f7-43ce-a283-489cc8ddce2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30da8aecfbd64d1b9b6516c51d133d9f', 'request_id': 'req-4a93ac1b-31f7-43ce-a283-489cc8ddce2a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:40.242176 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4a93ac1b-31f7-43ce-a283-489cc8ddce2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30da8aecfbd64d1b9b6516c51d133d9f', 'request_id': 'req-4a93ac1b-31f7-43ce-a283-489cc8ddce2a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:40.254375 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4a93ac1b-31f7-43ce-a283-489cc8ddce2a admin admin] The token cache is being invalidate because project 30da8aecfbd64d1b9b6516c51d133d9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:32:40.254669 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4a93ac1b-31f7-43ce-a283-489cc8ddce2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:40.255340 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-4a93ac1b-31f7-43ce-a283-489cc8ddce2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:40.256846 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4390/8800] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:32:40 2022] DELETE /identity/v3/projects/30da8aecfbd64d1b9b6516c51d133d9f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:32:40.260872 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ebd74-52c2-4451-9e9c-344ee853b22b service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:40.270423 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ebd74-52c2-4451-9e9c-344ee853b22b service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:40.328120 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c5e3a-78a1-4f0c-ac56-959c852d68e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:40.328761 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c5e3a-78a1-4f0c-ac56-959c852d68e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:40.329042 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c5e3a-78a1-4f0c-ac56-959c852d68e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:40.329317 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c5e3a-78a1-4f0c-ac56-959c852d68e1 admin admin] PATH_INFO: `/v3/users/873ca821b87f41eda08246e7a98432b6` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:40.330479 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5c5e3a-78a1-4f0c-ac56-959c852d68e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=873ca821b87f41eda08246e7a98432b6)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:40.332440 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5c5e3a-78a1-4f0c-ac56-959c852d68e1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:40.378136 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4a5c5e3a-78a1-4f0c-ac56-959c852d68e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '873ca821b87f41eda08246e7a98432b6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:40.378786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4a5c5e3a-78a1-4f0c-ac56-959c852d68e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '873ca821b87f41eda08246e7a98432b6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:40.389170 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4a5c5e3a-78a1-4f0c-ac56-959c852d68e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '873ca821b87f41eda08246e7a98432b6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:40.396651 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4a5c5e3a-78a1-4f0c-ac56-959c852d68e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '873ca821b87f41eda08246e7a98432b6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:40.397255 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4a5c5e3a-78a1-4f0c-ac56-959c852d68e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '873ca821b87f41eda08246e7a98432b6'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:40.415635 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4411/8801] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:32:40 2022] DELETE /identity/v3/users/873ca821b87f41eda08246e7a98432b6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:32:40.695601 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93ac1b-31f7-43ce-a283-489cc8ddce2a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:40.697092 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4a93ac1b-31f7-43ce-a283-489cc8ddce2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:32:40.710638 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93ac1b-31f7-43ce-a283-489cc8ddce2a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:40.724185 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:40.773529 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c0505-fb89-4c0e-b64b-984cea5820f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:40.774160 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c0505-fb89-4c0e-b64b-984cea5820f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:40.774439 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c0505-fb89-4c0e-b64b-984cea5820f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:40.774738 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c0505-fb89-4c0e-b64b-984cea5820f6 admin admin] PATH_INFO: `/v3/projects/6d98629c1b6e4c47a74fa2d6da83f47e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:40.775913 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c0505-fb89-4c0e-b64b-984cea5820f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d98629c1b6e4c47a74fa2d6da83f47e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:40.777821 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c0505-fb89-4c0e-b64b-984cea5820f6 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:40.827943 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-854c0505-fb89-4c0e-b64b-984cea5820f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d98629c1b6e4c47a74fa2d6da83f47e', 'request_id': 'req-854c0505-fb89-4c0e-b64b-984cea5820f6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:40.833411 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-854c0505-fb89-4c0e-b64b-984cea5820f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d98629c1b6e4c47a74fa2d6da83f47e', 'request_id': 'req-854c0505-fb89-4c0e-b64b-984cea5820f6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:40.842718 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-854c0505-fb89-4c0e-b64b-984cea5820f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d98629c1b6e4c47a74fa2d6da83f47e', 'request_id': 'req-854c0505-fb89-4c0e-b64b-984cea5820f6'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:40.854165 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-854c0505-fb89-4c0e-b64b-984cea5820f6 admin admin] The token cache is being invalidate because project 6d98629c1b6e4c47a74fa2d6da83f47e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:32:40.854446 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-854c0505-fb89-4c0e-b64b-984cea5820f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:40.855151 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-854c0505-fb89-4c0e-b64b-984cea5820f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:40.856647 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4391/8802] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:32:40 2022] DELETE /identity/v3/projects/6d98629c1b6e4c47a74fa2d6da83f47e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:32:40.862572 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbca46f-77ea-4ec9-8aca-2f71ce933f84 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:40.863071 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbca46f-77ea-4ec9-8aca-2f71ce933f84 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:40.863168 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbca46f-77ea-4ec9-8aca-2f71ce933f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:40.883001 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-3fbca46f-77ea-4ec9-8aca-2f71ce933f84 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:32:40.884704 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-3fbca46f-77ea-4ec9-8aca-2f71ce933f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:32:40.945675 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4412/8803] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:32:40.954793 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a08f8a-c1df-4299-b1f3-5f9c95afbd45 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:40.955110 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a08f8a-c1df-4299-b1f3-5f9c95afbd45 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:40.955390 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a08f8a-c1df-4299-b1f3-5f9c95afbd45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:40.975699 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-41a08f8a-c1df-4299-b1f3-5f9c95afbd45 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:32:40.976902 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-41a08f8a-c1df-4299-b1f3-5f9c95afbd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:32:40.985061 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4392/8804] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:32:40.989248 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbca46f-77ea-4ec9-8aca-2f71ce933f84 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:40.999329 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbca46f-77ea-4ec9-8aca-2f71ce933f84 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:41.003925 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1736080-e4d3-41a2-b820-951db70e9b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:41.004523 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1736080-e4d3-41a2-b820-951db70e9b20 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:41.004797 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1736080-e4d3-41a2-b820-951db70e9b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:41.005062 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1736080-e4d3-41a2-b820-951db70e9b20 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:41.005727 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1736080-e4d3-41a2-b820-951db70e9b20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:32:41.006022 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1736080-e4d3-41a2-b820-951db70e9b20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:41.007653 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1736080-e4d3-41a2-b820-951db70e9b20 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:41.019790 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4413/8805] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:32:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:32:41.024171 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a08f8a-c1df-4299-b1f3-5f9c95afbd45 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:41.034314 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a08f8a-c1df-4299-b1f3-5f9c95afbd45 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:41.039094 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fffc24f-d724-46dd-96cc-cd3281648627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:41.039700 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffc24f-d724-46dd-96cc-cd3281648627 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:41.039981 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffc24f-d724-46dd-96cc-cd3281648627 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:41.040257 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffc24f-d724-46dd-96cc-cd3281648627 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:41.041922 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fffc24f-d724-46dd-96cc-cd3281648627 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:41.043131 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fffc24f-d724-46dd-96cc-cd3281648627 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:41.070620 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4393/8806] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:32:41 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:32:41.075968 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1736080-e4d3-41a2-b820-951db70e9b20 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:41.086278 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1736080-e4d3-41a2-b820-951db70e9b20 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:41.090131 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:41.147124 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ba8ac-3963-4fdc-9317-106290d9f060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:41.147738 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ba8ac-3963-4fdc-9317-106290d9f060 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:41.148023 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ba8ac-3963-4fdc-9317-106290d9f060 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:41.148306 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ba8ac-3963-4fdc-9317-106290d9f060 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:41.148936 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1ba8ac-3963-4fdc-9317-106290d9f060 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:41.151039 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1ba8ac-3963-4fdc-9317-106290d9f060 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:41.172333 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4414/8807] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:32:41 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:32:41.176486 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fffc24f-d724-46dd-96cc-cd3281648627 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:41.187662 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fffc24f-d724-46dd-96cc-cd3281648627 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:41.192595 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d999a2-3ddf-41d8-9054-0e95c1f9848e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:41.193226 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d999a2-3ddf-41d8-9054-0e95c1f9848e admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:41.193500 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d999a2-3ddf-41d8-9054-0e95c1f9848e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:41.193768 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d999a2-3ddf-41d8-9054-0e95c1f9848e admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:41.194431 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d999a2-3ddf-41d8-9054-0e95c1f9848e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:41.196111 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d999a2-3ddf-41d8-9054-0e95c1f9848e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:41.206900 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4394/8808] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:32:41.211097 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ba8ac-3963-4fdc-9317-106290d9f060 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:41.220708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ba8ac-3963-4fdc-9317-106290d9f060 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:41.225285 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf6dd4-b2a7-4721-b933-2a1fcb336ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:41.225873 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf6dd4-b2a7-4721-b933-2a1fcb336ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:41.226151 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf6dd4-b2a7-4721-b933-2a1fcb336ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:41.226421 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf6dd4-b2a7-4721-b933-2a1fcb336ce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:41.227083 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bf6dd4-b2a7-4721-b933-2a1fcb336ce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:41.228678 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bf6dd4-b2a7-4721-b933-2a1fcb336ce8 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:41.239280 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4415/8809] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:32:41.246169 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d999a2-3ddf-41d8-9054-0e95c1f9848e admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:41.256297 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d999a2-3ddf-41d8-9054-0e95c1f9848e admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:41.262113 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2878fe7-6a1c-4e98-87c2-2b0906b232b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:41.262783 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2878fe7-6a1c-4e98-87c2-2b0906b232b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:41.263092 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2878fe7-6a1c-4e98-87c2-2b0906b232b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:41.263373 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2878fe7-6a1c-4e98-87c2-2b0906b232b3 admin admin] PATH_INFO: `/v3/projects/40f75c929253424abd606d18c4b75a33/users/b8318bf000774d6189903e8bc8333440/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:41.278704 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2878fe7-6a1c-4e98-87c2-2b0906b232b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40f75c929253424abd606d18c4b75a33, user_id=b8318bf000774d6189903e8bc8333440, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:41.281437 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2878fe7-6a1c-4e98-87c2-2b0906b232b3 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:41.295324 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4395/8810] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:32:41 2022] PUT /identity/v3/projects/40f75c929253424abd606d18c4b75a33/users/b8318bf000774d6189903e8bc8333440/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:32:41.300420 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c9fb1-62b2-43b0-a6c2-2c84c99c281d None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:41.300703 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c9fb1-62b2-43b0-a6c2-2c84c99c281d None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:41.300999 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c9fb1-62b2-43b0-a6c2-2c84c99c281d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:41.320902 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-e65c9fb1-62b2-43b0-a6c2-2c84c99c281d None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:32:41.323083 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e65c9fb1-62b2-43b0-a6c2-2c84c99c281d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:32:41.383682 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4416/8811] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:32:41.394319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2878fe7-6a1c-4e98-87c2-2b0906b232b3 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:41.396048 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-c2878fe7-6a1c-4e98-87c2-2b0906b232b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:32:41.442988 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:41.455072 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2878fe7-6a1c-4e98-87c2-2b0906b232b3 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:41.458755 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea1975e-d6ce-4f39-abc5-db92a76314f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:41.459405 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1975e-d6ce-4f39-abc5-db92a76314f6 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:41.459681 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1975e-d6ce-4f39-abc5-db92a76314f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:41.459948 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1975e-d6ce-4f39-abc5-db92a76314f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:41.469179 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea1975e-d6ce-4f39-abc5-db92a76314f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:41.470617 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea1975e-d6ce-4f39-abc5-db92a76314f6 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:41.480694 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4396/8812] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:32:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:32:46.079254 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552239d7-da79-40cc-ac28-d10bf450e749 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:46.079703 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552239d7-da79-40cc-ac28-d10bf450e749 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:46.079877 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552239d7-da79-40cc-ac28-d10bf450e749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:46.118410 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-552239d7-da79-40cc-ac28-d10bf450e749 None None] MFA Rules not processed for user `b8318bf000774d6189903e8bc8333440`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:32:46.122110 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-552239d7-da79-40cc-ac28-d10bf450e749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:32:46.209777 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4417/8813] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:32:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:32:46.221611 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc916c-530f-4707-a2d7-37c322560b20 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:46.222099 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc916c-530f-4707-a2d7-37c322560b20 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:46.222191 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc916c-530f-4707-a2d7-37c322560b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:46.242731 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-4bbc916c-530f-4707-a2d7-37c322560b20 None None] MFA Rules not processed for user `b8318bf000774d6189903e8bc8333440`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:32:46.244582 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4bbc916c-530f-4707-a2d7-37c322560b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:32:46.252133 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4397/8814] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:32:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:32:46.265216 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552239d7-da79-40cc-ac28-d10bf450e749 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:46.266884 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-552239d7-da79-40cc-ac28-d10bf450e749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:32:46.287467 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:46.360718 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552239d7-da79-40cc-ac28-d10bf450e749 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:46.368490 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5eada-7145-4d64-840f-195fa1fbdb80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:46.369241 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5eada-7145-4d64-840f-195fa1fbdb80 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:46.369521 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5eada-7145-4d64-840f-195fa1fbdb80 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:46.369789 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5eada-7145-4d64-840f-195fa1fbdb80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:46.379145 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f5eada-7145-4d64-840f-195fa1fbdb80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:46.380761 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f5eada-7145-4d64-840f-195fa1fbdb80 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:46.390936 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4418/8815] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:32:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:32:46.654238 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc916c-530f-4707-a2d7-37c322560b20 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:46.655784 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4bbc916c-530f-4707-a2d7-37c322560b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:32:46.667862 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc916c-530f-4707-a2d7-37c322560b20 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:46.671443 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4227bf3-67c0-431d-b3fe-306d5c4d9071 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:46.672060 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4227bf3-67c0-431d-b3fe-306d5c4d9071 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:46.672340 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4227bf3-67c0-431d-b3fe-306d5c4d9071 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:46.672612 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4227bf3-67c0-431d-b3fe-306d5c4d9071 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:46.674995 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e4227bf3-67c0-431d-b3fe-306d5c4d9071 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:32:46.688393 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4227bf3-67c0-431d-b3fe-306d5c4d9071 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:46.689948 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4227bf3-67c0-431d-b3fe-306d5c4d9071 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:46.702686 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4398/8816] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:32:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:32:48.065990 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5eada-7145-4d64-840f-195fa1fbdb80 service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:48.067542 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-52f5eada-7145-4d64-840f-195fa1fbdb80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:32:48.159774 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5eada-7145-4d64-840f-195fa1fbdb80 service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:48.170358 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec39bf21-5fd2-4902-9405-7738d97af3a7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:48.171008 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39bf21-5fd2-4902-9405-7738d97af3a7 service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:48.171323 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39bf21-5fd2-4902-9405-7738d97af3a7 service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:48.171601 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39bf21-5fd2-4902-9405-7738d97af3a7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:48.173483 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ec39bf21-5fd2-4902-9405-7738d97af3a7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:32:48.186022 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec39bf21-5fd2-4902-9405-7738d97af3a7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:48.187818 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec39bf21-5fd2-4902-9405-7738d97af3a7 service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:48.209300 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4419/8817] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:32:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:32:56.695185 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=15 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:58.194714 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=59 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:58.605026 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4227bf3-67c0-431d-b3fe-306d5c4d9071 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:58.606654 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e4227bf3-67c0-431d-b3fe-306d5c4d9071 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:32:58.628248 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4227bf3-67c0-431d-b3fe-306d5c4d9071 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:58.634756 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a171de-69f6-42a6-b330-fa258f5e0ced service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:58.635551 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a171de-69f6-42a6-b330-fa258f5e0ced service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:58.635938 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a171de-69f6-42a6-b330-fa258f5e0ced service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:58.636311 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a171de-69f6-42a6-b330-fa258f5e0ced service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:58.638860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-38a171de-69f6-42a6-b330-fa258f5e0ced service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:32:58.656239 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a171de-69f6-42a6-b330-fa258f5e0ced service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:58.657986 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a171de-69f6-42a6-b330-fa258f5e0ced service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:58.672348 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4399/8818] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:32:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:33:01.032823 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec39bf21-5fd2-4902-9405-7738d97af3a7 service placement] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:33:01.042191 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec39bf21-5fd2-4902-9405-7738d97af3a7 service placement] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:33:01.045986 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f780d8e-3611-4ff1-8ad8-630eca048a21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:33:01.046665 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f780d8e-3611-4ff1-8ad8-630eca048a21 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:33:01.047063 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f780d8e-3611-4ff1-8ad8-630eca048a21 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:33:01.047389 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f780d8e-3611-4ff1-8ad8-630eca048a21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:33:01.049209 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9f780d8e-3611-4ff1-8ad8-630eca048a21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:33:01.062272 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f780d8e-3611-4ff1-8ad8-630eca048a21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:33:01.063764 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f780d8e-3611-4ff1-8ad8-630eca048a21 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:33:01.075789 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4420/8819] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:33:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:33:01.164013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab7ce7-3c2c-4473-9a28-2f60433b5934 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:33:01.164579 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab7ce7-3c2c-4473-9a28-2f60433b5934 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:33:01.164579 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab7ce7-3c2c-4473-9a28-2f60433b5934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:33:01.184337 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-feab7ce7-3c2c-4473-9a28-2f60433b5934 None None] MFA Rules not processed for user `c190fa4a280c41c684130e069bee99eb`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:33:01.185536 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-feab7ce7-3c2c-4473-9a28-2f60433b5934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:33:01.194508 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4400/8820] 10.222.0.83 () {58 vars in 1018 bytes} [Mon Aug 29 16:33:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:33:01.206588 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f780d8e-3611-4ff1-8ad8-630eca048a21 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:33:01.221670 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f780d8e-3611-4ff1-8ad8-630eca048a21 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:33:01.226738 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe46100f-472e-4619-8669-193b8e6f6b30 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:33:01.227368 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46100f-472e-4619-8669-193b8e6f6b30 service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:33:01.227647 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46100f-472e-4619-8669-193b8e6f6b30 service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:33:01.227917 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46100f-472e-4619-8669-193b8e6f6b30 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:33:01.236518 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe46100f-472e-4619-8669-193b8e6f6b30 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:33:01.238091 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe46100f-472e-4619-8669-193b8e6f6b30 service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:33:01.248846 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4421/8821] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:33:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:33:01.421862 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab7ce7-3c2c-4473-9a28-2f60433b5934 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:33:01.431318 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab7ce7-3c2c-4473-9a28-2f60433b5934 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:33:01.434920 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4bfcc6-ef12-482e-90b2-132514288a8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:33:01.435550 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4bfcc6-ef12-482e-90b2-132514288a8a service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:33:01.435837 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4bfcc6-ef12-482e-90b2-132514288a8a service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:33:01.436109 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4bfcc6-ef12-482e-90b2-132514288a8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:33:01.437862 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-da4bfcc6-ef12-482e-90b2-132514288a8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:33:01.454138 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4bfcc6-ef12-482e-90b2-132514288a8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:33:01.455627 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4bfcc6-ef12-482e-90b2-132514288a8a service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:33:01.469825 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4401/8822] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:33:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:33:01.534100 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe46100f-472e-4619-8669-193b8e6f6b30 service placement] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:33:01.548272 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe46100f-472e-4619-8669-193b8e6f6b30 service placement] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:33:01.553340 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6790de3d-e025-4dcb-ba7b-40dd7bd8de01 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:33:01.553942 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790de3d-e025-4dcb-ba7b-40dd7bd8de01 service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:33:01.554218 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790de3d-e025-4dcb-ba7b-40dd7bd8de01 service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:33:01.554490 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790de3d-e025-4dcb-ba7b-40dd7bd8de01 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:33:01.556248 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6790de3d-e025-4dcb-ba7b-40dd7bd8de01 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:33:01.568312 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6790de3d-e025-4dcb-ba7b-40dd7bd8de01 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:33:01.569927 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6790de3d-e025-4dcb-ba7b-40dd7bd8de01 service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:33:01.581238 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4422/8823] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:33:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:33:11.461769 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=15 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:33:11.577048 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=18 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:33:30.129268 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4bfcc6-ef12-482e-90b2-132514288a8a service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:33:30.137875 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4bfcc6-ef12-482e-90b2-132514288a8a service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:33:30.142020 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c32390-95c7-4319-9d6c-d8d5f6745c51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:33:30.142607 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c32390-95c7-4319-9d6c-d8d5f6745c51 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:33:30.142881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c32390-95c7-4319-9d6c-d8d5f6745c51 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:33:30.143188 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c32390-95c7-4319-9d6c-d8d5f6745c51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:33:30.144875 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-55c32390-95c7-4319-9d6c-d8d5f6745c51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:33:30.159527 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c32390-95c7-4319-9d6c-d8d5f6745c51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:33:30.160980 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c32390-95c7-4319-9d6c-d8d5f6745c51 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:33:30.172636 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4402/8824] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:33:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:33:30.733523 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6790de3d-e025-4dcb-ba7b-40dd7bd8de01 service placement] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:33:30.750431 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6790de3d-e025-4dcb-ba7b-40dd7bd8de01 service placement] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:33:30.755957 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5324f-3edc-48c6-934b-22ee5daeffe9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:33:30.756574 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5324f-3edc-48c6-934b-22ee5daeffe9 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:33:30.756852 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5324f-3edc-48c6-934b-22ee5daeffe9 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:33:30.757123 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5324f-3edc-48c6-934b-22ee5daeffe9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:33:30.758860 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-54c5324f-3edc-48c6-934b-22ee5daeffe9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:33:30.774647 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c5324f-3edc-48c6-934b-22ee5daeffe9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:33:30.776594 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c5324f-3edc-48c6-934b-22ee5daeffe9 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:33:30.791084 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4423/8825] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:33:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:33:36.592722 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e3b3b-f2b6-44b3-9c28-dddcebd2cc9d None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:33:36.593312 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e3b3b-f2b6-44b3-9c28-dddcebd2cc9d None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:33:36.593312 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e3b3b-f2b6-44b3-9c28-dddcebd2cc9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:33:36.614642 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-b13e3b3b-f2b6-44b3-9c28-dddcebd2cc9d None None] MFA Rules not processed for user `c190fa4a280c41c684130e069bee99eb`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:33:36.615906 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b13e3b3b-f2b6-44b3-9c28-dddcebd2cc9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:33:36.625521 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4403/8826] 10.222.0.77 () {58 vars in 1015 bytes} [Mon Aug 29 16:33:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:33:36.636965 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02488a68-c39e-4679-b357-0074b433c03e None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:33:36.637370 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02488a68-c39e-4679-b357-0074b433c03e None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:33:36.637519 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02488a68-c39e-4679-b357-0074b433c03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:33:36.657490 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-02488a68-c39e-4679-b357-0074b433c03e None None] MFA Rules not processed for user `c190fa4a280c41c684130e069bee99eb`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:33:36.658757 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-02488a68-c39e-4679-b357-0074b433c03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:33:36.667507 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4424/8827] 10.222.0.83 () {58 vars in 1058 bytes} [Mon Aug 29 16:33:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:33:36.673432 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e3b3b-f2b6-44b3-9c28-dddcebd2cc9d None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:33:36.684062 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e3b3b-f2b6-44b3-9c28-dddcebd2cc9d None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:33:36.689842 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0508d21-540b-4abc-8322-1bbba65f88a0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:33:36.690444 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0508d21-540b-4abc-8322-1bbba65f88a0 service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:33:36.690726 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0508d21-540b-4abc-8322-1bbba65f88a0 service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:33:36.691002 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0508d21-540b-4abc-8322-1bbba65f88a0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:33:36.699618 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0508d21-540b-4abc-8322-1bbba65f88a0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:33:36.701476 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0508d21-540b-4abc-8322-1bbba65f88a0 service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:33:36.712426 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4404/8828] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:33:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:33:44.043931 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02488a68-c39e-4679-b357-0074b433c03e None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:33:44.045411 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-02488a68-c39e-4679-b357-0074b433c03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:33:44.062900 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02488a68-c39e-4679-b357-0074b433c03e None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:33:44.068505 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5daf02-c626-458e-8cec-368727e9e329 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:33:44.069301 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5daf02-c626-458e-8cec-368727e9e329 service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:33:44.069641 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5daf02-c626-458e-8cec-368727e9e329 service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:33:44.069980 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5daf02-c626-458e-8cec-368727e9e329 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:33:44.071915 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6d5daf02-c626-458e-8cec-368727e9e329 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:33:44.097528 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5daf02-c626-458e-8cec-368727e9e329 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:33:44.099228 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5daf02-c626-458e-8cec-368727e9e329 service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:33:44.108891 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0508d21-540b-4abc-8322-1bbba65f88a0 service placement] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:33:44.115144 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4425/8829] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:33:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:33:44.127644 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0508d21-540b-4abc-8322-1bbba65f88a0 service placement] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:33:44.135689 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd2f59-158b-44c2-8fb2-0ed27f301a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:33:44.136343 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd2f59-158b-44c2-8fb2-0ed27f301a8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:33:44.136630 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd2f59-158b-44c2-8fb2-0ed27f301a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:33:44.136909 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd2f59-158b-44c2-8fb2-0ed27f301a8d admin admin] PATH_INFO: `/v3/users/b8318bf000774d6189903e8bc8333440` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:33:44.138062 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dd2f59-158b-44c2-8fb2-0ed27f301a8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8318bf000774d6189903e8bc8333440)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:33:44.141003 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dd2f59-158b-44c2-8fb2-0ed27f301a8d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:33:44.191203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-24dd2f59-158b-44c2-8fb2-0ed27f301a8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8318bf000774d6189903e8bc8333440'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:33:44.191877 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-24dd2f59-158b-44c2-8fb2-0ed27f301a8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8318bf000774d6189903e8bc8333440'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:33:44.205416 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-24dd2f59-158b-44c2-8fb2-0ed27f301a8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8318bf000774d6189903e8bc8333440'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:33:44.212142 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-24dd2f59-158b-44c2-8fb2-0ed27f301a8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8318bf000774d6189903e8bc8333440'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:33:44.219196 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-24dd2f59-158b-44c2-8fb2-0ed27f301a8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8318bf000774d6189903e8bc8333440'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:33:44.225439 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4405/8830] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:33:44 2022] DELETE /identity/v3/users/b8318bf000774d6189903e8bc8333440 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:33:44.408837 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5daf02-c626-458e-8cec-368727e9e329 service placement] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:33:44.427296 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5daf02-c626-458e-8cec-368727e9e329 service placement] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:33:44.487599 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb8ff74-23dd-4ab9-a056-8f8daf297ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:33:44.488255 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8ff74-23dd-4ab9-a056-8f8daf297ea1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:33:44.488529 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8ff74-23dd-4ab9-a056-8f8daf297ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:33:44.488797 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8ff74-23dd-4ab9-a056-8f8daf297ea1 admin admin] PATH_INFO: `/v3/projects/40f75c929253424abd606d18c4b75a33` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:33:44.489902 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb8ff74-23dd-4ab9-a056-8f8daf297ea1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40f75c929253424abd606d18c4b75a33)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:33:44.491882 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb8ff74-23dd-4ab9-a056-8f8daf297ea1 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:33:44.537802 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8cb8ff74-23dd-4ab9-a056-8f8daf297ea1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40f75c929253424abd606d18c4b75a33', 'request_id': 'req-8cb8ff74-23dd-4ab9-a056-8f8daf297ea1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:33:44.543334 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8cb8ff74-23dd-4ab9-a056-8f8daf297ea1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40f75c929253424abd606d18c4b75a33', 'request_id': 'req-8cb8ff74-23dd-4ab9-a056-8f8daf297ea1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:33:44.550096 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8cb8ff74-23dd-4ab9-a056-8f8daf297ea1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40f75c929253424abd606d18c4b75a33', 'request_id': 'req-8cb8ff74-23dd-4ab9-a056-8f8daf297ea1'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:33:44.563418 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8cb8ff74-23dd-4ab9-a056-8f8daf297ea1 admin admin] The token cache is being invalidate because project 40f75c929253424abd606d18c4b75a33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:33:44.563705 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8cb8ff74-23dd-4ab9-a056-8f8daf297ea1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:33:44.564329 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-8cb8ff74-23dd-4ab9-a056-8f8daf297ea1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:33:44.565853 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4426/8831] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:33:44 2022] DELETE /identity/v3/projects/40f75c929253424abd606d18c4b75a33 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:33:44.571558 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b65c6b-0a54-43a6-86cd-da526d5814fd None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:33:44.571846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b65c6b-0a54-43a6-86cd-da526d5814fd None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:33:44.572305 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b65c6b-0a54-43a6-86cd-da526d5814fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:33:44.592587 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-04b65c6b-0a54-43a6-86cd-da526d5814fd None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:33:44.593724 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-04b65c6b-0a54-43a6-86cd-da526d5814fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:33:44.651795 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4406/8832] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:33:44.660335 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc246520-f0ef-4a87-8f47-7f1caeda8f66 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:33:44.660663 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc246520-f0ef-4a87-8f47-7f1caeda8f66 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:33:44.661008 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc246520-f0ef-4a87-8f47-7f1caeda8f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:33:44.681324 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-bc246520-f0ef-4a87-8f47-7f1caeda8f66 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:33:44.682521 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-bc246520-f0ef-4a87-8f47-7f1caeda8f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:33:44.690636 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4427/8833] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:33:44.694923 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b65c6b-0a54-43a6-86cd-da526d5814fd None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:33:44.705655 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b65c6b-0a54-43a6-86cd-da526d5814fd None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:33:44.710285 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5cd33-d2fd-4dff-b0e7-8ed16a22cdd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:33:44.710889 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5cd33-d2fd-4dff-b0e7-8ed16a22cdd1 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:33:44.711197 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5cd33-d2fd-4dff-b0e7-8ed16a22cdd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:33:44.711471 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5cd33-d2fd-4dff-b0e7-8ed16a22cdd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:33:44.712123 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd5cd33-d2fd-4dff-b0e7-8ed16a22cdd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:33:44.712427 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd5cd33-d2fd-4dff-b0e7-8ed16a22cdd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:33:44.714031 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd5cd33-d2fd-4dff-b0e7-8ed16a22cdd1 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:33:44.726348 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4407/8834] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:33:44.730807 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc246520-f0ef-4a87-8f47-7f1caeda8f66 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:33:44.740989 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc246520-f0ef-4a87-8f47-7f1caeda8f66 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:33:44.745833 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e1350-0535-44fb-8428-fee7e9286e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:33:44.746458 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e1350-0535-44fb-8428-fee7e9286e5b admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:33:44.746741 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e1350-0535-44fb-8428-fee7e9286e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:33:44.747013 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e1350-0535-44fb-8428-fee7e9286e5b admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:33:44.747683 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e1350-0535-44fb-8428-fee7e9286e5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:33:44.749919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e1350-0535-44fb-8428-fee7e9286e5b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:33:44.777359 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4428/8835] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:33:44 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:33:44.781970 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5cd33-d2fd-4dff-b0e7-8ed16a22cdd1 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:33:44.792034 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5cd33-d2fd-4dff-b0e7-8ed16a22cdd1 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:33:44.816619 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:33:44.851520 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f021b0-9e52-4c8a-b3fd-d0d801b11613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:33:44.852055 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f021b0-9e52-4c8a-b3fd-d0d801b11613 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:33:44.852339 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f021b0-9e52-4c8a-b3fd-d0d801b11613 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:33:44.852616 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f021b0-9e52-4c8a-b3fd-d0d801b11613 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:33:44.853240 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f021b0-9e52-4c8a-b3fd-d0d801b11613 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:33:44.855190 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f021b0-9e52-4c8a-b3fd-d0d801b11613 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:33:44.877092 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4408/8836] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:33:44 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:33:44.880989 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e1350-0535-44fb-8428-fee7e9286e5b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:33:44.891676 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e1350-0535-44fb-8428-fee7e9286e5b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:33:44.896595 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0399a5-8a0b-4451-84c3-875f5dc0afde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:33:44.897197 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0399a5-8a0b-4451-84c3-875f5dc0afde admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:33:44.897478 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0399a5-8a0b-4451-84c3-875f5dc0afde admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:33:44.897752 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0399a5-8a0b-4451-84c3-875f5dc0afde admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:33:44.898392 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0399a5-8a0b-4451-84c3-875f5dc0afde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:33:44.900032 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0399a5-8a0b-4451-84c3-875f5dc0afde admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:33:44.911706 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4429/8837] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:33:44.915759 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f021b0-9e52-4c8a-b3fd-d0d801b11613 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:33:44.926760 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f021b0-9e52-4c8a-b3fd-d0d801b11613 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:33:44.931560 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39c25c-83d2-48b3-8ea7-42b4f001d90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:33:44.932172 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39c25c-83d2-48b3-8ea7-42b4f001d90e admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:33:44.932453 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39c25c-83d2-48b3-8ea7-42b4f001d90e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:33:44.932727 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39c25c-83d2-48b3-8ea7-42b4f001d90e admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:33:44.933365 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a39c25c-83d2-48b3-8ea7-42b4f001d90e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:33:44.934959 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a39c25c-83d2-48b3-8ea7-42b4f001d90e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:33:44.948559 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4409/8838] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:33:44.953655 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0399a5-8a0b-4451-84c3-875f5dc0afde admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:33:44.964004 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0399a5-8a0b-4451-84c3-875f5dc0afde admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:33:44.968873 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72fb458-ac97-45cc-8d97-710e18e63e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:33:44.969538 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72fb458-ac97-45cc-8d97-710e18e63e20 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:33:44.969810 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72fb458-ac97-45cc-8d97-710e18e63e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:33:44.970079 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72fb458-ac97-45cc-8d97-710e18e63e20 admin admin] PATH_INFO: `/v3/projects/bd54d609ed014dea947a1ce0b27b2d94/users/8fa173eefc8a420da1c367c8ad53e44c/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:33:44.986628 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72fb458-ac97-45cc-8d97-710e18e63e20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd54d609ed014dea947a1ce0b27b2d94, user_id=8fa173eefc8a420da1c367c8ad53e44c, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:33:44.989395 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72fb458-ac97-45cc-8d97-710e18e63e20 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:33:44.991850 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:33:45.006266 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4430/8839] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:33:44 2022] PUT /identity/v3/projects/bd54d609ed014dea947a1ce0b27b2d94/users/8fa173eefc8a420da1c367c8ad53e44c/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:33:45.011675 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01e5bd-0a9b-4880-b93c-fae1f442939c None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:33:45.011968 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01e5bd-0a9b-4880-b93c-fae1f442939c None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:33:45.012244 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01e5bd-0a9b-4880-b93c-fae1f442939c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:33:45.031720 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-0a01e5bd-0a9b-4880-b93c-fae1f442939c None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:33:45.032943 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0a01e5bd-0a9b-4880-b93c-fae1f442939c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:33:45.095440 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4410/8840] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:33:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:33:45.105258 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72fb458-ac97-45cc-8d97-710e18e63e20 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:33:45.106884 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c72fb458-ac97-45cc-8d97-710e18e63e20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:33:45.165318 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72fb458-ac97-45cc-8d97-710e18e63e20 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:33:45.169036 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd5fb3b-a370-491d-b6c3-08c63e5e2b2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:33:45.169648 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5fb3b-a370-491d-b6c3-08c63e5e2b2a service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:33:45.169925 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5fb3b-a370-491d-b6c3-08c63e5e2b2a service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:33:45.170198 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5fb3b-a370-491d-b6c3-08c63e5e2b2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:33:45.179874 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd5fb3b-a370-491d-b6c3-08c63e5e2b2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:33:45.181312 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd5fb3b-a370-491d-b6c3-08c63e5e2b2a service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:33:45.191631 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4431/8841] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:33:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:33:49.323606 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155f319-3784-4402-a011-e321d94cfae7 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:33:49.324113 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155f319-3784-4402-a011-e321d94cfae7 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:33:49.324194 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155f319-3784-4402-a011-e321d94cfae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:33:49.361682 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-3155f319-3784-4402-a011-e321d94cfae7 None None] MFA Rules not processed for user `8fa173eefc8a420da1c367c8ad53e44c`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:33:49.362932 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3155f319-3784-4402-a011-e321d94cfae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:33:49.440359 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4411/8842] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:33:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:33:49.452256 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e6c88-4c4e-4cd2-ab94-75d7ff61cf91 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:33:49.455584 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e6c88-4c4e-4cd2-ab94-75d7ff61cf91 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:33:49.456082 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e6c88-4c4e-4cd2-ab94-75d7ff61cf91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:33:49.477258 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-748e6c88-4c4e-4cd2-ab94-75d7ff61cf91 None None] MFA Rules not processed for user `8fa173eefc8a420da1c367c8ad53e44c`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:33:49.478493 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-748e6c88-4c4e-4cd2-ab94-75d7ff61cf91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:33:49.486459 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4432/8843] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:33:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:33:49.498984 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155f319-3784-4402-a011-e321d94cfae7 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:33:49.501439 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3155f319-3784-4402-a011-e321d94cfae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:33:49.555403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:33:49.596910 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155f319-3784-4402-a011-e321d94cfae7 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:33:49.602751 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886e75b-fe9e-4dad-aa23-53c32de1a7a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:33:49.603411 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886e75b-fe9e-4dad-aa23-53c32de1a7a4 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:33:49.603696 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886e75b-fe9e-4dad-aa23-53c32de1a7a4 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:33:49.603974 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886e75b-fe9e-4dad-aa23-53c32de1a7a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:33:49.613014 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6886e75b-fe9e-4dad-aa23-53c32de1a7a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:33:49.614621 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6886e75b-fe9e-4dad-aa23-53c32de1a7a4 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:33:49.625316 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4412/8844] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:33:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:33:50.745895 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8da4cb-1bfb-4243-bda2-01c5f53888c4 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:33:50.746407 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8da4cb-1bfb-4243-bda2-01c5f53888c4 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:33:50.746524 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8da4cb-1bfb-4243-bda2-01c5f53888c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:33:50.770790 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-5f8da4cb-1bfb-4243-bda2-01c5f53888c4 None None] MFA Rules not processed for user `c190fa4a280c41c684130e069bee99eb`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:33:50.772053 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5f8da4cb-1bfb-4243-bda2-01c5f53888c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:33:50.839730 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4433/8845] 10.222.0.78 () {58 vars in 1015 bytes} [Mon Aug 29 16:33:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:33:50.852802 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886e75b-fe9e-4dad-aa23-53c32de1a7a4 service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:33:50.854324 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6886e75b-fe9e-4dad-aa23-53c32de1a7a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:33:50.868610 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886e75b-fe9e-4dad-aa23-53c32de1a7a4 service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:33:50.873815 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c829329f-4d09-4968-9e27-65989963149f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:33:50.874922 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829329f-4d09-4968-9e27-65989963149f service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:33:50.875342 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829329f-4d09-4968-9e27-65989963149f service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:33:50.875809 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829329f-4d09-4968-9e27-65989963149f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:33:50.884797 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c829329f-4d09-4968-9e27-65989963149f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:33:50.886454 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c829329f-4d09-4968-9e27-65989963149f service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:33:50.897466 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4413/8846] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:33:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:34:00.830901 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:INSERT=1,keystone:SELECT=60 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:34:00.893000 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=24 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:34:31.772464 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8da4cb-1bfb-4243-bda2-01c5f53888c4 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:34:31.774031 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5f8da4cb-1bfb-4243-bda2-01c5f53888c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:34:31.786176 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8da4cb-1bfb-4243-bda2-01c5f53888c4 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:34:31.789722 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1ca0e-496e-4df3-822b-eba7be123153 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:34:31.790316 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1ca0e-496e-4df3-822b-eba7be123153 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:34:31.790583 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1ca0e-496e-4df3-822b-eba7be123153 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:34:31.790847 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1ca0e-496e-4df3-822b-eba7be123153 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:34:31.792496 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-36c1ca0e-496e-4df3-822b-eba7be123153 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:34:31.805308 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c1ca0e-496e-4df3-822b-eba7be123153 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:34:31.806731 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c1ca0e-496e-4df3-822b-eba7be123153 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:34:31.817925 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4434/8847] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:34:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:34:39.606377 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83460eed-e176-49dd-8fa3-4bb3ea90b042 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:34:39.606940 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83460eed-e176-49dd-8fa3-4bb3ea90b042 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:34:39.607531 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83460eed-e176-49dd-8fa3-4bb3ea90b042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:34:39.628205 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-83460eed-e176-49dd-8fa3-4bb3ea90b042 None None] MFA Rules not processed for user `8fa173eefc8a420da1c367c8ad53e44c`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:34:39.629404 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-83460eed-e176-49dd-8fa3-4bb3ea90b042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:34:39.636244 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4414/8848] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:34:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:34:41.811145 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=6 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:34:49.622341 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:35:32.718422 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1ca0e-496e-4df3-822b-eba7be123153 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:35:32.732055 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1ca0e-496e-4df3-822b-eba7be123153 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:35:32.737839 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6c873-c701-4ee1-8685-5443e7d92459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:35:32.738518 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6c873-c701-4ee1-8685-5443e7d92459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:35:32.738943 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6c873-c701-4ee1-8685-5443e7d92459 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:35:32.739256 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6c873-c701-4ee1-8685-5443e7d92459 admin admin] PATH_INFO: `/v3/users/8fa173eefc8a420da1c367c8ad53e44c` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:35:32.740414 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a6c873-c701-4ee1-8685-5443e7d92459 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fa173eefc8a420da1c367c8ad53e44c)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:35:32.742358 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a6c873-c701-4ee1-8685-5443e7d92459 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:35:32.792386 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-80a6c873-c701-4ee1-8685-5443e7d92459 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fa173eefc8a420da1c367c8ad53e44c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:35:32.793066 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-80a6c873-c701-4ee1-8685-5443e7d92459 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fa173eefc8a420da1c367c8ad53e44c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:35:32.802618 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-80a6c873-c701-4ee1-8685-5443e7d92459 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fa173eefc8a420da1c367c8ad53e44c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:35:32.809881 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-80a6c873-c701-4ee1-8685-5443e7d92459 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fa173eefc8a420da1c367c8ad53e44c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:35:32.810513 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-80a6c873-c701-4ee1-8685-5443e7d92459 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fa173eefc8a420da1c367c8ad53e44c'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:35:32.829853 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4435/8849] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:35:32 2022] DELETE /identity/v3/users/8fa173eefc8a420da1c367c8ad53e44c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:35:33.028182 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83460eed-e176-49dd-8fa3-4bb3ea90b042 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:35:33.049554 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83460eed-e176-49dd-8fa3-4bb3ea90b042 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:35:33.114106 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c03c1-8583-4e11-848b-8efa37360e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:35:33.115281 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c03c1-8583-4e11-848b-8efa37360e31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:35:33.115719 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c03c1-8583-4e11-848b-8efa37360e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:35:33.116132 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c03c1-8583-4e11-848b-8efa37360e31 admin admin] PATH_INFO: `/v3/projects/bd54d609ed014dea947a1ce0b27b2d94` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:35:33.117475 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4c03c1-8583-4e11-848b-8efa37360e31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd54d609ed014dea947a1ce0b27b2d94)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:35:33.120756 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4c03c1-8583-4e11-848b-8efa37360e31 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:35:33.171833 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3e4c03c1-8583-4e11-848b-8efa37360e31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd54d609ed014dea947a1ce0b27b2d94', 'request_id': 'req-3e4c03c1-8583-4e11-848b-8efa37360e31'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:35:33.177461 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3e4c03c1-8583-4e11-848b-8efa37360e31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd54d609ed014dea947a1ce0b27b2d94', 'request_id': 'req-3e4c03c1-8583-4e11-848b-8efa37360e31'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:35:33.185055 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3e4c03c1-8583-4e11-848b-8efa37360e31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd54d609ed014dea947a1ce0b27b2d94', 'request_id': 'req-3e4c03c1-8583-4e11-848b-8efa37360e31'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:35:33.198956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3e4c03c1-8583-4e11-848b-8efa37360e31 admin admin] The token cache is being invalidate because project bd54d609ed014dea947a1ce0b27b2d94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:35:33.199284 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3e4c03c1-8583-4e11-848b-8efa37360e31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:35:33.200524 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3e4c03c1-8583-4e11-848b-8efa37360e31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:35:33.203481 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4415/8850] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:35:33 2022] DELETE /identity/v3/projects/bd54d609ed014dea947a1ce0b27b2d94 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:35:33.208927 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9a2ef-d566-489d-9aee-195d9a39f74e None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:35:33.209217 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9a2ef-d566-489d-9aee-195d9a39f74e None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:35:33.209522 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9a2ef-d566-489d-9aee-195d9a39f74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:35:33.230663 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-04b9a2ef-d566-489d-9aee-195d9a39f74e None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:35:33.231895 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-04b9a2ef-d566-489d-9aee-195d9a39f74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:35:33.292299 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4436/8851] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:35:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:35:33.300961 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf7972-87cf-4954-881d-b9423a8f46c1 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:35:33.301250 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf7972-87cf-4954-881d-b9423a8f46c1 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:35:33.301526 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf7972-87cf-4954-881d-b9423a8f46c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:35:33.321789 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-a1bf7972-87cf-4954-881d-b9423a8f46c1 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:35:33.322985 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a1bf7972-87cf-4954-881d-b9423a8f46c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:35:33.331618 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4416/8852] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:35:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:35:33.335846 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9a2ef-d566-489d-9aee-195d9a39f74e None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:35:33.346671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9a2ef-d566-489d-9aee-195d9a39f74e None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:35:33.351324 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8619396c-a81c-4e0d-ab00-ab9de450a19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:35:33.351921 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619396c-a81c-4e0d-ab00-ab9de450a19a admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:35:33.352194 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619396c-a81c-4e0d-ab00-ab9de450a19a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:35:33.352461 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619396c-a81c-4e0d-ab00-ab9de450a19a admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:35:33.353101 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8619396c-a81c-4e0d-ab00-ab9de450a19a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:35:33.353398 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8619396c-a81c-4e0d-ab00-ab9de450a19a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:35:33.354977 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8619396c-a81c-4e0d-ab00-ab9de450a19a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:35:33.366720 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4437/8853] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:35:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:35:33.371112 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf7972-87cf-4954-881d-b9423a8f46c1 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:35:33.380946 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf7972-87cf-4954-881d-b9423a8f46c1 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:35:33.385638 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafcff7-7da2-4c67-bb95-cad3f2f75d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:35:33.386241 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafcff7-7da2-4c67-bb95-cad3f2f75d44 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:35:33.386520 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafcff7-7da2-4c67-bb95-cad3f2f75d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:35:33.386791 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafcff7-7da2-4c67-bb95-cad3f2f75d44 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:35:33.387466 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbafcff7-7da2-4c67-bb95-cad3f2f75d44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:35:33.389935 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbafcff7-7da2-4c67-bb95-cad3f2f75d44 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:35:33.417240 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4417/8854] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:35:33 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:35:33.421617 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8619396c-a81c-4e0d-ab00-ab9de450a19a admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:35:33.431973 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8619396c-a81c-4e0d-ab00-ab9de450a19a admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:35:33.489337 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cea99e-8f40-4626-8b7c-558fcf7f9621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:35:33.489955 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cea99e-8f40-4626-8b7c-558fcf7f9621 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:35:33.490227 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cea99e-8f40-4626-8b7c-558fcf7f9621 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:35:33.490497 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cea99e-8f40-4626-8b7c-558fcf7f9621 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:35:33.491171 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cea99e-8f40-4626-8b7c-558fcf7f9621 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:35:33.493124 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cea99e-8f40-4626-8b7c-558fcf7f9621 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:35:33.501444 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:35:33.517912 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4438/8855] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:35:33 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:35:33.522278 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafcff7-7da2-4c67-bb95-cad3f2f75d44 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:35:33.533642 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafcff7-7da2-4c67-bb95-cad3f2f75d44 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:35:33.538293 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9969af-03d9-45e5-9966-e2f5fdf6d907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:35:33.538890 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9969af-03d9-45e5-9966-e2f5fdf6d907 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:35:33.539218 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9969af-03d9-45e5-9966-e2f5fdf6d907 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:35:33.539492 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9969af-03d9-45e5-9966-e2f5fdf6d907 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:35:33.540133 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9969af-03d9-45e5-9966-e2f5fdf6d907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:35:33.541733 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9969af-03d9-45e5-9966-e2f5fdf6d907 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:35:33.551725 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4418/8856] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:35:33.555723 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cea99e-8f40-4626-8b7c-558fcf7f9621 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:35:33.566203 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cea99e-8f40-4626-8b7c-558fcf7f9621 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:35:33.571224 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafcc85e-ed4b-4db1-99db-b090097ac50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:35:33.571828 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcc85e-ed4b-4db1-99db-b090097ac50f admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:35:33.572106 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcc85e-ed4b-4db1-99db-b090097ac50f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:35:33.572378 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcc85e-ed4b-4db1-99db-b090097ac50f admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:35:33.573058 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafcc85e-ed4b-4db1-99db-b090097ac50f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:35:33.574623 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafcc85e-ed4b-4db1-99db-b090097ac50f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:35:33.586981 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4439/8857] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:35:33.591125 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9969af-03d9-45e5-9966-e2f5fdf6d907 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:35:33.601943 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9969af-03d9-45e5-9966-e2f5fdf6d907 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:35:33.606538 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e994440-d786-4a40-8d8e-e578b84ea761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:35:33.607224 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e994440-d786-4a40-8d8e-e578b84ea761 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:35:33.607656 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e994440-d786-4a40-8d8e-e578b84ea761 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:35:33.607934 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e994440-d786-4a40-8d8e-e578b84ea761 admin admin] PATH_INFO: `/v3/projects/fe2904332eef460b8b57f38b445a30aa/users/ea14a64fabd24976a0946f6817d2f679/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:35:33.622485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e994440-d786-4a40-8d8e-e578b84ea761 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe2904332eef460b8b57f38b445a30aa, user_id=ea14a64fabd24976a0946f6817d2f679, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:35:33.625751 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e994440-d786-4a40-8d8e-e578b84ea761 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:35:33.639369 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4419/8858] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:35:33 2022] PUT /identity/v3/projects/fe2904332eef460b8b57f38b445a30aa/users/ea14a64fabd24976a0946f6817d2f679/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:35:33.644451 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ea5eb-51df-41f7-8954-13a6f36d5b10 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:35:33.644739 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ea5eb-51df-41f7-8954-13a6f36d5b10 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:35:33.645012 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ea5eb-51df-41f7-8954-13a6f36d5b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:35:33.664689 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-356ea5eb-51df-41f7-8954-13a6f36d5b10 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:35:33.665888 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-356ea5eb-51df-41f7-8954-13a6f36d5b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:35:33.726169 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4440/8859] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:35:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:35:33.735965 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e994440-d786-4a40-8d8e-e578b84ea761 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:35:33.737694 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8e994440-d786-4a40-8d8e-e578b84ea761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:35:33.772532 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:35:33.801133 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e994440-d786-4a40-8d8e-e578b84ea761 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:35:33.804888 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17106c1b-5829-4a40-8474-9b8204d3defb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:35:33.805498 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17106c1b-5829-4a40-8474-9b8204d3defb service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:35:33.805776 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17106c1b-5829-4a40-8474-9b8204d3defb service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:35:33.806060 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17106c1b-5829-4a40-8474-9b8204d3defb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:35:33.815901 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17106c1b-5829-4a40-8474-9b8204d3defb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:35:33.817370 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17106c1b-5829-4a40-8474-9b8204d3defb service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:35:33.828209 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4420/8860] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:35:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:35:37.697602 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9b87b-19e5-4fe2-8ed9-5751a8fbe777 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:35:37.698484 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9b87b-19e5-4fe2-8ed9-5751a8fbe777 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:35:37.699308 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9b87b-19e5-4fe2-8ed9-5751a8fbe777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:35:37.744221 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-e6d9b87b-19e5-4fe2-8ed9-5751a8fbe777 None None] MFA Rules not processed for user `ea14a64fabd24976a0946f6817d2f679`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:35:37.745350 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e6d9b87b-19e5-4fe2-8ed9-5751a8fbe777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:35:37.827854 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4441/8861] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:35:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:35:37.844699 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17106c1b-5829-4a40-8474-9b8204d3defb service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:35:37.846280 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-17106c1b-5829-4a40-8474-9b8204d3defb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:35:37.940558 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17106c1b-5829-4a40-8474-9b8204d3defb service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:35:37.947305 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f991c-ddd9-4198-b249-2bb150b9f6bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:35:37.947924 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f991c-ddd9-4198-b249-2bb150b9f6bd service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:35:37.948200 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f991c-ddd9-4198-b249-2bb150b9f6bd service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:35:37.948469 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f991c-ddd9-4198-b249-2bb150b9f6bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:35:37.957449 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f991c-ddd9-4198-b249-2bb150b9f6bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:35:37.959136 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f991c-ddd9-4198-b249-2bb150b9f6bd service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:35:37.969921 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4421/8862] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:35:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:35:39.702907 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255079b-00cd-488d-9803-c0e3c0eeec37 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:35:39.703449 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255079b-00cd-488d-9803-c0e3c0eeec37 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:35:39.703449 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255079b-00cd-488d-9803-c0e3c0eeec37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:35:39.722937 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-8255079b-00cd-488d-9803-c0e3c0eeec37 None None] MFA Rules not processed for user `ea14a64fabd24976a0946f6817d2f679`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:35:39.724415 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8255079b-00cd-488d-9803-c0e3c0eeec37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:35:39.731653 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4442/8863] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:35:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:35:46.562290 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a168f0-9fcd-4d1d-a192-35a9d4a40911 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:35:46.562853 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a168f0-9fcd-4d1d-a192-35a9d4a40911 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:35:46.562853 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a168f0-9fcd-4d1d-a192-35a9d4a40911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:35:46.611784 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-59a168f0-9fcd-4d1d-a192-35a9d4a40911 None None] MFA Rules not processed for user `253947a5ef294d2bb828761873251bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:35:46.613583 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-59a168f0-9fcd-4d1d-a192-35a9d4a40911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:35:46.626870 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4422/8864] 10.222.0.83 () {58 vars in 1059 bytes} [Mon Aug 29 16:35:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:35:48.976270 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf14d28-07f2-4ff4-9d21-05522a8fe525 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:35:48.976807 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf14d28-07f2-4ff4-9d21-05522a8fe525 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:35:48.976807 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf14d28-07f2-4ff4-9d21-05522a8fe525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:35:48.998947 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-cbf14d28-07f2-4ff4-9d21-05522a8fe525 None None] MFA Rules not processed for user `253947a5ef294d2bb828761873251bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:35:49.000357 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-cbf14d28-07f2-4ff4-9d21-05522a8fe525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:35:49.010431 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4443/8865] 10.222.0.83 () {58 vars in 1059 bytes} [Mon Aug 29 16:35:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:35:49.187622 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898740c-5fca-4c60-a8d7-a2e924e60999 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:35:49.188165 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898740c-5fca-4c60-a8d7-a2e924e60999 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:35:49.188165 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898740c-5fca-4c60-a8d7-a2e924e60999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:35:49.208034 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-f898740c-5fca-4c60-a8d7-a2e924e60999 None None] MFA Rules not processed for user `253947a5ef294d2bb828761873251bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:35:49.209228 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f898740c-5fca-4c60-a8d7-a2e924e60999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:35:49.218514 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4423/8866] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 16:35:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:35:49.229305 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf14d28-07f2-4ff4-9d21-05522a8fe525 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:35:49.230632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-cbf14d28-07f2-4ff4-9d21-05522a8fe525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:35:49.242436 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf14d28-07f2-4ff4-9d21-05522a8fe525 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:35:49.245954 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87eed40-e998-40ec-ab0f-3310f1bcdbf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:35:49.246549 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87eed40-e998-40ec-ab0f-3310f1bcdbf6 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:35:49.246827 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87eed40-e998-40ec-ab0f-3310f1bcdbf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:35:49.247128 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87eed40-e998-40ec-ab0f-3310f1bcdbf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:35:49.257862 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87eed40-e998-40ec-ab0f-3310f1bcdbf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:35:49.259317 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87eed40-e998-40ec-ab0f-3310f1bcdbf6 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:35:49.270100 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4444/8867] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:35:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:35:59.202962 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=64 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:35:59.265529 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:INSERT=3,keystone:SELECT=78 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:36:20.179149 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c4229-fa1e-49cf-8b4b-b69c632e3de7 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:36:20.179733 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c4229-fa1e-49cf-8b4b-b69c632e3de7 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:36:20.179733 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c4229-fa1e-49cf-8b4b-b69c632e3de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:36:20.209238 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-e63c4229-fa1e-49cf-8b4b-b69c632e3de7 None None] MFA Rules not processed for user `253947a5ef294d2bb828761873251bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:36:20.210372 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e63c4229-fa1e-49cf-8b4b-b69c632e3de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:36:20.261431 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4424/8868] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 16:36:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:36:20.272780 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87eed40-e998-40ec-ab0f-3310f1bcdbf6 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:36:20.292963 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87eed40-e998-40ec-ab0f-3310f1bcdbf6 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:36:20.297491 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78e14d-d640-41b7-b06b-4a8fa7957ee8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:36:20.298093 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78e14d-d640-41b7-b06b-4a8fa7957ee8 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:36:20.298370 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78e14d-d640-41b7-b06b-4a8fa7957ee8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:36:20.298638 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78e14d-d640-41b7-b06b-4a8fa7957ee8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:36:20.308908 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78e14d-d640-41b7-b06b-4a8fa7957ee8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:36:20.310989 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78e14d-d640-41b7-b06b-4a8fa7957ee8 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:36:20.322057 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4445/8869] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:36:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:36:22.064506 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b242f5-b581-4fab-af53-69b83d1c6738 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:36:22.065081 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b242f5-b581-4fab-af53-69b83d1c6738 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:36:22.065081 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b242f5-b581-4fab-af53-69b83d1c6738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:36:22.110448 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-f7b242f5-b581-4fab-af53-69b83d1c6738 None None] MFA Rules not processed for user `9a84bb38f6454574897120223b8fc140`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:36:22.111722 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f7b242f5-b581-4fab-af53-69b83d1c6738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:36:22.118444 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4425/8870] 10.222.0.77 () {58 vars in 1015 bytes} [Mon Aug 29 16:36:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:36:22.130229 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78e14d-d640-41b7-b06b-4a8fa7957ee8 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:36:22.139420 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78e14d-d640-41b7-b06b-4a8fa7957ee8 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:36:22.143114 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e39182-22d9-4eaf-9b34-9c2893778fad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:36:22.143717 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e39182-22d9-4eaf-9b34-9c2893778fad service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:36:22.143995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e39182-22d9-4eaf-9b34-9c2893778fad service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:36:22.144265 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e39182-22d9-4eaf-9b34-9c2893778fad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:36:22.151699 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e39182-22d9-4eaf-9b34-9c2893778fad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:36:22.153140 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e39182-22d9-4eaf-9b34-9c2893778fad service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:36:22.161721 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4446/8871] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:36:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:36:32.107897 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=34 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:36:32.158218 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=17 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:36:34.883734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84045e55-27b8-4669-87e6-1a858b38f37f None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:36:34.884135 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84045e55-27b8-4669-87e6-1a858b38f37f None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:36:34.884333 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84045e55-27b8-4669-87e6-1a858b38f37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:36:34.906688 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-84045e55-27b8-4669-87e6-1a858b38f37f None None] MFA Rules not processed for user `9a84bb38f6454574897120223b8fc140`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:36:34.907951 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-84045e55-27b8-4669-87e6-1a858b38f37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:36:34.914681 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4426/8872] 10.222.0.78 () {58 vars in 1015 bytes} [Mon Aug 29 16:36:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:36:34.926663 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e39182-22d9-4eaf-9b34-9c2893778fad service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:36:34.935463 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e39182-22d9-4eaf-9b34-9c2893778fad service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:36:34.939163 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c7ee8-ee6a-453e-be14-dc1a1d469941 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:36:34.939771 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c7ee8-ee6a-453e-be14-dc1a1d469941 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:36:34.940043 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c7ee8-ee6a-453e-be14-dc1a1d469941 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:36:34.940310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c7ee8-ee6a-453e-be14-dc1a1d469941 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:36:34.948253 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c7ee8-ee6a-453e-be14-dc1a1d469941 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:36:34.950186 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c7ee8-ee6a-453e-be14-dc1a1d469941 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:36:34.958574 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4447/8873] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:36:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:36:35.379345 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bece141-e642-4fd6-918a-4c4a0a803b7d None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:36:35.379708 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bece141-e642-4fd6-918a-4c4a0a803b7d None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:36:35.380079 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bece141-e642-4fd6-918a-4c4a0a803b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:36:35.402242 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-9bece141-e642-4fd6-918a-4c4a0a803b7d None None] MFA Rules not processed for user `253947a5ef294d2bb828761873251bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:36:35.403629 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9bece141-e642-4fd6-918a-4c4a0a803b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:36:35.413255 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4427/8874] 10.222.0.83 () {58 vars in 1018 bytes} [Mon Aug 29 16:36:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:36:35.455557 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c7ee8-ee6a-453e-be14-dc1a1d469941 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:36:35.469421 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c7ee8-ee6a-453e-be14-dc1a1d469941 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:36:35.475148 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e64b30a-ca39-4d39-b67f-a1d897f059c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:36:35.475786 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e64b30a-ca39-4d39-b67f-a1d897f059c3 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:36:35.476059 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e64b30a-ca39-4d39-b67f-a1d897f059c3 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:36:35.476326 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e64b30a-ca39-4d39-b67f-a1d897f059c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:36:35.486357 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e64b30a-ca39-4d39-b67f-a1d897f059c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:36:35.488013 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e64b30a-ca39-4d39-b67f-a1d897f059c3 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:36:35.498840 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4448/8875] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:36:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:36:42.480685 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47c380-2559-44b1-9d86-dd8d4e48aa4d None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:36:42.481469 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47c380-2559-44b1-9d86-dd8d4e48aa4d None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:36:42.481469 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47c380-2559-44b1-9d86-dd8d4e48aa4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:36:42.504057 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-1a47c380-2559-44b1-9d86-dd8d4e48aa4d None None] MFA Rules not processed for user `253947a5ef294d2bb828761873251bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:36:42.505290 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1a47c380-2559-44b1-9d86-dd8d4e48aa4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:36:42.515650 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4428/8876] 10.222.0.83 () {58 vars in 1018 bytes} [Mon Aug 29 16:36:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:36:42.532583 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e64b30a-ca39-4d39-b67f-a1d897f059c3 service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:36:42.545930 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e64b30a-ca39-4d39-b67f-a1d897f059c3 service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:36:42.552914 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260750fa-41cf-4534-8fe1-3d91b3754215 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:36:42.553660 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260750fa-41cf-4534-8fe1-3d91b3754215 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:36:42.553946 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260750fa-41cf-4534-8fe1-3d91b3754215 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:36:42.554203 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260750fa-41cf-4534-8fe1-3d91b3754215 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:36:42.564470 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260750fa-41cf-4534-8fe1-3d91b3754215 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:36:42.566082 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260750fa-41cf-4534-8fe1-3d91b3754215 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:36:42.577687 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4449/8877] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:36:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:36:45.466489 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdb191-b52d-4fec-a392-30c8d9548a58 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:36:45.466960 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdb191-b52d-4fec-a392-30c8d9548a58 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:36:45.467313 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdb191-b52d-4fec-a392-30c8d9548a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:36:45.490225 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-6dfdb191-b52d-4fec-a392-30c8d9548a58 None None] MFA Rules not processed for user `ea14a64fabd24976a0946f6817d2f679`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:36:45.492674 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6dfdb191-b52d-4fec-a392-30c8d9548a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:36:45.503512 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4429/8878] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:36:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:36:45.830673 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f15d8-5a93-4ce1-85d9-ec7baac355d8 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:36:45.831696 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f15d8-5a93-4ce1-85d9-ec7baac355d8 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:36:45.831696 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f15d8-5a93-4ce1-85d9-ec7baac355d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:36:45.852433 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-387f15d8-5a93-4ce1-85d9-ec7baac355d8 None None] MFA Rules not processed for user `9a84bb38f6454574897120223b8fc140`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:36:45.853675 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-387f15d8-5a93-4ce1-85d9-ec7baac355d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:36:45.861433 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4450/8879] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 16:36:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:36:45.873535 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfdb191-b52d-4fec-a392-30c8d9548a58 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:36:45.883165 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfdb191-b52d-4fec-a392-30c8d9548a58 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:36:45.886891 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb13234-3cdd-4c85-bbb6-e9fa34d9526d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:36:45.887535 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb13234-3cdd-4c85-bbb6-e9fa34d9526d service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:36:45.887815 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb13234-3cdd-4c85-bbb6-e9fa34d9526d service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:36:45.888091 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb13234-3cdd-4c85-bbb6-e9fa34d9526d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:36:45.895404 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb13234-3cdd-4c85-bbb6-e9fa34d9526d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:36:45.896780 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb13234-3cdd-4c85-bbb6-e9fa34d9526d service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:36:45.905252 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4430/8880] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:36:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:36:55.846936 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=21 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:36:55.901127 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=18 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:38:21.312690 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d136b4c-3300-4d60-a47c-476da4e4882e None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:38:21.313964 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d136b4c-3300-4d60-a47c-476da4e4882e None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:38:21.313964 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d136b4c-3300-4d60-a47c-476da4e4882e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:38:21.356409 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-6d136b4c-3300-4d60-a47c-476da4e4882e None None] MFA Rules not processed for user `9a84bb38f6454574897120223b8fc140`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:38:21.357625 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6d136b4c-3300-4d60-a47c-476da4e4882e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:38:21.374992 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4451/8881] 10.222.0.83 () {58 vars in 1018 bytes} [Mon Aug 29 16:38:21 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:38:21.394391 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb13234-3cdd-4c85-bbb6-e9fa34d9526d service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:38:21.413750 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb13234-3cdd-4c85-bbb6-e9fa34d9526d service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:38:21.417356 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c07ad-3a8a-45e2-baa9-1b8151295212 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:38:21.417954 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c07ad-3a8a-45e2-baa9-1b8151295212 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:38:21.418232 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c07ad-3a8a-45e2-baa9-1b8151295212 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:38:21.418501 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c07ad-3a8a-45e2-baa9-1b8151295212 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:38:21.426647 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449c07ad-3a8a-45e2-baa9-1b8151295212 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:38:21.428118 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449c07ad-3a8a-45e2-baa9-1b8151295212 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:38:21.436204 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4431/8882] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:38:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:38:21.513374 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d136b4c-3300-4d60-a47c-476da4e4882e None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:38:21.514886 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6d136b4c-3300-4d60-a47c-476da4e4882e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:38:21.597001 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d136b4c-3300-4d60-a47c-476da4e4882e None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:38:21.601916 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba82421-c201-436b-b937-efafa5cda76b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:38:21.602523 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba82421-c201-436b-b937-efafa5cda76b service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:38:21.602800 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba82421-c201-436b-b937-efafa5cda76b service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:38:21.603100 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba82421-c201-436b-b937-efafa5cda76b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:38:21.604820 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1ba82421-c201-436b-b937-efafa5cda76b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:38:21.616834 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba82421-c201-436b-b937-efafa5cda76b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:38:21.618410 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba82421-c201-436b-b937-efafa5cda76b service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:38:21.628236 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4452/8883] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:38:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:38:21.801910 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23321481-808c-419d-99eb-5673007788eb None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:38:21.802196 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23321481-808c-419d-99eb-5673007788eb None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:38:21.802468 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23321481-808c-419d-99eb-5673007788eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:38:21.834222 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-23321481-808c-419d-99eb-5673007788eb None None] MFA Rules not processed for user `253947a5ef294d2bb828761873251bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:38:21.835460 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-23321481-808c-419d-99eb-5673007788eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:38:21.861007 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4432/8884] 10.222.0.83 () {58 vars in 1018 bytes} [Mon Aug 29 16:38:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:38:21.870872 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba82421-c201-436b-b937-efafa5cda76b service placement] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:38:21.880944 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba82421-c201-436b-b937-efafa5cda76b service placement] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:38:21.884446 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69e04f-db18-4563-842d-514e0ecd9a20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:38:21.885036 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69e04f-db18-4563-842d-514e0ecd9a20 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:38:21.885312 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69e04f-db18-4563-842d-514e0ecd9a20 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:38:21.885580 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69e04f-db18-4563-842d-514e0ecd9a20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:38:21.895622 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb69e04f-db18-4563-842d-514e0ecd9a20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:38:21.897033 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb69e04f-db18-4563-842d-514e0ecd9a20 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:38:21.907878 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4453/8885] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:38:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:38:21.968428 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23321481-808c-419d-99eb-5673007788eb None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:38:21.980851 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23321481-808c-419d-99eb-5673007788eb None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:38:21.986824 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff4f592-f420-4a54-9d84-ba1221796bdd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:38:21.987460 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4f592-f420-4a54-9d84-ba1221796bdd service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:38:21.987747 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4f592-f420-4a54-9d84-ba1221796bdd service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:38:21.988022 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4f592-f420-4a54-9d84-ba1221796bdd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:38:21.989797 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-aff4f592-f420-4a54-9d84-ba1221796bdd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:38:22.001877 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff4f592-f420-4a54-9d84-ba1221796bdd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:38:22.004125 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff4f592-f420-4a54-9d84-ba1221796bdd service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:38:22.015629 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4433/8886] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:38:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:38:26.226145 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992772b-6399-4ba2-b685-a489e48a20f9 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:38:26.226666 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992772b-6399-4ba2-b685-a489e48a20f9 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:38:26.226943 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992772b-6399-4ba2-b685-a489e48a20f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:38:26.247926 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-4992772b-6399-4ba2-b685-a489e48a20f9 None None] MFA Rules not processed for user `253947a5ef294d2bb828761873251bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:38:26.249141 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4992772b-6399-4ba2-b685-a489e48a20f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:38:26.265842 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4454/8887] 10.222.0.83 () {58 vars in 1018 bytes} [Mon Aug 29 16:38:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:38:26.300191 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff4f592-f420-4a54-9d84-ba1221796bdd service placement] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:38:26.320533 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff4f592-f420-4a54-9d84-ba1221796bdd service placement] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:38:26.326237 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d637e92-801d-4f17-8b73-6ec540449afa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:38:26.326847 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d637e92-801d-4f17-8b73-6ec540449afa service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:38:26.327392 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d637e92-801d-4f17-8b73-6ec540449afa service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:38:26.327672 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d637e92-801d-4f17-8b73-6ec540449afa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:38:26.337301 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d637e92-801d-4f17-8b73-6ec540449afa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:38:26.339461 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d637e92-801d-4f17-8b73-6ec540449afa service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:38:26.351567 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4434/8888] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:38:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:38:36.242736 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=62 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:38:36.346181 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=37 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:38:37.679830 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4992772b-6399-4ba2-b685-a489e48a20f9 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:38:37.692879 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4992772b-6399-4ba2-b685-a489e48a20f9 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:38:37.698092 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a567d-1b69-4c5f-a50d-9d31785721ca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:38:37.698848 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a567d-1b69-4c5f-a50d-9d31785721ca service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:38:37.699173 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a567d-1b69-4c5f-a50d-9d31785721ca service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:38:37.699489 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a567d-1b69-4c5f-a50d-9d31785721ca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:38:37.701439 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-822a567d-1b69-4c5f-a50d-9d31785721ca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:38:37.713986 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a567d-1b69-4c5f-a50d-9d31785721ca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:38:37.715695 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a567d-1b69-4c5f-a50d-9d31785721ca service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:38:37.726509 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4455/8889] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:38:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:38:38.996181 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745c73d-065f-48f5-ac75-52f3075207e8 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:38:38.996647 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745c73d-065f-48f5-ac75-52f3075207e8 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:38:38.996736 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745c73d-065f-48f5-ac75-52f3075207e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:38:39.017491 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-2745c73d-065f-48f5-ac75-52f3075207e8 None None] MFA Rules not processed for user `ea14a64fabd24976a0946f6817d2f679`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:38:39.018730 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2745c73d-065f-48f5-ac75-52f3075207e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:38:39.025780 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4435/8890] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:38:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:38:39.345385 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f659f06-db5e-45a6-849a-087be0dc06ad None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:38:39.346356 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f659f06-db5e-45a6-849a-087be0dc06ad None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:38:39.346356 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f659f06-db5e-45a6-849a-087be0dc06ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:38:39.366481 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-7f659f06-db5e-45a6-849a-087be0dc06ad None None] MFA Rules not processed for user `9a84bb38f6454574897120223b8fc140`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:38:39.367718 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7f659f06-db5e-45a6-849a-087be0dc06ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:38:39.374449 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4456/8891] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 16:38:39 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:38:39.387867 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745c73d-065f-48f5-ac75-52f3075207e8 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:38:39.398631 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745c73d-065f-48f5-ac75-52f3075207e8 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:38:39.402845 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0890c9f-2e79-42ad-823f-dfec50c7d39a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:38:39.403555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0890c9f-2e79-42ad-823f-dfec50c7d39a service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:38:39.403873 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0890c9f-2e79-42ad-823f-dfec50c7d39a service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:38:39.404259 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0890c9f-2e79-42ad-823f-dfec50c7d39a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:38:39.413243 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0890c9f-2e79-42ad-823f-dfec50c7d39a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:38:39.415216 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0890c9f-2e79-42ad-823f-dfec50c7d39a service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:38:39.423789 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4436/8892] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:38:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:38:39.800707 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5395d-6e17-4b97-a8a2-5ad48e54d16c None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:38:39.801333 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5395d-6e17-4b97-a8a2-5ad48e54d16c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:38:39.801333 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5395d-6e17-4b97-a8a2-5ad48e54d16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:38:39.857834 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-f3f5395d-6e17-4b97-a8a2-5ad48e54d16c None None] MFA Rules not processed for user `c190fa4a280c41c684130e069bee99eb`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:38:39.859118 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f3f5395d-6e17-4b97-a8a2-5ad48e54d16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:38:39.869472 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4457/8893] 10.222.0.83 () {58 vars in 1058 bytes} [Mon Aug 29 16:38:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:38:39.878305 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0890c9f-2e79-42ad-823f-dfec50c7d39a service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:38:39.895644 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0890c9f-2e79-42ad-823f-dfec50c7d39a service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:38:39.905050 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5997f14-fd59-4713-85fe-15dfa4a0771a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:38:39.905676 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5997f14-fd59-4713-85fe-15dfa4a0771a service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:38:39.905958 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5997f14-fd59-4713-85fe-15dfa4a0771a service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:38:39.906298 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5997f14-fd59-4713-85fe-15dfa4a0771a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:38:39.908396 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a5997f14-fd59-4713-85fe-15dfa4a0771a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:38:39.920873 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5997f14-fd59-4713-85fe-15dfa4a0771a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:38:39.922467 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5997f14-fd59-4713-85fe-15dfa4a0771a service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:38:39.934437 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4437/8894] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:38:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:38:49.853362 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=18 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:38:49.929480 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=15 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:39:23.437296 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f5395d-6e17-4b97-a8a2-5ad48e54d16c None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:39:23.448496 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f5395d-6e17-4b97-a8a2-5ad48e54d16c None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:39:23.453743 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ccba55-38c8-4f62-a367-37d05d350981 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:39:23.454352 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ccba55-38c8-4f62-a367-37d05d350981 service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:39:23.454636 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ccba55-38c8-4f62-a367-37d05d350981 service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:39:23.454913 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ccba55-38c8-4f62-a367-37d05d350981 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:39:23.457530 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-52ccba55-38c8-4f62-a367-37d05d350981 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:39:23.468971 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ccba55-38c8-4f62-a367-37d05d350981 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:39:23.470565 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ccba55-38c8-4f62-a367-37d05d350981 service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:39:23.481414 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4458/8895] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:39:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:39:33.477100 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=6 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:39:57.087203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efce0a-6609-4ec2-aaf1-43502f3c2579 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:39:57.087721 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efce0a-6609-4ec2-aaf1-43502f3c2579 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:39:57.087721 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efce0a-6609-4ec2-aaf1-43502f3c2579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:39:57.107289 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-56efce0a-6609-4ec2-aaf1-43502f3c2579 None None] MFA Rules not processed for user `ea14a64fabd24976a0946f6817d2f679`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:39:57.108409 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-56efce0a-6609-4ec2-aaf1-43502f3c2579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:39:57.115495 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4438/8896] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:39:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:40:07.102244 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:41:24.382019 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7950c8-238c-47e8-ad58-b6c0a2d356f4 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:41:24.382538 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7950c8-238c-47e8-ad58-b6c0a2d356f4 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:41:24.382644 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7950c8-238c-47e8-ad58-b6c0a2d356f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:41:24.432879 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-7a7950c8-238c-47e8-ad58-b6c0a2d356f4 None None] MFA Rules not processed for user `fd42634b2795427cba6614c53491ded2`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:41:24.434080 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7a7950c8-238c-47e8-ad58-b6c0a2d356f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:41:24.495425 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4459/8897] 10.222.0.83 () {58 vars in 1061 bytes} [Mon Aug 29 16:41:24 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:41:24.501339 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56efce0a-6609-4ec2-aaf1-43502f3c2579 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:41:24.511269 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56efce0a-6609-4ec2-aaf1-43502f3c2579 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:41:24.515179 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dda6c9-ffcb-4620-ab4d-209f8fa943de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:41:24.515604 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dda6c9-ffcb-4620-ab4d-209f8fa943de service cinder] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:41:24.516176 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dda6c9-ffcb-4620-ab4d-209f8fa943de service cinder] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:41:24.516176 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dda6c9-ffcb-4620-ab4d-209f8fa943de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:41:24.525452 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dda6c9-ffcb-4620-ab4d-209f8fa943de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:41:24.527235 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dda6c9-ffcb-4620-ab4d-209f8fa943de service cinder] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:41:24.536748 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4439/8898] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:41:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:41:25.952458 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7950c8-238c-47e8-ad58-b6c0a2d356f4 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:41:25.962420 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7950c8-238c-47e8-ad58-b6c0a2d356f4 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:41:25.966051 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe7f0d-c10e-41a8-9e43-97cd3e3f0b3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:41:25.966653 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe7f0d-c10e-41a8-9e43-97cd3e3f0b3d service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:41:25.966937 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe7f0d-c10e-41a8-9e43-97cd3e3f0b3d service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:41:25.967256 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe7f0d-c10e-41a8-9e43-97cd3e3f0b3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:41:25.977983 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe7f0d-c10e-41a8-9e43-97cd3e3f0b3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:41:25.979450 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe7f0d-c10e-41a8-9e43-97cd3e3f0b3d service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:41:25.990432 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4460/8899] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:41:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:41:26.189984 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dda6c9-ffcb-4620-ab4d-209f8fa943de service cinder] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:41:26.191424 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-22dda6c9-ffcb-4620-ab4d-209f8fa943de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:41:26.203452 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dda6c9-ffcb-4620-ab4d-209f8fa943de service cinder] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:41:26.207099 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd39e417-1d8e-4320-9e69-9884a46f2922 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:41:26.207695 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39e417-1d8e-4320-9e69-9884a46f2922 service cinder] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:41:26.208507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39e417-1d8e-4320-9e69-9884a46f2922 service cinder] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:41:26.208823 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39e417-1d8e-4320-9e69-9884a46f2922 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:41:26.218909 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd39e417-1d8e-4320-9e69-9884a46f2922 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:41:26.220406 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd39e417-1d8e-4320-9e69-9884a46f2922 service cinder] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:41:26.231939 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4440/8900] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:41:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:41:35.985709 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=44 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:41:36.227296 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=12 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:41:38.620653 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe7f0d-c10e-41a8-9e43-97cd3e3f0b3d service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:41:38.630000 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe7f0d-c10e-41a8-9e43-97cd3e3f0b3d service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:41:38.634036 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e7500-75af-4c0d-885a-9c34a1936a8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:41:38.634641 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e7500-75af-4c0d-885a-9c34a1936a8a service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:41:38.634925 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e7500-75af-4c0d-885a-9c34a1936a8a service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:41:38.635269 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e7500-75af-4c0d-885a-9c34a1936a8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:41:38.642841 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e7500-75af-4c0d-885a-9c34a1936a8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:41:38.644314 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e7500-75af-4c0d-885a-9c34a1936a8a service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:41:38.653177 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4461/8901] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:41:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:41:48.649672 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=6 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:41:58.695990 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd39e417-1d8e-4320-9e69-9884a46f2922 service cinder] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:41:58.706196 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd39e417-1d8e-4320-9e69-9884a46f2922 service cinder] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:41:58.710186 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b2a4a6-2db6-498f-828c-a6e1b1aec886 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:41:58.710782 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2a4a6-2db6-498f-828c-a6e1b1aec886 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:41:58.711091 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2a4a6-2db6-498f-828c-a6e1b1aec886 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:41:58.711367 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2a4a6-2db6-498f-828c-a6e1b1aec886 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:41:58.718376 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b2a4a6-2db6-498f-828c-a6e1b1aec886 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:41:58.719837 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b2a4a6-2db6-498f-828c-a6e1b1aec886 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:41:58.727809 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4441/8902] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:41:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:42:08.724424 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=6 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:42:15.197774 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e7500-75af-4c0d-885a-9c34a1936a8a service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:42:15.219745 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e7500-75af-4c0d-885a-9c34a1936a8a service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:42:15.226175 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e617dc4-1aad-4a3d-aa0f-3ee7ffc30dc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:42:15.226788 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e617dc4-1aad-4a3d-aa0f-3ee7ffc30dc2 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:42:15.227092 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e617dc4-1aad-4a3d-aa0f-3ee7ffc30dc2 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:42:15.227371 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e617dc4-1aad-4a3d-aa0f-3ee7ffc30dc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:42:15.239634 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e617dc4-1aad-4a3d-aa0f-3ee7ffc30dc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:42:15.241268 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e617dc4-1aad-4a3d-aa0f-3ee7ffc30dc2 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:42:15.252496 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4462/8903] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:42:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:42:18.638784 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b2a4a6-2db6-498f-828c-a6e1b1aec886 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:42:18.652591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b2a4a6-2db6-498f-828c-a6e1b1aec886 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:42:18.659232 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b2e01-3fa3-4b0d-a367-555299a4b534 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:42:18.659882 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b2e01-3fa3-4b0d-a367-555299a4b534 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:42:18.660167 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b2e01-3fa3-4b0d-a367-555299a4b534 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:42:18.660438 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b2e01-3fa3-4b0d-a367-555299a4b534 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:42:18.669852 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b2e01-3fa3-4b0d-a367-555299a4b534 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:42:18.671480 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b2e01-3fa3-4b0d-a367-555299a4b534 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:42:18.682436 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4442/8904] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:42:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:42:25.248034 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=6 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:42:28.677704 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=6 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:42:46.504515 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e617dc4-1aad-4a3d-aa0f-3ee7ffc30dc2 service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:42:46.514013 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e617dc4-1aad-4a3d-aa0f-3ee7ffc30dc2 service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:42:46.517583 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a01030-a415-4532-9335-8c51a02bfce0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:42:46.518273 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a01030-a415-4532-9335-8c51a02bfce0 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:42:46.518553 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a01030-a415-4532-9335-8c51a02bfce0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:42:46.518828 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a01030-a415-4532-9335-8c51a02bfce0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:42:46.527866 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a01030-a415-4532-9335-8c51a02bfce0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:42:46.529293 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a01030-a415-4532-9335-8c51a02bfce0 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:42:46.558527 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4463/8905] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:42:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:42:49.793151 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a66d0-8233-4b4e-8818-170ecba6ad83 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:42:49.793670 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a66d0-8233-4b4e-8818-170ecba6ad83 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:42:49.793834 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a66d0-8233-4b4e-8818-170ecba6ad83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:42:49.816918 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-9c9a66d0-8233-4b4e-8818-170ecba6ad83 None None] MFA Rules not processed for user `c190fa4a280c41c684130e069bee99eb`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:42:49.818319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9c9a66d0-8233-4b4e-8818-170ecba6ad83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:42:49.846776 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4443/8906] 10.222.0.83 () {58 vars in 1018 bytes} [Mon Aug 29 16:42:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:42:49.860028 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a01030-a415-4532-9335-8c51a02bfce0 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:42:49.872874 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a01030-a415-4532-9335-8c51a02bfce0 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:42:49.878942 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed0b95-f586-4250-b613-eb12896925f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:42:49.879323 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed0b95-f586-4250-b613-eb12896925f8 service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:42:49.879604 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed0b95-f586-4250-b613-eb12896925f8 service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:42:49.879869 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed0b95-f586-4250-b613-eb12896925f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:42:49.885407 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a66d0-8233-4b4e-8818-170ecba6ad83 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:42:49.892097 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed0b95-f586-4250-b613-eb12896925f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:42:49.894096 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed0b95-f586-4250-b613-eb12896925f8 service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:42:49.898327 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a66d0-8233-4b4e-8818-170ecba6ad83 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:42:49.903707 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55b3bd-9141-4123-8055-196b2e0c0338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:42:49.904355 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55b3bd-9141-4123-8055-196b2e0c0338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:42:49.904645 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55b3bd-9141-4123-8055-196b2e0c0338 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:42:49.904923 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55b3bd-9141-4123-8055-196b2e0c0338 admin admin] PATH_INFO: `/v3/users/ea14a64fabd24976a0946f6817d2f679` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:42:49.906122 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae55b3bd-9141-4123-8055-196b2e0c0338 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea14a64fabd24976a0946f6817d2f679)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:42:49.908157 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae55b3bd-9141-4123-8055-196b2e0c0338 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:42:49.914260 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4464/8907] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:42:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:42:49.966556 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ae55b3bd-9141-4123-8055-196b2e0c0338 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea14a64fabd24976a0946f6817d2f679'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:42:49.967264 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ae55b3bd-9141-4123-8055-196b2e0c0338 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea14a64fabd24976a0946f6817d2f679'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:42:49.980709 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ae55b3bd-9141-4123-8055-196b2e0c0338 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea14a64fabd24976a0946f6817d2f679'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:42:49.988493 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ae55b3bd-9141-4123-8055-196b2e0c0338 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea14a64fabd24976a0946f6817d2f679'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:42:49.996399 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-ae55b3bd-9141-4123-8055-196b2e0c0338 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea14a64fabd24976a0946f6817d2f679'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:42:50.003297 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4444/8908] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:42:49 2022] DELETE /identity/v3/users/ea14a64fabd24976a0946f6817d2f679 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:42:50.179027 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed0b95-f586-4250-b613-eb12896925f8 service placement] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:42:50.190643 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed0b95-f586-4250-b613-eb12896925f8 service placement] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:42:50.248474 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d43cff-2438-499d-8dc9-a88e6fd63a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:42:50.249101 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d43cff-2438-499d-8dc9-a88e6fd63a90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:42:50.249383 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d43cff-2438-499d-8dc9-a88e6fd63a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:42:50.249654 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d43cff-2438-499d-8dc9-a88e6fd63a90 admin admin] PATH_INFO: `/v3/projects/fe2904332eef460b8b57f38b445a30aa` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:42:50.250788 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d43cff-2438-499d-8dc9-a88e6fd63a90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe2904332eef460b8b57f38b445a30aa)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:42:50.252913 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d43cff-2438-499d-8dc9-a88e6fd63a90 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:42:50.300228 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-43d43cff-2438-499d-8dc9-a88e6fd63a90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe2904332eef460b8b57f38b445a30aa', 'request_id': 'req-43d43cff-2438-499d-8dc9-a88e6fd63a90'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:42:50.305475 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-43d43cff-2438-499d-8dc9-a88e6fd63a90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe2904332eef460b8b57f38b445a30aa', 'request_id': 'req-43d43cff-2438-499d-8dc9-a88e6fd63a90'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:42:50.312136 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-43d43cff-2438-499d-8dc9-a88e6fd63a90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe2904332eef460b8b57f38b445a30aa', 'request_id': 'req-43d43cff-2438-499d-8dc9-a88e6fd63a90'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:42:50.337544 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-43d43cff-2438-499d-8dc9-a88e6fd63a90 admin admin] The token cache is being invalidate because project fe2904332eef460b8b57f38b445a30aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:42:50.337840 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-43d43cff-2438-499d-8dc9-a88e6fd63a90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:42:50.338475 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-43d43cff-2438-499d-8dc9-a88e6fd63a90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:42:50.340098 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4465/8909] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:42:50 2022] DELETE /identity/v3/projects/fe2904332eef460b8b57f38b445a30aa => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:42:50.345074 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bad0f-1d1a-4445-bf71-ae0be4c0037e None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:42:50.345363 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bad0f-1d1a-4445-bf71-ae0be4c0037e None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:42:50.345640 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bad0f-1d1a-4445-bf71-ae0be4c0037e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:42:50.394383 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-e51bad0f-1d1a-4445-bf71-ae0be4c0037e None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:42:50.395672 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e51bad0f-1d1a-4445-bf71-ae0be4c0037e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:42:50.454995 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4445/8910] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:42:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:42:50.520391 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d6e2f-23d0-4412-be03-45352356c4f7 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:42:50.520673 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d6e2f-23d0-4412-be03-45352356c4f7 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:42:50.520947 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d6e2f-23d0-4412-be03-45352356c4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:42:50.540876 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-4f0d6e2f-23d0-4412-be03-45352356c4f7 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:42:50.542062 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4f0d6e2f-23d0-4412-be03-45352356c4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:42:50.550291 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4466/8911] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:42:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:42:50.554117 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51bad0f-1d1a-4445-bf71-ae0be4c0037e None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:42:50.564020 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51bad0f-1d1a-4445-bf71-ae0be4c0037e None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:42:50.569135 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78854613-6fa7-4b3f-8934-a966691d0a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:42:50.569748 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78854613-6fa7-4b3f-8934-a966691d0a19 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:42:50.570029 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78854613-6fa7-4b3f-8934-a966691d0a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:42:50.570304 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78854613-6fa7-4b3f-8934-a966691d0a19 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:42:50.570956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78854613-6fa7-4b3f-8934-a966691d0a19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:42:50.571294 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78854613-6fa7-4b3f-8934-a966691d0a19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:42:50.572914 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78854613-6fa7-4b3f-8934-a966691d0a19 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:42:50.586337 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4446/8912] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:42:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:42:50.590613 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d6e2f-23d0-4412-be03-45352356c4f7 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:42:50.600550 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d6e2f-23d0-4412-be03-45352356c4f7 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:42:50.605273 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8e7b1-ca0d-4ebe-99f9-acd8e1c42f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:42:50.605874 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8e7b1-ca0d-4ebe-99f9-acd8e1c42f1e admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:42:50.606156 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8e7b1-ca0d-4ebe-99f9-acd8e1c42f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:42:50.606429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8e7b1-ca0d-4ebe-99f9-acd8e1c42f1e admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:42:50.607077 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa8e7b1-ca0d-4ebe-99f9-acd8e1c42f1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:42:50.608992 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa8e7b1-ca0d-4ebe-99f9-acd8e1c42f1e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:42:50.640448 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:42:50.648420 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4467/8913] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:42:50 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:42:50.652435 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78854613-6fa7-4b3f-8934-a966691d0a19 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:42:50.663347 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78854613-6fa7-4b3f-8934-a966691d0a19 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:42:50.682373 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:42:50.724285 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf01375-0702-48f4-8a13-c9ab66348537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:42:50.724903 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf01375-0702-48f4-8a13-c9ab66348537 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:42:50.725186 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf01375-0702-48f4-8a13-c9ab66348537 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:42:50.725462 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf01375-0702-48f4-8a13-c9ab66348537 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:42:50.726111 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf01375-0702-48f4-8a13-c9ab66348537 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:42:50.728151 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf01375-0702-48f4-8a13-c9ab66348537 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:42:50.749630 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4447/8914] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:42:50 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:42:50.754559 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8e7b1-ca0d-4ebe-99f9-acd8e1c42f1e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:42:50.765540 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8e7b1-ca0d-4ebe-99f9-acd8e1c42f1e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:42:50.770295 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6022db9-806d-4802-b8f5-6f5347b3fe64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:42:50.770898 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6022db9-806d-4802-b8f5-6f5347b3fe64 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:42:50.771212 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6022db9-806d-4802-b8f5-6f5347b3fe64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:42:50.771480 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6022db9-806d-4802-b8f5-6f5347b3fe64 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:42:50.772140 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6022db9-806d-4802-b8f5-6f5347b3fe64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:42:50.773724 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6022db9-806d-4802-b8f5-6f5347b3fe64 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:42:50.784711 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4468/8915] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:42:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:42:50.788478 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf01375-0702-48f4-8a13-c9ab66348537 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:42:50.798354 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf01375-0702-48f4-8a13-c9ab66348537 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:42:50.803598 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999fc453-de01-4e67-90ff-b69fe53c0a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:42:50.804210 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999fc453-de01-4e67-90ff-b69fe53c0a8b admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:42:50.804467 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999fc453-de01-4e67-90ff-b69fe53c0a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:42:50.804737 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999fc453-de01-4e67-90ff-b69fe53c0a8b admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:42:50.805379 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999fc453-de01-4e67-90ff-b69fe53c0a8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:42:50.806968 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999fc453-de01-4e67-90ff-b69fe53c0a8b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:42:50.818284 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4448/8916] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:42:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:42:50.822447 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6022db9-806d-4802-b8f5-6f5347b3fe64 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:42:50.833322 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6022db9-806d-4802-b8f5-6f5347b3fe64 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:42:50.838931 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b54960-0fd3-4312-95f9-6b40b09eba3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:42:50.839743 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b54960-0fd3-4312-95f9-6b40b09eba3d admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:42:50.840179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b54960-0fd3-4312-95f9-6b40b09eba3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:42:50.840580 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b54960-0fd3-4312-95f9-6b40b09eba3d admin admin] PATH_INFO: `/v3/projects/8916574f66d44b14922a241d52602a21/users/3822e8832e1d4d09b0b68658e1e7a313/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:42:50.856271 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b54960-0fd3-4312-95f9-6b40b09eba3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8916574f66d44b14922a241d52602a21, user_id=3822e8832e1d4d09b0b68658e1e7a313, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:42:50.858957 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b54960-0fd3-4312-95f9-6b40b09eba3d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:42:50.872336 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4469/8917] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:42:50 2022] PUT /identity/v3/projects/8916574f66d44b14922a241d52602a21/users/3822e8832e1d4d09b0b68658e1e7a313/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:42:50.877616 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db774d-6d55-4049-a0dd-3021e499abb7 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:42:50.877896 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db774d-6d55-4049-a0dd-3021e499abb7 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:42:50.878169 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db774d-6d55-4049-a0dd-3021e499abb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:42:50.896994 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-f7db774d-6d55-4049-a0dd-3021e499abb7 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:42:50.898195 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f7db774d-6d55-4049-a0dd-3021e499abb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:42:50.957898 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4449/8918] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:42:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:42:50.967352 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b54960-0fd3-4312-95f9-6b40b09eba3d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:42:50.969074 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d2b54960-0fd3-4312-95f9-6b40b09eba3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:42:51.025909 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b54960-0fd3-4312-95f9-6b40b09eba3d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:42:51.029634 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff3117-161e-4199-8b01-6bc842844bee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:42:51.030235 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff3117-161e-4199-8b01-6bc842844bee service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:42:51.030510 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff3117-161e-4199-8b01-6bc842844bee service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:42:51.030779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff3117-161e-4199-8b01-6bc842844bee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:42:51.039915 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff3117-161e-4199-8b01-6bc842844bee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:42:51.041332 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff3117-161e-4199-8b01-6bc842844bee service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:42:51.052005 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4470/8919] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:42:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:42:55.257479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c1df4-06e5-4fca-9252-25e6d4586b4d None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:42:55.258044 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c1df4-06e5-4fca-9252-25e6d4586b4d None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:42:55.258044 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c1df4-06e5-4fca-9252-25e6d4586b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:42:55.299492 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-2b1c1df4-06e5-4fca-9252-25e6d4586b4d None None] MFA Rules not processed for user `3822e8832e1d4d09b0b68658e1e7a313`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:42:55.300994 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2b1c1df4-06e5-4fca-9252-25e6d4586b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:42:55.391884 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4450/8920] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:42:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:42:55.400205 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523924c-f65e-4e9b-a267-5f08f4948459 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:42:55.400751 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523924c-f65e-4e9b-a267-5f08f4948459 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:42:55.400751 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523924c-f65e-4e9b-a267-5f08f4948459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:42:55.422106 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-d523924c-f65e-4e9b-a267-5f08f4948459 None None] MFA Rules not processed for user `3822e8832e1d4d09b0b68658e1e7a313`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:42:55.423373 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d523924c-f65e-4e9b-a267-5f08f4948459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:42:55.431431 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4471/8921] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:42:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:42:55.443755 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c1df4-06e5-4fca-9252-25e6d4586b4d None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:42:55.445895 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2b1c1df4-06e5-4fca-9252-25e6d4586b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:42:55.485941 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:42:55.539931 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c1df4-06e5-4fca-9252-25e6d4586b4d None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:42:55.545985 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee6548-68d5-43b7-a4e9-ef1e5aac6da7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:42:55.546618 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee6548-68d5-43b7-a4e9-ef1e5aac6da7 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:42:55.547058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee6548-68d5-43b7-a4e9-ef1e5aac6da7 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:42:55.547355 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee6548-68d5-43b7-a4e9-ef1e5aac6da7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:42:55.557158 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ee6548-68d5-43b7-a4e9-ef1e5aac6da7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:42:55.558791 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ee6548-68d5-43b7-a4e9-ef1e5aac6da7 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:42:55.570404 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4451/8922] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:42:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:43:05.416567 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=44,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:43:05.565885 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=20 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:43:06.908469 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb446c-23d7-45e3-97ef-e1045e12168c None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:43:06.908970 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb446c-23d7-45e3-97ef-e1045e12168c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:43:06.909067 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb446c-23d7-45e3-97ef-e1045e12168c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:43:06.928278 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a4bb446c-23d7-45e3-97ef-e1045e12168c None None] MFA Rules not processed for user `3822e8832e1d4d09b0b68658e1e7a313`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:43:06.929475 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a4bb446c-23d7-45e3-97ef-e1045e12168c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:43:06.936584 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4472/8923] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:43:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:43:07.195196 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee6548-68d5-43b7-a4e9-ef1e5aac6da7 service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:43:07.204805 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee6548-68d5-43b7-a4e9-ef1e5aac6da7 service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:43:07.208943 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee6bbc-9497-437f-8fda-637cd2976676 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:43:07.209567 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee6bbc-9497-437f-8fda-637cd2976676 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:43:07.209872 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee6bbc-9497-437f-8fda-637cd2976676 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:43:07.210161 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee6bbc-9497-437f-8fda-637cd2976676 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:43:07.211945 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-b8ee6bbc-9497-437f-8fda-637cd2976676 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:43:07.222151 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee6bbc-9497-437f-8fda-637cd2976676 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:43:07.223722 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee6bbc-9497-437f-8fda-637cd2976676 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:43:07.232373 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4452/8924] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:43:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:43:16.922412 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:43:17.228390 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=6 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:43:30.040188 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb446c-23d7-45e3-97ef-e1045e12168c None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:43:30.055412 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb446c-23d7-45e3-97ef-e1045e12168c None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:43:30.060503 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd9624-7ae3-4bb6-9385-7352d86c904e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:43:30.061139 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd9624-7ae3-4bb6-9385-7352d86c904e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:43:30.061418 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd9624-7ae3-4bb6-9385-7352d86c904e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:43:30.061688 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd9624-7ae3-4bb6-9385-7352d86c904e admin admin] PATH_INFO: `/v3/users/3822e8832e1d4d09b0b68658e1e7a313` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:43:30.062801 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cd9624-7ae3-4bb6-9385-7352d86c904e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3822e8832e1d4d09b0b68658e1e7a313)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:43:30.065225 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cd9624-7ae3-4bb6-9385-7352d86c904e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:43:30.114224 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b7cd9624-7ae3-4bb6-9385-7352d86c904e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3822e8832e1d4d09b0b68658e1e7a313'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:43:30.114932 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b7cd9624-7ae3-4bb6-9385-7352d86c904e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3822e8832e1d4d09b0b68658e1e7a313'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:43:30.121305 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b7cd9624-7ae3-4bb6-9385-7352d86c904e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3822e8832e1d4d09b0b68658e1e7a313'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:43:30.128431 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b7cd9624-7ae3-4bb6-9385-7352d86c904e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3822e8832e1d4d09b0b68658e1e7a313'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:43:30.129073 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b7cd9624-7ae3-4bb6-9385-7352d86c904e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3822e8832e1d4d09b0b68658e1e7a313'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:43:30.146906 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4473/8925] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:43:30 2022] DELETE /identity/v3/users/3822e8832e1d4d09b0b68658e1e7a313 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:43:30.323687 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee6bbc-9497-437f-8fda-637cd2976676 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:43:30.335892 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee6bbc-9497-437f-8fda-637cd2976676 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:43:30.395037 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a9ae32-0b63-4adb-9c2f-a4b0ecd43725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:43:30.395693 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9ae32-0b63-4adb-9c2f-a4b0ecd43725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:43:30.395974 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9ae32-0b63-4adb-9c2f-a4b0ecd43725 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:43:30.396247 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9ae32-0b63-4adb-9c2f-a4b0ecd43725 admin admin] PATH_INFO: `/v3/projects/8916574f66d44b14922a241d52602a21` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:43:30.397396 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a9ae32-0b63-4adb-9c2f-a4b0ecd43725 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8916574f66d44b14922a241d52602a21)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:43:30.399360 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a9ae32-0b63-4adb-9c2f-a4b0ecd43725 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:43:30.448571 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e6a9ae32-0b63-4adb-9c2f-a4b0ecd43725 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8916574f66d44b14922a241d52602a21', 'request_id': 'req-e6a9ae32-0b63-4adb-9c2f-a4b0ecd43725'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:43:30.454001 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e6a9ae32-0b63-4adb-9c2f-a4b0ecd43725 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8916574f66d44b14922a241d52602a21', 'request_id': 'req-e6a9ae32-0b63-4adb-9c2f-a4b0ecd43725'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:43:30.461741 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e6a9ae32-0b63-4adb-9c2f-a4b0ecd43725 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8916574f66d44b14922a241d52602a21', 'request_id': 'req-e6a9ae32-0b63-4adb-9c2f-a4b0ecd43725'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:43:30.473620 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e6a9ae32-0b63-4adb-9c2f-a4b0ecd43725 admin admin] The token cache is being invalidate because project 8916574f66d44b14922a241d52602a21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:43:30.474063 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e6a9ae32-0b63-4adb-9c2f-a4b0ecd43725 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:43:30.474782 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-e6a9ae32-0b63-4adb-9c2f-a4b0ecd43725 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:43:30.476465 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4453/8926] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:43:30 2022] DELETE /identity/v3/projects/8916574f66d44b14922a241d52602a21 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:43:30.481566 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14c5c7-1735-42c2-acaf-734f4199ebfb None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:43:30.481856 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14c5c7-1735-42c2-acaf-734f4199ebfb None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:43:30.482134 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14c5c7-1735-42c2-acaf-734f4199ebfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:43:30.503206 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-eb14c5c7-1735-42c2-acaf-734f4199ebfb None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:43:30.504424 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-eb14c5c7-1735-42c2-acaf-734f4199ebfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:43:30.564625 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4474/8927] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:43:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:43:30.572901 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00c81d-3436-4e1a-b78b-5e085299d456 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:43:30.573218 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00c81d-3436-4e1a-b78b-5e085299d456 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:43:30.573495 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00c81d-3436-4e1a-b78b-5e085299d456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:43:30.594042 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-0a00c81d-3436-4e1a-b78b-5e085299d456 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:43:30.595874 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0a00c81d-3436-4e1a-b78b-5e085299d456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:43:30.604706 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4454/8928] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:43:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:43:30.608995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14c5c7-1735-42c2-acaf-734f4199ebfb None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:43:30.619652 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14c5c7-1735-42c2-acaf-734f4199ebfb None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:43:30.624468 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa0cf5-d0ca-4011-b0a3-9aae27093bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:43:30.625063 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa0cf5-d0ca-4011-b0a3-9aae27093bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:43:30.625338 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa0cf5-d0ca-4011-b0a3-9aae27093bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:43:30.625605 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa0cf5-d0ca-4011-b0a3-9aae27093bc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:43:30.626238 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aa0cf5-d0ca-4011-b0a3-9aae27093bc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:43:30.626563 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aa0cf5-d0ca-4011-b0a3-9aae27093bc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:43:30.628350 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aa0cf5-d0ca-4011-b0a3-9aae27093bc2 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:43:30.644172 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4475/8929] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:43:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:43:30.650337 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00c81d-3436-4e1a-b78b-5e085299d456 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:43:30.660782 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00c81d-3436-4e1a-b78b-5e085299d456 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:43:30.665577 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3cd746-71f5-40a4-9ee0-fea7726a9202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:43:30.666181 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3cd746-71f5-40a4-9ee0-fea7726a9202 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:43:30.666460 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3cd746-71f5-40a4-9ee0-fea7726a9202 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:43:30.666734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3cd746-71f5-40a4-9ee0-fea7726a9202 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:43:30.667397 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3cd746-71f5-40a4-9ee0-fea7726a9202 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:43:30.669307 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3cd746-71f5-40a4-9ee0-fea7726a9202 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:43:30.698196 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4455/8930] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:43:30 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:43:30.702635 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa0cf5-d0ca-4011-b0a3-9aae27093bc2 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:43:30.714713 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa0cf5-d0ca-4011-b0a3-9aae27093bc2 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:43:30.772074 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e043151-aa67-4b30-b7e9-031d166cf578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:43:30.772684 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e043151-aa67-4b30-b7e9-031d166cf578 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:43:30.772966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e043151-aa67-4b30-b7e9-031d166cf578 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:43:30.773243 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e043151-aa67-4b30-b7e9-031d166cf578 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:43:30.773872 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e043151-aa67-4b30-b7e9-031d166cf578 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:43:30.775843 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e043151-aa67-4b30-b7e9-031d166cf578 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:43:30.784143 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:43:30.798948 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4476/8931] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:43:30 2022] POST /identity/v3/users => generated 285 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:43:30.803340 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3cd746-71f5-40a4-9ee0-fea7726a9202 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:43:30.814497 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3cd746-71f5-40a4-9ee0-fea7726a9202 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:43:30.819278 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab7684-7b8d-4725-bb76-abf10e229774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:43:30.819872 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab7684-7b8d-4725-bb76-abf10e229774 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:43:30.820148 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab7684-7b8d-4725-bb76-abf10e229774 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:43:30.820414 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab7684-7b8d-4725-bb76-abf10e229774 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:43:30.821058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab7684-7b8d-4725-bb76-abf10e229774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:43:30.822648 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab7684-7b8d-4725-bb76-abf10e229774 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:43:30.833993 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4456/8932] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:43:30.837873 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e043151-aa67-4b30-b7e9-031d166cf578 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:43:30.848193 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e043151-aa67-4b30-b7e9-031d166cf578 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:43:30.852979 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ecf8bb-a88e-4481-b847-73199481a403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:43:30.853668 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ecf8bb-a88e-4481-b847-73199481a403 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:43:30.853940 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ecf8bb-a88e-4481-b847-73199481a403 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:43:30.854219 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ecf8bb-a88e-4481-b847-73199481a403 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:43:30.854849 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ecf8bb-a88e-4481-b847-73199481a403 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:43:30.856504 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ecf8bb-a88e-4481-b847-73199481a403 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:43:30.870136 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4477/8933] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:43:30.874369 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab7684-7b8d-4725-bb76-abf10e229774 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:43:30.885398 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab7684-7b8d-4725-bb76-abf10e229774 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:43:30.889993 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5af4a-1b0d-432f-8155-355439b2635a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:43:30.890632 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5af4a-1b0d-432f-8155-355439b2635a admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:43:30.890906 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5af4a-1b0d-432f-8155-355439b2635a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:43:30.891213 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5af4a-1b0d-432f-8155-355439b2635a admin admin] PATH_INFO: `/v3/projects/6c660ceb4d244810bdaa91ef0ff8523b/users/23f4d60174d64bc5934d056df7dc1b47/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:43:30.906279 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd5af4a-1b0d-432f-8155-355439b2635a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c660ceb4d244810bdaa91ef0ff8523b, user_id=23f4d60174d64bc5934d056df7dc1b47, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:43:30.910452 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd5af4a-1b0d-432f-8155-355439b2635a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:43:30.924503 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4457/8934] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:43:30 2022] PUT /identity/v3/projects/6c660ceb4d244810bdaa91ef0ff8523b/users/23f4d60174d64bc5934d056df7dc1b47/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:43:30.941030 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d17c85-7bec-4703-9bc5-c0240368e5e0 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:43:30.941486 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d17c85-7bec-4703-9bc5-c0240368e5e0 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:43:30.941618 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d17c85-7bec-4703-9bc5-c0240368e5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:43:30.969112 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-31d17c85-7bec-4703-9bc5-c0240368e5e0 None None] MFA Rules not processed for user `23f4d60174d64bc5934d056df7dc1b47`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:43:30.970398 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-31d17c85-7bec-4703-9bc5-c0240368e5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:43:31.035451 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4478/8935] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:43:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:43:31.045814 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5af4a-1b0d-432f-8155-355439b2635a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:43:31.047576 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-cfd5af4a-1b0d-432f-8155-355439b2635a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:43:31.078931 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:43:31.107571 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5af4a-1b0d-432f-8155-355439b2635a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:43:31.111775 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b00d1-f613-43f1-afca-cc49d97a431a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:43:31.112382 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b00d1-f613-43f1-afca-cc49d97a431a service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:43:31.112658 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b00d1-f613-43f1-afca-cc49d97a431a service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:43:31.112925 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b00d1-f613-43f1-afca-cc49d97a431a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:43:31.121236 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b00d1-f613-43f1-afca-cc49d97a431a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:43:31.122656 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b00d1-f613-43f1-afca-cc49d97a431a service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:43:31.132250 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4458/8936] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:43:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:43:36.640397 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e70b32-1138-49dd-9557-c5b03e22324b None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:43:36.640935 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e70b32-1138-49dd-9557-c5b03e22324b None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:43:36.640935 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e70b32-1138-49dd-9557-c5b03e22324b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:43:36.663499 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a8e70b32-1138-49dd-9557-c5b03e22324b None None] MFA Rules not processed for user `c190fa4a280c41c684130e069bee99eb`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:43:36.664726 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a8e70b32-1138-49dd-9557-c5b03e22324b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:43:36.767669 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4479/8937] 10.222.0.83 () {58 vars in 1018 bytes} [Mon Aug 29 16:43:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:43:36.780078 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b00d1-f613-43f1-afca-cc49d97a431a service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:43:36.781526 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-933b00d1-f613-43f1-afca-cc49d97a431a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:43:36.800555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b00d1-f613-43f1-afca-cc49d97a431a service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:43:36.806331 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c781fc-4bf2-4d4d-8497-1251260caec1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:43:36.807086 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c781fc-4bf2-4d4d-8497-1251260caec1 service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:43:36.807298 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c781fc-4bf2-4d4d-8497-1251260caec1 service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:43:36.807657 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c781fc-4bf2-4d4d-8497-1251260caec1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:43:36.819066 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c781fc-4bf2-4d4d-8497-1251260caec1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:43:36.820889 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c781fc-4bf2-4d4d-8497-1251260caec1 service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:43:36.834570 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4459/8938] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:43:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:43:38.199817 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e70b32-1138-49dd-9557-c5b03e22324b None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:43:38.212833 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e70b32-1138-49dd-9557-c5b03e22324b None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:43:38.219046 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecee2c3-2f65-4465-a021-46096edb2c97 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:43:38.220046 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecee2c3-2f65-4465-a021-46096edb2c97 service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:43:38.220496 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecee2c3-2f65-4465-a021-46096edb2c97 service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:43:38.221003 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecee2c3-2f65-4465-a021-46096edb2c97 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:43:38.223626 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1ecee2c3-2f65-4465-a021-46096edb2c97 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:43:38.237213 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecee2c3-2f65-4465-a021-46096edb2c97 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:43:38.238814 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecee2c3-2f65-4465-a021-46096edb2c97 service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:43:38.249382 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4480/8939] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:43:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:43:43.998606 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c781fc-4bf2-4d4d-8497-1251260caec1 service placement] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:43:44.064104 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c781fc-4bf2-4d4d-8497-1251260caec1 service placement] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:43:44.068700 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6460d48-af4c-49b5-b28e-cd9d29d7391f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:43:44.069330 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6460d48-af4c-49b5-b28e-cd9d29d7391f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:43:44.069613 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6460d48-af4c-49b5-b28e-cd9d29d7391f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:43:44.069885 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6460d48-af4c-49b5-b28e-cd9d29d7391f admin admin] PATH_INFO: `/v3/users/23f4d60174d64bc5934d056df7dc1b47` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:43:44.071004 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6460d48-af4c-49b5-b28e-cd9d29d7391f admin admin] RBAC: Authorizing `identity:delete_user(user_id=23f4d60174d64bc5934d056df7dc1b47)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:43:44.073006 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6460d48-af4c-49b5-b28e-cd9d29d7391f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:43:44.119964 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a6460d48-af4c-49b5-b28e-cd9d29d7391f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23f4d60174d64bc5934d056df7dc1b47'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:43:44.120538 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a6460d48-af4c-49b5-b28e-cd9d29d7391f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23f4d60174d64bc5934d056df7dc1b47'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:43:44.133244 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a6460d48-af4c-49b5-b28e-cd9d29d7391f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23f4d60174d64bc5934d056df7dc1b47'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:43:44.140957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a6460d48-af4c-49b5-b28e-cd9d29d7391f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23f4d60174d64bc5934d056df7dc1b47'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:43:44.148241 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a6460d48-af4c-49b5-b28e-cd9d29d7391f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23f4d60174d64bc5934d056df7dc1b47'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:43:44.154335 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4460/8940] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:43:43 2022] DELETE /identity/v3/users/23f4d60174d64bc5934d056df7dc1b47 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:43:44.159357 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a6aa8-c112-456d-84e6-c282b6572597 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:43:44.159836 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a6aa8-c112-456d-84e6-c282b6572597 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:43:44.159933 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a6aa8-c112-456d-84e6-c282b6572597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:43:44.180179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-e40a6aa8-c112-456d-84e6-c282b6572597 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:43:44.181376 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e40a6aa8-c112-456d-84e6-c282b6572597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:43:44.225914 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:43:44.243563 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4481/8941] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:43:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:43:44.253689 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6460d48-af4c-49b5-b28e-cd9d29d7391f admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:43:44.255144 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a6460d48-af4c-49b5-b28e-cd9d29d7391f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:43:44.295533 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:43:44.315896 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6460d48-af4c-49b5-b28e-cd9d29d7391f admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:43:44.319573 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06fbc6e-1b44-4570-9280-dc72ecec754a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:43:44.320179 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fbc6e-1b44-4570-9280-dc72ecec754a service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:43:44.320458 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fbc6e-1b44-4570-9280-dc72ecec754a service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:43:44.320729 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fbc6e-1b44-4570-9280-dc72ecec754a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:43:44.329941 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06fbc6e-1b44-4570-9280-dc72ecec754a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:43:44.331423 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06fbc6e-1b44-4570-9280-dc72ecec754a service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:43:44.340947 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4461/8942] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:43:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:43:44.520542 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a6aa8-c112-456d-84e6-c282b6572597 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:43:44.522584 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e40a6aa8-c112-456d-84e6-c282b6572597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:43:44.537676 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a6aa8-c112-456d-84e6-c282b6572597 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:43:44.543037 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27323d4f-b0dd-4f36-8304-8112d1c34d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:43:44.543912 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27323d4f-b0dd-4f36-8304-8112d1c34d71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:43:44.544204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27323d4f-b0dd-4f36-8304-8112d1c34d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:43:44.544527 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27323d4f-b0dd-4f36-8304-8112d1c34d71 admin admin] PATH_INFO: `/v3/projects/6c660ceb4d244810bdaa91ef0ff8523b` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:43:44.545657 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27323d4f-b0dd-4f36-8304-8112d1c34d71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c660ceb4d244810bdaa91ef0ff8523b)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:43:44.547573 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27323d4f-b0dd-4f36-8304-8112d1c34d71 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:43:44.595931 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-27323d4f-b0dd-4f36-8304-8112d1c34d71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c660ceb4d244810bdaa91ef0ff8523b', 'request_id': 'req-27323d4f-b0dd-4f36-8304-8112d1c34d71'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:43:44.601830 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-27323d4f-b0dd-4f36-8304-8112d1c34d71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c660ceb4d244810bdaa91ef0ff8523b', 'request_id': 'req-27323d4f-b0dd-4f36-8304-8112d1c34d71'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:43:44.608671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-27323d4f-b0dd-4f36-8304-8112d1c34d71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c660ceb4d244810bdaa91ef0ff8523b', 'request_id': 'req-27323d4f-b0dd-4f36-8304-8112d1c34d71'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:43:44.621982 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-27323d4f-b0dd-4f36-8304-8112d1c34d71 admin admin] The token cache is being invalidate because project 6c660ceb4d244810bdaa91ef0ff8523b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:43:44.622269 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-27323d4f-b0dd-4f36-8304-8112d1c34d71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:43:44.623102 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-27323d4f-b0dd-4f36-8304-8112d1c34d71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:43:44.624623 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4482/8943] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:43:44 2022] DELETE /identity/v3/projects/6c660ceb4d244810bdaa91ef0ff8523b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:43:44.629989 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f05c6c-4919-447c-a3e8-8e408f31dd6b None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:43:44.630327 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f05c6c-4919-447c-a3e8-8e408f31dd6b None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:43:44.630623 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f05c6c-4919-447c-a3e8-8e408f31dd6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:43:44.650879 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-73f05c6c-4919-447c-a3e8-8e408f31dd6b None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:43:44.652052 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-73f05c6c-4919-447c-a3e8-8e408f31dd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:43:44.713313 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4462/8944] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:43:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:43:44.721736 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4a258-c39e-4aca-9a96-de32535c480f None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:43:44.722051 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4a258-c39e-4aca-9a96-de32535c480f None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:43:44.722332 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4a258-c39e-4aca-9a96-de32535c480f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:43:44.742048 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-5cc4a258-c39e-4aca-9a96-de32535c480f None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:43:44.743358 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5cc4a258-c39e-4aca-9a96-de32535c480f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:43:44.752017 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4483/8945] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:43:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:43:44.756364 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f05c6c-4919-447c-a3e8-8e408f31dd6b None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:43:44.766211 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f05c6c-4919-447c-a3e8-8e408f31dd6b None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:43:44.771858 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda52c49-070d-47cd-8862-16d1408402d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:43:44.772464 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda52c49-070d-47cd-8862-16d1408402d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:43:44.772768 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda52c49-070d-47cd-8862-16d1408402d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:43:44.773041 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda52c49-070d-47cd-8862-16d1408402d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:43:44.773678 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda52c49-070d-47cd-8862-16d1408402d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:43:44.773980 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda52c49-070d-47cd-8862-16d1408402d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:43:44.775708 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda52c49-070d-47cd-8862-16d1408402d2 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:43:44.787690 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4463/8946] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:43:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:43:44.791890 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4a258-c39e-4aca-9a96-de32535c480f None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:43:44.801657 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4a258-c39e-4aca-9a96-de32535c480f None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:43:44.806384 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06df838a-7746-4627-978d-111965ff4a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:43:44.806986 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df838a-7746-4627-978d-111965ff4a0c admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:43:44.807300 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df838a-7746-4627-978d-111965ff4a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:43:44.807574 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df838a-7746-4627-978d-111965ff4a0c admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:43:44.808216 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06df838a-7746-4627-978d-111965ff4a0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:43:44.810382 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06df838a-7746-4627-978d-111965ff4a0c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:43:44.839078 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4484/8947] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:43:44 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:43:44.843351 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda52c49-070d-47cd-8862-16d1408402d2 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:43:44.853259 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda52c49-070d-47cd-8862-16d1408402d2 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:43:44.911483 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9184af35-cb55-4698-b194-f50ec9c4f117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:43:44.912006 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184af35-cb55-4698-b194-f50ec9c4f117 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:43:44.912285 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184af35-cb55-4698-b194-f50ec9c4f117 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:43:44.912557 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184af35-cb55-4698-b194-f50ec9c4f117 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:43:44.913177 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9184af35-cb55-4698-b194-f50ec9c4f117 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:43:44.915164 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9184af35-cb55-4698-b194-f50ec9c4f117 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:43:44.939665 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4464/8948] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:43:44 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:43:44.942173 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06df838a-7746-4627-978d-111965ff4a0c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:43:44.952582 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06df838a-7746-4627-978d-111965ff4a0c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:43:44.959351 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b244cb-9e18-4be5-a457-5f4c3a96dfd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:43:44.959963 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b244cb-9e18-4be5-a457-5f4c3a96dfd0 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:43:44.960251 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b244cb-9e18-4be5-a457-5f4c3a96dfd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:43:44.960526 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b244cb-9e18-4be5-a457-5f4c3a96dfd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:43:44.961171 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b244cb-9e18-4be5-a457-5f4c3a96dfd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:43:44.962816 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b244cb-9e18-4be5-a457-5f4c3a96dfd0 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:43:44.973730 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4485/8949] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:43:44.977688 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9184af35-cb55-4698-b194-f50ec9c4f117 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:43:44.987868 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9184af35-cb55-4698-b194-f50ec9c4f117 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:43:44.992582 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd7b9a-c4aa-428e-9b09-fdf24f033abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:43:44.993178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd7b9a-c4aa-428e-9b09-fdf24f033abb admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:43:44.993459 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd7b9a-c4aa-428e-9b09-fdf24f033abb admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:43:44.993730 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd7b9a-c4aa-428e-9b09-fdf24f033abb admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:43:44.994370 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd7b9a-c4aa-428e-9b09-fdf24f033abb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:43:44.996009 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd7b9a-c4aa-428e-9b09-fdf24f033abb admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:43:45.007757 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4465/8950] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:43:45.011787 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b244cb-9e18-4be5-a457-5f4c3a96dfd0 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:43:45.022726 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b244cb-9e18-4be5-a457-5f4c3a96dfd0 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:43:45.027412 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc03a3-1fa5-48de-a929-f0f4fe16db8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:43:45.028045 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc03a3-1fa5-48de-a929-f0f4fe16db8a admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:43:45.028321 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc03a3-1fa5-48de-a929-f0f4fe16db8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:43:45.028595 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc03a3-1fa5-48de-a929-f0f4fe16db8a admin admin] PATH_INFO: `/v3/projects/b5833bbc01594f8bb6f52c1514cffbcd/users/439f56d131224dcd95c867c0f42ee262/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:43:45.043053 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc03a3-1fa5-48de-a929-f0f4fe16db8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5833bbc01594f8bb6f52c1514cffbcd, user_id=439f56d131224dcd95c867c0f42ee262, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:43:45.045701 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc03a3-1fa5-48de-a929-f0f4fe16db8a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:43:45.060147 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4486/8951] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:43:45 2022] PUT /identity/v3/projects/b5833bbc01594f8bb6f52c1514cffbcd/users/439f56d131224dcd95c867c0f42ee262/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:43:45.070638 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f82e1-97d6-48ff-9780-9f84d5cd622d None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:43:45.070927 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f82e1-97d6-48ff-9780-9f84d5cd622d None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:43:45.071227 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f82e1-97d6-48ff-9780-9f84d5cd622d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:43:45.099932 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-553f82e1-97d6-48ff-9780-9f84d5cd622d None None] MFA Rules not processed for user `439f56d131224dcd95c867c0f42ee262`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:43:45.101179 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-553f82e1-97d6-48ff-9780-9f84d5cd622d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:43:45.134588 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:43:45.167672 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4466/8952] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:43:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:43:45.178241 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc03a3-1fa5-48de-a929-f0f4fe16db8a admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:43:45.180432 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-08fc03a3-1fa5-48de-a929-f0f4fe16db8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:43:45.238611 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc03a3-1fa5-48de-a929-f0f4fe16db8a admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:43:45.242331 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902839bc-a9d7-46ff-8628-2bee3bc8453b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:43:45.242939 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902839bc-a9d7-46ff-8628-2bee3bc8453b service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:43:45.243246 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902839bc-a9d7-46ff-8628-2bee3bc8453b service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:43:45.243521 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902839bc-a9d7-46ff-8628-2bee3bc8453b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:43:45.253093 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902839bc-a9d7-46ff-8628-2bee3bc8453b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:43:45.254677 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902839bc-a9d7-46ff-8628-2bee3bc8453b service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:43:45.264687 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4487/8953] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:43:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:43:50.127957 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f82e1-97d6-48ff-9780-9f84d5cd622d None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:43:50.192484 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f82e1-97d6-48ff-9780-9f84d5cd622d None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:43:50.197443 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc91381-e468-4674-9619-cd13dd45407e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:43:50.198075 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc91381-e468-4674-9619-cd13dd45407e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:43:50.198356 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc91381-e468-4674-9619-cd13dd45407e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:43:50.198629 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc91381-e468-4674-9619-cd13dd45407e admin admin] PATH_INFO: `/v3/users/439f56d131224dcd95c867c0f42ee262` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:43:50.199784 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc91381-e468-4674-9619-cd13dd45407e admin admin] RBAC: Authorizing `identity:delete_user(user_id=439f56d131224dcd95c867c0f42ee262)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:43:50.201717 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc91381-e468-4674-9619-cd13dd45407e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:43:50.252633 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6cc91381-e468-4674-9619-cd13dd45407e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '439f56d131224dcd95c867c0f42ee262'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:43:50.253351 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6cc91381-e468-4674-9619-cd13dd45407e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '439f56d131224dcd95c867c0f42ee262'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:43:50.265099 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6cc91381-e468-4674-9619-cd13dd45407e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '439f56d131224dcd95c867c0f42ee262'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:43:50.273402 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6cc91381-e468-4674-9619-cd13dd45407e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '439f56d131224dcd95c867c0f42ee262'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:43:50.280676 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-6cc91381-e468-4674-9619-cd13dd45407e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '439f56d131224dcd95c867c0f42ee262'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:43:50.286749 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4467/8954] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:43:50 2022] DELETE /identity/v3/users/439f56d131224dcd95c867c0f42ee262 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:43:50.291282 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf4444-8a6c-47d2-bcf4-1259aee1a2b6 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:43:50.291775 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf4444-8a6c-47d2-bcf4-1259aee1a2b6 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:43:50.291878 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf4444-8a6c-47d2-bcf4-1259aee1a2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:43:50.312471 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-5cbf4444-8a6c-47d2-bcf4-1259aee1a2b6 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:43:50.314339 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5cbf4444-8a6c-47d2-bcf4-1259aee1a2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:43:50.322721 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:43:50.375768 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4488/8955] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:43:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:43:50.386178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc91381-e468-4674-9619-cd13dd45407e admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:43:50.387601 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6cc91381-e468-4674-9619-cd13dd45407e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:43:50.446016 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc91381-e468-4674-9619-cd13dd45407e admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:43:50.449739 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2162988-9a5f-4359-9fb4-01b0f3bdb570 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:43:50.450343 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2162988-9a5f-4359-9fb4-01b0f3bdb570 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:43:50.450621 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2162988-9a5f-4359-9fb4-01b0f3bdb570 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:43:50.450893 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2162988-9a5f-4359-9fb4-01b0f3bdb570 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:43:50.458001 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:43:50.460622 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2162988-9a5f-4359-9fb4-01b0f3bdb570 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:43:50.462583 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2162988-9a5f-4359-9fb4-01b0f3bdb570 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:43:50.473239 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4468/8956] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:43:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:43:50.646912 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf4444-8a6c-47d2-bcf4-1259aee1a2b6 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:43:50.648381 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-5cbf4444-8a6c-47d2-bcf4-1259aee1a2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:43:50.660873 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf4444-8a6c-47d2-bcf4-1259aee1a2b6 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:43:50.665502 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc25e7-de7c-4b38-ba3d-46209b02cddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:43:50.666147 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc25e7-de7c-4b38-ba3d-46209b02cddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:43:50.666424 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc25e7-de7c-4b38-ba3d-46209b02cddc admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:43:50.666694 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc25e7-de7c-4b38-ba3d-46209b02cddc admin admin] PATH_INFO: `/v3/projects/b5833bbc01594f8bb6f52c1514cffbcd` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:43:50.667845 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc25e7-de7c-4b38-ba3d-46209b02cddc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5833bbc01594f8bb6f52c1514cffbcd)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:43:50.669889 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc25e7-de7c-4b38-ba3d-46209b02cddc admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:43:50.721146 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4efc25e7-de7c-4b38-ba3d-46209b02cddc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5833bbc01594f8bb6f52c1514cffbcd', 'request_id': 'req-4efc25e7-de7c-4b38-ba3d-46209b02cddc'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:43:50.726757 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4efc25e7-de7c-4b38-ba3d-46209b02cddc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5833bbc01594f8bb6f52c1514cffbcd', 'request_id': 'req-4efc25e7-de7c-4b38-ba3d-46209b02cddc'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:43:50.733198 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4efc25e7-de7c-4b38-ba3d-46209b02cddc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5833bbc01594f8bb6f52c1514cffbcd', 'request_id': 'req-4efc25e7-de7c-4b38-ba3d-46209b02cddc'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:43:50.746412 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4efc25e7-de7c-4b38-ba3d-46209b02cddc admin admin] The token cache is being invalidate because project b5833bbc01594f8bb6f52c1514cffbcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:43:50.746705 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4efc25e7-de7c-4b38-ba3d-46209b02cddc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:43:50.747358 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4efc25e7-de7c-4b38-ba3d-46209b02cddc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:43:50.748914 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4489/8957] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:43:50 2022] DELETE /identity/v3/projects/b5833bbc01594f8bb6f52c1514cffbcd => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:43:50.754023 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c717aaf-a9d7-4b78-be37-8077e9ba3797 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:43:50.754349 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c717aaf-a9d7-4b78-be37-8077e9ba3797 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:43:50.754630 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c717aaf-a9d7-4b78-be37-8077e9ba3797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:43:50.774247 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-3c717aaf-a9d7-4b78-be37-8077e9ba3797 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:43:50.775501 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3c717aaf-a9d7-4b78-be37-8077e9ba3797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:43:50.835373 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4469/8958] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:43:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:43:50.843307 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ddd722-fc77-40e5-b97e-cc91d3e921ca None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:43:50.843533 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ddd722-fc77-40e5-b97e-cc91d3e921ca None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:43:50.843794 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ddd722-fc77-40e5-b97e-cc91d3e921ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:43:50.864941 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-03ddd722-fc77-40e5-b97e-cc91d3e921ca None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:43:50.866148 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-03ddd722-fc77-40e5-b97e-cc91d3e921ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:43:50.874129 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4490/8959] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:43:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:43:50.878554 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c717aaf-a9d7-4b78-be37-8077e9ba3797 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:43:50.888442 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c717aaf-a9d7-4b78-be37-8077e9ba3797 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:43:50.893200 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de07d65-6e06-4463-850e-64df855cbd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:43:50.893871 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de07d65-6e06-4463-850e-64df855cbd06 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:43:50.894150 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de07d65-6e06-4463-850e-64df855cbd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:43:50.894419 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de07d65-6e06-4463-850e-64df855cbd06 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:43:50.895083 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de07d65-6e06-4463-850e-64df855cbd06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:43:50.895383 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de07d65-6e06-4463-850e-64df855cbd06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:43:50.896978 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de07d65-6e06-4463-850e-64df855cbd06 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:43:50.909253 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4470/8960] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:43:50.913540 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ddd722-fc77-40e5-b97e-cc91d3e921ca None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:43:50.922728 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ddd722-fc77-40e5-b97e-cc91d3e921ca None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:43:50.928014 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053b9e0-ae64-4e3c-895e-ca1acdcd17f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:43:50.928607 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053b9e0-ae64-4e3c-895e-ca1acdcd17f0 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:43:50.928883 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053b9e0-ae64-4e3c-895e-ca1acdcd17f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:43:50.929170 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053b9e0-ae64-4e3c-895e-ca1acdcd17f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:43:50.929792 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053b9e0-ae64-4e3c-895e-ca1acdcd17f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:43:50.931731 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053b9e0-ae64-4e3c-895e-ca1acdcd17f0 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:43:50.958838 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4491/8961] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:43:50 2022] POST /identity/v3/projects => generated 389 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:43:50.963008 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de07d65-6e06-4463-850e-64df855cbd06 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:43:50.973886 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de07d65-6e06-4463-850e-64df855cbd06 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:43:51.030343 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80569c82-8368-40e3-927a-4db4621f75ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:43:51.031196 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80569c82-8368-40e3-927a-4db4621f75ee admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:43:51.031466 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80569c82-8368-40e3-927a-4db4621f75ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:43:51.031742 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80569c82-8368-40e3-927a-4db4621f75ee admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:43:51.032374 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80569c82-8368-40e3-927a-4db4621f75ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:43:51.034825 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80569c82-8368-40e3-927a-4db4621f75ee admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:43:51.056460 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4471/8962] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:43:50 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:43:51.060888 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053b9e0-ae64-4e3c-895e-ca1acdcd17f0 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:43:51.071530 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053b9e0-ae64-4e3c-895e-ca1acdcd17f0 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:43:51.076382 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f373a6d3-645f-4bb2-ba25-7aad6a117d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:43:51.076990 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373a6d3-645f-4bb2-ba25-7aad6a117d08 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:43:51.077269 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373a6d3-645f-4bb2-ba25-7aad6a117d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:43:51.077540 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373a6d3-645f-4bb2-ba25-7aad6a117d08 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:43:51.078175 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f373a6d3-645f-4bb2-ba25-7aad6a117d08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:43:51.080470 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f373a6d3-645f-4bb2-ba25-7aad6a117d08 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:43:51.090474 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4492/8963] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:43:51.094555 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80569c82-8368-40e3-927a-4db4621f75ee admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:43:51.105434 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80569c82-8368-40e3-927a-4db4621f75ee admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:43:51.110126 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef36b7-9168-430f-b3ee-944db36d6588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:43:51.110751 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef36b7-9168-430f-b3ee-944db36d6588 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:43:51.111215 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef36b7-9168-430f-b3ee-944db36d6588 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:43:51.111498 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef36b7-9168-430f-b3ee-944db36d6588 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:43:51.112142 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef36b7-9168-430f-b3ee-944db36d6588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:43:51.113752 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef36b7-9168-430f-b3ee-944db36d6588 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:43:51.124423 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4472/8964] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:43:51.128644 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f373a6d3-645f-4bb2-ba25-7aad6a117d08 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:43:51.138689 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f373a6d3-645f-4bb2-ba25-7aad6a117d08 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:43:51.144647 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7268012-c57c-42da-b560-c4532683938a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:43:51.145344 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7268012-c57c-42da-b560-c4532683938a admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:43:51.145629 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7268012-c57c-42da-b560-c4532683938a admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:43:51.145907 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7268012-c57c-42da-b560-c4532683938a admin admin] PATH_INFO: `/v3/projects/52e3fd33e0a3498bbddebe188d0f6514/users/e3fc099340254aafbe1798f54d26d977/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:43:51.161517 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7268012-c57c-42da-b560-c4532683938a admin admin] RBAC: Authorizing `identity:create_grant(project_id=52e3fd33e0a3498bbddebe188d0f6514, user_id=e3fc099340254aafbe1798f54d26d977, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:43:51.164286 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7268012-c57c-42da-b560-c4532683938a admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:43:51.177448 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4493/8965] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:43:51 2022] PUT /identity/v3/projects/52e3fd33e0a3498bbddebe188d0f6514/users/e3fc099340254aafbe1798f54d26d977/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:43:51.182733 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa9f3e-a6e4-4d91-bb73-471e566670ae None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:43:51.183243 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa9f3e-a6e4-4d91-bb73-471e566670ae None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:43:51.183343 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa9f3e-a6e4-4d91-bb73-471e566670ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:43:51.202445 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-62fa9f3e-a6e4-4d91-bb73-471e566670ae None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:43:51.203675 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-62fa9f3e-a6e4-4d91-bb73-471e566670ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:43:51.265072 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4473/8966] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:43:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:43:51.275539 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7268012-c57c-42da-b560-c4532683938a admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:43:51.277243 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f7268012-c57c-42da-b560-c4532683938a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:43:51.315716 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:43:51.339335 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7268012-c57c-42da-b560-c4532683938a admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:43:51.343043 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab440301-8c3b-4ffa-ba07-dc892e7b738a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:43:51.343665 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab440301-8c3b-4ffa-ba07-dc892e7b738a service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:43:51.343944 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab440301-8c3b-4ffa-ba07-dc892e7b738a service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:43:51.344214 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab440301-8c3b-4ffa-ba07-dc892e7b738a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:43:51.353728 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab440301-8c3b-4ffa-ba07-dc892e7b738a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:43:51.355151 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab440301-8c3b-4ffa-ba07-dc892e7b738a service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:43:51.365581 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4494/8967] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:43:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:43:55.096895 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5ab1e-8b76-416b-bc57-3db5c4fd8316 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:43:55.097479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5ab1e-8b76-416b-bc57-3db5c4fd8316 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:43:55.097662 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5ab1e-8b76-416b-bc57-3db5c4fd8316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:43:55.104903 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:43:55.130850 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-98d5ab1e-8b76-416b-bc57-3db5c4fd8316 None None] MFA Rules not processed for user `e3fc099340254aafbe1798f54d26d977`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:43:55.132271 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-98d5ab1e-8b76-416b-bc57-3db5c4fd8316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:43:55.199792 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4474/8968] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:43:55 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:43:55.204293 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab440301-8c3b-4ffa-ba07-dc892e7b738a service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:43:55.214615 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab440301-8c3b-4ffa-ba07-dc892e7b738a service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:43:55.219289 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f37ee-95ba-44a6-806f-2e896be4e22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:43:55.219890 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f37ee-95ba-44a6-806f-2e896be4e22e admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:43:55.220169 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f37ee-95ba-44a6-806f-2e896be4e22e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:43:55.220438 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f37ee-95ba-44a6-806f-2e896be4e22e admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:43:55.221064 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62f37ee-95ba-44a6-806f-2e896be4e22e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:43:55.223826 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62f37ee-95ba-44a6-806f-2e896be4e22e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:43:55.255538 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4495/8969] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:43:55 2022] POST /identity/v3/projects => generated 389 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:43:55.259520 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5ab1e-8b76-416b-bc57-3db5c4fd8316 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:43:55.271363 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5ab1e-8b76-416b-bc57-3db5c4fd8316 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:43:55.344231 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31912d06-3316-48e5-861b-b277a7e868a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:43:55.344918 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31912d06-3316-48e5-861b-b277a7e868a7 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:43:55.345209 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31912d06-3316-48e5-861b-b277a7e868a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:43:55.345487 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31912d06-3316-48e5-861b-b277a7e868a7 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:43:55.346142 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31912d06-3316-48e5-861b-b277a7e868a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:43:55.348926 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31912d06-3316-48e5-861b-b277a7e868a7 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:43:55.378537 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4475/8970] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:43:55 2022] POST /identity/v3/users => generated 301 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:43:55.380324 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f37ee-95ba-44a6-806f-2e896be4e22e admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:43:55.391389 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f37ee-95ba-44a6-806f-2e896be4e22e admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:43:55.396681 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dcdeed-1781-4c96-8455-10ec71af65ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:43:55.397404 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dcdeed-1781-4c96-8455-10ec71af65ed admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:43:55.397757 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dcdeed-1781-4c96-8455-10ec71af65ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:43:55.398099 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dcdeed-1781-4c96-8455-10ec71af65ed admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:43:55.398824 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dcdeed-1781-4c96-8455-10ec71af65ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:43:55.400581 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dcdeed-1781-4c96-8455-10ec71af65ed admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:43:55.417912 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4496/8971] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:43:55.423216 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31912d06-3316-48e5-861b-b277a7e868a7 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:43:55.456198 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31912d06-3316-48e5-861b-b277a7e868a7 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:43:55.461922 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165bca62-b1d8-4195-bad7-72a644561723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:43:55.462600 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165bca62-b1d8-4195-bad7-72a644561723 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:43:55.462880 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165bca62-b1d8-4195-bad7-72a644561723 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:43:55.463188 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165bca62-b1d8-4195-bad7-72a644561723 admin admin] PATH_INFO: `/v3/projects/6be62bda1cb94940a516c35d5e06a77a/users/bded6640123347f48ee3b6c7223aaf4e/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:43:55.480006 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165bca62-b1d8-4195-bad7-72a644561723 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6be62bda1cb94940a516c35d5e06a77a, user_id=bded6640123347f48ee3b6c7223aaf4e, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:43:55.482679 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165bca62-b1d8-4195-bad7-72a644561723 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:43:55.502560 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4476/8972] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:43:55 2022] PUT /identity/v3/projects/6be62bda1cb94940a516c35d5e06a77a/users/bded6640123347f48ee3b6c7223aaf4e/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:43:55.507169 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dcdeed-1781-4c96-8455-10ec71af65ed admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:43:55.518040 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dcdeed-1781-4c96-8455-10ec71af65ed admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:43:55.584464 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1d6b4-6d95-4b94-a94c-e773914099e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:43:55.585090 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1d6b4-6d95-4b94-a94c-e773914099e8 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:43:55.585371 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1d6b4-6d95-4b94-a94c-e773914099e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:43:55.585642 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1d6b4-6d95-4b94-a94c-e773914099e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:43:55.586317 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1d6b4-6d95-4b94-a94c-e773914099e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:43:55.587984 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1d6b4-6d95-4b94-a94c-e773914099e8 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:43:55.599906 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4497/8973] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:43:55.604269 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165bca62-b1d8-4195-bad7-72a644561723 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:43:55.615124 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165bca62-b1d8-4195-bad7-72a644561723 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:43:55.620124 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e8019-5b0f-44da-9d4d-1099b7c6fa35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:43:55.620796 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e8019-5b0f-44da-9d4d-1099b7c6fa35 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:43:55.621073 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e8019-5b0f-44da-9d4d-1099b7c6fa35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:43:55.621486 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e8019-5b0f-44da-9d4d-1099b7c6fa35 admin admin] PATH_INFO: `/v3/projects/6be62bda1cb94940a516c35d5e06a77a/users/bded6640123347f48ee3b6c7223aaf4e/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:43:55.623317 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9e8019-5b0f-44da-9d4d-1099b7c6fa35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6be62bda1cb94940a516c35d5e06a77a, user_id=bded6640123347f48ee3b6c7223aaf4e, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:43:55.626044 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9e8019-5b0f-44da-9d4d-1099b7c6fa35 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:43:55.637707 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4477/8974] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:43:55 2022] PUT /identity/v3/projects/6be62bda1cb94940a516c35d5e06a77a/users/bded6640123347f48ee3b6c7223aaf4e/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:44:00.263846 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01edddab-5850-4f50-8e90-81bf4f1d375c None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:44:00.264292 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01edddab-5850-4f50-8e90-81bf4f1d375c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:44:00.264403 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01edddab-5850-4f50-8e90-81bf4f1d375c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:44:00.297440 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-01edddab-5850-4f50-8e90-81bf4f1d375c None None] MFA Rules not processed for user `bded6640123347f48ee3b6c7223aaf4e`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:44:00.299312 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-01edddab-5850-4f50-8e90-81bf4f1d375c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:44:00.426168 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4498/8975] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:44:00 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:44:00.454307 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e8019-5b0f-44da-9d4d-1099b7c6fa35 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:44:00.457674 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-cf9e8019-5b0f-44da-9d4d-1099b7c6fa35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:44:00.534993 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:44:00.578878 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e8019-5b0f-44da-9d4d-1099b7c6fa35 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:44:00.585217 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc71db1-da67-436f-8fc3-6298dd213c22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:44:00.585828 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc71db1-da67-436f-8fc3-6298dd213c22 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:44:00.586108 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc71db1-da67-436f-8fc3-6298dd213c22 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:44:00.586379 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc71db1-da67-436f-8fc3-6298dd213c22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:44:00.654679 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc71db1-da67-436f-8fc3-6298dd213c22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:44:00.656389 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc71db1-da67-436f-8fc3-6298dd213c22 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:44:00.668354 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4478/8976] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:44:00 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:44:00.743490 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc581f3a-9174-4769-9270-4faefffd7206 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:44:00.743719 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc581f3a-9174-4769-9270-4faefffd7206 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:44:00.744497 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc581f3a-9174-4769-9270-4faefffd7206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:44:00.765759 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-bc581f3a-9174-4769-9270-4faefffd7206 None None] MFA Rules not processed for user `e3fc099340254aafbe1798f54d26d977`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:44:00.767071 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-bc581f3a-9174-4769-9270-4faefffd7206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:44:00.775070 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4499/8977] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:44:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:44:01.052495 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc71db1-da67-436f-8fc3-6298dd213c22 service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:44:01.053895 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-6cc71db1-da67-436f-8fc3-6298dd213c22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:44:01.112630 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc71db1-da67-436f-8fc3-6298dd213c22 service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:44:01.116478 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed7383c-aa86-46f0-9370-03e63d4fee87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:44:01.117085 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7383c-aa86-46f0-9370-03e63d4fee87 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:44:01.117363 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7383c-aa86-46f0-9370-03e63d4fee87 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:44:01.117635 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7383c-aa86-46f0-9370-03e63d4fee87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:44:01.119375 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5ed7383c-aa86-46f0-9370-03e63d4fee87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:44:01.128687 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed7383c-aa86-46f0-9370-03e63d4fee87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:44:01.130123 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed7383c-aa86-46f0-9370-03e63d4fee87 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:44:01.137967 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4479/8978] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:44:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:44:01.496864 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc581f3a-9174-4769-9270-4faefffd7206 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:44:01.498413 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-bc581f3a-9174-4769-9270-4faefffd7206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:44:01.523724 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:44:01.588113 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc581f3a-9174-4769-9270-4faefffd7206 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:44:01.593008 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266bcbd-d276-4415-88b0-7fc370a2babe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:44:01.593616 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266bcbd-d276-4415-88b0-7fc370a2babe service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:44:01.593889 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266bcbd-d276-4415-88b0-7fc370a2babe service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:44:01.594155 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266bcbd-d276-4415-88b0-7fc370a2babe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:44:01.596108 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7266bcbd-d276-4415-88b0-7fc370a2babe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:44:01.608727 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7266bcbd-d276-4415-88b0-7fc370a2babe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:44:01.610317 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7266bcbd-d276-4415-88b0-7fc370a2babe service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:44:01.621795 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4500/8979] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:44:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:44:04.104576 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed7383c-aa86-46f0-9370-03e63d4fee87 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:44:04.106111 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5ed7383c-aa86-46f0-9370-03e63d4fee87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:44:04.125180 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed7383c-aa86-46f0-9370-03e63d4fee87 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:44:04.135203 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c048242-46af-4588-a264-be3036fd4022 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:44:04.136424 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c048242-46af-4588-a264-be3036fd4022 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:44:04.136900 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c048242-46af-4588-a264-be3036fd4022 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:44:04.137174 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c048242-46af-4588-a264-be3036fd4022 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:44:04.138946 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5c048242-46af-4588-a264-be3036fd4022 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:44:04.152646 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c048242-46af-4588-a264-be3036fd4022 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:44:04.154275 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c048242-46af-4588-a264-be3036fd4022 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:44:04.167542 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4480/8980] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:44:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:44:11.277235 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266bcbd-d276-4415-88b0-7fc370a2babe service placement] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:44:11.278592 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7266bcbd-d276-4415-88b0-7fc370a2babe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:44:11.336413 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266bcbd-d276-4415-88b0-7fc370a2babe service placement] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:44:11.340003 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48cf041-82c8-4f8c-904c-e0355198275e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:44:11.340602 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48cf041-82c8-4f8c-904c-e0355198275e service cinder] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:44:11.340872 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48cf041-82c8-4f8c-904c-e0355198275e service cinder] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:44:11.341137 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48cf041-82c8-4f8c-904c-e0355198275e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:44:11.350320 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48cf041-82c8-4f8c-904c-e0355198275e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:44:11.351774 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48cf041-82c8-4f8c-904c-e0355198275e service cinder] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:44:11.361160 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4501/8981] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:44:11 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:44:14.163335 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=68 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:44:21.356992 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=50 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:44:36.847041 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b5078-aa16-41fd-bae2-0eba78be11d8 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:44:36.847558 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b5078-aa16-41fd-bae2-0eba78be11d8 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:44:36.847656 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b5078-aa16-41fd-bae2-0eba78be11d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:44:36.867386 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-3f5b5078-aa16-41fd-bae2-0eba78be11d8 None None] MFA Rules not processed for user `e3fc099340254aafbe1798f54d26d977`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:44:36.868573 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-3f5b5078-aa16-41fd-bae2-0eba78be11d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:44:36.875659 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4481/8982] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:44:36 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:44:37.455449 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48cf041-82c8-4f8c-904c-e0355198275e service cinder] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:44:37.456881 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e48cf041-82c8-4f8c-904c-e0355198275e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:44:37.472496 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48cf041-82c8-4f8c-904c-e0355198275e service cinder] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:44:37.477628 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced7d8e-ac75-4104-85a1-a97b3f6db477 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:44:37.478234 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced7d8e-ac75-4104-85a1-a97b3f6db477 service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:44:37.478534 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced7d8e-ac75-4104-85a1-a97b3f6db477 service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:44:37.478806 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced7d8e-ac75-4104-85a1-a97b3f6db477 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:44:37.480536 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-eced7d8e-ac75-4104-85a1-a97b3f6db477 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:44:37.494104 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eced7d8e-ac75-4104-85a1-a97b3f6db477 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:44:37.495744 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eced7d8e-ac75-4104-85a1-a97b3f6db477 service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:44:37.508419 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4502/8983] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:44:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:44:46.861870 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:44:47.503179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=6 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:44:54.215900 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b5078-aa16-41fd-bae2-0eba78be11d8 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:44:54.228207 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b5078-aa16-41fd-bae2-0eba78be11d8 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:44:54.234452 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2affe-74ab-40e6-8c2a-d7f1d6dc8a8a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:44:54.234710 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2affe-74ab-40e6-8c2a-d7f1d6dc8a8a service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:44:54.235004 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2affe-74ab-40e6-8c2a-d7f1d6dc8a8a service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:44:54.235320 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2affe-74ab-40e6-8c2a-d7f1d6dc8a8a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:44:54.237130 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-97e2affe-74ab-40e6-8c2a-d7f1d6dc8a8a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:44:54.249451 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e2affe-74ab-40e6-8c2a-d7f1d6dc8a8a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:44:54.251089 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e2affe-74ab-40e6-8c2a-d7f1d6dc8a8a service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:44:54.262426 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4482/8984] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:44:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:45:04.257174 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=6 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:45:13.889824 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6b3ae-fd83-44f4-a2bc-2f7c88046a6c None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:45:13.890396 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6b3ae-fd83-44f4-a2bc-2f7c88046a6c None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:45:13.890396 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6b3ae-fd83-44f4-a2bc-2f7c88046a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:45:13.910664 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-02b6b3ae-fd83-44f4-a2bc-2f7c88046a6c None None] MFA Rules not processed for user `e3fc099340254aafbe1798f54d26d977`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:45:13.911948 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-02b6b3ae-fd83-44f4-a2bc-2f7c88046a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:45:13.919949 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4503/8985] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:45:13 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:45:23.904884 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=3 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:45:55.586552 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2affe-74ab-40e6-8c2a-d7f1d6dc8a8a service placement] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:45:55.679944 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2affe-74ab-40e6-8c2a-d7f1d6dc8a8a service placement] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:45:55.685524 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35c6cb-883d-499c-80ae-cb061d84b70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:45:55.686160 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35c6cb-883d-499c-80ae-cb061d84b70b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:45:55.686436 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35c6cb-883d-499c-80ae-cb061d84b70b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:45:55.686708 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35c6cb-883d-499c-80ae-cb061d84b70b admin admin] PATH_INFO: `/v3/users/e3fc099340254aafbe1798f54d26d977` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:45:55.688013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b35c6cb-883d-499c-80ae-cb061d84b70b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3fc099340254aafbe1798f54d26d977)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:45:55.689968 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b35c6cb-883d-499c-80ae-cb061d84b70b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:45:55.741347 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8b35c6cb-883d-499c-80ae-cb061d84b70b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3fc099340254aafbe1798f54d26d977'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:45:55.741347 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8b35c6cb-883d-499c-80ae-cb061d84b70b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3fc099340254aafbe1798f54d26d977'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:45:55.756390 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8b35c6cb-883d-499c-80ae-cb061d84b70b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3fc099340254aafbe1798f54d26d977'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:45:55.764852 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8b35c6cb-883d-499c-80ae-cb061d84b70b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3fc099340254aafbe1798f54d26d977'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:45:55.772117 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-8b35c6cb-883d-499c-80ae-cb061d84b70b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3fc099340254aafbe1798f54d26d977'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:45:55.778060 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4483/8986] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:45:55 2022] DELETE /identity/v3/users/e3fc099340254aafbe1798f54d26d977 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:45:55.952051 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6b3ae-fd83-44f4-a2bc-2f7c88046a6c None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:45:55.969883 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6b3ae-fd83-44f4-a2bc-2f7c88046a6c None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:45:56.027885 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280bf81-07f6-47da-b727-37011a7598e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:45:56.028527 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280bf81-07f6-47da-b727-37011a7598e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:45:56.028806 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280bf81-07f6-47da-b727-37011a7598e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:45:56.029078 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280bf81-07f6-47da-b727-37011a7598e5 admin admin] PATH_INFO: `/v3/projects/52e3fd33e0a3498bbddebe188d0f6514` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:45:56.030192 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1280bf81-07f6-47da-b727-37011a7598e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52e3fd33e0a3498bbddebe188d0f6514)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:45:56.032188 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1280bf81-07f6-47da-b727-37011a7598e5 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:45:56.082633 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1280bf81-07f6-47da-b727-37011a7598e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52e3fd33e0a3498bbddebe188d0f6514', 'request_id': 'req-1280bf81-07f6-47da-b727-37011a7598e5'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:45:56.087953 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1280bf81-07f6-47da-b727-37011a7598e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52e3fd33e0a3498bbddebe188d0f6514', 'request_id': 'req-1280bf81-07f6-47da-b727-37011a7598e5'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:45:56.094555 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1280bf81-07f6-47da-b727-37011a7598e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52e3fd33e0a3498bbddebe188d0f6514', 'request_id': 'req-1280bf81-07f6-47da-b727-37011a7598e5'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:45:56.107772 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1280bf81-07f6-47da-b727-37011a7598e5 admin admin] The token cache is being invalidate because project 52e3fd33e0a3498bbddebe188d0f6514 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:45:56.108057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1280bf81-07f6-47da-b727-37011a7598e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:45:56.108717 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-1280bf81-07f6-47da-b727-37011a7598e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:45:56.110226 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4504/8987] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:45:55 2022] DELETE /identity/v3/projects/52e3fd33e0a3498bbddebe188d0f6514 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:45:56.114221 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35c6cb-883d-499c-80ae-cb061d84b70b admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:45:56.115722 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-8b35c6cb-883d-499c-80ae-cb061d84b70b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:45:56.129670 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35c6cb-883d-499c-80ae-cb061d84b70b admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:45:56.188636 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb6f3c-5c08-41b1-aa5a-e7b6af4744a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:45:56.189299 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb6f3c-5c08-41b1-aa5a-e7b6af4744a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:45:56.189578 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb6f3c-5c08-41b1-aa5a-e7b6af4744a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:45:56.189850 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb6f3c-5c08-41b1-aa5a-e7b6af4744a0 admin admin] PATH_INFO: `/v3/users/bded6640123347f48ee3b6c7223aaf4e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:45:56.190985 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fb6f3c-5c08-41b1-aa5a-e7b6af4744a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bded6640123347f48ee3b6c7223aaf4e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:45:56.192973 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fb6f3c-5c08-41b1-aa5a-e7b6af4744a0 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:45:56.214491 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:45:56.239939 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d5fb6f3c-5c08-41b1-aa5a-e7b6af4744a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bded6640123347f48ee3b6c7223aaf4e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:45:56.240602 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d5fb6f3c-5c08-41b1-aa5a-e7b6af4744a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bded6640123347f48ee3b6c7223aaf4e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:45:56.253014 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d5fb6f3c-5c08-41b1-aa5a-e7b6af4744a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bded6640123347f48ee3b6c7223aaf4e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:45:56.260236 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d5fb6f3c-5c08-41b1-aa5a-e7b6af4744a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bded6640123347f48ee3b6c7223aaf4e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:45:56.267455 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-d5fb6f3c-5c08-41b1-aa5a-e7b6af4744a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bded6640123347f48ee3b6c7223aaf4e'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:45:56.273670 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4484/8988] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:45:56 2022] DELETE /identity/v3/users/bded6640123347f48ee3b6c7223aaf4e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:45:56.449595 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280bf81-07f6-47da-b727-37011a7598e5 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:45:56.451299 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1280bf81-07f6-47da-b727-37011a7598e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:45:56.466557 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280bf81-07f6-47da-b727-37011a7598e5 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:45:56.526790 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945ac2e-5d70-4015-bdf3-46604c9cdee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:45:56.527453 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945ac2e-5d70-4015-bdf3-46604c9cdee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:45:56.527716 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945ac2e-5d70-4015-bdf3-46604c9cdee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:45:56.527977 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945ac2e-5d70-4015-bdf3-46604c9cdee0 admin admin] PATH_INFO: `/v3/projects/6be62bda1cb94940a516c35d5e06a77a` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:45:56.529094 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d945ac2e-5d70-4015-bdf3-46604c9cdee0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6be62bda1cb94940a516c35d5e06a77a)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:45:56.531045 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d945ac2e-5d70-4015-bdf3-46604c9cdee0 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:45:56.566933 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:45:56.580736 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d945ac2e-5d70-4015-bdf3-46604c9cdee0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6be62bda1cb94940a516c35d5e06a77a', 'request_id': 'req-d945ac2e-5d70-4015-bdf3-46604c9cdee0'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:45:56.586576 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d945ac2e-5d70-4015-bdf3-46604c9cdee0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6be62bda1cb94940a516c35d5e06a77a', 'request_id': 'req-d945ac2e-5d70-4015-bdf3-46604c9cdee0'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:45:56.593264 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d945ac2e-5d70-4015-bdf3-46604c9cdee0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6be62bda1cb94940a516c35d5e06a77a', 'request_id': 'req-d945ac2e-5d70-4015-bdf3-46604c9cdee0'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:45:56.608113 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d945ac2e-5d70-4015-bdf3-46604c9cdee0 admin admin] The token cache is being invalidate because project 6be62bda1cb94940a516c35d5e06a77a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:45:56.608391 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d945ac2e-5d70-4015-bdf3-46604c9cdee0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:45:56.609063 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-d945ac2e-5d70-4015-bdf3-46604c9cdee0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:45:56.610582 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4505/8989] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:45:56 2022] DELETE /identity/v3/projects/6be62bda1cb94940a516c35d5e06a77a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:45:56.615779 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b350bb-ac27-46d2-b38e-c60f36ab1b81 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:45:56.616262 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b350bb-ac27-46d2-b38e-c60f36ab1b81 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:45:56.616360 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b350bb-ac27-46d2-b38e-c60f36ab1b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:45:56.636741 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-52b350bb-ac27-46d2-b38e-c60f36ab1b81 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:45:56.637873 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-52b350bb-ac27-46d2-b38e-c60f36ab1b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:45:56.701254 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4485/8990] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:45:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:45:56.706363 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7714c6-b5ef-48f0-9234-9ebb5dc34f07 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:45:56.706658 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7714c6-b5ef-48f0-9234-9ebb5dc34f07 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:45:56.706938 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7714c6-b5ef-48f0-9234-9ebb5dc34f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:45:56.727996 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-cd7714c6-b5ef-48f0-9234-9ebb5dc34f07 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:45:56.729849 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-cd7714c6-b5ef-48f0-9234-9ebb5dc34f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:45:56.737872 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4506/8991] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:45:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:45:56.742136 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b350bb-ac27-46d2-b38e-c60f36ab1b81 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:45:56.752711 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b350bb-ac27-46d2-b38e-c60f36ab1b81 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:45:56.757500 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef41a8-3e94-4c2b-b50c-8318be8d352b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:45:56.758106 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef41a8-3e94-4c2b-b50c-8318be8d352b admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:45:56.758388 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef41a8-3e94-4c2b-b50c-8318be8d352b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:45:56.758662 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef41a8-3e94-4c2b-b50c-8318be8d352b admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:45:56.759343 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef41a8-3e94-4c2b-b50c-8318be8d352b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:45:56.759649 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef41a8-3e94-4c2b-b50c-8318be8d352b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:45:56.761393 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef41a8-3e94-4c2b-b50c-8318be8d352b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:45:56.773539 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4486/8992] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:45:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:45:56.779259 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7714c6-b5ef-48f0-9234-9ebb5dc34f07 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:45:56.788640 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7714c6-b5ef-48f0-9234-9ebb5dc34f07 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:45:56.794678 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3858d71-8abf-41bc-809d-b70baa979a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:45:56.795354 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3858d71-8abf-41bc-809d-b70baa979a8b admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:45:56.795628 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3858d71-8abf-41bc-809d-b70baa979a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:45:56.795895 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3858d71-8abf-41bc-809d-b70baa979a8b admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:45:56.796519 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3858d71-8abf-41bc-809d-b70baa979a8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:45:56.798409 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3858d71-8abf-41bc-809d-b70baa979a8b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:45:56.826906 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4507/8993] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:45:56 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:45:56.831301 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef41a8-3e94-4c2b-b50c-8318be8d352b admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:45:56.842245 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef41a8-3e94-4c2b-b50c-8318be8d352b admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:45:56.897735 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c52797-be56-47c1-9b03-29ddc352e0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:45:56.898262 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c52797-be56-47c1-9b03-29ddc352e0ef admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:45:56.898543 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c52797-be56-47c1-9b03-29ddc352e0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:45:56.898815 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c52797-be56-47c1-9b03-29ddc352e0ef admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:45:56.899471 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c52797-be56-47c1-9b03-29ddc352e0ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:45:56.902016 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c52797-be56-47c1-9b03-29ddc352e0ef admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:45:56.923273 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4487/8994] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:45:56 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:45:56.927514 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3858d71-8abf-41bc-809d-b70baa979a8b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:45:56.938223 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3858d71-8abf-41bc-809d-b70baa979a8b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:45:56.942927 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c8d12-7554-4605-ae69-3ee74da38062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:45:56.943571 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c8d12-7554-4605-ae69-3ee74da38062 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:45:56.943851 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c8d12-7554-4605-ae69-3ee74da38062 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:45:56.944125 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c8d12-7554-4605-ae69-3ee74da38062 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:45:56.944765 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c8d12-7554-4605-ae69-3ee74da38062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:45:56.946368 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c8d12-7554-4605-ae69-3ee74da38062 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:45:56.956708 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4508/8995] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:45:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:45:56.960815 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c52797-be56-47c1-9b03-29ddc352e0ef admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:45:56.971077 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c52797-be56-47c1-9b03-29ddc352e0ef admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:45:56.975829 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b4fbb-a8f2-454b-b133-da9ee25e8cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:45:56.976432 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b4fbb-a8f2-454b-b133-da9ee25e8cad admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:45:56.976714 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b4fbb-a8f2-454b-b133-da9ee25e8cad admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:45:56.977124 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b4fbb-a8f2-454b-b133-da9ee25e8cad admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:45:56.977663 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b4fbb-a8f2-454b-b133-da9ee25e8cad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:45:56.979880 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b4fbb-a8f2-454b-b133-da9ee25e8cad admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:45:56.990726 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4488/8996] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:45:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:45:56.995626 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c8d12-7554-4605-ae69-3ee74da38062 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:45:57.006900 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c8d12-7554-4605-ae69-3ee74da38062 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:45:57.011715 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1211aad-6ceb-4cbb-a77b-ec5443504b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:45:57.012375 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1211aad-6ceb-4cbb-a77b-ec5443504b04 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:45:57.012655 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1211aad-6ceb-4cbb-a77b-ec5443504b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:45:57.012930 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1211aad-6ceb-4cbb-a77b-ec5443504b04 admin admin] PATH_INFO: `/v3/projects/e85e2ac1358a4913bfc77ae8d79802da/users/da236bec13cf409ca4f644e76fbb5e1b/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:45:57.027820 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1211aad-6ceb-4cbb-a77b-ec5443504b04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e85e2ac1358a4913bfc77ae8d79802da, user_id=da236bec13cf409ca4f644e76fbb5e1b, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:45:57.030484 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1211aad-6ceb-4cbb-a77b-ec5443504b04 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:45:57.044251 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4509/8997] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:45:56 2022] PUT /identity/v3/projects/e85e2ac1358a4913bfc77ae8d79802da/users/da236bec13cf409ca4f644e76fbb5e1b/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:45:57.049380 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa047cb3-df3b-4a69-b872-644adc38023b None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:45:57.049668 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa047cb3-df3b-4a69-b872-644adc38023b None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:45:57.049946 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa047cb3-df3b-4a69-b872-644adc38023b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:45:57.058214 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:45:57.070741 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-fa047cb3-df3b-4a69-b872-644adc38023b None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:45:57.072037 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-fa047cb3-df3b-4a69-b872-644adc38023b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:45:57.134940 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4489/8998] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:45:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:45:57.144740 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1211aad-6ceb-4cbb-a77b-ec5443504b04 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:45:57.146423 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f1211aad-6ceb-4cbb-a77b-ec5443504b04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:45:57.208998 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1211aad-6ceb-4cbb-a77b-ec5443504b04 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:45:57.212797 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fcbd63-7440-4949-aa31-e41b973e0a50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:45:57.214075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fcbd63-7440-4949-aa31-e41b973e0a50 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:45:57.214353 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fcbd63-7440-4949-aa31-e41b973e0a50 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:45:57.214634 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fcbd63-7440-4949-aa31-e41b973e0a50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:45:57.224431 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fcbd63-7440-4949-aa31-e41b973e0a50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:45:57.225882 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fcbd63-7440-4949-aa31-e41b973e0a50 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:45:57.236594 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4510/8999] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:45:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:46:01.072315 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9eeca-814d-4577-bdaa-a7b7021a47a6 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:46:01.073372 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9eeca-814d-4577-bdaa-a7b7021a47a6 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:46:01.073469 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9eeca-814d-4577-bdaa-a7b7021a47a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:46:01.103285 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-dcf9eeca-814d-4577-bdaa-a7b7021a47a6 None None] MFA Rules not processed for user `da236bec13cf409ca4f644e76fbb5e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:46:01.104590 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-dcf9eeca-814d-4577-bdaa-a7b7021a47a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:46:01.171682 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4490/9000] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:46:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:46:01.176108 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fcbd63-7440-4949-aa31-e41b973e0a50 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:46:01.186751 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fcbd63-7440-4949-aa31-e41b973e0a50 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:46:01.191729 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3abc5f-eb26-471e-89e5-4882af7d944b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:46:01.192424 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3abc5f-eb26-471e-89e5-4882af7d944b admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:46:01.192774 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3abc5f-eb26-471e-89e5-4882af7d944b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:46:01.193143 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3abc5f-eb26-471e-89e5-4882af7d944b admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:46:01.193862 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3abc5f-eb26-471e-89e5-4882af7d944b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:46:01.195912 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3abc5f-eb26-471e-89e5-4882af7d944b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:46:01.226308 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4511/9001] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:46:01 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:46:01.231071 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9eeca-814d-4577-bdaa-a7b7021a47a6 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:46:01.243012 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9eeca-814d-4577-bdaa-a7b7021a47a6 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:46:01.312391 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f679af-b465-43c7-9be2-700953c58f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:46:01.313380 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f679af-b465-43c7-9be2-700953c58f0b admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:46:01.313380 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f679af-b465-43c7-9be2-700953c58f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:46:01.313579 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f679af-b465-43c7-9be2-700953c58f0b admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:46:01.314137 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f679af-b465-43c7-9be2-700953c58f0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:46:01.316164 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f679af-b465-43c7-9be2-700953c58f0b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:46:01.348546 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4491/9002] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:46:01 2022] POST /identity/v3/users => generated 298 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:46:01.352505 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3abc5f-eb26-471e-89e5-4882af7d944b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:46:01.365861 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3abc5f-eb26-471e-89e5-4882af7d944b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:46:01.370746 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff94dd-44e8-448c-87bc-a48bca7baee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:46:01.371412 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff94dd-44e8-448c-87bc-a48bca7baee9 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:46:01.371692 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff94dd-44e8-448c-87bc-a48bca7baee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:46:01.371972 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff94dd-44e8-448c-87bc-a48bca7baee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:46:01.372618 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff94dd-44e8-448c-87bc-a48bca7baee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:46:01.374244 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff94dd-44e8-448c-87bc-a48bca7baee9 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:46:01.388519 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4512/9003] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:46:01.392606 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f679af-b465-43c7-9be2-700953c58f0b admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:46:01.404849 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f679af-b465-43c7-9be2-700953c58f0b admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:46:01.410846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d86deda-6f80-4de8-aa70-af5f3a9af1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:46:01.411958 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86deda-6f80-4de8-aa70-af5f3a9af1b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:46:01.412436 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86deda-6f80-4de8-aa70-af5f3a9af1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:46:01.412723 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86deda-6f80-4de8-aa70-af5f3a9af1b8 admin admin] PATH_INFO: `/v3/projects/418fb3e6b27b4a579c3c7af59f0b8eec/users/1ff37f714f084f82992237c07c4e6772/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:46:01.436463 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d86deda-6f80-4de8-aa70-af5f3a9af1b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=418fb3e6b27b4a579c3c7af59f0b8eec, user_id=1ff37f714f084f82992237c07c4e6772, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:46:01.440504 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d86deda-6f80-4de8-aa70-af5f3a9af1b8 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:46:01.457204 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:46:01.460749 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4492/9004] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:46:01 2022] PUT /identity/v3/projects/418fb3e6b27b4a579c3c7af59f0b8eec/users/1ff37f714f084f82992237c07c4e6772/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:46:01.466325 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff94dd-44e8-448c-87bc-a48bca7baee9 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:46:01.498086 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff94dd-44e8-448c-87bc-a48bca7baee9 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:46:01.535878 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:46:01.577660 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3906f6-70c4-4523-b67c-9e2d069406af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:46:01.578343 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3906f6-70c4-4523-b67c-9e2d069406af admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:46:01.578664 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3906f6-70c4-4523-b67c-9e2d069406af admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:46:01.578938 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3906f6-70c4-4523-b67c-9e2d069406af admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:46:01.579632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3906f6-70c4-4523-b67c-9e2d069406af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:46:01.581282 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3906f6-70c4-4523-b67c-9e2d069406af admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:46:01.593370 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4513/9005] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:46:01.597578 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d86deda-6f80-4de8-aa70-af5f3a9af1b8 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:46:01.609515 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d86deda-6f80-4de8-aa70-af5f3a9af1b8 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:46:01.614340 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33831185-2145-4f08-b3c2-9b7208428104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:46:01.615005 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33831185-2145-4f08-b3c2-9b7208428104 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:46:01.615459 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33831185-2145-4f08-b3c2-9b7208428104 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:46:01.615738 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33831185-2145-4f08-b3c2-9b7208428104 admin admin] PATH_INFO: `/v3/projects/418fb3e6b27b4a579c3c7af59f0b8eec/users/1ff37f714f084f82992237c07c4e6772/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:46:01.617724 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33831185-2145-4f08-b3c2-9b7208428104 admin admin] RBAC: Authorizing `identity:create_grant(project_id=418fb3e6b27b4a579c3c7af59f0b8eec, user_id=1ff37f714f084f82992237c07c4e6772, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:46:01.620776 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33831185-2145-4f08-b3c2-9b7208428104 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:46:01.632866 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4493/9006] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:46:01 2022] PUT /identity/v3/projects/418fb3e6b27b4a579c3c7af59f0b8eec/users/1ff37f714f084f82992237c07c4e6772/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:46:06.310852 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfed6ee-7f39-4ea7-9a90-1e1680d86d77 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:46:06.311904 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfed6ee-7f39-4ea7-9a90-1e1680d86d77 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:46:06.312302 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfed6ee-7f39-4ea7-9a90-1e1680d86d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:46:06.354598 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-7cfed6ee-7f39-4ea7-9a90-1e1680d86d77 None None] MFA Rules not processed for user `1ff37f714f084f82992237c07c4e6772`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:46:06.356104 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7cfed6ee-7f39-4ea7-9a90-1e1680d86d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:46:06.482418 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4514/9007] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:46:06 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:46:06.517970 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d06e2-5fef-4fe6-9bf4-85030df9d3be None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:46:06.518420 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d06e2-5fef-4fe6-9bf4-85030df9d3be None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:46:06.519474 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d06e2-5fef-4fe6-9bf4-85030df9d3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:46:06.610618 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-820d06e2-5fef-4fe6-9bf4-85030df9d3be None None] MFA Rules not processed for user `e6b0f9835ed549cab91d684326be83fa`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:46:06.612197 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-820d06e2-5fef-4fe6-9bf4-85030df9d3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:46:06.681014 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4494/9008] 10.222.0.83 () {58 vars in 1064 bytes} [Mon Aug 29 16:46:06 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:46:06.688413 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfed6ee-7f39-4ea7-9a90-1e1680d86d77 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:46:06.699584 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfed6ee-7f39-4ea7-9a90-1e1680d86d77 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:46:06.703942 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d75a2-5f4f-451b-bcba-b352a948014c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6b0f9835ed549cab91d684326be83fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:46:06.704585 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d75a2-5f4f-451b-bcba-b352a948014c service glance] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:46:06.704863 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d75a2-5f4f-451b-bcba-b352a948014c service glance] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:46:06.705138 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d75a2-5f4f-451b-bcba-b352a948014c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:46:06.787633 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3d75a2-5f4f-451b-bcba-b352a948014c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:46:06.789312 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3d75a2-5f4f-451b-bcba-b352a948014c service glance] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:46:06.800405 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4515/9009] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:46:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:46:06.940353 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d631192-3c32-44f0-92e4-ef6f3aa6add5 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:46:06.940645 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d631192-3c32-44f0-92e4-ef6f3aa6add5 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:46:06.940927 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d631192-3c32-44f0-92e4-ef6f3aa6add5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:46:06.994365 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-5d631192-3c32-44f0-92e4-ef6f3aa6add5 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:46:06.995901 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5d631192-3c32-44f0-92e4-ef6f3aa6add5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:46:07.066183 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4495/9010] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 16:46:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:46:07.113605 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3bb3c-7c71-4fa0-a4fe-7d69c49fcfb4 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:46:07.113900 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3bb3c-7c71-4fa0-a4fe-7d69c49fcfb4 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:46:07.114181 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3bb3c-7c71-4fa0-a4fe-7d69c49fcfb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:46:07.166810 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-6cf3bb3c-7c71-4fa0-a4fe-7d69c49fcfb4 None None] MFA Rules not processed for user `b0f8e95d393f499baf44830f9fb7e583`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:46:07.168078 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6cf3bb3c-7c71-4fa0-a4fe-7d69c49fcfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:46:07.185926 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=100 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:46:07.242984 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4516/9011] 10.222.0.83 () {58 vars in 1040 bytes} [Mon Aug 29 16:46:07 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:46:07.250215 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d631192-3c32-44f0-92e4-ef6f3aa6add5 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:46:07.263046 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d631192-3c32-44f0-92e4-ef6f3aa6add5 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:46:07.268131 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6148d1a6-4fce-43ac-b048-8983b420261d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:46:07.268741 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148d1a6-4fce-43ac-b048-8983b420261d service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:46:07.269025 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148d1a6-4fce-43ac-b048-8983b420261d service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:46:07.269301 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148d1a6-4fce-43ac-b048-8983b420261d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:46:07.277507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6148d1a6-4fce-43ac-b048-8983b420261d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:46:07.279137 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6148d1a6-4fce-43ac-b048-8983b420261d service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:46:07.287268 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4496/9012] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 16:46:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:46:16.089469 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdeef1-8e97-4c60-80a6-2b0efdaa2ab6 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:46:16.090107 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdeef1-8e97-4c60-80a6-2b0efdaa2ab6 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:46:16.090404 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdeef1-8e97-4c60-80a6-2b0efdaa2ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:46:16.110549 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-11cdeef1-8e97-4c60-80a6-2b0efdaa2ab6 None None] MFA Rules not processed for user `da236bec13cf409ca4f644e76fbb5e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:46:16.111780 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-11cdeef1-8e97-4c60-80a6-2b0efdaa2ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:46:16.118692 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4517/9013] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:46:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:46:17.284007 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:46:18.438441 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3907dd-0e3d-429e-bc10-90c3c8883505 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:46:18.439062 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3907dd-0e3d-429e-bc10-90c3c8883505 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:46:18.439062 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3907dd-0e3d-429e-bc10-90c3c8883505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:46:18.459093 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-5e3907dd-0e3d-429e-bc10-90c3c8883505 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:46:18.460325 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5e3907dd-0e3d-429e-bc10-90c3c8883505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:46:18.467797 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4497/9014] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 16:46:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:46:18.481170 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cdeef1-8e97-4c60-80a6-2b0efdaa2ab6 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:46:18.493211 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cdeef1-8e97-4c60-80a6-2b0efdaa2ab6 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:46:18.499345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e970cbcf-e908-441d-836e-91ddb3aacab2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:46:18.499955 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970cbcf-e908-441d-836e-91ddb3aacab2 service swift] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:46:18.500232 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970cbcf-e908-441d-836e-91ddb3aacab2 service swift] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:46:18.500505 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970cbcf-e908-441d-836e-91ddb3aacab2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:46:18.509088 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e970cbcf-e908-441d-836e-91ddb3aacab2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:46:18.511233 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e970cbcf-e908-441d-836e-91ddb3aacab2 service swift] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:46:18.521230 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4518/9015] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 16:46:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:46:25.298037 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3907dd-0e3d-429e-bc10-90c3c8883505 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:46:25.382286 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3907dd-0e3d-429e-bc10-90c3c8883505 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:46:25.389082 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9bd7a-b52b-4640-9346-0f346ea73374 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:46:25.390119 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9bd7a-b52b-4640-9346-0f346ea73374 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:46:25.390460 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9bd7a-b52b-4640-9346-0f346ea73374 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:46:25.390804 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9bd7a-b52b-4640-9346-0f346ea73374 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:46:25.392744 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-fde9bd7a-b52b-4640-9346-0f346ea73374 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:46:25.509049 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde9bd7a-b52b-4640-9346-0f346ea73374 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:46:25.511403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde9bd7a-b52b-4640-9346-0f346ea73374 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:46:25.524403 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4498/9016] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:46:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:46:26.718407 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e970cbcf-e908-441d-836e-91ddb3aacab2 service swift] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:46:26.720753 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e970cbcf-e908-441d-836e-91ddb3aacab2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:46:26.745875 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e970cbcf-e908-441d-836e-91ddb3aacab2 service swift] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:46:26.749879 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130fa4b8-df67-43be-96fb-52ed3a43e868 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:46:26.750594 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130fa4b8-df67-43be-96fb-52ed3a43e868 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:46:26.750876 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130fa4b8-df67-43be-96fb-52ed3a43e868 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:46:26.751188 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130fa4b8-df67-43be-96fb-52ed3a43e868 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:46:26.752950 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-130fa4b8-df67-43be-96fb-52ed3a43e868 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:46:26.767357 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130fa4b8-df67-43be-96fb-52ed3a43e868 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:46:26.768794 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130fa4b8-df67-43be-96fb-52ed3a43e868 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:46:26.780794 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4519/9017] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:46:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:46:35.519117 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=79 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:46:36.775410 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=43 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:46:46.852108 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9bd7a-b52b-4640-9346-0f346ea73374 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:46:46.861406 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9bd7a-b52b-4640-9346-0f346ea73374 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:46:46.865184 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6ad8c-a6e8-45ae-a9ac-464662c41417 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:46:46.865796 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6ad8c-a6e8-45ae-a9ac-464662c41417 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:46:46.866080 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6ad8c-a6e8-45ae-a9ac-464662c41417 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:46:46.866353 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6ad8c-a6e8-45ae-a9ac-464662c41417 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:46:46.868921 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-32c6ad8c-a6e8-45ae-a9ac-464662c41417 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:46:46.878965 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c6ad8c-a6e8-45ae-a9ac-464662c41417 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:46:46.880430 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c6ad8c-a6e8-45ae-a9ac-464662c41417 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:46:46.889733 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4499/9018] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:46:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:46:52.953810 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130fa4b8-df67-43be-96fb-52ed3a43e868 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:46:52.962310 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130fa4b8-df67-43be-96fb-52ed3a43e868 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:46:52.966189 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c049e0-32ee-40c6-942e-a1e98ecce9e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:46:52.966779 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c049e0-32ee-40c6-942e-a1e98ecce9e1 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:46:52.967085 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c049e0-32ee-40c6-942e-a1e98ecce9e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:46:52.967357 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c049e0-32ee-40c6-942e-a1e98ecce9e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:46:52.976243 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c049e0-32ee-40c6-942e-a1e98ecce9e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:46:52.977653 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c049e0-32ee-40c6-942e-a1e98ecce9e1 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:46:52.987728 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4520/9019] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:46:52 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:46:56.885516 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=6 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:47:02.983515 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=6 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:48:44.235940 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6ad8c-a6e8-45ae-a9ac-464662c41417 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:48:44.237392 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-32c6ad8c-a6e8-45ae-a9ac-464662c41417 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:48:44.320240 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6ad8c-a6e8-45ae-a9ac-464662c41417 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:48:44.325255 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f6f97a-5186-4a39-8872-c5c6f0b90614 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:48:44.325860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6f97a-5186-4a39-8872-c5c6f0b90614 service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:48:44.326142 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6f97a-5186-4a39-8872-c5c6f0b90614 service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:48:44.326405 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6f97a-5186-4a39-8872-c5c6f0b90614 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:48:44.328166 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-26f6f97a-5186-4a39-8872-c5c6f0b90614 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:48:44.340701 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f6f97a-5186-4a39-8872-c5c6f0b90614 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:48:44.342273 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f6f97a-5186-4a39-8872-c5c6f0b90614 service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:48:44.352863 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4500/9020] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:48:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:48:54.348699 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=37 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:49:59.154168 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c049e0-32ee-40c6-942e-a1e98ecce9e1 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:49:59.155581 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-48c049e0-32ee-40c6-942e-a1e98ecce9e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:49:59.169706 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c049e0-32ee-40c6-942e-a1e98ecce9e1 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:49:59.174896 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b758ed33-eadf-4557-9a57-d09c6a3c50bd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:49:59.175550 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b758ed33-eadf-4557-9a57-d09c6a3c50bd service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:49:59.175835 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b758ed33-eadf-4557-9a57-d09c6a3c50bd service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:49:59.176217 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b758ed33-eadf-4557-9a57-d09c6a3c50bd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:49:59.177942 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b758ed33-eadf-4557-9a57-d09c6a3c50bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:49:59.193583 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b758ed33-eadf-4557-9a57-d09c6a3c50bd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:49:59.196208 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b758ed33-eadf-4557-9a57-d09c6a3c50bd service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:49:59.206681 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4521/9021] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:49:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:50:09.202385 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=6 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:50:59.011711 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f6f97a-5186-4a39-8872-c5c6f0b90614 service placement] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:50:59.014115 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-26f6f97a-5186-4a39-8872-c5c6f0b90614 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:50:59.099546 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f6f97a-5186-4a39-8872-c5c6f0b90614 service placement] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:50:59.106267 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c85b8-e04a-4452-a995-2245b53c8a2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:50:59.107297 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c85b8-e04a-4452-a995-2245b53c8a2d service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:50:59.107827 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c85b8-e04a-4452-a995-2245b53c8a2d service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:50:59.108277 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c85b8-e04a-4452-a995-2245b53c8a2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:50:59.110960 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-825c85b8-e04a-4452-a995-2245b53c8a2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:50:59.126311 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c85b8-e04a-4452-a995-2245b53c8a2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:50:59.129049 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c85b8-e04a-4452-a995-2245b53c8a2d service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:50:59.141856 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4501/9022] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:50:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:51:07.211268 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b758ed33-eadf-4557-9a57-d09c6a3c50bd service placement] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:51:07.212719 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b758ed33-eadf-4557-9a57-d09c6a3c50bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:51:07.271401 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b758ed33-eadf-4557-9a57-d09c6a3c50bd service placement] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:51:07.275372 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc51c4-6615-48f6-93a9-f91fd4803dd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd42634b2795427cba6614c53491ded2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:51:07.275986 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc51c4-6615-48f6-93a9-f91fd4803dd7 service cinder] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:51:07.276269 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc51c4-6615-48f6-93a9-f91fd4803dd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:51:07.276543 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc51c4-6615-48f6-93a9-f91fd4803dd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:51:07.287133 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc51c4-6615-48f6-93a9-f91fd4803dd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:51:07.289024 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc51c4-6615-48f6-93a9-f91fd4803dd7 service cinder] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:51:07.299728 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4522/9023] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:51:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:51:09.136178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=18 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:51:13.248665 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897669f0-c961-46a6-b101-dc8a2359b1f6 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:51:13.249242 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897669f0-c961-46a6-b101-dc8a2359b1f6 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:51:13.249242 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897669f0-c961-46a6-b101-dc8a2359b1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:51:13.269382 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-897669f0-c961-46a6-b101-dc8a2359b1f6 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:51:13.270701 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-897669f0-c961-46a6-b101-dc8a2359b1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:51:13.277871 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4502/9024] 10.222.0.83 () {58 vars in 967 bytes} [Mon Aug 29 16:51:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:51:13.318887 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc51c4-6615-48f6-93a9-f91fd4803dd7 service cinder] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:51:13.330802 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc51c4-6615-48f6-93a9-f91fd4803dd7 service cinder] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:51:13.340471 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f21f1-3119-466a-b063-9450cb5e093f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:51:13.341026 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f21f1-3119-466a-b063-9450cb5e093f service swift] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:51:13.341309 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f21f1-3119-466a-b063-9450cb5e093f service swift] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:51:13.341582 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f21f1-3119-466a-b063-9450cb5e093f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:51:13.350777 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42f21f1-3119-466a-b063-9450cb5e093f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:51:13.352403 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42f21f1-3119-466a-b063-9450cb5e093f service swift] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:51:13.360567 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4523/9025] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 16:51:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:51:13.837841 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708717f3-7552-45b7-a456-de29c0b1d23e None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:51:13.838199 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708717f3-7552-45b7-a456-de29c0b1d23e None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:51:13.838478 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708717f3-7552-45b7-a456-de29c0b1d23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:51:13.857625 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-708717f3-7552-45b7-a456-de29c0b1d23e None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:51:13.858889 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-708717f3-7552-45b7-a456-de29c0b1d23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:51:13.866312 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4503/9026] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 16:51:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:51:13.878790 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f21f1-3119-466a-b063-9450cb5e093f service swift] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:51:13.888996 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f21f1-3119-466a-b063-9450cb5e093f service swift] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:51:13.894792 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576f8c5-5878-4b7e-8a74-8acf74e53177 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:51:13.895431 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576f8c5-5878-4b7e-8a74-8acf74e53177 service swift] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:51:13.895733 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576f8c5-5878-4b7e-8a74-8acf74e53177 service swift] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:51:13.896008 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576f8c5-5878-4b7e-8a74-8acf74e53177 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:51:13.904536 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8576f8c5-5878-4b7e-8a74-8acf74e53177 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:51:13.906264 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8576f8c5-5878-4b7e-8a74-8acf74e53177 service swift] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:51:13.914965 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4524/9027] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 16:51:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:51:22.343558 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b841f33-3bf6-46c5-b0f1-d4ec7af6389b None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:51:22.344091 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b841f33-3bf6-46c5-b0f1-d4ec7af6389b None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:51:22.344205 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b841f33-3bf6-46c5-b0f1-d4ec7af6389b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:51:22.364690 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-9b841f33-3bf6-46c5-b0f1-d4ec7af6389b None None] MFA Rules not processed for user `da236bec13cf409ca4f644e76fbb5e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:51:22.365893 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9b841f33-3bf6-46c5-b0f1-d4ec7af6389b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:51:22.372873 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4504/9028] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:51:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:51:22.632831 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576f8c5-5878-4b7e-8a74-8acf74e53177 service swift] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:51:22.652832 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576f8c5-5878-4b7e-8a74-8acf74e53177 service swift] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:51:22.656449 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e452790d-f55a-4501-b563-8a55d5ee0945 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:51:22.657048 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452790d-f55a-4501-b563-8a55d5ee0945 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:51:22.657324 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452790d-f55a-4501-b563-8a55d5ee0945 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:51:22.657592 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452790d-f55a-4501-b563-8a55d5ee0945 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:51:22.659301 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e452790d-f55a-4501-b563-8a55d5ee0945 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:51:22.683128 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e452790d-f55a-4501-b563-8a55d5ee0945 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:51:22.684752 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e452790d-f55a-4501-b563-8a55d5ee0945 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:51:22.692739 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4525/9029] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:51:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:51:23.016075 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b841f33-3bf6-46c5-b0f1-d4ec7af6389b None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:51:23.029806 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b841f33-3bf6-46c5-b0f1-d4ec7af6389b None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:51:23.035078 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3077ba5-950a-4aef-aea9-c27babf81f15 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:51:23.035846 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3077ba5-950a-4aef-aea9-c27babf81f15 service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:51:23.036132 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3077ba5-950a-4aef-aea9-c27babf81f15 service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:51:23.036404 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3077ba5-950a-4aef-aea9-c27babf81f15 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:51:23.038285 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f3077ba5-950a-4aef-aea9-c27babf81f15 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:51:23.050254 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3077ba5-950a-4aef-aea9-c27babf81f15 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:51:23.051975 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3077ba5-950a-4aef-aea9-c27babf81f15 service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:51:23.062865 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4505/9030] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:51:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:51:24.232214 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771612f-9c9b-47a2-8bf1-064ffef0ca18 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:51:24.232708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771612f-9c9b-47a2-8bf1-064ffef0ca18 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:51:24.232928 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771612f-9c9b-47a2-8bf1-064ffef0ca18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:51:24.252123 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-9771612f-9c9b-47a2-8bf1-064ffef0ca18 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:51:24.253627 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9771612f-9c9b-47a2-8bf1-064ffef0ca18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:51:24.261488 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4526/9031] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 16:51:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:51:24.274456 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3077ba5-950a-4aef-aea9-c27babf81f15 service placement] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:51:24.286083 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3077ba5-950a-4aef-aea9-c27babf81f15 service placement] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:51:24.291100 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fcd730-819b-4853-a19b-7861ed334a17 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:51:24.291708 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcd730-819b-4853-a19b-7861ed334a17 service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:51:24.291985 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcd730-819b-4853-a19b-7861ed334a17 service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:51:24.292254 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcd730-819b-4853-a19b-7861ed334a17 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:51:24.302246 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fcd730-819b-4853-a19b-7861ed334a17 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:51:24.304228 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fcd730-819b-4853-a19b-7861ed334a17 service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:51:24.313133 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4506/9032] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 16:51:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:51:26.448788 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771612f-9c9b-47a2-8bf1-064ffef0ca18 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:51:26.473174 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771612f-9c9b-47a2-8bf1-064ffef0ca18 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:51:26.477390 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678773da-e8ac-436a-a6fe-b502d7187534 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:51:26.478025 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678773da-e8ac-436a-a6fe-b502d7187534 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:51:26.478322 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678773da-e8ac-436a-a6fe-b502d7187534 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:51:26.478604 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678773da-e8ac-436a-a6fe-b502d7187534 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:51:26.495878 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678773da-e8ac-436a-a6fe-b502d7187534 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:51:26.498203 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678773da-e8ac-436a-a6fe-b502d7187534 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:51:26.512758 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4527/9033] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:51:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:51:27.729932 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fcd730-819b-4853-a19b-7861ed334a17 service swift] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:51:27.741060 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fcd730-819b-4853-a19b-7861ed334a17 service swift] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:51:27.745253 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7c565-aa5b-49dc-82a8-60030099078a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:51:27.746045 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7c565-aa5b-49dc-82a8-60030099078a service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:51:27.746644 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7c565-aa5b-49dc-82a8-60030099078a service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:51:27.747115 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7c565-aa5b-49dc-82a8-60030099078a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:51:27.760422 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a7c565-aa5b-49dc-82a8-60030099078a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:51:27.761909 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a7c565-aa5b-49dc-82a8-60030099078a service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:51:27.775042 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4507/9034] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:51:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:51:33.028537 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678773da-e8ac-436a-a6fe-b502d7187534 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:51:33.032707 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=63 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:51:33.039173 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678773da-e8ac-436a-a6fe-b502d7187534 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:51:33.042909 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f07fe-dd33-44d3-91b7-dbc539d4df3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:51:33.043595 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f07fe-dd33-44d3-91b7-dbc539d4df3e service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:51:33.043877 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f07fe-dd33-44d3-91b7-dbc539d4df3e service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:51:33.044154 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f07fe-dd33-44d3-91b7-dbc539d4df3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:51:33.045898 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2e5f07fe-dd33-44d3-91b7-dbc539d4df3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:51:33.055755 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f07fe-dd33-44d3-91b7-dbc539d4df3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:51:33.057173 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f07fe-dd33-44d3-91b7-dbc539d4df3e service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:51:33.065335 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4528/9035] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:51:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:51:33.656594 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7c565-aa5b-49dc-82a8-60030099078a service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:51:33.670295 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7c565-aa5b-49dc-82a8-60030099078a service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:51:33.678767 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a385e26e-27e9-4626-920a-21c90afcfd3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:51:33.679615 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385e26e-27e9-4626-920a-21c90afcfd3b service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:51:33.679976 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385e26e-27e9-4626-920a-21c90afcfd3b service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:51:33.680395 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385e26e-27e9-4626-920a-21c90afcfd3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:51:33.682520 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-a385e26e-27e9-4626-920a-21c90afcfd3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:51:33.697898 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a385e26e-27e9-4626-920a-21c90afcfd3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:51:33.700605 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a385e26e-27e9-4626-920a-21c90afcfd3b service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:51:33.715895 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4508/9036] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:51:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:51:37.828965 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f07fe-dd33-44d3-91b7-dbc539d4df3e service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:51:37.830565 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2e5f07fe-dd33-44d3-91b7-dbc539d4df3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:51:37.849658 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f07fe-dd33-44d3-91b7-dbc539d4df3e service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:51:37.855202 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d9326c-f312-4765-84cd-c3f86ab6e749 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:51:37.855811 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9326c-f312-4765-84cd-c3f86ab6e749 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:51:37.856087 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9326c-f312-4765-84cd-c3f86ab6e749 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:51:37.856356 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9326c-f312-4765-84cd-c3f86ab6e749 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:51:37.858057 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-59d9326c-f312-4765-84cd-c3f86ab6e749 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:51:37.870976 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d9326c-f312-4765-84cd-c3f86ab6e749 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:51:37.872594 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d9326c-f312-4765-84cd-c3f86ab6e749 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:51:37.884392 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4529/9037] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:51:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:51:43.710686 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=33 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:51:47.879757 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=11 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:51:53.009795 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a385e26e-27e9-4626-920a-21c90afcfd3b service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:51:53.019812 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a385e26e-27e9-4626-920a-21c90afcfd3b service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:51:53.023583 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e5327-0477-44ac-a1da-3149504c5aa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:51:53.024185 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e5327-0477-44ac-a1da-3149504c5aa3 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:51:53.024462 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e5327-0477-44ac-a1da-3149504c5aa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:51:53.024729 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e5327-0477-44ac-a1da-3149504c5aa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:51:53.034626 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e5327-0477-44ac-a1da-3149504c5aa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:51:53.036148 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e5327-0477-44ac-a1da-3149504c5aa3 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:51:53.045660 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4509/9038] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:51:53 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:52:03.041528 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=6 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:53:11.986869 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a2dca-5fed-4b46-8ab9-ae3de08e9b17 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:53:11.987400 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a2dca-5fed-4b46-8ab9-ae3de08e9b17 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:53:11.987501 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a2dca-5fed-4b46-8ab9-ae3de08e9b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:53:12.006921 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-ae4a2dca-5fed-4b46-8ab9-ae3de08e9b17 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:53:12.008223 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ae4a2dca-5fed-4b46-8ab9-ae3de08e9b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:53:12.016554 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4530/9039] 10.222.0.83 () {58 vars in 967 bytes} [Mon Aug 29 16:53:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:53:12.056787 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e5327-0477-44ac-a1da-3149504c5aa3 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:53:12.068806 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e5327-0477-44ac-a1da-3149504c5aa3 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:53:12.074473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad65b8-9d7c-4999-9a75-fba6f0c118c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:53:12.075240 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad65b8-9d7c-4999-9a75-fba6f0c118c5 service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:53:12.075524 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad65b8-9d7c-4999-9a75-fba6f0c118c5 service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:53:12.075799 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad65b8-9d7c-4999-9a75-fba6f0c118c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:53:12.083872 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad65b8-9d7c-4999-9a75-fba6f0c118c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:53:12.085489 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad65b8-9d7c-4999-9a75-fba6f0c118c5 service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:53:12.093621 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4510/9040] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 16:53:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:53:12.442773 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a2dca-5fed-4b46-8ab9-ae3de08e9b17 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:53:12.452551 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a2dca-5fed-4b46-8ab9-ae3de08e9b17 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:53:12.456148 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d70a7-02ff-4da2-a552-b319f48f6b5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:53:12.456754 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d70a7-02ff-4da2-a552-b319f48f6b5e service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:53:12.457036 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d70a7-02ff-4da2-a552-b319f48f6b5e service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:53:12.457317 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d70a7-02ff-4da2-a552-b319f48f6b5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:53:12.529125 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d70a7-02ff-4da2-a552-b319f48f6b5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:53:12.530584 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d70a7-02ff-4da2-a552-b319f48f6b5e service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:53:12.550018 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4531/9041] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:53:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:53:15.768588 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad65b8-9d7c-4999-9a75-fba6f0c118c5 service swift] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:53:15.808427 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad65b8-9d7c-4999-9a75-fba6f0c118c5 service swift] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:53:15.816409 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ca875-5e24-474b-b9d0-fae26711ac5e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:53:15.817129 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ca875-5e24-474b-b9d0-fae26711ac5e service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:53:15.817598 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ca875-5e24-474b-b9d0-fae26711ac5e service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:53:15.818063 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ca875-5e24-474b-b9d0-fae26711ac5e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:53:15.820598 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-277ca875-5e24-474b-b9d0-fae26711ac5e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:53:15.836811 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277ca875-5e24-474b-b9d0-fae26711ac5e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:53:15.839472 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277ca875-5e24-474b-b9d0-fae26711ac5e service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:53:15.853225 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4511/9042] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:53:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:53:19.127909 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d70a7-02ff-4da2-a552-b319f48f6b5e service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:53:19.141182 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d70a7-02ff-4da2-a552-b319f48f6b5e service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:53:19.144265 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a795d9-1d6d-42b6-80ab-4b576e2db99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:53:19.144922 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a795d9-1d6d-42b6-80ab-4b576e2db99d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:53:19.145203 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a795d9-1d6d-42b6-80ab-4b576e2db99d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:53:19.145541 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a795d9-1d6d-42b6-80ab-4b576e2db99d admin admin] PATH_INFO: `/v3/users/da236bec13cf409ca4f644e76fbb5e1b` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:53:19.146703 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a795d9-1d6d-42b6-80ab-4b576e2db99d admin admin] RBAC: Authorizing `identity:delete_user(user_id=da236bec13cf409ca4f644e76fbb5e1b)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:53:19.148571 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a795d9-1d6d-42b6-80ab-4b576e2db99d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:53:19.199086 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b2a795d9-1d6d-42b6-80ab-4b576e2db99d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da236bec13cf409ca4f644e76fbb5e1b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:53:19.199750 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b2a795d9-1d6d-42b6-80ab-4b576e2db99d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da236bec13cf409ca4f644e76fbb5e1b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:53:19.207290 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b2a795d9-1d6d-42b6-80ab-4b576e2db99d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da236bec13cf409ca4f644e76fbb5e1b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:53:19.215410 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b2a795d9-1d6d-42b6-80ab-4b576e2db99d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da236bec13cf409ca4f644e76fbb5e1b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:53:19.216255 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b2a795d9-1d6d-42b6-80ab-4b576e2db99d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da236bec13cf409ca4f644e76fbb5e1b'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:53:19.234318 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4532/9043] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:53:19 2022] DELETE /identity/v3/users/da236bec13cf409ca4f644e76fbb5e1b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:53:19.408346 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ca875-5e24-474b-b9d0-fae26711ac5e service placement] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:53:19.421505 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ca875-5e24-474b-b9d0-fae26711ac5e service placement] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:53:19.481017 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d144666-ccb4-4e9c-a0aa-3b6153dca21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:53:19.481658 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d144666-ccb4-4e9c-a0aa-3b6153dca21b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:53:19.481936 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d144666-ccb4-4e9c-a0aa-3b6153dca21b admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:53:19.482216 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d144666-ccb4-4e9c-a0aa-3b6153dca21b admin admin] PATH_INFO: `/v3/projects/e85e2ac1358a4913bfc77ae8d79802da` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:53:19.483393 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d144666-ccb4-4e9c-a0aa-3b6153dca21b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e85e2ac1358a4913bfc77ae8d79802da)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:53:19.485319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d144666-ccb4-4e9c-a0aa-3b6153dca21b admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:53:19.532742 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7d144666-ccb4-4e9c-a0aa-3b6153dca21b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e85e2ac1358a4913bfc77ae8d79802da', 'request_id': 'req-7d144666-ccb4-4e9c-a0aa-3b6153dca21b'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:53:19.539665 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7d144666-ccb4-4e9c-a0aa-3b6153dca21b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e85e2ac1358a4913bfc77ae8d79802da', 'request_id': 'req-7d144666-ccb4-4e9c-a0aa-3b6153dca21b'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:53:19.548296 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7d144666-ccb4-4e9c-a0aa-3b6153dca21b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e85e2ac1358a4913bfc77ae8d79802da', 'request_id': 'req-7d144666-ccb4-4e9c-a0aa-3b6153dca21b'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:53:19.572799 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7d144666-ccb4-4e9c-a0aa-3b6153dca21b admin admin] The token cache is being invalidate because project e85e2ac1358a4913bfc77ae8d79802da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:53:19.573834 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7d144666-ccb4-4e9c-a0aa-3b6153dca21b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:53:19.574766 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7d144666-ccb4-4e9c-a0aa-3b6153dca21b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:53:19.576164 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4512/9044] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:53:19 2022] DELETE /identity/v3/projects/e85e2ac1358a4913bfc77ae8d79802da => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:53:19.580277 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a795d9-1d6d-42b6-80ab-4b576e2db99d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:53:19.581684 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b2a795d9-1d6d-42b6-80ab-4b576e2db99d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:53:19.594984 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a795d9-1d6d-42b6-80ab-4b576e2db99d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:53:19.638665 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:53:19.656177 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b810d8ef-01b1-4377-8144-e38984f8d101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:53:19.656817 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810d8ef-01b1-4377-8144-e38984f8d101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:53:19.657113 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810d8ef-01b1-4377-8144-e38984f8d101 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:53:19.657387 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810d8ef-01b1-4377-8144-e38984f8d101 admin admin] PATH_INFO: `/v3/users/1ff37f714f084f82992237c07c4e6772` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:53:19.658520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b810d8ef-01b1-4377-8144-e38984f8d101 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ff37f714f084f82992237c07c4e6772)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:53:19.660548 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b810d8ef-01b1-4377-8144-e38984f8d101 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:53:19.713546 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b810d8ef-01b1-4377-8144-e38984f8d101 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ff37f714f084f82992237c07c4e6772'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:53:19.714328 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b810d8ef-01b1-4377-8144-e38984f8d101 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ff37f714f084f82992237c07c4e6772'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:53:19.723926 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b810d8ef-01b1-4377-8144-e38984f8d101 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ff37f714f084f82992237c07c4e6772'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:53:19.732123 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b810d8ef-01b1-4377-8144-e38984f8d101 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ff37f714f084f82992237c07c4e6772'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:53:19.732914 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-b810d8ef-01b1-4377-8144-e38984f8d101 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ff37f714f084f82992237c07c4e6772'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:53:19.757114 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4533/9045] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 16:53:19 2022] DELETE /identity/v3/users/1ff37f714f084f82992237c07c4e6772 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:53:19.933860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d144666-ccb4-4e9c-a0aa-3b6153dca21b admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:53:19.935588 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7d144666-ccb4-4e9c-a0aa-3b6153dca21b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:53:19.950056 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d144666-ccb4-4e9c-a0aa-3b6153dca21b admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:53:19.992714 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:53:20.008835 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb545c-a198-4e91-8b95-ab1c7441b091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:53:20.009473 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb545c-a198-4e91-8b95-ab1c7441b091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:53:20.009755 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb545c-a198-4e91-8b95-ab1c7441b091 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:53:20.010030 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb545c-a198-4e91-8b95-ab1c7441b091 admin admin] PATH_INFO: `/v3/projects/418fb3e6b27b4a579c3c7af59f0b8eec` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:53:20.011481 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafb545c-a198-4e91-8b95-ab1c7441b091 admin admin] RBAC: Authorizing `identity:delete_project(project_id=418fb3e6b27b4a579c3c7af59f0b8eec)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:53:20.013421 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafb545c-a198-4e91-8b95-ab1c7441b091 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:53:20.060153 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-eafb545c-a198-4e91-8b95-ab1c7441b091 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '418fb3e6b27b4a579c3c7af59f0b8eec', 'request_id': 'req-eafb545c-a198-4e91-8b95-ab1c7441b091'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:53:20.065620 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-eafb545c-a198-4e91-8b95-ab1c7441b091 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '418fb3e6b27b4a579c3c7af59f0b8eec', 'request_id': 'req-eafb545c-a198-4e91-8b95-ab1c7441b091'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:53:20.073058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-eafb545c-a198-4e91-8b95-ab1c7441b091 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '418fb3e6b27b4a579c3c7af59f0b8eec', 'request_id': 'req-eafb545c-a198-4e91-8b95-ab1c7441b091'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:53:20.084120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-eafb545c-a198-4e91-8b95-ab1c7441b091 admin admin] The token cache is being invalidate because project 418fb3e6b27b4a579c3c7af59f0b8eec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:53:20.084429 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-eafb545c-a198-4e91-8b95-ab1c7441b091 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:53:20.085065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-eafb545c-a198-4e91-8b95-ab1c7441b091 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:53:20.086546 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4513/9046] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 16:53:19 2022] DELETE /identity/v3/projects/418fb3e6b27b4a579c3c7af59f0b8eec => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:53:20.092451 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98dfe47-7f71-4b0d-8ec8-948dbbd05c86 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:53:20.092742 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98dfe47-7f71-4b0d-8ec8-948dbbd05c86 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:53:20.093022 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98dfe47-7f71-4b0d-8ec8-948dbbd05c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:53:20.150511 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-a98dfe47-7f71-4b0d-8ec8-948dbbd05c86 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:53:20.152396 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a98dfe47-7f71-4b0d-8ec8-948dbbd05c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:53:20.212366 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4534/9047] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:53:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:53:20.220603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7cff8b-3e26-4287-8cd8-5fce019cee28 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:53:20.220889 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7cff8b-3e26-4287-8cd8-5fce019cee28 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:53:20.221253 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7cff8b-3e26-4287-8cd8-5fce019cee28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:53:20.241619 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-1d7cff8b-3e26-4287-8cd8-5fce019cee28 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:53:20.242834 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1d7cff8b-3e26-4287-8cd8-5fce019cee28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:53:20.251727 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4514/9048] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:53:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:53:20.255955 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98dfe47-7f71-4b0d-8ec8-948dbbd05c86 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:53:20.266546 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98dfe47-7f71-4b0d-8ec8-948dbbd05c86 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:53:20.271135 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84afbec-2663-4ff5-aff3-47f8a9c7763c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:53:20.271731 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84afbec-2663-4ff5-aff3-47f8a9c7763c admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:53:20.272005 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84afbec-2663-4ff5-aff3-47f8a9c7763c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:53:20.272271 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84afbec-2663-4ff5-aff3-47f8a9c7763c admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:53:20.272903 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84afbec-2663-4ff5-aff3-47f8a9c7763c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:53:20.273234 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84afbec-2663-4ff5-aff3-47f8a9c7763c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:53:20.274828 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84afbec-2663-4ff5-aff3-47f8a9c7763c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:53:20.286560 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4535/9049] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 16:53:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:53:20.291010 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7cff8b-3e26-4287-8cd8-5fce019cee28 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:53:20.300206 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7cff8b-3e26-4287-8cd8-5fce019cee28 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:53:20.304875 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61f565-aef5-4d61-9f07-dd635d99aa6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:53:20.305466 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61f565-aef5-4d61-9f07-dd635d99aa6a admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:53:20.305740 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61f565-aef5-4d61-9f07-dd635d99aa6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:53:20.306009 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61f565-aef5-4d61-9f07-dd635d99aa6a admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:53:20.306642 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba61f565-aef5-4d61-9f07-dd635d99aa6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:53:20.309160 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba61f565-aef5-4d61-9f07-dd635d99aa6a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:53:20.351788 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4515/9050] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:53:20 2022] POST /identity/v3/projects => generated 391 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:53:20.353360 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84afbec-2663-4ff5-aff3-47f8a9c7763c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:53:20.363611 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84afbec-2663-4ff5-aff3-47f8a9c7763c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:53:20.376421 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:53:20.424206 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb15f88-9779-4f02-9d67-73d3ad84ee82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:53:20.424731 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb15f88-9779-4f02-9d67-73d3ad84ee82 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:53:20.425006 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb15f88-9779-4f02-9d67-73d3ad84ee82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:53:20.425273 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb15f88-9779-4f02-9d67-73d3ad84ee82 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:53:20.425889 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb15f88-9779-4f02-9d67-73d3ad84ee82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:53:20.427827 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb15f88-9779-4f02-9d67-73d3ad84ee82 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:53:20.450446 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4536/9051] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:53:20 2022] POST /identity/v3/users => generated 296 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:53:20.454816 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61f565-aef5-4d61-9f07-dd635d99aa6a admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:53:20.465319 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61f565-aef5-4d61-9f07-dd635d99aa6a admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:53:20.470089 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c66c80-0f2b-4a31-b47f-f34eaa450406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:53:20.470697 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c66c80-0f2b-4a31-b47f-f34eaa450406 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:53:20.470978 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c66c80-0f2b-4a31-b47f-f34eaa450406 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:53:20.471288 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c66c80-0f2b-4a31-b47f-f34eaa450406 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:53:20.471963 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c66c80-0f2b-4a31-b47f-f34eaa450406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:53:20.473581 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c66c80-0f2b-4a31-b47f-f34eaa450406 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:53:20.484317 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4516/9052] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:53:20.488314 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb15f88-9779-4f02-9d67-73d3ad84ee82 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:53:20.499339 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb15f88-9779-4f02-9d67-73d3ad84ee82 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:53:20.504126 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67cb2a-2fe5-4cf7-a200-75bf05a5873e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:53:20.504730 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67cb2a-2fe5-4cf7-a200-75bf05a5873e admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:53:20.505007 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67cb2a-2fe5-4cf7-a200-75bf05a5873e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:53:20.505278 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67cb2a-2fe5-4cf7-a200-75bf05a5873e admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:53:20.505920 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e67cb2a-2fe5-4cf7-a200-75bf05a5873e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:53:20.507558 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e67cb2a-2fe5-4cf7-a200-75bf05a5873e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:53:20.518446 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4537/9053] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:53:20.522782 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c66c80-0f2b-4a31-b47f-f34eaa450406 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:53:20.533215 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c66c80-0f2b-4a31-b47f-f34eaa450406 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:53:20.537939 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d905c8d-56e2-467d-ac10-f3fbdb63db86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:53:20.538591 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d905c8d-56e2-467d-ac10-f3fbdb63db86 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:53:20.538872 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d905c8d-56e2-467d-ac10-f3fbdb63db86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:53:20.539185 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d905c8d-56e2-467d-ac10-f3fbdb63db86 admin admin] PATH_INFO: `/v3/projects/197e7b145ed049b0a37bd871b4a34920/users/a0e53500b97e4c3286d76015abcf6e0a/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:53:20.554417 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d905c8d-56e2-467d-ac10-f3fbdb63db86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=197e7b145ed049b0a37bd871b4a34920, user_id=a0e53500b97e4c3286d76015abcf6e0a, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:53:20.557119 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d905c8d-56e2-467d-ac10-f3fbdb63db86 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:53:20.571277 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4517/9054] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:53:20 2022] PUT /identity/v3/projects/197e7b145ed049b0a37bd871b4a34920/users/a0e53500b97e4c3286d76015abcf6e0a/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:53:20.582318 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226b225-fe27-4f70-a13a-71486f8cebb7 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:53:20.582605 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226b225-fe27-4f70-a13a-71486f8cebb7 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:53:20.582877 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226b225-fe27-4f70-a13a-71486f8cebb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:53:20.611677 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-8226b225-fe27-4f70-a13a-71486f8cebb7 None None] MFA Rules not processed for user `a0e53500b97e4c3286d76015abcf6e0a`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:53:20.612884 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-8226b225-fe27-4f70-a13a-71486f8cebb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:53:20.679413 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4538/9055] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:53:20 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:53:20.684855 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d905c8d-56e2-467d-ac10-f3fbdb63db86 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:53:20.749317 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d905c8d-56e2-467d-ac10-f3fbdb63db86 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:53:20.754656 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d58aa9-b1d7-48a7-898e-fd748c0f6bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:53:20.755365 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d58aa9-b1d7-48a7-898e-fd748c0f6bef admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:53:20.755642 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d58aa9-b1d7-48a7-898e-fd748c0f6bef admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:53:20.755916 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d58aa9-b1d7-48a7-898e-fd748c0f6bef admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:53:20.756550 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d58aa9-b1d7-48a7-898e-fd748c0f6bef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:53:20.758483 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d58aa9-b1d7-48a7-898e-fd748c0f6bef admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:53:20.764071 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:53:20.788456 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4518/9056] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 16:53:20 2022] POST /identity/v3/projects => generated 389 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:53:20.793099 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226b225-fe27-4f70-a13a-71486f8cebb7 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:53:20.804036 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226b225-fe27-4f70-a13a-71486f8cebb7 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:53:20.861705 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2ebc4-2de0-410e-9142-e572386ecf4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:53:20.862307 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2ebc4-2de0-410e-9142-e572386ecf4d admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:53:20.862582 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2ebc4-2de0-410e-9142-e572386ecf4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:53:20.862850 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2ebc4-2de0-410e-9142-e572386ecf4d admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:53:20.863506 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f2ebc4-2de0-410e-9142-e572386ecf4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:53:20.865419 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f2ebc4-2de0-410e-9142-e572386ecf4d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:53:20.889666 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4539/9057] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 16:53:20 2022] POST /identity/v3/users => generated 301 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:53:20.890830 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d58aa9-b1d7-48a7-898e-fd748c0f6bef admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:53:20.901994 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d58aa9-b1d7-48a7-898e-fd748c0f6bef admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:53:20.907619 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6cc2f-adea-4e17-aff0-079437259e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:53:20.908410 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6cc2f-adea-4e17-aff0-079437259e85 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:53:20.908548 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6cc2f-adea-4e17-aff0-079437259e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:53:20.908790 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6cc2f-adea-4e17-aff0-079437259e85 admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:53:20.909414 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b6cc2f-adea-4e17-aff0-079437259e85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:53:20.911050 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b6cc2f-adea-4e17-aff0-079437259e85 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:53:20.922766 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4519/9058] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:53:20.927148 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2ebc4-2de0-410e-9142-e572386ecf4d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:53:20.938009 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2ebc4-2de0-410e-9142-e572386ecf4d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:53:20.942652 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c624318-9e29-489e-a65b-b32ef70025ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:53:20.943349 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c624318-9e29-489e-a65b-b32ef70025ca admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:53:20.943630 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c624318-9e29-489e-a65b-b32ef70025ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:53:20.943905 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c624318-9e29-489e-a65b-b32ef70025ca admin admin] PATH_INFO: `/v3/projects/985805adf8ac49f5bfdba22604806d34/users/d16bb16e0feb4b149c6d5763bcaebf32/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:53:20.958133 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:53:20.961520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c624318-9e29-489e-a65b-b32ef70025ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=985805adf8ac49f5bfdba22604806d34, user_id=d16bb16e0feb4b149c6d5763bcaebf32, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:53:20.965250 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c624318-9e29-489e-a65b-b32ef70025ca admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:53:20.978403 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4540/9059] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:53:20 2022] PUT /identity/v3/projects/985805adf8ac49f5bfdba22604806d34/users/d16bb16e0feb4b149c6d5763bcaebf32/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:53:20.982585 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6cc2f-adea-4e17-aff0-079437259e85 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:53:20.992719 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6cc2f-adea-4e17-aff0-079437259e85 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:53:21.054247 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3364d-8ce5-4629-953b-7ebd52fa0f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:53:21.054865 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3364d-8ce5-4629-953b-7ebd52fa0f2a admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:53:21.055184 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3364d-8ce5-4629-953b-7ebd52fa0f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:53:21.055463 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3364d-8ce5-4629-953b-7ebd52fa0f2a admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:53:21.056106 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b3364d-8ce5-4629-953b-7ebd52fa0f2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:53:21.058327 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b3364d-8ce5-4629-953b-7ebd52fa0f2a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:53:21.068435 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4520/9060] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:53:21.072554 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c624318-9e29-489e-a65b-b32ef70025ca admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:53:21.083634 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c624318-9e29-489e-a65b-b32ef70025ca admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:53:21.088280 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae4706-02cc-4e9c-893a-ba1518c5c884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:53:21.089015 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae4706-02cc-4e9c-893a-ba1518c5c884 admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:53:21.089286 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae4706-02cc-4e9c-893a-ba1518c5c884 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:53:21.089555 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae4706-02cc-4e9c-893a-ba1518c5c884 admin admin] PATH_INFO: `/v3/projects/985805adf8ac49f5bfdba22604806d34/users/d16bb16e0feb4b149c6d5763bcaebf32/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:53:21.091514 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae4706-02cc-4e9c-893a-ba1518c5c884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=985805adf8ac49f5bfdba22604806d34, user_id=d16bb16e0feb4b149c6d5763bcaebf32, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:53:21.094144 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae4706-02cc-4e9c-893a-ba1518c5c884 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:53:21.104630 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4541/9061] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 16:53:21 2022] PUT /identity/v3/projects/985805adf8ac49f5bfdba22604806d34/users/d16bb16e0feb4b149c6d5763bcaebf32/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:53:21.114488 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026456d2-df7d-4b0d-a38f-b551bc2dc56c None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:53:21.114773 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026456d2-df7d-4b0d-a38f-b551bc2dc56c None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:53:21.115072 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026456d2-df7d-4b0d-a38f-b551bc2dc56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:53:21.144442 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-026456d2-df7d-4b0d-a38f-b551bc2dc56c None None] MFA Rules not processed for user `d16bb16e0feb4b149c6d5763bcaebf32`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:53:21.145666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-026456d2-df7d-4b0d-a38f-b551bc2dc56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:53:21.214668 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4521/9062] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:53:21 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:53:21.228821 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae4706-02cc-4e9c-893a-ba1518c5c884 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:53:21.231423 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-ddae4706-02cc-4e9c-893a-ba1518c5c884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:53:21.305754 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae4706-02cc-4e9c-893a-ba1518c5c884 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:53:21.312213 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf1fd2-b6f8-46be-9e01-512843f0824f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:53:21.312817 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf1fd2-b6f8-46be-9e01-512843f0824f service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:53:21.313092 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf1fd2-b6f8-46be-9e01-512843f0824f service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:53:21.313390 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf1fd2-b6f8-46be-9e01-512843f0824f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:53:21.368246 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caf1fd2-b6f8-46be-9e01-512843f0824f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:53:21.370443 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caf1fd2-b6f8-46be-9e01-512843f0824f service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:53:21.379335 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4542/9063] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:53:21 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:53:24.091620 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026456d2-df7d-4b0d-a38f-b551bc2dc56c None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:53:24.093053 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-026456d2-df7d-4b0d-a38f-b551bc2dc56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:53:24.152679 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026456d2-df7d-4b0d-a38f-b551bc2dc56c None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:53:24.156277 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b67eb-7732-483f-90c3-15485cc81475 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:53:24.156881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b67eb-7732-483f-90c3-15485cc81475 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:53:24.157157 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b67eb-7732-483f-90c3-15485cc81475 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:53:24.157426 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b67eb-7732-483f-90c3-15485cc81475 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:53:24.168406 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b67eb-7732-483f-90c3-15485cc81475 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:53:24.169852 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b67eb-7732-483f-90c3-15485cc81475 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:53:24.175053 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:53:24.180539 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4522/9064] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:53:24 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:53:27.241349 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277d5ea-db6f-4a76-b203-08fda9495850 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:53:27.241863 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277d5ea-db6f-4a76-b203-08fda9495850 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:53:27.241863 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277d5ea-db6f-4a76-b203-08fda9495850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:53:27.262328 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-6277d5ea-db6f-4a76-b203-08fda9495850 None None] MFA Rules not processed for user `a0e53500b97e4c3286d76015abcf6e0a`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:53:27.263603 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6277d5ea-db6f-4a76-b203-08fda9495850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:53:27.275382 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4543/9065] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:53:27 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:53:28.095331 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b67eb-7732-483f-90c3-15485cc81475 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:53:28.096872 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9b7b67eb-7732-483f-90c3-15485cc81475 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:53:28.231539 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b67eb-7732-483f-90c3-15485cc81475 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:53:28.236813 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1cf93-87d6-41ca-936e-4a56789b360d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:53:28.237437 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1cf93-87d6-41ca-936e-4a56789b360d service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:53:28.237719 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1cf93-87d6-41ca-936e-4a56789b360d service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:53:28.237996 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1cf93-87d6-41ca-936e-4a56789b360d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:53:28.240283 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0db1cf93-87d6-41ca-936e-4a56789b360d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:53:28.261600 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db1cf93-87d6-41ca-936e-4a56789b360d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:53:28.263268 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db1cf93-87d6-41ca-936e-4a56789b360d service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:53:28.278561 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4523/9066] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:53:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:53:37.256407 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=67,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:53:38.272479 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=32 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:53:47.206922 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277d5ea-db6f-4a76-b203-08fda9495850 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:53:47.220215 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277d5ea-db6f-4a76-b203-08fda9495850 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:53:47.225167 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a45787d-eac6-43b6-b5f4-61f125aa4057 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:53:47.225773 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45787d-eac6-43b6-b5f4-61f125aa4057 service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:53:47.226047 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45787d-eac6-43b6-b5f4-61f125aa4057 service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:53:47.226311 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45787d-eac6-43b6-b5f4-61f125aa4057 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:53:47.228056 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6a45787d-eac6-43b6-b5f4-61f125aa4057 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:53:47.240831 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a45787d-eac6-43b6-b5f4-61f125aa4057 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:53:47.244901 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a45787d-eac6-43b6-b5f4-61f125aa4057 service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:53:47.255775 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4544/9067] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:53:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:53:57.250612 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=6 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:54:29.123218 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0312afc-0223-49e3-874c-603b0272f4f2 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:54:29.123707 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0312afc-0223-49e3-874c-603b0272f4f2 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:54:29.123811 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0312afc-0223-49e3-874c-603b0272f4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:54:29.145241 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-d0312afc-0223-49e3-874c-603b0272f4f2 None None] MFA Rules not processed for user `a0e53500b97e4c3286d76015abcf6e0a`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:54:29.146858 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d0312afc-0223-49e3-874c-603b0272f4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:54:29.156870 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4524/9068] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:54:29 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:54:39.139332 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:55:05.140819 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a45787d-eac6-43b6-b5f4-61f125aa4057 service placement] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:55:05.142494 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6a45787d-eac6-43b6-b5f4-61f125aa4057 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:55:05.155781 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a45787d-eac6-43b6-b5f4-61f125aa4057 service placement] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:55:05.160706 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6dc9f-2147-434b-93b9-eb6b4eed1ad7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:55:05.161298 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6dc9f-2147-434b-93b9-eb6b4eed1ad7 service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:55:05.161571 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6dc9f-2147-434b-93b9-eb6b4eed1ad7 service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:55:05.161837 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6dc9f-2147-434b-93b9-eb6b4eed1ad7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:55:05.163532 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2bb6dc9f-2147-434b-93b9-eb6b4eed1ad7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:55:05.174979 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6dc9f-2147-434b-93b9-eb6b4eed1ad7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:55:05.176568 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6dc9f-2147-434b-93b9-eb6b4eed1ad7 service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:55:05.187728 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4545/9069] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:55:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:55:15.182232 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=6 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:56:18.564699 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1323716-4eae-4859-baae-607dacffb99a None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:56:18.565273 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1323716-4eae-4859-baae-607dacffb99a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:56:18.565273 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1323716-4eae-4859-baae-607dacffb99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:56:18.587730 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-e1323716-4eae-4859-baae-607dacffb99a None None] MFA Rules not processed for user `a0e53500b97e4c3286d76015abcf6e0a`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:56:18.588881 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-e1323716-4eae-4859-baae-607dacffb99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:56:18.599223 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4525/9070] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:56:18 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:56:18.953715 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6dc9f-2147-434b-93b9-eb6b4eed1ad7 service placement] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:56:18.955355 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2bb6dc9f-2147-434b-93b9-eb6b4eed1ad7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:56:18.969052 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6dc9f-2147-434b-93b9-eb6b4eed1ad7 service placement] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:56:18.973563 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e1515-24ea-4a7a-9172-5e71ca9746a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:56:18.974245 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e1515-24ea-4a7a-9172-5e71ca9746a9 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:56:18.974532 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e1515-24ea-4a7a-9172-5e71ca9746a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:56:18.974793 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e1515-24ea-4a7a-9172-5e71ca9746a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:56:18.976631 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-e20e1515-24ea-4a7a-9172-5e71ca9746a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:56:18.989270 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e1515-24ea-4a7a-9172-5e71ca9746a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:56:18.990966 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e1515-24ea-4a7a-9172-5e71ca9746a9 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:56:19.000420 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4546/9071] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:56:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:56:27.294098 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1323716-4eae-4859-baae-607dacffb99a None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:56:27.318372 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1323716-4eae-4859-baae-607dacffb99a None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:56:27.323148 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fef72c-c83f-40ce-98ce-2612a08f59bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:56:27.324029 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fef72c-c83f-40ce-98ce-2612a08f59bf service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:56:27.324900 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fef72c-c83f-40ce-98ce-2612a08f59bf service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:56:27.325385 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fef72c-c83f-40ce-98ce-2612a08f59bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:56:27.327610 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d5fef72c-c83f-40ce-98ce-2612a08f59bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:56:27.398471 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fef72c-c83f-40ce-98ce-2612a08f59bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:56:27.400581 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fef72c-c83f-40ce-98ce-2612a08f59bf service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:56:27.413578 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4526/9072] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:56:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:56:28.996279 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=6 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:56:29.052780 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e1515-24ea-4a7a-9172-5e71ca9746a9 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:56:29.073765 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e1515-24ea-4a7a-9172-5e71ca9746a9 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:56:29.077516 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf7693-e898-4e35-ad3a-9c6db6ed01a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:56:29.078130 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf7693-e898-4e35-ad3a-9c6db6ed01a3 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:56:29.078424 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf7693-e898-4e35-ad3a-9c6db6ed01a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:56:29.078674 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf7693-e898-4e35-ad3a-9c6db6ed01a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:56:29.080443 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6eaf7693-e898-4e35-ad3a-9c6db6ed01a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:56:29.094574 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf7693-e898-4e35-ad3a-9c6db6ed01a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:56:29.096069 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf7693-e898-4e35-ad3a-9c6db6ed01a3 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:56:29.107619 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4547/9073] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:56:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:56:33.452659 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fef72c-c83f-40ce-98ce-2612a08f59bf service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:56:33.467906 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fef72c-c83f-40ce-98ce-2612a08f59bf service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:56:33.471583 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e2b2e0-48ed-48a6-af0b-913dfcbcf421 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:56:33.472829 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2b2e0-48ed-48a6-af0b-913dfcbcf421 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:56:33.473376 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2b2e0-48ed-48a6-af0b-913dfcbcf421 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:56:33.473634 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2b2e0-48ed-48a6-af0b-913dfcbcf421 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:56:33.476489 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-93e2b2e0-48ed-48a6-af0b-913dfcbcf421 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:56:33.487389 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e2b2e0-48ed-48a6-af0b-913dfcbcf421 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:56:33.489429 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e2b2e0-48ed-48a6-af0b-913dfcbcf421 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:56:33.498292 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4527/9074] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:56:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:56:39.102645 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=11 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:56:43.494504 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=37 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:57:06.022711 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b410dac-3b6e-451a-bf8b-36889c5cfa77 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:57:06.023341 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b410dac-3b6e-451a-bf8b-36889c5cfa77 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:57:06.023341 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b410dac-3b6e-451a-bf8b-36889c5cfa77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:57:06.074761 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-7b410dac-3b6e-451a-bf8b-36889c5cfa77 None None] MFA Rules not processed for user `9a84bb38f6454574897120223b8fc140`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:57:06.076004 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7b410dac-3b6e-451a-bf8b-36889c5cfa77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:57:06.082815 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4548/9075] 10.222.0.83 () {58 vars in 1018 bytes} [Mon Aug 29 16:57:06 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:57:06.094247 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e2b2e0-48ed-48a6-af0b-913dfcbcf421 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:57:06.103386 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e2b2e0-48ed-48a6-af0b-913dfcbcf421 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:57:06.107209 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de80b2-f7ef-4bb9-b9e8-4194bbeb2e1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:57:06.107844 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de80b2-f7ef-4bb9-b9e8-4194bbeb2e1f service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:57:06.108129 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de80b2-f7ef-4bb9-b9e8-4194bbeb2e1f service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:57:06.108404 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de80b2-f7ef-4bb9-b9e8-4194bbeb2e1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:57:06.116748 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8de80b2-f7ef-4bb9-b9e8-4194bbeb2e1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:57:06.118242 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8de80b2-f7ef-4bb9-b9e8-4194bbeb2e1f service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:57:06.126702 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4528/9076] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:57:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:57:06.218864 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209dccf-0b05-47ea-a0a4-a0215e8f4b10 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:57:06.219214 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209dccf-0b05-47ea-a0a4-a0215e8f4b10 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:57:06.219483 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209dccf-0b05-47ea-a0a4-a0215e8f4b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:57:06.258464 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-9209dccf-0b05-47ea-a0a4-a0215e8f4b10 None None] MFA Rules not processed for user `c190fa4a280c41c684130e069bee99eb`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:57:06.259630 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9209dccf-0b05-47ea-a0a4-a0215e8f4b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:57:06.268318 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4549/9077] 10.222.0.83 () {58 vars in 1018 bytes} [Mon Aug 29 16:57:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:57:06.280059 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de80b2-f7ef-4bb9-b9e8-4194bbeb2e1f service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:57:06.292939 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de80b2-f7ef-4bb9-b9e8-4194bbeb2e1f service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:57:06.297993 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40624a6-d571-4181-b9fb-ee4069c88eed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:57:06.298588 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40624a6-d571-4181-b9fb-ee4069c88eed service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:57:06.298867 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40624a6-d571-4181-b9fb-ee4069c88eed service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:57:06.299177 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40624a6-d571-4181-b9fb-ee4069c88eed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:57:06.308347 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40624a6-d571-4181-b9fb-ee4069c88eed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:57:06.309929 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40624a6-d571-4181-b9fb-ee4069c88eed service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:57:06.320013 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4529/9078] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:57:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:57:06.496093 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3102616-212d-4cdf-a18d-62056231a055 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:57:06.496378 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3102616-212d-4cdf-a18d-62056231a055 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:57:06.496674 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3102616-212d-4cdf-a18d-62056231a055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:57:06.534216 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-c3102616-212d-4cdf-a18d-62056231a055 None None] MFA Rules not processed for user `253947a5ef294d2bb828761873251bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:57:06.535401 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c3102616-212d-4cdf-a18d-62056231a055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:57:06.545219 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4550/9079] 10.222.0.83 () {58 vars in 1018 bytes} [Mon Aug 29 16:57:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:57:06.556145 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40624a6-d571-4181-b9fb-ee4069c88eed service placement] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:57:06.565693 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40624a6-d571-4181-b9fb-ee4069c88eed service placement] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:57:06.569462 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11faea-8ad7-41eb-a6d9-facfcd718419 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:57:06.570059 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11faea-8ad7-41eb-a6d9-facfcd718419 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:57:06.570338 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11faea-8ad7-41eb-a6d9-facfcd718419 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:57:06.570609 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11faea-8ad7-41eb-a6d9-facfcd718419 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:57:06.580907 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff11faea-8ad7-41eb-a6d9-facfcd718419 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:57:06.582338 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff11faea-8ad7-41eb-a6d9-facfcd718419 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:57:06.593681 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4530/9080] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:57:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:57:06.655273 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3102616-212d-4cdf-a18d-62056231a055 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:57:06.667184 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3102616-212d-4cdf-a18d-62056231a055 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:57:06.672569 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8fa3c-3883-4d95-8e93-b0d31921d622 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:57:06.673214 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8fa3c-3883-4d95-8e93-b0d31921d622 service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:57:06.673498 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8fa3c-3883-4d95-8e93-b0d31921d622 service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:57:06.673771 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8fa3c-3883-4d95-8e93-b0d31921d622 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:57:06.675566 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-89e8fa3c-3883-4d95-8e93-b0d31921d622 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:57:06.697049 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e8fa3c-3883-4d95-8e93-b0d31921d622 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:57:06.698695 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e8fa3c-3883-4d95-8e93-b0d31921d622 service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:57:06.718326 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4551/9081] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:57:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:57:16.588987 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=18 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:57:16.713756 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=37 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:57:25.219702 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11faea-8ad7-41eb-a6d9-facfcd718419 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:57:25.228337 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11faea-8ad7-41eb-a6d9-facfcd718419 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:57:25.232022 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b347080-cee6-4e34-bb79-5cef44fe6d61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:57:25.232615 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b347080-cee6-4e34-bb79-5cef44fe6d61 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:57:25.232892 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b347080-cee6-4e34-bb79-5cef44fe6d61 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:57:25.233159 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b347080-cee6-4e34-bb79-5cef44fe6d61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:57:25.234902 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9b347080-cee6-4e34-bb79-5cef44fe6d61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:57:25.244448 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b347080-cee6-4e34-bb79-5cef44fe6d61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:57:25.245894 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b347080-cee6-4e34-bb79-5cef44fe6d61 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:57:25.254028 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4531/9082] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:57:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:57:25.677152 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8fa3c-3883-4d95-8e93-b0d31921d622 service placement] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:57:25.690386 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8fa3c-3883-4d95-8e93-b0d31921d622 service placement] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:57:25.696179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03107e5e-e053-49e0-9b3e-88e2f9367e39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:57:25.696817 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03107e5e-e053-49e0-9b3e-88e2f9367e39 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:57:25.697082 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03107e5e-e053-49e0-9b3e-88e2f9367e39 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:57:25.697358 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03107e5e-e053-49e0-9b3e-88e2f9367e39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:57:25.699193 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-03107e5e-e053-49e0-9b3e-88e2f9367e39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:57:25.712821 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03107e5e-e053-49e0-9b3e-88e2f9367e39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:57:25.714440 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03107e5e-e053-49e0-9b3e-88e2f9367e39 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:57:25.726305 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4552/9083] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:57:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:57:32.678509 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b347080-cee6-4e34-bb79-5cef44fe6d61 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:57:32.681403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9b347080-cee6-4e34-bb79-5cef44fe6d61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:57:32.728336 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b347080-cee6-4e34-bb79-5cef44fe6d61 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:57:32.737302 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85440353-f7cd-4596-aee2-17c184d215c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:57:32.738504 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85440353-f7cd-4596-aee2-17c184d215c8 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:57:32.743653 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85440353-f7cd-4596-aee2-17c184d215c8 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:57:32.744277 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85440353-f7cd-4596-aee2-17c184d215c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:57:32.746838 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-85440353-f7cd-4596-aee2-17c184d215c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:57:32.765296 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85440353-f7cd-4596-aee2-17c184d215c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:57:32.766949 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85440353-f7cd-4596-aee2-17c184d215c8 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:57:32.780422 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4532/9084] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:57:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:57:35.721536 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=6 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:57:42.773926 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=12 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:58:20.207406 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03107e5e-e053-49e0-9b3e-88e2f9367e39 service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:58:20.221924 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03107e5e-e053-49e0-9b3e-88e2f9367e39 service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:58:20.231894 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99411c66-f6b6-4fba-8c6e-70d54b0e85d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:58:20.232539 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99411c66-f6b6-4fba-8c6e-70d54b0e85d0 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:58:20.232997 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99411c66-f6b6-4fba-8c6e-70d54b0e85d0 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:58:20.233392 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99411c66-f6b6-4fba-8c6e-70d54b0e85d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:58:20.235272 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-99411c66-f6b6-4fba-8c6e-70d54b0e85d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:58:20.251778 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99411c66-f6b6-4fba-8c6e-70d54b0e85d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:58:20.253959 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99411c66-f6b6-4fba-8c6e-70d54b0e85d0 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:58:20.269047 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4553/9085] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:58:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:58:21.549979 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85440353-f7cd-4596-aee2-17c184d215c8 service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:58:21.562269 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85440353-f7cd-4596-aee2-17c184d215c8 service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:58:21.568080 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b951e-d542-4985-81b8-f7da6b9c724d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:58:21.568719 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b951e-d542-4985-81b8-f7da6b9c724d service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:58:21.568994 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b951e-d542-4985-81b8-f7da6b9c724d service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:58:21.569264 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b951e-d542-4985-81b8-f7da6b9c724d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:58:21.581548 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b951e-d542-4985-81b8-f7da6b9c724d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:58:21.583218 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b951e-d542-4985-81b8-f7da6b9c724d service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:58:21.592884 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4533/9086] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:58:21 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:58:26.732464 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99411c66-f6b6-4fba-8c6e-70d54b0e85d0 service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:58:26.745551 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99411c66-f6b6-4fba-8c6e-70d54b0e85d0 service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:58:26.758221 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9900c61a-acd7-4cd1-b072-94c335ed1c6c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:58:26.759196 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900c61a-acd7-4cd1-b072-94c335ed1c6c service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:58:26.759651 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900c61a-acd7-4cd1-b072-94c335ed1c6c service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:58:26.760088 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900c61a-acd7-4cd1-b072-94c335ed1c6c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:58:26.763287 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9900c61a-acd7-4cd1-b072-94c335ed1c6c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:58:26.778870 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9900c61a-acd7-4cd1-b072-94c335ed1c6c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:58:26.780569 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9900c61a-acd7-4cd1-b072-94c335ed1c6c service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:58:26.808675 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4554/9087] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:58:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:58:30.032675 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b951e-d542-4985-81b8-f7da6b9c724d service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:58:30.042458 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b951e-d542-4985-81b8-f7da6b9c724d service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:58:30.046833 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cea8d-1c9e-4dd6-9315-cef7307663ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:58:30.047487 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cea8d-1c9e-4dd6-9315-cef7307663ec service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:58:30.047774 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cea8d-1c9e-4dd6-9315-cef7307663ec service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:58:30.048050 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cea8d-1c9e-4dd6-9315-cef7307663ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:58:30.057672 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90cea8d-1c9e-4dd6-9315-cef7307663ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:58:30.059715 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90cea8d-1c9e-4dd6-9315-cef7307663ec service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:58:30.070562 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4534/9088] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:58:30 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:58:32.781004 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564501d9-9e11-4210-8068-736d4800308a None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:58:32.781533 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564501d9-9e11-4210-8068-736d4800308a None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:58:32.781743 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564501d9-9e11-4210-8068-736d4800308a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:58:32.802355 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-564501d9-9e11-4210-8068-736d4800308a None None] MFA Rules not processed for user `a0e53500b97e4c3286d76015abcf6e0a`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:58:32.803586 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-564501d9-9e11-4210-8068-736d4800308a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:58:32.812207 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4555/9089] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 16:58:32 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:58:33.533232 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cea8d-1c9e-4dd6-9315-cef7307663ec service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:58:33.545853 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cea8d-1c9e-4dd6-9315-cef7307663ec service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:58:33.551383 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7a278-f08f-4eb0-893f-e70d52823194 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:58:33.552207 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7a278-f08f-4eb0-893f-e70d52823194 service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:58:33.552493 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7a278-f08f-4eb0-893f-e70d52823194 service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:58:33.552767 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7a278-f08f-4eb0-893f-e70d52823194 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:58:33.563514 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e7a278-f08f-4eb0-893f-e70d52823194 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:58:33.566879 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e7a278-f08f-4eb0-893f-e70d52823194 service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:58:33.578726 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4535/9090] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:58:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:58:42.797534 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=15 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:58:43.574031 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=18 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:58:50.172254 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564501d9-9e11-4210-8068-736d4800308a None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:58:50.183946 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564501d9-9e11-4210-8068-736d4800308a None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:58:50.189317 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08959173-7ec4-421e-be0f-1452335ca596 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:58:50.189920 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08959173-7ec4-421e-be0f-1452335ca596 service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:58:50.190194 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08959173-7ec4-421e-be0f-1452335ca596 service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:58:50.190467 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08959173-7ec4-421e-be0f-1452335ca596 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:58:50.198968 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08959173-7ec4-421e-be0f-1452335ca596 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:58:50.200587 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08959173-7ec4-421e-be0f-1452335ca596 service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:58:50.210429 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4556/9091] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 16:58:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:59:00.206248 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=6 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:00:07.125394 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7a278-f08f-4eb0-893f-e70d52823194 service placement] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:00:07.136126 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7a278-f08f-4eb0-893f-e70d52823194 service placement] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:00:07.141949 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f8d1d-1d22-4b9b-8328-4097ab2d522f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:00:07.142574 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f8d1d-1d22-4b9b-8328-4097ab2d522f service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:00:07.142854 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f8d1d-1d22-4b9b-8328-4097ab2d522f service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:00:07.143153 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f8d1d-1d22-4b9b-8328-4097ab2d522f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:00:07.151778 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f8d1d-1d22-4b9b-8328-4097ab2d522f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:00:07.153352 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f8d1d-1d22-4b9b-8328-4097ab2d522f service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:00:07.163777 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4536/9092] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 17:00:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 17:00:15.011304 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08959173-7ec4-421e-be0f-1452335ca596 service placement] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:00:15.023301 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08959173-7ec4-421e-be0f-1452335ca596 service placement] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:00:15.029419 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b86a643-fd3c-4523-a0ea-305b0763e992 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:00:15.030103 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b86a643-fd3c-4523-a0ea-305b0763e992 service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:00:15.030384 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b86a643-fd3c-4523-a0ea-305b0763e992 service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:00:15.030645 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b86a643-fd3c-4523-a0ea-305b0763e992 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:00:15.032462 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-1b86a643-fd3c-4523-a0ea-305b0763e992 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:00:15.062695 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b86a643-fd3c-4523-a0ea-305b0763e992 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:00:15.064742 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b86a643-fd3c-4523-a0ea-305b0763e992 service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:00:15.081572 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4557/9093] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 17:00:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 17:00:17.159813 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=6 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:00:21.142762 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f2bae-a464-4d2b-899d-0491c7f2039d None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:00:21.143408 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f2bae-a464-4d2b-899d-0491c7f2039d None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:00:21.143408 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f2bae-a464-4d2b-899d-0491c7f2039d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:00:21.163551 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-513f2bae-a464-4d2b-899d-0491c7f2039d None None] MFA Rules not processed for user `a0e53500b97e4c3286d76015abcf6e0a`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 17:00:21.164763 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-513f2bae-a464-4d2b-899d-0491c7f2039d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:00:21.172914 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4537/9094] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 17:00:21 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 17:00:21.509077 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b86a643-fd3c-4523-a0ea-305b0763e992 service placement] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:00:21.520119 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b86a643-fd3c-4523-a0ea-305b0763e992 service placement] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:00:21.523918 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b957a-93cd-4583-b01d-18858d6ca5e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:00:21.524656 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b957a-93cd-4583-b01d-18858d6ca5e2 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:00:21.524936 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b957a-93cd-4583-b01d-18858d6ca5e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:00:21.525207 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b957a-93cd-4583-b01d-18858d6ca5e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:00:21.527154 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-357b957a-93cd-4583-b01d-18858d6ca5e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:00:21.539230 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b957a-93cd-4583-b01d-18858d6ca5e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:00:21.540872 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b957a-93cd-4583-b01d-18858d6ca5e2 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:00:21.551584 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4558/9095] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 17:00:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 17:00:31.158458 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:00:31.547066 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=17 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:01:21.295264 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f2bae-a464-4d2b-899d-0491c7f2039d None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:01:21.367778 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f2bae-a464-4d2b-899d-0491c7f2039d None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:01:21.372722 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9d2c2-72b6-4aa4-a522-34e59c6f559d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:01:21.373375 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9d2c2-72b6-4aa4-a522-34e59c6f559d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:01:21.373663 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9d2c2-72b6-4aa4-a522-34e59c6f559d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:01:21.373929 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9d2c2-72b6-4aa4-a522-34e59c6f559d admin admin] PATH_INFO: `/v3/users/a0e53500b97e4c3286d76015abcf6e0a` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:01:21.375109 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da9d2c2-72b6-4aa4-a522-34e59c6f559d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0e53500b97e4c3286d76015abcf6e0a)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:01:21.377057 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da9d2c2-72b6-4aa4-a522-34e59c6f559d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:01:21.430549 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9da9d2c2-72b6-4aa4-a522-34e59c6f559d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0e53500b97e4c3286d76015abcf6e0a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:01:21.431244 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9da9d2c2-72b6-4aa4-a522-34e59c6f559d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0e53500b97e4c3286d76015abcf6e0a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:01:21.443334 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9da9d2c2-72b6-4aa4-a522-34e59c6f559d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0e53500b97e4c3286d76015abcf6e0a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:01:21.452283 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9da9d2c2-72b6-4aa4-a522-34e59c6f559d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0e53500b97e4c3286d76015abcf6e0a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:01:21.459393 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9da9d2c2-72b6-4aa4-a522-34e59c6f559d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0e53500b97e4c3286d76015abcf6e0a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:01:21.465915 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4538/9096] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 17:01:21 2022] DELETE /identity/v3/users/a0e53500b97e4c3286d76015abcf6e0a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 17:01:21.470753 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69437bdd-53e5-4783-b84e-15acbfd23da4 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:01:21.471303 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69437bdd-53e5-4783-b84e-15acbfd23da4 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:01:21.471470 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69437bdd-53e5-4783-b84e-15acbfd23da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:01:21.492120 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-69437bdd-53e5-4783-b84e-15acbfd23da4 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 17:01:21.493339 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-69437bdd-53e5-4783-b84e-15acbfd23da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:01:21.556129 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4559/9097] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 17:01:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 17:01:21.566556 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9d2c2-72b6-4aa4-a522-34e59c6f559d admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:01:21.567994 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9da9d2c2-72b6-4aa4-a522-34e59c6f559d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:01:21.629051 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9d2c2-72b6-4aa4-a522-34e59c6f559d admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:01:21.632940 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766235f2-ff4e-463f-86c7-cc8e8bb93ff8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:01:21.633544 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766235f2-ff4e-463f-86c7-cc8e8bb93ff8 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:01:21.633823 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766235f2-ff4e-463f-86c7-cc8e8bb93ff8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:01:21.634092 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766235f2-ff4e-463f-86c7-cc8e8bb93ff8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:01:21.643093 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766235f2-ff4e-463f-86c7-cc8e8bb93ff8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:01:21.644526 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766235f2-ff4e-463f-86c7-cc8e8bb93ff8 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:01:21.654445 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4539/9098] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 17:01:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 17:01:21.828850 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69437bdd-53e5-4783-b84e-15acbfd23da4 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:01:21.830311 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-69437bdd-53e5-4783-b84e-15acbfd23da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:01:21.845638 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69437bdd-53e5-4783-b84e-15acbfd23da4 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:01:21.851866 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b22ba-58ec-4a50-8751-f6f77de95873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:01:21.852526 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b22ba-58ec-4a50-8751-f6f77de95873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:01:21.852807 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b22ba-58ec-4a50-8751-f6f77de95873 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:01:21.853614 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b22ba-58ec-4a50-8751-f6f77de95873 admin admin] PATH_INFO: `/v3/projects/197e7b145ed049b0a37bd871b4a34920` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:01:21.855138 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b22ba-58ec-4a50-8751-f6f77de95873 admin admin] RBAC: Authorizing `identity:delete_project(project_id=197e7b145ed049b0a37bd871b4a34920)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:01:21.857055 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b22ba-58ec-4a50-8751-f6f77de95873 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:01:21.908433 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4f6b22ba-58ec-4a50-8751-f6f77de95873 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '197e7b145ed049b0a37bd871b4a34920', 'request_id': 'req-4f6b22ba-58ec-4a50-8751-f6f77de95873'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:01:21.914336 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4f6b22ba-58ec-4a50-8751-f6f77de95873 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '197e7b145ed049b0a37bd871b4a34920', 'request_id': 'req-4f6b22ba-58ec-4a50-8751-f6f77de95873'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:01:21.920825 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4f6b22ba-58ec-4a50-8751-f6f77de95873 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '197e7b145ed049b0a37bd871b4a34920', 'request_id': 'req-4f6b22ba-58ec-4a50-8751-f6f77de95873'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:01:21.936377 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4f6b22ba-58ec-4a50-8751-f6f77de95873 admin admin] The token cache is being invalidate because project 197e7b145ed049b0a37bd871b4a34920 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 17:01:21.936671 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4f6b22ba-58ec-4a50-8751-f6f77de95873 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:01:21.937319 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-4f6b22ba-58ec-4a50-8751-f6f77de95873 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:01:21.939245 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4560/9099] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 17:01:21 2022] DELETE /identity/v3/projects/197e7b145ed049b0a37bd871b4a34920 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 17:01:21.943325 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766235f2-ff4e-463f-86c7-cc8e8bb93ff8 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:01:21.953895 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766235f2-ff4e-463f-86c7-cc8e8bb93ff8 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:01:21.973723 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:01:22.014872 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d20eb85-6766-456d-af75-75c030fec57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:01:22.015459 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20eb85-6766-456d-af75-75c030fec57d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:01:22.015739 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20eb85-6766-456d-af75-75c030fec57d admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:01:22.016012 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20eb85-6766-456d-af75-75c030fec57d admin admin] PATH_INFO: `/v3/users/d16bb16e0feb4b149c6d5763bcaebf32` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:01:22.017130 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d20eb85-6766-456d-af75-75c030fec57d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d16bb16e0feb4b149c6d5763bcaebf32)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:01:22.019083 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d20eb85-6766-456d-af75-75c030fec57d admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:01:22.064409 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3d20eb85-6766-456d-af75-75c030fec57d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd16bb16e0feb4b149c6d5763bcaebf32'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:01:22.065058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3d20eb85-6766-456d-af75-75c030fec57d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd16bb16e0feb4b149c6d5763bcaebf32'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:01:22.077427 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3d20eb85-6766-456d-af75-75c030fec57d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd16bb16e0feb4b149c6d5763bcaebf32'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:01:22.084941 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3d20eb85-6766-456d-af75-75c030fec57d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd16bb16e0feb4b149c6d5763bcaebf32'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:01:22.091884 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-3d20eb85-6766-456d-af75-75c030fec57d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd16bb16e0feb4b149c6d5763bcaebf32'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:01:22.097768 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4540/9100] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 17:01:21 2022] DELETE /identity/v3/users/d16bb16e0feb4b149c6d5763bcaebf32 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 17:01:22.378040 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b22ba-58ec-4a50-8751-f6f77de95873 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:01:22.379519 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-4f6b22ba-58ec-4a50-8751-f6f77de95873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:01:22.392981 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b22ba-58ec-4a50-8751-f6f77de95873 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:01:22.453757 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17104a0d-96e8-46f5-ad7b-62c2aa22aeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:01:22.454416 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17104a0d-96e8-46f5-ad7b-62c2aa22aeae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:01:22.454693 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17104a0d-96e8-46f5-ad7b-62c2aa22aeae admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:01:22.454967 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17104a0d-96e8-46f5-ad7b-62c2aa22aeae admin admin] PATH_INFO: `/v3/projects/985805adf8ac49f5bfdba22604806d34` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:01:22.456121 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17104a0d-96e8-46f5-ad7b-62c2aa22aeae admin admin] RBAC: Authorizing `identity:delete_project(project_id=985805adf8ac49f5bfdba22604806d34)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:01:22.458076 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17104a0d-96e8-46f5-ad7b-62c2aa22aeae admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:01:22.488814 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:01:22.507153 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-17104a0d-96e8-46f5-ad7b-62c2aa22aeae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '985805adf8ac49f5bfdba22604806d34', 'request_id': 'req-17104a0d-96e8-46f5-ad7b-62c2aa22aeae'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:01:22.512720 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-17104a0d-96e8-46f5-ad7b-62c2aa22aeae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '985805adf8ac49f5bfdba22604806d34', 'request_id': 'req-17104a0d-96e8-46f5-ad7b-62c2aa22aeae'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:01:22.518929 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-17104a0d-96e8-46f5-ad7b-62c2aa22aeae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '985805adf8ac49f5bfdba22604806d34', 'request_id': 'req-17104a0d-96e8-46f5-ad7b-62c2aa22aeae'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:01:22.533533 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-17104a0d-96e8-46f5-ad7b-62c2aa22aeae admin admin] The token cache is being invalidate because project 985805adf8ac49f5bfdba22604806d34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 17:01:22.533821 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-17104a0d-96e8-46f5-ad7b-62c2aa22aeae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:01:22.534498 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-17104a0d-96e8-46f5-ad7b-62c2aa22aeae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:01:22.536005 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4561/9101] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 17:01:22 2022] DELETE /identity/v3/projects/985805adf8ac49f5bfdba22604806d34 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 17:01:22.542099 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21335f-35e3-420d-8ae8-412805583522 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:01:22.542672 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21335f-35e3-420d-8ae8-412805583522 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:01:22.542672 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21335f-35e3-420d-8ae8-412805583522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:01:22.562963 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-ae21335f-35e3-420d-8ae8-412805583522 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 17:01:22.564434 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ae21335f-35e3-420d-8ae8-412805583522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:01:22.625456 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4541/9102] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 17:01:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 17:01:22.634697 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180a42f-809f-4db5-a205-38073f4c3d65 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:01:22.634971 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180a42f-809f-4db5-a205-38073f4c3d65 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:01:22.635277 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180a42f-809f-4db5-a205-38073f4c3d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:01:22.655062 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-d180a42f-809f-4db5-a205-38073f4c3d65 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 17:01:22.656252 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d180a42f-809f-4db5-a205-38073f4c3d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:01:22.664402 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4562/9103] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 17:01:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 17:01:22.668704 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21335f-35e3-420d-8ae8-412805583522 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:01:22.678890 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21335f-35e3-420d-8ae8-412805583522 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:01:22.683559 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb0321b-1dee-4710-a3b7-c92f6e116339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:01:22.684163 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0321b-1dee-4710-a3b7-c92f6e116339 admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:01:22.684443 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0321b-1dee-4710-a3b7-c92f6e116339 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:01:22.684716 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0321b-1dee-4710-a3b7-c92f6e116339 admin admin] PATH_INFO: `/v3/domains` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:01:22.685361 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb0321b-1dee-4710-a3b7-c92f6e116339 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 17:01:22.685663 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb0321b-1dee-4710-a3b7-c92f6e116339 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:01:22.687304 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb0321b-1dee-4710-a3b7-c92f6e116339 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:01:22.702076 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4542/9104] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 17:01:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 17:01:22.704940 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d180a42f-809f-4db5-a205-38073f4c3d65 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:01:22.713942 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d180a42f-809f-4db5-a205-38073f4c3d65 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:01:22.718622 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2643d146-ddc2-4601-9d0d-82fd124ffb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:01:22.719250 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643d146-ddc2-4601-9d0d-82fd124ffb9c admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:01:22.719528 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643d146-ddc2-4601-9d0d-82fd124ffb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:01:22.719798 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643d146-ddc2-4601-9d0d-82fd124ffb9c admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:01:22.720437 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2643d146-ddc2-4601-9d0d-82fd124ffb9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:01:22.722331 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2643d146-ddc2-4601-9d0d-82fd124ffb9c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:01:22.750414 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4563/9105] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 17:01:22 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 17:01:22.754637 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb0321b-1dee-4710-a3b7-c92f6e116339 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:01:22.765603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb0321b-1dee-4710-a3b7-c92f6e116339 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:01:22.791933 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:01:22.826767 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9342d9-aece-4fcb-88a9-e82b596dcdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:01:22.827398 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9342d9-aece-4fcb-88a9-e82b596dcdee admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:01:22.827676 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9342d9-aece-4fcb-88a9-e82b596dcdee admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:01:22.827945 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9342d9-aece-4fcb-88a9-e82b596dcdee admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:01:22.828570 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9342d9-aece-4fcb-88a9-e82b596dcdee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:01:22.830600 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9342d9-aece-4fcb-88a9-e82b596dcdee admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:01:22.850840 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4543/9106] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 17:01:22 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 17:01:22.855391 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2643d146-ddc2-4601-9d0d-82fd124ffb9c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:01:22.865544 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2643d146-ddc2-4601-9d0d-82fd124ffb9c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:01:22.870809 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead6da4-3ac5-4338-86d4-a033b04ea5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:01:22.871438 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead6da4-3ac5-4338-86d4-a033b04ea5bc admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:01:22.871713 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead6da4-3ac5-4338-86d4-a033b04ea5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:01:22.871982 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead6da4-3ac5-4338-86d4-a033b04ea5bc admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:01:22.872613 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead6da4-3ac5-4338-86d4-a033b04ea5bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:01:22.874213 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead6da4-3ac5-4338-86d4-a033b04ea5bc admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:01:22.884236 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4564/9107] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 17:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 17:01:22.888081 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9342d9-aece-4fcb-88a9-e82b596dcdee admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:01:22.898158 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9342d9-aece-4fcb-88a9-e82b596dcdee admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:01:22.903115 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d780c1c-3ecc-4914-95a9-4303de4f492a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:01:22.903723 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d780c1c-3ecc-4914-95a9-4303de4f492a admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:01:22.904006 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d780c1c-3ecc-4914-95a9-4303de4f492a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:01:22.904316 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d780c1c-3ecc-4914-95a9-4303de4f492a admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:01:22.904960 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d780c1c-3ecc-4914-95a9-4303de4f492a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:01:22.906586 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d780c1c-3ecc-4914-95a9-4303de4f492a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:01:22.918337 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4544/9108] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 17:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 17:01:22.922596 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead6da4-3ac5-4338-86d4-a033b04ea5bc admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:01:22.933456 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead6da4-3ac5-4338-86d4-a033b04ea5bc admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:01:22.938087 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea5714-418b-4bf6-83f7-03a3936a899d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:01:22.938990 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea5714-418b-4bf6-83f7-03a3936a899d admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:01:22.939309 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea5714-418b-4bf6-83f7-03a3936a899d admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:01:22.939567 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea5714-418b-4bf6-83f7-03a3936a899d admin admin] PATH_INFO: `/v3/projects/6f5ff1a3351844f2a09239c37030423d/users/e5e3906fec6e465bb21f6b0846c7b70f/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:01:22.954216 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea5714-418b-4bf6-83f7-03a3936a899d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f5ff1a3351844f2a09239c37030423d, user_id=e5e3906fec6e465bb21f6b0846c7b70f, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:01:22.956889 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea5714-418b-4bf6-83f7-03a3936a899d admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:01:22.968991 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4565/9109] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 17:01:22 2022] PUT /identity/v3/projects/6f5ff1a3351844f2a09239c37030423d/users/e5e3906fec6e465bb21f6b0846c7b70f/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 17:01:22.974071 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7299c0a-1fac-48c5-8ffd-d30fb0d9eaeb None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:01:22.974362 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7299c0a-1fac-48c5-8ffd-d30fb0d9eaeb None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:01:22.974642 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7299c0a-1fac-48c5-8ffd-d30fb0d9eaeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:01:22.995225 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-f7299c0a-1fac-48c5-8ffd-d30fb0d9eaeb None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 17:01:22.996485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f7299c0a-1fac-48c5-8ffd-d30fb0d9eaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:01:23.054980 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4545/9110] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 17:01:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 17:01:23.065120 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea5714-418b-4bf6-83f7-03a3936a899d admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:01:23.066837 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-90ea5714-418b-4bf6-83f7-03a3936a899d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:01:23.145619 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea5714-418b-4bf6-83f7-03a3936a899d admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:01:23.149953 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b44d73-a804-4f73-961b-7667c0943280 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:01:23.150562 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b44d73-a804-4f73-961b-7667c0943280 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:01:23.150843 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b44d73-a804-4f73-961b-7667c0943280 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:01:23.151159 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b44d73-a804-4f73-961b-7667c0943280 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:01:23.160272 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b44d73-a804-4f73-961b-7667c0943280 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:01:23.161708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b44d73-a804-4f73-961b-7667c0943280 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:01:23.171855 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4566/9111] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 17:01:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 17:01:27.174076 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756fe2f5-a663-4a6a-be05-fc6487368bf1 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:01:27.174953 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756fe2f5-a663-4a6a-be05-fc6487368bf1 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:01:27.175423 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756fe2f5-a663-4a6a-be05-fc6487368bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:01:27.216399 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-756fe2f5-a663-4a6a-be05-fc6487368bf1 None None] MFA Rules not processed for user `e5e3906fec6e465bb21f6b0846c7b70f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 17:01:27.217828 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-756fe2f5-a663-4a6a-be05-fc6487368bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:01:27.293874 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4546/9112] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 17:01:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 17:01:27.298504 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b44d73-a804-4f73-961b-7667c0943280 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:01:27.310093 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b44d73-a804-4f73-961b-7667c0943280 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:01:27.315406 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b75460-e123-4471-ab76-8a94e5054886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:01:27.316301 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b75460-e123-4471-ab76-8a94e5054886 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:01:27.316654 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b75460-e123-4471-ab76-8a94e5054886 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:01:27.317114 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b75460-e123-4471-ab76-8a94e5054886 admin admin] PATH_INFO: `/v3/projects` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:01:27.317816 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b75460-e123-4471-ab76-8a94e5054886 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:01:27.320518 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b75460-e123-4471-ab76-8a94e5054886 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:01:27.353985 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4567/9113] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 17:01:27 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 17:01:27.358234 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756fe2f5-a663-4a6a-be05-fc6487368bf1 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:01:27.372019 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756fe2f5-a663-4a6a-be05-fc6487368bf1 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:01:27.415401 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:01:27.445919 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a88401-d050-405c-bfeb-41dc2ebbe893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:01:27.446612 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a88401-d050-405c-bfeb-41dc2ebbe893 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:01:27.446955 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a88401-d050-405c-bfeb-41dc2ebbe893 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:01:27.447327 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a88401-d050-405c-bfeb-41dc2ebbe893 admin admin] PATH_INFO: `/v3/users` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:01:27.448036 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a88401-d050-405c-bfeb-41dc2ebbe893 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:01:27.450099 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a88401-d050-405c-bfeb-41dc2ebbe893 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:01:27.477133 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4547/9114] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 17:01:27 2022] POST /identity/v3/users => generated 292 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 17:01:27.481183 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b75460-e123-4471-ab76-8a94e5054886 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:01:27.492483 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b75460-e123-4471-ab76-8a94e5054886 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:01:27.497587 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556dffc9-292c-46e5-8437-c710b27a691c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:01:27.498299 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556dffc9-292c-46e5-8437-c710b27a691c admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:01:27.498660 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556dffc9-292c-46e5-8437-c710b27a691c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:01:27.499000 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556dffc9-292c-46e5-8437-c710b27a691c admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:01:27.499750 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556dffc9-292c-46e5-8437-c710b27a691c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:01:27.501439 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556dffc9-292c-46e5-8437-c710b27a691c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:01:27.508672 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:01:27.518718 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4568/9115] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 17:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 17:01:27.521650 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a88401-d050-405c-bfeb-41dc2ebbe893 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:01:27.535444 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a88401-d050-405c-bfeb-41dc2ebbe893 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:01:27.541325 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca72b0-4de3-41e4-a86d-a7da04c046c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:01:27.542125 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca72b0-4de3-41e4-a86d-a7da04c046c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:01:27.542391 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca72b0-4de3-41e4-a86d-a7da04c046c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:01:27.542663 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca72b0-4de3-41e4-a86d-a7da04c046c0 admin admin] PATH_INFO: `/v3/projects/1182b48213ef4482883c44d4b91cc4a4/users/26581eccddb146c880a2596f241928d2/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:01:27.559277 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca72b0-4de3-41e4-a86d-a7da04c046c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1182b48213ef4482883c44d4b91cc4a4, user_id=26581eccddb146c880a2596f241928d2, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:01:27.561956 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca72b0-4de3-41e4-a86d-a7da04c046c0 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:01:27.577116 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4548/9116] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 17:01:27 2022] PUT /identity/v3/projects/1182b48213ef4482883c44d4b91cc4a4/users/26581eccddb146c880a2596f241928d2/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 17:01:27.581172 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556dffc9-292c-46e5-8437-c710b27a691c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:01:27.592401 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556dffc9-292c-46e5-8437-c710b27a691c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:01:27.670054 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75573ad6-8588-47d6-8f32-0a856575e453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:01:27.670692 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75573ad6-8588-47d6-8f32-0a856575e453 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:01:27.670968 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75573ad6-8588-47d6-8f32-0a856575e453 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:01:27.671267 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75573ad6-8588-47d6-8f32-0a856575e453 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:01:27.672788 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75573ad6-8588-47d6-8f32-0a856575e453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:01:27.674644 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75573ad6-8588-47d6-8f32-0a856575e453 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:01:27.699636 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4569/9117] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 17:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 17:01:27.707982 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca72b0-4de3-41e4-a86d-a7da04c046c0 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:01:27.719208 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca72b0-4de3-41e4-a86d-a7da04c046c0 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:01:27.723949 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2420c4c9-b421-4b66-9d98-da89198faaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:01:27.724603 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420c4c9-b421-4b66-9d98-da89198faaf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:01:27.724882 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420c4c9-b421-4b66-9d98-da89198faaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:01:27.725292 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420c4c9-b421-4b66-9d98-da89198faaf3 admin admin] PATH_INFO: `/v3/projects/1182b48213ef4482883c44d4b91cc4a4/users/26581eccddb146c880a2596f241928d2/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:01:27.727805 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2420c4c9-b421-4b66-9d98-da89198faaf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1182b48213ef4482883c44d4b91cc4a4, user_id=26581eccddb146c880a2596f241928d2, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:01:27.730670 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2420c4c9-b421-4b66-9d98-da89198faaf3 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:01:27.743135 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4549/9118] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 17:01:27 2022] PUT /identity/v3/projects/1182b48213ef4482883c44d4b91cc4a4/users/26581eccddb146c880a2596f241928d2/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 17:01:32.478158 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f50f1-7c3c-4717-bbc6-05288f3fd9ce None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:01:32.478758 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f50f1-7c3c-4717-bbc6-05288f3fd9ce None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:01:32.478758 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f50f1-7c3c-4717-bbc6-05288f3fd9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:01:32.508923 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-9a9f50f1-7c3c-4717-bbc6-05288f3fd9ce None None] MFA Rules not processed for user `26581eccddb146c880a2596f241928d2`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 17:01:32.510054 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-9a9f50f1-7c3c-4717-bbc6-05288f3fd9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:01:32.597935 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4570/9119] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 17:01:32 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 17:01:32.617443 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2420c4c9-b421-4b66-9d98-da89198faaf3 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:01:32.620229 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2420c4c9-b421-4b66-9d98-da89198faaf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:01:32.759952 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2420c4c9-b421-4b66-9d98-da89198faaf3 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:01:32.766061 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda6455-f018-4b23-b027-07d635a51c0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:01:32.766856 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda6455-f018-4b23-b027-07d635a51c0a service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:01:32.767225 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda6455-f018-4b23-b027-07d635a51c0a service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:01:32.767583 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda6455-f018-4b23-b027-07d635a51c0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:01:32.840592 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceda6455-f018-4b23-b027-07d635a51c0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:01:32.842614 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceda6455-f018-4b23-b027-07d635a51c0a service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:01:32.848981 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:01:32.867249 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4550/9120] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 17:01:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 17:01:33.880727 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185cd85f-31ea-4abe-b7da-c3321890ee46 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:01:33.881813 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185cd85f-31ea-4abe-b7da-c3321890ee46 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:01:33.881932 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185cd85f-31ea-4abe-b7da-c3321890ee46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:01:33.904134 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-185cd85f-31ea-4abe-b7da-c3321890ee46 None None] MFA Rules not processed for user `e5e3906fec6e465bb21f6b0846c7b70f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 17:01:33.905266 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-185cd85f-31ea-4abe-b7da-c3321890ee46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:01:33.913109 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4571/9121] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 17:01:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 17:01:33.964817 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda6455-f018-4b23-b027-07d635a51c0a service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:01:33.966937 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ceda6455-f018-4b23-b027-07d635a51c0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:01:34.049290 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda6455-f018-4b23-b027-07d635a51c0a service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:01:34.052980 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a937af2-3e03-4933-b3fe-85b4fdd7c139 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6b0f9835ed549cab91d684326be83fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:01:34.054126 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a937af2-3e03-4933-b3fe-85b4fdd7c139 service glance] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:01:34.054887 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a937af2-3e03-4933-b3fe-85b4fdd7c139 service glance] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:01:34.054887 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a937af2-3e03-4933-b3fe-85b4fdd7c139 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:01:34.056483 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0a937af2-3e03-4933-b3fe-85b4fdd7c139 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:01:34.070914 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a937af2-3e03-4933-b3fe-85b4fdd7c139 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:01:34.072390 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a937af2-3e03-4933-b3fe-85b4fdd7c139 service glance] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:01:34.084234 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4551/9122] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 17:01:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 17:01:34.370667 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185cd85f-31ea-4abe-b7da-c3321890ee46 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:01:34.372018 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-185cd85f-31ea-4abe-b7da-c3321890ee46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:01:34.431010 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185cd85f-31ea-4abe-b7da-c3321890ee46 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:01:34.434635 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb61eec7-e066-4570-bbfe-910143051f3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:01:34.435276 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61eec7-e066-4570-bbfe-910143051f3a service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:01:34.435552 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61eec7-e066-4570-bbfe-910143051f3a service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:01:34.435819 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61eec7-e066-4570-bbfe-910143051f3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:01:34.437520 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-bb61eec7-e066-4570-bbfe-910143051f3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:01:34.448076 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb61eec7-e066-4570-bbfe-910143051f3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:01:34.449586 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb61eec7-e066-4570-bbfe-910143051f3a service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:01:34.457810 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4572/9123] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 17:01:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 17:01:35.821751 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a937af2-3e03-4933-b3fe-85b4fdd7c139 service glance] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:01:35.832633 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a937af2-3e03-4933-b3fe-85b4fdd7c139 service glance] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:01:35.837298 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306b51d-23ac-477f-8e96-c0155d6f14bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:01:35.838058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306b51d-23ac-477f-8e96-c0155d6f14bd service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:01:35.838530 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306b51d-23ac-477f-8e96-c0155d6f14bd service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:01:35.839013 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306b51d-23ac-477f-8e96-c0155d6f14bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:01:35.840958 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-d306b51d-23ac-477f-8e96-c0155d6f14bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:01:35.858764 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d306b51d-23ac-477f-8e96-c0155d6f14bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:01:35.860617 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d306b51d-23ac-477f-8e96-c0155d6f14bd service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:01:35.886435 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4552/9124] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 17:01:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 17:01:37.617083 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb61eec7-e066-4570-bbfe-910143051f3a service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:01:37.626511 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb61eec7-e066-4570-bbfe-910143051f3a service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:01:37.630387 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b6427-0bfd-4d96-822f-1f873952bd79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:01:37.631001 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b6427-0bfd-4d96-822f-1f873952bd79 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:01:37.631396 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b6427-0bfd-4d96-822f-1f873952bd79 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:01:37.631674 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b6427-0bfd-4d96-822f-1f873952bd79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:01:37.633526 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-727b6427-0bfd-4d96-822f-1f873952bd79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:01:37.643906 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727b6427-0bfd-4d96-822f-1f873952bd79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:01:37.645354 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727b6427-0bfd-4d96-822f-1f873952bd79 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:01:37.654850 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4573/9125] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 17:01:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 17:01:45.867501 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=41 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:01:46.715633 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306b51d-23ac-477f-8e96-c0155d6f14bd service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:01:46.724378 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306b51d-23ac-477f-8e96-c0155d6f14bd service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:01:46.728189 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968fca47-441b-4235-9e72-a31248a6efa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:01:46.728787 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968fca47-441b-4235-9e72-a31248a6efa1 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:01:46.729067 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968fca47-441b-4235-9e72-a31248a6efa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:01:46.729342 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968fca47-441b-4235-9e72-a31248a6efa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:01:46.738530 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968fca47-441b-4235-9e72-a31248a6efa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:01:46.740012 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968fca47-441b-4235-9e72-a31248a6efa1 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:01:46.750420 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4553/9126] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 17:01:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 17:01:47.650900 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=98 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:01:56.745936 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=6 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:03:56.828330 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9de05-59af-4c71-8ad8-03bee5a868da None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:03:56.828841 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9de05-59af-4c71-8ad8-03bee5a868da None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:03:56.828954 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9de05-59af-4c71-8ad8-03bee5a868da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:03:56.879149 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-75d9de05-59af-4c71-8ad8-03bee5a868da None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 17:03:56.880368 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-75d9de05-59af-4c71-8ad8-03bee5a868da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:03:56.945240 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4574/9127] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 17:03:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 17:03:56.992898 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968fca47-441b-4235-9e72-a31248a6efa1 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:03:56.994506 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-968fca47-441b-4235-9e72-a31248a6efa1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:03:57.087507 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968fca47-441b-4235-9e72-a31248a6efa1 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:03:57.093189 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a81a3-6090-40c6-9970-8030d76de43f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:03:57.093790 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a81a3-6090-40c6-9970-8030d76de43f service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:03:57.094065 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a81a3-6090-40c6-9970-8030d76de43f service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:03:57.094333 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a81a3-6090-40c6-9970-8030d76de43f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:03:57.102332 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331a81a3-6090-40c6-9970-8030d76de43f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:03:57.103941 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331a81a3-6090-40c6-9970-8030d76de43f service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:03:57.112045 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4554/9128] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 17:03:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 17:03:58.206468 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9de05-59af-4c71-8ad8-03bee5a868da None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:03:58.207939 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-75d9de05-59af-4c71-8ad8-03bee5a868da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:03:58.310014 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9de05-59af-4c71-8ad8-03bee5a868da None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:03:58.320170 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db11c1a2-cd49-44d4-bf34-29860d2885b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:03:58.320908 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11c1a2-cd49-44d4-bf34-29860d2885b0 service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:03:58.321192 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11c1a2-cd49-44d4-bf34-29860d2885b0 service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:03:58.321466 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11c1a2-cd49-44d4-bf34-29860d2885b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:03:58.323263 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-db11c1a2-cd49-44d4-bf34-29860d2885b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:03:58.336100 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db11c1a2-cd49-44d4-bf34-29860d2885b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:03:58.337719 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db11c1a2-cd49-44d4-bf34-29860d2885b0 service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:03:58.350793 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4575/9129] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 17:03:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 17:03:59.313416 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a81a3-6090-40c6-9970-8030d76de43f service swift] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:03:59.329027 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a81a3-6090-40c6-9970-8030d76de43f service swift] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:03:59.342697 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb2fab-8b88-49e2-9581-72ba1b1519b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:03:59.344206 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb2fab-8b88-49e2-9581-72ba1b1519b0 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:03:59.344546 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb2fab-8b88-49e2-9581-72ba1b1519b0 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:03:59.344823 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb2fab-8b88-49e2-9581-72ba1b1519b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:03:59.346784 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-77cb2fab-8b88-49e2-9581-72ba1b1519b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:03:59.383470 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb2fab-8b88-49e2-9581-72ba1b1519b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:03:59.386000 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb2fab-8b88-49e2-9581-72ba1b1519b0 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:03:59.415361 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4555/9130] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 17:03:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 17:04:08.345491 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=76 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:04:09.400045 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=47 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:04:09.804471 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba17ca8-d6fc-42e9-b46c-4941d3ea7f32 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:04:09.805069 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba17ca8-d6fc-42e9-b46c-4941d3ea7f32 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:04:09.805282 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba17ca8-d6fc-42e9-b46c-4941d3ea7f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:04:09.841221 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-7ba17ca8-d6fc-42e9-b46c-4941d3ea7f32 None None] MFA Rules not processed for user `253947a5ef294d2bb828761873251bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 17:04:09.843945 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7ba17ca8-d6fc-42e9-b46c-4941d3ea7f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:04:09.860041 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4576/9131] 10.222.0.83 () {58 vars in 1018 bytes} [Mon Aug 29 17:04:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 17:04:09.871437 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb2fab-8b88-49e2-9581-72ba1b1519b0 service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:04:09.881230 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb2fab-8b88-49e2-9581-72ba1b1519b0 service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:04:09.884963 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7e8da-8020-4476-bf82-494812500f7b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6b0f9835ed549cab91d684326be83fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:04:09.885565 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7e8da-8020-4476-bf82-494812500f7b service glance] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:04:09.885863 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7e8da-8020-4476-bf82-494812500f7b service glance] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:04:09.886101 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7e8da-8020-4476-bf82-494812500f7b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:04:09.901224 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee7e8da-8020-4476-bf82-494812500f7b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:04:09.902666 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee7e8da-8020-4476-bf82-494812500f7b service glance] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:04:09.914866 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4556/9132] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 17:04:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 17:04:09.987179 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba17ca8-d6fc-42e9-b46c-4941d3ea7f32 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:04:09.996887 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba17ca8-d6fc-42e9-b46c-4941d3ea7f32 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:04:10.000908 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b69cb-ad71-48e6-aa4a-ae439828281a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:04:10.001525 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b69cb-ad71-48e6-aa4a-ae439828281a service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:04:10.001801 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b69cb-ad71-48e6-aa4a-ae439828281a service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:04:10.002068 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b69cb-ad71-48e6-aa4a-ae439828281a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:04:10.004104 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-413b69cb-ad71-48e6-aa4a-ae439828281a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:04:10.015191 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b69cb-ad71-48e6-aa4a-ae439828281a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:04:10.016618 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b69cb-ad71-48e6-aa4a-ae439828281a service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:04:10.024977 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4577/9133] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 17:04:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 17:04:10.099950 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7e8da-8020-4476-bf82-494812500f7b service glance] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:04:10.109709 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7e8da-8020-4476-bf82-494812500f7b service glance] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:04:10.113406 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0defc592-7453-49ec-8ebb-c1d372262f32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:04:10.113994 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0defc592-7453-49ec-8ebb-c1d372262f32 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:04:10.114268 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0defc592-7453-49ec-8ebb-c1d372262f32 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:04:10.114561 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0defc592-7453-49ec-8ebb-c1d372262f32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:04:10.116290 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-0defc592-7453-49ec-8ebb-c1d372262f32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:04:10.129870 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0defc592-7453-49ec-8ebb-c1d372262f32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:04:10.131318 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0defc592-7453-49ec-8ebb-c1d372262f32 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:04:10.142702 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4557/9134] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 17:04:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 17:04:10.208253 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b69cb-ad71-48e6-aa4a-ae439828281a service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:04:10.209695 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-413b69cb-ad71-48e6-aa4a-ae439828281a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:04:10.225351 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b69cb-ad71-48e6-aa4a-ae439828281a service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:04:10.230265 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3840b6d-179e-4597-b003-96e67dec95c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:04:10.230893 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3840b6d-179e-4597-b003-96e67dec95c0 service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:04:10.231172 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3840b6d-179e-4597-b003-96e67dec95c0 service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:04:10.231443 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3840b6d-179e-4597-b003-96e67dec95c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:04:10.233895 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-b3840b6d-179e-4597-b003-96e67dec95c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:04:10.245409 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3840b6d-179e-4597-b003-96e67dec95c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:04:10.246985 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3840b6d-179e-4597-b003-96e67dec95c0 service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:04:10.256788 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4578/9135] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 17:04:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 17:04:11.752376 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7142b-3626-40ef-a604-c15ffe1e2bb6 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:04:11.752852 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7142b-3626-40ef-a604-c15ffe1e2bb6 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:04:11.752955 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7142b-3626-40ef-a604-c15ffe1e2bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:04:11.773114 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-7ce7142b-3626-40ef-a604-c15ffe1e2bb6 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 17:04:11.774305 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7ce7142b-3626-40ef-a604-c15ffe1e2bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:04:11.781569 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4558/9136] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 17:04:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 17:04:11.793323 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3840b6d-179e-4597-b003-96e67dec95c0 service placement] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:04:11.804893 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3840b6d-179e-4597-b003-96e67dec95c0 service placement] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:04:11.811363 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b5774-5fea-4d0e-a48b-d5e9b9692a77 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:04:11.811967 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b5774-5fea-4d0e-a48b-d5e9b9692a77 service swift] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:04:11.812235 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b5774-5fea-4d0e-a48b-d5e9b9692a77 service swift] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:04:11.812499 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b5774-5fea-4d0e-a48b-d5e9b9692a77 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:04:11.821533 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b5774-5fea-4d0e-a48b-d5e9b9692a77 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:04:11.823139 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b5774-5fea-4d0e-a48b-d5e9b9692a77 service swift] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:04:11.832306 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4579/9137] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 17:04:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 17:04:21.767672 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=15 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:04:21.828732 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=25 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:04:26.680362 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ce2b9-574d-4e62-bd07-c586a3f9e109 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:04:26.680827 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ce2b9-574d-4e62-bd07-c586a3f9e109 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:04:26.681042 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ce2b9-574d-4e62-bd07-c586a3f9e109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:04:26.701720 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-9b2ce2b9-574d-4e62-bd07-c586a3f9e109 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 17:04:26.702992 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9b2ce2b9-574d-4e62-bd07-c586a3f9e109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:04:26.710449 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4559/9138] 10.222.0.83 () {58 vars in 967 bytes} [Mon Aug 29 17:04:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 17:04:26.723682 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b5774-5fea-4d0e-a48b-d5e9b9692a77 service swift] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:04:26.735287 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b5774-5fea-4d0e-a48b-d5e9b9692a77 service swift] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:04:26.740488 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d14fda-c2f7-4ce1-abcf-1b7051c2341c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:04:26.741113 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d14fda-c2f7-4ce1-abcf-1b7051c2341c service swift] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:04:26.741392 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d14fda-c2f7-4ce1-abcf-1b7051c2341c service swift] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:04:26.741664 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d14fda-c2f7-4ce1-abcf-1b7051c2341c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:04:26.750961 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d14fda-c2f7-4ce1-abcf-1b7051c2341c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:04:26.752603 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d14fda-c2f7-4ce1-abcf-1b7051c2341c service swift] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:04:26.761254 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4580/9139] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 17:04:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 17:04:36.695972 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:04:36.757774 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=6 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:05:09.090290 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ce2b9-574d-4e62-bd07-c586a3f9e109 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:05:09.102792 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ce2b9-574d-4e62-bd07-c586a3f9e109 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:05:09.107690 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8748d-8cbe-4870-a26b-1e7eeabf0808 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:05:09.108286 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8748d-8cbe-4870-a26b-1e7eeabf0808 service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:05:09.108584 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8748d-8cbe-4870-a26b-1e7eeabf0808 service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:05:09.108850 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8748d-8cbe-4870-a26b-1e7eeabf0808 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:05:09.111262 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1cf8748d-8cbe-4870-a26b-1e7eeabf0808 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:05:09.122726 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8748d-8cbe-4870-a26b-1e7eeabf0808 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:05:09.124339 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8748d-8cbe-4870-a26b-1e7eeabf0808 service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:05:09.134229 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4560/9140] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 17:05:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 17:05:19.130253 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=6 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:05:37.670436 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d14fda-c2f7-4ce1-abcf-1b7051c2341c service swift] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:05:37.684745 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d14fda-c2f7-4ce1-abcf-1b7051c2341c service swift] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:05:37.691894 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefef326-62f1-48aa-bec1-d9b4dee899cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:05:37.692793 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefef326-62f1-48aa-bec1-d9b4dee899cd service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:05:37.693268 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefef326-62f1-48aa-bec1-d9b4dee899cd service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:05:37.693733 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefef326-62f1-48aa-bec1-d9b4dee899cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:05:37.695723 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-fefef326-62f1-48aa-bec1-d9b4dee899cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:05:37.717382 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefef326-62f1-48aa-bec1-d9b4dee899cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:05:37.718973 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefef326-62f1-48aa-bec1-d9b4dee899cd service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:05:37.731669 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4581/9141] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 17:05:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 17:05:41.457492 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4c90c-6a24-47b0-a101-3c94973c2256 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:05:41.458014 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4c90c-6a24-47b0-a101-3c94973c2256 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:05:41.458123 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4c90c-6a24-47b0-a101-3c94973c2256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:05:41.477035 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-64f4c90c-6a24-47b0-a101-3c94973c2256 None None] MFA Rules not processed for user `e5e3906fec6e465bb21f6b0846c7b70f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 17:05:41.478228 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-64f4c90c-6a24-47b0-a101-3c94973c2256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:05:41.485096 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4561/9142] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 17:05:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 17:05:47.726809 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=6 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:05:51.472024 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:05:57.038483 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefef326-62f1-48aa-bec1-d9b4dee899cd service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:05:57.048265 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefef326-62f1-48aa-bec1-d9b4dee899cd service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:05:57.055550 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400388cd-0a0b-40c9-810c-6b0bb8eac2b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:05:57.055550 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400388cd-0a0b-40c9-810c-6b0bb8eac2b8 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:05:57.055550 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400388cd-0a0b-40c9-810c-6b0bb8eac2b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:05:57.055550 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400388cd-0a0b-40c9-810c-6b0bb8eac2b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:05:57.055986 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-400388cd-0a0b-40c9-810c-6b0bb8eac2b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:05:57.066254 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400388cd-0a0b-40c9-810c-6b0bb8eac2b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:05:57.068059 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400388cd-0a0b-40c9-810c-6b0bb8eac2b8 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:05:57.079170 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4582/9143] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 17:05:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 17:05:57.531556 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4c90c-6a24-47b0-a101-3c94973c2256 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:05:57.546119 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4c90c-6a24-47b0-a101-3c94973c2256 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:05:57.551672 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baacdb0-f19d-4e2a-9b32-7872e2d5510d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:05:57.552302 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baacdb0-f19d-4e2a-9b32-7872e2d5510d service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:05:57.552588 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baacdb0-f19d-4e2a-9b32-7872e2d5510d service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:05:57.552859 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baacdb0-f19d-4e2a-9b32-7872e2d5510d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:05:57.554642 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5baacdb0-f19d-4e2a-9b32-7872e2d5510d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:05:57.568016 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baacdb0-f19d-4e2a-9b32-7872e2d5510d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:05:57.569635 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baacdb0-f19d-4e2a-9b32-7872e2d5510d service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:05:57.581360 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4562/9144] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 17:05:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 17:05:59.494876 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400388cd-0a0b-40c9-810c-6b0bb8eac2b8 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:05:59.505864 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400388cd-0a0b-40c9-810c-6b0bb8eac2b8 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:05:59.509631 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6441f65f-b850-4175-a77a-452dac352150 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:05:59.510248 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441f65f-b850-4175-a77a-452dac352150 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:05:59.510525 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441f65f-b850-4175-a77a-452dac352150 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:05:59.510793 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441f65f-b850-4175-a77a-452dac352150 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:05:59.512582 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-6441f65f-b850-4175-a77a-452dac352150 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:05:59.524254 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6441f65f-b850-4175-a77a-452dac352150 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:05:59.525876 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6441f65f-b850-4175-a77a-452dac352150 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:05:59.536614 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4583/9145] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 17:05:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 17:06:07.575955 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=6 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:06:09.530758 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=12 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:08:15.101883 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baacdb0-f19d-4e2a-9b32-7872e2d5510d service placement] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:08:15.103532 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-5baacdb0-f19d-4e2a-9b32-7872e2d5510d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:08:15.169204 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baacdb0-f19d-4e2a-9b32-7872e2d5510d service placement] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:08:15.176375 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3b00a-8ba9-4073-b75d-36f8143f1cfa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:08:15.176997 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3b00a-8ba9-4073-b75d-36f8143f1cfa service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:08:15.177275 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3b00a-8ba9-4073-b75d-36f8143f1cfa service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:08:15.177547 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3b00a-8ba9-4073-b75d-36f8143f1cfa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:08:15.186502 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3b00a-8ba9-4073-b75d-36f8143f1cfa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:08:15.188189 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3b00a-8ba9-4073-b75d-36f8143f1cfa service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:08:15.197351 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4563/9146] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 17:08:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 17:08:15.384357 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6441f65f-b850-4175-a77a-452dac352150 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:08:15.403148 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6441f65f-b850-4175-a77a-452dac352150 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:08:15.407744 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87332c-2394-4ef1-a63f-c65306b1e920 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:08:15.408359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87332c-2394-4ef1-a63f-c65306b1e920 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:08:15.408636 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87332c-2394-4ef1-a63f-c65306b1e920 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:08:15.408908 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87332c-2394-4ef1-a63f-c65306b1e920 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:08:15.420383 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c87332c-2394-4ef1-a63f-c65306b1e920 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:08:15.422151 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c87332c-2394-4ef1-a63f-c65306b1e920 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:08:15.433287 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4584/9147] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 17:08:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 17:08:16.638046 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3b00a-8ba9-4073-b75d-36f8143f1cfa service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:08:16.648007 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3b00a-8ba9-4073-b75d-36f8143f1cfa service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:08:16.651708 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4585a54-a999-47a7-a651-68383f7e81b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:08:16.652304 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4585a54-a999-47a7-a651-68383f7e81b2 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:08:16.652585 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4585a54-a999-47a7-a651-68383f7e81b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:08:16.652860 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4585a54-a999-47a7-a651-68383f7e81b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:08:16.663242 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4585a54-a999-47a7-a651-68383f7e81b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:08:16.664613 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4585a54-a999-47a7-a651-68383f7e81b2 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:08:16.675996 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4564/9148] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 17:08:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 17:08:25.428355 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=11 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:08:26.671374 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=34 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:08:35.692009 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87332c-2394-4ef1-a63f-c65306b1e920 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:08:35.701396 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87332c-2394-4ef1-a63f-c65306b1e920 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:08:35.705470 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1a796-36af-426e-b695-27de185579bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:08:35.706487 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1a796-36af-426e-b695-27de185579bd service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:08:35.706487 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1a796-36af-426e-b695-27de185579bd service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:08:35.706687 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1a796-36af-426e-b695-27de185579bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:08:35.714301 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a1a796-36af-426e-b695-27de185579bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:08:35.715828 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a1a796-36af-426e-b695-27de185579bd service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:08:35.724308 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4585/9149] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 17:08:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 17:08:45.720401 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=6 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:09:03.149856 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4585a54-a999-47a7-a651-68383f7e81b2 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:09:03.161329 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4585a54-a999-47a7-a651-68383f7e81b2 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:09:03.166499 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee00cc-37f2-47ce-bd29-28f471a658d3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:09:03.167113 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee00cc-37f2-47ce-bd29-28f471a658d3 service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:09:03.167391 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee00cc-37f2-47ce-bd29-28f471a658d3 service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:09:03.167661 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee00cc-37f2-47ce-bd29-28f471a658d3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:09:03.176847 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ee00cc-37f2-47ce-bd29-28f471a658d3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:09:03.178412 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ee00cc-37f2-47ce-bd29-28f471a658d3 service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:09:03.189278 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4565/9150] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 17:09:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 17:09:13.184083 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=6 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:10:05.237775 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1a796-36af-426e-b695-27de185579bd service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:10:05.251291 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1a796-36af-426e-b695-27de185579bd service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:10:05.257464 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a398e-fad6-44ad-9d3a-eef580fde095 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:10:05.258078 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a398e-fad6-44ad-9d3a-eef580fde095 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:10:05.258359 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a398e-fad6-44ad-9d3a-eef580fde095 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:10:05.258631 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a398e-fad6-44ad-9d3a-eef580fde095 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:10:05.260426 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-793a398e-fad6-44ad-9d3a-eef580fde095 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:10:05.274248 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793a398e-fad6-44ad-9d3a-eef580fde095 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:10:05.275863 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793a398e-fad6-44ad-9d3a-eef580fde095 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:10:05.287483 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4586/9151] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 17:10:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 17:10:11.190360 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee00cc-37f2-47ce-bd29-28f471a658d3 service placement] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:10:11.201660 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee00cc-37f2-47ce-bd29-28f471a658d3 service placement] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:10:11.205646 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56688f-2dbf-4ea4-b44b-8f5eb8b85681 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:10:11.206428 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56688f-2dbf-4ea4-b44b-8f5eb8b85681 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:10:11.206712 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56688f-2dbf-4ea4-b44b-8f5eb8b85681 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:10:11.206987 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56688f-2dbf-4ea4-b44b-8f5eb8b85681 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:10:11.286397 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f56688f-2dbf-4ea4-b44b-8f5eb8b85681 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:10:11.287814 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f56688f-2dbf-4ea4-b44b-8f5eb8b85681 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:10:11.311389 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4566/9152] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 17:10:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 17:10:14.095993 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a398e-fad6-44ad-9d3a-eef580fde095 service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:10:14.109808 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a398e-fad6-44ad-9d3a-eef580fde095 service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:10:14.116389 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99eb522-b035-4c1c-b63a-e44d8a43dc7d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:10:14.117067 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99eb522-b035-4c1c-b63a-e44d8a43dc7d service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:10:14.117351 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99eb522-b035-4c1c-b63a-e44d8a43dc7d service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:10:14.117721 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99eb522-b035-4c1c-b63a-e44d8a43dc7d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:10:14.129184 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99eb522-b035-4c1c-b63a-e44d8a43dc7d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:10:14.131071 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99eb522-b035-4c1c-b63a-e44d8a43dc7d service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:10:14.145545 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4587/9153] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 17:10:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 17:10:14.795506 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56688f-2dbf-4ea4-b44b-8f5eb8b85681 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:10:14.808759 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56688f-2dbf-4ea4-b44b-8f5eb8b85681 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:10:14.814923 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c1ecfa-afb0-408d-9fe0-3d933bc67558 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:10:14.815663 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1ecfa-afb0-408d-9fe0-3d933bc67558 service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:10:14.815939 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1ecfa-afb0-408d-9fe0-3d933bc67558 service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:10:14.816208 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1ecfa-afb0-408d-9fe0-3d933bc67558 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:10:14.818229 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-13c1ecfa-afb0-408d-9fe0-3d933bc67558 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:10:14.833280 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c1ecfa-afb0-408d-9fe0-3d933bc67558 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:10:14.835722 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c1ecfa-afb0-408d-9fe0-3d933bc67558 service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:10:14.848480 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4567/9154] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 17:10:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 17:10:18.176800 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99eb522-b035-4c1c-b63a-e44d8a43dc7d service placement] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:10:18.191829 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99eb522-b035-4c1c-b63a-e44d8a43dc7d service placement] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:10:18.196674 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7c3ea-bc1e-4cf5-b17b-7103846dce10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:10:18.197307 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7c3ea-bc1e-4cf5-b17b-7103846dce10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:10:18.197586 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7c3ea-bc1e-4cf5-b17b-7103846dce10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:10:18.197855 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7c3ea-bc1e-4cf5-b17b-7103846dce10 admin admin] PATH_INFO: `/v3/users/e5e3906fec6e465bb21f6b0846c7b70f` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:10:18.200164 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a7c3ea-bc1e-4cf5-b17b-7103846dce10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5e3906fec6e465bb21f6b0846c7b70f)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:10:18.202252 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a7c3ea-bc1e-4cf5-b17b-7103846dce10 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:10:18.256454 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-89a7c3ea-bc1e-4cf5-b17b-7103846dce10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5e3906fec6e465bb21f6b0846c7b70f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:10:18.257119 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-89a7c3ea-bc1e-4cf5-b17b-7103846dce10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5e3906fec6e465bb21f6b0846c7b70f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:10:18.278296 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-89a7c3ea-bc1e-4cf5-b17b-7103846dce10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5e3906fec6e465bb21f6b0846c7b70f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:10:18.286570 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-89a7c3ea-bc1e-4cf5-b17b-7103846dce10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5e3906fec6e465bb21f6b0846c7b70f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:10:18.287456 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-89a7c3ea-bc1e-4cf5-b17b-7103846dce10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5e3906fec6e465bb21f6b0846c7b70f'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:10:18.317950 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4588/9155] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 17:10:18 2022] DELETE /identity/v3/users/e5e3906fec6e465bb21f6b0846c7b70f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 17:10:18.494903 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c1ecfa-afb0-408d-9fe0-3d933bc67558 service placement] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:10:18.508607 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c1ecfa-afb0-408d-9fe0-3d933bc67558 service placement] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:10:18.565309 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d750a-ec3e-476f-8c15-d829cf5e29f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:10:18.565936 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d750a-ec3e-476f-8c15-d829cf5e29f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:10:18.566213 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d750a-ec3e-476f-8c15-d829cf5e29f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:10:18.566484 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d750a-ec3e-476f-8c15-d829cf5e29f0 admin admin] PATH_INFO: `/v3/projects/6f5ff1a3351844f2a09239c37030423d` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:10:18.567859 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165d750a-ec3e-476f-8c15-d829cf5e29f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f5ff1a3351844f2a09239c37030423d)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:10:18.569756 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165d750a-ec3e-476f-8c15-d829cf5e29f0 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:10:18.614493 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-165d750a-ec3e-476f-8c15-d829cf5e29f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f5ff1a3351844f2a09239c37030423d', 'request_id': 'req-165d750a-ec3e-476f-8c15-d829cf5e29f0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:10:18.620274 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-165d750a-ec3e-476f-8c15-d829cf5e29f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f5ff1a3351844f2a09239c37030423d', 'request_id': 'req-165d750a-ec3e-476f-8c15-d829cf5e29f0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:10:18.628425 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-165d750a-ec3e-476f-8c15-d829cf5e29f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f5ff1a3351844f2a09239c37030423d', 'request_id': 'req-165d750a-ec3e-476f-8c15-d829cf5e29f0'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:10:18.629790 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:10:18.655536 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-165d750a-ec3e-476f-8c15-d829cf5e29f0 admin admin] The token cache is being invalidate because project 6f5ff1a3351844f2a09239c37030423d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 17:10:18.655826 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-165d750a-ec3e-476f-8c15-d829cf5e29f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:10:18.656464 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-165d750a-ec3e-476f-8c15-d829cf5e29f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:10:18.657976 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4568/9156] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 17:10:18 2022] DELETE /identity/v3/projects/6f5ff1a3351844f2a09239c37030423d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 17:10:18.661971 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7c3ea-bc1e-4cf5-b17b-7103846dce10 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:10:18.663396 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-89a7c3ea-bc1e-4cf5-b17b-7103846dce10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:10:18.676823 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7c3ea-bc1e-4cf5-b17b-7103846dce10 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:10:18.738406 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba05171-696d-4617-b751-8e135faaf06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:10:18.739070 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba05171-696d-4617-b751-8e135faaf06e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:10:18.739358 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba05171-696d-4617-b751-8e135faaf06e admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:10:18.739634 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba05171-696d-4617-b751-8e135faaf06e admin admin] PATH_INFO: `/v3/users/26581eccddb146c880a2596f241928d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:10:18.740791 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba05171-696d-4617-b751-8e135faaf06e admin admin] RBAC: Authorizing `identity:delete_user(user_id=26581eccddb146c880a2596f241928d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:10:18.742723 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba05171-696d-4617-b751-8e135faaf06e admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:10:18.794028 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-bba05171-696d-4617-b751-8e135faaf06e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26581eccddb146c880a2596f241928d2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:10:18.794689 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-bba05171-696d-4617-b751-8e135faaf06e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26581eccddb146c880a2596f241928d2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:10:18.796369 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:10:18.804749 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-bba05171-696d-4617-b751-8e135faaf06e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26581eccddb146c880a2596f241928d2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:10:18.815831 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-bba05171-696d-4617-b751-8e135faaf06e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26581eccddb146c880a2596f241928d2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:10:18.816572 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-bba05171-696d-4617-b751-8e135faaf06e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26581eccddb146c880a2596f241928d2'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:10:18.834792 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4589/9157] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 17:10:18 2022] DELETE /identity/v3/users/26581eccddb146c880a2596f241928d2 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 17:10:19.014747 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d750a-ec3e-476f-8c15-d829cf5e29f0 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:10:19.016194 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-165d750a-ec3e-476f-8c15-d829cf5e29f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:10:19.033379 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d750a-ec3e-476f-8c15-d829cf5e29f0 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:10:19.093616 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1953a8a-8441-455c-8321-825acc569e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:10:19.094252 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1953a8a-8441-455c-8321-825acc569e5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:10:19.094531 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1953a8a-8441-455c-8321-825acc569e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:10:19.094808 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1953a8a-8441-455c-8321-825acc569e5a admin admin] PATH_INFO: `/v3/projects/1182b48213ef4482883c44d4b91cc4a4` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:10:19.095975 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1953a8a-8441-455c-8321-825acc569e5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1182b48213ef4482883c44d4b91cc4a4)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:10:19.097900 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1953a8a-8441-455c-8321-825acc569e5a admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:10:19.144100 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a1953a8a-8441-455c-8321-825acc569e5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1182b48213ef4482883c44d4b91cc4a4', 'request_id': 'req-a1953a8a-8441-455c-8321-825acc569e5a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:10:19.149476 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a1953a8a-8441-455c-8321-825acc569e5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1182b48213ef4482883c44d4b91cc4a4', 'request_id': 'req-a1953a8a-8441-455c-8321-825acc569e5a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:10:19.157061 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a1953a8a-8441-455c-8321-825acc569e5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1182b48213ef4482883c44d4b91cc4a4', 'request_id': 'req-a1953a8a-8441-455c-8321-825acc569e5a'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:10:19.168356 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a1953a8a-8441-455c-8321-825acc569e5a admin admin] The token cache is being invalidate because project 1182b48213ef4482883c44d4b91cc4a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 17:10:19.168640 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a1953a8a-8441-455c-8321-825acc569e5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:10:19.169287 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-a1953a8a-8441-455c-8321-825acc569e5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:10:19.170805 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4569/9158] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 17:10:19 2022] DELETE /identity/v3/projects/1182b48213ef4482883c44d4b91cc4a4 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 17:10:19.176020 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719ab42-08cb-4ca5-ae3a-60f989b6c0c7 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:10:19.176302 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719ab42-08cb-4ca5-ae3a-60f989b6c0c7 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:10:19.176572 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719ab42-08cb-4ca5-ae3a-60f989b6c0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:10:19.224588 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-f719ab42-08cb-4ca5-ae3a-60f989b6c0c7 None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 17:10:19.225771 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f719ab42-08cb-4ca5-ae3a-60f989b6c0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:10:19.283563 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4590/9159] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 17:10:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 17:10:19.291928 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b76a5-2c57-431d-980a-80cabfa6691a None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:10:19.292218 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b76a5-2c57-431d-980a-80cabfa6691a None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:10:19.292861 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b76a5-2c57-431d-980a-80cabfa6691a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:10:19.313161 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-760b76a5-2c57-431d-980a-80cabfa6691a None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 17:10:19.314375 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-760b76a5-2c57-431d-980a-80cabfa6691a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:10:19.322941 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4570/9160] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 17:10:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 17:10:19.328149 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719ab42-08cb-4ca5-ae3a-60f989b6c0c7 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:10:19.338038 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719ab42-08cb-4ca5-ae3a-60f989b6c0c7 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:10:19.342783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b6639-7c29-482c-98ac-513f2628ba62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:10:19.343410 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b6639-7c29-482c-98ac-513f2628ba62 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:10:19.343722 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b6639-7c29-482c-98ac-513f2628ba62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:10:19.343998 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b6639-7c29-482c-98ac-513f2628ba62 admin admin] PATH_INFO: `/v3/domains` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:10:19.344678 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463b6639-7c29-482c-98ac-513f2628ba62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 17:10:19.344981 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463b6639-7c29-482c-98ac-513f2628ba62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:10:19.346624 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463b6639-7c29-482c-98ac-513f2628ba62 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:10:19.359144 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4591/9161] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 17:10:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 17:10:19.363626 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b76a5-2c57-431d-980a-80cabfa6691a None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:10:19.373624 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b76a5-2c57-431d-980a-80cabfa6691a None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:10:19.378373 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee985f-4a90-460b-aeae-1bafd4240f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:10:19.378972 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee985f-4a90-460b-aeae-1bafd4240f65 admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:10:19.379287 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee985f-4a90-460b-aeae-1bafd4240f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:10:19.379564 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee985f-4a90-460b-aeae-1bafd4240f65 admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:10:19.380204 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ee985f-4a90-460b-aeae-1bafd4240f65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:10:19.382122 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ee985f-4a90-460b-aeae-1bafd4240f65 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:10:19.423298 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4571/9162] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 17:10:19 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 17:10:19.424906 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b6639-7c29-482c-98ac-513f2628ba62 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:10:19.435590 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b6639-7c29-482c-98ac-513f2628ba62 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:10:19.492833 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0cca0-628e-4e5a-9857-0592bb0069fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:10:19.493429 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0cca0-628e-4e5a-9857-0592bb0069fe admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:10:19.493703 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0cca0-628e-4e5a-9857-0592bb0069fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:10:19.493970 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0cca0-628e-4e5a-9857-0592bb0069fe admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:10:19.494585 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a0cca0-628e-4e5a-9857-0592bb0069fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:10:19.497097 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a0cca0-628e-4e5a-9857-0592bb0069fe admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:10:19.518544 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4592/9163] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 17:10:19 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 17:10:19.522719 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee985f-4a90-460b-aeae-1bafd4240f65 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:10:19.534056 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee985f-4a90-460b-aeae-1bafd4240f65 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:10:19.538813 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9bc493-22df-410b-82b0-f6c419af584e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:10:19.539456 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9bc493-22df-410b-82b0-f6c419af584e admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:10:19.539738 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9bc493-22df-410b-82b0-f6c419af584e admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:10:19.540014 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9bc493-22df-410b-82b0-f6c419af584e admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:10:19.540664 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9bc493-22df-410b-82b0-f6c419af584e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:10:19.542268 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9bc493-22df-410b-82b0-f6c419af584e admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:10:19.552968 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4572/9164] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 17:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 17:10:19.556914 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0cca0-628e-4e5a-9857-0592bb0069fe admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:10:19.567866 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0cca0-628e-4e5a-9857-0592bb0069fe admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:10:19.572539 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc12c4-5694-4cd0-8254-a2a65eeb0275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:10:19.573139 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc12c4-5694-4cd0-8254-a2a65eeb0275 admin admin] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:10:19.573422 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc12c4-5694-4cd0-8254-a2a65eeb0275 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:10:19.573702 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc12c4-5694-4cd0-8254-a2a65eeb0275 admin admin] PATH_INFO: `/v3/roles` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:10:19.574344 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc12c4-5694-4cd0-8254-a2a65eeb0275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:10:19.575974 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc12c4-5694-4cd0-8254-a2a65eeb0275 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:10:19.586153 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4593/9165] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 17:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 17:10:19.590872 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9bc493-22df-410b-82b0-f6c419af584e admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:10:19.600958 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9bc493-22df-410b-82b0-f6c419af584e admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:10:19.606276 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b05a1-92d6-4492-b721-7f598ea3bda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:10:19.607156 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b05a1-92d6-4492-b721-7f598ea3bda7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:10:19.607444 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b05a1-92d6-4492-b721-7f598ea3bda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:10:19.607743 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b05a1-92d6-4492-b721-7f598ea3bda7 admin admin] PATH_INFO: `/v3/projects/8e27c4a205fa4cae93194ba885284bdd/users/f201d9769b5a469098fa5fb5043399f8/roles/e85047210af34e2d87f8162c8bd2005e` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:10:19.622950 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871b05a1-92d6-4492-b721-7f598ea3bda7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e27c4a205fa4cae93194ba885284bdd, user_id=f201d9769b5a469098fa5fb5043399f8, role_id=e85047210af34e2d87f8162c8bd2005e)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:10:19.625647 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871b05a1-92d6-4492-b721-7f598ea3bda7 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:10:19.634316 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:10:19.639773 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4573/9166] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 17:10:19 2022] PUT /identity/v3/projects/8e27c4a205fa4cae93194ba885284bdd/users/f201d9769b5a469098fa5fb5043399f8/roles/e85047210af34e2d87f8162c8bd2005e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 17:10:19.644977 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819ee95-8d1a-4c97-9347-2a8d8918f16f None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:10:19.645251 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819ee95-8d1a-4c97-9347-2a8d8918f16f None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:10:19.645523 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819ee95-8d1a-4c97-9347-2a8d8918f16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:10:19.664627 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-2819ee95-8d1a-4c97-9347-2a8d8918f16f None None] MFA Rules not processed for user `6db5f614a81044e59454d15b8c60cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 17:10:19.665742 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2819ee95-8d1a-4c97-9347-2a8d8918f16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:10:19.671368 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:10:19.731175 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4594/9167] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 17:10:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 17:10:19.740931 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b05a1-92d6-4492-b721-7f598ea3bda7 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:10:19.742642 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-871b05a1-92d6-4492-b721-7f598ea3bda7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:10:19.801661 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b05a1-92d6-4492-b721-7f598ea3bda7 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:10:19.805383 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e8ab0-2c8a-4706-818b-1797b457b0f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:10:19.805991 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e8ab0-2c8a-4706-818b-1797b457b0f8 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:10:19.806271 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e8ab0-2c8a-4706-818b-1797b457b0f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:10:19.806545 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e8ab0-2c8a-4706-818b-1797b457b0f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:10:19.816296 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e8ab0-2c8a-4706-818b-1797b457b0f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:10:19.817992 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e8ab0-2c8a-4706-818b-1797b457b0f8 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:10:19.827624 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4574/9168] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 17:10:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 17:10:23.963473 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a623809-61eb-425c-928c-74761550b622 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:10:23.964033 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a623809-61eb-425c-928c-74761550b622 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:10:23.964853 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a623809-61eb-425c-928c-74761550b622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:10:23.995894 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-2a623809-61eb-425c-928c-74761550b622 None None] MFA Rules not processed for user `f201d9769b5a469098fa5fb5043399f8`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 17:10:23.997194 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-2a623809-61eb-425c-928c-74761550b622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:10:24.083322 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4595/9169] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 17:10:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 17:10:24.087781 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e8ab0-2c8a-4706-818b-1797b457b0f8 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:10:24.098254 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e8ab0-2c8a-4706-818b-1797b457b0f8 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:10:24.103212 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a8d7b-6ed6-4c04-a963-00349017f40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:10:24.104270 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a8d7b-6ed6-4c04-a963-00349017f40f admin admin] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:10:24.104564 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a8d7b-6ed6-4c04-a963-00349017f40f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:10:24.104924 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a8d7b-6ed6-4c04-a963-00349017f40f admin admin] PATH_INFO: `/v3/projects` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:10:24.105740 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2a8d7b-6ed6-4c04-a963-00349017f40f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:10:24.107742 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2a8d7b-6ed6-4c04-a963-00349017f40f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:10:24.133758 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4575/9170] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 17:10:24 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 17:10:24.138632 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a623809-61eb-425c-928c-74761550b622 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:10:24.149368 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a623809-61eb-425c-928c-74761550b622 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:10:24.212614 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b067a7ba-0070-48e3-a45d-87b7e09a6af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:10:24.213315 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067a7ba-0070-48e3-a45d-87b7e09a6af6 admin admin] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:10:24.213679 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067a7ba-0070-48e3-a45d-87b7e09a6af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:10:24.214120 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067a7ba-0070-48e3-a45d-87b7e09a6af6 admin admin] PATH_INFO: `/v3/users` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:10:24.215661 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b067a7ba-0070-48e3-a45d-87b7e09a6af6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:10:24.217659 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b067a7ba-0070-48e3-a45d-87b7e09a6af6 admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:10:24.243368 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4596/9171] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 17:10:24 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 17:10:24.244727 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a8d7b-6ed6-4c04-a963-00349017f40f admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:10:24.256449 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a8d7b-6ed6-4c04-a963-00349017f40f admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:10:24.262005 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bfa26f-33b4-4447-a6cf-c1fcdab258de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:10:24.262838 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bfa26f-33b4-4447-a6cf-c1fcdab258de admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:10:24.263334 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bfa26f-33b4-4447-a6cf-c1fcdab258de admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:10:24.263681 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bfa26f-33b4-4447-a6cf-c1fcdab258de admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:10:24.264407 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bfa26f-33b4-4447-a6cf-c1fcdab258de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:10:24.266138 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bfa26f-33b4-4447-a6cf-c1fcdab258de admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:10:24.279607 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4576/9172] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 17:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 17:10:24.284026 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b067a7ba-0070-48e3-a45d-87b7e09a6af6 admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:10:24.295588 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b067a7ba-0070-48e3-a45d-87b7e09a6af6 admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:10:24.300688 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f9115-6244-4ec9-a315-c8a49b7ced8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:10:24.301392 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f9115-6244-4ec9-a315-c8a49b7ced8b admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:10:24.301668 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f9115-6244-4ec9-a315-c8a49b7ced8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:10:24.301956 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f9115-6244-4ec9-a315-c8a49b7ced8b admin admin] PATH_INFO: `/v3/projects/45f2ed97fc4e47978edd00d4219036d0/users/62a85abe68f742dbba6795b7f7e17767/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:10:24.318442 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f9115-6244-4ec9-a315-c8a49b7ced8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=45f2ed97fc4e47978edd00d4219036d0, user_id=62a85abe68f742dbba6795b7f7e17767, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:10:24.321178 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f9115-6244-4ec9-a315-c8a49b7ced8b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:10:24.336148 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4597/9173] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 17:10:24 2022] PUT /identity/v3/projects/45f2ed97fc4e47978edd00d4219036d0/users/62a85abe68f742dbba6795b7f7e17767/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 17:10:24.340871 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bfa26f-33b4-4447-a6cf-c1fcdab258de admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:10:24.351316 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bfa26f-33b4-4447-a6cf-c1fcdab258de admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:10:24.410175 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a914531b-3a59-449f-9c15-ca0a44f06e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:10:24.410790 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a914531b-3a59-449f-9c15-ca0a44f06e5f admin admin] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:10:24.411108 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a914531b-3a59-449f-9c15-ca0a44f06e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:10:24.411384 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a914531b-3a59-449f-9c15-ca0a44f06e5f admin admin] PATH_INFO: `/v3/roles` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:10:24.412025 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a914531b-3a59-449f-9c15-ca0a44f06e5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:10:24.413617 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a914531b-3a59-449f-9c15-ca0a44f06e5f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:10:24.424238 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4577/9174] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 17:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 17:10:24.428368 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f9115-6244-4ec9-a315-c8a49b7ced8b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:10:24.436739 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:10:24.440670 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f9115-6244-4ec9-a315-c8a49b7ced8b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:10:24.447679 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884b8e0-c704-4c4c-8b28-7d99d3fa724c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:10:24.449173 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884b8e0-c704-4c4c-8b28-7d99d3fa724c admin admin] REQUEST_METHOD: `PUT` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:10:24.449563 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884b8e0-c704-4c4c-8b28-7d99d3fa724c admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:10:24.450393 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884b8e0-c704-4c4c-8b28-7d99d3fa724c admin admin] PATH_INFO: `/v3/projects/45f2ed97fc4e47978edd00d4219036d0/users/62a85abe68f742dbba6795b7f7e17767/roles/4bb2bbb7bb544610877949fc933504d2` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:10:24.452641 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f884b8e0-c704-4c4c-8b28-7d99d3fa724c admin admin] RBAC: Authorizing `identity:create_grant(project_id=45f2ed97fc4e47978edd00d4219036d0, user_id=62a85abe68f742dbba6795b7f7e17767, role_id=4bb2bbb7bb544610877949fc933504d2)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:10:24.455684 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f884b8e0-c704-4c4c-8b28-7d99d3fa724c admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:10:24.472264 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4598/9175] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 17:10:24 2022] PUT /identity/v3/projects/45f2ed97fc4e47978edd00d4219036d0/users/62a85abe68f742dbba6795b7f7e17767/roles/4bb2bbb7bb544610877949fc933504d2 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 17:10:29.179921 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136171b6-7576-40cb-8cd3-fa06728bf4b8 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:10:29.180488 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136171b6-7576-40cb-8cd3-fa06728bf4b8 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:10:29.180488 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136171b6-7576-40cb-8cd3-fa06728bf4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:10:29.219355 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-136171b6-7576-40cb-8cd3-fa06728bf4b8 None None] MFA Rules not processed for user `62a85abe68f742dbba6795b7f7e17767`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 17:10:29.220592 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-136171b6-7576-40cb-8cd3-fa06728bf4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:10:29.275250 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:10:29.296661 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4578/9176] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 17:10:29 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 17:10:29.312550 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884b8e0-c704-4c4c-8b28-7d99d3fa724c admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:10:29.314389 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f884b8e0-c704-4c4c-8b28-7d99d3fa724c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:10:29.394128 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884b8e0-c704-4c4c-8b28-7d99d3fa724c admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:10:29.399724 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095ca0e8-1b6a-4fa9-8bec-cc2062be2d4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:10:29.400345 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ca0e8-1b6a-4fa9-8bec-cc2062be2d4b service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:10:29.400629 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ca0e8-1b6a-4fa9-8bec-cc2062be2d4b service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:10:29.400904 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ca0e8-1b6a-4fa9-8bec-cc2062be2d4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:10:29.459389 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095ca0e8-1b6a-4fa9-8bec-cc2062be2d4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:10:29.460973 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095ca0e8-1b6a-4fa9-8bec-cc2062be2d4b service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:10:29.470039 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4599/9177] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 17:10:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 17:10:30.514290 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecec22-71b6-4e68-bb70-93f6921e4db6 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:10:30.514789 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecec22-71b6-4e68-bb70-93f6921e4db6 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:10:30.514934 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecec22-71b6-4e68-bb70-93f6921e4db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:10:30.535794 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-ddecec22-71b6-4e68-bb70-93f6921e4db6 None None] MFA Rules not processed for user `f201d9769b5a469098fa5fb5043399f8`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 17:10:30.537020 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-ddecec22-71b6-4e68-bb70-93f6921e4db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:10:30.544447 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4579/9178] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 17:10:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 17:10:30.883580 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095ca0e8-1b6a-4fa9-8bec-cc2062be2d4b service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:10:30.946315 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095ca0e8-1b6a-4fa9-8bec-cc2062be2d4b service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:10:30.950877 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab3e89-6192-47f5-a27f-df78861e16ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:10:30.951539 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab3e89-6192-47f5-a27f-df78861e16ae service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:10:30.951820 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab3e89-6192-47f5-a27f-df78861e16ae service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:10:30.952095 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab3e89-6192-47f5-a27f-df78861e16ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:10:30.953834 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d8ab3e89-6192-47f5-a27f-df78861e16ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:10:30.963809 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab3e89-6192-47f5-a27f-df78861e16ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:10:30.965541 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab3e89-6192-47f5-a27f-df78861e16ae service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:10:30.974086 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4600/9179] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 17:10:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 17:10:39.076068 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddecec22-71b6-4e68-bb70-93f6921e4db6 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:10:39.093251 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddecec22-71b6-4e68-bb70-93f6921e4db6 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:10:39.098772 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6372f0-dadc-4b1d-850b-14dda53b196d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:10:39.099418 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6372f0-dadc-4b1d-850b-14dda53b196d service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:10:39.099699 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6372f0-dadc-4b1d-850b-14dda53b196d service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:10:39.099971 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6372f0-dadc-4b1d-850b-14dda53b196d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:10:39.101730 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7c6372f0-dadc-4b1d-850b-14dda53b196d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:10:39.114632 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6372f0-dadc-4b1d-850b-14dda53b196d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:10:39.116246 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6372f0-dadc-4b1d-850b-14dda53b196d service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:10:39.127166 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4580/9180] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 17:10:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 17:10:40.971113 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=85,keystone:INSERT=1 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:10:41.019075 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab3e89-6192-47f5-a27f-df78861e16ae service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:10:41.027901 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab3e89-6192-47f5-a27f-df78861e16ae service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:10:41.031539 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f413fcc-08d0-472c-b7eb-d4ad810113c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:10:41.032137 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f413fcc-08d0-472c-b7eb-d4ad810113c2 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:10:41.032414 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f413fcc-08d0-472c-b7eb-d4ad810113c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:10:41.032682 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f413fcc-08d0-472c-b7eb-d4ad810113c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:10:41.041708 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f413fcc-08d0-472c-b7eb-d4ad810113c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:10:41.043158 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f413fcc-08d0-472c-b7eb-d4ad810113c2 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:10:41.052548 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4601/9181] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 17:10:41 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 17:10:42.962360 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6372f0-dadc-4b1d-850b-14dda53b196d service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:10:42.975047 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6372f0-dadc-4b1d-850b-14dda53b196d service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:10:42.981260 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ec30d-82ef-4c2e-ada9-c62c067d7327 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:10:42.981939 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ec30d-82ef-4c2e-ada9-c62c067d7327 service nova] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:10:42.982279 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ec30d-82ef-4c2e-ada9-c62c067d7327 service nova] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:10:42.982614 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ec30d-82ef-4c2e-ada9-c62c067d7327 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:10:42.984488 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-690ec30d-82ef-4c2e-ada9-c62c067d7327 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:10:42.997562 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ec30d-82ef-4c2e-ada9-c62c067d7327 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:10:42.999262 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ec30d-82ef-4c2e-ada9-c62c067d7327 service nova] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:10:43.010239 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4581/9182] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 17:10:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 17:10:51.048479 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=6 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:10:53.005541 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=19 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:12:41.945431 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b31f88-ac09-4e5b-831e-79b76e45a129 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:12:41.946027 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b31f88-ac09-4e5b-831e-79b76e45a129 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:12:41.946200 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b31f88-ac09-4e5b-831e-79b76e45a129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:12:41.977747 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-f4b31f88-ac09-4e5b-831e-79b76e45a129 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 17:12:41.979089 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f4b31f88-ac09-4e5b-831e-79b76e45a129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:12:42.044000 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4602/9183] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 17:12:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 17:12:42.092007 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ec30d-82ef-4c2e-ada9-c62c067d7327 service nova] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:12:42.093401 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-690ec30d-82ef-4c2e-ada9-c62c067d7327 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:12:42.161286 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ec30d-82ef-4c2e-ada9-c62c067d7327 service nova] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:12:42.167182 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe1f6d-97a7-48e9-be3e-c9a288694cc0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:12:42.167798 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe1f6d-97a7-48e9-be3e-c9a288694cc0 service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:12:42.168073 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe1f6d-97a7-48e9-be3e-c9a288694cc0 service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:12:42.168339 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe1f6d-97a7-48e9-be3e-c9a288694cc0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:12:42.176743 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe1f6d-97a7-48e9-be3e-c9a288694cc0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:12:42.178997 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe1f6d-97a7-48e9-be3e-c9a288694cc0 service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:12:42.187287 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4582/9184] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 17:12:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 17:12:51.859880 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539e804-f805-4eb2-98c3-d5a284772917 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:12:51.860385 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539e804-f805-4eb2-98c3-d5a284772917 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:12:51.860501 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539e804-f805-4eb2-98c3-d5a284772917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:12:51.882394 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-f539e804-f805-4eb2-98c3-d5a284772917 None None] MFA Rules not processed for user `f201d9769b5a469098fa5fb5043399f8`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 17:12:51.883637 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-f539e804-f805-4eb2-98c3-d5a284772917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:12:51.890638 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4603/9185] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 17:12:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 17:12:52.184053 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=32 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:12:52.531457 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe1f6d-97a7-48e9-be3e-c9a288694cc0 service swift] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:12:52.533342 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1bfe1f6d-97a7-48e9-be3e-c9a288694cc0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:12:52.620557 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe1f6d-97a7-48e9-be3e-c9a288694cc0 service swift] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:12:52.625636 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c3b1e-c0a2-4b33-b261-c9b86f33e506 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:12:52.626248 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c3b1e-c0a2-4b33-b261-c9b86f33e506 service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:12:52.626531 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c3b1e-c0a2-4b33-b261-c9b86f33e506 service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:12:52.626804 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c3b1e-c0a2-4b33-b261-c9b86f33e506 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:12:52.628561 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-273c3b1e-c0a2-4b33-b261-c9b86f33e506 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:12:52.639901 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c3b1e-c0a2-4b33-b261-c9b86f33e506 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:12:52.641485 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c3b1e-c0a2-4b33-b261-c9b86f33e506 service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:12:52.652113 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4583/9186] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 17:12:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 17:12:53.961444 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c17f2-0263-40f3-95ac-d2bc8c7748d8 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:12:53.961957 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c17f2-0263-40f3-95ac-d2bc8c7748d8 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:12:53.962072 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c17f2-0263-40f3-95ac-d2bc8c7748d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:12:53.981374 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-054c17f2-0263-40f3-95ac-d2bc8c7748d8 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 17:12:53.982630 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-054c17f2-0263-40f3-95ac-d2bc8c7748d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:12:53.990495 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4604/9187] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 17:12:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 17:12:54.003367 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c3b1e-c0a2-4b33-b261-c9b86f33e506 service placement] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:12:54.015498 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c3b1e-c0a2-4b33-b261-c9b86f33e506 service placement] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:12:54.021640 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7511b-ebac-4350-b023-fac2926bd305 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:12:54.022197 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7511b-ebac-4350-b023-fac2926bd305 service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:12:54.022486 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7511b-ebac-4350-b023-fac2926bd305 service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:12:54.022761 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7511b-ebac-4350-b023-fac2926bd305 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:12:54.032047 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d7511b-ebac-4350-b023-fac2926bd305 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:12:54.033650 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d7511b-ebac-4350-b023-fac2926bd305 service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:12:54.043413 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4584/9188] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 17:12:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 17:13:03.976186 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=38 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:13:04.039392 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=43 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:13:04.236975 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c17f2-0263-40f3-95ac-d2bc8c7748d8 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:13:04.257530 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c17f2-0263-40f3-95ac-d2bc8c7748d8 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:13:04.261604 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ebf87-c2e2-4f58-94ce-fc78d125fb62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:13:04.262220 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ebf87-c2e2-4f58-94ce-fc78d125fb62 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:13:04.262500 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ebf87-c2e2-4f58-94ce-fc78d125fb62 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:13:04.262771 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ebf87-c2e2-4f58-94ce-fc78d125fb62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:13:04.264544 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7f4ebf87-c2e2-4f58-94ce-fc78d125fb62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:13:04.287088 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4ebf87-c2e2-4f58-94ce-fc78d125fb62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:13:04.289204 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4ebf87-c2e2-4f58-94ce-fc78d125fb62 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:13:04.297392 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4605/9189] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 17:13:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 17:13:14.293919 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=15 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:14:07.167820 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7511b-ebac-4350-b023-fac2926bd305 service swift] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:14:07.189168 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7511b-ebac-4350-b023-fac2926bd305 service swift] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:14:07.194527 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d923fb0-018b-474b-8de3-d367f66240f9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:14:07.195162 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d923fb0-018b-474b-8de3-d367f66240f9 service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:14:07.195443 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d923fb0-018b-474b-8de3-d367f66240f9 service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:14:07.195717 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d923fb0-018b-474b-8de3-d367f66240f9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:14:07.197409 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-4d923fb0-018b-474b-8de3-d367f66240f9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:14:07.209202 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d923fb0-018b-474b-8de3-d367f66240f9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:14:07.210784 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d923fb0-018b-474b-8de3-d367f66240f9 service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:14:07.221217 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4585/9190] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 17:14:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 17:14:11.894958 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ebf87-c2e2-4f58-94ce-fc78d125fb62 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:14:11.897387 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-7f4ebf87-c2e2-4f58-94ce-fc78d125fb62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:14:11.908368 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ebf87-c2e2-4f58-94ce-fc78d125fb62 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:14:11.912101 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0514a4c7-eb89-4140-abe3-f02c44b2a327 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:14:11.912717 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514a4c7-eb89-4140-abe3-f02c44b2a327 service neutron] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:14:11.912999 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514a4c7-eb89-4140-abe3-f02c44b2a327 service neutron] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:14:11.913273 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514a4c7-eb89-4140-abe3-f02c44b2a327 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:14:11.915017 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-0514a4c7-eb89-4140-abe3-f02c44b2a327 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:14:11.925578 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0514a4c7-eb89-4140-abe3-f02c44b2a327 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:14:11.927046 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0514a4c7-eb89-4140-abe3-f02c44b2a327 service neutron] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:14:11.936730 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4606/9191] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 17:14:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 17:14:17.217046 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=10 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:14:21.931723 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=6 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:15:15.329351 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6c013-214e-4360-a96f-37e07bca7be4 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:15:15.329922 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6c013-214e-4360-a96f-37e07bca7be4 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:15:15.329922 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6c013-214e-4360-a96f-37e07bca7be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:15:15.396046 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-2cb6c013-214e-4360-a96f-37e07bca7be4 None None] MFA Rules not processed for user `e6b0f9835ed549cab91d684326be83fa`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 17:15:15.397545 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2cb6c013-214e-4360-a96f-37e07bca7be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:15:15.460250 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4586/9192] 10.222.0.83 () {58 vars in 1064 bytes} [Mon Aug 29 17:15:15 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 17:15:15.466666 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0514a4c7-eb89-4140-abe3-f02c44b2a327 service neutron] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:15:15.475946 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0514a4c7-eb89-4140-abe3-f02c44b2a327 service neutron] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:15:15.479560 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268410c-fa8e-4eb6-b090-7f520c7ca698 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6b0f9835ed549cab91d684326be83fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:15:15.480164 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268410c-fa8e-4eb6-b090-7f520c7ca698 service glance] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:15:15.480441 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268410c-fa8e-4eb6-b090-7f520c7ca698 service glance] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:15:15.480713 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268410c-fa8e-4eb6-b090-7f520c7ca698 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:15:15.483153 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-d268410c-fa8e-4eb6-b090-7f520c7ca698 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:15:15.510139 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d268410c-fa8e-4eb6-b090-7f520c7ca698 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:15:15.511636 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d268410c-fa8e-4eb6-b090-7f520c7ca698 service glance] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:15:15.532316 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4607/9193] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 17:15:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 17:15:20.112273 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb6c013-214e-4360-a96f-37e07bca7be4 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:15:20.113707 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-2cb6c013-214e-4360-a96f-37e07bca7be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:15:20.130368 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb6c013-214e-4360-a96f-37e07bca7be4 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:15:20.135699 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe2403-94e0-4b5c-a958-23a71af76700 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:15:20.136315 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe2403-94e0-4b5c-a958-23a71af76700 service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:15:20.136597 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe2403-94e0-4b5c-a958-23a71af76700 service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:15:20.136872 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe2403-94e0-4b5c-a958-23a71af76700 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:15:20.138787 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-52fe2403-94e0-4b5c-a958-23a71af76700 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:15:20.150856 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fe2403-94e0-4b5c-a958-23a71af76700 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:15:20.152483 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fe2403-94e0-4b5c-a958-23a71af76700 service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:15:20.163768 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4587/9194] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 17:15:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 17:15:23.297063 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c18b1b-c813-4ec7-b963-453f34ba9376 None None] REQUEST_METHOD: `POST` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:15:23.297579 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c18b1b-c813-4ec7-b963-453f34ba9376 None None] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:15:23.297703 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c18b1b-c813-4ec7-b963-453f34ba9376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:15:23.347538 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.auth.core [None req-32c18b1b-c813-4ec7-b963-453f34ba9376 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 17:15:23.348731 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-32c18b1b-c813-4ec7-b963-453f34ba9376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:15:23.365572 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4608/9195] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 17:15:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 17:15:23.406193 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe2403-94e0-4b5c-a958-23a71af76700 service placement] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:15:23.427131 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe2403-94e0-4b5c-a958-23a71af76700 service placement] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:15:23.432475 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d26c03-134a-4594-8eb3-92a5b599ea33 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:15:23.433076 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d26c03-134a-4594-8eb3-92a5b599ea33 service swift] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:15:23.433358 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d26c03-134a-4594-8eb3-92a5b599ea33 service swift] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:15:23.433633 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d26c03-134a-4594-8eb3-92a5b599ea33 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:15:23.442613 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d26c03-134a-4594-8eb3-92a5b599ea33 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:15:23.444477 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d26c03-134a-4594-8eb3-92a5b599ea33 service swift] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:15:23.452540 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4588/9196] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 17:15:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 17:15:29.036334 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c18b1b-c813-4ec7-b963-453f34ba9376 None None] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:15:29.047374 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c18b1b-c813-4ec7-b963-453f34ba9376 None None] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:15:29.051674 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e88789-a01c-4c1f-8d90-c20582ea2984 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6b0f9835ed549cab91d684326be83fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:15:29.052339 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e88789-a01c-4c1f-8d90-c20582ea2984 service glance] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:15:29.052624 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e88789-a01c-4c1f-8d90-c20582ea2984 service glance] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:15:29.052883 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e88789-a01c-4c1f-8d90-c20582ea2984 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:15:29.063172 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e88789-a01c-4c1f-8d90-c20582ea2984 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:15:29.064715 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e88789-a01c-4c1f-8d90-c20582ea2984 service glance] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:15:29.077499 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4609/9197] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 17:15:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 17:15:32.228090 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a4103-e5ff-4295-89c0-592d35572d21 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:15:32.228598 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a4103-e5ff-4295-89c0-592d35572d21 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:15:32.228716 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a4103-e5ff-4295-89c0-592d35572d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:15:32.249448 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-dc1a4103-e5ff-4295-89c0-592d35572d21 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 17:15:32.250766 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-dc1a4103-e5ff-4295-89c0-592d35572d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:15:32.258714 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4589/9198] 10.222.0.83 () {58 vars in 967 bytes} [Mon Aug 29 17:15:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 17:15:32.271492 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e88789-a01c-4c1f-8d90-c20582ea2984 service glance] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:15:32.283292 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e88789-a01c-4c1f-8d90-c20582ea2984 service glance] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:15:32.288219 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b60fe1-5372-422f-9f14-8598a5d9eb9d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:15:32.288817 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b60fe1-5372-422f-9f14-8598a5d9eb9d service swift] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:15:32.289097 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b60fe1-5372-422f-9f14-8598a5d9eb9d service swift] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:15:32.289370 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b60fe1-5372-422f-9f14-8598a5d9eb9d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:15:32.297734 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b60fe1-5372-422f-9f14-8598a5d9eb9d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:15:32.299512 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b60fe1-5372-422f-9f14-8598a5d9eb9d service swift] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:15:32.307689 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4610/9199] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 17:15:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 17:15:33.681474 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a4103-e5ff-4295-89c0-592d35572d21 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:15:33.691505 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a4103-e5ff-4295-89c0-592d35572d21 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:15:33.696018 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a4ccf-47e0-4d95-9d8c-5cc20fff0240 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:15:33.696741 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a4ccf-47e0-4d95-9d8c-5cc20fff0240 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:15:33.697100 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a4ccf-47e0-4d95-9d8c-5cc20fff0240 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:15:33.697398 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a4ccf-47e0-4d95-9d8c-5cc20fff0240 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:15:33.699296 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-841a4ccf-47e0-4d95-9d8c-5cc20fff0240 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:15:33.714242 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a4ccf-47e0-4d95-9d8c-5cc20fff0240 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:15:33.716005 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a4ccf-47e0-4d95-9d8c-5cc20fff0240 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:15:33.728868 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4590/9200] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 17:15:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 17:15:35.912907 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b60fe1-5372-422f-9f14-8598a5d9eb9d service swift] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:15:35.925525 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b60fe1-5372-422f-9f14-8598a5d9eb9d service swift] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:15:35.931175 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad119fb-2cfb-4e0a-bb2e-a424ed9f0102 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '253947a5ef294d2bb828761873251bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:15:35.931788 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad119fb-2cfb-4e0a-bb2e-a424ed9f0102 service nova] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:15:35.932068 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad119fb-2cfb-4e0a-bb2e-a424ed9f0102 service nova] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:15:35.932341 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad119fb-2cfb-4e0a-bb2e-a424ed9f0102 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:15:35.934091 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-aad119fb-2cfb-4e0a-bb2e-a424ed9f0102 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:15:35.946995 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad119fb-2cfb-4e0a-bb2e-a424ed9f0102 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:15:35.948620 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad119fb-2cfb-4e0a-bb2e-a424ed9f0102 service nova] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:15:35.959312 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4611/9201] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 17:15:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 17:15:37.300380 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a88adc-3df8-400b-9826-59167b649ae9 None None] REQUEST_METHOD: `POST` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:15:37.300839 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a88adc-3df8-400b-9826-59167b649ae9 None None] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:15:37.300946 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a88adc-3df8-400b-9826-59167b649ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:15:37.308210 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=68 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:15:37.322557 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.auth.core [None req-f0a88adc-3df8-400b-9826-59167b649ae9 None None] MFA Rules not processed for user `712a09e9d2a248309b91424dd05d2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 17:15:37.323804 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-f0a88adc-3df8-400b-9826-59167b649ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:15:37.331107 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4591/9202] 10.222.0.83 () {58 vars in 967 bytes} [Mon Aug 29 17:15:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 17:15:37.343905 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad119fb-2cfb-4e0a-bb2e-a424ed9f0102 service nova] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:15:37.354998 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad119fb-2cfb-4e0a-bb2e-a424ed9f0102 service nova] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:15:37.360551 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a7f1b-9abd-41b6-aae9-14a6dcf112df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f8e95d393f499baf44830f9fb7e583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:15:37.361175 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a7f1b-9abd-41b6-aae9-14a6dcf112df service swift] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:15:37.361476 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a7f1b-9abd-41b6-aae9-14a6dcf112df service swift] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:15:37.361751 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a7f1b-9abd-41b6-aae9-14a6dcf112df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:15:37.369824 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a7f1b-9abd-41b6-aae9-14a6dcf112df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:15:37.371463 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a7f1b-9abd-41b6-aae9-14a6dcf112df service swift] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:15:37.379920 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4612/9203] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 17:15:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 17:15:41.482642 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a88adc-3df8-400b-9826-59167b649ae9 None None] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:15:41.492062 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a88adc-3df8-400b-9826-59167b649ae9 None None] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:15:41.496189 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc05051-ea7d-4284-b2c7-0d2116d59894 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a84bb38f6454574897120223b8fc140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:15:41.496784 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc05051-ea7d-4284-b2c7-0d2116d59894 service neutron] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:15:41.497079 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc05051-ea7d-4284-b2c7-0d2116d59894 service neutron] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:15:41.497877 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc05051-ea7d-4284-b2c7-0d2116d59894 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:15:41.575174 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc05051-ea7d-4284-b2c7-0d2116d59894 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:15:41.576812 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc05051-ea7d-4284-b2c7-0d2116d59894 service neutron] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:15:41.586860 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4592/9204] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 17:15:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 17:15:44.800877 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a7f1b-9abd-41b6-aae9-14a6dcf112df service swift] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:15:44.809980 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=58 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:15:44.818327 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a7f1b-9abd-41b6-aae9-14a6dcf112df service swift] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:15:44.824297 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab80f1-a45b-4d06-b505-3908a40ece2f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:15:44.825002 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab80f1-a45b-4d06-b505-3908a40ece2f service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:15:44.825355 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab80f1-a45b-4d06-b505-3908a40ece2f service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:15:44.825628 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab80f1-a45b-4d06-b505-3908a40ece2f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:15:44.827657 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-14ab80f1-a45b-4d06-b505-3908a40ece2f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:15:44.842139 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ab80f1-a45b-4d06-b505-3908a40ece2f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:15:44.843954 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ab80f1-a45b-4d06-b505-3908a40ece2f service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:15:44.855540 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4613/9205] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 17:15:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 17:15:48.112359 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc05051-ea7d-4284-b2c7-0d2116d59894 service neutron] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:15:48.124734 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc05051-ea7d-4284-b2c7-0d2116d59894 service neutron] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:15:48.130282 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285f48c-37d0-4c5b-b3eb-07bec3dbb725 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:15:48.130896 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285f48c-37d0-4c5b-b3eb-07bec3dbb725 service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:15:48.131223 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285f48c-37d0-4c5b-b3eb-07bec3dbb725 service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:15:48.131497 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285f48c-37d0-4c5b-b3eb-07bec3dbb725 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:15:48.133241 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-1285f48c-37d0-4c5b-b3eb-07bec3dbb725 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:15:48.146155 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1285f48c-37d0-4c5b-b3eb-07bec3dbb725 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:15:48.147805 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1285f48c-37d0-4c5b-b3eb-07bec3dbb725 service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:15:48.165059 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4593/9206] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 17:15:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 17:15:48.174278 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab80f1-a45b-4d06-b505-3908a40ece2f service placement] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:15:48.187794 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab80f1-a45b-4d06-b505-3908a40ece2f service placement] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:15:48.194503 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6202153-940c-481e-82d3-baf8392de31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:15:48.195328 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6202153-940c-481e-82d3-baf8392de31f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:15:48.195674 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6202153-940c-481e-82d3-baf8392de31f admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:15:48.196027 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6202153-940c-481e-82d3-baf8392de31f admin admin] PATH_INFO: `/v3/users/f201d9769b5a469098fa5fb5043399f8` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:15:48.197391 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6202153-940c-481e-82d3-baf8392de31f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f201d9769b5a469098fa5fb5043399f8)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:15:48.199457 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6202153-940c-481e-82d3-baf8392de31f admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:15:48.250789 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a6202153-940c-481e-82d3-baf8392de31f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f201d9769b5a469098fa5fb5043399f8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:15:48.251474 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a6202153-940c-481e-82d3-baf8392de31f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f201d9769b5a469098fa5fb5043399f8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:15:48.262631 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a6202153-940c-481e-82d3-baf8392de31f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f201d9769b5a469098fa5fb5043399f8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:15:48.269801 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a6202153-940c-481e-82d3-baf8392de31f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f201d9769b5a469098fa5fb5043399f8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:15:48.270447 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-a6202153-940c-481e-82d3-baf8392de31f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f201d9769b5a469098fa5fb5043399f8'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:15:48.288424 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4614/9207] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 17:15:48 2022] DELETE /identity/v3/users/f201d9769b5a469098fa5fb5043399f8 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 17:15:48.473079 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285f48c-37d0-4c5b-b3eb-07bec3dbb725 service placement] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:15:48.484178 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285f48c-37d0-4c5b-b3eb-07bec3dbb725 service placement] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:15:48.547403 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75b204-5f9a-43e1-8157-2f14269aa5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:15:48.548003 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75b204-5f9a-43e1-8157-2f14269aa5d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:15:48.548285 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75b204-5f9a-43e1-8157-2f14269aa5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:15:48.548558 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75b204-5f9a-43e1-8157-2f14269aa5d3 admin admin] PATH_INFO: `/v3/projects/8e27c4a205fa4cae93194ba885284bdd` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:15:48.549825 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75b204-5f9a-43e1-8157-2f14269aa5d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e27c4a205fa4cae93194ba885284bdd)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:15:48.551792 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75b204-5f9a-43e1-8157-2f14269aa5d3 admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:15:48.600140 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7c75b204-5f9a-43e1-8157-2f14269aa5d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e27c4a205fa4cae93194ba885284bdd', 'request_id': 'req-7c75b204-5f9a-43e1-8157-2f14269aa5d3'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:15:48.605916 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7c75b204-5f9a-43e1-8157-2f14269aa5d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e27c4a205fa4cae93194ba885284bdd', 'request_id': 'req-7c75b204-5f9a-43e1-8157-2f14269aa5d3'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:15:48.614673 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7c75b204-5f9a-43e1-8157-2f14269aa5d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e27c4a205fa4cae93194ba885284bdd', 'request_id': 'req-7c75b204-5f9a-43e1-8157-2f14269aa5d3'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:15:48.625824 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7c75b204-5f9a-43e1-8157-2f14269aa5d3 admin admin] The token cache is being invalidate because project 8e27c4a205fa4cae93194ba885284bdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 17:15:48.626120 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7c75b204-5f9a-43e1-8157-2f14269aa5d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:15:48.626761 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-7c75b204-5f9a-43e1-8157-2f14269aa5d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:15:48.628282 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4594/9208] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 17:15:48 2022] DELETE /identity/v3/projects/8e27c4a205fa4cae93194ba885284bdd => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 17:15:48.632263 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6202153-940c-481e-82d3-baf8392de31f admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:15:48.633653 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-a6202153-940c-481e-82d3-baf8392de31f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:15:48.646822 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6202153-940c-481e-82d3-baf8392de31f admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:15:48.705496 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9674101-2164-4e8a-9b1c-01172d20c47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:15:48.706030 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9674101-2164-4e8a-9b1c-01172d20c47b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:15:48.706342 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9674101-2164-4e8a-9b1c-01172d20c47b admin admin] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:15:48.706621 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9674101-2164-4e8a-9b1c-01172d20c47b admin admin] PATH_INFO: `/v3/users/62a85abe68f742dbba6795b7f7e17767` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:15:48.707828 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9674101-2164-4e8a-9b1c-01172d20c47b admin admin] RBAC: Authorizing `identity:delete_user(user_id=62a85abe68f742dbba6795b7f7e17767)` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:15:48.709783 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9674101-2164-4e8a-9b1c-01172d20c47b admin admin] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:15:48.761934 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c9674101-2164-4e8a-9b1c-01172d20c47b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62a85abe68f742dbba6795b7f7e17767'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:15:48.762736 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c9674101-2164-4e8a-9b1c-01172d20c47b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62a85abe68f742dbba6795b7f7e17767'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:15:48.771240 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c9674101-2164-4e8a-9b1c-01172d20c47b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62a85abe68f742dbba6795b7f7e17767'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:15:48.779870 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c9674101-2164-4e8a-9b1c-01172d20c47b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62a85abe68f742dbba6795b7f7e17767'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:15:48.780543 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.notifications [None req-c9674101-2164-4e8a-9b1c-01172d20c47b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62a85abe68f742dbba6795b7f7e17767'} {{(pid=82149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:15:48.781663 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:15:48.801022 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4615/9209] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 17:15:48 2022] DELETE /identity/v3/users/62a85abe68f742dbba6795b7f7e17767 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 17:15:48.977408 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75b204-5f9a-43e1-8157-2f14269aa5d3 admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:15:48.978845 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-7c75b204-5f9a-43e1-8157-2f14269aa5d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:15:48.996198 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75b204-5f9a-43e1-8157-2f14269aa5d3 admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:15:49.000519 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:15:49.061606 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc7983-ffda-4882-98ae-f928500bf76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db5f614a81044e59454d15b8c60cf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be1d9508c364610be9aca20e58e1d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:15:49.061837 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc7983-ffda-4882-98ae-f928500bf76f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:15:49.062106 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc7983-ffda-4882-98ae-f928500bf76f admin admin] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:15:49.062376 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc7983-ffda-4882-98ae-f928500bf76f admin admin] PATH_INFO: `/v3/projects/45f2ed97fc4e47978edd00d4219036d0` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:15:49.063575 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc7983-ffda-4882-98ae-f928500bf76f admin admin] RBAC: Authorizing `identity:delete_project(project_id=45f2ed97fc4e47978edd00d4219036d0)` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:15:49.065627 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc7983-ffda-4882-98ae-f928500bf76f admin admin] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:15:49.114338 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9ffc7983-ffda-4882-98ae-f928500bf76f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45f2ed97fc4e47978edd00d4219036d0', 'request_id': 'req-9ffc7983-ffda-4882-98ae-f928500bf76f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:15:49.119822 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9ffc7983-ffda-4882-98ae-f928500bf76f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45f2ed97fc4e47978edd00d4219036d0', 'request_id': 'req-9ffc7983-ffda-4882-98ae-f928500bf76f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:15:49.127785 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9ffc7983-ffda-4882-98ae-f928500bf76f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45f2ed97fc4e47978edd00d4219036d0', 'request_id': 'req-9ffc7983-ffda-4882-98ae-f928500bf76f'} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:15:49.139765 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9ffc7983-ffda-4882-98ae-f928500bf76f admin admin] The token cache is being invalidate because project 45f2ed97fc4e47978edd00d4219036d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 17:15:49.140058 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9ffc7983-ffda-4882-98ae-f928500bf76f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:15:49.140857 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.notifications [None req-9ffc7983-ffda-4882-98ae-f928500bf76f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 17:15:49.142412 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4595/9210] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 17:15:48 2022] DELETE /identity/v3/projects/45f2ed97fc4e47978edd00d4219036d0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 17:15:58.797367 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=7,keystone:DELETE=2 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:15:59.136210 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=48,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:19:13.138777 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9674101-2164-4e8a-9b1c-01172d20c47b admin admin] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:19:13.140236 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-c9674101-2164-4e8a-9b1c-01172d20c47b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:19:13.265123 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9674101-2164-4e8a-9b1c-01172d20c47b admin admin] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:19:13.325920 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb113b77-44d3-41b8-9e76-085e90ac8b60 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:19:13.326521 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb113b77-44d3-41b8-9e76-085e90ac8b60 service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:19:13.326796 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb113b77-44d3-41b8-9e76-085e90ac8b60 service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:19:13.327092 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb113b77-44d3-41b8-9e76-085e90ac8b60 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:19:13.328830 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.fernet_utils [None req-eb113b77-44d3-41b8-9e76-085e90ac8b60 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:19:13.339687 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb113b77-44d3-41b8-9e76-085e90ac8b60 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:19:13.341545 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb113b77-44d3-41b8-9e76-085e90ac8b60 service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:19:13.351884 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4616/9211] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 17:19:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 17:19:23.347210 n-d-836830-13 devstack@keystone.service[82149]: DEBUG dbcounter [-] [82149] Writing DB stats keystone:SELECT=80 {{(pid=82149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:20:28.056108 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc7983-ffda-4882-98ae-f928500bf76f admin admin] Authenticating user token {{(pid=82148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:20:28.058595 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-9ffc7983-ffda-4882-98ae-f928500bf76f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:20:28.099872 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc7983-ffda-4882-98ae-f928500bf76f admin admin] Validating token access rules against request {{(pid=82148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:20:28.105169 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a547b-166e-4e5c-bfdf-5319d7c96262 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:20:28.105899 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a547b-166e-4e5c-bfdf-5319d7c96262 service placement] REQUEST_METHOD: `GET` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:20:28.106262 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a547b-166e-4e5c-bfdf-5319d7c96262 service placement] SCRIPT_NAME: `/identity` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:20:28.106561 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a547b-166e-4e5c-bfdf-5319d7c96262 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:20:28.108393 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.fernet_utils [None req-435a547b-166e-4e5c-bfdf-5319d7c96262 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 17:20:28.120588 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435a547b-166e-4e5c-bfdf-5319d7c96262 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:20:28.122177 n-d-836830-13 devstack@keystone.service[82148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435a547b-166e-4e5c-bfdf-5319d7c96262 service placement] RBAC: Authorization granted {{(pid=82148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:20:28.132410 n-d-836830-13 devstack@keystone.service[82148]: [pid: 82148|app: 0|req: 4596/9212] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 17:20:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 17:20:38.128258 n-d-836830-13 devstack@keystone.service[82148]: DEBUG dbcounter [-] [82148] Writing DB stats keystone:SELECT=17 {{(pid=82148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:24:19.144442 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb113b77-44d3-41b8-9e76-085e90ac8b60 service placement] Authenticating user token {{(pid=82149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 17:24:19.168031 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb113b77-44d3-41b8-9e76-085e90ac8b60 service placement] Validating token access rules against request {{(pid=82149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 17:24:19.173183 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd576d-1064-4e39-930c-22198b459f73 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190fa4a280c41c684130e069bee99eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44655977b0814a728f0fa73d442a7ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 17:24:19.173715 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd576d-1064-4e39-930c-22198b459f73 service placement] REQUEST_METHOD: `GET` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 17:24:19.173992 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd576d-1064-4e39-930c-22198b459f73 service placement] SCRIPT_NAME: `/identity` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 17:24:19.174279 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd576d-1064-4e39-930c-22198b459f73 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 17:24:19.183198 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd576d-1064-4e39-930c-22198b459f73 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 17:24:19.184832 n-d-836830-13 devstack@keystone.service[82149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd576d-1064-4e39-930c-22198b459f73 service placement] RBAC: Authorization granted {{(pid=82149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 17:24:19.195808 n-d-836830-13 devstack@keystone.service[82149]: [pid: 82149|app: 0|req: 4617/9213] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 17:24:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)